2024-09-18T01:34:43.052 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-18T01:34:43.069 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-18T01:34:43.152 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-17_21:40:02-rgw-squid-distro-default-smithi/7909748 branch: squid description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{centos_latest}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7909748' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-17_21:40:02-rgw-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client: debug rgw: 20 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f rgw: ec-data-pool: true frontend: beast s3tests: slow_backend: true selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: b0d356b98e08f6bc59ef15652f0d0e4298fc83c7 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - osd.0 - - mgr.x - client.0 - osd.1 - osd.2 - osd.3 seed: 9034 sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f sleep_before_teardown: 0 subset: 0/1 suite: rgw suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_b0d356b98e08f6bc59ef15652f0d0e4298fc83c7/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: b0d356b98e08f6bc59ef15652f0d0e4298fc83c7 targets: smithi129.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK9gBw0jhyeZQwqd/Ilh5hmMK8aRqyP0EOBiqr2ZlXMUF2wZwiWXrnNT50uxQSPLxXUT7rdw2rrr8tnJBGfFkaI= smithi146.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPyrv+8yATla5drKWQ7rs+93i/LNZ94m5gasYJdBU3tzWrgO2IdUdRGHZoy/wqz7917Ach70vcKc7o90Erep2dQ= tasks: - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: null - radosgw-admin: null - radosgw-admin-rest: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-17_21:40:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-18T01:34:43.152 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_b0d356b98e08f6bc59ef15652f0d0e4298fc83c7/qa; will attempt to use it 2024-09-18T01:34:43.153 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_b0d356b98e08f6bc59ef15652f0d0e4298fc83c7/qa/tasks 2024-09-18T01:34:43.153 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-18T01:34:43.155 INFO:teuthology.task.internal:Checking packages... 2024-09-18T01:34:43.176 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'c2ddf9721ef254645201cdbabd9c8f49c30a586f' 2024-09-18T01:34:43.176 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-18T01:34:43.176 INFO:teuthology.packaging:ref: None 2024-09-18T01:34:43.176 INFO:teuthology.packaging:tag: None 2024-09-18T01:34:43.177 INFO:teuthology.packaging:branch: squid 2024-09-18T01:34:43.177 INFO:teuthology.packaging:sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-18T01:34:43.177 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-18T01:34:43.410 INFO:teuthology.task.internal:Found packages for ceph version 19.2.0-0 2024-09-18T01:34:43.411 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-18T01:34:43.418 INFO:teuthology.task.internal:no buildpackages task found 2024-09-18T01:34:43.418 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-18T01:34:43.425 INFO:teuthology.task.internal:Saving configuration 2024-09-18T01:34:43.436 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-18T01:34:43.443 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-18T01:34:43.463 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi129.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-17_21:40:02-rgw-squid-distro-default-smithi/7909748', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-18 01:29:41.429592', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK9gBw0jhyeZQwqd/Ilh5hmMK8aRqyP0EOBiqr2ZlXMUF2wZwiWXrnNT50uxQSPLxXUT7rdw2rrr8tnJBGfFkaI='} 2024-09-18T01:34:43.481 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi146.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-17_21:40:02-rgw-squid-distro-default-smithi/7909748', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-18 01:29:41.428148', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPyrv+8yATla5drKWQ7rs+93i/LNZ94m5gasYJdBU3tzWrgO2IdUdRGHZoy/wqz7917Ach70vcKc7o90Erep2dQ='} 2024-09-18T01:34:43.481 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-18T01:34:43.487 INFO:teuthology.task.internal:roles: ubuntu@smithi129.front.sepia.ceph.com - ['mon.a', 'osd.0'] 2024-09-18T01:34:43.487 INFO:teuthology.task.internal:roles: ubuntu@smithi146.front.sepia.ceph.com - ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3'] 2024-09-18T01:34:43.487 INFO:teuthology.run_tasks:Running task console_log... 2024-09-18T01:34:43.537 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8419307ac0>, signals=[15]) 2024-09-18T01:34:43.537 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-18T01:34:43.543 INFO:teuthology.task.internal:Opening connections... 2024-09-18T01:34:43.544 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi129.front.sepia.ceph.com 2024-09-18T01:34:43.545 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T01:34:43.624 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi146.front.sepia.ceph.com 2024-09-18T01:34:43.625 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T01:34:43.705 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-18T01:34:43.712 DEBUG:teuthology.orchestra.run.smithi129:> uname -m 2024-09-18T01:34:43.730 INFO:teuthology.orchestra.run.smithi129.stdout:x86_64 2024-09-18T01:34:43.730 DEBUG:teuthology.orchestra.run.smithi129:> cat /etc/os-release 2024-09-18T01:34:43.789 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="CentOS Stream" 2024-09-18T01:34:43.789 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="9" 2024-09-18T01:34:43.789 INFO:teuthology.orchestra.run.smithi129.stdout:ID="centos" 2024-09-18T01:34:43.789 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE="rhel fedora" 2024-09-18T01:34:43.789 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="9" 2024-09-18T01:34:43.789 INFO:teuthology.orchestra.run.smithi129.stdout:PLATFORM_ID="platform:el9" 2024-09-18T01:34:43.789 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-18T01:34:43.789 INFO:teuthology.orchestra.run.smithi129.stdout:ANSI_COLOR="0;31" 2024-09-18T01:34:43.789 INFO:teuthology.orchestra.run.smithi129.stdout:LOGO="fedora-logo-icon" 2024-09-18T01:34:43.789 INFO:teuthology.orchestra.run.smithi129.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-18T01:34:43.790 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://centos.org/" 2024-09-18T01:34:43.790 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-18T01:34:43.790 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-18T01:34:43.790 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-18T01:34:43.790 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server 2024-09-18T01:34:43.812 DEBUG:teuthology.orchestra.run.smithi146:> uname -m 2024-09-18T01:34:43.829 INFO:teuthology.orchestra.run.smithi146.stdout:x86_64 2024-09-18T01:34:43.830 DEBUG:teuthology.orchestra.run.smithi146:> cat /etc/os-release 2024-09-18T01:34:43.889 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="CentOS Stream" 2024-09-18T01:34:43.890 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="9" 2024-09-18T01:34:43.890 INFO:teuthology.orchestra.run.smithi146.stdout:ID="centos" 2024-09-18T01:34:43.890 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE="rhel fedora" 2024-09-18T01:34:43.890 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="9" 2024-09-18T01:34:43.890 INFO:teuthology.orchestra.run.smithi146.stdout:PLATFORM_ID="platform:el9" 2024-09-18T01:34:43.890 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-18T01:34:43.890 INFO:teuthology.orchestra.run.smithi146.stdout:ANSI_COLOR="0;31" 2024-09-18T01:34:43.890 INFO:teuthology.orchestra.run.smithi146.stdout:LOGO="fedora-logo-icon" 2024-09-18T01:34:43.890 INFO:teuthology.orchestra.run.smithi146.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-18T01:34:43.890 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://centos.org/" 2024-09-18T01:34:43.890 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-18T01:34:43.891 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-18T01:34:43.891 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-18T01:34:43.891 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2024-09-18T01:34:43.912 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-18T01:34:43.921 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-18T01:34:43.939 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-18T01:34:43.940 DEBUG:teuthology.orchestra.run.smithi129:> test '!' -e /home/ubuntu/cephtest 2024-09-18T01:34:43.942 DEBUG:teuthology.orchestra.run.smithi146:> test '!' -e /home/ubuntu/cephtest 2024-09-18T01:34:43.957 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-18T01:34:43.963 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-18T01:34:43.963 DEBUG:teuthology.orchestra.run.smithi129:> test -z $(ls -A /var/lib/ceph) 2024-09-18T01:34:44.000 DEBUG:teuthology.orchestra.run.smithi146:> test -z $(ls -A /var/lib/ceph) 2024-09-18T01:34:44.029 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-18T01:34:44.072 INFO:teuthology.run_tasks:Running task kernel... 2024-09-18T01:34:44.087 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-18T01:34:44.087 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-18T01:34:44.087 DEBUG:teuthology.orchestra.run.smithi129:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-18T01:34:44.088 DEBUG:teuthology.orchestra.run.smithi146:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-18T01:34:44.104 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T01:34:44.105 DEBUG:teuthology.orchestra.run.smithi146:> uname -r 2024-09-18T01:34:44.106 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T01:34:44.106 DEBUG:teuthology.orchestra.run.smithi129:> uname -r 2024-09-18T01:34:44.162 INFO:teuthology.orchestra.run.smithi146.stdout:5.14.0-503.el9.x86_64 2024-09-18T01:34:44.163 INFO:teuthology.task.kernel:Running kernel on smithi146: 5.14.0-503.el9.x86_64 2024-09-18T01:34:44.163 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum install -y kernel 2024-09-18T01:34:44.165 INFO:teuthology.orchestra.run.smithi129.stdout:5.14.0-503.el9.x86_64 2024-09-18T01:34:44.165 INFO:teuthology.task.kernel:Running kernel on smithi129: 5.14.0-503.el9.x86_64 2024-09-18T01:34:44.165 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum install -y kernel 2024-09-18T01:34:46.381 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.3 MB 00:00 2024-09-18T01:34:46.648 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.3 MB 00:00 2024-09-18T01:34:48.766 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 9 - AppStream 19 MB/s | 20 MB 00:01 2024-09-18T01:34:50.824 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - AppStream 6.0 MB/s | 20 MB 00:03 2024-09-18T01:34:55.067 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 9 - CRB 2.6 MB/s | 6.5 MB 00:02 2024-09-18T01:34:56.574 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - CRB 3.4 MB/s | 6.5 MB 00:01 2024-09-18T01:34:56.609 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 9 - Extras packages 87 kB/s | 19 kB 00:00 2024-09-18T01:34:58.033 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - Extras packages 78 kB/s | 19 kB 00:00 2024-09-18T01:34:58.822 INFO:teuthology.orchestra.run.smithi129.stdout:Extra Packages for Enterprise Linux 11 MB/s | 23 MB 00:02 2024-09-18T01:34:59.537 INFO:teuthology.orchestra.run.smithi146.stdout:Extra Packages for Enterprise Linux 16 MB/s | 23 MB 00:01 2024-09-18T01:35:04.252 INFO:teuthology.orchestra.run.smithi129.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-18T01:35:05.018 INFO:teuthology.orchestra.run.smithi146.stdout:lab-extras 39 kB/s | 1.7 kB 00:00 2024-09-18T01:35:06.142 INFO:teuthology.orchestra.run.smithi129.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-18T01:35:06.142 INFO:teuthology.orchestra.run.smithi129.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-18T01:35:06.244 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-09-18T01:35:06.253 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-18T01:35:06.253 INFO:teuthology.orchestra.run.smithi129.stdout: Package Architecture Version Repository Size 2024-09-18T01:35:06.253 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-18T01:35:06.253 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-09-18T01:35:06.253 INFO:teuthology.orchestra.run.smithi129.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-18T01:35:06.253 INFO:teuthology.orchestra.run.smithi129.stdout:Installing dependencies: 2024-09-18T01:35:06.253 INFO:teuthology.orchestra.run.smithi129.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-18T01:35:06.254 INFO:teuthology.orchestra.run.smithi129.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-18T01:35:06.254 INFO:teuthology.orchestra.run.smithi129.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-18T01:35:06.254 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:35:06.254 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-09-18T01:35:06.254 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-18T01:35:06.254 INFO:teuthology.orchestra.run.smithi129.stdout:Install 4 Packages 2024-09-18T01:35:06.254 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:35:06.255 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 79 M 2024-09-18T01:35:06.255 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 126 M 2024-09-18T01:35:06.255 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-09-18T01:35:06.404 INFO:teuthology.orchestra.run.smithi129.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 348 kB/s | 36 kB 00:00 2024-09-18T01:35:06.796 INFO:teuthology.orchestra.run.smithi129.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2024-09-18T01:35:06.882 INFO:teuthology.orchestra.run.smithi146.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-18T01:35:06.883 INFO:teuthology.orchestra.run.smithi146.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-18T01:35:06.988 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies resolved. 2024-09-18T01:35:06.997 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-18T01:35:06.998 INFO:teuthology.orchestra.run.smithi146.stdout: Package Architecture Version Repository Size 2024-09-18T01:35:06.998 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-18T01:35:06.998 INFO:teuthology.orchestra.run.smithi146.stdout:Installing: 2024-09-18T01:35:06.998 INFO:teuthology.orchestra.run.smithi146.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-18T01:35:06.998 INFO:teuthology.orchestra.run.smithi146.stdout:Installing dependencies: 2024-09-18T01:35:06.998 INFO:teuthology.orchestra.run.smithi146.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-18T01:35:06.998 INFO:teuthology.orchestra.run.smithi146.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-18T01:35:06.998 INFO:teuthology.orchestra.run.smithi146.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-18T01:35:06.998 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:35:06.998 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction Summary 2024-09-18T01:35:06.998 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-18T01:35:06.999 INFO:teuthology.orchestra.run.smithi146.stdout:Install 4 Packages 2024-09-18T01:35:06.999 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:35:06.999 INFO:teuthology.orchestra.run.smithi146.stdout:Total download size: 79 M 2024-09-18T01:35:06.999 INFO:teuthology.orchestra.run.smithi146.stdout:Installed size: 126 M 2024-09-18T01:35:06.999 INFO:teuthology.orchestra.run.smithi146.stdout:Downloading Packages: 2024-09-18T01:35:07.161 INFO:teuthology.orchestra.run.smithi146.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 308 kB/s | 36 kB 00:00 2024-09-18T01:35:07.229 INFO:teuthology.orchestra.run.smithi129.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 37 MB/s | 35 MB 00:00 2024-09-18T01:35:07.488 INFO:teuthology.orchestra.run.smithi129.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 26 MB/s | 29 MB 00:01 2024-09-18T01:35:07.488 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:35:07.488 INFO:teuthology.orchestra.run.smithi129.stdout:Total 64 MB/s | 79 MB 00:01 2024-09-18T01:35:07.761 INFO:teuthology.orchestra.run.smithi146.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 22 MB/s | 16 MB 00:00 2024-09-18T01:35:08.167 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-09-18T01:35:08.278 INFO:teuthology.orchestra.run.smithi146.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 28 MB/s | 35 MB 00:01 2024-09-18T01:35:08.509 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-09-18T01:35:08.510 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-09-18T01:35:08.678 INFO:teuthology.orchestra.run.smithi146.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 19 MB/s | 29 MB 00:01 2024-09-18T01:35:08.678 INFO:teuthology.orchestra.run.smithi146.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:35:08.678 INFO:teuthology.orchestra.run.smithi146.stdout:Total 47 MB/s | 79 MB 00:01 2024-09-18T01:35:09.359 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction check 2024-09-18T01:35:09.480 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-09-18T01:35:09.481 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-09-18T01:35:09.715 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction check succeeded. 2024-09-18T01:35:09.716 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction test 2024-09-18T01:35:10.666 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction test succeeded. 2024-09-18T01:35:10.666 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction 2024-09-18T01:35:11.907 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-09-18T01:35:12.829 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-18T01:35:12.937 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T01:35:13.119 INFO:teuthology.orchestra.run.smithi146.stdout: Preparing : 1/1 2024-09-18T01:35:13.804 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-18T01:35:13.895 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T01:35:15.694 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T01:35:15.822 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T01:35:16.668 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T01:35:16.806 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T01:35:20.647 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T01:35:20.691 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-18T01:35:21.627 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T01:35:21.681 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-18T01:35:25.544 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T01:35:26.521 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T01:36:03.777 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T01:36:03.816 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-18T01:36:04.184 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-18T01:36:04.184 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-18T01:36:04.184 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T01:36:04.184 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T01:36:04.705 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T01:36:04.744 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-18T01:36:05.017 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-18T01:36:05.018 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-18T01:36:05.018 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T01:36:05.018 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T01:36:05.079 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T01:36:05.079 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:36:05.079 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-09-18T01:36:05.079 INFO:teuthology.orchestra.run.smithi129.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-18T01:36:05.079 INFO:teuthology.orchestra.run.smithi129.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-18T01:36:05.080 INFO:teuthology.orchestra.run.smithi129.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-18T01:36:05.080 INFO:teuthology.orchestra.run.smithi129.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-18T01:36:05.080 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:36:05.080 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-09-18T01:36:05.422 DEBUG:teuthology.orchestra.run.smithi129:> rpm -q kernel | sort -rV | head -n 1 2024-09-18T01:36:05.540 INFO:teuthology.orchestra.run.smithi129.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-18T01:36:05.540 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-18T01:36:05.540 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-18T01:36:05.541 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-18T01:36:05.541 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-18T01:36:05.541 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-18T01:36:05.541 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi129.front.sepia.ceph.com, path=None, version=distro) 2024-09-18T01:36:05.541 DEBUG:teuthology.orchestra.run.smithi129:> rpm -q kernel | sort -rV | head -n 1 2024-09-18T01:36:05.600 INFO:teuthology.orchestra.run.smithi129.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-18T01:36:05.600 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-18T01:36:05.600 DEBUG:teuthology.orchestra.run.smithi129:> sudo rpm -qi grub2-tools 2024-09-18T01:36:05.632 INFO:teuthology.orchestra.run.smithi129.stdout:Name : grub2-tools 2024-09-18T01:36:05.633 INFO:teuthology.orchestra.run.smithi129.stdout:Epoch : 1 2024-09-18T01:36:05.633 INFO:teuthology.orchestra.run.smithi129.stdout:Version : 2.06 2024-09-18T01:36:05.633 INFO:teuthology.orchestra.run.smithi129.stdout:Release : 82.el9 2024-09-18T01:36:05.633 INFO:teuthology.orchestra.run.smithi129.stdout:Architecture: x86_64 2024-09-18T01:36:05.633 INFO:teuthology.orchestra.run.smithi129.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-18T01:36:05.633 INFO:teuthology.orchestra.run.smithi129.stdout:Group : Unspecified 2024-09-18T01:36:05.633 INFO:teuthology.orchestra.run.smithi129.stdout:Size : 8274670 2024-09-18T01:36:05.633 INFO:teuthology.orchestra.run.smithi129.stdout:License : GPLv3+ 2024-09-18T01:36:05.633 INFO:teuthology.orchestra.run.smithi129.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-18T01:36:05.633 INFO:teuthology.orchestra.run.smithi129.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-18T01:36:05.633 INFO:teuthology.orchestra.run.smithi129.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-18T01:36:05.633 INFO:teuthology.orchestra.run.smithi129.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-18T01:36:05.634 INFO:teuthology.orchestra.run.smithi129.stdout:Packager : builder@centos.org 2024-09-18T01:36:05.634 INFO:teuthology.orchestra.run.smithi129.stdout:Vendor : CentOS 2024-09-18T01:36:05.634 INFO:teuthology.orchestra.run.smithi129.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-18T01:36:05.634 INFO:teuthology.orchestra.run.smithi129.stdout:Summary : Support tools for GRUB. 2024-09-18T01:36:05.634 INFO:teuthology.orchestra.run.smithi129.stdout:Description : 2024-09-18T01:36:05.634 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:36:05.634 INFO:teuthology.orchestra.run.smithi129.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-18T01:36:05.634 INFO:teuthology.orchestra.run.smithi129.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-18T01:36:05.634 INFO:teuthology.orchestra.run.smithi129.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-18T01:36:05.634 INFO:teuthology.orchestra.run.smithi129.stdout:hardware devices. 2024-09-18T01:36:05.634 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:36:05.634 INFO:teuthology.orchestra.run.smithi129.stdout:This subpackage provides tools for support of all platforms. 2024-09-18T01:36:05.635 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-18T01:36:05.635 INFO:teuthology.task.kernel:Updating grub on smithi129 to boot 5.14.0-508.el9.x86_64 2024-09-18T01:36:05.635 DEBUG:teuthology.orchestra.run.smithi129:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-18T01:36:05.882 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T01:36:05.882 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:36:05.882 INFO:teuthology.orchestra.run.smithi146.stdout:Installed: 2024-09-18T01:36:05.882 INFO:teuthology.orchestra.run.smithi146.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-18T01:36:05.882 INFO:teuthology.orchestra.run.smithi146.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-18T01:36:05.883 INFO:teuthology.orchestra.run.smithi146.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-18T01:36:05.883 INFO:teuthology.orchestra.run.smithi146.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-18T01:36:05.883 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:36:05.883 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2024-09-18T01:36:06.218 DEBUG:teuthology.orchestra.run.smithi146:> rpm -q kernel | sort -rV | head -n 1 2024-09-18T01:36:06.300 INFO:teuthology.orchestra.run.smithi146.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-18T01:36:06.300 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-18T01:36:06.300 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-18T01:36:06.300 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-18T01:36:06.300 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-18T01:36:06.301 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-09-18T01:36:06.301 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi146.front.sepia.ceph.com, path=None, version=distro) 2024-09-18T01:36:06.301 DEBUG:teuthology.orchestra.run.smithi146:> rpm -q kernel | sort -rV | head -n 1 2024-09-18T01:36:06.301 INFO:teuthology.orchestra.run.smithi129.stderr:Generating grub configuration file ... 2024-09-18T01:36:06.359 INFO:teuthology.orchestra.run.smithi146.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-18T01:36:06.359 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-18T01:36:06.359 DEBUG:teuthology.orchestra.run.smithi146:> sudo rpm -qi grub2-tools 2024-09-18T01:36:06.391 INFO:teuthology.orchestra.run.smithi146.stdout:Name : grub2-tools 2024-09-18T01:36:06.391 INFO:teuthology.orchestra.run.smithi146.stdout:Epoch : 1 2024-09-18T01:36:06.391 INFO:teuthology.orchestra.run.smithi146.stdout:Version : 2.06 2024-09-18T01:36:06.391 INFO:teuthology.orchestra.run.smithi146.stdout:Release : 82.el9 2024-09-18T01:36:06.391 INFO:teuthology.orchestra.run.smithi146.stdout:Architecture: x86_64 2024-09-18T01:36:06.391 INFO:teuthology.orchestra.run.smithi146.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-18T01:36:06.391 INFO:teuthology.orchestra.run.smithi146.stdout:Group : Unspecified 2024-09-18T01:36:06.391 INFO:teuthology.orchestra.run.smithi146.stdout:Size : 8274670 2024-09-18T01:36:06.391 INFO:teuthology.orchestra.run.smithi146.stdout:License : GPLv3+ 2024-09-18T01:36:06.392 INFO:teuthology.orchestra.run.smithi146.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-18T01:36:06.392 INFO:teuthology.orchestra.run.smithi146.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-18T01:36:06.392 INFO:teuthology.orchestra.run.smithi146.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-18T01:36:06.392 INFO:teuthology.orchestra.run.smithi146.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-18T01:36:06.392 INFO:teuthology.orchestra.run.smithi146.stdout:Packager : builder@centos.org 2024-09-18T01:36:06.392 INFO:teuthology.orchestra.run.smithi146.stdout:Vendor : CentOS 2024-09-18T01:36:06.392 INFO:teuthology.orchestra.run.smithi146.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-18T01:36:06.392 INFO:teuthology.orchestra.run.smithi146.stdout:Summary : Support tools for GRUB. 2024-09-18T01:36:06.392 INFO:teuthology.orchestra.run.smithi146.stdout:Description : 2024-09-18T01:36:06.392 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:36:06.392 INFO:teuthology.orchestra.run.smithi146.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-18T01:36:06.392 INFO:teuthology.orchestra.run.smithi146.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-18T01:36:06.392 INFO:teuthology.orchestra.run.smithi146.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-18T01:36:06.392 INFO:teuthology.orchestra.run.smithi146.stdout:hardware devices. 2024-09-18T01:36:06.393 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:36:06.393 INFO:teuthology.orchestra.run.smithi146.stdout:This subpackage provides tools for support of all platforms. 2024-09-18T01:36:06.393 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-18T01:36:06.394 INFO:teuthology.task.kernel:Updating grub on smithi146 to boot 5.14.0-508.el9.x86_64 2024-09-18T01:36:06.394 DEBUG:teuthology.orchestra.run.smithi146:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-18T01:36:07.007 INFO:teuthology.orchestra.run.smithi146.stderr:Generating grub configuration file ... 2024-09-18T01:36:07.657 INFO:teuthology.orchestra.run.smithi129.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-18T01:36:07.683 INFO:teuthology.orchestra.run.smithi129.stderr:done 2024-09-18T01:36:07.694 DEBUG:teuthology.orchestra.run.smithi129:> mktemp 2024-09-18T01:36:07.710 INFO:teuthology.orchestra.run.smithi129.stdout:/tmp/tmp.O9u12Vy3l9 2024-09-18T01:36:07.711 DEBUG:teuthology.orchestra.run.smithi129:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.O9u12Vy3l9 2024-09-18T01:36:07.778 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod 0666 /tmp/tmp.O9u12Vy3l9 2024-09-18T01:36:07.913 DEBUG:teuthology.orchestra.remote:smithi129:/tmp/tmp.O9u12Vy3l9 is 6KB 2024-09-18T01:36:07.962 DEBUG:teuthology.orchestra.run.smithi129:> rm -fr /tmp/tmp.O9u12Vy3l9 2024-09-18T01:36:07.977 DEBUG:teuthology.orchestra.run.smithi129:> sudo /bin/ls /boot/loader/entries || true 2024-09-18T01:36:08.040 INFO:teuthology.orchestra.run.smithi129.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-18T01:36:08.040 INFO:teuthology.orchestra.run.smithi129.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-18T01:36:08.040 INFO:teuthology.orchestra.run.smithi129.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-18T01:36:08.040 INFO:teuthology.orchestra.run.smithi129.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-18T01:36:08.041 DEBUG:teuthology.orchestra.run.smithi129:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-18T01:36:08.183 DEBUG:teuthology.orchestra.run.smithi129:> sudo shutdown -r now 2024-09-18T01:36:08.350 INFO:teuthology.orchestra.run.smithi146.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-18T01:36:08.393 INFO:teuthology.orchestra.run.smithi146.stderr:done 2024-09-18T01:36:08.396 DEBUG:teuthology.orchestra.run.smithi146:> mktemp 2024-09-18T01:36:08.416 INFO:teuthology.orchestra.run.smithi146.stdout:/tmp/tmp.soZe0DIAAA 2024-09-18T01:36:08.416 DEBUG:teuthology.orchestra.run.smithi146:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.soZe0DIAAA 2024-09-18T01:36:08.483 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 0666 /tmp/tmp.soZe0DIAAA 2024-09-18T01:36:08.621 DEBUG:teuthology.orchestra.remote:smithi146:/tmp/tmp.soZe0DIAAA is 6KB 2024-09-18T01:36:08.671 DEBUG:teuthology.orchestra.run.smithi146:> rm -fr /tmp/tmp.soZe0DIAAA 2024-09-18T01:36:08.687 DEBUG:teuthology.orchestra.run.smithi146:> sudo /bin/ls /boot/loader/entries || true 2024-09-18T01:36:08.750 INFO:teuthology.orchestra.run.smithi146.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-18T01:36:08.750 INFO:teuthology.orchestra.run.smithi146.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-18T01:36:08.750 INFO:teuthology.orchestra.run.smithi146.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-18T01:36:08.750 INFO:teuthology.orchestra.run.smithi146.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-18T01:36:08.751 DEBUG:teuthology.orchestra.run.smithi146:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-18T01:36:08.904 DEBUG:teuthology.orchestra.run.smithi146:> sudo shutdown -r now 2024-09-18T01:36:38.213 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-18T01:36:38.214 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-09-18T01:36:38.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T01:36:38.908 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-09-18T01:36:38.908 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-09-18T01:36:38.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T01:36:56.637 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-09-18T01:36:57.405 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.146 2024-09-18T01:37:05.645 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-09-18T01:37:05.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T01:37:06.407 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-09-18T01:37:06.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T01:37:08.705 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-09-18T01:37:09.469 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.146 2024-09-18T01:37:20.717 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-09-18T01:37:20.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T01:37:21.470 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-09-18T01:37:21.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T01:37:39.133 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-09-18T01:37:39.901 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.146 2024-09-18T01:37:54.135 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-09-18T01:37:54.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T01:37:54.574 DEBUG:teuthology.orchestra.run.smithi129:> true 2024-09-18T01:37:54.901 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-09-18T01:37:54.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T01:37:54.943 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-09-18T01:37:54.943 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-508.el9.x86_64"... 2024-09-18T01:37:54.943 DEBUG:teuthology.orchestra.run.smithi129:> uname -r 2024-09-18T01:37:54.958 INFO:teuthology.orchestra.run.smithi129.stdout:5.14.0-508.el9.x86_64 2024-09-18T01:37:54.958 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-18T01:37:54.958 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-18T01:37:54.958 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-18T01:37:55.391 DEBUG:teuthology.orchestra.run.smithi146:> true 2024-09-18T01:37:55.909 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-09-18T01:37:55.909 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-508.el9.x86_64"... 2024-09-18T01:37:55.909 DEBUG:teuthology.orchestra.run.smithi146:> uname -r 2024-09-18T01:37:55.924 INFO:teuthology.orchestra.run.smithi146.stdout:5.14.0-508.el9.x86_64 2024-09-18T01:37:55.924 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-18T01:37:55.924 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-18T01:37:55.924 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-18T01:37:55.960 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-18T01:37:55.960 DEBUG:teuthology.orchestra.run.smithi129:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-18T01:37:56.088 INFO:teuthology.orchestra.run.smithi129.stdout:ttyS1 2024-09-18T01:37:56.112 DEBUG:teuthology.parallel:result is None 2024-09-18T01:37:56.925 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-09-18T01:37:56.925 DEBUG:teuthology.orchestra.run.smithi146:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-18T01:37:57.004 INFO:teuthology.orchestra.run.smithi146.stdout:ttyS1 2024-09-18T01:37:57.030 DEBUG:teuthology.parallel:result is None 2024-09-18T01:37:57.030 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-18T01:37:57.037 INFO:teuthology.task.internal:Creating test directory... 2024-09-18T01:37:57.037 DEBUG:teuthology.orchestra.run.smithi129:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-18T01:37:57.039 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-18T01:37:57.055 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-18T01:37:57.061 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-18T01:37:57.068 INFO:teuthology.task.internal:Creating archive directory... 2024-09-18T01:37:57.068 DEBUG:teuthology.orchestra.run.smithi129:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-18T01:37:57.095 DEBUG:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-18T01:37:57.122 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-18T01:37:57.128 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-18T01:37:57.128 DEBUG:teuthology.orchestra.run.smithi129:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-18T01:37:57.156 DEBUG:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-18T01:37:57.182 INFO:teuthology.orchestra.run.smithi129.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-18T01:37:57.191 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-18T01:37:57.193 INFO:teuthology.orchestra.run.smithi129.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-18T01:37:57.202 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-18T01:37:57.203 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-18T01:37:57.210 INFO:teuthology.task.internal:Configuring sudo... 2024-09-18T01:37:57.210 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-18T01:37:57.237 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-18T01:37:57.270 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-18T01:37:57.279 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-18T01:37:57.279 DEBUG:teuthology.orchestra.run.smithi129:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-18T01:37:57.303 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-18T01:37:57.324 DEBUG:teuthology.orchestra.run.smithi129:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-18T01:37:57.399 DEBUG:teuthology.orchestra.run.smithi129:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-18T01:37:57.481 DEBUG:teuthology.orchestra.run.smithi129:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-18T01:37:57.523 DEBUG:teuthology.orchestra.run.smithi129:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-18T01:37:57.563 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-09-18T01:37:57.563 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-18T01:37:57.628 DEBUG:teuthology.orchestra.run.smithi146:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-18T01:37:57.668 DEBUG:teuthology.orchestra.run.smithi146:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-18T01:37:57.715 DEBUG:teuthology.orchestra.run.smithi146:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-18T01:37:57.797 DEBUG:teuthology.orchestra.run.smithi146:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-18T01:37:57.838 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-18T01:37:57.838 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-18T01:37:57.906 DEBUG:teuthology.orchestra.run.smithi129:> sudo service rsyslog restart 2024-09-18T01:37:57.908 DEBUG:teuthology.orchestra.run.smithi146:> sudo service rsyslog restart 2024-09-18T01:37:57.955 INFO:teuthology.orchestra.run.smithi129.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-18T01:37:58.000 INFO:teuthology.orchestra.run.smithi146.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-18T01:37:58.465 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-18T01:37:58.498 INFO:teuthology.task.internal:Starting timer... 2024-09-18T01:37:58.498 INFO:teuthology.run_tasks:Running task pcp... 2024-09-18T01:37:58.509 INFO:teuthology.run_tasks:Running task selinux... 2024-09-18T01:37:58.518 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-18T01:37:58.518 DEBUG:teuthology.orchestra.run.smithi129:> sudo service auditd rotate 2024-09-18T01:37:58.565 INFO:teuthology.orchestra.run.smithi129.stdout:Rotating logs: 2024-09-18T01:37:58.567 DEBUG:teuthology.orchestra.run.smithi146:> sudo service auditd rotate 2024-09-18T01:37:58.622 INFO:teuthology.orchestra.run.smithi146.stdout:Rotating logs: 2024-09-18T01:37:58.624 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-18T01:37:58.624 DEBUG:teuthology.orchestra.run.smithi129:> /usr/sbin/getenforce 2024-09-18T01:37:58.657 INFO:teuthology.orchestra.run.smithi129.stdout:Permissive 2024-09-18T01:37:58.657 DEBUG:teuthology.orchestra.run.smithi146:> /usr/sbin/getenforce 2024-09-18T01:37:58.677 INFO:teuthology.orchestra.run.smithi146.stdout:Permissive 2024-09-18T01:37:58.677 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi129.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi146.front.sepia.ceph.com': 'permissive'} 2024-09-18T01:37:58.677 DEBUG:teuthology.orchestra.run.smithi129:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-18T01:37:58.723 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T01:37:58.724 DEBUG:teuthology.orchestra.run.smithi146:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-18T01:37:58.748 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T01:37:58.748 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-18T01:37:58.748 DEBUG:teuthology.orchestra.run.smithi129:> sudo /usr/sbin/setenforce permissive 2024-09-18T01:37:58.802 DEBUG:teuthology.orchestra.run.smithi146:> sudo /usr/sbin/setenforce permissive 2024-09-18T01:37:58.848 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-18T01:37:58.886 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-18T01:37:58.890 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-18T01:37:59.007 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-18T01:37:59.018 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-18T01:37:59.019 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi129.front.sepia.ceph.com,smithi146.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-18T01:41:48.818 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi129.front.sepia.ceph.com'), Remote(name='ubuntu@smithi146.front.sepia.ceph.com')] 2024-09-18T01:41:48.819 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-09-18T01:41:48.821 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T01:41:48.899 DEBUG:teuthology.orchestra.run.smithi129:> true 2024-09-18T01:41:48.976 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-09-18T01:41:48.977 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-09-18T01:41:48.977 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T01:41:49.050 DEBUG:teuthology.orchestra.run.smithi146:> true 2024-09-18T01:41:49.132 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-09-18T01:41:49.132 INFO:teuthology.run_tasks:Running task clock... 2024-09-18T01:41:49.143 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-18T01:41:49.143 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-18T01:41:49.144 DEBUG:teuthology.orchestra.run.smithi129:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-18T01:41:49.146 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-18T01:41:49.146 DEBUG:teuthology.orchestra.run.smithi146:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-18T01:41:49.173 INFO:teuthology.orchestra.run.smithi129.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-18T01:41:49.187 INFO:teuthology.orchestra.run.smithi129.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-18T01:41:49.201 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-18T01:41:49.211 INFO:teuthology.orchestra.run.smithi129.stderr:sudo: ntpd: command not found 2024-09-18T01:41:49.216 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-18T01:41:49.222 INFO:teuthology.orchestra.run.smithi129.stdout:506 Cannot talk to daemon 2024-09-18T01:41:49.236 INFO:teuthology.orchestra.run.smithi129.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-18T01:41:49.241 INFO:teuthology.orchestra.run.smithi146.stderr:sudo: ntpd: command not found 2024-09-18T01:41:49.250 INFO:teuthology.orchestra.run.smithi129.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-18T01:41:49.251 INFO:teuthology.orchestra.run.smithi146.stdout:506 Cannot talk to daemon 2024-09-18T01:41:49.266 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-18T01:41:49.280 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-18T01:41:49.311 INFO:teuthology.orchestra.run.smithi129.stderr:bash: line 1: ntpq: command not found 2024-09-18T01:41:49.316 INFO:teuthology.orchestra.run.smithi129.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-18T01:41:49.316 INFO:teuthology.orchestra.run.smithi129.stdout:=============================================================================== 2024-09-18T01:41:49.316 INFO:teuthology.orchestra.run.smithi129.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T01:41:49.316 INFO:teuthology.orchestra.run.smithi129.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T01:41:49.316 INFO:teuthology.orchestra.run.smithi129.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T01:41:49.316 INFO:teuthology.orchestra.run.smithi129.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T01:41:49.338 INFO:teuthology.orchestra.run.smithi146.stderr:bash: line 1: ntpq: command not found 2024-09-18T01:41:49.342 INFO:teuthology.orchestra.run.smithi146.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-18T01:41:49.342 INFO:teuthology.orchestra.run.smithi146.stdout:=============================================================================== 2024-09-18T01:41:49.342 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T01:41:49.342 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T01:41:49.342 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T01:41:49.342 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T01:41:49.342 INFO:teuthology.run_tasks:Running task install... 2024-09-18T01:41:49.350 DEBUG:teuthology.task.install:project ceph 2024-09-18T01:41:49.350 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f'}} 2024-09-18T01:41:49.350 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f'} 2024-09-18T01:41:49.350 INFO:teuthology.task.install:Using flavor: default 2024-09-18T01:41:49.356 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-18T01:41:49.356 INFO:teuthology.task.install:extra packages: [] 2024-09-18T01:41:49.356 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f', 'tag': None, 'wait_for_package': False} 2024-09-18T01:41:49.357 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-18T01:41:49.358 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f', 'tag': None, 'wait_for_package': False} 2024-09-18T01:41:49.359 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-18T01:41:49.507 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/centos/9/flavors/default/ 2024-09-18T01:41:49.507 INFO:teuthology.task.install.rpm:Package version is 19.1.1-330.gc2ddf972 2024-09-18T01:41:49.515 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/centos/9/flavors/default/ 2024-09-18T01:41:49.515 INFO:teuthology.task.install.rpm:Package version is 19.1.1-330.gc2ddf972 2024-09-18T01:41:49.619 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-18T01:41:49.619 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-09-18T01:41:49.619 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-18T01:41:49.624 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-18T01:41:49.624 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-18T01:41:49.624 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-18T01:41:49.645 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-18T01:41:49.645 DEBUG:teuthology.orchestra.run.smithi129:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/c2ddf9721ef254645201cdbabd9c8f49c30a586f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-18T01:41:49.652 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-18T01:41:49.652 DEBUG:teuthology.orchestra.run.smithi146:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/c2ddf9721ef254645201cdbabd9c8f49c30a586f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-18T01:41:49.712 DEBUG:teuthology.orchestra.run.smithi129:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-18T01:41:49.719 DEBUG:teuthology.orchestra.run.smithi146:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-18T01:41:49.787 DEBUG:teuthology.orchestra.run.smithi129:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-18T01:41:49.794 DEBUG:teuthology.orchestra.run.smithi146:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-18T01:41:49.852 INFO:teuthology.orchestra.run.smithi129.stdout:check_obsoletes = 1 2024-09-18T01:41:49.854 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum clean all 2024-09-18T01:41:49.858 INFO:teuthology.orchestra.run.smithi146.stdout:check_obsoletes = 1 2024-09-18T01:41:49.860 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum clean all 2024-09-18T01:41:50.083 INFO:teuthology.orchestra.run.smithi129.stdout:45 files removed 2024-09-18T01:41:50.085 INFO:teuthology.orchestra.run.smithi146.stdout:45 files removed 2024-09-18T01:41:50.110 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install ceph-radosgw 2024-09-18T01:41:50.112 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum -y install ceph-radosgw 2024-09-18T01:41:50.677 INFO:teuthology.orchestra.run.smithi146.stdout:ceph packages for x86_64 298 kB/s | 84 kB 00:00 2024-09-18T01:41:50.690 INFO:teuthology.orchestra.run.smithi129.stdout:ceph packages for x86_64 286 kB/s | 84 kB 00:00 2024-09-18T01:41:50.961 INFO:teuthology.orchestra.run.smithi146.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-18T01:41:50.966 INFO:teuthology.orchestra.run.smithi129.stdout:ceph noarch packages 51 kB/s | 12 kB 00:00 2024-09-18T01:41:51.228 INFO:teuthology.orchestra.run.smithi146.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-18T01:41:51.233 INFO:teuthology.orchestra.run.smithi129.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-18T01:41:51.675 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 9 - BaseOS 20 MB/s | 8.3 MB 00:00 2024-09-18T01:41:52.098 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - BaseOS 9.9 MB/s | 8.3 MB 00:00 2024-09-18T01:41:53.855 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - AppStream 30 MB/s | 20 MB 00:00 2024-09-18T01:41:58.114 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-18T01:42:00.573 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - Extras packages 15 kB/s | 19 kB 00:01 2024-09-18T01:42:02.869 INFO:teuthology.orchestra.run.smithi146.stdout:Extra Packages for Enterprise Linux 10 MB/s | 23 MB 00:02 2024-09-18T01:42:08.291 INFO:teuthology.orchestra.run.smithi146.stdout:lab-extras 39 kB/s | 1.7 kB 00:00 2024-09-18T01:42:10.166 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 9 - AppStream 1.2 MB/s | 20 MB 00:17 2024-09-18T01:42:10.517 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies resolved. 2024-09-18T01:42:10.531 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-18T01:42:10.531 INFO:teuthology.orchestra.run.smithi146.stdout: Package Arch Version Repository Size 2024-09-18T01:42:10.531 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-18T01:42:10.531 INFO:teuthology.orchestra.run.smithi146.stdout:Installing: 2024-09-18T01:42:10.531 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-radosgw x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 11 M 2024-09-18T01:42:10.531 INFO:teuthology.orchestra.run.smithi146.stdout:Upgrading: 2024-09-18T01:42:10.531 INFO:teuthology.orchestra.run.smithi146.stdout: librados2 x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 3.4 M 2024-09-18T01:42:10.532 INFO:teuthology.orchestra.run.smithi146.stdout: librbd1 x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 3.2 M 2024-09-18T01:42:10.532 INFO:teuthology.orchestra.run.smithi146.stdout:Installing dependencies: 2024-09-18T01:42:10.532 INFO:teuthology.orchestra.run.smithi146.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-18T01:42:10.532 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-base x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 5.4 M 2024-09-18T01:42:10.532 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-common x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 21 M 2024-09-18T01:42:10.532 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-selinux x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 25 k 2024-09-18T01:42:10.532 INFO:teuthology.orchestra.run.smithi146.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-18T01:42:10.532 INFO:teuthology.orchestra.run.smithi146.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-18T01:42:10.532 INFO:teuthology.orchestra.run.smithi146.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-18T01:42:10.532 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs2 x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 751 k 2024-09-18T01:42:10.532 INFO:teuthology.orchestra.run.smithi146.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-18T01:42:10.532 INFO:teuthology.orchestra.run.smithi146.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-18T01:42:10.533 INFO:teuthology.orchestra.run.smithi146.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-18T01:42:10.533 INFO:teuthology.orchestra.run.smithi146.stdout: libradosstriper1 x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 506 k 2024-09-18T01:42:10.533 INFO:teuthology.orchestra.run.smithi146.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-18T01:42:10.533 INFO:teuthology.orchestra.run.smithi146.stdout: librgw2 x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 5.3 M 2024-09-18T01:42:10.533 INFO:teuthology.orchestra.run.smithi146.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-18T01:42:10.533 INFO:teuthology.orchestra.run.smithi146.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-18T01:42:10.533 INFO:teuthology.orchestra.run.smithi146.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-18T01:42:10.533 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-argparse x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 45 k 2024-09-18T01:42:10.533 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-common x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 136 k 2024-09-18T01:42:10.533 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cephfs x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 162 k 2024-09-18T01:42:10.533 INFO:teuthology.orchestra.run.smithi146.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-18T01:42:10.533 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rados x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 320 k 2024-09-18T01:42:10.533 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rbd x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 300 k 2024-09-18T01:42:10.534 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rgw x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 99 k 2024-09-18T01:42:10.534 INFO:teuthology.orchestra.run.smithi146.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-18T01:42:10.534 INFO:teuthology.orchestra.run.smithi146.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-18T01:42:10.534 INFO:teuthology.orchestra.run.smithi146.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-18T01:42:10.534 INFO:teuthology.orchestra.run.smithi146.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-18T01:42:10.534 INFO:teuthology.orchestra.run.smithi146.stdout:Installing weak dependencies: 2024-09-18T01:42:10.534 INFO:teuthology.orchestra.run.smithi146.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-18T01:42:10.534 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:42:10.534 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction Summary 2024-09-18T01:42:10.534 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-18T01:42:10.534 INFO:teuthology.orchestra.run.smithi146.stdout:Install 30 Packages 2024-09-18T01:42:10.534 INFO:teuthology.orchestra.run.smithi146.stdout:Upgrade 2 Packages 2024-09-18T01:42:10.534 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:42:10.535 INFO:teuthology.orchestra.run.smithi146.stdout:Total download size: 60 M 2024-09-18T01:42:10.535 INFO:teuthology.orchestra.run.smithi146.stdout:Downloading Packages: 2024-09-18T01:42:11.167 INFO:teuthology.orchestra.run.smithi146.stdout:(1/32): ceph-base-19.1.1-330.gc2ddf972.el9.x86_ 12 MB/s | 5.4 MB 00:00 2024-09-18T01:42:11.225 INFO:teuthology.orchestra.run.smithi146.stdout:(2/32): ceph-selinux-19.1.1-330.gc2ddf972.el9.x 432 kB/s | 25 kB 00:00 2024-09-18T01:42:11.309 INFO:teuthology.orchestra.run.smithi146.stdout:(3/32): libcephfs2-19.1.1-330.gc2ddf972.el9.x86 8.8 MB/s | 751 kB 00:00 2024-09-18T01:42:11.392 INFO:teuthology.orchestra.run.smithi146.stdout:(4/32): libradosstriper1-19.1.1-330.gc2ddf972.e 5.9 MB/s | 506 kB 00:00 2024-09-18T01:42:11.676 INFO:teuthology.orchestra.run.smithi146.stdout:(5/32): librgw2-19.1.1-330.gc2ddf972.el9.x86_64 19 MB/s | 5.3 MB 00:00 2024-09-18T01:42:11.726 INFO:teuthology.orchestra.run.smithi146.stdout:(6/32): python3-ceph-argparse-19.1.1-330.gc2ddf 902 kB/s | 45 kB 00:00 2024-09-18T01:42:11.851 INFO:teuthology.orchestra.run.smithi146.stdout:(7/32): ceph-radosgw-19.1.1-330.gc2ddf972.el9.x 9.5 MB/s | 11 MB 00:01 2024-09-18T01:42:11.877 INFO:teuthology.orchestra.run.smithi146.stdout:(8/32): python3-ceph-common-19.1.1-330.gc2ddf97 907 kB/s | 136 kB 00:00 2024-09-18T01:42:11.902 INFO:teuthology.orchestra.run.smithi146.stdout:(9/32): python3-cephfs-19.1.1-330.gc2ddf972.el9 3.2 MB/s | 162 kB 00:00 2024-09-18T01:42:11.927 INFO:teuthology.orchestra.run.smithi146.stdout:(10/32): python3-rados-19.1.1-330.gc2ddf972.el9 6.2 MB/s | 320 kB 00:00 2024-09-18T01:42:11.955 INFO:teuthology.orchestra.run.smithi146.stdout:(11/32): python3-rbd-19.1.1-330.gc2ddf972.el9.x 5.6 MB/s | 300 kB 00:00 2024-09-18T01:42:11.980 INFO:teuthology.orchestra.run.smithi146.stdout:(12/32): python3-rgw-19.1.1-330.gc2ddf972.el9.x 1.9 MB/s | 99 kB 00:00 2024-09-18T01:42:12.222 INFO:teuthology.orchestra.run.smithi146.stdout:(13/32): ceph-common-19.1.1-330.gc2ddf972.el9.x 14 MB/s | 21 MB 00:01 2024-09-18T01:42:12.272 INFO:teuthology.orchestra.run.smithi146.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 337 kB/s | 107 kB 00:00 2024-09-18T01:42:12.323 INFO:teuthology.orchestra.run.smithi146.stdout:(15/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 468 kB/s | 160 kB 00:00 2024-09-18T01:42:12.348 INFO:teuthology.orchestra.run.smithi146.stdout:(16/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 362 kB/s | 45 kB 00:00 2024-09-18T01:42:12.415 INFO:teuthology.orchestra.run.smithi146.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 634 kB/s | 42 kB 00:00 2024-09-18T01:42:12.507 INFO:teuthology.orchestra.run.smithi146.stdout:(18/32): qatlib-24.02.0-1.el9.x86_64.rpm 2.4 MB/s | 221 kB 00:00 2024-09-18T01:42:12.532 INFO:teuthology.orchestra.run.smithi146.stdout:(19/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.4 MB/s | 292 kB 00:00 2024-09-18T01:42:12.565 INFO:teuthology.orchestra.run.smithi146.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 614 kB/s | 36 kB 00:00 2024-09-18T01:42:12.591 INFO:teuthology.orchestra.run.smithi146.stdout:(21/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 811 kB/s | 47 kB 00:00 2024-09-18T01:42:12.633 INFO:teuthology.orchestra.run.smithi146.stdout:(22/32): librdkafka-1.6.1-102.el9.x86_64.rpm 1.8 MB/s | 662 kB 00:00 2024-09-18T01:42:12.683 INFO:teuthology.orchestra.run.smithi146.stdout:(23/32): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.6 MB/s | 308 kB 00:00 2024-09-18T01:42:12.708 INFO:teuthology.orchestra.run.smithi146.stdout:(24/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 355 kB/s | 26 kB 00:00 2024-09-18T01:42:12.733 INFO:teuthology.orchestra.run.smithi146.stdout:(25/32): liboath-2.6.7-2.el9.x86_64.rpm 971 kB/s | 49 kB 00:00 2024-09-18T01:42:12.750 INFO:teuthology.orchestra.run.smithi146.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-09-18T01:42:12.800 INFO:teuthology.orchestra.run.smithi146.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-18T01:42:12.834 INFO:teuthology.orchestra.run.smithi146.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.2 MB/s | 839 kB 00:00 2024-09-18T01:42:13.018 INFO:teuthology.orchestra.run.smithi146.stdout:(29/32): librados2-19.1.1-330.gc2ddf972.el9.x86 19 MB/s | 3.4 MB 00:00 2024-09-18T01:42:13.051 INFO:teuthology.orchestra.run.smithi146.stdout:(30/32): thrift-0.15.0-2.el9.x86_64.rpm 6.3 MB/s | 1.6 MB 00:00 2024-09-18T01:42:13.160 INFO:teuthology.orchestra.run.smithi146.stdout:(31/32): libarrow-9.0.0-11.el9.x86_64.rpm 7.8 MB/s | 4.4 MB 00:00 2024-09-18T01:42:13.227 INFO:teuthology.orchestra.run.smithi146.stdout:(32/32): librbd1-19.1.1-330.gc2ddf972.el9.x86_6 15 MB/s | 3.2 MB 00:00 2024-09-18T01:42:13.232 INFO:teuthology.orchestra.run.smithi146.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:42:13.233 INFO:teuthology.orchestra.run.smithi146.stdout:Total 22 MB/s | 60 MB 00:02 2024-09-18T01:42:13.336 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction check 2024-09-18T01:42:13.372 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction check succeeded. 2024-09-18T01:42:13.372 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction test 2024-09-18T01:42:14.060 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction test succeeded. 2024-09-18T01:42:14.061 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction 2024-09-18T01:42:15.508 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 9 - CRB 4.3 MB/s | 6.5 MB 00:01 2024-09-18T01:42:15.521 INFO:teuthology.orchestra.run.smithi146.stdout: Preparing : 1/1 2024-09-18T01:42:15.634 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-18T01:42:15.665 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-18T01:42:15.693 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-18T01:42:15.713 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-18T01:42:15.735 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-18T01:42:15.924 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-18T01:42:15.976 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-18T01:42:16.368 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-18T01:42:16.416 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : librados2-2:19.1.1-330.gc2ddf972.el9.x86_64 7/34 2024-09-18T01:42:16.501 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librados2-2:19.1.1-330.gc2ddf972.el9.x86_64 7/34 2024-09-18T01:42:16.590 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rados-2:19.1.1-330.gc2ddf972.el9.x86_64 8/34 2024-09-18T01:42:16.618 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libcephfs2-2:19.1.1-330.gc2ddf972.el9.x86_64 9/34 2024-09-18T01:42:16.664 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libcephfs2-2:19.1.1-330.gc2ddf972.el9.x86_64 9/34 2024-09-18T01:42:16.701 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-18T01:42:16.745 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-ceph-argparse-2:19.1.1-330.gc2ddf972.el9.x 11/34 2024-09-18T01:42:16.814 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cephfs-2:19.1.1-330.gc2ddf972.el9.x86_64 12/34 2024-09-18T01:42:16.836 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libradosstriper1-2:19.1.1-330.gc2ddf972.el9.x86_64 13/34 2024-09-18T01:42:16.900 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libradosstriper1-2:19.1.1-330.gc2ddf972.el9.x86_64 13/34 2024-09-18T01:42:16.935 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-18T01:42:17.045 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-18T01:42:17.078 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-18T01:42:17.119 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-18T01:42:17.159 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/34 2024-09-18T01:42:17.188 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-18T01:42:17.230 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-18T01:42:17.301 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 19 kB 00:00 2024-09-18T01:42:17.549 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-18T01:42:17.584 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : librbd1-2:19.1.1-330.gc2ddf972.el9.x86_64 22/34 2024-09-18T01:42:17.678 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librbd1-2:19.1.1-330.gc2ddf972.el9.x86_64 22/34 2024-09-18T01:42:17.706 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rbd-2:19.1.1-330.gc2ddf972.el9.x86_64 23/34 2024-09-18T01:42:17.750 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-18T01:42:18.230 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-18T01:42:18.272 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librgw2-2:19.1.1-330.gc2ddf972.el9.x86_64 26/34 2024-09-18T01:42:18.341 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librgw2-2:19.1.1-330.gc2ddf972.el9.x86_64 26/34 2024-09-18T01:42:18.418 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rgw-2:19.1.1-330.gc2ddf972.el9.x86_64 27/34 2024-09-18T01:42:18.447 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-ceph-common-2:19.1.1-330.gc2ddf972.el9.x86 28/34 2024-09-18T01:42:18.913 INFO:teuthology.orchestra.run.smithi129.stdout:Extra Packages for Enterprise Linux 15 MB/s | 23 MB 00:01 2024-09-18T01:42:20.689 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-common-2:19.1.1-330.gc2ddf972.el9.x86_64 29/34 2024-09-18T01:42:20.735 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-common-2:19.1.1-330.gc2ddf972.el9.x86_64 29/34 2024-09-18T01:42:21.299 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-common-2:19.1.1-330.gc2ddf972.el9.x86_64 29/34 2024-09-18T01:42:21.352 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-base-2:19.1.1-330.gc2ddf972.el9.x86_64 30/34 2024-09-18T01:42:21.449 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-base-2:19.1.1-330.gc2ddf972.el9.x86_64 30/34 2024-09-18T01:42:21.449 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-18T01:42:21.449 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-18T01:42:21.449 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:42:21.481 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-selinux-2:19.1.1-330.gc2ddf972.el9.x86_64 31/34 2024-09-18T01:42:24.252 INFO:teuthology.orchestra.run.smithi129.stdout:lab-extras 36 kB/s | 1.7 kB 00:00 2024-09-18T01:42:26.496 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-09-18T01:42:26.510 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-18T01:42:26.510 INFO:teuthology.orchestra.run.smithi129.stdout: Package Arch Version Repository Size 2024-09-18T01:42:26.510 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-18T01:42:26.510 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-09-18T01:42:26.511 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-radosgw x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 11 M 2024-09-18T01:42:26.511 INFO:teuthology.orchestra.run.smithi129.stdout:Upgrading: 2024-09-18T01:42:26.511 INFO:teuthology.orchestra.run.smithi129.stdout: librados2 x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 3.4 M 2024-09-18T01:42:26.511 INFO:teuthology.orchestra.run.smithi129.stdout: librbd1 x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 3.2 M 2024-09-18T01:42:26.511 INFO:teuthology.orchestra.run.smithi129.stdout:Installing dependencies: 2024-09-18T01:42:26.511 INFO:teuthology.orchestra.run.smithi129.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-18T01:42:26.511 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-base x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 5.4 M 2024-09-18T01:42:26.511 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-common x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 21 M 2024-09-18T01:42:26.511 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-selinux x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 25 k 2024-09-18T01:42:26.511 INFO:teuthology.orchestra.run.smithi129.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-18T01:42:26.512 INFO:teuthology.orchestra.run.smithi129.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-18T01:42:26.512 INFO:teuthology.orchestra.run.smithi129.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-18T01:42:26.512 INFO:teuthology.orchestra.run.smithi129.stdout: libcephfs2 x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 751 k 2024-09-18T01:42:26.512 INFO:teuthology.orchestra.run.smithi129.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-18T01:42:26.512 INFO:teuthology.orchestra.run.smithi129.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-18T01:42:26.512 INFO:teuthology.orchestra.run.smithi129.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-18T01:42:26.512 INFO:teuthology.orchestra.run.smithi129.stdout: libradosstriper1 x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 506 k 2024-09-18T01:42:26.512 INFO:teuthology.orchestra.run.smithi129.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-18T01:42:26.512 INFO:teuthology.orchestra.run.smithi129.stdout: librgw2 x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 5.3 M 2024-09-18T01:42:26.512 INFO:teuthology.orchestra.run.smithi129.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-18T01:42:26.512 INFO:teuthology.orchestra.run.smithi129.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-18T01:42:26.512 INFO:teuthology.orchestra.run.smithi129.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-18T01:42:26.513 INFO:teuthology.orchestra.run.smithi129.stdout: python3-ceph-argparse x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 45 k 2024-09-18T01:42:26.513 INFO:teuthology.orchestra.run.smithi129.stdout: python3-ceph-common x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 136 k 2024-09-18T01:42:26.513 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cephfs x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 162 k 2024-09-18T01:42:26.513 INFO:teuthology.orchestra.run.smithi129.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-18T01:42:26.513 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rados x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 320 k 2024-09-18T01:42:26.513 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rbd x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 300 k 2024-09-18T01:42:26.513 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rgw x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 99 k 2024-09-18T01:42:26.513 INFO:teuthology.orchestra.run.smithi129.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-18T01:42:26.513 INFO:teuthology.orchestra.run.smithi129.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-18T01:42:26.513 INFO:teuthology.orchestra.run.smithi129.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-18T01:42:26.513 INFO:teuthology.orchestra.run.smithi129.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-18T01:42:26.513 INFO:teuthology.orchestra.run.smithi129.stdout:Installing weak dependencies: 2024-09-18T01:42:26.514 INFO:teuthology.orchestra.run.smithi129.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-18T01:42:26.514 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:42:26.514 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-09-18T01:42:26.514 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-18T01:42:26.514 INFO:teuthology.orchestra.run.smithi129.stdout:Install 30 Packages 2024-09-18T01:42:26.514 INFO:teuthology.orchestra.run.smithi129.stdout:Upgrade 2 Packages 2024-09-18T01:42:26.514 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:42:26.514 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 60 M 2024-09-18T01:42:26.515 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-09-18T01:42:27.345 INFO:teuthology.orchestra.run.smithi129.stdout:(1/32): ceph-base-19.1.1-330.gc2ddf972.el9.x86_ 11 MB/s | 5.4 MB 00:00 2024-09-18T01:42:27.421 INFO:teuthology.orchestra.run.smithi129.stdout:(2/32): ceph-selinux-19.1.1-330.gc2ddf972.el9.x 335 kB/s | 25 kB 00:00 2024-09-18T01:42:27.513 INFO:teuthology.orchestra.run.smithi129.stdout:(3/32): libcephfs2-19.1.1-330.gc2ddf972.el9.x86 8.0 MB/s | 751 kB 00:00 2024-09-18T01:42:27.621 INFO:teuthology.orchestra.run.smithi129.stdout:(4/32): ceph-radosgw-19.1.1-330.gc2ddf972.el9.x 14 MB/s | 11 MB 00:00 2024-09-18T01:42:27.646 INFO:teuthology.orchestra.run.smithi129.stdout:(5/32): libradosstriper1-19.1.1-330.gc2ddf972.e 3.7 MB/s | 506 kB 00:00 2024-09-18T01:42:27.705 INFO:teuthology.orchestra.run.smithi129.stdout:(6/32): python3-ceph-argparse-19.1.1-330.gc2ddf 774 kB/s | 45 kB 00:00 2024-09-18T01:42:27.797 INFO:teuthology.orchestra.run.smithi129.stdout:(7/32): python3-ceph-common-19.1.1-330.gc2ddf97 1.5 MB/s | 136 kB 00:00 2024-09-18T01:42:27.880 INFO:teuthology.orchestra.run.smithi129.stdout:(8/32): librgw2-19.1.1-330.gc2ddf972.el9.x86_64 21 MB/s | 5.3 MB 00:00 2024-09-18T01:42:27.906 INFO:teuthology.orchestra.run.smithi129.stdout:(9/32): python3-cephfs-19.1.1-330.gc2ddf972.el9 1.5 MB/s | 162 kB 00:00 2024-09-18T01:42:27.939 INFO:teuthology.orchestra.run.smithi129.stdout:(10/32): python3-rados-19.1.1-330.gc2ddf972.el9 5.3 MB/s | 320 kB 00:00 2024-09-18T01:42:27.965 INFO:teuthology.orchestra.run.smithi129.stdout:(11/32): python3-rbd-19.1.1-330.gc2ddf972.el9.x 5.0 MB/s | 300 kB 00:00 2024-09-18T01:42:27.990 INFO:teuthology.orchestra.run.smithi129.stdout:(12/32): python3-rgw-19.1.1-330.gc2ddf972.el9.x 1.9 MB/s | 99 kB 00:00 2024-09-18T01:42:28.207 INFO:teuthology.orchestra.run.smithi129.stdout:(13/32): ceph-common-19.1.1-330.gc2ddf972.el9.x 16 MB/s | 21 MB 00:01 2024-09-18T01:42:28.265 INFO:teuthology.orchestra.run.smithi129.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 356 kB/s | 107 kB 00:00 2024-09-18T01:42:28.299 INFO:teuthology.orchestra.run.smithi129.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 493 kB/s | 45 kB 00:00 2024-09-18T01:42:28.324 INFO:teuthology.orchestra.run.smithi129.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 479 kB/s | 160 kB 00:00 2024-09-18T01:42:28.366 INFO:teuthology.orchestra.run.smithi129.stdout:(17/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-09-18T01:42:28.391 INFO:teuthology.orchestra.run.smithi129.stdout:(18/32): python3-prettytable-0.7.2-27.el9.noarc 631 kB/s | 42 kB 00:00 2024-09-18T01:42:28.416 INFO:teuthology.orchestra.run.smithi129.stdout:(19/32): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-18T01:42:28.450 INFO:teuthology.orchestra.run.smithi129.stdout:(20/32): librdkafka-1.6.1-102.el9.x86_64.rpm 3.5 MB/s | 662 kB 00:00 2024-09-18T01:42:28.467 INFO:teuthology.orchestra.run.smithi129.stdout:(21/32): qatlib-service-24.02.0-1.el9.x86_64.rp 475 kB/s | 36 kB 00:00 2024-09-18T01:42:28.495 INFO:teuthology.orchestra.run.smithi129.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 609 kB/s | 47 kB 00:00 2024-09-18T01:42:28.562 INFO:teuthology.orchestra.run.smithi129.stdout:(23/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 491 kB/s | 26 kB 00:00 2024-09-18T01:42:28.595 INFO:teuthology.orchestra.run.smithi129.stdout:(24/32): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.1 MB/s | 308 kB 00:00 2024-09-18T01:42:28.620 INFO:teuthology.orchestra.run.smithi129.stdout:(25/32): liboath-2.6.7-2.el9.x86_64.rpm 832 kB/s | 49 kB 00:00 2024-09-18T01:42:28.646 INFO:teuthology.orchestra.run.smithi129.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-18T01:42:28.688 INFO:teuthology.orchestra.run.smithi129.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-18T01:42:28.788 INFO:teuthology.orchestra.run.smithi129.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.9 MB/s | 839 kB 00:00 2024-09-18T01:42:28.972 INFO:teuthology.orchestra.run.smithi129.stdout:(29/32): librados2-19.1.1-330.gc2ddf972.el9.x86 19 MB/s | 3.4 MB 00:00 2024-09-18T01:42:29.014 INFO:teuthology.orchestra.run.smithi129.stdout:(30/32): thrift-0.15.0-2.el9.x86_64.rpm 4.9 MB/s | 1.6 MB 00:00 2024-09-18T01:42:29.122 INFO:teuthology.orchestra.run.smithi129.stdout:(31/32): librbd1-19.1.1-330.gc2ddf972.el9.x86_6 21 MB/s | 3.2 MB 00:00 2024-09-18T01:42:29.223 INFO:teuthology.orchestra.run.smithi129.stdout:(32/32): libarrow-9.0.0-11.el9.x86_64.rpm 5.8 MB/s | 4.4 MB 00:00 2024-09-18T01:42:29.227 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:42:29.227 INFO:teuthology.orchestra.run.smithi129.stdout:Total 22 MB/s | 60 MB 00:02 2024-09-18T01:42:29.322 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-09-18T01:42:29.358 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-09-18T01:42:29.358 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-09-18T01:42:30.015 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-09-18T01:42:30.015 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-09-18T01:42:31.207 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-selinux-2:19.1.1-330.gc2ddf972.el9.x86_64 31/34 2024-09-18T01:42:31.208 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /sys 2024-09-18T01:42:31.208 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /proc 2024-09-18T01:42:31.208 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /mnt 2024-09-18T01:42:31.208 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /var/tmp 2024-09-18T01:42:31.208 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /home 2024-09-18T01:42:31.208 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /root 2024-09-18T01:42:31.208 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /tmp 2024-09-18T01:42:31.208 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:42:31.489 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-09-18T01:42:31.573 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-18T01:42:31.603 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-18T01:42:31.628 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-18T01:42:31.651 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-18T01:42:31.672 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-18T01:42:31.827 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-18T01:42:31.881 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-18T01:42:32.205 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-radosgw-2:19.1.1-330.gc2ddf972.el9.x86_64 32/34 2024-09-18T01:42:32.230 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-330.gc2ddf972.el9.x86_64 32/34 2024-09-18T01:42:32.231 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T01:42:32.231 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-18T01:42:32.231 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-18T01:42:32.231 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-18T01:42:32.231 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:42:32.232 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-18T01:42:32.248 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-18T01:42:32.307 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-18T01:42:32.307 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-18T01:42:32.338 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : librados2-2:19.1.1-330.gc2ddf972.el9.x86_64 7/34 2024-09-18T01:42:32.431 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: librados2-2:19.1.1-330.gc2ddf972.el9.x86_64 7/34 2024-09-18T01:42:32.522 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-rados-2:19.1.1-330.gc2ddf972.el9.x86_64 8/34 2024-09-18T01:42:32.557 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libcephfs2-2:19.1.1-330.gc2ddf972.el9.x86_64 9/34 2024-09-18T01:42:32.628 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: libcephfs2-2:19.1.1-330.gc2ddf972.el9.x86_64 9/34 2024-09-18T01:42:32.674 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-18T01:42:32.717 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-ceph-argparse-2:19.1.1-330.gc2ddf972.el9.x 11/34 2024-09-18T01:42:32.788 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-cephfs-2:19.1.1-330.gc2ddf972.el9.x86_64 12/34 2024-09-18T01:42:32.817 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libradosstriper1-2:19.1.1-330.gc2ddf972.el9.x86_64 13/34 2024-09-18T01:42:32.890 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: libradosstriper1-2:19.1.1-330.gc2ddf972.el9.x86_64 13/34 2024-09-18T01:42:32.924 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-18T01:42:33.035 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-18T01:42:33.067 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-18T01:42:33.108 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-18T01:42:33.157 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/34 2024-09-18T01:42:33.187 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-18T01:42:33.228 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-18T01:42:33.520 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-18T01:42:33.520 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-base-2:19.1.1-330.gc2ddf972.el9.x86_64 1/34 2024-09-18T01:42:33.520 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-common-2:19.1.1-330.gc2ddf972.el9.x86_64 2/34 2024-09-18T01:42:33.520 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-radosgw-2:19.1.1-330.gc2ddf972.el9.x86_64 3/34 2024-09-18T01:42:33.520 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-selinux-2:19.1.1-330.gc2ddf972.el9.x86_64 4/34 2024-09-18T01:42:33.520 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libcephfs2-2:19.1.1-330.gc2ddf972.el9.x86_64 5/34 2024-09-18T01:42:33.521 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libradosstriper1-2:19.1.1-330.gc2ddf972.el9.x86_64 6/34 2024-09-18T01:42:33.521 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librgw2-2:19.1.1-330.gc2ddf972.el9.x86_64 7/34 2024-09-18T01:42:33.521 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-ceph-argparse-2:19.1.1-330.gc2ddf972.el9.x 8/34 2024-09-18T01:42:33.521 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-ceph-common-2:19.1.1-330.gc2ddf972.el9.x86 9/34 2024-09-18T01:42:33.521 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cephfs-2:19.1.1-330.gc2ddf972.el9.x86_64 10/34 2024-09-18T01:42:33.521 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rados-2:19.1.1-330.gc2ddf972.el9.x86_64 11/34 2024-09-18T01:42:33.521 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rbd-2:19.1.1-330.gc2ddf972.el9.x86_64 12/34 2024-09-18T01:42:33.521 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rgw-2:19.1.1-330.gc2ddf972.el9.x86_64 13/34 2024-09-18T01:42:33.521 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-18T01:42:33.521 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-18T01:42:33.521 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-18T01:42:33.521 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-18T01:42:33.521 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-18T01:42:33.522 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-18T01:42:33.522 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-18T01:42:33.522 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-18T01:42:33.522 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-18T01:42:33.522 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 23/34 2024-09-18T01:42:33.522 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-18T01:42:33.522 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-18T01:42:33.522 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-18T01:42:33.522 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-18T01:42:33.523 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-18T01:42:33.523 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-18T01:42:33.523 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-18T01:42:33.523 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librados2-2:19.1.1-330.gc2ddf972.el9.x86_64 31/34 2024-09-18T01:42:33.524 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-18T01:42:33.524 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librbd1-2:19.1.1-330.gc2ddf972.el9.x86_64 33/34 2024-09-18T01:42:33.551 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-18T01:42:33.590 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : librbd1-2:19.1.1-330.gc2ddf972.el9.x86_64 22/34 2024-09-18T01:42:33.685 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: librbd1-2:19.1.1-330.gc2ddf972.el9.x86_64 22/34 2024-09-18T01:42:33.712 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-rbd-2:19.1.1-330.gc2ddf972.el9.x86_64 23/34 2024-09-18T01:42:33.749 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-18T01:42:34.228 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-18T01:42:34.260 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : librgw2-2:19.1.1-330.gc2ddf972.el9.x86_64 26/34 2024-09-18T01:42:34.331 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: librgw2-2:19.1.1-330.gc2ddf972.el9.x86_64 26/34 2024-09-18T01:42:34.417 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-rgw-2:19.1.1-330.gc2ddf972.el9.x86_64 27/34 2024-09-18T01:42:34.446 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-ceph-common-2:19.1.1-330.gc2ddf972.el9.x86 28/34 2024-09-18T01:42:34.615 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-18T01:42:34.615 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:42:34.615 INFO:teuthology.orchestra.run.smithi146.stdout:Upgraded: 2024-09-18T01:42:34.615 INFO:teuthology.orchestra.run.smithi146.stdout: librados2-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:42:34.615 INFO:teuthology.orchestra.run.smithi146.stdout: librbd1-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:42:34.615 INFO:teuthology.orchestra.run.smithi146.stdout:Installed: 2024-09-18T01:42:34.616 INFO:teuthology.orchestra.run.smithi146.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-18T01:42:34.616 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-base-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:42:34.616 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-common-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:42:34.616 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-radosgw-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:42:34.616 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-selinux-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:42:34.616 INFO:teuthology.orchestra.run.smithi146.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-18T01:42:34.616 INFO:teuthology.orchestra.run.smithi146.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-18T01:42:34.616 INFO:teuthology.orchestra.run.smithi146.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-18T01:42:34.616 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs2-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:42:34.616 INFO:teuthology.orchestra.run.smithi146.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-18T01:42:34.616 INFO:teuthology.orchestra.run.smithi146.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-18T01:42:34.616 INFO:teuthology.orchestra.run.smithi146.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-18T01:42:34.616 INFO:teuthology.orchestra.run.smithi146.stdout: libradosstriper1-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:42:34.617 INFO:teuthology.orchestra.run.smithi146.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-18T01:42:34.617 INFO:teuthology.orchestra.run.smithi146.stdout: librgw2-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:42:34.617 INFO:teuthology.orchestra.run.smithi146.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-18T01:42:34.617 INFO:teuthology.orchestra.run.smithi146.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-18T01:42:34.617 INFO:teuthology.orchestra.run.smithi146.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-18T01:42:34.617 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-argparse-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:42:34.617 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-common-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:42:34.617 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cephfs-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:42:34.617 INFO:teuthology.orchestra.run.smithi146.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-18T01:42:34.617 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rados-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:42:34.617 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rbd-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:42:34.617 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rgw-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:42:34.617 INFO:teuthology.orchestra.run.smithi146.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-18T01:42:34.618 INFO:teuthology.orchestra.run.smithi146.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-18T01:42:34.618 INFO:teuthology.orchestra.run.smithi146.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-18T01:42:34.618 INFO:teuthology.orchestra.run.smithi146.stdout: re2-1:20211101-20.el9.x86_64 2024-09-18T01:42:34.618 INFO:teuthology.orchestra.run.smithi146.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-18T01:42:34.618 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:42:34.618 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2024-09-18T01:42:34.987 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum -y install ceph-test 2024-09-18T01:42:35.567 INFO:teuthology.orchestra.run.smithi146.stdout:Last metadata expiration check: 0:00:27 ago on Wed 18 Sep 2024 01:42:08 AM UTC. 2024-09-18T01:42:35.698 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies resolved. 2024-09-18T01:42:35.699 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-18T01:42:35.699 INFO:teuthology.orchestra.run.smithi146.stdout: Package Arch Version Repository Size 2024-09-18T01:42:35.699 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-18T01:42:35.699 INFO:teuthology.orchestra.run.smithi146.stdout:Installing: 2024-09-18T01:42:35.699 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-test x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 49 M 2024-09-18T01:42:35.699 INFO:teuthology.orchestra.run.smithi146.stdout:Installing dependencies: 2024-09-18T01:42:35.699 INFO:teuthology.orchestra.run.smithi146.stdout: libcephsqlite x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 163 k 2024-09-18T01:42:35.699 INFO:teuthology.orchestra.run.smithi146.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-18T01:42:35.699 INFO:teuthology.orchestra.run.smithi146.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-18T01:42:35.700 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:42:35.700 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction Summary 2024-09-18T01:42:35.700 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-18T01:42:35.700 INFO:teuthology.orchestra.run.smithi146.stdout:Install 4 Packages 2024-09-18T01:42:35.700 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:42:35.700 INFO:teuthology.orchestra.run.smithi146.stdout:Total download size: 49 M 2024-09-18T01:42:35.701 INFO:teuthology.orchestra.run.smithi146.stdout:Installed size: 209 M 2024-09-18T01:42:35.701 INFO:teuthology.orchestra.run.smithi146.stdout:Downloading Packages: 2024-09-18T01:42:35.955 INFO:teuthology.orchestra.run.smithi146.stdout:(1/4): libcephsqlite-19.1.1-330.gc2ddf972.el9.x 725 kB/s | 163 kB 00:00 2024-09-18T01:42:35.979 INFO:teuthology.orchestra.run.smithi146.stdout:(2/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.2 MB/s | 304 kB 00:00 2024-09-18T01:42:36.097 INFO:teuthology.orchestra.run.smithi146.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 449 kB/s | 64 kB 00:00 2024-09-18T01:42:36.704 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-common-2:19.1.1-330.gc2ddf972.el9.x86_64 29/34 2024-09-18T01:42:36.896 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-common-2:19.1.1-330.gc2ddf972.el9.x86_64 29/34 2024-09-18T01:42:37.305 INFO:teuthology.orchestra.run.smithi146.stdout:(4/4): ceph-test-19.1.1-330.gc2ddf972.el9.x86_6 31 MB/s | 49 MB 00:01 2024-09-18T01:42:37.307 INFO:teuthology.orchestra.run.smithi146.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:42:37.308 INFO:teuthology.orchestra.run.smithi146.stdout:Total 31 MB/s | 49 MB 00:01 2024-09-18T01:42:37.335 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction check 2024-09-18T01:42:37.356 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction check succeeded. 2024-09-18T01:42:37.356 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction test 2024-09-18T01:42:37.463 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-common-2:19.1.1-330.gc2ddf972.el9.x86_64 29/34 2024-09-18T01:42:37.504 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-base-2:19.1.1-330.gc2ddf972.el9.x86_64 30/34 2024-09-18T01:42:37.595 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-base-2:19.1.1-330.gc2ddf972.el9.x86_64 30/34 2024-09-18T01:42:37.596 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-18T01:42:37.596 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-18T01:42:37.596 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:42:37.631 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-selinux-2:19.1.1-330.gc2ddf972.el9.x86_64 31/34 2024-09-18T01:42:37.743 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction test succeeded. 2024-09-18T01:42:37.744 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction 2024-09-18T01:42:38.268 INFO:teuthology.orchestra.run.smithi146.stdout: Preparing : 1/1 2024-09-18T01:42:38.357 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-18T01:42:38.396 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-18T01:42:38.423 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libcephsqlite-2:19.1.1-330.gc2ddf972.el9.x86_64 3/4 2024-09-18T01:42:43.073 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libcephsqlite-2:19.1.1-330.gc2ddf972.el9.x86_64 3/4 2024-09-18T01:42:43.163 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-test-2:19.1.1-330.gc2ddf972.el9.x86_64 4/4 2024-09-18T01:42:45.471 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-test-2:19.1.1-330.gc2ddf972.el9.x86_64 4/4 2024-09-18T01:42:45.471 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-test-2:19.1.1-330.gc2ddf972.el9.x86_64 1/4 2024-09-18T01:42:45.471 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libcephsqlite-2:19.1.1-330.gc2ddf972.el9.x86_64 2/4 2024-09-18T01:42:45.471 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-18T01:42:45.776 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-18T01:42:45.776 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:42:45.776 INFO:teuthology.orchestra.run.smithi146.stdout:Installed: 2024-09-18T01:42:45.776 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-test-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:42:45.776 INFO:teuthology.orchestra.run.smithi146.stdout: libcephsqlite-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:42:45.776 INFO:teuthology.orchestra.run.smithi146.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-18T01:42:45.776 INFO:teuthology.orchestra.run.smithi146.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-18T01:42:45.776 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:42:45.776 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2024-09-18T01:42:46.050 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum -y install ceph 2024-09-18T01:42:46.653 INFO:teuthology.orchestra.run.smithi146.stdout:Last metadata expiration check: 0:00:38 ago on Wed 18 Sep 2024 01:42:08 AM UTC. 2024-09-18T01:42:46.796 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies resolved. 2024-09-18T01:42:46.799 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-18T01:42:46.799 INFO:teuthology.orchestra.run.smithi146.stdout: Package Arch Version Repository Size 2024-09-18T01:42:46.799 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-18T01:42:46.799 INFO:teuthology.orchestra.run.smithi146.stdout:Installing: 2024-09-18T01:42:46.799 INFO:teuthology.orchestra.run.smithi146.stdout: ceph x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 6.5 k 2024-09-18T01:42:46.799 INFO:teuthology.orchestra.run.smithi146.stdout:Installing dependencies: 2024-09-18T01:42:46.799 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mds x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 2.4 M 2024-09-18T01:42:46.799 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 1.5 M 2024-09-18T01:42:46.799 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-modules-core noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 249 k 2024-09-18T01:42:46.800 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mon x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 4.7 M 2024-09-18T01:42:46.800 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-osd x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 17 M 2024-09-18T01:42:46.800 INFO:teuthology.orchestra.run.smithi146.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-18T01:42:46.800 INFO:teuthology.orchestra.run.smithi146.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-18T01:42:46.800 INFO:teuthology.orchestra.run.smithi146.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-18T01:42:46.800 INFO:teuthology.orchestra.run.smithi146.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-18T01:42:46.800 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-18T01:42:46.800 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-18T01:42:46.800 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-18T01:42:46.800 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-18T01:42:46.800 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-18T01:42:46.800 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-18T01:42:46.800 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-18T01:42:46.800 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-18T01:42:46.801 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-18T01:42:46.801 INFO:teuthology.orchestra.run.smithi146.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-18T01:42:46.801 INFO:teuthology.orchestra.run.smithi146.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-18T01:42:46.801 INFO:teuthology.orchestra.run.smithi146.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-18T01:42:46.801 INFO:teuthology.orchestra.run.smithi146.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-18T01:42:46.801 INFO:teuthology.orchestra.run.smithi146.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-18T01:42:46.801 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-18T01:42:46.801 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-18T01:42:46.801 INFO:teuthology.orchestra.run.smithi146.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-18T01:42:46.801 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-18T01:42:46.801 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-18T01:42:46.801 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-18T01:42:46.801 INFO:teuthology.orchestra.run.smithi146.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-18T01:42:46.802 INFO:teuthology.orchestra.run.smithi146.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-18T01:42:46.802 INFO:teuthology.orchestra.run.smithi146.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-18T01:42:46.802 INFO:teuthology.orchestra.run.smithi146.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-18T01:42:46.802 INFO:teuthology.orchestra.run.smithi146.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-18T01:42:46.802 INFO:teuthology.orchestra.run.smithi146.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-18T01:42:46.802 INFO:teuthology.orchestra.run.smithi146.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-18T01:42:46.802 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:42:46.802 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction Summary 2024-09-18T01:42:46.802 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-18T01:42:46.802 INFO:teuthology.orchestra.run.smithi146.stdout:Install 37 Packages 2024-09-18T01:42:46.802 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:42:46.803 INFO:teuthology.orchestra.run.smithi146.stdout:Total download size: 30 M 2024-09-18T01:42:46.803 INFO:teuthology.orchestra.run.smithi146.stdout:Installed size: 108 M 2024-09-18T01:42:46.803 INFO:teuthology.orchestra.run.smithi146.stdout:Downloading Packages: 2024-09-18T01:42:47.173 INFO:teuthology.orchestra.run.smithi146.stdout:(1/37): ceph-19.1.1-330.gc2ddf972.el9.x86_64.rp 51 kB/s | 6.5 kB 00:00 2024-09-18T01:42:47.372 INFO:teuthology.orchestra.run.smithi146.stdout:(2/37): ceph-mds-19.1.1-330.gc2ddf972.el9.x86_6 7.3 MB/s | 2.4 MB 00:00 2024-09-18T01:42:47.423 INFO:teuthology.orchestra.run.smithi146.stdout:(3/37): ceph-mgr-19.1.1-330.gc2ddf972.el9.x86_6 4.0 MB/s | 1.5 MB 00:00 2024-09-18T01:42:47.531 INFO:teuthology.orchestra.run.smithi146.stdout:(4/37): ceph-mgr-modules-core-19.1.1-330.gc2ddf 2.3 MB/s | 249 kB 00:00 2024-09-18T01:42:47.615 INFO:teuthology.orchestra.run.smithi146.stdout:(5/37): ceph-mon-19.1.1-330.gc2ddf972.el9.x86_6 11 MB/s | 4.7 MB 00:00 2024-09-18T01:42:47.696 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-selinux-2:19.1.1-330.gc2ddf972.el9.x86_64 31/34 2024-09-18T01:42:47.696 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /sys 2024-09-18T01:42:47.697 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /proc 2024-09-18T01:42:47.697 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /mnt 2024-09-18T01:42:47.697 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /var/tmp 2024-09-18T01:42:47.697 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /home 2024-09-18T01:42:47.697 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /root 2024-09-18T01:42:47.697 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /tmp 2024-09-18T01:42:47.697 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:42:47.765 INFO:teuthology.orchestra.run.smithi146.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.1 MB/s | 253 kB 00:00 2024-09-18T01:42:47.949 INFO:teuthology.orchestra.run.smithi146.stdout:(7/37): ceph-osd-19.1.1-330.gc2ddf972.el9.x86_6 29 MB/s | 17 MB 00:00 2024-09-18T01:42:47.965 INFO:teuthology.orchestra.run.smithi146.stdout:(8/37): python3-ply-3.11-14.el9.noarch.rpm 532 kB/s | 106 kB 00:00 2024-09-18T01:42:48.007 INFO:teuthology.orchestra.run.smithi146.stdout:(9/37): python3-cryptography-36.0.1-4.el9.x86_6 3.1 MB/s | 1.2 MB 00:00 2024-09-18T01:42:48.033 INFO:teuthology.orchestra.run.smithi146.stdout:(10/37): python3-requests-2.25.1-8.el9.noarch.r 1.8 MB/s | 125 kB 00:00 2024-09-18T01:42:48.066 INFO:teuthology.orchestra.run.smithi146.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 3.6 MB/s | 215 kB 00:00 2024-09-18T01:42:48.083 INFO:teuthology.orchestra.run.smithi146.stdout:(12/37): python3-pycparser-2.20-6.el9.noarch.rp 1.0 MB/s | 135 kB 00:00 2024-09-18T01:42:48.167 INFO:teuthology.orchestra.run.smithi146.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 417 kB/s | 35 kB 00:00 2024-09-18T01:42:48.192 INFO:teuthology.orchestra.run.smithi146.stdout:(14/37): lua-5.4.4-4.el9.x86_64.rpm 1.2 MB/s | 188 kB 00:00 2024-09-18T01:42:48.217 INFO:teuthology.orchestra.run.smithi146.stdout:(15/37): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-09-18T01:42:48.243 INFO:teuthology.orchestra.run.smithi146.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-18T01:42:48.268 INFO:teuthology.orchestra.run.smithi146.stdout:(17/37): python3-packaging-20.9-5.el9.noarch.rp 764 kB/s | 77 kB 00:00 2024-09-18T01:42:48.288 INFO:teuthology.orchestra.run.smithi146.stdout:(18/37): python3-toml-0.10.2-6.el9.noarch.rpm 590 kB/s | 42 kB 00:00 2024-09-18T01:42:48.330 INFO:teuthology.orchestra.run.smithi146.stdout:(19/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.0 MB/s | 43 kB 00:00 2024-09-18T01:42:48.355 INFO:teuthology.orchestra.run.smithi146.stdout:(20/37): luarocks-3.9.2-5.el9.noarch.rpm 1.7 MB/s | 151 kB 00:00 2024-09-18T01:42:48.372 INFO:teuthology.orchestra.run.smithi146.stdout:(21/37): lua-devel-5.4.4-4.el9.x86_64.rpm 172 kB/s | 22 kB 00:00 2024-09-18T01:42:48.406 INFO:teuthology.orchestra.run.smithi146.stdout:(22/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-18T01:42:48.431 INFO:teuthology.orchestra.run.smithi146.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 755 kB/s | 18 kB 00:00 2024-09-18T01:42:48.448 INFO:teuthology.orchestra.run.smithi146.stdout:(24/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 141 kB/s | 11 kB 00:00 2024-09-18T01:42:48.473 INFO:teuthology.orchestra.run.smithi146.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 556 kB/s | 23 kB 00:00 2024-09-18T01:42:48.498 INFO:teuthology.orchestra.run.smithi146.stdout:(26/37): python3-cherrypy-18.6.1-2.el9.noarch.r 2.5 MB/s | 358 kB 00:00 2024-09-18T01:42:48.524 INFO:teuthology.orchestra.run.smithi146.stdout:(27/37): python3-jaraco-functools-3.5.0-2.el9.n 258 kB/s | 19 kB 00:00 2024-09-18T01:42:48.549 INFO:teuthology.orchestra.run.smithi146.stdout:(28/37): python3-jaraco-text-3.2.0-6.el9.noarch 260 kB/s | 20 kB 00:00 2024-09-18T01:42:48.574 INFO:teuthology.orchestra.run.smithi146.stdout:(29/37): python3-logutils-0.3.5-21.el9.noarch.r 614 kB/s | 46 kB 00:00 2024-09-18T01:42:48.600 INFO:teuthology.orchestra.run.smithi146.stdout:(30/37): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-09-18T01:42:48.625 INFO:teuthology.orchestra.run.smithi146.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 326 kB/s | 16 kB 00:00 2024-09-18T01:42:48.653 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-radosgw-2:19.1.1-330.gc2ddf972.el9.x86_64 32/34 2024-09-18T01:42:48.658 INFO:teuthology.orchestra.run.smithi146.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.5 MB/s | 90 kB 00:00 2024-09-18T01:42:48.678 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-330.gc2ddf972.el9.x86_64 32/34 2024-09-18T01:42:48.678 INFO:teuthology.orchestra.run.smithi129.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T01:42:48.678 INFO:teuthology.orchestra.run.smithi129.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-18T01:42:48.678 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-18T01:42:48.678 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-18T01:42:48.679 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:42:48.680 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-18T01:42:48.683 INFO:teuthology.orchestra.run.smithi146.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 610 kB/s | 36 kB 00:00 2024-09-18T01:42:48.709 INFO:teuthology.orchestra.run.smithi146.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.7 MB/s | 272 kB 00:00 2024-09-18T01:42:48.734 INFO:teuthology.orchestra.run.smithi146.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 797 kB/s | 20 kB 00:00 2024-09-18T01:42:48.759 INFO:teuthology.orchestra.run.smithi146.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-18T01:42:48.772 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-18T01:42:48.772 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-18T01:42:48.784 INFO:teuthology.orchestra.run.smithi146.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.1 MB/s | 427 kB 00:00 2024-09-18T01:42:48.788 INFO:teuthology.orchestra.run.smithi146.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:42:48.789 INFO:teuthology.orchestra.run.smithi146.stdout:Total 15 MB/s | 30 MB 00:01 2024-09-18T01:42:48.934 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction check 2024-09-18T01:42:48.975 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction check succeeded. 2024-09-18T01:42:48.975 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction test 2024-09-18T01:42:49.440 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction test succeeded. 2024-09-18T01:42:49.441 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction 2024-09-18T01:42:50.033 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-18T01:42:50.033 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-base-2:19.1.1-330.gc2ddf972.el9.x86_64 1/34 2024-09-18T01:42:50.033 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-common-2:19.1.1-330.gc2ddf972.el9.x86_64 2/34 2024-09-18T01:42:50.033 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-radosgw-2:19.1.1-330.gc2ddf972.el9.x86_64 3/34 2024-09-18T01:42:50.033 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-selinux-2:19.1.1-330.gc2ddf972.el9.x86_64 4/34 2024-09-18T01:42:50.033 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libcephfs2-2:19.1.1-330.gc2ddf972.el9.x86_64 5/34 2024-09-18T01:42:50.033 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libradosstriper1-2:19.1.1-330.gc2ddf972.el9.x86_64 6/34 2024-09-18T01:42:50.033 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librgw2-2:19.1.1-330.gc2ddf972.el9.x86_64 7/34 2024-09-18T01:42:50.033 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-ceph-argparse-2:19.1.1-330.gc2ddf972.el9.x 8/34 2024-09-18T01:42:50.033 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-ceph-common-2:19.1.1-330.gc2ddf972.el9.x86 9/34 2024-09-18T01:42:50.033 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-cephfs-2:19.1.1-330.gc2ddf972.el9.x86_64 10/34 2024-09-18T01:42:50.034 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-rados-2:19.1.1-330.gc2ddf972.el9.x86_64 11/34 2024-09-18T01:42:50.034 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-rbd-2:19.1.1-330.gc2ddf972.el9.x86_64 12/34 2024-09-18T01:42:50.034 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-rgw-2:19.1.1-330.gc2ddf972.el9.x86_64 13/34 2024-09-18T01:42:50.034 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-18T01:42:50.034 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-18T01:42:50.034 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-18T01:42:50.034 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-18T01:42:50.034 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-18T01:42:50.034 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-18T01:42:50.034 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-18T01:42:50.034 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-18T01:42:50.034 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-18T01:42:50.034 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 23/34 2024-09-18T01:42:50.035 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-18T01:42:50.035 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-18T01:42:50.035 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-18T01:42:50.035 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-18T01:42:50.035 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-18T01:42:50.035 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-18T01:42:50.035 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-18T01:42:50.035 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librados2-2:19.1.1-330.gc2ddf972.el9.x86_64 31/34 2024-09-18T01:42:50.035 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-18T01:42:50.035 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librbd1-2:19.1.1-330.gc2ddf972.el9.x86_64 33/34 2024-09-18T01:42:50.800 INFO:teuthology.orchestra.run.smithi146.stdout: Preparing : 1/1 2024-09-18T01:42:50.871 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-18T01:42:50.911 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-18T01:42:50.940 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-18T01:42:51.011 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-18T01:42:51.055 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-18T01:42:51.088 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-18T01:42:51.143 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-18T01:42:51.143 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:42:51.143 INFO:teuthology.orchestra.run.smithi129.stdout:Upgraded: 2024-09-18T01:42:51.144 INFO:teuthology.orchestra.run.smithi129.stdout: librados2-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:42:51.144 INFO:teuthology.orchestra.run.smithi129.stdout: librbd1-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:42:51.144 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-09-18T01:42:51.144 INFO:teuthology.orchestra.run.smithi129.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-18T01:42:51.144 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-base-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:42:51.144 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-common-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:42:51.144 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-radosgw-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:42:51.144 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-selinux-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:42:51.144 INFO:teuthology.orchestra.run.smithi129.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-18T01:42:51.144 INFO:teuthology.orchestra.run.smithi129.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-18T01:42:51.144 INFO:teuthology.orchestra.run.smithi129.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-18T01:42:51.144 INFO:teuthology.orchestra.run.smithi129.stdout: libcephfs2-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:42:51.144 INFO:teuthology.orchestra.run.smithi129.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-18T01:42:51.144 INFO:teuthology.orchestra.run.smithi129.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-18T01:42:51.145 INFO:teuthology.orchestra.run.smithi129.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-18T01:42:51.145 INFO:teuthology.orchestra.run.smithi129.stdout: libradosstriper1-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:42:51.145 INFO:teuthology.orchestra.run.smithi129.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-18T01:42:51.145 INFO:teuthology.orchestra.run.smithi129.stdout: librgw2-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:42:51.145 INFO:teuthology.orchestra.run.smithi129.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-18T01:42:51.145 INFO:teuthology.orchestra.run.smithi129.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-18T01:42:51.145 INFO:teuthology.orchestra.run.smithi129.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-18T01:42:51.145 INFO:teuthology.orchestra.run.smithi129.stdout: python3-ceph-argparse-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:42:51.145 INFO:teuthology.orchestra.run.smithi129.stdout: python3-ceph-common-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:42:51.145 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cephfs-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:42:51.145 INFO:teuthology.orchestra.run.smithi129.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-18T01:42:51.145 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rados-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:42:51.146 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rbd-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:42:51.146 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rgw-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:42:51.146 INFO:teuthology.orchestra.run.smithi129.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-18T01:42:51.146 INFO:teuthology.orchestra.run.smithi129.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-18T01:42:51.146 INFO:teuthology.orchestra.run.smithi129.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-18T01:42:51.146 INFO:teuthology.orchestra.run.smithi129.stdout: re2-1:20211101-20.el9.x86_64 2024-09-18T01:42:51.146 INFO:teuthology.orchestra.run.smithi129.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-18T01:42:51.146 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:42:51.146 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-09-18T01:42:51.181 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-18T01:42:51.249 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-18T01:42:51.291 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-18T01:42:51.326 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-18T01:42:51.356 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-18T01:42:51.390 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-18T01:42:51.424 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-18T01:42:51.464 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-18T01:42:51.507 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-18T01:42:51.513 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install ceph-test 2024-09-18T01:42:51.553 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-18T01:42:51.598 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-18T01:42:51.630 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-18T01:42:51.703 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-18T01:42:51.851 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-18T01:42:51.939 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-18T01:42:51.991 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-18T01:42:52.029 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-18T01:42:52.078 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-18T01:42:52.096 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:00:28 ago on Wed 18 Sep 2024 01:42:24 AM UTC. 2024-09-18T01:42:52.133 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-18T01:42:52.228 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-09-18T01:42:52.229 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-18T01:42:52.229 INFO:teuthology.orchestra.run.smithi129.stdout: Package Arch Version Repository Size 2024-09-18T01:42:52.229 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-18T01:42:52.229 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-09-18T01:42:52.229 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-test x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 49 M 2024-09-18T01:42:52.229 INFO:teuthology.orchestra.run.smithi129.stdout:Installing dependencies: 2024-09-18T01:42:52.229 INFO:teuthology.orchestra.run.smithi129.stdout: libcephsqlite x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 163 k 2024-09-18T01:42:52.229 INFO:teuthology.orchestra.run.smithi129.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-18T01:42:52.229 INFO:teuthology.orchestra.run.smithi129.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-18T01:42:52.230 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:42:52.230 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-09-18T01:42:52.230 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-18T01:42:52.230 INFO:teuthology.orchestra.run.smithi129.stdout:Install 4 Packages 2024-09-18T01:42:52.230 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:42:52.230 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 49 M 2024-09-18T01:42:52.230 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 209 M 2024-09-18T01:42:52.230 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-09-18T01:42:52.322 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-18T01:42:52.367 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-18T01:42:52.445 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-18T01:42:52.497 INFO:teuthology.orchestra.run.smithi129.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 2.4 MB/s | 304 kB 00:00 2024-09-18T01:42:52.534 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-18T01:42:52.538 INFO:teuthology.orchestra.run.smithi129.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-18T01:42:52.583 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-18T01:42:52.588 INFO:teuthology.orchestra.run.smithi129.stdout:(3/4): libcephsqlite-19.1.1-330.gc2ddf972.el9.x 750 kB/s | 163 kB 00:00 2024-09-18T01:42:52.698 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-18T01:42:52.864 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-330.gc2ddf972.el9.n 32/37 2024-09-18T01:42:52.893 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-2:19.1.1-330.gc2ddf972.el9.x86_64 33/37 2024-09-18T01:42:52.919 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-2:19.1.1-330.gc2ddf972.el9.x86_64 33/37 2024-09-18T01:42:52.919 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T01:42:52.919 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-18T01:42:52.919 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-18T01:42:52.920 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-18T01:42:52.920 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:42:54.360 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-osd-2:19.1.1-330.gc2ddf972.el9.x86_64 34/37 2024-09-18T01:42:54.388 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-osd-2:19.1.1-330.gc2ddf972.el9.x86_64 34/37 2024-09-18T01:42:54.388 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T01:42:54.388 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-18T01:42:54.388 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-18T01:42:54.388 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-18T01:42:54.388 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:42:54.422 INFO:teuthology.orchestra.run.smithi129.stdout:(4/4): ceph-test-19.1.1-330.gc2ddf972.el9.x86_6 24 MB/s | 49 MB 00:02 2024-09-18T01:42:54.425 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:42:54.425 INFO:teuthology.orchestra.run.smithi129.stdout:Total 22 MB/s | 49 MB 00:02 2024-09-18T01:42:54.452 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-09-18T01:42:54.472 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-09-18T01:42:54.472 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-09-18T01:42:54.828 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mon-2:19.1.1-330.gc2ddf972.el9.x86_64 35/37 2024-09-18T01:42:54.851 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mon-2:19.1.1-330.gc2ddf972.el9.x86_64 35/37 2024-09-18T01:42:54.852 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T01:42:54.852 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-18T01:42:54.852 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-18T01:42:54.852 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-18T01:42:54.852 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:42:54.861 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-09-18T01:42:54.861 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-09-18T01:42:55.086 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mds-2:19.1.1-330.gc2ddf972.el9.x86_64 36/37 2024-09-18T01:42:55.110 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mds-2:19.1.1-330.gc2ddf972.el9.x86_64 36/37 2024-09-18T01:42:55.110 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T01:42:55.110 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-18T01:42:55.110 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-18T01:42:55.110 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-18T01:42:55.110 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:42:55.174 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-2:19.1.1-330.gc2ddf972.el9.x86_64 37/37 2024-09-18T01:42:55.392 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-09-18T01:42:55.483 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-18T01:42:55.530 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-18T01:42:55.575 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libcephsqlite-2:19.1.1-330.gc2ddf972.el9.x86_64 3/4 2024-09-18T01:42:56.907 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-2:19.1.1-330.gc2ddf972.el9.x86_64 37/37 2024-09-18T01:42:56.907 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-2:19.1.1-330.gc2ddf972.el9.x86_64 1/37 2024-09-18T01:42:56.907 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mds-2:19.1.1-330.gc2ddf972.el9.x86_64 2/37 2024-09-18T01:42:56.907 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-2:19.1.1-330.gc2ddf972.el9.x86_64 3/37 2024-09-18T01:42:56.907 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mon-2:19.1.1-330.gc2ddf972.el9.x86_64 4/37 2024-09-18T01:42:56.908 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-osd-2:19.1.1-330.gc2ddf972.el9.x86_64 5/37 2024-09-18T01:42:56.908 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-330.gc2ddf972.el9.n 6/37 2024-09-18T01:42:56.908 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-18T01:42:56.908 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-18T01:42:56.908 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-18T01:42:56.908 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-18T01:42:56.908 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-18T01:42:56.908 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-18T01:42:56.908 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-18T01:42:56.908 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-18T01:42:56.908 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-18T01:42:56.908 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-18T01:42:56.909 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-18T01:42:56.909 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-18T01:42:56.909 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-18T01:42:56.909 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-18T01:42:56.909 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-18T01:42:56.909 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-18T01:42:56.909 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-18T01:42:56.909 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-18T01:42:56.909 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-18T01:42:56.909 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-18T01:42:56.909 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-18T01:42:56.909 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-18T01:42:56.910 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-18T01:42:56.910 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-18T01:42:56.910 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-18T01:42:56.911 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-18T01:42:56.911 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-18T01:42:56.911 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-18T01:42:56.911 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-18T01:42:56.911 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-18T01:42:57.950 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-18T01:42:57.950 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:42:57.950 INFO:teuthology.orchestra.run.smithi146.stdout:Installed: 2024-09-18T01:42:57.950 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:42:57.950 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mds-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:42:57.950 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:42:57.950 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-modules-core-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-18T01:42:57.951 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mon-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:42:57.951 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-osd-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:42:57.951 INFO:teuthology.orchestra.run.smithi146.stdout: lua-5.4.4-4.el9.x86_64 2024-09-18T01:42:57.951 INFO:teuthology.orchestra.run.smithi146.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-18T01:42:57.951 INFO:teuthology.orchestra.run.smithi146.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-18T01:42:57.951 INFO:teuthology.orchestra.run.smithi146.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-18T01:42:57.951 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-18T01:42:57.951 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-18T01:42:57.951 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-18T01:42:57.951 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-18T01:42:57.951 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-18T01:42:57.951 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-18T01:42:57.951 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-18T01:42:57.951 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-18T01:42:57.952 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-18T01:42:57.952 INFO:teuthology.orchestra.run.smithi146.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-18T01:42:57.952 INFO:teuthology.orchestra.run.smithi146.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-18T01:42:57.952 INFO:teuthology.orchestra.run.smithi146.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-18T01:42:57.952 INFO:teuthology.orchestra.run.smithi146.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-18T01:42:57.952 INFO:teuthology.orchestra.run.smithi146.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-18T01:42:57.952 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-18T01:42:57.952 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ply-3.11-14.el9.noarch 2024-09-18T01:42:57.952 INFO:teuthology.orchestra.run.smithi146.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-18T01:42:57.952 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-18T01:42:57.952 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-18T01:42:57.952 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-18T01:42:57.952 INFO:teuthology.orchestra.run.smithi146.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-18T01:42:57.953 INFO:teuthology.orchestra.run.smithi146.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-18T01:42:57.953 INFO:teuthology.orchestra.run.smithi146.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-18T01:42:57.953 INFO:teuthology.orchestra.run.smithi146.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-18T01:42:57.953 INFO:teuthology.orchestra.run.smithi146.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-18T01:42:57.953 INFO:teuthology.orchestra.run.smithi146.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-18T01:42:57.953 INFO:teuthology.orchestra.run.smithi146.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-18T01:42:57.953 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:42:57.953 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2024-09-18T01:42:58.355 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum -y install ceph-base 2024-09-18T01:42:58.942 INFO:teuthology.orchestra.run.smithi146.stdout:Last metadata expiration check: 0:00:50 ago on Wed 18 Sep 2024 01:42:08 AM UTC. 2024-09-18T01:42:59.032 INFO:teuthology.orchestra.run.smithi146.stdout:Package ceph-base-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-18T01:42:59.073 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies resolved. 2024-09-18T01:42:59.074 INFO:teuthology.orchestra.run.smithi146.stdout:Nothing to do. 2024-09-18T01:42:59.075 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2024-09-18T01:42:59.146 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum -y install cephadm 2024-09-18T01:42:59.724 INFO:teuthology.orchestra.run.smithi146.stdout:Last metadata expiration check: 0:00:51 ago on Wed 18 Sep 2024 01:42:08 AM UTC. 2024-09-18T01:42:59.855 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies resolved. 2024-09-18T01:42:59.856 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-18T01:42:59.856 INFO:teuthology.orchestra.run.smithi146.stdout: Package Arch Version Repository Size 2024-09-18T01:42:59.857 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-18T01:42:59.857 INFO:teuthology.orchestra.run.smithi146.stdout:Installing: 2024-09-18T01:42:59.857 INFO:teuthology.orchestra.run.smithi146.stdout: cephadm noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 765 k 2024-09-18T01:42:59.857 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:42:59.857 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction Summary 2024-09-18T01:42:59.857 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-18T01:42:59.857 INFO:teuthology.orchestra.run.smithi146.stdout:Install 1 Package 2024-09-18T01:42:59.857 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:42:59.857 INFO:teuthology.orchestra.run.smithi146.stdout:Total download size: 765 k 2024-09-18T01:42:59.857 INFO:teuthology.orchestra.run.smithi146.stdout:Installed size: 771 k 2024-09-18T01:42:59.857 INFO:teuthology.orchestra.run.smithi146.stdout:Downloading Packages: 2024-09-18T01:43:00.152 INFO:teuthology.orchestra.run.smithi146.stdout:cephadm-19.1.1-330.gc2ddf972.el9.noarch.rpm 2.5 MB/s | 765 kB 00:00 2024-09-18T01:43:00.152 INFO:teuthology.orchestra.run.smithi146.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:43:00.153 INFO:teuthology.orchestra.run.smithi146.stdout:Total 2.5 MB/s | 765 kB 00:00 2024-09-18T01:43:00.153 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction check 2024-09-18T01:43:00.158 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction check succeeded. 2024-09-18T01:43:00.158 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction test 2024-09-18T01:43:00.164 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction test succeeded. 2024-09-18T01:43:00.164 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction 2024-09-18T01:43:00.204 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: libcephsqlite-2:19.1.1-330.gc2ddf972.el9.x86_64 3/4 2024-09-18T01:43:00.233 INFO:teuthology.orchestra.run.smithi146.stdout: Preparing : 1/1 2024-09-18T01:43:00.282 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-test-2:19.1.1-330.gc2ddf972.el9.x86_64 4/4 2024-09-18T01:43:00.704 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 1/1 2024-09-18T01:43:00.797 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 1/1 2024-09-18T01:43:01.158 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 1/1 2024-09-18T01:43:01.401 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 1/1 2024-09-18T01:43:01.402 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:43:01.402 INFO:teuthology.orchestra.run.smithi146.stdout:Installed: 2024-09-18T01:43:01.402 INFO:teuthology.orchestra.run.smithi146.stdout: cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-18T01:43:01.402 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:43:01.402 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2024-09-18T01:43:01.631 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum -y install ceph-immutable-object-cache 2024-09-18T01:43:02.239 INFO:teuthology.orchestra.run.smithi146.stdout:Last metadata expiration check: 0:00:54 ago on Wed 18 Sep 2024 01:42:08 AM UTC. 2024-09-18T01:43:02.371 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies resolved. 2024-09-18T01:43:02.372 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-18T01:43:02.372 INFO:teuthology.orchestra.run.smithi146.stdout: Package Arch Version Repo Size 2024-09-18T01:43:02.372 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-18T01:43:02.372 INFO:teuthology.orchestra.run.smithi146.stdout:Installing: 2024-09-18T01:43:02.372 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 145 k 2024-09-18T01:43:02.372 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:43:02.372 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction Summary 2024-09-18T01:43:02.372 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-18T01:43:02.372 INFO:teuthology.orchestra.run.smithi146.stdout:Install 1 Package 2024-09-18T01:43:02.372 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:43:02.373 INFO:teuthology.orchestra.run.smithi146.stdout:Total download size: 145 k 2024-09-18T01:43:02.373 INFO:teuthology.orchestra.run.smithi146.stdout:Installed size: 435 k 2024-09-18T01:43:02.373 INFO:teuthology.orchestra.run.smithi146.stdout:Downloading Packages: 2024-09-18T01:43:02.582 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-immutable-object-cache-19.1.1-330.gc2ddf97 694 kB/s | 145 kB 00:00 2024-09-18T01:43:02.583 INFO:teuthology.orchestra.run.smithi146.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:43:02.583 INFO:teuthology.orchestra.run.smithi146.stdout:Total 690 kB/s | 145 kB 00:00 2024-09-18T01:43:02.583 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction check 2024-09-18T01:43:02.590 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction check succeeded. 2024-09-18T01:43:02.591 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction test 2024-09-18T01:43:02.649 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction test succeeded. 2024-09-18T01:43:02.649 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction 2024-09-18T01:43:02.757 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-test-2:19.1.1-330.gc2ddf972.el9.x86_64 4/4 2024-09-18T01:43:02.757 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-test-2:19.1.1-330.gc2ddf972.el9.x86_64 1/4 2024-09-18T01:43:02.757 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libcephsqlite-2:19.1.1-330.gc2ddf972.el9.x86_64 2/4 2024-09-18T01:43:02.757 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-18T01:43:02.808 INFO:teuthology.orchestra.run.smithi146.stdout: Preparing : 1/1 2024-09-18T01:43:02.867 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-330.gc2ddf972.e 1/1 2024-09-18T01:43:02.891 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-330.gc2ddf972.e 1/1 2024-09-18T01:43:02.892 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T01:43:02.892 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-18T01:43:02.892 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:43:03.079 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-18T01:43:03.080 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:43:03.080 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-09-18T01:43:03.080 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-test-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:43:03.080 INFO:teuthology.orchestra.run.smithi129.stdout: libcephsqlite-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:43:03.080 INFO:teuthology.orchestra.run.smithi129.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-18T01:43:03.080 INFO:teuthology.orchestra.run.smithi129.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-18T01:43:03.080 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:43:03.080 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-09-18T01:43:03.355 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install ceph 2024-09-18T01:43:03.817 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-330.gc2ddf972.e 1/1 2024-09-18T01:43:03.817 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:43:03.817 INFO:teuthology.orchestra.run.smithi146.stdout:Installed: 2024-09-18T01:43:03.818 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-immutable-object-cache-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:43:03.818 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:43:03.818 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2024-09-18T01:43:03.964 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:00:39 ago on Wed 18 Sep 2024 01:42:24 AM UTC. 2024-09-18T01:43:04.060 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum -y install ceph-mgr 2024-09-18T01:43:04.110 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-09-18T01:43:04.113 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-18T01:43:04.113 INFO:teuthology.orchestra.run.smithi129.stdout: Package Arch Version Repository Size 2024-09-18T01:43:04.113 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-18T01:43:04.113 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-09-18T01:43:04.113 INFO:teuthology.orchestra.run.smithi129.stdout: ceph x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 6.5 k 2024-09-18T01:43:04.113 INFO:teuthology.orchestra.run.smithi129.stdout:Installing dependencies: 2024-09-18T01:43:04.113 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mds x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 2.4 M 2024-09-18T01:43:04.113 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 1.5 M 2024-09-18T01:43:04.113 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-modules-core noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 249 k 2024-09-18T01:43:04.114 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mon x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 4.7 M 2024-09-18T01:43:04.114 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-osd x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 17 M 2024-09-18T01:43:04.114 INFO:teuthology.orchestra.run.smithi129.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-18T01:43:04.114 INFO:teuthology.orchestra.run.smithi129.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-18T01:43:04.114 INFO:teuthology.orchestra.run.smithi129.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-18T01:43:04.114 INFO:teuthology.orchestra.run.smithi129.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-18T01:43:04.114 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-18T01:43:04.114 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-18T01:43:04.114 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-18T01:43:04.114 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-18T01:43:04.115 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-18T01:43:04.115 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-18T01:43:04.115 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-18T01:43:04.115 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-18T01:43:04.115 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-18T01:43:04.115 INFO:teuthology.orchestra.run.smithi129.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-18T01:43:04.115 INFO:teuthology.orchestra.run.smithi129.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-18T01:43:04.115 INFO:teuthology.orchestra.run.smithi129.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-18T01:43:04.115 INFO:teuthology.orchestra.run.smithi129.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-18T01:43:04.115 INFO:teuthology.orchestra.run.smithi129.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-18T01:43:04.115 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-18T01:43:04.116 INFO:teuthology.orchestra.run.smithi129.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-18T01:43:04.116 INFO:teuthology.orchestra.run.smithi129.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-18T01:43:04.116 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-18T01:43:04.116 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-18T01:43:04.116 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-18T01:43:04.116 INFO:teuthology.orchestra.run.smithi129.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-18T01:43:04.116 INFO:teuthology.orchestra.run.smithi129.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-18T01:43:04.116 INFO:teuthology.orchestra.run.smithi129.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-18T01:43:04.116 INFO:teuthology.orchestra.run.smithi129.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-18T01:43:04.116 INFO:teuthology.orchestra.run.smithi129.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-18T01:43:04.116 INFO:teuthology.orchestra.run.smithi129.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-18T01:43:04.117 INFO:teuthology.orchestra.run.smithi129.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-18T01:43:04.117 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:43:04.117 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-09-18T01:43:04.117 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-18T01:43:04.117 INFO:teuthology.orchestra.run.smithi129.stdout:Install 37 Packages 2024-09-18T01:43:04.117 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:43:04.118 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 30 M 2024-09-18T01:43:04.118 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 108 M 2024-09-18T01:43:04.118 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-09-18T01:43:04.476 INFO:teuthology.orchestra.run.smithi129.stdout:(1/37): ceph-19.1.1-330.gc2ddf972.el9.x86_64.rp 51 kB/s | 6.5 kB 00:00 2024-09-18T01:43:04.650 INFO:teuthology.orchestra.run.smithi146.stdout:Last metadata expiration check: 0:00:56 ago on Wed 18 Sep 2024 01:42:08 AM UTC. 2024-09-18T01:43:04.701 INFO:teuthology.orchestra.run.smithi129.stdout:(2/37): ceph-mds-19.1.1-330.gc2ddf972.el9.x86_6 6.7 MB/s | 2.4 MB 00:00 2024-09-18T01:43:04.734 INFO:teuthology.orchestra.run.smithi129.stdout:(3/37): ceph-mgr-19.1.1-330.gc2ddf972.el9.x86_6 3.9 MB/s | 1.5 MB 00:00 2024-09-18T01:43:04.743 INFO:teuthology.orchestra.run.smithi146.stdout:Package ceph-mgr-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-18T01:43:04.785 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies resolved. 2024-09-18T01:43:04.786 INFO:teuthology.orchestra.run.smithi146.stdout:Nothing to do. 2024-09-18T01:43:04.786 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2024-09-18T01:43:04.802 INFO:teuthology.orchestra.run.smithi129.stdout:(4/37): ceph-mgr-modules-core-19.1.1-330.gc2ddf 3.7 MB/s | 249 kB 00:00 2024-09-18T01:43:04.856 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum -y install ceph-mgr-dashboard 2024-09-18T01:43:04.894 INFO:teuthology.orchestra.run.smithi129.stdout:(5/37): ceph-mon-19.1.1-330.gc2ddf972.el9.x86_6 11 MB/s | 4.7 MB 00:00 2024-09-18T01:43:05.011 INFO:teuthology.orchestra.run.smithi129.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.2 MB/s | 253 kB 00:00 2024-09-18T01:43:05.069 INFO:teuthology.orchestra.run.smithi129.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-18T01:43:05.129 INFO:teuthology.orchestra.run.smithi129.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 2.3 MB/s | 135 kB 00:00 2024-09-18T01:43:05.187 INFO:teuthology.orchestra.run.smithi129.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 2.1 MB/s | 125 kB 00:00 2024-09-18T01:43:05.379 INFO:teuthology.orchestra.run.smithi129.stdout:(10/37): ceph-osd-19.1.1-330.gc2ddf972.el9.x86_ 25 MB/s | 17 MB 00:00 2024-09-18T01:43:05.404 INFO:teuthology.orchestra.run.smithi129.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 989 kB/s | 215 kB 00:00 2024-09-18T01:43:05.438 INFO:teuthology.orchestra.run.smithi129.stdout:(12/37): python3-cryptography-36.0.1-4.el9.x86_ 2.3 MB/s | 1.2 MB 00:00 2024-09-18T01:43:05.441 INFO:teuthology.orchestra.run.smithi146.stdout:Last metadata expiration check: 0:00:57 ago on Wed 18 Sep 2024 01:42:08 AM UTC. 2024-09-18T01:43:05.521 INFO:teuthology.orchestra.run.smithi129.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 417 kB/s | 35 kB 00:00 2024-09-18T01:43:05.546 INFO:teuthology.orchestra.run.smithi129.stdout:(14/37): python3-mako-1.1.4-6.el9.noarch.rpm 1.2 MB/s | 172 kB 00:00 2024-09-18T01:43:05.572 INFO:teuthology.orchestra.run.smithi129.stdout:(15/37): lua-5.4.4-4.el9.x86_64.rpm 978 kB/s | 188 kB 00:00 2024-09-18T01:43:05.572 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies resolved. 2024-09-18T01:43:05.574 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-18T01:43:05.574 INFO:teuthology.orchestra.run.smithi146.stdout: Package Arch Version Repository Size 2024-09-18T01:43:05.574 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-18T01:43:05.574 INFO:teuthology.orchestra.run.smithi146.stdout:Installing: 2024-09-18T01:43:05.574 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-dashboard noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 3.6 M 2024-09-18T01:43:05.574 INFO:teuthology.orchestra.run.smithi146.stdout:Installing dependencies: 2024-09-18T01:43:05.574 INFO:teuthology.orchestra.run.smithi146.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-18T01:43:05.574 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-grafana-dashboards noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 32 k 2024-09-18T01:43:05.574 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-prometheus-alerts noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 16 k 2024-09-18T01:43:05.574 INFO:teuthology.orchestra.run.smithi146.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-18T01:43:05.574 INFO:teuthology.orchestra.run.smithi146.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-18T01:43:05.575 INFO:teuthology.orchestra.run.smithi146.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-18T01:43:05.575 INFO:teuthology.orchestra.run.smithi146.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-18T01:43:05.575 INFO:teuthology.orchestra.run.smithi146.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-18T01:43:05.575 INFO:teuthology.orchestra.run.smithi146.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-18T01:43:05.575 INFO:teuthology.orchestra.run.smithi146.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-18T01:43:05.575 INFO:teuthology.orchestra.run.smithi146.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-18T01:43:05.575 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:43:05.575 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction Summary 2024-09-18T01:43:05.575 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-18T01:43:05.575 INFO:teuthology.orchestra.run.smithi146.stdout:Install 12 Packages 2024-09-18T01:43:05.575 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:43:05.576 INFO:teuthology.orchestra.run.smithi146.stdout:Total download size: 8.7 M 2024-09-18T01:43:05.576 INFO:teuthology.orchestra.run.smithi146.stdout:Installed size: 104 M 2024-09-18T01:43:05.576 INFO:teuthology.orchestra.run.smithi146.stdout:Downloading Packages: 2024-09-18T01:43:05.597 INFO:teuthology.orchestra.run.smithi129.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-18T01:43:05.623 INFO:teuthology.orchestra.run.smithi129.stdout:(17/37): python3-packaging-20.9-5.el9.noarch.rp 763 kB/s | 77 kB 00:00 2024-09-18T01:43:05.648 INFO:teuthology.orchestra.run.smithi129.stdout:(18/37): python3-toml-0.10.2-6.el9.noarch.rpm 550 kB/s | 42 kB 00:00 2024-09-18T01:43:05.707 INFO:teuthology.orchestra.run.smithi129.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 1.8 MB/s | 151 kB 00:00 2024-09-18T01:43:05.740 INFO:teuthology.orchestra.run.smithi129.stdout:(20/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 473 kB/s | 43 kB 00:00 2024-09-18T01:43:05.782 INFO:teuthology.orchestra.run.smithi129.stdout:(21/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 4.0 MB/s | 172 kB 00:00 2024-09-18T01:43:05.807 INFO:teuthology.orchestra.run.smithi129.stdout:(22/37): python3-cherrypy-18.6.1-2.el9.noarch.r 5.2 MB/s | 358 kB 00:00 2024-09-18T01:43:05.824 INFO:teuthology.orchestra.run.smithi129.stdout:(23/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 255 kB/s | 11 kB 00:00 2024-09-18T01:43:05.850 INFO:teuthology.orchestra.run.smithi129.stdout:(24/37): python3-jaraco-classes-3.2.1-5.el9.noa 420 kB/s | 18 kB 00:00 2024-09-18T01:43:05.875 INFO:teuthology.orchestra.run.smithi129.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 461 kB/s | 23 kB 00:00 2024-09-18T01:43:05.900 INFO:teuthology.orchestra.run.smithi129.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 388 kB/s | 19 kB 00:00 2024-09-18T01:43:05.925 INFO:teuthology.orchestra.run.smithi129.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 390 kB/s | 20 kB 00:00 2024-09-18T01:43:05.927 INFO:teuthology.orchestra.run.smithi146.stdout:(1/12): ceph-grafana-dashboards-19.1.1-330.gc2d 218 kB/s | 32 kB 00:00 2024-09-18T01:43:05.953 INFO:teuthology.orchestra.run.smithi146.stdout:(2/12): ceph-prometheus-alerts-19.1.1-330.gc2dd 96 kB/s | 16 kB 00:00 2024-09-18T01:43:05.959 INFO:teuthology.orchestra.run.smithi129.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 788 kB/s | 46 kB 00:00 2024-09-18T01:43:05.984 INFO:teuthology.orchestra.run.smithi129.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-18T01:43:06.010 INFO:teuthology.orchestra.run.smithi129.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 659 kB/s | 16 kB 00:00 2024-09-18T01:43:06.035 INFO:teuthology.orchestra.run.smithi129.stdout:(31/37): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-18T01:43:06.077 INFO:teuthology.orchestra.run.smithi129.stdout:(32/37): python3-tempora-5.0.0-2.el9.noarch.rpm 862 kB/s | 36 kB 00:00 2024-09-18T01:43:06.102 INFO:teuthology.orchestra.run.smithi129.stdout:(33/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 978 kB/s | 90 kB 00:00 2024-09-18T01:43:06.145 INFO:teuthology.orchestra.run.smithi129.stdout:(34/37): python3-webob-1.8.8-2.el9.noarch.rpm 3.3 MB/s | 230 kB 00:00 2024-09-18T01:43:06.161 INFO:teuthology.orchestra.run.smithi146.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.3 MB/s | 269 kB 00:00 2024-09-18T01:43:06.170 INFO:teuthology.orchestra.run.smithi129.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 805 kB/s | 20 kB 00:00 2024-09-18T01:43:06.207 INFO:teuthology.orchestra.run.smithi129.stdout:(36/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.0 MB/s | 427 kB 00:00 2024-09-18T01:43:06.220 INFO:teuthology.orchestra.run.smithi146.stdout:(4/12): ceph-mgr-dashboard-19.1.1-330.gc2ddf972 8.1 MB/s | 3.6 MB 00:00 2024-09-18T01:43:06.291 INFO:teuthology.orchestra.run.smithi129.stdout:(37/37): lua-devel-5.4.4-4.el9.x86_64.rpm 32 kB/s | 22 kB 00:00 2024-09-18T01:43:06.296 INFO:teuthology.orchestra.run.smithi146.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 7.1 MB/s | 548 kB 00:00 2024-09-18T01:43:06.297 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:43:06.297 INFO:teuthology.orchestra.run.smithi129.stdout:Total 14 MB/s | 30 MB 00:02 2024-09-18T01:43:06.321 INFO:teuthology.orchestra.run.smithi146.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 770 kB/s | 19 kB 00:00 2024-09-18T01:43:06.354 INFO:teuthology.orchestra.run.smithi146.stdout:(7/12): protobuf-3.14.0-13.el9.x86_64.rpm 2.4 MB/s | 1.0 MB 00:00 2024-09-18T01:43:06.413 INFO:teuthology.orchestra.run.smithi146.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 2.4 MB/s | 144 kB 00:00 2024-09-18T01:43:06.438 INFO:teuthology.orchestra.run.smithi146.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-18T01:43:06.450 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-09-18T01:43:06.489 INFO:teuthology.orchestra.run.smithi146.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 3.7 MB/s | 188 kB 00:00 2024-09-18T01:43:06.491 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-09-18T01:43:06.491 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-09-18T01:43:06.514 INFO:teuthology.orchestra.run.smithi146.stdout:(11/12): protobuf-compiler-3.14.0-13.el9.x86_64 2.4 MB/s | 863 kB 00:00 2024-09-18T01:43:06.564 INFO:teuthology.orchestra.run.smithi146.stdout:(12/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 8.4 MB/s | 2.0 MB 00:00 2024-09-18T01:43:06.567 INFO:teuthology.orchestra.run.smithi146.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:43:06.567 INFO:teuthology.orchestra.run.smithi146.stdout:Total 8.7 MB/s | 8.7 MB 00:00 2024-09-18T01:43:06.614 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction check 2024-09-18T01:43:06.630 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction check succeeded. 2024-09-18T01:43:06.630 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction test 2024-09-18T01:43:06.842 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction test succeeded. 2024-09-18T01:43:06.843 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction 2024-09-18T01:43:06.962 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-09-18T01:43:06.962 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-09-18T01:43:07.374 INFO:teuthology.orchestra.run.smithi146.stdout: Preparing : 1/1 2024-09-18T01:43:07.439 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-18T01:43:07.483 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-18T01:43:07.530 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-18T01:43:07.568 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-18T01:43:07.664 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-18T01:43:07.795 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-18T01:43:07.890 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-18T01:43:07.934 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-18T01:43:07.961 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-18T01:43:07.993 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-330.gc2ddf972.el9. 10/12 2024-09-18T01:43:08.312 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-09-18T01:43:08.385 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-18T01:43:08.426 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-18T01:43:08.454 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-18T01:43:08.527 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-18T01:43:08.579 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-18T01:43:08.611 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-18T01:43:08.703 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-18T01:43:08.789 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-18T01:43:08.831 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-18T01:43:08.866 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-18T01:43:08.913 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-18T01:43:08.947 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-18T01:43:08.981 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-18T01:43:09.021 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-18T01:43:09.056 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-18T01:43:09.058 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-330.gc2ddf972.el9 11/12 2024-09-18T01:43:09.090 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-18T01:43:09.102 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-330.gc2ddf972.el9.noar 12/12 2024-09-18T01:43:09.139 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-18T01:43:09.180 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-18T01:43:09.253 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-18T01:43:09.390 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-18T01:43:09.471 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-18T01:43:09.524 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-18T01:43:09.563 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-18T01:43:09.611 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-18T01:43:09.675 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-18T01:43:09.865 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-18T01:43:09.933 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-18T01:43:10.016 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-18T01:43:10.105 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-18T01:43:10.141 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-18T01:43:10.272 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-18T01:43:10.427 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-330.gc2ddf972.el9.n 32/37 2024-09-18T01:43:10.457 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mgr-2:19.1.1-330.gc2ddf972.el9.x86_64 33/37 2024-09-18T01:43:10.459 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-330.gc2ddf972.el9.noar 12/12 2024-09-18T01:43:10.459 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-330.gc2ddf972.el9 1/12 2024-09-18T01:43:10.459 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-330.gc2ddf972.el9.noar 2/12 2024-09-18T01:43:10.459 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-330.gc2ddf972.el9. 3/12 2024-09-18T01:43:10.459 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-18T01:43:10.459 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-18T01:43:10.459 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-18T01:43:10.459 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-18T01:43:10.459 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-18T01:43:10.459 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-18T01:43:10.459 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-18T01:43:10.459 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-18T01:43:10.484 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mgr-2:19.1.1-330.gc2ddf972.el9.x86_64 33/37 2024-09-18T01:43:10.484 INFO:teuthology.orchestra.run.smithi129.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T01:43:10.484 INFO:teuthology.orchestra.run.smithi129.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-18T01:43:10.484 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-18T01:43:10.484 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-18T01:43:10.484 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:43:10.781 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-18T01:43:10.781 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:43:10.781 INFO:teuthology.orchestra.run.smithi146.stdout:Installed: 2024-09-18T01:43:10.781 INFO:teuthology.orchestra.run.smithi146.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-18T01:43:10.781 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-grafana-dashboards-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-18T01:43:10.781 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-dashboard-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-18T01:43:10.781 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-prometheus-alerts-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-18T01:43:10.781 INFO:teuthology.orchestra.run.smithi146.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-18T01:43:10.781 INFO:teuthology.orchestra.run.smithi146.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-18T01:43:10.782 INFO:teuthology.orchestra.run.smithi146.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-18T01:43:10.782 INFO:teuthology.orchestra.run.smithi146.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-18T01:43:10.782 INFO:teuthology.orchestra.run.smithi146.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-18T01:43:10.782 INFO:teuthology.orchestra.run.smithi146.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-18T01:43:10.782 INFO:teuthology.orchestra.run.smithi146.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-18T01:43:10.782 INFO:teuthology.orchestra.run.smithi146.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-18T01:43:10.782 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:43:10.782 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2024-09-18T01:43:11.018 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-18T01:43:11.599 INFO:teuthology.orchestra.run.smithi146.stdout:Last metadata expiration check: 0:01:03 ago on Wed 18 Sep 2024 01:42:08 AM UTC. 2024-09-18T01:43:11.731 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies resolved. 2024-09-18T01:43:11.733 INFO:teuthology.orchestra.run.smithi146.stdout:====================================================================================== 2024-09-18T01:43:11.733 INFO:teuthology.orchestra.run.smithi146.stdout: Package Arch Version Repository Size 2024-09-18T01:43:11.733 INFO:teuthology.orchestra.run.smithi146.stdout:====================================================================================== 2024-09-18T01:43:11.733 INFO:teuthology.orchestra.run.smithi146.stdout:Installing: 2024-09-18T01:43:11.733 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 7.4 M 2024-09-18T01:43:11.733 INFO:teuthology.orchestra.run.smithi146.stdout:Installing dependencies: 2024-09-18T01:43:11.733 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-18T01:43:11.733 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-18T01:43:11.733 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-18T01:43:11.734 INFO:teuthology.orchestra.run.smithi146.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-18T01:43:11.734 INFO:teuthology.orchestra.run.smithi146.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-18T01:43:11.734 INFO:teuthology.orchestra.run.smithi146.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-18T01:43:11.734 INFO:teuthology.orchestra.run.smithi146.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-18T01:43:11.734 INFO:teuthology.orchestra.run.smithi146.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-18T01:43:11.734 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-18T01:43:11.734 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-18T01:43:11.734 INFO:teuthology.orchestra.run.smithi146.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-18T01:43:11.734 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:43:11.734 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction Summary 2024-09-18T01:43:11.734 INFO:teuthology.orchestra.run.smithi146.stdout:====================================================================================== 2024-09-18T01:43:11.734 INFO:teuthology.orchestra.run.smithi146.stdout:Install 12 Packages 2024-09-18T01:43:11.734 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:43:11.735 INFO:teuthology.orchestra.run.smithi146.stdout:Total download size: 38 M 2024-09-18T01:43:11.735 INFO:teuthology.orchestra.run.smithi146.stdout:Installed size: 212 M 2024-09-18T01:43:11.735 INFO:teuthology.orchestra.run.smithi146.stdout:Downloading Packages: 2024-09-18T01:43:11.925 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-osd-2:19.1.1-330.gc2ddf972.el9.x86_64 34/37 2024-09-18T01:43:11.953 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-osd-2:19.1.1-330.gc2ddf972.el9.x86_64 34/37 2024-09-18T01:43:11.953 INFO:teuthology.orchestra.run.smithi129.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T01:43:11.953 INFO:teuthology.orchestra.run.smithi129.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-18T01:43:11.953 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-18T01:43:11.953 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-18T01:43:11.953 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:43:12.365 INFO:teuthology.orchestra.run.smithi146.stdout:(1/12): ceph-mgr-diskprediction-local-19.1.1-33 15 MB/s | 7.4 MB 00:00 2024-09-18T01:43:12.392 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mon-2:19.1.1-330.gc2ddf972.el9.x86_64 35/37 2024-09-18T01:43:12.416 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mon-2:19.1.1-330.gc2ddf972.el9.x86_64 35/37 2024-09-18T01:43:12.416 INFO:teuthology.orchestra.run.smithi129.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T01:43:12.416 INFO:teuthology.orchestra.run.smithi129.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-18T01:43:12.416 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-18T01:43:12.416 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-18T01:43:12.416 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:43:12.465 INFO:teuthology.orchestra.run.smithi146.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 328 kB/s | 33 kB 00:00 2024-09-18T01:43:12.643 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mds-2:19.1.1-330.gc2ddf972.el9.x86_64 36/37 2024-09-18T01:43:12.648 INFO:teuthology.orchestra.run.smithi146.stdout:(3/12): libquadmath-11.5.0-2.el9.x86_64.rpm 249 kB/s | 191 kB 00:00 2024-09-18T01:43:12.667 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mds-2:19.1.1-330.gc2ddf972.el9.x86_64 36/37 2024-09-18T01:43:12.667 INFO:teuthology.orchestra.run.smithi129.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T01:43:12.667 INFO:teuthology.orchestra.run.smithi129.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-18T01:43:12.667 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-18T01:43:12.667 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-18T01:43:12.667 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:43:12.699 INFO:teuthology.orchestra.run.smithi146.stdout:(4/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 13 MB/s | 3.0 MB 00:00 2024-09-18T01:43:12.731 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-2:19.1.1-330.gc2ddf972.el9.x86_64 37/37 2024-09-18T01:43:12.732 INFO:teuthology.orchestra.run.smithi146.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 1.1 MB/s | 38 kB 00:00 2024-09-18T01:43:12.757 INFO:teuthology.orchestra.run.smithi146.stdout:(6/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 168 kB/s | 18 kB 00:00 2024-09-18T01:43:12.849 INFO:teuthology.orchestra.run.smithi146.stdout:(7/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 42 MB/s | 4.9 MB 00:00 2024-09-18T01:43:12.966 INFO:teuthology.orchestra.run.smithi146.stdout:(8/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 44 MB/s | 5.1 MB 00:00 2024-09-18T01:43:13.000 INFO:teuthology.orchestra.run.smithi146.stdout:(9/12): libgfortran-11.5.0-2.el9.x86_64.rpm 715 kB/s | 801 kB 00:01 2024-09-18T01:43:13.025 INFO:teuthology.orchestra.run.smithi146.stdout:(10/12): python3-devel-3.9.19-8.el9.x86_64.rpm 915 kB/s | 245 kB 00:00 2024-09-18T01:43:13.059 INFO:teuthology.orchestra.run.smithi146.stdout:(11/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 2.7 MB/s | 250 kB 00:00 2024-09-18T01:43:13.950 INFO:teuthology.orchestra.run.smithi146.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 17 MB/s | 16 MB 00:00 2024-09-18T01:43:13.952 INFO:teuthology.orchestra.run.smithi146.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:43:13.952 INFO:teuthology.orchestra.run.smithi146.stdout:Total 17 MB/s | 38 MB 00:02 2024-09-18T01:43:14.306 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction check 2024-09-18T01:43:14.333 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction check succeeded. 2024-09-18T01:43:14.333 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction test 2024-09-18T01:43:14.626 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-2:19.1.1-330.gc2ddf972.el9.x86_64 37/37 2024-09-18T01:43:14.626 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-2:19.1.1-330.gc2ddf972.el9.x86_64 1/37 2024-09-18T01:43:14.627 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mds-2:19.1.1-330.gc2ddf972.el9.x86_64 2/37 2024-09-18T01:43:14.627 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mgr-2:19.1.1-330.gc2ddf972.el9.x86_64 3/37 2024-09-18T01:43:14.627 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mon-2:19.1.1-330.gc2ddf972.el9.x86_64 4/37 2024-09-18T01:43:14.627 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-osd-2:19.1.1-330.gc2ddf972.el9.x86_64 5/37 2024-09-18T01:43:14.627 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-330.gc2ddf972.el9.n 6/37 2024-09-18T01:43:14.627 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-18T01:43:14.627 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-18T01:43:14.627 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-18T01:43:14.627 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-18T01:43:14.627 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-18T01:43:14.627 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-18T01:43:14.627 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-18T01:43:14.627 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-18T01:43:14.628 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-18T01:43:14.628 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-18T01:43:14.628 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-18T01:43:14.628 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-18T01:43:14.628 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-18T01:43:14.628 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-18T01:43:14.628 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-18T01:43:14.628 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-18T01:43:14.628 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-18T01:43:14.628 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-18T01:43:14.628 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-18T01:43:14.628 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-18T01:43:14.628 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-18T01:43:14.629 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-18T01:43:14.630 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-18T01:43:14.630 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-18T01:43:14.630 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-18T01:43:14.630 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-18T01:43:14.630 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-18T01:43:14.630 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-18T01:43:14.630 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-18T01:43:14.630 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-18T01:43:14.769 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction test succeeded. 2024-09-18T01:43:14.769 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction 2024-09-18T01:43:15.525 INFO:teuthology.orchestra.run.smithi146.stdout: Preparing : 1/1 2024-09-18T01:43:15.586 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-18T01:43:15.612 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-18T01:43:15.613 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:43:15.613 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-09-18T01:43:15.613 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:43:15.613 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mds-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:43:15.613 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:43:15.613 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-modules-core-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-18T01:43:15.613 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mon-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:43:15.613 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-osd-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:43:15.613 INFO:teuthology.orchestra.run.smithi129.stdout: lua-5.4.4-4.el9.x86_64 2024-09-18T01:43:15.613 INFO:teuthology.orchestra.run.smithi129.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-18T01:43:15.613 INFO:teuthology.orchestra.run.smithi129.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-18T01:43:15.614 INFO:teuthology.orchestra.run.smithi129.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-18T01:43:15.614 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-18T01:43:15.614 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-18T01:43:15.614 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-18T01:43:15.614 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-18T01:43:15.614 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-18T01:43:15.614 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-18T01:43:15.614 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-18T01:43:15.614 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-18T01:43:15.614 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-18T01:43:15.614 INFO:teuthology.orchestra.run.smithi129.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-18T01:43:15.615 INFO:teuthology.orchestra.run.smithi129.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-18T01:43:15.615 INFO:teuthology.orchestra.run.smithi129.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-18T01:43:15.615 INFO:teuthology.orchestra.run.smithi129.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-18T01:43:15.615 INFO:teuthology.orchestra.run.smithi129.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-18T01:43:15.615 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-18T01:43:15.615 INFO:teuthology.orchestra.run.smithi129.stdout: python3-ply-3.11-14.el9.noarch 2024-09-18T01:43:15.615 INFO:teuthology.orchestra.run.smithi129.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-18T01:43:15.615 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-18T01:43:15.615 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-18T01:43:15.615 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-18T01:43:15.615 INFO:teuthology.orchestra.run.smithi129.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-18T01:43:15.615 INFO:teuthology.orchestra.run.smithi129.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-18T01:43:15.615 INFO:teuthology.orchestra.run.smithi129.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-18T01:43:15.615 INFO:teuthology.orchestra.run.smithi129.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-18T01:43:15.616 INFO:teuthology.orchestra.run.smithi129.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-18T01:43:15.616 INFO:teuthology.orchestra.run.smithi129.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-18T01:43:15.616 INFO:teuthology.orchestra.run.smithi129.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-18T01:43:15.616 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:43:15.616 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-09-18T01:43:15.623 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-18T01:43:15.732 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-18T01:43:15.783 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-18T01:43:15.968 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-18T01:43:15.998 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-18T01:43:16.023 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install ceph-base 2024-09-18T01:43:16.076 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-18T01:43:16.608 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:00:52 ago on Wed 18 Sep 2024 01:42:24 AM UTC. 2024-09-18T01:43:16.698 INFO:teuthology.orchestra.run.smithi129.stdout:Package ceph-base-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-18T01:43:16.740 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-09-18T01:43:16.741 INFO:teuthology.orchestra.run.smithi129.stdout:Nothing to do. 2024-09-18T01:43:16.741 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-09-18T01:43:16.744 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-18T01:43:16.816 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install cephadm 2024-09-18T01:43:16.862 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-18T01:43:17.395 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:00:53 ago on Wed 18 Sep 2024 01:42:24 AM UTC. 2024-09-18T01:43:17.529 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-09-18T01:43:17.529 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-18T01:43:17.529 INFO:teuthology.orchestra.run.smithi129.stdout: Package Arch Version Repository Size 2024-09-18T01:43:17.530 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-18T01:43:17.530 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-09-18T01:43:17.530 INFO:teuthology.orchestra.run.smithi129.stdout: cephadm noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 765 k 2024-09-18T01:43:17.530 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:43:17.530 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-09-18T01:43:17.530 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-18T01:43:17.530 INFO:teuthology.orchestra.run.smithi129.stdout:Install 1 Package 2024-09-18T01:43:17.530 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:43:17.530 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 765 k 2024-09-18T01:43:17.530 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 771 k 2024-09-18T01:43:17.530 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-09-18T01:43:17.794 INFO:teuthology.orchestra.run.smithi129.stdout:cephadm-19.1.1-330.gc2ddf972.el9.noarch.rpm 2.8 MB/s | 765 kB 00:00 2024-09-18T01:43:17.795 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:43:17.795 INFO:teuthology.orchestra.run.smithi129.stdout:Total 2.8 MB/s | 765 kB 00:00 2024-09-18T01:43:17.795 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-09-18T01:43:17.800 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-09-18T01:43:17.800 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-09-18T01:43:17.806 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-09-18T01:43:17.806 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-09-18T01:43:17.880 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-09-18T01:43:18.121 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-18T01:43:18.355 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 1/1 2024-09-18T01:43:18.432 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 1/1 2024-09-18T01:43:18.777 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 1/1 2024-09-18T01:43:19.036 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 1/1 2024-09-18T01:43:19.036 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:43:19.036 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-09-18T01:43:19.036 INFO:teuthology.orchestra.run.smithi129.stdout: cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-18T01:43:19.036 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:43:19.036 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-09-18T01:43:19.200 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-18T01:43:19.230 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-330.gc2ddf9 12/12 2024-09-18T01:43:19.249 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install ceph-immutable-object-cache 2024-09-18T01:43:19.845 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:00:55 ago on Wed 18 Sep 2024 01:42:24 AM UTC. 2024-09-18T01:43:19.982 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-09-18T01:43:19.983 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-18T01:43:19.983 INFO:teuthology.orchestra.run.smithi129.stdout: Package Arch Version Repo Size 2024-09-18T01:43:19.983 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-18T01:43:19.983 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-09-18T01:43:19.983 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 145 k 2024-09-18T01:43:19.983 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:43:19.983 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-09-18T01:43:19.983 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-18T01:43:19.983 INFO:teuthology.orchestra.run.smithi129.stdout:Install 1 Package 2024-09-18T01:43:19.983 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:43:19.983 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 145 k 2024-09-18T01:43:19.984 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 435 k 2024-09-18T01:43:19.984 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-09-18T01:43:20.193 INFO:teuthology.orchestra.run.smithi129.stdout:ceph-immutable-object-cache-19.1.1-330.gc2ddf97 696 kB/s | 145 kB 00:00 2024-09-18T01:43:20.194 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:43:20.194 INFO:teuthology.orchestra.run.smithi129.stdout:Total 690 kB/s | 145 kB 00:00 2024-09-18T01:43:20.194 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-09-18T01:43:20.201 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-09-18T01:43:20.201 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-09-18T01:43:20.258 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-09-18T01:43:20.258 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-09-18T01:43:20.402 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-09-18T01:43:20.469 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-330.gc2ddf972.e 1/1 2024-09-18T01:43:20.494 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-330.gc2ddf972.e 1/1 2024-09-18T01:43:20.495 INFO:teuthology.orchestra.run.smithi129.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T01:43:20.495 INFO:teuthology.orchestra.run.smithi129.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-18T01:43:20.495 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:43:21.477 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-330.gc2ddf972.e 1/1 2024-09-18T01:43:21.477 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:43:21.478 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-09-18T01:43:21.478 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-immutable-object-cache-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:43:21.478 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:43:21.478 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-09-18T01:43:21.682 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install ceph-mgr 2024-09-18T01:43:21.707 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-330.gc2ddf9 12/12 2024-09-18T01:43:21.707 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-330.gc2ddf9 1/12 2024-09-18T01:43:21.707 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-18T01:43:21.707 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-18T01:43:21.707 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-18T01:43:21.707 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-18T01:43:21.708 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-18T01:43:21.708 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-18T01:43:21.708 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-18T01:43:21.708 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-18T01:43:21.708 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-18T01:43:21.708 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-18T01:43:22.182 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-18T01:43:22.182 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:43:22.182 INFO:teuthology.orchestra.run.smithi146.stdout:Installed: 2024-09-18T01:43:22.182 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-diskprediction-local-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-18T01:43:22.182 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-18T01:43:22.182 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-18T01:43:22.182 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-18T01:43:22.182 INFO:teuthology.orchestra.run.smithi146.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-18T01:43:22.183 INFO:teuthology.orchestra.run.smithi146.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-18T01:43:22.183 INFO:teuthology.orchestra.run.smithi146.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-18T01:43:22.183 INFO:teuthology.orchestra.run.smithi146.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-18T01:43:22.183 INFO:teuthology.orchestra.run.smithi146.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-18T01:43:22.183 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-18T01:43:22.183 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-18T01:43:22.183 INFO:teuthology.orchestra.run.smithi146.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-18T01:43:22.183 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:43:22.183 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2024-09-18T01:43:22.272 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:00:58 ago on Wed 18 Sep 2024 01:42:24 AM UTC. 2024-09-18T01:43:22.366 INFO:teuthology.orchestra.run.smithi129.stdout:Package ceph-mgr-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-18T01:43:22.409 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-09-18T01:43:22.410 INFO:teuthology.orchestra.run.smithi129.stdout:Nothing to do. 2024-09-18T01:43:22.410 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-09-18T01:43:22.495 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install ceph-mgr-dashboard 2024-09-18T01:43:22.544 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum -y install ceph-mgr-rook 2024-09-18T01:43:23.071 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:00:59 ago on Wed 18 Sep 2024 01:42:24 AM UTC. 2024-09-18T01:43:23.135 INFO:teuthology.orchestra.run.smithi146.stdout:Last metadata expiration check: 0:01:15 ago on Wed 18 Sep 2024 01:42:08 AM UTC. 2024-09-18T01:43:23.201 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-09-18T01:43:23.202 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-18T01:43:23.202 INFO:teuthology.orchestra.run.smithi129.stdout: Package Arch Version Repository Size 2024-09-18T01:43:23.202 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-18T01:43:23.202 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-09-18T01:43:23.203 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-dashboard noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 3.6 M 2024-09-18T01:43:23.203 INFO:teuthology.orchestra.run.smithi129.stdout:Installing dependencies: 2024-09-18T01:43:23.203 INFO:teuthology.orchestra.run.smithi129.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-18T01:43:23.203 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-grafana-dashboards noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 32 k 2024-09-18T01:43:23.203 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-prometheus-alerts noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 16 k 2024-09-18T01:43:23.203 INFO:teuthology.orchestra.run.smithi129.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-18T01:43:23.203 INFO:teuthology.orchestra.run.smithi129.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-18T01:43:23.203 INFO:teuthology.orchestra.run.smithi129.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-18T01:43:23.203 INFO:teuthology.orchestra.run.smithi129.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-18T01:43:23.203 INFO:teuthology.orchestra.run.smithi129.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-18T01:43:23.203 INFO:teuthology.orchestra.run.smithi129.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-18T01:43:23.203 INFO:teuthology.orchestra.run.smithi129.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-18T01:43:23.203 INFO:teuthology.orchestra.run.smithi129.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-18T01:43:23.204 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:43:23.204 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-09-18T01:43:23.204 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-18T01:43:23.204 INFO:teuthology.orchestra.run.smithi129.stdout:Install 12 Packages 2024-09-18T01:43:23.204 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:43:23.204 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 8.7 M 2024-09-18T01:43:23.204 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 104 M 2024-09-18T01:43:23.205 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-09-18T01:43:23.269 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies resolved. 2024-09-18T01:43:23.270 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-18T01:43:23.270 INFO:teuthology.orchestra.run.smithi146.stdout: Package Arch Version Repository Size 2024-09-18T01:43:23.270 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-18T01:43:23.270 INFO:teuthology.orchestra.run.smithi146.stdout:Installing: 2024-09-18T01:43:23.270 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-rook noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 49 k 2024-09-18T01:43:23.271 INFO:teuthology.orchestra.run.smithi146.stdout:Installing dependencies: 2024-09-18T01:43:23.271 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-18T01:43:23.271 INFO:teuthology.orchestra.run.smithi146.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-18T01:43:23.271 INFO:teuthology.orchestra.run.smithi146.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-18T01:43:23.271 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-18T01:43:23.271 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-18T01:43:23.271 INFO:teuthology.orchestra.run.smithi146.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-18T01:43:23.271 INFO:teuthology.orchestra.run.smithi146.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-18T01:43:23.271 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-18T01:43:23.271 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-18T01:43:23.271 INFO:teuthology.orchestra.run.smithi146.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-18T01:43:23.271 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-18T01:43:23.271 INFO:teuthology.orchestra.run.smithi146.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-18T01:43:23.271 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:43:23.271 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction Summary 2024-09-18T01:43:23.272 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-18T01:43:23.272 INFO:teuthology.orchestra.run.smithi146.stdout:Install 13 Packages 2024-09-18T01:43:23.272 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:43:23.272 INFO:teuthology.orchestra.run.smithi146.stdout:Total download size: 2.2 M 2024-09-18T01:43:23.272 INFO:teuthology.orchestra.run.smithi146.stdout:Installed size: 26 M 2024-09-18T01:43:23.272 INFO:teuthology.orchestra.run.smithi146.stdout:Downloading Packages: 2024-09-18T01:43:23.731 INFO:teuthology.orchestra.run.smithi146.stdout:(1/13): ceph-mgr-rook-19.1.1-330.gc2ddf972.el9. 287 kB/s | 49 kB 00:00 2024-09-18T01:43:24.106 INFO:teuthology.orchestra.run.smithi146.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 35 kB/s | 19 kB 00:00 2024-09-18T01:43:24.132 INFO:teuthology.orchestra.run.smithi146.stdout:(3/13): python3-jsonpatch-1.21-16.el9.noarch.rp 45 kB/s | 26 kB 00:00 2024-09-18T01:43:24.225 INFO:teuthology.orchestra.run.smithi129.stdout:(1/12): ceph-grafana-dashboards-19.1.1-330.gc2d 206 kB/s | 32 kB 00:00 2024-09-18T01:43:24.251 INFO:teuthology.orchestra.run.smithi129.stdout:(2/12): ceph-prometheus-alerts-19.1.1-330.gc2dd 91 kB/s | 16 kB 00:00 2024-09-18T01:43:24.426 INFO:teuthology.orchestra.run.smithi129.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.5 MB/s | 269 kB 00:00 2024-09-18T01:43:24.485 INFO:teuthology.orchestra.run.smithi129.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 3.9 MB/s | 1.0 MB 00:00 2024-09-18T01:43:24.498 INFO:teuthology.orchestra.run.smithi146.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 290 kB/s | 222 kB 00:00 2024-09-18T01:43:24.585 INFO:teuthology.orchestra.run.smithi129.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 5.4 MB/s | 548 kB 00:00 2024-09-18T01:43:24.652 INFO:teuthology.orchestra.run.smithi129.stdout:(6/12): ceph-mgr-dashboard-19.1.1-330.gc2ddf972 6.1 MB/s | 3.6 MB 00:00 2024-09-18T01:43:24.677 INFO:teuthology.orchestra.run.smithi129.stdout:(7/12): grpc-data-1.46.7-10.el9.noarch.rpm 211 kB/s | 19 kB 00:00 2024-09-18T01:43:24.711 INFO:teuthology.orchestra.run.smithi129.stdout:(8/12): protobuf-compiler-3.14.0-13.el9.x86_64. 3.0 MB/s | 863 kB 00:00 2024-09-18T01:43:24.736 INFO:teuthology.orchestra.run.smithi129.stdout:(9/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 2.8 MB/s | 144 kB 00:00 2024-09-18T01:43:24.778 INFO:teuthology.orchestra.run.smithi129.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 5.4 MB/s | 188 kB 00:00 2024-09-18T01:43:24.812 INFO:teuthology.orchestra.run.smithi129.stdout:(11/12): python3-repoze-lru-0.7-16.el9.noarch.r 312 kB/s | 31 kB 00:00 2024-09-18T01:43:24.849 INFO:teuthology.orchestra.run.smithi146.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 214 kB/s | 159 kB 00:00 2024-09-18T01:43:24.900 INFO:teuthology.orchestra.run.smithi146.stdout:(6/13): python3-cachetools-4.2.4-1.el9.noarch.r 650 kB/s | 32 kB 00:00 2024-09-18T01:43:24.924 INFO:teuthology.orchestra.run.smithi146.stdout:(7/13): python3-certifi-2023.05.07-4.el9.noarch 563 kB/s | 14 kB 00:00 2024-09-18T01:43:24.945 INFO:teuthology.orchestra.run.smithi129.stdout:(12/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 7.0 MB/s | 2.0 MB 00:00 2024-09-18T01:43:24.950 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:43:24.950 INFO:teuthology.orchestra.run.smithi129.stdout:Total 5.0 MB/s | 8.7 MB 00:01 2024-09-18T01:43:24.958 INFO:teuthology.orchestra.run.smithi146.stdout:(8/13): python3-google-auth-2.34.0-1.el9.noarch 6.5 MB/s | 220 kB 00:00 2024-09-18T01:43:24.983 INFO:teuthology.orchestra.run.smithi146.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 328 kB/s | 279 kB 00:00 2024-09-18T01:43:25.003 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-09-18T01:43:25.022 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-09-18T01:43:25.022 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-09-18T01:43:25.033 INFO:teuthology.orchestra.run.smithi146.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-18T01:43:25.067 INFO:teuthology.orchestra.run.smithi146.stdout:(11/13): python3-kubernetes-26.1.0-2.el9.noarch 9.4 MB/s | 1.0 MB 00:00 2024-09-18T01:43:25.092 INFO:teuthology.orchestra.run.smithi146.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.5 MB/s | 90 kB 00:00 2024-09-18T01:43:25.109 INFO:teuthology.orchestra.run.smithi146.stdout:(13/13): python3-requests-oauthlib-1.3.0-12.el9 88 kB/s | 54 kB 00:00 2024-09-18T01:43:25.112 INFO:teuthology.orchestra.run.smithi146.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:43:25.113 INFO:teuthology.orchestra.run.smithi146.stdout:Total 1.2 MB/s | 2.2 MB 00:01 2024-09-18T01:43:25.181 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction check 2024-09-18T01:43:25.197 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction check succeeded. 2024-09-18T01:43:25.198 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction test 2024-09-18T01:43:25.223 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-09-18T01:43:25.223 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-09-18T01:43:25.292 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction test succeeded. 2024-09-18T01:43:25.292 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction 2024-09-18T01:43:25.746 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-09-18T01:43:25.816 INFO:teuthology.orchestra.run.smithi146.stdout: Preparing : 1/1 2024-09-18T01:43:25.820 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-18T01:43:25.881 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-18T01:43:25.927 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-18T01:43:25.967 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-18T01:43:25.976 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-18T01:43:26.052 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-18T01:43:26.078 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-18T01:43:26.107 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-18T01:43:26.144 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-18T01:43:26.185 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-18T01:43:26.208 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-18T01:43:26.294 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-18T01:43:26.297 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-18T01:43:26.339 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-18T01:43:26.367 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-18T01:43:26.399 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-18T01:43:26.407 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-330.gc2ddf972.el9. 10/12 2024-09-18T01:43:26.454 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-18T01:43:27.173 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-18T01:43:27.234 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-18T01:43:27.268 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-18T01:43:27.316 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-18T01:43:27.346 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-rook-2:19.1.1-330.gc2ddf972.el9.noarch 13/13 2024-09-18T01:43:27.461 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-330.gc2ddf972.el9 11/12 2024-09-18T01:43:27.500 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-330.gc2ddf972.el9.noar 12/12 2024-09-18T01:43:28.111 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-330.gc2ddf972.el9.noarch 13/13 2024-09-18T01:43:28.111 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-rook-2:19.1.1-330.gc2ddf972.el9.noarch 1/13 2024-09-18T01:43:28.111 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-18T01:43:28.111 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-18T01:43:28.111 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-18T01:43:28.111 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-18T01:43:28.111 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-18T01:43:28.111 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-18T01:43:28.111 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-18T01:43:28.111 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-18T01:43:28.112 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-18T01:43:28.112 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-18T01:43:28.112 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-18T01:43:28.445 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-18T01:43:28.445 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:43:28.446 INFO:teuthology.orchestra.run.smithi146.stdout:Installed: 2024-09-18T01:43:28.446 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-rook-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-18T01:43:28.446 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-18T01:43:28.446 INFO:teuthology.orchestra.run.smithi146.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-18T01:43:28.446 INFO:teuthology.orchestra.run.smithi146.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-18T01:43:28.446 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-18T01:43:28.446 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-18T01:43:28.446 INFO:teuthology.orchestra.run.smithi146.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-18T01:43:28.446 INFO:teuthology.orchestra.run.smithi146.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-18T01:43:28.446 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-18T01:43:28.446 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-18T01:43:28.446 INFO:teuthology.orchestra.run.smithi146.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-18T01:43:28.446 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-18T01:43:28.447 INFO:teuthology.orchestra.run.smithi146.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-18T01:43:28.447 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:43:28.447 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2024-09-18T01:43:28.747 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum -y install ceph-mgr-cephadm 2024-09-18T01:43:28.926 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-330.gc2ddf972.el9.noar 12/12 2024-09-18T01:43:28.927 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-330.gc2ddf972.el9 1/12 2024-09-18T01:43:28.927 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-330.gc2ddf972.el9.noar 2/12 2024-09-18T01:43:28.927 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-330.gc2ddf972.el9. 3/12 2024-09-18T01:43:28.927 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-18T01:43:28.927 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-18T01:43:28.927 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-18T01:43:28.927 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-18T01:43:28.927 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-18T01:43:28.927 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-18T01:43:28.927 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-18T01:43:28.927 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-18T01:43:29.242 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-18T01:43:29.243 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:43:29.243 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-09-18T01:43:29.243 INFO:teuthology.orchestra.run.smithi129.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-18T01:43:29.243 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-grafana-dashboards-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-18T01:43:29.243 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-dashboard-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-18T01:43:29.243 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-prometheus-alerts-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-18T01:43:29.243 INFO:teuthology.orchestra.run.smithi129.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-18T01:43:29.243 INFO:teuthology.orchestra.run.smithi129.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-18T01:43:29.243 INFO:teuthology.orchestra.run.smithi129.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-18T01:43:29.243 INFO:teuthology.orchestra.run.smithi129.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-18T01:43:29.243 INFO:teuthology.orchestra.run.smithi129.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-18T01:43:29.244 INFO:teuthology.orchestra.run.smithi129.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-18T01:43:29.244 INFO:teuthology.orchestra.run.smithi129.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-18T01:43:29.244 INFO:teuthology.orchestra.run.smithi129.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-18T01:43:29.244 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:43:29.244 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-09-18T01:43:29.333 INFO:teuthology.orchestra.run.smithi146.stdout:Last metadata expiration check: 0:01:21 ago on Wed 18 Sep 2024 01:42:08 AM UTC. 2024-09-18T01:43:29.467 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies resolved. 2024-09-18T01:43:29.468 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-18T01:43:29.468 INFO:teuthology.orchestra.run.smithi146.stdout: Package Arch Version Repository Size 2024-09-18T01:43:29.468 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-18T01:43:29.468 INFO:teuthology.orchestra.run.smithi146.stdout:Installing: 2024-09-18T01:43:29.468 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-cephadm noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 146 k 2024-09-18T01:43:29.468 INFO:teuthology.orchestra.run.smithi146.stdout:Installing dependencies: 2024-09-18T01:43:29.468 INFO:teuthology.orchestra.run.smithi146.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-18T01:43:29.468 INFO:teuthology.orchestra.run.smithi146.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-18T01:43:29.468 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-18T01:43:29.468 INFO:teuthology.orchestra.run.smithi146.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-18T01:43:29.469 INFO:teuthology.orchestra.run.smithi146.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-18T01:43:29.469 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:43:29.469 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction Summary 2024-09-18T01:43:29.469 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-18T01:43:29.469 INFO:teuthology.orchestra.run.smithi146.stdout:Install 6 Packages 2024-09-18T01:43:29.469 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:43:29.469 INFO:teuthology.orchestra.run.smithi146.stdout:Total download size: 7.0 M 2024-09-18T01:43:29.470 INFO:teuthology.orchestra.run.smithi146.stdout:Installed size: 33 M 2024-09-18T01:43:29.470 INFO:teuthology.orchestra.run.smithi146.stdout:Downloading Packages: 2024-09-18T01:43:29.502 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-18T01:43:30.035 INFO:teuthology.orchestra.run.smithi146.stdout:(1/6): ceph-mgr-cephadm-19.1.1-330.gc2ddf972.el 688 kB/s | 146 kB 00:00 2024-09-18T01:43:30.075 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:06 ago on Wed 18 Sep 2024 01:42:24 AM UTC. 2024-09-18T01:43:30.160 INFO:teuthology.orchestra.run.smithi146.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 4.3 MB/s | 548 kB 00:00 2024-09-18T01:43:30.186 INFO:teuthology.orchestra.run.smithi146.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.4 MB/s | 58 kB 00:00 2024-09-18T01:43:30.207 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-09-18T01:43:30.208 INFO:teuthology.orchestra.run.smithi129.stdout:====================================================================================== 2024-09-18T01:43:30.208 INFO:teuthology.orchestra.run.smithi129.stdout: Package Arch Version Repository Size 2024-09-18T01:43:30.208 INFO:teuthology.orchestra.run.smithi129.stdout:====================================================================================== 2024-09-18T01:43:30.208 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-09-18T01:43:30.208 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 7.4 M 2024-09-18T01:43:30.209 INFO:teuthology.orchestra.run.smithi129.stdout:Installing dependencies: 2024-09-18T01:43:30.209 INFO:teuthology.orchestra.run.smithi129.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-18T01:43:30.209 INFO:teuthology.orchestra.run.smithi129.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-18T01:43:30.209 INFO:teuthology.orchestra.run.smithi129.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-18T01:43:30.209 INFO:teuthology.orchestra.run.smithi129.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-18T01:43:30.209 INFO:teuthology.orchestra.run.smithi129.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-18T01:43:30.210 INFO:teuthology.orchestra.run.smithi129.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-18T01:43:30.210 INFO:teuthology.orchestra.run.smithi129.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-18T01:43:30.210 INFO:teuthology.orchestra.run.smithi129.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-18T01:43:30.210 INFO:teuthology.orchestra.run.smithi129.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-18T01:43:30.210 INFO:teuthology.orchestra.run.smithi129.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-18T01:43:30.211 INFO:teuthology.orchestra.run.smithi129.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-18T01:43:30.211 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:43:30.211 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-09-18T01:43:30.211 INFO:teuthology.orchestra.run.smithi129.stdout:====================================================================================== 2024-09-18T01:43:30.211 INFO:teuthology.orchestra.run.smithi129.stdout:Install 12 Packages 2024-09-18T01:43:30.211 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:43:30.212 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 38 M 2024-09-18T01:43:30.213 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 212 M 2024-09-18T01:43:30.213 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-09-18T01:43:30.219 INFO:teuthology.orchestra.run.smithi146.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.2 MB/s | 74 kB 00:00 2024-09-18T01:43:30.620 INFO:teuthology.orchestra.run.smithi146.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 311 kB/s | 248 kB 00:00 2024-09-18T01:43:30.955 INFO:teuthology.orchestra.run.smithi129.stdout:(1/12): ceph-mgr-diskprediction-local-19.1.1-33 11 MB/s | 7.4 MB 00:00 2024-09-18T01:43:31.003 INFO:teuthology.orchestra.run.smithi146.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 5.1 MB/s | 6.0 MB 00:01 2024-09-18T01:43:31.005 INFO:teuthology.orchestra.run.smithi146.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:43:31.005 INFO:teuthology.orchestra.run.smithi146.stdout:Total 4.6 MB/s | 7.0 MB 00:01 2024-09-18T01:43:31.038 INFO:teuthology.orchestra.run.smithi129.stdout:(2/12): libquadmath-11.5.0-2.el9.x86_64.rpm 260 kB/s | 191 kB 00:00 2024-09-18T01:43:31.055 INFO:teuthology.orchestra.run.smithi129.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 326 kB/s | 33 kB 00:00 2024-09-18T01:43:31.076 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction check 2024-09-18T01:43:31.088 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction check succeeded. 2024-09-18T01:43:31.088 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction test 2024-09-18T01:43:31.097 INFO:teuthology.orchestra.run.smithi129.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 437 kB/s | 18 kB 00:00 2024-09-18T01:43:31.147 INFO:teuthology.orchestra.run.smithi129.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 766 kB/s | 38 kB 00:00 2024-09-18T01:43:31.189 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction test succeeded. 2024-09-18T01:43:31.190 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction 2024-09-18T01:43:31.206 INFO:teuthology.orchestra.run.smithi129.stdout:(6/12): libgfortran-11.5.0-2.el9.x86_64.rpm 888 kB/s | 801 kB 00:00 2024-09-18T01:43:31.373 INFO:teuthology.orchestra.run.smithi129.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 8.9 MB/s | 3.0 MB 00:00 2024-09-18T01:43:31.407 INFO:teuthology.orchestra.run.smithi129.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.2 MB/s | 245 kB 00:00 2024-09-18T01:43:31.482 INFO:teuthology.orchestra.run.smithi129.stdout:(9/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 15 MB/s | 4.9 MB 00:00 2024-09-18T01:43:31.499 INFO:teuthology.orchestra.run.smithi146.stdout: Preparing : 1/1 2024-09-18T01:43:31.557 INFO:teuthology.orchestra.run.smithi129.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 28 MB/s | 5.1 MB 00:00 2024-09-18T01:43:31.583 INFO:teuthology.orchestra.run.smithi129.stdout:(11/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 1.4 MB/s | 250 kB 00:00 2024-09-18T01:43:31.690 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-18T01:43:31.739 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-18T01:43:31.867 INFO:teuthology.orchestra.run.smithi129.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 42 MB/s | 16 MB 00:00 2024-09-18T01:43:31.867 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:43:31.867 INFO:teuthology.orchestra.run.smithi129.stdout:Total 23 MB/s | 38 MB 00:01 2024-09-18T01:43:32.224 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-09-18T01:43:32.250 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-09-18T01:43:32.250 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-09-18T01:43:32.276 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-18T01:43:32.368 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-18T01:43:32.431 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-18T01:43:32.458 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 6/6 2024-09-18T01:43:32.687 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-09-18T01:43:32.687 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-09-18T01:43:33.202 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 6/6 2024-09-18T01:43:33.202 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 1/6 2024-09-18T01:43:33.203 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-18T01:43:33.203 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-18T01:43:33.203 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-18T01:43:33.203 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-18T01:43:33.447 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-09-18T01:43:33.479 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-18T01:43:33.479 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:43:33.479 INFO:teuthology.orchestra.run.smithi146.stdout:Installed: 2024-09-18T01:43:33.479 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-18T01:43:33.479 INFO:teuthology.orchestra.run.smithi146.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-18T01:43:33.479 INFO:teuthology.orchestra.run.smithi146.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-18T01:43:33.480 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-18T01:43:33.480 INFO:teuthology.orchestra.run.smithi146.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-18T01:43:33.480 INFO:teuthology.orchestra.run.smithi146.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-18T01:43:33.480 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:43:33.480 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2024-09-18T01:43:33.528 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-18T01:43:33.574 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-18T01:43:33.675 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-18T01:43:33.715 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-18T01:43:33.754 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum -y install ceph-fuse 2024-09-18T01:43:33.899 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-18T01:43:33.931 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-18T01:43:34.009 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-18T01:43:34.337 INFO:teuthology.orchestra.run.smithi146.stdout:Last metadata expiration check: 0:01:26 ago on Wed 18 Sep 2024 01:42:08 AM UTC. 2024-09-18T01:43:34.470 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies resolved. 2024-09-18T01:43:34.470 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-18T01:43:34.470 INFO:teuthology.orchestra.run.smithi146.stdout: Package Arch Version Repository Size 2024-09-18T01:43:34.471 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-18T01:43:34.471 INFO:teuthology.orchestra.run.smithi146.stdout:Installing: 2024-09-18T01:43:34.471 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-fuse x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 897 k 2024-09-18T01:43:34.471 INFO:teuthology.orchestra.run.smithi146.stdout:Installing dependencies: 2024-09-18T01:43:34.471 INFO:teuthology.orchestra.run.smithi146.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-18T01:43:34.471 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:43:34.471 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction Summary 2024-09-18T01:43:34.471 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-18T01:43:34.471 INFO:teuthology.orchestra.run.smithi146.stdout:Install 2 Packages 2024-09-18T01:43:34.471 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:43:34.472 INFO:teuthology.orchestra.run.smithi146.stdout:Total download size: 977 k 2024-09-18T01:43:34.472 INFO:teuthology.orchestra.run.smithi146.stdout:Installed size: 2.9 M 2024-09-18T01:43:34.472 INFO:teuthology.orchestra.run.smithi146.stdout:Downloading Packages: 2024-09-18T01:43:34.665 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-18T01:43:34.730 INFO:teuthology.orchestra.run.smithi146.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 580 kB/s | 80 kB 00:00 2024-09-18T01:43:34.778 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-18T01:43:34.863 INFO:teuthology.orchestra.run.smithi146.stdout:(2/2): ceph-fuse-19.1.1-330.gc2ddf972.el9.x86_6 3.2 MB/s | 897 kB 00:00 2024-09-18T01:43:34.863 INFO:teuthology.orchestra.run.smithi146.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:43:34.864 INFO:teuthology.orchestra.run.smithi146.stdout:Total 2.4 MB/s | 977 kB 00:00 2024-09-18T01:43:34.876 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction check 2024-09-18T01:43:34.898 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction check succeeded. 2024-09-18T01:43:34.898 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction test 2024-09-18T01:43:34.980 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction test succeeded. 2024-09-18T01:43:34.980 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction 2024-09-18T01:43:35.215 INFO:teuthology.orchestra.run.smithi146.stdout: Preparing : 1/1 2024-09-18T01:43:35.360 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-18T01:43:35.437 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 2/2 2024-09-18T01:43:36.020 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-18T01:43:36.167 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 2/2 2024-09-18T01:43:36.167 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 1/2 2024-09-18T01:43:36.449 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-18T01:43:36.449 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:43:36.449 INFO:teuthology.orchestra.run.smithi146.stdout:Installed: 2024-09-18T01:43:36.449 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-18T01:43:36.449 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:43:36.449 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2024-09-18T01:43:36.751 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum -y install ceph-volume 2024-09-18T01:43:37.047 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-18T01:43:37.074 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-330.gc2ddf9 12/12 2024-09-18T01:43:37.356 INFO:teuthology.orchestra.run.smithi146.stdout:Last metadata expiration check: 0:01:29 ago on Wed 18 Sep 2024 01:42:08 AM UTC. 2024-09-18T01:43:37.490 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies resolved. 2024-09-18T01:43:37.491 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-18T01:43:37.491 INFO:teuthology.orchestra.run.smithi146.stdout: Package Arch Version Repository Size 2024-09-18T01:43:37.491 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-18T01:43:37.492 INFO:teuthology.orchestra.run.smithi146.stdout:Installing: 2024-09-18T01:43:37.492 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-volume noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 285 k 2024-09-18T01:43:37.492 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:43:37.492 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction Summary 2024-09-18T01:43:37.492 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-18T01:43:37.492 INFO:teuthology.orchestra.run.smithi146.stdout:Install 1 Package 2024-09-18T01:43:37.492 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:43:37.492 INFO:teuthology.orchestra.run.smithi146.stdout:Total download size: 285 k 2024-09-18T01:43:37.492 INFO:teuthology.orchestra.run.smithi146.stdout:Installed size: 1.3 M 2024-09-18T01:43:37.492 INFO:teuthology.orchestra.run.smithi146.stdout:Downloading Packages: 2024-09-18T01:43:37.717 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-volume-19.1.1-330.gc2ddf972.el9.noarch.rpm 1.2 MB/s | 285 kB 00:00 2024-09-18T01:43:37.717 INFO:teuthology.orchestra.run.smithi146.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:43:37.718 INFO:teuthology.orchestra.run.smithi146.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-18T01:43:37.718 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction check 2024-09-18T01:43:37.727 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction check succeeded. 2024-09-18T01:43:37.727 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction test 2024-09-18T01:43:37.751 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction test succeeded. 2024-09-18T01:43:37.751 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction 2024-09-18T01:43:37.966 INFO:teuthology.orchestra.run.smithi146.stdout: Preparing : 1/1 2024-09-18T01:43:38.027 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-volume-2:19.1.1-330.gc2ddf972.el9.noarch 1/1 2024-09-18T01:43:38.043 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-volume-2:19.1.1-330.gc2ddf972.el9.noarch 1/1 2024-09-18T01:43:38.043 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T01:43:38.044 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-18T01:43:38.044 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:43:38.976 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-volume-2:19.1.1-330.gc2ddf972.el9.noarch 1/1 2024-09-18T01:43:38.976 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:43:38.976 INFO:teuthology.orchestra.run.smithi146.stdout:Installed: 2024-09-18T01:43:38.976 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-volume-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-18T01:43:38.976 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:43:38.976 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2024-09-18T01:43:39.280 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum -y install librados-devel 2024-09-18T01:43:39.645 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-330.gc2ddf9 12/12 2024-09-18T01:43:39.645 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-330.gc2ddf9 1/12 2024-09-18T01:43:39.645 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-18T01:43:39.645 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-18T01:43:39.645 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-18T01:43:39.645 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-18T01:43:39.645 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-18T01:43:39.645 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-18T01:43:39.645 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-18T01:43:39.645 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-18T01:43:39.646 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-18T01:43:39.646 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-18T01:43:39.881 INFO:teuthology.orchestra.run.smithi146.stdout:Last metadata expiration check: 0:01:31 ago on Wed 18 Sep 2024 01:42:08 AM UTC. 2024-09-18T01:43:40.014 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies resolved. 2024-09-18T01:43:40.015 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-18T01:43:40.015 INFO:teuthology.orchestra.run.smithi146.stdout: Package Arch Version Repo Size 2024-09-18T01:43:40.015 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-18T01:43:40.015 INFO:teuthology.orchestra.run.smithi146.stdout:Installing: 2024-09-18T01:43:40.015 INFO:teuthology.orchestra.run.smithi146.stdout: librados-devel x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 127 k 2024-09-18T01:43:40.016 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:43:40.016 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction Summary 2024-09-18T01:43:40.016 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-18T01:43:40.016 INFO:teuthology.orchestra.run.smithi146.stdout:Install 1 Package 2024-09-18T01:43:40.016 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:43:40.016 INFO:teuthology.orchestra.run.smithi146.stdout:Total download size: 127 k 2024-09-18T01:43:40.016 INFO:teuthology.orchestra.run.smithi146.stdout:Installed size: 456 k 2024-09-18T01:43:40.016 INFO:teuthology.orchestra.run.smithi146.stdout:Downloading Packages: 2024-09-18T01:43:40.085 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-18T01:43:40.085 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:43:40.085 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-09-18T01:43:40.085 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-diskprediction-local-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-18T01:43:40.085 INFO:teuthology.orchestra.run.smithi129.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-18T01:43:40.085 INFO:teuthology.orchestra.run.smithi129.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-18T01:43:40.085 INFO:teuthology.orchestra.run.smithi129.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-18T01:43:40.086 INFO:teuthology.orchestra.run.smithi129.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-18T01:43:40.086 INFO:teuthology.orchestra.run.smithi129.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-18T01:43:40.086 INFO:teuthology.orchestra.run.smithi129.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-18T01:43:40.086 INFO:teuthology.orchestra.run.smithi129.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-18T01:43:40.086 INFO:teuthology.orchestra.run.smithi129.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-18T01:43:40.086 INFO:teuthology.orchestra.run.smithi129.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-18T01:43:40.086 INFO:teuthology.orchestra.run.smithi129.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-18T01:43:40.086 INFO:teuthology.orchestra.run.smithi129.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-18T01:43:40.086 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:43:40.086 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-09-18T01:43:40.222 INFO:teuthology.orchestra.run.smithi146.stdout:librados-devel-19.1.1-330.gc2ddf972.el9.x86_64. 616 kB/s | 127 kB 00:00 2024-09-18T01:43:40.222 INFO:teuthology.orchestra.run.smithi146.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:43:40.222 INFO:teuthology.orchestra.run.smithi146.stdout:Total 612 kB/s | 127 kB 00:00 2024-09-18T01:43:40.223 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction check 2024-09-18T01:43:40.228 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction check succeeded. 2024-09-18T01:43:40.228 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction test 2024-09-18T01:43:40.292 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction test succeeded. 2024-09-18T01:43:40.293 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction 2024-09-18T01:43:40.441 INFO:teuthology.orchestra.run.smithi146.stdout: Preparing : 1/1 2024-09-18T01:43:40.464 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install ceph-mgr-rook 2024-09-18T01:43:40.544 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librados-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:43:41.018 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librados-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:43:41.051 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:17 ago on Wed 18 Sep 2024 01:42:24 AM UTC. 2024-09-18T01:43:41.184 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-09-18T01:43:41.185 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-18T01:43:41.185 INFO:teuthology.orchestra.run.smithi129.stdout: Package Arch Version Repository Size 2024-09-18T01:43:41.185 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-18T01:43:41.185 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-09-18T01:43:41.185 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-rook noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 49 k 2024-09-18T01:43:41.185 INFO:teuthology.orchestra.run.smithi129.stdout:Installing dependencies: 2024-09-18T01:43:41.185 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-18T01:43:41.186 INFO:teuthology.orchestra.run.smithi129.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-18T01:43:41.186 INFO:teuthology.orchestra.run.smithi129.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-18T01:43:41.186 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-18T01:43:41.186 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-18T01:43:41.186 INFO:teuthology.orchestra.run.smithi129.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-18T01:43:41.186 INFO:teuthology.orchestra.run.smithi129.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-18T01:43:41.186 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-18T01:43:41.186 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-18T01:43:41.186 INFO:teuthology.orchestra.run.smithi129.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-18T01:43:41.186 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-18T01:43:41.186 INFO:teuthology.orchestra.run.smithi129.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-18T01:43:41.187 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:43:41.187 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-09-18T01:43:41.187 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-18T01:43:41.187 INFO:teuthology.orchestra.run.smithi129.stdout:Install 13 Packages 2024-09-18T01:43:41.187 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:43:41.187 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 2.2 M 2024-09-18T01:43:41.188 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 26 M 2024-09-18T01:43:41.188 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-09-18T01:43:41.277 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librados-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:43:41.277 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:43:41.277 INFO:teuthology.orchestra.run.smithi146.stdout:Installed: 2024-09-18T01:43:41.277 INFO:teuthology.orchestra.run.smithi146.stdout: librados-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:43:41.277 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:43:41.277 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2024-09-18T01:43:41.477 INFO:teuthology.orchestra.run.smithi129.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 237 kB/s | 19 kB 00:00 2024-09-18T01:43:41.503 INFO:teuthology.orchestra.run.smithi129.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 241 kB/s | 26 kB 00:00 2024-09-18T01:43:41.561 INFO:teuthology.orchestra.run.smithi129.stdout:(3/13): ceph-mgr-rook-19.1.1-330.gc2ddf972.el9. 299 kB/s | 49 kB 00:00 2024-09-18T01:43:41.566 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum -y install libcephfs2 2024-09-18T01:43:41.587 INFO:teuthology.orchestra.run.smithi129.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.0 MB/s | 222 kB 00:00 2024-09-18T01:43:41.612 INFO:teuthology.orchestra.run.smithi129.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-09-18T01:43:41.637 INFO:teuthology.orchestra.run.smithi129.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-09-18T01:43:41.679 INFO:teuthology.orchestra.run.smithi129.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 480 kB/s | 32 kB 00:00 2024-09-18T01:43:41.704 INFO:teuthology.orchestra.run.smithi129.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 211 kB/s | 14 kB 00:00 2024-09-18T01:43:41.738 INFO:teuthology.orchestra.run.smithi129.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.5 MB/s | 279 kB 00:00 2024-09-18T01:43:41.780 INFO:teuthology.orchestra.run.smithi129.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.2 MB/s | 220 kB 00:00 2024-09-18T01:43:41.814 INFO:teuthology.orchestra.run.smithi129.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 787 kB/s | 59 kB 00:00 2024-09-18T01:43:41.856 INFO:teuthology.orchestra.run.smithi129.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.2 MB/s | 90 kB 00:00 2024-09-18T01:43:41.889 INFO:teuthology.orchestra.run.smithi129.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 5.5 MB/s | 1.0 MB 00:00 2024-09-18T01:43:41.892 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:43:41.892 INFO:teuthology.orchestra.run.smithi129.stdout:Total 3.1 MB/s | 2.2 MB 00:00 2024-09-18T01:43:41.955 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-09-18T01:43:41.970 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-09-18T01:43:41.970 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-09-18T01:43:42.062 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-09-18T01:43:42.068 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-09-18T01:43:42.156 INFO:teuthology.orchestra.run.smithi146.stdout:Last metadata expiration check: 0:01:34 ago on Wed 18 Sep 2024 01:42:08 AM UTC. 2024-09-18T01:43:42.247 INFO:teuthology.orchestra.run.smithi146.stdout:Package libcephfs2-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-18T01:43:42.293 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies resolved. 2024-09-18T01:43:42.294 INFO:teuthology.orchestra.run.smithi146.stdout:Nothing to do. 2024-09-18T01:43:42.294 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2024-09-18T01:43:42.372 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum -y install libcephfs-devel 2024-09-18T01:43:42.590 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-09-18T01:43:42.761 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-18T01:43:42.824 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-18T01:43:42.880 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-18T01:43:42.917 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-18T01:43:42.956 INFO:teuthology.orchestra.run.smithi146.stdout:Last metadata expiration check: 0:01:34 ago on Wed 18 Sep 2024 01:42:08 AM UTC. 2024-09-18T01:43:42.958 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-18T01:43:43.061 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-18T01:43:43.090 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies resolved. 2024-09-18T01:43:43.091 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-18T01:43:43.091 INFO:teuthology.orchestra.run.smithi146.stdout: Package Arch Version Repo Size 2024-09-18T01:43:43.091 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-18T01:43:43.091 INFO:teuthology.orchestra.run.smithi146.stdout:Installing: 2024-09-18T01:43:43.091 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs-devel x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 32 k 2024-09-18T01:43:43.091 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:43:43.091 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction Summary 2024-09-18T01:43:43.092 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-18T01:43:43.092 INFO:teuthology.orchestra.run.smithi146.stdout:Install 1 Package 2024-09-18T01:43:43.092 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:43:43.092 INFO:teuthology.orchestra.run.smithi146.stdout:Total download size: 32 k 2024-09-18T01:43:43.092 INFO:teuthology.orchestra.run.smithi146.stdout:Installed size: 142 k 2024-09-18T01:43:43.092 INFO:teuthology.orchestra.run.smithi146.stdout:Downloading Packages: 2024-09-18T01:43:43.162 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-18T01:43:43.219 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-18T01:43:43.241 INFO:teuthology.orchestra.run.smithi146.stdout:libcephfs-devel-19.1.1-330.gc2ddf972.el9.x86_64 212 kB/s | 32 kB 00:00 2024-09-18T01:43:43.242 INFO:teuthology.orchestra.run.smithi146.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:43:43.243 INFO:teuthology.orchestra.run.smithi146.stdout:Total 210 kB/s | 32 kB 00:00 2024-09-18T01:43:43.243 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction check 2024-09-18T01:43:43.246 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction check succeeded. 2024-09-18T01:43:43.246 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction test 2024-09-18T01:43:43.263 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction test succeeded. 2024-09-18T01:43:43.264 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction 2024-09-18T01:43:43.353 INFO:teuthology.orchestra.run.smithi146.stdout: Preparing : 1/1 2024-09-18T01:43:43.455 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libcephfs-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:43:43.811 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libcephfs-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:43:43.941 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-18T01:43:43.991 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-18T01:43:44.025 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-18T01:43:44.042 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libcephfs-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:43:44.042 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:43:44.042 INFO:teuthology.orchestra.run.smithi146.stdout:Installed: 2024-09-18T01:43:44.042 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:43:44.043 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:43:44.043 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2024-09-18T01:43:44.073 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-18T01:43:44.095 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mgr-rook-2:19.1.1-330.gc2ddf972.el9.noarch 13/13 2024-09-18T01:43:44.247 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum -y install librados2 2024-09-18T01:43:44.828 INFO:teuthology.orchestra.run.smithi146.stdout:Last metadata expiration check: 0:01:36 ago on Wed 18 Sep 2024 01:42:08 AM UTC. 2024-09-18T01:43:44.837 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-330.gc2ddf972.el9.noarch 13/13 2024-09-18T01:43:44.837 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mgr-rook-2:19.1.1-330.gc2ddf972.el9.noarch 1/13 2024-09-18T01:43:44.837 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-18T01:43:44.837 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-18T01:43:44.837 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-18T01:43:44.837 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-18T01:43:44.837 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-18T01:43:44.837 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-18T01:43:44.837 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-18T01:43:44.837 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-18T01:43:44.838 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-18T01:43:44.838 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-18T01:43:44.838 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-18T01:43:44.917 INFO:teuthology.orchestra.run.smithi146.stdout:Package librados2-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-18T01:43:44.960 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies resolved. 2024-09-18T01:43:44.961 INFO:teuthology.orchestra.run.smithi146.stdout:Nothing to do. 2024-09-18T01:43:44.961 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2024-09-18T01:43:45.042 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum -y install librbd1 2024-09-18T01:43:45.190 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-18T01:43:45.190 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:43:45.190 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-09-18T01:43:45.190 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-rook-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-18T01:43:45.190 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-18T01:43:45.190 INFO:teuthology.orchestra.run.smithi129.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-18T01:43:45.191 INFO:teuthology.orchestra.run.smithi129.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-18T01:43:45.191 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-18T01:43:45.191 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-18T01:43:45.191 INFO:teuthology.orchestra.run.smithi129.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-18T01:43:45.191 INFO:teuthology.orchestra.run.smithi129.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-18T01:43:45.191 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-18T01:43:45.191 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-18T01:43:45.191 INFO:teuthology.orchestra.run.smithi129.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-18T01:43:45.191 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-18T01:43:45.191 INFO:teuthology.orchestra.run.smithi129.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-18T01:43:45.191 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:43:45.191 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-09-18T01:43:45.474 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install ceph-mgr-cephadm 2024-09-18T01:43:45.620 INFO:teuthology.orchestra.run.smithi146.stdout:Last metadata expiration check: 0:01:37 ago on Wed 18 Sep 2024 01:42:08 AM UTC. 2024-09-18T01:43:45.709 INFO:teuthology.orchestra.run.smithi146.stdout:Package librbd1-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-18T01:43:45.754 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies resolved. 2024-09-18T01:43:45.755 INFO:teuthology.orchestra.run.smithi146.stdout:Nothing to do. 2024-09-18T01:43:45.755 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2024-09-18T01:43:45.829 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum -y install python3-rados 2024-09-18T01:43:46.056 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:22 ago on Wed 18 Sep 2024 01:42:24 AM UTC. 2024-09-18T01:43:46.190 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-09-18T01:43:46.190 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-18T01:43:46.191 INFO:teuthology.orchestra.run.smithi129.stdout: Package Arch Version Repository Size 2024-09-18T01:43:46.191 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-18T01:43:46.191 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-09-18T01:43:46.191 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-cephadm noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 146 k 2024-09-18T01:43:46.191 INFO:teuthology.orchestra.run.smithi129.stdout:Installing dependencies: 2024-09-18T01:43:46.191 INFO:teuthology.orchestra.run.smithi129.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-18T01:43:46.191 INFO:teuthology.orchestra.run.smithi129.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-18T01:43:46.191 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-18T01:43:46.191 INFO:teuthology.orchestra.run.smithi129.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-18T01:43:46.191 INFO:teuthology.orchestra.run.smithi129.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-18T01:43:46.191 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:43:46.191 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-09-18T01:43:46.192 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-18T01:43:46.192 INFO:teuthology.orchestra.run.smithi129.stdout:Install 6 Packages 2024-09-18T01:43:46.192 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:43:46.192 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 7.0 M 2024-09-18T01:43:46.192 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 33 M 2024-09-18T01:43:46.192 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-09-18T01:43:46.414 INFO:teuthology.orchestra.run.smithi146.stdout:Last metadata expiration check: 0:01:38 ago on Wed 18 Sep 2024 01:42:08 AM UTC. 2024-09-18T01:43:46.505 INFO:teuthology.orchestra.run.smithi146.stdout:Package python3-rados-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-18T01:43:46.549 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies resolved. 2024-09-18T01:43:46.550 INFO:teuthology.orchestra.run.smithi146.stdout:Nothing to do. 2024-09-18T01:43:46.550 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2024-09-18T01:43:46.629 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum -y install python3-rgw 2024-09-18T01:43:46.701 INFO:teuthology.orchestra.run.smithi129.stdout:(1/6): ceph-mgr-cephadm-19.1.1-330.gc2ddf972.el 661 kB/s | 146 kB 00:00 2024-09-18T01:43:46.727 INFO:teuthology.orchestra.run.smithi129.stdout:(2/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.0 MB/s | 248 kB 00:00 2024-09-18T01:43:46.810 INFO:teuthology.orchestra.run.smithi129.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 4.9 MB/s | 548 kB 00:00 2024-09-18T01:43:46.836 INFO:teuthology.orchestra.run.smithi129.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 531 kB/s | 58 kB 00:00 2024-09-18T01:43:46.861 INFO:teuthology.orchestra.run.smithi129.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.4 MB/s | 74 kB 00:00 2024-09-18T01:43:46.970 INFO:teuthology.orchestra.run.smithi129.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 12 MB/s | 6.0 MB 00:00 2024-09-18T01:43:46.971 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:43:46.972 INFO:teuthology.orchestra.run.smithi129.stdout:Total 9.0 MB/s | 7.0 MB 00:00 2024-09-18T01:43:47.041 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-09-18T01:43:47.052 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-09-18T01:43:47.052 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-09-18T01:43:47.150 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-09-18T01:43:47.150 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-09-18T01:43:47.211 INFO:teuthology.orchestra.run.smithi146.stdout:Last metadata expiration check: 0:01:39 ago on Wed 18 Sep 2024 01:42:08 AM UTC. 2024-09-18T01:43:47.300 INFO:teuthology.orchestra.run.smithi146.stdout:Package python3-rgw-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-18T01:43:47.343 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies resolved. 2024-09-18T01:43:47.344 INFO:teuthology.orchestra.run.smithi146.stdout:Nothing to do. 2024-09-18T01:43:47.344 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2024-09-18T01:43:47.420 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum -y install python3-cephfs 2024-09-18T01:43:47.453 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-09-18T01:43:47.624 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-18T01:43:47.680 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-18T01:43:48.007 INFO:teuthology.orchestra.run.smithi146.stdout:Last metadata expiration check: 0:01:40 ago on Wed 18 Sep 2024 01:42:08 AM UTC. 2024-09-18T01:43:48.097 INFO:teuthology.orchestra.run.smithi146.stdout:Package python3-cephfs-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-18T01:43:48.141 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies resolved. 2024-09-18T01:43:48.142 INFO:teuthology.orchestra.run.smithi146.stdout:Nothing to do. 2024-09-18T01:43:48.142 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2024-09-18T01:43:48.201 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-18T01:43:48.222 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum -y install python3-rbd 2024-09-18T01:43:48.290 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-18T01:43:48.354 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-18T01:43:48.384 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 6/6 2024-09-18T01:43:48.807 INFO:teuthology.orchestra.run.smithi146.stdout:Last metadata expiration check: 0:01:40 ago on Wed 18 Sep 2024 01:42:08 AM UTC. 2024-09-18T01:43:48.897 INFO:teuthology.orchestra.run.smithi146.stdout:Package python3-rbd-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-18T01:43:48.941 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies resolved. 2024-09-18T01:43:48.942 INFO:teuthology.orchestra.run.smithi146.stdout:Nothing to do. 2024-09-18T01:43:48.942 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2024-09-18T01:43:49.023 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum -y install rbd-fuse 2024-09-18T01:43:49.136 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 6/6 2024-09-18T01:43:49.136 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 1/6 2024-09-18T01:43:49.136 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-18T01:43:49.136 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-18T01:43:49.136 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-18T01:43:49.137 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-18T01:43:49.414 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-18T01:43:49.414 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:43:49.414 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-09-18T01:43:49.414 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-18T01:43:49.414 INFO:teuthology.orchestra.run.smithi129.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-18T01:43:49.415 INFO:teuthology.orchestra.run.smithi129.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-18T01:43:49.415 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-18T01:43:49.415 INFO:teuthology.orchestra.run.smithi129.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-18T01:43:49.415 INFO:teuthology.orchestra.run.smithi129.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-18T01:43:49.415 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:43:49.415 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-09-18T01:43:49.603 INFO:teuthology.orchestra.run.smithi146.stdout:Last metadata expiration check: 0:01:41 ago on Wed 18 Sep 2024 01:42:08 AM UTC. 2024-09-18T01:43:49.684 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install ceph-fuse 2024-09-18T01:43:49.735 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies resolved. 2024-09-18T01:43:49.736 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-18T01:43:49.736 INFO:teuthology.orchestra.run.smithi146.stdout: Package Architecture Version Repository Size 2024-09-18T01:43:49.736 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-18T01:43:49.736 INFO:teuthology.orchestra.run.smithi146.stdout:Installing: 2024-09-18T01:43:49.736 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-fuse x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 85 k 2024-09-18T01:43:49.736 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:43:49.736 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction Summary 2024-09-18T01:43:49.736 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-18T01:43:49.736 INFO:teuthology.orchestra.run.smithi146.stdout:Install 1 Package 2024-09-18T01:43:49.736 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:43:49.737 INFO:teuthology.orchestra.run.smithi146.stdout:Total download size: 85 k 2024-09-18T01:43:49.737 INFO:teuthology.orchestra.run.smithi146.stdout:Installed size: 231 k 2024-09-18T01:43:49.737 INFO:teuthology.orchestra.run.smithi146.stdout:Downloading Packages: 2024-09-18T01:43:49.944 INFO:teuthology.orchestra.run.smithi146.stdout:rbd-fuse-19.1.1-330.gc2ddf972.el9.x86_64.rpm 413 kB/s | 85 kB 00:00 2024-09-18T01:43:49.944 INFO:teuthology.orchestra.run.smithi146.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:43:49.944 INFO:teuthology.orchestra.run.smithi146.stdout:Total 410 kB/s | 85 kB 00:00 2024-09-18T01:43:49.945 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction check 2024-09-18T01:43:49.951 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction check succeeded. 2024-09-18T01:43:49.951 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction test 2024-09-18T01:43:50.016 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction test succeeded. 2024-09-18T01:43:50.016 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction 2024-09-18T01:43:50.173 INFO:teuthology.orchestra.run.smithi146.stdout: Preparing : 1/1 2024-09-18T01:43:50.275 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : rbd-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:43:50.280 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:26 ago on Wed 18 Sep 2024 01:42:24 AM UTC. 2024-09-18T01:43:50.413 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-09-18T01:43:50.413 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-18T01:43:50.413 INFO:teuthology.orchestra.run.smithi129.stdout: Package Arch Version Repository Size 2024-09-18T01:43:50.413 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-18T01:43:50.413 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-09-18T01:43:50.413 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-fuse x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 897 k 2024-09-18T01:43:50.413 INFO:teuthology.orchestra.run.smithi129.stdout:Installing dependencies: 2024-09-18T01:43:50.414 INFO:teuthology.orchestra.run.smithi129.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-18T01:43:50.414 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:43:50.414 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-09-18T01:43:50.414 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-18T01:43:50.414 INFO:teuthology.orchestra.run.smithi129.stdout:Install 2 Packages 2024-09-18T01:43:50.414 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:43:50.414 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 977 k 2024-09-18T01:43:50.415 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 2.9 M 2024-09-18T01:43:50.415 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-09-18T01:43:50.682 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: rbd-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:43:50.765 INFO:teuthology.orchestra.run.smithi129.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 861 kB/s | 80 kB 00:00 2024-09-18T01:43:50.945 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : rbd-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:43:50.945 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:43:50.945 INFO:teuthology.orchestra.run.smithi146.stdout:Installed: 2024-09-18T01:43:50.945 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:43:50.945 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:43:50.945 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2024-09-18T01:43:50.965 INFO:teuthology.orchestra.run.smithi129.stdout:(2/2): ceph-fuse-19.1.1-330.gc2ddf972.el9.x86_6 3.0 MB/s | 897 kB 00:00 2024-09-18T01:43:50.965 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:43:50.965 INFO:teuthology.orchestra.run.smithi129.stdout:Total 1.7 MB/s | 977 kB 00:00 2024-09-18T01:43:50.977 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-09-18T01:43:50.998 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-09-18T01:43:50.999 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-09-18T01:43:51.082 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-09-18T01:43:51.082 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-09-18T01:43:51.234 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum -y install rbd-mirror 2024-09-18T01:43:51.267 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-09-18T01:43:51.421 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-18T01:43:51.498 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 2/2 2024-09-18T01:43:51.844 INFO:teuthology.orchestra.run.smithi146.stdout:Last metadata expiration check: 0:01:43 ago on Wed 18 Sep 2024 01:42:08 AM UTC. 2024-09-18T01:43:51.983 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies resolved. 2024-09-18T01:43:51.983 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-18T01:43:51.984 INFO:teuthology.orchestra.run.smithi146.stdout: Package Arch Version Repo Size 2024-09-18T01:43:51.984 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-18T01:43:51.984 INFO:teuthology.orchestra.run.smithi146.stdout:Installing: 2024-09-18T01:43:51.984 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-mirror x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 3.1 M 2024-09-18T01:43:51.984 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:43:51.984 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction Summary 2024-09-18T01:43:51.984 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-18T01:43:51.984 INFO:teuthology.orchestra.run.smithi146.stdout:Install 1 Package 2024-09-18T01:43:51.984 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:43:51.984 INFO:teuthology.orchestra.run.smithi146.stdout:Total download size: 3.1 M 2024-09-18T01:43:51.984 INFO:teuthology.orchestra.run.smithi146.stdout:Installed size: 13 M 2024-09-18T01:43:51.985 INFO:teuthology.orchestra.run.smithi146.stdout:Downloading Packages: 2024-09-18T01:43:52.158 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 2/2 2024-09-18T01:43:52.158 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 1/2 2024-09-18T01:43:52.364 INFO:teuthology.orchestra.run.smithi146.stdout:rbd-mirror-19.1.1-330.gc2ddf972.el9.x86_64.rpm 8.2 MB/s | 3.1 MB 00:00 2024-09-18T01:43:52.365 INFO:teuthology.orchestra.run.smithi146.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:43:52.365 INFO:teuthology.orchestra.run.smithi146.stdout:Total 8.1 MB/s | 3.1 MB 00:00 2024-09-18T01:43:52.365 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction check 2024-09-18T01:43:52.375 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction check succeeded. 2024-09-18T01:43:52.375 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction test 2024-09-18T01:43:52.437 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-18T01:43:52.438 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:43:52.438 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-09-18T01:43:52.438 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-18T01:43:52.438 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:43:52.438 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-09-18T01:43:52.457 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction test succeeded. 2024-09-18T01:43:52.458 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction 2024-09-18T01:43:52.746 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install ceph-volume 2024-09-18T01:43:52.880 INFO:teuthology.orchestra.run.smithi146.stdout: Preparing : 1/1 2024-09-18T01:43:52.940 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : rbd-mirror-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:43:52.966 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: rbd-mirror-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:43:52.966 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T01:43:52.966 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-18T01:43:52.966 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-18T01:43:52.966 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-18T01:43:52.966 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:43:53.339 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:29 ago on Wed 18 Sep 2024 01:42:24 AM UTC. 2024-09-18T01:43:53.478 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-09-18T01:43:53.479 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-18T01:43:53.479 INFO:teuthology.orchestra.run.smithi129.stdout: Package Arch Version Repository Size 2024-09-18T01:43:53.479 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-18T01:43:53.479 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-09-18T01:43:53.480 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-volume noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 285 k 2024-09-18T01:43:53.480 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:43:53.480 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-09-18T01:43:53.480 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-18T01:43:53.480 INFO:teuthology.orchestra.run.smithi129.stdout:Install 1 Package 2024-09-18T01:43:53.480 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:43:53.480 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 285 k 2024-09-18T01:43:53.480 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 1.3 M 2024-09-18T01:43:53.480 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-09-18T01:43:53.713 INFO:teuthology.orchestra.run.smithi129.stdout:ceph-volume-19.1.1-330.gc2ddf972.el9.noarch.rpm 1.2 MB/s | 285 kB 00:00 2024-09-18T01:43:53.714 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:43:53.714 INFO:teuthology.orchestra.run.smithi129.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-18T01:43:53.714 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-09-18T01:43:53.722 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-09-18T01:43:53.722 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-09-18T01:43:53.746 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-09-18T01:43:53.746 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-09-18T01:43:53.965 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-09-18T01:43:54.040 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-volume-2:19.1.1-330.gc2ddf972.el9.noarch 1/1 2024-09-18T01:43:54.056 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-volume-2:19.1.1-330.gc2ddf972.el9.noarch 1/1 2024-09-18T01:43:54.056 INFO:teuthology.orchestra.run.smithi129.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T01:43:54.056 INFO:teuthology.orchestra.run.smithi129.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-18T01:43:54.056 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:43:54.064 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : rbd-mirror-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:43:54.064 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:43:54.064 INFO:teuthology.orchestra.run.smithi146.stdout:Installed: 2024-09-18T01:43:54.064 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-mirror-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:43:54.065 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:43:54.065 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2024-09-18T01:43:54.309 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum -y install rbd-nbd 2024-09-18T01:43:54.914 INFO:teuthology.orchestra.run.smithi146.stdout:Last metadata expiration check: 0:01:46 ago on Wed 18 Sep 2024 01:42:08 AM UTC. 2024-09-18T01:43:55.048 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies resolved. 2024-09-18T01:43:55.049 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-18T01:43:55.049 INFO:teuthology.orchestra.run.smithi146.stdout: Package Architecture Version Repository Size 2024-09-18T01:43:55.049 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-18T01:43:55.050 INFO:teuthology.orchestra.run.smithi146.stdout:Installing: 2024-09-18T01:43:55.050 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-nbd x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 170 k 2024-09-18T01:43:55.050 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:43:55.050 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction Summary 2024-09-18T01:43:55.050 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-18T01:43:55.050 INFO:teuthology.orchestra.run.smithi146.stdout:Install 1 Package 2024-09-18T01:43:55.050 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:43:55.050 INFO:teuthology.orchestra.run.smithi146.stdout:Total download size: 170 k 2024-09-18T01:43:55.050 INFO:teuthology.orchestra.run.smithi146.stdout:Installed size: 494 k 2024-09-18T01:43:55.050 INFO:teuthology.orchestra.run.smithi146.stdout:Downloading Packages: 2024-09-18T01:43:55.172 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-volume-2:19.1.1-330.gc2ddf972.el9.noarch 1/1 2024-09-18T01:43:55.172 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:43:55.173 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-09-18T01:43:55.173 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-volume-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-18T01:43:55.173 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:43:55.173 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-09-18T01:43:55.259 INFO:teuthology.orchestra.run.smithi146.stdout:rbd-nbd-19.1.1-330.gc2ddf972.el9.x86_64.rpm 818 kB/s | 170 kB 00:00 2024-09-18T01:43:55.259 INFO:teuthology.orchestra.run.smithi146.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:43:55.259 INFO:teuthology.orchestra.run.smithi146.stdout:Total 812 kB/s | 170 kB 00:00 2024-09-18T01:43:55.260 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction check 2024-09-18T01:43:55.267 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction check succeeded. 2024-09-18T01:43:55.267 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction test 2024-09-18T01:43:55.332 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction test succeeded. 2024-09-18T01:43:55.332 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction 2024-09-18T01:43:55.483 INFO:teuthology.orchestra.run.smithi146.stdout: Preparing : 1/1 2024-09-18T01:43:55.511 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install librados-devel 2024-09-18T01:43:55.581 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : rbd-nbd-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:43:55.991 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: rbd-nbd-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:43:56.113 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:32 ago on Wed 18 Sep 2024 01:42:24 AM UTC. 2024-09-18T01:43:56.240 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : rbd-nbd-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:43:56.240 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:43:56.241 INFO:teuthology.orchestra.run.smithi146.stdout:Installed: 2024-09-18T01:43:56.241 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-nbd-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:43:56.241 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:43:56.241 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2024-09-18T01:43:56.245 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-09-18T01:43:56.245 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-18T01:43:56.245 INFO:teuthology.orchestra.run.smithi129.stdout: Package Arch Version Repo Size 2024-09-18T01:43:56.246 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-18T01:43:56.246 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-09-18T01:43:56.246 INFO:teuthology.orchestra.run.smithi129.stdout: librados-devel x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 127 k 2024-09-18T01:43:56.246 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:43:56.246 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-09-18T01:43:56.246 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-18T01:43:56.246 INFO:teuthology.orchestra.run.smithi129.stdout:Install 1 Package 2024-09-18T01:43:56.246 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:43:56.246 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 127 k 2024-09-18T01:43:56.246 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 456 k 2024-09-18T01:43:56.246 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-09-18T01:43:56.429 INFO:teuthology.orchestra.run.smithi129.stdout:librados-devel-19.1.1-330.gc2ddf972.el9.x86_64. 696 kB/s | 127 kB 00:00 2024-09-18T01:43:56.429 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:43:56.429 INFO:teuthology.orchestra.run.smithi129.stdout:Total 690 kB/s | 127 kB 00:00 2024-09-18T01:43:56.429 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-09-18T01:43:56.435 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-09-18T01:43:56.435 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-09-18T01:43:56.501 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-09-18T01:43:56.501 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-09-18T01:43:56.519 DEBUG:teuthology.parallel:result is None 2024-09-18T01:43:56.647 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-09-18T01:43:56.751 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : librados-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:43:57.191 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: librados-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:43:57.481 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librados-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:43:57.481 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:43:57.481 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-09-18T01:43:57.481 INFO:teuthology.orchestra.run.smithi129.stdout: librados-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:43:57.481 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:43:57.481 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-09-18T01:43:57.736 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install libcephfs2 2024-09-18T01:43:58.339 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:34 ago on Wed 18 Sep 2024 01:42:24 AM UTC. 2024-09-18T01:43:58.431 INFO:teuthology.orchestra.run.smithi129.stdout:Package libcephfs2-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-18T01:43:58.475 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-09-18T01:43:58.476 INFO:teuthology.orchestra.run.smithi129.stdout:Nothing to do. 2024-09-18T01:43:58.476 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-09-18T01:43:58.582 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install libcephfs-devel 2024-09-18T01:43:59.161 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:35 ago on Wed 18 Sep 2024 01:42:24 AM UTC. 2024-09-18T01:43:59.291 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-09-18T01:43:59.292 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-18T01:43:59.292 INFO:teuthology.orchestra.run.smithi129.stdout: Package Arch Version Repo Size 2024-09-18T01:43:59.292 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-18T01:43:59.292 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-09-18T01:43:59.292 INFO:teuthology.orchestra.run.smithi129.stdout: libcephfs-devel x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 32 k 2024-09-18T01:43:59.292 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:43:59.293 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-09-18T01:43:59.293 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-18T01:43:59.293 INFO:teuthology.orchestra.run.smithi129.stdout:Install 1 Package 2024-09-18T01:43:59.293 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:43:59.293 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 32 k 2024-09-18T01:43:59.293 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 142 k 2024-09-18T01:43:59.293 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-09-18T01:43:59.459 INFO:teuthology.orchestra.run.smithi129.stdout:libcephfs-devel-19.1.1-330.gc2ddf972.el9.x86_64 191 kB/s | 32 kB 00:00 2024-09-18T01:43:59.459 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:43:59.460 INFO:teuthology.orchestra.run.smithi129.stdout:Total 189 kB/s | 32 kB 00:00 2024-09-18T01:43:59.460 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-09-18T01:43:59.463 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-09-18T01:43:59.463 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-09-18T01:43:59.491 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-09-18T01:43:59.491 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-09-18T01:43:59.578 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-09-18T01:43:59.689 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libcephfs-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:44:00.039 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: libcephfs-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:44:00.270 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libcephfs-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:44:00.270 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:44:00.271 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-09-18T01:44:00.271 INFO:teuthology.orchestra.run.smithi129.stdout: libcephfs-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:44:00.271 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:44:00.271 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-09-18T01:44:00.480 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install librados2 2024-09-18T01:44:01.059 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:37 ago on Wed 18 Sep 2024 01:42:24 AM UTC. 2024-09-18T01:44:01.148 INFO:teuthology.orchestra.run.smithi129.stdout:Package librados2-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-18T01:44:01.191 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-09-18T01:44:01.192 INFO:teuthology.orchestra.run.smithi129.stdout:Nothing to do. 2024-09-18T01:44:01.192 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-09-18T01:44:01.271 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install librbd1 2024-09-18T01:44:01.851 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:37 ago on Wed 18 Sep 2024 01:42:24 AM UTC. 2024-09-18T01:44:01.940 INFO:teuthology.orchestra.run.smithi129.stdout:Package librbd1-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-18T01:44:01.982 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-09-18T01:44:01.983 INFO:teuthology.orchestra.run.smithi129.stdout:Nothing to do. 2024-09-18T01:44:01.984 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-09-18T01:44:02.059 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install python3-rados 2024-09-18T01:44:02.640 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:38 ago on Wed 18 Sep 2024 01:42:24 AM UTC. 2024-09-18T01:44:02.729 INFO:teuthology.orchestra.run.smithi129.stdout:Package python3-rados-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-18T01:44:02.772 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-09-18T01:44:02.773 INFO:teuthology.orchestra.run.smithi129.stdout:Nothing to do. 2024-09-18T01:44:02.773 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-09-18T01:44:02.854 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install python3-rgw 2024-09-18T01:44:03.441 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:39 ago on Wed 18 Sep 2024 01:42:24 AM UTC. 2024-09-18T01:44:03.532 INFO:teuthology.orchestra.run.smithi129.stdout:Package python3-rgw-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-18T01:44:03.575 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-09-18T01:44:03.576 INFO:teuthology.orchestra.run.smithi129.stdout:Nothing to do. 2024-09-18T01:44:03.576 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-09-18T01:44:03.653 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install python3-cephfs 2024-09-18T01:44:04.232 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:40 ago on Wed 18 Sep 2024 01:42:24 AM UTC. 2024-09-18T01:44:04.321 INFO:teuthology.orchestra.run.smithi129.stdout:Package python3-cephfs-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-18T01:44:04.364 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-09-18T01:44:04.365 INFO:teuthology.orchestra.run.smithi129.stdout:Nothing to do. 2024-09-18T01:44:04.365 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-09-18T01:44:04.442 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install python3-rbd 2024-09-18T01:44:05.027 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:41 ago on Wed 18 Sep 2024 01:42:24 AM UTC. 2024-09-18T01:44:05.117 INFO:teuthology.orchestra.run.smithi129.stdout:Package python3-rbd-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-18T01:44:05.160 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-09-18T01:44:05.161 INFO:teuthology.orchestra.run.smithi129.stdout:Nothing to do. 2024-09-18T01:44:05.161 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-09-18T01:44:05.245 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install rbd-fuse 2024-09-18T01:44:05.821 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:41 ago on Wed 18 Sep 2024 01:42:24 AM UTC. 2024-09-18T01:44:05.954 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-09-18T01:44:05.954 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-18T01:44:05.955 INFO:teuthology.orchestra.run.smithi129.stdout: Package Architecture Version Repository Size 2024-09-18T01:44:05.955 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-18T01:44:05.955 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-09-18T01:44:05.955 INFO:teuthology.orchestra.run.smithi129.stdout: rbd-fuse x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 85 k 2024-09-18T01:44:05.955 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:44:05.955 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-09-18T01:44:05.955 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-18T01:44:05.955 INFO:teuthology.orchestra.run.smithi129.stdout:Install 1 Package 2024-09-18T01:44:05.955 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:44:05.956 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 85 k 2024-09-18T01:44:05.956 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 231 k 2024-09-18T01:44:05.956 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-09-18T01:44:06.154 INFO:teuthology.orchestra.run.smithi129.stdout:rbd-fuse-19.1.1-330.gc2ddf972.el9.x86_64.rpm 430 kB/s | 85 kB 00:00 2024-09-18T01:44:06.155 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:44:06.155 INFO:teuthology.orchestra.run.smithi129.stdout:Total 427 kB/s | 85 kB 00:00 2024-09-18T01:44:06.155 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-09-18T01:44:06.162 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-09-18T01:44:06.162 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-09-18T01:44:06.225 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-09-18T01:44:06.226 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-09-18T01:44:06.375 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-09-18T01:44:06.477 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : rbd-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:44:06.864 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: rbd-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:44:07.121 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : rbd-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:44:07.121 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:44:07.121 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-09-18T01:44:07.122 INFO:teuthology.orchestra.run.smithi129.stdout: rbd-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:44:07.122 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:44:07.122 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-09-18T01:44:07.427 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install rbd-mirror 2024-09-18T01:44:08.037 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:44 ago on Wed 18 Sep 2024 01:42:24 AM UTC. 2024-09-18T01:44:08.179 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-09-18T01:44:08.180 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-18T01:44:08.180 INFO:teuthology.orchestra.run.smithi129.stdout: Package Arch Version Repo Size 2024-09-18T01:44:08.180 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-18T01:44:08.180 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-09-18T01:44:08.180 INFO:teuthology.orchestra.run.smithi129.stdout: rbd-mirror x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 3.1 M 2024-09-18T01:44:08.180 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:44:08.180 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-09-18T01:44:08.180 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-18T01:44:08.180 INFO:teuthology.orchestra.run.smithi129.stdout:Install 1 Package 2024-09-18T01:44:08.181 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:44:08.181 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 3.1 M 2024-09-18T01:44:08.181 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 13 M 2024-09-18T01:44:08.181 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-09-18T01:44:08.543 INFO:teuthology.orchestra.run.smithi129.stdout:rbd-mirror-19.1.1-330.gc2ddf972.el9.x86_64.rpm 8.6 MB/s | 3.1 MB 00:00 2024-09-18T01:44:08.543 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:44:08.544 INFO:teuthology.orchestra.run.smithi129.stdout:Total 8.5 MB/s | 3.1 MB 00:00 2024-09-18T01:44:08.544 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-09-18T01:44:08.553 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-09-18T01:44:08.553 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-09-18T01:44:08.635 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-09-18T01:44:08.635 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-09-18T01:44:09.090 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-09-18T01:44:09.161 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : rbd-mirror-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:44:09.187 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: rbd-mirror-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:44:09.187 INFO:teuthology.orchestra.run.smithi129.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T01:44:09.187 INFO:teuthology.orchestra.run.smithi129.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-18T01:44:09.187 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-18T01:44:09.187 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-18T01:44:09.187 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:44:10.311 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : rbd-mirror-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:44:10.311 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:44:10.311 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-09-18T01:44:10.311 INFO:teuthology.orchestra.run.smithi129.stdout: rbd-mirror-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:44:10.311 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:44:10.312 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-09-18T01:44:10.573 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install rbd-nbd 2024-09-18T01:44:11.169 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:47 ago on Wed 18 Sep 2024 01:42:24 AM UTC. 2024-09-18T01:44:11.303 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-09-18T01:44:11.304 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-18T01:44:11.304 INFO:teuthology.orchestra.run.smithi129.stdout: Package Architecture Version Repository Size 2024-09-18T01:44:11.304 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-18T01:44:11.304 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-09-18T01:44:11.305 INFO:teuthology.orchestra.run.smithi129.stdout: rbd-nbd x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 170 k 2024-09-18T01:44:11.305 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:44:11.305 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-09-18T01:44:11.305 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-09-18T01:44:11.305 INFO:teuthology.orchestra.run.smithi129.stdout:Install 1 Package 2024-09-18T01:44:11.305 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:44:11.305 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 170 k 2024-09-18T01:44:11.305 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 494 k 2024-09-18T01:44:11.305 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-09-18T01:44:11.515 INFO:teuthology.orchestra.run.smithi129.stdout:rbd-nbd-19.1.1-330.gc2ddf972.el9.x86_64.rpm 813 kB/s | 170 kB 00:00 2024-09-18T01:44:11.516 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-09-18T01:44:11.517 INFO:teuthology.orchestra.run.smithi129.stdout:Total 807 kB/s | 170 kB 00:00 2024-09-18T01:44:11.517 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-09-18T01:44:11.524 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-09-18T01:44:11.524 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-09-18T01:44:11.589 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-09-18T01:44:11.590 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-09-18T01:44:11.741 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-09-18T01:44:11.855 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : rbd-nbd-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:44:12.245 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: rbd-nbd-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:44:12.514 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : rbd-nbd-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-18T01:44:12.514 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:44:12.514 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-09-18T01:44:12.515 INFO:teuthology.orchestra.run.smithi129.stdout: rbd-nbd-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-18T01:44:12.515 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:44:12.515 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-09-18T01:44:12.778 DEBUG:teuthology.parallel:result is None 2024-09-18T01:44:12.779 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-18T01:44:12.925 DEBUG:teuthology.orchestra.run.smithi129:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-18T01:44:12.947 INFO:teuthology.orchestra.run.smithi129.stdout:19.1.1-330.gc2ddf972.el9 2024-09-18T01:44:12.948 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-330.gc2ddf972.el9 2024-09-18T01:44:12.948 INFO:teuthology.task.install:The correct ceph version 19.1.1-330.gc2ddf972 is installed. 2024-09-18T01:44:12.949 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-18T01:44:13.088 DEBUG:teuthology.orchestra.run.smithi146:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-18T01:44:13.114 INFO:teuthology.orchestra.run.smithi146.stdout:19.1.1-330.gc2ddf972.el9 2024-09-18T01:44:13.115 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-330.gc2ddf972.el9 2024-09-18T01:44:13.115 INFO:teuthology.task.install:The correct ceph version 19.1.1-330.gc2ddf972 is installed. 2024-09-18T01:44:13.116 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-18T01:44:13.117 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-09-18T01:44:13.117 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-18T01:44:13.148 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-18T01:44:13.148 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-18T01:44:13.184 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-18T01:44:13.184 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-09-18T01:44:13.184 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/usr/bin/daemon-helper 2024-09-18T01:44:13.214 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-18T01:44:13.279 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-18T01:44:13.279 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/daemon-helper 2024-09-18T01:44:13.307 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-18T01:44:13.375 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-18T01:44:13.375 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-09-18T01:44:13.375 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-18T01:44:13.401 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-18T01:44:13.467 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-18T01:44:13.467 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-18T01:44:13.494 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-18T01:44:13.561 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-18T01:44:13.561 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-09-18T01:44:13.561 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/usr/bin/stdin-killer 2024-09-18T01:44:13.586 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-18T01:44:13.652 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-18T01:44:13.652 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/stdin-killer 2024-09-18T01:44:13.678 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-18T01:44:13.744 INFO:teuthology.run_tasks:Running task ceph... 2024-09-18T01:44:13.824 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-18T01:44:13.824 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod 777 /var/log/ceph 2024-09-18T01:44:13.827 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 777 /var/log/ceph 2024-09-18T01:44:13.852 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-18T01:44:13.852 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-18T01:44:13.892 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-18T01:44:13.917 INFO:tasks.ceph:Creating extra log directories... 2024-09-18T01:44:13.918 DEBUG:teuthology.orchestra.run.smithi129:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-18T01:44:13.956 DEBUG:teuthology.orchestra.run.smithi146:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-18T01:44:13.990 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-18T01:44:13.990 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-18T01:44:13.990 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-17_21:40:02-rgw-squid-distro-default-smithi/7909748', 'branch': 'squid', 'description': 'rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{centos_latest}}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7909748', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-17_21:40:02-rgw-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f'}}, 'rgw': {'ec-data-pool': True, 'frontend': 'beast'}, 's3tests': {'slow_backend': True}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'b0d356b98e08f6bc59ef15652f0d0e4298fc83c7'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'osd.0'], ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 9034, 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f', 'sleep_before_teardown': 0, 'subset': '0/1', 'suite': 'rgw', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_b0d356b98e08f6bc59ef15652f0d0e4298fc83c7/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'b0d356b98e08f6bc59ef15652f0d0e4298fc83c7', 'targets': {'smithi129.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK9gBw0jhyeZQwqd/Ilh5hmMK8aRqyP0EOBiqr2ZlXMUF2wZwiWXrnNT50uxQSPLxXUT7rdw2rrr8tnJBGfFkaI=', 'smithi146.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPyrv+8yATla5drKWQ7rs+93i/LNZ94m5gasYJdBU3tzWrgO2IdUdRGHZoy/wqz7917Ach70vcKc7o90Erep2dQ='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f', 'cluster': 'ceph'}}, {'rgw': {'client.0': None}}, {'radosgw-admin': None}, {'radosgw-admin-rest': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-17_21:40:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-18T01:44:13.991 DEBUG:teuthology.orchestra.run.smithi129:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-18T01:44:14.021 DEBUG:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-18T01:44:14.038 DEBUG:teuthology.orchestra.run.smithi129:> sudo install -d -m0777 -- /var/run/ceph 2024-09-18T01:44:14.077 DEBUG:teuthology.orchestra.run.smithi146:> sudo install -d -m0777 -- /var/run/ceph 2024-09-18T01:44:14.103 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-09-18T01:44:14.103 DEBUG:teuthology.orchestra.run.smithi129:> dd if=/scratch_devs of=/dev/stdout 2024-09-18T01:44:14.156 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-18T01:44:14.156 DEBUG:teuthology.orchestra.run.smithi129:> stat /dev/vg_nvme/lv_1 2024-09-18T01:44:14.212 INFO:teuthology.orchestra.run.smithi129.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-18T01:44:14.212 INFO:teuthology.orchestra.run.smithi129.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T01:44:14.212 INFO:teuthology.orchestra.run.smithi129.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-18T01:44:14.212 INFO:teuthology.orchestra.run.smithi129.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T01:44:14.212 INFO:teuthology.orchestra.run.smithi129.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T01:44:14.212 INFO:teuthology.orchestra.run.smithi129.stdout:Access: 2024-09-18 01:44:09.439723669 +0000 2024-09-18T01:44:14.212 INFO:teuthology.orchestra.run.smithi129.stdout:Modify: 2024-09-18 01:41:21.549365323 +0000 2024-09-18T01:44:14.213 INFO:teuthology.orchestra.run.smithi129.stdout:Change: 2024-09-18 01:41:21.549365323 +0000 2024-09-18T01:44:14.213 INFO:teuthology.orchestra.run.smithi129.stdout: Birth: 2024-09-18 01:41:21.549365323 +0000 2024-09-18T01:44:14.213 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-18T01:44:14.275 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records in 2024-09-18T01:44:14.275 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records out 2024-09-18T01:44:14.275 INFO:teuthology.orchestra.run.smithi129.stderr:512 bytes copied, 0.000205807 s, 2.5 MB/s 2024-09-18T01:44:14.276 DEBUG:teuthology.orchestra.run.smithi129:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-18T01:44:14.333 DEBUG:teuthology.orchestra.run.smithi129:> stat /dev/vg_nvme/lv_2 2024-09-18T01:44:14.388 INFO:teuthology.orchestra.run.smithi129.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-18T01:44:14.388 INFO:teuthology.orchestra.run.smithi129.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T01:44:14.388 INFO:teuthology.orchestra.run.smithi129.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-18T01:44:14.388 INFO:teuthology.orchestra.run.smithi129.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T01:44:14.388 INFO:teuthology.orchestra.run.smithi129.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T01:44:14.388 INFO:teuthology.orchestra.run.smithi129.stdout:Access: 2024-09-18 01:44:09.439723669 +0000 2024-09-18T01:44:14.388 INFO:teuthology.orchestra.run.smithi129.stdout:Modify: 2024-09-18 01:41:21.869365064 +0000 2024-09-18T01:44:14.388 INFO:teuthology.orchestra.run.smithi129.stdout:Change: 2024-09-18 01:41:21.869365064 +0000 2024-09-18T01:44:14.388 INFO:teuthology.orchestra.run.smithi129.stdout: Birth: 2024-09-18 01:41:21.869365064 +0000 2024-09-18T01:44:14.389 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-18T01:44:14.451 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records in 2024-09-18T01:44:14.451 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records out 2024-09-18T01:44:14.451 INFO:teuthology.orchestra.run.smithi129.stderr:512 bytes copied, 0.000193715 s, 2.6 MB/s 2024-09-18T01:44:14.453 DEBUG:teuthology.orchestra.run.smithi129:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-18T01:44:14.510 DEBUG:teuthology.orchestra.run.smithi129:> stat /dev/vg_nvme/lv_3 2024-09-18T01:44:14.565 INFO:teuthology.orchestra.run.smithi129.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-18T01:44:14.565 INFO:teuthology.orchestra.run.smithi129.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T01:44:14.565 INFO:teuthology.orchestra.run.smithi129.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-18T01:44:14.565 INFO:teuthology.orchestra.run.smithi129.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T01:44:14.565 INFO:teuthology.orchestra.run.smithi129.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T01:44:14.565 INFO:teuthology.orchestra.run.smithi129.stdout:Access: 2024-09-18 01:44:09.440723665 +0000 2024-09-18T01:44:14.566 INFO:teuthology.orchestra.run.smithi129.stdout:Modify: 2024-09-18 01:41:22.204364794 +0000 2024-09-18T01:44:14.566 INFO:teuthology.orchestra.run.smithi129.stdout:Change: 2024-09-18 01:41:22.204364794 +0000 2024-09-18T01:44:14.566 INFO:teuthology.orchestra.run.smithi129.stdout: Birth: 2024-09-18 01:41:22.204364794 +0000 2024-09-18T01:44:14.566 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-18T01:44:14.627 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records in 2024-09-18T01:44:14.628 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records out 2024-09-18T01:44:14.628 INFO:teuthology.orchestra.run.smithi129.stderr:512 bytes copied, 0.000187359 s, 2.7 MB/s 2024-09-18T01:44:14.629 DEBUG:teuthology.orchestra.run.smithi129:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-18T01:44:14.685 DEBUG:teuthology.orchestra.run.smithi129:> stat /dev/vg_nvme/lv_4 2024-09-18T01:44:14.740 INFO:teuthology.orchestra.run.smithi129.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-18T01:44:14.740 INFO:teuthology.orchestra.run.smithi129.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T01:44:14.740 INFO:teuthology.orchestra.run.smithi129.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-18T01:44:14.740 INFO:teuthology.orchestra.run.smithi129.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T01:44:14.740 INFO:teuthology.orchestra.run.smithi129.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T01:44:14.740 INFO:teuthology.orchestra.run.smithi129.stdout:Access: 2024-09-18 01:44:09.440723665 +0000 2024-09-18T01:44:14.740 INFO:teuthology.orchestra.run.smithi129.stdout:Modify: 2024-09-18 01:41:22.528364532 +0000 2024-09-18T01:44:14.740 INFO:teuthology.orchestra.run.smithi129.stdout:Change: 2024-09-18 01:41:22.528364532 +0000 2024-09-18T01:44:14.740 INFO:teuthology.orchestra.run.smithi129.stdout: Birth: 2024-09-18 01:41:22.528364532 +0000 2024-09-18T01:44:14.741 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-18T01:44:14.803 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records in 2024-09-18T01:44:14.803 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records out 2024-09-18T01:44:14.803 INFO:teuthology.orchestra.run.smithi129.stderr:512 bytes copied, 0.000199835 s, 2.6 MB/s 2024-09-18T01:44:14.805 DEBUG:teuthology.orchestra.run.smithi129:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-18T01:44:14.861 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-18T01:44:14.861 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-18T01:44:14.861 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/scratch_devs of=/dev/stdout 2024-09-18T01:44:14.879 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-18T01:44:14.879 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_1 2024-09-18T01:44:14.937 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-18T01:44:14.937 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T01:44:14.937 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-18T01:44:14.937 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T01:44:14.938 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T01:44:14.938 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2024-09-18 01:43:53.216624739 +0000 2024-09-18T01:44:14.938 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2024-09-18 01:41:29.762354916 +0000 2024-09-18T01:44:14.938 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2024-09-18 01:41:29.762354916 +0000 2024-09-18T01:44:14.938 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: 2024-09-18 01:41:29.762354916 +0000 2024-09-18T01:44:14.938 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-18T01:44:15.003 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-18T01:44:15.003 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-18T01:44:15.003 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000255044 s, 2.0 MB/s 2024-09-18T01:44:15.005 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-18T01:44:15.063 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_2 2024-09-18T01:44:15.118 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-18T01:44:15.118 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T01:44:15.119 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-18T01:44:15.119 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T01:44:15.119 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T01:44:15.119 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2024-09-18 01:43:53.216624739 +0000 2024-09-18T01:44:15.119 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2024-09-18 01:41:30.109349173 +0000 2024-09-18T01:44:15.119 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2024-09-18 01:41:30.109349173 +0000 2024-09-18T01:44:15.119 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: 2024-09-18 01:41:30.109349173 +0000 2024-09-18T01:44:15.119 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-18T01:44:15.183 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-18T01:44:15.183 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-18T01:44:15.183 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000219647 s, 2.3 MB/s 2024-09-18T01:44:15.184 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-18T01:44:15.241 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_3 2024-09-18T01:44:15.297 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-18T01:44:15.297 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T01:44:15.297 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-18T01:44:15.297 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T01:44:15.297 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T01:44:15.297 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2024-09-18 01:43:53.217624723 +0000 2024-09-18T01:44:15.297 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2024-09-18 01:41:30.445343611 +0000 2024-09-18T01:44:15.298 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2024-09-18 01:41:30.445343611 +0000 2024-09-18T01:44:15.298 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: 2024-09-18 01:41:30.445343611 +0000 2024-09-18T01:44:15.298 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-18T01:44:15.361 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-18T01:44:15.361 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-18T01:44:15.361 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000207038 s, 2.5 MB/s 2024-09-18T01:44:15.362 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-18T01:44:15.418 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_4 2024-09-18T01:44:15.473 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-18T01:44:15.474 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T01:44:15.474 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-18T01:44:15.474 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T01:44:15.474 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T01:44:15.474 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2024-09-18 01:43:53.217624723 +0000 2024-09-18T01:44:15.474 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2024-09-18 01:41:30.759338413 +0000 2024-09-18T01:44:15.474 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2024-09-18 01:41:30.759338413 +0000 2024-09-18T01:44:15.474 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: 2024-09-18 01:41:30.759338413 +0000 2024-09-18T01:44:15.474 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-18T01:44:15.536 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-18T01:44:15.537 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-18T01:44:15.537 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000206553 s, 2.5 MB/s 2024-09-18T01:44:15.538 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-18T01:44:15.594 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-18T01:44:15.594 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi129.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi146.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-18T01:44:15.595 INFO:tasks.ceph:Generating config... 2024-09-18T01:44:15.596 INFO:tasks.ceph:[client] debug ms = 1 2024-09-18T01:44:15.596 INFO:tasks.ceph:[client] rgw gc obj min wait = 15 2024-09-18T01:44:15.596 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-18T01:44:15.596 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-18T01:44:15.596 INFO:tasks.ceph:[client] setuser = ceph 2024-09-18T01:44:15.596 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-18T01:44:15.596 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-18T01:44:15.596 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-18T01:44:15.596 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-18T01:44:15.596 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-18T01:44:15.596 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-18T01:44:15.597 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-18T01:44:15.597 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-18T01:44:15.597 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-18T01:44:15.597 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-18T01:44:15.597 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-18T01:44:15.597 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-18T01:44:15.597 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-18T01:44:15.597 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-18T01:44:15.597 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-18T01:44:15.597 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-18T01:44:15.597 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-18T01:44:15.597 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-18T01:44:15.598 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-18T01:44:15.598 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-18T01:44:15.598 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-18T01:44:15.598 INFO:tasks.ceph:Setting up mon.a... 2024-09-18T01:44:15.598 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-18T01:44:15.651 INFO:teuthology.orchestra.run.smithi129.stdout:creating /etc/ceph/ceph.keyring 2024-09-18T01:44:15.653 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-18T01:44:15.697 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-18T01:44:15.763 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.129')] 2024-09-18T01:44:15.763 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.129'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2024-09-18T01:44:15.764 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-09-18T01:44:15.765 DEBUG:teuthology.orchestra.run.smithi129:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-18T01:44:15.818 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.129 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-18T01:44:15.898 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:44:15.898 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:44:15.899 INFO:teuthology.orchestra.run.smithi129.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-18T01:44:15.899 INFO:teuthology.orchestra.run.smithi129.stdout:monmaptool: generated fsid 5634e4ff-a0cf-4689-882d-342647f6e34c 2024-09-18T01:44:15.899 INFO:teuthology.orchestra.run.smithi129.stdout:setting min_mon_release = quincy 2024-09-18T01:44:15.899 INFO:teuthology.orchestra.run.smithi129.stdout:epoch 0 2024-09-18T01:44:15.899 INFO:teuthology.orchestra.run.smithi129.stdout:fsid 5634e4ff-a0cf-4689-882d-342647f6e34c 2024-09-18T01:44:15.899 INFO:teuthology.orchestra.run.smithi129.stdout:last_changed 2024-09-18T01:44:15.898900+0000 2024-09-18T01:44:15.899 INFO:teuthology.orchestra.run.smithi129.stdout:created 2024-09-18T01:44:15.898900+0000 2024-09-18T01:44:15.899 INFO:teuthology.orchestra.run.smithi129.stdout:min_mon_release 17 (quincy) 2024-09-18T01:44:15.899 INFO:teuthology.orchestra.run.smithi129.stdout:election_strategy: 1 2024-09-18T01:44:15.899 INFO:teuthology.orchestra.run.smithi129.stdout:0: [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] mon.a 2024-09-18T01:44:15.899 INFO:teuthology.orchestra.run.smithi129.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-18T01:44:15.901 DEBUG:teuthology.orchestra.run.smithi129:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-18T01:44:15.956 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 5634e4ff-a0cf-4689-882d-342647f6e34c... 2024-09-18T01:44:15.957 DEBUG:teuthology.orchestra.run.smithi129:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-18T01:44:15.998 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-18T01:44:16.038 INFO:teuthology.orchestra.run.smithi129.stdout:[global] 2024-09-18T01:44:16.038 INFO:teuthology.orchestra.run.smithi129.stdout: chdir = "" 2024-09-18T01:44:16.038 INFO:teuthology.orchestra.run.smithi129.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-18T01:44:16.038 INFO:teuthology.orchestra.run.smithi129.stdout: auth supported = cephx 2024-09-18T01:44:16.038 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:44:16.039 INFO:teuthology.orchestra.run.smithi129.stdout: filestore xattr use omap = true 2024-09-18T01:44:16.039 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:44:16.039 INFO:teuthology.orchestra.run.smithi129.stdout: mon clock drift allowed = 1.000 2024-09-18T01:44:16.039 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:44:16.039 INFO:teuthology.orchestra.run.smithi129.stdout: osd crush chooseleaf type = 0 2024-09-18T01:44:16.039 INFO:teuthology.orchestra.run.smithi129.stdout: auth debug = true 2024-09-18T01:44:16.039 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:44:16.039 INFO:teuthology.orchestra.run.smithi129.stdout: ms die on old message = true 2024-09-18T01:44:16.039 INFO:teuthology.orchestra.run.smithi129.stdout: ms die on bug = true 2024-09-18T01:44:16.039 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:44:16.039 INFO:teuthology.orchestra.run.smithi129.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-18T01:44:16.039 INFO:teuthology.orchestra.run.smithi129.stdout: mon pg warn max object skew = 0 2024-09-18T01:44:16.039 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:44:16.039 INFO:teuthology.orchestra.run.smithi129.stdout: # disable pg_autoscaler by default for new pools 2024-09-18T01:44:16.039 INFO:teuthology.orchestra.run.smithi129.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-18T01:44:16.040 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:44:16.040 INFO:teuthology.orchestra.run.smithi129.stdout: osd pool default size = 2 2024-09-18T01:44:16.040 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:44:16.040 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd allow primary affinity = true 2024-09-18T01:44:16.040 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd allow pg remap = true 2024-09-18T01:44:16.040 INFO:teuthology.orchestra.run.smithi129.stdout: mon warn on legacy crush tunables = false 2024-09-18T01:44:16.040 INFO:teuthology.orchestra.run.smithi129.stdout: mon warn on crush straw calc version zero = false 2024-09-18T01:44:16.040 INFO:teuthology.orchestra.run.smithi129.stdout: mon warn on no sortbitwise = false 2024-09-18T01:44:16.040 INFO:teuthology.orchestra.run.smithi129.stdout: mon warn on osd down out interval zero = false 2024-09-18T01:44:16.040 INFO:teuthology.orchestra.run.smithi129.stdout: mon warn on too few osds = false 2024-09-18T01:44:16.040 INFO:teuthology.orchestra.run.smithi129.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-18T01:44:16.040 INFO:teuthology.orchestra.run.smithi129.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-18T01:44:16.040 INFO:teuthology.orchestra.run.smithi129.stdout: mon_allow_pool_size_one = true 2024-09-18T01:44:16.040 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:44:16.040 INFO:teuthology.orchestra.run.smithi129.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-18T01:44:16.041 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:44:16.041 INFO:teuthology.orchestra.run.smithi129.stdout: osd default data pool replay window = 5 2024-09-18T01:44:16.041 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:44:16.041 INFO:teuthology.orchestra.run.smithi129.stdout: mon allow pool delete = true 2024-09-18T01:44:16.041 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:44:16.041 INFO:teuthology.orchestra.run.smithi129.stdout: mon cluster log file level = debug 2024-09-18T01:44:16.041 INFO:teuthology.orchestra.run.smithi129.stdout: debug asserts on shutdown = true 2024-09-18T01:44:16.041 INFO:teuthology.orchestra.run.smithi129.stdout: mon health detail to clog = false 2024-09-18T01:44:16.041 INFO:teuthology.orchestra.run.smithi129.stdout: mon host = 172.21.15.129 2024-09-18T01:44:16.041 INFO:teuthology.orchestra.run.smithi129.stdout: fsid = 5634e4ff-a0cf-4689-882d-342647f6e34c 2024-09-18T01:44:16.041 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:44:16.041 INFO:teuthology.orchestra.run.smithi129.stdout:[osd] 2024-09-18T01:44:16.041 INFO:teuthology.orchestra.run.smithi129.stdout: osd journal size = 100 2024-09-18T01:44:16.041 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:44:16.041 INFO:teuthology.orchestra.run.smithi129.stdout: osd scrub load threshold = 5.0 2024-09-18T01:44:16.042 INFO:teuthology.orchestra.run.smithi129.stdout: osd scrub max interval = 600 2024-09-18T01:44:16.042 INFO:teuthology.orchestra.run.smithi129.stdout: osd mclock profile = high_recovery_ops 2024-09-18T01:44:16.042 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:44:16.042 INFO:teuthology.orchestra.run.smithi129.stdout: osd recover clone overlap = true 2024-09-18T01:44:16.042 INFO:teuthology.orchestra.run.smithi129.stdout: osd recovery max chunk = 1048576 2024-09-18T01:44:16.042 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:44:16.042 INFO:teuthology.orchestra.run.smithi129.stdout: osd debug shutdown = true 2024-09-18T01:44:16.042 INFO:teuthology.orchestra.run.smithi129.stdout: osd debug op order = true 2024-09-18T01:44:16.042 INFO:teuthology.orchestra.run.smithi129.stdout: osd debug verify stray on activate = true 2024-09-18T01:44:16.042 INFO:teuthology.orchestra.run.smithi129.stdout: osd debug trim objects = true 2024-09-18T01:44:16.042 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:44:16.042 INFO:teuthology.orchestra.run.smithi129.stdout: osd open classes on start = true 2024-09-18T01:44:16.042 INFO:teuthology.orchestra.run.smithi129.stdout: osd debug pg log writeout = true 2024-09-18T01:44:16.042 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:44:16.043 INFO:teuthology.orchestra.run.smithi129.stdout: osd deep scrub update digest min age = 30 2024-09-18T01:44:16.043 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:44:16.043 INFO:teuthology.orchestra.run.smithi129.stdout: osd map max advance = 10 2024-09-18T01:44:16.043 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:44:16.043 INFO:teuthology.orchestra.run.smithi129.stdout: journal zero on create = true 2024-09-18T01:44:16.043 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:44:16.043 INFO:teuthology.orchestra.run.smithi129.stdout: filestore ondisk finisher threads = 3 2024-09-18T01:44:16.043 INFO:teuthology.orchestra.run.smithi129.stdout: filestore apply finisher threads = 3 2024-09-18T01:44:16.043 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:44:16.043 INFO:teuthology.orchestra.run.smithi129.stdout: bdev debug aio = true 2024-09-18T01:44:16.043 INFO:teuthology.orchestra.run.smithi129.stdout: osd debug misdirected ops = true 2024-09-18T01:44:16.043 INFO:teuthology.orchestra.run.smithi129.stdout: debug ms = 1 2024-09-18T01:44:16.043 INFO:teuthology.orchestra.run.smithi129.stdout: debug objclass = 20 2024-09-18T01:44:16.043 INFO:teuthology.orchestra.run.smithi129.stdout: bdev async discard = True 2024-09-18T01:44:16.044 INFO:teuthology.orchestra.run.smithi129.stdout: bdev enable discard = True 2024-09-18T01:44:16.044 INFO:teuthology.orchestra.run.smithi129.stdout: bluestore allocator = bitmap 2024-09-18T01:44:16.044 INFO:teuthology.orchestra.run.smithi129.stdout: bluestore block size = 96636764160 2024-09-18T01:44:16.044 INFO:teuthology.orchestra.run.smithi129.stdout: bluestore fsck on mount = True 2024-09-18T01:44:16.044 INFO:teuthology.orchestra.run.smithi129.stdout: debug bluefs = 1/20 2024-09-18T01:44:16.044 INFO:teuthology.orchestra.run.smithi129.stdout: debug bluestore = 1/20 2024-09-18T01:44:16.044 INFO:teuthology.orchestra.run.smithi129.stdout: debug osd = 20 2024-09-18T01:44:16.044 INFO:teuthology.orchestra.run.smithi129.stdout: debug rocksdb = 4/10 2024-09-18T01:44:16.044 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd backfillfull_ratio = 0.85 2024-09-18T01:44:16.044 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd full ratio = 0.9 2024-09-18T01:44:16.044 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd nearfull ratio = 0.8 2024-09-18T01:44:16.044 INFO:teuthology.orchestra.run.smithi129.stdout: osd failsafe full ratio = 0.95 2024-09-18T01:44:16.044 INFO:teuthology.orchestra.run.smithi129.stdout: osd objectstore = bluestore 2024-09-18T01:44:16.044 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:44:16.044 INFO:teuthology.orchestra.run.smithi129.stdout:[mgr] 2024-09-18T01:44:16.045 INFO:teuthology.orchestra.run.smithi129.stdout: debug ms = 1 2024-09-18T01:44:16.045 INFO:teuthology.orchestra.run.smithi129.stdout: debug mgr = 20 2024-09-18T01:44:16.045 INFO:teuthology.orchestra.run.smithi129.stdout: debug mon = 20 2024-09-18T01:44:16.045 INFO:teuthology.orchestra.run.smithi129.stdout: debug auth = 20 2024-09-18T01:44:16.045 INFO:teuthology.orchestra.run.smithi129.stdout: mon reweight min pgs per osd = 4 2024-09-18T01:44:16.045 INFO:teuthology.orchestra.run.smithi129.stdout: mon reweight min bytes per osd = 10 2024-09-18T01:44:16.045 INFO:teuthology.orchestra.run.smithi129.stdout: mgr/telemetry/nag = false 2024-09-18T01:44:16.045 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:44:16.045 INFO:teuthology.orchestra.run.smithi129.stdout:[mon] 2024-09-18T01:44:16.045 INFO:teuthology.orchestra.run.smithi129.stdout: debug ms = 1 2024-09-18T01:44:16.045 INFO:teuthology.orchestra.run.smithi129.stdout: debug mon = 20 2024-09-18T01:44:16.045 INFO:teuthology.orchestra.run.smithi129.stdout: debug paxos = 20 2024-09-18T01:44:16.045 INFO:teuthology.orchestra.run.smithi129.stdout: debug auth = 20 2024-09-18T01:44:16.046 INFO:teuthology.orchestra.run.smithi129.stdout: mon data avail warn = 5 2024-09-18T01:44:16.046 INFO:teuthology.orchestra.run.smithi129.stdout: mon mgr mkfs grace = 240 2024-09-18T01:44:16.046 INFO:teuthology.orchestra.run.smithi129.stdout: mon reweight min pgs per osd = 4 2024-09-18T01:44:16.046 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd reporter subtree level = osd 2024-09-18T01:44:16.046 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd prime pg temp = true 2024-09-18T01:44:16.046 INFO:teuthology.orchestra.run.smithi129.stdout: mon reweight min bytes per osd = 10 2024-09-18T01:44:16.046 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:44:16.046 INFO:teuthology.orchestra.run.smithi129.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-18T01:44:16.046 INFO:teuthology.orchestra.run.smithi129.stdout: auth mon ticket ttl = 660 # 11m 2024-09-18T01:44:16.046 INFO:teuthology.orchestra.run.smithi129.stdout: auth service ticket ttl = 240 # 4m 2024-09-18T01:44:16.046 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:44:16.046 INFO:teuthology.orchestra.run.smithi129.stdout: # don't complain about insecure global_id in the test suite 2024-09-18T01:44:16.046 INFO:teuthology.orchestra.run.smithi129.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-18T01:44:16.046 INFO:teuthology.orchestra.run.smithi129.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-18T01:44:16.047 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:44:16.047 INFO:teuthology.orchestra.run.smithi129.stdout: # 1m isn't quite enough 2024-09-18T01:44:16.047 INFO:teuthology.orchestra.run.smithi129.stdout: mon_down_mkfs_grace = 2m 2024-09-18T01:44:16.047 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:44:16.047 INFO:teuthology.orchestra.run.smithi129.stdout: mon_warn_on_filestore_osds = false 2024-09-18T01:44:16.047 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:44:16.047 INFO:teuthology.orchestra.run.smithi129.stdout:[client] 2024-09-18T01:44:16.047 INFO:teuthology.orchestra.run.smithi129.stdout: rgw cache enabled = true 2024-09-18T01:44:16.047 INFO:teuthology.orchestra.run.smithi129.stdout: rgw enable ops log = true 2024-09-18T01:44:16.047 INFO:teuthology.orchestra.run.smithi129.stdout: rgw enable usage log = true 2024-09-18T01:44:16.047 INFO:teuthology.orchestra.run.smithi129.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-18T01:44:16.047 INFO:teuthology.orchestra.run.smithi129.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-18T01:44:16.047 INFO:teuthology.orchestra.run.smithi129.stdout: debug ms = 1 2024-09-18T01:44:16.047 INFO:teuthology.orchestra.run.smithi129.stdout: rgw gc obj min wait = 15 2024-09-18T01:44:16.047 INFO:teuthology.orchestra.run.smithi129.stdout: debug rgw = 20 2024-09-18T01:44:16.048 INFO:teuthology.orchestra.run.smithi129.stdout: setgroup = ceph 2024-09-18T01:44:16.048 INFO:teuthology.orchestra.run.smithi129.stdout: setuser = ceph 2024-09-18T01:44:16.048 INFO:teuthology.orchestra.run.smithi129.stdout:[mon.a] 2024-09-18T01:44:16.048 INFO:teuthology.orchestra.run.smithi146.stdout:[global] 2024-09-18T01:44:16.048 INFO:teuthology.orchestra.run.smithi146.stdout: chdir = "" 2024-09-18T01:44:16.048 INFO:teuthology.orchestra.run.smithi146.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-18T01:44:16.048 INFO:teuthology.orchestra.run.smithi146.stdout: auth supported = cephx 2024-09-18T01:44:16.048 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:44:16.048 INFO:teuthology.orchestra.run.smithi146.stdout: filestore xattr use omap = true 2024-09-18T01:44:16.048 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:44:16.048 INFO:teuthology.orchestra.run.smithi146.stdout: mon clock drift allowed = 1.000 2024-09-18T01:44:16.049 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:44:16.049 INFO:teuthology.orchestra.run.smithi146.stdout: osd crush chooseleaf type = 0 2024-09-18T01:44:16.049 INFO:teuthology.orchestra.run.smithi146.stdout: auth debug = true 2024-09-18T01:44:16.049 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:44:16.049 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on old message = true 2024-09-18T01:44:16.049 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on bug = true 2024-09-18T01:44:16.049 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:44:16.049 INFO:teuthology.orchestra.run.smithi146.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-18T01:44:16.049 INFO:teuthology.orchestra.run.smithi146.stdout: mon pg warn max object skew = 0 2024-09-18T01:44:16.049 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:44:16.049 INFO:teuthology.orchestra.run.smithi146.stdout: # disable pg_autoscaler by default for new pools 2024-09-18T01:44:16.049 INFO:teuthology.orchestra.run.smithi146.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-18T01:44:16.049 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:44:16.049 INFO:teuthology.orchestra.run.smithi146.stdout: osd pool default size = 2 2024-09-18T01:44:16.050 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:44:16.050 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd allow primary affinity = true 2024-09-18T01:44:16.050 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd allow pg remap = true 2024-09-18T01:44:16.050 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on legacy crush tunables = false 2024-09-18T01:44:16.050 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on crush straw calc version zero = false 2024-09-18T01:44:16.050 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on no sortbitwise = false 2024-09-18T01:44:16.050 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on osd down out interval zero = false 2024-09-18T01:44:16.050 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on too few osds = false 2024-09-18T01:44:16.050 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-18T01:44:16.050 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-18T01:44:16.050 INFO:teuthology.orchestra.run.smithi146.stdout: mon_allow_pool_size_one = true 2024-09-18T01:44:16.050 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:44:16.050 INFO:teuthology.orchestra.run.smithi146.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-18T01:44:16.050 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:44:16.050 INFO:teuthology.orchestra.run.smithi146.stdout: osd default data pool replay window = 5 2024-09-18T01:44:16.051 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:44:16.051 INFO:teuthology.orchestra.run.smithi146.stdout: mon allow pool delete = true 2024-09-18T01:44:16.051 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:44:16.051 INFO:teuthology.orchestra.run.smithi146.stdout: mon cluster log file level = debug 2024-09-18T01:44:16.051 INFO:teuthology.orchestra.run.smithi146.stdout: debug asserts on shutdown = true 2024-09-18T01:44:16.051 INFO:teuthology.orchestra.run.smithi146.stdout: mon health detail to clog = false 2024-09-18T01:44:16.051 INFO:teuthology.orchestra.run.smithi146.stdout: mon host = 172.21.15.129 2024-09-18T01:44:16.051 INFO:teuthology.orchestra.run.smithi146.stdout: fsid = 5634e4ff-a0cf-4689-882d-342647f6e34c 2024-09-18T01:44:16.051 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:44:16.051 INFO:teuthology.orchestra.run.smithi146.stdout:[osd] 2024-09-18T01:44:16.051 INFO:teuthology.orchestra.run.smithi146.stdout: osd journal size = 100 2024-09-18T01:44:16.051 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:44:16.051 INFO:teuthology.orchestra.run.smithi146.stdout: osd scrub load threshold = 5.0 2024-09-18T01:44:16.051 INFO:teuthology.orchestra.run.smithi146.stdout: osd scrub max interval = 600 2024-09-18T01:44:16.051 INFO:teuthology.orchestra.run.smithi146.stdout: osd mclock profile = high_recovery_ops 2024-09-18T01:44:16.052 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:44:16.052 INFO:teuthology.orchestra.run.smithi146.stdout: osd recover clone overlap = true 2024-09-18T01:44:16.052 INFO:teuthology.orchestra.run.smithi146.stdout: osd recovery max chunk = 1048576 2024-09-18T01:44:16.052 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:44:16.052 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug shutdown = true 2024-09-18T01:44:16.052 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug op order = true 2024-09-18T01:44:16.052 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug verify stray on activate = true 2024-09-18T01:44:16.052 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug trim objects = true 2024-09-18T01:44:16.052 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:44:16.052 INFO:teuthology.orchestra.run.smithi146.stdout: osd open classes on start = true 2024-09-18T01:44:16.053 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug pg log writeout = true 2024-09-18T01:44:16.053 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:44:16.053 INFO:teuthology.orchestra.run.smithi146.stdout: osd deep scrub update digest min age = 30 2024-09-18T01:44:16.053 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:44:16.053 INFO:teuthology.orchestra.run.smithi146.stdout: osd map max advance = 10 2024-09-18T01:44:16.053 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:44:16.053 INFO:teuthology.orchestra.run.smithi146.stdout: journal zero on create = true 2024-09-18T01:44:16.053 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:44:16.053 INFO:teuthology.orchestra.run.smithi146.stdout: filestore ondisk finisher threads = 3 2024-09-18T01:44:16.053 INFO:teuthology.orchestra.run.smithi146.stdout: filestore apply finisher threads = 3 2024-09-18T01:44:16.053 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:44:16.053 INFO:teuthology.orchestra.run.smithi146.stdout: bdev debug aio = true 2024-09-18T01:44:16.054 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug misdirected ops = true 2024-09-18T01:44:16.054 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2024-09-18T01:44:16.054 INFO:teuthology.orchestra.run.smithi146.stdout: debug objclass = 20 2024-09-18T01:44:16.054 INFO:teuthology.orchestra.run.smithi146.stdout: bdev async discard = True 2024-09-18T01:44:16.054 INFO:teuthology.orchestra.run.smithi146.stdout: bdev enable discard = True 2024-09-18T01:44:16.054 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore allocator = bitmap 2024-09-18T01:44:16.054 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore block size = 96636764160 2024-09-18T01:44:16.054 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore fsck on mount = True 2024-09-18T01:44:16.054 INFO:teuthology.orchestra.run.smithi146.stdout: debug bluefs = 1/20 2024-09-18T01:44:16.054 INFO:teuthology.orchestra.run.smithi146.stdout: debug bluestore = 1/20 2024-09-18T01:44:16.054 INFO:teuthology.orchestra.run.smithi146.stdout: debug osd = 20 2024-09-18T01:44:16.054 INFO:teuthology.orchestra.run.smithi146.stdout: debug rocksdb = 4/10 2024-09-18T01:44:16.054 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd backfillfull_ratio = 0.85 2024-09-18T01:44:16.054 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd full ratio = 0.9 2024-09-18T01:44:16.054 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd nearfull ratio = 0.8 2024-09-18T01:44:16.055 INFO:teuthology.orchestra.run.smithi146.stdout: osd failsafe full ratio = 0.95 2024-09-18T01:44:16.055 INFO:teuthology.orchestra.run.smithi146.stdout: osd objectstore = bluestore 2024-09-18T01:44:16.055 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:44:16.055 INFO:teuthology.orchestra.run.smithi146.stdout:[mgr] 2024-09-18T01:44:16.055 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2024-09-18T01:44:16.055 INFO:teuthology.orchestra.run.smithi146.stdout: debug mgr = 20 2024-09-18T01:44:16.055 INFO:teuthology.orchestra.run.smithi146.stdout: debug mon = 20 2024-09-18T01:44:16.055 INFO:teuthology.orchestra.run.smithi146.stdout: debug auth = 20 2024-09-18T01:44:16.055 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min pgs per osd = 4 2024-09-18T01:44:16.055 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min bytes per osd = 10 2024-09-18T01:44:16.055 INFO:teuthology.orchestra.run.smithi146.stdout: mgr/telemetry/nag = false 2024-09-18T01:44:16.055 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:44:16.055 INFO:teuthology.orchestra.run.smithi146.stdout:[mon] 2024-09-18T01:44:16.055 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2024-09-18T01:44:16.055 INFO:teuthology.orchestra.run.smithi146.stdout: debug mon = 20 2024-09-18T01:44:16.056 INFO:teuthology.orchestra.run.smithi146.stdout: debug paxos = 20 2024-09-18T01:44:16.056 INFO:teuthology.orchestra.run.smithi146.stdout: debug auth = 20 2024-09-18T01:44:16.056 INFO:teuthology.orchestra.run.smithi146.stdout: mon data avail warn = 5 2024-09-18T01:44:16.056 INFO:teuthology.orchestra.run.smithi146.stdout: mon mgr mkfs grace = 240 2024-09-18T01:44:16.056 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min pgs per osd = 4 2024-09-18T01:44:16.056 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd reporter subtree level = osd 2024-09-18T01:44:16.056 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd prime pg temp = true 2024-09-18T01:44:16.056 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min bytes per osd = 10 2024-09-18T01:44:16.056 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:44:16.056 INFO:teuthology.orchestra.run.smithi146.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-18T01:44:16.056 INFO:teuthology.orchestra.run.smithi146.stdout: auth mon ticket ttl = 660 # 11m 2024-09-18T01:44:16.056 INFO:teuthology.orchestra.run.smithi146.stdout: auth service ticket ttl = 240 # 4m 2024-09-18T01:44:16.056 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:44:16.056 INFO:teuthology.orchestra.run.smithi146.stdout: # don't complain about insecure global_id in the test suite 2024-09-18T01:44:16.057 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-18T01:44:16.057 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-18T01:44:16.057 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:44:16.057 INFO:teuthology.orchestra.run.smithi146.stdout: # 1m isn't quite enough 2024-09-18T01:44:16.057 INFO:teuthology.orchestra.run.smithi146.stdout: mon_down_mkfs_grace = 2m 2024-09-18T01:44:16.057 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:44:16.057 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_filestore_osds = false 2024-09-18T01:44:16.057 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-18T01:44:16.057 INFO:teuthology.orchestra.run.smithi146.stdout:[client] 2024-09-18T01:44:16.057 INFO:teuthology.orchestra.run.smithi146.stdout: rgw cache enabled = true 2024-09-18T01:44:16.057 INFO:teuthology.orchestra.run.smithi146.stdout: rgw enable ops log = true 2024-09-18T01:44:16.057 INFO:teuthology.orchestra.run.smithi146.stdout: rgw enable usage log = true 2024-09-18T01:44:16.057 INFO:teuthology.orchestra.run.smithi146.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-18T01:44:16.057 INFO:teuthology.orchestra.run.smithi146.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-18T01:44:16.057 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2024-09-18T01:44:16.058 INFO:teuthology.orchestra.run.smithi146.stdout: rgw gc obj min wait = 15 2024-09-18T01:44:16.058 INFO:teuthology.orchestra.run.smithi146.stdout: debug rgw = 20 2024-09-18T01:44:16.058 INFO:teuthology.orchestra.run.smithi146.stdout: setgroup = ceph 2024-09-18T01:44:16.058 INFO:teuthology.orchestra.run.smithi146.stdout: setuser = ceph 2024-09-18T01:44:16.058 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.a] 2024-09-18T01:44:16.059 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-18T01:44:16.059 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-18T01:44:16.153 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-18T01:44:16.153 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-09-18T01:44:16.153 DEBUG:teuthology.orchestra.run.smithi129:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-18T01:44:16.168 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-09-18T01:44:16.168 DEBUG:teuthology.orchestra.run.smithi129:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-18T01:44:16.224 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi129.front.sepia.ceph.com 2024-09-18T01:44:16.224 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-09-18T01:44:16.224 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-18T01:44:16.224 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-18T01:44:16.297 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-09-18T01:44:16.297 DEBUG:teuthology.orchestra.run.smithi129:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-18T01:44:16.353 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi146.front.sepia.ceph.com 2024-09-18T01:44:16.353 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-18T01:44:16.353 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-18T01:44:16.353 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-18T01:44:16.391 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-18T01:44:16.392 DEBUG:teuthology.orchestra.run.smithi146:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-18T01:44:16.447 INFO:tasks.ceph:Setting up mon nodes... 2024-09-18T01:44:16.447 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-18T01:44:16.447 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-18T01:44:16.549 INFO:teuthology.orchestra.run.smithi146.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-18T01:44:16.551 INFO:tasks.ceph:Setting up mds nodes... 2024-09-18T01:44:16.551 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-18T01:44:16.551 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-18T01:44:16.592 INFO:teuthology.orchestra.run.smithi146.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-18T01:44:16.605 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-18T01:44:16.605 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi129.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi146.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-18T01:44:16.605 DEBUG:teuthology.orchestra.run.smithi129:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-18T01:44:16.630 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-18T01:44:16.630 INFO:tasks.ceph:role: osd.0 2024-09-18T01:44:16.631 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi129.front.sepia.ceph.com 2024-09-18T01:44:16.631 DEBUG:teuthology.orchestra.run.smithi129:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-18T01:44:16.703 INFO:teuthology.orchestra.run.smithi129.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-18T01:44:16.703 INFO:teuthology.orchestra.run.smithi129.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-18T01:44:16.703 INFO:teuthology.orchestra.run.smithi129.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-18T01:44:16.703 INFO:teuthology.orchestra.run.smithi129.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-18T01:44:16.703 INFO:teuthology.orchestra.run.smithi129.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-18T01:44:16.703 INFO:teuthology.orchestra.run.smithi129.stdout: = sunit=0 swidth=0 blks 2024-09-18T01:44:16.703 INFO:teuthology.orchestra.run.smithi129.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-18T01:44:16.703 INFO:teuthology.orchestra.run.smithi129.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-18T01:44:16.704 INFO:teuthology.orchestra.run.smithi129.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-18T01:44:16.704 INFO:teuthology.orchestra.run.smithi129.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-18T01:44:17.204 INFO:teuthology.orchestra.run.smithi129.stdout:Discarding blocks...Done. 2024-09-18T01:44:17.206 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi129.front.sepia.ceph.com -o noatime 2024-09-18T01:44:17.207 DEBUG:teuthology.orchestra.run.smithi129:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-18T01:44:17.324 DEBUG:teuthology.orchestra.run.smithi129:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-18T01:44:17.362 DEBUG:teuthology.orchestra.run.smithi129:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T01:44:17.465 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:17.464+0000 7f14a05bb640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-18T01:44:17.467 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:17.466+0000 7f14a05bb640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-18T01:44:17.468 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:17.467+0000 7f14a05bb640 -1 bdev(0x55c52d3c1800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-18T01:44:17.468 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:17.467+0000 7f14a05bb640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-18T01:44:20.905 DEBUG:teuthology.orchestra.run.smithi129:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-18T01:44:20.936 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-18T01:44:20.966 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-18T01:44:20.966 INFO:tasks.ceph:role: osd.1 2024-09-18T01:44:20.966 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi146.front.sepia.ceph.com 2024-09-18T01:44:20.966 DEBUG:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-18T01:44:21.043 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-18T01:44:21.043 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-18T01:44:21.043 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-18T01:44:21.043 INFO:teuthology.orchestra.run.smithi146.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-18T01:44:21.043 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-18T01:44:21.043 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2024-09-18T01:44:21.043 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-18T01:44:21.043 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-18T01:44:21.044 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-18T01:44:21.044 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-18T01:44:21.550 INFO:teuthology.orchestra.run.smithi146.stdout:Discarding blocks...Done. 2024-09-18T01:44:21.552 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2024-09-18T01:44:21.552 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-09-18T01:44:21.656 DEBUG:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-18T01:44:21.687 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-18T01:44:21.753 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-18T01:44:21.753 INFO:tasks.ceph:role: osd.2 2024-09-18T01:44:21.754 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi146.front.sepia.ceph.com 2024-09-18T01:44:21.754 DEBUG:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-18T01:44:21.826 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-18T01:44:21.826 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-18T01:44:21.826 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-18T01:44:21.827 INFO:teuthology.orchestra.run.smithi146.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-18T01:44:21.827 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-18T01:44:21.827 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2024-09-18T01:44:21.827 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-18T01:44:21.827 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-18T01:44:21.827 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-18T01:44:21.827 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-18T01:44:22.288 INFO:teuthology.orchestra.run.smithi146.stdout:Discarding blocks...Done. 2024-09-18T01:44:22.290 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2024-09-18T01:44:22.291 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2024-09-18T01:44:22.383 DEBUG:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-18T01:44:22.412 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-18T01:44:22.477 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-18T01:44:22.477 INFO:tasks.ceph:role: osd.3 2024-09-18T01:44:22.478 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi146.front.sepia.ceph.com 2024-09-18T01:44:22.478 DEBUG:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-18T01:44:22.549 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-18T01:44:22.550 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-18T01:44:22.550 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-18T01:44:22.550 INFO:teuthology.orchestra.run.smithi146.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-18T01:44:22.550 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-18T01:44:22.550 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2024-09-18T01:44:22.550 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-18T01:44:22.550 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-18T01:44:22.550 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-18T01:44:22.550 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-18T01:44:23.038 INFO:teuthology.orchestra.run.smithi146.stdout:Discarding blocks...Done. 2024-09-18T01:44:23.040 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2024-09-18T01:44:23.040 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2024-09-18T01:44:23.182 DEBUG:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-18T01:44:23.213 DEBUG:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T01:44:23.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:23.341+0000 7fd61781e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-18T01:44:23.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:23.345+0000 7fd61781e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-18T01:44:23.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:23.345+0000 7fd61781e640 -1 bdev(0x55ea91a33800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-18T01:44:23.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:23.345+0000 7fd61781e640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-18T01:44:27.240 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-18T01:44:27.270 DEBUG:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T01:44:27.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:27.360+0000 7f88274f1640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-18T01:44:27.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:27.360+0000 7f88274f1640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-18T01:44:27.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:27.360+0000 7f88274f1640 -1 bdev(0x55926006d800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-18T01:44:27.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:27.360+0000 7f88274f1640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-18T01:44:31.257 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-18T01:44:31.287 DEBUG:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T01:44:31.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:31.377+0000 7fb530014640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-18T01:44:31.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:31.377+0000 7fb530014640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-18T01:44:31.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:31.377+0000 7fb530014640 -1 bdev(0x55c532559800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-18T01:44:31.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:31.377+0000 7fb530014640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-18T01:44:35.039 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-18T01:44:35.067 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-18T01:44:35.067 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-09-18T01:44:35.067 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-18T01:44:35.097 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-18T01:44:35.098 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-18T01:44:35.135 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-18T01:44:35.135 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-18T01:44:35.201 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-18T01:44:35.201 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-18T01:44:35.266 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-18T01:44:35.267 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-18T01:44:35.332 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-18T01:44:35.332 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-18T01:44:35.388 INFO:tasks.ceph:Adding keys to all mons... 2024-09-18T01:44:35.388 DEBUG:teuthology.orchestra.run.smithi129:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-18T01:44:35.413 INFO:teuthology.orchestra.run.smithi129.stdout:[osd.0] 2024-09-18T01:44:35.413 INFO:teuthology.orchestra.run.smithi129.stdout: key = AQBxMOpmyKe6GxAAaNhBUTRtebJBmbi7WFCfTg== 2024-09-18T01:44:35.413 INFO:teuthology.orchestra.run.smithi129.stdout:[mgr.x] 2024-09-18T01:44:35.414 INFO:teuthology.orchestra.run.smithi129.stdout: key = AQBwMOpmtJC5IBAAw43SJm1OA4HIvUV+5Lek4g== 2024-09-18T01:44:35.414 INFO:teuthology.orchestra.run.smithi129.stdout:[osd.1] 2024-09-18T01:44:35.414 INFO:teuthology.orchestra.run.smithi129.stdout: key = AQB3MOpmzlZbFBAAlv/9QqRAZddzzVRurwtXag== 2024-09-18T01:44:35.414 INFO:teuthology.orchestra.run.smithi129.stdout:[osd.2] 2024-09-18T01:44:35.414 INFO:teuthology.orchestra.run.smithi129.stdout: key = AQB7MOpmdGp9FRAAGI6amOZBcoV78aZ09onMtQ== 2024-09-18T01:44:35.414 INFO:teuthology.orchestra.run.smithi129.stdout:[osd.3] 2024-09-18T01:44:35.414 INFO:teuthology.orchestra.run.smithi129.stdout: key = AQB/MOpmClWSFhAAScn9pgrHoOwMCceBGYhTrg== 2024-09-18T01:44:35.414 INFO:teuthology.orchestra.run.smithi129.stdout:[client.0] 2024-09-18T01:44:35.414 INFO:teuthology.orchestra.run.smithi129.stdout: key = AQBwMOpmwTJNIxAAYye9xVytvPr6sNa8z0V85w== 2024-09-18T01:44:35.415 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T01:44:35.508 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-18T01:44:35.558 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T01:44:35.609 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T01:44:35.659 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T01:44:35.710 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-18T01:44:35.764 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-18T01:44:35.764 DEBUG:teuthology.orchestra.run.smithi129:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-18T01:44:35.789 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-18T01:44:35.884 DEBUG:teuthology.orchestra.run.smithi129:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-18T01:44:35.908 DEBUG:teuthology.orchestra.run.smithi129:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-18T01:44:35.964 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-18T01:44:35.965 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-18T01:44:35.965 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-18T01:44:36.007 INFO:tasks.ceph.mon.a:Started 2024-09-18T01:44:36.007 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-18T01:44:36.008 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-18T01:44:36.008 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-18T01:44:36.010 INFO:tasks.ceph.mgr.x:Started 2024-09-18T01:44:36.010 INFO:tasks.ceph:Setting crush tunables to default 2024-09-18T01:44:36.010 DEBUG:teuthology.orchestra.run.smithi129:> sudo ceph --cluster ceph osd crush tunables default 2024-09-18T01:44:36.112 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.110+0000 7fd415008640 1 Processor -- start 2024-09-18T01:44:36.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.110+0000 7fd415008640 1 -- start start 2024-09-18T01:44:36.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.111+0000 7fd415008640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fd41009bd50 0x7fd41009c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:36.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.111+0000 7fd415008640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd41009d3b0 con 0x7fd41009c670 2024-09-18T01:44:36.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.111+0000 7fd415008640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x7fd410098230 con 0x7fd41009bd50 2024-09-18T01:44:36.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.111+0000 7fd40ed9d640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fd41009bd50 0x7fd41009c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:36.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.111+0000 7fd40ed9d640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fd41009bd50 0x7fd41009c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:50520/0 (socket says 172.21.15.129:50520) 2024-09-18T01:44:36.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.111+0000 7fd40ed9d640 1 -- 172.21.15.129:0/1777495298 learned_addr learned my addr 172.21.15.129:0/1777495298 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-18T01:44:36.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.111+0000 7fd40ed9d640 1 -- 172.21.15.129:0/1777495298 >> v2:172.21.15.129:3300/0 conn(0x7fd41009bd50 msgr2=0x7fd41009c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-18T01:44:36.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.111+0000 7fd40ed9d640 1 -- 172.21.15.129:0/1777495298 >> v2:172.21.15.129:3300/0 conn(0x7fd41009bd50 msgr2=0x7fd41009c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-18T01:44:36.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.111+0000 7fd40ed9d640 1 --2- 172.21.15.129:0/1777495298 >> v2:172.21.15.129:3300/0 conn(0x7fd41009bd50 0x7fd41009c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-18T01:44:36.113 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.111+0000 7fd40ed9d640 1 --2- 172.21.15.129:0/1777495298 >> v2:172.21.15.129:3300/0 conn(0x7fd41009bd50 0x7fd41009c130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-18T01:44:36.120 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.118+0000 7fd40e59c640 1 -- 172.21.15.129:0/1777495298 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3958199332 0 0) 0x7fd3f8001110 con 0x7fd41009c670 2024-09-18T01:44:36.120 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.118+0000 7fd40e59c640 1 -- 172.21.15.129:0/1777495298 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd3fc003520 con 0x7fd41009c670 2024-09-18T01:44:36.120 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.118+0000 7fd40e59c640 1 -- 172.21.15.129:0/1777495298 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2411686302 0 0) 0x7fd3fc003520 con 0x7fd41009c670 2024-09-18T01:44:36.120 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.118+0000 7fd40e59c640 1 -- 172.21.15.129:0/1777495298 >> v2:172.21.15.129:3300/0 conn(0x7fd41009bd50 msgr2=0x7fd41009c130 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-18T01:44:36.121 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.118+0000 7fd40e59c640 1 --2- 172.21.15.129:0/1777495298 >> v2:172.21.15.129:3300/0 conn(0x7fd41009bd50 0x7fd41009c130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:36.121 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.118+0000 7fd40e59c640 1 -- 172.21.15.129:0/1777495298 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4100983e0 con 0x7fd41009c670 2024-09-18T01:44:36.121 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.118+0000 7fd40e59c640 1 -- 172.21.15.129:0/1777495298 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 1828513292 0 0) 0x7fd3f8001770 con 0x7fd41009c670 2024-09-18T01:44:36.121 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.118+0000 7fd40e59c640 1 -- 172.21.15.129:0/1777495298 >> v1:172.21.15.129:6789/0 conn(0x7fd41009c670 legacy=0x7fd4100990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:36.121 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.118+0000 7fd40e59c640 1 --2- 172.21.15.129:0/1777495298 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd3fc0039b0 0x7fd3fc003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:36.121 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.118+0000 7fd40e59c640 1 -- 172.21.15.129:0/1777495298 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fd410098230 con 0x7fd3fc0039b0 2024-09-18T01:44:36.121 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.119+0000 7fd40ed9d640 1 --2- 172.21.15.129:0/1777495298 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd3fc0039b0 0x7fd3fc003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:36.121 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.119+0000 7fd40ed9d640 1 -- 172.21.15.129:0/1777495298 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3fc003520 con 0x7fd3fc0039b0 2024-09-18T01:44:36.122 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.121+0000 7fd40ed9d640 1 --2- 172.21.15.129:0/1777495298 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd3fc0039b0 0x7fd3fc003db0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fd400009810 tx=0x7fd3fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35bc7160f67e2375 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:36.122 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.121+0000 7fd40e59c640 1 -- 172.21.15.129:0/1777495298 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd400037070 con 0x7fd3fc0039b0 2024-09-18T01:44:36.122 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.121+0000 7fd40e59c640 1 -- 172.21.15.129:0/1777495298 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd40002add0 con 0x7fd3fc0039b0 2024-09-18T01:44:36.122 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.121+0000 7fd40e59c640 1 -- 172.21.15.129:0/1777495298 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd40000f040 con 0x7fd3fc0039b0 2024-09-18T01:44:36.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.121+0000 7fd415008640 1 -- 172.21.15.129:0/1777495298 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd3fc0039b0 msgr2=0x7fd3fc003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:36.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.121+0000 7fd415008640 1 --2- 172.21.15.129:0/1777495298 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd3fc0039b0 0x7fd3fc003db0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fd400009810 tx=0x7fd3fc005830 comp rx=0 tx=0).stop 2024-09-18T01:44:36.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.121+0000 7fd415008640 1 -- 172.21.15.129:0/1777495298 shutdown_connections 2024-09-18T01:44:36.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.121+0000 7fd415008640 1 --2- 172.21.15.129:0/1777495298 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd3fc0039b0 0x7fd3fc003db0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:36.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.121+0000 7fd415008640 1 --2- 172.21.15.129:0/1777495298 >> v2:172.21.15.129:3300/0 conn(0x7fd41009bd50 0x7fd41009c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:36.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.122+0000 7fd415008640 1 -- 172.21.15.129:0/1777495298 >> 172.21.15.129:0/1777495298 conn(0x7fd41006d4a0 msgr2=0x7fd41006d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:36.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.122+0000 7fd415008640 1 -- 172.21.15.129:0/1777495298 shutdown_connections 2024-09-18T01:44:36.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.122+0000 7fd415008640 1 -- 172.21.15.129:0/1777495298 wait complete. 2024-09-18T01:44:36.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.123+0000 7fd415008640 1 Processor -- start 2024-09-18T01:44:36.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.123+0000 7fd415008640 1 -- start start 2024-09-18T01:44:36.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.123+0000 7fd415008640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd3fc0039b0 0x7fd4101c36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:36.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.123+0000 7fd415008640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fd410099b90 con 0x7fd3fc0039b0 2024-09-18T01:44:36.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.123+0000 7fd40ed9d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd3fc0039b0 0x7fd4101c36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:36.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.123+0000 7fd40ed9d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd3fc0039b0 0x7fd4101c36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:50534/0 (socket says 172.21.15.129:50534) 2024-09-18T01:44:36.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.123+0000 7fd40ed9d640 1 -- 172.21.15.129:0/24409952 learned_addr learned my addr 172.21.15.129:0/24409952 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-18T01:44:36.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.124+0000 7fd40ed9d640 1 -- 172.21.15.129:0/24409952 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4101c32f0 con 0x7fd3fc0039b0 2024-09-18T01:44:36.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.124+0000 7fd40ed9d640 1 --2- 172.21.15.129:0/24409952 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd3fc0039b0 0x7fd4101c36b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd400000c00 tx=0x7fd400004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:36.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.124+0000 7fd407fff640 1 -- 172.21.15.129:0/24409952 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd400037040 con 0x7fd3fc0039b0 2024-09-18T01:44:36.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.124+0000 7fd407fff640 1 -- 172.21.15.129:0/24409952 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd40000f000 con 0x7fd3fc0039b0 2024-09-18T01:44:36.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.124+0000 7fd407fff640 1 -- 172.21.15.129:0/24409952 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd40003e590 con 0x7fd3fc0039b0 2024-09-18T01:44:36.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.124+0000 7fd415008640 1 -- 172.21.15.129:0/24409952 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4101b4070 con 0x7fd3fc0039b0 2024-09-18T01:44:36.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.124+0000 7fd415008640 1 -- 172.21.15.129:0/24409952 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4101b4960 con 0x7fd3fc0039b0 2024-09-18T01:44:36.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.124+0000 7fd407fff640 1 -- 172.21.15.129:0/24409952 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd400045020 con 0x7fd3fc0039b0 2024-09-18T01:44:36.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.124+0000 7fd407fff640 1 -- 172.21.15.129:0/24409952 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd400043020 con 0x7fd3fc0039b0 2024-09-18T01:44:36.127 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.125+0000 7fd415008640 1 -- 172.21.15.129:0/24409952 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd41008c470 con 0x7fd3fc0039b0 2024-09-18T01:44:36.128 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.127+0000 7fd407fff640 1 -- 172.21.15.129:0/24409952 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fd41008c470 con 0x7fd3fc0039b0 2024-09-18T01:44:36.189 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.188+0000 7fd415008640 1 -- 172.21.15.129:0/24409952 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fd41009a130 con 0x7fd3fc0039b0 2024-09-18T01:44:36.189 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.188+0000 7fd407fff640 1 -- 172.21.15.129:0/24409952 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fd40004c020 con 0x7fd3fc0039b0 2024-09-18T01:44:36.190 INFO:teuthology.orchestra.run.smithi129.stderr:adjusted tunables profile to default 2024-09-18T01:44:36.190 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.189+0000 7fd415008640 1 -- 172.21.15.129:0/24409952 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd3fc0039b0 msgr2=0x7fd4101c36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:36.191 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.189+0000 7fd415008640 1 --2- 172.21.15.129:0/24409952 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd3fc0039b0 0x7fd4101c36b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd400000c00 tx=0x7fd400004730 comp rx=0 tx=0).stop 2024-09-18T01:44:36.191 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.189+0000 7fd415008640 1 -- 172.21.15.129:0/24409952 shutdown_connections 2024-09-18T01:44:36.191 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.189+0000 7fd415008640 1 --2- 172.21.15.129:0/24409952 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd3fc0039b0 0x7fd4101c36b0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:36.191 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.189+0000 7fd415008640 1 -- 172.21.15.129:0/24409952 >> 172.21.15.129:0/24409952 conn(0x7fd41006d4a0 msgr2=0x7fd41009eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:36.191 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.189+0000 7fd415008640 1 -- 172.21.15.129:0/24409952 shutdown_connections 2024-09-18T01:44:36.191 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:36.189+0000 7fd415008640 1 -- 172.21.15.129:0/24409952 wait complete. 2024-09-18T01:44:36.201 INFO:tasks.ceph:check_enable_crimson: False 2024-09-18T01:44:36.201 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-18T01:44:36.201 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-09-18T01:44:36.201 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-18T01:44:36.226 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-18T01:44:36.226 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-18T01:44:36.226 INFO:tasks.ceph.mgr.x.smithi146.stderr:2024-09-18T01:44:36.225+0000 7f82ac014040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-18T01:44:36.251 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-18T01:44:36.251 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-18T01:44:36.269 INFO:tasks.ceph.mgr.x.smithi146.stderr:2024-09-18T01:44:36.268+0000 7f82ac014040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-18T01:44:36.294 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-18T01:44:36.294 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-18T01:44:36.358 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd new 19ab8d59-755c-42b6-83df-b3c88496d6da 0 2024-09-18T01:44:36.420 INFO:tasks.ceph.mgr.x.smithi146.stderr:2024-09-18T01:44:36.419+0000 7f82ac014040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-18T01:44:36.473 INFO:tasks.ceph.mgr.x.smithi146.stderr:2024-09-18T01:44:36.472+0000 7f82ac014040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-18T01:44:36.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.497+0000 7f2683f0a640 1 Processor -- start 2024-09-18T01:44:36.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.497+0000 7f2683f0a640 1 -- start start 2024-09-18T01:44:36.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.497+0000 7f2683f0a640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f267c114d00 0x7f267c1150e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:36.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.497+0000 7f2683f0a640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f267c110950 con 0x7f267c10fd90 2024-09-18T01:44:36.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.497+0000 7f2683f0a640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x7f267c110b20 con 0x7f267c114d00 2024-09-18T01:44:36.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.498+0000 7f2681ca6640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f267c114d00 0x7f267c1150e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:36.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.498+0000 7f26814a5640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f267c10fd90 0x7f267c110240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:53900/0 (socket says 172.21.15.146:53900) 2024-09-18T01:44:36.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.498+0000 7f26814a5640 1 -- 172.21.15.146:0/1850971371 learned_addr learned my addr 172.21.15.146:0/1850971371 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:44:36.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.498+0000 7f2681ca6640 1 -- 172.21.15.146:0/1850971371 >> v1:172.21.15.129:6789/0 conn(0x7f267c10fd90 legacy=0x7f267c110240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:36.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.498+0000 7f2681ca6640 1 -- 172.21.15.146:0/1850971371 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f267c11c9c0 con 0x7f267c114d00 2024-09-18T01:44:36.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.499+0000 7f2681ca6640 1 --2- 172.21.15.146:0/1850971371 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f267c114d00 0x7f267c1150e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2678009720 tx=0x7f267802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9889baec927975df server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:36.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.499+0000 7f2680ca4640 1 -- 172.21.15.146:0/1850971371 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2678037070 con 0x7f267c114d00 2024-09-18T01:44:36.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.499+0000 7f2680ca4640 1 -- 172.21.15.146:0/1850971371 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f267802ad90 con 0x7f267c114d00 2024-09-18T01:44:36.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.499+0000 7f2680ca4640 1 -- 172.21.15.146:0/1850971371 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2678032590 con 0x7f267c114d00 2024-09-18T01:44:36.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.499+0000 7f2683f0a640 1 -- 172.21.15.146:0/1850971371 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f267c114d00 msgr2=0x7f267c1150e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:36.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.499+0000 7f2683f0a640 1 --2- 172.21.15.146:0/1850971371 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f267c114d00 0x7f267c1150e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2678009720 tx=0x7f267802a110 comp rx=0 tx=0).stop 2024-09-18T01:44:36.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.500+0000 7f2683f0a640 1 -- 172.21.15.146:0/1850971371 shutdown_connections 2024-09-18T01:44:36.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.500+0000 7f2683f0a640 1 --2- 172.21.15.146:0/1850971371 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f267c114d00 0x7f267c1150e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:36.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.500+0000 7f2683f0a640 1 -- 172.21.15.146:0/1850971371 >> 172.21.15.146:0/1850971371 conn(0x7f267c071040 msgr2=0x7f267c073460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:36.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.500+0000 7f2683f0a640 1 -- 172.21.15.146:0/1850971371 shutdown_connections 2024-09-18T01:44:36.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.500+0000 7f2683f0a640 1 -- 172.21.15.146:0/1850971371 wait complete. 2024-09-18T01:44:36.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.500+0000 7f2683f0a640 1 Processor -- start 2024-09-18T01:44:36.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.500+0000 7f2683f0a640 1 -- start start 2024-09-18T01:44:36.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.501+0000 7f2683f0a640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f267c10fd90 0x7f267c06d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:36.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.501+0000 7f2683f0a640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f267c11bdd0 con 0x7f267c10fd90 2024-09-18T01:44:36.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.501+0000 7f2681ca6640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f267c10fd90 0x7f267c06d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:36.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.501+0000 7f2681ca6640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f267c10fd90 0x7f267c06d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:36886/0 (socket says 172.21.15.146:36886) 2024-09-18T01:44:36.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.501+0000 7f2681ca6640 1 -- 172.21.15.146:0/3965497864 learned_addr learned my addr 172.21.15.146:0/3965497864 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:44:36.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.501+0000 7f2681ca6640 1 -- 172.21.15.146:0/3965497864 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f267c06db50 con 0x7f267c10fd90 2024-09-18T01:44:36.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.501+0000 7f2681ca6640 1 --2- 172.21.15.146:0/3965497864 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f267c10fd90 0x7f267c06d610 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2678009720 tx=0x7f26780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:36.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.502+0000 7f26727fc640 1 -- 172.21.15.146:0/3965497864 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2678041070 con 0x7f267c10fd90 2024-09-18T01:44:36.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.502+0000 7f26727fc640 1 -- 172.21.15.146:0/3965497864 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f267803c460 con 0x7f267c10fd90 2024-09-18T01:44:36.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.502+0000 7f26727fc640 1 -- 172.21.15.146:0/3965497864 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2678037040 con 0x7f267c10fd90 2024-09-18T01:44:36.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.502+0000 7f2683f0a640 1 -- 172.21.15.146:0/3965497864 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f267c06dde0 con 0x7f267c10fd90 2024-09-18T01:44:36.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.502+0000 7f2683f0a640 1 -- 172.21.15.146:0/3965497864 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f267c06e2b0 con 0x7f267c10fd90 2024-09-18T01:44:36.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.502+0000 7f26727fc640 1 -- 172.21.15.146:0/3965497864 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2678044070 con 0x7f267c10fd90 2024-09-18T01:44:36.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.502+0000 7f26727fc640 1 -- 172.21.15.146:0/3965497864 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f2678046c30 con 0x7f267c10fd90 2024-09-18T01:44:36.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.503+0000 7f2683f0a640 1 -- 172.21.15.146:0/3965497864 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f267c115160 con 0x7f267c10fd90 2024-09-18T01:44:36.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.505+0000 7f26727fc640 1 -- 172.21.15.146:0/3965497864 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f2678046450 con 0x7f267c10fd90 2024-09-18T01:44:36.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.574+0000 7f2683f0a640 1 -- 172.21.15.146:0/3965497864 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "osd new", "uuid": "19ab8d59-755c-42b6-83df-b3c88496d6da", "id": 0} v 0) -- 0x7f267c06e530 con 0x7f267c10fd90 2024-09-18T01:44:36.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.575+0000 7f26727fc640 1 -- 172.21.15.146:0/3965497864 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "19ab8d59-755c-42b6-83df-b3c88496d6da", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f267803c950 con 0x7f267c10fd90 2024-09-18T01:44:36.577 INFO:teuthology.orchestra.run.smithi146.stdout:0 2024-09-18T01:44:36.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.576+0000 7f2683f0a640 1 -- 172.21.15.146:0/3965497864 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f267c10fd90 msgr2=0x7f267c06d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:36.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.576+0000 7f2683f0a640 1 --2- 172.21.15.146:0/3965497864 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f267c10fd90 0x7f267c06d610 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2678009720 tx=0x7f26780046c0 comp rx=0 tx=0).stop 2024-09-18T01:44:36.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.576+0000 7f2683f0a640 1 -- 172.21.15.146:0/3965497864 shutdown_connections 2024-09-18T01:44:36.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.576+0000 7f2683f0a640 1 --2- 172.21.15.146:0/3965497864 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f267c10fd90 0x7f267c06d610 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:36.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.576+0000 7f2683f0a640 1 -- 172.21.15.146:0/3965497864 >> 172.21.15.146:0/3965497864 conn(0x7f267c071040 msgr2=0x7f267c1137a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:36.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.576+0000 7f2683f0a640 1 -- 172.21.15.146:0/3965497864 shutdown_connections 2024-09-18T01:44:36.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.576+0000 7f2683f0a640 1 -- 172.21.15.146:0/3965497864 wait complete. 2024-09-18T01:44:36.588 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd new 4d5949df-a041-424d-a475-2025e490700c 1 2024-09-18T01:44:36.655 INFO:tasks.ceph.mgr.x.smithi146.stderr:2024-09-18T01:44:36.653+0000 7f82ac014040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-18T01:44:36.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.726+0000 7fdc57f8a640 1 Processor -- start 2024-09-18T01:44:36.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.726+0000 7fdc57f8a640 1 -- start start 2024-09-18T01:44:36.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.726+0000 7fdc57f8a640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fdc50115d60 0x7fdc50116140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:36.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.726+0000 7fdc57f8a640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc50116830 con 0x7fdc5006c430 2024-09-18T01:44:36.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.726+0000 7fdc57f8a640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x7fdc5006cfd0 con 0x7fdc50115d60 2024-09-18T01:44:36.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.726+0000 7fdc55d26640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fdc50115d60 0x7fdc50116140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:36.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.726+0000 7fdc55d26640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fdc50115d60 0x7fdc50116140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:36894/0 (socket says 172.21.15.146:36894) 2024-09-18T01:44:36.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.726+0000 7fdc55525640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fdc5006c430 0x7fdc5006c8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:53902/0 (socket says 172.21.15.146:53902) 2024-09-18T01:44:36.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.726+0000 7fdc55d26640 1 -- 172.21.15.146:0/3750225473 learned_addr learned my addr 172.21.15.146:0/3750225473 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:44:36.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.727+0000 7fdc55d26640 1 -- 172.21.15.146:0/3750225473 >> v1:172.21.15.129:6789/0 conn(0x7fdc5006c430 legacy=0x7fdc5006c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:36.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.727+0000 7fdc55d26640 1 -- 172.21.15.146:0/3750225473 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc5006d150 con 0x7fdc50115d60 2024-09-18T01:44:36.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.727+0000 7fdc55d26640 1 --2- 172.21.15.146:0/3750225473 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdc50115d60 0x7fdc50116140 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdc400097f0 tx=0x7fdc4002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=291e7551f8d78d2e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:36.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.727+0000 7fdc54d24640 1 -- 172.21.15.146:0/3750225473 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc40037070 con 0x7fdc50115d60 2024-09-18T01:44:36.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.727+0000 7fdc54d24640 1 -- 172.21.15.146:0/3750225473 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc40032440 con 0x7fdc50115d60 2024-09-18T01:44:36.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.727+0000 7fdc54d24640 1 -- 172.21.15.146:0/3750225473 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc4002ae60 con 0x7fdc50115d60 2024-09-18T01:44:36.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.728+0000 7fdc57f8a640 1 -- 172.21.15.146:0/3750225473 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdc50115d60 msgr2=0x7fdc50116140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:36.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.728+0000 7fdc57f8a640 1 --2- 172.21.15.146:0/3750225473 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdc50115d60 0x7fdc50116140 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdc400097f0 tx=0x7fdc4002a1e0 comp rx=0 tx=0).stop 2024-09-18T01:44:36.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.728+0000 7fdc57f8a640 1 -- 172.21.15.146:0/3750225473 shutdown_connections 2024-09-18T01:44:36.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.728+0000 7fdc57f8a640 1 --2- 172.21.15.146:0/3750225473 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdc50115d60 0x7fdc50116140 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:36.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.728+0000 7fdc57f8a640 1 -- 172.21.15.146:0/3750225473 >> 172.21.15.146:0/3750225473 conn(0x7fdc5006ff70 msgr2=0x7fdc50072390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:36.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.728+0000 7fdc57f8a640 1 -- 172.21.15.146:0/3750225473 shutdown_connections 2024-09-18T01:44:36.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.728+0000 7fdc57f8a640 1 -- 172.21.15.146:0/3750225473 wait complete. 2024-09-18T01:44:36.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.729+0000 7fdc57f8a640 1 Processor -- start 2024-09-18T01:44:36.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.729+0000 7fdc57f8a640 1 -- start start 2024-09-18T01:44:36.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.729+0000 7fdc57f8a640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdc5006c430 0x7fdc501a4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:36.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.729+0000 7fdc57f8a640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fdc5011bf40 con 0x7fdc5006c430 2024-09-18T01:44:36.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.729+0000 7fdc55d26640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdc5006c430 0x7fdc501a4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:36.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.729+0000 7fdc55d26640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdc5006c430 0x7fdc501a4b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:36904/0 (socket says 172.21.15.146:36904) 2024-09-18T01:44:36.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.729+0000 7fdc55d26640 1 -- 172.21.15.146:0/3212863288 learned_addr learned my addr 172.21.15.146:0/3212863288 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:44:36.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.729+0000 7fdc55d26640 1 -- 172.21.15.146:0/3212863288 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc501a5100 con 0x7fdc5006c430 2024-09-18T01:44:36.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.729+0000 7fdc55d26640 1 --2- 172.21.15.146:0/3212863288 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdc5006c430 0x7fdc501a4b30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdc40035040 tx=0x7fdc400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:36.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.730+0000 7fdc467fc640 1 -- 172.21.15.146:0/3212863288 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc40041070 con 0x7fdc5006c430 2024-09-18T01:44:36.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.730+0000 7fdc467fc640 1 -- 172.21.15.146:0/3212863288 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc4003c7a0 con 0x7fdc5006c430 2024-09-18T01:44:36.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.730+0000 7fdc57f8a640 1 -- 172.21.15.146:0/3212863288 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc501a5390 con 0x7fdc5006c430 2024-09-18T01:44:36.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.730+0000 7fdc467fc640 1 -- 172.21.15.146:0/3212863288 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc40037040 con 0x7fdc5006c430 2024-09-18T01:44:36.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.730+0000 7fdc57f8a640 1 -- 172.21.15.146:0/3212863288 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc501a93c0 con 0x7fdc5006c430 2024-09-18T01:44:36.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.730+0000 7fdc467fc640 1 -- 172.21.15.146:0/3212863288 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdc40044070 con 0x7fdc5006c430 2024-09-18T01:44:36.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.730+0000 7fdc467fc640 1 -- 172.21.15.146:0/3212863288 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fdc4003d3f0 con 0x7fdc5006c430 2024-09-18T01:44:36.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.730+0000 7fdc57f8a640 1 -- 172.21.15.146:0/3212863288 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc501161c0 con 0x7fdc5006c430 2024-09-18T01:44:36.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.733+0000 7fdc467fc640 1 -- 172.21.15.146:0/3212863288 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fdc40046450 con 0x7fdc5006c430 2024-09-18T01:44:36.770 INFO:tasks.ceph.mgr.x.smithi146.stderr:2024-09-18T01:44:36.769+0000 7f82ac014040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-18T01:44:36.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.803+0000 7fdc57f8a640 1 -- 172.21.15.146:0/3212863288 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4d5949df-a041-424d-a475-2025e490700c", "id": 1} v 0) -- 0x7fdc501a5560 con 0x7fdc5006c430 2024-09-18T01:44:36.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.804+0000 7fdc467fc640 1 -- 172.21.15.146:0/3212863288 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4d5949df-a041-424d-a475-2025e490700c", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fdc4003caa0 con 0x7fdc5006c430 2024-09-18T01:44:36.806 INFO:teuthology.orchestra.run.smithi146.stdout:1 2024-09-18T01:44:36.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.805+0000 7fdc57f8a640 1 -- 172.21.15.146:0/3212863288 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdc5006c430 msgr2=0x7fdc501a4b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:36.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.805+0000 7fdc57f8a640 1 --2- 172.21.15.146:0/3212863288 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdc5006c430 0x7fdc501a4b30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdc40035040 tx=0x7fdc400046c0 comp rx=0 tx=0).stop 2024-09-18T01:44:36.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.805+0000 7fdc57f8a640 1 -- 172.21.15.146:0/3212863288 shutdown_connections 2024-09-18T01:44:36.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.805+0000 7fdc57f8a640 1 --2- 172.21.15.146:0/3212863288 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdc5006c430 0x7fdc501a4b30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:36.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.805+0000 7fdc57f8a640 1 -- 172.21.15.146:0/3212863288 >> 172.21.15.146:0/3212863288 conn(0x7fdc5006ff70 msgr2=0x7fdc50113a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:36.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.805+0000 7fdc57f8a640 1 -- 172.21.15.146:0/3212863288 shutdown_connections 2024-09-18T01:44:36.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.805+0000 7fdc57f8a640 1 -- 172.21.15.146:0/3212863288 wait complete. 2024-09-18T01:44:36.817 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd new ff23f4ef-a771-4752-b233-87f7287b6c75 2 2024-09-18T01:44:36.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.954+0000 7f60bef6c640 1 Processor -- start 2024-09-18T01:44:36.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.954+0000 7f60bef6c640 1 -- start start 2024-09-18T01:44:36.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.954+0000 7f60bef6c640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f60b8114cc0 0x7f60b81150a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:36.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.954+0000 7f60bef6c640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60b8115670 con 0x7f60b806c430 2024-09-18T01:44:36.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.954+0000 7f60bef6c640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x7f60b806cfd0 con 0x7f60b8114cc0 2024-09-18T01:44:36.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.954+0000 7f60bcd08640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f60b8114cc0 0x7f60b81150a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:36.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.954+0000 7f60b7fff640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f60b806c430 0x7f60b806c8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:53916/0 (socket says 172.21.15.146:53916) 2024-09-18T01:44:36.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.954+0000 7f60b7fff640 1 -- 172.21.15.146:0/1214103471 learned_addr learned my addr 172.21.15.146:0/1214103471 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:44:36.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.955+0000 7f60bcd08640 1 -- 172.21.15.146:0/1214103471 >> v1:172.21.15.129:6789/0 conn(0x7f60b806c430 legacy=0x7f60b806c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:36.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.955+0000 7f60bcd08640 1 -- 172.21.15.146:0/1214103471 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60b806d180 con 0x7f60b8114cc0 2024-09-18T01:44:36.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.955+0000 7f60bcd08640 1 --2- 172.21.15.146:0/1214103471 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f60b8114cc0 0x7f60b81150a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f60ac009720 tx=0x7f60ac02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc0862afe4f00910 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:36.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.956+0000 7f60b77fe640 1 -- 172.21.15.146:0/1214103471 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60ac037070 con 0x7f60b8114cc0 2024-09-18T01:44:36.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.956+0000 7f60b77fe640 1 -- 172.21.15.146:0/1214103471 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60ac02ad90 con 0x7f60b8114cc0 2024-09-18T01:44:36.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.956+0000 7f60b77fe640 1 -- 172.21.15.146:0/1214103471 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60ac032590 con 0x7f60b8114cc0 2024-09-18T01:44:36.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.956+0000 7f60bef6c640 1 -- 172.21.15.146:0/1214103471 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f60b8114cc0 msgr2=0x7f60b81150a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:36.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.956+0000 7f60bef6c640 1 --2- 172.21.15.146:0/1214103471 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f60b8114cc0 0x7f60b81150a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f60ac009720 tx=0x7f60ac02a110 comp rx=0 tx=0).stop 2024-09-18T01:44:36.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.956+0000 7f60bef6c640 1 -- 172.21.15.146:0/1214103471 shutdown_connections 2024-09-18T01:44:36.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.956+0000 7f60bef6c640 1 --2- 172.21.15.146:0/1214103471 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f60b8114cc0 0x7f60b81150a0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:36.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.956+0000 7f60bef6c640 1 -- 172.21.15.146:0/1214103471 >> 172.21.15.146:0/1214103471 conn(0x7f60b8070010 msgr2=0x7f60b8072430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:36.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.956+0000 7f60bef6c640 1 -- 172.21.15.146:0/1214103471 shutdown_connections 2024-09-18T01:44:36.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.956+0000 7f60bef6c640 1 -- 172.21.15.146:0/1214103471 wait complete. 2024-09-18T01:44:36.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.957+0000 7f60bef6c640 1 Processor -- start 2024-09-18T01:44:36.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.957+0000 7f60bef6c640 1 -- start start 2024-09-18T01:44:36.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.957+0000 7f60bef6c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f60b806c430 0x7f60b810ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:36.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.957+0000 7f60bef6c640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f60b811bf90 con 0x7f60b806c430 2024-09-18T01:44:36.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.957+0000 7f60bcd08640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f60b806c430 0x7f60b810ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:36.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.958+0000 7f60bcd08640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f60b806c430 0x7f60b810ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:36932/0 (socket says 172.21.15.146:36932) 2024-09-18T01:44:36.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.958+0000 7f60bcd08640 1 -- 172.21.15.146:0/3971821122 learned_addr learned my addr 172.21.15.146:0/3971821122 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:44:36.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.958+0000 7f60bcd08640 1 -- 172.21.15.146:0/3971821122 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60b810f390 con 0x7f60b806c430 2024-09-18T01:44:36.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.958+0000 7f60bcd08640 1 --2- 172.21.15.146:0/3971821122 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f60b806c430 0x7f60b810ee50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f60ac009720 tx=0x7f60ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:36.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.958+0000 7f60b57fa640 1 -- 172.21.15.146:0/3971821122 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60ac041070 con 0x7f60b806c430 2024-09-18T01:44:36.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.958+0000 7f60b57fa640 1 -- 172.21.15.146:0/3971821122 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60ac03c460 con 0x7f60b806c430 2024-09-18T01:44:36.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.958+0000 7f60b57fa640 1 -- 172.21.15.146:0/3971821122 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60ac037040 con 0x7f60b806c430 2024-09-18T01:44:36.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.958+0000 7f60bef6c640 1 -- 172.21.15.146:0/3971821122 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60b810f5c0 con 0x7f60b806c430 2024-09-18T01:44:36.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.958+0000 7f60bef6c640 1 -- 172.21.15.146:0/3971821122 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60b810fa30 con 0x7f60b806c430 2024-09-18T01:44:36.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.958+0000 7f60b57fa640 1 -- 172.21.15.146:0/3971821122 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f60ac044070 con 0x7f60b806c430 2024-09-18T01:44:36.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.958+0000 7f60b57fa640 1 -- 172.21.15.146:0/3971821122 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f60ac046d20 con 0x7f60b806c430 2024-09-18T01:44:36.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.959+0000 7f60bef6c640 1 -- 172.21.15.146:0/3971821122 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60b8115120 con 0x7f60b806c430 2024-09-18T01:44:36.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:36.961+0000 7f60b57fa640 1 -- 172.21.15.146:0/3971821122 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f60ac046900 con 0x7f60b806c430 2024-09-18T01:44:37.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.028+0000 7f60bef6c640 1 -- 172.21.15.146:0/3971821122 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ff23f4ef-a771-4752-b233-87f7287b6c75", "id": 2} v 0) -- 0x7f60b80008d0 con 0x7f60b806c430 2024-09-18T01:44:37.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.030+0000 7f60b57fa640 1 -- 172.21.15.146:0/3971821122 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ff23f4ef-a771-4752-b233-87f7287b6c75", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f60ac046b20 con 0x7f60b806c430 2024-09-18T01:44:37.031 INFO:teuthology.orchestra.run.smithi146.stdout:2 2024-09-18T01:44:37.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.030+0000 7f60bef6c640 1 -- 172.21.15.146:0/3971821122 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f60b806c430 msgr2=0x7f60b810ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:37.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.030+0000 7f60bef6c640 1 --2- 172.21.15.146:0/3971821122 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f60b806c430 0x7f60b810ee50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f60ac009720 tx=0x7f60ac0046c0 comp rx=0 tx=0).stop 2024-09-18T01:44:37.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.030+0000 7f60bef6c640 1 -- 172.21.15.146:0/3971821122 shutdown_connections 2024-09-18T01:44:37.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.030+0000 7f60bef6c640 1 --2- 172.21.15.146:0/3971821122 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f60b806c430 0x7f60b810ee50 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:37.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.030+0000 7f60bef6c640 1 -- 172.21.15.146:0/3971821122 >> 172.21.15.146:0/3971821122 conn(0x7f60b8070010 msgr2=0x7f60b811ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:37.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.030+0000 7f60bef6c640 1 -- 172.21.15.146:0/3971821122 shutdown_connections 2024-09-18T01:44:37.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.030+0000 7f60bef6c640 1 -- 172.21.15.146:0/3971821122 wait complete. 2024-09-18T01:44:37.044 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd new e84370c3-e85d-40c8-bea4-4a6e61cf53d1 3 2024-09-18T01:44:37.103 INFO:tasks.ceph.mgr.x.smithi146.stderr:2024-09-18T01:44:37.102+0000 7f82ac014040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-18T01:44:37.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.141+0000 7f4a5eb4b640 1 Processor -- start 2024-09-18T01:44:37.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.141+0000 7f4a5eb4b640 1 -- start start 2024-09-18T01:44:37.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.141+0000 7f4a5eb4b640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f4a58113d00 0x7f4a581140e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:37.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.141+0000 7f4a5eb4b640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a581146b0 con 0x7f4a5806c430 2024-09-18T01:44:37.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.141+0000 7f4a5eb4b640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x7f4a5806cfa0 con 0x7f4a58113d00 2024-09-18T01:44:37.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.142+0000 7f4a5c8e7640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f4a58113d00 0x7f4a581140e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:37.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.142+0000 7f4a5c8e7640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f4a58113d00 0x7f4a581140e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:36946/0 (socket says 172.21.15.146:36946) 2024-09-18T01:44:37.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.142+0000 7f4a5c8e7640 1 -- 172.21.15.146:0/602009281 learned_addr learned my addr 172.21.15.146:0/602009281 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:44:37.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.142+0000 7f4a5c8e7640 1 -- 172.21.15.146:0/602009281 >> v1:172.21.15.129:6789/0 conn(0x7f4a5806c430 legacy=0x7f4a5806c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:37.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.142+0000 7f4a5c8e7640 1 -- 172.21.15.146:0/602009281 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a5806d150 con 0x7f4a58113d00 2024-09-18T01:44:37.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.143+0000 7f4a5c8e7640 1 --2- 172.21.15.146:0/602009281 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4a58113d00 0x7f4a581140e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4a540097f0 tx=0x7f4a5402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c28f49f49046d63c server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:37.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.143+0000 7f4a4f7fe640 1 -- 172.21.15.146:0/602009281 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a54037070 con 0x7f4a58113d00 2024-09-18T01:44:37.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.143+0000 7f4a4f7fe640 1 -- 172.21.15.146:0/602009281 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a54032440 con 0x7f4a58113d00 2024-09-18T01:44:37.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.143+0000 7f4a4f7fe640 1 -- 172.21.15.146:0/602009281 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a5402ae60 con 0x7f4a58113d00 2024-09-18T01:44:37.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.143+0000 7f4a5eb4b640 1 -- 172.21.15.146:0/602009281 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4a58113d00 msgr2=0x7f4a581140e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:37.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.143+0000 7f4a5eb4b640 1 --2- 172.21.15.146:0/602009281 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4a58113d00 0x7f4a581140e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4a540097f0 tx=0x7f4a5402a1e0 comp rx=0 tx=0).stop 2024-09-18T01:44:37.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.143+0000 7f4a5eb4b640 1 -- 172.21.15.146:0/602009281 shutdown_connections 2024-09-18T01:44:37.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.143+0000 7f4a5eb4b640 1 --2- 172.21.15.146:0/602009281 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4a58113d00 0x7f4a581140e0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:37.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.143+0000 7f4a5eb4b640 1 -- 172.21.15.146:0/602009281 >> 172.21.15.146:0/602009281 conn(0x7f4a5806ffd0 msgr2=0x7f4a580723f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:37.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.143+0000 7f4a5eb4b640 1 -- 172.21.15.146:0/602009281 shutdown_connections 2024-09-18T01:44:37.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.143+0000 7f4a5eb4b640 1 -- 172.21.15.146:0/602009281 wait complete. 2024-09-18T01:44:37.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.144+0000 7f4a5eb4b640 1 Processor -- start 2024-09-18T01:44:37.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.144+0000 7f4a5eb4b640 1 -- start start 2024-09-18T01:44:37.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.144+0000 7f4a5eb4b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4a5806c430 0x7f4a5810ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:37.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.144+0000 7f4a5eb4b640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f4a5811bf30 con 0x7f4a5806c430 2024-09-18T01:44:37.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.145+0000 7f4a5c8e7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4a5806c430 0x7f4a5810ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:37.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.145+0000 7f4a5c8e7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4a5806c430 0x7f4a5810ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:36952/0 (socket says 172.21.15.146:36952) 2024-09-18T01:44:37.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.145+0000 7f4a5c8e7640 1 -- 172.21.15.146:0/1004140450 learned_addr learned my addr 172.21.15.146:0/1004140450 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:44:37.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.145+0000 7f4a5c8e7640 1 -- 172.21.15.146:0/1004140450 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a5810f390 con 0x7f4a5806c430 2024-09-18T01:44:37.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.145+0000 7f4a5c8e7640 1 --2- 172.21.15.146:0/1004140450 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4a5806c430 0x7f4a5810ee50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4a54035040 tx=0x7f4a540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:37.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.145+0000 7f4a4d7fa640 1 -- 172.21.15.146:0/1004140450 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a54041070 con 0x7f4a5806c430 2024-09-18T01:44:37.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.145+0000 7f4a4d7fa640 1 -- 172.21.15.146:0/1004140450 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a5403c7a0 con 0x7f4a5806c430 2024-09-18T01:44:37.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.145+0000 7f4a5eb4b640 1 -- 172.21.15.146:0/1004140450 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a5810f5c0 con 0x7f4a5806c430 2024-09-18T01:44:37.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.145+0000 7f4a4d7fa640 1 -- 172.21.15.146:0/1004140450 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a54037040 con 0x7f4a5806c430 2024-09-18T01:44:37.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.145+0000 7f4a5eb4b640 1 -- 172.21.15.146:0/1004140450 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a5810fab0 con 0x7f4a5806c430 2024-09-18T01:44:37.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.146+0000 7f4a4d7fa640 1 -- 172.21.15.146:0/1004140450 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4a54044070 con 0x7f4a5806c430 2024-09-18T01:44:37.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.146+0000 7f4a4d7fa640 1 -- 172.21.15.146:0/1004140450 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f4a5403d3f0 con 0x7f4a5806c430 2024-09-18T01:44:37.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.147+0000 7f4a5eb4b640 1 -- 172.21.15.146:0/1004140450 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a58114160 con 0x7f4a5806c430 2024-09-18T01:44:37.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.149+0000 7f4a4d7fa640 1 -- 172.21.15.146:0/1004140450 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f4a54046450 con 0x7f4a5806c430 2024-09-18T01:44:37.159 INFO:tasks.ceph.mgr.x.smithi146.stderr:2024-09-18T01:44:37.157+0000 7f82ac014040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-18T01:44:37.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.217+0000 7f4a5eb4b640 1 -- 172.21.15.146:0/1004140450 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e84370c3-e85d-40c8-bea4-4a6e61cf53d1", "id": 3} v 0) -- 0x7f4a58113d00 con 0x7f4a5806c430 2024-09-18T01:44:37.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.221+0000 7f4a4d7fa640 1 -- 172.21.15.146:0/1004140450 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e84370c3-e85d-40c8-bea4-4a6e61cf53d1", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f4a54046ad0 con 0x7f4a5806c430 2024-09-18T01:44:37.302 INFO:teuthology.orchestra.run.smithi146.stdout:3 2024-09-18T01:44:37.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.222+0000 7f4a5eb4b640 1 -- 172.21.15.146:0/1004140450 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4a5806c430 msgr2=0x7f4a5810ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:37.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.222+0000 7f4a5eb4b640 1 --2- 172.21.15.146:0/1004140450 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4a5806c430 0x7f4a5810ee50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4a54035040 tx=0x7f4a540046c0 comp rx=0 tx=0).stop 2024-09-18T01:44:37.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.222+0000 7f4a5eb4b640 1 -- 172.21.15.146:0/1004140450 shutdown_connections 2024-09-18T01:44:37.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.222+0000 7f4a5eb4b640 1 --2- 172.21.15.146:0/1004140450 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4a5806c430 0x7f4a5810ee50 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:37.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.222+0000 7f4a5eb4b640 1 -- 172.21.15.146:0/1004140450 >> 172.21.15.146:0/1004140450 conn(0x7f4a5806ffd0 msgr2=0x7f4a58112820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:37.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.222+0000 7f4a5eb4b640 1 -- 172.21.15.146:0/1004140450 shutdown_connections 2024-09-18T01:44:37.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:44:37.222+0000 7f4a5eb4b640 1 -- 172.21.15.146:0/1004140450 wait complete. 2024-09-18T01:44:37.304 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-18T01:44:37.304 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-18T01:44:37.307 INFO:tasks.ceph.osd.0:Started 2024-09-18T01:44:37.307 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-18T01:44:37.307 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-18T01:44:37.309 INFO:tasks.ceph.osd.1:Started 2024-09-18T01:44:37.309 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-18T01:44:37.309 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-18T01:44:37.311 INFO:tasks.ceph.osd.2:Started 2024-09-18T01:44:37.311 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-18T01:44:37.311 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-18T01:44:37.312 INFO:tasks.ceph.mgr.x.smithi146.stderr:2024-09-18T01:44:37.310+0000 7f82ac014040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-18T01:44:37.314 INFO:tasks.ceph.osd.3:Started 2024-09-18T01:44:37.314 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-18T01:44:37.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:37.422+0000 7f2b90050640 1 Processor -- start 2024-09-18T01:44:37.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:37.422+0000 7f2b90050640 1 -- start start 2024-09-18T01:44:37.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:37.423+0000 7f2b90050640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f2b8809a100 0x7f2b88133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:37.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:37.423+0000 7f2b90050640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b8809d3b0 con 0x7f2b8809bd50 2024-09-18T01:44:37.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:37.423+0000 7f2b90050640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x7f2b8809c840 con 0x7f2b8809a100 2024-09-18T01:44:37.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:37.423+0000 7f2b8d5eb640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f2b8809a100 0x7f2b88133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:37.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:37.423+0000 7f2b8ddec640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f2b8809bd50 0x7f2b8809c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:45924/0 (socket says 172.21.15.129:45924) 2024-09-18T01:44:37.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:37.423+0000 7f2b8ddec640 1 -- 172.21.15.129:0/642367202 learned_addr learned my addr 172.21.15.129:0/642367202 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-09-18T01:44:37.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:37.423+0000 7f2b8d5eb640 1 -- 172.21.15.129:0/642367202 >> v1:172.21.15.129:6789/0 conn(0x7f2b8809bd50 legacy=0x7f2b8809c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:37.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:37.423+0000 7f2b8d5eb640 1 -- 172.21.15.129:0/642367202 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b88098230 con 0x7f2b8809a100 2024-09-18T01:44:37.425 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:37.423+0000 7f2b8cdea640 1 -- 172.21.15.129:0/642367202 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1046650707 0 0) 0x7f2b78001490 con 0x7f2b8809bd50 2024-09-18T01:44:37.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:37.424+0000 7f2b8d5eb640 1 --2- 172.21.15.129:0/642367202 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2b8809a100 0x7f2b88133da0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c009720 tx=0x7f2b7c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=206f9a687c467ea1 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:37.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:37.424+0000 7f2b8cdea640 1 -- 172.21.15.129:0/642367202 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b7c037070 con 0x7f2b8809a100 2024-09-18T01:44:37.426 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:37.424+0000 7f2b8cdea640 1 -- 172.21.15.129:0/642367202 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b7c02ad90 con 0x7f2b8809a100 2024-09-18T01:44:37.427 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:37.424+0000 7f2b8cdea640 1 -- 172.21.15.129:0/642367202 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b7c032590 con 0x7f2b8809a100 2024-09-18T01:44:37.427 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:37.425+0000 7f2b90050640 1 -- 172.21.15.129:0/642367202 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2b8809a100 msgr2=0x7f2b88133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:37.427 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:37.425+0000 7f2b90050640 1 --2- 172.21.15.129:0/642367202 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2b8809a100 0x7f2b88133da0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c009720 tx=0x7f2b7c02a110 comp rx=0 tx=0).stop 2024-09-18T01:44:37.427 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:37.425+0000 7f2b90050640 1 -- 172.21.15.129:0/642367202 shutdown_connections 2024-09-18T01:44:37.427 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:37.425+0000 7f2b90050640 1 --2- 172.21.15.129:0/642367202 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2b8809a100 0x7f2b88133da0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:37.427 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:37.425+0000 7f2b90050640 1 -- 172.21.15.129:0/642367202 >> 172.21.15.129:0/642367202 conn(0x7f2b8806d4a0 msgr2=0x7f2b8806d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:37.427 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:37.425+0000 7f2b90050640 1 -- 172.21.15.129:0/642367202 shutdown_connections 2024-09-18T01:44:37.427 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:37.425+0000 7f2b90050640 1 -- 172.21.15.129:0/642367202 wait complete. 2024-09-18T01:44:37.429 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:37.426+0000 7f2b90050640 1 Processor -- start 2024-09-18T01:44:37.429 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:37.426+0000 7f2b90050640 1 -- start start 2024-09-18T01:44:37.429 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:37.426+0000 7f2b90050640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2b8809a100 0x7f2b881c3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:37.429 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:37.426+0000 7f2b90050640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f2b88134670 con 0x7f2b8809a100 2024-09-18T01:44:37.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:37.426+0000 7f2b8ddec640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2b8809a100 0x7f2b881c3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:37.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:37.426+0000 7f2b8ddec640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2b8809a100 0x7f2b881c3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:50564/0 (socket says 172.21.15.129:50564) 2024-09-18T01:44:37.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:37.426+0000 7f2b8ddec640 1 -- 172.21.15.129:0/645645609 learned_addr learned my addr 172.21.15.129:0/645645609 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-18T01:44:37.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:37.426+0000 7f2b8ddec640 1 -- 172.21.15.129:0/645645609 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b88095e90 con 0x7f2b8809a100 2024-09-18T01:44:37.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:37.427+0000 7f2b8ddec640 1 --2- 172.21.15.129:0/645645609 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2b8809a100 0x7f2b881c3990 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2b7800c790 tx=0x7f2b7800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:37.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:37.427+0000 7f2b867fc640 1 -- 172.21.15.129:0/645645609 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b78018070 con 0x7f2b8809a100 2024-09-18T01:44:37.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:37.427+0000 7f2b867fc640 1 -- 172.21.15.129:0/645645609 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b78004d70 con 0x7f2b8809a100 2024-09-18T01:44:37.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:37.427+0000 7f2b90050640 1 -- 172.21.15.129:0/645645609 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b88096d60 con 0x7f2b8809a100 2024-09-18T01:44:37.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:37.427+0000 7f2b867fc640 1 -- 172.21.15.129:0/645645609 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b7800a7f0 con 0x7f2b8809a100 2024-09-18T01:44:37.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:37.427+0000 7f2b90050640 1 -- 172.21.15.129:0/645645609 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b881c40b0 con 0x7f2b8809a100 2024-09-18T01:44:37.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:37.427+0000 7f2b867fc640 1 -- 172.21.15.129:0/645645609 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2b7801b070 con 0x7f2b8809a100 2024-09-18T01:44:37.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:37.427+0000 7f2b867fc640 1 -- 172.21.15.129:0/645645609 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f2b78007930 con 0x7f2b8809a100 2024-09-18T01:44:37.430 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:37.428+0000 7f2b90050640 1 -- 172.21.15.129:0/645645609 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b8809d020 con 0x7f2b8809a100 2024-09-18T01:44:37.431 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:37.430+0000 7f2b867fc640 1 -- 172.21.15.129:0/645645609 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f2b78022070 con 0x7f2b8809a100 2024-09-18T01:44:37.488 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:37.486+0000 7f2b90050640 1 -- 172.21.15.129:0/645645609 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2b88096a50 con 0x7f2b8809a100 2024-09-18T01:44:37.488 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:37.487+0000 7f2b867fc640 1 -- 172.21.15.129:0/645645609 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7f2b8809d3b0 con 0x7f2b8809a100 2024-09-18T01:44:37.489 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:44:37.489 INFO:teuthology.orchestra.run.smithi129.stdout:{"epoch":6,"fsid":"5634e4ff-a0cf-4689-882d-342647f6e34c","created":"2024-09-18T01:44:36.105421+0000","modified":"2024-09-18T01:44:37.219405+0000","last_up_change":"0.000000","last_in_change":"2024-09-18T01:44:37.219405+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"19ab8d59-755c-42b6-83df-b3c88496d6da","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"4d5949df-a041-424d-a475-2025e490700c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ff23f4ef-a771-4752-b233-87f7287b6c75","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e84370c3-e85d-40c8-bea4-4a6e61cf53d1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T01:44:37.489 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:37.487+0000 7f2b90050640 1 -- 172.21.15.129:0/645645609 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2b8809a100 msgr2=0x7f2b881c3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:37.490 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:37.487+0000 7f2b90050640 1 --2- 172.21.15.129:0/645645609 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2b8809a100 0x7f2b881c3990 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2b7800c790 tx=0x7f2b7800cc50 comp rx=0 tx=0).stop 2024-09-18T01:44:37.490 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:37.487+0000 7f2b90050640 1 -- 172.21.15.129:0/645645609 shutdown_connections 2024-09-18T01:44:37.490 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:37.487+0000 7f2b90050640 1 --2- 172.21.15.129:0/645645609 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2b8809a100 0x7f2b881c3990 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:37.490 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:37.487+0000 7f2b90050640 1 -- 172.21.15.129:0/645645609 >> 172.21.15.129:0/645645609 conn(0x7f2b8806d4a0 msgr2=0x7f2b8809f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:37.490 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:37.488+0000 7f2b90050640 1 -- 172.21.15.129:0/645645609 shutdown_connections 2024-09-18T01:44:37.490 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:37.488+0000 7f2b90050640 1 -- 172.21.15.129:0/645645609 wait complete. 2024-09-18T01:44:37.500 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-18T01:44:37.501 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-18T01:44:37.904 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-18T01:44:37.994 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:37.992+0000 7f5f4b09b640 1 Processor -- start 2024-09-18T01:44:37.994 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:37.992+0000 7f5f4b09b640 1 -- start start 2024-09-18T01:44:37.995 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:37.993+0000 7f5f4b09b640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f5f44131a40 0x7f5f44133e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:37.995 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:37.993+0000 7f5f4b09b640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f44098260 con 0x7f5f44097770 2024-09-18T01:44:37.995 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:37.993+0000 7f5f4b09b640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x7f5f440a0da0 con 0x7f5f44131a40 2024-09-18T01:44:37.995 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:37.993+0000 7f5f43fff640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f5f44131a40 0x7f5f44133e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:37.995 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:37.993+0000 7f5f48e37640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f5f44097770 0x7f5f44097b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:45934/0 (socket says 172.21.15.129:45934) 2024-09-18T01:44:37.995 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:37.993+0000 7f5f48e37640 1 -- 172.21.15.129:0/2092375329 learned_addr learned my addr 172.21.15.129:0/2092375329 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-09-18T01:44:37.995 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:37.993+0000 7f5f43fff640 1 --2- 172.21.15.129:0/2092375329 >> v2:172.21.15.129:3300/0 conn(0x7f5f44131a40 0x7f5f44133e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:50580/0 (socket says 172.21.15.129:50580) 2024-09-18T01:44:37.995 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:37.993+0000 7f5f43fff640 1 -- 172.21.15.129:0/2092375329 >> v1:172.21.15.129:6789/0 conn(0x7f5f44097770 legacy=0x7f5f44097b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:37.995 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:37.993+0000 7f5f437fe640 1 -- 172.21.15.129:0/2092375329 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1337743012 0 0) 0x7f5f44098260 con 0x7f5f44097770 2024-09-18T01:44:37.995 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:37.993+0000 7f5f43fff640 1 -- 172.21.15.129:0/2092375329 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f4409ac90 con 0x7f5f44131a40 2024-09-18T01:44:37.998 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:37.994+0000 7f5f43fff640 1 --2- 172.21.15.129:0/2092375329 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5f44131a40 0x7f5f44133e30 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5f30009720 tx=0x7f5f3002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d71f53d5b6f82b03 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:37.998 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:37.994+0000 7f5f437fe640 1 -- 172.21.15.129:0/2092375329 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f30037070 con 0x7f5f44131a40 2024-09-18T01:44:37.998 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:37.994+0000 7f5f437fe640 1 -- 172.21.15.129:0/2092375329 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f3002ad90 con 0x7f5f44131a40 2024-09-18T01:44:37.998 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:37.994+0000 7f5f437fe640 1 -- 172.21.15.129:0/2092375329 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f30032590 con 0x7f5f44131a40 2024-09-18T01:44:37.998 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:37.995+0000 7f5f4b09b640 1 -- 172.21.15.129:0/2092375329 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5f44131a40 msgr2=0x7f5f44133e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:37.998 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:37.995+0000 7f5f4b09b640 1 --2- 172.21.15.129:0/2092375329 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5f44131a40 0x7f5f44133e30 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5f30009720 tx=0x7f5f3002a110 comp rx=0 tx=0).stop 2024-09-18T01:44:37.998 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:37.995+0000 7f5f4b09b640 1 -- 172.21.15.129:0/2092375329 shutdown_connections 2024-09-18T01:44:37.999 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:37.995+0000 7f5f4b09b640 1 --2- 172.21.15.129:0/2092375329 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5f44131a40 0x7f5f44133e30 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:37.999 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:37.995+0000 7f5f4b09b640 1 -- 172.21.15.129:0/2092375329 >> 172.21.15.129:0/2092375329 conn(0x7f5f440a15f0 msgr2=0x7f5f4409dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:37.999 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:37.995+0000 7f5f4b09b640 1 -- 172.21.15.129:0/2092375329 shutdown_connections 2024-09-18T01:44:37.999 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:37.995+0000 7f5f4b09b640 1 -- 172.21.15.129:0/2092375329 wait complete. 2024-09-18T01:44:37.999 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:37.995+0000 7f5f4b09b640 1 Processor -- start 2024-09-18T01:44:37.999 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:37.996+0000 7f5f4b09b640 1 -- start start 2024-09-18T01:44:37.999 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:37.996+0000 7f5f4b09b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5f44097770 0x7f5f441c3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:37.999 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:37.996+0000 7f5f4b09b640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f5f4409a620 con 0x7f5f44097770 2024-09-18T01:44:37.999 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:37.996+0000 7f5f48e37640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5f44097770 0x7f5f441c3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:37.999 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:37.996+0000 7f5f48e37640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5f44097770 0x7f5f441c3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:50594/0 (socket says 172.21.15.129:50594) 2024-09-18T01:44:37.999 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:37.996+0000 7f5f48e37640 1 -- 172.21.15.129:0/762716796 learned_addr learned my addr 172.21.15.129:0/762716796 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-18T01:44:37.999 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:37.996+0000 7f5f48e37640 1 -- 172.21.15.129:0/762716796 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f44128a50 con 0x7f5f44097770 2024-09-18T01:44:38.000 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:37.996+0000 7f5f48e37640 1 --2- 172.21.15.129:0/762716796 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5f44097770 0x7f5f441c3240 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5f3800c420 tx=0x7f5f3800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:38.000 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:37.997+0000 7f5f417fa640 1 -- 172.21.15.129:0/762716796 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f38018070 con 0x7f5f44097770 2024-09-18T01:44:38.000 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:37.997+0000 7f5f417fa640 1 -- 172.21.15.129:0/762716796 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f380074d0 con 0x7f5f44097770 2024-09-18T01:44:38.000 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:37.997+0000 7f5f417fa640 1 -- 172.21.15.129:0/762716796 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f38004950 con 0x7f5f44097770 2024-09-18T01:44:38.000 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:37.997+0000 7f5f4b09b640 1 -- 172.21.15.129:0/762716796 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f44128000 con 0x7f5f44097770 2024-09-18T01:44:38.000 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:37.997+0000 7f5f4b09b640 1 -- 172.21.15.129:0/762716796 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f441c3960 con 0x7f5f44097770 2024-09-18T01:44:38.000 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:37.997+0000 7f5f417fa640 1 -- 172.21.15.129:0/762716796 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5f3801b070 con 0x7f5f44097770 2024-09-18T01:44:38.000 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:37.997+0000 7f5f417fa640 1 -- 172.21.15.129:0/762716796 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f5f3801c8c0 con 0x7f5f44097770 2024-09-18T01:44:38.001 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:37.998+0000 7f5f4b09b640 1 -- 172.21.15.129:0/762716796 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f44097b50 con 0x7f5f44097770 2024-09-18T01:44:38.001 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:38.000+0000 7f5f417fa640 1 -- 172.21.15.129:0/762716796 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f5f38022070 con 0x7f5f44097770 2024-09-18T01:44:38.057 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:38.056+0000 7f5f4b09b640 1 -- 172.21.15.129:0/762716796 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5f441292c0 con 0x7f5f44097770 2024-09-18T01:44:38.057 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:38.056+0000 7f5f417fa640 1 -- 172.21.15.129:0/762716796 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7f5f3801cc50 con 0x7f5f44097770 2024-09-18T01:44:38.058 INFO:teuthology.misc.health.smithi129.stdout: 2024-09-18T01:44:38.058 INFO:teuthology.misc.health.smithi129.stdout:{"epoch":6,"fsid":"5634e4ff-a0cf-4689-882d-342647f6e34c","created":"2024-09-18T01:44:36.105421+0000","modified":"2024-09-18T01:44:37.219405+0000","last_up_change":"0.000000","last_in_change":"2024-09-18T01:44:37.219405+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"19ab8d59-755c-42b6-83df-b3c88496d6da","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"4d5949df-a041-424d-a475-2025e490700c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ff23f4ef-a771-4752-b233-87f7287b6c75","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e84370c3-e85d-40c8-bea4-4a6e61cf53d1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T01:44:38.058 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:38.057+0000 7f5f4b09b640 1 -- 172.21.15.129:0/762716796 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5f44097770 msgr2=0x7f5f441c3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:38.059 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:38.057+0000 7f5f4b09b640 1 --2- 172.21.15.129:0/762716796 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5f44097770 0x7f5f441c3240 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5f3800c420 tx=0x7f5f3800c8e0 comp rx=0 tx=0).stop 2024-09-18T01:44:38.059 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:38.057+0000 7f5f4b09b640 1 -- 172.21.15.129:0/762716796 shutdown_connections 2024-09-18T01:44:38.059 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:38.057+0000 7f5f4b09b640 1 --2- 172.21.15.129:0/762716796 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5f44097770 0x7f5f441c3240 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:38.059 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:38.057+0000 7f5f4b09b640 1 -- 172.21.15.129:0/762716796 >> 172.21.15.129:0/762716796 conn(0x7f5f440a15f0 msgr2=0x7f5f44098530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:38.059 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:38.057+0000 7f5f4b09b640 1 -- 172.21.15.129:0/762716796 shutdown_connections 2024-09-18T01:44:38.059 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:38.057+0000 7f5f4b09b640 1 -- 172.21.15.129:0/762716796 wait complete. 2024-09-18T01:44:38.067 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-18T01:44:38.300 INFO:tasks.ceph.mgr.x.smithi146.stderr:2024-09-18T01:44:38.298+0000 7f82ac014040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-18T01:44:38.351 INFO:tasks.ceph.mgr.x.smithi146.stderr:2024-09-18T01:44:38.350+0000 7f82ac014040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-18T01:44:38.715 INFO:tasks.ceph.mgr.x.smithi146.stderr:2024-09-18T01:44:38.714+0000 7f82ac014040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-18T01:44:38.738 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-18T01:44:38.737+0000 7f23eb4d6640 -1 Falling back to public interface 2024-09-18T01:44:38.800 INFO:tasks.ceph.mgr.x.smithi146.stderr:2024-09-18T01:44:38.798+0000 7f82ac014040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-18T01:44:38.908 INFO:tasks.ceph.mgr.x.smithi146.stderr:2024-09-18T01:44:38.907+0000 7f82ac014040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-18T01:44:38.953 INFO:tasks.ceph.mgr.x.smithi146.stderr:2024-09-18T01:44:38.952+0000 7f82ac014040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-18T01:44:39.064 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-18T01:44:39.062+0000 7fe51ea11640 -1 Falling back to public interface 2024-09-18T01:44:39.064 INFO:tasks.ceph.mgr.x.smithi146.stderr:2024-09-18T01:44:39.063+0000 7f82ac014040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-18T01:44:39.118 INFO:tasks.ceph.mgr.x.smithi146.stderr:2024-09-18T01:44:39.117+0000 7f82ac014040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-18T01:44:39.163 INFO:tasks.ceph.mgr.x.smithi146.stderr:2024-09-18T01:44:39.161+0000 7f82ac014040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-18T01:44:39.271 INFO:tasks.ceph.mgr.x.smithi146.stderr:2024-09-18T01:44:39.270+0000 7f82ac014040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-18T01:44:39.321 INFO:tasks.ceph.mgr.x.smithi146.stderr:2024-09-18T01:44:39.320+0000 7f82ac014040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-18T01:44:39.326 INFO:tasks.ceph.osd.1.smithi146.stderr:2024-09-18T01:44:39.324+0000 7ff0e20e0640 -1 Falling back to public interface 2024-09-18T01:44:39.326 INFO:tasks.ceph.osd.3.smithi146.stderr:2024-09-18T01:44:39.324+0000 7f9b0e4fe640 -1 Falling back to public interface 2024-09-18T01:44:39.374 INFO:tasks.ceph.mgr.x.smithi146.stderr:2024-09-18T01:44:39.373+0000 7f82ac014040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-18T01:44:39.440 INFO:tasks.ceph.mgr.x.smithi146.stderr:2024-09-18T01:44:39.439+0000 7f82ac014040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-18T01:44:39.484 INFO:tasks.ceph.mgr.x.smithi146.stderr:2024-09-18T01:44:39.483+0000 7f82ac014040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-18T01:44:39.527 INFO:tasks.ceph.mgr.x.smithi146.stderr:2024-09-18T01:44:39.526+0000 7f82ac014040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-18T01:44:40.174 INFO:tasks.ceph.mgr.x.smithi146.stderr:2024-09-18T01:44:40.172+0000 7f82ac014040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-18T01:44:41.183 INFO:tasks.ceph.mgr.x.smithi146.stderr:2024-09-18T01:44:41.181+0000 7f824bba2640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-18T01:44:43.217 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-18T01:44:43.216+0000 7f23eb4d6640 -1 osd.0 0 log_to_monitors true 2024-09-18T01:44:43.394 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-18T01:44:43.392+0000 7fe51ea11640 -1 osd.2 0 log_to_monitors true 2024-09-18T01:44:43.690 INFO:tasks.ceph.osd.3.smithi146.stderr:2024-09-18T01:44:43.688+0000 7f9b0e4fe640 -1 osd.3 0 log_to_monitors true 2024-09-18T01:44:43.904 INFO:tasks.ceph.osd.1.smithi146.stderr:2024-09-18T01:44:43.902+0000 7ff0e20e0640 -1 osd.1 0 log_to_monitors true 2024-09-18T01:44:44.471 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-18T01:44:44.572 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:44.570+0000 7f4a26152640 1 Processor -- start 2024-09-18T01:44:44.572 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:44.570+0000 7f4a26152640 1 -- start start 2024-09-18T01:44:44.573 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:44.570+0000 7f4a26152640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f4a200730c0 0x7f4a20133a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:44.573 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:44.571+0000 7f4a26152640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a2006e0e0 con 0x7f4a2006d5f0 2024-09-18T01:44:44.573 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:44.571+0000 7f4a26152640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x7f4a200737f0 con 0x7f4a200730c0 2024-09-18T01:44:44.573 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:44.571+0000 7f4a1effd640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f4a200730c0 0x7f4a20133a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:44.573 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:44.571+0000 7f4a1f7fe640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f4a2006d5f0 0x7f4a2006d9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:53882/0 (socket says 172.21.15.129:53882) 2024-09-18T01:44:44.573 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:44.571+0000 7f4a1effd640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f4a200730c0 0x7f4a20133a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:49358/0 (socket says 172.21.15.129:49358) 2024-09-18T01:44:44.573 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:44.571+0000 7f4a1f7fe640 1 -- 172.21.15.129:0/3550074753 learned_addr learned my addr 172.21.15.129:0/3550074753 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-09-18T01:44:44.573 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:44.571+0000 7f4a1effd640 1 -- 172.21.15.129:0/3550074753 >> v1:172.21.15.129:6789/0 conn(0x7f4a2006d5f0 legacy=0x7f4a2006d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:44.573 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:44.571+0000 7f4a1effd640 1 -- 172.21.15.129:0/3550074753 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a2006d1c0 con 0x7f4a200730c0 2024-09-18T01:44:44.577 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:44.572+0000 7f4a1effd640 1 --2- 172.21.15.129:0/3550074753 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4a200730c0 0x7f4a20133a50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4a08009720 tx=0x7f4a0802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daa05d5ec2260b35 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:44.577 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:44.572+0000 7f4a1e7fc640 1 -- 172.21.15.129:0/3550074753 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a08037070 con 0x7f4a200730c0 2024-09-18T01:44:44.577 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:44.572+0000 7f4a1e7fc640 1 -- 172.21.15.129:0/3550074753 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a0802ad90 con 0x7f4a200730c0 2024-09-18T01:44:44.577 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:44.572+0000 7f4a1e7fc640 1 -- 172.21.15.129:0/3550074753 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a08032590 con 0x7f4a200730c0 2024-09-18T01:44:44.577 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:44.572+0000 7f4a26152640 1 -- 172.21.15.129:0/3550074753 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4a200730c0 msgr2=0x7f4a20133a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:44.577 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:44.572+0000 7f4a26152640 1 --2- 172.21.15.129:0/3550074753 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4a200730c0 0x7f4a20133a50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4a08009720 tx=0x7f4a0802a110 comp rx=0 tx=0).stop 2024-09-18T01:44:44.577 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:44.572+0000 7f4a26152640 1 -- 172.21.15.129:0/3550074753 shutdown_connections 2024-09-18T01:44:44.577 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:44.572+0000 7f4a26152640 1 --2- 172.21.15.129:0/3550074753 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4a200730c0 0x7f4a20133a50 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:44.577 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:44.572+0000 7f4a26152640 1 -- 172.21.15.129:0/3550074753 >> 172.21.15.129:0/3550074753 conn(0x7f4a2009e0f0 msgr2=0x7f4a2009e500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:44.577 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:44.572+0000 7f4a26152640 1 -- 172.21.15.129:0/3550074753 shutdown_connections 2024-09-18T01:44:44.577 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:44.573+0000 7f4a26152640 1 -- 172.21.15.129:0/3550074753 wait complete. 2024-09-18T01:44:44.578 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:44.573+0000 7f4a26152640 1 Processor -- start 2024-09-18T01:44:44.578 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:44.574+0000 7f4a26152640 1 -- start start 2024-09-18T01:44:44.578 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:44.574+0000 7f4a26152640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4a2006d5f0 0x7f4a201c31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:44.578 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:44.574+0000 7f4a26152640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f4a20133f90 con 0x7f4a2006d5f0 2024-09-18T01:44:44.578 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:44.574+0000 7f4a1f7fe640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4a2006d5f0 0x7f4a201c31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:44.578 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:44.574+0000 7f4a1f7fe640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4a2006d5f0 0x7f4a201c31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:49366/0 (socket says 172.21.15.129:49366) 2024-09-18T01:44:44.578 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:44.574+0000 7f4a1f7fe640 1 -- 172.21.15.129:0/1937157807 learned_addr learned my addr 172.21.15.129:0/1937157807 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-18T01:44:44.578 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:44.574+0000 7f4a1f7fe640 1 -- 172.21.15.129:0/1937157807 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a20128f40 con 0x7f4a2006d5f0 2024-09-18T01:44:44.578 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:44.574+0000 7f4a1f7fe640 1 --2- 172.21.15.129:0/1937157807 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4a2006d5f0 0x7f4a201c31b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4a1000c4a0 tx=0x7f4a1000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:44.578 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:44.575+0000 7f4a17fff640 1 -- 172.21.15.129:0/1937157807 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a10017070 con 0x7f4a2006d5f0 2024-09-18T01:44:44.578 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:44.575+0000 7f4a17fff640 1 -- 172.21.15.129:0/1937157807 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a10005c10 con 0x7f4a2006d5f0 2024-09-18T01:44:44.578 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:44.575+0000 7f4a26152640 1 -- 172.21.15.129:0/1937157807 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a20132bc0 con 0x7f4a2006d5f0 2024-09-18T01:44:44.578 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:44.575+0000 7f4a17fff640 1 -- 172.21.15.129:0/1937157807 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a10007070 con 0x7f4a2006d5f0 2024-09-18T01:44:44.579 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:44.575+0000 7f4a26152640 1 -- 172.21.15.129:0/1937157807 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a20125640 con 0x7f4a2006d5f0 2024-09-18T01:44:44.579 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:44.575+0000 7f4a17fff640 1 -- 172.21.15.129:0/1937157807 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 4) ==== 45681+0+0 (secure 0 0 0) 0x7f4a1001a070 con 0x7f4a2006d5f0 2024-09-18T01:44:44.579 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:44.576+0000 7f4a17fff640 1 --2- 172.21.15.129:0/1937157807 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f4a00038210 0x7f4a0003a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:44.579 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:44.576+0000 7f4a17fff640 1 -- 172.21.15.129:0/1937157807 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1339+0+0 (secure 0 0 0) 0x7f4a10049b20 con 0x7f4a2006d5f0 2024-09-18T01:44:44.579 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:44.576+0000 7f4a26152640 1 -- 172.21.15.129:0/1937157807 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a2006d9d0 con 0x7f4a2006d5f0 2024-09-18T01:44:44.579 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:44.576+0000 7f4a1effd640 1 --2- 172.21.15.129:0/1937157807 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f4a00038210 0x7f4a0003a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:44.579 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:44.576+0000 7f4a1effd640 1 --2- 172.21.15.129:0/1937157807 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f4a00038210 0x7f4a0003a6d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4a08009720 tx=0x7f4a0802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:44.582 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:44.581+0000 7f4a17fff640 1 -- 172.21.15.129:0/1937157807 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4a1001b3b0 con 0x7f4a2006d5f0 2024-09-18T01:44:44.748 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:44.747+0000 7f4a26152640 1 -- 172.21.15.129:0/1937157807 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4a201249f0 con 0x7f4a2006d5f0 2024-09-18T01:44:44.748 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:44.747+0000 7f4a17fff640 1 -- 172.21.15.129:0/1937157807 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v7) ==== 74+0+4153 (secure 0 0 0) 0x7f4a10010300 con 0x7f4a2006d5f0 2024-09-18T01:44:44.748 INFO:teuthology.misc.health.smithi129.stdout: 2024-09-18T01:44:44.748 INFO:teuthology.misc.health.smithi129.stdout:{"epoch":7,"fsid":"5634e4ff-a0cf-4689-882d-342647f6e34c","created":"2024-09-18T01:44:36.105421+0000","modified":"2024-09-18T01:44:44.183756+0000","last_up_change":"0.000000","last_in_change":"2024-09-18T01:44:37.219405+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"19ab8d59-755c-42b6-83df-b3c88496d6da","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"4d5949df-a041-424d-a475-2025e490700c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ff23f4ef-a771-4752-b233-87f7287b6c75","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e84370c3-e85d-40c8-bea4-4a6e61cf53d1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T01:44:44.751 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:44.749+0000 7f4a26152640 1 -- 172.21.15.129:0/1937157807 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f4a00038210 msgr2=0x7f4a0003a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:44.751 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:44.749+0000 7f4a26152640 1 --2- 172.21.15.129:0/1937157807 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f4a00038210 0x7f4a0003a6d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4a08009720 tx=0x7f4a0802e000 comp rx=0 tx=0).stop 2024-09-18T01:44:44.751 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:44.749+0000 7f4a26152640 1 -- 172.21.15.129:0/1937157807 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4a2006d5f0 msgr2=0x7f4a201c31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:44.751 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:44.749+0000 7f4a26152640 1 --2- 172.21.15.129:0/1937157807 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4a2006d5f0 0x7f4a201c31b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4a1000c4a0 tx=0x7f4a1000c960 comp rx=0 tx=0).stop 2024-09-18T01:44:44.751 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:44.749+0000 7f4a26152640 1 -- 172.21.15.129:0/1937157807 shutdown_connections 2024-09-18T01:44:44.751 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:44.749+0000 7f4a26152640 1 --2- 172.21.15.129:0/1937157807 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f4a00038210 0x7f4a0003a6d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:44.751 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:44.749+0000 7f4a26152640 1 --2- 172.21.15.129:0/1937157807 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4a2006d5f0 0x7f4a201c31b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:44.751 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:44.749+0000 7f4a26152640 1 -- 172.21.15.129:0/1937157807 >> 172.21.15.129:0/1937157807 conn(0x7f4a2009e0f0 msgr2=0x7f4a20099270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:44.751 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:44.749+0000 7f4a26152640 1 -- 172.21.15.129:0/1937157807 shutdown_connections 2024-09-18T01:44:44.751 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:44.749+0000 7f4a26152640 1 -- 172.21.15.129:0/1937157807 wait complete. 2024-09-18T01:44:44.760 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-18T01:44:46.043 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-18T01:44:46.042+0000 7f23e7c79640 -1 osd.0 0 waiting for initial osdmap 2024-09-18T01:44:46.055 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-09-18T01:44:46.054+0000 7f23df274640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T01:44:46.863 INFO:tasks.ceph.osd.3.smithi146.stderr:2024-09-18T01:44:46.862+0000 7f9b09c6a640 -1 osd.3 0 waiting for initial osdmap 2024-09-18T01:44:46.874 INFO:tasks.ceph.osd.3.smithi146.stderr:2024-09-18T01:44:46.873+0000 7f9b0229c640 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T01:44:46.899 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-18T01:44:46.897+0000 7fe519b6f640 -1 osd.2 0 waiting for initial osdmap 2024-09-18T01:44:46.900 INFO:tasks.ceph.osd.1.smithi146.stderr:2024-09-18T01:44:46.899+0000 7ff0dd84c640 -1 osd.1 0 waiting for initial osdmap 2024-09-18T01:44:46.910 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-18T01:44:46.909+0000 7fe5121a1640 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T01:44:46.914 INFO:tasks.ceph.osd.1.smithi146.stderr:2024-09-18T01:44:46.913+0000 7ff0d5e7e640 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T01:44:51.164 DEBUG:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-18T01:44:51.266 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:51.265+0000 7f169be0e640 1 Processor -- start 2024-09-18T01:44:51.266 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:51.265+0000 7f169be0e640 1 -- start start 2024-09-18T01:44:51.268 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:51.266+0000 7f169be0e640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f1694094540 0x7f1694130650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:51.268 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:51.266+0000 7f169be0e640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1694127ec0 con 0x7f1694128310 2024-09-18T01:44:51.268 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:51.266+0000 7f169be0e640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x7f169406e430 con 0x7f1694094540 2024-09-18T01:44:51.268 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:51.266+0000 7f16993a9640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f1694094540 0x7f1694130650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:51.268 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:51.266+0000 7f16993a9640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f1694094540 0x7f1694130650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:49378/0 (socket says 172.21.15.129:49378) 2024-09-18T01:44:51.268 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:51.266+0000 7f16993a9640 1 -- 172.21.15.129:0/1825356211 learned_addr learned my addr 172.21.15.129:0/1825356211 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-18T01:44:51.269 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:51.266+0000 7f1699baa640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f1694128310 0x7f16941286f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:53894/0 (socket says 172.21.15.129:53894) 2024-09-18T01:44:51.269 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:51.266+0000 7f16993a9640 1 -- 172.21.15.129:0/1825356211 >> v1:172.21.15.129:6789/0 conn(0x7f1694128310 legacy=0x7f16941286f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:51.269 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:51.266+0000 7f1698ba8640 1 -- 172.21.15.129:0/1825356211 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3339591879 0 0) 0x7f1694127ec0 con 0x7f1694128310 2024-09-18T01:44:51.269 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:51.266+0000 7f16993a9640 1 -- 172.21.15.129:0/1825356211 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1694094970 con 0x7f1694094540 2024-09-18T01:44:51.269 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:51.267+0000 7f16993a9640 1 --2- 172.21.15.129:0/1825356211 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1694094540 0x7f1694130650 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f16840097f0 tx=0x7f168402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f18baece4ce1387 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:51.269 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:51.267+0000 7f1698ba8640 1 -- 172.21.15.129:0/1825356211 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1684037070 con 0x7f1694094540 2024-09-18T01:44:51.269 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:51.267+0000 7f1698ba8640 1 -- 172.21.15.129:0/1825356211 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1684032440 con 0x7f1694094540 2024-09-18T01:44:51.269 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:51.267+0000 7f1698ba8640 1 -- 172.21.15.129:0/1825356211 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f168402ae60 con 0x7f1694094540 2024-09-18T01:44:51.272 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:51.267+0000 7f169be0e640 1 -- 172.21.15.129:0/1825356211 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1694094540 msgr2=0x7f1694130650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:51.272 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:51.267+0000 7f169be0e640 1 --2- 172.21.15.129:0/1825356211 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1694094540 0x7f1694130650 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f16840097f0 tx=0x7f168402a1e0 comp rx=0 tx=0).stop 2024-09-18T01:44:51.273 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:51.268+0000 7f169be0e640 1 -- 172.21.15.129:0/1825356211 shutdown_connections 2024-09-18T01:44:51.273 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:51.268+0000 7f169be0e640 1 --2- 172.21.15.129:0/1825356211 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1694094540 0x7f1694130650 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:51.273 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:51.268+0000 7f169be0e640 1 -- 172.21.15.129:0/1825356211 >> 172.21.15.129:0/1825356211 conn(0x7f169409ac90 msgr2=0x7f169409b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:51.273 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:51.268+0000 7f169be0e640 1 -- 172.21.15.129:0/1825356211 shutdown_connections 2024-09-18T01:44:51.273 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:51.268+0000 7f169be0e640 1 -- 172.21.15.129:0/1825356211 wait complete. 2024-09-18T01:44:51.273 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:51.268+0000 7f169be0e640 1 Processor -- start 2024-09-18T01:44:51.273 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:51.268+0000 7f169be0e640 1 -- start start 2024-09-18T01:44:51.273 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:51.269+0000 7f169be0e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1694094540 0x7f1694121c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:51.273 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:51.269+0000 7f169be0e640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f1694130d10 con 0x7f1694094540 2024-09-18T01:44:51.273 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:51.269+0000 7f1699baa640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1694094540 0x7f1694121c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:51.273 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:51.269+0000 7f1699baa640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1694094540 0x7f1694121c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:49380/0 (socket says 172.21.15.129:49380) 2024-09-18T01:44:51.273 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:51.269+0000 7f1699baa640 1 -- 172.21.15.129:0/3578876184 learned_addr learned my addr 172.21.15.129:0/3578876184 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-18T01:44:51.274 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:51.269+0000 7f1699baa640 1 -- 172.21.15.129:0/3578876184 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1694094e60 con 0x7f1694094540 2024-09-18T01:44:51.274 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:51.269+0000 7f1699baa640 1 --2- 172.21.15.129:0/3578876184 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1694094540 0x7f1694121c70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f169000c840 tx=0x7f169000cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:51.274 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:51.269+0000 7f168a7fc640 1 -- 172.21.15.129:0/3578876184 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f169000a660 con 0x7f1694094540 2024-09-18T01:44:51.274 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:51.269+0000 7f168a7fc640 1 -- 172.21.15.129:0/3578876184 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f169000a800 con 0x7f1694094540 2024-09-18T01:44:51.274 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:51.269+0000 7f169be0e640 1 -- 172.21.15.129:0/3578876184 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16941239d0 con 0x7f1694094540 2024-09-18T01:44:51.274 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:51.269+0000 7f168a7fc640 1 -- 172.21.15.129:0/3578876184 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f169000a9b0 con 0x7f1694094540 2024-09-18T01:44:51.274 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:51.270+0000 7f169be0e640 1 -- 172.21.15.129:0/3578876184 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1694123e60 con 0x7f1694094540 2024-09-18T01:44:51.274 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:51.270+0000 7f168a7fc640 1 -- 172.21.15.129:0/3578876184 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f169000ac60 con 0x7f1694094540 2024-09-18T01:44:51.274 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:51.270+0000 7f168a7fc640 1 --2- 172.21.15.129:0/3578876184 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1678038250 0x7f167803a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:51.274 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:51.271+0000 7f168a7fc640 1 -- 172.21.15.129:0/3578876184 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3129+0+0 (secure 0 0 0) 0x7f169004b140 con 0x7f1694094540 2024-09-18T01:44:51.274 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:51.271+0000 7f169be0e640 1 -- 172.21.15.129:0/3578876184 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1694095ae0 con 0x7f1694094540 2024-09-18T01:44:51.274 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:51.271+0000 7f16993a9640 1 --2- 172.21.15.129:0/3578876184 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1678038250 0x7f167803a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:51.274 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:51.271+0000 7f16993a9640 1 --2- 172.21.15.129:0/3578876184 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1678038250 0x7f167803a710 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1684034000 tx=0x7f168402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:51.276 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:51.276+0000 7f168a7fc640 1 -- 172.21.15.129:0/3578876184 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1690011560 con 0x7f1694094540 2024-09-18T01:44:51.442 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:51.441+0000 7f169be0e640 1 -- 172.21.15.129:0/3578876184 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f16940756c0 con 0x7f1694094540 2024-09-18T01:44:51.443 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:51.442+0000 7f168a7fc640 1 -- 172.21.15.129:0/3578876184 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+8023 (secure 0 0 0) 0x7f1690011790 con 0x7f1694094540 2024-09-18T01:44:51.443 INFO:teuthology.misc.health.smithi129.stdout: 2024-09-18T01:44:51.443 INFO:teuthology.misc.health.smithi129.stdout:{"epoch":12,"fsid":"5634e4ff-a0cf-4689-882d-342647f6e34c","created":"2024-09-18T01:44:36.105421+0000","modified":"2024-09-18T01:44:50.216359+0000","last_up_change":"2024-09-18T01:44:47.044491+0000","last_in_change":"2024-09-18T01:44:37.219405+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-18T01:44:48.210295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19ab8d59-755c-42b6-83df-b3c88496d6da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":1759265424},{"type":"v1","addr":"172.21.15.129:6801","nonce":1759265424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":1759265424},{"type":"v1","addr":"172.21.15.129:6803","nonce":1759265424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":1759265424},{"type":"v1","addr":"172.21.15.129:6807","nonce":1759265424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":1759265424},{"type":"v1","addr":"172.21.15.129:6805","nonce":1759265424}]},"public_addr":"172.21.15.129:6801/1759265424","cluster_addr":"172.21.15.129:6803/1759265424","heartbeat_back_addr":"172.21.15.129:6807/1759265424","heartbeat_front_addr":"172.21.15.129:6805/1759265424","state":["exists","up"]},{"osd":1,"uuid":"4d5949df-a041-424d-a475-2025e490700c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":3930274777},{"type":"v1","addr":"172.21.15.146:6810","nonce":3930274777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":3930274777},{"type":"v1","addr":"172.21.15.146:6814","nonce":3930274777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":3930274777},{"type":"v1","addr":"172.21.15.146:6822","nonce":3930274777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":3930274777},{"type":"v1","addr":"172.21.15.146:6818","nonce":3930274777}]},"public_addr":"172.21.15.146:6810/3930274777","cluster_addr":"172.21.15.146:6814/3930274777","heartbeat_back_addr":"172.21.15.146:6822/3930274777","heartbeat_front_addr":"172.21.15.146:6818/3930274777","state":["exists","up"]},{"osd":2,"uuid":"ff23f4ef-a771-4752-b233-87f7287b6c75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3820039304},{"type":"v1","addr":"172.21.15.146:6801","nonce":3820039304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3820039304},{"type":"v1","addr":"172.21.15.146:6803","nonce":3820039304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3820039304},{"type":"v1","addr":"172.21.15.146:6807","nonce":3820039304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3820039304},{"type":"v1","addr":"172.21.15.146:6805","nonce":3820039304}]},"public_addr":"172.21.15.146:6801/3820039304","cluster_addr":"172.21.15.146:6803/3820039304","heartbeat_back_addr":"172.21.15.146:6807/3820039304","heartbeat_front_addr":"172.21.15.146:6805/3820039304","state":["exists","up"]},{"osd":3,"uuid":"e84370c3-e85d-40c8-bea4-4a6e61cf53d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":4106661138},{"type":"v1","addr":"172.21.15.146:6811","nonce":4106661138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6813","nonce":4106661138},{"type":"v1","addr":"172.21.15.146:6815","nonce":4106661138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6821","nonce":4106661138},{"type":"v1","addr":"172.21.15.146:6823","nonce":4106661138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":4106661138},{"type":"v1","addr":"172.21.15.146:6819","nonce":4106661138}]},"public_addr":"172.21.15.146:6811/4106661138","cluster_addr":"172.21.15.146:6815/4106661138","heartbeat_back_addr":"172.21.15.146:6823/4106661138","heartbeat_front_addr":"172.21.15.146:6819/4106661138","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T01:44:44.239764+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T01:44:44.858663+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T01:44:44.354345+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T01:44:44.723166+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T01:44:51.445 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:51.444+0000 7f169be0e640 1 -- 172.21.15.129:0/3578876184 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1678038250 msgr2=0x7f167803a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:51.445 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:51.444+0000 7f169be0e640 1 --2- 172.21.15.129:0/3578876184 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1678038250 0x7f167803a710 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1684034000 tx=0x7f168402e000 comp rx=0 tx=0).stop 2024-09-18T01:44:51.445 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:51.444+0000 7f169be0e640 1 -- 172.21.15.129:0/3578876184 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1694094540 msgr2=0x7f1694121c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:51.445 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:51.444+0000 7f169be0e640 1 --2- 172.21.15.129:0/3578876184 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1694094540 0x7f1694121c70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f169000c840 tx=0x7f169000cd00 comp rx=0 tx=0).stop 2024-09-18T01:44:51.445 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:51.444+0000 7f169be0e640 1 -- 172.21.15.129:0/3578876184 shutdown_connections 2024-09-18T01:44:51.446 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:51.444+0000 7f169be0e640 1 --2- 172.21.15.129:0/3578876184 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1678038250 0x7f167803a710 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:51.446 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:51.444+0000 7f169be0e640 1 --2- 172.21.15.129:0/3578876184 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1694094540 0x7f1694121c70 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:51.446 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:51.444+0000 7f169be0e640 1 -- 172.21.15.129:0/3578876184 >> 172.21.15.129:0/3578876184 conn(0x7f169409ac90 msgr2=0x7f16940975b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:51.446 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:51.444+0000 7f169be0e640 1 -- 172.21.15.129:0/3578876184 shutdown_connections 2024-09-18T01:44:51.446 INFO:teuthology.misc.health.smithi129.stderr:2024-09-18T01:44:51.444+0000 7f169be0e640 1 -- 172.21.15.129:0/3578876184 wait complete. 2024-09-18T01:44:51.454 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-09-18T01:44:51.454 INFO:tasks.ceph:Creating RBD pool 2024-09-18T01:44:51.455 DEBUG:teuthology.orchestra.run.smithi129:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-18T01:44:51.553 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:51.551+0000 7f89a6872640 1 Processor -- start 2024-09-18T01:44:51.553 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:51.551+0000 7f89a6872640 1 -- start start 2024-09-18T01:44:51.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:51.552+0000 7f89a6872640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f89a012e940 0x7f89a0130d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:51.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:51.552+0000 7f89a6872640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89a006eba0 con 0x7f89a006eda0 2024-09-18T01:44:51.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:51.552+0000 7f89a6872640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x7f89a006d2f0 con 0x7f89a012e940 2024-09-18T01:44:51.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:51.552+0000 7f899f7fe640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f89a012e940 0x7f89a0130d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:51.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:51.552+0000 7f899ffff640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f89a006eda0 0x7f89a006f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:53896/0 (socket says 172.21.15.129:53896) 2024-09-18T01:44:51.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:51.552+0000 7f899f7fe640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f89a012e940 0x7f89a0130d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:49388/0 (socket says 172.21.15.129:49388) 2024-09-18T01:44:51.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:51.552+0000 7f899ffff640 1 -- 172.21.15.129:0/1301290175 learned_addr learned my addr 172.21.15.129:0/1301290175 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-09-18T01:44:51.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:51.552+0000 7f899f7fe640 1 -- 172.21.15.129:0/1301290175 >> v1:172.21.15.129:6789/0 conn(0x7f89a006eda0 legacy=0x7f89a006f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:51.554 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:51.552+0000 7f899f7fe640 1 -- 172.21.15.129:0/1301290175 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a0070d50 con 0x7f89a012e940 2024-09-18T01:44:51.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:51.553+0000 7f899f7fe640 1 --2- 172.21.15.129:0/1301290175 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f89a012e940 0x7f89a0130d30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8994009720 tx=0x7f899402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42e528b69a147378 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:51.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:51.553+0000 7f899effd640 1 -- 172.21.15.129:0/1301290175 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8994037070 con 0x7f89a012e940 2024-09-18T01:44:51.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:51.553+0000 7f899effd640 1 -- 172.21.15.129:0/1301290175 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f899402ae20 con 0x7f89a012e940 2024-09-18T01:44:51.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:51.553+0000 7f899effd640 1 -- 172.21.15.129:0/1301290175 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8994032590 con 0x7f89a012e940 2024-09-18T01:44:51.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:51.554+0000 7f89a6872640 1 -- 172.21.15.129:0/1301290175 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f89a012e940 msgr2=0x7f89a0130d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:51.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:51.554+0000 7f89a6872640 1 --2- 172.21.15.129:0/1301290175 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f89a012e940 0x7f89a0130d30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8994009720 tx=0x7f899402a1a0 comp rx=0 tx=0).stop 2024-09-18T01:44:51.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:51.554+0000 7f89a6872640 1 -- 172.21.15.129:0/1301290175 shutdown_connections 2024-09-18T01:44:51.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:51.554+0000 7f89a6872640 1 --2- 172.21.15.129:0/1301290175 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f89a012e940 0x7f89a0130d30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:51.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:51.554+0000 7f89a6872640 1 -- 172.21.15.129:0/1301290175 >> 172.21.15.129:0/1301290175 conn(0x7f89a009a890 msgr2=0x7f89a009aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:51.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:51.554+0000 7f89a6872640 1 -- 172.21.15.129:0/1301290175 shutdown_connections 2024-09-18T01:44:51.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:51.554+0000 7f89a6872640 1 -- 172.21.15.129:0/1301290175 wait complete. 2024-09-18T01:44:51.556 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:51.554+0000 7f89a6872640 1 Processor -- start 2024-09-18T01:44:51.557 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:51.555+0000 7f89a6872640 1 -- start start 2024-09-18T01:44:51.558 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:51.555+0000 7f89a6872640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f89a006eda0 0x7f89a0122a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:51.559 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:51.555+0000 7f89a6872640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f89a006fcd0 con 0x7f89a006eda0 2024-09-18T01:44:51.559 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:51.555+0000 7f899ffff640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f89a006eda0 0x7f89a0122a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:51.559 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:51.555+0000 7f899ffff640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f89a006eda0 0x7f89a0122a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:49402/0 (socket says 172.21.15.129:49402) 2024-09-18T01:44:51.559 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:51.555+0000 7f899ffff640 1 -- 172.21.15.129:0/2468872342 learned_addr learned my addr 172.21.15.129:0/2468872342 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-18T01:44:51.559 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:51.555+0000 7f899ffff640 1 -- 172.21.15.129:0/2468872342 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a0125d80 con 0x7f89a006eda0 2024-09-18T01:44:51.559 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:51.555+0000 7f899ffff640 1 --2- 172.21.15.129:0/2468872342 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f89a006eda0 0x7f89a0122a60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f899000c380 tx=0x7f899000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:51.559 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:51.556+0000 7f899cff9640 1 -- 172.21.15.129:0/2468872342 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8990005c10 con 0x7f89a006eda0 2024-09-18T01:44:51.559 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:51.556+0000 7f899cff9640 1 -- 172.21.15.129:0/2468872342 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8990005db0 con 0x7f89a006eda0 2024-09-18T01:44:51.559 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:51.556+0000 7f89a6872640 1 -- 172.21.15.129:0/2468872342 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89a0124970 con 0x7f89a006eda0 2024-09-18T01:44:51.559 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:51.556+0000 7f899cff9640 1 -- 172.21.15.129:0/2468872342 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8990004930 con 0x7f89a006eda0 2024-09-18T01:44:51.559 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:51.556+0000 7f89a6872640 1 -- 172.21.15.129:0/2468872342 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89a01255e0 con 0x7f89a006eda0 2024-09-18T01:44:51.559 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:51.557+0000 7f89a6872640 1 -- 172.21.15.129:0/2468872342 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89a006f180 con 0x7f89a006eda0 2024-09-18T01:44:51.560 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:51.557+0000 7f899cff9640 1 -- 172.21.15.129:0/2468872342 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f899001a020 con 0x7f89a006eda0 2024-09-18T01:44:51.560 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:51.557+0000 7f899cff9640 1 --2- 172.21.15.129:0/2468872342 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f898c0382a0 0x7f898c03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:51.560 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:51.557+0000 7f899cff9640 1 -- 172.21.15.129:0/2468872342 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3129+0+0 (secure 0 0 0) 0x7f899004a8e0 con 0x7f89a006eda0 2024-09-18T01:44:51.560 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:51.557+0000 7f899f7fe640 1 --2- 172.21.15.129:0/2468872342 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f898c0382a0 0x7f898c03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:51.560 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:51.558+0000 7f899f7fe640 1 --2- 172.21.15.129:0/2468872342 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f898c0382a0 0x7f898c03a760 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8994034000 tx=0x7f899402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:51.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:51.561+0000 7f899cff9640 1 -- 172.21.15.129:0/2468872342 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f89a01255e0 con 0x7f89a006eda0 2024-09-18T01:44:51.727 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:51.726+0000 7f89a6872640 1 -- 172.21.15.129:0/2468872342 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f89a01297a0 con 0x7f89a006eda0 2024-09-18T01:44:52.223 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:52.222+0000 7f899cff9640 1 -- 172.21.15.129:0/2468872342 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v13) ==== 109+0+0 (secure 0 0 0) 0x7f89900127f0 con 0x7f89a006eda0 2024-09-18T01:44:52.223 INFO:teuthology.orchestra.run.smithi129.stderr:pool 'rbd' created 2024-09-18T01:44:52.225 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:52.224+0000 7f89a6872640 1 -- 172.21.15.129:0/2468872342 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f898c0382a0 msgr2=0x7f898c03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:52.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:52.224+0000 7f89a6872640 1 --2- 172.21.15.129:0/2468872342 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f898c0382a0 0x7f898c03a760 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8994034000 tx=0x7f899402e000 comp rx=0 tx=0).stop 2024-09-18T01:44:52.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:52.224+0000 7f89a6872640 1 -- 172.21.15.129:0/2468872342 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f89a006eda0 msgr2=0x7f89a0122a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:52.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:52.224+0000 7f89a6872640 1 --2- 172.21.15.129:0/2468872342 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f89a006eda0 0x7f89a0122a60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f899000c380 tx=0x7f899000c840 comp rx=0 tx=0).stop 2024-09-18T01:44:52.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:52.224+0000 7f89a6872640 1 -- 172.21.15.129:0/2468872342 shutdown_connections 2024-09-18T01:44:52.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:52.224+0000 7f89a6872640 1 --2- 172.21.15.129:0/2468872342 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f898c0382a0 0x7f898c03a760 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:52.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:52.224+0000 7f89a6872640 1 --2- 172.21.15.129:0/2468872342 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f89a006eda0 0x7f89a0122a60 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:52.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:52.224+0000 7f89a6872640 1 -- 172.21.15.129:0/2468872342 >> 172.21.15.129:0/2468872342 conn(0x7f89a009a890 msgr2=0x7f89a0071300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:52.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:52.224+0000 7f89a6872640 1 -- 172.21.15.129:0/2468872342 shutdown_connections 2024-09-18T01:44:52.226 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:52.224+0000 7f89a6872640 1 -- 172.21.15.129:0/2468872342 wait complete. 2024-09-18T01:44:52.237 DEBUG:teuthology.orchestra.run.smithi129:> rbd --cluster ceph pool init rbd 2024-09-18T01:44:52.301 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:44:52.301 INFO:teuthology.orchestra.run.smithi129.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:44:52.302 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:52.301+0000 7fb72be10d80 1 Processor -- start 2024-09-18T01:44:52.302 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:52.301+0000 7fb72be10d80 1 -- start start 2024-09-18T01:44:52.303 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:52.301+0000 7fb72be10d80 1 --2- >> v2:172.21.15.129:3300/0 conn(0x557c4dbeeee0 0x557c4dc85670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:52.303 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:52.301+0000 7fb72be10d80 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x557c4da5b050 con 0x557c4dc7f620 2024-09-18T01:44:52.303 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:52.301+0000 7fb72be10d80 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x557c4da69930 con 0x557c4dbeeee0 2024-09-18T01:44:52.303 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:52.301+0000 7fb723fff640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x557c4dbeeee0 0x557c4dc85670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:52.303 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:52.301+0000 7fb729b35640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x557c4dc7f620 0x557c4dc7fa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:53910/0 (socket says 172.21.15.129:53910) 2024-09-18T01:44:52.303 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:52.301+0000 7fb729b35640 1 -- 172.21.15.129:0/3755695334 learned_addr learned my addr 172.21.15.129:0/3755695334 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-09-18T01:44:52.303 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:52.301+0000 7fb723fff640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x557c4dbeeee0 0x557c4dc85670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:49412/0 (socket says 172.21.15.129:49412) 2024-09-18T01:44:52.303 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:52.302+0000 7fb723fff640 1 -- 172.21.15.129:0/3755695334 >> v1:172.21.15.129:6789/0 conn(0x557c4dc7f620 legacy=0x557c4dc7fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:52.303 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:52.302+0000 7fb723fff640 1 -- 172.21.15.129:0/3755695334 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c4da44ce0 con 0x557c4dbeeee0 2024-09-18T01:44:52.303 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:52.302+0000 7fb729334640 1 -- 172.21.15.129:0/3755695334 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4242283016 0 0) 0x557c4da5b050 con 0x557c4dc7f620 2024-09-18T01:44:52.305 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:52.303+0000 7fb723fff640 1 --2- 172.21.15.129:0/3755695334 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557c4dbeeee0 0x557c4dc85670 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb71400a470 tx=0x7fb714045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c36921d2c8b5d747 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:52.305 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:52.304+0000 7fb729334640 1 -- 172.21.15.129:0/3755695334 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb714053570 con 0x557c4dbeeee0 2024-09-18T01:44:52.305 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:52.304+0000 7fb729334640 1 -- 172.21.15.129:0/3755695334 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb714058070 con 0x557c4dbeeee0 2024-09-18T01:44:52.306 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:52.304+0000 7fb729334640 1 -- 172.21.15.129:0/3755695334 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb714053880 con 0x557c4dbeeee0 2024-09-18T01:44:52.306 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:52.304+0000 7fb72be10d80 1 -- 172.21.15.129:0/3755695334 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557c4dbeeee0 msgr2=0x557c4dc85670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:52.306 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:52.304+0000 7fb72be10d80 1 --2- 172.21.15.129:0/3755695334 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557c4dbeeee0 0x557c4dc85670 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb71400a470 tx=0x7fb714045a20 comp rx=0 tx=0).stop 2024-09-18T01:44:52.306 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:52.304+0000 7fb72be10d80 1 -- 172.21.15.129:0/3755695334 shutdown_connections 2024-09-18T01:44:52.306 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:52.304+0000 7fb72be10d80 1 --2- 172.21.15.129:0/3755695334 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557c4dbeeee0 0x557c4dc85670 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:52.306 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:52.304+0000 7fb72be10d80 1 -- 172.21.15.129:0/3755695334 >> 172.21.15.129:0/3755695334 conn(0x557c4dbefce0 msgr2=0x557c4dbed520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:52.306 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:52.304+0000 7fb72be10d80 1 -- 172.21.15.129:0/3755695334 shutdown_connections 2024-09-18T01:44:52.306 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:52.304+0000 7fb72be10d80 1 -- 172.21.15.129:0/3755695334 wait complete. 2024-09-18T01:44:52.309 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:52.305+0000 7fb72be10d80 1 Processor -- start 2024-09-18T01:44:52.309 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:52.305+0000 7fb72be10d80 1 -- start start 2024-09-18T01:44:52.309 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:52.305+0000 7fb72be10d80 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557c4dbeeee0 0x557c4dc6e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:52.309 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:52.305+0000 7fb72be10d80 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x557c4da6b540 con 0x557c4dbeeee0 2024-09-18T01:44:52.309 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:52.305+0000 7fb729b35640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557c4dbeeee0 0x557c4dc6e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:52.309 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:52.305+0000 7fb729b35640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557c4dbeeee0 0x557c4dc6e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:49428/0 (socket says 172.21.15.129:49428) 2024-09-18T01:44:52.309 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:52.305+0000 7fb729b35640 1 -- 172.21.15.129:0/1913475888 learned_addr learned my addr 172.21.15.129:0/1913475888 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-18T01:44:52.309 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:52.306+0000 7fb729b35640 1 -- 172.21.15.129:0/1913475888 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c4dc70660 con 0x557c4dbeeee0 2024-09-18T01:44:52.309 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:52.306+0000 7fb729b35640 1 --2- 172.21.15.129:0/1913475888 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557c4dbeeee0 0x557c4dc6e930 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb71c00bc10 tx=0x7fb71c009640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:52.310 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:52.306+0000 7fb721ffb640 1 -- 172.21.15.129:0/1913475888 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb71c012070 con 0x557c4dbeeee0 2024-09-18T01:44:52.310 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:52.306+0000 7fb721ffb640 1 -- 172.21.15.129:0/1913475888 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb71c00e470 con 0x557c4dbeeee0 2024-09-18T01:44:52.310 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:52.306+0000 7fb72be10d80 1 -- 172.21.15.129:0/1913475888 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557c4dbecc50 con 0x557c4dbeeee0 2024-09-18T01:44:52.310 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:52.306+0000 7fb721ffb640 1 -- 172.21.15.129:0/1913475888 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb71c00e770 con 0x557c4dbeeee0 2024-09-18T01:44:52.310 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:52.306+0000 7fb72be10d80 1 -- 172.21.15.129:0/1913475888 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c4dc71500 con 0x557c4dbeeee0 2024-09-18T01:44:52.310 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:52.307+0000 7fb721ffb640 1 -- 172.21.15.129:0/1913475888 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb71c015070 con 0x557c4dbeeee0 2024-09-18T01:44:52.310 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:52.307+0000 7fb721ffb640 1 --2- 172.21.15.129:0/1913475888 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb70c036b90 0x7fb70c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:52.310 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:52.307+0000 7fb721ffb640 1 -- 172.21.15.129:0/1913475888 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 3471+0+0 (secure 0 0 0) 0x7fb71c049f90 con 0x557c4dbeeee0 2024-09-18T01:44:52.310 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:52.307+0000 7fb72be10d80 1 -- 172.21.15.129:0/1913475888 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x557c4dc6f1a0 con 0x557c4dbeeee0 2024-09-18T01:44:52.310 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:52.307+0000 7fb723fff640 1 --2- 172.21.15.129:0/1913475888 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb70c036b90 0x7fb70c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:52.310 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:52.308+0000 7fb723fff640 1 --2- 172.21.15.129:0/1913475888 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb70c036b90 0x7fb70c039050 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb714057000 tx=0x7fb714052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:53.229 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:53.228+0000 7fb721ffb640 1 -- 172.21.15.129:0/1913475888 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v14) ==== 141+0+0 (secure 0 0 0) 0x7fb71c00d3d0 con 0x557c4dbeeee0 2024-09-18T01:44:53.230 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:53.228+0000 7fb72be10d80 1 -- 172.21.15.129:0/1913475888 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb714058070 con 0x557c4dbeeee0 2024-09-18T01:44:53.231 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:53.230+0000 7fb721ffb640 1 -- 172.21.15.129:0/1913475888 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fb71c016770 con 0x557c4dbeeee0 2024-09-18T01:44:53.231 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:53.230+0000 7fb728b33640 1 -- 172.21.15.129:0/1913475888 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=14}) -- 0x7fb708002ae0 con 0x557c4dbeeee0 2024-09-18T01:44:53.231 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:53.230+0000 7fb721ffb640 1 -- 172.21.15.129:0/1913475888 <== mon.0 v2:172.21.15.129:3300/0 8 ==== osd_map(14..14 src has 1..14) ==== 650+0+0 (secure 0 0 0) 0x7fb71c037e00 con 0x557c4dbeeee0 2024-09-18T01:44:53.231 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:53.230+0000 7fb72be10d80 1 --2- 172.21.15.129:0/1913475888 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x557c4dc7f620 0x557c4dc93ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:53.231 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:53.230+0000 7fb72be10d80 1 -- 172.21.15.129:0/1913475888 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14) -- 0x557c4dc93ff0 con 0x557c4dc7f620 2024-09-18T01:44:53.232 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:53.230+0000 7fb72ad97640 1 --2- 172.21.15.129:0/1913475888 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x557c4dc7f620 0x557c4dc93ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:53.232 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:53.231+0000 7fb72ad97640 1 --2- 172.21.15.129:0/1913475888 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x557c4dc7f620 0x557c4dc93ab0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:53.241 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:53.240+0000 7fb72ad97640 1 -- 172.21.15.129:0/1913475888 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(1 rbd_trash [create] v14'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7fb724002040 con 0x557c4dc7f620 2024-09-18T01:44:53.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:53.243+0000 7fb72be10d80 1 -- 172.21.15.129:0/1913475888 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e14) -- 0x557c4dce58d0 con 0x557c4dc7f620 2024-09-18T01:44:53.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:53.243+0000 7fb72ad97640 1 -- 172.21.15.129:0/1913475888 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb724002040 con 0x557c4dc7f620 2024-09-18T01:44:53.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:53.243+0000 7fb72be10d80 1 -- 172.21.15.129:0/1913475888 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e14) -- 0x557c4dce49e0 con 0x557c4dc7f620 2024-09-18T01:44:53.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:53.243+0000 7fb72ad97640 1 -- 172.21.15.129:0/1913475888 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb724002040 con 0x557c4dc7f620 2024-09-18T01:44:53.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:53.244+0000 7fb7237fe640 1 -- 172.21.15.129:0/1913475888 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7fb700001f00 con 0x557c4dbeeee0 2024-09-18T01:44:54.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:54.233+0000 7fb721ffb640 1 -- 172.21.15.129:0/1913475888 <== mon.0 v2:172.21.15.129:3300/0 9 ==== pool_op_reply(tid 4 (0) Success v15) ==== 55+0+0 (secure 0 0 0) 0x7fb71c015c80 con 0x557c4dbeeee0 2024-09-18T01:44:54.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:54.233+0000 7fb721ffb640 1 -- 172.21.15.129:0/1913475888 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=15}) -- 0x7fb70c03c740 con 0x557c4dbeeee0 2024-09-18T01:44:54.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:54.233+0000 7fb721ffb640 1 -- 172.21.15.129:0/1913475888 <== mon.0 v2:172.21.15.129:3300/0 10 ==== osd_map(15..15 src has 1..15) ==== 626+0+0 (secure 0 0 0) 0x7fb71c027060 con 0x557c4dbeeee0 2024-09-18T01:44:54.234 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:54.233+0000 7fb728b33640 1 -- 172.21.15.129:0/1913475888 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15) -- 0x7fb7080056e0 con 0x557c4dc7f620 2024-09-18T01:44:54.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:54.237+0000 7fb72ad97640 1 -- 172.21.15.129:0/1913475888 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(5 rbd_info [create,write 0~8] v15'1 uv1 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb724002040 con 0x557c4dc7f620 2024-09-18T01:44:54.238 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:54.237+0000 7fb7237fe640 1 -- 172.21.15.129:0/1913475888 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- pool_op(delete unmanaged snap pool 2 tid 6 name v15) -- 0x7fb700003350 con 0x557c4dbeeee0 2024-09-18T01:44:55.235 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.233+0000 7fb721ffb640 1 -- 172.21.15.129:0/1913475888 <== mon.0 v2:172.21.15.129:3300/0 11 ==== pool_op_reply(tid 6 (0) Success v16) ==== 43+0+0 (secure 0 0 0) 0x7fb71c0156f0 con 0x557c4dbeeee0 2024-09-18T01:44:55.235 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.233+0000 7fb721ffb640 1 -- 172.21.15.129:0/1913475888 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=16}) -- 0x7fb70c03c9c0 con 0x557c4dbeeee0 2024-09-18T01:44:55.235 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.233+0000 7fb721ffb640 1 -- 172.21.15.129:0/1913475888 <== mon.0 v2:172.21.15.129:3300/0 12 ==== osd_map(16..16 src has 1..16) ==== 654+0+0 (secure 0 0 0) 0x7fb71c0158d0 con 0x557c4dbeeee0 2024-09-18T01:44:55.235 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.234+0000 7fb728b33640 1 -- 172.21.15.129:0/1913475888 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16) -- 0x7fb708005aa0 con 0x557c4dc7f620 2024-09-18T01:44:55.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.242+0000 7fb72ad97640 1 -- 172.21.15.129:0/1913475888 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(7 rbd_info [write 0~19] v16'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb724002040 con 0x557c4dc7f620 2024-09-18T01:44:55.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.242+0000 7fb72be10d80 1 -- 172.21.15.129:0/1913475888 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x557c4dc7f620 msgr2=0x557c4dc93ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:55.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.242+0000 7fb72be10d80 1 --2- 172.21.15.129:0/1913475888 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x557c4dc7f620 0x557c4dc93ab0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:55.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.242+0000 7fb72be10d80 1 -- 172.21.15.129:0/1913475888 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb70c036b90 msgr2=0x7fb70c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:55.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.242+0000 7fb72be10d80 1 --2- 172.21.15.129:0/1913475888 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb70c036b90 0x7fb70c039050 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb714057000 tx=0x7fb714052000 comp rx=0 tx=0).stop 2024-09-18T01:44:55.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.242+0000 7fb72be10d80 1 -- 172.21.15.129:0/1913475888 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557c4dbeeee0 msgr2=0x557c4dc6e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:55.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.242+0000 7fb72be10d80 1 --2- 172.21.15.129:0/1913475888 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557c4dbeeee0 0x557c4dc6e930 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb71c00bc10 tx=0x7fb71c009640 comp rx=0 tx=0).stop 2024-09-18T01:44:55.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.242+0000 7fb72be10d80 1 -- 172.21.15.129:0/1913475888 shutdown_connections 2024-09-18T01:44:55.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.242+0000 7fb72be10d80 1 --2- 172.21.15.129:0/1913475888 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x557c4dc7f620 0x557c4dc93ab0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:55.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.242+0000 7fb72be10d80 1 --2- 172.21.15.129:0/1913475888 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb70c036b90 0x7fb70c039050 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:55.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.242+0000 7fb72be10d80 1 --2- 172.21.15.129:0/1913475888 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557c4dbeeee0 0x557c4dc6e930 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:55.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.242+0000 7fb72be10d80 1 -- 172.21.15.129:0/1913475888 >> 172.21.15.129:0/1913475888 conn(0x557c4dbefce0 msgr2=0x557c4dbf0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:55.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.242+0000 7fb72be10d80 1 -- 172.21.15.129:0/1913475888 shutdown_connections 2024-09-18T01:44:55.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.242+0000 7fb72be10d80 1 -- 172.21.15.129:0/1913475888 wait complete. 2024-09-18T01:44:55.248 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-18T01:44:55.248 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-18T01:44:55.249 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-18T01:44:55.249 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-18T01:44:55.249 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-18T01:44:55.357 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.356+0000 7fd917d66640 1 Processor -- start 2024-09-18T01:44:55.357 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.356+0000 7fd917d66640 1 -- start start 2024-09-18T01:44:55.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.356+0000 7fd917d66640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fd910096230 0x7fd910133e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:55.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.356+0000 7fd917d66640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd91009e100 con 0x7fd910095740 2024-09-18T01:44:55.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.356+0000 7fd917d66640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x7fd91009a960 con 0x7fd910096230 2024-09-18T01:44:55.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.356+0000 7fd915301640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fd910096230 0x7fd910133e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:55.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.356+0000 7fd915b02640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fd910095740 0x7fd910095b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40462/0 (socket says 172.21.15.129:40462) 2024-09-18T01:44:55.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.356+0000 7fd915b02640 1 -- 172.21.15.129:0/3402346236 learned_addr learned my addr 172.21.15.129:0/3402346236 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-09-18T01:44:55.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.357+0000 7fd915301640 1 -- 172.21.15.129:0/3402346236 >> v1:172.21.15.129:6789/0 conn(0x7fd910095740 legacy=0x7fd910095b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:55.358 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.357+0000 7fd915301640 1 -- 172.21.15.129:0/3402346236 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd910097220 con 0x7fd910096230 2024-09-18T01:44:55.360 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.357+0000 7fd915301640 1 --2- 172.21.15.129:0/3402346236 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd910096230 0x7fd910133e20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd900009720 tx=0x7fd90002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df6c601b0a85501e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:55.360 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.358+0000 7fd914b00640 1 -- 172.21.15.129:0/3402346236 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd900037070 con 0x7fd910096230 2024-09-18T01:44:55.360 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.358+0000 7fd914b00640 1 -- 172.21.15.129:0/3402346236 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd90002ae20 con 0x7fd910096230 2024-09-18T01:44:55.360 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.358+0000 7fd914b00640 1 -- 172.21.15.129:0/3402346236 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd900032590 con 0x7fd910096230 2024-09-18T01:44:55.360 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.358+0000 7fd917d66640 1 -- 172.21.15.129:0/3402346236 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd910096230 msgr2=0x7fd910133e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:55.360 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.358+0000 7fd917d66640 1 --2- 172.21.15.129:0/3402346236 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd910096230 0x7fd910133e20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd900009720 tx=0x7fd90002a1a0 comp rx=0 tx=0).stop 2024-09-18T01:44:55.360 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.358+0000 7fd917d66640 1 -- 172.21.15.129:0/3402346236 shutdown_connections 2024-09-18T01:44:55.360 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.358+0000 7fd917d66640 1 --2- 172.21.15.129:0/3402346236 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd910096230 0x7fd910133e20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:55.360 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.358+0000 7fd917d66640 1 -- 172.21.15.129:0/3402346236 >> 172.21.15.129:0/3402346236 conn(0x7fd91009d860 msgr2=0x7fd910099d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:55.360 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.358+0000 7fd917d66640 1 -- 172.21.15.129:0/3402346236 shutdown_connections 2024-09-18T01:44:55.360 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.358+0000 7fd917d66640 1 -- 172.21.15.129:0/3402346236 wait complete. 2024-09-18T01:44:55.362 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.359+0000 7fd917d66640 1 Processor -- start 2024-09-18T01:44:55.363 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.359+0000 7fd917d66640 1 -- start start 2024-09-18T01:44:55.363 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.359+0000 7fd917d66640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd910095740 0x7fd91006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:55.363 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.359+0000 7fd917d66640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fd910096bd0 con 0x7fd910095740 2024-09-18T01:44:55.363 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.360+0000 7fd915b02640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd910095740 0x7fd91006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:55.363 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.360+0000 7fd915b02640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd910095740 0x7fd91006d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:47950/0 (socket says 172.21.15.129:47950) 2024-09-18T01:44:55.363 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.360+0000 7fd915b02640 1 -- 172.21.15.129:0/629994500 learned_addr learned my addr 172.21.15.129:0/629994500 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-18T01:44:55.363 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.360+0000 7fd915b02640 1 -- 172.21.15.129:0/629994500 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd910094010 con 0x7fd910095740 2024-09-18T01:44:55.363 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.360+0000 7fd915b02640 1 --2- 172.21.15.129:0/629994500 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd910095740 0x7fd91006d7b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd90c00c380 tx=0x7fd90c00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:55.363 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.360+0000 7fd9067fc640 1 -- 172.21.15.129:0/629994500 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd90c005c10 con 0x7fd910095740 2024-09-18T01:44:55.363 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.360+0000 7fd9067fc640 1 -- 172.21.15.129:0/629994500 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd90c005db0 con 0x7fd910095740 2024-09-18T01:44:55.363 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.360+0000 7fd9067fc640 1 -- 172.21.15.129:0/629994500 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd90c004930 con 0x7fd910095740 2024-09-18T01:44:55.363 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.360+0000 7fd917d66640 1 -- 172.21.15.129:0/629994500 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd910093830 con 0x7fd910095740 2024-09-18T01:44:55.363 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.360+0000 7fd917d66640 1 -- 172.21.15.129:0/629994500 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd91006f4e0 con 0x7fd910095740 2024-09-18T01:44:55.364 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.361+0000 7fd9067fc640 1 -- 172.21.15.129:0/629994500 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd90c01a020 con 0x7fd910095740 2024-09-18T01:44:55.364 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.361+0000 7fd917d66640 1 -- 172.21.15.129:0/629994500 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd91012e660 con 0x7fd910095740 2024-09-18T01:44:55.364 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.361+0000 7fd9067fc640 1 --2- 172.21.15.129:0/629994500 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd8f40382a0 0x7fd8f403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:55.364 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.361+0000 7fd9067fc640 1 -- 172.21.15.129:0/629994500 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7fd90c04aa50 con 0x7fd910095740 2024-09-18T01:44:55.364 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.361+0000 7fd915301640 1 --2- 172.21.15.129:0/629994500 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd8f40382a0 0x7fd8f403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:55.364 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.362+0000 7fd915301640 1 --2- 172.21.15.129:0/629994500 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd8f40382a0 0x7fd8f403a760 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd900034000 tx=0x7fd90002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:55.367 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.366+0000 7fd9067fc640 1 -- 172.21.15.129:0/629994500 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd91012e660 con 0x7fd910095740 2024-09-18T01:44:55.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.577+0000 7fd917d66640 1 -- 172.21.15.129:0/629994500 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fd910095b20 con 0x7fd910095740 2024-09-18T01:44:55.580 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.579+0000 7fd9067fc640 1 -- 172.21.15.129:0/629994500 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+87485 (secure 0 0 0) 0x7fd90c0365d0 con 0x7fd910095740 2024-09-18T01:44:55.581 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:44:55.582 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.581+0000 7fd917d66640 1 -- 172.21.15.129:0/629994500 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd8f40382a0 msgr2=0x7fd8f403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:55.583 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.581+0000 7fd917d66640 1 --2- 172.21.15.129:0/629994500 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd8f40382a0 0x7fd8f403a760 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd900034000 tx=0x7fd90002e000 comp rx=0 tx=0).stop 2024-09-18T01:44:55.583 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.581+0000 7fd917d66640 1 -- 172.21.15.129:0/629994500 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd910095740 msgr2=0x7fd91006d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:55.583 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.581+0000 7fd917d66640 1 --2- 172.21.15.129:0/629994500 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd910095740 0x7fd91006d7b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd90c00c380 tx=0x7fd90c00c840 comp rx=0 tx=0).stop 2024-09-18T01:44:55.583 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.581+0000 7fd917d66640 1 -- 172.21.15.129:0/629994500 shutdown_connections 2024-09-18T01:44:55.583 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.581+0000 7fd917d66640 1 --2- 172.21.15.129:0/629994500 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd8f40382a0 0x7fd8f403a760 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:55.583 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.581+0000 7fd917d66640 1 --2- 172.21.15.129:0/629994500 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd910095740 0x7fd91006d7b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:55.583 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.581+0000 7fd917d66640 1 -- 172.21.15.129:0/629994500 >> 172.21.15.129:0/629994500 conn(0x7fd91009d860 msgr2=0x7fd910098430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:55.583 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.581+0000 7fd917d66640 1 -- 172.21.15.129:0/629994500 shutdown_connections 2024-09-18T01:44:55.583 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.581+0000 7fd917d66640 1 -- 172.21.15.129:0/629994500 wait complete. 2024-09-18T01:44:55.593 INFO:teuthology.orchestra.run.smithi129.stdout:{"epoch":5,"flags":0,"active_gid":4099,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":168968651},{"type":"v1","addr":"172.21.15.146:6825","nonce":168968651}]},"active_addr":"172.21.15.146:6825/168968651","active_change":"2024-09-18T01:44:40.175755+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.146:0","nonce":1957661297}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.146:0","nonce":4143277694}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.146:0","nonce":591802446}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.146:0","nonce":422333170}]}]} 2024-09-18T01:44:55.595 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-18T01:44:55.595 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-18T01:44:55.595 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-18T01:44:55.693 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.691+0000 7fc5a4c4c640 1 Processor -- start 2024-09-18T01:44:55.694 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.691+0000 7fc5a4c4c640 1 -- start start 2024-09-18T01:44:55.694 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.692+0000 7fc5a4c4c640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fc5a006eda0 0x7fc5a006f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:55.694 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.692+0000 7fc5a4c4c640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5a006eba0 con 0x7fc5a006f6c0 2024-09-18T01:44:55.694 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.692+0000 7fc5a4c4c640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x7fc5a006d2f0 con 0x7fc5a006eda0 2024-09-18T01:44:55.694 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.692+0000 7fc59e59c640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fc5a006eda0 0x7fc5a006f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:55.694 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.692+0000 7fc59dd9b640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fc5a006f6c0 0x7fc5a0121a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40478/0 (socket says 172.21.15.129:40478) 2024-09-18T01:44:55.694 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.692+0000 7fc59e59c640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fc5a006eda0 0x7fc5a006f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:47960/0 (socket says 172.21.15.129:47960) 2024-09-18T01:44:55.694 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.692+0000 7fc59dd9b640 1 -- 172.21.15.129:0/1228718116 learned_addr learned my addr 172.21.15.129:0/1228718116 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-09-18T01:44:55.694 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.692+0000 7fc59e59c640 1 -- 172.21.15.129:0/1228718116 >> v1:172.21.15.129:6789/0 conn(0x7fc5a006f6c0 legacy=0x7fc5a0121a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:55.694 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.692+0000 7fc59e59c640 1 -- 172.21.15.129:0/1228718116 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5a0070d50 con 0x7fc5a006eda0 2024-09-18T01:44:55.694 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.692+0000 7fc59d59a640 1 -- 172.21.15.129:0/1228718116 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3511115675 0 0) 0x7fc5a006eba0 con 0x7fc5a006f6c0 2024-09-18T01:44:55.695 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.693+0000 7fc59e59c640 1 --2- 172.21.15.129:0/1228718116 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5a006eda0 0x7fc5a006f180 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc598009d90 tx=0x7fc59802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e45654682e423a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:55.695 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.693+0000 7fc59d59a640 1 -- 172.21.15.129:0/1228718116 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc598007670 con 0x7fc5a006eda0 2024-09-18T01:44:55.695 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.693+0000 7fc59d59a640 1 -- 172.21.15.129:0/1228718116 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc598007810 con 0x7fc5a006eda0 2024-09-18T01:44:55.696 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.693+0000 7fc59d59a640 1 -- 172.21.15.129:0/1228718116 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc598007b10 con 0x7fc5a006eda0 2024-09-18T01:44:55.696 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.694+0000 7fc5a4c4c640 1 -- 172.21.15.129:0/1228718116 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5a006eda0 msgr2=0x7fc5a006f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:55.696 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.694+0000 7fc5a4c4c640 1 --2- 172.21.15.129:0/1228718116 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5a006eda0 0x7fc5a006f180 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc598009d90 tx=0x7fc59802a6f0 comp rx=0 tx=0).stop 2024-09-18T01:44:55.696 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.694+0000 7fc5a4c4c640 1 -- 172.21.15.129:0/1228718116 shutdown_connections 2024-09-18T01:44:55.696 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.694+0000 7fc5a4c4c640 1 --2- 172.21.15.129:0/1228718116 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5a006eda0 0x7fc5a006f180 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:55.696 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.694+0000 7fc5a4c4c640 1 -- 172.21.15.129:0/1228718116 >> 172.21.15.129:0/1228718116 conn(0x7fc5a009a890 msgr2=0x7fc5a009aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:55.696 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.694+0000 7fc5a4c4c640 1 -- 172.21.15.129:0/1228718116 shutdown_connections 2024-09-18T01:44:55.696 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.694+0000 7fc5a4c4c640 1 -- 172.21.15.129:0/1228718116 wait complete. 2024-09-18T01:44:55.698 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.695+0000 7fc5a4c4c640 1 Processor -- start 2024-09-18T01:44:55.698 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.695+0000 7fc5a4c4c640 1 -- start start 2024-09-18T01:44:55.698 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.695+0000 7fc5a4c4c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5a006eda0 0x7fc5a008afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:55.698 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.695+0000 7fc5a4c4c640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fc5a0122160 con 0x7fc5a006eda0 2024-09-18T01:44:55.698 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.695+0000 7fc59e59c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5a006eda0 0x7fc5a008afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:55.698 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.695+0000 7fc59e59c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5a006eda0 0x7fc5a008afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:47964/0 (socket says 172.21.15.129:47964) 2024-09-18T01:44:55.699 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.695+0000 7fc59e59c640 1 -- 172.21.15.129:0/844867911 learned_addr learned my addr 172.21.15.129:0/844867911 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-18T01:44:55.699 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.695+0000 7fc59e59c640 1 -- 172.21.15.129:0/844867911 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5a008c3f0 con 0x7fc5a006eda0 2024-09-18T01:44:55.699 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.696+0000 7fc59e59c640 1 --2- 172.21.15.129:0/844867911 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5a006eda0 0x7fc5a008afc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc598009d90 tx=0x7fc598004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:55.699 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.696+0000 7fc596ffd640 1 -- 172.21.15.129:0/844867911 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc598040070 con 0x7fc5a006eda0 2024-09-18T01:44:55.699 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.696+0000 7fc596ffd640 1 -- 172.21.15.129:0/844867911 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc598007af0 con 0x7fc5a006eda0 2024-09-18T01:44:55.699 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.696+0000 7fc5a4c4c640 1 -- 172.21.15.129:0/844867911 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5a008c870 con 0x7fc5a006eda0 2024-09-18T01:44:55.699 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.696+0000 7fc596ffd640 1 -- 172.21.15.129:0/844867911 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc598007e30 con 0x7fc5a006eda0 2024-09-18T01:44:55.699 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.696+0000 7fc5a4c4c640 1 -- 172.21.15.129:0/844867911 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5a008d500 con 0x7fc5a006eda0 2024-09-18T01:44:55.699 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.697+0000 7fc596ffd640 1 -- 172.21.15.129:0/844867911 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc598039040 con 0x7fc5a006eda0 2024-09-18T01:44:55.699 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.697+0000 7fc596ffd640 1 --2- 172.21.15.129:0/844867911 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc580038250 0x7fc58003a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:55.699 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.697+0000 7fc5a4c4c640 1 -- 172.21.15.129:0/844867911 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5a008d790 con 0x7fc5a006eda0 2024-09-18T01:44:55.699 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.697+0000 7fc596ffd640 1 -- 172.21.15.129:0/844867911 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7fc59806c5e0 con 0x7fc5a006eda0 2024-09-18T01:44:55.699 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.697+0000 7fc59dd9b640 1 --2- 172.21.15.129:0/844867911 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc580038250 0x7fc58003a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:55.700 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.698+0000 7fc59dd9b640 1 --2- 172.21.15.129:0/844867911 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc580038250 0x7fc58003a710 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc588000c00 tx=0x7fc588007910 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:55.702 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.702+0000 7fc596ffd640 1 -- 172.21.15.129:0/844867911 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc59803bc00 con 0x7fc5a006eda0 2024-09-18T01:44:55.867 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.866+0000 7fc5a4c4c640 1 -- 172.21.15.129:0/844867911 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc5a0122670 con 0x7fc5a006eda0 2024-09-18T01:44:55.868 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.867+0000 7fc596ffd640 1 -- 172.21.15.129:0/844867911 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+9923 (secure 0 0 0) 0x7fc59803c940 con 0x7fc5a006eda0 2024-09-18T01:44:55.868 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:44:55.868 INFO:teuthology.orchestra.run.smithi129.stdout:{"epoch":16,"fsid":"5634e4ff-a0cf-4689-882d-342647f6e34c","created":"2024-09-18T01:44:36.105421+0000","modified":"2024-09-18T01:44:55.232239+0000","last_up_change":"2024-09-18T01:44:47.044491+0000","last_in_change":"2024-09-18T01:44:37.219405+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-18T01:44:48.210295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-18T01:44:51.744833+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19ab8d59-755c-42b6-83df-b3c88496d6da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":1759265424},{"type":"v1","addr":"172.21.15.129:6801","nonce":1759265424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":1759265424},{"type":"v1","addr":"172.21.15.129:6803","nonce":1759265424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":1759265424},{"type":"v1","addr":"172.21.15.129:6807","nonce":1759265424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":1759265424},{"type":"v1","addr":"172.21.15.129:6805","nonce":1759265424}]},"public_addr":"172.21.15.129:6801/1759265424","cluster_addr":"172.21.15.129:6803/1759265424","heartbeat_back_addr":"172.21.15.129:6807/1759265424","heartbeat_front_addr":"172.21.15.129:6805/1759265424","state":["exists","up"]},{"osd":1,"uuid":"4d5949df-a041-424d-a475-2025e490700c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":3930274777},{"type":"v1","addr":"172.21.15.146:6810","nonce":3930274777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":3930274777},{"type":"v1","addr":"172.21.15.146:6814","nonce":3930274777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":3930274777},{"type":"v1","addr":"172.21.15.146:6822","nonce":3930274777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":3930274777},{"type":"v1","addr":"172.21.15.146:6818","nonce":3930274777}]},"public_addr":"172.21.15.146:6810/3930274777","cluster_addr":"172.21.15.146:6814/3930274777","heartbeat_back_addr":"172.21.15.146:6822/3930274777","heartbeat_front_addr":"172.21.15.146:6818/3930274777","state":["exists","up"]},{"osd":2,"uuid":"ff23f4ef-a771-4752-b233-87f7287b6c75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3820039304},{"type":"v1","addr":"172.21.15.146:6801","nonce":3820039304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3820039304},{"type":"v1","addr":"172.21.15.146:6803","nonce":3820039304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3820039304},{"type":"v1","addr":"172.21.15.146:6807","nonce":3820039304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3820039304},{"type":"v1","addr":"172.21.15.146:6805","nonce":3820039304}]},"public_addr":"172.21.15.146:6801/3820039304","cluster_addr":"172.21.15.146:6803/3820039304","heartbeat_back_addr":"172.21.15.146:6807/3820039304","heartbeat_front_addr":"172.21.15.146:6805/3820039304","state":["exists","up"]},{"osd":3,"uuid":"e84370c3-e85d-40c8-bea4-4a6e61cf53d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":4106661138},{"type":"v1","addr":"172.21.15.146:6811","nonce":4106661138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6813","nonce":4106661138},{"type":"v1","addr":"172.21.15.146:6815","nonce":4106661138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6821","nonce":4106661138},{"type":"v1","addr":"172.21.15.146:6823","nonce":4106661138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":4106661138},{"type":"v1","addr":"172.21.15.146:6819","nonce":4106661138}]},"public_addr":"172.21.15.146:6811/4106661138","cluster_addr":"172.21.15.146:6815/4106661138","heartbeat_back_addr":"172.21.15.146:6823/4106661138","heartbeat_front_addr":"172.21.15.146:6819/4106661138","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T01:44:44.239764+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T01:44:44.858663+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T01:44:44.354345+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T01:44:44.723166+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T01:44:55.870 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.869+0000 7fc5a4c4c640 1 -- 172.21.15.129:0/844867911 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc580038250 msgr2=0x7fc58003a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:55.870 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.869+0000 7fc5a4c4c640 1 --2- 172.21.15.129:0/844867911 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc580038250 0x7fc58003a710 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc588000c00 tx=0x7fc588007910 comp rx=0 tx=0).stop 2024-09-18T01:44:55.870 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.869+0000 7fc5a4c4c640 1 -- 172.21.15.129:0/844867911 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5a006eda0 msgr2=0x7fc5a008afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:55.870 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.869+0000 7fc5a4c4c640 1 --2- 172.21.15.129:0/844867911 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5a006eda0 0x7fc5a008afc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc598009d90 tx=0x7fc598004a40 comp rx=0 tx=0).stop 2024-09-18T01:44:55.870 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.869+0000 7fc5a4c4c640 1 -- 172.21.15.129:0/844867911 shutdown_connections 2024-09-18T01:44:55.870 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.869+0000 7fc5a4c4c640 1 --2- 172.21.15.129:0/844867911 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc580038250 0x7fc58003a710 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:55.870 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.869+0000 7fc5a4c4c640 1 --2- 172.21.15.129:0/844867911 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5a006eda0 0x7fc5a008afc0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:55.871 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.869+0000 7fc5a4c4c640 1 -- 172.21.15.129:0/844867911 >> 172.21.15.129:0/844867911 conn(0x7fc5a009a890 msgr2=0x7fc5a0098040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:55.871 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.869+0000 7fc5a4c4c640 1 -- 172.21.15.129:0/844867911 shutdown_connections 2024-09-18T01:44:55.871 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.869+0000 7fc5a4c4c640 1 -- 172.21.15.129:0/844867911 wait complete. 2024-09-18T01:44:55.881 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-18T01:44:55.881 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-18T01:44:55.978 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.976+0000 7f045d447640 1 Processor -- start 2024-09-18T01:44:55.978 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.976+0000 7f045d447640 1 -- start start 2024-09-18T01:44:55.978 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.977+0000 7f045d447640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f045809a100 0x7f0458133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:55.978 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.977+0000 7f045d447640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f045809d3b0 con 0x7f045809bd50 2024-09-18T01:44:55.978 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.977+0000 7f045d447640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x7f045809c840 con 0x7f045809a100 2024-09-18T01:44:55.978 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.977+0000 7f04567fc640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f045809a100 0x7f0458133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:55.978 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.977+0000 7f0456ffd640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f045809bd50 0x7f045809c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40484/0 (socket says 172.21.15.129:40484) 2024-09-18T01:44:55.979 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.977+0000 7f0456ffd640 1 -- 172.21.15.129:0/661512401 learned_addr learned my addr 172.21.15.129:0/661512401 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-09-18T01:44:55.979 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.977+0000 7f04567fc640 1 -- 172.21.15.129:0/661512401 >> v1:172.21.15.129:6789/0 conn(0x7f045809bd50 legacy=0x7f045809c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:55.979 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.977+0000 7f04567fc640 1 -- 172.21.15.129:0/661512401 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0458098230 con 0x7f045809a100 2024-09-18T01:44:55.980 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.977+0000 7f0455ffb640 1 -- 172.21.15.129:0/661512401 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3680468736 0 0) 0x7f0440001110 con 0x7f045809bd50 2024-09-18T01:44:55.980 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.978+0000 7f04567fc640 1 --2- 172.21.15.129:0/661512401 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f045809a100 0x7f0458133da0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0448009720 tx=0x7f044802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6fd6c8e53d1b9b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:55.980 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.978+0000 7f0455ffb640 1 -- 172.21.15.129:0/661512401 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0448037070 con 0x7f045809a100 2024-09-18T01:44:55.980 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.978+0000 7f0455ffb640 1 -- 172.21.15.129:0/661512401 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f044802ad90 con 0x7f045809a100 2024-09-18T01:44:55.980 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.978+0000 7f0455ffb640 1 -- 172.21.15.129:0/661512401 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0448032590 con 0x7f045809a100 2024-09-18T01:44:55.981 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.979+0000 7f045d447640 1 -- 172.21.15.129:0/661512401 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f045809a100 msgr2=0x7f0458133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:55.981 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.979+0000 7f045d447640 1 --2- 172.21.15.129:0/661512401 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f045809a100 0x7f0458133da0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0448009720 tx=0x7f044802a110 comp rx=0 tx=0).stop 2024-09-18T01:44:55.981 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.979+0000 7f045d447640 1 -- 172.21.15.129:0/661512401 shutdown_connections 2024-09-18T01:44:55.981 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.979+0000 7f045d447640 1 --2- 172.21.15.129:0/661512401 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f045809a100 0x7f0458133da0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:55.981 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.979+0000 7f045d447640 1 -- 172.21.15.129:0/661512401 >> 172.21.15.129:0/661512401 conn(0x7f045806d4a0 msgr2=0x7f045806d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:55.981 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.979+0000 7f045d447640 1 -- 172.21.15.129:0/661512401 shutdown_connections 2024-09-18T01:44:55.981 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.979+0000 7f045d447640 1 -- 172.21.15.129:0/661512401 wait complete. 2024-09-18T01:44:55.981 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.980+0000 7f045d447640 1 Processor -- start 2024-09-18T01:44:55.981 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.980+0000 7f045d447640 1 -- start start 2024-09-18T01:44:55.983 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.980+0000 7f045d447640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f045809a100 0x7f0458132a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:55.983 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.980+0000 7f045d447640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f0458134670 con 0x7f045809a100 2024-09-18T01:44:55.983 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.980+0000 7f0456ffd640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f045809a100 0x7f0458132a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:55.984 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.980+0000 7f0456ffd640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f045809a100 0x7f0458132a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:47974/0 (socket says 172.21.15.129:47974) 2024-09-18T01:44:55.984 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.980+0000 7f0456ffd640 1 -- 172.21.15.129:0/2443857229 learned_addr learned my addr 172.21.15.129:0/2443857229 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-18T01:44:55.984 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.981+0000 7f0456ffd640 1 -- 172.21.15.129:0/2443857229 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0458125fc0 con 0x7f045809a100 2024-09-18T01:44:55.984 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.981+0000 7f0456ffd640 1 --2- 172.21.15.129:0/2443857229 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f045809a100 0x7f0458132a40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f044000c700 tx=0x7f044000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:55.984 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.981+0000 7f044f7fe640 1 -- 172.21.15.129:0/2443857229 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0440018070 con 0x7f045809a100 2024-09-18T01:44:55.984 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.981+0000 7f044f7fe640 1 -- 172.21.15.129:0/2443857229 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04400070d0 con 0x7f045809a100 2024-09-18T01:44:55.984 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.981+0000 7f045d447640 1 -- 172.21.15.129:0/2443857229 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0458096570 con 0x7f045809a100 2024-09-18T01:44:55.984 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.981+0000 7f044f7fe640 1 -- 172.21.15.129:0/2443857229 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04400073f0 con 0x7f045809a100 2024-09-18T01:44:55.984 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.981+0000 7f045d447640 1 -- 172.21.15.129:0/2443857229 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0458096f80 con 0x7f045809a100 2024-09-18T01:44:55.984 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.982+0000 7f044f7fe640 1 -- 172.21.15.129:0/2443857229 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f044001b070 con 0x7f045809a100 2024-09-18T01:44:55.984 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.982+0000 7f044f7fe640 1 --2- 172.21.15.129:0/2443857229 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f04380382a0 0x7f043803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:55.984 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.982+0000 7f044f7fe640 1 -- 172.21.15.129:0/2443857229 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f044004a600 con 0x7f045809a100 2024-09-18T01:44:55.984 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.982+0000 7f045d447640 1 -- 172.21.15.129:0/2443857229 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0458126360 con 0x7f045809a100 2024-09-18T01:44:55.985 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.982+0000 7f04567fc640 1 --2- 172.21.15.129:0/2443857229 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f04380382a0 0x7f043803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:55.985 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.983+0000 7f04567fc640 1 --2- 172.21.15.129:0/2443857229 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f04380382a0 0x7f043803a760 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0448034000 tx=0x7f044802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:55.987 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:55.987+0000 7f044f7fe640 1 -- 172.21.15.129:0/2443857229 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0458125fc0 con 0x7f045809a100 2024-09-18T01:44:56.154 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.153+0000 7f045d447640 1 -- 172.21.15.129:0/2443857229 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f045809d020 con 0x7f045809a100 2024-09-18T01:44:56.154 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.153+0000 7f044f7fe640 1 -- 172.21.15.129:0/2443857229 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+9923 (secure 0 0 0) 0x7f045809d3b0 con 0x7f045809a100 2024-09-18T01:44:56.155 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:44:56.155 INFO:teuthology.orchestra.run.smithi129.stdout:{"epoch":16,"fsid":"5634e4ff-a0cf-4689-882d-342647f6e34c","created":"2024-09-18T01:44:36.105421+0000","modified":"2024-09-18T01:44:55.232239+0000","last_up_change":"2024-09-18T01:44:47.044491+0000","last_in_change":"2024-09-18T01:44:37.219405+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-18T01:44:48.210295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-18T01:44:51.744833+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19ab8d59-755c-42b6-83df-b3c88496d6da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":1759265424},{"type":"v1","addr":"172.21.15.129:6801","nonce":1759265424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":1759265424},{"type":"v1","addr":"172.21.15.129:6803","nonce":1759265424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":1759265424},{"type":"v1","addr":"172.21.15.129:6807","nonce":1759265424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":1759265424},{"type":"v1","addr":"172.21.15.129:6805","nonce":1759265424}]},"public_addr":"172.21.15.129:6801/1759265424","cluster_addr":"172.21.15.129:6803/1759265424","heartbeat_back_addr":"172.21.15.129:6807/1759265424","heartbeat_front_addr":"172.21.15.129:6805/1759265424","state":["exists","up"]},{"osd":1,"uuid":"4d5949df-a041-424d-a475-2025e490700c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":3930274777},{"type":"v1","addr":"172.21.15.146:6810","nonce":3930274777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":3930274777},{"type":"v1","addr":"172.21.15.146:6814","nonce":3930274777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":3930274777},{"type":"v1","addr":"172.21.15.146:6822","nonce":3930274777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":3930274777},{"type":"v1","addr":"172.21.15.146:6818","nonce":3930274777}]},"public_addr":"172.21.15.146:6810/3930274777","cluster_addr":"172.21.15.146:6814/3930274777","heartbeat_back_addr":"172.21.15.146:6822/3930274777","heartbeat_front_addr":"172.21.15.146:6818/3930274777","state":["exists","up"]},{"osd":2,"uuid":"ff23f4ef-a771-4752-b233-87f7287b6c75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3820039304},{"type":"v1","addr":"172.21.15.146:6801","nonce":3820039304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3820039304},{"type":"v1","addr":"172.21.15.146:6803","nonce":3820039304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3820039304},{"type":"v1","addr":"172.21.15.146:6807","nonce":3820039304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3820039304},{"type":"v1","addr":"172.21.15.146:6805","nonce":3820039304}]},"public_addr":"172.21.15.146:6801/3820039304","cluster_addr":"172.21.15.146:6803/3820039304","heartbeat_back_addr":"172.21.15.146:6807/3820039304","heartbeat_front_addr":"172.21.15.146:6805/3820039304","state":["exists","up"]},{"osd":3,"uuid":"e84370c3-e85d-40c8-bea4-4a6e61cf53d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":4106661138},{"type":"v1","addr":"172.21.15.146:6811","nonce":4106661138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6813","nonce":4106661138},{"type":"v1","addr":"172.21.15.146:6815","nonce":4106661138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6821","nonce":4106661138},{"type":"v1","addr":"172.21.15.146:6823","nonce":4106661138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":4106661138},{"type":"v1","addr":"172.21.15.146:6819","nonce":4106661138}]},"public_addr":"172.21.15.146:6811/4106661138","cluster_addr":"172.21.15.146:6815/4106661138","heartbeat_back_addr":"172.21.15.146:6823/4106661138","heartbeat_front_addr":"172.21.15.146:6819/4106661138","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T01:44:44.239764+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T01:44:44.858663+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T01:44:44.354345+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T01:44:44.723166+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T01:44:56.157 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.155+0000 7f045d447640 1 -- 172.21.15.129:0/2443857229 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f04380382a0 msgr2=0x7f043803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:56.157 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.155+0000 7f045d447640 1 --2- 172.21.15.129:0/2443857229 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f04380382a0 0x7f043803a760 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0448034000 tx=0x7f044802e000 comp rx=0 tx=0).stop 2024-09-18T01:44:56.157 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.155+0000 7f045d447640 1 -- 172.21.15.129:0/2443857229 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f045809a100 msgr2=0x7f0458132a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:56.157 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.155+0000 7f045d447640 1 --2- 172.21.15.129:0/2443857229 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f045809a100 0x7f0458132a40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f044000c700 tx=0x7f044000cbc0 comp rx=0 tx=0).stop 2024-09-18T01:44:56.157 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.155+0000 7f045d447640 1 -- 172.21.15.129:0/2443857229 shutdown_connections 2024-09-18T01:44:56.157 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.155+0000 7f045d447640 1 --2- 172.21.15.129:0/2443857229 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f04380382a0 0x7f043803a760 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:56.157 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.155+0000 7f045d447640 1 --2- 172.21.15.129:0/2443857229 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f045809a100 0x7f0458132a40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:56.157 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.155+0000 7f045d447640 1 -- 172.21.15.129:0/2443857229 >> 172.21.15.129:0/2443857229 conn(0x7f045806d4a0 msgr2=0x7f045808d790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:56.157 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.156+0000 7f045d447640 1 -- 172.21.15.129:0/2443857229 shutdown_connections 2024-09-18T01:44:56.158 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.156+0000 7f045d447640 1 -- 172.21.15.129:0/2443857229 wait complete. 2024-09-18T01:44:56.168 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-18T01:44:56.168 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-18T01:44:56.169 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-18T01:44:56.169 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-18T01:44:56.273 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.272+0000 7f0f1e368640 1 Processor -- start 2024-09-18T01:44:56.273 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.272+0000 7fddd4a77640 1 Processor -- start 2024-09-18T01:44:56.274 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.272+0000 7fddd4a77640 1 -- start start 2024-09-18T01:44:56.274 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.272+0000 7f0f1e368640 1 -- start start 2024-09-18T01:44:56.274 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.272+0000 7f0efff31640 1 Processor -- start 2024-09-18T01:44:56.274 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.272+0000 7ffaded91640 1 Processor -- start 2024-09-18T01:44:56.274 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.272+0000 7ffaded91640 1 -- start start 2024-09-18T01:44:56.275 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.272+0000 7f0efff31640 1 -- start start 2024-09-18T01:44:56.275 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.272+0000 7f0f1e368640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f0f1809bd50 0x7f0f1809c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:56.275 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.272+0000 7fddd4a77640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fddd0095110 0x7fddd0095520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:56.276 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.272+0000 7f0f1e368640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f1809d3b0 con 0x7f0f1809c670 2024-09-18T01:44:56.276 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.272+0000 7fddd4a77640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddd0095a60 con 0x7fddd0074c70 2024-09-18T01:44:56.276 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.272+0000 7fddd4a77640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x7fddd00972d0 con 0x7fddd0095110 2024-09-18T01:44:56.276 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.272+0000 7f0f1e368640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x7f0f18098230 con 0x7f0f1809bd50 2024-09-18T01:44:56.276 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.272+0000 7ffaded91640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7ffad8097330 0x7ffad8130a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:56.277 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.273+0000 7fddcdd9b640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fddd0095110 0x7fddd0095520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:56.277 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.273+0000 7ffad7fff640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7ffad8097330 0x7ffad8130a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:56.277 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.273+0000 7ffadcb2d640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7ffad8096840 0x7ffad8096c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40518/0 (socket says 172.21.15.129:40518) 2024-09-18T01:44:56.277 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.273+0000 7ffadcb2d640 1 -- 172.21.15.129:0/3058687501 learned_addr learned my addr 172.21.15.129:0/3058687501 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-09-18T01:44:56.277 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.273+0000 7fddce59c640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fddd0074c70 0x7fddd0094a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40498/0 (socket says 172.21.15.129:40498) 2024-09-18T01:44:56.277 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.273+0000 7fddce59c640 1 -- 172.21.15.129:0/1974762319 learned_addr learned my addr 172.21.15.129:0/1974762319 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-09-18T01:44:56.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.273+0000 7ffaded91640 1 -- 172.21.15.129:0/3058687501 --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffad809aaa0 con 0x7ffad8096840 2024-09-18T01:44:56.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.273+0000 7ffaded91640 1 -- 172.21.15.129:0/3058687501 --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x7ffad809e080 con 0x7ffad8097330 2024-09-18T01:44:56.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.273+0000 7f0efff31640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f0ef812fa00 0x7f0ef8131df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:56.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.273+0000 7f0efff31640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ef8070ac0 con 0x7f0ef8070ef0 2024-09-18T01:44:56.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.273+0000 7f0efff31640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x7f0ef8073490 con 0x7f0ef812fa00 2024-09-18T01:44:56.279 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.273+0000 7f0f17fff640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f0f1809bd50 0x7f0f1809c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:56.279 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.273+0000 7f0efdccd640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f0ef8070ef0 0x7f0ef80712d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40522/0 (socket says 172.21.15.129:40522) 2024-09-18T01:44:56.279 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.273+0000 7f0efdccd640 1 -- 172.21.15.129:0/101446183 learned_addr learned my addr 172.21.15.129:0/101446183 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-09-18T01:44:56.279 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.273+0000 7f0f17fff640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f0f1809bd50 0x7f0f1809c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:47982/0 (socket says 172.21.15.129:47982) 2024-09-18T01:44:56.279 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.273+0000 7f0f17fff640 1 -- 172.21.15.129:0/915097852 learned_addr learned my addr 172.21.15.129:0/915097852 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-18T01:44:56.280 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.273+0000 7f0f17fff640 1 -- 172.21.15.129:0/915097852 >> v1:172.21.15.129:6789/0 conn(0x7f0f1809c670 legacy=0x7f0f180990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-18T01:44:56.280 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.273+0000 7f0f17fff640 1 -- 172.21.15.129:0/915097852 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f180983e0 con 0x7f0f1809bd50 2024-09-18T01:44:56.280 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.273+0000 7f0efd4cc640 1 --2- 172.21.15.129:0/101446183 >> v2:172.21.15.129:3300/0 conn(0x7f0ef812fa00 0x7f0ef8131df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:56.280 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.273+0000 7fddcdd9b640 1 -- 172.21.15.129:0/1974762319 >> v1:172.21.15.129:6789/0 conn(0x7fddd0074c70 legacy=0x7fddd0094a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:56.280 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.273+0000 7fddcdd9b640 1 -- 172.21.15.129:0/1974762319 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddd0075050 con 0x7fddd0095110 2024-09-18T01:44:56.280 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.273+0000 7ffad7fff640 1 -- 172.21.15.129:0/3058687501 >> v1:172.21.15.129:6789/0 conn(0x7ffad8096840 legacy=0x7ffad8096c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:56.281 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.273+0000 7ffad7fff640 1 -- 172.21.15.129:0/3058687501 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffad8074ee0 con 0x7ffad8097330 2024-09-18T01:44:56.281 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.274+0000 7f0f17fff640 1 --2- 172.21.15.129:0/915097852 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0f1809bd50 0x7f0f1809c130 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0f080097f0 tx=0x7f0f0802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=819c2c44e1ce29ca server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:56.281 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.274+0000 7f0efd4cc640 1 -- 172.21.15.129:0/101446183 >> v1:172.21.15.129:6789/0 conn(0x7f0ef8070ef0 legacy=0x7f0ef80712d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:56.281 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.274+0000 7f0efd4cc640 1 -- 172.21.15.129:0/101446183 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ef806be10 con 0x7f0ef812fa00 2024-09-18T01:44:56.282 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.274+0000 7f0f16ffd640 1 -- 172.21.15.129:0/915097852 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f08037070 con 0x7f0f1809bd50 2024-09-18T01:44:56.282 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.274+0000 7f0f16ffd640 1 -- 172.21.15.129:0/915097852 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f0802ade0 con 0x7f0f1809bd50 2024-09-18T01:44:56.282 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.274+0000 7f0f16ffd640 1 -- 172.21.15.129:0/915097852 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f08032590 con 0x7f0f1809bd50 2024-09-18T01:44:56.282 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.274+0000 7ffad7fff640 1 --2- 172.21.15.129:0/3058687501 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ffad8097330 0x7ffad8130a10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ffac4009720 tx=0x7ffac402c220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c05119cf17c35d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:56.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.274+0000 7fddcdd9b640 1 --2- 172.21.15.129:0/1974762319 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fddd0095110 0x7fddd0095520 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fddc4009720 tx=0x7fddc402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be5a4cfdbb830bde server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:56.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.274+0000 7fddcd59a640 1 -- 172.21.15.129:0/1974762319 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddc4037070 con 0x7fddd0095110 2024-09-18T01:44:56.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.275+0000 7fddcd59a640 1 -- 172.21.15.129:0/1974762319 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddc402ad90 con 0x7fddd0095110 2024-09-18T01:44:56.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.275+0000 7fddcd59a640 1 -- 172.21.15.129:0/1974762319 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddc4032590 con 0x7fddd0095110 2024-09-18T01:44:56.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.275+0000 7ffad77fe640 1 -- 172.21.15.129:0/3058687501 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffac4039070 con 0x7ffad8097330 2024-09-18T01:44:56.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.275+0000 7ffad77fe640 1 -- 172.21.15.129:0/3058687501 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffac402cde0 con 0x7ffad8097330 2024-09-18T01:44:56.283 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.275+0000 7ffad77fe640 1 -- 172.21.15.129:0/3058687501 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffac4034590 con 0x7ffad8097330 2024-09-18T01:44:56.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.275+0000 7f0efd4cc640 1 --2- 172.21.15.129:0/101446183 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0ef812fa00 0x7f0ef8131df0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8009720 tx=0x7f0ee802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=903fa66d449283a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:56.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.275+0000 7f0f1e368640 1 -- 172.21.15.129:0/915097852 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0f1809bd50 msgr2=0x7f0f1809c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:56.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.275+0000 7f0efcccb640 1 -- 172.21.15.129:0/101446183 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ee8037070 con 0x7f0ef812fa00 2024-09-18T01:44:56.284 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.275+0000 7f0efcccb640 1 -- 172.21.15.129:0/101446183 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ee802ae20 con 0x7f0ef812fa00 2024-09-18T01:44:56.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.275+0000 7f0f1e368640 1 --2- 172.21.15.129:0/915097852 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0f1809bd50 0x7f0f1809c130 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0f080097f0 tx=0x7f0f0802a1a0 comp rx=0 tx=0).stop 2024-09-18T01:44:56.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.275+0000 7f0efcccb640 1 -- 172.21.15.129:0/101446183 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ee8032590 con 0x7f0ef812fa00 2024-09-18T01:44:56.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.275+0000 7f0f1e368640 1 -- 172.21.15.129:0/915097852 shutdown_connections 2024-09-18T01:44:56.285 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.275+0000 7f0f1e368640 1 --2- 172.21.15.129:0/915097852 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0f1809bd50 0x7f0f1809c130 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:56.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.275+0000 7f0f1e368640 1 -- 172.21.15.129:0/915097852 >> 172.21.15.129:0/915097852 conn(0x7f0f1806d4a0 msgr2=0x7f0f1806d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:56.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.275+0000 7f0f1e368640 1 -- 172.21.15.129:0/915097852 shutdown_connections 2024-09-18T01:44:56.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.275+0000 7f0f1e368640 1 -- 172.21.15.129:0/915097852 wait complete. 2024-09-18T01:44:56.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.275+0000 7fddd4a77640 1 -- 172.21.15.129:0/1974762319 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fddd0095110 msgr2=0x7fddd0095520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:56.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.275+0000 7fddd4a77640 1 --2- 172.21.15.129:0/1974762319 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fddd0095110 0x7fddd0095520 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fddc4009720 tx=0x7fddc402a110 comp rx=0 tx=0).stop 2024-09-18T01:44:56.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.275+0000 7ffaded91640 1 -- 172.21.15.129:0/3058687501 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ffad8097330 msgr2=0x7ffad8130a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:56.286 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.275+0000 7ffaded91640 1 --2- 172.21.15.129:0/3058687501 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ffad8097330 0x7ffad8130a10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ffac4009720 tx=0x7ffac402c220 comp rx=0 tx=0).stop 2024-09-18T01:44:56.287 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.275+0000 7fddd4a77640 1 -- 172.21.15.129:0/1974762319 shutdown_connections 2024-09-18T01:44:56.287 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.275+0000 7fddd4a77640 1 --2- 172.21.15.129:0/1974762319 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fddd0095110 0x7fddd0095520 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:56.287 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.275+0000 7fddd4a77640 1 -- 172.21.15.129:0/1974762319 >> 172.21.15.129:0/1974762319 conn(0x7fddd009d500 msgr2=0x7fddd009d910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:56.287 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.276+0000 7ffaded91640 1 -- 172.21.15.129:0/3058687501 shutdown_connections 2024-09-18T01:44:56.287 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.276+0000 7ffaded91640 1 --2- 172.21.15.129:0/3058687501 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ffad8097330 0x7ffad8130a10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:56.287 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.276+0000 7ffaded91640 1 -- 172.21.15.129:0/3058687501 >> 172.21.15.129:0/3058687501 conn(0x7ffad809d850 msgr2=0x7ffad8099d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:56.288 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.276+0000 7fddd4a77640 1 -- 172.21.15.129:0/1974762319 shutdown_connections 2024-09-18T01:44:56.288 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.276+0000 7fddd4a77640 1 -- 172.21.15.129:0/1974762319 wait complete. 2024-09-18T01:44:56.288 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.276+0000 7ffaded91640 1 -- 172.21.15.129:0/3058687501 shutdown_connections 2024-09-18T01:44:56.288 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.276+0000 7ffaded91640 1 -- 172.21.15.129:0/3058687501 wait complete. 2024-09-18T01:44:56.289 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.276+0000 7f0efff31640 1 -- 172.21.15.129:0/101446183 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0ef812fa00 msgr2=0x7f0ef8131df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:56.289 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.276+0000 7f0efff31640 1 --2- 172.21.15.129:0/101446183 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0ef812fa00 0x7f0ef8131df0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8009720 tx=0x7f0ee802a1a0 comp rx=0 tx=0).stop 2024-09-18T01:44:56.289 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.276+0000 7f0efff31640 1 -- 172.21.15.129:0/101446183 shutdown_connections 2024-09-18T01:44:56.289 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.276+0000 7f0efff31640 1 --2- 172.21.15.129:0/101446183 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0ef812fa00 0x7f0ef8131df0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:56.289 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.276+0000 7f0efff31640 1 -- 172.21.15.129:0/101446183 >> 172.21.15.129:0/101446183 conn(0x7f0ef809ac20 msgr2=0x7f0ef806d080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:56.289 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.276+0000 7f0f1e368640 1 Processor -- start 2024-09-18T01:44:56.290 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.276+0000 7f0efff31640 1 -- 172.21.15.129:0/101446183 shutdown_connections 2024-09-18T01:44:56.290 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.276+0000 7f0efff31640 1 -- 172.21.15.129:0/101446183 wait complete. 2024-09-18T01:44:56.290 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.276+0000 7f0f1e368640 1 -- start start 2024-09-18T01:44:56.290 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.277+0000 7f0f1e368640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0f1809bd50 0x7f0f181b4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:56.290 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.277+0000 7ffaded91640 1 Processor -- start 2024-09-18T01:44:56.291 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.277+0000 7f0f1e368640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f0f18099b90 con 0x7f0f1809bd50 2024-09-18T01:44:56.291 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.277+0000 7ffaded91640 1 -- start start 2024-09-18T01:44:56.291 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.277+0000 7f0f17fff640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0f1809bd50 0x7f0f181b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:56.292 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.277+0000 7f0f17fff640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0f1809bd50 0x7f0f181b4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:48010/0 (socket says 172.21.15.129:48010) 2024-09-18T01:44:56.292 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.277+0000 7f0f17fff640 1 -- 172.21.15.129:0/1025581590 learned_addr learned my addr 172.21.15.129:0/1025581590 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-18T01:44:56.292 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.277+0000 7fddd4a77640 1 Processor -- start 2024-09-18T01:44:56.292 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.277+0000 7fddd4a77640 1 -- start start 2024-09-18T01:44:56.292 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.277+0000 7f0f17fff640 1 -- 172.21.15.129:0/1025581590 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f181b1d50 con 0x7f0f1809bd50 2024-09-18T01:44:56.293 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.277+0000 7f0efff31640 1 Processor -- start 2024-09-18T01:44:56.293 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.277+0000 7ffaded91640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ffad8096840 0x7ffad81bebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:56.293 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.277+0000 7f0efff31640 1 -- start start 2024-09-18T01:44:56.293 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.277+0000 7f0f17fff640 1 --2- 172.21.15.129:0/1025581590 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0f1809bd50 0x7f0f181b4190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0f08035040 tx=0x7f0f08004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:56.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.277+0000 7ffaded91640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7ffad80751a0 con 0x7ffad8096840 2024-09-18T01:44:56.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.278+0000 7ffadcb2d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ffad8096840 0x7ffad81bebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:56.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.278+0000 7fddd4a77640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fddd0074c70 0x7fddd0131de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:56.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.278+0000 7ffadcb2d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ffad8096840 0x7ffad81bebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:48014/0 (socket says 172.21.15.129:48014) 2024-09-18T01:44:56.294 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.278+0000 7ffadcb2d640 1 -- 172.21.15.129:0/3001728512 learned_addr learned my addr 172.21.15.129:0/3001728512 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-18T01:44:56.295 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.278+0000 7fddd4a77640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fddd0094080 con 0x7fddd0074c70 2024-09-18T01:44:56.295 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.278+0000 7fddce59c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fddd0074c70 0x7fddd0131de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:56.295 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.278+0000 7fddce59c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fddd0074c70 0x7fddd0131de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:48026/0 (socket says 172.21.15.129:48026) 2024-09-18T01:44:56.296 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.278+0000 7fddce59c640 1 -- 172.21.15.129:0/3855582144 learned_addr learned my addr 172.21.15.129:0/3855582144 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-18T01:44:56.296 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.278+0000 7f0f14ff9640 1 -- 172.21.15.129:0/1025581590 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f08041070 con 0x7f0f1809bd50 2024-09-18T01:44:56.296 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.278+0000 7f0f1e368640 1 -- 172.21.15.129:0/1025581590 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f181b38a0 con 0x7f0f1809bd50 2024-09-18T01:44:56.296 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.278+0000 7f0f14ff9640 1 -- 172.21.15.129:0/1025581590 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f0803c670 con 0x7f0f1809bd50 2024-09-18T01:44:56.296 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.278+0000 7f0efff31640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0ef8070ef0 0x7f0ef812a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:56.297 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.278+0000 7f0f14ff9640 1 -- 172.21.15.129:0/1025581590 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f08041070 con 0x7f0f1809bd50 2024-09-18T01:44:56.297 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.278+0000 7ffadcb2d640 1 -- 172.21.15.129:0/3001728512 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffad8070470 con 0x7ffad8096840 2024-09-18T01:44:56.297 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.278+0000 7ffadcb2d640 1 --2- 172.21.15.129:0/3001728512 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ffad8096840 0x7ffad81bebc0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ffacc00c700 tx=0x7ffacc00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:56.301 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.278+0000 7f0f1e368640 1 -- 172.21.15.129:0/1025581590 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f181b2bc0 con 0x7f0f1809bd50 2024-09-18T01:44:56.301 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.278+0000 7fddce59c640 1 -- 172.21.15.129:0/3855582144 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddd0070500 con 0x7fddd0074c70 2024-09-18T01:44:56.301 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.278+0000 7f0efdccd640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0ef8070ef0 0x7f0ef812a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:56.302 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.278+0000 7f0efdccd640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0ef8070ef0 0x7f0ef812a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:48038/0 (socket says 172.21.15.129:48038) 2024-09-18T01:44:56.302 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.278+0000 7f0efdccd640 1 -- 172.21.15.129:0/504912242 learned_addr learned my addr 172.21.15.129:0/504912242 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-18T01:44:56.302 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.278+0000 7f0efff31640 1 -- 172.21.15.129:0/504912242 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef806c430 con 0x7f0ef8070ef0 2024-09-18T01:44:56.302 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.278+0000 7fddce59c640 1 --2- 172.21.15.129:0/3855582144 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fddd0074c70 0x7fddd0131de0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fddc000c4a0 tx=0x7fddc000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:56.302 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.278+0000 7ffad57fa640 1 -- 172.21.15.129:0/3001728512 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffacc018070 con 0x7ffad8096840 2024-09-18T01:44:56.302 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.279+0000 7ffad57fa640 1 -- 172.21.15.129:0/3001728512 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffacc007200 con 0x7ffad8096840 2024-09-18T01:44:56.303 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.279+0000 7fddbeffd640 1 -- 172.21.15.129:0/3855582144 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddc0017070 con 0x7fddd0074c70 2024-09-18T01:44:56.303 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.279+0000 7fddbeffd640 1 -- 172.21.15.129:0/3855582144 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddc0005c10 con 0x7fddd0074c70 2024-09-18T01:44:56.303 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.279+0000 7ffad57fa640 1 -- 172.21.15.129:0/3001728512 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffacc007500 con 0x7ffad8096840 2024-09-18T01:44:56.303 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.279+0000 7ffaded91640 1 -- 172.21.15.129:0/3001728512 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffad8070750 con 0x7ffad8096840 2024-09-18T01:44:56.304 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.279+0000 7fddd4a77640 1 -- 172.21.15.129:0/3855582144 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddd0097480 con 0x7fddd0074c70 2024-09-18T01:44:56.304 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.279+0000 7fddbeffd640 1 -- 172.21.15.129:0/3855582144 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddc0007070 con 0x7fddd0074c70 2024-09-18T01:44:56.304 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.279+0000 7ffaded91640 1 -- 172.21.15.129:0/3001728512 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffad806fbf0 con 0x7ffad8096840 2024-09-18T01:44:56.304 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.279+0000 7fddd4a77640 1 -- 172.21.15.129:0/3855582144 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddd0072020 con 0x7fddd0074c70 2024-09-18T01:44:56.305 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.279+0000 7f0efdccd640 1 -- 172.21.15.129:0/504912242 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ef812c2b0 con 0x7f0ef8070ef0 2024-09-18T01:44:56.305 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.279+0000 7f0efdccd640 1 --2- 172.21.15.129:0/504912242 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0ef8070ef0 0x7f0ef812a4f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0ef400c4a0 tx=0x7f0ef400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:56.305 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.279+0000 7f0f14ff9640 1 -- 172.21.15.129:0/1025581590 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0f08044070 con 0x7f0f1809bd50 2024-09-18T01:44:56.305 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.280+0000 7f0f14ff9640 1 --2- 172.21.15.129:0/1025581590 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0f04038460 0x7f0f0403a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:56.306 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.280+0000 7f0eee7fc640 1 -- 172.21.15.129:0/504912242 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ef4017070 con 0x7f0ef8070ef0 2024-09-18T01:44:56.306 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.280+0000 7f0efff31640 1 -- 172.21.15.129:0/504912242 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ef812ca90 con 0x7f0ef8070ef0 2024-09-18T01:44:56.306 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.280+0000 7f0efff31640 1 -- 172.21.15.129:0/504912242 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ef8129660 con 0x7f0ef8070ef0 2024-09-18T01:44:56.306 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.280+0000 7f0eee7fc640 1 -- 172.21.15.129:0/504912242 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ef4005c10 con 0x7f0ef8070ef0 2024-09-18T01:44:56.306 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.280+0000 7f0f14ff9640 1 -- 172.21.15.129:0/1025581590 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f0f080453b0 con 0x7f0f1809bd50 2024-09-18T01:44:56.307 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.280+0000 7ffad57fa640 1 -- 172.21.15.129:0/3001728512 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ffacc01b070 con 0x7ffad8096840 2024-09-18T01:44:56.307 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.280+0000 7f0eee7fc640 1 -- 172.21.15.129:0/504912242 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ef4017070 con 0x7f0ef8070ef0 2024-09-18T01:44:56.307 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.280+0000 7f0f1e368640 1 --2- 172.21.15.129:0/1025581590 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f0f1809c670 0x7f0f181afe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:56.307 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.280+0000 7f0f1e368640 1 -- 172.21.15.129:0/1025581590 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0f1809a760 con 0x7f0f1809c670 2024-09-18T01:44:56.307 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.280+0000 7f0f177fe640 1 --2- 172.21.15.129:0/1025581590 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0f04038460 0x7f0f0403a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:56.307 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.280+0000 7ffaded91640 1 -- 172.21.15.129:0/3001728512 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ffad8096c20 con 0x7ffad8096840 2024-09-18T01:44:56.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.280+0000 7fddbeffd640 1 -- 172.21.15.129:0/3855582144 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fddc001a070 con 0x7fddd0074c70 2024-09-18T01:44:56.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.280+0000 7ffad57fa640 1 --2- 172.21.15.129:0/3001728512 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ffabc038320 0x7ffabc03a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:56.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.281+0000 7ffad57fa640 1 -- 172.21.15.129:0/3001728512 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7ffacc04a990 con 0x7ffad8096840 2024-09-18T01:44:56.308 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.281+0000 7f0f1c905640 1 --2- 172.21.15.129:0/1025581590 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f0f1809c670 0x7f0f181afe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:56.309 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.281+0000 7ffad7fff640 1 --2- 172.21.15.129:0/3001728512 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ffabc038320 0x7ffabc03a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:56.309 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.281+0000 7f0f177fe640 1 --2- 172.21.15.129:0/1025581590 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0f04038460 0x7f0f0403a920 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0f1809cac0 tx=0x7f0f0c007a10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:56.309 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.281+0000 7f0efff31640 1 -- 172.21.15.129:0/504912242 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0ee0000f80 con 0x7f0ef8070ef0 2024-09-18T01:44:56.310 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.281+0000 7ffad57fa640 1 --2- 172.21.15.129:0/3001728512 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x7ffabc03daa0 0x7ffabc03ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:56.310 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.281+0000 7ffad57fa640 1 -- 172.21.15.129:0/3001728512 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffabc0405f0 con 0x7ffabc03daa0 2024-09-18T01:44:56.310 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.281+0000 7ffad57fa640 1 -- 172.21.15.129:0/3001728512 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7ffacc051050 con 0x7ffad8096840 2024-09-18T01:44:56.310 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.280+0000 7fddbeffd640 1 --2- 172.21.15.129:0/3855582144 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fddb00382f0 0x7fddb003a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:56.311 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.280+0000 7fddbeffd640 1 -- 172.21.15.129:0/3855582144 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7fddc004a550 con 0x7fddd0074c70 2024-09-18T01:44:56.311 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.281+0000 7fddcdd9b640 1 --2- 172.21.15.129:0/3855582144 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fddb00382f0 0x7fddb003a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:56.311 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.281+0000 7fddd4a77640 1 --2- 172.21.15.129:0/3855582144 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x7fddd0072310 0x7fddd00726f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:56.311 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.281+0000 7fddd4a77640 1 -- 172.21.15.129:0/3855582144 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fddd0095520 con 0x7fddd0072310 2024-09-18T01:44:56.311 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.281+0000 7ffadd32e640 1 --2- 172.21.15.129:0/3001728512 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x7ffabc03daa0 0x7ffabc03ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:56.311 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.281+0000 7f0f1c905640 1 --2- 172.21.15.129:0/1025581590 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f0f1809c670 0x7f0f181afe50 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:56.312 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.281+0000 7ffad7fff640 1 --2- 172.21.15.129:0/3001728512 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ffabc038320 0x7ffabc03a7e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ffac4009720 tx=0x7ffac4030000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:56.312 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.281+0000 7f0eee7fc640 1 -- 172.21.15.129:0/504912242 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0ef401a070 con 0x7f0ef8070ef0 2024-09-18T01:44:56.312 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.281+0000 7fddced9d640 1 --2- 172.21.15.129:0/3855582144 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x7fddd0072310 0x7fddd00726f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:56.312 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.282+0000 7f0eee7fc640 1 --2- 172.21.15.129:0/504912242 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0edc038630 0x7f0edc03aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:56.313 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.282+0000 7fddcdd9b640 1 --2- 172.21.15.129:0/3855582144 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fddb00382f0 0x7fddb003a7b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fddc4034000 tx=0x7fddc402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:56.313 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.282+0000 7f0eee7fc640 1 -- 172.21.15.129:0/504912242 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f0ef404a0e0 con 0x7f0ef8070ef0 2024-09-18T01:44:56.313 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.282+0000 7f0eee7fc640 1 --2- 172.21.15.129:0/504912242 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f0edc03ddb0 0x7f0edc040230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:56.313 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.282+0000 7f0eee7fc640 1 -- 172.21.15.129:0/504912242 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0ef4008e50 con 0x7f0edc03ddb0 2024-09-18T01:44:56.314 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.282+0000 7ffadd32e640 1 --2- 172.21.15.129:0/3001728512 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x7ffabc03daa0 0x7ffabc03ff20 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:56.314 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.282+0000 7f0eee7fc640 1 -- 172.21.15.129:0/504912242 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f0ef4051050 con 0x7f0ef8070ef0 2024-09-18T01:44:56.314 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.282+0000 7f0efd4cc640 1 --2- 172.21.15.129:0/504912242 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0edc038630 0x7f0edc03aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:56.314 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.282+0000 7fddced9d640 1 --2- 172.21.15.129:0/3855582144 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x7fddd0072310 0x7fddd00726f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:56.315 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.282+0000 7f0efe4ce640 1 --2- 172.21.15.129:0/504912242 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f0edc03ddb0 0x7f0edc040230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:56.315 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.282+0000 7f0efe4ce640 1 --2- 172.21.15.129:0/504912242 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f0edc03ddb0 0x7f0edc040230 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:56.315 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.282+0000 7f0efd4cc640 1 --2- 172.21.15.129:0/504912242 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0edc038630 0x7f0edc03aaf0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8034000 tx=0x7f0ee802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:56.315 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.282+0000 7f0f14ff9640 1 -- 172.21.15.129:0/1025581590 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0f1809a760 con 0x7f0f1809c670 2024-09-18T01:44:56.315 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.283+0000 7ffad57fa640 1 -- 172.21.15.129:0/3001728512 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ffabc0405f0 con 0x7ffabc03daa0 2024-09-18T01:44:56.316 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.283+0000 7fddbeffd640 1 -- 172.21.15.129:0/3855582144 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fddd0095520 con 0x7fddd0072310 2024-09-18T01:44:56.316 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.283+0000 7f0eee7fc640 1 -- 172.21.15.129:0/504912242 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0ef4008e50 con 0x7f0edc03ddb0 2024-09-18T01:44:56.316 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.296+0000 7f0f1e368640 1 -- 172.21.15.129:0/1025581590 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0f181b18b0 con 0x7f0f1809c670 2024-09-18T01:44:56.316 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.296+0000 7ffaded91640 1 -- 172.21.15.129:0/3001728512 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ffad8097330 con 0x7ffabc03daa0 2024-09-18T01:44:56.317 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.296+0000 7fddd4a77640 1 -- 172.21.15.129:0/3855582144 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fddd0071af0 con 0x7fddd0072310 2024-09-18T01:44:56.317 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.296+0000 7f0efff31640 1 -- 172.21.15.129:0/504912242 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0ee0002c70 con 0x7f0edc03ddb0 2024-09-18T01:44:56.318 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.297+0000 7f0f14ff9640 1 -- 172.21.15.129:0/1025581590 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0f181b18b0 con 0x7f0f1809c670 2024-09-18T01:44:56.318 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.297+0000 7fddbeffd640 1 -- 172.21.15.129:0/3855582144 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fddd0071af0 con 0x7fddd0072310 2024-09-18T01:44:56.318 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.297+0000 7ffad57fa640 1 -- 172.21.15.129:0/3001728512 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ffad8097330 con 0x7ffabc03daa0 2024-09-18T01:44:56.319 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.297+0000 7f0eee7fc640 1 -- 172.21.15.129:0/504912242 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0ee0002c70 con 0x7f0edc03ddb0 2024-09-18T01:44:56.319 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.297+0000 7fddd4a77640 1 -- 172.21.15.129:0/3855582144 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x7fddd0072310 msgr2=0x7fddd00726f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:56.320 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.297+0000 7f0f1e368640 1 -- 172.21.15.129:0/1025581590 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f0f1809c670 msgr2=0x7f0f181afe50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:56.320 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.297+0000 7f0f1e368640 1 --2- 172.21.15.129:0/1025581590 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f0f1809c670 0x7f0f181afe50 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:56.320 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.297+0000 7ffaded91640 1 -- 172.21.15.129:0/3001728512 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x7ffabc03daa0 msgr2=0x7ffabc03ff20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:56.320 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.297+0000 7ffaded91640 1 --2- 172.21.15.129:0/3001728512 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x7ffabc03daa0 0x7ffabc03ff20 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:56.320 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.297+0000 7fddd4a77640 1 --2- 172.21.15.129:0/3855582144 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x7fddd0072310 0x7fddd00726f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:56.321 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.297+0000 7f0f1e368640 1 -- 172.21.15.129:0/1025581590 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0f04038460 msgr2=0x7f0f0403a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:56.321 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.297+0000 7f0f1e368640 1 --2- 172.21.15.129:0/1025581590 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0f04038460 0x7f0f0403a920 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0f1809cac0 tx=0x7f0f0c007a10 comp rx=0 tx=0).stop 2024-09-18T01:44:56.321 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.297+0000 7ffaded91640 1 -- 172.21.15.129:0/3001728512 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ffabc038320 msgr2=0x7ffabc03a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:56.321 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.297+0000 7f0f1e368640 1 -- 172.21.15.129:0/1025581590 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0f1809bd50 msgr2=0x7f0f181b4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:56.322 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.297+0000 7f0f1e368640 1 --2- 172.21.15.129:0/1025581590 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0f1809bd50 0x7f0f181b4190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0f08035040 tx=0x7f0f08004730 comp rx=0 tx=0).stop 2024-09-18T01:44:56.322 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.297+0000 7ffaded91640 1 --2- 172.21.15.129:0/3001728512 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ffabc038320 0x7ffabc03a7e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ffac4009720 tx=0x7ffac4030000 comp rx=0 tx=0).stop 2024-09-18T01:44:56.322 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.297+0000 7f0efff31640 1 -- 172.21.15.129:0/504912242 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f0edc03ddb0 msgr2=0x7f0edc040230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:56.322 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.297+0000 7fddd4a77640 1 -- 172.21.15.129:0/3855582144 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fddb00382f0 msgr2=0x7fddb003a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:56.323 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.297+0000 7f0efff31640 1 --2- 172.21.15.129:0/504912242 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f0edc03ddb0 0x7f0edc040230 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:56.323 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.297+0000 7f0efff31640 1 -- 172.21.15.129:0/504912242 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0edc038630 msgr2=0x7f0edc03aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:56.323 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.297+0000 7f0efff31640 1 --2- 172.21.15.129:0/504912242 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0edc038630 0x7f0edc03aaf0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8034000 tx=0x7f0ee802e000 comp rx=0 tx=0).stop 2024-09-18T01:44:56.323 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.297+0000 7f0efff31640 1 -- 172.21.15.129:0/504912242 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0ef8070ef0 msgr2=0x7f0ef812a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:56.323 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.297+0000 7f0efff31640 1 --2- 172.21.15.129:0/504912242 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0ef8070ef0 0x7f0ef812a4f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0ef400c4a0 tx=0x7f0ef400c960 comp rx=0 tx=0).stop 2024-09-18T01:44:56.323 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.297+0000 7fddd4a77640 1 --2- 172.21.15.129:0/3855582144 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fddb00382f0 0x7fddb003a7b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fddc4034000 tx=0x7fddc402e000 comp rx=0 tx=0).stop 2024-09-18T01:44:56.323 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.297+0000 7f0f1e368640 1 -- 172.21.15.129:0/1025581590 shutdown_connections 2024-09-18T01:44:56.323 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.297+0000 7f0f1e368640 1 --2- 172.21.15.129:0/1025581590 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f0f1809c670 0x7f0f181afe50 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:56.324 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.297+0000 7f0f1e368640 1 --2- 172.21.15.129:0/1025581590 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0f04038460 0x7f0f0403a920 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:56.324 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.297+0000 7fddd4a77640 1 -- 172.21.15.129:0/3855582144 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fddd0074c70 msgr2=0x7fddd0131de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:56.324 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.297+0000 7fddd4a77640 1 --2- 172.21.15.129:0/3855582144 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fddd0074c70 0x7fddd0131de0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fddc000c4a0 tx=0x7fddc000c960 comp rx=0 tx=0).stop 2024-09-18T01:44:56.324 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.297+0000 7f0f1e368640 1 --2- 172.21.15.129:0/1025581590 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0f1809bd50 0x7f0f181b4190 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:56.324 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.297+0000 7f0f1e368640 1 -- 172.21.15.129:0/1025581590 >> 172.21.15.129:0/1025581590 conn(0x7f0f1806d4a0 msgr2=0x7f0f1809eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:56.325 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.297+0000 7f0efff31640 1 -- 172.21.15.129:0/504912242 shutdown_connections 2024-09-18T01:44:56.325 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.297+0000 7f0efff31640 1 --2- 172.21.15.129:0/504912242 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f0edc03ddb0 0x7f0edc040230 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:56.325 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.297+0000 7f0efff31640 1 --2- 172.21.15.129:0/504912242 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0edc038630 0x7f0edc03aaf0 secure :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8034000 tx=0x7f0ee802e000 comp rx=0 tx=0).stop 2024-09-18T01:44:56.325 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.297+0000 7f0efff31640 1 --2- 172.21.15.129:0/504912242 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0ef8070ef0 0x7f0ef812a4f0 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0ef400c4a0 tx=0x7f0ef400c960 comp rx=0 tx=0).stop 2024-09-18T01:44:56.325 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.297+0000 7f0efff31640 1 -- 172.21.15.129:0/504912242 >> 172.21.15.129:0/504912242 conn(0x7f0ef809ac20 msgr2=0x7f0ef8126740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:56.326 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.297+0000 7ffaded91640 1 -- 172.21.15.129:0/3001728512 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ffad8096840 msgr2=0x7ffad81bebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:56.326 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.297+0000 7ffaded91640 1 --2- 172.21.15.129:0/3001728512 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ffad8096840 0x7ffad81bebc0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ffacc00c700 tx=0x7ffacc00cbc0 comp rx=0 tx=0).stop 2024-09-18T01:44:56.326 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.297+0000 7ffaded91640 1 -- 172.21.15.129:0/3001728512 shutdown_connections 2024-09-18T01:44:56.326 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.297+0000 7ffaded91640 1 --2- 172.21.15.129:0/3001728512 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x7ffabc03daa0 0x7ffabc03ff20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:56.326 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.297+0000 7ffaded91640 1 --2- 172.21.15.129:0/3001728512 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ffabc038320 0x7ffabc03a7e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:56.326 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.297+0000 7fddd4a77640 1 -- 172.21.15.129:0/3855582144 shutdown_connections 2024-09-18T01:44:56.326 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.297+0000 7fddd4a77640 1 --2- 172.21.15.129:0/3855582144 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x7fddd0072310 0x7fddd00726f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:56.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.297+0000 7ffaded91640 1 --2- 172.21.15.129:0/3001728512 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ffad8096840 0x7ffad81bebc0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:56.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.297+0000 7fddd4a77640 1 --2- 172.21.15.129:0/3855582144 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fddb00382f0 0x7fddb003a7b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:56.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.297+0000 7f0f1e368640 1 -- 172.21.15.129:0/1025581590 shutdown_connections 2024-09-18T01:44:56.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.297+0000 7ffaded91640 1 -- 172.21.15.129:0/3001728512 >> 172.21.15.129:0/3001728512 conn(0x7ffad809d850 msgr2=0x7ffad80919c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:56.328 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.297+0000 7fddd4a77640 1 --2- 172.21.15.129:0/3855582144 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fddd0074c70 0x7fddd0131de0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:56.328 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.297+0000 7f0f1e368640 1 -- 172.21.15.129:0/1025581590 wait complete. 2024-09-18T01:44:56.328 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.297+0000 7fddd4a77640 1 -- 172.21.15.129:0/3855582144 >> 172.21.15.129:0/3855582144 conn(0x7fddd009d500 msgr2=0x7fddd0097e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:56.328 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.298+0000 7ffaded91640 1 -- 172.21.15.129:0/3001728512 shutdown_connections 2024-09-18T01:44:56.329 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.298+0000 7ffaded91640 1 -- 172.21.15.129:0/3001728512 wait complete. 2024-09-18T01:44:56.329 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.297+0000 7f0efff31640 1 -- 172.21.15.129:0/504912242 shutdown_connections 2024-09-18T01:44:56.329 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.298+0000 7f0efff31640 1 -- 172.21.15.129:0/504912242 wait complete. 2024-09-18T01:44:56.330 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.298+0000 7fddd4a77640 1 -- 172.21.15.129:0/3855582144 shutdown_connections 2024-09-18T01:44:56.330 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.298+0000 7fddd4a77640 1 -- 172.21.15.129:0/3855582144 wait complete. 2024-09-18T01:44:56.330 INFO:teuthology.orchestra.run.smithi129.stdout:38654705668 2024-09-18T01:44:56.330 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-18T01:44:56.331 INFO:teuthology.orchestra.run.smithi129.stdout:38654705668 2024-09-18T01:44:56.331 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-18T01:44:56.332 INFO:teuthology.orchestra.run.smithi129.stdout:38654705668 2024-09-18T01:44:56.332 INFO:teuthology.orchestra.run.smithi129.stdout:38654705668 2024-09-18T01:44:56.333 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-18T01:44:56.333 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-18T01:44:56.474 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.473+0000 7f68641c6640 1 Processor -- start 2024-09-18T01:44:56.475 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.473+0000 7f44b7a80640 1 Processor -- start 2024-09-18T01:44:56.475 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.473+0000 7fc4b8da6640 1 Processor -- start 2024-09-18T01:44:56.475 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.473+0000 7f68641c6640 1 -- start start 2024-09-18T01:44:56.475 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.474+0000 7f44b7a80640 1 -- start start 2024-09-18T01:44:56.476 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.474+0000 7fc4b8da6640 1 -- start start 2024-09-18T01:44:56.476 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.474+0000 7f7ac2bb9640 1 Processor -- start 2024-09-18T01:44:56.476 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.474+0000 7f7ac2bb9640 1 -- start start 2024-09-18T01:44:56.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.474+0000 7f68641c6640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f685c09a100 0x7f685c133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:56.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.474+0000 7f68641c6640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f685c09d3b0 con 0x7f685c09bd50 2024-09-18T01:44:56.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.474+0000 7f68641c6640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x7f685c09c840 con 0x7f685c09a100 2024-09-18T01:44:56.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.474+0000 7f44b7a80640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f44b006d8a0 0x7f44b006dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:56.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.474+0000 7f44b7a80640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44b006fc50 con 0x7f44b012ba10 2024-09-18T01:44:56.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.474+0000 7f44b7a80640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x7f44b006be30 con 0x7f44b006d8a0 2024-09-18T01:44:56.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.474+0000 7fc4b8da6640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fc4b406e7a0 0x7fc4b406eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:56.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.474+0000 7f7ac2bb9640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f7abc095730 0x7f7abc095b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:56.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.474+0000 7fc4b8da6640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4b406be10 con 0x7fc4b406f0c0 2024-09-18T01:44:56.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.474+0000 7fc4b8da6640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x7fc4b406ffb0 con 0x7fc4b406e7a0 2024-09-18T01:44:56.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.474+0000 7f7ac2bb9640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7abc09aa00 con 0x7f7abc096050 2024-09-18T01:44:56.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.474+0000 7f7ac2bb9640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x7f7abc0975e0 con 0x7f7abc095730 2024-09-18T01:44:56.479 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.474+0000 7f6861f62640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f685c09bd50 0x7f685c09c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40530/0 (socket says 172.21.15.129:40530) 2024-09-18T01:44:56.479 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.474+0000 7f44b581c640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f44b012ba10 0x7f44b012bdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40540/0 (socket says 172.21.15.129:40540) 2024-09-18T01:44:56.479 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.474+0000 7f44b581c640 1 -- 172.21.15.129:0/3848676739 learned_addr learned my addr 172.21.15.129:0/3848676739 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-09-18T01:44:56.479 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.474+0000 7f6861f62640 1 -- 172.21.15.129:0/1458225590 learned_addr learned my addr 172.21.15.129:0/1458225590 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-09-18T01:44:56.480 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.474+0000 7fc4b1d9b640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fc4b406f0c0 0x7fc4b412ec70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40542/0 (socket says 172.21.15.129:40542) 2024-09-18T01:44:56.480 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.474+0000 7fc4b1d9b640 1 -- 172.21.15.129:0/2328341820 learned_addr learned my addr 172.21.15.129:0/2328341820 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-09-18T01:44:56.480 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.474+0000 7fc4b259c640 1 --2- 172.21.15.129:0/2328341820 >> v2:172.21.15.129:3300/0 conn(0x7fc4b406e7a0 0x7fc4b406eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:56.480 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.474+0000 7f44b501b640 1 --2- 172.21.15.129:0/3848676739 >> v2:172.21.15.129:3300/0 conn(0x7f44b006d8a0 0x7f44b006dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:56.480 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.474+0000 7f7abbfff640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f7abc096050 0x7f7abc090010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40544/0 (socket says 172.21.15.129:40544) 2024-09-18T01:44:56.480 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.474+0000 7f7abbfff640 1 -- 172.21.15.129:0/3554695118 learned_addr learned my addr 172.21.15.129:0/3554695118 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-09-18T01:44:56.481 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.475+0000 7f6861761640 1 --2- 172.21.15.129:0/1458225590 >> v2:172.21.15.129:3300/0 conn(0x7f685c09a100 0x7f685c133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:56.481 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.475+0000 7f7ac0955640 1 --2- 172.21.15.129:0/3554695118 >> v2:172.21.15.129:3300/0 conn(0x7f7abc095730 0x7f7abc095b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:56.481 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.475+0000 7fc4b259c640 1 -- 172.21.15.129:0/2328341820 >> v1:172.21.15.129:6789/0 conn(0x7fc4b406f0c0 legacy=0x7fc4b412ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:56.481 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.475+0000 7fc4b259c640 1 -- 172.21.15.129:0/2328341820 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4b406c470 con 0x7fc4b406e7a0 2024-09-18T01:44:56.482 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.475+0000 7f44b501b640 1 -- 172.21.15.129:0/3848676739 >> v1:172.21.15.129:6789/0 conn(0x7f44b012ba10 legacy=0x7f44b012bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:56.482 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.475+0000 7f44b501b640 1 -- 172.21.15.129:0/3848676739 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44b012b5c0 con 0x7f44b006d8a0 2024-09-18T01:44:56.482 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.475+0000 7f6860f60640 1 -- 172.21.15.129:0/1458225590 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2658541015 0 0) 0x7f6858001110 con 0x7f685c09bd50 2024-09-18T01:44:56.482 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.475+0000 7f6860f60640 1 -- 172.21.15.129:0/1458225590 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6848003520 con 0x7f685c09bd50 2024-09-18T01:44:56.483 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.475+0000 7f7ac0955640 1 -- 172.21.15.129:0/3554695118 >> v1:172.21.15.129:6789/0 conn(0x7f7abc096050 legacy=0x7f7abc090010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:56.483 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.475+0000 7f7ac0955640 1 -- 172.21.15.129:0/3554695118 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7abc09a6a0 con 0x7f7abc095730 2024-09-18T01:44:56.483 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.475+0000 7f6861761640 1 -- 172.21.15.129:0/1458225590 >> v1:172.21.15.129:6789/0 conn(0x7f685c09bd50 legacy=0x7f685c09c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:56.483 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.475+0000 7f6861761640 1 -- 172.21.15.129:0/1458225590 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f685c098230 con 0x7f685c09a100 2024-09-18T01:44:56.483 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.476+0000 7f44b501b640 1 --2- 172.21.15.129:0/3848676739 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f44b006d8a0 0x7f44b006dd30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f44a0009720 tx=0x7f44a002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=654ddfbda202556f server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:56.484 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.476+0000 7fc4b259c640 1 --2- 172.21.15.129:0/2328341820 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc4b406e7a0 0x7fc4b406eb80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc4a4009720 tx=0x7fc4a402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=185964844847366e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:56.484 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.476+0000 7f44b481a640 1 -- 172.21.15.129:0/3848676739 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44a0037070 con 0x7f44b006d8a0 2024-09-18T01:44:56.484 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.476+0000 7f7ac0955640 1 --2- 172.21.15.129:0/3554695118 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7abc095730 0x7f7abc095b10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7aac009720 tx=0x7f7aac02a010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2329958a718b7f41 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:56.484 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.476+0000 7f44b481a640 1 -- 172.21.15.129:0/3848676739 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44a002ae20 con 0x7f44b006d8a0 2024-09-18T01:44:56.484 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.476+0000 7f44b481a640 1 -- 172.21.15.129:0/3848676739 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44a0032590 con 0x7f44b006d8a0 2024-09-18T01:44:56.485 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.476+0000 7fc4b159a640 1 -- 172.21.15.129:0/2328341820 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4a4037070 con 0x7fc4b406e7a0 2024-09-18T01:44:56.485 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.476+0000 7fc4b159a640 1 -- 172.21.15.129:0/2328341820 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4a402ad90 con 0x7fc4b406e7a0 2024-09-18T01:44:56.485 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.476+0000 7f7abb7fe640 1 -- 172.21.15.129:0/3554695118 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7aac037070 con 0x7f7abc095730 2024-09-18T01:44:56.485 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.476+0000 7fc4b159a640 1 -- 172.21.15.129:0/2328341820 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4a4032590 con 0x7fc4b406e7a0 2024-09-18T01:44:56.486 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.476+0000 7f7abb7fe640 1 -- 172.21.15.129:0/3554695118 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7aac02abd0 con 0x7f7abc095730 2024-09-18T01:44:56.486 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.476+0000 7f7abb7fe640 1 -- 172.21.15.129:0/3554695118 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7aac032440 con 0x7f7abc095730 2024-09-18T01:44:56.486 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.476+0000 7f6861761640 1 --2- 172.21.15.129:0/1458225590 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f685c09a100 0x7f685c133da0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f684c009720 tx=0x7f684c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42d72a21ecc29d57 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:56.486 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.476+0000 7f6860f60640 1 -- 172.21.15.129:0/1458225590 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f684c037070 con 0x7f685c09a100 2024-09-18T01:44:56.486 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.476+0000 7f6860f60640 1 -- 172.21.15.129:0/1458225590 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f684c02ad90 con 0x7f685c09a100 2024-09-18T01:44:56.486 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.476+0000 7f6860f60640 1 -- 172.21.15.129:0/1458225590 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f684c032590 con 0x7f685c09a100 2024-09-18T01:44:56.487 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.477+0000 7f44b7a80640 1 -- 172.21.15.129:0/3848676739 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f44b006d8a0 msgr2=0x7f44b006dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:56.487 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.477+0000 7f44b7a80640 1 --2- 172.21.15.129:0/3848676739 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f44b006d8a0 0x7f44b006dd30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f44a0009720 tx=0x7f44a002a1a0 comp rx=0 tx=0).stop 2024-09-18T01:44:56.487 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.477+0000 7f44b7a80640 1 -- 172.21.15.129:0/3848676739 shutdown_connections 2024-09-18T01:44:56.487 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.477+0000 7f44b7a80640 1 --2- 172.21.15.129:0/3848676739 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f44b006d8a0 0x7f44b006dd30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:56.487 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.477+0000 7f44b7a80640 1 -- 172.21.15.129:0/3848676739 >> 172.21.15.129:0/3848676739 conn(0x7f44b009a890 msgr2=0x7f44b009aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:56.487 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.477+0000 7fc4b8da6640 1 -- 172.21.15.129:0/2328341820 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc4b406e7a0 msgr2=0x7fc4b406eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:56.487 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.477+0000 7fc4b8da6640 1 --2- 172.21.15.129:0/2328341820 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc4b406e7a0 0x7fc4b406eb80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc4a4009720 tx=0x7fc4a402a110 comp rx=0 tx=0).stop 2024-09-18T01:44:56.488 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.477+0000 7f7ac2bb9640 1 -- 172.21.15.129:0/3554695118 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7abc095730 msgr2=0x7f7abc095b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:56.488 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.477+0000 7fc4b8da6640 1 -- 172.21.15.129:0/2328341820 shutdown_connections 2024-09-18T01:44:56.488 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.477+0000 7f7ac2bb9640 1 --2- 172.21.15.129:0/3554695118 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7abc095730 0x7f7abc095b10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7aac009720 tx=0x7f7aac02a010 comp rx=0 tx=0).stop 2024-09-18T01:44:56.488 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.477+0000 7f44b7a80640 1 -- 172.21.15.129:0/3848676739 shutdown_connections 2024-09-18T01:44:56.489 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.477+0000 7f44b7a80640 1 -- 172.21.15.129:0/3848676739 wait complete. 2024-09-18T01:44:56.489 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.477+0000 7fc4b8da6640 1 --2- 172.21.15.129:0/2328341820 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc4b406e7a0 0x7fc4b406eb80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:56.489 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.477+0000 7fc4b8da6640 1 -- 172.21.15.129:0/2328341820 >> 172.21.15.129:0/2328341820 conn(0x7fc4b409ac20 msgr2=0x7fc4b406d080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:56.489 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.477+0000 7f7ac2bb9640 1 -- 172.21.15.129:0/3554695118 shutdown_connections 2024-09-18T01:44:56.489 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.477+0000 7f7ac2bb9640 1 --2- 172.21.15.129:0/3554695118 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7abc095730 0x7f7abc095b10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:56.489 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.477+0000 7f7ac2bb9640 1 -- 172.21.15.129:0/3554695118 >> 172.21.15.129:0/3554695118 conn(0x7f7abc09d850 msgr2=0x7f7abc099d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:56.490 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.477+0000 7fc4b8da6640 1 -- 172.21.15.129:0/2328341820 shutdown_connections 2024-09-18T01:44:56.490 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.477+0000 7fc4b8da6640 1 -- 172.21.15.129:0/2328341820 wait complete. 2024-09-18T01:44:56.490 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.477+0000 7f7ac2bb9640 1 -- 172.21.15.129:0/3554695118 shutdown_connections 2024-09-18T01:44:56.490 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.477+0000 7f7ac2bb9640 1 -- 172.21.15.129:0/3554695118 wait complete. 2024-09-18T01:44:56.491 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.477+0000 7f68641c6640 1 -- 172.21.15.129:0/1458225590 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f685c09a100 msgr2=0x7f685c133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:56.491 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.477+0000 7f68641c6640 1 --2- 172.21.15.129:0/1458225590 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f685c09a100 0x7f685c133da0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f684c009720 tx=0x7f684c02a110 comp rx=0 tx=0).stop 2024-09-18T01:44:56.491 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.477+0000 7f68641c6640 1 -- 172.21.15.129:0/1458225590 shutdown_connections 2024-09-18T01:44:56.491 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.477+0000 7f68641c6640 1 --2- 172.21.15.129:0/1458225590 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f685c09a100 0x7f685c133da0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:56.491 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.477+0000 7f68641c6640 1 -- 172.21.15.129:0/1458225590 >> 172.21.15.129:0/1458225590 conn(0x7f685c06d4a0 msgr2=0x7f685c06d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:56.491 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.477+0000 7f68641c6640 1 -- 172.21.15.129:0/1458225590 shutdown_connections 2024-09-18T01:44:56.491 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.477+0000 7f68641c6640 1 -- 172.21.15.129:0/1458225590 wait complete. 2024-09-18T01:44:56.491 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.478+0000 7f44b7a80640 1 Processor -- start 2024-09-18T01:44:56.492 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.478+0000 7fc4b8da6640 1 Processor -- start 2024-09-18T01:44:56.492 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.478+0000 7f44b7a80640 1 -- start start 2024-09-18T01:44:56.492 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.479+0000 7fc4b8da6640 1 -- start start 2024-09-18T01:44:56.493 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.479+0000 7f7ac2bb9640 1 Processor -- start 2024-09-18T01:44:56.493 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.479+0000 7f7ac2bb9640 1 -- start start 2024-09-18T01:44:56.493 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.479+0000 7f68641c6640 1 Processor -- start 2024-09-18T01:44:56.493 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.479+0000 7f68641c6640 1 -- start start 2024-09-18T01:44:56.493 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.479+0000 7fc4b8da6640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc4b406e7a0 0x7fc4b4122bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:56.493 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.479+0000 7fc4b8da6640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b409b4d0 con 0x7fc4b406e7a0 2024-09-18T01:44:56.494 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.479+0000 7f44b7a80640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f44b006d8a0 0x7f44b01274b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:56.494 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.479+0000 7fc4b259c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc4b406e7a0 0x7fc4b4122bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:56.494 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.479+0000 7fc4b259c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc4b406e7a0 0x7fc4b4122bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:48096/0 (socket says 172.21.15.129:48096) 2024-09-18T01:44:56.494 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.479+0000 7fc4b259c640 1 -- 172.21.15.129:0/3752062454 learned_addr learned my addr 172.21.15.129:0/3752062454 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-18T01:44:56.495 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.479+0000 7f44b581c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f44b006d8a0 0x7f44b01274b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:56.495 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.479+0000 7f44b581c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f44b006d8a0 0x7f44b01274b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:48110/0 (socket says 172.21.15.129:48110) 2024-09-18T01:44:56.495 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.479+0000 7f44b581c640 1 -- 172.21.15.129:0/134314314 learned_addr learned my addr 172.21.15.129:0/134314314 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-18T01:44:56.495 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.480+0000 7f44b7a80640 1 -- 172.21.15.129:0/134314314 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f44b0070980 con 0x7f44b006d8a0 2024-09-18T01:44:56.496 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.480+0000 7f68641c6640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f685c09a100 0x7f685c092f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:56.496 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.480+0000 7f68641c6640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f685c134670 con 0x7f685c09a100 2024-09-18T01:44:56.496 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.480+0000 7f7ac2bb9640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7abc095730 0x7f7abc12bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:56.496 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.480+0000 7f7ac2bb9640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f7abc097240 con 0x7f7abc095730 2024-09-18T01:44:56.496 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.480+0000 7f6861f62640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f685c09a100 0x7f685c092f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:56.497 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.480+0000 7fc4b259c640 1 -- 172.21.15.129:0/3752062454 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4b41246d0 con 0x7fc4b406e7a0 2024-09-18T01:44:56.497 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.480+0000 7f6861f62640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f685c09a100 0x7f685c092f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:48114/0 (socket says 172.21.15.129:48114) 2024-09-18T01:44:56.497 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.480+0000 7f6861f62640 1 -- 172.21.15.129:0/2397712688 learned_addr learned my addr 172.21.15.129:0/2397712688 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-18T01:44:56.498 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.480+0000 7f7ac0955640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7abc095730 0x7f7abc12bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:56.498 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.480+0000 7f7ac0955640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7abc095730 0x7f7abc12bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:48128/0 (socket says 172.21.15.129:48128) 2024-09-18T01:44:56.498 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.480+0000 7f7ac0955640 1 -- 172.21.15.129:0/1304428448 learned_addr learned my addr 172.21.15.129:0/1304428448 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-18T01:44:56.498 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.480+0000 7f44b581c640 1 -- 172.21.15.129:0/134314314 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44b012cad0 con 0x7f44b006d8a0 2024-09-18T01:44:56.498 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.480+0000 7fc4b259c640 1 --2- 172.21.15.129:0/3752062454 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc4b406e7a0 0x7fc4b4122bb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc4a402a150 tx=0x7fc4a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:56.498 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.480+0000 7f44b581c640 1 --2- 172.21.15.129:0/134314314 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f44b006d8a0 0x7f44b01274b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f44ac005880 tx=0x7f44ac00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:56.499 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.480+0000 7f6861f62640 1 -- 172.21.15.129:0/2397712688 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f685c094be0 con 0x7f685c09a100 2024-09-18T01:44:56.499 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.480+0000 7f7ac0955640 1 -- 172.21.15.129:0/1304428448 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7abc1252c0 con 0x7f7abc095730 2024-09-18T01:44:56.499 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.480+0000 7f44a67fc640 1 -- 172.21.15.129:0/134314314 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44ac017070 con 0x7f44b006d8a0 2024-09-18T01:44:56.500 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.480+0000 7f44a67fc640 1 -- 172.21.15.129:0/134314314 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44ac005c10 con 0x7f44b006d8a0 2024-09-18T01:44:56.500 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.480+0000 7f44a67fc640 1 -- 172.21.15.129:0/134314314 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44ac007070 con 0x7f44b006d8a0 2024-09-18T01:44:56.500 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.480+0000 7f44b7a80640 1 -- 172.21.15.129:0/134314314 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44b0125ca0 con 0x7f44b006d8a0 2024-09-18T01:44:56.500 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.480+0000 7f6861f62640 1 --2- 172.21.15.129:0/2397712688 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f685c09a100 0x7f685c092f40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f685800c6b0 tx=0x7f685800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:56.500 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.480+0000 7f7ac0955640 1 --2- 172.21.15.129:0/1304428448 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7abc095730 0x7f7abc12bee0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7aac009720 tx=0x7f7aac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:56.500 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.481+0000 7f44b7a80640 1 -- 172.21.15.129:0/134314314 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44b0133350 con 0x7f44b006d8a0 2024-09-18T01:44:56.501 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.481+0000 7fc4a2ffd640 1 -- 172.21.15.129:0/3752062454 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4a4041070 con 0x7fc4b406e7a0 2024-09-18T01:44:56.501 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.481+0000 7fc4a2ffd640 1 -- 172.21.15.129:0/3752062454 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4a4032e30 con 0x7fc4b406e7a0 2024-09-18T01:44:56.501 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.481+0000 7fc4a2ffd640 1 -- 172.21.15.129:0/3752062454 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4a4037040 con 0x7fc4b406e7a0 2024-09-18T01:44:56.501 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.481+0000 7fc4b8da6640 1 -- 172.21.15.129:0/3752062454 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4b4124ea0 con 0x7fc4b406e7a0 2024-09-18T01:44:56.501 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.481+0000 7fc4b8da6640 1 -- 172.21.15.129:0/3752062454 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4b4123df0 con 0x7fc4b406e7a0 2024-09-18T01:44:56.501 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.481+0000 7f68527fc640 1 -- 172.21.15.129:0/2397712688 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6858017070 con 0x7f685c09a100 2024-09-18T01:44:56.502 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.481+0000 7f7ab97fa640 1 -- 172.21.15.129:0/1304428448 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7aac032d80 con 0x7f7abc095730 2024-09-18T01:44:56.502 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.481+0000 7f7ac2bb9640 1 -- 172.21.15.129:0/1304428448 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7abc12e180 con 0x7f7abc095730 2024-09-18T01:44:56.502 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.481+0000 7f7ac2bb9640 1 -- 172.21.15.129:0/1304428448 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7abc12d3d0 con 0x7f7abc095730 2024-09-18T01:44:56.502 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.481+0000 7f68527fc640 1 -- 172.21.15.129:0/2397712688 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68580058b0 con 0x7f685c09a100 2024-09-18T01:44:56.503 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.481+0000 7f68527fc640 1 -- 172.21.15.129:0/2397712688 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6858017070 con 0x7f685c09a100 2024-09-18T01:44:56.503 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.482+0000 7f7ab97fa640 1 -- 172.21.15.129:0/1304428448 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7aac02ab30 con 0x7f7abc095730 2024-09-18T01:44:56.503 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.482+0000 7f7ab97fa640 1 -- 172.21.15.129:0/1304428448 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7aac032d80 con 0x7f7abc095730 2024-09-18T01:44:56.503 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.482+0000 7f68641c6640 1 -- 172.21.15.129:0/2397712688 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f685c09a760 con 0x7f685c09a100 2024-09-18T01:44:56.503 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.482+0000 7f68641c6640 1 -- 172.21.15.129:0/2397712688 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f685c095a50 con 0x7f685c09a100 2024-09-18T01:44:56.504 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.482+0000 7f44a67fc640 1 -- 172.21.15.129:0/134314314 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f44ac01a070 con 0x7f44b006d8a0 2024-09-18T01:44:56.504 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.482+0000 7fc4a2ffd640 1 -- 172.21.15.129:0/3752062454 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc4a4044070 con 0x7fc4b406e7a0 2024-09-18T01:44:56.504 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.482+0000 7fc4b8da6640 1 -- 172.21.15.129:0/3752062454 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4b4125640 con 0x7fc4b406e7a0 2024-09-18T01:44:56.504 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.482+0000 7fc4a2ffd640 1 --2- 172.21.15.129:0/3752062454 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc494038340 0x7fc49403a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:56.504 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.482+0000 7fc4a2ffd640 1 -- 172.21.15.129:0/3752062454 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7fc4a406be50 con 0x7fc4b406e7a0 2024-09-18T01:44:56.505 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.482+0000 7f44b7a80640 1 -- 172.21.15.129:0/134314314 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44b012d2a0 con 0x7f44b006d8a0 2024-09-18T01:44:56.505 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.483+0000 7f44a67fc640 1 --2- 172.21.15.129:0/134314314 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f44940382a0 0x7f449403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:56.505 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.483+0000 7f7ac2bb9640 1 -- 172.21.15.129:0/1304428448 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a9c005080 con 0x7f7abc095730 2024-09-18T01:44:56.505 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.483+0000 7f44a67fc640 1 -- 172.21.15.129:0/134314314 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f44ac04a5f0 con 0x7f44b006d8a0 2024-09-18T01:44:56.506 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.483+0000 7f7ab97fa640 1 -- 172.21.15.129:0/1304428448 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7aac04a060 con 0x7f7abc095730 2024-09-18T01:44:56.506 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.483+0000 7fc4b1d9b640 1 --2- 172.21.15.129:0/3752062454 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc494038340 0x7fc49403a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:56.506 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.483+0000 7f44b501b640 1 --2- 172.21.15.129:0/134314314 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f44940382a0 0x7f449403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:56.506 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.483+0000 7f7ab97fa640 1 --2- 172.21.15.129:0/1304428448 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7aa8038480 0x7f7aa803a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:56.507 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.483+0000 7f7ab97fa640 1 -- 172.21.15.129:0/1304428448 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f7aac06cd40 con 0x7f7abc095730 2024-09-18T01:44:56.507 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.483+0000 7f68641c6640 1 -- 172.21.15.129:0/2397712688 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f685c094030 con 0x7f685c09a100 2024-09-18T01:44:56.507 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.483+0000 7f68527fc640 1 -- 172.21.15.129:0/2397712688 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f685801a070 con 0x7f685c09a100 2024-09-18T01:44:56.507 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.483+0000 7fc4b1d9b640 1 --2- 172.21.15.129:0/3752062454 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc494038340 0x7fc49403a800 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc4a80015c0 tx=0x7fc4a8007a80 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:56.507 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.484+0000 7f7abbfff640 1 --2- 172.21.15.129:0/1304428448 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7aa8038480 0x7f7aa803a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:56.508 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.484+0000 7f68527fc640 1 --2- 172.21.15.129:0/2397712688 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6840038680 0x7f684003ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:56.508 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.484+0000 7f68527fc640 1 -- 172.21.15.129:0/2397712688 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f685804a180 con 0x7f685c09a100 2024-09-18T01:44:56.508 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.484+0000 7f44b501b640 1 --2- 172.21.15.129:0/134314314 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f44940382a0 0x7f449403a760 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f44a0009720 tx=0x7f44a002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:56.509 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.484+0000 7f6861761640 1 --2- 172.21.15.129:0/2397712688 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6840038680 0x7f684003ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:56.509 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.484+0000 7f7abbfff640 1 --2- 172.21.15.129:0/1304428448 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7aa8038480 0x7f7aa803a940 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7ab00017b0 tx=0x7f7ab0007a20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:56.509 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.484+0000 7f6861761640 1 --2- 172.21.15.129:0/2397712688 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6840038680 0x7f684003ab40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f684c034000 tx=0x7f684c02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:56.509 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.488+0000 7f44a67fc640 1 -- 172.21.15.129:0/134314314 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f44ac049400 con 0x7f44b006d8a0 2024-09-18T01:44:56.510 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.492+0000 7fc4a2ffd640 1 -- 172.21.15.129:0/3752062454 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc4a406ac60 con 0x7fc4b406e7a0 2024-09-18T01:44:56.510 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.497+0000 7f68527fc640 1 -- 172.21.15.129:0/2397712688 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f685c09d3b0 con 0x7f685c09a100 2024-09-18T01:44:56.510 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.501+0000 7f7ab97fa640 1 -- 172.21.15.129:0/1304428448 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7aac072020 con 0x7f7abc095730 2024-09-18T01:44:56.663 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.662+0000 7f44b7a80640 1 -- 172.21.15.129:0/134314314 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f44b006bba0 con 0x7f44b006d8a0 2024-09-18T01:44:56.664 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.663+0000 7f44a67fc640 1 -- 172.21.15.129:0/134314314 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f44ac007210 con 0x7f44b006d8a0 2024-09-18T01:44:56.664 INFO:teuthology.orchestra.run.smithi129.stdout:38654705667 2024-09-18T01:44:56.667 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.666+0000 7f44b7a80640 1 -- 172.21.15.129:0/134314314 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f44940382a0 msgr2=0x7f449403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:56.667 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.666+0000 7f44b7a80640 1 --2- 172.21.15.129:0/134314314 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f44940382a0 0x7f449403a760 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f44a0009720 tx=0x7f44a002e000 comp rx=0 tx=0).stop 2024-09-18T01:44:56.667 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.666+0000 7f44b7a80640 1 -- 172.21.15.129:0/134314314 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f44b006d8a0 msgr2=0x7f44b01274b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:56.667 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.666+0000 7f44b7a80640 1 --2- 172.21.15.129:0/134314314 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f44b006d8a0 0x7f44b01274b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f44ac005880 tx=0x7f44ac00c8e0 comp rx=0 tx=0).stop 2024-09-18T01:44:56.668 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.666+0000 7f44b7a80640 1 -- 172.21.15.129:0/134314314 shutdown_connections 2024-09-18T01:44:56.668 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.666+0000 7f44b7a80640 1 --2- 172.21.15.129:0/134314314 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f44940382a0 0x7f449403a760 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:56.668 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.666+0000 7f44b7a80640 1 --2- 172.21.15.129:0/134314314 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f44b006d8a0 0x7f44b01274b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:56.668 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.666+0000 7f44b7a80640 1 -- 172.21.15.129:0/134314314 >> 172.21.15.129:0/134314314 conn(0x7f44b009a890 msgr2=0x7f44b006e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:56.668 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.666+0000 7f44b7a80640 1 -- 172.21.15.129:0/134314314 shutdown_connections 2024-09-18T01:44:56.668 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.666+0000 7f44b7a80640 1 -- 172.21.15.129:0/134314314 wait complete. 2024-09-18T01:44:56.672 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.671+0000 7f68641c6640 1 -- 172.21.15.129:0/2397712688 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f685c09d020 con 0x7f685c09a100 2024-09-18T01:44:56.673 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.672+0000 7f68527fc640 1 -- 172.21.15.129:0/2397712688 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6858048f90 con 0x7f685c09a100 2024-09-18T01:44:56.673 INFO:teuthology.orchestra.run.smithi129.stdout:38654705667 2024-09-18T01:44:56.675 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.674+0000 7f68641c6640 1 -- 172.21.15.129:0/2397712688 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6840038680 msgr2=0x7f684003ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:56.675 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.674+0000 7f68641c6640 1 --2- 172.21.15.129:0/2397712688 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6840038680 0x7f684003ab40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f684c034000 tx=0x7f684c02e000 comp rx=0 tx=0).stop 2024-09-18T01:44:56.675 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.674+0000 7f68641c6640 1 -- 172.21.15.129:0/2397712688 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f685c09a100 msgr2=0x7f685c092f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:56.675 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.674+0000 7f68641c6640 1 --2- 172.21.15.129:0/2397712688 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f685c09a100 0x7f685c092f40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f685800c6b0 tx=0x7f685800cb70 comp rx=0 tx=0).stop 2024-09-18T01:44:56.675 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.674+0000 7f68641c6640 1 -- 172.21.15.129:0/2397712688 shutdown_connections 2024-09-18T01:44:56.676 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.674+0000 7f68641c6640 1 --2- 172.21.15.129:0/2397712688 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6840038680 0x7f684003ab40 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:56.676 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.674+0000 7f68641c6640 1 --2- 172.21.15.129:0/2397712688 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f685c09a100 0x7f685c092f40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:56.676 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.674+0000 7f68641c6640 1 -- 172.21.15.129:0/2397712688 >> 172.21.15.129:0/2397712688 conn(0x7f685c06d4a0 msgr2=0x7f685c09f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:56.676 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.674+0000 7f68641c6640 1 -- 172.21.15.129:0/2397712688 shutdown_connections 2024-09-18T01:44:56.676 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.674+0000 7f68641c6640 1 -- 172.21.15.129:0/2397712688 wait complete. 2024-09-18T01:44:56.682 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.2 2024-09-18T01:44:56.685 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.1 2024-09-18T01:44:56.696 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.694+0000 7f7ac2bb9640 1 -- 172.21.15.129:0/1304428448 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f7a9c005370 con 0x7f7abc095730 2024-09-18T01:44:56.696 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.694+0000 7f7ab97fa640 1 -- 172.21.15.129:0/1304428448 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7aac03e070 con 0x7f7abc095730 2024-09-18T01:44:56.696 INFO:teuthology.orchestra.run.smithi129.stdout:38654705667 2024-09-18T01:44:56.697 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.695+0000 7fc4b8da6640 1 -- 172.21.15.129:0/3752062454 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fc4b412f8c0 con 0x7fc4b406e7a0 2024-09-18T01:44:56.697 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.696+0000 7fc4a2ffd640 1 -- 172.21.15.129:0/3752062454 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc4a406d070 con 0x7fc4b406e7a0 2024-09-18T01:44:56.697 INFO:teuthology.orchestra.run.smithi129.stdout:38654705667 2024-09-18T01:44:56.698 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.696+0000 7f7ac2bb9640 1 -- 172.21.15.129:0/1304428448 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7aa8038480 msgr2=0x7f7aa803a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:56.698 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.696+0000 7f7ac2bb9640 1 --2- 172.21.15.129:0/1304428448 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7aa8038480 0x7f7aa803a940 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7ab00017b0 tx=0x7f7ab0007a20 comp rx=0 tx=0).stop 2024-09-18T01:44:56.698 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.696+0000 7f7ac2bb9640 1 -- 172.21.15.129:0/1304428448 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7abc095730 msgr2=0x7f7abc12bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:56.698 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.696+0000 7f7ac2bb9640 1 --2- 172.21.15.129:0/1304428448 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7abc095730 0x7f7abc12bee0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7aac009720 tx=0x7f7aac0046c0 comp rx=0 tx=0).stop 2024-09-18T01:44:56.698 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.697+0000 7f7ac2bb9640 1 -- 172.21.15.129:0/1304428448 shutdown_connections 2024-09-18T01:44:56.698 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.697+0000 7f7ac2bb9640 1 --2- 172.21.15.129:0/1304428448 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7aa8038480 0x7f7aa803a940 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:56.698 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.697+0000 7f7ac2bb9640 1 --2- 172.21.15.129:0/1304428448 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7abc095730 0x7f7abc12bee0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:56.699 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.697+0000 7f7ac2bb9640 1 -- 172.21.15.129:0/1304428448 >> 172.21.15.129:0/1304428448 conn(0x7f7abc09d850 msgr2=0x7f7abc1242f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:56.699 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.697+0000 7f7ac2bb9640 1 -- 172.21.15.129:0/1304428448 shutdown_connections 2024-09-18T01:44:56.699 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.697+0000 7f7ac2bb9640 1 -- 172.21.15.129:0/1304428448 wait complete. 2024-09-18T01:44:56.700 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.698+0000 7fc4b8da6640 1 -- 172.21.15.129:0/3752062454 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc494038340 msgr2=0x7fc49403a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:56.700 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.698+0000 7fc4b8da6640 1 --2- 172.21.15.129:0/3752062454 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc494038340 0x7fc49403a800 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc4a80015c0 tx=0x7fc4a8007a80 comp rx=0 tx=0).stop 2024-09-18T01:44:56.700 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.698+0000 7fc4b8da6640 1 -- 172.21.15.129:0/3752062454 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc4b406e7a0 msgr2=0x7fc4b4122bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:56.700 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.698+0000 7fc4b8da6640 1 --2- 172.21.15.129:0/3752062454 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc4b406e7a0 0x7fc4b4122bb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc4a402a150 tx=0x7fc4a40046c0 comp rx=0 tx=0).stop 2024-09-18T01:44:56.700 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.698+0000 7fc4b8da6640 1 -- 172.21.15.129:0/3752062454 shutdown_connections 2024-09-18T01:44:56.700 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.698+0000 7fc4b8da6640 1 --2- 172.21.15.129:0/3752062454 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc494038340 0x7fc49403a800 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:56.700 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.698+0000 7fc4b8da6640 1 --2- 172.21.15.129:0/3752062454 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc4b406e7a0 0x7fc4b4122bb0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:56.700 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.698+0000 7fc4b8da6640 1 -- 172.21.15.129:0/3752062454 >> 172.21.15.129:0/3752062454 conn(0x7fc4b409ac20 msgr2=0x7fc4b40984f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:56.700 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.698+0000 7fc4b8da6640 1 -- 172.21.15.129:0/3752062454 shutdown_connections 2024-09-18T01:44:56.700 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:56.698+0000 7fc4b8da6640 1 -- 172.21.15.129:0/3752062454 wait complete. 2024-09-18T01:44:56.709 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.3 2024-09-18T01:44:56.711 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.0 2024-09-18T01:44:57.683 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-18T01:44:57.686 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-18T01:44:57.729 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-18T01:44:57.730 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-18T01:44:57.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.798+0000 7f7dd2bf6640 1 Processor -- start 2024-09-18T01:44:57.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.798+0000 7f7dd2bf6640 1 -- start start 2024-09-18T01:44:57.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.799+0000 7f7dd2bf6640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f7dcc09a100 0x7f7dcc133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:57.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.799+0000 7f7dd2bf6640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dcc09d3b0 con 0x7f7dcc09bd50 2024-09-18T01:44:57.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.799+0000 7f7dd2bf6640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x7f7dcc09c840 con 0x7f7dcc09a100 2024-09-18T01:44:57.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.799+0000 7f7dcbfff640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f7dcc09a100 0x7f7dcc133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:57.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.799+0000 7f7dd0992640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f7dcc09bd50 0x7f7dcc09c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40556/0 (socket says 172.21.15.129:40556) 2024-09-18T01:44:57.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.799+0000 7f7dd0992640 1 -- 172.21.15.129:0/221961199 learned_addr learned my addr 172.21.15.129:0/221961199 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-09-18T01:44:57.801 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.799+0000 7f7dcbfff640 1 -- 172.21.15.129:0/221961199 >> v1:172.21.15.129:6789/0 conn(0x7f7dcc09bd50 legacy=0x7f7dcc09c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:57.802 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.799+0000 7f7dcbfff640 1 -- 172.21.15.129:0/221961199 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dcc098230 con 0x7f7dcc09a100 2024-09-18T01:44:57.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.801+0000 7f7dcbfff640 1 --2- 172.21.15.129:0/221961199 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7dcc09a100 0x7f7dcc133da0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7db8009720 tx=0x7f7db802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=614e1e9f9a4224a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:57.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.801+0000 7f7dcb7fe640 1 -- 172.21.15.129:0/221961199 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7db8037070 con 0x7f7dcc09a100 2024-09-18T01:44:57.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.801+0000 7f7dcb7fe640 1 -- 172.21.15.129:0/221961199 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7db802ad90 con 0x7f7dcc09a100 2024-09-18T01:44:57.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.801+0000 7f7dcb7fe640 1 -- 172.21.15.129:0/221961199 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7db8032590 con 0x7f7dcc09a100 2024-09-18T01:44:57.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.801+0000 7f7dd2bf6640 1 -- 172.21.15.129:0/221961199 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7dcc09a100 msgr2=0x7f7dcc133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:57.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.801+0000 7f7dd2bf6640 1 --2- 172.21.15.129:0/221961199 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7dcc09a100 0x7f7dcc133da0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7db8009720 tx=0x7f7db802a110 comp rx=0 tx=0).stop 2024-09-18T01:44:57.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.802+0000 7f7dd2bf6640 1 -- 172.21.15.129:0/221961199 shutdown_connections 2024-09-18T01:44:57.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.802+0000 7f7dd2bf6640 1 --2- 172.21.15.129:0/221961199 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7dcc09a100 0x7f7dcc133da0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:57.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.802+0000 7f7dd2bf6640 1 -- 172.21.15.129:0/221961199 >> 172.21.15.129:0/221961199 conn(0x7f7dcc06d4a0 msgr2=0x7f7dcc06d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:57.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.802+0000 7f7dd2bf6640 1 -- 172.21.15.129:0/221961199 shutdown_connections 2024-09-18T01:44:57.803 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.802+0000 7f7dd2bf6640 1 -- 172.21.15.129:0/221961199 wait complete. 2024-09-18T01:44:57.804 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.803+0000 7f7dd2bf6640 1 Processor -- start 2024-09-18T01:44:57.804 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.803+0000 7f7dd2bf6640 1 -- start start 2024-09-18T01:44:57.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.804+0000 7f7dd2bf6640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7dcc09a100 0x7f7dcc1c3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:57.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.804+0000 7f7dd2bf6640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f7dcc134670 con 0x7f7dcc09a100 2024-09-18T01:44:57.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.804+0000 7f7dd0992640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7dcc09a100 0x7f7dcc1c3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:57.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.804+0000 7f7dd0992640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7dcc09a100 0x7f7dcc1c3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:48138/0 (socket says 172.21.15.129:48138) 2024-09-18T01:44:57.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.804+0000 7f7dd0992640 1 -- 172.21.15.129:0/3284759990 learned_addr learned my addr 172.21.15.129:0/3284759990 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-18T01:44:57.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.804+0000 7f7dd0992640 1 -- 172.21.15.129:0/3284759990 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dcc125ee0 con 0x7f7dcc09a100 2024-09-18T01:44:57.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.804+0000 7f7dd0992640 1 --2- 172.21.15.129:0/3284759990 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7dcc09a100 0x7f7dcc1c3990 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7dc000c4a0 tx=0x7f7dc000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:57.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.805+0000 7f7dc97fa640 1 -- 172.21.15.129:0/3284759990 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7dc0017070 con 0x7f7dcc09a100 2024-09-18T01:44:57.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.805+0000 7f7dc97fa640 1 -- 172.21.15.129:0/3284759990 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dc0005c10 con 0x7f7dcc09a100 2024-09-18T01:44:57.806 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.805+0000 7f7dd2bf6640 1 -- 172.21.15.129:0/3284759990 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dcc095510 con 0x7f7dcc09a100 2024-09-18T01:44:57.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.805+0000 7f7dc97fa640 1 -- 172.21.15.129:0/3284759990 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7dc0007070 con 0x7f7dcc09a100 2024-09-18T01:44:57.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.805+0000 7f7dd2bf6640 1 -- 172.21.15.129:0/3284759990 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dcc0961a0 con 0x7f7dcc09a100 2024-09-18T01:44:57.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.806+0000 7f7dd2bf6640 1 -- 172.21.15.129:0/3284759990 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dcc096490 con 0x7f7dcc09a100 2024-09-18T01:44:57.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.806+0000 7f7dc97fa640 1 -- 172.21.15.129:0/3284759990 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7dc001a070 con 0x7f7dcc09a100 2024-09-18T01:44:57.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.806+0000 7f7dc97fa640 1 --2- 172.21.15.129:0/3284759990 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7db00382a0 0x7f7db003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:57.807 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.806+0000 7f7dc97fa640 1 -- 172.21.15.129:0/3284759990 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f7dc004a510 con 0x7f7dcc09a100 2024-09-18T01:44:57.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.807+0000 7f7dcbfff640 1 --2- 172.21.15.129:0/3284759990 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7db00382a0 0x7f7db003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:57.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.807+0000 7f7dcbfff640 1 --2- 172.21.15.129:0/3284759990 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7db00382a0 0x7f7db003a760 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7db8034000 tx=0x7f7db802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:57.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.811+0000 7f7dc97fa640 1 -- 172.21.15.129:0/3284759990 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7dcc096490 con 0x7f7dcc09a100 2024-09-18T01:44:57.841 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.840+0000 7f51039b9640 1 Processor -- start 2024-09-18T01:44:57.841 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.840+0000 7f821232c640 1 Processor -- start 2024-09-18T01:44:57.842 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.840+0000 7fc6fa00e640 1 Processor -- start 2024-09-18T01:44:57.842 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.840+0000 7f51039b9640 1 -- start start 2024-09-18T01:44:57.842 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.840+0000 7f821232c640 1 -- start start 2024-09-18T01:44:57.842 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.840+0000 7fc6fa00e640 1 -- start start 2024-09-18T01:44:57.843 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.840+0000 7f51039b9640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f50fc096630 0x7f50fc096a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:57.843 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.840+0000 7fc6fa00e640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fc6f406eda0 0x7fc6f406f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:57.843 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.840+0000 7f51039b9640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50fc0702f0 con 0x7f50fc06d910 2024-09-18T01:44:57.843 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.840+0000 7fc6fa00e640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6f406eba0 con 0x7fc6f406f6c0 2024-09-18T01:44:57.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.840+0000 7fc6fa00e640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x7fc6f406d2f0 con 0x7fc6f406eda0 2024-09-18T01:44:57.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.840+0000 7f821232c640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f820c09a100 0x7f820c133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:57.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.840+0000 7f51039b9640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x7f50fc06f1f0 con 0x7f50fc096630 2024-09-18T01:44:57.844 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.840+0000 7f821232c640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f820c09d3b0 con 0x7f820c09bd50 2024-09-18T01:44:57.845 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.841+0000 7f821232c640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x7f820c09c840 con 0x7f820c09a100 2024-09-18T01:44:57.845 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.841+0000 7f5101755640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f50fc096630 0x7f50fc096a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:57.845 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.841+0000 7f5100f54640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f50fc06d910 0x7f50fc06dd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40570/0 (socket says 172.21.15.129:40570) 2024-09-18T01:44:57.845 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.841+0000 7fc6f2ffd640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fc6f406f6c0 0x7fc6f4121a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40578/0 (socket says 172.21.15.129:40578) 2024-09-18T01:44:57.845 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.841+0000 7fc6f2ffd640 1 -- 172.21.15.129:0/3046681749 learned_addr learned my addr 172.21.15.129:0/3046681749 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-09-18T01:44:57.846 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.841+0000 7fc6f37fe640 1 --2- 172.21.15.129:0/3046681749 >> v2:172.21.15.129:3300/0 conn(0x7fc6f406eda0 0x7fc6f406f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:57.846 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.841+0000 7f820b7fe640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f820c09a100 0x7f820c133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:57.846 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.841+0000 7f820b7fe640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f820c09a100 0x7f820c133da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:48168/0 (socket says 172.21.15.129:48168) 2024-09-18T01:44:57.846 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.841+0000 7f820b7fe640 1 -- 172.21.15.129:0/275220396 learned_addr learned my addr 172.21.15.129:0/275220396 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-18T01:44:57.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.841+0000 7f5100f54640 1 -- 172.21.15.129:0/2359039533 learned_addr learned my addr 172.21.15.129:0/2359039533 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-09-18T01:44:57.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.841+0000 7f5101755640 1 -- 172.21.15.129:0/2359039533 >> v1:172.21.15.129:6789/0 conn(0x7f50fc06d910 legacy=0x7f50fc06dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:57.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.841+0000 7f5101755640 1 -- 172.21.15.129:0/2359039533 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50fc06fb80 con 0x7f50fc096630 2024-09-18T01:44:57.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.841+0000 7f820b7fe640 1 -- 172.21.15.129:0/275220396 >> v1:172.21.15.129:6789/0 conn(0x7f820c09bd50 legacy=0x7f820c09c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-18T01:44:57.847 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.841+0000 7f820b7fe640 1 -- 172.21.15.129:0/275220396 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f820c098230 con 0x7f820c09a100 2024-09-18T01:44:57.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.841+0000 7fc6f27fc640 1 -- 172.21.15.129:0/3046681749 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3950317596 0 0) 0x7fc6f406eba0 con 0x7fc6f406f6c0 2024-09-18T01:44:57.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.841+0000 7fc6f27fc640 1 -- 172.21.15.129:0/3046681749 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6dc005730 con 0x7fc6f406f6c0 2024-09-18T01:44:57.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.841+0000 7fc6f37fe640 1 -- 172.21.15.129:0/3046681749 >> v1:172.21.15.129:6789/0 conn(0x7fc6f406f6c0 legacy=0x7fc6f4121a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:57.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.841+0000 7fc6f37fe640 1 -- 172.21.15.129:0/3046681749 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6f4070d50 con 0x7fc6f406eda0 2024-09-18T01:44:57.848 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.842+0000 7f820b7fe640 1 --2- 172.21.15.129:0/275220396 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f820c09a100 0x7f820c133da0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f82000097f0 tx=0x7f820002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c720ae294894af98 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:57.849 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.842+0000 7f5101755640 1 --2- 172.21.15.129:0/2359039533 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f50fc096630 0x7f50fc096a10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f50f8009720 tx=0x7f50f802b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=519bf87de73fa8bb server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:57.849 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.842+0000 7f50f3fff640 1 -- 172.21.15.129:0/2359039533 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50f8038070 con 0x7f50fc096630 2024-09-18T01:44:57.849 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.842+0000 7f50f3fff640 1 -- 172.21.15.129:0/2359039533 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50f8033440 con 0x7f50fc096630 2024-09-18T01:44:57.849 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.842+0000 7f50f3fff640 1 -- 172.21.15.129:0/2359039533 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50f8033740 con 0x7f50fc096630 2024-09-18T01:44:57.849 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.842+0000 7f820affd640 1 -- 172.21.15.129:0/275220396 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8200037070 con 0x7f820c09a100 2024-09-18T01:44:57.849 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.842+0000 7f820affd640 1 -- 172.21.15.129:0/275220396 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f820002ade0 con 0x7f820c09a100 2024-09-18T01:44:57.849 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.842+0000 7f820affd640 1 -- 172.21.15.129:0/275220396 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8200032590 con 0x7f820c09a100 2024-09-18T01:44:57.850 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.842+0000 7fc6f37fe640 1 --2- 172.21.15.129:0/3046681749 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc6f406eda0 0x7fc6f406f180 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4009720 tx=0x7fc6e402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c5017a0cb3fad3d server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:57.850 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.843+0000 7fc6f27fc640 1 -- 172.21.15.129:0/3046681749 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6e4037070 con 0x7fc6f406eda0 2024-09-18T01:44:57.850 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.843+0000 7fc6f27fc640 1 -- 172.21.15.129:0/3046681749 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6e402ae20 con 0x7fc6f406eda0 2024-09-18T01:44:57.850 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.843+0000 7fc6f27fc640 1 -- 172.21.15.129:0/3046681749 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6e4032590 con 0x7fc6f406eda0 2024-09-18T01:44:57.850 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.843+0000 7f51039b9640 1 -- 172.21.15.129:0/2359039533 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f50fc096630 msgr2=0x7f50fc096a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:57.851 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.843+0000 7f821232c640 1 -- 172.21.15.129:0/275220396 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f820c09a100 msgr2=0x7f820c133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:57.851 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.843+0000 7f51039b9640 1 --2- 172.21.15.129:0/2359039533 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f50fc096630 0x7f50fc096a10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f50f8009720 tx=0x7f50f802b340 comp rx=0 tx=0).stop 2024-09-18T01:44:57.852 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.843+0000 7f821232c640 1 --2- 172.21.15.129:0/275220396 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f820c09a100 0x7f820c133da0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f82000097f0 tx=0x7f820002a1a0 comp rx=0 tx=0).stop 2024-09-18T01:44:57.852 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.843+0000 7f821232c640 1 -- 172.21.15.129:0/275220396 shutdown_connections 2024-09-18T01:44:57.852 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.843+0000 7f821232c640 1 --2- 172.21.15.129:0/275220396 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f820c09a100 0x7f820c133da0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:57.852 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.843+0000 7f821232c640 1 -- 172.21.15.129:0/275220396 >> 172.21.15.129:0/275220396 conn(0x7f820c06d4a0 msgr2=0x7f820c06d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:57.852 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.843+0000 7f51039b9640 1 -- 172.21.15.129:0/2359039533 shutdown_connections 2024-09-18T01:44:57.852 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.843+0000 7f51039b9640 1 --2- 172.21.15.129:0/2359039533 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f50fc096630 0x7f50fc096a10 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:57.852 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.843+0000 7f51039b9640 1 -- 172.21.15.129:0/2359039533 >> 172.21.15.129:0/2359039533 conn(0x7f50fc09a890 msgr2=0x7f50fc09aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:57.853 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.843+0000 7f821232c640 1 -- 172.21.15.129:0/275220396 shutdown_connections 2024-09-18T01:44:57.853 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.843+0000 7f821232c640 1 -- 172.21.15.129:0/275220396 wait complete. 2024-09-18T01:44:57.853 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.843+0000 7f51039b9640 1 -- 172.21.15.129:0/2359039533 shutdown_connections 2024-09-18T01:44:57.853 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.843+0000 7f51039b9640 1 -- 172.21.15.129:0/2359039533 wait complete. 2024-09-18T01:44:57.854 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.844+0000 7fc6fa00e640 1 -- 172.21.15.129:0/3046681749 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc6f406eda0 msgr2=0x7fc6f406f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:57.854 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.844+0000 7fc6fa00e640 1 --2- 172.21.15.129:0/3046681749 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc6f406eda0 0x7fc6f406f180 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4009720 tx=0x7fc6e402a1a0 comp rx=0 tx=0).stop 2024-09-18T01:44:57.854 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.844+0000 7fc6fa00e640 1 -- 172.21.15.129:0/3046681749 shutdown_connections 2024-09-18T01:44:57.855 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.844+0000 7fc6fa00e640 1 --2- 172.21.15.129:0/3046681749 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc6f406eda0 0x7fc6f406f180 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:57.855 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.844+0000 7fc6fa00e640 1 -- 172.21.15.129:0/3046681749 >> 172.21.15.129:0/3046681749 conn(0x7fc6f409a890 msgr2=0x7fc6f409aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:57.855 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.844+0000 7fc6fa00e640 1 -- 172.21.15.129:0/3046681749 shutdown_connections 2024-09-18T01:44:57.855 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.844+0000 7fc6fa00e640 1 -- 172.21.15.129:0/3046681749 wait complete. 2024-09-18T01:44:57.855 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.844+0000 7f51039b9640 1 Processor -- start 2024-09-18T01:44:57.855 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.844+0000 7f51039b9640 1 -- start start 2024-09-18T01:44:57.855 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.844+0000 7f821232c640 1 Processor -- start 2024-09-18T01:44:57.855 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.845+0000 7f821232c640 1 -- start start 2024-09-18T01:44:57.856 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.845+0000 7f51039b9640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f50fc06d910 0x7f50fc125ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:57.856 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.845+0000 7f51039b9640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f50fc06d410 con 0x7f50fc06d910 2024-09-18T01:44:57.856 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.845+0000 7f5101755640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f50fc06d910 0x7f50fc125ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:57.856 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.845+0000 7f5101755640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f50fc06d910 0x7f50fc125ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:48176/0 (socket says 172.21.15.129:48176) 2024-09-18T01:44:57.856 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.845+0000 7f5101755640 1 -- 172.21.15.129:0/2392400864 learned_addr learned my addr 172.21.15.129:0/2392400864 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-18T01:44:57.857 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.845+0000 7f821232c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f820c09bd50 0x7f820c132880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:57.857 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.845+0000 7f821232c640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f820c134670 con 0x7f820c09bd50 2024-09-18T01:44:57.857 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.845+0000 7f5101755640 1 -- 172.21.15.129:0/2392400864 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50fc128870 con 0x7f50fc06d910 2024-09-18T01:44:57.857 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.845+0000 7f820bfff640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f820c09bd50 0x7f820c132880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:57.857 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.845+0000 7f820bfff640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f820c09bd50 0x7f820c132880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:48184/0 (socket says 172.21.15.129:48184) 2024-09-18T01:44:57.857 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.845+0000 7f820bfff640 1 -- 172.21.15.129:0/3136598946 learned_addr learned my addr 172.21.15.129:0/3136598946 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-18T01:44:57.858 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.845+0000 7f5101755640 1 --2- 172.21.15.129:0/2392400864 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f50fc06d910 0x7f50fc125ef0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f50f8036040 tx=0x7f50f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:57.858 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.845+0000 7fc6fa00e640 1 Processor -- start 2024-09-18T01:44:57.858 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.845+0000 7f50f1ffb640 1 -- 172.21.15.129:0/2392400864 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50f8042020 con 0x7f50fc06d910 2024-09-18T01:44:57.859 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.846+0000 7f820bfff640 1 -- 172.21.15.129:0/3136598946 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f820c0970d0 con 0x7f820c09bd50 2024-09-18T01:44:57.859 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.846+0000 7f820bfff640 1 --2- 172.21.15.129:0/3136598946 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f820c09bd50 0x7f820c132880 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f81fc00c3d0 tx=0x7f81fc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:57.859 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.846+0000 7fc6fa00e640 1 -- start start 2024-09-18T01:44:57.859 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.846+0000 7f51039b9640 1 -- 172.21.15.129:0/2392400864 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50fc127be0 con 0x7f50fc06d910 2024-09-18T01:44:57.859 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.846+0000 7f50f1ffb640 1 -- 172.21.15.129:0/2392400864 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50f8031830 con 0x7f50fc06d910 2024-09-18T01:44:57.859 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.846+0000 7f50f1ffb640 1 -- 172.21.15.129:0/2392400864 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50f8038040 con 0x7f50fc06d910 2024-09-18T01:44:57.859 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.846+0000 7f51039b9640 1 -- 172.21.15.129:0/2392400864 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50fc08b930 con 0x7f50fc06d910 2024-09-18T01:44:57.860 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.846+0000 7f8208ff9640 1 -- 172.21.15.129:0/3136598946 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81fc007150 con 0x7f820c09bd50 2024-09-18T01:44:57.860 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.846+0000 7f821232c640 1 -- 172.21.15.129:0/3136598946 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f820c126240 con 0x7f820c09bd50 2024-09-18T01:44:57.860 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.846+0000 7f8208ff9640 1 -- 172.21.15.129:0/3136598946 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81fc007310 con 0x7f820c09bd50 2024-09-18T01:44:57.860 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.846+0000 7f821232c640 1 -- 172.21.15.129:0/3136598946 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f820c132fa0 con 0x7f820c09bd50 2024-09-18T01:44:57.860 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.846+0000 7f8208ff9640 1 -- 172.21.15.129:0/3136598946 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81fc007630 con 0x7f820c09bd50 2024-09-18T01:44:57.861 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.846+0000 7fc6fa00e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc6f406eda0 0x7fc6f4127bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:57.861 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.846+0000 7fc6fa00e640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f4122160 con 0x7fc6f406eda0 2024-09-18T01:44:57.861 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.847+0000 7fc6f37fe640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc6f406eda0 0x7fc6f4127bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:57.861 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.847+0000 7fc6f37fe640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc6f406eda0 0x7fc6f4127bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:48196/0 (socket says 172.21.15.129:48196) 2024-09-18T01:44:57.861 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.847+0000 7fc6f37fe640 1 -- 172.21.15.129:0/670135997 learned_addr learned my addr 172.21.15.129:0/670135997 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-18T01:44:57.862 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.847+0000 7fc6f37fe640 1 -- 172.21.15.129:0/670135997 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6f4125d80 con 0x7fc6f406eda0 2024-09-18T01:44:57.862 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.847+0000 7f51039b9640 1 -- 172.21.15.129:0/2392400864 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50fc127740 con 0x7f50fc06d910 2024-09-18T01:44:57.862 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.847+0000 7f50f1ffb640 1 -- 172.21.15.129:0/2392400864 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f50f8045020 con 0x7f50fc06d910 2024-09-18T01:44:57.862 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.848+0000 7f50f1ffb640 1 --2- 172.21.15.129:0/2392400864 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f50e003c700 0x7f50e003ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:57.862 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.848+0000 7f50f1ffb640 1 -- 172.21.15.129:0/2392400864 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f50f806bf30 con 0x7f50fc06d910 2024-09-18T01:44:57.862 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.848+0000 7f8208ff9640 1 -- 172.21.15.129:0/3136598946 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f81fc019020 con 0x7f820c09bd50 2024-09-18T01:44:57.863 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.848+0000 7fc6f37fe640 1 --2- 172.21.15.129:0/670135997 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc6f406eda0 0x7fc6f4127bf0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4009720 tx=0x7fc6e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:57.863 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.848+0000 7f821232c640 1 -- 172.21.15.129:0/3136598946 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81ec005080 con 0x7f820c09bd50 2024-09-18T01:44:57.863 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.848+0000 7f8208ff9640 1 --2- 172.21.15.129:0/3136598946 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f81f80382a0 0x7f81f803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:57.863 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.848+0000 7f8208ff9640 1 -- 172.21.15.129:0/3136598946 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f81fc017020 con 0x7f820c09bd50 2024-09-18T01:44:57.863 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.848+0000 7f5100f54640 1 --2- 172.21.15.129:0/2392400864 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f50e003c700 0x7f50e003ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:57.864 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.848+0000 7f820b7fe640 1 --2- 172.21.15.129:0/3136598946 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f81f80382a0 0x7f81f803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:57.864 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.849+0000 7f5100f54640 1 --2- 172.21.15.129:0/2392400864 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f50e003c700 0x7f50e003ebc0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f50ec007fd0 tx=0x7f50ec007ac0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:57.864 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.849+0000 7f820b7fe640 1 --2- 172.21.15.129:0/3136598946 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f81f80382a0 0x7f81f803a760 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8200034000 tx=0x7f820002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:57.865 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.852+0000 7fc6dbfff640 1 -- 172.21.15.129:0/670135997 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6e4042070 con 0x7fc6f406eda0 2024-09-18T01:44:57.865 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.852+0000 7fc6fa00e640 1 -- 172.21.15.129:0/670135997 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6f408cf30 con 0x7fc6f406eda0 2024-09-18T01:44:57.865 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.852+0000 7fc6fa00e640 1 -- 172.21.15.129:0/670135997 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6f408b8f0 con 0x7fc6f406eda0 2024-09-18T01:44:57.865 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.853+0000 7f50f1ffb640 1 -- 172.21.15.129:0/2392400864 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f50f804c030 con 0x7f50fc06d910 2024-09-18T01:44:57.866 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.853+0000 7fc6fa00e640 1 -- 172.21.15.129:0/670135997 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6f408bec0 con 0x7fc6f406eda0 2024-09-18T01:44:57.866 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.857+0000 7fc6dbfff640 1 -- 172.21.15.129:0/670135997 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6e403e460 con 0x7fc6f406eda0 2024-09-18T01:44:57.866 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.857+0000 7fc6dbfff640 1 -- 172.21.15.129:0/670135997 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6e404c060 con 0x7fc6f406eda0 2024-09-18T01:44:57.866 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.857+0000 7f8208ff9640 1 -- 172.21.15.129:0/3136598946 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f81fc049b80 con 0x7f820c09bd50 2024-09-18T01:44:57.867 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.857+0000 7fc6dbfff640 1 -- 172.21.15.129:0/670135997 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc6e4045070 con 0x7fc6f406eda0 2024-09-18T01:44:57.867 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.858+0000 7fc6dbfff640 1 --2- 172.21.15.129:0/670135997 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc6e00382a0 0x7fc6e003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:57.867 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.858+0000 7fc6dbfff640 1 -- 172.21.15.129:0/670135997 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7fc6e406c0d0 con 0x7fc6f406eda0 2024-09-18T01:44:57.867 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.858+0000 7fc6f2ffd640 1 --2- 172.21.15.129:0/670135997 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc6e00382a0 0x7fc6e003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:57.867 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.859+0000 7fc6f2ffd640 1 --2- 172.21.15.129:0/670135997 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc6e00382a0 0x7fc6e003a760 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8001610 tx=0x7fc6e8007970 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:57.867 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.862+0000 7fc6dbfff640 1 -- 172.21.15.129:0/670135997 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc6e402ae20 con 0x7fc6f406eda0 2024-09-18T01:44:57.989 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.988+0000 7f7dd2bf6640 1 -- 172.21.15.129:0/3284759990 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f7dcc1260b0 con 0x7f7dcc09a100 2024-09-18T01:44:57.990 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.988+0000 7f7dc97fa640 1 -- 172.21.15.129:0/3284759990 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7dcc09d3b0 con 0x7f7dcc09a100 2024-09-18T01:44:57.990 INFO:teuthology.orchestra.run.smithi129.stdout:38654705667 2024-09-18T01:44:57.992 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.991+0000 7f7dd2bf6640 1 -- 172.21.15.129:0/3284759990 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7db00382a0 msgr2=0x7f7db003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:57.992 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.991+0000 7f7dd2bf6640 1 --2- 172.21.15.129:0/3284759990 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7db00382a0 0x7f7db003a760 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7db8034000 tx=0x7f7db802e000 comp rx=0 tx=0).stop 2024-09-18T01:44:57.992 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.991+0000 7f7dd2bf6640 1 -- 172.21.15.129:0/3284759990 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7dcc09a100 msgr2=0x7f7dcc1c3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:57.992 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.991+0000 7f7dd2bf6640 1 --2- 172.21.15.129:0/3284759990 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7dcc09a100 0x7f7dcc1c3990 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7dc000c4a0 tx=0x7f7dc000c960 comp rx=0 tx=0).stop 2024-09-18T01:44:57.992 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.991+0000 7f7dd2bf6640 1 -- 172.21.15.129:0/3284759990 shutdown_connections 2024-09-18T01:44:57.992 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.991+0000 7f7dd2bf6640 1 --2- 172.21.15.129:0/3284759990 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7db00382a0 0x7f7db003a760 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:57.993 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.991+0000 7f7dd2bf6640 1 --2- 172.21.15.129:0/3284759990 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7dcc09a100 0x7f7dcc1c3990 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:57.993 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.991+0000 7f7dd2bf6640 1 -- 172.21.15.129:0/3284759990 >> 172.21.15.129:0/3284759990 conn(0x7f7dcc06d4a0 msgr2=0x7f7dcc096af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:57.993 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.991+0000 7f7dd2bf6640 1 -- 172.21.15.129:0/3284759990 shutdown_connections 2024-09-18T01:44:57.993 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:57.991+0000 7f7dd2bf6640 1 -- 172.21.15.129:0/3284759990 wait complete. 2024-09-18T01:44:58.003 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.2 2024-09-18T01:44:58.032 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:58.031+0000 7f51039b9640 1 -- 172.21.15.129:0/2392400864 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f50fc09a580 con 0x7f50fc06d910 2024-09-18T01:44:58.032 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:58.031+0000 7f50f1ffb640 1 -- 172.21.15.129:0/2392400864 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f50f8032e80 con 0x7f50fc06d910 2024-09-18T01:44:58.033 INFO:teuthology.orchestra.run.smithi129.stdout:38654705667 2024-09-18T01:44:58.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:58.033+0000 7f51039b9640 1 -- 172.21.15.129:0/2392400864 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f50e003c700 msgr2=0x7f50e003ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:58.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:58.033+0000 7f51039b9640 1 --2- 172.21.15.129:0/2392400864 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f50e003c700 0x7f50e003ebc0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f50ec007fd0 tx=0x7f50ec007ac0 comp rx=0 tx=0).stop 2024-09-18T01:44:58.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:58.033+0000 7f51039b9640 1 -- 172.21.15.129:0/2392400864 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f50fc06d910 msgr2=0x7f50fc125ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:58.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:58.033+0000 7f51039b9640 1 --2- 172.21.15.129:0/2392400864 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f50fc06d910 0x7f50fc125ef0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f50f8036040 tx=0x7f50f80046c0 comp rx=0 tx=0).stop 2024-09-18T01:44:58.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:58.033+0000 7f51039b9640 1 -- 172.21.15.129:0/2392400864 shutdown_connections 2024-09-18T01:44:58.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:58.033+0000 7f51039b9640 1 --2- 172.21.15.129:0/2392400864 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f50e003c700 0x7f50e003ebc0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:58.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:58.033+0000 7f51039b9640 1 --2- 172.21.15.129:0/2392400864 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f50fc06d910 0x7f50fc125ef0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:58.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:58.033+0000 7f51039b9640 1 -- 172.21.15.129:0/2392400864 >> 172.21.15.129:0/2392400864 conn(0x7f50fc09a890 msgr2=0x7f50fc0717d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:58.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:58.033+0000 7f51039b9640 1 -- 172.21.15.129:0/2392400864 shutdown_connections 2024-09-18T01:44:58.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:58.033+0000 7f51039b9640 1 -- 172.21.15.129:0/2392400864 wait complete. 2024-09-18T01:44:58.046 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.0 2024-09-18T01:44:58.121 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:58.120+0000 7f821232c640 1 -- 172.21.15.129:0/3136598946 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f81ec005370 con 0x7f820c09bd50 2024-09-18T01:44:58.122 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:58.121+0000 7f8208ff9640 1 -- 172.21.15.129:0/3136598946 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f81fc011910 con 0x7f820c09bd50 2024-09-18T01:44:58.122 INFO:teuthology.orchestra.run.smithi129.stdout:38654705667 2024-09-18T01:44:58.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:58.123+0000 7f821232c640 1 -- 172.21.15.129:0/3136598946 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f81f80382a0 msgr2=0x7f81f803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:58.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:58.123+0000 7f821232c640 1 --2- 172.21.15.129:0/3136598946 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f81f80382a0 0x7f81f803a760 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8200034000 tx=0x7f820002e000 comp rx=0 tx=0).stop 2024-09-18T01:44:58.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:58.123+0000 7f821232c640 1 -- 172.21.15.129:0/3136598946 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f820c09bd50 msgr2=0x7f820c132880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:58.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:58.123+0000 7f821232c640 1 --2- 172.21.15.129:0/3136598946 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f820c09bd50 0x7f820c132880 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f81fc00c3d0 tx=0x7f81fc00c890 comp rx=0 tx=0).stop 2024-09-18T01:44:58.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:58.123+0000 7f821232c640 1 -- 172.21.15.129:0/3136598946 shutdown_connections 2024-09-18T01:44:58.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:58.123+0000 7f821232c640 1 --2- 172.21.15.129:0/3136598946 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f81f80382a0 0x7f81f803a760 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:58.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:58.123+0000 7f821232c640 1 --2- 172.21.15.129:0/3136598946 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f820c09bd50 0x7f820c132880 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:58.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:58.123+0000 7f821232c640 1 -- 172.21.15.129:0/3136598946 >> 172.21.15.129:0/3136598946 conn(0x7f820c06d4a0 msgr2=0x7f820c08d840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:58.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:58.123+0000 7f821232c640 1 -- 172.21.15.129:0/3136598946 shutdown_connections 2024-09-18T01:44:58.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:58.123+0000 7f821232c640 1 -- 172.21.15.129:0/3136598946 wait complete. 2024-09-18T01:44:58.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:58.125+0000 7fc6fa00e640 1 -- 172.21.15.129:0/670135997 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fc6f4122670 con 0x7fc6f406eda0 2024-09-18T01:44:58.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:58.125+0000 7fc6dbfff640 1 -- 172.21.15.129:0/670135997 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc6e40507e0 con 0x7fc6f406eda0 2024-09-18T01:44:58.126 INFO:teuthology.orchestra.run.smithi129.stdout:38654705667 2024-09-18T01:44:58.129 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:58.127+0000 7fc6fa00e640 1 -- 172.21.15.129:0/670135997 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc6e00382a0 msgr2=0x7fc6e003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:58.129 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:58.127+0000 7fc6fa00e640 1 --2- 172.21.15.129:0/670135997 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc6e00382a0 0x7fc6e003a760 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8001610 tx=0x7fc6e8007970 comp rx=0 tx=0).stop 2024-09-18T01:44:58.129 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:58.127+0000 7fc6fa00e640 1 -- 172.21.15.129:0/670135997 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc6f406eda0 msgr2=0x7fc6f4127bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:58.129 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:58.127+0000 7fc6fa00e640 1 --2- 172.21.15.129:0/670135997 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc6f406eda0 0x7fc6f4127bf0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4009720 tx=0x7fc6e40046c0 comp rx=0 tx=0).stop 2024-09-18T01:44:58.129 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:58.128+0000 7fc6fa00e640 1 -- 172.21.15.129:0/670135997 shutdown_connections 2024-09-18T01:44:58.129 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:58.128+0000 7fc6fa00e640 1 --2- 172.21.15.129:0/670135997 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc6e00382a0 0x7fc6e003a760 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:58.129 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:58.128+0000 7fc6fa00e640 1 --2- 172.21.15.129:0/670135997 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc6f406eda0 0x7fc6f4127bf0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:58.129 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:58.128+0000 7fc6fa00e640 1 -- 172.21.15.129:0/670135997 >> 172.21.15.129:0/670135997 conn(0x7fc6f409a890 msgr2=0x7fc6f4071f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:58.129 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:58.128+0000 7fc6fa00e640 1 -- 172.21.15.129:0/670135997 shutdown_connections 2024-09-18T01:44:58.130 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:58.128+0000 7fc6fa00e640 1 -- 172.21.15.129:0/670135997 wait complete. 2024-09-18T01:44:58.137 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.1 2024-09-18T01:44:58.141 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.3 2024-09-18T01:44:59.004 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-18T01:44:59.047 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-18T01:44:59.117 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.116+0000 7fc6dfa77640 1 Processor -- start 2024-09-18T01:44:59.117 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.116+0000 7fc6dfa77640 1 -- start start 2024-09-18T01:44:59.118 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.116+0000 7fc6dfa77640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fc6d809a100 0x7fc6d8133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:59.118 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.116+0000 7fc6dfa77640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6d809d3b0 con 0x7fc6d809bd50 2024-09-18T01:44:59.118 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.116+0000 7fc6dfa77640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x7fc6d809c840 con 0x7fc6d809a100 2024-09-18T01:44:59.118 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.116+0000 7fc6dd012640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fc6d809a100 0x7fc6d8133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:59.118 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.116+0000 7fc6dd813640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fc6d809bd50 0x7fc6d809c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40590/0 (socket says 172.21.15.129:40590) 2024-09-18T01:44:59.118 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.116+0000 7fc6dd813640 1 -- 172.21.15.129:0/2297871384 learned_addr learned my addr 172.21.15.129:0/2297871384 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-09-18T01:44:59.118 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.117+0000 7fc6dd012640 1 -- 172.21.15.129:0/2297871384 >> v1:172.21.15.129:6789/0 conn(0x7fc6d809bd50 legacy=0x7fc6d809c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:59.118 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.117+0000 7fc6dd012640 1 -- 172.21.15.129:0/2297871384 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6d8098230 con 0x7fc6d809a100 2024-09-18T01:44:59.119 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.117+0000 7fc6dd012640 1 --2- 172.21.15.129:0/2297871384 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc6d809a100 0x7fc6d8133da0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc009720 tx=0x7fc6cc02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a3f04df55b623ae server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:59.120 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.118+0000 7fc6dc811640 1 -- 172.21.15.129:0/2297871384 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6cc037070 con 0x7fc6d809a100 2024-09-18T01:44:59.120 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.118+0000 7fc6dc811640 1 -- 172.21.15.129:0/2297871384 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6cc02ad90 con 0x7fc6d809a100 2024-09-18T01:44:59.120 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.118+0000 7fc6dc811640 1 -- 172.21.15.129:0/2297871384 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6cc032590 con 0x7fc6d809a100 2024-09-18T01:44:59.120 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.118+0000 7fc6dfa77640 1 -- 172.21.15.129:0/2297871384 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc6d809a100 msgr2=0x7fc6d8133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:59.120 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.118+0000 7fc6dfa77640 1 --2- 172.21.15.129:0/2297871384 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc6d809a100 0x7fc6d8133da0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc009720 tx=0x7fc6cc02a110 comp rx=0 tx=0).stop 2024-09-18T01:44:59.120 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.118+0000 7fc6dfa77640 1 -- 172.21.15.129:0/2297871384 shutdown_connections 2024-09-18T01:44:59.120 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.118+0000 7fc6dfa77640 1 --2- 172.21.15.129:0/2297871384 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc6d809a100 0x7fc6d8133da0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:59.120 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.118+0000 7fc6dfa77640 1 -- 172.21.15.129:0/2297871384 >> 172.21.15.129:0/2297871384 conn(0x7fc6d806d4a0 msgr2=0x7fc6d806d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:59.120 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.118+0000 7fc6dfa77640 1 -- 172.21.15.129:0/2297871384 shutdown_connections 2024-09-18T01:44:59.120 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.118+0000 7fc6dfa77640 1 -- 172.21.15.129:0/2297871384 wait complete. 2024-09-18T01:44:59.122 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.119+0000 7fc6dfa77640 1 Processor -- start 2024-09-18T01:44:59.122 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.119+0000 7fc6dfa77640 1 -- start start 2024-09-18T01:44:59.122 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.120+0000 7fc6dfa77640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc6d809a100 0x7fc6d81c3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:59.122 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.120+0000 7fc6dfa77640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d8134670 con 0x7fc6d809a100 2024-09-18T01:44:59.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.120+0000 7fc6dd813640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc6d809a100 0x7fc6d81c3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:59.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.120+0000 7fc6dd813640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc6d809a100 0x7fc6d81c3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:48226/0 (socket says 172.21.15.129:48226) 2024-09-18T01:44:59.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.120+0000 7fc6dd813640 1 -- 172.21.15.129:0/2439513707 learned_addr learned my addr 172.21.15.129:0/2439513707 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-18T01:44:59.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.120+0000 7fc6dd813640 1 -- 172.21.15.129:0/2439513707 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6d8125ee0 con 0x7fc6d809a100 2024-09-18T01:44:59.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.120+0000 7fc6dd813640 1 --2- 172.21.15.129:0/2439513707 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc6d809a100 0x7fc6d81c3990 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc6d000c4a0 tx=0x7fc6d000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:59.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.120+0000 7fc6ca7fc640 1 -- 172.21.15.129:0/2439513707 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6d0017070 con 0x7fc6d809a100 2024-09-18T01:44:59.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.120+0000 7fc6ca7fc640 1 -- 172.21.15.129:0/2439513707 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6d0005c10 con 0x7fc6d809a100 2024-09-18T01:44:59.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.120+0000 7fc6dfa77640 1 -- 172.21.15.129:0/2439513707 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6d8095510 con 0x7fc6d809a100 2024-09-18T01:44:59.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.120+0000 7fc6ca7fc640 1 -- 172.21.15.129:0/2439513707 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6d0007070 con 0x7fc6d809a100 2024-09-18T01:44:59.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.120+0000 7fc6dfa77640 1 -- 172.21.15.129:0/2439513707 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6d80961a0 con 0x7fc6d809a100 2024-09-18T01:44:59.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.121+0000 7fc6ca7fc640 1 -- 172.21.15.129:0/2439513707 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc6d001a070 con 0x7fc6d809a100 2024-09-18T01:44:59.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.121+0000 7fc6ca7fc640 1 --2- 172.21.15.129:0/2439513707 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc6bc0382a0 0x7fc6bc03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:59.123 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.121+0000 7fc6ca7fc640 1 -- 172.21.15.129:0/2439513707 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7fc6d004a530 con 0x7fc6d809a100 2024-09-18T01:44:59.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.122+0000 7fc6dfa77640 1 -- 172.21.15.129:0/2439513707 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6d8096490 con 0x7fc6d809a100 2024-09-18T01:44:59.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.122+0000 7fc6dd012640 1 --2- 172.21.15.129:0/2439513707 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc6bc0382a0 0x7fc6bc03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:59.124 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.122+0000 7fc6dd012640 1 --2- 172.21.15.129:0/2439513707 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc6bc0382a0 0x7fc6bc03a760 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc034000 tx=0x7fc6cc02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:59.128 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.126+0000 7fc6ca7fc640 1 -- 172.21.15.129:0/2439513707 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc6d8096490 con 0x7fc6d809a100 2024-09-18T01:44:59.138 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-18T01:44:59.142 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-18T01:44:59.171 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.166+0000 7f7000cba640 1 Processor -- start 2024-09-18T01:44:59.171 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.166+0000 7f7000cba640 1 -- start start 2024-09-18T01:44:59.171 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.166+0000 7f7000cba640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f6ffc12e6f0 0x7f6ffc12ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:59.171 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.166+0000 7f7000cba640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ffc06e9a0 con 0x7f6ffc12f010 2024-09-18T01:44:59.171 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.166+0000 7f7000cba640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x7f6ffc12f420 con 0x7f6ffc12e6f0 2024-09-18T01:44:59.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.167+0000 7f6ffa59c640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f6ffc12e6f0 0x7f6ffc12ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:59.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.167+0000 7f6ffa59c640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f6ffc12e6f0 0x7f6ffc12ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:48234/0 (socket says 172.21.15.129:48234) 2024-09-18T01:44:59.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.167+0000 7f6ffa59c640 1 -- 172.21.15.129:0/3673048430 learned_addr learned my addr 172.21.15.129:0/3673048430 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-18T01:44:59.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.167+0000 7f6ff9d9b640 1 --1- 172.21.15.129:0/3673048430 >> v1:172.21.15.129:6789/0 conn(0x7f6ffc12f010 0x7f6ffc12b170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40606/0 (socket says 172.21.15.129:40606) 2024-09-18T01:44:59.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.167+0000 7f6ffa59c640 1 -- 172.21.15.129:0/3673048430 >> v1:172.21.15.129:6789/0 conn(0x7f6ffc12f010 legacy=0x7f6ffc12b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:59.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.167+0000 7f6ff959a640 1 -- 172.21.15.129:0/3673048430 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3316349130 0 0) 0x7f6ffc06e9a0 con 0x7f6ffc12f010 2024-09-18T01:44:59.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.167+0000 7f6ffa59c640 1 -- 172.21.15.129:0/3673048430 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ffc12f5a0 con 0x7f6ffc12e6f0 2024-09-18T01:44:59.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.168+0000 7f6ffa59c640 1 --2- 172.21.15.129:0/3673048430 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6ffc12e6f0 0x7f6ffc12ead0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6fec0097f0 tx=0x7f6fec02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f503cb5fc42fff8 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:59.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.168+0000 7f6ff959a640 1 -- 172.21.15.129:0/3673048430 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fec037070 con 0x7f6ffc12e6f0 2024-09-18T01:44:59.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.168+0000 7f6ff959a640 1 -- 172.21.15.129:0/3673048430 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fec032440 con 0x7f6ffc12e6f0 2024-09-18T01:44:59.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.168+0000 7f6ff959a640 1 -- 172.21.15.129:0/3673048430 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fec02ae60 con 0x7f6ffc12e6f0 2024-09-18T01:44:59.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.169+0000 7f7000cba640 1 -- 172.21.15.129:0/3673048430 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6ffc12e6f0 msgr2=0x7f6ffc12ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:59.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.169+0000 7f7000cba640 1 --2- 172.21.15.129:0/3673048430 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6ffc12e6f0 0x7f6ffc12ead0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6fec0097f0 tx=0x7f6fec02a1e0 comp rx=0 tx=0).stop 2024-09-18T01:44:59.172 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.169+0000 7f7000cba640 1 -- 172.21.15.129:0/3673048430 shutdown_connections 2024-09-18T01:44:59.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.169+0000 7f7000cba640 1 --2- 172.21.15.129:0/3673048430 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6ffc12e6f0 0x7f6ffc12ead0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:59.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.169+0000 7f7000cba640 1 -- 172.21.15.129:0/3673048430 >> 172.21.15.129:0/3673048430 conn(0x7f6ffc09f020 msgr2=0x7f6ffc09f430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:59.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.169+0000 7f7000cba640 1 -- 172.21.15.129:0/3673048430 shutdown_connections 2024-09-18T01:44:59.173 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.169+0000 7f7000cba640 1 -- 172.21.15.129:0/3673048430 wait complete. 2024-09-18T01:44:59.175 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.170+0000 7f7000cba640 1 Processor -- start 2024-09-18T01:44:59.175 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.170+0000 7f7000cba640 1 -- start start 2024-09-18T01:44:59.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.170+0000 7f7000cba640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6ffc12e6f0 0x7f6ffc127760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:59.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.170+0000 7f7000cba640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f6ffc12bc10 con 0x7f6ffc12e6f0 2024-09-18T01:44:59.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.170+0000 7f6ffa59c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6ffc12e6f0 0x7f6ffc127760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:59.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.170+0000 7f6ffa59c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6ffc12e6f0 0x7f6ffc127760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:48244/0 (socket says 172.21.15.129:48244) 2024-09-18T01:44:59.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.170+0000 7f6ffa59c640 1 -- 172.21.15.129:0/785312575 learned_addr learned my addr 172.21.15.129:0/785312575 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-18T01:44:59.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.171+0000 7f6ffa59c640 1 -- 172.21.15.129:0/785312575 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ffc08b6c0 con 0x7f6ffc12e6f0 2024-09-18T01:44:59.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.171+0000 7f6ffa59c640 1 --2- 172.21.15.129:0/785312575 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6ffc12e6f0 0x7f6ffc127760 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6fec035040 tx=0x7f6fec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:59.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.171+0000 7f6feaffd640 1 -- 172.21.15.129:0/785312575 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fec041020 con 0x7f6ffc12e6f0 2024-09-18T01:44:59.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.171+0000 7f6feaffd640 1 -- 172.21.15.129:0/785312575 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fec0306c0 con 0x7f6ffc12e6f0 2024-09-18T01:44:59.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.171+0000 7f6feaffd640 1 -- 172.21.15.129:0/785312575 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fec037040 con 0x7f6ffc12e6f0 2024-09-18T01:44:59.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.171+0000 7f7000cba640 1 -- 172.21.15.129:0/785312575 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ffc128e60 con 0x7f6ffc12e6f0 2024-09-18T01:44:59.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.171+0000 7f7000cba640 1 -- 172.21.15.129:0/785312575 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ffc08c530 con 0x7f6ffc12e6f0 2024-09-18T01:44:59.176 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.172+0000 7f7000cba640 1 -- 172.21.15.129:0/785312575 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ffc08b220 con 0x7f6ffc12e6f0 2024-09-18T01:44:59.177 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.173+0000 7f6feaffd640 1 -- 172.21.15.129:0/785312575 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6fec044020 con 0x7f6ffc12e6f0 2024-09-18T01:44:59.177 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.173+0000 7f6feaffd640 1 --2- 172.21.15.129:0/785312575 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6fdc0382a0 0x7f6fdc03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:59.177 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.173+0000 7f6feaffd640 1 -- 172.21.15.129:0/785312575 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f6fec06bc80 con 0x7f6ffc12e6f0 2024-09-18T01:44:59.177 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.173+0000 7f6ff9d9b640 1 --2- 172.21.15.129:0/785312575 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6fdc0382a0 0x7f6fdc03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:59.177 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.174+0000 7f6ff9d9b640 1 --2- 172.21.15.129:0/785312575 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6fdc0382a0 0x7f6fdc03a760 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0000c00 tx=0x7f6ff0007910 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:59.179 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.178+0000 7f6feaffd640 1 -- 172.21.15.129:0/785312575 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6fec04b030 con 0x7f6ffc12e6f0 2024-09-18T01:44:59.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.242+0000 7f9a6dd91640 1 Processor -- start 2024-09-18T01:44:59.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.242+0000 7f9a6dd91640 1 -- start start 2024-09-18T01:44:59.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.242+0000 7f9a6dd91640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f9a6812f1e0 0x7f9a68133a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:59.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.242+0000 7f9a6dd91640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a6806e9a0 con 0x7f9a6812e6f0 2024-09-18T01:44:59.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.242+0000 7f9a6dd91640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x7f9a6812f5f0 con 0x7f9a6812f1e0 2024-09-18T01:44:59.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.242+0000 7f9a66ffd640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f9a6812f1e0 0x7f9a68133a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:59.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.242+0000 7f9a677fe640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f9a6812e6f0 0x7f9a6812ead0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40612/0 (socket says 172.21.15.129:40612) 2024-09-18T01:44:59.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.242+0000 7f9a677fe640 1 -- 172.21.15.129:0/1907202344 learned_addr learned my addr 172.21.15.129:0/1907202344 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-09-18T01:44:59.244 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.243+0000 7f9a66ffd640 1 -- 172.21.15.129:0/1907202344 >> v1:172.21.15.129:6789/0 conn(0x7f9a6812e6f0 legacy=0x7f9a6812ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:59.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.243+0000 7f9a66ffd640 1 -- 172.21.15.129:0/1907202344 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a68134fc0 con 0x7f9a6812f1e0 2024-09-18T01:44:59.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.243+0000 7f9a66ffd640 1 --2- 172.21.15.129:0/1907202344 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9a6812f1e0 0x7f9a68133a70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c009720 tx=0x7f9a5c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29793ee5083d11b server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:59.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.244+0000 7f9a667fc640 1 -- 172.21.15.129:0/1907202344 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a5c037070 con 0x7f9a6812f1e0 2024-09-18T01:44:59.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.244+0000 7f9a667fc640 1 -- 172.21.15.129:0/1907202344 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a5c02ad90 con 0x7f9a6812f1e0 2024-09-18T01:44:59.245 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.244+0000 7f9a667fc640 1 -- 172.21.15.129:0/1907202344 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a5c032590 con 0x7f9a6812f1e0 2024-09-18T01:44:59.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.244+0000 7f9a6dd91640 1 -- 172.21.15.129:0/1907202344 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9a6812f1e0 msgr2=0x7f9a68133a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:59.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.244+0000 7f9a6dd91640 1 --2- 172.21.15.129:0/1907202344 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9a6812f1e0 0x7f9a68133a70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c009720 tx=0x7f9a5c02a110 comp rx=0 tx=0).stop 2024-09-18T01:44:59.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.244+0000 7f9a6dd91640 1 -- 172.21.15.129:0/1907202344 shutdown_connections 2024-09-18T01:44:59.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.244+0000 7f9a6dd91640 1 --2- 172.21.15.129:0/1907202344 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9a6812f1e0 0x7f9a68133a70 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:59.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.244+0000 7f9a6dd91640 1 -- 172.21.15.129:0/1907202344 >> 172.21.15.129:0/1907202344 conn(0x7f9a6809f020 msgr2=0x7f9a6809f430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:59.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.244+0000 7f9a6dd91640 1 -- 172.21.15.129:0/1907202344 shutdown_connections 2024-09-18T01:44:59.246 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.244+0000 7f9a6dd91640 1 -- 172.21.15.129:0/1907202344 wait complete. 2024-09-18T01:44:59.247 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.245+0000 7f9a6dd91640 1 Processor -- start 2024-09-18T01:44:59.247 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.246+0000 7f9a6dd91640 1 -- start start 2024-09-18T01:44:59.247 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.246+0000 7f9a6dd91640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9a6812e6f0 0x7f9a68131e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:59.247 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.246+0000 7f9a6dd91640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f9a68134340 con 0x7f9a6812e6f0 2024-09-18T01:44:59.248 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.246+0000 7f9a677fe640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9a6812e6f0 0x7f9a68131e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:59.248 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.246+0000 7f9a677fe640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9a6812e6f0 0x7f9a68131e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:48266/0 (socket says 172.21.15.129:48266) 2024-09-18T01:44:59.248 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.246+0000 7f9a677fe640 1 -- 172.21.15.129:0/2925788915 learned_addr learned my addr 172.21.15.129:0/2925788915 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-18T01:44:59.248 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.246+0000 7f9a677fe640 1 -- 172.21.15.129:0/2925788915 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a68133610 con 0x7f9a6812e6f0 2024-09-18T01:44:59.249 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.247+0000 7f9a677fe640 1 --2- 172.21.15.129:0/2925788915 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9a6812e6f0 0x7f9a68131e00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9a5800c480 tx=0x7f9a5800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:59.249 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.247+0000 7f9a4ffff640 1 -- 172.21.15.129:0/2925788915 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a58017070 con 0x7f9a6812e6f0 2024-09-18T01:44:59.249 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.247+0000 7f9a4ffff640 1 -- 172.21.15.129:0/2925788915 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a58005c10 con 0x7f9a6812e6f0 2024-09-18T01:44:59.249 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.247+0000 7f9a4ffff640 1 -- 172.21.15.129:0/2925788915 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a580070d0 con 0x7f9a6812e6f0 2024-09-18T01:44:59.249 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.247+0000 7f9a6dd91640 1 -- 172.21.15.129:0/2925788915 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a68125250 con 0x7f9a6812e6f0 2024-09-18T01:44:59.249 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.247+0000 7f9a6dd91640 1 -- 172.21.15.129:0/2925788915 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a68132340 con 0x7f9a6812e6f0 2024-09-18T01:44:59.250 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.248+0000 7f9a6dd91640 1 -- 172.21.15.129:0/2925788915 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a68124a40 con 0x7f9a6812e6f0 2024-09-18T01:44:59.250 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.248+0000 7f9a4ffff640 1 -- 172.21.15.129:0/2925788915 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9a5801a070 con 0x7f9a6812e6f0 2024-09-18T01:44:59.250 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.249+0000 7f9a4ffff640 1 --2- 172.21.15.129:0/2925788915 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9a540382d0 0x7f9a5403a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:59.250 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.249+0000 7f9a4ffff640 1 -- 172.21.15.129:0/2925788915 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f9a5804a570 con 0x7f9a6812e6f0 2024-09-18T01:44:59.250 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.249+0000 7f9a66ffd640 1 --2- 172.21.15.129:0/2925788915 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9a540382d0 0x7f9a5403a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:59.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.250+0000 7f9a66ffd640 1 --2- 172.21.15.129:0/2925788915 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9a540382d0 0x7f9a5403a790 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c034000 tx=0x7f9a5c02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:59.254 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.253+0000 7f9a4ffff640 1 -- 172.21.15.129:0/2925788915 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9a58007270 con 0x7f9a6812e6f0 2024-09-18T01:44:59.273 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.272+0000 7f9d46f3b640 1 Processor -- start 2024-09-18T01:44:59.273 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.272+0000 7f9d46f3b640 1 -- start start 2024-09-18T01:44:59.273 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.272+0000 7f9d46f3b640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f9d4009bd50 0x7f9d4009c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:59.273 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.272+0000 7f9d46f3b640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d4009d3b0 con 0x7f9d4009c670 2024-09-18T01:44:59.274 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.272+0000 7f9d46f3b640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x7f9d40098230 con 0x7f9d4009bd50 2024-09-18T01:44:59.274 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.272+0000 7f9d44cd7640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f9d4009bd50 0x7f9d4009c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:59.274 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.272+0000 7f9d3ffff640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f9d4009c670 0x7f9d400990f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40618/0 (socket says 172.21.15.129:40618) 2024-09-18T01:44:59.274 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.272+0000 7f9d3ffff640 1 -- 172.21.15.129:0/1783949851 learned_addr learned my addr 172.21.15.129:0/1783949851 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-09-18T01:44:59.274 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.273+0000 7f9d44cd7640 1 -- 172.21.15.129:0/1783949851 >> v1:172.21.15.129:6789/0 conn(0x7f9d4009c670 legacy=0x7f9d400990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:59.274 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.273+0000 7f9d44cd7640 1 -- 172.21.15.129:0/1783949851 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d400983e0 con 0x7f9d4009bd50 2024-09-18T01:44:59.275 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.274+0000 7f9d44cd7640 1 --2- 172.21.15.129:0/1783949851 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9d4009bd50 0x7f9d4009c130 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9d34009720 tx=0x7f9d3402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42274a8aba81b5fd server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:59.275 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.274+0000 7f9d3f7fe640 1 -- 172.21.15.129:0/1783949851 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d34037070 con 0x7f9d4009bd50 2024-09-18T01:44:59.275 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.274+0000 7f9d3f7fe640 1 -- 172.21.15.129:0/1783949851 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d3402ad90 con 0x7f9d4009bd50 2024-09-18T01:44:59.275 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.274+0000 7f9d3f7fe640 1 -- 172.21.15.129:0/1783949851 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d34032590 con 0x7f9d4009bd50 2024-09-18T01:44:59.276 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.274+0000 7f9d46f3b640 1 -- 172.21.15.129:0/1783949851 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9d4009bd50 msgr2=0x7f9d4009c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:59.276 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.274+0000 7f9d46f3b640 1 --2- 172.21.15.129:0/1783949851 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9d4009bd50 0x7f9d4009c130 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9d34009720 tx=0x7f9d3402a110 comp rx=0 tx=0).stop 2024-09-18T01:44:59.276 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.274+0000 7f9d46f3b640 1 -- 172.21.15.129:0/1783949851 shutdown_connections 2024-09-18T01:44:59.276 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.274+0000 7f9d46f3b640 1 --2- 172.21.15.129:0/1783949851 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9d4009bd50 0x7f9d4009c130 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:59.276 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.275+0000 7f9d46f3b640 1 -- 172.21.15.129:0/1783949851 >> 172.21.15.129:0/1783949851 conn(0x7f9d4006d4a0 msgr2=0x7f9d4006d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:59.276 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.275+0000 7f9d46f3b640 1 -- 172.21.15.129:0/1783949851 shutdown_connections 2024-09-18T01:44:59.276 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.275+0000 7f9d46f3b640 1 -- 172.21.15.129:0/1783949851 wait complete. 2024-09-18T01:44:59.277 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.275+0000 7f9d46f3b640 1 Processor -- start 2024-09-18T01:44:59.277 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.275+0000 7f9d46f3b640 1 -- start start 2024-09-18T01:44:59.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.276+0000 7f9d46f3b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9d4009c670 0x7f9d40093340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:59.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.276+0000 7f9d46f3b640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f9d40099b90 con 0x7f9d4009c670 2024-09-18T01:44:59.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.276+0000 7f9d44cd7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9d4009c670 0x7f9d40093340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:59.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.276+0000 7f9d44cd7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9d4009c670 0x7f9d40093340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:48274/0 (socket says 172.21.15.129:48274) 2024-09-18T01:44:59.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.276+0000 7f9d44cd7640 1 -- 172.21.15.129:0/3458644151 learned_addr learned my addr 172.21.15.129:0/3458644151 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-18T01:44:59.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.277+0000 7f9d44cd7640 1 -- 172.21.15.129:0/3458644151 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d400956a0 con 0x7f9d4009c670 2024-09-18T01:44:59.278 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.277+0000 7f9d44cd7640 1 --2- 172.21.15.129:0/3458644151 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9d4009c670 0x7f9d40093340 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9d3402a680 tx=0x7f9d340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:59.279 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.277+0000 7f9d3d7fa640 1 -- 172.21.15.129:0/3458644151 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d34041070 con 0x7f9d4009c670 2024-09-18T01:44:59.279 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.277+0000 7f9d46f3b640 1 -- 172.21.15.129:0/3458644151 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d401b6720 con 0x7f9d4009c670 2024-09-18T01:44:59.279 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.277+0000 7f9d3d7fa640 1 -- 172.21.15.129:0/3458644151 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d3403c460 con 0x7f9d4009c670 2024-09-18T01:44:59.279 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.277+0000 7f9d3d7fa640 1 -- 172.21.15.129:0/3458644151 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d34041070 con 0x7f9d4009c670 2024-09-18T01:44:59.279 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.277+0000 7f9d46f3b640 1 -- 172.21.15.129:0/3458644151 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d40095fb0 con 0x7f9d4009c670 2024-09-18T01:44:59.280 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.278+0000 7f9d46f3b640 1 -- 172.21.15.129:0/3458644151 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d4009a130 con 0x7f9d4009c670 2024-09-18T01:44:59.280 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.278+0000 7f9d3d7fa640 1 -- 172.21.15.129:0/3458644151 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9d34044070 con 0x7f9d4009c670 2024-09-18T01:44:59.280 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.279+0000 7f9d3d7fa640 1 --2- 172.21.15.129:0/3458644151 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9d24038660 0x7f9d2403ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:59.280 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.279+0000 7f9d3d7fa640 1 -- 172.21.15.129:0/3458644151 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f9d3403ba00 con 0x7f9d4009c670 2024-09-18T01:44:59.280 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.279+0000 7f9d3ffff640 1 --2- 172.21.15.129:0/3458644151 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9d24038660 0x7f9d2403ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:59.281 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.279+0000 7f9d3ffff640 1 --2- 172.21.15.129:0/3458644151 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9d24038660 0x7f9d2403ab20 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c007fd0 tx=0x7f9d2c007ac0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:59.289 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.288+0000 7f9d3d7fa640 1 -- 172.21.15.129:0/3458644151 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9d400956a0 con 0x7f9d4009c670 2024-09-18T01:44:59.323 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.322+0000 7fc6dfa77640 1 -- 172.21.15.129:0/2439513707 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fc6d81260b0 con 0x7fc6d809a100 2024-09-18T01:44:59.323 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.322+0000 7fc6ca7fc640 1 -- 172.21.15.129:0/2439513707 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc6d809d3b0 con 0x7fc6d809a100 2024-09-18T01:44:59.323 INFO:teuthology.orchestra.run.smithi129.stdout:38654705669 2024-09-18T01:44:59.326 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.324+0000 7fc6dfa77640 1 -- 172.21.15.129:0/2439513707 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc6bc0382a0 msgr2=0x7fc6bc03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:59.326 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.324+0000 7fc6dfa77640 1 --2- 172.21.15.129:0/2439513707 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc6bc0382a0 0x7fc6bc03a760 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc034000 tx=0x7fc6cc02e000 comp rx=0 tx=0).stop 2024-09-18T01:44:59.326 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.324+0000 7fc6dfa77640 1 -- 172.21.15.129:0/2439513707 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc6d809a100 msgr2=0x7fc6d81c3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:59.326 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.324+0000 7fc6dfa77640 1 --2- 172.21.15.129:0/2439513707 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc6d809a100 0x7fc6d81c3990 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc6d000c4a0 tx=0x7fc6d000c960 comp rx=0 tx=0).stop 2024-09-18T01:44:59.326 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.325+0000 7fc6dfa77640 1 -- 172.21.15.129:0/2439513707 shutdown_connections 2024-09-18T01:44:59.326 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.325+0000 7fc6dfa77640 1 --2- 172.21.15.129:0/2439513707 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc6bc0382a0 0x7fc6bc03a760 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:59.326 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.325+0000 7fc6dfa77640 1 --2- 172.21.15.129:0/2439513707 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc6d809a100 0x7fc6d81c3990 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:59.326 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.325+0000 7fc6dfa77640 1 -- 172.21.15.129:0/2439513707 >> 172.21.15.129:0/2439513707 conn(0x7fc6d806d4a0 msgr2=0x7fc6d8096af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:59.326 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.325+0000 7fc6dfa77640 1 -- 172.21.15.129:0/2439513707 shutdown_connections 2024-09-18T01:44:59.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.325+0000 7fc6dfa77640 1 -- 172.21.15.129:0/2439513707 wait complete. 2024-09-18T01:44:59.341 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705669 for osd.2 2024-09-18T01:44:59.341 DEBUG:teuthology.parallel:result is None 2024-09-18T01:44:59.363 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.362+0000 7f7000cba640 1 -- 172.21.15.129:0/785312575 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f6ffc12ead0 con 0x7f6ffc12e6f0 2024-09-18T01:44:59.363 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.362+0000 7f6feaffd640 1 -- 172.21.15.129:0/785312575 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6fec03d7a0 con 0x7f6ffc12e6f0 2024-09-18T01:44:59.363 INFO:teuthology.orchestra.run.smithi129.stdout:38654705669 2024-09-18T01:44:59.367 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.365+0000 7f7000cba640 1 -- 172.21.15.129:0/785312575 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6fdc0382a0 msgr2=0x7f6fdc03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:59.367 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.365+0000 7f7000cba640 1 --2- 172.21.15.129:0/785312575 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6fdc0382a0 0x7f6fdc03a760 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0000c00 tx=0x7f6ff0007910 comp rx=0 tx=0).stop 2024-09-18T01:44:59.367 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.365+0000 7f7000cba640 1 -- 172.21.15.129:0/785312575 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6ffc12e6f0 msgr2=0x7f6ffc127760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:59.367 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.365+0000 7f7000cba640 1 --2- 172.21.15.129:0/785312575 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6ffc12e6f0 0x7f6ffc127760 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6fec035040 tx=0x7f6fec0046c0 comp rx=0 tx=0).stop 2024-09-18T01:44:59.367 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.365+0000 7f7000cba640 1 -- 172.21.15.129:0/785312575 shutdown_connections 2024-09-18T01:44:59.367 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.365+0000 7f7000cba640 1 --2- 172.21.15.129:0/785312575 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6fdc0382a0 0x7f6fdc03a760 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:59.367 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.365+0000 7f7000cba640 1 --2- 172.21.15.129:0/785312575 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6ffc12e6f0 0x7f6ffc127760 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:59.367 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.365+0000 7f7000cba640 1 -- 172.21.15.129:0/785312575 >> 172.21.15.129:0/785312575 conn(0x7f6ffc09f020 msgr2=0x7f6ffc0987e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:59.367 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.365+0000 7f7000cba640 1 -- 172.21.15.129:0/785312575 shutdown_connections 2024-09-18T01:44:59.367 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.365+0000 7f7000cba640 1 -- 172.21.15.129:0/785312575 wait complete. 2024-09-18T01:44:59.381 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705669 for osd.0 2024-09-18T01:44:59.381 DEBUG:teuthology.parallel:result is None 2024-09-18T01:44:59.439 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.438+0000 7f9a6dd91640 1 -- 172.21.15.129:0/2925788915 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f9a6812ead0 con 0x7f9a6812e6f0 2024-09-18T01:44:59.440 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.439+0000 7f9a4ffff640 1 -- 172.21.15.129:0/2925788915 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9a58012400 con 0x7f9a6812e6f0 2024-09-18T01:44:59.440 INFO:teuthology.orchestra.run.smithi129.stdout:38654705669 2024-09-18T01:44:59.442 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.440+0000 7f9a6dd91640 1 -- 172.21.15.129:0/2925788915 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9a540382d0 msgr2=0x7f9a5403a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:59.442 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.440+0000 7f9a6dd91640 1 --2- 172.21.15.129:0/2925788915 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9a540382d0 0x7f9a5403a790 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c034000 tx=0x7f9a5c02e000 comp rx=0 tx=0).stop 2024-09-18T01:44:59.442 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.440+0000 7f9a6dd91640 1 -- 172.21.15.129:0/2925788915 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9a6812e6f0 msgr2=0x7f9a68131e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:59.442 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.440+0000 7f9a6dd91640 1 --2- 172.21.15.129:0/2925788915 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9a6812e6f0 0x7f9a68131e00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9a5800c480 tx=0x7f9a5800c940 comp rx=0 tx=0).stop 2024-09-18T01:44:59.442 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.441+0000 7f9a6dd91640 1 -- 172.21.15.129:0/2925788915 shutdown_connections 2024-09-18T01:44:59.442 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.441+0000 7f9a6dd91640 1 --2- 172.21.15.129:0/2925788915 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9a540382d0 0x7f9a5403a790 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:59.442 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.441+0000 7f9a6dd91640 1 --2- 172.21.15.129:0/2925788915 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9a6812e6f0 0x7f9a68131e00 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:59.443 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.441+0000 7f9a6dd91640 1 -- 172.21.15.129:0/2925788915 >> 172.21.15.129:0/2925788915 conn(0x7f9a6809f020 msgr2=0x7f9a680974c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:59.443 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.441+0000 7f9a6dd91640 1 -- 172.21.15.129:0/2925788915 shutdown_connections 2024-09-18T01:44:59.443 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.441+0000 7f9a6dd91640 1 -- 172.21.15.129:0/2925788915 wait complete. 2024-09-18T01:44:59.453 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705669 for osd.1 2024-09-18T01:44:59.453 DEBUG:teuthology.parallel:result is None 2024-09-18T01:44:59.473 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.472+0000 7f9d46f3b640 1 -- 172.21.15.129:0/3458644151 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f9d40096670 con 0x7f9d4009c670 2024-09-18T01:44:59.473 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.472+0000 7f9d3d7fa640 1 -- 172.21.15.129:0/3458644151 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9d400956a0 con 0x7f9d4009c670 2024-09-18T01:44:59.474 INFO:teuthology.orchestra.run.smithi129.stdout:38654705669 2024-09-18T01:44:59.476 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.474+0000 7f9d46f3b640 1 -- 172.21.15.129:0/3458644151 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9d24038660 msgr2=0x7f9d2403ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:59.476 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.474+0000 7f9d46f3b640 1 --2- 172.21.15.129:0/3458644151 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9d24038660 0x7f9d2403ab20 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c007fd0 tx=0x7f9d2c007ac0 comp rx=0 tx=0).stop 2024-09-18T01:44:59.476 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.474+0000 7f9d46f3b640 1 -- 172.21.15.129:0/3458644151 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9d4009c670 msgr2=0x7f9d40093340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:59.476 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.474+0000 7f9d46f3b640 1 --2- 172.21.15.129:0/3458644151 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9d4009c670 0x7f9d40093340 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9d3402a680 tx=0x7f9d340046c0 comp rx=0 tx=0).stop 2024-09-18T01:44:59.476 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.475+0000 7f9d46f3b640 1 -- 172.21.15.129:0/3458644151 shutdown_connections 2024-09-18T01:44:59.476 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.475+0000 7f9d46f3b640 1 --2- 172.21.15.129:0/3458644151 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9d24038660 0x7f9d2403ab20 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:59.476 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.475+0000 7f9d46f3b640 1 --2- 172.21.15.129:0/3458644151 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9d4009c670 0x7f9d40093340 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:59.476 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.475+0000 7f9d46f3b640 1 -- 172.21.15.129:0/3458644151 >> 172.21.15.129:0/3458644151 conn(0x7f9d4006d4a0 msgr2=0x7f9d4009eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:59.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.475+0000 7f9d46f3b640 1 -- 172.21.15.129:0/3458644151 shutdown_connections 2024-09-18T01:44:59.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.475+0000 7f9d46f3b640 1 -- 172.21.15.129:0/3458644151 wait complete. 2024-09-18T01:44:59.486 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705669 for osd.3 2024-09-18T01:44:59.487 DEBUG:teuthology.parallel:result is None 2024-09-18T01:44:59.487 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-18T01:44:59.487 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T01:44:59.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.623+0000 7faa032a5640 1 Processor -- start 2024-09-18T01:44:59.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.623+0000 7faa032a5640 1 -- start start 2024-09-18T01:44:59.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.623+0000 7faa032a5640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fa9fc06d460 0x7fa9fc131060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:59.625 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.623+0000 7faa032a5640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9fc0702f0 con 0x7fa9fc06d080 2024-09-18T01:44:59.626 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.623+0000 7faa032a5640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x7fa9fc06f1f0 con 0x7fa9fc06d460 2024-09-18T01:44:59.626 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.623+0000 7faa00840640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fa9fc06d460 0x7fa9fc131060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:59.626 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.623+0000 7faa01041640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fa9fc06d080 0x7fa9fc096630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40630/0 (socket says 172.21.15.129:40630) 2024-09-18T01:44:59.626 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.623+0000 7faa01041640 1 -- 172.21.15.129:0/907971056 learned_addr learned my addr 172.21.15.129:0/907971056 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-09-18T01:44:59.626 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.624+0000 7faa00840640 1 -- 172.21.15.129:0/907971056 >> v1:172.21.15.129:6789/0 conn(0x7fa9fc06d080 legacy=0x7fa9fc096630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:59.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.624+0000 7fa9f3fff640 1 -- 172.21.15.129:0/907971056 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1364553615 0 0) 0x7fa9fc0702f0 con 0x7fa9fc06d080 2024-09-18T01:44:59.627 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.624+0000 7faa00840640 1 -- 172.21.15.129:0/907971056 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9fc096d40 con 0x7fa9fc06d460 2024-09-18T01:44:59.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.624+0000 7faa00840640 1 --2- 172.21.15.129:0/907971056 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa9fc06d460 0x7fa9fc131060 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec009720 tx=0x7fa9ec02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56092e4f115b2eaf server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:59.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.625+0000 7fa9f3fff640 1 -- 172.21.15.129:0/907971056 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9ec037070 con 0x7fa9fc06d460 2024-09-18T01:44:59.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.625+0000 7fa9f3fff640 1 -- 172.21.15.129:0/907971056 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9ec02ae20 con 0x7fa9fc06d460 2024-09-18T01:44:59.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.625+0000 7fa9f3fff640 1 -- 172.21.15.129:0/907971056 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9ec032590 con 0x7fa9fc06d460 2024-09-18T01:44:59.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.625+0000 7faa032a5640 1 -- 172.21.15.129:0/907971056 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa9fc06d460 msgr2=0x7fa9fc131060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:59.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.625+0000 7faa032a5640 1 --2- 172.21.15.129:0/907971056 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa9fc06d460 0x7fa9fc131060 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec009720 tx=0x7fa9ec02a1a0 comp rx=0 tx=0).stop 2024-09-18T01:44:59.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.625+0000 7faa032a5640 1 -- 172.21.15.129:0/907971056 shutdown_connections 2024-09-18T01:44:59.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.625+0000 7faa032a5640 1 --2- 172.21.15.129:0/907971056 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa9fc06d460 0x7fa9fc131060 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:59.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.625+0000 7faa032a5640 1 -- 172.21.15.129:0/907971056 >> 172.21.15.129:0/907971056 conn(0x7fa9fc09a890 msgr2=0x7fa9fc09aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:59.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.625+0000 7faa032a5640 1 -- 172.21.15.129:0/907971056 shutdown_connections 2024-09-18T01:44:59.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.625+0000 7faa032a5640 1 -- 172.21.15.129:0/907971056 wait complete. 2024-09-18T01:44:59.630 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.626+0000 7faa032a5640 1 Processor -- start 2024-09-18T01:44:59.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.626+0000 7faa032a5640 1 -- start start 2024-09-18T01:44:59.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.627+0000 7faa032a5640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa9fc06d080 0x7fa9fc128cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:59.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.627+0000 7faa032a5640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fa9fc06eba0 con 0x7fa9fc06d080 2024-09-18T01:44:59.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.627+0000 7faa01041640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa9fc06d080 0x7fa9fc128cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:59.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.627+0000 7faa01041640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa9fc06d080 0x7fa9fc128cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:48288/0 (socket says 172.21.15.129:48288) 2024-09-18T01:44:59.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.627+0000 7faa01041640 1 -- 172.21.15.129:0/3724101820 learned_addr learned my addr 172.21.15.129:0/3724101820 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-18T01:44:59.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.627+0000 7faa01041640 1 -- 172.21.15.129:0/3724101820 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9fc127c80 con 0x7fa9fc06d080 2024-09-18T01:44:59.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.627+0000 7faa01041640 1 --2- 172.21.15.129:0/3724101820 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa9fc06d080 0x7fa9fc128cd0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa9f800c420 tx=0x7fa9f800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:59.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.627+0000 7fa9f1ffb640 1 -- 172.21.15.129:0/3724101820 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9f8018070 con 0x7fa9fc06d080 2024-09-18T01:44:59.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.627+0000 7fa9f1ffb640 1 -- 172.21.15.129:0/3724101820 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9f80074d0 con 0x7fa9fc06d080 2024-09-18T01:44:59.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.627+0000 7faa032a5640 1 -- 172.21.15.129:0/3724101820 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9fc072ea0 con 0x7fa9fc06d080 2024-09-18T01:44:59.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.627+0000 7fa9f1ffb640 1 -- 172.21.15.129:0/3724101820 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9f8004950 con 0x7fa9fc06d080 2024-09-18T01:44:59.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.627+0000 7faa032a5640 1 -- 172.21.15.129:0/3724101820 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9fc12a290 con 0x7fa9fc06d080 2024-09-18T01:44:59.631 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.628+0000 7fa9f1ffb640 1 -- 172.21.15.129:0/3724101820 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa9f801b070 con 0x7fa9fc06d080 2024-09-18T01:44:59.632 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.628+0000 7faa032a5640 1 -- 172.21.15.129:0/3724101820 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9fc08b1e0 con 0x7fa9fc06d080 2024-09-18T01:44:59.632 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.628+0000 7fa9f1ffb640 1 --2- 172.21.15.129:0/3724101820 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fa9e00382a0 0x7fa9e003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:59.632 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.628+0000 7fa9f1ffb640 1 -- 172.21.15.129:0/3724101820 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7fa9f804a5f0 con 0x7fa9fc06d080 2024-09-18T01:44:59.632 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.629+0000 7faa00840640 1 --2- 172.21.15.129:0/3724101820 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fa9e00382a0 0x7fa9e003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:59.632 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.629+0000 7faa00840640 1 --2- 172.21.15.129:0/3724101820 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fa9e00382a0 0x7fa9e003a760 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec034000 tx=0x7fa9ec02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:59.634 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.633+0000 7fa9f1ffb640 1 -- 172.21.15.129:0/3724101820 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa9f8011980 con 0x7fa9fc06d080 2024-09-18T01:44:59.794 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.793+0000 7faa032a5640 1 -- 172.21.15.129:0/3724101820 --> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa9fc096630 con 0x7fa9e00382a0 2024-09-18T01:44:59.795 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.794+0000 7fa9f1ffb640 1 -- 172.21.15.129:0/3724101820 <== mgr.4099 v2:172.21.15.146:6824/168968651 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32189 (secure 0 0 0) 0x7fa9fc096630 con 0x7fa9e00382a0 2024-09-18T01:44:59.796 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:44:59.796 INFO:teuthology.orchestra.run.smithi129.stderr:dumped all 2024-09-18T01:44:59.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.796+0000 7faa032a5640 1 -- 172.21.15.129:0/3724101820 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fa9e00382a0 msgr2=0x7fa9e003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:59.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.796+0000 7faa032a5640 1 --2- 172.21.15.129:0/3724101820 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fa9e00382a0 0x7fa9e003a760 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec034000 tx=0x7fa9ec02e000 comp rx=0 tx=0).stop 2024-09-18T01:44:59.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.796+0000 7faa032a5640 1 -- 172.21.15.129:0/3724101820 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa9fc06d080 msgr2=0x7fa9fc128cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:59.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.796+0000 7faa032a5640 1 --2- 172.21.15.129:0/3724101820 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa9fc06d080 0x7fa9fc128cd0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa9f800c420 tx=0x7fa9f800c8e0 comp rx=0 tx=0).stop 2024-09-18T01:44:59.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.796+0000 7faa032a5640 1 -- 172.21.15.129:0/3724101820 shutdown_connections 2024-09-18T01:44:59.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.796+0000 7faa032a5640 1 --2- 172.21.15.129:0/3724101820 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fa9e00382a0 0x7fa9e003a760 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:59.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.796+0000 7faa032a5640 1 --2- 172.21.15.129:0/3724101820 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa9fc06d080 0x7fa9fc128cd0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:59.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.796+0000 7faa032a5640 1 -- 172.21.15.129:0/3724101820 >> 172.21.15.129:0/3724101820 conn(0x7fa9fc09a890 msgr2=0x7fa9fc12be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:59.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.796+0000 7faa032a5640 1 -- 172.21.15.129:0/3724101820 shutdown_connections 2024-09-18T01:44:59.798 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.796+0000 7faa032a5640 1 -- 172.21.15.129:0/3724101820 wait complete. 2024-09-18T01:44:59.808 INFO:teuthology.orchestra.run.smithi129.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-09-18T01:44:58.182523+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109844,"kb_used_data":1712,"kb_used_omap":6,"kb_used_meta":108025,"kb_avail":377377516,"statfs":{"total":386547056640,"available":386434576384,"internally_reserved":0,"allocated":1753088,"data_stored":1361342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":110618391},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.958790"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-18T01:44:55.241531+0000","last_change":"2024-09-18T01:44:55.241531+0000","last_active":"2024-09-18T01:44:55.241531+0000","last_peered":"2024-09-18T01:44:55.241531+0000","last_clean":"2024-09-18T01:44:55.241531+0000","last_became_active":"2024-09-18T01:44:53.298677+0000","last_became_peered":"2024-09-18T01:44:53.298677+0000","last_unstale":"2024-09-18T01:44:55.241531+0000","last_undegraded":"2024-09-18T01:44:55.241531+0000","last_fullsized":"2024-09-18T01:44:55.241531+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:07:05.603416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052495500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-18T01:44:55.234985+0000","last_change":"2024-09-18T01:44:55.234985+0000","last_active":"2024-09-18T01:44:55.234985+0000","last_peered":"2024-09-18T01:44:55.234985+0000","last_clean":"2024-09-18T01:44:55.234985+0000","last_became_active":"2024-09-18T01:44:53.236812+0000","last_became_peered":"2024-09-18T01:44:53.236812+0000","last_unstale":"2024-09-18T01:44:55.234985+0000","last_undegraded":"2024-09-18T01:44:55.234985+0000","last_fullsized":"2024-09-18T01:44:55.234985+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:54:16.245255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044136000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-18T01:44:55.242318+0000","last_change":"2024-09-18T01:44:55.242318+0000","last_active":"2024-09-18T01:44:55.242318+0000","last_peered":"2024-09-18T01:44:55.242318+0000","last_clean":"2024-09-18T01:44:55.242318+0000","last_became_active":"2024-09-18T01:44:53.236927+0000","last_became_peered":"2024-09-18T01:44:53.236927+0000","last_unstale":"2024-09-18T01:44:55.242318+0000","last_undegraded":"2024-09-18T01:44:55.242318+0000","last_fullsized":"2024-09-18T01:44:55.242318+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:52:39.601060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00130324,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-18T01:44:55.234985+0000","last_change":"2024-09-18T01:44:55.234985+0000","last_active":"2024-09-18T01:44:55.234985+0000","last_peered":"2024-09-18T01:44:55.234985+0000","last_clean":"2024-09-18T01:44:55.234985+0000","last_became_active":"2024-09-18T01:44:53.234966+0000","last_became_peered":"2024-09-18T01:44:53.234966+0000","last_unstale":"2024-09-18T01:44:55.234985+0000","last_undegraded":"2024-09-18T01:44:55.234985+0000","last_fullsized":"2024-09-18T01:44:55.234985+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:30:53.728764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045990099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"16'2","reported_seq":21,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-18T01:44:55.243241+0000","last_change":"2024-09-18T01:44:55.242065+0000","last_active":"2024-09-18T01:44:55.243241+0000","last_peered":"2024-09-18T01:44:55.243241+0000","last_clean":"2024-09-18T01:44:55.243241+0000","last_became_active":"2024-09-18T01:44:53.236990+0000","last_became_peered":"2024-09-18T01:44:53.236990+0000","last_unstale":"2024-09-18T01:44:55.243241+0000","last_undegraded":"2024-09-18T01:44:55.243241+0000","last_fullsized":"2024-09-18T01:44:55.243241+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:45:10.092337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001062627,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-18T01:44:55.620700+0000","last_change":"2024-09-18T01:44:55.620700+0000","last_active":"2024-09-18T01:44:55.620700+0000","last_peered":"2024-09-18T01:44:55.620700+0000","last_clean":"2024-09-18T01:44:55.620700+0000","last_became_active":"2024-09-18T01:44:53.237016+0000","last_became_peered":"2024-09-18T01:44:53.237016+0000","last_unstale":"2024-09-18T01:44:55.620700+0000","last_undegraded":"2024-09-18T01:44:55.620700+0000","last_fullsized":"2024-09-18T01:44:55.620700+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:36:02.583348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039942899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-18T01:44:55.242126+0000","last_change":"2024-09-18T01:44:55.242126+0000","last_active":"2024-09-18T01:44:55.242126+0000","last_peered":"2024-09-18T01:44:55.242126+0000","last_clean":"2024-09-18T01:44:55.242126+0000","last_became_active":"2024-09-18T01:44:53.237059+0000","last_became_peered":"2024-09-18T01:44:53.237059+0000","last_unstale":"2024-09-18T01:44:55.242126+0000","last_undegraded":"2024-09-18T01:44:55.242126+0000","last_fullsized":"2024-09-18T01:44:55.242126+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:32:06.823521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011095359999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"14'1","reported_seq":20,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-18T01:44:55.241426+0000","last_change":"2024-09-18T01:44:55.241426+0000","last_active":"2024-09-18T01:44:55.241426+0000","last_peered":"2024-09-18T01:44:55.241426+0000","last_clean":"2024-09-18T01:44:55.241426+0000","last_became_active":"2024-09-18T01:44:53.233974+0000","last_became_peered":"2024-09-18T01:44:53.233974+0000","last_unstale":"2024-09-18T01:44:55.241426+0000","last_undegraded":"2024-09-18T01:44:55.241426+0000","last_fullsized":"2024-09-18T01:44:55.241426+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:12:59.234293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045237700000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"11'117","reported_seq":170,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-18T01:44:55.793637+0000","last_change":"2024-09-18T01:44:49.573399+0000","last_active":"2024-09-18T01:44:55.793637+0000","last_peered":"2024-09-18T01:44:55.793637+0000","last_clean":"2024-09-18T01:44:55.793637+0000","last_became_active":"2024-09-18T01:44:49.572263+0000","last_became_peered":"2024-09-18T01:44:49.572263+0000","last_unstale":"2024-09-18T01:44:55.793637+0000","last_undegraded":"2024-09-18T01:44:55.793637+0000","last_fullsized":"2024-09-18T01:44:55.793637+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:48.210722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:48.210722+0000","last_clean_scrub_stamp":"2024-09-18T01:44:48.210722+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:56:09.389853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":143360,"data_stored":45161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":733184,"data_stored":635510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":733184,"data_stored":635510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":143360,"data_stored":45161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T01:44:59.809 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T01:44:59.908 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.906+0000 7f493d359640 1 Processor -- start 2024-09-18T01:44:59.908 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.906+0000 7f493d359640 1 -- start start 2024-09-18T01:44:59.908 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.907+0000 7f493d359640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f493812c570 0x7f493812c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:59.908 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.907+0000 7f493d359640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4938131890 con 0x7f4938098a20 2024-09-18T01:44:59.909 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.907+0000 7f493d359640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x7f4938098550 con 0x7f493812c570 2024-09-18T01:44:59.909 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.907+0000 7f4936ffd640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f493812c570 0x7f493812c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:59.909 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.907+0000 7f492e7fc640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f4938098a20 0x7f493812ce90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40640/0 (socket says 172.21.15.129:40640) 2024-09-18T01:44:59.909 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.907+0000 7f492e7fc640 1 -- 172.21.15.129:0/2369184016 learned_addr learned my addr 172.21.15.129:0/2369184016 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-09-18T01:44:59.909 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.907+0000 7f4936ffd640 1 -- 172.21.15.129:0/2369184016 >> v1:172.21.15.129:6789/0 conn(0x7f4938098a20 legacy=0x7f493812ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:59.909 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.907+0000 7f4936ffd640 1 -- 172.21.15.129:0/2369184016 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4938132a70 con 0x7f493812c570 2024-09-18T01:44:59.909 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.907+0000 7f49367fc640 1 -- 172.21.15.129:0/2369184016 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1357587956 0 0) 0x7f4938131890 con 0x7f4938098a20 2024-09-18T01:44:59.910 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.908+0000 7f4936ffd640 1 --2- 172.21.15.129:0/2369184016 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f493812c570 0x7f493812c950 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4928009720 tx=0x7f492802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d67a029dee9f0829 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:59.910 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.908+0000 7f49367fc640 1 -- 172.21.15.129:0/2369184016 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4928037070 con 0x7f493812c570 2024-09-18T01:44:59.911 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.908+0000 7f49367fc640 1 -- 172.21.15.129:0/2369184016 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f492802ad90 con 0x7f493812c570 2024-09-18T01:44:59.911 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.908+0000 7f49367fc640 1 -- 172.21.15.129:0/2369184016 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4928032590 con 0x7f493812c570 2024-09-18T01:44:59.911 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.908+0000 7f493d359640 1 -- 172.21.15.129:0/2369184016 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f493812c570 msgr2=0x7f493812c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:44:59.911 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.908+0000 7f493d359640 1 --2- 172.21.15.129:0/2369184016 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f493812c570 0x7f493812c950 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4928009720 tx=0x7f492802a110 comp rx=0 tx=0).stop 2024-09-18T01:44:59.911 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.908+0000 7f493d359640 1 -- 172.21.15.129:0/2369184016 shutdown_connections 2024-09-18T01:44:59.911 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.908+0000 7f493d359640 1 --2- 172.21.15.129:0/2369184016 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f493812c570 0x7f493812c950 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:44:59.911 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.908+0000 7f493d359640 1 -- 172.21.15.129:0/2369184016 >> 172.21.15.129:0/2369184016 conn(0x7f493809f020 msgr2=0x7f493809f430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:44:59.911 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.909+0000 7f493d359640 1 -- 172.21.15.129:0/2369184016 shutdown_connections 2024-09-18T01:44:59.911 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.909+0000 7f493d359640 1 -- 172.21.15.129:0/2369184016 wait complete. 2024-09-18T01:44:59.911 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.909+0000 7f493d359640 1 Processor -- start 2024-09-18T01:44:59.911 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.909+0000 7f493d359640 1 -- start start 2024-09-18T01:44:59.913 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.910+0000 7f493d359640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4938098a20 0x7f4938070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:59.913 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.910+0000 7f493d359640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f4938131df0 con 0x7f4938098a20 2024-09-18T01:44:59.913 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.910+0000 7f4936ffd640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4938098a20 0x7f4938070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:59.913 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.910+0000 7f4936ffd640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4938098a20 0x7f4938070ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:48298/0 (socket says 172.21.15.129:48298) 2024-09-18T01:44:59.914 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.910+0000 7f4936ffd640 1 -- 172.21.15.129:0/3608042534 learned_addr learned my addr 172.21.15.129:0/3608042534 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-18T01:44:59.914 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.910+0000 7f4936ffd640 1 -- 172.21.15.129:0/3608042534 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4938131510 con 0x7f4938098a20 2024-09-18T01:44:59.914 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.910+0000 7f4936ffd640 1 --2- 172.21.15.129:0/3608042534 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4938098a20 0x7f4938070ac0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4928009720 tx=0x7f49280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:59.914 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.910+0000 7f492ffff640 1 -- 172.21.15.129:0/3608042534 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4928041070 con 0x7f4938098a20 2024-09-18T01:44:59.914 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.910+0000 7f492ffff640 1 -- 172.21.15.129:0/3608042534 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f492803c460 con 0x7f4938098a20 2024-09-18T01:44:59.914 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.910+0000 7f493d359640 1 -- 172.21.15.129:0/3608042534 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f493812dcb0 con 0x7f4938098a20 2024-09-18T01:44:59.914 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.911+0000 7f492ffff640 1 -- 172.21.15.129:0/3608042534 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4928037040 con 0x7f4938098a20 2024-09-18T01:44:59.914 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.911+0000 7f493d359640 1 -- 172.21.15.129:0/3608042534 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f493812e140 con 0x7f4938098a20 2024-09-18T01:44:59.914 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.911+0000 7f492ffff640 1 -- 172.21.15.129:0/3608042534 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4928044070 con 0x7f4938098a20 2024-09-18T01:44:59.914 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.912+0000 7f493d359640 1 -- 172.21.15.129:0/3608042534 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4938071eb0 con 0x7f4938098a20 2024-09-18T01:44:59.914 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.912+0000 7f492ffff640 1 --2- 172.21.15.129:0/3608042534 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f49180382a0 0x7f491803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:44:59.914 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.912+0000 7f492ffff640 1 -- 172.21.15.129:0/3608042534 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f492806bcc0 con 0x7f4938098a20 2024-09-18T01:44:59.914 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.912+0000 7f492e7fc640 1 --2- 172.21.15.129:0/3608042534 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f49180382a0 0x7f491803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:44:59.914 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.912+0000 7f492e7fc640 1 --2- 172.21.15.129:0/3608042534 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f49180382a0 0x7f491803a760 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4920000c00 tx=0x7f4920007910 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:44:59.917 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:44:59.916+0000 7f492ffff640 1 -- 172.21.15.129:0/3608042534 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f492803a520 con 0x7f4938098a20 2024-09-18T01:45:00.078 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.076+0000 7f493d359640 1 -- 172.21.15.129:0/3608042534 --> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f49381322a0 con 0x7f49180382a0 2024-09-18T01:45:00.079 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.078+0000 7f492ffff640 1 -- 172.21.15.129:0/3608042534 <== mgr.4099 v2:172.21.15.146:6824/168968651 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32189 (secure 0 0 0) 0x7f49381322a0 con 0x7f49180382a0 2024-09-18T01:45:00.079 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:45:00.080 INFO:teuthology.orchestra.run.smithi129.stderr:dumped all 2024-09-18T01:45:00.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.080+0000 7f493d359640 1 -- 172.21.15.129:0/3608042534 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f49180382a0 msgr2=0x7f491803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:00.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.080+0000 7f493d359640 1 --2- 172.21.15.129:0/3608042534 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f49180382a0 0x7f491803a760 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4920000c00 tx=0x7f4920007910 comp rx=0 tx=0).stop 2024-09-18T01:45:00.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.080+0000 7f493d359640 1 -- 172.21.15.129:0/3608042534 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4938098a20 msgr2=0x7f4938070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:00.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.080+0000 7f493d359640 1 --2- 172.21.15.129:0/3608042534 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4938098a20 0x7f4938070ac0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4928009720 tx=0x7f49280046c0 comp rx=0 tx=0).stop 2024-09-18T01:45:00.081 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.080+0000 7f493d359640 1 -- 172.21.15.129:0/3608042534 shutdown_connections 2024-09-18T01:45:00.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.080+0000 7f493d359640 1 --2- 172.21.15.129:0/3608042534 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f49180382a0 0x7f491803a760 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:00.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.080+0000 7f493d359640 1 --2- 172.21.15.129:0/3608042534 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4938098a20 0x7f4938070ac0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:00.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.080+0000 7f493d359640 1 -- 172.21.15.129:0/3608042534 >> 172.21.15.129:0/3608042534 conn(0x7f493809f020 msgr2=0x7f493812b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:00.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.080+0000 7f493d359640 1 -- 172.21.15.129:0/3608042534 shutdown_connections 2024-09-18T01:45:00.082 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.080+0000 7f493d359640 1 -- 172.21.15.129:0/3608042534 wait complete. 2024-09-18T01:45:00.092 INFO:teuthology.orchestra.run.smithi129.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-09-18T01:44:58.182523+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109844,"kb_used_data":1712,"kb_used_omap":6,"kb_used_meta":108025,"kb_avail":377377516,"statfs":{"total":386547056640,"available":386434576384,"internally_reserved":0,"allocated":1753088,"data_stored":1361342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":110618391},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.958790"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-18T01:44:55.241531+0000","last_change":"2024-09-18T01:44:55.241531+0000","last_active":"2024-09-18T01:44:55.241531+0000","last_peered":"2024-09-18T01:44:55.241531+0000","last_clean":"2024-09-18T01:44:55.241531+0000","last_became_active":"2024-09-18T01:44:53.298677+0000","last_became_peered":"2024-09-18T01:44:53.298677+0000","last_unstale":"2024-09-18T01:44:55.241531+0000","last_undegraded":"2024-09-18T01:44:55.241531+0000","last_fullsized":"2024-09-18T01:44:55.241531+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:07:05.603416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052495500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-18T01:44:55.234985+0000","last_change":"2024-09-18T01:44:55.234985+0000","last_active":"2024-09-18T01:44:55.234985+0000","last_peered":"2024-09-18T01:44:55.234985+0000","last_clean":"2024-09-18T01:44:55.234985+0000","last_became_active":"2024-09-18T01:44:53.236812+0000","last_became_peered":"2024-09-18T01:44:53.236812+0000","last_unstale":"2024-09-18T01:44:55.234985+0000","last_undegraded":"2024-09-18T01:44:55.234985+0000","last_fullsized":"2024-09-18T01:44:55.234985+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:54:16.245255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044136000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-18T01:44:55.242318+0000","last_change":"2024-09-18T01:44:55.242318+0000","last_active":"2024-09-18T01:44:55.242318+0000","last_peered":"2024-09-18T01:44:55.242318+0000","last_clean":"2024-09-18T01:44:55.242318+0000","last_became_active":"2024-09-18T01:44:53.236927+0000","last_became_peered":"2024-09-18T01:44:53.236927+0000","last_unstale":"2024-09-18T01:44:55.242318+0000","last_undegraded":"2024-09-18T01:44:55.242318+0000","last_fullsized":"2024-09-18T01:44:55.242318+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:52:39.601060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00130324,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-18T01:44:55.234985+0000","last_change":"2024-09-18T01:44:55.234985+0000","last_active":"2024-09-18T01:44:55.234985+0000","last_peered":"2024-09-18T01:44:55.234985+0000","last_clean":"2024-09-18T01:44:55.234985+0000","last_became_active":"2024-09-18T01:44:53.234966+0000","last_became_peered":"2024-09-18T01:44:53.234966+0000","last_unstale":"2024-09-18T01:44:55.234985+0000","last_undegraded":"2024-09-18T01:44:55.234985+0000","last_fullsized":"2024-09-18T01:44:55.234985+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:30:53.728764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045990099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"16'2","reported_seq":21,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-18T01:44:55.243241+0000","last_change":"2024-09-18T01:44:55.242065+0000","last_active":"2024-09-18T01:44:55.243241+0000","last_peered":"2024-09-18T01:44:55.243241+0000","last_clean":"2024-09-18T01:44:55.243241+0000","last_became_active":"2024-09-18T01:44:53.236990+0000","last_became_peered":"2024-09-18T01:44:53.236990+0000","last_unstale":"2024-09-18T01:44:55.243241+0000","last_undegraded":"2024-09-18T01:44:55.243241+0000","last_fullsized":"2024-09-18T01:44:55.243241+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:45:10.092337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001062627,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-18T01:44:55.620700+0000","last_change":"2024-09-18T01:44:55.620700+0000","last_active":"2024-09-18T01:44:55.620700+0000","last_peered":"2024-09-18T01:44:55.620700+0000","last_clean":"2024-09-18T01:44:55.620700+0000","last_became_active":"2024-09-18T01:44:53.237016+0000","last_became_peered":"2024-09-18T01:44:53.237016+0000","last_unstale":"2024-09-18T01:44:55.620700+0000","last_undegraded":"2024-09-18T01:44:55.620700+0000","last_fullsized":"2024-09-18T01:44:55.620700+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:36:02.583348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039942899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-18T01:44:55.242126+0000","last_change":"2024-09-18T01:44:55.242126+0000","last_active":"2024-09-18T01:44:55.242126+0000","last_peered":"2024-09-18T01:44:55.242126+0000","last_clean":"2024-09-18T01:44:55.242126+0000","last_became_active":"2024-09-18T01:44:53.237059+0000","last_became_peered":"2024-09-18T01:44:53.237059+0000","last_unstale":"2024-09-18T01:44:55.242126+0000","last_undegraded":"2024-09-18T01:44:55.242126+0000","last_fullsized":"2024-09-18T01:44:55.242126+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:32:06.823521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011095359999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"14'1","reported_seq":20,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-18T01:44:55.241426+0000","last_change":"2024-09-18T01:44:55.241426+0000","last_active":"2024-09-18T01:44:55.241426+0000","last_peered":"2024-09-18T01:44:55.241426+0000","last_clean":"2024-09-18T01:44:55.241426+0000","last_became_active":"2024-09-18T01:44:53.233974+0000","last_became_peered":"2024-09-18T01:44:53.233974+0000","last_unstale":"2024-09-18T01:44:55.241426+0000","last_undegraded":"2024-09-18T01:44:55.241426+0000","last_fullsized":"2024-09-18T01:44:55.241426+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:12:59.234293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045237700000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"11'117","reported_seq":170,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-18T01:44:55.793637+0000","last_change":"2024-09-18T01:44:49.573399+0000","last_active":"2024-09-18T01:44:55.793637+0000","last_peered":"2024-09-18T01:44:55.793637+0000","last_clean":"2024-09-18T01:44:55.793637+0000","last_became_active":"2024-09-18T01:44:49.572263+0000","last_became_peered":"2024-09-18T01:44:49.572263+0000","last_unstale":"2024-09-18T01:44:55.793637+0000","last_undegraded":"2024-09-18T01:44:55.793637+0000","last_fullsized":"2024-09-18T01:44:55.793637+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:48.210722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:48.210722+0000","last_clean_scrub_stamp":"2024-09-18T01:44:48.210722+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:56:09.389853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":143360,"data_stored":45161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":733184,"data_stored":635510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":733184,"data_stored":635510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":143360,"data_stored":45161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T01:45:00.093 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-18T01:45:00.093 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-18T01:45:00.093 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-18T01:45:00.093 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-18T01:45:00.190 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.188+0000 7f44459e4640 1 Processor -- start 2024-09-18T01:45:00.191 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.189+0000 7f44459e4640 1 -- start start 2024-09-18T01:45:00.191 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.189+0000 7f44459e4640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f444009bd50 0x7f444009c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:00.191 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.189+0000 7f44459e4640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f444009d3b0 con 0x7f444009c670 2024-09-18T01:45:00.191 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.189+0000 7f44459e4640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x7f4440098230 con 0x7f444009bd50 2024-09-18T01:45:00.191 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.189+0000 7f443effd640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f444009bd50 0x7f444009c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:00.191 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.189+0000 7f4437fff640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f444009c670 0x7f44400990f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40646/0 (socket says 172.21.15.129:40646) 2024-09-18T01:45:00.191 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.189+0000 7f4437fff640 1 -- 172.21.15.129:0/2587114123 learned_addr learned my addr 172.21.15.129:0/2587114123 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-09-18T01:45:00.191 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.189+0000 7f443effd640 1 -- 172.21.15.129:0/2587114123 >> v1:172.21.15.129:6789/0 conn(0x7f444009c670 legacy=0x7f44400990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:00.191 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.189+0000 7f443effd640 1 -- 172.21.15.129:0/2587114123 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44400983e0 con 0x7f444009bd50 2024-09-18T01:45:00.191 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.189+0000 7f443e7fc640 1 -- 172.21.15.129:0/2587114123 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4198888462 0 0) 0x7f4428001110 con 0x7f444009c670 2024-09-18T01:45:00.194 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.190+0000 7f443effd640 1 --2- 172.21.15.129:0/2587114123 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f444009bd50 0x7f444009c130 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4430009720 tx=0x7f443002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91f438be29a4022d server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:00.194 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.190+0000 7f443e7fc640 1 -- 172.21.15.129:0/2587114123 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4430037070 con 0x7f444009bd50 2024-09-18T01:45:00.195 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.190+0000 7f443e7fc640 1 -- 172.21.15.129:0/2587114123 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f443002ad90 con 0x7f444009bd50 2024-09-18T01:45:00.195 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.190+0000 7f443e7fc640 1 -- 172.21.15.129:0/2587114123 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4430032590 con 0x7f444009bd50 2024-09-18T01:45:00.195 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.191+0000 7f44459e4640 1 -- 172.21.15.129:0/2587114123 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f444009bd50 msgr2=0x7f444009c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:00.195 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.191+0000 7f44459e4640 1 --2- 172.21.15.129:0/2587114123 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f444009bd50 0x7f444009c130 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4430009720 tx=0x7f443002a110 comp rx=0 tx=0).stop 2024-09-18T01:45:00.195 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.191+0000 7f44459e4640 1 -- 172.21.15.129:0/2587114123 shutdown_connections 2024-09-18T01:45:00.195 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.191+0000 7f44459e4640 1 --2- 172.21.15.129:0/2587114123 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f444009bd50 0x7f444009c130 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:00.195 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.191+0000 7f44459e4640 1 -- 172.21.15.129:0/2587114123 >> 172.21.15.129:0/2587114123 conn(0x7f444006d4a0 msgr2=0x7f444006d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:00.195 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.191+0000 7f44459e4640 1 -- 172.21.15.129:0/2587114123 shutdown_connections 2024-09-18T01:45:00.195 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.191+0000 7f44459e4640 1 -- 172.21.15.129:0/2587114123 wait complete. 2024-09-18T01:45:00.195 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.192+0000 7f44459e4640 1 Processor -- start 2024-09-18T01:45:00.195 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.192+0000 7f44459e4640 1 -- start start 2024-09-18T01:45:00.195 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.192+0000 7f44459e4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f444009bd50 0x7f4440096cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:00.195 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.192+0000 7f44459e4640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f4440099b90 con 0x7f444009bd50 2024-09-18T01:45:00.195 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.192+0000 7f443effd640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f444009bd50 0x7f4440096cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:00.196 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.192+0000 7f443effd640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f444009bd50 0x7f4440096cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:48312/0 (socket says 172.21.15.129:48312) 2024-09-18T01:45:00.196 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.192+0000 7f443effd640 1 -- 172.21.15.129:0/280581615 learned_addr learned my addr 172.21.15.129:0/280581615 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-18T01:45:00.196 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.192+0000 7f443effd640 1 -- 172.21.15.129:0/280581615 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f444008c2c0 con 0x7f444009bd50 2024-09-18T01:45:00.196 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.192+0000 7f443effd640 1 --2- 172.21.15.129:0/280581615 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f444009bd50 0x7f4440096cd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4430035040 tx=0x7f44300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:00.196 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.193+0000 7f443cff9640 1 -- 172.21.15.129:0/280581615 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4430037040 con 0x7f444009bd50 2024-09-18T01:45:00.196 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.193+0000 7f443cff9640 1 -- 172.21.15.129:0/280581615 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4430004160 con 0x7f444009bd50 2024-09-18T01:45:00.196 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.193+0000 7f443cff9640 1 -- 172.21.15.129:0/280581615 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4430004440 con 0x7f444009bd50 2024-09-18T01:45:00.196 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.193+0000 7f44459e4640 1 -- 172.21.15.129:0/280581615 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f444009a760 con 0x7f444009bd50 2024-09-18T01:45:00.196 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.193+0000 7f44459e4640 1 -- 172.21.15.129:0/280581615 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f444008c5d0 con 0x7f444009bd50 2024-09-18T01:45:00.196 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.193+0000 7f443cff9640 1 -- 172.21.15.129:0/280581615 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4430003610 con 0x7f444009bd50 2024-09-18T01:45:00.196 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.194+0000 7f44459e4640 1 -- 172.21.15.129:0/280581615 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f444009a130 con 0x7f444009bd50 2024-09-18T01:45:00.197 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.194+0000 7f443cff9640 1 --2- 172.21.15.129:0/280581615 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f44200382a0 0x7f442003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:00.197 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.194+0000 7f443cff9640 1 -- 172.21.15.129:0/280581615 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f443006c360 con 0x7f444009bd50 2024-09-18T01:45:00.197 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.194+0000 7f4437fff640 1 --2- 172.21.15.129:0/280581615 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f44200382a0 0x7f442003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:00.197 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.194+0000 7f4437fff640 1 --2- 172.21.15.129:0/280581615 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f44200382a0 0x7f442003a760 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4428000c00 tx=0x7f4428001250 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:00.199 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.198+0000 7f443cff9640 1 -- 172.21.15.129:0/280581615 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f443003ec70 con 0x7f444009bd50 2024-09-18T01:45:00.402 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.400+0000 7f44459e4640 1 -- 172.21.15.129:0/280581615 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f444009d020 con 0x7f444009bd50 2024-09-18T01:45:00.402 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.401+0000 7f443cff9640 1 -- 172.21.15.129:0/280581615 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f443003ccd0 con 0x7f444009bd50 2024-09-18T01:45:00.403 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:45:00.403 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-18T01:45:00.405 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.403+0000 7f44459e4640 1 -- 172.21.15.129:0/280581615 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f44200382a0 msgr2=0x7f442003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:00.405 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.403+0000 7f44459e4640 1 --2- 172.21.15.129:0/280581615 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f44200382a0 0x7f442003a760 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4428000c00 tx=0x7f4428001250 comp rx=0 tx=0).stop 2024-09-18T01:45:00.405 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.403+0000 7f44459e4640 1 -- 172.21.15.129:0/280581615 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f444009bd50 msgr2=0x7f4440096cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:00.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.403+0000 7f44459e4640 1 --2- 172.21.15.129:0/280581615 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f444009bd50 0x7f4440096cd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4430035040 tx=0x7f44300046c0 comp rx=0 tx=0).stop 2024-09-18T01:45:00.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.403+0000 7f44459e4640 1 -- 172.21.15.129:0/280581615 shutdown_connections 2024-09-18T01:45:00.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.403+0000 7f44459e4640 1 --2- 172.21.15.129:0/280581615 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f44200382a0 0x7f442003a760 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:00.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.403+0000 7f44459e4640 1 --2- 172.21.15.129:0/280581615 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f444009bd50 0x7f4440096cd0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:00.406 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.403+0000 7f44459e4640 1 -- 172.21.15.129:0/280581615 >> 172.21.15.129:0/280581615 conn(0x7f444006d4a0 msgr2=0x7f444009eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:00.407 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.403+0000 7f44459e4640 1 -- 172.21.15.129:0/280581615 shutdown_connections 2024-09-18T01:45:00.407 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:45:00.403+0000 7f44459e4640 1 -- 172.21.15.129:0/280581615 wait complete. 2024-09-18T01:45:00.415 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-18T01:45:00.415 INFO:teuthology.run_tasks:Running task rgw... 2024-09-18T01:45:00.474 DEBUG:tasks.rgw:config is {'client.0': None} 2024-09-18T01:45:00.474 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-18T01:45:00.474 INFO:tasks.rgw:Creating data pools 2024-09-18T01:45:00.474 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-18T01:45:00.475 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph osd erasure-code-profile set client.0 k=2 m=1 crush-failure-domain=osd --cluster ceph 2024-09-18T01:45:00.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:00.585+0000 7f26fd5e8640 1 Processor -- start 2024-09-18T01:45:00.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:00.585+0000 7f26fd5e8640 1 -- start start 2024-09-18T01:45:00.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:00.585+0000 7f26fd5e8640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f26f8073970 0x7f26f811d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:00.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:00.585+0000 7f26fd5e8640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26f8073f40 con 0x7f26f8111c20 2024-09-18T01:45:00.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:00.585+0000 7f26fd5e8640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x7f26f811ea50 con 0x7f26f8073970 2024-09-18T01:45:00.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:00.586+0000 7f26effff640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f26f8073970 0x7f26f811d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:00.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:00.586+0000 7f26f6ffd640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f26f8111c20 0x7f26f8073260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:34820/0 (socket says 172.21.15.146:34820) 2024-09-18T01:45:00.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:00.586+0000 7f26f6ffd640 1 -- 172.21.15.146:0/2669716575 learned_addr learned my addr 172.21.15.146:0/2669716575 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:45:00.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:00.586+0000 7f26effff640 1 -- 172.21.15.146:0/2669716575 >> v1:172.21.15.129:6789/0 conn(0x7f26f8111c20 legacy=0x7f26f8073260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:00.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:00.586+0000 7f26effff640 1 -- 172.21.15.146:0/2669716575 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26f811ebd0 con 0x7f26f8073970 2024-09-18T01:45:00.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:00.587+0000 7f26effff640 1 --2- 172.21.15.146:0/2669716575 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f26f8073970 0x7f26f811d500 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f26e0009720 tx=0x7f26e002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1574fd9f119a049f server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:00.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:00.587+0000 7f26f67fc640 1 -- 172.21.15.146:0/2669716575 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26e0037070 con 0x7f26f8073970 2024-09-18T01:45:00.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:00.587+0000 7f26f67fc640 1 -- 172.21.15.146:0/2669716575 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26e002ae20 con 0x7f26f8073970 2024-09-18T01:45:00.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:00.587+0000 7f26f67fc640 1 -- 172.21.15.146:0/2669716575 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26e0032590 con 0x7f26f8073970 2024-09-18T01:45:00.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:00.587+0000 7f26fd5e8640 1 -- 172.21.15.146:0/2669716575 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f26f8073970 msgr2=0x7f26f811d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:00.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:00.587+0000 7f26fd5e8640 1 --2- 172.21.15.146:0/2669716575 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f26f8073970 0x7f26f811d500 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f26e0009720 tx=0x7f26e002a1a0 comp rx=0 tx=0).stop 2024-09-18T01:45:00.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:00.587+0000 7f26fd5e8640 1 -- 172.21.15.146:0/2669716575 shutdown_connections 2024-09-18T01:45:00.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:00.588+0000 7f26fd5e8640 1 --2- 172.21.15.146:0/2669716575 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f26f8073970 0x7f26f811d500 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:00.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:00.588+0000 7f26fd5e8640 1 -- 172.21.15.146:0/2669716575 >> 172.21.15.146:0/2669716575 conn(0x7f26f806f300 msgr2=0x7f26f8071720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:00.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:00.588+0000 7f26fd5e8640 1 -- 172.21.15.146:0/2669716575 shutdown_connections 2024-09-18T01:45:00.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:00.588+0000 7f26fd5e8640 1 -- 172.21.15.146:0/2669716575 wait complete. 2024-09-18T01:45:00.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:00.588+0000 7f26fd5e8640 1 Processor -- start 2024-09-18T01:45:00.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:00.588+0000 7f26fd5e8640 1 -- start start 2024-09-18T01:45:00.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:00.588+0000 7f26fd5e8640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f26f8073970 0x7f26f81a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:00.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:00.588+0000 7f26fd5e8640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f26f811df20 con 0x7f26f8073970 2024-09-18T01:45:00.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:00.589+0000 7f26f6ffd640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f26f8073970 0x7f26f81a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:00.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:00.589+0000 7f26f6ffd640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f26f8073970 0x7f26f81a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:47344/0 (socket says 172.21.15.146:47344) 2024-09-18T01:45:00.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:00.589+0000 7f26f6ffd640 1 -- 172.21.15.146:0/1144734060 learned_addr learned my addr 172.21.15.146:0/1144734060 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:00.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:00.589+0000 7f26f6ffd640 1 -- 172.21.15.146:0/1144734060 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26f81a7300 con 0x7f26f8073970 2024-09-18T01:45:00.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:00.589+0000 7f26f6ffd640 1 --2- 172.21.15.146:0/1144734060 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f26f8073970 0x7f26f81a6d30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f26e800c4a0 tx=0x7f26e800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:00.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:00.589+0000 7f26ef7fe640 1 -- 172.21.15.146:0/1144734060 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26e8017070 con 0x7f26f8073970 2024-09-18T01:45:00.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:00.589+0000 7f26ef7fe640 1 -- 172.21.15.146:0/1144734060 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26e8005c10 con 0x7f26f8073970 2024-09-18T01:45:00.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:00.589+0000 7f26fd5e8640 1 -- 172.21.15.146:0/1144734060 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26f81a75f0 con 0x7f26f8073970 2024-09-18T01:45:00.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:00.589+0000 7f26ef7fe640 1 -- 172.21.15.146:0/1144734060 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26e8007070 con 0x7f26f8073970 2024-09-18T01:45:00.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:00.589+0000 7f26fd5e8640 1 -- 172.21.15.146:0/1144734060 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26f81ab5e0 con 0x7f26f8073970 2024-09-18T01:45:00.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:00.590+0000 7f26ef7fe640 1 -- 172.21.15.146:0/1144734060 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f26e801a070 con 0x7f26f8073970 2024-09-18T01:45:00.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:00.590+0000 7f26fd5e8640 1 -- 172.21.15.146:0/1144734060 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26f81a7820 con 0x7f26f8073970 2024-09-18T01:45:00.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:00.590+0000 7f26ef7fe640 1 --2- 172.21.15.146:0/1144734060 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f26d80382a0 0x7f26d803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:00.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:00.590+0000 7f26ef7fe640 1 -- 172.21.15.146:0/1144734060 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f26e804a590 con 0x7f26f8073970 2024-09-18T01:45:00.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:00.591+0000 7f26effff640 1 --2- 172.21.15.146:0/1144734060 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f26d80382a0 0x7f26d803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:00.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:00.591+0000 7f26effff640 1 --2- 172.21.15.146:0/1144734060 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f26d80382a0 0x7f26d803a760 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f26e0034000 tx=0x7f26e002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:00.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:00.595+0000 7f26ef7fe640 1 -- 172.21.15.146:0/1144734060 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f26e801b3b0 con 0x7f26f8073970 2024-09-18T01:45:00.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:00.767+0000 7f26fd5e8640 1 -- 172.21.15.146:0/1144734060 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]} v 0) -- 0x7f26f811e460 con 0x7f26f8073970 2024-09-18T01:45:01.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:01.087+0000 7f26ef7fe640 1 -- 172.21.15.146:0/1144734060 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]}]=0 v17) ==== 151+0+0 (secure 0 0 0) 0x7f26e8010300 con 0x7f26f8073970 2024-09-18T01:45:01.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:01.089+0000 7f26fd5e8640 1 -- 172.21.15.146:0/1144734060 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f26d80382a0 msgr2=0x7f26d803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:01.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:01.089+0000 7f26fd5e8640 1 --2- 172.21.15.146:0/1144734060 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f26d80382a0 0x7f26d803a760 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f26e0034000 tx=0x7f26e002e000 comp rx=0 tx=0).stop 2024-09-18T01:45:01.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:01.089+0000 7f26fd5e8640 1 -- 172.21.15.146:0/1144734060 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f26f8073970 msgr2=0x7f26f81a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:01.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:01.089+0000 7f26fd5e8640 1 --2- 172.21.15.146:0/1144734060 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f26f8073970 0x7f26f81a6d30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f26e800c4a0 tx=0x7f26e800c960 comp rx=0 tx=0).stop 2024-09-18T01:45:01.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:01.089+0000 7f26fd5e8640 1 -- 172.21.15.146:0/1144734060 shutdown_connections 2024-09-18T01:45:01.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:01.089+0000 7f26fd5e8640 1 --2- 172.21.15.146:0/1144734060 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f26d80382a0 0x7f26d803a760 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:01.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:01.089+0000 7f26fd5e8640 1 --2- 172.21.15.146:0/1144734060 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f26f8073970 0x7f26f81a6d30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:01.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:01.089+0000 7f26fd5e8640 1 -- 172.21.15.146:0/1144734060 >> 172.21.15.146:0/1144734060 conn(0x7f26f806f300 msgr2=0x7f26f8070300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:01.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:01.089+0000 7f26fd5e8640 1 -- 172.21.15.146:0/1144734060 shutdown_connections 2024-09-18T01:45:01.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:01.089+0000 7f26fd5e8640 1 -- 172.21.15.146:0/1144734060 wait complete. 2024-09-18T01:45:01.102 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-09-18T01:45:01.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:01.203+0000 7fba1eaa6640 1 Processor -- start 2024-09-18T01:45:01.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:01.203+0000 7fba1eaa6640 1 -- start start 2024-09-18T01:45:01.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:01.204+0000 7fba1eaa6640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fba1811aca0 0x7fba1811d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:01.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:01.204+0000 7fba1eaa6640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba1811d660 con 0x7fba18118020 2024-09-18T01:45:01.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:01.204+0000 7fba1eaa6640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x7fba1811e860 con 0x7fba1811aca0 2024-09-18T01:45:01.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:01.204+0000 7fba17fff640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fba1811aca0 0x7fba1811d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:01.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:01.204+0000 7fba1c842640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fba18118020 0x7fba18118400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:34828/0 (socket says 172.21.15.146:34828) 2024-09-18T01:45:01.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:01.204+0000 7fba17fff640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fba1811aca0 0x7fba1811d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:47350/0 (socket says 172.21.15.146:47350) 2024-09-18T01:45:01.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:01.204+0000 7fba1c842640 1 -- 172.21.15.146:0/2904661855 learned_addr learned my addr 172.21.15.146:0/2904661855 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:45:01.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:01.204+0000 7fba17fff640 1 -- 172.21.15.146:0/2904661855 >> v1:172.21.15.129:6789/0 conn(0x7fba18118020 legacy=0x7fba18118400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:01.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:01.205+0000 7fba17fff640 1 -- 172.21.15.146:0/2904661855 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba1811ea10 con 0x7fba1811aca0 2024-09-18T01:45:01.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:01.204+0000 7fba177fe640 1 -- 172.21.15.146:0/2904661855 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2541733564 0 0) 0x7fba1811d660 con 0x7fba18118020 2024-09-18T01:45:01.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:01.205+0000 7fba17fff640 1 --2- 172.21.15.146:0/2904661855 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fba1811aca0 0x7fba1811d090 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fba04009720 tx=0x7fba0402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b66fd02ff3df937 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:01.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:01.205+0000 7fba177fe640 1 -- 172.21.15.146:0/2904661855 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba04037070 con 0x7fba1811aca0 2024-09-18T01:45:01.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:01.205+0000 7fba177fe640 1 -- 172.21.15.146:0/2904661855 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba0402ad90 con 0x7fba1811aca0 2024-09-18T01:45:01.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:01.205+0000 7fba177fe640 1 -- 172.21.15.146:0/2904661855 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba04032590 con 0x7fba1811aca0 2024-09-18T01:45:01.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:01.206+0000 7fba1eaa6640 1 -- 172.21.15.146:0/2904661855 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fba1811aca0 msgr2=0x7fba1811d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:01.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:01.206+0000 7fba1eaa6640 1 --2- 172.21.15.146:0/2904661855 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fba1811aca0 0x7fba1811d090 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fba04009720 tx=0x7fba0402a110 comp rx=0 tx=0).stop 2024-09-18T01:45:01.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:01.206+0000 7fba1eaa6640 1 -- 172.21.15.146:0/2904661855 shutdown_connections 2024-09-18T01:45:01.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:01.206+0000 7fba1eaa6640 1 --2- 172.21.15.146:0/2904661855 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fba1811aca0 0x7fba1811d090 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:01.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:01.206+0000 7fba1eaa6640 1 -- 172.21.15.146:0/2904661855 >> 172.21.15.146:0/2904661855 conn(0x7fba1806e680 msgr2=0x7fba1806ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:01.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:01.206+0000 7fba1eaa6640 1 -- 172.21.15.146:0/2904661855 shutdown_connections 2024-09-18T01:45:01.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:01.206+0000 7fba1eaa6640 1 -- 172.21.15.146:0/2904661855 wait complete. 2024-09-18T01:45:01.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:01.207+0000 7fba1eaa6640 1 Processor -- start 2024-09-18T01:45:01.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:01.207+0000 7fba1eaa6640 1 -- start start 2024-09-18T01:45:01.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:01.208+0000 7fba1eaa6640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fba18118020 0x7fba181ac4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:01.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:01.208+0000 7fba1eaa6640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fba1811dd50 con 0x7fba18118020 2024-09-18T01:45:01.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:01.208+0000 7fba1c842640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fba18118020 0x7fba181ac4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:01.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:01.208+0000 7fba1c842640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fba18118020 0x7fba181ac4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:47362/0 (socket says 172.21.15.146:47362) 2024-09-18T01:45:01.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:01.208+0000 7fba1c842640 1 -- 172.21.15.146:0/3276331265 learned_addr learned my addr 172.21.15.146:0/3276331265 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:01.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:01.208+0000 7fba1c842640 1 -- 172.21.15.146:0/3276331265 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba181aca90 con 0x7fba18118020 2024-09-18T01:45:01.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:01.208+0000 7fba1c842640 1 --2- 172.21.15.146:0/3276331265 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fba18118020 0x7fba181ac4c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fba0c00c420 tx=0x7fba0c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:01.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:01.208+0000 7fba157fa640 1 -- 172.21.15.146:0/3276331265 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba0c018070 con 0x7fba18118020 2024-09-18T01:45:01.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:01.209+0000 7fba157fa640 1 -- 172.21.15.146:0/3276331265 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba0c0074d0 con 0x7fba18118020 2024-09-18T01:45:01.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:01.209+0000 7fba1eaa6640 1 -- 172.21.15.146:0/3276331265 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba181acd80 con 0x7fba18118020 2024-09-18T01:45:01.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:01.209+0000 7fba157fa640 1 -- 172.21.15.146:0/3276331265 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba0c004950 con 0x7fba18118020 2024-09-18T01:45:01.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:01.209+0000 7fba1eaa6640 1 -- 172.21.15.146:0/3276331265 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba181a6790 con 0x7fba18118020 2024-09-18T01:45:01.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:01.209+0000 7fba157fa640 1 -- 172.21.15.146:0/3276331265 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fba0c01b070 con 0x7fba18118020 2024-09-18T01:45:01.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:01.210+0000 7fba157fa640 1 --2- 172.21.15.146:0/3276331265 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb9fc0382a0 0x7fb9fc03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:01.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:01.210+0000 7fba157fa640 1 -- 172.21.15.146:0/3276331265 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3802+0+0 (secure 0 0 0) 0x7fba0c04a790 con 0x7fba18118020 2024-09-18T01:45:01.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:01.210+0000 7fba1eaa6640 1 -- 172.21.15.146:0/3276331265 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba1811e2b0 con 0x7fba18118020 2024-09-18T01:45:01.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:01.210+0000 7fba17fff640 1 --2- 172.21.15.146:0/3276331265 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb9fc0382a0 0x7fb9fc03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:01.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:01.210+0000 7fba17fff640 1 --2- 172.21.15.146:0/3276331265 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb9fc0382a0 0x7fb9fc03a760 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fba04034000 tx=0x7fba0402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:01.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:01.215+0000 7fba157fa640 1 -- 172.21.15.146:0/3276331265 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fba0c011980 con 0x7fba18118020 2024-09-18T01:45:01.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:01.393+0000 7fba1eaa6640 1 -- 172.21.15.146:0/3276331265 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"} v 0) -- 0x7fba181acfb0 con 0x7fba18118020 2024-09-18T01:45:03.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:03.251+0000 7fba157fa640 1 -- 172.21.15.146:0/3276331265 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"}]=0 pool 'default.rgw.buckets.data' created v19) ==== 227+0+0 (secure 0 0 0) 0x7fba0c011be0 con 0x7fba18118020 2024-09-18T01:45:03.252 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'default.rgw.buckets.data' created 2024-09-18T01:45:03.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:03.253+0000 7fba1eaa6640 1 -- 172.21.15.146:0/3276331265 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb9fc0382a0 msgr2=0x7fb9fc03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:03.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:03.253+0000 7fba1eaa6640 1 --2- 172.21.15.146:0/3276331265 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb9fc0382a0 0x7fb9fc03a760 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fba04034000 tx=0x7fba0402e000 comp rx=0 tx=0).stop 2024-09-18T01:45:03.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:03.253+0000 7fba1eaa6640 1 -- 172.21.15.146:0/3276331265 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fba18118020 msgr2=0x7fba181ac4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:03.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:03.253+0000 7fba1eaa6640 1 --2- 172.21.15.146:0/3276331265 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fba18118020 0x7fba181ac4c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fba0c00c420 tx=0x7fba0c00c8e0 comp rx=0 tx=0).stop 2024-09-18T01:45:03.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:03.253+0000 7fba1eaa6640 1 -- 172.21.15.146:0/3276331265 shutdown_connections 2024-09-18T01:45:03.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:03.254+0000 7fba1eaa6640 1 --2- 172.21.15.146:0/3276331265 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb9fc0382a0 0x7fb9fc03a760 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:03.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:03.254+0000 7fba1eaa6640 1 --2- 172.21.15.146:0/3276331265 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fba18118020 0x7fba181ac4c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:03.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:03.254+0000 7fba1eaa6640 1 -- 172.21.15.146:0/3276331265 >> 172.21.15.146:0/3276331265 conn(0x7fba1806e680 msgr2=0x7fba1811b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:03.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:03.254+0000 7fba1eaa6640 1 -- 172.21.15.146:0/3276331265 shutdown_connections 2024-09-18T01:45:03.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:03.254+0000 7fba1eaa6640 1 -- 172.21.15.146:0/3276331265 wait complete. 2024-09-18T01:45:03.274 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-18T01:45:03.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:03.376+0000 7f7df27fd640 1 Processor -- start 2024-09-18T01:45:03.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:03.376+0000 7f7df27fd640 1 -- start start 2024-09-18T01:45:03.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:03.376+0000 7f7df27fd640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f7dec10ed80 0x7f7dec10f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:03.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:03.376+0000 7f7df27fd640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dec10fb50 con 0x7f7dec10f6a0 2024-09-18T01:45:03.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:03.376+0000 7f7df27fd640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x7f7dec11c830 con 0x7f7dec10ed80 2024-09-18T01:45:03.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:03.377+0000 7f7debfff640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f7dec10ed80 0x7f7dec10f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:03.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:03.377+0000 7f7debfff640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f7dec10ed80 0x7f7dec10f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:47366/0 (socket says 172.21.15.146:47366) 2024-09-18T01:45:03.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:03.377+0000 7f7deb7fe640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f7dec10f6a0 0x7f7dec11a100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:34832/0 (socket says 172.21.15.146:34832) 2024-09-18T01:45:03.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:03.377+0000 7f7debfff640 1 -- 172.21.15.146:0/1836558952 learned_addr learned my addr 172.21.15.146:0/1836558952 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:03.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:03.377+0000 7f7debfff640 1 -- 172.21.15.146:0/1836558952 >> v1:172.21.15.129:6789/0 conn(0x7f7dec10f6a0 legacy=0x7f7dec11a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:03.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:03.377+0000 7f7debfff640 1 -- 172.21.15.146:0/1836558952 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dec11c9b0 con 0x7f7dec10ed80 2024-09-18T01:45:03.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:03.378+0000 7f7debfff640 1 --2- 172.21.15.146:0/1836558952 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7dec10ed80 0x7f7dec10f160 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc0097f0 tx=0x7f7ddc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a70286489187dea server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:03.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:03.378+0000 7f7deaffd640 1 -- 172.21.15.146:0/1836558952 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ddc037070 con 0x7f7dec10ed80 2024-09-18T01:45:03.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:03.378+0000 7f7deaffd640 1 -- 172.21.15.146:0/1836558952 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ddc032440 con 0x7f7dec10ed80 2024-09-18T01:45:03.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:03.378+0000 7f7deaffd640 1 -- 172.21.15.146:0/1836558952 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ddc02ae60 con 0x7f7dec10ed80 2024-09-18T01:45:03.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:03.379+0000 7f7df27fd640 1 -- 172.21.15.146:0/1836558952 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7dec10ed80 msgr2=0x7f7dec10f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:03.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:03.379+0000 7f7df27fd640 1 --2- 172.21.15.146:0/1836558952 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7dec10ed80 0x7f7dec10f160 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc0097f0 tx=0x7f7ddc02a1e0 comp rx=0 tx=0).stop 2024-09-18T01:45:03.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:03.379+0000 7f7df27fd640 1 -- 172.21.15.146:0/1836558952 shutdown_connections 2024-09-18T01:45:03.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:03.379+0000 7f7df27fd640 1 --2- 172.21.15.146:0/1836558952 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7dec10ed80 0x7f7dec10f160 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:03.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:03.379+0000 7f7df27fd640 1 -- 172.21.15.146:0/1836558952 >> 172.21.15.146:0/1836558952 conn(0x7f7dec06f300 msgr2=0x7f7dec071720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:03.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:03.379+0000 7f7df27fd640 1 -- 172.21.15.146:0/1836558952 shutdown_connections 2024-09-18T01:45:03.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:03.379+0000 7f7df27fd640 1 -- 172.21.15.146:0/1836558952 wait complete. 2024-09-18T01:45:03.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:03.379+0000 7f7df27fd640 1 Processor -- start 2024-09-18T01:45:03.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:03.380+0000 7f7df27fd640 1 -- start start 2024-09-18T01:45:03.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:03.380+0000 7f7df27fd640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7dec10ed80 0x7f7dec10ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:03.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:03.380+0000 7f7df27fd640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f7dec11bc70 con 0x7f7dec10ed80 2024-09-18T01:45:03.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:03.380+0000 7f7debfff640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7dec10ed80 0x7f7dec10ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:03.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:03.380+0000 7f7debfff640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7dec10ed80 0x7f7dec10ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:47368/0 (socket says 172.21.15.146:47368) 2024-09-18T01:45:03.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:03.380+0000 7f7debfff640 1 -- 172.21.15.146:0/1249132585 learned_addr learned my addr 172.21.15.146:0/1249132585 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:03.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:03.380+0000 7f7debfff640 1 -- 172.21.15.146:0/1249132585 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dec1104a0 con 0x7f7dec10ed80 2024-09-18T01:45:03.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:03.380+0000 7f7debfff640 1 --2- 172.21.15.146:0/1249132585 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7dec10ed80 0x7f7dec10ff60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc035040 tx=0x7f7ddc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:03.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:03.381+0000 7f7de8ff9640 1 -- 172.21.15.146:0/1249132585 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ddc041070 con 0x7f7dec10ed80 2024-09-18T01:45:03.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:03.381+0000 7f7de8ff9640 1 -- 172.21.15.146:0/1249132585 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ddc03c7a0 con 0x7f7dec10ed80 2024-09-18T01:45:03.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:03.381+0000 7f7df27fd640 1 -- 172.21.15.146:0/1249132585 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dec110730 con 0x7f7dec10ed80 2024-09-18T01:45:03.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:03.381+0000 7f7de8ff9640 1 -- 172.21.15.146:0/1249132585 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ddc037040 con 0x7f7dec10ed80 2024-09-18T01:45:03.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:03.381+0000 7f7df27fd640 1 -- 172.21.15.146:0/1249132585 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dec110c80 con 0x7f7dec10ed80 2024-09-18T01:45:03.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:03.382+0000 7f7df27fd640 1 -- 172.21.15.146:0/1249132585 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dec10f160 con 0x7f7dec10ed80 2024-09-18T01:45:03.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:03.382+0000 7f7de8ff9640 1 -- 172.21.15.146:0/1249132585 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7ddc044070 con 0x7f7dec10ed80 2024-09-18T01:45:03.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:03.382+0000 7f7de8ff9640 1 --2- 172.21.15.146:0/1249132585 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7dd80382a0 0x7f7dd803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:03.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:03.382+0000 7f7de8ff9640 1 -- 172.21.15.146:0/1249132585 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4249+0+0 (secure 0 0 0) 0x7f7ddc06c200 con 0x7f7dec10ed80 2024-09-18T01:45:03.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:03.382+0000 7f7deb7fe640 1 --2- 172.21.15.146:0/1249132585 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7dd80382a0 0x7f7dd803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:03.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:03.382+0000 7f7deb7fe640 1 --2- 172.21.15.146:0/1249132585 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7dd80382a0 0x7f7dd803a760 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7de00015f0 tx=0x7f7de0007a40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:03.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:03.388+0000 7f7de8ff9640 1 -- 172.21.15.146:0/1249132585 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7ddc0307c0 con 0x7f7dec10ed80 2024-09-18T01:45:03.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:03.553+0000 7f7df27fd640 1 -- 172.21.15.146:0/1249132585 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"} v 0) -- 0x7f7dec10f6a0 con 0x7f7dec10ed80 2024-09-18T01:45:04.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:04.257+0000 7f7de8ff9640 1 -- 172.21.15.146:0/1249132585 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.data' v20) ==== 185+0+0 (secure 0 0 0) 0x7f7ddc03d3f0 con 0x7f7dec10ed80 2024-09-18T01:45:04.257 INFO:teuthology.orchestra.run.smithi146.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-18T01:45:04.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:04.260+0000 7f7df27fd640 1 -- 172.21.15.146:0/1249132585 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7dd80382a0 msgr2=0x7f7dd803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:04.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:04.260+0000 7f7df27fd640 1 --2- 172.21.15.146:0/1249132585 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7dd80382a0 0x7f7dd803a760 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7de00015f0 tx=0x7f7de0007a40 comp rx=0 tx=0).stop 2024-09-18T01:45:04.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:04.260+0000 7f7df27fd640 1 -- 172.21.15.146:0/1249132585 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7dec10ed80 msgr2=0x7f7dec10ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:04.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:04.260+0000 7f7df27fd640 1 --2- 172.21.15.146:0/1249132585 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7dec10ed80 0x7f7dec10ff60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc035040 tx=0x7f7ddc0046c0 comp rx=0 tx=0).stop 2024-09-18T01:45:04.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:04.262+0000 7f7df27fd640 1 -- 172.21.15.146:0/1249132585 shutdown_connections 2024-09-18T01:45:04.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:04.262+0000 7f7df27fd640 1 --2- 172.21.15.146:0/1249132585 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7dd80382a0 0x7f7dd803a760 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:04.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:04.262+0000 7f7df27fd640 1 --2- 172.21.15.146:0/1249132585 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7dec10ed80 0x7f7dec10ff60 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:04.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:04.262+0000 7f7df27fd640 1 -- 172.21.15.146:0/1249132585 >> 172.21.15.146:0/1249132585 conn(0x7f7dec06f300 msgr2=0x7f7dec117680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:04.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:04.266+0000 7f7df27fd640 1 -- 172.21.15.146:0/1249132585 shutdown_connections 2024-09-18T01:45:04.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:04.266+0000 7f7df27fd640 1 -- 172.21.15.146:0/1249132585 wait complete. 2024-09-18T01:45:04.294 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-18T01:45:04.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:04.394+0000 7f55bf928640 1 Processor -- start 2024-09-18T01:45:04.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:04.394+0000 7f55bf928640 1 -- start start 2024-09-18T01:45:04.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:04.394+0000 7f55bf928640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f55b8117fe0 0x7f55b81183c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:04.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:04.394+0000 7f55bf928640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55b8118a50 con 0x7f55b8111da0 2024-09-18T01:45:04.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:04.394+0000 7f55bf928640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x7f55b8112960 con 0x7f55b8117fe0 2024-09-18T01:45:04.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:04.395+0000 7f55bd6c4640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f55b8117fe0 0x7f55b81183c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:04.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:04.395+0000 7f55bd6c4640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f55b8117fe0 0x7f55b81183c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:47372/0 (socket says 172.21.15.146:47372) 2024-09-18T01:45:04.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:04.395+0000 7f55bd6c4640 1 -- 172.21.15.146:0/506440964 learned_addr learned my addr 172.21.15.146:0/506440964 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:04.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:04.395+0000 7f55bcec3640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f55b8111da0 0x7f55b8112250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:34836/0 (socket says 172.21.15.146:34836) 2024-09-18T01:45:04.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:04.395+0000 7f55bd6c4640 1 -- 172.21.15.146:0/506440964 >> v1:172.21.15.129:6789/0 conn(0x7f55b8111da0 legacy=0x7f55b8112250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:04.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:04.395+0000 7f55bd6c4640 1 -- 172.21.15.146:0/506440964 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55b8112b10 con 0x7f55b8117fe0 2024-09-18T01:45:04.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:04.396+0000 7f55bd6c4640 1 --2- 172.21.15.146:0/506440964 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f55b8117fe0 0x7f55b81183c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f55b00097f0 tx=0x7f55b002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a990039db57d5f25 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:04.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:04.396+0000 7f55affff640 1 -- 172.21.15.146:0/506440964 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55b0037070 con 0x7f55b8117fe0 2024-09-18T01:45:04.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:04.396+0000 7f55affff640 1 -- 172.21.15.146:0/506440964 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55b0032440 con 0x7f55b8117fe0 2024-09-18T01:45:04.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:04.396+0000 7f55affff640 1 -- 172.21.15.146:0/506440964 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55b002ae60 con 0x7f55b8117fe0 2024-09-18T01:45:04.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:04.396+0000 7f55bf928640 1 -- 172.21.15.146:0/506440964 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f55b8117fe0 msgr2=0x7f55b81183c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:04.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:04.396+0000 7f55bf928640 1 --2- 172.21.15.146:0/506440964 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f55b8117fe0 0x7f55b81183c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f55b00097f0 tx=0x7f55b002a1e0 comp rx=0 tx=0).stop 2024-09-18T01:45:04.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:04.396+0000 7f55bf928640 1 -- 172.21.15.146:0/506440964 shutdown_connections 2024-09-18T01:45:04.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:04.396+0000 7f55bf928640 1 --2- 172.21.15.146:0/506440964 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f55b8117fe0 0x7f55b81183c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:04.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:04.396+0000 7f55bf928640 1 -- 172.21.15.146:0/506440964 >> 172.21.15.146:0/506440964 conn(0x7f55b806e680 msgr2=0x7f55b806ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:04.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:04.397+0000 7f55bf928640 1 -- 172.21.15.146:0/506440964 shutdown_connections 2024-09-18T01:45:04.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:04.397+0000 7f55bf928640 1 -- 172.21.15.146:0/506440964 wait complete. 2024-09-18T01:45:04.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:04.397+0000 7f55bf928640 1 Processor -- start 2024-09-18T01:45:04.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:04.397+0000 7f55bf928640 1 -- start start 2024-09-18T01:45:04.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:04.397+0000 7f55bf928640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f55b8111da0 0x7f55b81a6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:04.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:04.397+0000 7f55bf928640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f55b811e1b0 con 0x7f55b8111da0 2024-09-18T01:45:04.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:04.398+0000 7f55bd6c4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f55b8111da0 0x7f55b81a6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:04.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:04.398+0000 7f55bd6c4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f55b8111da0 0x7f55b81a6c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:47382/0 (socket says 172.21.15.146:47382) 2024-09-18T01:45:04.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:04.398+0000 7f55bd6c4640 1 -- 172.21.15.146:0/948980319 learned_addr learned my addr 172.21.15.146:0/948980319 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:04.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:04.398+0000 7f55bd6c4640 1 -- 172.21.15.146:0/948980319 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55b81a71d0 con 0x7f55b8111da0 2024-09-18T01:45:04.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:04.398+0000 7f55bd6c4640 1 --2- 172.21.15.146:0/948980319 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f55b8111da0 0x7f55b81a6c00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f55b0035040 tx=0x7f55b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:04.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:04.398+0000 7f55adffb640 1 -- 172.21.15.146:0/948980319 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55b0041070 con 0x7f55b8111da0 2024-09-18T01:45:04.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:04.398+0000 7f55adffb640 1 -- 172.21.15.146:0/948980319 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55b003c7a0 con 0x7f55b8111da0 2024-09-18T01:45:04.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:04.398+0000 7f55adffb640 1 -- 172.21.15.146:0/948980319 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55b0037040 con 0x7f55b8111da0 2024-09-18T01:45:04.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:04.398+0000 7f55bf928640 1 -- 172.21.15.146:0/948980319 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55b81a74c0 con 0x7f55b8111da0 2024-09-18T01:45:04.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:04.399+0000 7f55bf928640 1 -- 172.21.15.146:0/948980319 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55b81ab4b0 con 0x7f55b8111da0 2024-09-18T01:45:04.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:04.399+0000 7f55adffb640 1 -- 172.21.15.146:0/948980319 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f55b0044070 con 0x7f55b8111da0 2024-09-18T01:45:04.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:04.399+0000 7f55bf928640 1 -- 172.21.15.146:0/948980319 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55b81a76f0 con 0x7f55b8111da0 2024-09-18T01:45:04.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:04.400+0000 7f55adffb640 1 --2- 172.21.15.146:0/948980319 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f559c038250 0x7f559c03a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:04.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:04.400+0000 7f55adffb640 1 -- 172.21.15.146:0/948980319 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4260+0+0 (secure 0 0 0) 0x7f55b006c1d0 con 0x7f55b8111da0 2024-09-18T01:45:04.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:04.400+0000 7f55bcec3640 1 --2- 172.21.15.146:0/948980319 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f559c038250 0x7f559c03a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:04.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:04.400+0000 7f55bcec3640 1 --2- 172.21.15.146:0/948980319 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f559c038250 0x7f559c03a710 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f55a80015f0 tx=0x7f55a8007a40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:04.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:04.404+0000 7f55adffb640 1 -- 172.21.15.146:0/948980319 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f55b003a520 con 0x7f55b8111da0 2024-09-18T01:45:04.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:04.569+0000 7f55bf928640 1 -- 172.21.15.146:0/948980319 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64} v 0) -- 0x7f55b8118440 con 0x7f55b8111da0 2024-09-18T01:45:05.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:05.261+0000 7f55adffb640 1 -- 172.21.15.146:0/948980319 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.index' created v21) ==== 169+0+0 (secure 0 0 0) 0x7f55b003a780 con 0x7f55b8111da0 2024-09-18T01:45:05.262 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'default.rgw.buckets.index' created 2024-09-18T01:45:05.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:05.264+0000 7f55bf928640 1 -- 172.21.15.146:0/948980319 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f559c038250 msgr2=0x7f559c03a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:05.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:05.264+0000 7f55bf928640 1 --2- 172.21.15.146:0/948980319 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f559c038250 0x7f559c03a710 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f55a80015f0 tx=0x7f55a8007a40 comp rx=0 tx=0).stop 2024-09-18T01:45:05.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:05.264+0000 7f55bf928640 1 -- 172.21.15.146:0/948980319 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f55b8111da0 msgr2=0x7f55b81a6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:05.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:05.264+0000 7f55bf928640 1 --2- 172.21.15.146:0/948980319 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f55b8111da0 0x7f55b81a6c00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f55b0035040 tx=0x7f55b00046c0 comp rx=0 tx=0).stop 2024-09-18T01:45:05.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:05.265+0000 7f55bf928640 1 -- 172.21.15.146:0/948980319 shutdown_connections 2024-09-18T01:45:05.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:05.265+0000 7f55bf928640 1 --2- 172.21.15.146:0/948980319 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f559c038250 0x7f559c03a710 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:05.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:05.265+0000 7f55bf928640 1 --2- 172.21.15.146:0/948980319 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f55b8111da0 0x7f55b81a6c00 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:05.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:05.265+0000 7f55bf928640 1 -- 172.21.15.146:0/948980319 >> 172.21.15.146:0/948980319 conn(0x7f55b806e680 msgr2=0x7f55b811cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:05.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:05.265+0000 7f55bf928640 1 -- 172.21.15.146:0/948980319 shutdown_connections 2024-09-18T01:45:05.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:05.265+0000 7f55bf928640 1 -- 172.21.15.146:0/948980319 wait complete. 2024-09-18T01:45:05.286 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-18T01:45:05.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:05.388+0000 7f0c47c8d640 1 Processor -- start 2024-09-18T01:45:05.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:05.389+0000 7f0c47c8d640 1 -- start start 2024-09-18T01:45:05.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:05.389+0000 7f0c47c8d640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f0c40114c40 0x7f0c40115020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:05.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:05.389+0000 7f0c47c8d640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c401156e0 con 0x7f0c40073260 2024-09-18T01:45:05.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:05.389+0000 7f0c47c8d640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x7f0c40073e00 con 0x7f0c40114c40 2024-09-18T01:45:05.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:05.389+0000 7f0c45a29640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f0c40114c40 0x7f0c40115020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:05.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:05.389+0000 7f0c45228640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f0c40073260 0x7f0c400736f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:34838/0 (socket says 172.21.15.146:34838) 2024-09-18T01:45:05.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:05.389+0000 7f0c45228640 1 -- 172.21.15.146:0/169755875 learned_addr learned my addr 172.21.15.146:0/169755875 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:45:05.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:05.389+0000 7f0c45a29640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f0c40114c40 0x7f0c40115020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:47386/0 (socket says 172.21.15.146:47386) 2024-09-18T01:45:05.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:05.390+0000 7f0c45a29640 1 -- 172.21.15.146:0/169755875 >> v1:172.21.15.129:6789/0 conn(0x7f0c40073260 legacy=0x7f0c400736f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:05.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:05.390+0000 7f0c45a29640 1 -- 172.21.15.146:0/169755875 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c40073fb0 con 0x7f0c40114c40 2024-09-18T01:45:05.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:05.390+0000 7f0c45a29640 1 --2- 172.21.15.146:0/169755875 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0c40114c40 0x7f0c40115020 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0c34009720 tx=0x7f0c3402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=666f9cf2b99526ea server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:05.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:05.391+0000 7f0c44a27640 1 -- 172.21.15.146:0/169755875 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c34037070 con 0x7f0c40114c40 2024-09-18T01:45:05.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:05.391+0000 7f0c44a27640 1 -- 172.21.15.146:0/169755875 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c3402ad90 con 0x7f0c40114c40 2024-09-18T01:45:05.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:05.391+0000 7f0c44a27640 1 -- 172.21.15.146:0/169755875 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c34032590 con 0x7f0c40114c40 2024-09-18T01:45:05.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:05.391+0000 7f0c47c8d640 1 -- 172.21.15.146:0/169755875 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0c40114c40 msgr2=0x7f0c40115020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:05.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:05.391+0000 7f0c47c8d640 1 --2- 172.21.15.146:0/169755875 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0c40114c40 0x7f0c40115020 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0c34009720 tx=0x7f0c3402a110 comp rx=0 tx=0).stop 2024-09-18T01:45:05.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:05.391+0000 7f0c47c8d640 1 -- 172.21.15.146:0/169755875 shutdown_connections 2024-09-18T01:45:05.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:05.391+0000 7f0c47c8d640 1 --2- 172.21.15.146:0/169755875 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0c40114c40 0x7f0c40115020 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:05.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:05.391+0000 7f0c47c8d640 1 -- 172.21.15.146:0/169755875 >> 172.21.15.146:0/169755875 conn(0x7f0c4006f300 msgr2=0x7f0c40071720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:05.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:05.391+0000 7f0c47c8d640 1 -- 172.21.15.146:0/169755875 shutdown_connections 2024-09-18T01:45:05.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:05.391+0000 7f0c47c8d640 1 -- 172.21.15.146:0/169755875 wait complete. 2024-09-18T01:45:05.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:05.392+0000 7f0c47c8d640 1 Processor -- start 2024-09-18T01:45:05.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:05.392+0000 7f0c47c8d640 1 -- start start 2024-09-18T01:45:05.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:05.392+0000 7f0c47c8d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0c40073260 0x7f0c401a3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:05.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:05.392+0000 7f0c47c8d640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f0c4011aea0 con 0x7f0c40073260 2024-09-18T01:45:05.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:05.392+0000 7f0c45a29640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0c40073260 0x7f0c401a3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:05.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:05.392+0000 7f0c45a29640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0c40073260 0x7f0c401a3970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:47396/0 (socket says 172.21.15.146:47396) 2024-09-18T01:45:05.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:05.392+0000 7f0c45a29640 1 -- 172.21.15.146:0/2244979999 learned_addr learned my addr 172.21.15.146:0/2244979999 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:05.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:05.393+0000 7f0c45a29640 1 -- 172.21.15.146:0/2244979999 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c401a3f40 con 0x7f0c40073260 2024-09-18T01:45:05.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:05.393+0000 7f0c45a29640 1 --2- 172.21.15.146:0/2244979999 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0c40073260 0x7f0c401a3970 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0c34009720 tx=0x7f0c340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:05.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:05.393+0000 7f0c327fc640 1 -- 172.21.15.146:0/2244979999 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c34041070 con 0x7f0c40073260 2024-09-18T01:45:05.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:05.393+0000 7f0c327fc640 1 -- 172.21.15.146:0/2244979999 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c3403c460 con 0x7f0c40073260 2024-09-18T01:45:05.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:05.393+0000 7f0c327fc640 1 -- 172.21.15.146:0/2244979999 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c34037040 con 0x7f0c40073260 2024-09-18T01:45:05.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:05.393+0000 7f0c47c8d640 1 -- 172.21.15.146:0/2244979999 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c401a41d0 con 0x7f0c40073260 2024-09-18T01:45:05.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:05.393+0000 7f0c47c8d640 1 -- 172.21.15.146:0/2244979999 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c401a8200 con 0x7f0c40073260 2024-09-18T01:45:05.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:05.394+0000 7f0c47c8d640 1 -- 172.21.15.146:0/2244979999 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c401a43a0 con 0x7f0c40073260 2024-09-18T01:45:05.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:05.394+0000 7f0c327fc640 1 -- 172.21.15.146:0/2244979999 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0c34044070 con 0x7f0c40073260 2024-09-18T01:45:05.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:05.394+0000 7f0c327fc640 1 --2- 172.21.15.146:0/2244979999 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0c24038250 0x7f0c2403a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:05.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:05.394+0000 7f0c327fc640 1 -- 172.21.15.146:0/2244979999 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 4624+0+0 (secure 0 0 0) 0x7f0c3406c170 con 0x7f0c40073260 2024-09-18T01:45:05.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:05.394+0000 7f0c45228640 1 --2- 172.21.15.146:0/2244979999 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0c24038250 0x7f0c2403a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:05.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:05.395+0000 7f0c45228640 1 --2- 172.21.15.146:0/2244979999 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0c24038250 0x7f0c2403a710 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c007fd0 tx=0x7f0c3c007ac0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:05.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:05.400+0000 7f0c327fc640 1 -- 172.21.15.146:0/2244979999 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0c3403a520 con 0x7f0c40073260 2024-09-18T01:45:05.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:05.569+0000 7f0c47c8d640 1 -- 172.21.15.146:0/2244979999 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"} v 0) -- 0x7f0c40114c40 con 0x7f0c40073260 2024-09-18T01:45:06.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:06.266+0000 7f0c327fc640 1 -- 172.21.15.146:0/2244979999 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.index' v22) ==== 187+0+0 (secure 0 0 0) 0x7f0c3403a780 con 0x7f0c40073260 2024-09-18T01:45:06.267 INFO:teuthology.orchestra.run.smithi146.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-18T01:45:06.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:06.270+0000 7f0c47c8d640 1 -- 172.21.15.146:0/2244979999 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0c24038250 msgr2=0x7f0c2403a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:06.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:06.270+0000 7f0c47c8d640 1 --2- 172.21.15.146:0/2244979999 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0c24038250 0x7f0c2403a710 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c007fd0 tx=0x7f0c3c007ac0 comp rx=0 tx=0).stop 2024-09-18T01:45:06.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:06.270+0000 7f0c47c8d640 1 -- 172.21.15.146:0/2244979999 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0c40073260 msgr2=0x7f0c401a3970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:06.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:06.270+0000 7f0c47c8d640 1 --2- 172.21.15.146:0/2244979999 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0c40073260 0x7f0c401a3970 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0c34009720 tx=0x7f0c340046c0 comp rx=0 tx=0).stop 2024-09-18T01:45:06.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:06.271+0000 7f0c47c8d640 1 -- 172.21.15.146:0/2244979999 shutdown_connections 2024-09-18T01:45:06.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:06.271+0000 7f0c47c8d640 1 --2- 172.21.15.146:0/2244979999 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0c24038250 0x7f0c2403a710 secure :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c007fd0 tx=0x7f0c3c007ac0 comp rx=0 tx=0).stop 2024-09-18T01:45:06.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:06.271+0000 7f0c47c8d640 1 --2- 172.21.15.146:0/2244979999 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0c40073260 0x7f0c401a3970 secure :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0c34009720 tx=0x7f0c340046c0 comp rx=0 tx=0).stop 2024-09-18T01:45:06.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:06.271+0000 7f0c47c8d640 1 -- 172.21.15.146:0/2244979999 >> 172.21.15.146:0/2244979999 conn(0x7f0c4006f300 msgr2=0x7f0c40115b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:06.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:06.273+0000 7f0c47c8d640 1 -- 172.21.15.146:0/2244979999 shutdown_connections 2024-09-18T01:45:06.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:06.273+0000 7f0c47c8d640 1 -- 172.21.15.146:0/2244979999 wait complete. 2024-09-18T01:45:06.298 DEBUG:tasks.rgw:Pools created 2024-09-18T01:45:06.298 INFO:tasks.rgw:Starting rgw... 2024-09-18T01:45:06.298 INFO:tasks.rgw:rgw client.0 config is {} 2024-09-18T01:45:06.298 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-18T01:45:06.298 DEBUG:teuthology.orchestra.run.smithi146:> sudo echo -n http://smithi146.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-18T01:45:06.326 INFO:teuthology.orchestra.run.smithi146.stdout:http://smithi146.front.sepia.ceph.com:80 2024-09-18T01:45:06.326 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-18T01:45:06.392 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-18T01:45:06.393 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-18T01:45:06.435 INFO:tasks.rgw.client.0:Started 2024-09-18T01:45:06.435 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi146.front.sepia.ceph.com:80/ 2024-09-18T01:45:06.435 DEBUG:teuthology.orchestra.run.smithi146:> curl http://smithi146.front.sepia.ceph.com:80/ 2024-09-18T01:45:06.472 INFO:teuthology.orchestra.run.smithi146.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-18T01:45:06.472 INFO:teuthology.orchestra.run.smithi146.stderr: Dload Upload Total Spent Left Speed 2024-09-18T01:45:06.472 INFO:teuthology.orchestra.run.smithi146.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-18T01:45:06.473 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-18T01:45:06.474 INFO:teuthology.orchestra.run.smithi146.stderr:curl: (7) Failed to connect to smithi146.front.sepia.ceph.com port 80: Connection refused 2024-09-18T01:45:07.475 DEBUG:teuthology.orchestra.run.smithi146:> curl http://smithi146.front.sepia.ceph.com:80/ 2024-09-18T01:45:07.496 INFO:teuthology.orchestra.run.smithi146.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-18T01:45:07.496 INFO:teuthology.orchestra.run.smithi146.stderr: Dload Upload Total Spent Left Speed 2024-09-18T01:45:07.498 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-18T01:45:07.498 INFO:teuthology.orchestra.run.smithi146.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-18T01:45:07.498 INFO:teuthology.orchestra.run.smithi146.stderr:curl: (7) Failed to connect to smithi146.front.sepia.ceph.com port 80: Connection refused 2024-09-18T01:45:09.499 DEBUG:teuthology.orchestra.run.smithi146:> curl http://smithi146.front.sepia.ceph.com:80/ 2024-09-18T01:45:09.523 INFO:teuthology.orchestra.run.smithi146.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-18T01:45:09.523 INFO:teuthology.orchestra.run.smithi146.stderr: Dload Upload Total Spent Left Speed 2024-09-18T01:45:09.523 INFO:teuthology.orchestra.run.smithi146.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-18T01:45:09.524 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-18T01:45:09.524 INFO:teuthology.orchestra.run.smithi146.stderr:curl: (7) Failed to connect to smithi146.front.sepia.ceph.com port 80: Connection refused 2024-09-18T01:45:13.526 DEBUG:teuthology.orchestra.run.smithi146:> curl http://smithi146.front.sepia.ceph.com:80/ 2024-09-18T01:45:13.548 INFO:teuthology.orchestra.run.smithi146.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-18T01:45:13.549 INFO:teuthology.orchestra.run.smithi146.stderr: Dload Upload Total Spent Left Speed 2024-09-18T01:45:13.550 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-18T01:45:13.550 INFO:teuthology.orchestra.run.smithi146.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-18T01:45:13.550 INFO:teuthology.orchestra.run.smithi146.stderr:curl: (7) Failed to connect to smithi146.front.sepia.ceph.com port 80: Connection refused 2024-09-18T01:45:15.467 INFO:tasks.rgw.client.0.smithi146.stdout:2024-09-18T01:45:15.467+0000 7f19c814d880 -1 LDAP not started since no server URIs were provided in the configuration. 2024-09-18T01:45:21.552 DEBUG:teuthology.orchestra.run.smithi146:> curl http://smithi146.front.sepia.ceph.com:80/ 2024-09-18T01:45:21.576 INFO:teuthology.orchestra.run.smithi146.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-18T01:45:21.577 INFO:teuthology.orchestra.run.smithi146.stderr: Dload Upload Total Spent Left Speed 2024-09-18T01:45:21.578 INFO:teuthology.orchestra.run.smithi146.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 93500 0 --:--:-- --:--:-- --:--:-- 93500 2024-09-18T01:45:21.579 INFO:teuthology.orchestra.run.smithi146.stdout:anonymous 2024-09-18T01:45:21.579 INFO:teuthology.run_tasks:Running task radosgw-admin... 2024-09-18T01:45:21.678 DEBUG:tasks.radosgw_admin:config is: {'client.0': None} 2024-09-18T01:45:21.678 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-18T01:45:21.678 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-18T01:45:21.678 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-18T01:45:21.730 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:21.730 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:21.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.730+0000 7f034b326800 1 Processor -- start 2024-09-18T01:45:21.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.731+0000 7f034b326800 1 -- start start 2024-09-18T01:45:21.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.731+0000 7f034b326800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55a5d8f06e00 0x55a5d8f961b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:21.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.731+0000 7f034b326800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a5d8e52b30 con 0x55a5d8f966f0 2024-09-18T01:45:21.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.731+0000 7f034b326800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x55a5d8e34360 con 0x55a5d8f06e00 2024-09-18T01:45:21.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.731+0000 7f0346f13640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55a5d8f06e00 0x55a5d8f961b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:21.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.731+0000 7f0346f13640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55a5d8f06e00 0x55a5d8f961b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59060/0 (socket says 172.21.15.146:59060) 2024-09-18T01:45:21.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.731+0000 7f0346f13640 1 -- 172.21.15.146:0/3029084600 learned_addr learned my addr 172.21.15.146:0/3029084600 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:21.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.731+0000 7f0346f13640 1 -- 172.21.15.146:0/3029084600 >> v1:172.21.15.129:6789/0 conn(0x55a5d8f966f0 legacy=0x55a5d8f98ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:21.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.732+0000 7f0345f11640 1 -- 172.21.15.146:0/3029084600 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3566181057 0 0) 0x55a5d8e52b30 con 0x55a5d8f966f0 2024-09-18T01:45:21.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.732+0000 7f0346f13640 1 -- 172.21.15.146:0/3029084600 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5d8e5ae00 con 0x55a5d8f06e00 2024-09-18T01:45:21.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.733+0000 7f0346f13640 1 --2- 172.21.15.146:0/3029084600 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a5d8f06e00 0x55a5d8f961b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0338005fd0 tx=0x7f0338045cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29ee7650a57a1314 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:21.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.734+0000 7f0345f11640 1 -- 172.21.15.146:0/3029084600 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f033804e600 con 0x55a5d8f06e00 2024-09-18T01:45:21.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.734+0000 7f0345f11640 1 -- 172.21.15.146:0/3029084600 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f033804e7a0 con 0x55a5d8f06e00 2024-09-18T01:45:21.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.734+0000 7f0345f11640 1 -- 172.21.15.146:0/3029084600 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f033804eaa0 con 0x55a5d8f06e00 2024-09-18T01:45:21.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.734+0000 7f034b326800 1 -- 172.21.15.146:0/3029084600 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a5d8f06e00 msgr2=0x55a5d8f961b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:21.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.734+0000 7f034b326800 1 --2- 172.21.15.146:0/3029084600 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a5d8f06e00 0x55a5d8f961b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0338005fd0 tx=0x7f0338045cf0 comp rx=0 tx=0).stop 2024-09-18T01:45:21.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.734+0000 7f034b326800 1 -- 172.21.15.146:0/3029084600 shutdown_connections 2024-09-18T01:45:21.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.734+0000 7f034b326800 1 --2- 172.21.15.146:0/3029084600 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a5d8f06e00 0x55a5d8f961b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:21.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.734+0000 7f034b326800 1 -- 172.21.15.146:0/3029084600 >> 172.21.15.146:0/3029084600 conn(0x55a5d8f8dde0 msgr2=0x55a5d8f90200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:21.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.734+0000 7f034b326800 1 -- 172.21.15.146:0/3029084600 shutdown_connections 2024-09-18T01:45:21.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.734+0000 7f034b326800 1 -- 172.21.15.146:0/3029084600 wait complete. 2024-09-18T01:45:21.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.750+0000 7f034b326800 1 Processor -- start 2024-09-18T01:45:21.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.750+0000 7f034b326800 1 -- start start 2024-09-18T01:45:21.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.750+0000 7f034b326800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a5d8f06e00 0x55a5d9082600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:21.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.751+0000 7f034b326800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55a5d8edf320 con 0x55a5d8f06e00 2024-09-18T01:45:21.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.751+0000 7f0346f13640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a5d8f06e00 0x55a5d9082600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:21.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.751+0000 7f0346f13640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a5d8f06e00 0x55a5d9082600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59074/0 (socket says 172.21.15.146:59074) 2024-09-18T01:45:21.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.751+0000 7f0346f13640 1 -- 172.21.15.146:0/3876065217 learned_addr learned my addr 172.21.15.146:0/3876065217 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:21.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.751+0000 7f0346f13640 1 -- 172.21.15.146:0/3876065217 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5d8e2cbc0 con 0x55a5d8f06e00 2024-09-18T01:45:21.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.751+0000 7f0346f13640 1 --2- 172.21.15.146:0/3876065217 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a5d8f06e00 0x55a5d9082600 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f033800a4b0 tx=0x7f0338050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c253f6292361545 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:21.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.752+0000 7f0234e09640 1 -- 172.21.15.146:0/3876065217 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f033804ea80 con 0x55a5d8f06e00 2024-09-18T01:45:21.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.752+0000 7f0234e09640 1 -- 172.21.15.146:0/3876065217 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0338066070 con 0x55a5d8f06e00 2024-09-18T01:45:21.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.752+0000 7f0234e09640 1 -- 172.21.15.146:0/3876065217 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f033804edc0 con 0x55a5d8f06e00 2024-09-18T01:45:21.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.752+0000 7f034b326800 1 -- 172.21.15.146:0/3876065217 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a5d8f06e00 msgr2=0x55a5d9082600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:21.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.752+0000 7f034b326800 1 --2- 172.21.15.146:0/3876065217 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a5d8f06e00 0x55a5d9082600 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f033800a4b0 tx=0x7f0338050000 comp rx=0 tx=0).stop 2024-09-18T01:45:21.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.753+0000 7f034b326800 1 -- 172.21.15.146:0/3876065217 shutdown_connections 2024-09-18T01:45:21.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.753+0000 7f034b326800 1 --2- 172.21.15.146:0/3876065217 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a5d8f06e00 0x55a5d9082600 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:21.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.753+0000 7f034b326800 1 -- 172.21.15.146:0/3876065217 >> 172.21.15.146:0/3876065217 conn(0x55a5d8f8dde0 msgr2=0x55a5d907dfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:21.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.753+0000 7f034b326800 1 -- 172.21.15.146:0/3876065217 shutdown_connections 2024-09-18T01:45:21.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.753+0000 7f034b326800 1 -- 172.21.15.146:0/3876065217 wait complete. 2024-09-18T01:45:21.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.753+0000 7f034b326800 1 Processor -- start 2024-09-18T01:45:21.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.753+0000 7f034b326800 1 -- start start 2024-09-18T01:45:21.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.753+0000 7f034b326800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a5d8f06e00 0x55a5d9089e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:21.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.753+0000 7f034b326800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55a5d8f9a5f0 con 0x55a5d8f06e00 2024-09-18T01:45:21.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.754+0000 7f0346f13640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a5d8f06e00 0x55a5d9089e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:21.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.754+0000 7f0346f13640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a5d8f06e00 0x55a5d9089e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59080/0 (socket says 172.21.15.146:59080) 2024-09-18T01:45:21.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.754+0000 7f0346f13640 1 -- 172.21.15.146:0/108579414 learned_addr learned my addr 172.21.15.146:0/108579414 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:21.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.754+0000 7f0346f13640 1 -- 172.21.15.146:0/108579414 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5d8e40fe0 con 0x55a5d8f06e00 2024-09-18T01:45:21.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.754+0000 7f0346f13640 1 --2- 172.21.15.146:0/108579414 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a5d8f06e00 0x55a5d9089e60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0338063040 tx=0x7f0338003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:21.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.754+0000 7f0233606640 1 -- 172.21.15.146:0/108579414 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0338076470 con 0x55a5d8f06e00 2024-09-18T01:45:21.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.754+0000 7f0233606640 1 -- 172.21.15.146:0/108579414 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0338071070 con 0x55a5d8f06e00 2024-09-18T01:45:21.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.754+0000 7f034b326800 1 -- 172.21.15.146:0/108579414 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a5d908a3a0 con 0x55a5d8f06e00 2024-09-18T01:45:21.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.754+0000 7f0233606640 1 -- 172.21.15.146:0/108579414 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0338076740 con 0x55a5d8f06e00 2024-09-18T01:45:21.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.754+0000 7f034b326800 1 -- 172.21.15.146:0/108579414 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5d908a8c0 con 0x55a5d8f06e00 2024-09-18T01:45:21.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.755+0000 7f0233606640 1 -- 172.21.15.146:0/108579414 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f033806d420 con 0x55a5d8f06e00 2024-09-18T01:45:21.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.755+0000 7f0233606640 1 --2- 172.21.15.146:0/108579414 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f022c036b40 0x7f022c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:21.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.756+0000 7f0233606640 1 -- 172.21.15.146:0/108579414 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f0338091620 con 0x55a5d8f06e00 2024-09-18T01:45:21.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.756+0000 7f0346712640 1 --2- 172.21.15.146:0/108579414 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f022c036b40 0x7f022c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:21.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.756+0000 7f034b326800 1 --2- 172.21.15.146:0/108579414 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a5d8f966f0 0x55a5d9090ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:21.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.756+0000 7f034b326800 1 -- 172.21.15.146:0/108579414 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a5d9091460 con 0x55a5d8f966f0 2024-09-18T01:45:21.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.756+0000 7f0347714640 1 --2- 172.21.15.146:0/108579414 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a5d8f966f0 0x55a5d9090ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:21.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.756+0000 7f0346712640 1 --2- 172.21.15.146:0/108579414 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f022c036b40 0x7f022c039000 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0330000f60 tx=0x7f03300013f0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:21.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.756+0000 7f0347714640 1 --2- 172.21.15.146:0/108579414 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a5d8f966f0 0x55a5d9090ed0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:21.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.756+0000 7f0347714640 1 -- 172.21.15.146:0/108579414 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f03400083e0 con 0x55a5d8f966f0 2024-09-18T01:45:21.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.757+0000 7f034b326800 1 -- 172.21.15.146:0/108579414 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a5d908e460 con 0x55a5d8f966f0 2024-09-18T01:45:21.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.757+0000 7f0347714640 1 -- 172.21.15.146:0/108579414 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f03400083e0 con 0x55a5d8f966f0 2024-09-18T01:45:21.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.757+0000 7f034b326800 1 -- 172.21.15.146:0/108579414 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90932d0 con 0x55a5d8f966f0 2024-09-18T01:45:21.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.757+0000 7f0347714640 1 -- 172.21.15.146:0/108579414 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f03400083e0 con 0x55a5d8f966f0 2024-09-18T01:45:21.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.757+0000 7f034b326800 1 -- 172.21.15.146:0/108579414 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a5d9092500 con 0x55a5d8f966f0 2024-09-18T01:45:21.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.757+0000 7f0347714640 1 -- 172.21.15.146:0/108579414 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f03400083e0 con 0x55a5d8f966f0 2024-09-18T01:45:21.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.758+0000 7f034b326800 1 --2- 172.21.15.146:0/108579414 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55a5d9094680 0x55a5d9096a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:21.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.758+0000 7f034b326800 1 -- 172.21.15.146:0/108579414 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a5d9096fb0 con 0x55a5d9094680 2024-09-18T01:45:21.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.758+0000 7f0346f13640 1 --2- 172.21.15.146:0/108579414 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55a5d9094680 0x55a5d9096a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:21.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.758+0000 7f0346f13640 1 --2- 172.21.15.146:0/108579414 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55a5d9094680 0x55a5d9096a70 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:21.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.758+0000 7f0346f13640 1 -- 172.21.15.146:0/108579414 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f033806c420 con 0x55a5d9094680 2024-09-18T01:45:21.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.759+0000 7f034b326800 1 Processor -- start 2024-09-18T01:45:21.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.759+0000 7f034b326800 1 -- start start 2024-09-18T01:45:21.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.759+0000 7f034b326800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a5d90a4c50 0x55a5d90a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:21.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.759+0000 7f034b326800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55a5d8e2e580 con 0x55a5d90a4c50 2024-09-18T01:45:21.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.759+0000 7f0347714640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a5d90a4c50 0x55a5d90a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:21.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.759+0000 7f0347714640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a5d90a4c50 0x55a5d90a5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59088/0 (socket says 172.21.15.146:59088) 2024-09-18T01:45:21.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.759+0000 7f0347714640 1 -- 172.21.15.146:0/3362070275 learned_addr learned my addr 172.21.15.146:0/3362070275 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:21.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.760+0000 7f0347714640 1 -- 172.21.15.146:0/3362070275 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5d90a55b0 con 0x55a5d90a4c50 2024-09-18T01:45:21.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.760+0000 7f0347714640 1 --2- 172.21.15.146:0/3362070275 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a5d90a4c50 0x55a5d90a5070 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x55a5d908b080 tx=0x7f034000ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:21.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.760+0000 7f0230e01640 1 -- 172.21.15.146:0/3362070275 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f034001c070 con 0x55a5d90a4c50 2024-09-18T01:45:21.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.760+0000 7f0230e01640 1 -- 172.21.15.146:0/3362070275 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f034000bdc0 con 0x55a5d90a4c50 2024-09-18T01:45:21.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.760+0000 7f034b326800 1 -- 172.21.15.146:0/3362070275 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a5d90a5840 con 0x55a5d90a4c50 2024-09-18T01:45:21.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.760+0000 7f0230e01640 1 -- 172.21.15.146:0/3362070275 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0340018540 con 0x55a5d90a4c50 2024-09-18T01:45:21.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.760+0000 7f034b326800 1 -- 172.21.15.146:0/3362070275 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5d90a8520 con 0x55a5d90a4c50 2024-09-18T01:45:21.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.761+0000 7f0230e01640 1 -- 172.21.15.146:0/3362070275 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f034001f070 con 0x55a5d90a4c50 2024-09-18T01:45:21.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.761+0000 7f0230e01640 1 --2- 172.21.15.146:0/3362070275 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0220036b90 0x7f0220039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:21.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.761+0000 7f0230e01640 1 -- 172.21.15.146:0/3362070275 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f034004e5a0 con 0x55a5d90a4c50 2024-09-18T01:45:21.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.761+0000 7f0346f13640 1 --2- 172.21.15.146:0/3362070275 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0220036b90 0x7f0220039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:21.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.762+0000 7f034b326800 1 Processor -- start 2024-09-18T01:45:21.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.762+0000 7f0346f13640 1 --2- 172.21.15.146:0/3362070275 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0220036b90 0x7f0220039050 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f033808fb30 tx=0x7f033806c6f0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:21.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.762+0000 7f034b326800 1 -- start start 2024-09-18T01:45:21.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.762+0000 7f034b326800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a5d8f933e0 0x55a5d8f937e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:21.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.762+0000 7f034b326800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55a5d9082cf0 con 0x55a5d8f933e0 2024-09-18T01:45:21.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.762+0000 7f0347714640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a5d8f933e0 0x55a5d8f937e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:21.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.762+0000 7f0347714640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a5d8f933e0 0x55a5d8f937e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59094/0 (socket says 172.21.15.146:59094) 2024-09-18T01:45:21.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.762+0000 7f0347714640 1 -- 172.21.15.146:0/1777398660 learned_addr learned my addr 172.21.15.146:0/1777398660 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:21.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.762+0000 7f0347714640 1 -- 172.21.15.146:0/1777398660 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5d8f93db0 con 0x55a5d8f933e0 2024-09-18T01:45:21.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.763+0000 7f0347714640 1 --2- 172.21.15.146:0/1777398660 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a5d8f933e0 0x55a5d8f937e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f034004c920 tx=0x7f034004caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0a8501db1aa0a04 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:21.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.763+0000 7f022a7fc640 1 -- 172.21.15.146:0/1777398660 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0340029480 con 0x55a5d8f933e0 2024-09-18T01:45:21.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.763+0000 7f022a7fc640 1 -- 172.21.15.146:0/1777398660 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0340029c70 con 0x55a5d8f933e0 2024-09-18T01:45:21.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.763+0000 7f022a7fc640 1 -- 172.21.15.146:0/1777398660 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0340014bb0 con 0x55a5d8f933e0 2024-09-18T01:45:21.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.763+0000 7f034b326800 1 -- 172.21.15.146:0/1777398660 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a5d8f933e0 msgr2=0x55a5d8f937e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:21.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.763+0000 7f034b326800 1 --2- 172.21.15.146:0/1777398660 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a5d8f933e0 0x55a5d8f937e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f034004c920 tx=0x7f034004caf0 comp rx=0 tx=0).stop 2024-09-18T01:45:21.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.763+0000 7f034b326800 1 -- 172.21.15.146:0/1777398660 shutdown_connections 2024-09-18T01:45:21.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.763+0000 7f034b326800 1 --2- 172.21.15.146:0/1777398660 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a5d8f933e0 0x55a5d8f937e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:21.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.763+0000 7f034b326800 1 -- 172.21.15.146:0/1777398660 >> 172.21.15.146:0/1777398660 conn(0x55a5d90adc00 msgr2=0x55a5d90abd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:21.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.763+0000 7f034b326800 1 -- 172.21.15.146:0/1777398660 shutdown_connections 2024-09-18T01:45:21.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.763+0000 7f034b326800 1 -- 172.21.15.146:0/1777398660 wait complete. 2024-09-18T01:45:21.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.764+0000 7f034b326800 1 Processor -- start 2024-09-18T01:45:21.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.764+0000 7f034b326800 1 -- start start 2024-09-18T01:45:21.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.764+0000 7f034b326800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a5d8f933e0 0x55a5d90baf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:21.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.764+0000 7f034b326800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55a5d8f92110 con 0x55a5d8f933e0 2024-09-18T01:45:21.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.764+0000 7f0347714640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a5d8f933e0 0x55a5d90baf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:21.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.764+0000 7f0347714640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a5d8f933e0 0x55a5d90baf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59106/0 (socket says 172.21.15.146:59106) 2024-09-18T01:45:21.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.764+0000 7f0347714640 1 -- 172.21.15.146:0/1160970618 learned_addr learned my addr 172.21.15.146:0/1160970618 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:21.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.764+0000 7f0347714640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5d90bb490 con 0x55a5d8f933e0 2024-09-18T01:45:21.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.765+0000 7f0347714640 1 --2- 172.21.15.146:0/1160970618 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a5d8f933e0 0x55a5d90baf50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f03400176b0 tx=0x7f034004c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:21.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.765+0000 7f0228ff9640 1 -- 172.21.15.146:0/1160970618 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f034003b070 con 0x55a5d8f933e0 2024-09-18T01:45:21.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.765+0000 7f0228ff9640 1 -- 172.21.15.146:0/1160970618 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f034004e280 con 0x55a5d8f933e0 2024-09-18T01:45:21.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.765+0000 7f034b326800 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a5d90bb720 con 0x55a5d8f933e0 2024-09-18T01:45:21.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.765+0000 7f0228ff9640 1 -- 172.21.15.146:0/1160970618 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0340029850 con 0x55a5d8f933e0 2024-09-18T01:45:21.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.765+0000 7f034b326800 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5d90be3d0 con 0x55a5d8f933e0 2024-09-18T01:45:21.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.766+0000 7f0228ff9640 1 -- 172.21.15.146:0/1160970618 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f034003e070 con 0x55a5d8f933e0 2024-09-18T01:45:21.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.766+0000 7f0228ff9640 1 --2- 172.21.15.146:0/1160970618 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0210036b40 0x7f0210039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:21.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.766+0000 7f0228ff9640 1 -- 172.21.15.146:0/1160970618 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f0340033070 con 0x55a5d8f933e0 2024-09-18T01:45:21.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.766+0000 7f0346f13640 1 --2- 172.21.15.146:0/1160970618 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0210036b40 0x7f0210039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:21.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.766+0000 7f034b326800 20 rados->read ofs=0 len=0 2024-09-18T01:45:21.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.766+0000 7f034b326800 1 --2- 172.21.15.146:0/1160970618 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a5d90c69f0 0x55a5d90c8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:21.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.766+0000 7f034b326800 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90c9600 con 0x55a5d90c69f0 2024-09-18T01:45:21.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.766+0000 7f0346712640 1 --2- 172.21.15.146:0/1160970618 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a5d90c69f0 0x55a5d90c8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:21.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.767+0000 7f0346f13640 1 --2- 172.21.15.146:0/1160970618 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0210036b40 0x7f0210039000 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0338000f80 tx=0x7f0338094000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:21.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.767+0000 7f0346712640 1 --2- 172.21.15.146:0/1160970618 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a5d90c69f0 0x55a5d90c8eb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:21.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.767+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0330010510 con 0x55a5d90c69f0 2024-09-18T01:45:21.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.767+0000 7f034b326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:21.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.767+0000 7f034b326800 20 realm 2024-09-18T01:45:21.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.767+0000 7f034b326800 20 rados->read ofs=0 len=0 2024-09-18T01:45:21.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.767+0000 7f034b326800 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90c5e40 con 0x55a5d90c69f0 2024-09-18T01:45:21.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.767+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0330010510 con 0x55a5d90c69f0 2024-09-18T01:45:21.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.767+0000 7f034b326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:21.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.767+0000 7f034b326800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:21.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.767+0000 7f034b326800 20 rados->read ofs=0 len=0 2024-09-18T01:45:21.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.767+0000 7f034b326800 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90ca0e0 con 0x55a5d90c69f0 2024-09-18T01:45:21.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.767+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0330010510 con 0x55a5d90c69f0 2024-09-18T01:45:21.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.767+0000 7f034b326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:21.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.767+0000 7f034b326800 20 rados->read ofs=0 len=0 2024-09-18T01:45:21.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.768+0000 7f034b326800 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90ca9b0 con 0x55a5d90c69f0 2024-09-18T01:45:21.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.768+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0330010510 con 0x55a5d90c69f0 2024-09-18T01:45:21.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.768+0000 7f034b326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:21.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.768+0000 7f034b326800 20 rados->read ofs=0 len=0 2024-09-18T01:45:21.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.768+0000 7f034b326800 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90cad50 con 0x55a5d90c69f0 2024-09-18T01:45:21.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.768+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0330010510 con 0x55a5d90c69f0 2024-09-18T01:45:21.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.768+0000 7f034b326800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:21.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.768+0000 7f034b326800 20 searching for the correct realm 2024-09-18T01:45:21.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.768+0000 7f034b326800 1 --2- 172.21.15.146:0/1160970618 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55a5d90ccc80 0x55a5d90cf070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:21.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.768+0000 7f034b326800 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90cf740 con 0x55a5d90ccc80 2024-09-18T01:45:21.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.768+0000 7f0347714640 1 --2- 172.21.15.146:0/1160970618 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55a5d90ccc80 0x55a5d90cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:21.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.769+0000 7f0347714640 1 --2- 172.21.15.146:0/1160970618 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55a5d90ccc80 0x55a5d90cf070 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:21.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.769+0000 7f0347714640 1 -- 172.21.15.146:0/1160970618 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0340056040 con 0x55a5d90ccc80 2024-09-18T01:45:21.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.769+0000 7f0347714640 1 --2- 172.21.15.146:0/1160970618 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f03400163a0 0x7f0340016a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:21.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.769+0000 7f0347714640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90cf740 con 0x7f03400163a0 2024-09-18T01:45:21.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.769+0000 7f0346f13640 1 --2- 172.21.15.146:0/1160970618 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f03400163a0 0x7f0340016a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:21.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.769+0000 7f0346f13640 1 --2- 172.21.15.146:0/1160970618 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f03400163a0 0x7f0340016a60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:21.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.770+0000 7f0346f13640 1 -- 172.21.15.146:0/1160970618 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f033806c420 con 0x7f03400163a0 2024-09-18T01:45:21.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.770+0000 7f0346f13640 1 --2- 172.21.15.146:0/1160970618 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f033806d040 0x7f03380768e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:21.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.770+0000 7f0346f13640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90cf740 con 0x7f033806d040 2024-09-18T01:45:21.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.770+0000 7f0346712640 1 --2- 172.21.15.146:0/1160970618 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f033806d040 0x7f03380768e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:21.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.770+0000 7f0346712640 1 --2- 172.21.15.146:0/1160970618 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f033806d040 0x7f03380768e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:21.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.771+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0330010510 con 0x7f033806d040 2024-09-18T01:45:21.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.771+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90cf740 con 0x55a5d90c69f0 2024-09-18T01:45:21.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.771+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v24'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0330010510 con 0x55a5d90c69f0 2024-09-18T01:45:21.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.771+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90cf740 con 0x55a5d90c69f0 2024-09-18T01:45:21.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.771+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f033002b040 con 0x55a5d90c69f0 2024-09-18T01:45:21.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.771+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90cf740 con 0x7f033806d040 2024-09-18T01:45:21.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.771+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f033002b040 con 0x7f033806d040 2024-09-18T01:45:21.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.771+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90cf740 con 0x7f033806d040 2024-09-18T01:45:21.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.772+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f033002b040 con 0x7f033806d040 2024-09-18T01:45:21.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.772+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90cf740 con 0x7f03400163a0 2024-09-18T01:45:21.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.772+0000 7f0346f13640 1 -- 172.21.15.146:0/1160970618 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f033806c420 con 0x7f03400163a0 2024-09-18T01:45:21.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.772+0000 7f0346f13640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90cf740 con 0x55a5d90ccc80 2024-09-18T01:45:21.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.772+0000 7f0347714640 1 -- 172.21.15.146:0/1160970618 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0340056040 con 0x55a5d90ccc80 2024-09-18T01:45:21.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.772+0000 7f0347714640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90cf740 con 0x55a5d90c69f0 2024-09-18T01:45:21.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.773+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f033002b040 con 0x55a5d90c69f0 2024-09-18T01:45:21.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.773+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90cf740 con 0x7f033806d040 2024-09-18T01:45:21.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.773+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f033002b040 con 0x7f033806d040 2024-09-18T01:45:21.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.773+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90cf740 con 0x55a5d90c69f0 2024-09-18T01:45:21.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.773+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f033002b040 con 0x55a5d90c69f0 2024-09-18T01:45:21.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.773+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90cf740 con 0x7f03400163a0 2024-09-18T01:45:21.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.773+0000 7f0346f13640 1 -- 172.21.15.146:0/1160970618 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f033806c420 con 0x7f03400163a0 2024-09-18T01:45:21.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.773+0000 7f0346f13640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90cf740 con 0x55a5d90ccc80 2024-09-18T01:45:21.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.774+0000 7f0347714640 1 -- 172.21.15.146:0/1160970618 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0340056040 con 0x55a5d90ccc80 2024-09-18T01:45:21.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.774+0000 7f0347714640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90cf740 con 0x55a5d90ccc80 2024-09-18T01:45:21.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.774+0000 7f0347714640 1 -- 172.21.15.146:0/1160970618 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0340056040 con 0x55a5d90ccc80 2024-09-18T01:45:21.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.774+0000 7f0347714640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90cf740 con 0x7f033806d040 2024-09-18T01:45:21.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.774+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f033002b040 con 0x7f033806d040 2024-09-18T01:45:21.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.774+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90cf740 con 0x55a5d90ccc80 2024-09-18T01:45:21.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.775+0000 7f0347714640 1 -- 172.21.15.146:0/1160970618 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0340056040 con 0x55a5d90ccc80 2024-09-18T01:45:21.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.775+0000 7f0347714640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90cf740 con 0x55a5d90ccc80 2024-09-18T01:45:21.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.775+0000 7f0347714640 1 -- 172.21.15.146:0/1160970618 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0340056040 con 0x55a5d90ccc80 2024-09-18T01:45:21.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.775+0000 7f0347714640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90cf740 con 0x55a5d90c69f0 2024-09-18T01:45:21.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.775+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f033002b040 con 0x55a5d90c69f0 2024-09-18T01:45:21.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.775+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90cf740 con 0x55a5d90c69f0 2024-09-18T01:45:21.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.775+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f033002b040 con 0x55a5d90c69f0 2024-09-18T01:45:21.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.775+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90cf740 con 0x7f033806d040 2024-09-18T01:45:21.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.776+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f033002b040 con 0x7f033806d040 2024-09-18T01:45:21.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.776+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90cf740 con 0x55a5d90ccc80 2024-09-18T01:45:21.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.776+0000 7f0347714640 1 -- 172.21.15.146:0/1160970618 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0340056040 con 0x55a5d90ccc80 2024-09-18T01:45:21.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.776+0000 7f0347714640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90cf740 con 0x7f03400163a0 2024-09-18T01:45:21.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.776+0000 7f0346f13640 1 -- 172.21.15.146:0/1160970618 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f033806c420 con 0x7f03400163a0 2024-09-18T01:45:21.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.776+0000 7f0346f13640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90cf740 con 0x55a5d90c69f0 2024-09-18T01:45:21.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.776+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f033002b040 con 0x55a5d90c69f0 2024-09-18T01:45:21.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.776+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90cf740 con 0x7f033806d040 2024-09-18T01:45:21.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.777+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f033003b040 con 0x7f033806d040 2024-09-18T01:45:21.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.777+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90cf740 con 0x55a5d90ccc80 2024-09-18T01:45:21.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.777+0000 7f0347714640 1 -- 172.21.15.146:0/1160970618 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0340056040 con 0x55a5d90ccc80 2024-09-18T01:45:21.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.777+0000 7f0347714640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90cf740 con 0x7f033806d040 2024-09-18T01:45:21.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.777+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f033003b040 con 0x7f033806d040 2024-09-18T01:45:21.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.777+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90cf740 con 0x7f03400163a0 2024-09-18T01:45:21.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.778+0000 7f0346f13640 1 -- 172.21.15.146:0/1160970618 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f033806c420 con 0x7f03400163a0 2024-09-18T01:45:21.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.778+0000 7f0346f13640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90cf740 con 0x55a5d90ccc80 2024-09-18T01:45:21.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.778+0000 7f0347714640 1 -- 172.21.15.146:0/1160970618 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0340056040 con 0x55a5d90ccc80 2024-09-18T01:45:21.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.778+0000 7f0347714640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90cf740 con 0x7f033806d040 2024-09-18T01:45:21.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.778+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f033003b040 con 0x7f033806d040 2024-09-18T01:45:21.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.778+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90cf740 con 0x55a5d90c69f0 2024-09-18T01:45:21.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.779+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f033003b040 con 0x55a5d90c69f0 2024-09-18T01:45:21.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.779+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90cf740 con 0x7f03400163a0 2024-09-18T01:45:21.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.779+0000 7f0346f13640 1 -- 172.21.15.146:0/1160970618 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03380b4040 con 0x7f03400163a0 2024-09-18T01:45:21.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.779+0000 7f034b326800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:21.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.779+0000 7f034b326800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:21.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.779+0000 7f034b326800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:21.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.779+0000 7f034b326800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:21.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.779+0000 7f034b326800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:21.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.779+0000 7f034b326800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:21.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.779+0000 7f034b326800 20 rados->read ofs=0 len=0 2024-09-18T01:45:21.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.779+0000 7f034b326800 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90cb6d0 con 0x55a5d90c69f0 2024-09-18T01:45:21.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.779+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f033003b040 con 0x55a5d90c69f0 2024-09-18T01:45:21.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.779+0000 7f034b326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:21.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.779+0000 7f034b326800 20 rados->read ofs=0 len=0 2024-09-18T01:45:21.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.779+0000 7f034b326800 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90cbf70 con 0x55a5d90c69f0 2024-09-18T01:45:21.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.779+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f033003b040 con 0x55a5d90c69f0 2024-09-18T01:45:21.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.780+0000 7f034b326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:21.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.780+0000 7f034b326800 20 rados->read ofs=0 len=0 2024-09-18T01:45:21.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.780+0000 7f034b326800 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90cb310 con 0x7f03400163a0 2024-09-18T01:45:21.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.780+0000 7f0346f13640 1 -- 172.21.15.146:0/1160970618 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f03380b4040 con 0x7f03400163a0 2024-09-18T01:45:21.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.780+0000 7f034b326800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:21.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.780+0000 7f034b326800 20 zone default found 2024-09-18T01:45:21.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.780+0000 7f034b326800 4 Realm: () 2024-09-18T01:45:21.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.780+0000 7f034b326800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:21.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.780+0000 7f034b326800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:21.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.780+0000 7f034b326800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:21.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.780+0000 7f034b326800 20 zonegroup default 2024-09-18T01:45:21.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.780+0000 7f034b326800 20 rados->read ofs=0 len=0 2024-09-18T01:45:21.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.780+0000 7f034b326800 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90cfbc0 con 0x7f033806d040 2024-09-18T01:45:21.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.780+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f033003b040 con 0x7f033806d040 2024-09-18T01:45:21.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.780+0000 7f034b326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:21.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.780+0000 7f034b326800 20 rados->read ofs=0 len=0 2024-09-18T01:45:21.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.780+0000 7f034b326800 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90d1a50 con 0x55a5d90ccc80 2024-09-18T01:45:21.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.780+0000 7f0347714640 1 -- 172.21.15.146:0/1160970618 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0340056040 con 0x55a5d90ccc80 2024-09-18T01:45:21.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.781+0000 7f034b326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:21.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.781+0000 7f034b326800 20 rados->read ofs=0 len=0 2024-09-18T01:45:21.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.781+0000 7f034b326800 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90d1df0 con 0x55a5d90ccc80 2024-09-18T01:45:21.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.781+0000 7f0347714640 1 -- 172.21.15.146:0/1160970618 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0340056040 con 0x55a5d90ccc80 2024-09-18T01:45:21.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.781+0000 7f034b326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:21.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.781+0000 7f034b326800 20 started sync module instance, tier type = 2024-09-18T01:45:21.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.781+0000 7f034b326800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:21.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.781+0000 7f034b326800 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90d0e90 con 0x7f03400163a0 2024-09-18T01:45:21.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.782+0000 7f0346f13640 1 -- 172.21.15.146:0/1160970618 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v31'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03380b4040 con 0x7f03400163a0 2024-09-18T01:45:21.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.782+0000 7f034b326800 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94170799477424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90d0af0 con 0x7f03400163a0 2024-09-18T01:45:21.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.782+0000 7f034b326800 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90d28c0 con 0x55a5d90c69f0 2024-09-18T01:45:21.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.783+0000 7f0346f13640 1 -- 172.21.15.146:0/1160970618 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94170799477424] v31'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03380b4040 con 0x7f03400163a0 2024-09-18T01:45:21.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.783+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v31'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f033003b040 con 0x55a5d90c69f0 2024-09-18T01:45:21.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.784+0000 7f034b326800 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94170799481872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90d2ce0 con 0x55a5d90c69f0 2024-09-18T01:45:21.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.784+0000 7f034b326800 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90d36a0 con 0x55a5d90ccc80 2024-09-18T01:45:21.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.785+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94170799481872] v31'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f033003b040 con 0x55a5d90c69f0 2024-09-18T01:45:21.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.785+0000 7f0347714640 1 -- 172.21.15.146:0/1160970618 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v31'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0340056040 con 0x55a5d90ccc80 2024-09-18T01:45:21.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.785+0000 7f034b326800 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94170799485904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90d2ce0 con 0x55a5d90ccc80 2024-09-18T01:45:21.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.785+0000 7f034b326800 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90d4130 con 0x7f03400163a0 2024-09-18T01:45:21.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.786+0000 7f0347714640 1 -- 172.21.15.146:0/1160970618 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94170799485904] v31'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0340056040 con 0x55a5d90ccc80 2024-09-18T01:45:21.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.786+0000 7f0346f13640 1 -- 172.21.15.146:0/1160970618 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v31'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03380b4040 con 0x7f03400163a0 2024-09-18T01:45:21.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.786+0000 7f034b326800 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94170799488000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90d2ce0 con 0x7f03400163a0 2024-09-18T01:45:21.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.786+0000 7f034b326800 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90d4bc0 con 0x55a5d90c69f0 2024-09-18T01:45:21.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.787+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v31'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f033003b040 con 0x55a5d90c69f0 2024-09-18T01:45:21.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.787+0000 7f034b326800 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94170799490704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90d4bc0 con 0x55a5d90c69f0 2024-09-18T01:45:21.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.787+0000 7f034b326800 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90d5bc0 con 0x7f033806d040 2024-09-18T01:45:21.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.787+0000 7f0346f13640 1 -- 172.21.15.146:0/1160970618 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94170799488000] v31'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03380b4040 con 0x7f03400163a0 2024-09-18T01:45:21.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.789+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v31'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f033003b040 con 0x7f033806d040 2024-09-18T01:45:21.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.789+0000 7f034b326800 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94170799494832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90d5b80 con 0x7f033806d040 2024-09-18T01:45:21.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.789+0000 7f034b326800 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90d65d0 con 0x7f033806d040 2024-09-18T01:45:21.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.789+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94170799490704] v31'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f033003b040 con 0x55a5d90c69f0 2024-09-18T01:45:21.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.790+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94170799494832] v31'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f033003b040 con 0x7f033806d040 2024-09-18T01:45:21.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.790+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v31'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f033003b040 con 0x7f033806d040 2024-09-18T01:45:21.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.790+0000 7f034b326800 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94170799482928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90d6120 con 0x7f033806d040 2024-09-18T01:45:21.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.790+0000 7f034b326800 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90d6e70 con 0x7f033806d040 2024-09-18T01:45:21.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.791+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94170799482928] v31'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f033003b040 con 0x7f033806d040 2024-09-18T01:45:21.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.791+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v31'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f033003b040 con 0x7f033806d040 2024-09-18T01:45:21.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.791+0000 7f034b326800 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94170799492992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90d6120 con 0x7f033806d040 2024-09-18T01:45:21.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.791+0000 7f034b326800 20 add_watcher() i=0 2024-09-18T01:45:21.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.791+0000 7f034b326800 20 add_watcher() i=1 2024-09-18T01:45:21.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.791+0000 7f034b326800 20 add_watcher() i=2 2024-09-18T01:45:21.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.791+0000 7f034b326800 20 add_watcher() i=3 2024-09-18T01:45:21.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.791+0000 7f034b326800 20 add_watcher() i=4 2024-09-18T01:45:21.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.791+0000 7f034b326800 20 add_watcher() i=5 2024-09-18T01:45:21.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.791+0000 7f034b326800 20 add_watcher() i=6 2024-09-18T01:45:21.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.792+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94170799492992] v31'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f033003b040 con 0x7f033806d040 2024-09-18T01:45:21.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.792+0000 7f034b326800 20 add_watcher() i=7 2024-09-18T01:45:21.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.792+0000 7f034b326800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:21.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.792+0000 7f034b326800 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90d9e40 con 0x55a5d90c69f0 2024-09-18T01:45:21.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.793+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f033003b040 con 0x55a5d90c69f0 2024-09-18T01:45:21.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.793+0000 7f034b326800 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94170799498928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90d7360 con 0x55a5d90c69f0 2024-09-18T01:45:21.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.794+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94170799498928] v31'30 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f033003b040 con 0x55a5d90c69f0 2024-09-18T01:45:21.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.794+0000 7f01fd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:21.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.794+0000 7f034b326800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:21.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.794+0000 7f034b326800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:21.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.794+0000 7f034b326800 5 note: GC not initialized 2024-09-18T01:45:21.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.794+0000 7f0177fff640 20 reqs_thread_entry: start 2024-09-18T01:45:21.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.794+0000 7f034b326800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:21.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.794+0000 7f034b326800 20 Filter name: none 2024-09-18T01:45:21.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.794+0000 7f0175ffb640 20 reqs_thread_entry: start 2024-09-18T01:45:21.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.795+0000 7f034b326800 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d910c890 con 0x55a5d90ccc80 2024-09-18T01:45:21.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.795+0000 7f0347714640 1 -- 172.21.15.146:0/1160970618 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(62 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0340056040 con 0x55a5d90ccc80 2024-09-18T01:45:21.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.795+0000 7f0347714640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90d1a50 con 0x55a5d90ccc80 2024-09-18T01:45:21.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.795+0000 7f0347714640 1 -- 172.21.15.146:0/1160970618 <== osd.3 v2:172.21.15.146:6809/4106661138 15 ==== osd_op_reply(63 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0340056040 con 0x55a5d90ccc80 2024-09-18T01:45:21.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.795+0000 7f0347714640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90d1a50 con 0x55a5d90c69f0 2024-09-18T01:45:21.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.795+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(64 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f033003b040 con 0x55a5d90c69f0 2024-09-18T01:45:21.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.795+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90cb6d0 con 0x55a5d90c69f0 2024-09-18T01:45:21.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.796+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(65 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f033003b040 con 0x55a5d90c69f0 2024-09-18T01:45:21.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.796+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90cb6d0 con 0x7f03400163a0 2024-09-18T01:45:21.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.796+0000 7f0346f13640 1 -- 172.21.15.146:0/1160970618 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(66 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03380b4040 con 0x7f03400163a0 2024-09-18T01:45:21.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.796+0000 7f0346f13640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90d0af0 con 0x55a5d90ccc80 2024-09-18T01:45:21.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.796+0000 7f0347714640 1 -- 172.21.15.146:0/1160970618 <== osd.3 v2:172.21.15.146:6809/4106661138 16 ==== osd_op_reply(67 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0340056040 con 0x55a5d90ccc80 2024-09-18T01:45:21.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.796+0000 7f0347714640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90d0af0 con 0x55a5d90c69f0 2024-09-18T01:45:21.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.796+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(68 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f033003b040 con 0x55a5d90c69f0 2024-09-18T01:45:21.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.796+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90d0af0 con 0x55a5d90ccc80 2024-09-18T01:45:21.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.797+0000 7f0347714640 1 -- 172.21.15.146:0/1160970618 <== osd.3 v2:172.21.15.146:6809/4106661138 17 ==== osd_op_reply(69 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0340056040 con 0x55a5d90ccc80 2024-09-18T01:45:21.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.797+0000 7f0347714640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90d0af0 con 0x7f03400163a0 2024-09-18T01:45:21.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.797+0000 7f0346f13640 1 -- 172.21.15.146:0/1160970618 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(70 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03380b4040 con 0x7f03400163a0 2024-09-18T01:45:21.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.797+0000 7f0346f13640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90d0af0 con 0x55a5d90ccc80 2024-09-18T01:45:21.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.797+0000 7f0347714640 1 -- 172.21.15.146:0/1160970618 <== osd.3 v2:172.21.15.146:6809/4106661138 18 ==== osd_op_reply(71 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0340056040 con 0x55a5d90ccc80 2024-09-18T01:45:21.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.797+0000 7f0347714640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90d0af0 con 0x55a5d90c69f0 2024-09-18T01:45:21.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.797+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(72 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f033003b040 con 0x55a5d90c69f0 2024-09-18T01:45:21.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.797+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90d0af0 con 0x7f033806d040 2024-09-18T01:45:21.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.798+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(73 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f033003b040 con 0x7f033806d040 2024-09-18T01:45:21.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.798+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90d0af0 con 0x7f033806d040 2024-09-18T01:45:21.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.798+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(74 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f033003b040 con 0x7f033806d040 2024-09-18T01:45:21.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.798+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90d0af0 con 0x55a5d90ccc80 2024-09-18T01:45:21.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.798+0000 7f0347714640 1 -- 172.21.15.146:0/1160970618 <== osd.3 v2:172.21.15.146:6809/4106661138 19 ==== osd_op_reply(75 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0340056040 con 0x55a5d90ccc80 2024-09-18T01:45:21.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.798+0000 7f0347714640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90d0af0 con 0x7f033806d040 2024-09-18T01:45:21.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.799+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(76 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f033003b040 con 0x7f033806d040 2024-09-18T01:45:21.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.799+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90d0af0 con 0x7f033806d040 2024-09-18T01:45:21.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.799+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(77 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f033003b040 con 0x7f033806d040 2024-09-18T01:45:21.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.799+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90d0af0 con 0x7f033806d040 2024-09-18T01:45:21.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.799+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== osd_op_reply(78 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f033003b040 con 0x7f033806d040 2024-09-18T01:45:21.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.799+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90d0af0 con 0x55a5d90ccc80 2024-09-18T01:45:21.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.799+0000 7f0347714640 1 -- 172.21.15.146:0/1160970618 <== osd.3 v2:172.21.15.146:6809/4106661138 20 ==== osd_op_reply(79 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0340056040 con 0x55a5d90ccc80 2024-09-18T01:45:21.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.799+0000 7f0347714640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90d0af0 con 0x7f03400163a0 2024-09-18T01:45:21.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.800+0000 7f0346f13640 1 -- 172.21.15.146:0/1160970618 <== osd.2 v2:172.21.15.146:6800/3820039304 14 ==== osd_op_reply(80 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03380b4040 con 0x7f03400163a0 2024-09-18T01:45:21.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.800+0000 7f0346f13640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90d0af0 con 0x55a5d90c69f0 2024-09-18T01:45:21.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.800+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(81 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f033003b040 con 0x55a5d90c69f0 2024-09-18T01:45:21.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.800+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90d0af0 con 0x55a5d90c69f0 2024-09-18T01:45:21.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.800+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== osd_op_reply(82 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f033003b040 con 0x55a5d90c69f0 2024-09-18T01:45:21.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.800+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90d0af0 con 0x55a5d90ccc80 2024-09-18T01:45:21.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.800+0000 7f0347714640 1 -- 172.21.15.146:0/1160970618 <== osd.3 v2:172.21.15.146:6809/4106661138 21 ==== osd_op_reply(83 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0340056040 con 0x55a5d90ccc80 2024-09-18T01:45:21.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.800+0000 7f0347714640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90d0af0 con 0x7f03400163a0 2024-09-18T01:45:21.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.801+0000 7f0346f13640 1 -- 172.21.15.146:0/1160970618 <== osd.2 v2:172.21.15.146:6800/3820039304 15 ==== osd_op_reply(84 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03380b4040 con 0x7f03400163a0 2024-09-18T01:45:21.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.801+0000 7f0346f13640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90d0af0 con 0x7f033806d040 2024-09-18T01:45:21.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.801+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.0 v2:172.21.15.129:6800/1759265424 22 ==== osd_op_reply(85 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f033003b040 con 0x7f033806d040 2024-09-18T01:45:21.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.801+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90d0af0 con 0x55a5d90c69f0 2024-09-18T01:45:21.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.801+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.1 v2:172.21.15.146:6808/3930274777 28 ==== osd_op_reply(86 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f033003b040 con 0x55a5d90c69f0 2024-09-18T01:45:21.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.801+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90d0af0 con 0x7f033806d040 2024-09-18T01:45:21.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.802+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.0 v2:172.21.15.129:6800/1759265424 23 ==== osd_op_reply(87 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f033003b040 con 0x7f033806d040 2024-09-18T01:45:21.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.802+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90d0af0 con 0x55a5d90ccc80 2024-09-18T01:45:21.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.802+0000 7f0347714640 1 -- 172.21.15.146:0/1160970618 <== osd.3 v2:172.21.15.146:6809/4106661138 22 ==== osd_op_reply(88 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0340056040 con 0x55a5d90ccc80 2024-09-18T01:45:21.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.802+0000 7f0347714640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90d0af0 con 0x7f03400163a0 2024-09-18T01:45:21.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.802+0000 7f0346f13640 1 -- 172.21.15.146:0/1160970618 <== osd.2 v2:172.21.15.146:6800/3820039304 16 ==== osd_op_reply(89 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03380b4040 con 0x7f03400163a0 2024-09-18T01:45:21.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.802+0000 7f0346f13640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90d0af0 con 0x7f033806d040 2024-09-18T01:45:21.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.802+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.0 v2:172.21.15.129:6800/1759265424 24 ==== osd_op_reply(90 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f033003b040 con 0x7f033806d040 2024-09-18T01:45:21.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.802+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90d0af0 con 0x55a5d90c69f0 2024-09-18T01:45:21.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.803+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.1 v2:172.21.15.146:6808/3930274777 29 ==== osd_op_reply(91 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f033003b040 con 0x55a5d90c69f0 2024-09-18T01:45:21.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.803+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90d0af0 con 0x55a5d90ccc80 2024-09-18T01:45:21.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.803+0000 7f0347714640 1 -- 172.21.15.146:0/1160970618 <== osd.3 v2:172.21.15.146:6809/4106661138 23 ==== osd_op_reply(92 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0340056040 con 0x55a5d90ccc80 2024-09-18T01:45:21.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.803+0000 7f0347714640 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90d0af0 con 0x7f03400163a0 2024-09-18T01:45:21.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.803+0000 7f0346f13640 1 -- 172.21.15.146:0/1160970618 <== osd.2 v2:172.21.15.146:6800/3820039304 17 ==== osd_op_reply(93 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03380b4040 con 0x7f03400163a0 2024-09-18T01:45:21.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.804+0000 7f01fd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:21.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.804+0000 7f034b326800 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94170799498928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90d1a50 con 0x55a5d90c69f0 2024-09-18T01:45:21.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.805+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.1 v2:172.21.15.146:6808/3930274777 30 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94170799498928] v31'31 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f033003b040 con 0x55a5d90c69f0 2024-09-18T01:45:21.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.805+0000 7f034b326800 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94170799477424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90cb6d0 con 0x7f03400163a0 2024-09-18T01:45:21.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.806+0000 7f0346f13640 1 -- 172.21.15.146:0/1160970618 <== osd.2 v2:172.21.15.146:6800/3820039304 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94170799477424] v31'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03380b4040 con 0x7f03400163a0 2024-09-18T01:45:21.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.806+0000 7f034b326800 20 remove_watcher() i=0 2024-09-18T01:45:21.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.806+0000 7f034b326800 2 removed watcher, disabling cache 2024-09-18T01:45:21.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.806+0000 7f034b326800 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94170799481872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90cb6d0 con 0x55a5d90c69f0 2024-09-18T01:45:21.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.808+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.1 v2:172.21.15.146:6808/3930274777 31 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94170799481872] v31'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f033003b040 con 0x55a5d90c69f0 2024-09-18T01:45:21.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.808+0000 7f034b326800 20 remove_watcher() i=1 2024-09-18T01:45:21.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.808+0000 7f034b326800 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94170799485904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90cb6d0 con 0x55a5d90ccc80 2024-09-18T01:45:21.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.809+0000 7f0347714640 1 -- 172.21.15.146:0/1160970618 <== osd.3 v2:172.21.15.146:6809/4106661138 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94170799485904] v31'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0340056040 con 0x55a5d90ccc80 2024-09-18T01:45:21.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.809+0000 7f034b326800 20 remove_watcher() i=2 2024-09-18T01:45:21.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.809+0000 7f034b326800 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94170799488000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90d2410 con 0x7f03400163a0 2024-09-18T01:45:21.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.810+0000 7f0346f13640 1 -- 172.21.15.146:0/1160970618 <== osd.2 v2:172.21.15.146:6800/3820039304 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94170799488000] v31'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03380b4040 con 0x7f03400163a0 2024-09-18T01:45:21.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.810+0000 7f034b326800 20 remove_watcher() i=3 2024-09-18T01:45:21.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.810+0000 7f034b326800 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94170799490704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90d33d0 con 0x55a5d90c69f0 2024-09-18T01:45:21.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.811+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.1 v2:172.21.15.146:6808/3930274777 32 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94170799490704] v31'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f033003b040 con 0x55a5d90c69f0 2024-09-18T01:45:21.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.811+0000 7f034b326800 20 remove_watcher() i=4 2024-09-18T01:45:21.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.811+0000 7f034b326800 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94170799494832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90d3c00 con 0x7f033806d040 2024-09-18T01:45:21.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.812+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.0 v2:172.21.15.129:6800/1759265424 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94170799494832] v31'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f033003b040 con 0x7f033806d040 2024-09-18T01:45:21.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.812+0000 7f034b326800 20 remove_watcher() i=5 2024-09-18T01:45:21.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.812+0000 7f034b326800 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94170799482928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90d2410 con 0x7f033806d040 2024-09-18T01:45:21.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.813+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.0 v2:172.21.15.129:6800/1759265424 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94170799482928] v31'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f033003b040 con 0x7f033806d040 2024-09-18T01:45:21.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.813+0000 7f034b326800 20 remove_watcher() i=6 2024-09-18T01:45:21.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.813+0000 7f034b326800 1 -- 172.21.15.146:0/1160970618 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94170799492992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5d90d56b0 con 0x7f033806d040 2024-09-18T01:45:21.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.814+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 <== osd.0 v2:172.21.15.129:6800/1759265424 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94170799492992] v31'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f033003b040 con 0x7f033806d040 2024-09-18T01:45:21.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.814+0000 7f034b326800 20 remove_watcher() i=7 2024-09-18T01:45:21.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.814+0000 7f034b326800 1 -- 172.21.15.146:0/1160970618 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f033806d040 msgr2=0x7f03380768e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:21.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.814+0000 7f034b326800 1 --2- 172.21.15.146:0/1160970618 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f033806d040 0x7f03380768e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:21.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.814+0000 7f034b326800 1 -- 172.21.15.146:0/1160970618 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a5d90c69f0 msgr2=0x55a5d90c8eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:21.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.814+0000 7f034b326800 1 --2- 172.21.15.146:0/1160970618 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a5d90c69f0 0x55a5d90c8eb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:21.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.814+0000 7f034b326800 1 -- 172.21.15.146:0/1160970618 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f03400163a0 msgr2=0x7f0340016a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:21.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.814+0000 7f034b326800 1 --2- 172.21.15.146:0/1160970618 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f03400163a0 0x7f0340016a60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:21.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.814+0000 7f034b326800 1 -- 172.21.15.146:0/1160970618 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55a5d90ccc80 msgr2=0x55a5d90cf070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:21.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.814+0000 7f034b326800 1 --2- 172.21.15.146:0/1160970618 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55a5d90ccc80 0x55a5d90cf070 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:21.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.814+0000 7f034b326800 1 -- 172.21.15.146:0/1160970618 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0210036b40 msgr2=0x7f0210039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:21.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.814+0000 7f034b326800 1 --2- 172.21.15.146:0/1160970618 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0210036b40 0x7f0210039000 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0338000f80 tx=0x7f0338094000 comp rx=0 tx=0).stop 2024-09-18T01:45:21.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.814+0000 7f034b326800 1 -- 172.21.15.146:0/1160970618 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a5d8f933e0 msgr2=0x55a5d90baf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:21.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.814+0000 7f0346712640 1 -- 172.21.15.146:0/1160970618 reap_dead start 2024-09-18T01:45:21.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.814+0000 7f034b326800 1 --2- 172.21.15.146:0/1160970618 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a5d8f933e0 0x55a5d90baf50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f03400176b0 tx=0x7f034004c880 comp rx=0 tx=0).stop 2024-09-18T01:45:21.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.815+0000 7f034b326800 1 -- 172.21.15.146:0/1160970618 shutdown_connections 2024-09-18T01:45:21.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.815+0000 7f034b326800 1 --2- 172.21.15.146:0/1160970618 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a5d8f933e0 0x55a5d90baf50 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:21.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.815+0000 7f034b326800 1 -- 172.21.15.146:0/1160970618 >> 172.21.15.146:0/1160970618 conn(0x55a5d90adc00 msgr2=0x55a5d8f92870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:21.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.815+0000 7f034b326800 1 -- 172.21.15.146:0/1160970618 shutdown_connections 2024-09-18T01:45:21.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.815+0000 7f034b326800 1 -- 172.21.15.146:0/1160970618 wait complete. 2024-09-18T01:45:21.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.815+0000 7f034b326800 1 -- 172.21.15.146:0/3362070275 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0220036b90 msgr2=0x7f0220039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:21.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.815+0000 7f034b326800 1 --2- 172.21.15.146:0/3362070275 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0220036b90 0x7f0220039050 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f033808fb30 tx=0x7f033806c6f0 comp rx=0 tx=0).stop 2024-09-18T01:45:21.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.815+0000 7f034b326800 1 -- 172.21.15.146:0/3362070275 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a5d90a4c50 msgr2=0x55a5d90a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:21.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.815+0000 7f034b326800 1 --2- 172.21.15.146:0/3362070275 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a5d90a4c50 0x55a5d90a5070 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x55a5d908b080 tx=0x7f034000ef30 comp rx=0 tx=0).stop 2024-09-18T01:45:21.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.815+0000 7f034b326800 1 -- 172.21.15.146:0/3362070275 shutdown_connections 2024-09-18T01:45:21.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.815+0000 7f034b326800 1 --2- 172.21.15.146:0/3362070275 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0220036b90 0x7f0220039050 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:21.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.815+0000 7f034b326800 1 --2- 172.21.15.146:0/3362070275 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a5d90a4c50 0x55a5d90a5070 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:21.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.815+0000 7f034b326800 1 -- 172.21.15.146:0/3362070275 >> 172.21.15.146:0/3362070275 conn(0x55a5d9099be0 msgr2=0x55a5d909c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:21.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.815+0000 7f034b326800 1 -- 172.21.15.146:0/3362070275 shutdown_connections 2024-09-18T01:45:21.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.815+0000 7f034b326800 1 -- 172.21.15.146:0/3362070275 wait complete. 2024-09-18T01:45:21.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.815+0000 7f034b326800 1 -- 172.21.15.146:0/108579414 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a5d8f966f0 msgr2=0x55a5d9090ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:21.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.815+0000 7f034b326800 1 --2- 172.21.15.146:0/108579414 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a5d8f966f0 0x55a5d9090ed0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:21.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.815+0000 7f034b326800 1 -- 172.21.15.146:0/108579414 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55a5d9094680 msgr2=0x55a5d9096a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:21.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.815+0000 7f034b326800 1 --2- 172.21.15.146:0/108579414 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55a5d9094680 0x55a5d9096a70 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:21.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.815+0000 7f034b326800 1 -- 172.21.15.146:0/108579414 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f022c036b40 msgr2=0x7f022c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:21.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.815+0000 7f034b326800 1 --2- 172.21.15.146:0/108579414 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f022c036b40 0x7f022c039000 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0330000f60 tx=0x7f03300013f0 comp rx=0 tx=0).stop 2024-09-18T01:45:21.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.815+0000 7f034b326800 1 -- 172.21.15.146:0/108579414 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a5d8f06e00 msgr2=0x55a5d9089e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:21.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.815+0000 7f034b326800 1 --2- 172.21.15.146:0/108579414 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a5d8f06e00 0x55a5d9089e60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0338063040 tx=0x7f0338003330 comp rx=0 tx=0).stop 2024-09-18T01:45:21.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.816+0000 7f034b326800 1 -- 172.21.15.146:0/108579414 shutdown_connections 2024-09-18T01:45:21.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.816+0000 7f034b326800 1 --2- 172.21.15.146:0/108579414 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55a5d9094680 0x55a5d9096a70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:21.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.816+0000 7f034b326800 1 --2- 172.21.15.146:0/108579414 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a5d8f966f0 0x55a5d9090ed0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:21.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.816+0000 7f034b326800 1 --2- 172.21.15.146:0/108579414 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f022c036b40 0x7f022c039000 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:21.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.816+0000 7f034b326800 1 --2- 172.21.15.146:0/108579414 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a5d8f06e00 0x55a5d9089e60 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:21.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.816+0000 7f034b326800 1 -- 172.21.15.146:0/108579414 >> 172.21.15.146:0/108579414 conn(0x55a5d8f8dde0 msgr2=0x55a5d907c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:21.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.816+0000 7f034b326800 1 -- 172.21.15.146:0/108579414 shutdown_connections 2024-09-18T01:45:21.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.816+0000 7f034b326800 1 -- 172.21.15.146:0/108579414 wait complete. 2024-09-18T01:45:21.830 INFO:teuthology.orchestra.run.smithi146.stdout:[] 2024-09-18T01:45:21.831 DEBUG:tasks.util.rgw: json result: [] 2024-09-18T01:45:21.831 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud'] 2024-09-18T01:45:21.831 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud'] 2024-09-18T01:45:21.831 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud 2024-09-18T01:45:21.875 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:21.875 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:21.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.875+0000 7fefaac11800 1 Processor -- start 2024-09-18T01:45:21.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.875+0000 7fefaac11800 1 -- start start 2024-09-18T01:45:21.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.876+0000 7fefaac11800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55c73550ad00 0x55c73550d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:21.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.876+0000 7fefaac11800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c7353c3b30 con 0x55c735477df0 2024-09-18T01:45:21.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.876+0000 7fefaac11800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x55c7353a5360 con 0x55c73550ad00 2024-09-18T01:45:21.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.876+0000 7fef9db2b640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55c73550ad00 0x55c73550d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:21.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.876+0000 7fefa632c640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x55c735477df0 0x55c7355095e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:38630/0 (socket says 172.21.15.146:38630) 2024-09-18T01:45:21.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.876+0000 7fefa632c640 1 -- 172.21.15.146:0/2598361015 learned_addr learned my addr 172.21.15.146:0/2598361015 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:45:21.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.876+0000 7fef9db2b640 1 -- 172.21.15.146:0/2598361015 >> v1:172.21.15.129:6789/0 conn(0x55c735477df0 legacy=0x55c7355095e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:21.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.876+0000 7fef9db2b640 1 -- 172.21.15.146:0/2598361015 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7353cbe00 con 0x55c73550ad00 2024-09-18T01:45:21.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.878+0000 7fef9db2b640 1 --2- 172.21.15.146:0/2598361015 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c73550ad00 0x55c73550d0f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fef9000a470 tx=0x7fef90045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60f8ea8a67fa159a server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:21.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.878+0000 7fefa5b2b640 1 -- 172.21.15.146:0/2598361015 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef90053570 con 0x55c73550ad00 2024-09-18T01:45:21.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.878+0000 7fefa5b2b640 1 -- 172.21.15.146:0/2598361015 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef90058070 con 0x55c73550ad00 2024-09-18T01:45:21.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.878+0000 7fefa5b2b640 1 -- 172.21.15.146:0/2598361015 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef90053880 con 0x55c73550ad00 2024-09-18T01:45:21.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.879+0000 7fefaac11800 1 -- 172.21.15.146:0/2598361015 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c73550ad00 msgr2=0x55c73550d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:21.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.879+0000 7fefaac11800 1 --2- 172.21.15.146:0/2598361015 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c73550ad00 0x55c73550d0f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fef9000a470 tx=0x7fef90045a20 comp rx=0 tx=0).stop 2024-09-18T01:45:21.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.879+0000 7fefaac11800 1 -- 172.21.15.146:0/2598361015 shutdown_connections 2024-09-18T01:45:21.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.879+0000 7fefaac11800 1 --2- 172.21.15.146:0/2598361015 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c73550ad00 0x55c73550d0f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:21.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.879+0000 7fefaac11800 1 -- 172.21.15.146:0/2598361015 >> 172.21.15.146:0/2598361015 conn(0x55c7354fedf0 msgr2=0x55c735501210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:21.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.879+0000 7fefaac11800 1 -- 172.21.15.146:0/2598361015 shutdown_connections 2024-09-18T01:45:21.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.879+0000 7fefaac11800 1 -- 172.21.15.146:0/2598361015 wait complete. 2024-09-18T01:45:21.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.892+0000 7fefaac11800 1 Processor -- start 2024-09-18T01:45:21.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.892+0000 7fefaac11800 1 -- start start 2024-09-18T01:45:21.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.892+0000 7fefaac11800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c735477df0 0x55c7355f5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:21.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.892+0000 7fefaac11800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55c735450330 con 0x55c735477df0 2024-09-18T01:45:21.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.893+0000 7fefa632c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c735477df0 0x55c7355f5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:21.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.893+0000 7fefa632c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c735477df0 0x55c7355f5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59124/0 (socket says 172.21.15.146:59124) 2024-09-18T01:45:21.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.893+0000 7fefa632c640 1 -- 172.21.15.146:0/3497931564 learned_addr learned my addr 172.21.15.146:0/3497931564 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:21.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.893+0000 7fefa632c640 1 -- 172.21.15.146:0/3497931564 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c73539dbc0 con 0x55c735477df0 2024-09-18T01:45:21.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.893+0000 7fefa632c640 1 --2- 172.21.15.146:0/3497931564 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c735477df0 0x55c7355f5c10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fef98001e10 tx=0x7fef9800b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2b97aeaf38741fb server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:21.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.893+0000 7fee94608640 1 -- 172.21.15.146:0/3497931564 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef98012020 con 0x55c735477df0 2024-09-18T01:45:21.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.893+0000 7fee94608640 1 -- 172.21.15.146:0/3497931564 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef9800e5a0 con 0x55c735477df0 2024-09-18T01:45:21.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.893+0000 7fee94608640 1 -- 172.21.15.146:0/3497931564 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef9800e8e0 con 0x55c735477df0 2024-09-18T01:45:21.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.894+0000 7fefaac11800 1 -- 172.21.15.146:0/3497931564 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c735477df0 msgr2=0x55c7355f5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:21.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.894+0000 7fefaac11800 1 --2- 172.21.15.146:0/3497931564 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c735477df0 0x55c7355f5c10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fef98001e10 tx=0x7fef9800b780 comp rx=0 tx=0).stop 2024-09-18T01:45:21.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.894+0000 7fefaac11800 1 -- 172.21.15.146:0/3497931564 shutdown_connections 2024-09-18T01:45:21.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.894+0000 7fefaac11800 1 --2- 172.21.15.146:0/3497931564 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c735477df0 0x55c7355f5c10 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:21.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.894+0000 7fefaac11800 1 -- 172.21.15.146:0/3497931564 >> 172.21.15.146:0/3497931564 conn(0x55c7354fedf0 msgr2=0x55c7355f1530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:21.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.894+0000 7fefaac11800 1 -- 172.21.15.146:0/3497931564 shutdown_connections 2024-09-18T01:45:21.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.894+0000 7fefaac11800 1 -- 172.21.15.146:0/3497931564 wait complete. 2024-09-18T01:45:21.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.894+0000 7fefaac11800 1 Processor -- start 2024-09-18T01:45:21.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.895+0000 7fefaac11800 1 -- start start 2024-09-18T01:45:21.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.895+0000 7fefaac11800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c735477df0 0x55c7355fd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:21.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.895+0000 7fefaac11800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55c73550d900 con 0x55c735477df0 2024-09-18T01:45:21.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.895+0000 7fefa632c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c735477df0 0x55c7355fd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:21.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.895+0000 7fefa632c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c735477df0 0x55c7355fd5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59132/0 (socket says 172.21.15.146:59132) 2024-09-18T01:45:21.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.895+0000 7fefa632c640 1 -- 172.21.15.146:0/211133421 learned_addr learned my addr 172.21.15.146:0/211133421 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:21.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.895+0000 7fefa632c640 1 -- 172.21.15.146:0/211133421 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7353b1fe0 con 0x55c735477df0 2024-09-18T01:45:21.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.895+0000 7fefa632c640 1 --2- 172.21.15.146:0/211133421 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c735477df0 0x55c7355fd5f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fef98001e10 tx=0x7fef98000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:21.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.895+0000 7fee92e05640 1 -- 172.21.15.146:0/211133421 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef98012030 con 0x55c735477df0 2024-09-18T01:45:21.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.895+0000 7fee92e05640 1 -- 172.21.15.146:0/211133421 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef9801a7a0 con 0x55c735477df0 2024-09-18T01:45:21.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.895+0000 7fefaac11800 1 -- 172.21.15.146:0/211133421 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c7355fdb30 con 0x55c735477df0 2024-09-18T01:45:21.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.896+0000 7fee92e05640 1 -- 172.21.15.146:0/211133421 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef9801aac0 con 0x55c735477df0 2024-09-18T01:45:21.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.896+0000 7fefaac11800 1 -- 172.21.15.146:0/211133421 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7355fe050 con 0x55c735477df0 2024-09-18T01:45:21.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.896+0000 7fee92e05640 1 -- 172.21.15.146:0/211133421 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fef98015020 con 0x55c735477df0 2024-09-18T01:45:21.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.897+0000 7fee92e05640 1 --2- 172.21.15.146:0/211133421 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fee8c036b90 0x7fee8c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:21.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.897+0000 7fee92e05640 1 -- 172.21.15.146:0/211133421 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fef98020030 con 0x55c735477df0 2024-09-18T01:45:21.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.897+0000 7fef9db2b640 1 --2- 172.21.15.146:0/211133421 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fee8c036b90 0x7fee8c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:21.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.897+0000 7fefaac11800 1 --2- 172.21.15.146:0/211133421 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55c735602650 0x55c735604a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:21.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.897+0000 7fefaac11800 1 -- 172.21.15.146:0/211133421 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c735604f80 con 0x55c735602650 2024-09-18T01:45:21.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.897+0000 7fefa6b2d640 1 --2- 172.21.15.146:0/211133421 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55c735602650 0x55c735604a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:21.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.897+0000 7fef9db2b640 1 --2- 172.21.15.146:0/211133421 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fee8c036b90 0x7fee8c039050 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fef90057000 tx=0x7fef90052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:21.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.897+0000 7fefa6b2d640 1 --2- 172.21.15.146:0/211133421 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55c735602650 0x55c735604a40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:21.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.897+0000 7fefa6b2d640 1 -- 172.21.15.146:0/211133421 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fefa000a4a0 con 0x55c735602650 2024-09-18T01:45:21.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.898+0000 7fefaac11800 1 -- 172.21.15.146:0/211133421 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c735601c10 con 0x55c735602650 2024-09-18T01:45:21.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.898+0000 7fefa6b2d640 1 -- 172.21.15.146:0/211133421 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fefa000a4a0 con 0x55c735602650 2024-09-18T01:45:21.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.898+0000 7fefaac11800 1 -- 172.21.15.146:0/211133421 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c735606d80 con 0x55c735602650 2024-09-18T01:45:21.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.898+0000 7fefa6b2d640 1 -- 172.21.15.146:0/211133421 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fefa000a4a0 con 0x55c735602650 2024-09-18T01:45:21.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.898+0000 7fefaac11800 1 -- 172.21.15.146:0/211133421 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c735605ec0 con 0x55c735602650 2024-09-18T01:45:21.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.898+0000 7fefa6b2d640 1 -- 172.21.15.146:0/211133421 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fefa000a4a0 con 0x55c735602650 2024-09-18T01:45:21.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.898+0000 7fefaac11800 1 --2- 172.21.15.146:0/211133421 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55c735606960 0x55c73560a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:21.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.898+0000 7fefaac11800 1 -- 172.21.15.146:0/211133421 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c73560a950 con 0x55c735606960 2024-09-18T01:45:21.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.898+0000 7fefa632c640 1 --2- 172.21.15.146:0/211133421 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55c735606960 0x55c73560a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:21.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.899+0000 7fefa632c640 1 --2- 172.21.15.146:0/211133421 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55c735606960 0x55c73560a1c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:21.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.899+0000 7fefa632c640 1 -- 172.21.15.146:0/211133421 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fef9800dcd0 con 0x55c735606960 2024-09-18T01:45:21.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.899+0000 7fefaac11800 1 Processor -- start 2024-09-18T01:45:21.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.899+0000 7fefaac11800 1 -- start start 2024-09-18T01:45:21.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.900+0000 7fefaac11800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c735618700 0x55c735618b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:21.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.900+0000 7fefaac11800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55c73539f580 con 0x55c735618700 2024-09-18T01:45:21.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.900+0000 7fefa6b2d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c735618700 0x55c735618b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:21.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.900+0000 7fefa6b2d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c735618700 0x55c735618b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59138/0 (socket says 172.21.15.146:59138) 2024-09-18T01:45:21.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.900+0000 7fefa6b2d640 1 -- 172.21.15.146:0/1367185462 learned_addr learned my addr 172.21.15.146:0/1367185462 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:21.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.900+0000 7fefa6b2d640 1 -- 172.21.15.146:0/1367185462 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c735619060 con 0x55c735618700 2024-09-18T01:45:21.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.900+0000 7fefa6b2d640 1 --2- 172.21.15.146:0/1367185462 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c735618700 0x55c735618b20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x55c735605360 tx=0x7fefa00178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:21.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.901+0000 7fee8bfff640 1 -- 172.21.15.146:0/1367185462 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefa0013440 con 0x55c735618700 2024-09-18T01:45:21.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.901+0000 7fee8bfff640 1 -- 172.21.15.146:0/1367185462 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefa00135e0 con 0x55c735618700 2024-09-18T01:45:21.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.901+0000 7fefaac11800 1 -- 172.21.15.146:0/1367185462 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c7356192f0 con 0x55c735618700 2024-09-18T01:45:21.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.901+0000 7fee8bfff640 1 -- 172.21.15.146:0/1367185462 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefa00138c0 con 0x55c735618700 2024-09-18T01:45:21.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.901+0000 7fefaac11800 1 -- 172.21.15.146:0/1367185462 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c73561bfd0 con 0x55c735618700 2024-09-18T01:45:21.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.901+0000 7fee8bfff640 1 -- 172.21.15.146:0/1367185462 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fefa0011040 con 0x55c735618700 2024-09-18T01:45:21.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.902+0000 7fee8bfff640 1 --2- 172.21.15.146:0/1367185462 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fee80036b40 0x7fee80039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:21.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.902+0000 7fee8bfff640 1 -- 172.21.15.146:0/1367185462 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fefa001d070 con 0x55c735618700 2024-09-18T01:45:21.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.902+0000 7fefa632c640 1 --2- 172.21.15.146:0/1367185462 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fee80036b40 0x7fee80039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:21.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.902+0000 7fefaac11800 1 Processor -- start 2024-09-18T01:45:21.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.902+0000 7fefa632c640 1 --2- 172.21.15.146:0/1367185462 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fee80036b40 0x7fee80039000 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x55c735606260 tx=0x7fef98024000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:21.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.902+0000 7fefaac11800 1 -- start start 2024-09-18T01:45:21.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.902+0000 7fefaac11800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c7356253a0 0x55c7356257a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:21.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.902+0000 7fefaac11800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55c7355f63c0 con 0x55c7356253a0 2024-09-18T01:45:21.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.902+0000 7fefa6b2d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c7356253a0 0x55c7356257a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:21.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.902+0000 7fefa6b2d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c7356253a0 0x55c7356257a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59150/0 (socket says 172.21.15.146:59150) 2024-09-18T01:45:21.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.902+0000 7fefa6b2d640 1 -- 172.21.15.146:0/4206538513 learned_addr learned my addr 172.21.15.146:0/4206538513 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:21.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.903+0000 7fefa6b2d640 1 -- 172.21.15.146:0/4206538513 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c735625d70 con 0x55c7356253a0 2024-09-18T01:45:21.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.903+0000 7fefa6b2d640 1 --2- 172.21.15.146:0/4206538513 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c7356253a0 0x55c7356257a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fefa0001450 tx=0x7fefa004caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99d8c8c367687c5d server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:21.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.903+0000 7fee89ffb640 1 -- 172.21.15.146:0/4206538513 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefa0045070 con 0x55c7356253a0 2024-09-18T01:45:21.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.903+0000 7fee89ffb640 1 -- 172.21.15.146:0/4206538513 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefa0015560 con 0x55c7356253a0 2024-09-18T01:45:21.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.903+0000 7fee89ffb640 1 -- 172.21.15.146:0/4206538513 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefa002ad80 con 0x55c7356253a0 2024-09-18T01:45:21.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.903+0000 7fefaac11800 1 -- 172.21.15.146:0/4206538513 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c7356253a0 msgr2=0x55c7356257a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:21.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.903+0000 7fefaac11800 1 --2- 172.21.15.146:0/4206538513 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c7356253a0 0x55c7356257a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fefa0001450 tx=0x7fefa004caf0 comp rx=0 tx=0).stop 2024-09-18T01:45:21.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.903+0000 7fefaac11800 1 -- 172.21.15.146:0/4206538513 shutdown_connections 2024-09-18T01:45:21.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.903+0000 7fefaac11800 1 --2- 172.21.15.146:0/4206538513 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c7356253a0 0x55c7356257a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:21.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.903+0000 7fefaac11800 1 -- 172.21.15.146:0/4206538513 >> 172.21.15.146:0/4206538513 conn(0x55c735621750 msgr2=0x55c73561f850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:21.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.903+0000 7fefaac11800 1 -- 172.21.15.146:0/4206538513 shutdown_connections 2024-09-18T01:45:21.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.903+0000 7fefaac11800 1 -- 172.21.15.146:0/4206538513 wait complete. 2024-09-18T01:45:21.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.904+0000 7fefaac11800 1 Processor -- start 2024-09-18T01:45:21.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.904+0000 7fefaac11800 1 -- start start 2024-09-18T01:45:21.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.904+0000 7fefaac11800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c7356253a0 0x55c73562c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:21.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.904+0000 7fefaac11800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55c735626340 con 0x55c7356253a0 2024-09-18T01:45:21.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.904+0000 7fefa6b2d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c7356253a0 0x55c73562c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:21.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.904+0000 7fefa6b2d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c7356253a0 0x55c73562c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59158/0 (socket says 172.21.15.146:59158) 2024-09-18T01:45:21.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.904+0000 7fefa6b2d640 1 -- 172.21.15.146:0/2425630948 learned_addr learned my addr 172.21.15.146:0/2425630948 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:21.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.904+0000 7fefa6b2d640 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c73562cce0 con 0x55c7356253a0 2024-09-18T01:45:21.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.905+0000 7fefa6b2d640 1 --2- 172.21.15.146:0/2425630948 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c7356253a0 0x55c73562c7a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fefa0043040 tx=0x7fefa004c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:21.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.905+0000 7fee77fff640 1 -- 172.21.15.146:0/2425630948 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefa003a070 con 0x55c7356253a0 2024-09-18T01:45:21.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.905+0000 7fee77fff640 1 -- 172.21.15.146:0/2425630948 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefa004e070 con 0x55c7356253a0 2024-09-18T01:45:21.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.905+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c73562cf70 con 0x55c7356253a0 2024-09-18T01:45:21.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.905+0000 7fee77fff640 1 -- 172.21.15.146:0/2425630948 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefa0045040 con 0x55c7356253a0 2024-09-18T01:45:21.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.905+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c73562fc20 con 0x55c7356253a0 2024-09-18T01:45:21.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.905+0000 7fee77fff640 1 -- 172.21.15.146:0/2425630948 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fefa003d070 con 0x55c7356253a0 2024-09-18T01:45:21.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.906+0000 7fee77fff640 1 --2- 172.21.15.146:0/2425630948 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fee70036b40 0x7fee70039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:21.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.906+0000 7fee77fff640 1 -- 172.21.15.146:0/2425630948 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fefa000e040 con 0x55c7356253a0 2024-09-18T01:45:21.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.906+0000 7fefa632c640 1 --2- 172.21.15.146:0/2425630948 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fee70036b40 0x7fee70039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:21.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.906+0000 7fefa632c640 1 --2- 172.21.15.146:0/2425630948 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fee70036b40 0x7fee70039000 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fef98001620 tx=0x7fef98036000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:21.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.906+0000 7fefaac11800 20 rados->read ofs=0 len=0 2024-09-18T01:45:21.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.906+0000 7fefaac11800 1 --2- 172.21.15.146:0/2425630948 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55c7356384d0 0x55c73563a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:21.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.906+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c73563b0e0 con 0x55c7356384d0 2024-09-18T01:45:21.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.907+0000 7fef9db2b640 1 --2- 172.21.15.146:0/2425630948 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55c7356384d0 0x55c73563a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:21.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.907+0000 7fef9db2b640 1 --2- 172.21.15.146:0/2425630948 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55c7356384d0 0x55c73563a990 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:21.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.907+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fef90051070 con 0x55c7356384d0 2024-09-18T01:45:21.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.907+0000 7fefaac11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:21.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.907+0000 7fefaac11800 20 realm 2024-09-18T01:45:21.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.907+0000 7fefaac11800 20 rados->read ofs=0 len=0 2024-09-18T01:45:21.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.907+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c73563b510 con 0x55c7356384d0 2024-09-18T01:45:21.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.907+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fef90051070 con 0x55c7356384d0 2024-09-18T01:45:21.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.907+0000 7fefaac11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:21.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.907+0000 7fefaac11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:21.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.907+0000 7fefaac11800 20 rados->read ofs=0 len=0 2024-09-18T01:45:21.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.907+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c73563bde0 con 0x55c7356384d0 2024-09-18T01:45:21.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.908+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fef90051070 con 0x55c7356384d0 2024-09-18T01:45:21.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.908+0000 7fefaac11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:21.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.908+0000 7fefaac11800 20 rados->read ofs=0 len=0 2024-09-18T01:45:21.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.908+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c73563c180 con 0x55c7356384d0 2024-09-18T01:45:21.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.908+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fef90051070 con 0x55c7356384d0 2024-09-18T01:45:21.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.908+0000 7fefaac11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:21.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.908+0000 7fefaac11800 20 rados->read ofs=0 len=0 2024-09-18T01:45:21.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.908+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c73563c9d0 con 0x55c7356384d0 2024-09-18T01:45:21.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.908+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fef90051070 con 0x55c7356384d0 2024-09-18T01:45:21.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.908+0000 7fefaac11800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:21.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.908+0000 7fefaac11800 20 searching for the correct realm 2024-09-18T01:45:21.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.908+0000 7fefaac11800 1 --2- 172.21.15.146:0/2425630948 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55c73563e740 0x55c735640b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:21.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.908+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c735641160 con 0x55c73563e740 2024-09-18T01:45:21.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.908+0000 7fefa6b2d640 1 --2- 172.21.15.146:0/2425630948 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55c73563e740 0x55c735640b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:21.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.909+0000 7fefa6b2d640 1 --2- 172.21.15.146:0/2425630948 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55c73563e740 0x55c735640b30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:21.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.909+0000 7fefa6b2d640 1 -- 172.21.15.146:0/2425630948 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefa003c030 con 0x55c73563e740 2024-09-18T01:45:21.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.909+0000 7fefa6b2d640 1 --2- 172.21.15.146:0/2425630948 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fefa003f060 0x7fefa0023070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:21.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.909+0000 7fefa6b2d640 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c735641160 con 0x7fefa003f060 2024-09-18T01:45:21.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.909+0000 7fefa632c640 1 --2- 172.21.15.146:0/2425630948 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fefa003f060 0x7fefa0023070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:21.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.909+0000 7fefa632c640 1 --2- 172.21.15.146:0/2425630948 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fefa003f060 0x7fefa0023070 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:21.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.909+0000 7fefa632c640 1 -- 172.21.15.146:0/2425630948 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef98053040 con 0x7fefa003f060 2024-09-18T01:45:21.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.909+0000 7fefa632c640 1 --2- 172.21.15.146:0/2425630948 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fef98017050 0x7fef9804c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:21.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.909+0000 7fefa632c640 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c735641160 con 0x7fef98017050 2024-09-18T01:45:21.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.910+0000 7fef9db2b640 1 --2- 172.21.15.146:0/2425630948 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fef98017050 0x7fef9804c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:21.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.910+0000 7fef9db2b640 1 --2- 172.21.15.146:0/2425630948 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fef98017050 0x7fef9804c130 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:21.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.910+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef90051070 con 0x7fef98017050 2024-09-18T01:45:21.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.910+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c735641160 con 0x55c7356384d0 2024-09-18T01:45:21.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.910+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v24'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fef90051070 con 0x55c7356384d0 2024-09-18T01:45:21.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.910+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c735641160 con 0x55c7356384d0 2024-09-18T01:45:21.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.911+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef90051070 con 0x55c7356384d0 2024-09-18T01:45:21.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.911+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c735641160 con 0x7fef98017050 2024-09-18T01:45:21.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.911+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef90051070 con 0x7fef98017050 2024-09-18T01:45:21.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.911+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c735641160 con 0x7fef98017050 2024-09-18T01:45:21.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.911+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef90051070 con 0x7fef98017050 2024-09-18T01:45:21.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.911+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c735641160 con 0x7fefa003f060 2024-09-18T01:45:21.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.911+0000 7fefa632c640 1 -- 172.21.15.146:0/2425630948 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef98053040 con 0x7fefa003f060 2024-09-18T01:45:21.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.911+0000 7fefa632c640 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c735641160 con 0x55c73563e740 2024-09-18T01:45:21.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.912+0000 7fefa6b2d640 1 -- 172.21.15.146:0/2425630948 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefa003c030 con 0x55c73563e740 2024-09-18T01:45:21.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.912+0000 7fefa6b2d640 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c735641160 con 0x55c7356384d0 2024-09-18T01:45:21.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.912+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef90051070 con 0x55c7356384d0 2024-09-18T01:45:21.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.912+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c735641160 con 0x7fef98017050 2024-09-18T01:45:21.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.912+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef90051070 con 0x7fef98017050 2024-09-18T01:45:21.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.912+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c735641160 con 0x55c7356384d0 2024-09-18T01:45:21.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.912+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef90051070 con 0x55c7356384d0 2024-09-18T01:45:21.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.912+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c735641160 con 0x7fefa003f060 2024-09-18T01:45:21.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.913+0000 7fefa632c640 1 -- 172.21.15.146:0/2425630948 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fef98053040 con 0x7fefa003f060 2024-09-18T01:45:21.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.913+0000 7fefa632c640 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c735641160 con 0x55c73563e740 2024-09-18T01:45:21.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.913+0000 7fefa6b2d640 1 -- 172.21.15.146:0/2425630948 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefa003c030 con 0x55c73563e740 2024-09-18T01:45:21.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.913+0000 7fefa6b2d640 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c735641160 con 0x55c73563e740 2024-09-18T01:45:21.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.913+0000 7fefa6b2d640 1 -- 172.21.15.146:0/2425630948 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefa003c030 con 0x55c73563e740 2024-09-18T01:45:21.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.913+0000 7fefa6b2d640 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c735641160 con 0x7fef98017050 2024-09-18T01:45:21.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.913+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef90051070 con 0x7fef98017050 2024-09-18T01:45:21.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.913+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c735641160 con 0x55c73563e740 2024-09-18T01:45:21.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.913+0000 7fefa6b2d640 1 -- 172.21.15.146:0/2425630948 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefa003c030 con 0x55c73563e740 2024-09-18T01:45:21.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.913+0000 7fefa6b2d640 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c735641160 con 0x55c73563e740 2024-09-18T01:45:21.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.914+0000 7fefa6b2d640 1 -- 172.21.15.146:0/2425630948 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefa003c030 con 0x55c73563e740 2024-09-18T01:45:21.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.914+0000 7fefa6b2d640 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c735641160 con 0x55c7356384d0 2024-09-18T01:45:21.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.914+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef90051070 con 0x55c7356384d0 2024-09-18T01:45:21.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.914+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c735641160 con 0x55c7356384d0 2024-09-18T01:45:21.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.914+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fef90051070 con 0x55c7356384d0 2024-09-18T01:45:21.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.914+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c735641160 con 0x7fef98017050 2024-09-18T01:45:21.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.914+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef90051070 con 0x7fef98017050 2024-09-18T01:45:21.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.914+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c735641160 con 0x55c73563e740 2024-09-18T01:45:21.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.915+0000 7fefa6b2d640 1 -- 172.21.15.146:0/2425630948 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefa003c030 con 0x55c73563e740 2024-09-18T01:45:21.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.915+0000 7fefa6b2d640 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c735641160 con 0x7fefa003f060 2024-09-18T01:45:21.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.915+0000 7fefa632c640 1 -- 172.21.15.146:0/2425630948 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef98053040 con 0x7fefa003f060 2024-09-18T01:45:21.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.915+0000 7fefa632c640 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c735641160 con 0x55c7356384d0 2024-09-18T01:45:21.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.915+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef90051070 con 0x55c7356384d0 2024-09-18T01:45:21.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.915+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c735641160 con 0x7fef98017050 2024-09-18T01:45:21.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.915+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef90051070 con 0x7fef98017050 2024-09-18T01:45:21.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.915+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c735641160 con 0x55c73563e740 2024-09-18T01:45:21.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.916+0000 7fefa6b2d640 1 -- 172.21.15.146:0/2425630948 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefa003c030 con 0x55c73563e740 2024-09-18T01:45:21.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.916+0000 7fefa6b2d640 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c735641160 con 0x7fef98017050 2024-09-18T01:45:21.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.916+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef90051070 con 0x7fef98017050 2024-09-18T01:45:21.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.916+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c735641160 con 0x7fefa003f060 2024-09-18T01:45:21.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.916+0000 7fefa632c640 1 -- 172.21.15.146:0/2425630948 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef98053040 con 0x7fefa003f060 2024-09-18T01:45:21.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.916+0000 7fefa632c640 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c735641160 con 0x55c73563e740 2024-09-18T01:45:21.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.916+0000 7fefa6b2d640 1 -- 172.21.15.146:0/2425630948 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefa003c030 con 0x55c73563e740 2024-09-18T01:45:21.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.916+0000 7fefa6b2d640 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c735641160 con 0x7fef98017050 2024-09-18T01:45:21.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.917+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef90051070 con 0x7fef98017050 2024-09-18T01:45:21.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.917+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c735641160 con 0x55c7356384d0 2024-09-18T01:45:21.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.917+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fef90051070 con 0x55c7356384d0 2024-09-18T01:45:21.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.917+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c735641160 con 0x7fefa003f060 2024-09-18T01:45:21.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.917+0000 7fefa632c640 1 -- 172.21.15.146:0/2425630948 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef9805f040 con 0x7fefa003f060 2024-09-18T01:45:21.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.917+0000 7fefaac11800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:21.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.917+0000 7fefaac11800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:21.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.917+0000 7fefaac11800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:21.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.917+0000 7fefaac11800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:21.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.917+0000 7fefaac11800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:21.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.917+0000 7fefaac11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:21.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.917+0000 7fefaac11800 20 rados->read ofs=0 len=0 2024-09-18T01:45:21.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.917+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c73563d380 con 0x55c7356384d0 2024-09-18T01:45:21.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.918+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fef90051070 con 0x55c7356384d0 2024-09-18T01:45:21.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.918+0000 7fefaac11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:21.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.918+0000 7fefaac11800 20 rados->read ofs=0 len=0 2024-09-18T01:45:21.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.918+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c73563dc20 con 0x55c7356384d0 2024-09-18T01:45:21.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.918+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fef90051070 con 0x55c7356384d0 2024-09-18T01:45:21.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.918+0000 7fefaac11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:21.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.918+0000 7fefaac11800 20 rados->read ofs=0 len=0 2024-09-18T01:45:21.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.918+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c7356415e0 con 0x7fefa003f060 2024-09-18T01:45:21.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.918+0000 7fefa632c640 1 -- 172.21.15.146:0/2425630948 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fef9805f040 con 0x7fefa003f060 2024-09-18T01:45:21.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.918+0000 7fefaac11800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:21.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.918+0000 7fefaac11800 20 zone default found 2024-09-18T01:45:21.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.918+0000 7fefaac11800 4 Realm: () 2024-09-18T01:45:21.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.918+0000 7fefaac11800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:21.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.918+0000 7fefaac11800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:21.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.918+0000 7fefaac11800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:21.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.918+0000 7fefaac11800 20 zonegroup default 2024-09-18T01:45:21.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.918+0000 7fefaac11800 20 rados->read ofs=0 len=0 2024-09-18T01:45:21.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.918+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c735641e30 con 0x7fef98017050 2024-09-18T01:45:21.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.919+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fef90051070 con 0x7fef98017050 2024-09-18T01:45:21.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.919+0000 7fefaac11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:21.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.919+0000 7fefaac11800 20 rados->read ofs=0 len=0 2024-09-18T01:45:21.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.919+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c735643810 con 0x55c73563e740 2024-09-18T01:45:21.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.919+0000 7fefa6b2d640 1 -- 172.21.15.146:0/2425630948 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fefa003c030 con 0x55c73563e740 2024-09-18T01:45:21.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.919+0000 7fefaac11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:21.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.919+0000 7fefaac11800 20 rados->read ofs=0 len=0 2024-09-18T01:45:21.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.919+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c735643d80 con 0x55c73563e740 2024-09-18T01:45:21.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.919+0000 7fefa6b2d640 1 -- 172.21.15.146:0/2425630948 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fefa003c030 con 0x55c73563e740 2024-09-18T01:45:21.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.919+0000 7fefaac11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:21.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.919+0000 7fefaac11800 20 started sync module instance, tier type = 2024-09-18T01:45:21.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.919+0000 7fefaac11800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:21.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.919+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c735642ca0 con 0x7fefa003f060 2024-09-18T01:45:21.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.920+0000 7fefa632c640 1 -- 172.21.15.146:0/2425630948 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v31'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef9805f040 con 0x7fefa003f060 2024-09-18T01:45:21.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.920+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94314082611344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c735644690 con 0x7fefa003f060 2024-09-18T01:45:21.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.920+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c735644ee0 con 0x55c7356384d0 2024-09-18T01:45:21.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.921+0000 7fefa632c640 1 -- 172.21.15.146:0/2425630948 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94314082611344] v31'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef9805f040 con 0x7fefa003f060 2024-09-18T01:45:21.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.921+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v31'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef90051070 con 0x55c7356384d0 2024-09-18T01:45:21.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.921+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94314082615776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c735644ee0 con 0x55c7356384d0 2024-09-18T01:45:21.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.921+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c735645990 con 0x55c73563e740 2024-09-18T01:45:21.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.922+0000 7fefa6b2d640 1 -- 172.21.15.146:0/2425630948 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v31'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefa003c030 con 0x55c73563e740 2024-09-18T01:45:21.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.922+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94314082620528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c735646230 con 0x55c73563e740 2024-09-18T01:45:21.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.922+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c735646d30 con 0x7fefa003f060 2024-09-18T01:45:21.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.923+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94314082615776] v31'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef90051070 con 0x55c7356384d0 2024-09-18T01:45:21.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.925+0000 7fefa6b2d640 1 -- 172.21.15.146:0/2425630948 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94314082620528] v31'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefa003c030 con 0x55c73563e740 2024-09-18T01:45:21.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.925+0000 7fefa632c640 1 -- 172.21.15.146:0/2425630948 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v31'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef9805f040 con 0x7fefa003f060 2024-09-18T01:45:21.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.925+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94314082617904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c735646230 con 0x7fefa003f060 2024-09-18T01:45:21.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.925+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c7356475d0 con 0x55c7356384d0 2024-09-18T01:45:21.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.928+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v31'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef90051070 con 0x55c7356384d0 2024-09-18T01:45:21.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.928+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94314082628384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c735647e70 con 0x55c7356384d0 2024-09-18T01:45:21.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.928+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c735648960 con 0x7fef98017050 2024-09-18T01:45:21.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.931+0000 7fefa632c640 1 -- 172.21.15.146:0/2425630948 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94314082617904] v31'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef9805f040 con 0x7fefa003f060 2024-09-18T01:45:21.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.931+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v31'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef90051070 con 0x7fef98017050 2024-09-18T01:45:21.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.931+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94314082632752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c735648920 con 0x7fef98017050 2024-09-18T01:45:21.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.931+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c735649370 con 0x7fef98017050 2024-09-18T01:45:21.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.933+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94314082628384] v31'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef90051070 con 0x55c7356384d0 2024-09-18T01:45:21.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.933+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(56 notify.6 [create] v31'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef90051070 con 0x7fef98017050 2024-09-18T01:45:21.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.934+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94314082630080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c735649370 con 0x7fef98017050 2024-09-18T01:45:21.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.934+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c735649d80 con 0x7fef98017050 2024-09-18T01:45:21.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.934+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94314082632752] v31'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef90051070 con 0x7fef98017050 2024-09-18T01:45:21.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.936+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(58 notify.7 [create] v31'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef90051070 con 0x7fef98017050 2024-09-18T01:45:21.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.936+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94314082622848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c735649d80 con 0x7fef98017050 2024-09-18T01:45:21.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.936+0000 7fefaac11800 20 add_watcher() i=0 2024-09-18T01:45:21.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.936+0000 7fefaac11800 20 add_watcher() i=1 2024-09-18T01:45:21.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.936+0000 7fefaac11800 20 add_watcher() i=2 2024-09-18T01:45:21.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.936+0000 7fefaac11800 20 add_watcher() i=3 2024-09-18T01:45:21.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.936+0000 7fefaac11800 20 add_watcher() i=4 2024-09-18T01:45:21.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.936+0000 7fefaac11800 20 add_watcher() i=5 2024-09-18T01:45:21.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.937+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94314082630080] v31'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef90051070 con 0x7fef98017050 2024-09-18T01:45:21.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.937+0000 7fefaac11800 20 add_watcher() i=6 2024-09-18T01:45:21.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.937+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94314082622848] v31'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef90051070 con 0x7fef98017050 2024-09-18T01:45:21.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.937+0000 7fefaac11800 20 add_watcher() i=7 2024-09-18T01:45:21.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.937+0000 7fefaac11800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:21.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.937+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c73564cdb0 con 0x55c7356384d0 2024-09-18T01:45:21.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.938+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fef90051070 con 0x55c7356384d0 2024-09-18T01:45:21.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.938+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94314082638032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c73564a1a0 con 0x55c7356384d0 2024-09-18T01:45:21.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.939+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94314082638032] v31'32 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fef90051070 con 0x55c7356384d0 2024-09-18T01:45:21.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.939+0000 7fee5cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:21.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.939+0000 7fefaac11800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:21.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.939+0000 7fefaac11800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:21.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.939+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c7356556a0 con 0x55c7356384d0 2024-09-18T01:45:21.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.941+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'40 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fef90051070 con 0x55c7356384d0 2024-09-18T01:45:21.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.941+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c735655d70 con 0x7fef98017050 2024-09-18T01:45:21.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.942+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fef90051070 con 0x7fef98017050 2024-09-18T01:45:21.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.942+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c735656190 con 0x55c73563e740 2024-09-18T01:45:21.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.943+0000 7fefa6b2d640 1 -- 172.21.15.146:0/2425630948 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fefa003c030 con 0x55c73563e740 2024-09-18T01:45:21.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.943+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c735656160 con 0x55c7356384d0 2024-09-18T01:45:21.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.943+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'33 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fef90051070 con 0x55c7356384d0 2024-09-18T01:45:21.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.944+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c7356566f0 con 0x7fefa003f060 2024-09-18T01:45:21.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.945+0000 7fefa632c640 1 -- 172.21.15.146:0/2425630948 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fef9805f040 con 0x7fefa003f060 2024-09-18T01:45:21.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.945+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c735656c60 con 0x55c73563e740 2024-09-18T01:45:21.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.946+0000 7fefa6b2d640 1 -- 172.21.15.146:0/2425630948 <== osd.3 v2:172.21.15.146:6809/4106661138 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'27 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fefa003c030 con 0x55c73563e740 2024-09-18T01:45:21.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.946+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c735656cf0 con 0x55c7356384d0 2024-09-18T01:45:21.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.947+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fef90051070 con 0x55c7356384d0 2024-09-18T01:45:21.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.947+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c735656d80 con 0x7fef98017050 2024-09-18T01:45:21.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.948+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'19 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fef90051070 con 0x7fef98017050 2024-09-18T01:45:21.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.948+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c735656e10 con 0x7fefa003f060 2024-09-18T01:45:21.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.950+0000 7fefa632c640 1 -- 172.21.15.146:0/2425630948 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fef9805f040 con 0x7fefa003f060 2024-09-18T01:45:21.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.950+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c7356572c0 con 0x55c73563e740 2024-09-18T01:45:21.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.952+0000 7fefa6b2d640 1 -- 172.21.15.146:0/2425630948 <== osd.3 v2:172.21.15.146:6809/4106661138 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fefa003c030 con 0x55c73563e740 2024-09-18T01:45:21.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.952+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c7356572c0 con 0x7fefa003f060 2024-09-18T01:45:21.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.955+0000 7fefa632c640 1 -- 172.21.15.146:0/2425630948 <== osd.2 v2:172.21.15.146:6800/3820039304 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'27 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef9805f040 con 0x7fefa003f060 2024-09-18T01:45:21.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.955+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c7356572c0 con 0x7fef98017050 2024-09-18T01:45:21.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.956+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'12 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef90051070 con 0x7fef98017050 2024-09-18T01:45:21.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.956+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c7356572c0 con 0x7fefa003f060 2024-09-18T01:45:21.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.958+0000 7fefa632c640 1 -- 172.21.15.146:0/2425630948 <== osd.2 v2:172.21.15.146:6800/3820039304 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef9805f040 con 0x7fefa003f060 2024-09-18T01:45:21.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.958+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c7356572c0 con 0x7fef98017050 2024-09-18T01:45:21.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.961+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'31 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef90051070 con 0x7fef98017050 2024-09-18T01:45:21.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.961+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c7356572c0 con 0x55c7356384d0 2024-09-18T01:45:21.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.961+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'34 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef90051070 con 0x55c7356384d0 2024-09-18T01:45:21.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.962+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c7356572c0 con 0x55c73563e740 2024-09-18T01:45:21.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.963+0000 7fefa6b2d640 1 -- 172.21.15.146:0/2425630948 <== osd.3 v2:172.21.15.146:6809/4106661138 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'20 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fefa003c030 con 0x55c73563e740 2024-09-18T01:45:21.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.963+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c7356572c0 con 0x7fefa003f060 2024-09-18T01:45:21.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.964+0000 7fefa632c640 1 -- 172.21.15.146:0/2425630948 <== osd.2 v2:172.21.15.146:6800/3820039304 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'28 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef9805f040 con 0x7fefa003f060 2024-09-18T01:45:21.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.964+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c7356572c0 con 0x55c73563e740 2024-09-18T01:45:21.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.965+0000 7fefa6b2d640 1 -- 172.21.15.146:0/2425630948 <== osd.3 v2:172.21.15.146:6809/4106661138 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'22 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fefa003c030 con 0x55c73563e740 2024-09-18T01:45:21.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.965+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c735657300 con 0x55c7356384d0 2024-09-18T01:45:21.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.966+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef90051070 con 0x55c7356384d0 2024-09-18T01:45:21.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.966+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c7356572c0 con 0x55c7356384d0 2024-09-18T01:45:21.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.967+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'35 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef90051070 con 0x55c7356384d0 2024-09-18T01:45:21.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.967+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c7356572c0 con 0x55c73563e740 2024-09-18T01:45:21.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.968+0000 7fefa6b2d640 1 -- 172.21.15.146:0/2425630948 <== osd.3 v2:172.21.15.146:6809/4106661138 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'21 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fefa003c030 con 0x55c73563e740 2024-09-18T01:45:21.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.968+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c7356572c0 con 0x7fefa003f060 2024-09-18T01:45:21.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.969+0000 7fefa632c640 1 -- 172.21.15.146:0/2425630948 <== osd.2 v2:172.21.15.146:6800/3820039304 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'26 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef9805f040 con 0x7fefa003f060 2024-09-18T01:45:21.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.969+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c7356572c0 con 0x55c73563e740 2024-09-18T01:45:21.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.970+0000 7fefa6b2d640 1 -- 172.21.15.146:0/2425630948 <== osd.3 v2:172.21.15.146:6809/4106661138 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'18 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fefa003c030 con 0x55c73563e740 2024-09-18T01:45:21.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.970+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c7356572c0 con 0x55c73563e740 2024-09-18T01:45:21.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.971+0000 7fefa6b2d640 1 -- 172.21.15.146:0/2425630948 <== osd.3 v2:172.21.15.146:6809/4106661138 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'28 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fefa003c030 con 0x55c73563e740 2024-09-18T01:45:21.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.971+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c7356572c0 con 0x55c73563e740 2024-09-18T01:45:21.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.972+0000 7fefa6b2d640 1 -- 172.21.15.146:0/2425630948 <== osd.3 v2:172.21.15.146:6809/4106661138 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fefa003c030 con 0x55c73563e740 2024-09-18T01:45:21.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.972+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c7356572c0 con 0x55c73563e740 2024-09-18T01:45:21.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.973+0000 7fefa6b2d640 1 -- 172.21.15.146:0/2425630948 <== osd.3 v2:172.21.15.146:6809/4106661138 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'28 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fefa003c030 con 0x55c73563e740 2024-09-18T01:45:21.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.973+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c735657300 con 0x7fef98017050 2024-09-18T01:45:21.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.974+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'18 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef90051070 con 0x7fef98017050 2024-09-18T01:45:21.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.974+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c7356572c0 con 0x55c73563e740 2024-09-18T01:45:21.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.975+0000 7fefa6b2d640 1 -- 172.21.15.146:0/2425630948 <== osd.3 v2:172.21.15.146:6809/4106661138 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fefa003c030 con 0x55c73563e740 2024-09-18T01:45:21.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.975+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c7356572c0 con 0x7fef98017050 2024-09-18T01:45:21.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.976+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 <== osd.0 v2:172.21.15.129:6800/1759265424 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'20 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef90051070 con 0x7fef98017050 2024-09-18T01:45:21.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.976+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c7356572c0 con 0x55c73563e740 2024-09-18T01:45:21.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.977+0000 7fefa6b2d640 1 -- 172.21.15.146:0/2425630948 <== osd.3 v2:172.21.15.146:6809/4106661138 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fefa003c030 con 0x55c73563e740 2024-09-18T01:45:21.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.977+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c7356572c0 con 0x7fef98017050 2024-09-18T01:45:21.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.979+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 <== osd.0 v2:172.21.15.129:6800/1759265424 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'32 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef90051070 con 0x7fef98017050 2024-09-18T01:45:21.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.979+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c7356572c0 con 0x7fefa003f060 2024-09-18T01:45:21.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.980+0000 7fefa632c640 1 -- 172.21.15.146:0/2425630948 <== osd.2 v2:172.21.15.146:6800/3820039304 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef9805f040 con 0x7fefa003f060 2024-09-18T01:45:21.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.980+0000 7fedd77fe640 20 reqs_thread_entry: start 2024-09-18T01:45:21.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.980+0000 7fefaac11800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:21.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.980+0000 7fefaac11800 20 Filter name: none 2024-09-18T01:45:21.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.980+0000 7fedd57fa640 20 reqs_thread_entry: start 2024-09-18T01:45:21.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.980+0000 7fefaac11800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-18T01:45:21.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.980+0000 7fefaac11800 20 rados->read ofs=0 len=0 2024-09-18T01:45:21.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.980+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c735682570 con 0x7fefa003f060 2024-09-18T01:45:21.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.981+0000 7fefa632c640 1 -- 172.21.15.146:0/2425630948 <== osd.2 v2:172.21.15.146:6800/3820039304 19 ==== osd_op_reply(94 bud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fef9805f040 con 0x7fefa003f060 2024-09-18T01:45:21.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.981+0000 7fefaac11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:21.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.981+0000 7fefaac11800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x0 2024-09-18T01:45:21.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.981+0000 7fefaac11800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-18T01:45:21.987 INFO:teuthology.orchestra.run.smithi146.stderr:could not remove user: unable to remove user, user does not exist 2024-09-18T01:45:21.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.981+0000 7fee5cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:21.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.981+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94314082638032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c735650fd0 con 0x55c7356384d0 2024-09-18T01:45:21.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.982+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 <== osd.1 v2:172.21.15.146:6808/3930274777 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94314082638032] v31'36 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fef90051070 con 0x55c7356384d0 2024-09-18T01:45:21.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.982+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94314082611344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c735650fd0 con 0x7fefa003f060 2024-09-18T01:45:21.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.983+0000 7fefa632c640 1 -- 172.21.15.146:0/2425630948 <== osd.2 v2:172.21.15.146:6800/3820039304 20 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94314082611344] v31'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef9805f040 con 0x7fefa003f060 2024-09-18T01:45:21.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.983+0000 7fefaac11800 20 remove_watcher() i=0 2024-09-18T01:45:21.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.983+0000 7fefaac11800 2 removed watcher, disabling cache 2024-09-18T01:45:21.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.983+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94314082615776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c735643090 con 0x55c7356384d0 2024-09-18T01:45:21.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.985+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 <== osd.1 v2:172.21.15.146:6808/3930274777 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94314082615776] v31'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef90051070 con 0x55c7356384d0 2024-09-18T01:45:21.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.985+0000 7fefaac11800 20 remove_watcher() i=1 2024-09-18T01:45:21.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.985+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94314082620528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c7356441e0 con 0x55c73563e740 2024-09-18T01:45:21.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.986+0000 7fefa6b2d640 1 -- 172.21.15.146:0/2425630948 <== osd.3 v2:172.21.15.146:6809/4106661138 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94314082620528] v31'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefa003c030 con 0x55c73563e740 2024-09-18T01:45:21.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.986+0000 7fefaac11800 20 remove_watcher() i=2 2024-09-18T01:45:21.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.986+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94314082617904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c7356441e0 con 0x7fefa003f060 2024-09-18T01:45:21.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.987+0000 7fefa632c640 1 -- 172.21.15.146:0/2425630948 <== osd.2 v2:172.21.15.146:6800/3820039304 21 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94314082617904] v31'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef9805f040 con 0x7fefa003f060 2024-09-18T01:45:21.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.987+0000 7fefaac11800 20 remove_watcher() i=3 2024-09-18T01:45:21.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.987+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94314082628384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c735644a30 con 0x55c7356384d0 2024-09-18T01:45:21.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.988+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 <== osd.1 v2:172.21.15.146:6808/3930274777 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94314082628384] v31'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef90051070 con 0x55c7356384d0 2024-09-18T01:45:21.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.988+0000 7fefaac11800 20 remove_watcher() i=4 2024-09-18T01:45:21.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.988+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94314082632752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c7356441e0 con 0x7fef98017050 2024-09-18T01:45:21.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.989+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 <== osd.0 v2:172.21.15.129:6800/1759265424 24 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94314082632752] v31'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef90051070 con 0x7fef98017050 2024-09-18T01:45:21.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.989+0000 7fefaac11800 20 remove_watcher() i=5 2024-09-18T01:45:21.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.989+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94314082630080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c735648430 con 0x7fef98017050 2024-09-18T01:45:21.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.990+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 <== osd.0 v2:172.21.15.129:6800/1759265424 25 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94314082630080] v31'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef90051070 con 0x7fef98017050 2024-09-18T01:45:21.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.990+0000 7fefaac11800 20 remove_watcher() i=6 2024-09-18T01:45:21.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.990+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94314082622848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c7356441e0 con 0x7fef98017050 2024-09-18T01:45:21.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.991+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 <== osd.0 v2:172.21.15.129:6800/1759265424 26 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94314082622848] v31'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef90051070 con 0x7fef98017050 2024-09-18T01:45:21.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.991+0000 7fefaac11800 20 remove_watcher() i=7 2024-09-18T01:45:21.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.991+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fef98017050 msgr2=0x7fef9804c130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:21.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.991+0000 7fefaac11800 1 --2- 172.21.15.146:0/2425630948 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fef98017050 0x7fef9804c130 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:21.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.991+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55c7356384d0 msgr2=0x55c73563a990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:21.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.991+0000 7fefaac11800 1 --2- 172.21.15.146:0/2425630948 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55c7356384d0 0x55c73563a990 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:21.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.991+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fefa003f060 msgr2=0x7fefa0023070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:21.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.991+0000 7fefaac11800 1 --2- 172.21.15.146:0/2425630948 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fefa003f060 0x7fefa0023070 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:21.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.991+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55c73563e740 msgr2=0x55c735640b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:21.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.991+0000 7fefaac11800 1 --2- 172.21.15.146:0/2425630948 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55c73563e740 0x55c735640b30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:21.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.991+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fee70036b40 msgr2=0x7fee70039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:21.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.991+0000 7fefaac11800 1 --2- 172.21.15.146:0/2425630948 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fee70036b40 0x7fee70039000 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fef98001620 tx=0x7fef98036000 comp rx=0 tx=0).stop 2024-09-18T01:45:21.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.991+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c7356253a0 msgr2=0x55c73562c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:21.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.991+0000 7fef9db2b640 1 -- 172.21.15.146:0/2425630948 reap_dead start 2024-09-18T01:45:21.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.991+0000 7fefaac11800 1 --2- 172.21.15.146:0/2425630948 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c7356253a0 0x55c73562c7a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fefa0043040 tx=0x7fefa004c880 comp rx=0 tx=0).stop 2024-09-18T01:45:21.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.991+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 shutdown_connections 2024-09-18T01:45:21.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.991+0000 7fefaac11800 1 --2- 172.21.15.146:0/2425630948 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c7356253a0 0x55c73562c7a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:21.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.991+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 >> 172.21.15.146:0/2425630948 conn(0x55c735621750 msgr2=0x55c735626ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:21.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.991+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 shutdown_connections 2024-09-18T01:45:21.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.991+0000 7fefaac11800 1 -- 172.21.15.146:0/2425630948 wait complete. 2024-09-18T01:45:21.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.992+0000 7fefaac11800 1 -- 172.21.15.146:0/1367185462 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fee80036b40 msgr2=0x7fee80039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:21.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.992+0000 7fefaac11800 1 --2- 172.21.15.146:0/1367185462 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fee80036b40 0x7fee80039000 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x55c735606260 tx=0x7fef98024000 comp rx=0 tx=0).stop 2024-09-18T01:45:21.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.992+0000 7fefaac11800 1 -- 172.21.15.146:0/1367185462 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c735618700 msgr2=0x55c735618b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:21.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.992+0000 7fefaac11800 1 --2- 172.21.15.146:0/1367185462 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c735618700 0x55c735618b20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x55c735605360 tx=0x7fefa00178e0 comp rx=0 tx=0).stop 2024-09-18T01:45:21.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.992+0000 7fefaac11800 1 -- 172.21.15.146:0/1367185462 shutdown_connections 2024-09-18T01:45:21.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.992+0000 7fefaac11800 1 --2- 172.21.15.146:0/1367185462 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fee80036b40 0x7fee80039000 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:21.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.992+0000 7fefaac11800 1 --2- 172.21.15.146:0/1367185462 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c735618700 0x55c735618b20 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:21.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.992+0000 7fefaac11800 1 -- 172.21.15.146:0/1367185462 >> 172.21.15.146:0/1367185462 conn(0x55c73560d690 msgr2=0x55c735610210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:21.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.992+0000 7fefaac11800 1 -- 172.21.15.146:0/1367185462 shutdown_connections 2024-09-18T01:45:21.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.992+0000 7fefaac11800 1 -- 172.21.15.146:0/1367185462 wait complete. 2024-09-18T01:45:21.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.992+0000 7fefaac11800 1 -- 172.21.15.146:0/211133421 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55c735602650 msgr2=0x55c735604a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:21.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.992+0000 7fefaac11800 1 --2- 172.21.15.146:0/211133421 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55c735602650 0x55c735604a40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:21.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.992+0000 7fefaac11800 1 -- 172.21.15.146:0/211133421 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55c735606960 msgr2=0x55c73560a1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:21.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.992+0000 7fefaac11800 1 --2- 172.21.15.146:0/211133421 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55c735606960 0x55c73560a1c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:21.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.992+0000 7fefaac11800 1 -- 172.21.15.146:0/211133421 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fee8c036b90 msgr2=0x7fee8c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:21.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.992+0000 7fefaac11800 1 --2- 172.21.15.146:0/211133421 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fee8c036b90 0x7fee8c039050 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fef90057000 tx=0x7fef90052000 comp rx=0 tx=0).stop 2024-09-18T01:45:21.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.992+0000 7fefaac11800 1 -- 172.21.15.146:0/211133421 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c735477df0 msgr2=0x55c7355fd5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:21.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.992+0000 7fefaac11800 1 --2- 172.21.15.146:0/211133421 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c735477df0 0x55c7355fd5f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fef98001e10 tx=0x7fef98000ed0 comp rx=0 tx=0).stop 2024-09-18T01:45:21.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.992+0000 7fefaac11800 1 -- 172.21.15.146:0/211133421 shutdown_connections 2024-09-18T01:45:21.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.992+0000 7fefaac11800 1 --2- 172.21.15.146:0/211133421 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55c735606960 0x55c73560a1c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:21.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.992+0000 7fefaac11800 1 --2- 172.21.15.146:0/211133421 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55c735602650 0x55c735604a40 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:21.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.992+0000 7fefaac11800 1 --2- 172.21.15.146:0/211133421 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fee8c036b90 0x7fee8c039050 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:21.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.992+0000 7fefaac11800 1 --2- 172.21.15.146:0/211133421 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c735477df0 0x55c7355fd5f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:21.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.992+0000 7fefaac11800 1 -- 172.21.15.146:0/211133421 >> 172.21.15.146:0/211133421 conn(0x55c7354fedf0 msgr2=0x55c7355efe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:21.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.992+0000 7fefaac11800 1 -- 172.21.15.146:0/211133421 shutdown_connections 2024-09-18T01:45:21.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:21.992+0000 7fefaac11800 1 -- 172.21.15.146:0/211133421 wait complete. 2024-09-18T01:45:22.001 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-18T01:45:22.001 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bar'] 2024-09-18T01:45:22.001 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bar'] 2024-09-18T01:45:22.002 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bar 2024-09-18T01:45:22.046 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:22.046 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:22.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.046+0000 7f91f5a10800 1 Processor -- start 2024-09-18T01:45:22.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.046+0000 7f91f5a10800 1 -- start start 2024-09-18T01:45:22.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.046+0000 7f91f5a10800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x562c154c1d90 0x562c154c4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.046+0000 7f91f5a10800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562c1537ab30 con 0x562c1542f610 2024-09-18T01:45:22.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.046+0000 7f91f5a10800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x562c1535c360 con 0x562c154c1d90 2024-09-18T01:45:22.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.046+0000 7f91ebfff640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x562c154c1d90 0x562c154c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.046+0000 7f91f10f7640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x562c1542f610 0x562c154c0670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:38644/0 (socket says 172.21.15.146:38644) 2024-09-18T01:45:22.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.046+0000 7f91ebfff640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x562c154c1d90 0x562c154c4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59168/0 (socket says 172.21.15.146:59168) 2024-09-18T01:45:22.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.046+0000 7f91f10f7640 1 -- 172.21.15.146:0/2357085371 learned_addr learned my addr 172.21.15.146:0/2357085371 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:45:22.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.046+0000 7f91ebfff640 1 -- 172.21.15.146:0/2357085371 >> v1:172.21.15.129:6789/0 conn(0x562c1542f610 legacy=0x562c154c0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.046+0000 7f91ebfff640 1 -- 172.21.15.146:0/2357085371 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c15382e00 con 0x562c154c1d90 2024-09-18T01:45:22.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.048+0000 7f91ebfff640 1 --2- 172.21.15.146:0/2357085371 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562c154c1d90 0x562c154c4180 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f91dc00a470 tx=0x7f91dc045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9aad98d58b9bb2a server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.048+0000 7f91f08f6640 1 -- 172.21.15.146:0/2357085371 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91dc053570 con 0x562c154c1d90 2024-09-18T01:45:22.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.048+0000 7f91f08f6640 1 -- 172.21.15.146:0/2357085371 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91dc058070 con 0x562c154c1d90 2024-09-18T01:45:22.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.048+0000 7f91f08f6640 1 -- 172.21.15.146:0/2357085371 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91dc053880 con 0x562c154c1d90 2024-09-18T01:45:22.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.049+0000 7f91f5a10800 1 -- 172.21.15.146:0/2357085371 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562c154c1d90 msgr2=0x562c154c4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.049+0000 7f91f5a10800 1 --2- 172.21.15.146:0/2357085371 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562c154c1d90 0x562c154c4180 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f91dc00a470 tx=0x7f91dc045a20 comp rx=0 tx=0).stop 2024-09-18T01:45:22.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.049+0000 7f91f5a10800 1 -- 172.21.15.146:0/2357085371 shutdown_connections 2024-09-18T01:45:22.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.049+0000 7f91f5a10800 1 --2- 172.21.15.146:0/2357085371 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562c154c1d90 0x562c154c4180 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.049+0000 7f91f5a10800 1 -- 172.21.15.146:0/2357085371 >> 172.21.15.146:0/2357085371 conn(0x562c154b5de0 msgr2=0x562c154b8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:22.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.049+0000 7f91f5a10800 1 -- 172.21.15.146:0/2357085371 shutdown_connections 2024-09-18T01:45:22.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.049+0000 7f91f5a10800 1 -- 172.21.15.146:0/2357085371 wait complete. 2024-09-18T01:45:22.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.062+0000 7f91f5a10800 1 Processor -- start 2024-09-18T01:45:22.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.063+0000 7f91f5a10800 1 -- start start 2024-09-18T01:45:22.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.063+0000 7f91f5a10800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562c1542f610 0x562c155aca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.063+0000 7f91f5a10800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x562c15407330 con 0x562c1542f610 2024-09-18T01:45:22.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.063+0000 7f91f10f7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562c1542f610 0x562c155aca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.063+0000 7f91f10f7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562c1542f610 0x562c155aca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59178/0 (socket says 172.21.15.146:59178) 2024-09-18T01:45:22.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.063+0000 7f91f10f7640 1 -- 172.21.15.146:0/3981448117 learned_addr learned my addr 172.21.15.146:0/3981448117 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:22.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.063+0000 7f91f10f7640 1 -- 172.21.15.146:0/3981448117 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c15354bc0 con 0x562c1542f610 2024-09-18T01:45:22.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.063+0000 7f91f10f7640 1 --2- 172.21.15.146:0/3981448117 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562c1542f610 0x562c155aca90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f91e4001d80 tx=0x7f91e4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dc2f9471fec67d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.064+0000 7f90df606640 1 -- 172.21.15.146:0/3981448117 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91e4013030 con 0x562c1542f610 2024-09-18T01:45:22.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.064+0000 7f90df606640 1 -- 172.21.15.146:0/3981448117 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91e400e470 con 0x562c1542f610 2024-09-18T01:45:22.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.064+0000 7f90df606640 1 -- 172.21.15.146:0/3981448117 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91e400e810 con 0x562c1542f610 2024-09-18T01:45:22.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.064+0000 7f91f5a10800 1 -- 172.21.15.146:0/3981448117 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562c1542f610 msgr2=0x562c155aca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.064+0000 7f91f5a10800 1 --2- 172.21.15.146:0/3981448117 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562c1542f610 0x562c155aca90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f91e4001d80 tx=0x7f91e4001e70 comp rx=0 tx=0).stop 2024-09-18T01:45:22.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.064+0000 7f91f5a10800 1 -- 172.21.15.146:0/3981448117 shutdown_connections 2024-09-18T01:45:22.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.064+0000 7f91f5a10800 1 --2- 172.21.15.146:0/3981448117 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562c1542f610 0x562c155aca90 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.064+0000 7f91f5a10800 1 -- 172.21.15.146:0/3981448117 >> 172.21.15.146:0/3981448117 conn(0x562c154b5de0 msgr2=0x562c155a8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:22.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.064+0000 7f91f5a10800 1 -- 172.21.15.146:0/3981448117 shutdown_connections 2024-09-18T01:45:22.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.064+0000 7f91f5a10800 1 -- 172.21.15.146:0/3981448117 wait complete. 2024-09-18T01:45:22.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.065+0000 7f91f5a10800 1 Processor -- start 2024-09-18T01:45:22.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.065+0000 7f91f5a10800 1 -- start start 2024-09-18T01:45:22.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.065+0000 7f91f5a10800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562c1542f610 0x562c155b44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.065+0000 7f91f5a10800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x562c154c4990 con 0x562c1542f610 2024-09-18T01:45:22.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.065+0000 7f91f10f7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562c1542f610 0x562c155b44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.065+0000 7f91f10f7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562c1542f610 0x562c155b44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59188/0 (socket says 172.21.15.146:59188) 2024-09-18T01:45:22.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.065+0000 7f91f10f7640 1 -- 172.21.15.146:0/4255834528 learned_addr learned my addr 172.21.15.146:0/4255834528 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:22.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.065+0000 7f91f10f7640 1 -- 172.21.15.146:0/4255834528 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c15368fe0 con 0x562c1542f610 2024-09-18T01:45:22.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.066+0000 7f91f10f7640 1 --2- 172.21.15.146:0/4255834528 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562c1542f610 0x562c155b44c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f91e4004000 tx=0x7f91e4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.066+0000 7f90dde03640 1 -- 172.21.15.146:0/4255834528 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91e4027070 con 0x562c1542f610 2024-09-18T01:45:22.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.066+0000 7f90dde03640 1 -- 172.21.15.146:0/4255834528 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91e4019900 con 0x562c1542f610 2024-09-18T01:45:22.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.066+0000 7f91f5a10800 1 -- 172.21.15.146:0/4255834528 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562c155b4a00 con 0x562c1542f610 2024-09-18T01:45:22.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.066+0000 7f90dde03640 1 -- 172.21.15.146:0/4255834528 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91e4019c60 con 0x562c1542f610 2024-09-18T01:45:22.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.066+0000 7f91f5a10800 1 -- 172.21.15.146:0/4255834528 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c155b4f20 con 0x562c1542f610 2024-09-18T01:45:22.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.067+0000 7f90dde03640 1 -- 172.21.15.146:0/4255834528 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f91e402a070 con 0x562c1542f610 2024-09-18T01:45:22.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.067+0000 7f90dde03640 1 --2- 172.21.15.146:0/4255834528 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f90d8036b40 0x7f90d8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.067+0000 7f90dde03640 1 -- 172.21.15.146:0/4255834528 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f91e401f070 con 0x562c1542f610 2024-09-18T01:45:22.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.067+0000 7f91ebfff640 1 --2- 172.21.15.146:0/4255834528 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f90d8036b40 0x7f90d8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.067+0000 7f91f5a10800 1 --2- 172.21.15.146:0/4255834528 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x562c154c1d90 0x562c155bb530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.067+0000 7f91f5a10800 1 -- 172.21.15.146:0/4255834528 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562c155bbb00 con 0x562c154c1d90 2024-09-18T01:45:22.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.067+0000 7f91f18f8640 1 --2- 172.21.15.146:0/4255834528 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x562c154c1d90 0x562c155bb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.067+0000 7f91ebfff640 1 --2- 172.21.15.146:0/4255834528 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f90d8036b40 0x7f90d8039000 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f91dc057000 tx=0x7f91dc052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.067+0000 7f91f18f8640 1 --2- 172.21.15.146:0/4255834528 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x562c154c1d90 0x562c155bb530 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.068+0000 7f91f18f8640 1 -- 172.21.15.146:0/4255834528 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f91ec00a4a0 con 0x562c154c1d90 2024-09-18T01:45:22.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.068+0000 7f91f5a10800 1 -- 172.21.15.146:0/4255834528 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562c155b8b00 con 0x562c154c1d90 2024-09-18T01:45:22.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.068+0000 7f91f18f8640 1 -- 172.21.15.146:0/4255834528 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f91ec00a4a0 con 0x562c154c1d90 2024-09-18T01:45:22.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.068+0000 7f91f5a10800 1 -- 172.21.15.146:0/4255834528 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562c155bd900 con 0x562c154c1d90 2024-09-18T01:45:22.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.068+0000 7f91f18f8640 1 -- 172.21.15.146:0/4255834528 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f91ec00a4a0 con 0x562c154c1d90 2024-09-18T01:45:22.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.068+0000 7f91f5a10800 1 -- 172.21.15.146:0/4255834528 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562c155bca40 con 0x562c154c1d90 2024-09-18T01:45:22.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.069+0000 7f91f18f8640 1 -- 172.21.15.146:0/4255834528 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f91ec00a4a0 con 0x562c154c1d90 2024-09-18T01:45:22.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.069+0000 7f91f5a10800 1 --2- 172.21.15.146:0/4255834528 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x562c155bd510 0x562c155c0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.069+0000 7f91f5a10800 1 -- 172.21.15.146:0/4255834528 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562c155c14e0 con 0x562c155bd510 2024-09-18T01:45:22.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.069+0000 7f91f10f7640 1 --2- 172.21.15.146:0/4255834528 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x562c155bd510 0x562c155c0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.069+0000 7f91f10f7640 1 --2- 172.21.15.146:0/4255834528 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x562c155bd510 0x562c155c0d50 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.069+0000 7f91f10f7640 1 -- 172.21.15.146:0/4255834528 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f91e4029030 con 0x562c155bd510 2024-09-18T01:45:22.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.070+0000 7f91f5a10800 1 Processor -- start 2024-09-18T01:45:22.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.070+0000 7f91f5a10800 1 -- start start 2024-09-18T01:45:22.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.070+0000 7f91f5a10800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562c155cf270 0x562c155cf690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.070+0000 7f91f5a10800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x562c15356580 con 0x562c155cf270 2024-09-18T01:45:22.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.070+0000 7f91f18f8640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562c155cf270 0x562c155cf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.070+0000 7f91f18f8640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562c155cf270 0x562c155cf690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59204/0 (socket says 172.21.15.146:59204) 2024-09-18T01:45:22.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.070+0000 7f91f18f8640 1 -- 172.21.15.146:0/3111596229 learned_addr learned my addr 172.21.15.146:0/3111596229 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:22.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.070+0000 7f91f18f8640 1 -- 172.21.15.146:0/3111596229 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c155cfbd0 con 0x562c155cf270 2024-09-18T01:45:22.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.071+0000 7f91f18f8640 1 --2- 172.21.15.146:0/3111596229 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562c155cf270 0x562c155cf690 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x562c155bbec0 tx=0x7f91ec0178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.071+0000 7f90d6ffd640 1 -- 172.21.15.146:0/3111596229 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91ec013440 con 0x562c155cf270 2024-09-18T01:45:22.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.071+0000 7f90d6ffd640 1 -- 172.21.15.146:0/3111596229 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91ec0135e0 con 0x562c155cf270 2024-09-18T01:45:22.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.071+0000 7f91f5a10800 1 -- 172.21.15.146:0/3111596229 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562c155cfe60 con 0x562c155cf270 2024-09-18T01:45:22.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.071+0000 7f90d6ffd640 1 -- 172.21.15.146:0/3111596229 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91ec0138c0 con 0x562c155cf270 2024-09-18T01:45:22.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.071+0000 7f91f5a10800 1 -- 172.21.15.146:0/3111596229 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c155d2b40 con 0x562c155cf270 2024-09-18T01:45:22.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.072+0000 7f90d6ffd640 1 -- 172.21.15.146:0/3111596229 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f91ec011040 con 0x562c155cf270 2024-09-18T01:45:22.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.072+0000 7f90d6ffd640 1 --2- 172.21.15.146:0/3111596229 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f90c8036b40 0x7f90c8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.072+0000 7f90d6ffd640 1 -- 172.21.15.146:0/3111596229 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f91ec01d070 con 0x562c155cf270 2024-09-18T01:45:22.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.072+0000 7f91f10f7640 1 --2- 172.21.15.146:0/3111596229 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f90c8036b40 0x7f90c8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.072+0000 7f91f5a10800 1 Processor -- start 2024-09-18T01:45:22.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.072+0000 7f91f5a10800 1 -- start start 2024-09-18T01:45:22.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.072+0000 7f91f10f7640 1 --2- 172.21.15.146:0/3111596229 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f90c8036b40 0x7f90c8039000 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f91e400dfd0 tx=0x7f91e402ae80 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.072+0000 7f91f5a10800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562c155dbf10 0x562c155dc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.072+0000 7f91f5a10800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x562c155ad240 con 0x562c155dbf10 2024-09-18T01:45:22.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.073+0000 7f91f18f8640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562c155dbf10 0x562c155dc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.073+0000 7f91f18f8640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562c155dbf10 0x562c155dc310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59220/0 (socket says 172.21.15.146:59220) 2024-09-18T01:45:22.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.073+0000 7f91f18f8640 1 -- 172.21.15.146:0/294383092 learned_addr learned my addr 172.21.15.146:0/294383092 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:22.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.073+0000 7f91f18f8640 1 -- 172.21.15.146:0/294383092 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c155dc8e0 con 0x562c155dbf10 2024-09-18T01:45:22.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.073+0000 7f91f18f8640 1 --2- 172.21.15.146:0/294383092 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562c155dbf10 0x562c155dc310 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f91ec04cb30 tx=0x7f91ec012a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89ffe8b2580ef432 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.073+0000 7f90d4ff9640 1 -- 172.21.15.146:0/294383092 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91ec045070 con 0x562c155dbf10 2024-09-18T01:45:22.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.073+0000 7f90d4ff9640 1 -- 172.21.15.146:0/294383092 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91ec015430 con 0x562c155dbf10 2024-09-18T01:45:22.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.073+0000 7f90d4ff9640 1 -- 172.21.15.146:0/294383092 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91ec02ac50 con 0x562c155dbf10 2024-09-18T01:45:22.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.074+0000 7f91f5a10800 1 -- 172.21.15.146:0/294383092 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562c155dbf10 msgr2=0x562c155dc310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.074+0000 7f91f5a10800 1 --2- 172.21.15.146:0/294383092 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562c155dbf10 0x562c155dc310 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f91ec04cb30 tx=0x7f91ec012a30 comp rx=0 tx=0).stop 2024-09-18T01:45:22.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.074+0000 7f91f5a10800 1 -- 172.21.15.146:0/294383092 shutdown_connections 2024-09-18T01:45:22.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.074+0000 7f91f5a10800 1 --2- 172.21.15.146:0/294383092 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562c155dbf10 0x562c155dc310 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.074+0000 7f91f5a10800 1 -- 172.21.15.146:0/294383092 >> 172.21.15.146:0/294383092 conn(0x562c155d82c0 msgr2=0x562c155d63c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:22.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.074+0000 7f91f5a10800 1 -- 172.21.15.146:0/294383092 shutdown_connections 2024-09-18T01:45:22.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.074+0000 7f91f5a10800 1 -- 172.21.15.146:0/294383092 wait complete. 2024-09-18T01:45:22.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.074+0000 7f91f5a10800 1 Processor -- start 2024-09-18T01:45:22.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.074+0000 7f91f5a10800 1 -- start start 2024-09-18T01:45:22.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.074+0000 7f91f5a10800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562c155dbf10 0x562c155e33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.074+0000 7f91f5a10800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x562c155dceb0 con 0x562c155dbf10 2024-09-18T01:45:22.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.074+0000 7f91f18f8640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562c155dbf10 0x562c155e33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.074+0000 7f91f18f8640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562c155dbf10 0x562c155e33a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59232/0 (socket says 172.21.15.146:59232) 2024-09-18T01:45:22.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.074+0000 7f91f18f8640 1 -- 172.21.15.146:0/1588533099 learned_addr learned my addr 172.21.15.146:0/1588533099 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:22.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.075+0000 7f91f18f8640 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c155e38e0 con 0x562c155dbf10 2024-09-18T01:45:22.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.075+0000 7f91f18f8640 1 --2- 172.21.15.146:0/1588533099 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562c155dbf10 0x562c155e33a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f91ec012b80 tx=0x7f91ec04c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.075+0000 7f90c6ffd640 1 -- 172.21.15.146:0/1588533099 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91ec045030 con 0x562c155dbf10 2024-09-18T01:45:22.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.075+0000 7f90c6ffd640 1 -- 172.21.15.146:0/1588533099 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91ec04b500 con 0x562c155dbf10 2024-09-18T01:45:22.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.075+0000 7f90c6ffd640 1 -- 172.21.15.146:0/1588533099 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91ec013af0 con 0x562c155dbf10 2024-09-18T01:45:22.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.075+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562c155e3b70 con 0x562c155dbf10 2024-09-18T01:45:22.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.075+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c155e6820 con 0x562c155dbf10 2024-09-18T01:45:22.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.076+0000 7f90c6ffd640 1 -- 172.21.15.146:0/1588533099 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f91ec013c90 con 0x562c155dbf10 2024-09-18T01:45:22.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.076+0000 7f90c6ffd640 1 --2- 172.21.15.146:0/1588533099 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f90bc036b40 0x7f90bc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.076+0000 7f90c6ffd640 1 -- 172.21.15.146:0/1588533099 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f91ec046070 con 0x562c155dbf10 2024-09-18T01:45:22.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.076+0000 7f91f10f7640 1 --2- 172.21.15.146:0/1588533099 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f90bc036b40 0x7f90bc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.077+0000 7f91f10f7640 1 --2- 172.21.15.146:0/1588533099 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f90bc036b40 0x7f90bc039000 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f91e4016fd0 tx=0x7f91e4037000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.077+0000 7f91f5a10800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.077+0000 7f91f5a10800 1 --2- 172.21.15.146:0/1588533099 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x562c155eeff0 0x562c155f14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.077+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562c155f1c00 con 0x562c155eeff0 2024-09-18T01:45:22.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.077+0000 7f91ebfff640 1 --2- 172.21.15.146:0/1588533099 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x562c155eeff0 0x562c155f14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.077+0000 7f91ebfff640 1 --2- 172.21.15.146:0/1588533099 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x562c155eeff0 0x562c155f14b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.077+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f91dc051070 con 0x562c155eeff0 2024-09-18T01:45:22.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.077+0000 7f91f5a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:22.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.077+0000 7f91f5a10800 20 realm 2024-09-18T01:45:22.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.077+0000 7f91f5a10800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.077+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562c155f2030 con 0x562c155eeff0 2024-09-18T01:45:22.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.077+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f91dc051070 con 0x562c155eeff0 2024-09-18T01:45:22.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.077+0000 7f91f5a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:22.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.077+0000 7f91f5a10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:22.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.077+0000 7f91f5a10800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.077+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562c155f2900 con 0x562c155eeff0 2024-09-18T01:45:22.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.078+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f91dc051070 con 0x562c155eeff0 2024-09-18T01:45:22.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.078+0000 7f91f5a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:22.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.078+0000 7f91f5a10800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.078+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562c155f2ca0 con 0x562c155eeff0 2024-09-18T01:45:22.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.078+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f91dc051070 con 0x562c155eeff0 2024-09-18T01:45:22.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.078+0000 7f91f5a10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:22.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.078+0000 7f91f5a10800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.078+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562c155f34f0 con 0x562c155eeff0 2024-09-18T01:45:22.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.078+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f91dc051070 con 0x562c155eeff0 2024-09-18T01:45:22.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.078+0000 7f91f5a10800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:22.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.078+0000 7f91f5a10800 20 searching for the correct realm 2024-09-18T01:45:22.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.078+0000 7f91f5a10800 1 --2- 172.21.15.146:0/1588533099 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x562c155f5260 0x562c155f7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.078+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c155f7c80 con 0x562c155f5260 2024-09-18T01:45:22.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.078+0000 7f91f18f8640 1 --2- 172.21.15.146:0/1588533099 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x562c155f5260 0x562c155f7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.079+0000 7f91f18f8640 1 --2- 172.21.15.146:0/1588533099 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x562c155f5260 0x562c155f7650 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.079+0000 7f91f18f8640 1 -- 172.21.15.146:0/1588533099 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91ec03c020 con 0x562c155f5260 2024-09-18T01:45:22.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.079+0000 7f91f18f8640 1 --2- 172.21.15.146:0/1588533099 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f91ec0080c0 0x7f91ec0123a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.079+0000 7f91f18f8640 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c155f7c80 con 0x7f91ec0080c0 2024-09-18T01:45:22.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.079+0000 7f91f10f7640 1 --2- 172.21.15.146:0/1588533099 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f91ec0080c0 0x7f91ec0123a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.079+0000 7f91f10f7640 1 --2- 172.21.15.146:0/1588533099 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f91ec0080c0 0x7f91ec0123a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.080+0000 7f91f10f7640 1 -- 172.21.15.146:0/1588533099 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91e4029030 con 0x7f91ec0080c0 2024-09-18T01:45:22.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.080+0000 7f91f10f7640 1 --2- 172.21.15.146:0/1588533099 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f91e402c060 0x7f91e400c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.080+0000 7f91f10f7640 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c155f7c80 con 0x7f91e402c060 2024-09-18T01:45:22.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.080+0000 7f91ebfff640 1 --2- 172.21.15.146:0/1588533099 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f91e402c060 0x7f91e400c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.080+0000 7f91ebfff640 1 --2- 172.21.15.146:0/1588533099 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f91e402c060 0x7f91e400c590 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.080+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91dc051070 con 0x7f91e402c060 2024-09-18T01:45:22.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.080+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c155f7c80 con 0x562c155eeff0 2024-09-18T01:45:22.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.081+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v24'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f91dc051070 con 0x562c155eeff0 2024-09-18T01:45:22.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.081+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c155f7c80 con 0x562c155eeff0 2024-09-18T01:45:22.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.081+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91dc051070 con 0x562c155eeff0 2024-09-18T01:45:22.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.081+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c155f7c80 con 0x7f91e402c060 2024-09-18T01:45:22.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.081+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91dc051070 con 0x7f91e402c060 2024-09-18T01:45:22.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.081+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c155f7c80 con 0x7f91e402c060 2024-09-18T01:45:22.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.081+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91dc051070 con 0x7f91e402c060 2024-09-18T01:45:22.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.081+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c155f7c80 con 0x7f91ec0080c0 2024-09-18T01:45:22.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.082+0000 7f91f10f7640 1 -- 172.21.15.146:0/1588533099 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91e4029030 con 0x7f91ec0080c0 2024-09-18T01:45:22.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.082+0000 7f91f10f7640 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c155f7c80 con 0x562c155f5260 2024-09-18T01:45:22.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.082+0000 7f91f18f8640 1 -- 172.21.15.146:0/1588533099 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91ec03c020 con 0x562c155f5260 2024-09-18T01:45:22.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.082+0000 7f91f18f8640 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c155f7c80 con 0x562c155eeff0 2024-09-18T01:45:22.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.082+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91dc051070 con 0x562c155eeff0 2024-09-18T01:45:22.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.082+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c155f7c80 con 0x7f91e402c060 2024-09-18T01:45:22.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.082+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91dc051070 con 0x7f91e402c060 2024-09-18T01:45:22.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.082+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c155f7c80 con 0x562c155eeff0 2024-09-18T01:45:22.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.082+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91dc051070 con 0x562c155eeff0 2024-09-18T01:45:22.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.082+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c155f7c80 con 0x7f91ec0080c0 2024-09-18T01:45:22.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.083+0000 7f91f10f7640 1 -- 172.21.15.146:0/1588533099 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f91e4029030 con 0x7f91ec0080c0 2024-09-18T01:45:22.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.083+0000 7f91f10f7640 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c155f7c80 con 0x562c155f5260 2024-09-18T01:45:22.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.083+0000 7f91f18f8640 1 -- 172.21.15.146:0/1588533099 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91ec03c020 con 0x562c155f5260 2024-09-18T01:45:22.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.083+0000 7f91f18f8640 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c155f7c80 con 0x562c155f5260 2024-09-18T01:45:22.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.083+0000 7f91f18f8640 1 -- 172.21.15.146:0/1588533099 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91ec03c020 con 0x562c155f5260 2024-09-18T01:45:22.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.083+0000 7f91f18f8640 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c155f7c80 con 0x7f91e402c060 2024-09-18T01:45:22.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.084+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91dc051070 con 0x7f91e402c060 2024-09-18T01:45:22.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.084+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c155f7c80 con 0x562c155f5260 2024-09-18T01:45:22.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.084+0000 7f91f18f8640 1 -- 172.21.15.146:0/1588533099 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91ec03c020 con 0x562c155f5260 2024-09-18T01:45:22.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.084+0000 7f91f18f8640 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c155f7c80 con 0x562c155f5260 2024-09-18T01:45:22.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.084+0000 7f91f18f8640 1 -- 172.21.15.146:0/1588533099 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91ec03c020 con 0x562c155f5260 2024-09-18T01:45:22.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.084+0000 7f91f18f8640 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c155f7c80 con 0x562c155eeff0 2024-09-18T01:45:22.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.084+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91dc051070 con 0x562c155eeff0 2024-09-18T01:45:22.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.084+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c155f7c80 con 0x562c155eeff0 2024-09-18T01:45:22.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.084+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f91dc051070 con 0x562c155eeff0 2024-09-18T01:45:22.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.084+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c155f7c80 con 0x7f91e402c060 2024-09-18T01:45:22.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.085+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91dc051070 con 0x7f91e402c060 2024-09-18T01:45:22.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.085+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c155f7c80 con 0x562c155f5260 2024-09-18T01:45:22.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.085+0000 7f91f18f8640 1 -- 172.21.15.146:0/1588533099 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91ec03c020 con 0x562c155f5260 2024-09-18T01:45:22.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.085+0000 7f91f18f8640 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c155f7c80 con 0x7f91ec0080c0 2024-09-18T01:45:22.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.085+0000 7f91f10f7640 1 -- 172.21.15.146:0/1588533099 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91e4029030 con 0x7f91ec0080c0 2024-09-18T01:45:22.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.085+0000 7f91f10f7640 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c155f7c80 con 0x562c155eeff0 2024-09-18T01:45:22.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.085+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91dc051070 con 0x562c155eeff0 2024-09-18T01:45:22.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.085+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c155f7c80 con 0x7f91e402c060 2024-09-18T01:45:22.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.086+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91dc051070 con 0x7f91e402c060 2024-09-18T01:45:22.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.086+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c155f7c80 con 0x562c155f5260 2024-09-18T01:45:22.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.086+0000 7f91f18f8640 1 -- 172.21.15.146:0/1588533099 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91ec03c020 con 0x562c155f5260 2024-09-18T01:45:22.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.086+0000 7f91f18f8640 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c155f7c80 con 0x7f91e402c060 2024-09-18T01:45:22.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.086+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91dc051070 con 0x7f91e402c060 2024-09-18T01:45:22.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.086+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c155f7c80 con 0x7f91ec0080c0 2024-09-18T01:45:22.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.087+0000 7f91f10f7640 1 -- 172.21.15.146:0/1588533099 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91e4029030 con 0x7f91ec0080c0 2024-09-18T01:45:22.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.087+0000 7f91f10f7640 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c155f7c80 con 0x562c155f5260 2024-09-18T01:45:22.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.087+0000 7f91f18f8640 1 -- 172.21.15.146:0/1588533099 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91ec03c020 con 0x562c155f5260 2024-09-18T01:45:22.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.087+0000 7f91f18f8640 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c155f7c80 con 0x7f91e402c060 2024-09-18T01:45:22.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.087+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91dc051070 con 0x7f91e402c060 2024-09-18T01:45:22.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.087+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c155f7c80 con 0x562c155eeff0 2024-09-18T01:45:22.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.087+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f91dc051070 con 0x562c155eeff0 2024-09-18T01:45:22.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.087+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562c155f7c80 con 0x7f91ec0080c0 2024-09-18T01:45:22.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.088+0000 7f91f10f7640 1 -- 172.21.15.146:0/1588533099 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91e4062040 con 0x7f91ec0080c0 2024-09-18T01:45:22.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.088+0000 7f91f5a10800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:22.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.088+0000 7f91f5a10800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:22.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.088+0000 7f91f5a10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:22.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.088+0000 7f91f5a10800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:22.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.088+0000 7f91f5a10800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:22.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.088+0000 7f91f5a10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:22.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.088+0000 7f91f5a10800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.088+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562c155f3ea0 con 0x562c155eeff0 2024-09-18T01:45:22.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.088+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f91dc051070 con 0x562c155eeff0 2024-09-18T01:45:22.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.088+0000 7f91f5a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:22.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.088+0000 7f91f5a10800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.088+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562c155f4740 con 0x562c155eeff0 2024-09-18T01:45:22.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.088+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f91dc051070 con 0x562c155eeff0 2024-09-18T01:45:22.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.088+0000 7f91f5a10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:22.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.088+0000 7f91f5a10800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.088+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562c155f8100 con 0x7f91ec0080c0 2024-09-18T01:45:22.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.088+0000 7f91f10f7640 1 -- 172.21.15.146:0/1588533099 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f91e4062040 con 0x7f91ec0080c0 2024-09-18T01:45:22.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.088+0000 7f91f5a10800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:22.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.088+0000 7f91f5a10800 20 zone default found 2024-09-18T01:45:22.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.088+0000 7f91f5a10800 4 Realm: () 2024-09-18T01:45:22.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.088+0000 7f91f5a10800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:22.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.088+0000 7f91f5a10800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:22.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.088+0000 7f91f5a10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:22.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.088+0000 7f91f5a10800 20 zonegroup default 2024-09-18T01:45:22.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.088+0000 7f91f5a10800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.088+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562c155f8950 con 0x7f91e402c060 2024-09-18T01:45:22.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.089+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f91dc051070 con 0x7f91e402c060 2024-09-18T01:45:22.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.089+0000 7f91f5a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:22.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.089+0000 7f91f5a10800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.089+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562c155fa330 con 0x562c155f5260 2024-09-18T01:45:22.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.089+0000 7f91f18f8640 1 -- 172.21.15.146:0/1588533099 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f91ec03c020 con 0x562c155f5260 2024-09-18T01:45:22.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.089+0000 7f91f5a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:22.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.089+0000 7f91f5a10800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.089+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562c155fa7f0 con 0x562c155f5260 2024-09-18T01:45:22.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.089+0000 7f91f18f8640 1 -- 172.21.15.146:0/1588533099 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f91ec03c020 con 0x562c155f5260 2024-09-18T01:45:22.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.089+0000 7f91f5a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:22.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.089+0000 7f91f5a10800 20 started sync module instance, tier type = 2024-09-18T01:45:22.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.089+0000 7f91f5a10800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:22.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.089+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c155f97c0 con 0x7f91ec0080c0 2024-09-18T01:45:22.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.090+0000 7f91f10f7640 1 -- 172.21.15.146:0/1588533099 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v31'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91e4062040 con 0x7f91ec0080c0 2024-09-18T01:45:22.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.090+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94747337137072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c155fb100 con 0x7f91ec0080c0 2024-09-18T01:45:22.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.090+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c155fb950 con 0x562c155eeff0 2024-09-18T01:45:22.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.091+0000 7f91f10f7640 1 -- 172.21.15.146:0/1588533099 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94747337137072] v31'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91e4062040 con 0x7f91ec0080c0 2024-09-18T01:45:22.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.092+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v31'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91dc051070 con 0x562c155eeff0 2024-09-18T01:45:22.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.092+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94747337141328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c155fb990 con 0x562c155eeff0 2024-09-18T01:45:22.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.092+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c155fc480 con 0x562c155f5260 2024-09-18T01:45:22.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.093+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94747337141328] v31'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91dc051070 con 0x562c155eeff0 2024-09-18T01:45:22.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.093+0000 7f91f18f8640 1 -- 172.21.15.146:0/1588533099 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v31'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91ec03c020 con 0x562c155f5260 2024-09-18T01:45:22.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.093+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94747337146192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c155fc870 con 0x562c155f5260 2024-09-18T01:45:22.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.093+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c155fd2b0 con 0x7f91ec0080c0 2024-09-18T01:45:22.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.094+0000 7f91f18f8640 1 -- 172.21.15.146:0/1588533099 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94747337146192] v31'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91ec03c020 con 0x562c155f5260 2024-09-18T01:45:22.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.094+0000 7f91f10f7640 1 -- 172.21.15.146:0/1588533099 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v31'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91e4062040 con 0x7f91ec0080c0 2024-09-18T01:45:22.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.094+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94747337149824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c155fd6a0 con 0x7f91ec0080c0 2024-09-18T01:45:22.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.094+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c155fe0c0 con 0x562c155eeff0 2024-09-18T01:45:22.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.095+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v31'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91dc051070 con 0x562c155eeff0 2024-09-18T01:45:22.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.095+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94747337153456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c155fe080 con 0x562c155eeff0 2024-09-18T01:45:22.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.095+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c155ff090 con 0x7f91e402c060 2024-09-18T01:45:22.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.098+0000 7f91f10f7640 1 -- 172.21.15.146:0/1588533099 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94747337149824] v31'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91e4062040 con 0x7f91ec0080c0 2024-09-18T01:45:22.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.098+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v31'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91dc051070 con 0x7f91e402c060 2024-09-18T01:45:22.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.098+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94747337143456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c155ff090 con 0x7f91e402c060 2024-09-18T01:45:22.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.098+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c155ffaa0 con 0x7f91e402c060 2024-09-18T01:45:22.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.101+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94747337153456] v31'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91dc051070 con 0x562c155eeff0 2024-09-18T01:45:22.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.101+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94747337143456] v31'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91dc051070 con 0x7f91e402c060 2024-09-18T01:45:22.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.103+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v31'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91dc051070 con 0x7f91e402c060 2024-09-18T01:45:22.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.103+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94747337157456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c155ff5f0 con 0x7f91e402c060 2024-09-18T01:45:22.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.103+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c155fffb0 con 0x7f91e402c060 2024-09-18T01:45:22.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.106+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(58 notify.7 [create] v31'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91dc051070 con 0x7f91e402c060 2024-09-18T01:45:22.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.106+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94747337157456] v31'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91dc051070 con 0x7f91e402c060 2024-09-18T01:45:22.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.106+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94747337161472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c155fff20 con 0x7f91e402c060 2024-09-18T01:45:22.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.106+0000 7f91f5a10800 20 add_watcher() i=0 2024-09-18T01:45:22.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.106+0000 7f91f5a10800 20 add_watcher() i=1 2024-09-18T01:45:22.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.106+0000 7f91f5a10800 20 add_watcher() i=2 2024-09-18T01:45:22.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.106+0000 7f91f5a10800 20 add_watcher() i=3 2024-09-18T01:45:22.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.106+0000 7f91f5a10800 20 add_watcher() i=4 2024-09-18T01:45:22.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.106+0000 7f91f5a10800 20 add_watcher() i=5 2024-09-18T01:45:22.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.106+0000 7f91f5a10800 20 add_watcher() i=6 2024-09-18T01:45:22.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.108+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94747337161472] v31'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91dc051070 con 0x7f91e402c060 2024-09-18T01:45:22.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.109+0000 7f91f5a10800 20 add_watcher() i=7 2024-09-18T01:45:22.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.109+0000 7f91f5a10800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:22.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.109+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562c15603380 con 0x562c155eeff0 2024-09-18T01:45:22.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.109+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f91dc051070 con 0x562c155eeff0 2024-09-18T01:45:22.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.109+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94747337155632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c15600840 con 0x562c155eeff0 2024-09-18T01:45:22.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.110+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94747337155632] v31'37 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f91dc051070 con 0x562c155eeff0 2024-09-18T01:45:22.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.110+0000 7f90a77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:22.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.110+0000 7f91f5a10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:22.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.110+0000 7f91f5a10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:22.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.110+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c15603170 con 0x562c155eeff0 2024-09-18T01:45:22.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.118+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'41 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f91dc051070 con 0x562c155eeff0 2024-09-18T01:45:22.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.118+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c1560c4d0 con 0x7f91e402c060 2024-09-18T01:45:22.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.119+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f91dc051070 con 0x7f91e402c060 2024-09-18T01:45:22.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.119+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c1560ca40 con 0x562c155f5260 2024-09-18T01:45:22.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.120+0000 7f91f18f8640 1 -- 172.21.15.146:0/1588533099 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f91ec03c020 con 0x562c155f5260 2024-09-18T01:45:22.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.120+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c1560cad0 con 0x562c155eeff0 2024-09-18T01:45:22.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.121+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'38 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f91dc051070 con 0x562c155eeff0 2024-09-18T01:45:22.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.121+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c1560cf80 con 0x7f91ec0080c0 2024-09-18T01:45:22.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.122+0000 7f91f10f7640 1 -- 172.21.15.146:0/1588533099 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'29 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f91e4062040 con 0x7f91ec0080c0 2024-09-18T01:45:22.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.122+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c1560ba40 con 0x562c155f5260 2024-09-18T01:45:22.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.123+0000 7f91f18f8640 1 -- 172.21.15.146:0/1588533099 <== osd.3 v2:172.21.15.146:6809/4106661138 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'29 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f91ec03c020 con 0x562c155f5260 2024-09-18T01:45:22.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.123+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c1560ba40 con 0x562c155eeff0 2024-09-18T01:45:22.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.124+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f91dc051070 con 0x562c155eeff0 2024-09-18T01:45:22.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.124+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c1560ba40 con 0x7f91e402c060 2024-09-18T01:45:22.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.125+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'21 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f91dc051070 con 0x7f91e402c060 2024-09-18T01:45:22.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.125+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c1560ba40 con 0x7f91ec0080c0 2024-09-18T01:45:22.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.126+0000 7f91f10f7640 1 -- 172.21.15.146:0/1588533099 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f91e4062040 con 0x7f91ec0080c0 2024-09-18T01:45:22.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.126+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c1560ba40 con 0x562c155f5260 2024-09-18T01:45:22.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.128+0000 7f91f18f8640 1 -- 172.21.15.146:0/1588533099 <== osd.3 v2:172.21.15.146:6809/4106661138 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f91ec03c020 con 0x562c155f5260 2024-09-18T01:45:22.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.128+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c1560bb20 con 0x7f91ec0080c0 2024-09-18T01:45:22.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.130+0000 7f91f10f7640 1 -- 172.21.15.146:0/1588533099 <== osd.2 v2:172.21.15.146:6800/3820039304 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'30 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f91e4062040 con 0x7f91ec0080c0 2024-09-18T01:45:22.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.130+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c1560bc10 con 0x7f91e402c060 2024-09-18T01:45:22.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.131+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'13 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f91dc051070 con 0x7f91e402c060 2024-09-18T01:45:22.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.131+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c1560dae0 con 0x7f91ec0080c0 2024-09-18T01:45:22.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.132+0000 7f91f10f7640 1 -- 172.21.15.146:0/1588533099 <== osd.2 v2:172.21.15.146:6800/3820039304 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f91e4062040 con 0x7f91ec0080c0 2024-09-18T01:45:22.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.132+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c1560dae0 con 0x7f91e402c060 2024-09-18T01:45:22.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.133+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'33 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f91dc051070 con 0x7f91e402c060 2024-09-18T01:45:22.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.133+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c1560dae0 con 0x562c155eeff0 2024-09-18T01:45:22.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.134+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'39 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f91dc051070 con 0x562c155eeff0 2024-09-18T01:45:22.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.134+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c1560dae0 con 0x562c155f5260 2024-09-18T01:45:22.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.136+0000 7f91f18f8640 1 -- 172.21.15.146:0/1588533099 <== osd.3 v2:172.21.15.146:6809/4106661138 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'23 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f91ec03c020 con 0x562c155f5260 2024-09-18T01:45:22.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.136+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c1560db70 con 0x7f91ec0080c0 2024-09-18T01:45:22.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.136+0000 7f91f10f7640 1 -- 172.21.15.146:0/1588533099 <== osd.2 v2:172.21.15.146:6800/3820039304 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'31 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f91e4062040 con 0x7f91ec0080c0 2024-09-18T01:45:22.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.137+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c1560db70 con 0x562c155f5260 2024-09-18T01:45:22.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.138+0000 7f91f18f8640 1 -- 172.21.15.146:0/1588533099 <== osd.3 v2:172.21.15.146:6809/4106661138 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'23 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f91ec03c020 con 0x562c155f5260 2024-09-18T01:45:22.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.138+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c1560db70 con 0x562c155eeff0 2024-09-18T01:45:22.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.139+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f91dc051070 con 0x562c155eeff0 2024-09-18T01:45:22.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.139+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c1560db70 con 0x562c155eeff0 2024-09-18T01:45:22.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.140+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'40 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f91dc051070 con 0x562c155eeff0 2024-09-18T01:45:22.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.140+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c1560db70 con 0x562c155f5260 2024-09-18T01:45:22.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.141+0000 7f91f18f8640 1 -- 172.21.15.146:0/1588533099 <== osd.3 v2:172.21.15.146:6809/4106661138 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'24 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f91ec03c020 con 0x562c155f5260 2024-09-18T01:45:22.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.141+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c1560dae0 con 0x7f91ec0080c0 2024-09-18T01:45:22.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.142+0000 7f91f10f7640 1 -- 172.21.15.146:0/1588533099 <== osd.2 v2:172.21.15.146:6800/3820039304 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'27 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f91e4062040 con 0x7f91ec0080c0 2024-09-18T01:45:22.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.142+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c1560dae0 con 0x562c155f5260 2024-09-18T01:45:22.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.144+0000 7f91f18f8640 1 -- 172.21.15.146:0/1588533099 <== osd.3 v2:172.21.15.146:6809/4106661138 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'19 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f91ec03c020 con 0x562c155f5260 2024-09-18T01:45:22.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.144+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c1560dae0 con 0x562c155f5260 2024-09-18T01:45:22.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.145+0000 7f91f18f8640 1 -- 172.21.15.146:0/1588533099 <== osd.3 v2:172.21.15.146:6809/4106661138 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'29 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f91ec03c020 con 0x562c155f5260 2024-09-18T01:45:22.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.145+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c1560dae0 con 0x562c155f5260 2024-09-18T01:45:22.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.146+0000 7f91f18f8640 1 -- 172.21.15.146:0/1588533099 <== osd.3 v2:172.21.15.146:6809/4106661138 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f91ec03c020 con 0x562c155f5260 2024-09-18T01:45:22.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.146+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c1560dae0 con 0x562c155f5260 2024-09-18T01:45:22.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.147+0000 7f91f18f8640 1 -- 172.21.15.146:0/1588533099 <== osd.3 v2:172.21.15.146:6809/4106661138 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'30 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f91ec03c020 con 0x562c155f5260 2024-09-18T01:45:22.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.147+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c1560dae0 con 0x7f91e402c060 2024-09-18T01:45:22.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.149+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'19 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f91dc051070 con 0x7f91e402c060 2024-09-18T01:45:22.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.149+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c1560dae0 con 0x562c155f5260 2024-09-18T01:45:22.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.150+0000 7f91f18f8640 1 -- 172.21.15.146:0/1588533099 <== osd.3 v2:172.21.15.146:6809/4106661138 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f91ec03c020 con 0x562c155f5260 2024-09-18T01:45:22.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.150+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c1560dae0 con 0x7f91e402c060 2024-09-18T01:45:22.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.152+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.0 v2:172.21.15.129:6800/1759265424 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'22 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f91dc051070 con 0x7f91e402c060 2024-09-18T01:45:22.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.152+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c1560dae0 con 0x562c155f5260 2024-09-18T01:45:22.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.153+0000 7f91f18f8640 1 -- 172.21.15.146:0/1588533099 <== osd.3 v2:172.21.15.146:6809/4106661138 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f91ec03c020 con 0x562c155f5260 2024-09-18T01:45:22.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.153+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c1560dae0 con 0x7f91e402c060 2024-09-18T01:45:22.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.154+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.0 v2:172.21.15.129:6800/1759265424 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'34 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f91dc051070 con 0x7f91e402c060 2024-09-18T01:45:22.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.154+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c1560dae0 con 0x7f91ec0080c0 2024-09-18T01:45:22.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.155+0000 7f91f10f7640 1 -- 172.21.15.146:0/1588533099 <== osd.2 v2:172.21.15.146:6800/3820039304 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f91e4062040 con 0x7f91ec0080c0 2024-09-18T01:45:22.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.155+0000 7f90a67e4640 20 reqs_thread_entry: start 2024-09-18T01:45:22.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.156+0000 7f91f5a10800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:22.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.156+0000 7f91f5a10800 20 Filter name: none 2024-09-18T01:45:22.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.156+0000 7f9017fff640 20 reqs_thread_entry: start 2024-09-18T01:45:22.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.156+0000 7f91f5a10800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-18T01:45:22.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.156+0000 7f91f5a10800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.156+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:94 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562c15638960 con 0x7f91e402c060 2024-09-18T01:45:22.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.156+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.0 v2:172.21.15.129:6800/1759265424 24 ==== osd_op_reply(94 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f91dc051070 con 0x7f91e402c060 2024-09-18T01:45:22.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.156+0000 7f91f5a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:22.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.156+0000 7f91f5a10800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-18T01:45:22.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.156+0000 7f91f5a10800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-18T01:45:22.158 INFO:teuthology.orchestra.run.smithi146.stderr:could not remove user: unable to remove user, user does not exist 2024-09-18T01:45:22.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.157+0000 7f90a77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:22.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.157+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94747337155632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c1560a9c0 con 0x562c155eeff0 2024-09-18T01:45:22.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.158+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.1 v2:172.21.15.146:6808/3930274777 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94747337155632] v31'41 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f91dc051070 con 0x562c155eeff0 2024-09-18T01:45:22.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.158+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94747337137072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c155fe430 con 0x7f91ec0080c0 2024-09-18T01:45:22.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.159+0000 7f91f10f7640 1 -- 172.21.15.146:0/1588533099 <== osd.2 v2:172.21.15.146:6800/3820039304 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94747337137072] v31'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91e4062040 con 0x7f91ec0080c0 2024-09-18T01:45:22.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.159+0000 7f91f5a10800 20 remove_watcher() i=0 2024-09-18T01:45:22.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.159+0000 7f91f5a10800 2 removed watcher, disabling cache 2024-09-18T01:45:22.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.159+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94747337141328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c155fe430 con 0x562c155eeff0 2024-09-18T01:45:22.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.160+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.1 v2:172.21.15.146:6808/3930274777 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94747337141328] v31'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91dc051070 con 0x562c155eeff0 2024-09-18T01:45:22.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.160+0000 7f91f5a10800 20 remove_watcher() i=1 2024-09-18T01:45:22.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.160+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94747337146192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c155fac50 con 0x562c155f5260 2024-09-18T01:45:22.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.161+0000 7f91f18f8640 1 -- 172.21.15.146:0/1588533099 <== osd.3 v2:172.21.15.146:6809/4106661138 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94747337146192] v31'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91ec03c020 con 0x562c155f5260 2024-09-18T01:45:22.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.161+0000 7f91f5a10800 20 remove_watcher() i=2 2024-09-18T01:45:22.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.161+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94747337149824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c155fe430 con 0x7f91ec0080c0 2024-09-18T01:45:22.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.162+0000 7f91f10f7640 1 -- 172.21.15.146:0/1588533099 <== osd.2 v2:172.21.15.146:6800/3820039304 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94747337149824] v31'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91e4062040 con 0x7f91ec0080c0 2024-09-18T01:45:22.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.162+0000 7f91f5a10800 20 remove_watcher() i=3 2024-09-18T01:45:22.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.162+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94747337153456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c155fbf50 con 0x562c155eeff0 2024-09-18T01:45:22.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.163+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.1 v2:172.21.15.146:6808/3930274777 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94747337153456] v31'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91dc051070 con 0x562c155eeff0 2024-09-18T01:45:22.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.163+0000 7f91f5a10800 20 remove_watcher() i=4 2024-09-18T01:45:22.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.163+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94747337143456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c155fac50 con 0x7f91e402c060 2024-09-18T01:45:22.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.164+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.0 v2:172.21.15.129:6800/1759265424 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94747337143456] v31'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91dc051070 con 0x7f91e402c060 2024-09-18T01:45:22.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.164+0000 7f91f5a10800 20 remove_watcher() i=5 2024-09-18T01:45:22.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.164+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94747337157456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c155fe430 con 0x7f91e402c060 2024-09-18T01:45:22.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.165+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.0 v2:172.21.15.129:6800/1759265424 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94747337157456] v31'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91dc051070 con 0x7f91e402c060 2024-09-18T01:45:22.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.165+0000 7f91f5a10800 20 remove_watcher() i=6 2024-09-18T01:45:22.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.165+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94747337161472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562c155fbf50 con 0x7f91e402c060 2024-09-18T01:45:22.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.166+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 <== osd.0 v2:172.21.15.129:6800/1759265424 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94747337161472] v31'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91dc051070 con 0x7f91e402c060 2024-09-18T01:45:22.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.166+0000 7f91f5a10800 20 remove_watcher() i=7 2024-09-18T01:45:22.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.166+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f91e402c060 msgr2=0x7f91e400c590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.166+0000 7f91f5a10800 1 --2- 172.21.15.146:0/1588533099 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f91e402c060 0x7f91e400c590 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.166+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x562c155eeff0 msgr2=0x562c155f14b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.166+0000 7f91f5a10800 1 --2- 172.21.15.146:0/1588533099 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x562c155eeff0 0x562c155f14b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.166+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f91ec0080c0 msgr2=0x7f91ec0123a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.166+0000 7f91f5a10800 1 --2- 172.21.15.146:0/1588533099 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f91ec0080c0 0x7f91ec0123a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.166+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x562c155f5260 msgr2=0x562c155f7650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.166+0000 7f91f5a10800 1 --2- 172.21.15.146:0/1588533099 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x562c155f5260 0x562c155f7650 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.166+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f90bc036b40 msgr2=0x7f90bc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.166+0000 7f91f5a10800 1 --2- 172.21.15.146:0/1588533099 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f90bc036b40 0x7f90bc039000 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f91e4016fd0 tx=0x7f91e4037000 comp rx=0 tx=0).stop 2024-09-18T01:45:22.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.166+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562c155dbf10 msgr2=0x562c155e33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.166+0000 7f91f5a10800 1 --2- 172.21.15.146:0/1588533099 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562c155dbf10 0x562c155e33a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f91ec012b80 tx=0x7f91ec04c840 comp rx=0 tx=0).stop 2024-09-18T01:45:22.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.166+0000 7f91ebfff640 1 -- 172.21.15.146:0/1588533099 reap_dead start 2024-09-18T01:45:22.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.167+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 shutdown_connections 2024-09-18T01:45:22.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.167+0000 7f91f5a10800 1 --2- 172.21.15.146:0/1588533099 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562c155dbf10 0x562c155e33a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.167+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 >> 172.21.15.146:0/1588533099 conn(0x562c155d82c0 msgr2=0x562c155dd620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:22.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.167+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 shutdown_connections 2024-09-18T01:45:22.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.167+0000 7f91f5a10800 1 -- 172.21.15.146:0/1588533099 wait complete. 2024-09-18T01:45:22.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.167+0000 7f91f5a10800 1 -- 172.21.15.146:0/3111596229 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f90c8036b40 msgr2=0x7f90c8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.167+0000 7f91f5a10800 1 --2- 172.21.15.146:0/3111596229 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f90c8036b40 0x7f90c8039000 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f91e400dfd0 tx=0x7f91e402ae80 comp rx=0 tx=0).stop 2024-09-18T01:45:22.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.167+0000 7f91f5a10800 1 -- 172.21.15.146:0/3111596229 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562c155cf270 msgr2=0x562c155cf690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.167+0000 7f91f5a10800 1 --2- 172.21.15.146:0/3111596229 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562c155cf270 0x562c155cf690 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x562c155bbec0 tx=0x7f91ec0178e0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.167+0000 7f91f5a10800 1 -- 172.21.15.146:0/3111596229 shutdown_connections 2024-09-18T01:45:22.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.167+0000 7f91f5a10800 1 --2- 172.21.15.146:0/3111596229 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f90c8036b40 0x7f90c8039000 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.167+0000 7f91f5a10800 1 --2- 172.21.15.146:0/3111596229 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562c155cf270 0x562c155cf690 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.167+0000 7f91f5a10800 1 -- 172.21.15.146:0/3111596229 >> 172.21.15.146:0/3111596229 conn(0x562c155c4200 msgr2=0x562c155c6d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:22.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.167+0000 7f91f5a10800 1 -- 172.21.15.146:0/3111596229 shutdown_connections 2024-09-18T01:45:22.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.167+0000 7f91f5a10800 1 -- 172.21.15.146:0/3111596229 wait complete. 2024-09-18T01:45:22.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.167+0000 7f91f5a10800 1 -- 172.21.15.146:0/4255834528 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x562c154c1d90 msgr2=0x562c155bb530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.167+0000 7f91f5a10800 1 --2- 172.21.15.146:0/4255834528 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x562c154c1d90 0x562c155bb530 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.167+0000 7f91f5a10800 1 -- 172.21.15.146:0/4255834528 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x562c155bd510 msgr2=0x562c155c0d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.167+0000 7f91f5a10800 1 --2- 172.21.15.146:0/4255834528 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x562c155bd510 0x562c155c0d50 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.167+0000 7f91f5a10800 1 -- 172.21.15.146:0/4255834528 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f90d8036b40 msgr2=0x7f90d8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.167+0000 7f91f5a10800 1 --2- 172.21.15.146:0/4255834528 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f90d8036b40 0x7f90d8039000 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f91dc057000 tx=0x7f91dc052000 comp rx=0 tx=0).stop 2024-09-18T01:45:22.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.167+0000 7f91f5a10800 1 -- 172.21.15.146:0/4255834528 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562c1542f610 msgr2=0x562c155b44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.167+0000 7f91f5a10800 1 --2- 172.21.15.146:0/4255834528 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562c1542f610 0x562c155b44c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f91e4004000 tx=0x7f91e4000bc0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.167+0000 7f91f5a10800 1 -- 172.21.15.146:0/4255834528 shutdown_connections 2024-09-18T01:45:22.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.167+0000 7f91f5a10800 1 --2- 172.21.15.146:0/4255834528 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x562c155bd510 0x562c155c0d50 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.167+0000 7f91f5a10800 1 --2- 172.21.15.146:0/4255834528 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x562c154c1d90 0x562c155bb530 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.167+0000 7f91f5a10800 1 --2- 172.21.15.146:0/4255834528 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f90d8036b40 0x7f90d8039000 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.167+0000 7f91f5a10800 1 --2- 172.21.15.146:0/4255834528 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562c1542f610 0x562c155b44c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.168+0000 7f91f5a10800 1 -- 172.21.15.146:0/4255834528 >> 172.21.15.146:0/4255834528 conn(0x562c154b5de0 msgr2=0x562c155a6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:22.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.168+0000 7f91f5a10800 1 -- 172.21.15.146:0/4255834528 shutdown_connections 2024-09-18T01:45:22.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.168+0000 7f91f5a10800 1 -- 172.21.15.146:0/4255834528 wait complete. 2024-09-18T01:45:22.177 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-18T01:45:22.178 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-18T01:45:22.178 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-18T01:45:22.178 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-18T01:45:22.223 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:22.223 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:22.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.223+0000 7ff6d52b5800 1 Processor -- start 2024-09-18T01:45:22.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.223+0000 7ff6d52b5800 1 -- start start 2024-09-18T01:45:22.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.223+0000 7ff6d52b5800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x564ec718f760 0x564ec718fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.223+0000 7ff6d52b5800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564ec704eb30 con 0x564ec71900a0 2024-09-18T01:45:22.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.223+0000 7ff6d52b5800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x564ec7030360 con 0x564ec718f760 2024-09-18T01:45:22.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.223+0000 7ff6d2da9640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x564ec718f760 0x564ec718fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.223+0000 7ff6d25a8640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x564ec71900a0 0x564ec7194ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:38650/0 (socket says 172.21.15.146:38650) 2024-09-18T01:45:22.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.223+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3704912144 learned_addr learned my addr 172.21.15.146:0/3704912144 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:45:22.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.224+0000 7ff6d2da9640 1 -- 172.21.15.146:0/3704912144 >> v1:172.21.15.129:6789/0 conn(0x564ec71900a0 legacy=0x564ec7194ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.224+0000 7ff6d2da9640 1 -- 172.21.15.146:0/3704912144 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ec7056e00 con 0x564ec718f760 2024-09-18T01:45:22.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.224+0000 7ff6d1da7640 1 -- 172.21.15.146:0/3704912144 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2971111456 0 0) 0x564ec704eb30 con 0x564ec71900a0 2024-09-18T01:45:22.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.225+0000 7ff6d2da9640 1 --2- 172.21.15.146:0/3704912144 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ec718f760 0x564ec718fb60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4005fd0 tx=0x7ff6c4045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=145c10e2ff416127 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.226+0000 7ff6d1da7640 1 -- 172.21.15.146:0/3704912144 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6c4058530 con 0x564ec718f760 2024-09-18T01:45:22.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.226+0000 7ff6d1da7640 1 -- 172.21.15.146:0/3704912144 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6c40586d0 con 0x564ec718f760 2024-09-18T01:45:22.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.226+0000 7ff6d1da7640 1 -- 172.21.15.146:0/3704912144 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6c40589d0 con 0x564ec718f760 2024-09-18T01:45:22.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.226+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3704912144 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ec718f760 msgr2=0x564ec718fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.226+0000 7ff6d52b5800 1 --2- 172.21.15.146:0/3704912144 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ec718f760 0x564ec718fb60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4005fd0 tx=0x7ff6c4045c30 comp rx=0 tx=0).stop 2024-09-18T01:45:22.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.226+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3704912144 shutdown_connections 2024-09-18T01:45:22.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.226+0000 7ff6d52b5800 1 --2- 172.21.15.146:0/3704912144 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ec718f760 0x564ec718fb60 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.226+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3704912144 >> 172.21.15.146:0/3704912144 conn(0x564ec718aff0 msgr2=0x564ec718d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:22.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.226+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3704912144 shutdown_connections 2024-09-18T01:45:22.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.226+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3704912144 wait complete. 2024-09-18T01:45:22.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.240+0000 7ff6d52b5800 1 Processor -- start 2024-09-18T01:45:22.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.240+0000 7ff6d52b5800 1 -- start start 2024-09-18T01:45:22.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.240+0000 7ff6d52b5800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ec718f760 0x564ec727e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.240+0000 7ff6d52b5800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x564ec70db330 con 0x564ec718f760 2024-09-18T01:45:22.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.240+0000 7ff6d2da9640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ec718f760 0x564ec727e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.240+0000 7ff6d2da9640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ec718f760 0x564ec727e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59240/0 (socket says 172.21.15.146:59240) 2024-09-18T01:45:22.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.240+0000 7ff6d2da9640 1 -- 172.21.15.146:0/181046224 learned_addr learned my addr 172.21.15.146:0/181046224 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:22.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.240+0000 7ff6d2da9640 1 -- 172.21.15.146:0/181046224 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ec7028bc0 con 0x564ec718f760 2024-09-18T01:45:22.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.240+0000 7ff6d2da9640 1 --2- 172.21.15.146:0/181046224 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ec718f760 0x564ec727e660 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff6c400a3f0 tx=0x7ff6c4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a1927866a81a9fd server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.241+0000 7ff5c0e09640 1 -- 172.21.15.146:0/181046224 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6c4058a30 con 0x564ec718f760 2024-09-18T01:45:22.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.241+0000 7ff5c0e09640 1 -- 172.21.15.146:0/181046224 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6c4068070 con 0x564ec718f760 2024-09-18T01:45:22.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.241+0000 7ff5c0e09640 1 -- 172.21.15.146:0/181046224 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6c4058d60 con 0x564ec718f760 2024-09-18T01:45:22.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.241+0000 7ff6d52b5800 1 -- 172.21.15.146:0/181046224 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ec718f760 msgr2=0x564ec727e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.241+0000 7ff6d52b5800 1 --2- 172.21.15.146:0/181046224 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ec718f760 0x564ec727e660 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff6c400a3f0 tx=0x7ff6c4051000 comp rx=0 tx=0).stop 2024-09-18T01:45:22.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.241+0000 7ff6d52b5800 1 -- 172.21.15.146:0/181046224 shutdown_connections 2024-09-18T01:45:22.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.241+0000 7ff6d52b5800 1 --2- 172.21.15.146:0/181046224 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ec718f760 0x564ec727e660 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.241+0000 7ff6d52b5800 1 -- 172.21.15.146:0/181046224 >> 172.21.15.146:0/181046224 conn(0x564ec718aff0 msgr2=0x564ec727a020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:22.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.242+0000 7ff6d52b5800 1 -- 172.21.15.146:0/181046224 shutdown_connections 2024-09-18T01:45:22.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.242+0000 7ff6d52b5800 1 -- 172.21.15.146:0/181046224 wait complete. 2024-09-18T01:45:22.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.242+0000 7ff6d52b5800 1 Processor -- start 2024-09-18T01:45:22.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.242+0000 7ff6d52b5800 1 -- start start 2024-09-18T01:45:22.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.242+0000 7ff6d52b5800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ec718f760 0x564ec7285fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.242+0000 7ff6d52b5800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x564ec7196640 con 0x564ec718f760 2024-09-18T01:45:22.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.242+0000 7ff6d2da9640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ec718f760 0x564ec7285fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.242+0000 7ff6d2da9640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ec718f760 0x564ec7285fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59252/0 (socket says 172.21.15.146:59252) 2024-09-18T01:45:22.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.242+0000 7ff6d2da9640 1 -- 172.21.15.146:0/4094185132 learned_addr learned my addr 172.21.15.146:0/4094185132 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:22.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.242+0000 7ff6d2da9640 1 -- 172.21.15.146:0/4094185132 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ec703cfe0 con 0x564ec718f760 2024-09-18T01:45:22.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.243+0000 7ff6d2da9640 1 --2- 172.21.15.146:0/4094185132 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ec718f760 0x564ec7285fe0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff6c400a3f0 tx=0x7ff6c4003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.243+0000 7ff5bf606640 1 -- 172.21.15.146:0/4094185132 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6c4063680 con 0x564ec718f760 2024-09-18T01:45:22.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.243+0000 7ff5bf606640 1 -- 172.21.15.146:0/4094185132 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6c4063820 con 0x564ec718f760 2024-09-18T01:45:22.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.243+0000 7ff6d52b5800 1 -- 172.21.15.146:0/4094185132 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564ec7286520 con 0x564ec718f760 2024-09-18T01:45:22.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.243+0000 7ff5bf606640 1 -- 172.21.15.146:0/4094185132 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6c4063b40 con 0x564ec718f760 2024-09-18T01:45:22.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.243+0000 7ff6d52b5800 1 -- 172.21.15.146:0/4094185132 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ec72869e0 con 0x564ec718f760 2024-09-18T01:45:22.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.244+0000 7ff5bf606640 1 -- 172.21.15.146:0/4094185132 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff6c4063ce0 con 0x564ec718f760 2024-09-18T01:45:22.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.244+0000 7ff5bf606640 1 --2- 172.21.15.146:0/4094185132 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff5b8036b40 0x7ff5b8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.244+0000 7ff5bf606640 1 -- 172.21.15.146:0/4094185132 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7ff6c4090df0 con 0x564ec718f760 2024-09-18T01:45:22.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.244+0000 7ff6d25a8640 1 --2- 172.21.15.146:0/4094185132 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff5b8036b40 0x7ff5b8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.244+0000 7ff6d52b5800 1 --2- 172.21.15.146:0/4094185132 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564ec71900a0 0x564ec728cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.244+0000 7ff6d52b5800 1 -- 172.21.15.146:0/4094185132 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564ec728d580 con 0x564ec71900a0 2024-09-18T01:45:22.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.244+0000 7ff6d35aa640 1 --2- 172.21.15.146:0/4094185132 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564ec71900a0 0x564ec728cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.244+0000 7ff6d25a8640 1 --2- 172.21.15.146:0/4094185132 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff5b8036b40 0x7ff5b8039000 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc000c00 tx=0x7ff6bc0013b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.244+0000 7ff6d35aa640 1 --2- 172.21.15.146:0/4094185132 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564ec71900a0 0x564ec728cf60 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.245+0000 7ff6d35aa640 1 -- 172.21.15.146:0/4094185132 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff6cc0083e0 con 0x564ec71900a0 2024-09-18T01:45:22.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.245+0000 7ff6d52b5800 1 -- 172.21.15.146:0/4094185132 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564ec728a5e0 con 0x564ec71900a0 2024-09-18T01:45:22.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.245+0000 7ff6d35aa640 1 -- 172.21.15.146:0/4094185132 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff6cc0083e0 con 0x564ec71900a0 2024-09-18T01:45:22.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.245+0000 7ff6d52b5800 1 -- 172.21.15.146:0/4094185132 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564ec728f3a0 con 0x564ec71900a0 2024-09-18T01:45:22.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.245+0000 7ff6d35aa640 1 -- 172.21.15.146:0/4094185132 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff6cc0083e0 con 0x564ec71900a0 2024-09-18T01:45:22.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.245+0000 7ff6d52b5800 1 -- 172.21.15.146:0/4094185132 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564ec728e510 con 0x564ec71900a0 2024-09-18T01:45:22.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.246+0000 7ff6d35aa640 1 -- 172.21.15.146:0/4094185132 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff6cc0083e0 con 0x564ec71900a0 2024-09-18T01:45:22.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.246+0000 7ff6d52b5800 1 --2- 172.21.15.146:0/4094185132 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x564ec728efb0 0x564ec72927c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.246+0000 7ff6d52b5800 1 -- 172.21.15.146:0/4094185132 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564ec7292f50 con 0x564ec728efb0 2024-09-18T01:45:22.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.246+0000 7ff6d2da9640 1 --2- 172.21.15.146:0/4094185132 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x564ec728efb0 0x564ec72927c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.246+0000 7ff6d2da9640 1 --2- 172.21.15.146:0/4094185132 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x564ec728efb0 0x564ec72927c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.246+0000 7ff6d2da9640 1 -- 172.21.15.146:0/4094185132 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff6c4074d00 con 0x564ec728efb0 2024-09-18T01:45:22.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.247+0000 7ff6d52b5800 1 Processor -- start 2024-09-18T01:45:22.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.247+0000 7ff6d52b5800 1 -- start start 2024-09-18T01:45:22.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.247+0000 7ff6d52b5800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ec72a0ce0 0x564ec72a1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.247+0000 7ff6d52b5800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x564ec702a580 con 0x564ec72a0ce0 2024-09-18T01:45:22.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.247+0000 7ff6d35aa640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ec72a0ce0 0x564ec72a1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.247+0000 7ff6d35aa640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ec72a0ce0 0x564ec72a1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59256/0 (socket says 172.21.15.146:59256) 2024-09-18T01:45:22.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.247+0000 7ff6d35aa640 1 -- 172.21.15.146:0/3307824858 learned_addr learned my addr 172.21.15.146:0/3307824858 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:22.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.247+0000 7ff6d35aa640 1 -- 172.21.15.146:0/3307824858 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ec72a1640 con 0x564ec72a0ce0 2024-09-18T01:45:22.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.247+0000 7ff6d35aa640 1 --2- 172.21.15.146:0/3307824858 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ec72a0ce0 0x564ec72a1100 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x564ec7287090 tx=0x7ff6cc00ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.248+0000 7ff5bce01640 1 -- 172.21.15.146:0/3307824858 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6cc01c070 con 0x564ec72a0ce0 2024-09-18T01:45:22.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.248+0000 7ff5bce01640 1 -- 172.21.15.146:0/3307824858 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6cc018410 con 0x564ec72a0ce0 2024-09-18T01:45:22.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.248+0000 7ff5bce01640 1 -- 172.21.15.146:0/3307824858 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6cc018730 con 0x564ec72a0ce0 2024-09-18T01:45:22.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.248+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3307824858 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564ec72a18d0 con 0x564ec72a0ce0 2024-09-18T01:45:22.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.248+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3307824858 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ec72a45b0 con 0x564ec72a0ce0 2024-09-18T01:45:22.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.248+0000 7ff5bce01640 1 -- 172.21.15.146:0/3307824858 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff6cc01f070 con 0x564ec72a0ce0 2024-09-18T01:45:22.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.249+0000 7ff5bce01640 1 --2- 172.21.15.146:0/3307824858 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff5ac036b40 0x7ff5ac039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.249+0000 7ff5bce01640 1 -- 172.21.15.146:0/3307824858 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7ff6cc04e600 con 0x564ec72a0ce0 2024-09-18T01:45:22.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.249+0000 7ff6d2da9640 1 --2- 172.21.15.146:0/3307824858 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff5ac036b40 0x7ff5ac039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.249+0000 7ff6d52b5800 1 Processor -- start 2024-09-18T01:45:22.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.249+0000 7ff6d2da9640 1 --2- 172.21.15.146:0/3307824858 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff5ac036b40 0x7ff5ac039000 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x564ec728e4e0 tx=0x7ff6c4075480 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.249+0000 7ff6d52b5800 1 -- start start 2024-09-18T01:45:22.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.249+0000 7ff6d52b5800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ec72ad9a0 0x564ec72adda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.249+0000 7ff6d52b5800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x564ec727ed50 con 0x564ec72ad9a0 2024-09-18T01:45:22.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.249+0000 7ff6d35aa640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ec72ad9a0 0x564ec72adda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.249+0000 7ff6d35aa640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ec72ad9a0 0x564ec72adda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59266/0 (socket says 172.21.15.146:59266) 2024-09-18T01:45:22.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.249+0000 7ff6d35aa640 1 -- 172.21.15.146:0/1130792238 learned_addr learned my addr 172.21.15.146:0/1130792238 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:22.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.250+0000 7ff6d35aa640 1 -- 172.21.15.146:0/1130792238 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ec72ae2e0 con 0x564ec72ad9a0 2024-09-18T01:45:22.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.250+0000 7ff6d35aa640 1 --2- 172.21.15.146:0/1130792238 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ec72ad9a0 0x564ec72adda0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc014800 tx=0x7ff6cc0146a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=748df906d77a50d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.250+0000 7ff5b67fc640 1 -- 172.21.15.146:0/1130792238 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6cc016c80 con 0x564ec72ad9a0 2024-09-18T01:45:22.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.250+0000 7ff5b67fc640 1 -- 172.21.15.146:0/1130792238 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6cc040e50 con 0x564ec72ad9a0 2024-09-18T01:45:22.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.250+0000 7ff5b67fc640 1 -- 172.21.15.146:0/1130792238 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6cc04e0d0 con 0x564ec72ad9a0 2024-09-18T01:45:22.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.250+0000 7ff6d52b5800 1 -- 172.21.15.146:0/1130792238 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ec72ad9a0 msgr2=0x564ec72adda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.250+0000 7ff6d52b5800 1 --2- 172.21.15.146:0/1130792238 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ec72ad9a0 0x564ec72adda0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc014800 tx=0x7ff6cc0146a0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.250+0000 7ff6d52b5800 1 -- 172.21.15.146:0/1130792238 shutdown_connections 2024-09-18T01:45:22.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.250+0000 7ff6d52b5800 1 --2- 172.21.15.146:0/1130792238 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ec72ad9a0 0x564ec72adda0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.250+0000 7ff6d52b5800 1 -- 172.21.15.146:0/1130792238 >> 172.21.15.146:0/1130792238 conn(0x564ec72a9d50 msgr2=0x564ec72a7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:22.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.250+0000 7ff6d52b5800 1 -- 172.21.15.146:0/1130792238 shutdown_connections 2024-09-18T01:45:22.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.250+0000 7ff6d52b5800 1 -- 172.21.15.146:0/1130792238 wait complete. 2024-09-18T01:45:22.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.251+0000 7ff6d52b5800 1 Processor -- start 2024-09-18T01:45:22.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.251+0000 7ff6d52b5800 1 -- start start 2024-09-18T01:45:22.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.251+0000 7ff6d52b5800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ec72ad9a0 0x564ec72b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.251+0000 7ff6d52b5800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x564ec72ae980 con 0x564ec72ad9a0 2024-09-18T01:45:22.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.251+0000 7ff6d35aa640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ec72ad9a0 0x564ec72b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.251+0000 7ff6d35aa640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ec72ad9a0 0x564ec72b4e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59282/0 (socket says 172.21.15.146:59282) 2024-09-18T01:45:22.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.251+0000 7ff6d35aa640 1 -- 172.21.15.146:0/3856882270 learned_addr learned my addr 172.21.15.146:0/3856882270 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:22.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.251+0000 7ff6d35aa640 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ec72b5380 con 0x564ec72ad9a0 2024-09-18T01:45:22.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.251+0000 7ff6d35aa640 1 --2- 172.21.15.146:0/3856882270 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ec72ad9a0 0x564ec72b4e40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc014b00 tx=0x7ff6cc04c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.252+0000 7ff5b4ff9640 1 -- 172.21.15.146:0/3856882270 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6cc007b50 con 0x564ec72ad9a0 2024-09-18T01:45:22.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.252+0000 7ff5b4ff9640 1 -- 172.21.15.146:0/3856882270 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6cc04a030 con 0x564ec72ad9a0 2024-09-18T01:45:22.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.252+0000 7ff5b4ff9640 1 -- 172.21.15.146:0/3856882270 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6cc007e60 con 0x564ec72ad9a0 2024-09-18T01:45:22.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.252+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564ec72b5610 con 0x564ec72ad9a0 2024-09-18T01:45:22.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.252+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ec72b82c0 con 0x564ec72ad9a0 2024-09-18T01:45:22.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.252+0000 7ff5b4ff9640 1 -- 172.21.15.146:0/3856882270 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff6cc0189a0 con 0x564ec72ad9a0 2024-09-18T01:45:22.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.253+0000 7ff5b4ff9640 1 --2- 172.21.15.146:0/3856882270 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff59c036b40 0x7ff59c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.253+0000 7ff5b4ff9640 1 -- 172.21.15.146:0/3856882270 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7ff6cc033070 con 0x564ec72ad9a0 2024-09-18T01:45:22.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.253+0000 7ff6d2da9640 1 --2- 172.21.15.146:0/3856882270 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff59c036b40 0x7ff59c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.253+0000 7ff6d2da9640 1 --2- 172.21.15.146:0/3856882270 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff59c036b40 0x7ff59c039000 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff6c40738c0 tx=0x7ff6c4094000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.253+0000 7ff6d52b5800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.253+0000 7ff6d52b5800 1 --2- 172.21.15.146:0/3856882270 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564ec72c0930 0x564ec72c2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.253+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564ec72c3540 con 0x564ec72c0930 2024-09-18T01:45:22.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.253+0000 7ff6d25a8640 1 --2- 172.21.15.146:0/3856882270 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564ec72c0930 0x564ec72c2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.254+0000 7ff6d25a8640 1 --2- 172.21.15.146:0/3856882270 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564ec72c0930 0x564ec72c2df0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.254+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff6bc00f5f0 con 0x564ec72c0930 2024-09-18T01:45:22.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.254+0000 7ff6d52b5800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:22.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.254+0000 7ff6d52b5800 20 realm 2024-09-18T01:45:22.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.254+0000 7ff6d52b5800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.254+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564ec72bfd80 con 0x564ec72c0930 2024-09-18T01:45:22.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.254+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff6bc00f5f0 con 0x564ec72c0930 2024-09-18T01:45:22.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.254+0000 7ff6d52b5800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:22.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.254+0000 7ff6d52b5800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:22.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.254+0000 7ff6d52b5800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.254+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564ec72c4030 con 0x564ec72c0930 2024-09-18T01:45:22.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.254+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff6bc00f5f0 con 0x564ec72c0930 2024-09-18T01:45:22.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.254+0000 7ff6d52b5800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:22.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.254+0000 7ff6d52b5800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.254+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564ec72c4900 con 0x564ec72c0930 2024-09-18T01:45:22.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.255+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff6bc00f5f0 con 0x564ec72c0930 2024-09-18T01:45:22.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.255+0000 7ff6d52b5800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:22.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.255+0000 7ff6d52b5800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.255+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564ec72c4ca0 con 0x564ec72c0930 2024-09-18T01:45:22.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.255+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff6bc00f5f0 con 0x564ec72c0930 2024-09-18T01:45:22.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.255+0000 7ff6d52b5800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:22.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.255+0000 7ff6d52b5800 20 searching for the correct realm 2024-09-18T01:45:22.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.255+0000 7ff6d52b5800 1 --2- 172.21.15.146:0/3856882270 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x564ec72c6bd0 0x564ec72c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.255+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ec72c96b0 con 0x564ec72c6bd0 2024-09-18T01:45:22.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.255+0000 7ff6d35aa640 1 --2- 172.21.15.146:0/3856882270 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x564ec72c6bd0 0x564ec72c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.255+0000 7ff6d35aa640 1 --2- 172.21.15.146:0/3856882270 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x564ec72c6bd0 0x564ec72c8fe0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.256+0000 7ff6d35aa640 1 -- 172.21.15.146:0/3856882270 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6cc057040 con 0x564ec72c6bd0 2024-09-18T01:45:22.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.256+0000 7ff6d35aa640 1 --2- 172.21.15.146:0/3856882270 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7ff6cc021070 0x7ff6cc00c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.256+0000 7ff6d35aa640 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ec72c96b0 con 0x7ff6cc021070 2024-09-18T01:45:22.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.256+0000 7ff6d2da9640 1 --2- 172.21.15.146:0/3856882270 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7ff6cc021070 0x7ff6cc00c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.256+0000 7ff6d2da9640 1 --2- 172.21.15.146:0/3856882270 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7ff6cc021070 0x7ff6cc00c900 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.256+0000 7ff6d2da9640 1 -- 172.21.15.146:0/3856882270 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6c4074d00 con 0x7ff6cc021070 2024-09-18T01:45:22.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.256+0000 7ff6d2da9640 1 --2- 172.21.15.146:0/3856882270 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7ff6c40a7040 0x7ff6c408f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.256+0000 7ff6d2da9640 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ec72c96b0 con 0x7ff6c40a7040 2024-09-18T01:45:22.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.256+0000 7ff6d25a8640 1 --2- 172.21.15.146:0/3856882270 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7ff6c40a7040 0x7ff6c408f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.257+0000 7ff6d25a8640 1 --2- 172.21.15.146:0/3856882270 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7ff6c40a7040 0x7ff6c408f550 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.257+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6bc00f5f0 con 0x7ff6c40a7040 2024-09-18T01:45:22.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.257+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ec72c96b0 con 0x564ec72c0930 2024-09-18T01:45:22.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.257+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v24'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff6bc00f5f0 con 0x564ec72c0930 2024-09-18T01:45:22.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.257+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ec72c96b0 con 0x564ec72c0930 2024-09-18T01:45:22.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.258+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6bc00f5f0 con 0x564ec72c0930 2024-09-18T01:45:22.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.258+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ec72c96b0 con 0x7ff6c40a7040 2024-09-18T01:45:22.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.258+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6bc00f5f0 con 0x7ff6c40a7040 2024-09-18T01:45:22.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.258+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ec72c96b0 con 0x7ff6c40a7040 2024-09-18T01:45:22.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.258+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6bc00f5f0 con 0x7ff6c40a7040 2024-09-18T01:45:22.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.258+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ec72c96b0 con 0x7ff6cc021070 2024-09-18T01:45:22.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.258+0000 7ff6d2da9640 1 -- 172.21.15.146:0/3856882270 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6c4074d00 con 0x7ff6cc021070 2024-09-18T01:45:22.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.258+0000 7ff6d2da9640 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ec72c96b0 con 0x564ec72c6bd0 2024-09-18T01:45:22.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.258+0000 7ff6d35aa640 1 -- 172.21.15.146:0/3856882270 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6cc057040 con 0x564ec72c6bd0 2024-09-18T01:45:22.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.258+0000 7ff6d35aa640 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ec72c96b0 con 0x564ec72c0930 2024-09-18T01:45:22.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.259+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6bc00f5f0 con 0x564ec72c0930 2024-09-18T01:45:22.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.259+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ec72c96b0 con 0x7ff6c40a7040 2024-09-18T01:45:22.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.259+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6bc00f5f0 con 0x7ff6c40a7040 2024-09-18T01:45:22.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.259+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ec72c96b0 con 0x564ec72c0930 2024-09-18T01:45:22.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.259+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6bc00f5f0 con 0x564ec72c0930 2024-09-18T01:45:22.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.259+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ec72c96b0 con 0x7ff6cc021070 2024-09-18T01:45:22.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.259+0000 7ff6d2da9640 1 -- 172.21.15.146:0/3856882270 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7ff6c4074d00 con 0x7ff6cc021070 2024-09-18T01:45:22.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.259+0000 7ff6d2da9640 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ec72c96b0 con 0x564ec72c6bd0 2024-09-18T01:45:22.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.260+0000 7ff6d35aa640 1 -- 172.21.15.146:0/3856882270 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6cc057040 con 0x564ec72c6bd0 2024-09-18T01:45:22.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.260+0000 7ff6d35aa640 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ec72c96b0 con 0x564ec72c6bd0 2024-09-18T01:45:22.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.260+0000 7ff6d35aa640 1 -- 172.21.15.146:0/3856882270 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6cc057040 con 0x564ec72c6bd0 2024-09-18T01:45:22.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.260+0000 7ff6d35aa640 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ec72c96b0 con 0x7ff6c40a7040 2024-09-18T01:45:22.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.260+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6bc00f5f0 con 0x7ff6c40a7040 2024-09-18T01:45:22.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.260+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ec72c96b0 con 0x564ec72c6bd0 2024-09-18T01:45:22.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.260+0000 7ff6d35aa640 1 -- 172.21.15.146:0/3856882270 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6cc057040 con 0x564ec72c6bd0 2024-09-18T01:45:22.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.260+0000 7ff6d35aa640 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ec72c96b0 con 0x564ec72c6bd0 2024-09-18T01:45:22.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.261+0000 7ff6d35aa640 1 -- 172.21.15.146:0/3856882270 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6cc057040 con 0x564ec72c6bd0 2024-09-18T01:45:22.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.261+0000 7ff6d35aa640 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ec72c96b0 con 0x564ec72c0930 2024-09-18T01:45:22.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.261+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6bc00f5f0 con 0x564ec72c0930 2024-09-18T01:45:22.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.261+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ec72c96b0 con 0x564ec72c0930 2024-09-18T01:45:22.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.261+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff6bc00f5f0 con 0x564ec72c0930 2024-09-18T01:45:22.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.261+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ec72c96b0 con 0x7ff6c40a7040 2024-09-18T01:45:22.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.261+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6bc00f5f0 con 0x7ff6c40a7040 2024-09-18T01:45:22.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.261+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ec72c96b0 con 0x564ec72c6bd0 2024-09-18T01:45:22.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.261+0000 7ff6d35aa640 1 -- 172.21.15.146:0/3856882270 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6cc057040 con 0x564ec72c6bd0 2024-09-18T01:45:22.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.261+0000 7ff6d35aa640 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ec72c96b0 con 0x7ff6cc021070 2024-09-18T01:45:22.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.262+0000 7ff6d2da9640 1 -- 172.21.15.146:0/3856882270 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6c4074d00 con 0x7ff6cc021070 2024-09-18T01:45:22.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.262+0000 7ff6d2da9640 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ec72c96b0 con 0x564ec72c0930 2024-09-18T01:45:22.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.262+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6bc00f5f0 con 0x564ec72c0930 2024-09-18T01:45:22.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.262+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ec72c96b0 con 0x7ff6c40a7040 2024-09-18T01:45:22.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.262+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6bc03b040 con 0x7ff6c40a7040 2024-09-18T01:45:22.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.262+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ec72c96b0 con 0x564ec72c6bd0 2024-09-18T01:45:22.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.262+0000 7ff6d35aa640 1 -- 172.21.15.146:0/3856882270 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6cc057040 con 0x564ec72c6bd0 2024-09-18T01:45:22.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.262+0000 7ff6d35aa640 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ec72c96b0 con 0x7ff6c40a7040 2024-09-18T01:45:22.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.263+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6bc03b040 con 0x7ff6c40a7040 2024-09-18T01:45:22.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.263+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ec72c96b0 con 0x7ff6cc021070 2024-09-18T01:45:22.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.263+0000 7ff6d2da9640 1 -- 172.21.15.146:0/3856882270 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6c4074d00 con 0x7ff6cc021070 2024-09-18T01:45:22.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.263+0000 7ff6d2da9640 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ec72c96b0 con 0x564ec72c6bd0 2024-09-18T01:45:22.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.263+0000 7ff6d35aa640 1 -- 172.21.15.146:0/3856882270 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6cc057040 con 0x564ec72c6bd0 2024-09-18T01:45:22.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.263+0000 7ff6d35aa640 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ec72c96b0 con 0x7ff6c40a7040 2024-09-18T01:45:22.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.263+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6bc03b040 con 0x7ff6c40a7040 2024-09-18T01:45:22.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.264+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ec72c96b0 con 0x564ec72c0930 2024-09-18T01:45:22.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.264+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff6bc03b040 con 0x564ec72c0930 2024-09-18T01:45:22.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.264+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564ec72c96b0 con 0x7ff6cc021070 2024-09-18T01:45:22.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.264+0000 7ff6d2da9640 1 -- 172.21.15.146:0/3856882270 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6c4074d00 con 0x7ff6cc021070 2024-09-18T01:45:22.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.264+0000 7ff6d52b5800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:22.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.264+0000 7ff6d52b5800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:22.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.264+0000 7ff6d52b5800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:22.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.264+0000 7ff6d52b5800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:22.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.264+0000 7ff6d52b5800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:22.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.264+0000 7ff6d52b5800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:22.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.264+0000 7ff6d52b5800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.264+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564ec72c5670 con 0x564ec72c0930 2024-09-18T01:45:22.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.264+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff6bc03b040 con 0x564ec72c0930 2024-09-18T01:45:22.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.264+0000 7ff6d52b5800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:22.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.264+0000 7ff6d52b5800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.264+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564ec72c5f10 con 0x564ec72c0930 2024-09-18T01:45:22.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.264+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff6bc03b040 con 0x564ec72c0930 2024-09-18T01:45:22.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.264+0000 7ff6d52b5800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:22.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.264+0000 7ff6d52b5800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.264+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564ec72c5f10 con 0x7ff6cc021070 2024-09-18T01:45:22.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.265+0000 7ff6d2da9640 1 -- 172.21.15.146:0/3856882270 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff6c4074d00 con 0x7ff6cc021070 2024-09-18T01:45:22.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.265+0000 7ff6d52b5800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:22.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.265+0000 7ff6d52b5800 20 zone default found 2024-09-18T01:45:22.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.265+0000 7ff6d52b5800 4 Realm: () 2024-09-18T01:45:22.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.265+0000 7ff6d52b5800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:22.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.265+0000 7ff6d52b5800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:22.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.265+0000 7ff6d52b5800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:22.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.265+0000 7ff6d52b5800 20 zonegroup default 2024-09-18T01:45:22.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.265+0000 7ff6d52b5800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.265+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564ec72c9fe0 con 0x7ff6c40a7040 2024-09-18T01:45:22.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.265+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff6bc03b040 con 0x7ff6c40a7040 2024-09-18T01:45:22.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.265+0000 7ff6d52b5800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:22.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.265+0000 7ff6d52b5800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.265+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564ec72cb9c0 con 0x564ec72c6bd0 2024-09-18T01:45:22.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.265+0000 7ff6d35aa640 1 -- 172.21.15.146:0/3856882270 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff6cc057040 con 0x564ec72c6bd0 2024-09-18T01:45:22.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.265+0000 7ff6d52b5800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:22.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.265+0000 7ff6d52b5800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.265+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564ec72cbe40 con 0x564ec72c6bd0 2024-09-18T01:45:22.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.266+0000 7ff6d35aa640 1 -- 172.21.15.146:0/3856882270 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff6cc057040 con 0x564ec72c6bd0 2024-09-18T01:45:22.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.266+0000 7ff6d52b5800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:22.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.266+0000 7ff6d52b5800 20 started sync module instance, tier type = 2024-09-18T01:45:22.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.266+0000 7ff6d52b5800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:22.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.266+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72cae00 con 0x7ff6cc021070 2024-09-18T01:45:22.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.267+0000 7ff6d2da9640 1 -- 172.21.15.146:0/3856882270 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v31'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6c4074d00 con 0x7ff6cc021070 2024-09-18T01:45:22.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.267+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94896349030736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72cc2a0 con 0x7ff6cc021070 2024-09-18T01:45:22.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.267+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72ccaf0 con 0x564ec72c0930 2024-09-18T01:45:22.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.268+0000 7ff6d2da9640 1 -- 172.21.15.146:0/3856882270 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94896349030736] v31'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6c4074d00 con 0x7ff6cc021070 2024-09-18T01:45:22.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.268+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v31'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6bc03b040 con 0x564ec72c0930 2024-09-18T01:45:22.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.268+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94896349038144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72ccf10 con 0x564ec72c0930 2024-09-18T01:45:22.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.268+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72cd760 con 0x564ec72c6bd0 2024-09-18T01:45:22.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.269+0000 7ff6d35aa640 1 -- 172.21.15.146:0/3856882270 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v31'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6cc057040 con 0x564ec72c6bd0 2024-09-18T01:45:22.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.269+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94896349040912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72cd730 con 0x564ec72c6bd0 2024-09-18T01:45:22.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.269+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72ce750 con 0x7ff6cc021070 2024-09-18T01:45:22.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.269+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94896349038144] v31'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6bc03b040 con 0x564ec72c0930 2024-09-18T01:45:22.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.270+0000 7ff6d35aa640 1 -- 172.21.15.146:0/3856882270 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94896349040912] v31'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6cc057040 con 0x564ec72c6bd0 2024-09-18T01:45:22.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.270+0000 7ff6d2da9640 1 -- 172.21.15.146:0/3856882270 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v31'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6c4074d00 con 0x7ff6cc021070 2024-09-18T01:45:22.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.270+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94896349043536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72cca60 con 0x7ff6cc021070 2024-09-18T01:45:22.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.270+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72cf030 con 0x564ec72c0930 2024-09-18T01:45:22.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.271+0000 7ff6d2da9640 1 -- 172.21.15.146:0/3856882270 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94896349043536] v31'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6c4074d00 con 0x7ff6cc021070 2024-09-18T01:45:22.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.272+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v31'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6bc03b040 con 0x564ec72c0930 2024-09-18T01:45:22.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.272+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94896349045280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72cf420 con 0x564ec72c0930 2024-09-18T01:45:22.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.272+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72cfe40 con 0x7ff6c40a7040 2024-09-18T01:45:22.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.273+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v31'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6bc03b040 con 0x7ff6c40a7040 2024-09-18T01:45:22.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.273+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94896349051184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72cfe00 con 0x7ff6c40a7040 2024-09-18T01:45:22.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.273+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72cfe00 con 0x7ff6c40a7040 2024-09-18T01:45:22.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.273+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94896349045280] v31'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6bc03b040 con 0x564ec72c0930 2024-09-18T01:45:22.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.274+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94896349051184] v31'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6bc03b040 con 0x7ff6c40a7040 2024-09-18T01:45:22.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.275+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v31'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6bc03b040 con 0x7ff6c40a7040 2024-09-18T01:45:22.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.275+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94896349055104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72d0060 con 0x7ff6c40a7040 2024-09-18T01:45:22.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.275+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72d1200 con 0x7ff6c40a7040 2024-09-18T01:45:22.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.276+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94896349055104] v31'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6bc03b040 con 0x7ff6c40a7040 2024-09-18T01:45:22.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.276+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v31'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6bc03b040 con 0x7ff6c40a7040 2024-09-18T01:45:22.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.276+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94896349047616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72d1200 con 0x7ff6c40a7040 2024-09-18T01:45:22.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.276+0000 7ff6d52b5800 20 add_watcher() i=0 2024-09-18T01:45:22.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.276+0000 7ff6d52b5800 20 add_watcher() i=1 2024-09-18T01:45:22.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.276+0000 7ff6d52b5800 20 add_watcher() i=2 2024-09-18T01:45:22.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.276+0000 7ff6d52b5800 20 add_watcher() i=3 2024-09-18T01:45:22.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.276+0000 7ff6d52b5800 20 add_watcher() i=4 2024-09-18T01:45:22.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.276+0000 7ff6d52b5800 20 add_watcher() i=5 2024-09-18T01:45:22.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.276+0000 7ff6d52b5800 20 add_watcher() i=6 2024-09-18T01:45:22.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.276+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94896349047616] v31'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6bc03b040 con 0x7ff6c40a7040 2024-09-18T01:45:22.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.276+0000 7ff6d52b5800 20 add_watcher() i=7 2024-09-18T01:45:22.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.276+0000 7ff6d52b5800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:22.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.277+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564ec72d4580 con 0x564ec72c0930 2024-09-18T01:45:22.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.277+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff6bc03b040 con 0x564ec72c0930 2024-09-18T01:45:22.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.277+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94896349069152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72d1370 con 0x564ec72c0930 2024-09-18T01:45:22.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.278+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94896349069152] v31'42 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff6bc03b040 con 0x564ec72c0930 2024-09-18T01:45:22.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.279+0000 7ff5897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:22.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.279+0000 7ff6d52b5800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:22.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.279+0000 7ff6d52b5800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:22.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.279+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72d3980 con 0x564ec72c0930 2024-09-18T01:45:22.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.280+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'42 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff6bc03b040 con 0x564ec72c0930 2024-09-18T01:45:22.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.280+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72dd7a0 con 0x7ff6c40a7040 2024-09-18T01:45:22.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.281+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff6bc03b040 con 0x7ff6c40a7040 2024-09-18T01:45:22.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.281+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72ddbc0 con 0x564ec72c6bd0 2024-09-18T01:45:22.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.283+0000 7ff6d35aa640 1 -- 172.21.15.146:0/3856882270 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff6cc057040 con 0x564ec72c6bd0 2024-09-18T01:45:22.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.283+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72ddb90 con 0x564ec72c0930 2024-09-18T01:45:22.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.284+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'43 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff6bc03b040 con 0x564ec72c0930 2024-09-18T01:45:22.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.284+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72de100 con 0x7ff6cc021070 2024-09-18T01:45:22.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.286+0000 7ff6d2da9640 1 -- 172.21.15.146:0/3856882270 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'32 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff6c4074d00 con 0x7ff6cc021070 2024-09-18T01:45:22.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.286+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72de5b0 con 0x564ec72c6bd0 2024-09-18T01:45:22.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.287+0000 7ff6d35aa640 1 -- 172.21.15.146:0/3856882270 <== osd.3 v2:172.21.15.146:6809/4106661138 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'31 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff6cc057040 con 0x564ec72c6bd0 2024-09-18T01:45:22.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.287+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72de5b0 con 0x564ec72c0930 2024-09-18T01:45:22.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.289+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff6bc03b040 con 0x564ec72c0930 2024-09-18T01:45:22.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.289+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72dccb0 con 0x7ff6c40a7040 2024-09-18T01:45:22.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.290+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'23 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff6bc03b040 con 0x7ff6c40a7040 2024-09-18T01:45:22.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.291+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72dccb0 con 0x7ff6cc021070 2024-09-18T01:45:22.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.292+0000 7ff6d2da9640 1 -- 172.21.15.146:0/3856882270 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff6c4074d00 con 0x7ff6cc021070 2024-09-18T01:45:22.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.292+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72dccb0 con 0x564ec72c6bd0 2024-09-18T01:45:22.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.293+0000 7ff6d35aa640 1 -- 172.21.15.146:0/3856882270 <== osd.3 v2:172.21.15.146:6809/4106661138 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff6cc057040 con 0x564ec72c6bd0 2024-09-18T01:45:22.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.293+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72dccb0 con 0x7ff6cc021070 2024-09-18T01:45:22.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.295+0000 7ff6d2da9640 1 -- 172.21.15.146:0/3856882270 <== osd.2 v2:172.21.15.146:6800/3820039304 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'33 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6c4074d00 con 0x7ff6cc021070 2024-09-18T01:45:22.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.295+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72dccb0 con 0x7ff6c40a7040 2024-09-18T01:45:22.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.296+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'14 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6bc03b040 con 0x7ff6c40a7040 2024-09-18T01:45:22.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.296+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72dcae0 con 0x7ff6cc021070 2024-09-18T01:45:22.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.297+0000 7ff6d2da9640 1 -- 172.21.15.146:0/3856882270 <== osd.2 v2:172.21.15.146:6800/3820039304 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6c4074d00 con 0x7ff6cc021070 2024-09-18T01:45:22.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.297+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72dcae0 con 0x7ff6c40a7040 2024-09-18T01:45:22.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.299+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'35 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6bc03b040 con 0x7ff6c40a7040 2024-09-18T01:45:22.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.299+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72dcae0 con 0x564ec72c0930 2024-09-18T01:45:22.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.300+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'44 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6bc03b040 con 0x564ec72c0930 2024-09-18T01:45:22.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.300+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72dcae0 con 0x564ec72c6bd0 2024-09-18T01:45:22.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.301+0000 7ff6d35aa640 1 -- 172.21.15.146:0/3856882270 <== osd.3 v2:172.21.15.146:6809/4106661138 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'26 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6cc057040 con 0x564ec72c6bd0 2024-09-18T01:45:22.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.301+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72dcb70 con 0x7ff6cc021070 2024-09-18T01:45:22.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.302+0000 7ff6d2da9640 1 -- 172.21.15.146:0/3856882270 <== osd.2 v2:172.21.15.146:6800/3820039304 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'34 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6c4074d00 con 0x7ff6cc021070 2024-09-18T01:45:22.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.302+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72dcb70 con 0x564ec72c6bd0 2024-09-18T01:45:22.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.303+0000 7ff6d35aa640 1 -- 172.21.15.146:0/3856882270 <== osd.3 v2:172.21.15.146:6809/4106661138 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'24 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6cc057040 con 0x564ec72c6bd0 2024-09-18T01:45:22.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.303+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72dcb70 con 0x564ec72c0930 2024-09-18T01:45:22.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.305+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6bc03b040 con 0x564ec72c0930 2024-09-18T01:45:22.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.305+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72dcb70 con 0x564ec72c0930 2024-09-18T01:45:22.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.308+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'45 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6bc03b040 con 0x564ec72c0930 2024-09-18T01:45:22.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.308+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72dcb70 con 0x564ec72c6bd0 2024-09-18T01:45:22.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.309+0000 7ff6d35aa640 1 -- 172.21.15.146:0/3856882270 <== osd.3 v2:172.21.15.146:6809/4106661138 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'27 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6cc057040 con 0x564ec72c6bd0 2024-09-18T01:45:22.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.309+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72dcb70 con 0x7ff6cc021070 2024-09-18T01:45:22.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.310+0000 7ff6d2da9640 1 -- 172.21.15.146:0/3856882270 <== osd.2 v2:172.21.15.146:6800/3820039304 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'28 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6c4074d00 con 0x7ff6cc021070 2024-09-18T01:45:22.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.310+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72dcb70 con 0x564ec72c6bd0 2024-09-18T01:45:22.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.313+0000 7ff6d35aa640 1 -- 172.21.15.146:0/3856882270 <== osd.3 v2:172.21.15.146:6809/4106661138 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'20 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6cc057040 con 0x564ec72c6bd0 2024-09-18T01:45:22.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.313+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72dcb70 con 0x564ec72c6bd0 2024-09-18T01:45:22.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.314+0000 7ff6d35aa640 1 -- 172.21.15.146:0/3856882270 <== osd.3 v2:172.21.15.146:6809/4106661138 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'30 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6cc057040 con 0x564ec72c6bd0 2024-09-18T01:45:22.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.314+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72dcae0 con 0x564ec72c6bd0 2024-09-18T01:45:22.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.316+0000 7ff6d35aa640 1 -- 172.21.15.146:0/3856882270 <== osd.3 v2:172.21.15.146:6809/4106661138 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6cc057040 con 0x564ec72c6bd0 2024-09-18T01:45:22.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.316+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72dcae0 con 0x564ec72c6bd0 2024-09-18T01:45:22.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.317+0000 7ff6d35aa640 1 -- 172.21.15.146:0/3856882270 <== osd.3 v2:172.21.15.146:6809/4106661138 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'32 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6cc057040 con 0x564ec72c6bd0 2024-09-18T01:45:22.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.317+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72dcae0 con 0x7ff6c40a7040 2024-09-18T01:45:22.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.319+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'20 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6bc03b040 con 0x7ff6c40a7040 2024-09-18T01:45:22.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.319+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72dcae0 con 0x564ec72c6bd0 2024-09-18T01:45:22.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.321+0000 7ff6d35aa640 1 -- 172.21.15.146:0/3856882270 <== osd.3 v2:172.21.15.146:6809/4106661138 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6cc057040 con 0x564ec72c6bd0 2024-09-18T01:45:22.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.321+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72dcae0 con 0x7ff6c40a7040 2024-09-18T01:45:22.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.322+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.0 v2:172.21.15.129:6800/1759265424 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'24 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6bc03b040 con 0x7ff6c40a7040 2024-09-18T01:45:22.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.322+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72dcae0 con 0x564ec72c6bd0 2024-09-18T01:45:22.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.323+0000 7ff6d35aa640 1 -- 172.21.15.146:0/3856882270 <== osd.3 v2:172.21.15.146:6809/4106661138 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'28 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6cc057040 con 0x564ec72c6bd0 2024-09-18T01:45:22.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.323+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72dcae0 con 0x7ff6c40a7040 2024-09-18T01:45:22.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.324+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.0 v2:172.21.15.129:6800/1759265424 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'36 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6bc03b040 con 0x7ff6c40a7040 2024-09-18T01:45:22.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.324+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72dcae0 con 0x7ff6cc021070 2024-09-18T01:45:22.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.326+0000 7ff6d2da9640 1 -- 172.21.15.146:0/3856882270 <== osd.2 v2:172.21.15.146:6800/3820039304 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6c4074d00 con 0x7ff6cc021070 2024-09-18T01:45:22.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.326+0000 7ff503fff640 20 reqs_thread_entry: start 2024-09-18T01:45:22.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.326+0000 7ff6d52b5800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:22.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.326+0000 7ff6d52b5800 20 Filter name: none 2024-09-18T01:45:22.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.326+0000 7ff501ffb640 20 reqs_thread_entry: start 2024-09-18T01:45:22.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.326+0000 7ff6d52b5800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-18T01:45:22.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.326+0000 7ff6d52b5800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.326+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564ec73099d0 con 0x7ff6c40a7040 2024-09-18T01:45:22.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.327+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.0 v2:172.21.15.129:6800/1759265424 24 ==== osd_op_reply(94 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7ff6bc03b040 con 0x7ff6c40a7040 2024-09-18T01:45:22.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.327+0000 7ff6d52b5800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:22.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.327+0000 7ff6d52b5800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-18T01:45:22.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.327+0000 7ff6d52b5800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-18T01:45:22.328 INFO:teuthology.orchestra.run.smithi146.stderr:could not remove user: unable to remove user, user does not exist 2024-09-18T01:45:22.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.327+0000 7ff5897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:22.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.327+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94896349069152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72dc010 con 0x564ec72c0930 2024-09-18T01:45:22.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.328+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.1 v2:172.21.15.146:6808/3930274777 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94896349069152] v31'46 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff6bc03b040 con 0x564ec72c0930 2024-09-18T01:45:22.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.329+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94896349030736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72dc010 con 0x7ff6cc021070 2024-09-18T01:45:22.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.329+0000 7ff6d2da9640 1 -- 172.21.15.146:0/3856882270 <== osd.2 v2:172.21.15.146:6800/3820039304 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94896349030736] v31'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6c4074d00 con 0x7ff6cc021070 2024-09-18T01:45:22.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.329+0000 7ff6d52b5800 20 remove_watcher() i=0 2024-09-18T01:45:22.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.329+0000 7ff6d52b5800 2 removed watcher, disabling cache 2024-09-18T01:45:22.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.329+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94896349038144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72ca950 con 0x564ec72c0930 2024-09-18T01:45:22.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.331+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.1 v2:172.21.15.146:6808/3930274777 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94896349038144] v31'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6bc03b040 con 0x564ec72c0930 2024-09-18T01:45:22.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.331+0000 7ff6d52b5800 20 remove_watcher() i=1 2024-09-18T01:45:22.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.331+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94896349040912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72ca950 con 0x564ec72c6bd0 2024-09-18T01:45:22.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.332+0000 7ff6d35aa640 1 -- 172.21.15.146:0/3856882270 <== osd.3 v2:172.21.15.146:6809/4106661138 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94896349040912] v31'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6cc057040 con 0x564ec72c6bd0 2024-09-18T01:45:22.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.332+0000 7ff6d52b5800 20 remove_watcher() i=2 2024-09-18T01:45:22.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.332+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94896349043536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72ca950 con 0x7ff6cc021070 2024-09-18T01:45:22.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.333+0000 7ff6d2da9640 1 -- 172.21.15.146:0/3856882270 <== osd.2 v2:172.21.15.146:6800/3820039304 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94896349043536] v31'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6c4074d00 con 0x7ff6cc021070 2024-09-18T01:45:22.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.333+0000 7ff6d52b5800 20 remove_watcher() i=3 2024-09-18T01:45:22.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.333+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94896349045280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72cdb50 con 0x564ec72c0930 2024-09-18T01:45:22.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.335+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.1 v2:172.21.15.146:6808/3930274777 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94896349045280] v31'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6bc03b040 con 0x564ec72c0930 2024-09-18T01:45:22.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.335+0000 7ff6d52b5800 20 remove_watcher() i=4 2024-09-18T01:45:22.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.335+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94896349051184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72ca950 con 0x7ff6c40a7040 2024-09-18T01:45:22.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.336+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.0 v2:172.21.15.129:6800/1759265424 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94896349051184] v31'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6bc03b040 con 0x7ff6c40a7040 2024-09-18T01:45:22.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.336+0000 7ff6d52b5800 20 remove_watcher() i=5 2024-09-18T01:45:22.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.336+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94896349055104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72ce220 con 0x7ff6c40a7040 2024-09-18T01:45:22.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.338+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.0 v2:172.21.15.129:6800/1759265424 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94896349055104] v31'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6bc03b040 con 0x7ff6c40a7040 2024-09-18T01:45:22.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.338+0000 7ff6d52b5800 20 remove_watcher() i=6 2024-09-18T01:45:22.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.338+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94896349047616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564ec72cf930 con 0x7ff6c40a7040 2024-09-18T01:45:22.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.339+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 <== osd.0 v2:172.21.15.129:6800/1759265424 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94896349047616] v31'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6bc03b040 con 0x7ff6c40a7040 2024-09-18T01:45:22.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.339+0000 7ff6d52b5800 20 remove_watcher() i=7 2024-09-18T01:45:22.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.339+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7ff6c40a7040 msgr2=0x7ff6c408f550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.339+0000 7ff6d52b5800 1 --2- 172.21.15.146:0/3856882270 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7ff6c40a7040 0x7ff6c408f550 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.339+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564ec72c0930 msgr2=0x564ec72c2df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.339+0000 7ff6d52b5800 1 --2- 172.21.15.146:0/3856882270 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564ec72c0930 0x564ec72c2df0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.339+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7ff6cc021070 msgr2=0x7ff6cc00c900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.339+0000 7ff6d52b5800 1 --2- 172.21.15.146:0/3856882270 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7ff6cc021070 0x7ff6cc00c900 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.339+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x564ec72c6bd0 msgr2=0x564ec72c8fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.339+0000 7ff6d52b5800 1 --2- 172.21.15.146:0/3856882270 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x564ec72c6bd0 0x564ec72c8fe0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.339+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff59c036b40 msgr2=0x7ff59c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.339+0000 7ff6d52b5800 1 --2- 172.21.15.146:0/3856882270 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff59c036b40 0x7ff59c039000 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff6c40738c0 tx=0x7ff6c4094000 comp rx=0 tx=0).stop 2024-09-18T01:45:22.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.339+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ec72ad9a0 msgr2=0x564ec72b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.339+0000 7ff6d52b5800 1 --2- 172.21.15.146:0/3856882270 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ec72ad9a0 0x564ec72b4e40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc014b00 tx=0x7ff6cc04c8e0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.339+0000 7ff6d25a8640 1 -- 172.21.15.146:0/3856882270 reap_dead start 2024-09-18T01:45:22.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.339+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 shutdown_connections 2024-09-18T01:45:22.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.339+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 >> 172.21.15.146:0/3856882270 conn(0x564ec72a9d50 msgr2=0x564ec72a7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:22.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.339+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 shutdown_connections 2024-09-18T01:45:22.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.339+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3856882270 wait complete. 2024-09-18T01:45:22.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.340+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3307824858 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff5ac036b40 msgr2=0x7ff5ac039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.340+0000 7ff6d52b5800 1 --2- 172.21.15.146:0/3307824858 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff5ac036b40 0x7ff5ac039000 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x564ec728e4e0 tx=0x7ff6c4075480 comp rx=0 tx=0).stop 2024-09-18T01:45:22.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.340+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3307824858 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ec72a0ce0 msgr2=0x564ec72a1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.340+0000 7ff6d52b5800 1 --2- 172.21.15.146:0/3307824858 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ec72a0ce0 0x564ec72a1100 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x564ec7287090 tx=0x7ff6cc00ef30 comp rx=0 tx=0).stop 2024-09-18T01:45:22.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.340+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3307824858 shutdown_connections 2024-09-18T01:45:22.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.340+0000 7ff6d52b5800 1 --2- 172.21.15.146:0/3307824858 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff5ac036b40 0x7ff5ac039000 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.340+0000 7ff6d52b5800 1 --2- 172.21.15.146:0/3307824858 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ec72a0ce0 0x564ec72a1100 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.340+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3307824858 >> 172.21.15.146:0/3307824858 conn(0x564ec7295c70 msgr2=0x564ec72987f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:22.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.340+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3307824858 shutdown_connections 2024-09-18T01:45:22.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.340+0000 7ff6d52b5800 1 -- 172.21.15.146:0/3307824858 wait complete. 2024-09-18T01:45:22.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.340+0000 7ff6d52b5800 1 -- 172.21.15.146:0/4094185132 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564ec71900a0 msgr2=0x564ec728cf60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.340+0000 7ff6d52b5800 1 --2- 172.21.15.146:0/4094185132 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564ec71900a0 0x564ec728cf60 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.340+0000 7ff6d52b5800 1 -- 172.21.15.146:0/4094185132 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x564ec728efb0 msgr2=0x564ec72927c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.340+0000 7ff6d52b5800 1 --2- 172.21.15.146:0/4094185132 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x564ec728efb0 0x564ec72927c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.340+0000 7ff6d52b5800 1 -- 172.21.15.146:0/4094185132 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff5b8036b40 msgr2=0x7ff5b8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.340+0000 7ff6d52b5800 1 --2- 172.21.15.146:0/4094185132 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff5b8036b40 0x7ff5b8039000 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc000c00 tx=0x7ff6bc0013b0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.340+0000 7ff6d52b5800 1 -- 172.21.15.146:0/4094185132 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ec718f760 msgr2=0x564ec7285fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.340+0000 7ff6d52b5800 1 --2- 172.21.15.146:0/4094185132 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ec718f760 0x564ec7285fe0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff6c400a3f0 tx=0x7ff6c4003330 comp rx=0 tx=0).stop 2024-09-18T01:45:22.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.340+0000 7ff6d52b5800 1 -- 172.21.15.146:0/4094185132 shutdown_connections 2024-09-18T01:45:22.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.340+0000 7ff6d52b5800 1 --2- 172.21.15.146:0/4094185132 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x564ec728efb0 0x564ec72927c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.340+0000 7ff6d52b5800 1 --2- 172.21.15.146:0/4094185132 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564ec71900a0 0x564ec728cf60 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.340+0000 7ff6d52b5800 1 --2- 172.21.15.146:0/4094185132 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff5b8036b40 0x7ff5b8039000 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.340+0000 7ff6d52b5800 1 --2- 172.21.15.146:0/4094185132 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ec718f760 0x564ec7285fe0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.340+0000 7ff6d52b5800 1 -- 172.21.15.146:0/4094185132 >> 172.21.15.146:0/4094185132 conn(0x564ec718aff0 msgr2=0x564ec7278890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:22.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.340+0000 7ff6d52b5800 1 -- 172.21.15.146:0/4094185132 shutdown_connections 2024-09-18T01:45:22.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.340+0000 7ff6d52b5800 1 -- 172.21.15.146:0/4094185132 wait complete. 2024-09-18T01:45:22.349 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-18T01:45:22.349 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-18T01:45:22.350 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-18T01:45:22.350 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-18T01:45:22.394 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:22.394 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:22.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.394+0000 7f0f41213800 1 Processor -- start 2024-09-18T01:45:22.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.394+0000 7f0f41213800 1 -- start start 2024-09-18T01:45:22.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.394+0000 7f0f41213800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x56350d0eda60 0x56350d0efe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.394+0000 7f0f41213800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56350cfa8b30 con 0x56350d0e9760 2024-09-18T01:45:22.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.394+0000 7f0f41213800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x56350cf8a360 con 0x56350d0eda60 2024-09-18T01:45:22.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.394+0000 7f0f37fff640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x56350d0eda60 0x56350d0efe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.394+0000 7f0f37fff640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x56350d0eda60 0x56350d0efe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59296/0 (socket says 172.21.15.146:59296) 2024-09-18T01:45:22.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.394+0000 7f0f37fff640 1 -- 172.21.15.146:0/750058411 learned_addr learned my addr 172.21.15.146:0/750058411 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:22.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.394+0000 7f0f3c86e640 1 --1- 172.21.15.146:0/750058411 >> v1:172.21.15.129:6789/0 conn(0x56350d0e9760 0x56350d0e9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:38652/0 (socket says 172.21.15.146:38652) 2024-09-18T01:45:22.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.395+0000 7f0f37fff640 1 -- 172.21.15.146:0/750058411 >> v1:172.21.15.129:6789/0 conn(0x56350d0e9760 legacy=0x56350d0e9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.395+0000 7f0f377fe640 1 -- 172.21.15.146:0/750058411 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3847226200 0 0) 0x56350cfa8b30 con 0x56350d0e9760 2024-09-18T01:45:22.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.395+0000 7f0f37fff640 1 -- 172.21.15.146:0/750058411 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56350cfb0e00 con 0x56350d0eda60 2024-09-18T01:45:22.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.396+0000 7f0f37fff640 1 --2- 172.21.15.146:0/750058411 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56350d0eda60 0x56350d0efe50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0f2800a520 tx=0x7f0f28045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ec2678ebf3238ab server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.396+0000 7f0f377fe640 1 -- 172.21.15.146:0/750058411 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f28055070 con 0x56350d0eda60 2024-09-18T01:45:22.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.396+0000 7f0f377fe640 1 -- 172.21.15.146:0/750058411 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f280515b0 con 0x56350d0eda60 2024-09-18T01:45:22.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.397+0000 7f0f377fe640 1 -- 172.21.15.146:0/750058411 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f280518d0 con 0x56350d0eda60 2024-09-18T01:45:22.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.397+0000 7f0f41213800 1 -- 172.21.15.146:0/750058411 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56350d0eda60 msgr2=0x56350d0efe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.397+0000 7f0f41213800 1 --2- 172.21.15.146:0/750058411 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56350d0eda60 0x56350d0efe50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0f2800a520 tx=0x7f0f28045ba0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.397+0000 7f0f41213800 1 -- 172.21.15.146:0/750058411 shutdown_connections 2024-09-18T01:45:22.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.397+0000 7f0f41213800 1 --2- 172.21.15.146:0/750058411 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56350d0eda60 0x56350d0efe50 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.397+0000 7f0f41213800 1 -- 172.21.15.146:0/750058411 >> 172.21.15.146:0/750058411 conn(0x56350d0e4ff0 msgr2=0x56350d0e7410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:22.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.397+0000 7f0f41213800 1 -- 172.21.15.146:0/750058411 shutdown_connections 2024-09-18T01:45:22.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.397+0000 7f0f41213800 1 -- 172.21.15.146:0/750058411 wait complete. 2024-09-18T01:45:22.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.410+0000 7f0f41213800 1 Processor -- start 2024-09-18T01:45:22.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.410+0000 7f0f41213800 1 -- start start 2024-09-18T01:45:22.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.411+0000 7f0f41213800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56350d0e9760 0x56350d05f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.411+0000 7f0f41213800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x56350d035330 con 0x56350d0e9760 2024-09-18T01:45:22.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.411+0000 7f0f3c86e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56350d0e9760 0x56350d05f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.411+0000 7f0f3c86e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56350d0e9760 0x56350d05f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59302/0 (socket says 172.21.15.146:59302) 2024-09-18T01:45:22.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.411+0000 7f0f3c86e640 1 -- 172.21.15.146:0/90051919 learned_addr learned my addr 172.21.15.146:0/90051919 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:22.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.411+0000 7f0f3c86e640 1 -- 172.21.15.146:0/90051919 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56350cf82bc0 con 0x56350d0e9760 2024-09-18T01:45:22.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.411+0000 7f0f3c86e640 1 --2- 172.21.15.146:0/90051919 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56350d0e9760 0x56350d05f6c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0f3000b240 tx=0x7f0f3000b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91bb0309529f1e46 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.412+0000 7f0e2ae05640 1 -- 172.21.15.146:0/90051919 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f30008070 con 0x56350d0e9760 2024-09-18T01:45:22.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.412+0000 7f0e2ae05640 1 -- 172.21.15.146:0/90051919 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f3000d500 con 0x56350d0e9760 2024-09-18T01:45:22.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.412+0000 7f0e2ae05640 1 -- 172.21.15.146:0/90051919 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f3000d860 con 0x56350d0e9760 2024-09-18T01:45:22.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.412+0000 7f0f41213800 1 -- 172.21.15.146:0/90051919 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56350d0e9760 msgr2=0x56350d05f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.412+0000 7f0f41213800 1 --2- 172.21.15.146:0/90051919 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56350d0e9760 0x56350d05f6c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0f3000b240 tx=0x7f0f3000b700 comp rx=0 tx=0).stop 2024-09-18T01:45:22.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.412+0000 7f0f41213800 1 -- 172.21.15.146:0/90051919 shutdown_connections 2024-09-18T01:45:22.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.412+0000 7f0f41213800 1 --2- 172.21.15.146:0/90051919 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56350d0e9760 0x56350d05f6c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.412+0000 7f0f41213800 1 -- 172.21.15.146:0/90051919 >> 172.21.15.146:0/90051919 conn(0x56350d0e4ff0 msgr2=0x56350d1d4000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:22.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.412+0000 7f0f41213800 1 -- 172.21.15.146:0/90051919 shutdown_connections 2024-09-18T01:45:22.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.412+0000 7f0f41213800 1 -- 172.21.15.146:0/90051919 wait complete. 2024-09-18T01:45:22.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.413+0000 7f0f41213800 1 Processor -- start 2024-09-18T01:45:22.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.413+0000 7f0f41213800 1 -- start start 2024-09-18T01:45:22.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.413+0000 7f0f41213800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56350d0e9760 0x56350d1e22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.413+0000 7f0f41213800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x56350d0f0690 con 0x56350d0e9760 2024-09-18T01:45:22.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.413+0000 7f0f3c86e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56350d0e9760 0x56350d1e22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.413+0000 7f0f3c86e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56350d0e9760 0x56350d1e22c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59306/0 (socket says 172.21.15.146:59306) 2024-09-18T01:45:22.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.413+0000 7f0f3c86e640 1 -- 172.21.15.146:0/3681265472 learned_addr learned my addr 172.21.15.146:0/3681265472 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:22.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.413+0000 7f0f3c86e640 1 -- 172.21.15.146:0/3681265472 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56350cf96fe0 con 0x56350d0e9760 2024-09-18T01:45:22.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.414+0000 7f0f3c86e640 1 --2- 172.21.15.146:0/3681265472 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56350d0e9760 0x56350d1e22c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0f30000f60 tx=0x7f0f30000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.414+0000 7f0e29602640 1 -- 172.21.15.146:0/3681265472 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f30019870 con 0x56350d0e9760 2024-09-18T01:45:22.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.414+0000 7f0e29602640 1 -- 172.21.15.146:0/3681265472 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f30019a10 con 0x56350d0e9760 2024-09-18T01:45:22.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.414+0000 7f0f41213800 1 -- 172.21.15.146:0/3681265472 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56350d1e2800 con 0x56350d0e9760 2024-09-18T01:45:22.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.414+0000 7f0e29602640 1 -- 172.21.15.146:0/3681265472 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f30019d10 con 0x56350d0e9760 2024-09-18T01:45:22.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.414+0000 7f0f41213800 1 -- 172.21.15.146:0/3681265472 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56350d1e2d20 con 0x56350d0e9760 2024-09-18T01:45:22.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.415+0000 7f0e29602640 1 -- 172.21.15.146:0/3681265472 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0f30017040 con 0x56350d0e9760 2024-09-18T01:45:22.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.415+0000 7f0e29602640 1 --2- 172.21.15.146:0/3681265472 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0e24036b40 0x7f0e24039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.415+0000 7f0e29602640 1 -- 172.21.15.146:0/3681265472 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f0f30015020 con 0x56350d0e9760 2024-09-18T01:45:22.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.415+0000 7f0f37fff640 1 --2- 172.21.15.146:0/3681265472 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0e24036b40 0x7f0e24039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.415+0000 7f0f41213800 1 --2- 172.21.15.146:0/3681265472 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56350d0eda60 0x56350d1e9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.415+0000 7f0f41213800 1 -- 172.21.15.146:0/3681265472 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56350d1e9870 con 0x56350d0eda60 2024-09-18T01:45:22.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.415+0000 7f0f3d06f640 1 --2- 172.21.15.146:0/3681265472 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56350d0eda60 0x56350d1e9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.415+0000 7f0f37fff640 1 --2- 172.21.15.146:0/3681265472 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0e24036b40 0x7f0e24039000 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0f28057000 tx=0x7f0f28052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.415+0000 7f0f3d06f640 1 --2- 172.21.15.146:0/3681265472 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56350d0eda60 0x56350d1e9330 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.416+0000 7f0f3d06f640 1 -- 172.21.15.146:0/3681265472 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0f3800a4a0 con 0x56350d0eda60 2024-09-18T01:45:22.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.416+0000 7f0f41213800 1 -- 172.21.15.146:0/3681265472 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56350d1e6900 con 0x56350d0eda60 2024-09-18T01:45:22.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.416+0000 7f0f3d06f640 1 -- 172.21.15.146:0/3681265472 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0f3800a4a0 con 0x56350d0eda60 2024-09-18T01:45:22.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.416+0000 7f0f41213800 1 -- 172.21.15.146:0/3681265472 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56350d1eb650 con 0x56350d0eda60 2024-09-18T01:45:22.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.416+0000 7f0f3d06f640 1 -- 172.21.15.146:0/3681265472 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0f3800a4a0 con 0x56350d0eda60 2024-09-18T01:45:22.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.416+0000 7f0f41213800 1 -- 172.21.15.146:0/3681265472 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56350d1ea880 con 0x56350d0eda60 2024-09-18T01:45:22.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.417+0000 7f0f3d06f640 1 -- 172.21.15.146:0/3681265472 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0f3800a4a0 con 0x56350d0eda60 2024-09-18T01:45:22.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.417+0000 7f0f41213800 1 --2- 172.21.15.146:0/3681265472 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x56350d1eca00 0x56350d1eedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.417+0000 7f0f41213800 1 -- 172.21.15.146:0/3681265472 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56350d1ef330 con 0x56350d1eca00 2024-09-18T01:45:22.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.417+0000 7f0f3c86e640 1 --2- 172.21.15.146:0/3681265472 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x56350d1eca00 0x56350d1eedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.417+0000 7f0f3c86e640 1 --2- 172.21.15.146:0/3681265472 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x56350d1eca00 0x56350d1eedf0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.417+0000 7f0f3c86e640 1 -- 172.21.15.146:0/3681265472 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0f3002d070 con 0x56350d1eca00 2024-09-18T01:45:22.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.418+0000 7f0f41213800 1 Processor -- start 2024-09-18T01:45:22.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.418+0000 7f0f41213800 1 -- start start 2024-09-18T01:45:22.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.418+0000 7f0f41213800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56350d1fcfb0 0x56350d1fd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.418+0000 7f0f41213800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x56350cf84580 con 0x56350d1fcfb0 2024-09-18T01:45:22.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.418+0000 7f0f3d06f640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56350d1fcfb0 0x56350d1fd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.418+0000 7f0f3d06f640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56350d1fcfb0 0x56350d1fd3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59318/0 (socket says 172.21.15.146:59318) 2024-09-18T01:45:22.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.418+0000 7f0f3d06f640 1 -- 172.21.15.146:0/1550335525 learned_addr learned my addr 172.21.15.146:0/1550335525 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:22.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.418+0000 7f0f3d06f640 1 -- 172.21.15.146:0/1550335525 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56350d1fd910 con 0x56350d1fcfb0 2024-09-18T01:45:22.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.419+0000 7f0f3d06f640 1 --2- 172.21.15.146:0/1550335525 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56350d1fcfb0 0x56350d1fd3d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x56350d1e36c0 tx=0x7f0f380178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.419+0000 7f0e227fc640 1 -- 172.21.15.146:0/1550335525 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f38013440 con 0x56350d1fcfb0 2024-09-18T01:45:22.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.419+0000 7f0e227fc640 1 -- 172.21.15.146:0/1550335525 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f380135e0 con 0x56350d1fcfb0 2024-09-18T01:45:22.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.419+0000 7f0f41213800 1 -- 172.21.15.146:0/1550335525 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56350d1fdba0 con 0x56350d1fcfb0 2024-09-18T01:45:22.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.419+0000 7f0e227fc640 1 -- 172.21.15.146:0/1550335525 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f380138c0 con 0x56350d1fcfb0 2024-09-18T01:45:22.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.419+0000 7f0f41213800 1 -- 172.21.15.146:0/1550335525 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56350d200880 con 0x56350d1fcfb0 2024-09-18T01:45:22.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.419+0000 7f0e227fc640 1 -- 172.21.15.146:0/1550335525 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0f38011040 con 0x56350d1fcfb0 2024-09-18T01:45:22.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.420+0000 7f0e227fc640 1 --2- 172.21.15.146:0/1550335525 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0e14036b40 0x7f0e14039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.420+0000 7f0e227fc640 1 -- 172.21.15.146:0/1550335525 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f0f3801d070 con 0x56350d1fcfb0 2024-09-18T01:45:22.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.420+0000 7f0f3c86e640 1 --2- 172.21.15.146:0/1550335525 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0e14036b40 0x7f0e14039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.420+0000 7f0f41213800 1 Processor -- start 2024-09-18T01:45:22.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.420+0000 7f0f3c86e640 1 --2- 172.21.15.146:0/1550335525 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0e14036b40 0x7f0e14039000 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0f3000eb40 tx=0x7f0f300015f0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.420+0000 7f0f41213800 1 -- start start 2024-09-18T01:45:22.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.420+0000 7f0f41213800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56350d209c10 0x56350d20a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.420+0000 7f0f41213800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x56350d05dd90 con 0x56350d209c10 2024-09-18T01:45:22.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.420+0000 7f0f3d06f640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56350d209c10 0x56350d20a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.420+0000 7f0f3d06f640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56350d209c10 0x56350d20a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59334/0 (socket says 172.21.15.146:59334) 2024-09-18T01:45:22.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.420+0000 7f0f3d06f640 1 -- 172.21.15.146:0/2410390771 learned_addr learned my addr 172.21.15.146:0/2410390771 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:22.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.421+0000 7f0f3d06f640 1 -- 172.21.15.146:0/2410390771 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56350d20a5e0 con 0x56350d209c10 2024-09-18T01:45:22.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.421+0000 7f0f3d06f640 1 --2- 172.21.15.146:0/2410390771 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56350d209c10 0x56350d20a010 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0f3804c8f0 tx=0x7f0f3804cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2e5c2bc6913d6bf server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.421+0000 7f0e13fff640 1 -- 172.21.15.146:0/2410390771 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f38012cc0 con 0x56350d209c10 2024-09-18T01:45:22.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.421+0000 7f0e13fff640 1 -- 172.21.15.146:0/2410390771 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f3804e070 con 0x56350d209c10 2024-09-18T01:45:22.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.421+0000 7f0e13fff640 1 -- 172.21.15.146:0/2410390771 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f38012e60 con 0x56350d209c10 2024-09-18T01:45:22.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.421+0000 7f0f41213800 1 -- 172.21.15.146:0/2410390771 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56350d209c10 msgr2=0x56350d20a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.421+0000 7f0f41213800 1 --2- 172.21.15.146:0/2410390771 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56350d209c10 0x56350d20a010 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0f3804c8f0 tx=0x7f0f3804cbc0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.421+0000 7f0f41213800 1 -- 172.21.15.146:0/2410390771 shutdown_connections 2024-09-18T01:45:22.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.421+0000 7f0f41213800 1 --2- 172.21.15.146:0/2410390771 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56350d209c10 0x56350d20a010 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.421+0000 7f0f41213800 1 -- 172.21.15.146:0/2410390771 >> 172.21.15.146:0/2410390771 conn(0x56350d206000 msgr2=0x56350d204100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:22.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.421+0000 7f0f41213800 1 -- 172.21.15.146:0/2410390771 shutdown_connections 2024-09-18T01:45:22.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.421+0000 7f0f41213800 1 -- 172.21.15.146:0/2410390771 wait complete. 2024-09-18T01:45:22.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.422+0000 7f0f41213800 1 Processor -- start 2024-09-18T01:45:22.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.422+0000 7f0f41213800 1 -- start start 2024-09-18T01:45:22.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.422+0000 7f0f41213800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56350d209c10 0x56350d2110f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.422+0000 7f0f41213800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x56350d20ac20 con 0x56350d209c10 2024-09-18T01:45:22.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.422+0000 7f0f3d06f640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56350d209c10 0x56350d2110f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.422+0000 7f0f3d06f640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56350d209c10 0x56350d2110f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59338/0 (socket says 172.21.15.146:59338) 2024-09-18T01:45:22.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.422+0000 7f0f3d06f640 1 -- 172.21.15.146:0/4017026198 learned_addr learned my addr 172.21.15.146:0/4017026198 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:22.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.422+0000 7f0f3d06f640 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56350d211630 con 0x56350d209c10 2024-09-18T01:45:22.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.422+0000 7f0f3d06f640 1 --2- 172.21.15.146:0/4017026198 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56350d209c10 0x56350d2110f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0f38044040 tx=0x7f0f3804c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.423+0000 7f0e127fc640 1 -- 172.21.15.146:0/4017026198 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f38046040 con 0x56350d209c10 2024-09-18T01:45:22.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.423+0000 7f0e127fc640 1 -- 172.21.15.146:0/4017026198 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f38041050 con 0x56350d209c10 2024-09-18T01:45:22.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.423+0000 7f0e127fc640 1 -- 172.21.15.146:0/4017026198 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f38013dc0 con 0x56350d209c10 2024-09-18T01:45:22.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.423+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56350d2118c0 con 0x56350d209c10 2024-09-18T01:45:22.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.423+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56350d214570 con 0x56350d209c10 2024-09-18T01:45:22.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.423+0000 7f0e127fc640 1 -- 172.21.15.146:0/4017026198 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0f3802aa60 con 0x56350d209c10 2024-09-18T01:45:22.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.423+0000 7f0e127fc640 1 --2- 172.21.15.146:0/4017026198 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0e08036af0 0x7f0e08038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.424+0000 7f0e127fc640 1 -- 172.21.15.146:0/4017026198 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f0f38034070 con 0x56350d209c10 2024-09-18T01:45:22.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.424+0000 7f0f3c86e640 1 --2- 172.21.15.146:0/4017026198 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0e08036af0 0x7f0e08038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.424+0000 7f0f3c86e640 1 --2- 172.21.15.146:0/4017026198 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0e08036af0 0x7f0e08038fb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0f3004ba50 tx=0x7f0f30035000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.424+0000 7f0f41213800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.424+0000 7f0f41213800 1 --2- 172.21.15.146:0/4017026198 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56350d21cd50 0x56350d21f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.424+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56350d21f960 con 0x56350d21cd50 2024-09-18T01:45:22.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.424+0000 7f0f37fff640 1 --2- 172.21.15.146:0/4017026198 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56350d21cd50 0x56350d21f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.425+0000 7f0f37fff640 1 --2- 172.21.15.146:0/4017026198 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56350d21cd50 0x56350d21f210 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.425+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0f28057030 con 0x56350d21cd50 2024-09-18T01:45:22.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.425+0000 7f0f41213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:22.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.425+0000 7f0f41213800 20 realm 2024-09-18T01:45:22.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.425+0000 7f0f41213800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.425+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56350d21fd90 con 0x56350d21cd50 2024-09-18T01:45:22.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.425+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0f28057030 con 0x56350d21cd50 2024-09-18T01:45:22.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.425+0000 7f0f41213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:22.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.425+0000 7f0f41213800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:22.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.425+0000 7f0f41213800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.425+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56350d220660 con 0x56350d21cd50 2024-09-18T01:45:22.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.425+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0f28057030 con 0x56350d21cd50 2024-09-18T01:45:22.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.425+0000 7f0f41213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:22.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.425+0000 7f0f41213800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.425+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56350d220a00 con 0x56350d21cd50 2024-09-18T01:45:22.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.426+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0f28057030 con 0x56350d21cd50 2024-09-18T01:45:22.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.426+0000 7f0f41213800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:22.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.426+0000 7f0f41213800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.426+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56350d221250 con 0x56350d21cd50 2024-09-18T01:45:22.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.426+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0f28057030 con 0x56350d21cd50 2024-09-18T01:45:22.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.426+0000 7f0f41213800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:22.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.426+0000 7f0f41213800 20 searching for the correct realm 2024-09-18T01:45:22.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.426+0000 7f0f41213800 1 --2- 172.21.15.146:0/4017026198 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x56350d222fc0 0x56350d2253b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.426+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56350d2259e0 con 0x56350d222fc0 2024-09-18T01:45:22.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.426+0000 7f0f3d06f640 1 --2- 172.21.15.146:0/4017026198 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x56350d222fc0 0x56350d2253b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.426+0000 7f0f3d06f640 1 --2- 172.21.15.146:0/4017026198 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x56350d222fc0 0x56350d2253b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.427+0000 7f0f3d06f640 1 -- 172.21.15.146:0/4017026198 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f3803e020 con 0x56350d222fc0 2024-09-18T01:45:22.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.427+0000 7f0f3d06f640 1 --2- 172.21.15.146:0/4017026198 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f0f380123a0 0x7f0f38022420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.427+0000 7f0f3d06f640 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56350d2259e0 con 0x7f0f380123a0 2024-09-18T01:45:22.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.427+0000 7f0f3c86e640 1 --2- 172.21.15.146:0/4017026198 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f0f380123a0 0x7f0f38022420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.427+0000 7f0f3c86e640 1 --2- 172.21.15.146:0/4017026198 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f0f380123a0 0x7f0f38022420 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.427+0000 7f0f3c86e640 1 -- 172.21.15.146:0/4017026198 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f30054040 con 0x7f0f380123a0 2024-09-18T01:45:22.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.427+0000 7f0f3c86e640 1 --2- 172.21.15.146:0/4017026198 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f0f30018ab0 0x7f0f3000f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.427+0000 7f0f3c86e640 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56350d2259e0 con 0x7f0f30018ab0 2024-09-18T01:45:22.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.427+0000 7f0f37fff640 1 --2- 172.21.15.146:0/4017026198 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f0f30018ab0 0x7f0f3000f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.428+0000 7f0f37fff640 1 --2- 172.21.15.146:0/4017026198 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f0f30018ab0 0x7f0f3000f470 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.428+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f28057030 con 0x7f0f30018ab0 2024-09-18T01:45:22.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.428+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56350d2259e0 con 0x56350d21cd50 2024-09-18T01:45:22.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.428+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v24'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0f28057030 con 0x56350d21cd50 2024-09-18T01:45:22.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.428+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56350d2259e0 con 0x56350d21cd50 2024-09-18T01:45:22.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.428+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f28057030 con 0x56350d21cd50 2024-09-18T01:45:22.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.428+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56350d2259e0 con 0x7f0f30018ab0 2024-09-18T01:45:22.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.429+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f28057030 con 0x7f0f30018ab0 2024-09-18T01:45:22.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.429+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56350d2259e0 con 0x7f0f30018ab0 2024-09-18T01:45:22.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.429+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f28057030 con 0x7f0f30018ab0 2024-09-18T01:45:22.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.429+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56350d2259e0 con 0x7f0f380123a0 2024-09-18T01:45:22.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.429+0000 7f0f3c86e640 1 -- 172.21.15.146:0/4017026198 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f30054040 con 0x7f0f380123a0 2024-09-18T01:45:22.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.429+0000 7f0f3c86e640 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56350d2259e0 con 0x56350d222fc0 2024-09-18T01:45:22.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.429+0000 7f0f3d06f640 1 -- 172.21.15.146:0/4017026198 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f3803e020 con 0x56350d222fc0 2024-09-18T01:45:22.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.430+0000 7f0f3d06f640 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56350d2259e0 con 0x56350d21cd50 2024-09-18T01:45:22.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.430+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f28057030 con 0x56350d21cd50 2024-09-18T01:45:22.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.430+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56350d2259e0 con 0x7f0f30018ab0 2024-09-18T01:45:22.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.430+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f28057030 con 0x7f0f30018ab0 2024-09-18T01:45:22.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.430+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56350d2259e0 con 0x56350d21cd50 2024-09-18T01:45:22.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.430+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f28057030 con 0x56350d21cd50 2024-09-18T01:45:22.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.430+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56350d2259e0 con 0x7f0f380123a0 2024-09-18T01:45:22.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.431+0000 7f0f3c86e640 1 -- 172.21.15.146:0/4017026198 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f0f30054040 con 0x7f0f380123a0 2024-09-18T01:45:22.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.431+0000 7f0f3c86e640 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56350d2259e0 con 0x56350d222fc0 2024-09-18T01:45:22.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.431+0000 7f0f3d06f640 1 -- 172.21.15.146:0/4017026198 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f3803e020 con 0x56350d222fc0 2024-09-18T01:45:22.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.431+0000 7f0f3d06f640 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56350d2259e0 con 0x56350d222fc0 2024-09-18T01:45:22.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.431+0000 7f0f3d06f640 1 -- 172.21.15.146:0/4017026198 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f3803e020 con 0x56350d222fc0 2024-09-18T01:45:22.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.431+0000 7f0f3d06f640 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56350d2259e0 con 0x7f0f30018ab0 2024-09-18T01:45:22.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.431+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f28057030 con 0x7f0f30018ab0 2024-09-18T01:45:22.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.431+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56350d2259e0 con 0x56350d222fc0 2024-09-18T01:45:22.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.431+0000 7f0f3d06f640 1 -- 172.21.15.146:0/4017026198 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f3803e020 con 0x56350d222fc0 2024-09-18T01:45:22.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.432+0000 7f0f3d06f640 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56350d2259e0 con 0x56350d222fc0 2024-09-18T01:45:22.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.432+0000 7f0f3d06f640 1 -- 172.21.15.146:0/4017026198 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f3803e020 con 0x56350d222fc0 2024-09-18T01:45:22.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.432+0000 7f0f3d06f640 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56350d2259e0 con 0x56350d21cd50 2024-09-18T01:45:22.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.432+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f28057030 con 0x56350d21cd50 2024-09-18T01:45:22.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.432+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56350d2259e0 con 0x56350d21cd50 2024-09-18T01:45:22.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.432+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0f28057030 con 0x56350d21cd50 2024-09-18T01:45:22.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.432+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56350d2259e0 con 0x7f0f30018ab0 2024-09-18T01:45:22.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.432+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f28057030 con 0x7f0f30018ab0 2024-09-18T01:45:22.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.432+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56350d2259e0 con 0x56350d222fc0 2024-09-18T01:45:22.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.433+0000 7f0f3d06f640 1 -- 172.21.15.146:0/4017026198 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f3803e020 con 0x56350d222fc0 2024-09-18T01:45:22.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.433+0000 7f0f3d06f640 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56350d2259e0 con 0x7f0f380123a0 2024-09-18T01:45:22.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.433+0000 7f0f3c86e640 1 -- 172.21.15.146:0/4017026198 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f30054040 con 0x7f0f380123a0 2024-09-18T01:45:22.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.433+0000 7f0f3c86e640 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56350d2259e0 con 0x56350d21cd50 2024-09-18T01:45:22.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.433+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f28057030 con 0x56350d21cd50 2024-09-18T01:45:22.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.433+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56350d2259e0 con 0x7f0f30018ab0 2024-09-18T01:45:22.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.433+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f28057030 con 0x7f0f30018ab0 2024-09-18T01:45:22.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.433+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56350d2259e0 con 0x56350d222fc0 2024-09-18T01:45:22.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.434+0000 7f0f3d06f640 1 -- 172.21.15.146:0/4017026198 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f3803e020 con 0x56350d222fc0 2024-09-18T01:45:22.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.434+0000 7f0f3d06f640 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56350d2259e0 con 0x7f0f30018ab0 2024-09-18T01:45:22.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.434+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f28057030 con 0x7f0f30018ab0 2024-09-18T01:45:22.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.434+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56350d2259e0 con 0x7f0f380123a0 2024-09-18T01:45:22.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.434+0000 7f0f3c86e640 1 -- 172.21.15.146:0/4017026198 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f30054040 con 0x7f0f380123a0 2024-09-18T01:45:22.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.434+0000 7f0f3c86e640 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56350d2259e0 con 0x56350d222fc0 2024-09-18T01:45:22.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.434+0000 7f0f3d06f640 1 -- 172.21.15.146:0/4017026198 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f3803e020 con 0x56350d222fc0 2024-09-18T01:45:22.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.434+0000 7f0f3d06f640 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56350d2259e0 con 0x7f0f30018ab0 2024-09-18T01:45:22.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.435+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f28057030 con 0x7f0f30018ab0 2024-09-18T01:45:22.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.435+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56350d2259e0 con 0x56350d21cd50 2024-09-18T01:45:22.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.435+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0f28057030 con 0x56350d21cd50 2024-09-18T01:45:22.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.435+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56350d2259e0 con 0x7f0f380123a0 2024-09-18T01:45:22.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.435+0000 7f0f3c86e640 1 -- 172.21.15.146:0/4017026198 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f3005f040 con 0x7f0f380123a0 2024-09-18T01:45:22.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.435+0000 7f0f41213800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:22.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.435+0000 7f0f41213800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:22.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.435+0000 7f0f41213800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:22.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.435+0000 7f0f41213800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:22.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.435+0000 7f0f41213800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:22.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.435+0000 7f0f41213800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:22.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.435+0000 7f0f41213800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.435+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56350d221bd0 con 0x56350d21cd50 2024-09-18T01:45:22.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.435+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0f28057030 con 0x56350d21cd50 2024-09-18T01:45:22.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.435+0000 7f0f41213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:22.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.435+0000 7f0f41213800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.435+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56350d222470 con 0x56350d21cd50 2024-09-18T01:45:22.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.436+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0f28057030 con 0x56350d21cd50 2024-09-18T01:45:22.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.436+0000 7f0f41213800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:22.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.436+0000 7f0f41213800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.436+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56350d225e60 con 0x7f0f380123a0 2024-09-18T01:45:22.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.436+0000 7f0f3c86e640 1 -- 172.21.15.146:0/4017026198 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0f3005f040 con 0x7f0f380123a0 2024-09-18T01:45:22.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.436+0000 7f0f41213800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:22.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.436+0000 7f0f41213800 20 zone default found 2024-09-18T01:45:22.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.436+0000 7f0f41213800 4 Realm: () 2024-09-18T01:45:22.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.436+0000 7f0f41213800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:22.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.436+0000 7f0f41213800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:22.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.436+0000 7f0f41213800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:22.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.436+0000 7f0f41213800 20 zonegroup default 2024-09-18T01:45:22.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.436+0000 7f0f41213800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.436+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56350d2266b0 con 0x7f0f30018ab0 2024-09-18T01:45:22.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.436+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0f28057030 con 0x7f0f30018ab0 2024-09-18T01:45:22.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.436+0000 7f0f41213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:22.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.436+0000 7f0f41213800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.436+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56350d228090 con 0x56350d222fc0 2024-09-18T01:45:22.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.436+0000 7f0f3d06f640 1 -- 172.21.15.146:0/4017026198 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0f3803e020 con 0x56350d222fc0 2024-09-18T01:45:22.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.436+0000 7f0f41213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:22.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.436+0000 7f0f41213800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.436+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56350d2285a0 con 0x56350d222fc0 2024-09-18T01:45:22.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.437+0000 7f0f3d06f640 1 -- 172.21.15.146:0/4017026198 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0f3803e020 con 0x56350d222fc0 2024-09-18T01:45:22.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.437+0000 7f0f41213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:22.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.437+0000 7f0f41213800 20 started sync module instance, tier type = 2024-09-18T01:45:22.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.437+0000 7f0f41213800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:22.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.437+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d227520 con 0x7f0f380123a0 2024-09-18T01:45:22.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.438+0000 7f0f3c86e640 1 -- 172.21.15.146:0/4017026198 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v31'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f3005f040 con 0x7f0f380123a0 2024-09-18T01:45:22.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.438+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94785853618448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d228eb0 con 0x7f0f380123a0 2024-09-18T01:45:22.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.438+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d229700 con 0x56350d21cd50 2024-09-18T01:45:22.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.439+0000 7f0f3c86e640 1 -- 172.21.15.146:0/4017026198 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94785853618448] v31'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f3005f040 con 0x7f0f380123a0 2024-09-18T01:45:22.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.439+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v31'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f28057030 con 0x56350d21cd50 2024-09-18T01:45:22.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.439+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94785853622784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d229700 con 0x56350d21cd50 2024-09-18T01:45:22.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.439+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d22a1c0 con 0x56350d222fc0 2024-09-18T01:45:22.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.440+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94785853622784] v31'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f28057030 con 0x56350d21cd50 2024-09-18T01:45:22.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.440+0000 7f0f3d06f640 1 -- 172.21.15.146:0/4017026198 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v31'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f3803e020 con 0x56350d222fc0 2024-09-18T01:45:22.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.440+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94785853627632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d22a1c0 con 0x56350d222fc0 2024-09-18T01:45:22.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.440+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d22ac20 con 0x7f0f380123a0 2024-09-18T01:45:22.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.442+0000 7f0f3d06f640 1 -- 172.21.15.146:0/4017026198 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94785853627632] v31'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f3803e020 con 0x56350d222fc0 2024-09-18T01:45:22.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.442+0000 7f0f3c86e640 1 -- 172.21.15.146:0/4017026198 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v31'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f3005f040 con 0x7f0f380123a0 2024-09-18T01:45:22.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.443+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94785853624912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d22b040 con 0x7f0f380123a0 2024-09-18T01:45:22.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.443+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d22ba60 con 0x56350d21cd50 2024-09-18T01:45:22.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.444+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v31'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f28057030 con 0x56350d21cd50 2024-09-18T01:45:22.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.444+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94785853633872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d22c300 con 0x56350d21cd50 2024-09-18T01:45:22.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.444+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d22cde0 con 0x7f0f30018ab0 2024-09-18T01:45:22.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.445+0000 7f0f3c86e640 1 -- 172.21.15.146:0/4017026198 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94785853624912] v31'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f3005f040 con 0x7f0f380123a0 2024-09-18T01:45:22.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.445+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v31'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f28057030 con 0x7f0f30018ab0 2024-09-18T01:45:22.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.445+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94785853638896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d22cde0 con 0x7f0f30018ab0 2024-09-18T01:45:22.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.445+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d22d7f0 con 0x7f0f30018ab0 2024-09-18T01:45:22.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.445+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94785853633872] v31'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f28057030 con 0x56350d21cd50 2024-09-18T01:45:22.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.446+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94785853638896] v31'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f28057030 con 0x7f0f30018ab0 2024-09-18T01:45:22.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.447+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v31'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f28057030 con 0x7f0f30018ab0 2024-09-18T01:45:22.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.447+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94785853630256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d22d340 con 0x7f0f30018ab0 2024-09-18T01:45:22.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.447+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d22dd00 con 0x7f0f30018ab0 2024-09-18T01:45:22.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.449+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(58 notify.7 [create] v31'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f28057030 con 0x7f0f30018ab0 2024-09-18T01:45:22.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.449+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94785853642832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d22e120 con 0x7f0f30018ab0 2024-09-18T01:45:22.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.449+0000 7f0f41213800 20 add_watcher() i=0 2024-09-18T01:45:22.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.449+0000 7f0f41213800 20 add_watcher() i=1 2024-09-18T01:45:22.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.449+0000 7f0f41213800 20 add_watcher() i=2 2024-09-18T01:45:22.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.449+0000 7f0f41213800 20 add_watcher() i=3 2024-09-18T01:45:22.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.449+0000 7f0f41213800 20 add_watcher() i=4 2024-09-18T01:45:22.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.449+0000 7f0f41213800 20 add_watcher() i=5 2024-09-18T01:45:22.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.449+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94785853630256] v31'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f28057030 con 0x7f0f30018ab0 2024-09-18T01:45:22.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.449+0000 7f0f41213800 20 add_watcher() i=6 2024-09-18T01:45:22.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.450+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94785853642832] v31'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f28057030 con 0x7f0f30018ab0 2024-09-18T01:45:22.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.450+0000 7f0f41213800 20 add_watcher() i=7 2024-09-18T01:45:22.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.450+0000 7f0f41213800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:22.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.450+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56350d22e120 con 0x56350d21cd50 2024-09-18T01:45:22.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.450+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0f28057030 con 0x56350d21cd50 2024-09-18T01:45:22.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.450+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94785853643888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d22e090 con 0x56350d21cd50 2024-09-18T01:45:22.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.451+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94785853643888] v31'47 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0f28057030 con 0x56350d21cd50 2024-09-18T01:45:22.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.451+0000 7f0df2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:22.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.451+0000 7f0f41213800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:22.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.451+0000 7f0f41213800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:22.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.452+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d239a90 con 0x56350d21cd50 2024-09-18T01:45:22.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.453+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'43 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0f28057030 con 0x56350d21cd50 2024-09-18T01:45:22.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.453+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d23a160 con 0x7f0f30018ab0 2024-09-18T01:45:22.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.454+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0f28057030 con 0x7f0f30018ab0 2024-09-18T01:45:22.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.454+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d23a580 con 0x56350d222fc0 2024-09-18T01:45:22.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.455+0000 7f0f3d06f640 1 -- 172.21.15.146:0/4017026198 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0f3803e020 con 0x56350d222fc0 2024-09-18T01:45:22.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.455+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d23a560 con 0x56350d21cd50 2024-09-18T01:45:22.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.456+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'48 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0f28057030 con 0x56350d21cd50 2024-09-18T01:45:22.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.456+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d23ab70 con 0x7f0f380123a0 2024-09-18T01:45:22.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.457+0000 7f0f3c86e640 1 -- 172.21.15.146:0/4017026198 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'35 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0f3005f040 con 0x7f0f380123a0 2024-09-18T01:45:22.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.457+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d23b020 con 0x56350d222fc0 2024-09-18T01:45:22.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.458+0000 7f0f3d06f640 1 -- 172.21.15.146:0/4017026198 <== osd.3 v2:172.21.15.146:6809/4106661138 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'33 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0f3803e020 con 0x56350d222fc0 2024-09-18T01:45:22.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.458+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d23b020 con 0x56350d21cd50 2024-09-18T01:45:22.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.459+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0f28057030 con 0x56350d21cd50 2024-09-18T01:45:22.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.459+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d23b020 con 0x7f0f30018ab0 2024-09-18T01:45:22.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.461+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'25 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0f28057030 con 0x7f0f30018ab0 2024-09-18T01:45:22.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.461+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d23b020 con 0x7f0f380123a0 2024-09-18T01:45:22.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.462+0000 7f0f3c86e640 1 -- 172.21.15.146:0/4017026198 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0f3005f040 con 0x7f0f380123a0 2024-09-18T01:45:22.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.462+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d23b5d0 con 0x56350d222fc0 2024-09-18T01:45:22.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.463+0000 7f0f3d06f640 1 -- 172.21.15.146:0/4017026198 <== osd.3 v2:172.21.15.146:6809/4106661138 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0f3803e020 con 0x56350d222fc0 2024-09-18T01:45:22.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.463+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d23b5d0 con 0x7f0f380123a0 2024-09-18T01:45:22.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.465+0000 7f0f3c86e640 1 -- 172.21.15.146:0/4017026198 <== osd.2 v2:172.21.15.146:6800/3820039304 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'36 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f3005f040 con 0x7f0f380123a0 2024-09-18T01:45:22.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.465+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d23b5d0 con 0x7f0f30018ab0 2024-09-18T01:45:22.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.467+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'15 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f28057030 con 0x7f0f30018ab0 2024-09-18T01:45:22.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.467+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d23b5d0 con 0x7f0f380123a0 2024-09-18T01:45:22.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.468+0000 7f0f3c86e640 1 -- 172.21.15.146:0/4017026198 <== osd.2 v2:172.21.15.146:6800/3820039304 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f3005f040 con 0x7f0f380123a0 2024-09-18T01:45:22.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.468+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d23b5d0 con 0x7f0f30018ab0 2024-09-18T01:45:22.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.469+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'37 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f28057030 con 0x7f0f30018ab0 2024-09-18T01:45:22.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.469+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d23b5d0 con 0x56350d21cd50 2024-09-18T01:45:22.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.472+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'49 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f28057030 con 0x56350d21cd50 2024-09-18T01:45:22.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.472+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d23b5d0 con 0x56350d222fc0 2024-09-18T01:45:22.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.473+0000 7f0f3d06f640 1 -- 172.21.15.146:0/4017026198 <== osd.3 v2:172.21.15.146:6809/4106661138 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'29 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f3803e020 con 0x56350d222fc0 2024-09-18T01:45:22.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.473+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d23b5d0 con 0x7f0f380123a0 2024-09-18T01:45:22.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.474+0000 7f0f3c86e640 1 -- 172.21.15.146:0/4017026198 <== osd.2 v2:172.21.15.146:6800/3820039304 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'37 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f3005f040 con 0x7f0f380123a0 2024-09-18T01:45:22.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.474+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d23b5d0 con 0x56350d222fc0 2024-09-18T01:45:22.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.475+0000 7f0f3d06f640 1 -- 172.21.15.146:0/4017026198 <== osd.3 v2:172.21.15.146:6809/4106661138 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'25 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f3803e020 con 0x56350d222fc0 2024-09-18T01:45:22.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.475+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d23b5d0 con 0x56350d21cd50 2024-09-18T01:45:22.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.476+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f28057030 con 0x56350d21cd50 2024-09-18T01:45:22.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.476+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d23b5d0 con 0x56350d21cd50 2024-09-18T01:45:22.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.477+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'50 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f28057030 con 0x56350d21cd50 2024-09-18T01:45:22.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.477+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d23b5d0 con 0x56350d222fc0 2024-09-18T01:45:22.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.478+0000 7f0f3d06f640 1 -- 172.21.15.146:0/4017026198 <== osd.3 v2:172.21.15.146:6809/4106661138 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'30 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f3803e020 con 0x56350d222fc0 2024-09-18T01:45:22.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.478+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d23b5d0 con 0x7f0f380123a0 2024-09-18T01:45:22.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.479+0000 7f0f3c86e640 1 -- 172.21.15.146:0/4017026198 <== osd.2 v2:172.21.15.146:6800/3820039304 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'29 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f3005f040 con 0x7f0f380123a0 2024-09-18T01:45:22.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.479+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d23b5d0 con 0x56350d222fc0 2024-09-18T01:45:22.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.480+0000 7f0f3d06f640 1 -- 172.21.15.146:0/4017026198 <== osd.3 v2:172.21.15.146:6809/4106661138 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'21 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f3803e020 con 0x56350d222fc0 2024-09-18T01:45:22.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.480+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d23b5d0 con 0x56350d222fc0 2024-09-18T01:45:22.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.481+0000 7f0f3d06f640 1 -- 172.21.15.146:0/4017026198 <== osd.3 v2:172.21.15.146:6809/4106661138 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'31 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f3803e020 con 0x56350d222fc0 2024-09-18T01:45:22.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.481+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d23b5d0 con 0x56350d222fc0 2024-09-18T01:45:22.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.482+0000 7f0f3d06f640 1 -- 172.21.15.146:0/4017026198 <== osd.3 v2:172.21.15.146:6809/4106661138 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f3803e020 con 0x56350d222fc0 2024-09-18T01:45:22.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.482+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d23b5d0 con 0x56350d222fc0 2024-09-18T01:45:22.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.483+0000 7f0f3d06f640 1 -- 172.21.15.146:0/4017026198 <== osd.3 v2:172.21.15.146:6809/4106661138 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'34 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f3803e020 con 0x56350d222fc0 2024-09-18T01:45:22.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.483+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d23b5d0 con 0x7f0f30018ab0 2024-09-18T01:45:22.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.484+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'21 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f28057030 con 0x7f0f30018ab0 2024-09-18T01:45:22.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.484+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d23b5d0 con 0x56350d222fc0 2024-09-18T01:45:22.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.485+0000 7f0f3d06f640 1 -- 172.21.15.146:0/4017026198 <== osd.3 v2:172.21.15.146:6809/4106661138 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f3803e020 con 0x56350d222fc0 2024-09-18T01:45:22.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.485+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d23b5d0 con 0x7f0f30018ab0 2024-09-18T01:45:22.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.486+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.0 v2:172.21.15.129:6800/1759265424 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'26 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f28057030 con 0x7f0f30018ab0 2024-09-18T01:45:22.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.486+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d23b5d0 con 0x56350d222fc0 2024-09-18T01:45:22.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.487+0000 7f0f3d06f640 1 -- 172.21.15.146:0/4017026198 <== osd.3 v2:172.21.15.146:6809/4106661138 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'31 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f3803e020 con 0x56350d222fc0 2024-09-18T01:45:22.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.487+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d23b5d0 con 0x7f0f30018ab0 2024-09-18T01:45:22.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.488+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.0 v2:172.21.15.129:6800/1759265424 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'38 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f28057030 con 0x7f0f30018ab0 2024-09-18T01:45:22.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.488+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d23b5d0 con 0x7f0f380123a0 2024-09-18T01:45:22.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.489+0000 7f0f3c86e640 1 -- 172.21.15.146:0/4017026198 <== osd.2 v2:172.21.15.146:6800/3820039304 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f3005f040 con 0x7f0f380123a0 2024-09-18T01:45:22.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.489+0000 7f0df1fe3640 20 reqs_thread_entry: start 2024-09-18T01:45:22.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.490+0000 7f0f41213800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:22.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.490+0000 7f0f41213800 20 Filter name: none 2024-09-18T01:45:22.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.490+0000 7f0d637fe640 20 reqs_thread_entry: start 2024-09-18T01:45:22.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.490+0000 7f0f41213800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T01:45:22.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.490+0000 7f0f41213800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.490+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56350d266580 con 0x56350d21cd50 2024-09-18T01:45:22.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.490+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.1 v2:172.21.15.146:6808/3930274777 28 ==== osd_op_reply(94 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f0f28057030 con 0x56350d21cd50 2024-09-18T01:45:22.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.490+0000 7f0f41213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:22.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.490+0000 7f0f41213800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-18T01:45:22.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.490+0000 7f0f41213800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:45:22.492 INFO:teuthology.orchestra.run.smithi146.stderr:could not remove user: unable to remove user, user does not exist 2024-09-18T01:45:22.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.491+0000 7f0df2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:22.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.491+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94785853643888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d235490 con 0x56350d21cd50 2024-09-18T01:45:22.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.492+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.1 v2:172.21.15.146:6808/3930274777 29 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94785853643888] v31'51 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0f28057030 con 0x56350d21cd50 2024-09-18T01:45:22.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.492+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94785853618448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d235490 con 0x7f0f380123a0 2024-09-18T01:45:22.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.493+0000 7f0f3c86e640 1 -- 172.21.15.146:0/4017026198 <== osd.2 v2:172.21.15.146:6800/3820039304 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94785853618448] v31'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f3005f040 con 0x7f0f380123a0 2024-09-18T01:45:22.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.493+0000 7f0f41213800 20 remove_watcher() i=0 2024-09-18T01:45:22.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.493+0000 7f0f41213800 2 removed watcher, disabling cache 2024-09-18T01:45:22.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.493+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94785853622784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d227910 con 0x56350d21cd50 2024-09-18T01:45:22.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.494+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.1 v2:172.21.15.146:6808/3930274777 30 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94785853622784] v31'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f28057030 con 0x56350d21cd50 2024-09-18T01:45:22.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.494+0000 7f0f41213800 20 remove_watcher() i=1 2024-09-18T01:45:22.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.494+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94785853627632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d235490 con 0x56350d222fc0 2024-09-18T01:45:22.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.495+0000 7f0f3d06f640 1 -- 172.21.15.146:0/4017026198 <== osd.3 v2:172.21.15.146:6809/4106661138 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94785853627632] v31'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f3803e020 con 0x56350d222fc0 2024-09-18T01:45:22.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.495+0000 7f0f41213800 20 remove_watcher() i=2 2024-09-18T01:45:22.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.495+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94785853624912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d228a00 con 0x7f0f380123a0 2024-09-18T01:45:22.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.496+0000 7f0f3c86e640 1 -- 172.21.15.146:0/4017026198 <== osd.2 v2:172.21.15.146:6800/3820039304 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94785853624912] v31'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f3005f040 con 0x7f0f380123a0 2024-09-18T01:45:22.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.496+0000 7f0f41213800 20 remove_watcher() i=3 2024-09-18T01:45:22.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.496+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94785853633872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d227910 con 0x56350d21cd50 2024-09-18T01:45:22.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.497+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.1 v2:172.21.15.146:6808/3930274777 31 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94785853633872] v31'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f28057030 con 0x56350d21cd50 2024-09-18T01:45:22.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.497+0000 7f0f41213800 20 remove_watcher() i=4 2024-09-18T01:45:22.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.497+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94785853638896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d235490 con 0x7f0f30018ab0 2024-09-18T01:45:22.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.498+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.0 v2:172.21.15.129:6800/1759265424 24 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94785853638896] v31'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f28057030 con 0x7f0f30018ab0 2024-09-18T01:45:22.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.498+0000 7f0f41213800 20 remove_watcher() i=5 2024-09-18T01:45:22.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.498+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94785853630256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d228a00 con 0x7f0f30018ab0 2024-09-18T01:45:22.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.499+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.0 v2:172.21.15.129:6800/1759265424 25 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94785853630256] v31'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f28057030 con 0x7f0f30018ab0 2024-09-18T01:45:22.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.499+0000 7f0f41213800 20 remove_watcher() i=6 2024-09-18T01:45:22.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.499+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94785853642832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56350d227910 con 0x7f0f30018ab0 2024-09-18T01:45:22.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.500+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 <== osd.0 v2:172.21.15.129:6800/1759265424 26 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94785853642832] v31'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f28057030 con 0x7f0f30018ab0 2024-09-18T01:45:22.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.500+0000 7f0f41213800 20 remove_watcher() i=7 2024-09-18T01:45:22.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.500+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f0f30018ab0 msgr2=0x7f0f3000f470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.500+0000 7f0f41213800 1 --2- 172.21.15.146:0/4017026198 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f0f30018ab0 0x7f0f3000f470 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.500+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56350d21cd50 msgr2=0x56350d21f210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.500+0000 7f0f41213800 1 --2- 172.21.15.146:0/4017026198 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56350d21cd50 0x56350d21f210 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.500+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f0f380123a0 msgr2=0x7f0f38022420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.500+0000 7f0f41213800 1 --2- 172.21.15.146:0/4017026198 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f0f380123a0 0x7f0f38022420 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.500+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x56350d222fc0 msgr2=0x56350d2253b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.500+0000 7f0f41213800 1 --2- 172.21.15.146:0/4017026198 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x56350d222fc0 0x56350d2253b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.500+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0e08036af0 msgr2=0x7f0e08038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.500+0000 7f0f41213800 1 --2- 172.21.15.146:0/4017026198 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0e08036af0 0x7f0e08038fb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0f3004ba50 tx=0x7f0f30035000 comp rx=0 tx=0).stop 2024-09-18T01:45:22.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.500+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56350d209c10 msgr2=0x56350d2110f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.500+0000 7f0f41213800 1 --2- 172.21.15.146:0/4017026198 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56350d209c10 0x56350d2110f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0f38044040 tx=0x7f0f3804c880 comp rx=0 tx=0).stop 2024-09-18T01:45:22.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.500+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 reap_dead start 2024-09-18T01:45:22.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.500+0000 7f0f37fff640 1 -- 172.21.15.146:0/4017026198 reap_dead start 2024-09-18T01:45:22.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.500+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 shutdown_connections 2024-09-18T01:45:22.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.500+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 >> 172.21.15.146:0/4017026198 conn(0x56350d206000 msgr2=0x56350d2040d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:22.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.500+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 shutdown_connections 2024-09-18T01:45:22.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.500+0000 7f0f41213800 1 -- 172.21.15.146:0/4017026198 wait complete. 2024-09-18T01:45:22.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.500+0000 7f0f41213800 1 -- 172.21.15.146:0/1550335525 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0e14036b40 msgr2=0x7f0e14039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.500+0000 7f0f41213800 1 --2- 172.21.15.146:0/1550335525 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0e14036b40 0x7f0e14039000 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0f3000eb40 tx=0x7f0f300015f0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.500+0000 7f0f41213800 1 -- 172.21.15.146:0/1550335525 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56350d1fcfb0 msgr2=0x56350d1fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.500+0000 7f0f41213800 1 --2- 172.21.15.146:0/1550335525 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56350d1fcfb0 0x56350d1fd3d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x56350d1e36c0 tx=0x7f0f380178e0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.501+0000 7f0f41213800 1 -- 172.21.15.146:0/1550335525 shutdown_connections 2024-09-18T01:45:22.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.501+0000 7f0f41213800 1 --2- 172.21.15.146:0/1550335525 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0e14036b40 0x7f0e14039000 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.501+0000 7f0f41213800 1 --2- 172.21.15.146:0/1550335525 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56350d1fcfb0 0x56350d1fd3d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.501+0000 7f0f41213800 1 -- 172.21.15.146:0/1550335525 >> 172.21.15.146:0/1550335525 conn(0x56350d1f1f40 msgr2=0x56350d1f4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:22.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.501+0000 7f0f41213800 1 -- 172.21.15.146:0/1550335525 shutdown_connections 2024-09-18T01:45:22.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.501+0000 7f0f41213800 1 -- 172.21.15.146:0/1550335525 wait complete. 2024-09-18T01:45:22.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.501+0000 7f0f41213800 1 -- 172.21.15.146:0/3681265472 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56350d0eda60 msgr2=0x56350d1e9330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.501+0000 7f0f41213800 1 --2- 172.21.15.146:0/3681265472 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56350d0eda60 0x56350d1e9330 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.501+0000 7f0f41213800 1 -- 172.21.15.146:0/3681265472 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x56350d1eca00 msgr2=0x56350d1eedf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.501+0000 7f0f41213800 1 --2- 172.21.15.146:0/3681265472 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x56350d1eca00 0x56350d1eedf0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.501+0000 7f0f41213800 1 -- 172.21.15.146:0/3681265472 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0e24036b40 msgr2=0x7f0e24039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.501+0000 7f0f41213800 1 --2- 172.21.15.146:0/3681265472 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0e24036b40 0x7f0e24039000 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0f28057000 tx=0x7f0f28052000 comp rx=0 tx=0).stop 2024-09-18T01:45:22.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.501+0000 7f0f41213800 1 -- 172.21.15.146:0/3681265472 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56350d0e9760 msgr2=0x56350d1e22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.501+0000 7f0f41213800 1 --2- 172.21.15.146:0/3681265472 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56350d0e9760 0x56350d1e22c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0f30000f60 tx=0x7f0f30000ed0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.501+0000 7f0f41213800 1 -- 172.21.15.146:0/3681265472 shutdown_connections 2024-09-18T01:45:22.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.501+0000 7f0f41213800 1 --2- 172.21.15.146:0/3681265472 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x56350d1eca00 0x56350d1eedf0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.501+0000 7f0f41213800 1 --2- 172.21.15.146:0/3681265472 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56350d0eda60 0x56350d1e9330 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.501+0000 7f0f41213800 1 --2- 172.21.15.146:0/3681265472 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0e24036b40 0x7f0e24039000 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.501+0000 7f0f41213800 1 --2- 172.21.15.146:0/3681265472 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56350d0e9760 0x56350d1e22c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.501+0000 7f0f41213800 1 -- 172.21.15.146:0/3681265472 >> 172.21.15.146:0/3681265472 conn(0x56350d0e4ff0 msgr2=0x56350d1d3bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:22.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.501+0000 7f0f41213800 1 -- 172.21.15.146:0/3681265472 shutdown_connections 2024-09-18T01:45:22.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.501+0000 7f0f41213800 1 -- 172.21.15.146:0/3681265472 wait complete. 2024-09-18T01:45:22.510 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-18T01:45:22.511 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-18T01:45:22.511 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-18T01:45:22.511 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-18T01:45:22.557 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:22.557 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:22.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.557+0000 7f16c362f800 1 Processor -- start 2024-09-18T01:45:22.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.557+0000 7f16c362f800 1 -- start start 2024-09-18T01:45:22.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.557+0000 7f16c362f800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55ca7035fe40 0x55ca70362230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.557+0000 7f16c362f800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ca70218b30 con 0x55ca702cd700 2024-09-18T01:45:22.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.557+0000 7f16c362f800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x55ca701fa360 con 0x55ca7035fe40 2024-09-18T01:45:22.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.558+0000 7f16c0929640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55ca7035fe40 0x55ca70362230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.558+0000 7f16c0929640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55ca7035fe40 0x55ca70362230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59354/0 (socket says 172.21.15.146:59354) 2024-09-18T01:45:22.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.558+0000 7f16c112a640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x55ca702cd700 0x55ca7035e720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:38656/0 (socket says 172.21.15.146:38656) 2024-09-18T01:45:22.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.558+0000 7f16c0929640 1 -- 172.21.15.146:0/2351139211 learned_addr learned my addr 172.21.15.146:0/2351139211 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:22.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.558+0000 7f16c0929640 1 -- 172.21.15.146:0/2351139211 >> v1:172.21.15.129:6789/0 conn(0x55ca702cd700 legacy=0x55ca7035e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.558+0000 7f16c0929640 1 -- 172.21.15.146:0/2351139211 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca70220e00 con 0x55ca7035fe40 2024-09-18T01:45:22.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.560+0000 7f16c0929640 1 --2- 172.21.15.146:0/2351139211 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ca7035fe40 0x55ca70362230 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f16b800a520 tx=0x7f16b8045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3907265f24b88cb server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.560+0000 7f16b3fff640 1 -- 172.21.15.146:0/2351139211 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16b8055070 con 0x55ca7035fe40 2024-09-18T01:45:22.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.560+0000 7f16b3fff640 1 -- 172.21.15.146:0/2351139211 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16b80515b0 con 0x55ca7035fe40 2024-09-18T01:45:22.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.560+0000 7f16b3fff640 1 -- 172.21.15.146:0/2351139211 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16b80518d0 con 0x55ca7035fe40 2024-09-18T01:45:22.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.560+0000 7f16c362f800 1 -- 172.21.15.146:0/2351139211 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ca7035fe40 msgr2=0x55ca70362230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.560+0000 7f16c362f800 1 --2- 172.21.15.146:0/2351139211 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ca7035fe40 0x55ca70362230 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f16b800a520 tx=0x7f16b8045ba0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.560+0000 7f16c362f800 1 -- 172.21.15.146:0/2351139211 shutdown_connections 2024-09-18T01:45:22.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.560+0000 7f16c362f800 1 --2- 172.21.15.146:0/2351139211 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ca7035fe40 0x55ca70362230 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.560+0000 7f16c362f800 1 -- 172.21.15.146:0/2351139211 >> 172.21.15.146:0/2351139211 conn(0x55ca70353e90 msgr2=0x55ca703562b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:22.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.560+0000 7f16c362f800 1 -- 172.21.15.146:0/2351139211 shutdown_connections 2024-09-18T01:45:22.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.560+0000 7f16c362f800 1 -- 172.21.15.146:0/2351139211 wait complete. 2024-09-18T01:45:22.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.574+0000 7f16c362f800 1 Processor -- start 2024-09-18T01:45:22.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.574+0000 7f16c362f800 1 -- start start 2024-09-18T01:45:22.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.574+0000 7f16c362f800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ca702cd700 0x55ca7044ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.574+0000 7f16c362f800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55ca702a5350 con 0x55ca702cd700 2024-09-18T01:45:22.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.575+0000 7f16c112a640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ca702cd700 0x55ca7044ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.575+0000 7f16c112a640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ca702cd700 0x55ca7044ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59356/0 (socket says 172.21.15.146:59356) 2024-09-18T01:45:22.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.575+0000 7f16c112a640 1 -- 172.21.15.146:0/322901549 learned_addr learned my addr 172.21.15.146:0/322901549 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:22.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.575+0000 7f16c112a640 1 -- 172.21.15.146:0/322901549 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca701f2bc0 con 0x55ca702cd700 2024-09-18T01:45:22.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.575+0000 7f16c112a640 1 --2- 172.21.15.146:0/322901549 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ca702cd700 0x55ca7044ab40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f16b4001e40 tx=0x7f16b4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=396efb39e4a40afa server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.575+0000 7f15af606640 1 -- 172.21.15.146:0/322901549 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16b400e5c0 con 0x55ca702cd700 2024-09-18T01:45:22.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.575+0000 7f15af606640 1 -- 172.21.15.146:0/322901549 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16b4006070 con 0x55ca702cd700 2024-09-18T01:45:22.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.575+0000 7f15af606640 1 -- 172.21.15.146:0/322901549 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16b400e910 con 0x55ca702cd700 2024-09-18T01:45:22.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.576+0000 7f16c362f800 1 -- 172.21.15.146:0/322901549 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ca702cd700 msgr2=0x55ca7044ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.576+0000 7f16c362f800 1 --2- 172.21.15.146:0/322901549 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ca702cd700 0x55ca7044ab40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f16b4001e40 tx=0x7f16b4001e70 comp rx=0 tx=0).stop 2024-09-18T01:45:22.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.576+0000 7f16c362f800 1 -- 172.21.15.146:0/322901549 shutdown_connections 2024-09-18T01:45:22.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.576+0000 7f16c362f800 1 --2- 172.21.15.146:0/322901549 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ca702cd700 0x55ca7044ab40 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.576+0000 7f16c362f800 1 -- 172.21.15.146:0/322901549 >> 172.21.15.146:0/322901549 conn(0x55ca70353e90 msgr2=0x55ca70446500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:22.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.576+0000 7f16c362f800 1 -- 172.21.15.146:0/322901549 shutdown_connections 2024-09-18T01:45:22.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.576+0000 7f16c362f800 1 -- 172.21.15.146:0/322901549 wait complete. 2024-09-18T01:45:22.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.576+0000 7f16c362f800 1 Processor -- start 2024-09-18T01:45:22.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.576+0000 7f16c362f800 1 -- start start 2024-09-18T01:45:22.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.577+0000 7f16c362f800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ca702cd700 0x55ca70452550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.577+0000 7f16c362f800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55ca70362a10 con 0x55ca702cd700 2024-09-18T01:45:22.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.577+0000 7f16c112a640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ca702cd700 0x55ca70452550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.577+0000 7f16c112a640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ca702cd700 0x55ca70452550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59358/0 (socket says 172.21.15.146:59358) 2024-09-18T01:45:22.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.577+0000 7f16c112a640 1 -- 172.21.15.146:0/3083332070 learned_addr learned my addr 172.21.15.146:0/3083332070 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:22.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.577+0000 7f16c112a640 1 -- 172.21.15.146:0/3083332070 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca70206fe0 con 0x55ca702cd700 2024-09-18T01:45:22.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.577+0000 7f16c112a640 1 --2- 172.21.15.146:0/3083332070 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ca702cd700 0x55ca70452550 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f16b4004000 tx=0x7f16b4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.577+0000 7f15ade03640 1 -- 172.21.15.146:0/3083332070 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16b401a7c0 con 0x55ca702cd700 2024-09-18T01:45:22.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.577+0000 7f15ade03640 1 -- 172.21.15.146:0/3083332070 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16b401a960 con 0x55ca702cd700 2024-09-18T01:45:22.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.577+0000 7f16c362f800 1 -- 172.21.15.146:0/3083332070 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ca70452a90 con 0x55ca702cd700 2024-09-18T01:45:22.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.577+0000 7f15ade03640 1 -- 172.21.15.146:0/3083332070 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16b401acc0 con 0x55ca702cd700 2024-09-18T01:45:22.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.578+0000 7f16c362f800 1 -- 172.21.15.146:0/3083332070 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca70452fb0 con 0x55ca702cd700 2024-09-18T01:45:22.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.578+0000 7f16c362f800 1 Processor -- start 2024-09-18T01:45:22.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.578+0000 7f16c362f800 1 -- start start 2024-09-18T01:45:22.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.578+0000 7f15ade03640 1 -- 172.21.15.146:0/3083332070 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f16b4017070 con 0x55ca702cd700 2024-09-18T01:45:22.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.578+0000 7f16c362f800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ca7045f2f0 0x55ca7045f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.578+0000 7f16c362f800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55ca701f4580 con 0x55ca7045f2f0 2024-09-18T01:45:22.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.578+0000 7f15ade03640 1 --2- 172.21.15.146:0/3083332070 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f15a8036b40 0x7f15a8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.579+0000 7f15ade03640 1 -- 172.21.15.146:0/3083332070 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f16b4015020 con 0x55ca702cd700 2024-09-18T01:45:22.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.579+0000 7f16c112a640 1 --2- 172.21.15.146:0/3083332070 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f15a8036b40 0x7f15a8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.579+0000 7f16c192b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ca7045f2f0 0x55ca7045f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.579+0000 7f16c192b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ca7045f2f0 0x55ca7045f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59366/0 (socket says 172.21.15.146:59366) 2024-09-18T01:45:22.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.579+0000 7f16c192b640 1 -- 172.21.15.146:0/3360894203 learned_addr learned my addr 172.21.15.146:0/3360894203 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:22.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.579+0000 7f16c112a640 1 --2- 172.21.15.146:0/3083332070 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f15a8036b40 0x7f15a8039000 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f16b4001270 tx=0x7f16b401d820 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.579+0000 7f16c192b640 1 -- 172.21.15.146:0/3360894203 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca7045fc30 con 0x55ca7045f2f0 2024-09-18T01:45:22.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.579+0000 7f16c192b640 1 --2- 172.21.15.146:0/3360894203 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ca7045f2f0 0x55ca7045f6f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f16bc00a430 tx=0x7f16bc00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9721ca357a403a88 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.579+0000 7f15a77fe640 1 -- 172.21.15.146:0/3360894203 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16bc015070 con 0x55ca7045f2f0 2024-09-18T01:45:22.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.579+0000 7f15a77fe640 1 -- 172.21.15.146:0/3360894203 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16bc001670 con 0x55ca7045f2f0 2024-09-18T01:45:22.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.579+0000 7f15a77fe640 1 -- 172.21.15.146:0/3360894203 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16bc001990 con 0x55ca7045f2f0 2024-09-18T01:45:22.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.580+0000 7f16c362f800 1 -- 172.21.15.146:0/3360894203 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ca7045f2f0 msgr2=0x55ca7045f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.580+0000 7f16c362f800 1 --2- 172.21.15.146:0/3360894203 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ca7045f2f0 0x55ca7045f6f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f16bc00a430 tx=0x7f16bc00a8f0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.580+0000 7f16c362f800 1 -- 172.21.15.146:0/3360894203 shutdown_connections 2024-09-18T01:45:22.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.580+0000 7f16c362f800 1 --2- 172.21.15.146:0/3360894203 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ca7045f2f0 0x55ca7045f6f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.580+0000 7f16c362f800 1 -- 172.21.15.146:0/3360894203 >> 172.21.15.146:0/3360894203 conn(0x55ca7035fe40 msgr2=0x55ca7045aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:22.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.580+0000 7f16c362f800 1 -- 172.21.15.146:0/3360894203 shutdown_connections 2024-09-18T01:45:22.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.580+0000 7f16c362f800 1 -- 172.21.15.146:0/3360894203 wait complete. 2024-09-18T01:45:22.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.580+0000 7f16c362f800 1 Processor -- start 2024-09-18T01:45:22.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.580+0000 7f16c362f800 1 -- start start 2024-09-18T01:45:22.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.580+0000 7f16c362f800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ca7045f2f0 0x55ca70466920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.580+0000 7f16c362f800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55ca704605e0 con 0x55ca7045f2f0 2024-09-18T01:45:22.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.580+0000 7f16c192b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ca7045f2f0 0x55ca70466920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.580+0000 7f16c192b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ca7045f2f0 0x55ca70466920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59372/0 (socket says 172.21.15.146:59372) 2024-09-18T01:45:22.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.580+0000 7f16c192b640 1 -- 172.21.15.146:0/3361201006 learned_addr learned my addr 172.21.15.146:0/3361201006 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:22.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.581+0000 7f16c192b640 1 -- 172.21.15.146:0/3361201006 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca70466e60 con 0x55ca7045f2f0 2024-09-18T01:45:22.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.581+0000 7f16c192b640 1 --2- 172.21.15.146:0/3361201006 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ca7045f2f0 0x55ca70466920 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f16bc00a930 tx=0x7f16bc003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.581+0000 7f15a5ffb640 1 -- 172.21.15.146:0/3361201006 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16bc020020 con 0x55ca7045f2f0 2024-09-18T01:45:22.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.581+0000 7f15a5ffb640 1 -- 172.21.15.146:0/3361201006 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16bc0108b0 con 0x55ca7045f2f0 2024-09-18T01:45:22.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.581+0000 7f16c362f800 1 -- 172.21.15.146:0/3361201006 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ca704670f0 con 0x55ca7045f2f0 2024-09-18T01:45:22.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.581+0000 7f15a5ffb640 1 -- 172.21.15.146:0/3361201006 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16bc015040 con 0x55ca7045f2f0 2024-09-18T01:45:22.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.581+0000 7f16c362f800 1 -- 172.21.15.146:0/3361201006 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca70469da0 con 0x55ca7045f2f0 2024-09-18T01:45:22.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.582+0000 7f15a5ffb640 1 -- 172.21.15.146:0/3361201006 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f16bc023020 con 0x55ca7045f2f0 2024-09-18T01:45:22.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.582+0000 7f15a5ffb640 1 --2- 172.21.15.146:0/3361201006 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1598036b40 0x7f1598039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.582+0000 7f15a5ffb640 1 -- 172.21.15.146:0/3361201006 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f16bc04c280 con 0x55ca7045f2f0 2024-09-18T01:45:22.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.582+0000 7f16c0929640 1 --2- 172.21.15.146:0/3361201006 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1598036b40 0x7f1598039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.582+0000 7f16c362f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:22.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.582+0000 7f16c362f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:22.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.583+0000 7f16c0929640 1 --2- 172.21.15.146:0/3361201006 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1598036b40 0x7f1598039000 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f16b8057000 tx=0x7f16b8052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.583+0000 7f16c362f800 1 Processor -- start 2024-09-18T01:45:22.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.583+0000 7f16c362f800 1 -- start start 2024-09-18T01:45:22.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.583+0000 7f16c362f800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ca70480940 0x55ca70480d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.583+0000 7f16c362f800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55ca7044b2f0 con 0x55ca70480940 2024-09-18T01:45:22.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.583+0000 7f16c112a640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ca70480940 0x55ca70480d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.583+0000 7f16c112a640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ca70480940 0x55ca70480d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59376/0 (socket says 172.21.15.146:59376) 2024-09-18T01:45:22.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.583+0000 7f16c112a640 1 -- 172.21.15.146:0/1622042312 learned_addr learned my addr 172.21.15.146:0/1622042312 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:22.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.583+0000 7f16c112a640 1 -- 172.21.15.146:0/1622042312 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca70481330 con 0x55ca70480940 2024-09-18T01:45:22.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.584+0000 7f16c112a640 1 --2- 172.21.15.146:0/1622042312 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ca70480940 0x55ca70480d60 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f16b401dfb0 tx=0x7f16b4013c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.584+0000 7f15867e4640 1 -- 172.21.15.146:0/1622042312 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16b40193e0 con 0x55ca70480940 2024-09-18T01:45:22.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.584+0000 7f15867e4640 1 -- 172.21.15.146:0/1622042312 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16b400fa90 con 0x55ca70480940 2024-09-18T01:45:22.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.584+0000 7f16c362f800 1 -- 172.21.15.146:0/1622042312 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ca70483f80 con 0x55ca70480940 2024-09-18T01:45:22.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.584+0000 7f15867e4640 1 -- 172.21.15.146:0/1622042312 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16b401dbe0 con 0x55ca70480940 2024-09-18T01:45:22.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.584+0000 7f16c362f800 1 -- 172.21.15.146:0/1622042312 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca70484360 con 0x55ca70480940 2024-09-18T01:45:22.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.584+0000 7f15867e4640 1 -- 172.21.15.146:0/1622042312 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f16b4017bc0 con 0x55ca70480940 2024-09-18T01:45:22.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.585+0000 7f15867e4640 1 --2- 172.21.15.146:0/1622042312 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f14f8036b90 0x7f14f8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.585+0000 7f15867e4640 1 -- 172.21.15.146:0/1622042312 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f16b4038070 con 0x55ca70480940 2024-09-18T01:45:22.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.585+0000 7f16c0929640 1 --2- 172.21.15.146:0/1622042312 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f14f8036b90 0x7f14f8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.585+0000 7f157ffff640 20 reqs_thread_entry: start 2024-09-18T01:45:22.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.585+0000 7f16c362f800 1 --2- 172.21.15.146:0/3083332070 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55ca7048e340 0x55ca70490790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.585+0000 7f16c362f800 1 -- 172.21.15.146:0/3083332070 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ca70490e60 con 0x55ca7048e340 2024-09-18T01:45:22.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.585+0000 7f16c0929640 1 --2- 172.21.15.146:0/1622042312 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f14f8036b90 0x7f14f8039050 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f16b8045be0 tx=0x7f16b8005ac0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.585+0000 7f16c192b640 1 --2- 172.21.15.146:0/3083332070 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55ca7048e340 0x55ca70490790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.585+0000 7f16c192b640 1 --2- 172.21.15.146:0/3083332070 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55ca7048e340 0x55ca70490790 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.586+0000 7f16c192b640 1 -- 172.21.15.146:0/3083332070 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f16bc00e070 con 0x55ca7048e340 2024-09-18T01:45:22.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.586+0000 7f16c362f800 1 -- 172.21.15.146:0/3083332070 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ca70492720 con 0x55ca7048e340 2024-09-18T01:45:22.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.586+0000 7f16c192b640 1 -- 172.21.15.146:0/3083332070 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f16bc00e070 con 0x55ca7048e340 2024-09-18T01:45:22.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.586+0000 7f16c362f800 1 -- 172.21.15.146:0/3083332070 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ca704972c0 con 0x55ca7048e340 2024-09-18T01:45:22.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.587+0000 7f16c192b640 1 -- 172.21.15.146:0/3083332070 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [stat,call,call,writefull 0~993] v31'2 uv2 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f16bc00e070 con 0x55ca7048e340 2024-09-18T01:45:22.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.588+0000 7f16c362f800 1 -- 172.21.15.146:0/3361201006 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1598036b40 msgr2=0x7f1598039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.588+0000 7f16c362f800 1 --2- 172.21.15.146:0/3361201006 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1598036b40 0x7f1598039000 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f16b8057000 tx=0x7f16b8052000 comp rx=0 tx=0).stop 2024-09-18T01:45:22.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.588+0000 7f16c362f800 1 -- 172.21.15.146:0/3361201006 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ca7045f2f0 msgr2=0x55ca70466920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.588+0000 7f16c362f800 1 --2- 172.21.15.146:0/3361201006 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ca7045f2f0 0x55ca70466920 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f16bc00a930 tx=0x7f16bc003370 comp rx=0 tx=0).stop 2024-09-18T01:45:22.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.588+0000 7f16c362f800 1 -- 172.21.15.146:0/3361201006 shutdown_connections 2024-09-18T01:45:22.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.588+0000 7f16c362f800 1 --2- 172.21.15.146:0/3361201006 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1598036b40 0x7f1598039000 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.588+0000 7f16c362f800 1 --2- 172.21.15.146:0/3361201006 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ca7045f2f0 0x55ca70466920 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.588+0000 7f16c362f800 1 -- 172.21.15.146:0/3361201006 >> 172.21.15.146:0/3361201006 conn(0x55ca7035fe40 msgr2=0x55ca7045a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:22.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.588+0000 7f16c362f800 1 -- 172.21.15.146:0/3361201006 shutdown_connections 2024-09-18T01:45:22.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.588+0000 7f16c362f800 1 -- 172.21.15.146:0/3361201006 wait complete. 2024-09-18T01:45:22.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.589+0000 7f16c362f800 1 -- 172.21.15.146:0/1622042312 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f14f8036b90 msgr2=0x7f14f8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.589+0000 7f16c362f800 1 --2- 172.21.15.146:0/1622042312 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f14f8036b90 0x7f14f8039050 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f16b8045be0 tx=0x7f16b8005ac0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.589+0000 7f16c362f800 1 -- 172.21.15.146:0/1622042312 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ca70480940 msgr2=0x55ca70480d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.589+0000 7f16c362f800 1 --2- 172.21.15.146:0/1622042312 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ca70480940 0x55ca70480d60 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f16b401dfb0 tx=0x7f16b4013c70 comp rx=0 tx=0).stop 2024-09-18T01:45:22.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.589+0000 7f16c362f800 1 -- 172.21.15.146:0/1622042312 shutdown_connections 2024-09-18T01:45:22.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.589+0000 7f16c362f800 1 --2- 172.21.15.146:0/1622042312 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f14f8036b90 0x7f14f8039050 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.589+0000 7f16c362f800 1 --2- 172.21.15.146:0/1622042312 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ca70480940 0x55ca70480d60 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.589+0000 7f16c362f800 1 -- 172.21.15.146:0/1622042312 >> 172.21.15.146:0/1622042312 conn(0x55ca70475870 msgr2=0x55ca70478160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:22.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.589+0000 7f16c362f800 1 -- 172.21.15.146:0/1622042312 shutdown_connections 2024-09-18T01:45:22.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.589+0000 7f16c362f800 1 -- 172.21.15.146:0/1622042312 wait complete. 2024-09-18T01:45:22.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.589+0000 7f16c362f800 1 -- 172.21.15.146:0/3083332070 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55ca7048e340 msgr2=0x55ca70490790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.589+0000 7f16c362f800 1 --2- 172.21.15.146:0/3083332070 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55ca7048e340 0x55ca70490790 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.589+0000 7f16c362f800 1 -- 172.21.15.146:0/3083332070 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f15a8036b40 msgr2=0x7f15a8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.589+0000 7f16c362f800 1 --2- 172.21.15.146:0/3083332070 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f15a8036b40 0x7f15a8039000 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f16b4001270 tx=0x7f16b401d820 comp rx=0 tx=0).stop 2024-09-18T01:45:22.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.589+0000 7f16c362f800 1 -- 172.21.15.146:0/3083332070 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ca702cd700 msgr2=0x55ca70452550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.589+0000 7f16c362f800 1 --2- 172.21.15.146:0/3083332070 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ca702cd700 0x55ca70452550 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f16b4004000 tx=0x7f16b4000bc0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.589+0000 7f16c362f800 1 -- 172.21.15.146:0/3083332070 shutdown_connections 2024-09-18T01:45:22.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.589+0000 7f16c362f800 1 --2- 172.21.15.146:0/3083332070 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55ca7048e340 0x55ca70490790 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.589+0000 7f16c362f800 1 --2- 172.21.15.146:0/3083332070 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f15a8036b40 0x7f15a8039000 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.589+0000 7f16c362f800 1 --2- 172.21.15.146:0/3083332070 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ca702cd700 0x55ca70452550 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.589+0000 7f16c362f800 1 -- 172.21.15.146:0/3083332070 >> 172.21.15.146:0/3083332070 conn(0x55ca70353e90 msgr2=0x55ca70444db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:22.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.589+0000 7f16c362f800 1 -- 172.21.15.146:0/3083332070 shutdown_connections 2024-09-18T01:45:22.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.589+0000 7f16c362f800 1 -- 172.21.15.146:0/3083332070 wait complete. 2024-09-18T01:45:22.598 INFO:teuthology.orchestra.run.smithi146.stdout:{"id":"8ac01ed4-7422-45e2-b799-bf55088fb4fc","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-18T01:45:22.598 DEBUG:tasks.util.rgw: json result: {'id': '8ac01ed4-7422-45e2-b799-bf55088fb4fc', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-18T01:45:22.600 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-18T01:45:22.600 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-18T01:45:22.600 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-18T01:45:22.644 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:22.644 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:22.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.644+0000 7f47fc210800 1 Processor -- start 2024-09-18T01:45:22.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.644+0000 7f47fc210800 1 -- start start 2024-09-18T01:45:22.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.644+0000 7f47fc210800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55663880ed80 0x556638811170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.644+0000 7f47fc210800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5566386c7b30 con 0x55663877c600 2024-09-18T01:45:22.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.644+0000 7f47fc210800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x5566386a9360 con 0x55663880ed80 2024-09-18T01:45:22.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.645+0000 7f47ef183640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55663880ed80 0x556638811170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.645+0000 7f47ef183640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55663880ed80 0x556638811170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59386/0 (socket says 172.21.15.146:59386) 2024-09-18T01:45:22.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.645+0000 7f47ef183640 1 -- 172.21.15.146:0/2973608594 learned_addr learned my addr 172.21.15.146:0/2973608594 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:22.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.645+0000 7f47f7984640 1 --1- 172.21.15.146:0/2973608594 >> v1:172.21.15.129:6789/0 conn(0x55663877c600 0x55663880d660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:38662/0 (socket says 172.21.15.146:38662) 2024-09-18T01:45:22.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.645+0000 7f47ef183640 1 -- 172.21.15.146:0/2973608594 >> v1:172.21.15.129:6789/0 conn(0x55663877c600 legacy=0x55663880d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.645+0000 7f47ef183640 1 -- 172.21.15.146:0/2973608594 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566386cfe00 con 0x55663880ed80 2024-09-18T01:45:22.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.647+0000 7f47ef183640 1 --2- 172.21.15.146:0/2973608594 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55663880ed80 0x556638811170 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f47e000a520 tx=0x7f47e0045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=769b417dbb662a54 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.647+0000 7f47f7183640 1 -- 172.21.15.146:0/2973608594 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47e0055070 con 0x55663880ed80 2024-09-18T01:45:22.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.647+0000 7f47f7183640 1 -- 172.21.15.146:0/2973608594 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47e00515b0 con 0x55663880ed80 2024-09-18T01:45:22.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.647+0000 7f47f7183640 1 -- 172.21.15.146:0/2973608594 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47e00518d0 con 0x55663880ed80 2024-09-18T01:45:22.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.647+0000 7f47fc210800 1 -- 172.21.15.146:0/2973608594 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55663880ed80 msgr2=0x556638811170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.647+0000 7f47fc210800 1 --2- 172.21.15.146:0/2973608594 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55663880ed80 0x556638811170 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f47e000a520 tx=0x7f47e0045ba0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.647+0000 7f47fc210800 1 -- 172.21.15.146:0/2973608594 shutdown_connections 2024-09-18T01:45:22.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.647+0000 7f47fc210800 1 --2- 172.21.15.146:0/2973608594 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55663880ed80 0x556638811170 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.647+0000 7f47fc210800 1 -- 172.21.15.146:0/2973608594 >> 172.21.15.146:0/2973608594 conn(0x556638802dd0 msgr2=0x5566388051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:22.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.647+0000 7f47fc210800 1 -- 172.21.15.146:0/2973608594 shutdown_connections 2024-09-18T01:45:22.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.647+0000 7f47fc210800 1 -- 172.21.15.146:0/2973608594 wait complete. 2024-09-18T01:45:22.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.661+0000 7f47fc210800 1 Processor -- start 2024-09-18T01:45:22.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.661+0000 7f47fc210800 1 -- start start 2024-09-18T01:45:22.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.661+0000 7f47fc210800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55663877c600 0x5566388f9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.661+0000 7f47fc210800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x556638754320 con 0x55663877c600 2024-09-18T01:45:22.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.661+0000 7f47f7984640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55663877c600 0x5566388f9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.662+0000 7f47f7984640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55663877c600 0x5566388f9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59402/0 (socket says 172.21.15.146:59402) 2024-09-18T01:45:22.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.662+0000 7f47f7984640 1 -- 172.21.15.146:0/1420785055 learned_addr learned my addr 172.21.15.146:0/1420785055 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:22.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.662+0000 7f47f7984640 1 -- 172.21.15.146:0/1420785055 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566386a1bc0 con 0x55663877c600 2024-09-18T01:45:22.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.662+0000 7f47f7984640 1 --2- 172.21.15.146:0/1420785055 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55663877c600 0x5566388f9a80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f47e800b230 tx=0x7f47e800b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf4aaa4ca0bdc4bb server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.662+0000 7f46e5e0b640 1 -- 172.21.15.146:0/1420785055 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47e800e5c0 con 0x55663877c600 2024-09-18T01:45:22.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.662+0000 7f46e5e0b640 1 -- 172.21.15.146:0/1420785055 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47e8006070 con 0x55663877c600 2024-09-18T01:45:22.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.662+0000 7f46e5e0b640 1 -- 172.21.15.146:0/1420785055 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47e800e890 con 0x55663877c600 2024-09-18T01:45:22.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.663+0000 7f47fc210800 1 -- 172.21.15.146:0/1420785055 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55663877c600 msgr2=0x5566388f9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.663+0000 7f47fc210800 1 --2- 172.21.15.146:0/1420785055 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55663877c600 0x5566388f9a80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f47e800b230 tx=0x7f47e800b6f0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.663+0000 7f47fc210800 1 -- 172.21.15.146:0/1420785055 shutdown_connections 2024-09-18T01:45:22.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.663+0000 7f47fc210800 1 --2- 172.21.15.146:0/1420785055 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55663877c600 0x5566388f9a80 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.663+0000 7f47fc210800 1 -- 172.21.15.146:0/1420785055 >> 172.21.15.146:0/1420785055 conn(0x556638802dd0 msgr2=0x5566388f5440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:22.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.663+0000 7f47fc210800 1 -- 172.21.15.146:0/1420785055 shutdown_connections 2024-09-18T01:45:22.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.663+0000 7f47fc210800 1 -- 172.21.15.146:0/1420785055 wait complete. 2024-09-18T01:45:22.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.663+0000 7f47fc210800 1 Processor -- start 2024-09-18T01:45:22.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.663+0000 7f47fc210800 1 -- start start 2024-09-18T01:45:22.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.663+0000 7f47fc210800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55663877c600 0x5566389014b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.663+0000 7f47fc210800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x556638811980 con 0x55663877c600 2024-09-18T01:45:22.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.664+0000 7f47f7984640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55663877c600 0x5566389014b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.664+0000 7f47f7984640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55663877c600 0x5566389014b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59410/0 (socket says 172.21.15.146:59410) 2024-09-18T01:45:22.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.664+0000 7f47f7984640 1 -- 172.21.15.146:0/3644515508 learned_addr learned my addr 172.21.15.146:0/3644515508 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:22.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.664+0000 7f47f7984640 1 -- 172.21.15.146:0/3644515508 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566386b5fe0 con 0x55663877c600 2024-09-18T01:45:22.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.664+0000 7f47f7984640 1 --2- 172.21.15.146:0/3644515508 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55663877c600 0x5566389014b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f47e8000fd0 tx=0x7f47e8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.664+0000 7f46dffff640 1 -- 172.21.15.146:0/3644515508 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47e800f8d0 con 0x55663877c600 2024-09-18T01:45:22.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.664+0000 7f46dffff640 1 -- 172.21.15.146:0/3644515508 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47e800fa90 con 0x55663877c600 2024-09-18T01:45:22.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.664+0000 7f47fc210800 1 -- 172.21.15.146:0/3644515508 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5566389019f0 con 0x55663877c600 2024-09-18T01:45:22.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.664+0000 7f46dffff640 1 -- 172.21.15.146:0/3644515508 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47e800fdb0 con 0x55663877c600 2024-09-18T01:45:22.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.664+0000 7f47fc210800 1 -- 172.21.15.146:0/3644515508 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556638901f10 con 0x55663877c600 2024-09-18T01:45:22.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.665+0000 7f46dffff640 1 -- 172.21.15.146:0/3644515508 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f47e8017070 con 0x55663877c600 2024-09-18T01:45:22.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.665+0000 7f46dffff640 1 --2- 172.21.15.146:0/3644515508 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f46e0036b40 0x7f46e0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.665+0000 7f46dffff640 1 -- 172.21.15.146:0/3644515508 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f47e8015020 con 0x55663877c600 2024-09-18T01:45:22.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.665+0000 7f47ef183640 1 --2- 172.21.15.146:0/3644515508 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f46e0036b40 0x7f46e0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.665+0000 7f47fc210800 1 --2- 172.21.15.146:0/3644515508 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55663880ed80 0x556638908520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.665+0000 7f47fc210800 1 -- 172.21.15.146:0/3644515508 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556638908aa0 con 0x55663880ed80 2024-09-18T01:45:22.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.666+0000 7f47f8185640 1 --2- 172.21.15.146:0/3644515508 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55663880ed80 0x556638908520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.666+0000 7f47ef183640 1 --2- 172.21.15.146:0/3644515508 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f46e0036b40 0x7f46e0039000 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f47e0057000 tx=0x7f47e0052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.666+0000 7f47f8185640 1 --2- 172.21.15.146:0/3644515508 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55663880ed80 0x556638908520 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.666+0000 7f47f8185640 1 -- 172.21.15.146:0/3644515508 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f47f000a4a0 con 0x55663880ed80 2024-09-18T01:45:22.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.666+0000 7f47fc210800 1 -- 172.21.15.146:0/3644515508 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556638905af0 con 0x55663880ed80 2024-09-18T01:45:22.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.666+0000 7f47f8185640 1 -- 172.21.15.146:0/3644515508 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f47f000a4a0 con 0x55663880ed80 2024-09-18T01:45:22.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.666+0000 7f47fc210800 1 -- 172.21.15.146:0/3644515508 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55663890a8c0 con 0x55663880ed80 2024-09-18T01:45:22.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.667+0000 7f47f8185640 1 -- 172.21.15.146:0/3644515508 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f47f000a4a0 con 0x55663880ed80 2024-09-18T01:45:22.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.667+0000 7f47fc210800 1 -- 172.21.15.146:0/3644515508 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556638909af0 con 0x55663880ed80 2024-09-18T01:45:22.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.667+0000 7f47f8185640 1 -- 172.21.15.146:0/3644515508 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f47f000a4a0 con 0x55663880ed80 2024-09-18T01:45:22.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.667+0000 7f47fc210800 1 --2- 172.21.15.146:0/3644515508 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55663890bc70 0x55663890e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.667+0000 7f47fc210800 1 -- 172.21.15.146:0/3644515508 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55663890e5a0 con 0x55663890bc70 2024-09-18T01:45:22.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.667+0000 7f47f7984640 1 --2- 172.21.15.146:0/3644515508 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55663890bc70 0x55663890e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.667+0000 7f47f7984640 1 --2- 172.21.15.146:0/3644515508 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55663890bc70 0x55663890e060 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.668+0000 7f47f7984640 1 -- 172.21.15.146:0/3644515508 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f47e802e070 con 0x55663890bc70 2024-09-18T01:45:22.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.668+0000 7f47fc210800 1 Processor -- start 2024-09-18T01:45:22.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.668+0000 7f47fc210800 1 -- start start 2024-09-18T01:45:22.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.668+0000 7f47fc210800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55663891c220 0x55663891c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.668+0000 7f47fc210800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5566386a3580 con 0x55663891c220 2024-09-18T01:45:22.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.668+0000 7f47f8185640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55663891c220 0x55663891c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.668+0000 7f47f8185640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55663891c220 0x55663891c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59412/0 (socket says 172.21.15.146:59412) 2024-09-18T01:45:22.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.668+0000 7f47f8185640 1 -- 172.21.15.146:0/3007162654 learned_addr learned my addr 172.21.15.146:0/3007162654 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:22.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.668+0000 7f47f8185640 1 -- 172.21.15.146:0/3007162654 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55663891cb80 con 0x55663891c220 2024-09-18T01:45:22.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.669+0000 7f47f8185640 1 --2- 172.21.15.146:0/3007162654 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55663891c220 0x55663891c640 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x5566389028b0 tx=0x7f47f00178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.669+0000 7f46dd7fa640 1 -- 172.21.15.146:0/3007162654 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47f0013440 con 0x55663891c220 2024-09-18T01:45:22.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.669+0000 7f46dd7fa640 1 -- 172.21.15.146:0/3007162654 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47f00135e0 con 0x55663891c220 2024-09-18T01:45:22.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.669+0000 7f47fc210800 1 -- 172.21.15.146:0/3007162654 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55663891ce10 con 0x55663891c220 2024-09-18T01:45:22.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.669+0000 7f46dd7fa640 1 -- 172.21.15.146:0/3007162654 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47f00138c0 con 0x55663891c220 2024-09-18T01:45:22.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.669+0000 7f47fc210800 1 -- 172.21.15.146:0/3007162654 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55663891faf0 con 0x55663891c220 2024-09-18T01:45:22.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.670+0000 7f46dd7fa640 1 -- 172.21.15.146:0/3007162654 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f47f0011040 con 0x55663891c220 2024-09-18T01:45:22.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.670+0000 7f46dd7fa640 1 --2- 172.21.15.146:0/3007162654 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f46d0036b40 0x7f46d0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.670+0000 7f46dd7fa640 1 -- 172.21.15.146:0/3007162654 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f47f001d070 con 0x55663891c220 2024-09-18T01:45:22.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.670+0000 7f47f7984640 1 --2- 172.21.15.146:0/3007162654 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f46d0036b40 0x7f46d0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.670+0000 7f47fc210800 1 Processor -- start 2024-09-18T01:45:22.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.670+0000 7f47fc210800 1 -- start start 2024-09-18T01:45:22.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.670+0000 7f47f7984640 1 --2- 172.21.15.146:0/3007162654 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f46d0036b40 0x7f46d0039000 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f47e800ff70 tx=0x7f47e804b690 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.670+0000 7f47fc210800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556638928f10 0x556638929310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.670+0000 7f47fc210800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5566388fa230 con 0x556638928f10 2024-09-18T01:45:22.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.670+0000 7f47f8185640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556638928f10 0x556638929310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.670+0000 7f47f8185640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556638928f10 0x556638929310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59422/0 (socket says 172.21.15.146:59422) 2024-09-18T01:45:22.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.670+0000 7f47f8185640 1 -- 172.21.15.146:0/1148708964 learned_addr learned my addr 172.21.15.146:0/1148708964 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:22.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.671+0000 7f47f8185640 1 -- 172.21.15.146:0/1148708964 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566389298e0 con 0x556638928f10 2024-09-18T01:45:22.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.671+0000 7f47f8185640 1 --2- 172.21.15.146:0/1148708964 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556638928f10 0x556638929310 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f47f004c8f0 tx=0x7f47f0001f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d8f6a118ebc4f97 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.671+0000 7f46d6ffd640 1 -- 172.21.15.146:0/1148708964 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47f004e110 con 0x556638928f10 2024-09-18T01:45:22.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.671+0000 7f46d6ffd640 1 -- 172.21.15.146:0/1148708964 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47f004e2b0 con 0x556638928f10 2024-09-18T01:45:22.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.671+0000 7f46d6ffd640 1 -- 172.21.15.146:0/1148708964 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47f004b250 con 0x556638928f10 2024-09-18T01:45:22.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.671+0000 7f47fc210800 1 -- 172.21.15.146:0/1148708964 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556638928f10 msgr2=0x556638929310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.671+0000 7f47fc210800 1 --2- 172.21.15.146:0/1148708964 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556638928f10 0x556638929310 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f47f004c8f0 tx=0x7f47f0001f40 comp rx=0 tx=0).stop 2024-09-18T01:45:22.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.671+0000 7f47fc210800 1 -- 172.21.15.146:0/1148708964 shutdown_connections 2024-09-18T01:45:22.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.671+0000 7f47fc210800 1 --2- 172.21.15.146:0/1148708964 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556638928f10 0x556638929310 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.671+0000 7f47fc210800 1 -- 172.21.15.146:0/1148708964 >> 172.21.15.146:0/1148708964 conn(0x556638925270 msgr2=0x556638923370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:22.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.671+0000 7f47fc210800 1 -- 172.21.15.146:0/1148708964 shutdown_connections 2024-09-18T01:45:22.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.671+0000 7f47fc210800 1 -- 172.21.15.146:0/1148708964 wait complete. 2024-09-18T01:45:22.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.672+0000 7f47fc210800 1 Processor -- start 2024-09-18T01:45:22.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.672+0000 7f47fc210800 1 -- start start 2024-09-18T01:45:22.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.672+0000 7f47fc210800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556638928f10 0x5566389303c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.672+0000 7f47fc210800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x556638929f50 con 0x556638928f10 2024-09-18T01:45:22.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.672+0000 7f47f8185640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556638928f10 0x5566389303c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.672+0000 7f47f8185640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556638928f10 0x5566389303c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59438/0 (socket says 172.21.15.146:59438) 2024-09-18T01:45:22.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.672+0000 7f47f8185640 1 -- 172.21.15.146:0/3355025669 learned_addr learned my addr 172.21.15.146:0/3355025669 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:22.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.672+0000 7f47f8185640 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556638930900 con 0x556638928f10 2024-09-18T01:45:22.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.672+0000 7f47f8185640 1 --2- 172.21.15.146:0/3355025669 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556638928f10 0x5566389303c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f47f004c8f0 tx=0x7f47f004c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.673+0000 7f46d57fa640 1 -- 172.21.15.146:0/3355025669 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47f0046040 con 0x556638928f10 2024-09-18T01:45:22.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.673+0000 7f46d57fa640 1 -- 172.21.15.146:0/3355025669 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47f0041050 con 0x556638928f10 2024-09-18T01:45:22.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.673+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556638930b90 con 0x556638928f10 2024-09-18T01:45:22.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.673+0000 7f46d57fa640 1 -- 172.21.15.146:0/3355025669 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47f004e110 con 0x556638928f10 2024-09-18T01:45:22.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.673+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556638933840 con 0x556638928f10 2024-09-18T01:45:22.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.673+0000 7f46d57fa640 1 -- 172.21.15.146:0/3355025669 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f47f004ca30 con 0x556638928f10 2024-09-18T01:45:22.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.674+0000 7f46d57fa640 1 --2- 172.21.15.146:0/3355025669 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f46c0036b40 0x7f46c0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.674+0000 7f46d57fa640 1 -- 172.21.15.146:0/3355025669 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f47f0034070 con 0x556638928f10 2024-09-18T01:45:22.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.674+0000 7f47f7984640 1 --2- 172.21.15.146:0/3355025669 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f46c0036b40 0x7f46c0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.674+0000 7f47fc210800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.674+0000 7f47fc210800 1 --2- 172.21.15.146:0/3355025669 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55663893bf40 0x55663893e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.674+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55663893eb50 con 0x55663893bf40 2024-09-18T01:45:22.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.674+0000 7f47ef183640 1 --2- 172.21.15.146:0/3355025669 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55663893bf40 0x55663893e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.674+0000 7f47f7984640 1 --2- 172.21.15.146:0/3355025669 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f46c0036b40 0x7f46c0039000 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f47e801dfd0 tx=0x7f47e8042000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.674+0000 7f47ef183640 1 --2- 172.21.15.146:0/3355025669 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55663893bf40 0x55663893e400 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.675+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f47e0057030 con 0x55663893bf40 2024-09-18T01:45:22.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.675+0000 7f47fc210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:22.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.675+0000 7f47fc210800 20 realm 2024-09-18T01:45:22.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.675+0000 7f47fc210800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.675+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55663893ef80 con 0x55663893bf40 2024-09-18T01:45:22.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.675+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f47e0057030 con 0x55663893bf40 2024-09-18T01:45:22.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.675+0000 7f47fc210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:22.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.675+0000 7f47fc210800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:22.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.675+0000 7f47fc210800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.675+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55663893f850 con 0x55663893bf40 2024-09-18T01:45:22.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.675+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f47e0057030 con 0x55663893bf40 2024-09-18T01:45:22.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.675+0000 7f47fc210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:22.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.675+0000 7f47fc210800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.675+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55663893fbf0 con 0x55663893bf40 2024-09-18T01:45:22.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.675+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f47e0057030 con 0x55663893bf40 2024-09-18T01:45:22.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.675+0000 7f47fc210800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:22.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.675+0000 7f47fc210800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.675+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55663893f460 con 0x55663893bf40 2024-09-18T01:45:22.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.675+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f47e0057030 con 0x55663893bf40 2024-09-18T01:45:22.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.676+0000 7f47fc210800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:22.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.676+0000 7f47fc210800 20 searching for the correct realm 2024-09-18T01:45:22.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.676+0000 7f47fc210800 1 --2- 172.21.15.146:0/3355025669 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5566389420b0 0x5566389444c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.676+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556638944b90 con 0x5566389420b0 2024-09-18T01:45:22.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.676+0000 7f47f8185640 1 --2- 172.21.15.146:0/3355025669 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5566389420b0 0x5566389444c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.676+0000 7f47f8185640 1 --2- 172.21.15.146:0/3355025669 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5566389420b0 0x5566389444c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.676+0000 7f47f8185640 1 -- 172.21.15.146:0/3355025669 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47f003e020 con 0x5566389420b0 2024-09-18T01:45:22.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.676+0000 7f47f8185640 1 --2- 172.21.15.146:0/3355025669 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f47f00123a0 0x7f47f002c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.676+0000 7f47f8185640 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556638944b90 con 0x7f47f00123a0 2024-09-18T01:45:22.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.676+0000 7f47f7984640 1 --2- 172.21.15.146:0/3355025669 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f47f00123a0 0x7f47f002c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.677+0000 7f47f7984640 1 --2- 172.21.15.146:0/3355025669 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f47f00123a0 0x7f47f002c480 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.677+0000 7f47f7984640 1 -- 172.21.15.146:0/3355025669 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47e802e070 con 0x7f47f00123a0 2024-09-18T01:45:22.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.677+0000 7f47f7984640 1 --2- 172.21.15.146:0/3355025669 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f47e800f070 0x7f47e8019860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.677+0000 7f47f7984640 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556638944b90 con 0x7f47e800f070 2024-09-18T01:45:22.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.677+0000 7f47ef183640 1 --2- 172.21.15.146:0/3355025669 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f47e800f070 0x7f47e8019860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.678+0000 7f47ef183640 1 --2- 172.21.15.146:0/3355025669 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f47e800f070 0x7f47e8019860 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.678+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47e0057030 con 0x7f47e800f070 2024-09-18T01:45:22.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.678+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556638944b90 con 0x55663893bf40 2024-09-18T01:45:22.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.678+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f47e0057030 con 0x55663893bf40 2024-09-18T01:45:22.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.678+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556638944b90 con 0x55663893bf40 2024-09-18T01:45:22.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.678+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47e0057030 con 0x55663893bf40 2024-09-18T01:45:22.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.678+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556638944b90 con 0x7f47e800f070 2024-09-18T01:45:22.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.679+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47e0057030 con 0x7f47e800f070 2024-09-18T01:45:22.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.679+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556638944b90 con 0x7f47e800f070 2024-09-18T01:45:22.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.679+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47e0057030 con 0x7f47e800f070 2024-09-18T01:45:22.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.679+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556638944b90 con 0x7f47f00123a0 2024-09-18T01:45:22.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.679+0000 7f47f7984640 1 -- 172.21.15.146:0/3355025669 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47e802e070 con 0x7f47f00123a0 2024-09-18T01:45:22.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.679+0000 7f47f7984640 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556638944b90 con 0x5566389420b0 2024-09-18T01:45:22.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.679+0000 7f47f8185640 1 -- 172.21.15.146:0/3355025669 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47f003e020 con 0x5566389420b0 2024-09-18T01:45:22.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.679+0000 7f47f8185640 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556638944b90 con 0x55663893bf40 2024-09-18T01:45:22.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.679+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47e0057030 con 0x55663893bf40 2024-09-18T01:45:22.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.679+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556638944b90 con 0x7f47e800f070 2024-09-18T01:45:22.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.680+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47e0057030 con 0x7f47e800f070 2024-09-18T01:45:22.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.680+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556638944b90 con 0x55663893bf40 2024-09-18T01:45:22.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.680+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47e0057030 con 0x55663893bf40 2024-09-18T01:45:22.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.680+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556638944b90 con 0x7f47f00123a0 2024-09-18T01:45:22.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.680+0000 7f47f7984640 1 -- 172.21.15.146:0/3355025669 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f47e802e070 con 0x7f47f00123a0 2024-09-18T01:45:22.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.680+0000 7f47f7984640 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556638944b90 con 0x5566389420b0 2024-09-18T01:45:22.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.680+0000 7f47f8185640 1 -- 172.21.15.146:0/3355025669 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47f003e020 con 0x5566389420b0 2024-09-18T01:45:22.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.681+0000 7f47f8185640 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556638944b90 con 0x5566389420b0 2024-09-18T01:45:22.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.681+0000 7f47f8185640 1 -- 172.21.15.146:0/3355025669 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47f003e020 con 0x5566389420b0 2024-09-18T01:45:22.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.681+0000 7f47f8185640 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556638944b90 con 0x7f47e800f070 2024-09-18T01:45:22.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.681+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47e0057030 con 0x7f47e800f070 2024-09-18T01:45:22.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.681+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556638944b90 con 0x5566389420b0 2024-09-18T01:45:22.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.681+0000 7f47f8185640 1 -- 172.21.15.146:0/3355025669 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47f003e020 con 0x5566389420b0 2024-09-18T01:45:22.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.681+0000 7f47f8185640 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556638944b90 con 0x5566389420b0 2024-09-18T01:45:22.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.682+0000 7f47f8185640 1 -- 172.21.15.146:0/3355025669 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47f003e020 con 0x5566389420b0 2024-09-18T01:45:22.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.682+0000 7f47f8185640 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556638944b90 con 0x55663893bf40 2024-09-18T01:45:22.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.682+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47e0057030 con 0x55663893bf40 2024-09-18T01:45:22.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.682+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556638944b90 con 0x55663893bf40 2024-09-18T01:45:22.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.682+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f47e0057030 con 0x55663893bf40 2024-09-18T01:45:22.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.682+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556638944b90 con 0x7f47e800f070 2024-09-18T01:45:22.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.682+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47e0057030 con 0x7f47e800f070 2024-09-18T01:45:22.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.682+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556638944b90 con 0x5566389420b0 2024-09-18T01:45:22.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.682+0000 7f47f8185640 1 -- 172.21.15.146:0/3355025669 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47f003e020 con 0x5566389420b0 2024-09-18T01:45:22.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.682+0000 7f47f8185640 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556638944b90 con 0x7f47f00123a0 2024-09-18T01:45:22.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.683+0000 7f47f7984640 1 -- 172.21.15.146:0/3355025669 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47e802e070 con 0x7f47f00123a0 2024-09-18T01:45:22.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.683+0000 7f47f7984640 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556638944b90 con 0x55663893bf40 2024-09-18T01:45:22.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.683+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47e0057030 con 0x55663893bf40 2024-09-18T01:45:22.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.683+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556638944b90 con 0x7f47e800f070 2024-09-18T01:45:22.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.683+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47e0057030 con 0x7f47e800f070 2024-09-18T01:45:22.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.683+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556638944b90 con 0x5566389420b0 2024-09-18T01:45:22.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.683+0000 7f47f8185640 1 -- 172.21.15.146:0/3355025669 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47f003e020 con 0x5566389420b0 2024-09-18T01:45:22.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.683+0000 7f47f8185640 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556638944b90 con 0x7f47e800f070 2024-09-18T01:45:22.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.684+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47e0057030 con 0x7f47e800f070 2024-09-18T01:45:22.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.684+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556638944b90 con 0x7f47f00123a0 2024-09-18T01:45:22.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.684+0000 7f47f7984640 1 -- 172.21.15.146:0/3355025669 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47e802e070 con 0x7f47f00123a0 2024-09-18T01:45:22.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.684+0000 7f47f7984640 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556638944b90 con 0x5566389420b0 2024-09-18T01:45:22.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.684+0000 7f47f8185640 1 -- 172.21.15.146:0/3355025669 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47f003e020 con 0x5566389420b0 2024-09-18T01:45:22.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.684+0000 7f47f8185640 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556638944b90 con 0x7f47e800f070 2024-09-18T01:45:22.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.684+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47e0057030 con 0x7f47e800f070 2024-09-18T01:45:22.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.684+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556638944b90 con 0x55663893bf40 2024-09-18T01:45:22.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.685+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f47e0057030 con 0x55663893bf40 2024-09-18T01:45:22.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.685+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556638944b90 con 0x7f47f00123a0 2024-09-18T01:45:22.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.685+0000 7f47f7984640 1 -- 172.21.15.146:0/3355025669 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47e802e070 con 0x7f47f00123a0 2024-09-18T01:45:22.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.685+0000 7f47fc210800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:22.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.685+0000 7f47fc210800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:22.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.685+0000 7f47fc210800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:22.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.685+0000 7f47fc210800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:22.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.685+0000 7f47fc210800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:22.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.685+0000 7f47fc210800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:22.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.685+0000 7f47fc210800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.685+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556638940b30 con 0x55663893bf40 2024-09-18T01:45:22.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.685+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f47e0057030 con 0x55663893bf40 2024-09-18T01:45:22.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.685+0000 7f47fc210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:22.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.685+0000 7f47fc210800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.685+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5566389413d0 con 0x55663893bf40 2024-09-18T01:45:22.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.685+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f47e0057030 con 0x55663893bf40 2024-09-18T01:45:22.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.685+0000 7f47fc210800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:22.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.685+0000 7f47fc210800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.685+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556638940770 con 0x7f47f00123a0 2024-09-18T01:45:22.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.686+0000 7f47f7984640 1 -- 172.21.15.146:0/3355025669 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f47e802e070 con 0x7f47f00123a0 2024-09-18T01:45:22.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.686+0000 7f47fc210800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:22.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.686+0000 7f47fc210800 20 zone default found 2024-09-18T01:45:22.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.686+0000 7f47fc210800 4 Realm: () 2024-09-18T01:45:22.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.686+0000 7f47fc210800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:22.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.686+0000 7f47fc210800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:22.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.686+0000 7f47fc210800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:22.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.686+0000 7f47fc210800 20 zonegroup default 2024-09-18T01:45:22.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.686+0000 7f47fc210800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.686+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5566389454c0 con 0x7f47e800f070 2024-09-18T01:45:22.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.686+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f47e0057030 con 0x7f47e800f070 2024-09-18T01:45:22.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.686+0000 7f47fc210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:22.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.686+0000 7f47fc210800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.686+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556638947020 con 0x5566389420b0 2024-09-18T01:45:22.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.686+0000 7f47f8185640 1 -- 172.21.15.146:0/3355025669 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f47f003e020 con 0x5566389420b0 2024-09-18T01:45:22.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.686+0000 7f47fc210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:22.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.686+0000 7f47fc210800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.686+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5566389474b0 con 0x5566389420b0 2024-09-18T01:45:22.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.686+0000 7f47f8185640 1 -- 172.21.15.146:0/3355025669 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f47f003e020 con 0x5566389420b0 2024-09-18T01:45:22.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.686+0000 7f47fc210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:22.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.686+0000 7f47fc210800 20 started sync module instance, tier type = 2024-09-18T01:45:22.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.686+0000 7f47fc210800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:22.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.686+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556638945f20 con 0x7f47f00123a0 2024-09-18T01:45:22.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.687+0000 7f47f7984640 1 -- 172.21.15.146:0/3355025669 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v31'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47e802e070 con 0x7f47f00123a0 2024-09-18T01:45:22.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.687+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93897524273936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556638947dc0 con 0x7f47f00123a0 2024-09-18T01:45:22.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.688+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556638948610 con 0x55663893bf40 2024-09-18T01:45:22.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.689+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v31'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47e0057030 con 0x55663893bf40 2024-09-18T01:45:22.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.689+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93897524281696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556638948b10 con 0x55663893bf40 2024-09-18T01:45:22.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.689+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556638949610 con 0x5566389420b0 2024-09-18T01:45:22.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.689+0000 7f47f7984640 1 -- 172.21.15.146:0/3355025669 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93897524273936] v31'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47e802e070 con 0x7f47f00123a0 2024-09-18T01:45:22.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.691+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93897524281696] v31'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47e0057030 con 0x55663893bf40 2024-09-18T01:45:22.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.691+0000 7f47f8185640 1 -- 172.21.15.146:0/3355025669 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v31'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47f003e020 con 0x5566389420b0 2024-09-18T01:45:22.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.691+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93897524285696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5566389495d0 con 0x5566389420b0 2024-09-18T01:45:22.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.691+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556638949ee0 con 0x7f47f00123a0 2024-09-18T01:45:22.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.693+0000 7f47f8185640 1 -- 172.21.15.146:0/3355025669 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93897524285696] v31'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47f003e020 con 0x5566389420b0 2024-09-18T01:45:22.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.693+0000 7f47f7984640 1 -- 172.21.15.146:0/3355025669 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v31'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47e802e070 con 0x7f47f00123a0 2024-09-18T01:45:22.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.693+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93897524288048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5566389495d0 con 0x7f47f00123a0 2024-09-18T01:45:22.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.693+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55663894a9a0 con 0x55663893bf40 2024-09-18T01:45:22.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.696+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v31'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47e0057030 con 0x55663893bf40 2024-09-18T01:45:22.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.696+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93897524290672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55663894a960 con 0x55663893bf40 2024-09-18T01:45:22.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.696+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55663894b950 con 0x7f47e800f070 2024-09-18T01:45:22.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.696+0000 7f47f7984640 1 -- 172.21.15.146:0/3355025669 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93897524288048] v31'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47e802e070 con 0x7f47f00123a0 2024-09-18T01:45:22.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.697+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v31'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47e0057030 con 0x7f47e800f070 2024-09-18T01:45:22.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.697+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93897524279568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55663894b950 con 0x7f47e800f070 2024-09-18T01:45:22.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.697+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55663894c360 con 0x7f47e800f070 2024-09-18T01:45:22.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.697+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93897524290672] v31'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47e0057030 con 0x55663893bf40 2024-09-18T01:45:22.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.698+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93897524279568] v31'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47e0057030 con 0x7f47e800f070 2024-09-18T01:45:22.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.698+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v31'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47e0057030 con 0x7f47e800f070 2024-09-18T01:45:22.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.698+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93897524294704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55663894beb0 con 0x7f47e800f070 2024-09-18T01:45:22.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.698+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55663894c870 con 0x7f47e800f070 2024-09-18T01:45:22.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.699+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93897524294704] v31'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47e0057030 con 0x7f47e800f070 2024-09-18T01:45:22.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.699+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v31'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47e0057030 con 0x7f47e800f070 2024-09-18T01:45:22.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.699+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93897524292928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55663894c870 con 0x7f47e800f070 2024-09-18T01:45:22.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.699+0000 7f47fc210800 20 add_watcher() i=0 2024-09-18T01:45:22.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.699+0000 7f47fc210800 20 add_watcher() i=1 2024-09-18T01:45:22.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.699+0000 7f47fc210800 20 add_watcher() i=2 2024-09-18T01:45:22.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.699+0000 7f47fc210800 20 add_watcher() i=3 2024-09-18T01:45:22.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.699+0000 7f47fc210800 20 add_watcher() i=4 2024-09-18T01:45:22.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.699+0000 7f47fc210800 20 add_watcher() i=5 2024-09-18T01:45:22.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.699+0000 7f47fc210800 20 add_watcher() i=6 2024-09-18T01:45:22.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.700+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93897524292928] v31'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47e0057030 con 0x7f47e800f070 2024-09-18T01:45:22.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.700+0000 7f47fc210800 20 add_watcher() i=7 2024-09-18T01:45:22.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.700+0000 7f47fc210800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:22.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.700+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55663894fb90 con 0x55663893bf40 2024-09-18T01:45:22.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.700+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f47e0057030 con 0x55663893bf40 2024-09-18T01:45:22.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.700+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93897524299056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55663894ce00 con 0x55663893bf40 2024-09-18T01:45:22.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.702+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93897524299056] v31'52 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f47e0057030 con 0x55663893bf40 2024-09-18T01:45:22.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.702+0000 7f46adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:22.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.702+0000 7f47fc210800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:22.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.702+0000 7f47fc210800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:22.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.702+0000 7f47fc210800 5 note: GC not initialized 2024-09-18T01:45:22.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.702+0000 7f46acfe1640 20 reqs_thread_entry: start 2024-09-18T01:45:22.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.702+0000 7f47fc210800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:22.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.702+0000 7f47fc210800 20 Filter name: none 2024-09-18T01:45:22.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.702+0000 7f46267fc640 20 reqs_thread_entry: start 2024-09-18T01:45:22.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.702+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5566389834e0 con 0x55663893bf40 2024-09-18T01:45:22.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.703+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f47e0057030 con 0x55663893bf40 2024-09-18T01:45:22.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.703+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5566389834e0 con 0x7f47f00123a0 2024-09-18T01:45:22.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.703+0000 7f47f7984640 1 -- 172.21.15.146:0/3355025669 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f47e802e070 con 0x7f47f00123a0 2024-09-18T01:45:22.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.703+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5566389834a0 con 0x55663893bf40 2024-09-18T01:45:22.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.703+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f47e0057030 con 0x55663893bf40 2024-09-18T01:45:22.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.703+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5566389834a0 con 0x5566389420b0 2024-09-18T01:45:22.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.703+0000 7f47f8185640 1 -- 172.21.15.146:0/3355025669 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f47f003e020 con 0x5566389420b0 2024-09-18T01:45:22.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.703+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556638983a00 con 0x5566389420b0 2024-09-18T01:45:22.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.704+0000 7f47f8185640 1 -- 172.21.15.146:0/3355025669 <== osd.3 v2:172.21.15.146:6809/4106661138 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f47f003e020 con 0x5566389420b0 2024-09-18T01:45:22.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.704+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556638983a00 con 0x5566389420b0 2024-09-18T01:45:22.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.704+0000 7f47f8185640 1 -- 172.21.15.146:0/3355025669 <== osd.3 v2:172.21.15.146:6809/4106661138 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f47f003e020 con 0x5566389420b0 2024-09-18T01:45:22.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.704+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556638983a00 con 0x55663893bf40 2024-09-18T01:45:22.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.704+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f47e0057030 con 0x55663893bf40 2024-09-18T01:45:22.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.704+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556638983a00 con 0x55663893bf40 2024-09-18T01:45:22.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.704+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f47e0057030 con 0x55663893bf40 2024-09-18T01:45:22.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.704+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556638983960 con 0x5566389420b0 2024-09-18T01:45:22.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.705+0000 7f47f8185640 1 -- 172.21.15.146:0/3355025669 <== osd.3 v2:172.21.15.146:6809/4106661138 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f47f003e020 con 0x5566389420b0 2024-09-18T01:45:22.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.705+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556638983960 con 0x5566389420b0 2024-09-18T01:45:22.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.705+0000 7f47f8185640 1 -- 172.21.15.146:0/3355025669 <== osd.3 v2:172.21.15.146:6809/4106661138 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f47f003e020 con 0x5566389420b0 2024-09-18T01:45:22.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.705+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556638983960 con 0x7f47e800f070 2024-09-18T01:45:22.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.705+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(72 usage.10 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f47e0057030 con 0x7f47e800f070 2024-09-18T01:45:22.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.705+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556638983960 con 0x55663893bf40 2024-09-18T01:45:22.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.705+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f47e0057030 con 0x55663893bf40 2024-09-18T01:45:22.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.705+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556638983960 con 0x7f47f00123a0 2024-09-18T01:45:22.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.706+0000 7f47f7984640 1 -- 172.21.15.146:0/3355025669 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f47e802e070 con 0x7f47f00123a0 2024-09-18T01:45:22.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.706+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556638983960 con 0x5566389420b0 2024-09-18T01:45:22.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.706+0000 7f47f8185640 1 -- 172.21.15.146:0/3355025669 <== osd.3 v2:172.21.15.146:6809/4106661138 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f47f003e020 con 0x5566389420b0 2024-09-18T01:45:22.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.706+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556638983960 con 0x7f47e800f070 2024-09-18T01:45:22.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.706+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f47e0057030 con 0x7f47e800f070 2024-09-18T01:45:22.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.706+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556638983960 con 0x7f47e800f070 2024-09-18T01:45:22.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.706+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f47e0057030 con 0x7f47e800f070 2024-09-18T01:45:22.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.706+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556638983960 con 0x5566389420b0 2024-09-18T01:45:22.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.707+0000 7f47f8185640 1 -- 172.21.15.146:0/3355025669 <== osd.3 v2:172.21.15.146:6809/4106661138 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f47f003e020 con 0x5566389420b0 2024-09-18T01:45:22.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.707+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556638983960 con 0x7f47e800f070 2024-09-18T01:45:22.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.707+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(79 usage.17 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f47e0057030 con 0x7f47e800f070 2024-09-18T01:45:22.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.707+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556638983960 con 0x55663893bf40 2024-09-18T01:45:22.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.707+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f47e0057030 con 0x55663893bf40 2024-09-18T01:45:22.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.707+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556638983960 con 0x5566389420b0 2024-09-18T01:45:22.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.707+0000 7f47f8185640 1 -- 172.21.15.146:0/3355025669 <== osd.3 v2:172.21.15.146:6809/4106661138 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f47f003e020 con 0x5566389420b0 2024-09-18T01:45:22.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.707+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556638983960 con 0x7f47e800f070 2024-09-18T01:45:22.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.708+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f47e0057030 con 0x7f47e800f070 2024-09-18T01:45:22.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.708+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556638983960 con 0x7f47f00123a0 2024-09-18T01:45:22.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.708+0000 7f47f7984640 1 -- 172.21.15.146:0/3355025669 <== osd.2 v2:172.21.15.146:6800/3820039304 14 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f47e802e070 con 0x7f47f00123a0 2024-09-18T01:45:22.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.708+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556638983910 con 0x7f47e800f070 2024-09-18T01:45:22.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.708+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.0 v2:172.21.15.129:6800/1759265424 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f47e0057030 con 0x7f47e800f070 2024-09-18T01:45:22.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.708+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556638983910 con 0x55663893bf40 2024-09-18T01:45:22.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.708+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.1 v2:172.21.15.146:6808/3930274777 28 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f47e0057030 con 0x55663893bf40 2024-09-18T01:45:22.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.708+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556638983910 con 0x55663893bf40 2024-09-18T01:45:22.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.708+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.1 v2:172.21.15.146:6808/3930274777 29 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f47e0057030 con 0x55663893bf40 2024-09-18T01:45:22.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.708+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556638983910 con 0x5566389420b0 2024-09-18T01:45:22.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.709+0000 7f47f8185640 1 -- 172.21.15.146:0/3355025669 <== osd.3 v2:172.21.15.146:6809/4106661138 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f47f003e020 con 0x5566389420b0 2024-09-18T01:45:22.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.709+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556638983910 con 0x55663893bf40 2024-09-18T01:45:22.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.709+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.1 v2:172.21.15.146:6808/3930274777 30 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f47e0057030 con 0x55663893bf40 2024-09-18T01:45:22.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.709+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556638983910 con 0x55663893bf40 2024-09-18T01:45:22.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.709+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.1 v2:172.21.15.146:6808/3930274777 31 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f47e0057030 con 0x55663893bf40 2024-09-18T01:45:22.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.709+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556638983910 con 0x5566389420b0 2024-09-18T01:45:22.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.709+0000 7f47f8185640 1 -- 172.21.15.146:0/3355025669 <== osd.3 v2:172.21.15.146:6809/4106661138 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f47f003e020 con 0x5566389420b0 2024-09-18T01:45:22.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.709+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556638983910 con 0x5566389420b0 2024-09-18T01:45:22.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.709+0000 7f47f8185640 1 -- 172.21.15.146:0/3355025669 <== osd.3 v2:172.21.15.146:6809/4106661138 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f47f003e020 con 0x5566389420b0 2024-09-18T01:45:22.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.709+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556638983910 con 0x5566389420b0 2024-09-18T01:45:22.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.710+0000 7f47f8185640 1 -- 172.21.15.146:0/3355025669 <== osd.3 v2:172.21.15.146:6809/4106661138 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f47f003e020 con 0x5566389420b0 2024-09-18T01:45:22.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.710+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556638983910 con 0x7f47e800f070 2024-09-18T01:45:22.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.710+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.0 v2:172.21.15.129:6800/1759265424 23 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f47e0057030 con 0x7f47e800f070 2024-09-18T01:45:22.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.711+0000 7f46adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:22.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.711+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93897524299056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556638983910 con 0x55663893bf40 2024-09-18T01:45:22.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.712+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.1 v2:172.21.15.146:6808/3930274777 32 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 93897524299056] v31'53 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f47e0057030 con 0x55663893bf40 2024-09-18T01:45:22.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.712+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93897524273936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556638983910 con 0x7f47f00123a0 2024-09-18T01:45:22.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.714+0000 7f47f7984640 1 -- 172.21.15.146:0/3355025669 <== osd.2 v2:172.21.15.146:6800/3820039304 15 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 93897524273936] v31'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47e802e070 con 0x7f47f00123a0 2024-09-18T01:45:22.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.714+0000 7f47fc210800 20 remove_watcher() i=0 2024-09-18T01:45:22.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.714+0000 7f47fc210800 2 removed watcher, disabling cache 2024-09-18T01:45:22.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.714+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93897524281696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556638983910 con 0x55663893bf40 2024-09-18T01:45:22.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.715+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.1 v2:172.21.15.146:6808/3930274777 33 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 93897524281696] v31'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47e0057030 con 0x55663893bf40 2024-09-18T01:45:22.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.715+0000 7f47fc210800 20 remove_watcher() i=1 2024-09-18T01:45:22.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.715+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93897524285696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556638983910 con 0x5566389420b0 2024-09-18T01:45:22.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.716+0000 7f47f8185640 1 -- 172.21.15.146:0/3355025669 <== osd.3 v2:172.21.15.146:6809/4106661138 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 93897524285696] v31'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47f003e020 con 0x5566389420b0 2024-09-18T01:45:22.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.716+0000 7f47fc210800 20 remove_watcher() i=2 2024-09-18T01:45:22.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.716+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93897524288048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556638983910 con 0x7f47f00123a0 2024-09-18T01:45:22.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.717+0000 7f47f7984640 1 -- 172.21.15.146:0/3355025669 <== osd.2 v2:172.21.15.146:6800/3820039304 16 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 93897524288048] v31'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47e802e070 con 0x7f47f00123a0 2024-09-18T01:45:22.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.717+0000 7f47fc210800 20 remove_watcher() i=3 2024-09-18T01:45:22.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.717+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93897524290672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556638983910 con 0x55663893bf40 2024-09-18T01:45:22.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.718+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.1 v2:172.21.15.146:6808/3930274777 34 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 93897524290672] v31'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47e0057030 con 0x55663893bf40 2024-09-18T01:45:22.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.718+0000 7f47fc210800 20 remove_watcher() i=4 2024-09-18T01:45:22.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.718+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93897524279568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556638983910 con 0x7f47e800f070 2024-09-18T01:45:22.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.719+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.0 v2:172.21.15.129:6800/1759265424 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 93897524279568] v31'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47e0057030 con 0x7f47e800f070 2024-09-18T01:45:22.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.719+0000 7f47fc210800 20 remove_watcher() i=5 2024-09-18T01:45:22.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.719+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93897524294704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556638983910 con 0x7f47e800f070 2024-09-18T01:45:22.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.720+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.0 v2:172.21.15.129:6800/1759265424 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 93897524294704] v31'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47e0057030 con 0x7f47e800f070 2024-09-18T01:45:22.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.720+0000 7f47fc210800 20 remove_watcher() i=6 2024-09-18T01:45:22.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.720+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93897524292928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556638983910 con 0x7f47e800f070 2024-09-18T01:45:22.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.721+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 <== osd.0 v2:172.21.15.129:6800/1759265424 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 93897524292928] v31'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47e0057030 con 0x7f47e800f070 2024-09-18T01:45:22.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.721+0000 7f47fc210800 20 remove_watcher() i=7 2024-09-18T01:45:22.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.721+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f47e800f070 msgr2=0x7f47e8019860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.721+0000 7f47fc210800 1 --2- 172.21.15.146:0/3355025669 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f47e800f070 0x7f47e8019860 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.721+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55663893bf40 msgr2=0x55663893e400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.721+0000 7f47fc210800 1 --2- 172.21.15.146:0/3355025669 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55663893bf40 0x55663893e400 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.721+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f47f00123a0 msgr2=0x7f47f002c480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.721+0000 7f47fc210800 1 --2- 172.21.15.146:0/3355025669 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f47f00123a0 0x7f47f002c480 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.721+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5566389420b0 msgr2=0x5566389444c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.721+0000 7f47fc210800 1 --2- 172.21.15.146:0/3355025669 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5566389420b0 0x5566389444c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.721+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f46c0036b40 msgr2=0x7f46c0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.721+0000 7f47fc210800 1 --2- 172.21.15.146:0/3355025669 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f46c0036b40 0x7f46c0039000 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f47e801dfd0 tx=0x7f47e8042000 comp rx=0 tx=0).stop 2024-09-18T01:45:22.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.721+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556638928f10 msgr2=0x5566389303c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.721+0000 7f47ef183640 1 -- 172.21.15.146:0/3355025669 reap_dead start 2024-09-18T01:45:22.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.721+0000 7f47fc210800 1 --2- 172.21.15.146:0/3355025669 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556638928f10 0x5566389303c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f47f004c8f0 tx=0x7f47f004c880 comp rx=0 tx=0).stop 2024-09-18T01:45:22.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.721+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 shutdown_connections 2024-09-18T01:45:22.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.722+0000 7f47fc210800 1 --2- 172.21.15.146:0/3355025669 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556638928f10 0x5566389303c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.722+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 >> 172.21.15.146:0/3355025669 conn(0x556638925270 msgr2=0x556638923340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:22.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.722+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 shutdown_connections 2024-09-18T01:45:22.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.722+0000 7f47fc210800 1 -- 172.21.15.146:0/3355025669 wait complete. 2024-09-18T01:45:22.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.722+0000 7f47fc210800 1 -- 172.21.15.146:0/3007162654 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f46d0036b40 msgr2=0x7f46d0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.722+0000 7f47fc210800 1 --2- 172.21.15.146:0/3007162654 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f46d0036b40 0x7f46d0039000 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f47e800ff70 tx=0x7f47e804b690 comp rx=0 tx=0).stop 2024-09-18T01:45:22.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.722+0000 7f47fc210800 1 -- 172.21.15.146:0/3007162654 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55663891c220 msgr2=0x55663891c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.722+0000 7f47fc210800 1 --2- 172.21.15.146:0/3007162654 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55663891c220 0x55663891c640 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x5566389028b0 tx=0x7f47f00178e0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.722+0000 7f47fc210800 1 -- 172.21.15.146:0/3007162654 shutdown_connections 2024-09-18T01:45:22.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.722+0000 7f47fc210800 1 --2- 172.21.15.146:0/3007162654 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f46d0036b40 0x7f46d0039000 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.722+0000 7f47fc210800 1 --2- 172.21.15.146:0/3007162654 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55663891c220 0x55663891c640 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.722+0000 7f47fc210800 1 -- 172.21.15.146:0/3007162654 >> 172.21.15.146:0/3007162654 conn(0x5566389111b0 msgr2=0x556638913d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:22.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.722+0000 7f47fc210800 1 -- 172.21.15.146:0/3007162654 shutdown_connections 2024-09-18T01:45:22.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.722+0000 7f47fc210800 1 -- 172.21.15.146:0/3007162654 wait complete. 2024-09-18T01:45:22.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.722+0000 7f47fc210800 1 -- 172.21.15.146:0/3644515508 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55663880ed80 msgr2=0x556638908520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.722+0000 7f47fc210800 1 --2- 172.21.15.146:0/3644515508 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55663880ed80 0x556638908520 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.722+0000 7f47fc210800 1 -- 172.21.15.146:0/3644515508 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55663890bc70 msgr2=0x55663890e060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.722+0000 7f47fc210800 1 --2- 172.21.15.146:0/3644515508 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55663890bc70 0x55663890e060 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.722+0000 7f47fc210800 1 -- 172.21.15.146:0/3644515508 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f46e0036b40 msgr2=0x7f46e0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.722+0000 7f47fc210800 1 --2- 172.21.15.146:0/3644515508 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f46e0036b40 0x7f46e0039000 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f47e0057000 tx=0x7f47e0052000 comp rx=0 tx=0).stop 2024-09-18T01:45:22.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.722+0000 7f47fc210800 1 -- 172.21.15.146:0/3644515508 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55663877c600 msgr2=0x5566389014b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.722+0000 7f47fc210800 1 --2- 172.21.15.146:0/3644515508 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55663877c600 0x5566389014b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f47e8000fd0 tx=0x7f47e8000ed0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.722+0000 7f47fc210800 1 -- 172.21.15.146:0/3644515508 shutdown_connections 2024-09-18T01:45:22.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.722+0000 7f47fc210800 1 --2- 172.21.15.146:0/3644515508 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55663890bc70 0x55663890e060 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.722+0000 7f47fc210800 1 --2- 172.21.15.146:0/3644515508 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55663880ed80 0x556638908520 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.722+0000 7f47fc210800 1 --2- 172.21.15.146:0/3644515508 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f46e0036b40 0x7f46e0039000 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.722+0000 7f47fc210800 1 --2- 172.21.15.146:0/3644515508 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55663877c600 0x5566389014b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.723+0000 7f47fc210800 1 -- 172.21.15.146:0/3644515508 >> 172.21.15.146:0/3644515508 conn(0x556638802dd0 msgr2=0x5566388f3cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:22.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.723+0000 7f47fc210800 1 -- 172.21.15.146:0/3644515508 shutdown_connections 2024-09-18T01:45:22.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.723+0000 7f47fc210800 1 -- 172.21.15.146:0/3644515508 wait complete. 2024-09-18T01:45:22.731 INFO:teuthology.orchestra.run.smithi146.stdout:{"entries":[],"summary":[]} 2024-09-18T01:45:22.732 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-18T01:45:22.732 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-18T01:45:22.732 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-18T01:45:22.732 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-18T01:45:22.816 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:22.816 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:22.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.816+0000 7fd400e0f800 1 Processor -- start 2024-09-18T01:45:22.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.816+0000 7fd400e0f800 1 -- start start 2024-09-18T01:45:22.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.816+0000 7fd400e0f800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x557e4d1a3860 0x557e4d1a5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.816+0000 7fd400e0f800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557e4d05eb30 con 0x557e4d112e90 2024-09-18T01:45:22.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.816+0000 7fd400e0f800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x557e4d040360 con 0x557e4d1a3860 2024-09-18T01:45:22.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.816+0000 7fd3fbce6640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x557e4d1a3860 0x557e4d1a5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.816+0000 7fd3fbce6640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x557e4d1a3860 0x557e4d1a5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59446/0 (socket says 172.21.15.146:59446) 2024-09-18T01:45:22.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.816+0000 7fd3fbce6640 1 -- 172.21.15.146:0/1763367746 learned_addr learned my addr 172.21.15.146:0/1763367746 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:22.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.816+0000 7fd3fc4e7640 1 --1- 172.21.15.146:0/1763367746 >> v1:172.21.15.129:6789/0 conn(0x557e4d112e90 0x557e4d1a2140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:38678/0 (socket says 172.21.15.146:38678) 2024-09-18T01:45:22.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.816+0000 7fd3fbce6640 1 -- 172.21.15.146:0/1763367746 >> v1:172.21.15.129:6789/0 conn(0x557e4d112e90 legacy=0x557e4d1a2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.816+0000 7fd3fbce6640 1 -- 172.21.15.146:0/1763367746 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e4d066e00 con 0x557e4d1a3860 2024-09-18T01:45:22.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.816+0000 7fd3fb4e5640 1 -- 172.21.15.146:0/1763367746 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3052689218 0 0) 0x557e4d05eb30 con 0x557e4d112e90 2024-09-18T01:45:22.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.818+0000 7fd3fbce6640 1 --2- 172.21.15.146:0/1763367746 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557e4d1a3860 0x557e4d1a5c70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd3e400a520 tx=0x7fd3e4045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4956adc68e323c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.818+0000 7fd3fb4e5640 1 -- 172.21.15.146:0/1763367746 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3e4055070 con 0x557e4d1a3860 2024-09-18T01:45:22.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.818+0000 7fd3fb4e5640 1 -- 172.21.15.146:0/1763367746 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3e40515b0 con 0x557e4d1a3860 2024-09-18T01:45:22.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.818+0000 7fd3fb4e5640 1 -- 172.21.15.146:0/1763367746 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3e40518d0 con 0x557e4d1a3860 2024-09-18T01:45:22.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.819+0000 7fd400e0f800 1 -- 172.21.15.146:0/1763367746 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557e4d1a3860 msgr2=0x557e4d1a5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.819+0000 7fd400e0f800 1 --2- 172.21.15.146:0/1763367746 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557e4d1a3860 0x557e4d1a5c70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd3e400a520 tx=0x7fd3e4045ba0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.819+0000 7fd400e0f800 1 -- 172.21.15.146:0/1763367746 shutdown_connections 2024-09-18T01:45:22.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.819+0000 7fd400e0f800 1 --2- 172.21.15.146:0/1763367746 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557e4d1a3860 0x557e4d1a5c70 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.819+0000 7fd400e0f800 1 -- 172.21.15.146:0/1763367746 >> 172.21.15.146:0/1763367746 conn(0x557e4d199df0 msgr2=0x557e4d19c210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:22.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.819+0000 7fd400e0f800 1 -- 172.21.15.146:0/1763367746 shutdown_connections 2024-09-18T01:45:22.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.819+0000 7fd400e0f800 1 -- 172.21.15.146:0/1763367746 wait complete. 2024-09-18T01:45:22.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.832+0000 7fd400e0f800 1 Processor -- start 2024-09-18T01:45:22.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.832+0000 7fd400e0f800 1 -- start start 2024-09-18T01:45:22.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.833+0000 7fd400e0f800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557e4d112e90 0x557e4d19fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.833+0000 7fd400e0f800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x557e4d0eb330 con 0x557e4d112e90 2024-09-18T01:45:22.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.833+0000 7fd3fc4e7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557e4d112e90 0x557e4d19fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.833+0000 7fd3fc4e7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557e4d112e90 0x557e4d19fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59454/0 (socket says 172.21.15.146:59454) 2024-09-18T01:45:22.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.833+0000 7fd3fc4e7640 1 -- 172.21.15.146:0/3335044198 learned_addr learned my addr 172.21.15.146:0/3335044198 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:22.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.833+0000 7fd3fc4e7640 1 -- 172.21.15.146:0/3335044198 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e4d038bc0 con 0x557e4d112e90 2024-09-18T01:45:22.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.834+0000 7fd3fc4e7640 1 --2- 172.21.15.146:0/3335044198 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557e4d112e90 0x557e4d19fa70 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd3f400b240 tx=0x7fd3f400b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0b691a3e14f75cd server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.834+0000 7fd2ea60c640 1 -- 172.21.15.146:0/3335044198 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3f4008070 con 0x557e4d112e90 2024-09-18T01:45:22.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.834+0000 7fd2ea60c640 1 -- 172.21.15.146:0/3335044198 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3f400d500 con 0x557e4d112e90 2024-09-18T01:45:22.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.834+0000 7fd2ea60c640 1 -- 172.21.15.146:0/3335044198 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3f400d860 con 0x557e4d112e90 2024-09-18T01:45:22.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.834+0000 7fd400e0f800 1 -- 172.21.15.146:0/3335044198 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557e4d112e90 msgr2=0x557e4d19fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.834+0000 7fd400e0f800 1 --2- 172.21.15.146:0/3335044198 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557e4d112e90 0x557e4d19fa70 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd3f400b240 tx=0x7fd3f400b700 comp rx=0 tx=0).stop 2024-09-18T01:45:22.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.834+0000 7fd400e0f800 1 -- 172.21.15.146:0/3335044198 shutdown_connections 2024-09-18T01:45:22.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.834+0000 7fd400e0f800 1 --2- 172.21.15.146:0/3335044198 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557e4d112e90 0x557e4d19fa70 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.834+0000 7fd400e0f800 1 -- 172.21.15.146:0/3335044198 >> 172.21.15.146:0/3335044198 conn(0x557e4d199df0 msgr2=0x557e4d289ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:22.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.834+0000 7fd400e0f800 1 -- 172.21.15.146:0/3335044198 shutdown_connections 2024-09-18T01:45:22.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.834+0000 7fd400e0f800 1 -- 172.21.15.146:0/3335044198 wait complete. 2024-09-18T01:45:22.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.835+0000 7fd400e0f800 1 Processor -- start 2024-09-18T01:45:22.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.835+0000 7fd400e0f800 1 -- start start 2024-09-18T01:45:22.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.835+0000 7fd400e0f800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557e4d112e90 0x557e4d2982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.835+0000 7fd400e0f800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x557e4d1a65f0 con 0x557e4d112e90 2024-09-18T01:45:22.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.835+0000 7fd3fc4e7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557e4d112e90 0x557e4d2982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.835+0000 7fd3fc4e7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557e4d112e90 0x557e4d2982c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59456/0 (socket says 172.21.15.146:59456) 2024-09-18T01:45:22.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.835+0000 7fd3fc4e7640 1 -- 172.21.15.146:0/972397026 learned_addr learned my addr 172.21.15.146:0/972397026 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:22.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.835+0000 7fd3fc4e7640 1 -- 172.21.15.146:0/972397026 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e4d04cfe0 con 0x557e4d112e90 2024-09-18T01:45:22.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.835+0000 7fd3fc4e7640 1 --2- 172.21.15.146:0/972397026 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557e4d112e90 0x557e4d2982c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4000f60 tx=0x7fd3f4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.836+0000 7fd2e8e09640 1 -- 172.21.15.146:0/972397026 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3f4019870 con 0x557e4d112e90 2024-09-18T01:45:22.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.836+0000 7fd2e8e09640 1 -- 172.21.15.146:0/972397026 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3f4019a10 con 0x557e4d112e90 2024-09-18T01:45:22.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.836+0000 7fd400e0f800 1 -- 172.21.15.146:0/972397026 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557e4d298800 con 0x557e4d112e90 2024-09-18T01:45:22.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.836+0000 7fd2e8e09640 1 -- 172.21.15.146:0/972397026 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3f4019d10 con 0x557e4d112e90 2024-09-18T01:45:22.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.836+0000 7fd400e0f800 1 -- 172.21.15.146:0/972397026 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e4d298d20 con 0x557e4d112e90 2024-09-18T01:45:22.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.836+0000 7fd2e8e09640 1 -- 172.21.15.146:0/972397026 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd3f4017040 con 0x557e4d112e90 2024-09-18T01:45:22.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.837+0000 7fd2e8e09640 1 --2- 172.21.15.146:0/972397026 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd2e4036b90 0x7fd2e4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.837+0000 7fd2e8e09640 1 -- 172.21.15.146:0/972397026 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fd3f4015020 con 0x557e4d112e90 2024-09-18T01:45:22.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.837+0000 7fd3fbce6640 1 --2- 172.21.15.146:0/972397026 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd2e4036b90 0x7fd2e4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.837+0000 7fd400e0f800 1 --2- 172.21.15.146:0/972397026 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x557e4d1a3860 0x557e4d29f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.837+0000 7fd400e0f800 1 -- 172.21.15.146:0/972397026 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557e4d29f870 con 0x557e4d1a3860 2024-09-18T01:45:22.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.837+0000 7fd3fcce8640 1 --2- 172.21.15.146:0/972397026 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x557e4d1a3860 0x557e4d29f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.837+0000 7fd3fbce6640 1 --2- 172.21.15.146:0/972397026 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd2e4036b90 0x7fd2e4039050 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4057000 tx=0x7fd3e4052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.837+0000 7fd3fcce8640 1 --2- 172.21.15.146:0/972397026 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x557e4d1a3860 0x557e4d29f330 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.837+0000 7fd3fcce8640 1 -- 172.21.15.146:0/972397026 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd3ec00a4a0 con 0x557e4d1a3860 2024-09-18T01:45:22.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.838+0000 7fd400e0f800 1 -- 172.21.15.146:0/972397026 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557e4d29c8e0 con 0x557e4d1a3860 2024-09-18T01:45:22.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.838+0000 7fd3fcce8640 1 -- 172.21.15.146:0/972397026 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd3ec00a4a0 con 0x557e4d1a3860 2024-09-18T01:45:22.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.838+0000 7fd400e0f800 1 -- 172.21.15.146:0/972397026 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2a1650 con 0x557e4d1a3860 2024-09-18T01:45:22.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.838+0000 7fd3fcce8640 1 -- 172.21.15.146:0/972397026 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd3ec00a4a0 con 0x557e4d1a3860 2024-09-18T01:45:22.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.838+0000 7fd400e0f800 1 -- 172.21.15.146:0/972397026 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2a0790 con 0x557e4d1a3860 2024-09-18T01:45:22.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.838+0000 7fd3fcce8640 1 -- 172.21.15.146:0/972397026 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd3ec00a4a0 con 0x557e4d1a3860 2024-09-18T01:45:22.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.838+0000 7fd400e0f800 1 --2- 172.21.15.146:0/972397026 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x557e4d2a1230 0x557e4d2a4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.838+0000 7fd400e0f800 1 -- 172.21.15.146:0/972397026 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2a5220 con 0x557e4d2a1230 2024-09-18T01:45:22.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.839+0000 7fd3fc4e7640 1 --2- 172.21.15.146:0/972397026 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x557e4d2a1230 0x557e4d2a4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.839+0000 7fd3fc4e7640 1 --2- 172.21.15.146:0/972397026 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x557e4d2a1230 0x557e4d2a4a90 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.839+0000 7fd3fc4e7640 1 -- 172.21.15.146:0/972397026 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd3f402d070 con 0x557e4d2a1230 2024-09-18T01:45:22.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.839+0000 7fd400e0f800 1 Processor -- start 2024-09-18T01:45:22.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.839+0000 7fd400e0f800 1 -- start start 2024-09-18T01:45:22.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.840+0000 7fd400e0f800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557e4d2b2fd0 0x557e4d2b33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.840+0000 7fd400e0f800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x557e4d03a580 con 0x557e4d2b2fd0 2024-09-18T01:45:22.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.840+0000 7fd3fcce8640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557e4d2b2fd0 0x557e4d2b33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.840+0000 7fd3fcce8640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557e4d2b2fd0 0x557e4d2b33f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59464/0 (socket says 172.21.15.146:59464) 2024-09-18T01:45:22.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.840+0000 7fd3fcce8640 1 -- 172.21.15.146:0/3336647552 learned_addr learned my addr 172.21.15.146:0/3336647552 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:22.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.840+0000 7fd3fcce8640 1 -- 172.21.15.146:0/3336647552 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e4d2b3930 con 0x557e4d2b2fd0 2024-09-18T01:45:22.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.840+0000 7fd3fcce8640 1 --2- 172.21.15.146:0/3336647552 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557e4d2b2fd0 0x557e4d2b33f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x557e4d29fc30 tx=0x7fd3ec0178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.840+0000 7fd2e1ffb640 1 -- 172.21.15.146:0/3336647552 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3ec013440 con 0x557e4d2b2fd0 2024-09-18T01:45:22.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.840+0000 7fd2e1ffb640 1 -- 172.21.15.146:0/3336647552 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3ec0135e0 con 0x557e4d2b2fd0 2024-09-18T01:45:22.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.840+0000 7fd400e0f800 1 -- 172.21.15.146:0/3336647552 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557e4d2b3bc0 con 0x557e4d2b2fd0 2024-09-18T01:45:22.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.840+0000 7fd2e1ffb640 1 -- 172.21.15.146:0/3336647552 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3ec0138c0 con 0x557e4d2b2fd0 2024-09-18T01:45:22.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.840+0000 7fd400e0f800 1 -- 172.21.15.146:0/3336647552 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e4d2b68a0 con 0x557e4d2b2fd0 2024-09-18T01:45:22.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.841+0000 7fd2e1ffb640 1 -- 172.21.15.146:0/3336647552 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd3ec011040 con 0x557e4d2b2fd0 2024-09-18T01:45:22.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.841+0000 7fd2e1ffb640 1 --2- 172.21.15.146:0/3336647552 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd2d4036b40 0x7fd2d4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.841+0000 7fd2e1ffb640 1 -- 172.21.15.146:0/3336647552 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fd3ec01d070 con 0x557e4d2b2fd0 2024-09-18T01:45:22.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.841+0000 7fd3fc4e7640 1 --2- 172.21.15.146:0/3336647552 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd2d4036b40 0x7fd2d4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.842+0000 7fd400e0f800 1 Processor -- start 2024-09-18T01:45:22.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.842+0000 7fd400e0f800 1 -- start start 2024-09-18T01:45:22.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.842+0000 7fd3fc4e7640 1 --2- 172.21.15.146:0/3336647552 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd2d4036b40 0x7fd2d4039000 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x557e4d2a0b30 tx=0x7fd3f40015f0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.842+0000 7fd400e0f800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557e4d2bfca0 0x557e4d2c00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.842+0000 7fd400e0f800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x557e4d19e140 con 0x557e4d2bfca0 2024-09-18T01:45:22.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.842+0000 7fd3fcce8640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557e4d2bfca0 0x557e4d2c00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.842+0000 7fd3fcce8640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557e4d2bfca0 0x557e4d2c00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59478/0 (socket says 172.21.15.146:59478) 2024-09-18T01:45:22.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.842+0000 7fd3fcce8640 1 -- 172.21.15.146:0/3297216997 learned_addr learned my addr 172.21.15.146:0/3297216997 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:22.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.842+0000 7fd3fcce8640 1 -- 172.21.15.146:0/3297216997 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e4d2c0670 con 0x557e4d2bfca0 2024-09-18T01:45:22.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.842+0000 7fd3fcce8640 1 --2- 172.21.15.146:0/3297216997 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557e4d2bfca0 0x557e4d2c00a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec04cb30 tx=0x7fd3ec012a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bffddefa6896cc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.842+0000 7fd2db7fe640 1 -- 172.21.15.146:0/3297216997 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3ec045070 con 0x557e4d2bfca0 2024-09-18T01:45:22.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.842+0000 7fd2db7fe640 1 -- 172.21.15.146:0/3297216997 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3ec015430 con 0x557e4d2bfca0 2024-09-18T01:45:22.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.842+0000 7fd2db7fe640 1 -- 172.21.15.146:0/3297216997 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3ec02ac50 con 0x557e4d2bfca0 2024-09-18T01:45:22.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.843+0000 7fd400e0f800 1 -- 172.21.15.146:0/3297216997 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557e4d2bfca0 msgr2=0x557e4d2c00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.843+0000 7fd400e0f800 1 --2- 172.21.15.146:0/3297216997 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557e4d2bfca0 0x557e4d2c00a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec04cb30 tx=0x7fd3ec012a30 comp rx=0 tx=0).stop 2024-09-18T01:45:22.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.843+0000 7fd400e0f800 1 -- 172.21.15.146:0/3297216997 shutdown_connections 2024-09-18T01:45:22.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.843+0000 7fd400e0f800 1 --2- 172.21.15.146:0/3297216997 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557e4d2bfca0 0x557e4d2c00a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.843+0000 7fd400e0f800 1 -- 172.21.15.146:0/3297216997 >> 172.21.15.146:0/3297216997 conn(0x557e4d2bc000 msgr2=0x557e4d2ba100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:22.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.843+0000 7fd400e0f800 1 -- 172.21.15.146:0/3297216997 shutdown_connections 2024-09-18T01:45:22.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.843+0000 7fd400e0f800 1 -- 172.21.15.146:0/3297216997 wait complete. 2024-09-18T01:45:22.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.843+0000 7fd400e0f800 1 Processor -- start 2024-09-18T01:45:22.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.843+0000 7fd400e0f800 1 -- start start 2024-09-18T01:45:22.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.843+0000 7fd400e0f800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557e4d2bfca0 0x557e4d2c70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.843+0000 7fd400e0f800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x557e4d2c0d20 con 0x557e4d2bfca0 2024-09-18T01:45:22.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.844+0000 7fd3fcce8640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557e4d2bfca0 0x557e4d2c70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.844+0000 7fd3fcce8640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557e4d2bfca0 0x557e4d2c70e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59492/0 (socket says 172.21.15.146:59492) 2024-09-18T01:45:22.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.844+0000 7fd3fcce8640 1 -- 172.21.15.146:0/2787135373 learned_addr learned my addr 172.21.15.146:0/2787135373 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:22.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.844+0000 7fd3fcce8640 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e4d2c7620 con 0x557e4d2bfca0 2024-09-18T01:45:22.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.844+0000 7fd3fcce8640 1 --2- 172.21.15.146:0/2787135373 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557e4d2bfca0 0x557e4d2c70e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec04cb30 tx=0x7fd3ec04c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.844+0000 7fd2d9ffb640 1 -- 172.21.15.146:0/2787135373 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3ec045030 con 0x557e4d2bfca0 2024-09-18T01:45:22.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.844+0000 7fd2d9ffb640 1 -- 172.21.15.146:0/2787135373 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3ec001700 con 0x557e4d2bfca0 2024-09-18T01:45:22.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.844+0000 7fd400e0f800 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557e4d2c78b0 con 0x557e4d2bfca0 2024-09-18T01:45:22.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.844+0000 7fd2d9ffb640 1 -- 172.21.15.146:0/2787135373 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3ec013af0 con 0x557e4d2bfca0 2024-09-18T01:45:22.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.844+0000 7fd400e0f800 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e4d2ca560 con 0x557e4d2bfca0 2024-09-18T01:45:22.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.845+0000 7fd2d9ffb640 1 -- 172.21.15.146:0/2787135373 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd3ec013c90 con 0x557e4d2bfca0 2024-09-18T01:45:22.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.845+0000 7fd2d9ffb640 1 --2- 172.21.15.146:0/2787135373 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd2cc036b40 0x7fd2cc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.845+0000 7fd2d9ffb640 1 -- 172.21.15.146:0/2787135373 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fd3ec046070 con 0x557e4d2bfca0 2024-09-18T01:45:22.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.845+0000 7fd3fc4e7640 1 --2- 172.21.15.146:0/2787135373 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd2cc036b40 0x7fd2cc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.846+0000 7fd3fc4e7640 1 --2- 172.21.15.146:0/2787135373 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd2cc036b40 0x7fd2cc039000 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd3f400e500 tx=0x7fd3f4032040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.846+0000 7fd400e0f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.846+0000 7fd400e0f800 1 --2- 172.21.15.146:0/2787135373 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x557e4d2d2db0 0x557e4d2d5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.846+0000 7fd400e0f800 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2d59c0 con 0x557e4d2d2db0 2024-09-18T01:45:22.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.846+0000 7fd3fbce6640 1 --2- 172.21.15.146:0/2787135373 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x557e4d2d2db0 0x557e4d2d5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.846+0000 7fd3fbce6640 1 --2- 172.21.15.146:0/2787135373 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x557e4d2d2db0 0x557e4d2d5270 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.846+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd3e4057030 con 0x557e4d2d2db0 2024-09-18T01:45:22.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.846+0000 7fd400e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:22.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.846+0000 7fd400e0f800 20 realm 2024-09-18T01:45:22.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.846+0000 7fd400e0f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.846+0000 7fd400e0f800 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2d5df0 con 0x557e4d2d2db0 2024-09-18T01:45:22.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.847+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd3e4057030 con 0x557e4d2d2db0 2024-09-18T01:45:22.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.847+0000 7fd400e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:22.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.847+0000 7fd400e0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:22.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.847+0000 7fd400e0f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.847+0000 7fd400e0f800 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2d66c0 con 0x557e4d2d2db0 2024-09-18T01:45:22.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.847+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd3e4057030 con 0x557e4d2d2db0 2024-09-18T01:45:22.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.847+0000 7fd400e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:22.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.847+0000 7fd400e0f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.847+0000 7fd400e0f800 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2d6a60 con 0x557e4d2d2db0 2024-09-18T01:45:22.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.847+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd3e4057030 con 0x557e4d2d2db0 2024-09-18T01:45:22.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.847+0000 7fd400e0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:22.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.847+0000 7fd400e0f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.847+0000 7fd400e0f800 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2d62d0 con 0x557e4d2d2db0 2024-09-18T01:45:22.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.847+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd3e4057030 con 0x557e4d2d2db0 2024-09-18T01:45:22.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.847+0000 7fd400e0f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:22.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.847+0000 7fd400e0f800 20 searching for the correct realm 2024-09-18T01:45:22.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.847+0000 7fd400e0f800 1 --2- 172.21.15.146:0/2787135373 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x557e4d2d8f20 0x557e4d2db330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.847+0000 7fd400e0f800 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2dba00 con 0x557e4d2d8f20 2024-09-18T01:45:22.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.848+0000 7fd3fcce8640 1 --2- 172.21.15.146:0/2787135373 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x557e4d2d8f20 0x557e4d2db330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.848+0000 7fd3fcce8640 1 --2- 172.21.15.146:0/2787135373 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x557e4d2d8f20 0x557e4d2db330 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.848+0000 7fd3fcce8640 1 -- 172.21.15.146:0/2787135373 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3ec03c020 con 0x557e4d2d8f20 2024-09-18T01:45:22.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.848+0000 7fd3fcce8640 1 --2- 172.21.15.146:0/2787135373 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fd3ec0500c0 0x7fd3ec02b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.848+0000 7fd3fcce8640 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2dba00 con 0x7fd3ec0500c0 2024-09-18T01:45:22.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.848+0000 7fd3fc4e7640 1 --2- 172.21.15.146:0/2787135373 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fd3ec0500c0 0x7fd3ec02b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.848+0000 7fd3fc4e7640 1 --2- 172.21.15.146:0/2787135373 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fd3ec0500c0 0x7fd3ec02b600 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.849+0000 7fd3fc4e7640 1 -- 172.21.15.146:0/2787135373 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3f4044d70 con 0x7fd3ec0500c0 2024-09-18T01:45:22.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.849+0000 7fd3fc4e7640 1 --2- 172.21.15.146:0/2787135373 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fd3f4018ab0 0x7fd3f400f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.849+0000 7fd3fc4e7640 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2dba00 con 0x7fd3f4018ab0 2024-09-18T01:45:22.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.849+0000 7fd3fbce6640 1 --2- 172.21.15.146:0/2787135373 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fd3f4018ab0 0x7fd3f400f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.849+0000 7fd3fbce6640 1 --2- 172.21.15.146:0/2787135373 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fd3f4018ab0 0x7fd3f400f470 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.849+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3e4057030 con 0x7fd3f4018ab0 2024-09-18T01:45:22.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.849+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2dba00 con 0x557e4d2d2db0 2024-09-18T01:45:22.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.850+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd3e4057030 con 0x557e4d2d2db0 2024-09-18T01:45:22.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.850+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2dba00 con 0x557e4d2d2db0 2024-09-18T01:45:22.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.850+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3e4057030 con 0x557e4d2d2db0 2024-09-18T01:45:22.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.850+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2dba00 con 0x7fd3f4018ab0 2024-09-18T01:45:22.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.850+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3e4057030 con 0x7fd3f4018ab0 2024-09-18T01:45:22.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.850+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2dba00 con 0x7fd3f4018ab0 2024-09-18T01:45:22.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.850+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3e4057030 con 0x7fd3f4018ab0 2024-09-18T01:45:22.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.850+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2dba00 con 0x7fd3ec0500c0 2024-09-18T01:45:22.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.851+0000 7fd3fc4e7640 1 -- 172.21.15.146:0/2787135373 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3f4044d70 con 0x7fd3ec0500c0 2024-09-18T01:45:22.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.851+0000 7fd3fc4e7640 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2dba00 con 0x557e4d2d8f20 2024-09-18T01:45:22.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.851+0000 7fd3fcce8640 1 -- 172.21.15.146:0/2787135373 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3ec03c020 con 0x557e4d2d8f20 2024-09-18T01:45:22.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.851+0000 7fd3fcce8640 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2dba00 con 0x557e4d2d2db0 2024-09-18T01:45:22.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.851+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3e4057030 con 0x557e4d2d2db0 2024-09-18T01:45:22.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.851+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2dba00 con 0x7fd3f4018ab0 2024-09-18T01:45:22.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.851+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3e4057030 con 0x7fd3f4018ab0 2024-09-18T01:45:22.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.851+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2dba00 con 0x557e4d2d2db0 2024-09-18T01:45:22.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.852+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3e4057030 con 0x557e4d2d2db0 2024-09-18T01:45:22.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.852+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2dba00 con 0x7fd3ec0500c0 2024-09-18T01:45:22.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.852+0000 7fd3fc4e7640 1 -- 172.21.15.146:0/2787135373 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fd3f4044d70 con 0x7fd3ec0500c0 2024-09-18T01:45:22.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.852+0000 7fd3fc4e7640 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2dba00 con 0x557e4d2d8f20 2024-09-18T01:45:22.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.852+0000 7fd3fcce8640 1 -- 172.21.15.146:0/2787135373 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3ec03c020 con 0x557e4d2d8f20 2024-09-18T01:45:22.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.852+0000 7fd3fcce8640 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2dba00 con 0x557e4d2d8f20 2024-09-18T01:45:22.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.852+0000 7fd3fcce8640 1 -- 172.21.15.146:0/2787135373 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3ec03c020 con 0x557e4d2d8f20 2024-09-18T01:45:22.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.852+0000 7fd3fcce8640 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2dba00 con 0x7fd3f4018ab0 2024-09-18T01:45:22.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.853+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3e4057030 con 0x7fd3f4018ab0 2024-09-18T01:45:22.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.853+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2dba00 con 0x557e4d2d8f20 2024-09-18T01:45:22.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.853+0000 7fd3fcce8640 1 -- 172.21.15.146:0/2787135373 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3ec03c020 con 0x557e4d2d8f20 2024-09-18T01:45:22.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.853+0000 7fd3fcce8640 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2dba00 con 0x557e4d2d8f20 2024-09-18T01:45:22.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.853+0000 7fd3fcce8640 1 -- 172.21.15.146:0/2787135373 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3ec03c020 con 0x557e4d2d8f20 2024-09-18T01:45:22.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.853+0000 7fd3fcce8640 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2dba00 con 0x557e4d2d2db0 2024-09-18T01:45:22.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.853+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3e4057030 con 0x557e4d2d2db0 2024-09-18T01:45:22.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.853+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2dba00 con 0x557e4d2d2db0 2024-09-18T01:45:22.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.853+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd3e4057030 con 0x557e4d2d2db0 2024-09-18T01:45:22.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.853+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2dba00 con 0x7fd3f4018ab0 2024-09-18T01:45:22.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.854+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3e4057030 con 0x7fd3f4018ab0 2024-09-18T01:45:22.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.854+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2dba00 con 0x557e4d2d8f20 2024-09-18T01:45:22.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.854+0000 7fd3fcce8640 1 -- 172.21.15.146:0/2787135373 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3ec03c020 con 0x557e4d2d8f20 2024-09-18T01:45:22.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.854+0000 7fd3fcce8640 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2dba00 con 0x7fd3ec0500c0 2024-09-18T01:45:22.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.854+0000 7fd3fc4e7640 1 -- 172.21.15.146:0/2787135373 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3f4044d70 con 0x7fd3ec0500c0 2024-09-18T01:45:22.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.854+0000 7fd3fc4e7640 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2dba00 con 0x557e4d2d2db0 2024-09-18T01:45:22.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.854+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3e4057030 con 0x557e4d2d2db0 2024-09-18T01:45:22.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.854+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2dba00 con 0x7fd3f4018ab0 2024-09-18T01:45:22.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.855+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3e4057030 con 0x7fd3f4018ab0 2024-09-18T01:45:22.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.855+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2dba00 con 0x557e4d2d8f20 2024-09-18T01:45:22.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.855+0000 7fd3fcce8640 1 -- 172.21.15.146:0/2787135373 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3ec03c020 con 0x557e4d2d8f20 2024-09-18T01:45:22.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.855+0000 7fd3fcce8640 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2dba00 con 0x7fd3f4018ab0 2024-09-18T01:45:22.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.855+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3e4057030 con 0x7fd3f4018ab0 2024-09-18T01:45:22.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.855+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2dba00 con 0x7fd3ec0500c0 2024-09-18T01:45:22.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.855+0000 7fd3fc4e7640 1 -- 172.21.15.146:0/2787135373 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3f4044d70 con 0x7fd3ec0500c0 2024-09-18T01:45:22.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.855+0000 7fd3fc4e7640 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2dba00 con 0x557e4d2d8f20 2024-09-18T01:45:22.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.856+0000 7fd3fcce8640 1 -- 172.21.15.146:0/2787135373 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3ec03c020 con 0x557e4d2d8f20 2024-09-18T01:45:22.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.856+0000 7fd3fcce8640 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2dba00 con 0x7fd3f4018ab0 2024-09-18T01:45:22.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.856+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3e4057030 con 0x7fd3f4018ab0 2024-09-18T01:45:22.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.856+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2dba00 con 0x557e4d2d2db0 2024-09-18T01:45:22.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.856+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd3e4057030 con 0x557e4d2d2db0 2024-09-18T01:45:22.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.856+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2dba00 con 0x7fd3ec0500c0 2024-09-18T01:45:22.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.856+0000 7fd3fc4e7640 1 -- 172.21.15.146:0/2787135373 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3f4044d70 con 0x7fd3ec0500c0 2024-09-18T01:45:22.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.856+0000 7fd400e0f800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:22.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.856+0000 7fd400e0f800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:22.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.856+0000 7fd400e0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:22.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.856+0000 7fd400e0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:22.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.856+0000 7fd400e0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:22.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.856+0000 7fd400e0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:22.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.856+0000 7fd400e0f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.856+0000 7fd400e0f800 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2d7970 con 0x557e4d2d2db0 2024-09-18T01:45:22.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.857+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd3e4057030 con 0x557e4d2d2db0 2024-09-18T01:45:22.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.857+0000 7fd400e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:22.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.857+0000 7fd400e0f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.857+0000 7fd400e0f800 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2d8210 con 0x557e4d2d2db0 2024-09-18T01:45:22.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.857+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd3e4057030 con 0x557e4d2d2db0 2024-09-18T01:45:22.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.857+0000 7fd400e0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:22.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.857+0000 7fd400e0f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.857+0000 7fd400e0f800 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2d75b0 con 0x7fd3ec0500c0 2024-09-18T01:45:22.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.857+0000 7fd3fc4e7640 1 -- 172.21.15.146:0/2787135373 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd3f4044d70 con 0x7fd3ec0500c0 2024-09-18T01:45:22.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.857+0000 7fd400e0f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:22.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.857+0000 7fd400e0f800 20 zone default found 2024-09-18T01:45:22.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.857+0000 7fd400e0f800 4 Realm: () 2024-09-18T01:45:22.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.857+0000 7fd400e0f800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:22.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.857+0000 7fd400e0f800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:22.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.857+0000 7fd400e0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:22.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.857+0000 7fd400e0f800 20 zonegroup default 2024-09-18T01:45:22.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.857+0000 7fd400e0f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.857+0000 7fd400e0f800 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2dc330 con 0x7fd3f4018ab0 2024-09-18T01:45:22.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.858+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd3e4057030 con 0x7fd3f4018ab0 2024-09-18T01:45:22.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.858+0000 7fd400e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:22.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.858+0000 7fd400e0f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.858+0000 7fd400e0f800 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2dde00 con 0x557e4d2d8f20 2024-09-18T01:45:22.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.858+0000 7fd3fcce8640 1 -- 172.21.15.146:0/2787135373 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd3ec03c020 con 0x557e4d2d8f20 2024-09-18T01:45:22.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.858+0000 7fd400e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:22.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.858+0000 7fd400e0f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.858+0000 7fd400e0f800 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2de2c0 con 0x557e4d2d8f20 2024-09-18T01:45:22.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.858+0000 7fd3fcce8640 1 -- 172.21.15.146:0/2787135373 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd3ec03c020 con 0x557e4d2d8f20 2024-09-18T01:45:22.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.858+0000 7fd400e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:22.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.858+0000 7fd400e0f800 20 started sync module instance, tier type = 2024-09-18T01:45:22.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.858+0000 7fd400e0f800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:22.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.858+0000 7fd400e0f800 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2dd930 con 0x7fd3ec0500c0 2024-09-18T01:45:22.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.859+0000 7fd3fc4e7640 1 -- 172.21.15.146:0/2787135373 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v31'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3f4044d70 con 0x7fd3ec0500c0 2024-09-18T01:45:22.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.859+0000 7fd400e0f800 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94000949087664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2de720 con 0x7fd3ec0500c0 2024-09-18T01:45:22.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.859+0000 7fd400e0f800 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2df190 con 0x557e4d2d2db0 2024-09-18T01:45:22.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.860+0000 7fd3fc4e7640 1 -- 172.21.15.146:0/2787135373 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94000949087664] v31'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3f4044d70 con 0x7fd3ec0500c0 2024-09-18T01:45:22.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.861+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v31'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3e4057030 con 0x557e4d2d2db0 2024-09-18T01:45:22.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.861+0000 7fd400e0f800 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94000949095552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2df5b0 con 0x557e4d2d2db0 2024-09-18T01:45:22.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.861+0000 7fd400e0f800 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2dfff0 con 0x557e4d2d8f20 2024-09-18T01:45:22.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.862+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94000949095552] v31'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3e4057030 con 0x557e4d2d2db0 2024-09-18T01:45:22.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.862+0000 7fd3fcce8640 1 -- 172.21.15.146:0/2787135373 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v31'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3ec03c020 con 0x557e4d2d8f20 2024-09-18T01:45:22.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.862+0000 7fd400e0f800 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94000949099200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2e03e0 con 0x557e4d2d8f20 2024-09-18T01:45:22.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.862+0000 7fd400e0f800 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2e0e40 con 0x7fd3ec0500c0 2024-09-18T01:45:22.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.863+0000 7fd3fc4e7640 1 -- 172.21.15.146:0/2787135373 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v31'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3f4044d70 con 0x7fd3ec0500c0 2024-09-18T01:45:22.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.863+0000 7fd400e0f800 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94000949102880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2e16e0 con 0x7fd3ec0500c0 2024-09-18T01:45:22.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.863+0000 7fd400e0f800 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2e21c0 con 0x557e4d2d2db0 2024-09-18T01:45:22.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.863+0000 7fd3fcce8640 1 -- 172.21.15.146:0/2787135373 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94000949099200] v31'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3ec03c020 con 0x557e4d2d8f20 2024-09-18T01:45:22.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.864+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v31'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3e4057030 con 0x557e4d2d2db0 2024-09-18T01:45:22.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.864+0000 7fd3fc4e7640 1 -- 172.21.15.146:0/2787135373 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94000949102880] v31'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3f4044d70 con 0x7fd3ec0500c0 2024-09-18T01:45:22.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.864+0000 7fd400e0f800 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94000949107920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2e25b0 con 0x557e4d2d2db0 2024-09-18T01:45:22.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.864+0000 7fd400e0f800 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2e1230 con 0x7fd3f4018ab0 2024-09-18T01:45:22.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.865+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v31'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3e4057030 con 0x7fd3f4018ab0 2024-09-18T01:45:22.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.865+0000 7fd400e0f800 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94000949111488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2e2560 con 0x7fd3f4018ab0 2024-09-18T01:45:22.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.865+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94000949107920] v31'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3e4057030 con 0x557e4d2d2db0 2024-09-18T01:45:22.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.865+0000 7fd400e0f800 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2e39b0 con 0x7fd3f4018ab0 2024-09-18T01:45:22.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.866+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94000949111488] v31'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3e4057030 con 0x7fd3f4018ab0 2024-09-18T01:45:22.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.866+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v31'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3e4057030 con 0x7fd3f4018ab0 2024-09-18T01:45:22.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.866+0000 7fd400e0f800 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94000949112544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2e3500 con 0x7fd3f4018ab0 2024-09-18T01:45:22.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.866+0000 7fd400e0f800 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2e4280 con 0x7fd3f4018ab0 2024-09-18T01:45:22.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.867+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94000949112544] v31'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3e4057030 con 0x7fd3f4018ab0 2024-09-18T01:45:22.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.867+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v31'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3e4057030 con 0x7fd3f4018ab0 2024-09-18T01:45:22.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.867+0000 7fd400e0f800 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94000949088896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2e3500 con 0x7fd3f4018ab0 2024-09-18T01:45:22.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.867+0000 7fd400e0f800 20 add_watcher() i=0 2024-09-18T01:45:22.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.867+0000 7fd400e0f800 20 add_watcher() i=1 2024-09-18T01:45:22.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.867+0000 7fd400e0f800 20 add_watcher() i=2 2024-09-18T01:45:22.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.867+0000 7fd400e0f800 20 add_watcher() i=3 2024-09-18T01:45:22.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.867+0000 7fd400e0f800 20 add_watcher() i=4 2024-09-18T01:45:22.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.867+0000 7fd400e0f800 20 add_watcher() i=5 2024-09-18T01:45:22.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.867+0000 7fd400e0f800 20 add_watcher() i=6 2024-09-18T01:45:22.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.868+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94000949088896] v31'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3e4057030 con 0x7fd3f4018ab0 2024-09-18T01:45:22.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.868+0000 7fd400e0f800 20 add_watcher() i=7 2024-09-18T01:45:22.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.868+0000 7fd400e0f800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:22.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.868+0000 7fd400e0f800 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2e72b0 con 0x557e4d2d2db0 2024-09-18T01:45:22.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.868+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd3e4057030 con 0x557e4d2d2db0 2024-09-18T01:45:22.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.868+0000 7fd400e0f800 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94000949116288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e4d2e4720 con 0x557e4d2d2db0 2024-09-18T01:45:22.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.869+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94000949116288] v31'54 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd3e4057030 con 0x557e4d2d2db0 2024-09-18T01:45:22.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.869+0000 7fd2b27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:22.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.869+0000 7fd400e0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:22.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.869+0000 7fd400e0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:22.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.870+0000 7fd400e0f800 5 note: GC not initialized 2024-09-18T01:45:22.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.870+0000 7fd2b17e2640 20 reqs_thread_entry: start 2024-09-18T01:45:22.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.870+0000 7fd400e0f800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:22.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.870+0000 7fd400e0f800 20 Filter name: none 2024-09-18T01:45:22.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.870+0000 7fd222ffd640 20 reqs_thread_entry: start 2024-09-18T01:45:22.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.870+0000 7fd400e0f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:22.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.870+0000 7fd400e0f800 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557e4d31a0c0 con 0x557e4d2d2db0 2024-09-18T01:45:22.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.870+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fd3e4057030 con 0x557e4d2d2db0 2024-09-18T01:45:22.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.870+0000 7fd400e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:22.885 INFO:teuthology.orchestra.run.smithi146.stderr:could not fetch user info: no user info saved 2024-09-18T01:45:22.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.871+0000 7fd2b27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:22.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.871+0000 7fd400e0f800 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94000949116288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e4d31a080 con 0x557e4d2d2db0 2024-09-18T01:45:22.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.872+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94000949116288] v31'55 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd3e4057030 con 0x557e4d2d2db0 2024-09-18T01:45:22.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.872+0000 7fd400e0f800 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94000949087664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e4d317eb0 con 0x7fd3ec0500c0 2024-09-18T01:45:22.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.873+0000 7fd3fc4e7640 1 -- 172.21.15.146:0/2787135373 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94000949087664] v31'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3f4044d70 con 0x7fd3ec0500c0 2024-09-18T01:45:22.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.873+0000 7fd400e0f800 20 remove_watcher() i=0 2024-09-18T01:45:22.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.873+0000 7fd400e0f800 2 removed watcher, disabling cache 2024-09-18T01:45:22.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.873+0000 7fd400e0f800 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94000949095552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e4d317eb0 con 0x557e4d2d2db0 2024-09-18T01:45:22.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.874+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94000949095552] v31'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3e4057030 con 0x557e4d2d2db0 2024-09-18T01:45:22.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.874+0000 7fd400e0f800 20 remove_watcher() i=1 2024-09-18T01:45:22.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.874+0000 7fd400e0f800 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94000949099200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e4d317eb0 con 0x557e4d2d8f20 2024-09-18T01:45:22.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.875+0000 7fd3fcce8640 1 -- 172.21.15.146:0/2787135373 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94000949099200] v31'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3ec03c020 con 0x557e4d2d8f20 2024-09-18T01:45:22.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.875+0000 7fd400e0f800 20 remove_watcher() i=2 2024-09-18T01:45:22.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.875+0000 7fd400e0f800 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94000949102880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e4d317eb0 con 0x7fd3ec0500c0 2024-09-18T01:45:22.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.876+0000 7fd3fc4e7640 1 -- 172.21.15.146:0/2787135373 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94000949102880] v31'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3f4044d70 con 0x7fd3ec0500c0 2024-09-18T01:45:22.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.876+0000 7fd400e0f800 20 remove_watcher() i=3 2024-09-18T01:45:22.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.876+0000 7fd400e0f800 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94000949107920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e4d317eb0 con 0x557e4d2d2db0 2024-09-18T01:45:22.894 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-18T01:45:22.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.877+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94000949107920] v31'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3e4057030 con 0x557e4d2d2db0 2024-09-18T01:45:22.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.877+0000 7fd400e0f800 20 remove_watcher() i=4 2024-09-18T01:45:22.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.877+0000 7fd400e0f800 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94000949111488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e4d317eb0 con 0x7fd3f4018ab0 2024-09-18T01:45:22.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.878+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94000949111488] v31'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3e4057030 con 0x7fd3f4018ab0 2024-09-18T01:45:22.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.878+0000 7fd400e0f800 20 remove_watcher() i=5 2024-09-18T01:45:22.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.878+0000 7fd400e0f800 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94000949112544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e4d317eb0 con 0x7fd3f4018ab0 2024-09-18T01:45:22.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.879+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94000949112544] v31'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3e4057030 con 0x7fd3f4018ab0 2024-09-18T01:45:22.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.879+0000 7fd400e0f800 20 remove_watcher() i=6 2024-09-18T01:45:22.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.879+0000 7fd400e0f800 1 -- 172.21.15.146:0/2787135373 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94000949088896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e4d317eb0 con 0x7fd3f4018ab0 2024-09-18T01:45:22.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.880+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94000949088896] v31'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3e4057030 con 0x7fd3f4018ab0 2024-09-18T01:45:22.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.880+0000 7fd400e0f800 20 remove_watcher() i=7 2024-09-18T01:45:22.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.880+0000 7fd400e0f800 1 -- 172.21.15.146:0/2787135373 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fd3f4018ab0 msgr2=0x7fd3f400f470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.880+0000 7fd400e0f800 1 --2- 172.21.15.146:0/2787135373 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fd3f4018ab0 0x7fd3f400f470 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.880+0000 7fd400e0f800 1 -- 172.21.15.146:0/2787135373 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x557e4d2d2db0 msgr2=0x557e4d2d5270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.880+0000 7fd400e0f800 1 --2- 172.21.15.146:0/2787135373 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x557e4d2d2db0 0x557e4d2d5270 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.880+0000 7fd400e0f800 1 -- 172.21.15.146:0/2787135373 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fd3ec0500c0 msgr2=0x7fd3ec02b600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.880+0000 7fd400e0f800 1 --2- 172.21.15.146:0/2787135373 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fd3ec0500c0 0x7fd3ec02b600 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.880+0000 7fd400e0f800 1 -- 172.21.15.146:0/2787135373 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x557e4d2d8f20 msgr2=0x557e4d2db330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.880+0000 7fd400e0f800 1 --2- 172.21.15.146:0/2787135373 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x557e4d2d8f20 0x557e4d2db330 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.881+0000 7fd400e0f800 1 -- 172.21.15.146:0/2787135373 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd2cc036b40 msgr2=0x7fd2cc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.881+0000 7fd400e0f800 1 --2- 172.21.15.146:0/2787135373 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd2cc036b40 0x7fd2cc039000 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd3f400e500 tx=0x7fd3f4032040 comp rx=0 tx=0).stop 2024-09-18T01:45:22.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.881+0000 7fd400e0f800 1 -- 172.21.15.146:0/2787135373 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557e4d2bfca0 msgr2=0x557e4d2c70e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.881+0000 7fd400e0f800 1 --2- 172.21.15.146:0/2787135373 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557e4d2bfca0 0x557e4d2c70e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec04cb30 tx=0x7fd3ec04c840 comp rx=0 tx=0).stop 2024-09-18T01:45:22.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.881+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 reap_dead start 2024-09-18T01:45:22.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.881+0000 7fd3fbce6640 1 -- 172.21.15.146:0/2787135373 reap_dead start 2024-09-18T01:45:22.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.881+0000 7fd400e0f800 1 -- 172.21.15.146:0/2787135373 shutdown_connections 2024-09-18T01:45:22.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.881+0000 7fd400e0f800 1 -- 172.21.15.146:0/2787135373 >> 172.21.15.146:0/2787135373 conn(0x557e4d2bc000 msgr2=0x557e4d2ba0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:22.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.881+0000 7fd400e0f800 1 -- 172.21.15.146:0/2787135373 shutdown_connections 2024-09-18T01:45:22.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.881+0000 7fd400e0f800 1 -- 172.21.15.146:0/2787135373 wait complete. 2024-09-18T01:45:22.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.881+0000 7fd400e0f800 1 -- 172.21.15.146:0/3336647552 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd2d4036b40 msgr2=0x7fd2d4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.881+0000 7fd400e0f800 1 --2- 172.21.15.146:0/3336647552 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd2d4036b40 0x7fd2d4039000 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x557e4d2a0b30 tx=0x7fd3f40015f0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.881+0000 7fd400e0f800 1 -- 172.21.15.146:0/3336647552 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557e4d2b2fd0 msgr2=0x557e4d2b33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.881+0000 7fd400e0f800 1 --2- 172.21.15.146:0/3336647552 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557e4d2b2fd0 0x557e4d2b33f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x557e4d29fc30 tx=0x7fd3ec0178e0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.881+0000 7fd400e0f800 1 -- 172.21.15.146:0/3336647552 shutdown_connections 2024-09-18T01:45:22.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.881+0000 7fd400e0f800 1 --2- 172.21.15.146:0/3336647552 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd2d4036b40 0x7fd2d4039000 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.881+0000 7fd400e0f800 1 --2- 172.21.15.146:0/3336647552 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557e4d2b2fd0 0x557e4d2b33f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.881+0000 7fd400e0f800 1 -- 172.21.15.146:0/3336647552 >> 172.21.15.146:0/3336647552 conn(0x557e4d2a7f60 msgr2=0x557e4d2aaae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:22.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.881+0000 7fd400e0f800 1 -- 172.21.15.146:0/3336647552 shutdown_connections 2024-09-18T01:45:22.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.881+0000 7fd400e0f800 1 -- 172.21.15.146:0/3336647552 wait complete. 2024-09-18T01:45:22.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.881+0000 7fd400e0f800 1 -- 172.21.15.146:0/972397026 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x557e4d1a3860 msgr2=0x557e4d29f330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.881+0000 7fd400e0f800 1 --2- 172.21.15.146:0/972397026 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x557e4d1a3860 0x557e4d29f330 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.881+0000 7fd400e0f800 1 -- 172.21.15.146:0/972397026 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x557e4d2a1230 msgr2=0x557e4d2a4a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.881+0000 7fd400e0f800 1 --2- 172.21.15.146:0/972397026 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x557e4d2a1230 0x557e4d2a4a90 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.881+0000 7fd400e0f800 1 -- 172.21.15.146:0/972397026 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd2e4036b90 msgr2=0x7fd2e4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.882+0000 7fd400e0f800 1 --2- 172.21.15.146:0/972397026 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd2e4036b90 0x7fd2e4039050 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4057000 tx=0x7fd3e4052000 comp rx=0 tx=0).stop 2024-09-18T01:45:22.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.882+0000 7fd400e0f800 1 -- 172.21.15.146:0/972397026 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557e4d112e90 msgr2=0x557e4d2982c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.882+0000 7fd400e0f800 1 --2- 172.21.15.146:0/972397026 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557e4d112e90 0x557e4d2982c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4000f60 tx=0x7fd3f4000ed0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.882+0000 7fd400e0f800 1 -- 172.21.15.146:0/972397026 shutdown_connections 2024-09-18T01:45:22.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.882+0000 7fd400e0f800 1 --2- 172.21.15.146:0/972397026 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x557e4d2a1230 0x557e4d2a4a90 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.882+0000 7fd400e0f800 1 --2- 172.21.15.146:0/972397026 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x557e4d1a3860 0x557e4d29f330 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.882+0000 7fd400e0f800 1 --2- 172.21.15.146:0/972397026 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd2e4036b90 0x7fd2e4039050 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.882+0000 7fd400e0f800 1 --2- 172.21.15.146:0/972397026 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557e4d112e90 0x557e4d2982c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.882+0000 7fd400e0f800 1 -- 172.21.15.146:0/972397026 >> 172.21.15.146:0/972397026 conn(0x557e4d199df0 msgr2=0x557e4d289bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:22.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.882+0000 7fd400e0f800 1 -- 172.21.15.146:0/972397026 shutdown_connections 2024-09-18T01:45:22.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.882+0000 7fd400e0f800 1 -- 172.21.15.146:0/972397026 wait complete. 2024-09-18T01:45:22.900 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-18T01:45:22.900 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-18T01:45:22.900 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid foo --display-name Foo --email foo@foo.com --access-key 9te6NH5mcdcq0Tc5i8i1 --secret Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu --max-buckets 4 2024-09-18T01:45:22.955 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:22.955 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:22.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.955+0000 7f022d663800 1 Processor -- start 2024-09-18T01:45:22.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.955+0000 7f022d663800 1 -- start start 2024-09-18T01:45:22.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.955+0000 7f022d663800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x56089bc8bd70 0x56089bc8e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.955+0000 7f022d663800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56089bb44b30 con 0x56089bbf9640 2024-09-18T01:45:22.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.955+0000 7f022d663800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x56089bb26360 con 0x56089bc8bd70 2024-09-18T01:45:22.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.955+0000 7f022a956640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x56089bc8bd70 0x56089bc8e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.955+0000 7f022a956640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x56089bc8bd70 0x56089bc8e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59500/0 (socket says 172.21.15.146:59500) 2024-09-18T01:45:22.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.955+0000 7f022a956640 1 -- 172.21.15.146:0/536697215 learned_addr learned my addr 172.21.15.146:0/536697215 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:22.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.955+0000 7f022b157640 1 --1- 172.21.15.146:0/536697215 >> v1:172.21.15.129:6789/0 conn(0x56089bbf9640 0x56089bc8a650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:38694/0 (socket says 172.21.15.146:38694) 2024-09-18T01:45:22.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.955+0000 7f022a956640 1 -- 172.21.15.146:0/536697215 >> v1:172.21.15.129:6789/0 conn(0x56089bbf9640 legacy=0x56089bc8a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.955+0000 7f022a956640 1 -- 172.21.15.146:0/536697215 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56089bb4ce00 con 0x56089bc8bd70 2024-09-18T01:45:22.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.957+0000 7f022a956640 1 --2- 172.21.15.146:0/536697215 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56089bc8bd70 0x56089bc8e160 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f022000a520 tx=0x7f0220045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fd3498e91b8351b server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.957+0000 7f022a155640 1 -- 172.21.15.146:0/536697215 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0220055070 con 0x56089bc8bd70 2024-09-18T01:45:22.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.957+0000 7f022a155640 1 -- 172.21.15.146:0/536697215 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02200515b0 con 0x56089bc8bd70 2024-09-18T01:45:22.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.957+0000 7f022a155640 1 -- 172.21.15.146:0/536697215 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02200518d0 con 0x56089bc8bd70 2024-09-18T01:45:22.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.958+0000 7f022d663800 1 -- 172.21.15.146:0/536697215 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56089bc8bd70 msgr2=0x56089bc8e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.958+0000 7f022d663800 1 --2- 172.21.15.146:0/536697215 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56089bc8bd70 0x56089bc8e160 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f022000a520 tx=0x7f0220045ba0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.958+0000 7f022d663800 1 -- 172.21.15.146:0/536697215 shutdown_connections 2024-09-18T01:45:22.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.958+0000 7f022d663800 1 --2- 172.21.15.146:0/536697215 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56089bc8bd70 0x56089bc8e160 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.958+0000 7f022d663800 1 -- 172.21.15.146:0/536697215 >> 172.21.15.146:0/536697215 conn(0x56089bc7fde0 msgr2=0x56089bc82200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:22.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.958+0000 7f022d663800 1 -- 172.21.15.146:0/536697215 shutdown_connections 2024-09-18T01:45:22.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.958+0000 7f022d663800 1 -- 172.21.15.146:0/536697215 wait complete. 2024-09-18T01:45:22.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.971+0000 7f022d663800 1 Processor -- start 2024-09-18T01:45:22.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.971+0000 7f022d663800 1 -- start start 2024-09-18T01:45:22.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.971+0000 7f022d663800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56089bbf9640 0x56089bd76b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.971+0000 7f022d663800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x56089bbd1450 con 0x56089bbf9640 2024-09-18T01:45:22.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.972+0000 7f022b157640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56089bbf9640 0x56089bd76b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.972+0000 7f022b157640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56089bbf9640 0x56089bd76b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59508/0 (socket says 172.21.15.146:59508) 2024-09-18T01:45:22.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.972+0000 7f022b157640 1 -- 172.21.15.146:0/656371287 learned_addr learned my addr 172.21.15.146:0/656371287 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:22.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.972+0000 7f022b157640 1 -- 172.21.15.146:0/656371287 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56089bb1ebc0 con 0x56089bbf9640 2024-09-18T01:45:22.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.972+0000 7f022b157640 1 --2- 172.21.15.146:0/656371287 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56089bbf9640 0x56089bd76b60 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f021c00b230 tx=0x7f021c00b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b32e0e9c5cdd3ba server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.972+0000 7f011960a640 1 -- 172.21.15.146:0/656371287 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f021c00e5c0 con 0x56089bbf9640 2024-09-18T01:45:22.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.972+0000 7f011960a640 1 -- 172.21.15.146:0/656371287 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f021c006070 con 0x56089bbf9640 2024-09-18T01:45:22.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.972+0000 7f011960a640 1 -- 172.21.15.146:0/656371287 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f021c00e890 con 0x56089bbf9640 2024-09-18T01:45:22.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.973+0000 7f022d663800 1 -- 172.21.15.146:0/656371287 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56089bbf9640 msgr2=0x56089bd76b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.973+0000 7f022d663800 1 --2- 172.21.15.146:0/656371287 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56089bbf9640 0x56089bd76b60 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f021c00b230 tx=0x7f021c00b6f0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.973+0000 7f022d663800 1 -- 172.21.15.146:0/656371287 shutdown_connections 2024-09-18T01:45:22.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.973+0000 7f022d663800 1 --2- 172.21.15.146:0/656371287 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56089bbf9640 0x56089bd76b60 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.973+0000 7f022d663800 1 -- 172.21.15.146:0/656371287 >> 172.21.15.146:0/656371287 conn(0x56089bc7fde0 msgr2=0x56089bd72520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:22.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.973+0000 7f022d663800 1 -- 172.21.15.146:0/656371287 shutdown_connections 2024-09-18T01:45:22.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.973+0000 7f022d663800 1 -- 172.21.15.146:0/656371287 wait complete. 2024-09-18T01:45:22.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.973+0000 7f022d663800 1 Processor -- start 2024-09-18T01:45:22.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.973+0000 7f022d663800 1 -- start start 2024-09-18T01:45:22.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.973+0000 7f022d663800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56089bbf9640 0x56089bd7e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.973+0000 7f022d663800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x56089bc8e940 con 0x56089bbf9640 2024-09-18T01:45:22.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.974+0000 7f022b157640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56089bbf9640 0x56089bd7e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.974+0000 7f022b157640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56089bbf9640 0x56089bd7e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59516/0 (socket says 172.21.15.146:59516) 2024-09-18T01:45:22.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.974+0000 7f022b157640 1 -- 172.21.15.146:0/605575322 learned_addr learned my addr 172.21.15.146:0/605575322 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:22.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.974+0000 7f022b157640 1 -- 172.21.15.146:0/605575322 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56089bb32fe0 con 0x56089bbf9640 2024-09-18T01:45:22.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.974+0000 7f022b157640 1 --2- 172.21.15.146:0/605575322 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56089bbf9640 0x56089bd7e570 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f021c000c00 tx=0x7f021c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.974+0000 7f0117e07640 1 -- 172.21.15.146:0/605575322 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f021c00f8d0 con 0x56089bbf9640 2024-09-18T01:45:22.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.974+0000 7f0117e07640 1 -- 172.21.15.146:0/605575322 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f021c00fa90 con 0x56089bbf9640 2024-09-18T01:45:22.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.974+0000 7f022d663800 1 -- 172.21.15.146:0/605575322 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56089bd7eab0 con 0x56089bbf9640 2024-09-18T01:45:22.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.974+0000 7f0117e07640 1 -- 172.21.15.146:0/605575322 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f021c00fdb0 con 0x56089bbf9640 2024-09-18T01:45:22.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.974+0000 7f022d663800 1 -- 172.21.15.146:0/605575322 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56089bd7efd0 con 0x56089bbf9640 2024-09-18T01:45:22.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.975+0000 7f0117e07640 1 -- 172.21.15.146:0/605575322 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f021c017070 con 0x56089bbf9640 2024-09-18T01:45:22.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.975+0000 7f0117e07640 1 --2- 172.21.15.146:0/605575322 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0110036b40 0x7f0110039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.975+0000 7f0117e07640 1 -- 172.21.15.146:0/605575322 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f021c015020 con 0x56089bbf9640 2024-09-18T01:45:22.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.975+0000 7f022a956640 1 --2- 172.21.15.146:0/605575322 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0110036b40 0x7f0110039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.975+0000 7f022d663800 1 --2- 172.21.15.146:0/605575322 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56089bc8bd70 0x56089bd855e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.975+0000 7f022d663800 1 -- 172.21.15.146:0/605575322 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56089bd85b60 con 0x56089bc8bd70 2024-09-18T01:45:22.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.976+0000 7f022b958640 1 --2- 172.21.15.146:0/605575322 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56089bc8bd70 0x56089bd855e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.976+0000 7f022a956640 1 --2- 172.21.15.146:0/605575322 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0110036b40 0x7f0110039000 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0220057000 tx=0x7f0220052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.976+0000 7f022b958640 1 --2- 172.21.15.146:0/605575322 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56089bc8bd70 0x56089bd855e0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.976+0000 7f022b958640 1 -- 172.21.15.146:0/605575322 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f022400a4a0 con 0x56089bc8bd70 2024-09-18T01:45:22.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.976+0000 7f022d663800 1 -- 172.21.15.146:0/605575322 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56089bd82bb0 con 0x56089bc8bd70 2024-09-18T01:45:22.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.977+0000 7f022b958640 1 -- 172.21.15.146:0/605575322 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f022400a4a0 con 0x56089bc8bd70 2024-09-18T01:45:22.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.977+0000 7f022d663800 1 -- 172.21.15.146:0/605575322 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56089bd879a0 con 0x56089bc8bd70 2024-09-18T01:45:22.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.977+0000 7f022b958640 1 -- 172.21.15.146:0/605575322 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f022400a4a0 con 0x56089bc8bd70 2024-09-18T01:45:22.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.977+0000 7f022d663800 1 -- 172.21.15.146:0/605575322 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56089bd86bd0 con 0x56089bc8bd70 2024-09-18T01:45:22.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.977+0000 7f022b958640 1 -- 172.21.15.146:0/605575322 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f022400a4a0 con 0x56089bc8bd70 2024-09-18T01:45:22.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.977+0000 7f022d663800 1 --2- 172.21.15.146:0/605575322 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x56089bd88d50 0x56089bd8b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.977+0000 7f022d663800 1 -- 172.21.15.146:0/605575322 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56089bd8b680 con 0x56089bd88d50 2024-09-18T01:45:22.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.977+0000 7f022b157640 1 --2- 172.21.15.146:0/605575322 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x56089bd88d50 0x56089bd8b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.978+0000 7f022b157640 1 --2- 172.21.15.146:0/605575322 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x56089bd88d50 0x56089bd8b140 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.978+0000 7f022b157640 1 -- 172.21.15.146:0/605575322 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f021c02e070 con 0x56089bd88d50 2024-09-18T01:45:22.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.978+0000 7f022d663800 1 Processor -- start 2024-09-18T01:45:22.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.978+0000 7f022d663800 1 -- start start 2024-09-18T01:45:22.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.978+0000 7f022d663800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56089bd99300 0x56089bd99720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.978+0000 7f022d663800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x56089bb20580 con 0x56089bd99300 2024-09-18T01:45:22.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.979+0000 7f022b958640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56089bd99300 0x56089bd99720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.979+0000 7f022b958640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56089bd99300 0x56089bd99720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59524/0 (socket says 172.21.15.146:59524) 2024-09-18T01:45:22.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.979+0000 7f022b958640 1 -- 172.21.15.146:0/3205598448 learned_addr learned my addr 172.21.15.146:0/3205598448 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:22.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.979+0000 7f022b958640 1 -- 172.21.15.146:0/3205598448 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56089bd99c60 con 0x56089bd99300 2024-09-18T01:45:22.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.979+0000 7f022b958640 1 --2- 172.21.15.146:0/3205598448 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56089bd99300 0x56089bd99720 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x56089bd7f970 tx=0x7f02240178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.979+0000 7f0115602640 1 -- 172.21.15.146:0/3205598448 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0224013440 con 0x56089bd99300 2024-09-18T01:45:22.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.979+0000 7f0115602640 1 -- 172.21.15.146:0/3205598448 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02240135e0 con 0x56089bd99300 2024-09-18T01:45:22.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.979+0000 7f022d663800 1 -- 172.21.15.146:0/3205598448 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56089bd99ef0 con 0x56089bd99300 2024-09-18T01:45:22.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.979+0000 7f0115602640 1 -- 172.21.15.146:0/3205598448 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02240138c0 con 0x56089bd99300 2024-09-18T01:45:22.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.979+0000 7f022d663800 1 -- 172.21.15.146:0/3205598448 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56089bd9cbd0 con 0x56089bd99300 2024-09-18T01:45:22.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.980+0000 7f0115602640 1 -- 172.21.15.146:0/3205598448 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0224011040 con 0x56089bd99300 2024-09-18T01:45:22.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.980+0000 7f0115602640 1 --2- 172.21.15.146:0/3205598448 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0104036b40 0x7f0104039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.980+0000 7f0115602640 1 -- 172.21.15.146:0/3205598448 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f022401d070 con 0x56089bd99300 2024-09-18T01:45:22.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.980+0000 7f022b157640 1 --2- 172.21.15.146:0/3205598448 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0104036b40 0x7f0104039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.980+0000 7f022d663800 1 Processor -- start 2024-09-18T01:45:22.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.981+0000 7f022d663800 1 -- start start 2024-09-18T01:45:22.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.981+0000 7f022b157640 1 --2- 172.21.15.146:0/3205598448 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0104036b40 0x7f0104039000 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f021c0176e0 tx=0x7f021c04b740 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.981+0000 7f022d663800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56089bda5fa0 0x56089bda63a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.981+0000 7f022d663800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x56089bd77310 con 0x56089bda5fa0 2024-09-18T01:45:22.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.981+0000 7f022b958640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56089bda5fa0 0x56089bda63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.981+0000 7f022b958640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56089bda5fa0 0x56089bda63a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59532/0 (socket says 172.21.15.146:59532) 2024-09-18T01:45:22.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.981+0000 7f022b958640 1 -- 172.21.15.146:0/3854429575 learned_addr learned my addr 172.21.15.146:0/3854429575 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:22.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.981+0000 7f022b958640 1 -- 172.21.15.146:0/3854429575 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56089bda6970 con 0x56089bda5fa0 2024-09-18T01:45:22.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.981+0000 7f022b958640 1 --2- 172.21.15.146:0/3854429575 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56089bda5fa0 0x56089bda63a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f022404c8f0 tx=0x7f0224012860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bc77113b68560ef server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.981+0000 7f010effd640 1 -- 172.21.15.146:0/3854429575 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0224012cc0 con 0x56089bda5fa0 2024-09-18T01:45:22.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.981+0000 7f010effd640 1 -- 172.21.15.146:0/3854429575 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f022404b250 con 0x56089bda5fa0 2024-09-18T01:45:22.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.981+0000 7f010effd640 1 -- 172.21.15.146:0/3854429575 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0224012e60 con 0x56089bda5fa0 2024-09-18T01:45:22.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.982+0000 7f022d663800 1 -- 172.21.15.146:0/3854429575 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56089bda5fa0 msgr2=0x56089bda63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:22.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.982+0000 7f022d663800 1 --2- 172.21.15.146:0/3854429575 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56089bda5fa0 0x56089bda63a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f022404c8f0 tx=0x7f0224012860 comp rx=0 tx=0).stop 2024-09-18T01:45:22.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.982+0000 7f022d663800 1 -- 172.21.15.146:0/3854429575 shutdown_connections 2024-09-18T01:45:22.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.982+0000 7f022d663800 1 --2- 172.21.15.146:0/3854429575 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56089bda5fa0 0x56089bda63a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:22.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.982+0000 7f022d663800 1 -- 172.21.15.146:0/3854429575 >> 172.21.15.146:0/3854429575 conn(0x56089bda2350 msgr2=0x56089bda0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:22.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.982+0000 7f022d663800 1 -- 172.21.15.146:0/3854429575 shutdown_connections 2024-09-18T01:45:22.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.982+0000 7f022d663800 1 -- 172.21.15.146:0/3854429575 wait complete. 2024-09-18T01:45:22.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.982+0000 7f022d663800 1 Processor -- start 2024-09-18T01:45:22.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.982+0000 7f022d663800 1 -- start start 2024-09-18T01:45:22.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.982+0000 7f022d663800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56089bda5fa0 0x56089bdad460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.982+0000 7f022d663800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x56089bda6f80 con 0x56089bda5fa0 2024-09-18T01:45:22.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.982+0000 7f022b958640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56089bda5fa0 0x56089bdad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:22.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.982+0000 7f022b958640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56089bda5fa0 0x56089bdad460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59538/0 (socket says 172.21.15.146:59538) 2024-09-18T01:45:22.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.982+0000 7f022b958640 1 -- 172.21.15.146:0/1254734851 learned_addr learned my addr 172.21.15.146:0/1254734851 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:22.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.983+0000 7f022b958640 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56089bdad9a0 con 0x56089bda5fa0 2024-09-18T01:45:22.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.983+0000 7f022b958640 1 --2- 172.21.15.146:0/1254734851 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56089bda5fa0 0x56089bdad460 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f022404b770 tx=0x7f022404c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:22.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.983+0000 7f010d7fa640 1 -- 172.21.15.146:0/1254734851 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0224046040 con 0x56089bda5fa0 2024-09-18T01:45:22.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.983+0000 7f010d7fa640 1 -- 172.21.15.146:0/1254734851 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0224041050 con 0x56089bda5fa0 2024-09-18T01:45:22.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.983+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56089bdadc30 con 0x56089bda5fa0 2024-09-18T01:45:22.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.983+0000 7f010d7fa640 1 -- 172.21.15.146:0/1254734851 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0224013c70 con 0x56089bda5fa0 2024-09-18T01:45:22.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.983+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56089bdb08e0 con 0x56089bda5fa0 2024-09-18T01:45:22.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.984+0000 7f010d7fa640 1 -- 172.21.15.146:0/1254734851 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f022402aa60 con 0x56089bda5fa0 2024-09-18T01:45:22.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.984+0000 7f010d7fa640 1 --2- 172.21.15.146:0/1254734851 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f00f4036b40 0x7f00f4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:22.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.984+0000 7f010d7fa640 1 -- 172.21.15.146:0/1254734851 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f0224034070 con 0x56089bda5fa0 2024-09-18T01:45:22.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.984+0000 7f022b157640 1 --2- 172.21.15.146:0/1254734851 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f00f4036b40 0x7f00f4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.984+0000 7f022b157640 1 --2- 172.21.15.146:0/1254734851 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f00f4036b40 0x7f00f4039000 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f021c04bfd0 tx=0x7f021c042000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.984+0000 7f022d663800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.985+0000 7f022d663800 1 --2- 172.21.15.146:0/1254734851 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56089bdb9090 0x56089bdbb550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.985+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56089bdbbca0 con 0x56089bdb9090 2024-09-18T01:45:23.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.985+0000 7f022a956640 1 --2- 172.21.15.146:0/1254734851 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56089bdb9090 0x56089bdbb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.985+0000 7f022a956640 1 --2- 172.21.15.146:0/1254734851 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56089bdb9090 0x56089bdbb550 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.985+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0220057030 con 0x56089bdb9090 2024-09-18T01:45:23.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.985+0000 7f022d663800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.985+0000 7f022d663800 20 realm 2024-09-18T01:45:23.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.985+0000 7f022d663800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.985+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56089bdbc0d0 con 0x56089bdb9090 2024-09-18T01:45:23.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.985+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0220057030 con 0x56089bdb9090 2024-09-18T01:45:23.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.985+0000 7f022d663800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.985+0000 7f022d663800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:23.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.985+0000 7f022d663800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.985+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56089bdbc9a0 con 0x56089bdb9090 2024-09-18T01:45:23.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.986+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0220057030 con 0x56089bdb9090 2024-09-18T01:45:23.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.986+0000 7f022d663800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.986+0000 7f022d663800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.986+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56089bdbcd40 con 0x56089bdb9090 2024-09-18T01:45:23.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.986+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0220057030 con 0x56089bdb9090 2024-09-18T01:45:23.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.986+0000 7f022d663800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:23.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.986+0000 7f022d663800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.986+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56089bdbd590 con 0x56089bdb9090 2024-09-18T01:45:23.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.986+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0220057030 con 0x56089bdb9090 2024-09-18T01:45:23.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.986+0000 7f022d663800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:23.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.986+0000 7f022d663800 20 searching for the correct realm 2024-09-18T01:45:23.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.986+0000 7f022d663800 1 --2- 172.21.15.146:0/1254734851 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x56089bdbf300 0x56089bdc16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.986+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56089bdc1d00 con 0x56089bdbf300 2024-09-18T01:45:23.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.986+0000 7f022b958640 1 --2- 172.21.15.146:0/1254734851 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x56089bdbf300 0x56089bdc16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.987+0000 7f022b958640 1 --2- 172.21.15.146:0/1254734851 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x56089bdbf300 0x56089bdc16f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.987+0000 7f022b958640 1 -- 172.21.15.146:0/1254734851 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f022403e020 con 0x56089bdbf300 2024-09-18T01:45:23.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.987+0000 7f022b958640 1 --2- 172.21.15.146:0/1254734851 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f022405b040 0x7f0224014030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.987+0000 7f022b958640 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56089bdc1d00 con 0x7f022405b040 2024-09-18T01:45:23.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.987+0000 7f022b157640 1 --2- 172.21.15.146:0/1254734851 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f022405b040 0x7f0224014030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.987+0000 7f022b157640 1 --2- 172.21.15.146:0/1254734851 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f022405b040 0x7f0224014030 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.988+0000 7f022b157640 1 -- 172.21.15.146:0/1254734851 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f021c02e070 con 0x7f022405b040 2024-09-18T01:45:23.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.988+0000 7f022b157640 1 --2- 172.21.15.146:0/1254734851 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f021c00f070 0x7f021c019860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.988+0000 7f022b157640 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56089bdc1d00 con 0x7f021c00f070 2024-09-18T01:45:23.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.988+0000 7f022a956640 1 --2- 172.21.15.146:0/1254734851 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f021c00f070 0x7f021c019860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.988+0000 7f022a956640 1 --2- 172.21.15.146:0/1254734851 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f021c00f070 0x7f021c019860 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.988+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0220057030 con 0x7f021c00f070 2024-09-18T01:45:23.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.988+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56089bdc1d00 con 0x56089bdb9090 2024-09-18T01:45:23.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.989+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0220057030 con 0x56089bdb9090 2024-09-18T01:45:23.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.989+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56089bdc1d00 con 0x56089bdb9090 2024-09-18T01:45:23.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.989+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0220057030 con 0x56089bdb9090 2024-09-18T01:45:23.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.989+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56089bdc1d00 con 0x7f021c00f070 2024-09-18T01:45:23.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.989+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0220057030 con 0x7f021c00f070 2024-09-18T01:45:23.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.989+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56089bdc1d00 con 0x7f021c00f070 2024-09-18T01:45:23.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.989+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0220057030 con 0x7f021c00f070 2024-09-18T01:45:23.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.989+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56089bdc1d00 con 0x7f022405b040 2024-09-18T01:45:23.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.990+0000 7f022b157640 1 -- 172.21.15.146:0/1254734851 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f021c02e070 con 0x7f022405b040 2024-09-18T01:45:23.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.990+0000 7f022b157640 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56089bdc1d00 con 0x56089bdbf300 2024-09-18T01:45:23.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.990+0000 7f022b958640 1 -- 172.21.15.146:0/1254734851 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f022403e020 con 0x56089bdbf300 2024-09-18T01:45:23.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.990+0000 7f022b958640 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56089bdc1d00 con 0x56089bdb9090 2024-09-18T01:45:23.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.990+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0220057030 con 0x56089bdb9090 2024-09-18T01:45:23.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.990+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56089bdc1d00 con 0x7f021c00f070 2024-09-18T01:45:23.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.990+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0220057030 con 0x7f021c00f070 2024-09-18T01:45:23.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.990+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56089bdc1d00 con 0x56089bdb9090 2024-09-18T01:45:23.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.990+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0220057030 con 0x56089bdb9090 2024-09-18T01:45:23.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.991+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56089bdc1d00 con 0x7f022405b040 2024-09-18T01:45:23.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.991+0000 7f022b157640 1 -- 172.21.15.146:0/1254734851 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f021c02e070 con 0x7f022405b040 2024-09-18T01:45:23.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.991+0000 7f022b157640 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56089bdc1d00 con 0x56089bdbf300 2024-09-18T01:45:23.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.991+0000 7f022b958640 1 -- 172.21.15.146:0/1254734851 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f022403e020 con 0x56089bdbf300 2024-09-18T01:45:23.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.991+0000 7f022b958640 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56089bdc1d00 con 0x56089bdbf300 2024-09-18T01:45:23.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.991+0000 7f022b958640 1 -- 172.21.15.146:0/1254734851 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f022403e020 con 0x56089bdbf300 2024-09-18T01:45:23.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.991+0000 7f022b958640 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56089bdc1d00 con 0x7f021c00f070 2024-09-18T01:45:23.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.992+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0220057030 con 0x7f021c00f070 2024-09-18T01:45:23.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.992+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56089bdc1d00 con 0x56089bdbf300 2024-09-18T01:45:23.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.992+0000 7f022b958640 1 -- 172.21.15.146:0/1254734851 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f022403e020 con 0x56089bdbf300 2024-09-18T01:45:23.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.992+0000 7f022b958640 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56089bdc1d00 con 0x56089bdbf300 2024-09-18T01:45:23.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.992+0000 7f022b958640 1 -- 172.21.15.146:0/1254734851 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f022403e020 con 0x56089bdbf300 2024-09-18T01:45:23.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.992+0000 7f022b958640 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56089bdc1d00 con 0x56089bdb9090 2024-09-18T01:45:23.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.992+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0220057030 con 0x56089bdb9090 2024-09-18T01:45:23.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.992+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56089bdc1d00 con 0x56089bdb9090 2024-09-18T01:45:23.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.992+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0220057030 con 0x56089bdb9090 2024-09-18T01:45:23.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.992+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56089bdc1d00 con 0x7f021c00f070 2024-09-18T01:45:23.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.993+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0220057030 con 0x7f021c00f070 2024-09-18T01:45:23.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.993+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56089bdc1d00 con 0x56089bdbf300 2024-09-18T01:45:23.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.993+0000 7f022b958640 1 -- 172.21.15.146:0/1254734851 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f022403e020 con 0x56089bdbf300 2024-09-18T01:45:23.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.993+0000 7f022b958640 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56089bdc1d00 con 0x7f022405b040 2024-09-18T01:45:23.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.993+0000 7f022b157640 1 -- 172.21.15.146:0/1254734851 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f021c02e070 con 0x7f022405b040 2024-09-18T01:45:23.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.993+0000 7f022b157640 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56089bdc1d00 con 0x56089bdb9090 2024-09-18T01:45:23.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.993+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0220057030 con 0x56089bdb9090 2024-09-18T01:45:23.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.993+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56089bdc1d00 con 0x7f021c00f070 2024-09-18T01:45:23.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.994+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0220057030 con 0x7f021c00f070 2024-09-18T01:45:23.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.994+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56089bdc1d00 con 0x56089bdbf300 2024-09-18T01:45:23.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.994+0000 7f022b958640 1 -- 172.21.15.146:0/1254734851 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f022403e020 con 0x56089bdbf300 2024-09-18T01:45:23.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.994+0000 7f022b958640 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56089bdc1d00 con 0x7f021c00f070 2024-09-18T01:45:23.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.994+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0220057030 con 0x7f021c00f070 2024-09-18T01:45:23.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.994+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56089bdc1d00 con 0x7f022405b040 2024-09-18T01:45:23.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.994+0000 7f022b157640 1 -- 172.21.15.146:0/1254734851 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f021c02e070 con 0x7f022405b040 2024-09-18T01:45:23.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.995+0000 7f022b157640 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56089bdc1d00 con 0x56089bdbf300 2024-09-18T01:45:23.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.995+0000 7f022b958640 1 -- 172.21.15.146:0/1254734851 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f022403e020 con 0x56089bdbf300 2024-09-18T01:45:23.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.995+0000 7f022b958640 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56089bdc1d00 con 0x7f021c00f070 2024-09-18T01:45:23.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.995+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0220057030 con 0x7f021c00f070 2024-09-18T01:45:23.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.995+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56089bdc1d00 con 0x56089bdb9090 2024-09-18T01:45:23.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.995+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0220057030 con 0x56089bdb9090 2024-09-18T01:45:23.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.995+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56089bdc1d00 con 0x7f022405b040 2024-09-18T01:45:23.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.996+0000 7f022b157640 1 -- 172.21.15.146:0/1254734851 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f021c05f040 con 0x7f022405b040 2024-09-18T01:45:23.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.996+0000 7f022d663800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:23.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.996+0000 7f022d663800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:23.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.996+0000 7f022d663800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:23.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.996+0000 7f022d663800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:23.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.996+0000 7f022d663800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:23.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.996+0000 7f022d663800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:23.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.996+0000 7f022d663800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.996+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56089bdbdf10 con 0x56089bdb9090 2024-09-18T01:45:23.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.996+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0220057030 con 0x56089bdb9090 2024-09-18T01:45:23.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.996+0000 7f022d663800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.996+0000 7f022d663800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.996+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56089bdbe7b0 con 0x56089bdb9090 2024-09-18T01:45:23.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.996+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0220057030 con 0x56089bdb9090 2024-09-18T01:45:23.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.996+0000 7f022d663800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:23.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.996+0000 7f022d663800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.996+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56089bdc2180 con 0x7f022405b040 2024-09-18T01:45:23.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.996+0000 7f022b157640 1 -- 172.21.15.146:0/1254734851 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f021c05f040 con 0x7f022405b040 2024-09-18T01:45:23.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.996+0000 7f022d663800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:23.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.996+0000 7f022d663800 20 zone default found 2024-09-18T01:45:23.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.996+0000 7f022d663800 4 Realm: () 2024-09-18T01:45:23.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.996+0000 7f022d663800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:23.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.996+0000 7f022d663800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:23.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.996+0000 7f022d663800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:23.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.996+0000 7f022d663800 20 zonegroup default 2024-09-18T01:45:23.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.996+0000 7f022d663800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.996+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56089bdc29d0 con 0x7f021c00f070 2024-09-18T01:45:23.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.997+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0220057030 con 0x7f021c00f070 2024-09-18T01:45:23.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.997+0000 7f022d663800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.997+0000 7f022d663800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.997+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56089bdc43b0 con 0x56089bdbf300 2024-09-18T01:45:23.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.997+0000 7f022b958640 1 -- 172.21.15.146:0/1254734851 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f022403e020 con 0x56089bdbf300 2024-09-18T01:45:23.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.997+0000 7f022d663800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.997+0000 7f022d663800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.997+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56089bdc4830 con 0x56089bdbf300 2024-09-18T01:45:23.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.997+0000 7f022b958640 1 -- 172.21.15.146:0/1254734851 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f022403e020 con 0x56089bdbf300 2024-09-18T01:45:23.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.997+0000 7f022d663800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.997+0000 7f022d663800 20 started sync module instance, tier type = 2024-09-18T01:45:23.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.997+0000 7f022d663800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:23.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.997+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56089bdc3840 con 0x7f022405b040 2024-09-18T01:45:23.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.998+0000 7f022b157640 1 -- 172.21.15.146:0/1254734851 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v31'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f021c05f040 con 0x7f022405b040 2024-09-18T01:45:23.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.998+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94594974628960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56089bdc34a0 con 0x7f022405b040 2024-09-18T01:45:23.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.998+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56089bdc5760 con 0x56089bdb9090 2024-09-18T01:45:23.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.999+0000 7f022b157640 1 -- 172.21.15.146:0/1254734851 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94594974628960] v31'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f021c05f040 con 0x7f022405b040 2024-09-18T01:45:23.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.999+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v31'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0220057030 con 0x56089bdb9090 2024-09-18T01:45:23.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:22.999+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94594974634672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56089bdc5b80 con 0x56089bdb9090 2024-09-18T01:45:23.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.000+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56089bdc6540 con 0x56089bdbf300 2024-09-18T01:45:23.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.001+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94594974634672] v31'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0220057030 con 0x56089bdb9090 2024-09-18T01:45:23.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.001+0000 7f022b958640 1 -- 172.21.15.146:0/1254734851 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v31'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f022403e020 con 0x56089bdbf300 2024-09-18T01:45:23.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.001+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94594974638704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56089bdc5b80 con 0x56089bdbf300 2024-09-18T01:45:23.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.001+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56089bdc6f90 con 0x7f022405b040 2024-09-18T01:45:23.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.002+0000 7f022b958640 1 -- 172.21.15.146:0/1254734851 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94594974638704] v31'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f022403e020 con 0x56089bdbf300 2024-09-18T01:45:23.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.002+0000 7f022b157640 1 -- 172.21.15.146:0/1254734851 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v31'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f021c05f040 con 0x7f022405b040 2024-09-18T01:45:23.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.002+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94594974635728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56089bdc5af0 con 0x7f022405b040 2024-09-18T01:45:23.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.002+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56089bdc7e50 con 0x56089bdb9090 2024-09-18T01:45:23.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.003+0000 7f022b157640 1 -- 172.21.15.146:0/1254734851 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94594974635728] v31'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f021c05f040 con 0x7f022405b040 2024-09-18T01:45:23.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.003+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v31'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0220057030 con 0x56089bdb9090 2024-09-18T01:45:23.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.003+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94594974644640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56089bdc7dc0 con 0x56089bdb9090 2024-09-18T01:45:23.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.003+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56089bdc8d10 con 0x7f021c00f070 2024-09-18T01:45:23.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.004+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94594974644640] v31'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0220057030 con 0x56089bdb9090 2024-09-18T01:45:23.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.004+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v31'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0220057030 con 0x7f021c00f070 2024-09-18T01:45:23.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.004+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94594974646768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56089bdc8d10 con 0x7f021c00f070 2024-09-18T01:45:23.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.004+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56089bdc9720 con 0x7f021c00f070 2024-09-18T01:45:23.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.005+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94594974646768] v31'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0220057030 con 0x7f021c00f070 2024-09-18T01:45:23.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.005+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v31'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0220057030 con 0x7f021c00f070 2024-09-18T01:45:23.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.005+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94594974648896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56089bdc9720 con 0x7f021c00f070 2024-09-18T01:45:23.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.005+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56089bdca0e0 con 0x7f021c00f070 2024-09-18T01:45:23.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.006+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(58 notify.7 [create] v31'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0220057030 con 0x7f021c00f070 2024-09-18T01:45:23.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.006+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94594974648896] v31'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0220057030 con 0x7f021c00f070 2024-09-18T01:45:23.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.006+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94594974653488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56089bdca500 con 0x7f021c00f070 2024-09-18T01:45:23.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.006+0000 7f022d663800 20 add_watcher() i=0 2024-09-18T01:45:23.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.006+0000 7f022d663800 20 add_watcher() i=1 2024-09-18T01:45:23.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.006+0000 7f022d663800 20 add_watcher() i=2 2024-09-18T01:45:23.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.006+0000 7f022d663800 20 add_watcher() i=3 2024-09-18T01:45:23.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.006+0000 7f022d663800 20 add_watcher() i=4 2024-09-18T01:45:23.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.006+0000 7f022d663800 20 add_watcher() i=5 2024-09-18T01:45:23.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.006+0000 7f022d663800 20 add_watcher() i=6 2024-09-18T01:45:23.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.007+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94594974653488] v31'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0220057030 con 0x7f021c00f070 2024-09-18T01:45:23.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.007+0000 7f022d663800 20 add_watcher() i=7 2024-09-18T01:45:23.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.007+0000 7f022d663800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:23.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.007+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56089bdca500 con 0x56089bdb9090 2024-09-18T01:45:23.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.007+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0220057030 con 0x56089bdb9090 2024-09-18T01:45:23.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.007+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94594974654544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56089bdca4a0 con 0x56089bdb9090 2024-09-18T01:45:23.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.008+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94594974654544] v31'56 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0220057030 con 0x56089bdb9090 2024-09-18T01:45:23.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.008+0000 7f00e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:23.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.008+0000 7f022d663800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:23.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.008+0000 7f022d663800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:23.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.008+0000 7f022d663800 5 note: GC not initialized 2024-09-18T01:45:23.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.009+0000 7f00e0fe1640 20 reqs_thread_entry: start 2024-09-18T01:45:23.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.009+0000 7f022d663800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:23.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.009+0000 7f022d663800 20 Filter name: none 2024-09-18T01:45:23.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.009+0000 7f005a7fc640 20 reqs_thread_entry: start 2024-09-18T01:45:23.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.009+0000 7f022d663800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T01:45:23.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.009+0000 7f022d663800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.009+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56089be00890 con 0x56089bdb9090 2024-09-18T01:45:23.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.009+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f0220057030 con 0x56089bdb9090 2024-09-18T01:45:23.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.009+0000 7f022d663800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.009+0000 7f022d663800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-18T01:45:23.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.009+0000 7f022d663800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:45:23.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.009+0000 7f022d663800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-18T01:45:23.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.009+0000 7f022d663800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.009+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56089bdfeed0 con 0x56089bdb9090 2024-09-18T01:45:23.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.009+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(63 foo@foo.com [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7f0220057030 con 0x56089bdb9090 2024-09-18T01:45:23.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.009+0000 7f022d663800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.009+0000 7f022d663800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x0 2024-09-18T01:45:23.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.009+0000 7f022d663800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-18T01:45:23.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.009+0000 7f022d663800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : miss 2024-09-18T01:45:23.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.009+0000 7f022d663800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.009+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:64 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56089bdfeed0 con 0x7f021c00f070 2024-09-18T01:45:23.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.010+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(64 9te6NH5mcdcq0Tc5i8i1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f0220057030 con 0x7f021c00f070 2024-09-18T01:45:23.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.010+0000 7f022d663800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.010+0000 7f022d663800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x0 2024-09-18T01:45:23.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.010+0000 7f022d663800 10 adding default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-18T01:45:23.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.010+0000 7f022d663800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-18T01:45:23.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.010+0000 7f022d663800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-18T01:45:23.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.010+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56089bdff8f0 con 0x56089bdb9090 2024-09-18T01:45:23.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.011+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(65 foo [delete,create,call,writefull 0~391] v31'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f0220057030 con 0x56089bdb9090 2024-09-18T01:45:23.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.011+0000 7f022d663800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:45:23.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.011+0000 7f022d663800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:45:23.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.011+0000 7f022d663800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-18T01:45:23.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.011+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify cookie 94594974872336 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56089be04340 con 0x56089bdb9090 2024-09-18T01:45:23.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.011+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== watch-notify(notify (1) cookie 94594974644640 notify 133143986176 ret 0) ==== 609+0+0 (crc 0 0 0) 0x56089bdffc90 con 0x56089bdb9090 2024-09-18T01:45:23.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.011+0000 7f010effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986176 cookie 94594974644640 notifier 4299 bl.length()=567 2024-09-18T01:45:23.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.011+0000 7f010effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:45:23.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.011+0000 7f010effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:45:23.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.011+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(66 notify.4 [notify cookie 94594974872336 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0220057030 con 0x56089bdb9090 2024-09-18T01:45:23.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.011+0000 7f010effd640 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f00f0003ea0 con 0x56089bdb9090 2024-09-18T01:45:23.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.011+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== osd_op_reply(67 notify.4 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0220057030 con 0x56089bdb9090 2024-09-18T01:45:23.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.011+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 <== osd.1 v2:172.21.15.146:6808/3930274777 28 ==== watch-notify(notify_complete (2) cookie 94594974872336 notify 133143986176 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56089be004b0 con 0x56089bdb9090 2024-09-18T01:45:23.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.012+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:68 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56089be01e10 con 0x56089bdb9090 2024-09-18T01:45:23.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.013+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 <== osd.1 v2:172.21.15.146:6808/3930274777 29 ==== osd_op_reply(68 foo@foo.com [delete,create,writefull 0~7] v31'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f0220057030 con 0x56089bdb9090 2024-09-18T01:45:23.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.013+0000 7f022d663800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-18T01:45:23.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.013+0000 7f022d663800 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-18T01:45:23.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.013+0000 7f022d663800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-18T01:45:23.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.013+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 94594974872192 in=181b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56089be01e10 con 0x7f022405b040 2024-09-18T01:45:23.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.013+0000 7f022b157640 1 -- 172.21.15.146:0/1254734851 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== watch-notify(notify (1) cookie 94594974635728 notify 133143986176 ret 0) ==== 211+0+0 (crc 0 0 0) 0x56089bd7efd0 con 0x7f022405b040 2024-09-18T01:45:23.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.013+0000 7f010effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986176 cookie 94594974635728 notifier 4299 bl.length()=169 2024-09-18T01:45:23.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.013+0000 7f010effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-18T01:45:23.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.013+0000 7f010effd640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-18T01:45:23.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.013+0000 7f022b157640 1 -- 172.21.15.146:0/1254734851 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(69 notify.3 [notify cookie 94594974872192 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f021c05f040 con 0x7f022405b040 2024-09-18T01:45:23.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.013+0000 7f010effd640 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f00f0003ea0 con 0x7f022405b040 2024-09-18T01:45:23.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.014+0000 7f022b157640 1 -- 172.21.15.146:0/1254734851 <== osd.2 v2:172.21.15.146:6800/3820039304 14 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f021c05f040 con 0x7f022405b040 2024-09-18T01:45:23.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.014+0000 7f022b157640 1 -- 172.21.15.146:0/1254734851 <== osd.2 v2:172.21.15.146:6800/3820039304 15 ==== watch-notify(notify_complete (2) cookie 94594974872192 notify 133143986176 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56089bd7eab0 con 0x7f022405b040 2024-09-18T01:45:23.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.014+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:71 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56089bdff280 con 0x7f021c00f070 2024-09-18T01:45:23.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.015+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(71 9te6NH5mcdcq0Tc5i8i1 [delete,create,writefull 0~7] v31'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f0220057030 con 0x7f021c00f070 2024-09-18T01:45:23.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.015+0000 7f022d663800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-18T01:45:23.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.015+0000 7f022d663800 10 moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-18T01:45:23.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.015+0000 7f022d663800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-18T01:45:23.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.015+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:72 7.e 7:7759931f:::notify.3:head [notify cookie 94594974872096 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56089be04770 con 0x7f022405b040 2024-09-18T01:45:23.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.015+0000 7f022b157640 1 -- 172.21.15.146:0/1254734851 <== osd.2 v2:172.21.15.146:6800/3820039304 16 ==== watch-notify(notify (1) cookie 94594974635728 notify 133143986177 ret 0) ==== 219+0+0 (crc 0 0 0) 0x56089bd7eab0 con 0x7f022405b040 2024-09-18T01:45:23.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.015+0000 7f010e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986177 cookie 94594974635728 notifier 4299 bl.length()=177 2024-09-18T01:45:23.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.015+0000 7f010e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-18T01:45:23.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.015+0000 7f010e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-18T01:45:23.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.015+0000 7f022b157640 1 -- 172.21.15.146:0/1254734851 <== osd.2 v2:172.21.15.146:6800/3820039304 17 ==== osd_op_reply(72 notify.3 [notify cookie 94594974872096 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f021c05f040 con 0x7f022405b040 2024-09-18T01:45:23.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.015+0000 7f010e7fc640 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f0060003400 con 0x7f022405b040 2024-09-18T01:45:23.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.016+0000 7f022b157640 1 -- 172.21.15.146:0/1254734851 <== osd.2 v2:172.21.15.146:6800/3820039304 18 ==== watch-notify(notify_complete (2) cookie 94594974872096 notify 133143986177 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56089bb32fe0 con 0x7f022405b040 2024-09-18T01:45:23.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.016+0000 7f022b157640 1 -- 172.21.15.146:0/1254734851 <== osd.2 v2:172.21.15.146:6800/3820039304 19 ==== osd_op_reply(73 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f021c05f040 con 0x7f022405b040 2024-09-18T01:45:23.035 INFO:teuthology.orchestra.run.smithi146.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T01:45:23.010714Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:45:23.010705Z","tags":[],"group_ids":[]} 2024-09-18T01:45:23.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.016+0000 7f00e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:23.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.016+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:74 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94594974654544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56089bdfe570 con 0x56089bdb9090 2024-09-18T01:45:23.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.017+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 <== osd.1 v2:172.21.15.146:6808/3930274777 30 ==== osd_op_reply(74 data_loggenerations_metadata [watch unwatch cookie 94594974654544] v31'57 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0220057030 con 0x56089bdb9090 2024-09-18T01:45:23.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.017+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:75 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94594974628960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56089bdfe570 con 0x7f022405b040 2024-09-18T01:45:23.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.018+0000 7f022b157640 1 -- 172.21.15.146:0/1254734851 <== osd.2 v2:172.21.15.146:6800/3820039304 20 ==== osd_op_reply(75 notify.0 [watch unwatch cookie 94594974628960] v31'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f021c05f040 con 0x7f022405b040 2024-09-18T01:45:23.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.018+0000 7f022d663800 20 remove_watcher() i=0 2024-09-18T01:45:23.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.018+0000 7f022d663800 2 removed watcher, disabling cache 2024-09-18T01:45:23.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.018+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:76 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94594974634672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56089bdfe570 con 0x56089bdb9090 2024-09-18T01:45:23.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.020+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 <== osd.1 v2:172.21.15.146:6808/3930274777 31 ==== osd_op_reply(76 notify.1 [watch unwatch cookie 94594974634672] v31'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0220057030 con 0x56089bdb9090 2024-09-18T01:45:23.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.020+0000 7f022d663800 20 remove_watcher() i=1 2024-09-18T01:45:23.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.020+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94594974638704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56089bdfe570 con 0x56089bdbf300 2024-09-18T01:45:23.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.021+0000 7f022b958640 1 -- 172.21.15.146:0/1254734851 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(77 notify.2 [watch unwatch cookie 94594974638704] v31'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f022403e020 con 0x56089bdbf300 2024-09-18T01:45:23.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.021+0000 7f022d663800 20 remove_watcher() i=2 2024-09-18T01:45:23.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.021+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94594974635728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56089bdfe570 con 0x7f022405b040 2024-09-18T01:45:23.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.021+0000 7f022b157640 1 -- 172.21.15.146:0/1254734851 <== osd.2 v2:172.21.15.146:6800/3820039304 21 ==== osd_op_reply(78 notify.3 [watch unwatch cookie 94594974635728] v31'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f021c05f040 con 0x7f022405b040 2024-09-18T01:45:23.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.022+0000 7f022d663800 20 remove_watcher() i=3 2024-09-18T01:45:23.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.022+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:79 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94594974644640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56089bdfe570 con 0x56089bdb9090 2024-09-18T01:45:23.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.023+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 <== osd.1 v2:172.21.15.146:6808/3930274777 32 ==== osd_op_reply(79 notify.4 [watch unwatch cookie 94594974644640] v31'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0220057030 con 0x56089bdb9090 2024-09-18T01:45:23.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.023+0000 7f022d663800 20 remove_watcher() i=4 2024-09-18T01:45:23.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.023+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:80 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94594974646768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56089bdfe570 con 0x7f021c00f070 2024-09-18T01:45:23.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.024+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(80 notify.5 [watch unwatch cookie 94594974646768] v31'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0220057030 con 0x7f021c00f070 2024-09-18T01:45:23.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.024+0000 7f022d663800 20 remove_watcher() i=5 2024-09-18T01:45:23.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.024+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:81 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94594974648896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56089bdfe570 con 0x7f021c00f070 2024-09-18T01:45:23.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.024+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(81 notify.6 [watch unwatch cookie 94594974648896] v31'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0220057030 con 0x7f021c00f070 2024-09-18T01:45:23.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.024+0000 7f022d663800 20 remove_watcher() i=6 2024-09-18T01:45:23.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.024+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:82 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94594974653488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56089bdfe570 con 0x7f021c00f070 2024-09-18T01:45:23.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.025+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== osd_op_reply(82 notify.7 [watch unwatch cookie 94594974653488] v31'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0220057030 con 0x7f021c00f070 2024-09-18T01:45:23.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.025+0000 7f022d663800 20 remove_watcher() i=7 2024-09-18T01:45:23.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.025+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f021c00f070 msgr2=0x7f021c019860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.025+0000 7f022d663800 1 --2- 172.21.15.146:0/1254734851 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f021c00f070 0x7f021c019860 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.025+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56089bdb9090 msgr2=0x56089bdbb550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.025+0000 7f022d663800 1 --2- 172.21.15.146:0/1254734851 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56089bdb9090 0x56089bdbb550 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.025+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f022405b040 msgr2=0x7f0224014030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.025+0000 7f022d663800 1 --2- 172.21.15.146:0/1254734851 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f022405b040 0x7f0224014030 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.026+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x56089bdbf300 msgr2=0x56089bdc16f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.026+0000 7f022d663800 1 --2- 172.21.15.146:0/1254734851 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x56089bdbf300 0x56089bdc16f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.026+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f00f4036b40 msgr2=0x7f00f4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.026+0000 7f022d663800 1 --2- 172.21.15.146:0/1254734851 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f00f4036b40 0x7f00f4039000 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f021c04bfd0 tx=0x7f021c042000 comp rx=0 tx=0).stop 2024-09-18T01:45:23.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.026+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56089bda5fa0 msgr2=0x56089bdad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.026+0000 7f022a956640 1 -- 172.21.15.146:0/1254734851 reap_dead start 2024-09-18T01:45:23.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.026+0000 7f022d663800 1 --2- 172.21.15.146:0/1254734851 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56089bda5fa0 0x56089bdad460 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f022404b770 tx=0x7f022404c880 comp rx=0 tx=0).stop 2024-09-18T01:45:23.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.026+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 shutdown_connections 2024-09-18T01:45:23.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.026+0000 7f022d663800 1 --2- 172.21.15.146:0/1254734851 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56089bda5fa0 0x56089bdad460 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.026+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 >> 172.21.15.146:0/1254734851 conn(0x56089bda2350 msgr2=0x56089bda76e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:23.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.026+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 shutdown_connections 2024-09-18T01:45:23.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.026+0000 7f022d663800 1 -- 172.21.15.146:0/1254734851 wait complete. 2024-09-18T01:45:23.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.026+0000 7f022d663800 1 -- 172.21.15.146:0/3205598448 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0104036b40 msgr2=0x7f0104039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.026+0000 7f022d663800 1 --2- 172.21.15.146:0/3205598448 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0104036b40 0x7f0104039000 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f021c0176e0 tx=0x7f021c04b740 comp rx=0 tx=0).stop 2024-09-18T01:45:23.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.026+0000 7f022d663800 1 -- 172.21.15.146:0/3205598448 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56089bd99300 msgr2=0x56089bd99720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.026+0000 7f022d663800 1 --2- 172.21.15.146:0/3205598448 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56089bd99300 0x56089bd99720 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x56089bd7f970 tx=0x7f02240178e0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.026+0000 7f022d663800 1 -- 172.21.15.146:0/3205598448 shutdown_connections 2024-09-18T01:45:23.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.026+0000 7f022d663800 1 --2- 172.21.15.146:0/3205598448 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0104036b40 0x7f0104039000 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.026+0000 7f022d663800 1 --2- 172.21.15.146:0/3205598448 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56089bd99300 0x56089bd99720 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.026+0000 7f022d663800 1 -- 172.21.15.146:0/3205598448 >> 172.21.15.146:0/3205598448 conn(0x56089bd8e290 msgr2=0x56089bd90e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:23.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.026+0000 7f022d663800 1 -- 172.21.15.146:0/3205598448 shutdown_connections 2024-09-18T01:45:23.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.026+0000 7f022d663800 1 -- 172.21.15.146:0/3205598448 wait complete. 2024-09-18T01:45:23.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.026+0000 7f022d663800 1 -- 172.21.15.146:0/605575322 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56089bc8bd70 msgr2=0x56089bd855e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.026+0000 7f022d663800 1 --2- 172.21.15.146:0/605575322 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56089bc8bd70 0x56089bd855e0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.027+0000 7f022d663800 1 -- 172.21.15.146:0/605575322 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x56089bd88d50 msgr2=0x56089bd8b140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.027+0000 7f022d663800 1 --2- 172.21.15.146:0/605575322 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x56089bd88d50 0x56089bd8b140 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.027+0000 7f022d663800 1 -- 172.21.15.146:0/605575322 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0110036b40 msgr2=0x7f0110039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.027+0000 7f022d663800 1 --2- 172.21.15.146:0/605575322 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0110036b40 0x7f0110039000 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0220057000 tx=0x7f0220052000 comp rx=0 tx=0).stop 2024-09-18T01:45:23.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.027+0000 7f022d663800 1 -- 172.21.15.146:0/605575322 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56089bbf9640 msgr2=0x56089bd7e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.027+0000 7f022d663800 1 --2- 172.21.15.146:0/605575322 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56089bbf9640 0x56089bd7e570 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f021c000c00 tx=0x7f021c000ed0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.027+0000 7f022d663800 1 -- 172.21.15.146:0/605575322 shutdown_connections 2024-09-18T01:45:23.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.027+0000 7f022d663800 1 --2- 172.21.15.146:0/605575322 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x56089bd88d50 0x56089bd8b140 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.027+0000 7f022d663800 1 --2- 172.21.15.146:0/605575322 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56089bc8bd70 0x56089bd855e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.027+0000 7f022d663800 1 --2- 172.21.15.146:0/605575322 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0110036b40 0x7f0110039000 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.027+0000 7f022d663800 1 --2- 172.21.15.146:0/605575322 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56089bbf9640 0x56089bd7e570 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.027+0000 7f022d663800 1 -- 172.21.15.146:0/605575322 >> 172.21.15.146:0/605575322 conn(0x56089bc7fde0 msgr2=0x56089bd70db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:23.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.027+0000 7f022d663800 1 -- 172.21.15.146:0/605575322 shutdown_connections 2024-09-18T01:45:23.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.027+0000 7f022d663800 1 -- 172.21.15.146:0/605575322 wait complete. 2024-09-18T01:45:23.047 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T01:45:23.010714Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:45:23.010705Z', 'tags': [], 'group_ids': []} 2024-09-18T01:45:23.047 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-18T01:45:23.048 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-18T01:45:23.048 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --email foo@foo.com 2024-09-18T01:45:23.096 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:23.096 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:23.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.096+0000 7fed9a939800 1 Processor -- start 2024-09-18T01:45:23.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.096+0000 7fed9a939800 1 -- start start 2024-09-18T01:45:23.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.096+0000 7fed9a939800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55f4b99ed510 0x55f4b99ed910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.096+0000 7fed9a939800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f4b98adb30 con 0x55f4b99ede50 2024-09-18T01:45:23.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.096+0000 7fed9a939800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x55f4b988f360 con 0x55f4b99ed510 2024-09-18T01:45:23.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.097+0000 7fed965f5640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55f4b99ed510 0x55f4b99ed910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.097+0000 7fed965f5640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55f4b99ed510 0x55f4b99ed910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59542/0 (socket says 172.21.15.146:59542) 2024-09-18T01:45:23.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.097+0000 7fed965f5640 1 -- 172.21.15.146:0/345612265 learned_addr learned my addr 172.21.15.146:0/345612265 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:23.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.097+0000 7fed965f5640 1 -- 172.21.15.146:0/345612265 >> v1:172.21.15.129:6789/0 conn(0x55f4b99ede50 legacy=0x55f4b99f29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.097+0000 7fed965f5640 1 -- 172.21.15.146:0/345612265 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4b98b5e00 con 0x55f4b99ed510 2024-09-18T01:45:23.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.099+0000 7fed965f5640 1 --2- 172.21.15.146:0/345612265 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f4b99ed510 0x55f4b99ed910 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fed8800a520 tx=0x7fed88045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7112fa31e585a4af server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.099+0000 7fed955f3640 1 -- 172.21.15.146:0/345612265 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed88055070 con 0x55f4b99ed510 2024-09-18T01:45:23.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.099+0000 7fed955f3640 1 -- 172.21.15.146:0/345612265 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed880515b0 con 0x55f4b99ed510 2024-09-18T01:45:23.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.099+0000 7fed955f3640 1 -- 172.21.15.146:0/345612265 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed880518d0 con 0x55f4b99ed510 2024-09-18T01:45:23.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.100+0000 7fed9a939800 1 -- 172.21.15.146:0/345612265 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f4b99ed510 msgr2=0x55f4b99ed910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.100+0000 7fed9a939800 1 --2- 172.21.15.146:0/345612265 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f4b99ed510 0x55f4b99ed910 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fed8800a520 tx=0x7fed88045ba0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.100+0000 7fed9a939800 1 -- 172.21.15.146:0/345612265 shutdown_connections 2024-09-18T01:45:23.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.100+0000 7fed9a939800 1 --2- 172.21.15.146:0/345612265 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f4b99ed510 0x55f4b99ed910 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.100+0000 7fed9a939800 1 -- 172.21.15.146:0/345612265 >> 172.21.15.146:0/345612265 conn(0x55f4b99e8da0 msgr2=0x55f4b99eb1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:23.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.100+0000 7fed9a939800 1 -- 172.21.15.146:0/345612265 shutdown_connections 2024-09-18T01:45:23.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.100+0000 7fed9a939800 1 -- 172.21.15.146:0/345612265 wait complete. 2024-09-18T01:45:23.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.113+0000 7fed9a939800 1 Processor -- start 2024-09-18T01:45:23.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.113+0000 7fed9a939800 1 -- start start 2024-09-18T01:45:23.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.114+0000 7fed9a939800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f4b99ed510 0x55f4b9adc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.114+0000 7fed9a939800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55f4b993a350 con 0x55f4b99ed510 2024-09-18T01:45:23.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.114+0000 7fed965f5640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f4b99ed510 0x55f4b9adc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.114+0000 7fed965f5640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f4b99ed510 0x55f4b9adc7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59544/0 (socket says 172.21.15.146:59544) 2024-09-18T01:45:23.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.114+0000 7fed965f5640 1 -- 172.21.15.146:0/66719579 learned_addr learned my addr 172.21.15.146:0/66719579 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:23.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.114+0000 7fed965f5640 1 -- 172.21.15.146:0/66719579 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4b9887bc0 con 0x55f4b99ed510 2024-09-18T01:45:23.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.114+0000 7fed965f5640 1 --2- 172.21.15.146:0/66719579 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f4b99ed510 0x55f4b9adc7d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fed88025da0 tx=0x7fed88051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c59ad7715b1b05f server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.115+0000 7fec84608640 1 -- 172.21.15.146:0/66719579 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed88051950 con 0x55f4b99ed510 2024-09-18T01:45:23.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.115+0000 7fec84608640 1 -- 172.21.15.146:0/66719579 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed88051af0 con 0x55f4b99ed510 2024-09-18T01:45:23.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.115+0000 7fec84608640 1 -- 172.21.15.146:0/66719579 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed88051dd0 con 0x55f4b99ed510 2024-09-18T01:45:23.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.115+0000 7fed9a939800 1 -- 172.21.15.146:0/66719579 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f4b99ed510 msgr2=0x55f4b9adc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.115+0000 7fed9a939800 1 --2- 172.21.15.146:0/66719579 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f4b99ed510 0x55f4b9adc7d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fed88025da0 tx=0x7fed88051000 comp rx=0 tx=0).stop 2024-09-18T01:45:23.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.115+0000 7fed9a939800 1 -- 172.21.15.146:0/66719579 shutdown_connections 2024-09-18T01:45:23.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.115+0000 7fed9a939800 1 --2- 172.21.15.146:0/66719579 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f4b99ed510 0x55f4b9adc7d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.115+0000 7fed9a939800 1 -- 172.21.15.146:0/66719579 >> 172.21.15.146:0/66719579 conn(0x55f4b99e8da0 msgr2=0x55f4b9ad8190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:23.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.115+0000 7fed9a939800 1 -- 172.21.15.146:0/66719579 shutdown_connections 2024-09-18T01:45:23.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.115+0000 7fed9a939800 1 -- 172.21.15.146:0/66719579 wait complete. 2024-09-18T01:45:23.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.116+0000 7fed9a939800 1 Processor -- start 2024-09-18T01:45:23.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.116+0000 7fed9a939800 1 -- start start 2024-09-18T01:45:23.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.116+0000 7fed9a939800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f4b99ed510 0x55f4b9962670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.116+0000 7fed9a939800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55f4b99f4530 con 0x55f4b99ed510 2024-09-18T01:45:23.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.116+0000 7fed965f5640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f4b99ed510 0x55f4b9962670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.116+0000 7fed965f5640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f4b99ed510 0x55f4b9962670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59548/0 (socket says 172.21.15.146:59548) 2024-09-18T01:45:23.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.116+0000 7fed965f5640 1 -- 172.21.15.146:0/2644425651 learned_addr learned my addr 172.21.15.146:0/2644425651 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:23.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.116+0000 7fed965f5640 1 -- 172.21.15.146:0/2644425651 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4b989bfe0 con 0x55f4b99ed510 2024-09-18T01:45:23.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.117+0000 7fed965f5640 1 --2- 172.21.15.146:0/2644425651 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f4b99ed510 0x55f4b9962670 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fed88067040 tx=0x7fed88002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.117+0000 7fec82e05640 1 -- 172.21.15.146:0/2644425651 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed88073070 con 0x55f4b99ed510 2024-09-18T01:45:23.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.117+0000 7fec82e05640 1 -- 172.21.15.146:0/2644425651 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed8805a450 con 0x55f4b99ed510 2024-09-18T01:45:23.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.117+0000 7fed9a939800 1 -- 172.21.15.146:0/2644425651 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f4b9ae7d50 con 0x55f4b99ed510 2024-09-18T01:45:23.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.117+0000 7fec82e05640 1 -- 172.21.15.146:0/2644425651 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed8805a730 con 0x55f4b99ed510 2024-09-18T01:45:23.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.117+0000 7fed9a939800 1 -- 172.21.15.146:0/2644425651 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4b9ae82d0 con 0x55f4b99ed510 2024-09-18T01:45:23.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.118+0000 7fec82e05640 1 -- 172.21.15.146:0/2644425651 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fed88076070 con 0x55f4b99ed510 2024-09-18T01:45:23.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.118+0000 7fec82e05640 1 --2- 172.21.15.146:0/2644425651 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fec7c036b40 0x7fec7c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.118+0000 7fec82e05640 1 -- 172.21.15.146:0/2644425651 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fed88062070 con 0x55f4b99ed510 2024-09-18T01:45:23.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.118+0000 7fed95df4640 1 --2- 172.21.15.146:0/2644425651 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fec7c036b40 0x7fec7c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.118+0000 7fed9a939800 1 --2- 172.21.15.146:0/2644425651 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55f4b99ede50 0x55f4b9aec0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.118+0000 7fed9a939800 1 -- 172.21.15.146:0/2644425651 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9aec6f0 con 0x55f4b99ede50 2024-09-18T01:45:23.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.118+0000 7fed96df6640 1 --2- 172.21.15.146:0/2644425651 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55f4b99ede50 0x55f4b9aec0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.118+0000 7fed95df4640 1 --2- 172.21.15.146:0/2644425651 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fec7c036b40 0x7fec7c039000 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fed8c001e10 tx=0x7fed8c001390 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.118+0000 7fed96df6640 1 --2- 172.21.15.146:0/2644425651 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55f4b99ede50 0x55f4b9aec0f0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.119+0000 7fed96df6640 1 -- 172.21.15.146:0/2644425651 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fed9000a4a0 con 0x55f4b99ede50 2024-09-18T01:45:23.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.119+0000 7fed9a939800 1 -- 172.21.15.146:0/2644425651 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9aecfb0 con 0x55f4b99ede50 2024-09-18T01:45:23.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.119+0000 7fed96df6640 1 -- 172.21.15.146:0/2644425651 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fed9000a4a0 con 0x55f4b99ede50 2024-09-18T01:45:23.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.119+0000 7fed9a939800 1 -- 172.21.15.146:0/2644425651 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9aee360 con 0x55f4b99ede50 2024-09-18T01:45:23.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.119+0000 7fed96df6640 1 -- 172.21.15.146:0/2644425651 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fed9000a4a0 con 0x55f4b99ede50 2024-09-18T01:45:23.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.119+0000 7fed9a939800 1 -- 172.21.15.146:0/2644425651 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9aed800 con 0x55f4b99ede50 2024-09-18T01:45:23.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.120+0000 7fed96df6640 1 -- 172.21.15.146:0/2644425651 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fed9000a4a0 con 0x55f4b99ede50 2024-09-18T01:45:23.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.120+0000 7fed9a939800 1 --2- 172.21.15.146:0/2644425651 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55f4b9aef710 0x55f4b9af1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.120+0000 7fed9a939800 1 -- 172.21.15.146:0/2644425651 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9af2110 con 0x55f4b9aef710 2024-09-18T01:45:23.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.120+0000 7fed965f5640 1 --2- 172.21.15.146:0/2644425651 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55f4b9aef710 0x55f4b9af1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.120+0000 7fed965f5640 1 --2- 172.21.15.146:0/2644425651 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55f4b9aef710 0x55f4b9af1b00 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.120+0000 7fed965f5640 1 -- 172.21.15.146:0/2644425651 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fed8807f070 con 0x55f4b9aef710 2024-09-18T01:45:23.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.121+0000 7fed9a939800 1 Processor -- start 2024-09-18T01:45:23.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.121+0000 7fed9a939800 1 -- start start 2024-09-18T01:45:23.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.121+0000 7fed9a939800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f4b9ae5700 0x55f4b9ae3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.121+0000 7fed9a939800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55f4b9889580 con 0x55f4b9ae5700 2024-09-18T01:45:23.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.121+0000 7fed96df6640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f4b9ae5700 0x55f4b9ae3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.121+0000 7fed96df6640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f4b9ae5700 0x55f4b9ae3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59550/0 (socket says 172.21.15.146:59550) 2024-09-18T01:45:23.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.121+0000 7fed96df6640 1 -- 172.21.15.146:0/3244919862 learned_addr learned my addr 172.21.15.146:0/3244919862 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:23.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.121+0000 7fed96df6640 1 -- 172.21.15.146:0/3244919862 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4b9ae5b20 con 0x55f4b9ae5700 2024-09-18T01:45:23.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.121+0000 7fed96df6640 1 --2- 172.21.15.146:0/3244919862 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f4b9ae5700 0x55f4b9ae3d50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x55f4b9aecad0 tx=0x7fed900178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.121+0000 7fec7bfff640 1 -- 172.21.15.146:0/3244919862 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed90013440 con 0x55f4b9ae5700 2024-09-18T01:45:23.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.121+0000 7fec7bfff640 1 -- 172.21.15.146:0/3244919862 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed900135e0 con 0x55f4b9ae5700 2024-09-18T01:45:23.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.121+0000 7fed9a939800 1 -- 172.21.15.146:0/3244919862 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f4b9ae4350 con 0x55f4b9ae5700 2024-09-18T01:45:23.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.121+0000 7fec7bfff640 1 -- 172.21.15.146:0/3244919862 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed900138c0 con 0x55f4b9ae5700 2024-09-18T01:45:23.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.122+0000 7fed9a939800 1 -- 172.21.15.146:0/3244919862 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4b9ae4850 con 0x55f4b9ae5700 2024-09-18T01:45:23.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.122+0000 7fec7bfff640 1 -- 172.21.15.146:0/3244919862 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fed90011040 con 0x55f4b9ae5700 2024-09-18T01:45:23.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.122+0000 7fec7bfff640 1 --2- 172.21.15.146:0/3244919862 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fec70036b40 0x7fec70039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.122+0000 7fec7bfff640 1 -- 172.21.15.146:0/3244919862 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fed9001d070 con 0x55f4b9ae5700 2024-09-18T01:45:23.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.123+0000 7fed965f5640 1 --2- 172.21.15.146:0/3244919862 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fec70036b40 0x7fec70039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.123+0000 7fed9a939800 1 Processor -- start 2024-09-18T01:45:23.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.123+0000 7fed9a939800 1 -- start start 2024-09-18T01:45:23.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.123+0000 7fed965f5640 1 --2- 172.21.15.146:0/3244919862 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fec70036b40 0x7fec70039000 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x55f4b9aedba0 tx=0x7fed8808f220 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.123+0000 7fed9a939800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f4b9b0ed30 0x55f4b9b0f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.123+0000 7fed9a939800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55f4b9adcec0 con 0x55f4b9b0ed30 2024-09-18T01:45:23.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.123+0000 7fed96df6640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f4b9b0ed30 0x55f4b9b0f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.123+0000 7fed96df6640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f4b9b0ed30 0x55f4b9b0f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59556/0 (socket says 172.21.15.146:59556) 2024-09-18T01:45:23.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.123+0000 7fed96df6640 1 -- 172.21.15.146:0/3294960414 learned_addr learned my addr 172.21.15.146:0/3294960414 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:23.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.123+0000 7fed96df6640 1 -- 172.21.15.146:0/3294960414 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4b9b0f670 con 0x55f4b9b0ed30 2024-09-18T01:45:23.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.124+0000 7fed96df6640 1 --2- 172.21.15.146:0/3294960414 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f4b9b0ed30 0x55f4b9b0f130 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fed9004c9c0 tx=0x7fed9004cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bb5aaca38eac52d server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.124+0000 7fec79ffb640 1 -- 172.21.15.146:0/3294960414 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed90015430 con 0x55f4b9b0ed30 2024-09-18T01:45:23.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.124+0000 7fec79ffb640 1 -- 172.21.15.146:0/3294960414 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed90044070 con 0x55f4b9b0ed30 2024-09-18T01:45:23.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.124+0000 7fec79ffb640 1 -- 172.21.15.146:0/3294960414 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed90021bf0 con 0x55f4b9b0ed30 2024-09-18T01:45:23.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.124+0000 7fed9a939800 1 -- 172.21.15.146:0/3294960414 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f4b9b0ed30 msgr2=0x55f4b9b0f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.124+0000 7fed9a939800 1 --2- 172.21.15.146:0/3294960414 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f4b9b0ed30 0x55f4b9b0f130 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fed9004c9c0 tx=0x7fed9004cc90 comp rx=0 tx=0).stop 2024-09-18T01:45:23.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.124+0000 7fed9a939800 1 -- 172.21.15.146:0/3294960414 shutdown_connections 2024-09-18T01:45:23.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.124+0000 7fed9a939800 1 --2- 172.21.15.146:0/3294960414 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f4b9b0ed30 0x55f4b9b0f130 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.124+0000 7fed9a939800 1 -- 172.21.15.146:0/3294960414 >> 172.21.15.146:0/3294960414 conn(0x55f4b9b0b0e0 msgr2=0x55f4b9b091e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:23.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.124+0000 7fed9a939800 1 -- 172.21.15.146:0/3294960414 shutdown_connections 2024-09-18T01:45:23.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.124+0000 7fed9a939800 1 -- 172.21.15.146:0/3294960414 wait complete. 2024-09-18T01:45:23.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.124+0000 7fed9a939800 1 Processor -- start 2024-09-18T01:45:23.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.125+0000 7fed9a939800 1 -- start start 2024-09-18T01:45:23.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.125+0000 7fed9a939800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f4b9b0ed30 0x55f4b9b161b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.125+0000 7fed9a939800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55f4b9b0fd10 con 0x55f4b9b0ed30 2024-09-18T01:45:23.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.125+0000 7fed96df6640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f4b9b0ed30 0x55f4b9b161b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.125+0000 7fed96df6640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f4b9b0ed30 0x55f4b9b161b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59560/0 (socket says 172.21.15.146:59560) 2024-09-18T01:45:23.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.125+0000 7fed96df6640 1 -- 172.21.15.146:0/2471034104 learned_addr learned my addr 172.21.15.146:0/2471034104 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:23.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.125+0000 7fed96df6640 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4b9b166f0 con 0x55f4b9b0ed30 2024-09-18T01:45:23.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.125+0000 7fed96df6640 1 --2- 172.21.15.146:0/2471034104 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f4b9b0ed30 0x55f4b9b161b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fed9004a040 tx=0x7fed9004c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.125+0000 7fec67fff640 1 -- 172.21.15.146:0/2471034104 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed90012cc0 con 0x55f4b9b0ed30 2024-09-18T01:45:23.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.125+0000 7fec67fff640 1 -- 172.21.15.146:0/2471034104 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed9002b3a0 con 0x55f4b9b0ed30 2024-09-18T01:45:23.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.125+0000 7fed9a939800 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f4b9b16980 con 0x55f4b9b0ed30 2024-09-18T01:45:23.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.125+0000 7fec67fff640 1 -- 172.21.15.146:0/2471034104 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed90012e60 con 0x55f4b9b0ed30 2024-09-18T01:45:23.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.125+0000 7fed9a939800 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4b9b19630 con 0x55f4b9b0ed30 2024-09-18T01:45:23.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.126+0000 7fec67fff640 1 -- 172.21.15.146:0/2471034104 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fed9004e070 con 0x55f4b9b0ed30 2024-09-18T01:45:23.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.126+0000 7fec67fff640 1 --2- 172.21.15.146:0/2471034104 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fec60036b40 0x7fec60039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.126+0000 7fec67fff640 1 -- 172.21.15.146:0/2471034104 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fed90034070 con 0x55f4b9b0ed30 2024-09-18T01:45:23.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.126+0000 7fed965f5640 1 --2- 172.21.15.146:0/2471034104 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fec60036b40 0x7fec60039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.127+0000 7fed965f5640 1 --2- 172.21.15.146:0/2471034104 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fec60036b40 0x7fec60039000 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fed8805ab80 tx=0x7fed88069000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.127+0000 7fed9a939800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.127+0000 7fed9a939800 1 --2- 172.21.15.146:0/2471034104 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55f4b9b21ec0 0x55f4b9b24380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.127+0000 7fed9a939800 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9b24ad0 con 0x55f4b9b21ec0 2024-09-18T01:45:23.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.127+0000 7fed95df4640 1 --2- 172.21.15.146:0/2471034104 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55f4b9b21ec0 0x55f4b9b24380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.128+0000 7fed95df4640 1 --2- 172.21.15.146:0/2471034104 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55f4b9b21ec0 0x55f4b9b24380 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.128+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fed8c00bdb0 con 0x55f4b9b21ec0 2024-09-18T01:45:23.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.128+0000 7fed9a939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.128+0000 7fed9a939800 20 realm 2024-09-18T01:45:23.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.128+0000 7fed9a939800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.128+0000 7fed9a939800 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9b21310 con 0x55f4b9b21ec0 2024-09-18T01:45:23.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.128+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fed8c00bdb0 con 0x55f4b9b21ec0 2024-09-18T01:45:23.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.128+0000 7fed9a939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.128+0000 7fed9a939800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:23.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.128+0000 7fed9a939800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.128+0000 7fed9a939800 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9b255c0 con 0x55f4b9b21ec0 2024-09-18T01:45:23.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.128+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fed8c00bdb0 con 0x55f4b9b21ec0 2024-09-18T01:45:23.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.128+0000 7fed9a939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.128+0000 7fed9a939800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.128+0000 7fed9a939800 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9b25e90 con 0x55f4b9b21ec0 2024-09-18T01:45:23.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.129+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fed8c00bdb0 con 0x55f4b9b21ec0 2024-09-18T01:45:23.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.129+0000 7fed9a939800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:23.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.129+0000 7fed9a939800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.129+0000 7fed9a939800 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9b26230 con 0x55f4b9b21ec0 2024-09-18T01:45:23.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.129+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fed8c00bdb0 con 0x55f4b9b21ec0 2024-09-18T01:45:23.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.129+0000 7fed9a939800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:23.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.129+0000 7fed9a939800 20 searching for the correct realm 2024-09-18T01:45:23.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.129+0000 7fed9a939800 1 --2- 172.21.15.146:0/2471034104 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55f4b9b28110 0x55f4b9b2a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.129+0000 7fed9a939800 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9b2abf0 con 0x55f4b9b28110 2024-09-18T01:45:23.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.129+0000 7fed96df6640 1 --2- 172.21.15.146:0/2471034104 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55f4b9b28110 0x55f4b9b2a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.129+0000 7fed96df6640 1 --2- 172.21.15.146:0/2471034104 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55f4b9b28110 0x55f4b9b2a520 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.129+0000 7fed96df6640 1 -- 172.21.15.146:0/2471034104 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed9003e020 con 0x55f4b9b28110 2024-09-18T01:45:23.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.129+0000 7fed96df6640 1 --2- 172.21.15.146:0/2471034104 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fed90040a70 0x7fed900169d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.129+0000 7fed96df6640 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9b2abf0 con 0x7fed90040a70 2024-09-18T01:45:23.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.130+0000 7fed965f5640 1 --2- 172.21.15.146:0/2471034104 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fed90040a70 0x7fed900169d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.130+0000 7fed965f5640 1 --2- 172.21.15.146:0/2471034104 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fed90040a70 0x7fed900169d0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.130+0000 7fed965f5640 1 -- 172.21.15.146:0/2471034104 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed8807f070 con 0x7fed90040a70 2024-09-18T01:45:23.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.130+0000 7fed965f5640 1 --2- 172.21.15.146:0/2471034104 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fed8809f070 0x7fed8806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.130+0000 7fed965f5640 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9b2abf0 con 0x7fed8809f070 2024-09-18T01:45:23.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.130+0000 7fed95df4640 1 --2- 172.21.15.146:0/2471034104 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fed8809f070 0x7fed8806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.131+0000 7fed95df4640 1 --2- 172.21.15.146:0/2471034104 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fed8809f070 0x7fed8806e3c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.131+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed8c00bdb0 con 0x7fed8809f070 2024-09-18T01:45:23.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.131+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9b2abf0 con 0x55f4b9b21ec0 2024-09-18T01:45:23.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.131+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fed8c00bdb0 con 0x55f4b9b21ec0 2024-09-18T01:45:23.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.131+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9b2abf0 con 0x55f4b9b21ec0 2024-09-18T01:45:23.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.131+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed8c02b040 con 0x55f4b9b21ec0 2024-09-18T01:45:23.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.131+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9b2abf0 con 0x7fed8809f070 2024-09-18T01:45:23.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.132+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed8c02b040 con 0x7fed8809f070 2024-09-18T01:45:23.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.132+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9b2abf0 con 0x7fed8809f070 2024-09-18T01:45:23.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.132+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed8c02b040 con 0x7fed8809f070 2024-09-18T01:45:23.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.132+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9b2abf0 con 0x7fed90040a70 2024-09-18T01:45:23.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.132+0000 7fed965f5640 1 -- 172.21.15.146:0/2471034104 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed8807f070 con 0x7fed90040a70 2024-09-18T01:45:23.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.132+0000 7fed965f5640 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9b2abf0 con 0x55f4b9b28110 2024-09-18T01:45:23.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.132+0000 7fed96df6640 1 -- 172.21.15.146:0/2471034104 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed9003e020 con 0x55f4b9b28110 2024-09-18T01:45:23.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.132+0000 7fed96df6640 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9b2abf0 con 0x55f4b9b21ec0 2024-09-18T01:45:23.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.132+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed8c02b040 con 0x55f4b9b21ec0 2024-09-18T01:45:23.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.132+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9b2abf0 con 0x7fed8809f070 2024-09-18T01:45:23.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.133+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed8c02b040 con 0x7fed8809f070 2024-09-18T01:45:23.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.133+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9b2abf0 con 0x55f4b9b21ec0 2024-09-18T01:45:23.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.133+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed8c02b040 con 0x55f4b9b21ec0 2024-09-18T01:45:23.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.133+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9b2abf0 con 0x7fed90040a70 2024-09-18T01:45:23.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.133+0000 7fed965f5640 1 -- 172.21.15.146:0/2471034104 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fed8807f070 con 0x7fed90040a70 2024-09-18T01:45:23.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.133+0000 7fed965f5640 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fed880ac0a0 con 0x55f4b9b28110 2024-09-18T01:45:23.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.133+0000 7fed96df6640 1 -- 172.21.15.146:0/2471034104 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed9003e020 con 0x55f4b9b28110 2024-09-18T01:45:23.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.133+0000 7fed96df6640 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fed880ac0a0 con 0x55f4b9b28110 2024-09-18T01:45:23.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.134+0000 7fed96df6640 1 -- 172.21.15.146:0/2471034104 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed9003e020 con 0x55f4b9b28110 2024-09-18T01:45:23.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.134+0000 7fed96df6640 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fed880ac0a0 con 0x7fed8809f070 2024-09-18T01:45:23.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.134+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed8c02b040 con 0x7fed8809f070 2024-09-18T01:45:23.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.134+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fed880ac0a0 con 0x55f4b9b28110 2024-09-18T01:45:23.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.134+0000 7fed96df6640 1 -- 172.21.15.146:0/2471034104 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed9003e020 con 0x55f4b9b28110 2024-09-18T01:45:23.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.134+0000 7fed96df6640 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fed880ac0a0 con 0x55f4b9b28110 2024-09-18T01:45:23.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.134+0000 7fed96df6640 1 -- 172.21.15.146:0/2471034104 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed9003e020 con 0x55f4b9b28110 2024-09-18T01:45:23.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.134+0000 7fed96df6640 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fed880ac0a0 con 0x55f4b9b21ec0 2024-09-18T01:45:23.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.135+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed8c02b040 con 0x55f4b9b21ec0 2024-09-18T01:45:23.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.135+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fed880ac0a0 con 0x55f4b9b21ec0 2024-09-18T01:45:23.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.135+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fed8c02b040 con 0x55f4b9b21ec0 2024-09-18T01:45:23.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.135+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fed880ac0a0 con 0x7fed8809f070 2024-09-18T01:45:23.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.135+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed8c02b040 con 0x7fed8809f070 2024-09-18T01:45:23.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.135+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fed880ac0a0 con 0x55f4b9b28110 2024-09-18T01:45:23.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.135+0000 7fed96df6640 1 -- 172.21.15.146:0/2471034104 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed9003e020 con 0x55f4b9b28110 2024-09-18T01:45:23.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.135+0000 7fed96df6640 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fed880ac0a0 con 0x7fed90040a70 2024-09-18T01:45:23.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.136+0000 7fed965f5640 1 -- 172.21.15.146:0/2471034104 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed8807f070 con 0x7fed90040a70 2024-09-18T01:45:23.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.136+0000 7fed965f5640 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fed880ac0a0 con 0x55f4b9b21ec0 2024-09-18T01:45:23.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.136+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed8c02b040 con 0x55f4b9b21ec0 2024-09-18T01:45:23.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.136+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fed880ac0a0 con 0x7fed8809f070 2024-09-18T01:45:23.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.136+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed8c02b040 con 0x7fed8809f070 2024-09-18T01:45:23.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.136+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fed880ac0a0 con 0x55f4b9b28110 2024-09-18T01:45:23.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.136+0000 7fed96df6640 1 -- 172.21.15.146:0/2471034104 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed9003e020 con 0x55f4b9b28110 2024-09-18T01:45:23.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.136+0000 7fed96df6640 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fed880ac0a0 con 0x7fed8809f070 2024-09-18T01:45:23.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.137+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed8c02b040 con 0x7fed8809f070 2024-09-18T01:45:23.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.137+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fed880ac0a0 con 0x7fed90040a70 2024-09-18T01:45:23.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.137+0000 7fed965f5640 1 -- 172.21.15.146:0/2471034104 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed8807f070 con 0x7fed90040a70 2024-09-18T01:45:23.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.137+0000 7fed965f5640 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fed880ac0a0 con 0x55f4b9b28110 2024-09-18T01:45:23.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.137+0000 7fed96df6640 1 -- 172.21.15.146:0/2471034104 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed9003e020 con 0x55f4b9b28110 2024-09-18T01:45:23.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.137+0000 7fed96df6640 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fed880ac0a0 con 0x7fed8809f070 2024-09-18T01:45:23.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.137+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed8c02b040 con 0x7fed8809f070 2024-09-18T01:45:23.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.137+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fed880ac0a0 con 0x55f4b9b21ec0 2024-09-18T01:45:23.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.138+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fed8c03b040 con 0x55f4b9b21ec0 2024-09-18T01:45:23.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.138+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fed880ac0a0 con 0x7fed90040a70 2024-09-18T01:45:23.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.138+0000 7fed965f5640 1 -- 172.21.15.146:0/2471034104 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed8807f070 con 0x7fed90040a70 2024-09-18T01:45:23.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.138+0000 7fed9a939800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:23.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.138+0000 7fed9a939800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:23.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.138+0000 7fed9a939800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:23.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.138+0000 7fed9a939800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:23.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.138+0000 7fed9a939800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:23.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.138+0000 7fed9a939800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:23.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.138+0000 7fed9a939800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.138+0000 7fed9a939800 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9b26bb0 con 0x55f4b9b21ec0 2024-09-18T01:45:23.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.138+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fed8c03b040 con 0x55f4b9b21ec0 2024-09-18T01:45:23.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.138+0000 7fed9a939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.138+0000 7fed9a939800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.138+0000 7fed9a939800 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9b27450 con 0x55f4b9b21ec0 2024-09-18T01:45:23.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.138+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fed8c03b040 con 0x55f4b9b21ec0 2024-09-18T01:45:23.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.138+0000 7fed9a939800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:23.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.138+0000 7fed9a939800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.138+0000 7fed9a939800 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9b2b070 con 0x7fed90040a70 2024-09-18T01:45:23.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.139+0000 7fed965f5640 1 -- 172.21.15.146:0/2471034104 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fed8807f070 con 0x7fed90040a70 2024-09-18T01:45:23.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.139+0000 7fed9a939800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:23.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.139+0000 7fed9a939800 20 zone default found 2024-09-18T01:45:23.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.139+0000 7fed9a939800 4 Realm: () 2024-09-18T01:45:23.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.139+0000 7fed9a939800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:23.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.139+0000 7fed9a939800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:23.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.139+0000 7fed9a939800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:23.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.139+0000 7fed9a939800 20 zonegroup default 2024-09-18T01:45:23.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.139+0000 7fed9a939800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.139+0000 7fed9a939800 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9b2b8c0 con 0x7fed8809f070 2024-09-18T01:45:23.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.139+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fed8c03b040 con 0x7fed8809f070 2024-09-18T01:45:23.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.139+0000 7fed9a939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.139+0000 7fed9a939800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.139+0000 7fed9a939800 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9b2d2a0 con 0x55f4b9b28110 2024-09-18T01:45:23.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.139+0000 7fed96df6640 1 -- 172.21.15.146:0/2471034104 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fed9003e020 con 0x55f4b9b28110 2024-09-18T01:45:23.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.139+0000 7fed9a939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.139+0000 7fed9a939800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.139+0000 7fed9a939800 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9b2d7c0 con 0x55f4b9b28110 2024-09-18T01:45:23.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.139+0000 7fed96df6640 1 -- 172.21.15.146:0/2471034104 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fed9003e020 con 0x55f4b9b28110 2024-09-18T01:45:23.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.140+0000 7fed9a939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.140+0000 7fed9a939800 20 started sync module instance, tier type = 2024-09-18T01:45:23.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.140+0000 7fed9a939800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:23.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.140+0000 7fed9a939800 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9b2c730 con 0x7fed90040a70 2024-09-18T01:45:23.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.141+0000 7fed965f5640 1 -- 172.21.15.146:0/2471034104 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v31'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed8807f070 con 0x7fed90040a70 2024-09-18T01:45:23.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.141+0000 7fed9a939800 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94509575883552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9b2e0d0 con 0x7fed90040a70 2024-09-18T01:45:23.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.141+0000 7fed9a939800 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9b2e920 con 0x55f4b9b21ec0 2024-09-18T01:45:23.180 DEBUG:teuthology.orchestra.run:got remote process result: 240 2024-09-18T01:45:23.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.142+0000 7fed965f5640 1 -- 172.21.15.146:0/2471034104 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94509575883552] v31'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed8807f070 con 0x7fed90040a70 2024-09-18T01:45:23.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.142+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v31'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed8c03b040 con 0x55f4b9b21ec0 2024-09-18T01:45:23.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.142+0000 7fed9a939800 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94509575887904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9b2e920 con 0x55f4b9b21ec0 2024-09-18T01:45:23.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.142+0000 7fed9a939800 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9b2f410 con 0x55f4b9b28110 2024-09-18T01:45:23.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.143+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94509575887904] v31'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed8c03b040 con 0x55f4b9b21ec0 2024-09-18T01:45:23.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.143+0000 7fed96df6640 1 -- 172.21.15.146:0/2471034104 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v31'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed9003e020 con 0x55f4b9b28110 2024-09-18T01:45:23.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.143+0000 7fed9a939800 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94509575892704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9b2e920 con 0x55f4b9b28110 2024-09-18T01:45:23.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.143+0000 7fed9a939800 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9b2fcb0 con 0x7fed90040a70 2024-09-18T01:45:23.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.144+0000 7fed96df6640 1 -- 172.21.15.146:0/2471034104 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94509575892704] v31'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed9003e020 con 0x55f4b9b28110 2024-09-18T01:45:23.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.144+0000 7fed965f5640 1 -- 172.21.15.146:0/2471034104 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v31'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed8807f070 con 0x7fed90040a70 2024-09-18T01:45:23.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.144+0000 7fed9a939800 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94509575890032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9b30500 con 0x7fed90040a70 2024-09-18T01:45:23.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.144+0000 7fed9a939800 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9b30d50 con 0x55f4b9b21ec0 2024-09-18T01:45:23.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.145+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v31'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed8c03b040 con 0x55f4b9b21ec0 2024-09-18T01:45:23.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.145+0000 7fed9a939800 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94509575898880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9b30d00 con 0x55f4b9b21ec0 2024-09-18T01:45:23.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.145+0000 7fed9a939800 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9b31d20 con 0x7fed8809f070 2024-09-18T01:45:23.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.146+0000 7fed965f5640 1 -- 172.21.15.146:0/2471034104 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94509575890032] v31'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed8807f070 con 0x7fed90040a70 2024-09-18T01:45:23.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.146+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94509575898880] v31'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed8c03b040 con 0x55f4b9b21ec0 2024-09-18T01:45:23.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.146+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v31'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed8c03b040 con 0x7fed8809f070 2024-09-18T01:45:23.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.146+0000 7fed9a939800 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94509575903248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9b31ce0 con 0x7fed8809f070 2024-09-18T01:45:23.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.146+0000 7fed9a939800 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9b325c0 con 0x7fed8809f070 2024-09-18T01:45:23.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.147+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(56 notify.6 [create] v31'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed8c03b040 con 0x7fed8809f070 2024-09-18T01:45:23.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.147+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94509575903248] v31'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed8c03b040 con 0x7fed8809f070 2024-09-18T01:45:23.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.147+0000 7fed9a939800 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94509575905472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9b31ce0 con 0x7fed8809f070 2024-09-18T01:45:23.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.147+0000 7fed9a939800 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9b30090 con 0x7fed8809f070 2024-09-18T01:45:23.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.148+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(58 notify.7 [create] v31'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed8c03b040 con 0x7fed8809f070 2024-09-18T01:45:23.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.148+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94509575905472] v31'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed8c03b040 con 0x7fed8809f070 2024-09-18T01:45:23.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.148+0000 7fed9a939800 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94509575897232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9b32be0 con 0x7fed8809f070 2024-09-18T01:45:23.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.148+0000 7fed9a939800 20 add_watcher() i=0 2024-09-18T01:45:23.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.148+0000 7fed9a939800 20 add_watcher() i=1 2024-09-18T01:45:23.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.148+0000 7fed9a939800 20 add_watcher() i=2 2024-09-18T01:45:23.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.148+0000 7fed9a939800 20 add_watcher() i=3 2024-09-18T01:45:23.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.148+0000 7fed9a939800 20 add_watcher() i=4 2024-09-18T01:45:23.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.148+0000 7fed9a939800 20 add_watcher() i=5 2024-09-18T01:45:23.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.148+0000 7fed9a939800 20 add_watcher() i=6 2024-09-18T01:45:23.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.150+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94509575897232] v31'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed8c03b040 con 0x7fed8809f070 2024-09-18T01:45:23.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.150+0000 7fed9a939800 20 add_watcher() i=7 2024-09-18T01:45:23.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.150+0000 7fed9a939800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:23.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.150+0000 7fed9a939800 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9b360c0 con 0x55f4b9b21ec0 2024-09-18T01:45:23.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.150+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fed8c03b040 con 0x55f4b9b21ec0 2024-09-18T01:45:23.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.150+0000 7fed9a939800 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94509575908320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9b334b0 con 0x55f4b9b21ec0 2024-09-18T01:45:23.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.151+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94509575908320] v31'58 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fed8c03b040 con 0x55f4b9b21ec0 2024-09-18T01:45:23.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.151+0000 7fec4cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:23.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.151+0000 7fed9a939800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:23.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.151+0000 7fed9a939800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:23.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.151+0000 7fed9a939800 5 note: GC not initialized 2024-09-18T01:45:23.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.152+0000 7febc77fe640 20 reqs_thread_entry: start 2024-09-18T01:45:23.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.152+0000 7fed9a939800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:23.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.152+0000 7fed9a939800 20 Filter name: none 2024-09-18T01:45:23.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.152+0000 7febc57fa640 20 reqs_thread_entry: start 2024-09-18T01:45:23.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.152+0000 7fed9a939800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-18T01:45:23.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.152+0000 7fed9a939800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.152+0000 7fed9a939800 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9b69360 con 0x7fed8809f070 2024-09-18T01:45:23.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.152+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fed8c03b040 con 0x7fed8809f070 2024-09-18T01:45:23.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.152+0000 7fed9a939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.152+0000 7fed9a939800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-18T01:45:23.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.152+0000 7fed9a939800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-18T01:45:23.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.152+0000 7fed9a939800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-18T01:45:23.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.152+0000 7fed9a939800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.152+0000 7fed9a939800 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9b679a0 con 0x55f4b9b21ec0 2024-09-18T01:45:23.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.153+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(63 foo@foo.com [stat out=16b,read 0~7 out=7b] v0'0 uv1 ondisk = 0) ==== 197+0+23 (crc 0 0 0) 0x7fed8c03b040 con 0x55f4b9b21ec0 2024-09-18T01:45:23.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.153+0000 7fed9a939800 20 rados_obj.operate() r=0 bl.length=7 2024-09-18T01:45:23.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.153+0000 7fed9a939800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x5 2024-09-18T01:45:23.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.153+0000 7fed9a939800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-18T01:45:23.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.153+0000 7fed9a939800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T01:45:23.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.153+0000 7fed9a939800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.153+0000 7fed9a939800 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9b67d90 con 0x55f4b9b21ec0 2024-09-18T01:45:23.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.153+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(64 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fed8c03b040 con 0x55f4b9b21ec0 2024-09-18T01:45:23.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.153+0000 7fed9a939800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:45:23.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.153+0000 7fed9a939800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T01:45:23.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.153+0000 7fed9a939800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:45:23.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.153+0000 7fed9a939800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:45:23.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.153+0000 7fed9a939800 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+foo 2024-09-18T01:45:23.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.153+0000 7fed9a939800 20 get_user_info_from_index found 0 xattrs 2024-09-18T01:45:23.186 INFO:teuthology.orchestra.run.smithi146.stderr:could not create user: unable to parse parameters, email: foo@foo.com is the email address of an existing user 2024-09-18T01:45:23.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.154+0000 7fec4cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:23.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.154+0000 7fed9a939800 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94509575908320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9b1b830 con 0x55f4b9b21ec0 2024-09-18T01:45:23.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.155+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94509575908320] v31'59 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fed8c03b040 con 0x55f4b9b21ec0 2024-09-18T01:45:23.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.155+0000 7fed9a939800 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94509575883552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9b670d0 con 0x7fed90040a70 2024-09-18T01:45:23.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.156+0000 7fed965f5640 1 -- 172.21.15.146:0/2471034104 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94509575883552] v31'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed8807f070 con 0x7fed90040a70 2024-09-18T01:45:23.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.156+0000 7fed9a939800 20 remove_watcher() i=0 2024-09-18T01:45:23.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.156+0000 7fed9a939800 2 removed watcher, disabling cache 2024-09-18T01:45:23.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.156+0000 7fed9a939800 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94509575887904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9b670d0 con 0x55f4b9b21ec0 2024-09-18T01:45:23.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.157+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94509575887904] v31'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed8c03b040 con 0x55f4b9b21ec0 2024-09-18T01:45:23.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.157+0000 7fed9a939800 20 remove_watcher() i=1 2024-09-18T01:45:23.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.157+0000 7fed9a939800 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94509575892704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9b670d0 con 0x55f4b9b28110 2024-09-18T01:45:23.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.158+0000 7fed96df6640 1 -- 172.21.15.146:0/2471034104 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94509575892704] v31'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed9003e020 con 0x55f4b9b28110 2024-09-18T01:45:23.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.158+0000 7fed9a939800 20 remove_watcher() i=2 2024-09-18T01:45:23.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.158+0000 7fed9a939800 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94509575890032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9b670d0 con 0x7fed90040a70 2024-09-18T01:45:23.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.159+0000 7fed965f5640 1 -- 172.21.15.146:0/2471034104 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94509575890032] v31'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed8807f070 con 0x7fed90040a70 2024-09-18T01:45:23.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.159+0000 7fed9a939800 20 remove_watcher() i=3 2024-09-18T01:45:23.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.159+0000 7fed9a939800 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94509575898880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9b670d0 con 0x55f4b9b21ec0 2024-09-18T01:45:23.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.160+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94509575898880] v31'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed8c03b040 con 0x55f4b9b21ec0 2024-09-18T01:45:23.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.160+0000 7fed9a939800 20 remove_watcher() i=4 2024-09-18T01:45:23.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.160+0000 7fed9a939800 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94509575903248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9b670d0 con 0x7fed8809f070 2024-09-18T01:45:23.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.161+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94509575903248] v31'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed8c03b040 con 0x7fed8809f070 2024-09-18T01:45:23.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.161+0000 7fed9a939800 20 remove_watcher() i=5 2024-09-18T01:45:23.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.161+0000 7fed9a939800 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94509575905472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9b670d0 con 0x7fed8809f070 2024-09-18T01:45:23.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.162+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94509575905472] v31'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed8c03b040 con 0x7fed8809f070 2024-09-18T01:45:23.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.162+0000 7fed9a939800 20 remove_watcher() i=6 2024-09-18T01:45:23.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.162+0000 7fed9a939800 1 -- 172.21.15.146:0/2471034104 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94509575897232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4b9b670d0 con 0x7fed8809f070 2024-09-18T01:45:23.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.163+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94509575897232] v31'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed8c03b040 con 0x7fed8809f070 2024-09-18T01:45:23.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.163+0000 7fed9a939800 20 remove_watcher() i=7 2024-09-18T01:45:23.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.163+0000 7fed9a939800 1 -- 172.21.15.146:0/2471034104 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fed8809f070 msgr2=0x7fed8806e3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.163+0000 7fed9a939800 1 --2- 172.21.15.146:0/2471034104 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fed8809f070 0x7fed8806e3c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.163+0000 7fed9a939800 1 -- 172.21.15.146:0/2471034104 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55f4b9b21ec0 msgr2=0x55f4b9b24380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.163+0000 7fed9a939800 1 --2- 172.21.15.146:0/2471034104 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55f4b9b21ec0 0x55f4b9b24380 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.163+0000 7fed9a939800 1 -- 172.21.15.146:0/2471034104 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fed90040a70 msgr2=0x7fed900169d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.163+0000 7fed9a939800 1 --2- 172.21.15.146:0/2471034104 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fed90040a70 0x7fed900169d0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.163+0000 7fed9a939800 1 -- 172.21.15.146:0/2471034104 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55f4b9b28110 msgr2=0x55f4b9b2a520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.163+0000 7fed9a939800 1 --2- 172.21.15.146:0/2471034104 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55f4b9b28110 0x55f4b9b2a520 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.163+0000 7fed9a939800 1 -- 172.21.15.146:0/2471034104 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fec60036b40 msgr2=0x7fec60039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.163+0000 7fed9a939800 1 --2- 172.21.15.146:0/2471034104 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fec60036b40 0x7fec60039000 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fed8805ab80 tx=0x7fed88069000 comp rx=0 tx=0).stop 2024-09-18T01:45:23.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.163+0000 7fed9a939800 1 -- 172.21.15.146:0/2471034104 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f4b9b0ed30 msgr2=0x55f4b9b161b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.163+0000 7fed9a939800 1 --2- 172.21.15.146:0/2471034104 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f4b9b0ed30 0x55f4b9b161b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fed9004a040 tx=0x7fed9004c950 comp rx=0 tx=0).stop 2024-09-18T01:45:23.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.163+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 reap_dead start 2024-09-18T01:45:23.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.163+0000 7fed95df4640 1 -- 172.21.15.146:0/2471034104 reap_dead start 2024-09-18T01:45:23.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.163+0000 7fed9a939800 1 -- 172.21.15.146:0/2471034104 shutdown_connections 2024-09-18T01:45:23.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.163+0000 7fed9a939800 1 -- 172.21.15.146:0/2471034104 >> 172.21.15.146:0/2471034104 conn(0x55f4b9b0b0e0 msgr2=0x55f4b9b091b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:23.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.163+0000 7fed9a939800 1 -- 172.21.15.146:0/2471034104 shutdown_connections 2024-09-18T01:45:23.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.163+0000 7fed9a939800 1 -- 172.21.15.146:0/2471034104 wait complete. 2024-09-18T01:45:23.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.164+0000 7fed9a939800 1 -- 172.21.15.146:0/3244919862 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fec70036b40 msgr2=0x7fec70039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.164+0000 7fed9a939800 1 --2- 172.21.15.146:0/3244919862 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fec70036b40 0x7fec70039000 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x55f4b9aedba0 tx=0x7fed8808f220 comp rx=0 tx=0).stop 2024-09-18T01:45:23.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.164+0000 7fed9a939800 1 -- 172.21.15.146:0/3244919862 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f4b9ae5700 msgr2=0x55f4b9ae3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.164+0000 7fed9a939800 1 --2- 172.21.15.146:0/3244919862 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f4b9ae5700 0x55f4b9ae3d50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x55f4b9aecad0 tx=0x7fed900178e0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.164+0000 7fed9a939800 1 -- 172.21.15.146:0/3244919862 shutdown_connections 2024-09-18T01:45:23.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.164+0000 7fed9a939800 1 --2- 172.21.15.146:0/3244919862 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fec70036b40 0x7fec70039000 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.164+0000 7fed9a939800 1 --2- 172.21.15.146:0/3244919862 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f4b9ae5700 0x55f4b9ae3d50 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.164+0000 7fed9a939800 1 -- 172.21.15.146:0/3244919862 >> 172.21.15.146:0/3244919862 conn(0x55f4b9af4e50 msgr2=0x55f4b9af79d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:23.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.164+0000 7fed9a939800 1 -- 172.21.15.146:0/3244919862 shutdown_connections 2024-09-18T01:45:23.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.164+0000 7fed9a939800 1 -- 172.21.15.146:0/3244919862 wait complete. 2024-09-18T01:45:23.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.164+0000 7fed9a939800 1 -- 172.21.15.146:0/2644425651 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55f4b99ede50 msgr2=0x55f4b9aec0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.164+0000 7fed9a939800 1 --2- 172.21.15.146:0/2644425651 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55f4b99ede50 0x55f4b9aec0f0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.164+0000 7fed9a939800 1 -- 172.21.15.146:0/2644425651 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55f4b9aef710 msgr2=0x55f4b9af1b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.164+0000 7fed9a939800 1 --2- 172.21.15.146:0/2644425651 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55f4b9aef710 0x55f4b9af1b00 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.164+0000 7fed9a939800 1 -- 172.21.15.146:0/2644425651 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fec7c036b40 msgr2=0x7fec7c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.164+0000 7fed9a939800 1 --2- 172.21.15.146:0/2644425651 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fec7c036b40 0x7fec7c039000 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fed8c001e10 tx=0x7fed8c001390 comp rx=0 tx=0).stop 2024-09-18T01:45:23.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.164+0000 7fed9a939800 1 -- 172.21.15.146:0/2644425651 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f4b99ed510 msgr2=0x55f4b9962670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.164+0000 7fed9a939800 1 --2- 172.21.15.146:0/2644425651 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f4b99ed510 0x55f4b9962670 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fed88067040 tx=0x7fed88002fb0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.164+0000 7fed9a939800 1 -- 172.21.15.146:0/2644425651 shutdown_connections 2024-09-18T01:45:23.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.164+0000 7fed9a939800 1 --2- 172.21.15.146:0/2644425651 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55f4b9aef710 0x55f4b9af1b00 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.164+0000 7fed9a939800 1 --2- 172.21.15.146:0/2644425651 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55f4b99ede50 0x55f4b9aec0f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.164+0000 7fed9a939800 1 --2- 172.21.15.146:0/2644425651 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fec7c036b40 0x7fec7c039000 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.164+0000 7fed9a939800 1 --2- 172.21.15.146:0/2644425651 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f4b99ed510 0x55f4b9962670 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.164+0000 7fed9a939800 1 -- 172.21.15.146:0/2644425651 >> 172.21.15.146:0/2644425651 conn(0x55f4b99e8da0 msgr2=0x55f4b9ad6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:23.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.164+0000 7fed9a939800 1 -- 172.21.15.146:0/2644425651 shutdown_connections 2024-09-18T01:45:23.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.164+0000 7fed9a939800 1 -- 172.21.15.146:0/2644425651 wait complete. 2024-09-18T01:45:23.193 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-18T01:45:23.193 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-18T01:45:23.193 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-18T01:45:23.237 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:23.237 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:23.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.237+0000 7f033c836800 1 Processor -- start 2024-09-18T01:45:23.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.237+0000 7f033c836800 1 -- start start 2024-09-18T01:45:23.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.238+0000 7f033c836800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55fecb5b1610 0x55fecb642670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.238+0000 7f033c836800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fecb4fcb30 con 0x55fecb642bb0 2024-09-18T01:45:23.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.238+0000 7f033c836800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x55fecb4de360 con 0x55fecb5b1610 2024-09-18T01:45:23.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.238+0000 7f0337b52640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55fecb5b1610 0x55fecb642670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.238+0000 7f0337351640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x55fecb642bb0 0x55fecb644fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:38712/0 (socket says 172.21.15.146:38712) 2024-09-18T01:45:23.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.238+0000 7f0337b52640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55fecb5b1610 0x55fecb642670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59562/0 (socket says 172.21.15.146:59562) 2024-09-18T01:45:23.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.238+0000 7f0337351640 1 -- 172.21.15.146:0/748480167 learned_addr learned my addr 172.21.15.146:0/748480167 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:45:23.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.238+0000 7f0337b52640 1 -- 172.21.15.146:0/748480167 >> v1:172.21.15.129:6789/0 conn(0x55fecb642bb0 legacy=0x55fecb644fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.238+0000 7f0337b52640 1 -- 172.21.15.146:0/748480167 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fecb504e00 con 0x55fecb5b1610 2024-09-18T01:45:23.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.240+0000 7f0337b52640 1 --2- 172.21.15.146:0/748480167 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fecb5b1610 0x55fecb642670 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f032800a470 tx=0x7f0328045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe7442c30bc92e28 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.240+0000 7f0336b50640 1 -- 172.21.15.146:0/748480167 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0328053570 con 0x55fecb5b1610 2024-09-18T01:45:23.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.240+0000 7f0336b50640 1 -- 172.21.15.146:0/748480167 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0328058070 con 0x55fecb5b1610 2024-09-18T01:45:23.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.240+0000 7f0336b50640 1 -- 172.21.15.146:0/748480167 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0328053880 con 0x55fecb5b1610 2024-09-18T01:45:23.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.240+0000 7f033c836800 1 -- 172.21.15.146:0/748480167 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fecb5b1610 msgr2=0x55fecb642670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.240+0000 7f033c836800 1 --2- 172.21.15.146:0/748480167 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fecb5b1610 0x55fecb642670 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f032800a470 tx=0x7f0328045a20 comp rx=0 tx=0).stop 2024-09-18T01:45:23.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.240+0000 7f033c836800 1 -- 172.21.15.146:0/748480167 shutdown_connections 2024-09-18T01:45:23.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.240+0000 7f033c836800 1 --2- 172.21.15.146:0/748480167 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fecb5b1610 0x55fecb642670 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.240+0000 7f033c836800 1 -- 172.21.15.146:0/748480167 >> 172.21.15.146:0/748480167 conn(0x55fecb637de0 msgr2=0x55fecb63a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:23.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.241+0000 7f033c836800 1 -- 172.21.15.146:0/748480167 shutdown_connections 2024-09-18T01:45:23.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.241+0000 7f033c836800 1 -- 172.21.15.146:0/748480167 wait complete. 2024-09-18T01:45:23.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.254+0000 7f033c836800 1 Processor -- start 2024-09-18T01:45:23.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.254+0000 7f033c836800 1 -- start start 2024-09-18T01:45:23.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.254+0000 7f033c836800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fecb5b1610 0x55fecb72ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.254+0000 7f033c836800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55fecb589330 con 0x55fecb5b1610 2024-09-18T01:45:23.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.254+0000 7f0337b52640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fecb5b1610 0x55fecb72ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.254+0000 7f0337b52640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fecb5b1610 0x55fecb72ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59574/0 (socket says 172.21.15.146:59574) 2024-09-18T01:45:23.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.254+0000 7f0337b52640 1 -- 172.21.15.146:0/496963435 learned_addr learned my addr 172.21.15.146:0/496963435 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:23.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.255+0000 7f0337b52640 1 -- 172.21.15.146:0/496963435 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fecb4d6bc0 con 0x55fecb5b1610 2024-09-18T01:45:23.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.255+0000 7f0337b52640 1 --2- 172.21.15.146:0/496963435 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fecb5b1610 0x55fecb72ea50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0328025c20 tx=0x7f0328051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10206602bd91166a server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.255+0000 7f0225e0b640 1 -- 172.21.15.146:0/496963435 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f032805c580 con 0x55fecb5b1610 2024-09-18T01:45:23.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.255+0000 7f0225e0b640 1 -- 172.21.15.146:0/496963435 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0328063030 con 0x55fecb5b1610 2024-09-18T01:45:23.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.255+0000 7f0225e0b640 1 -- 172.21.15.146:0/496963435 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f032805c850 con 0x55fecb5b1610 2024-09-18T01:45:23.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.256+0000 7f033c836800 1 -- 172.21.15.146:0/496963435 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fecb5b1610 msgr2=0x55fecb72ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.256+0000 7f033c836800 1 --2- 172.21.15.146:0/496963435 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fecb5b1610 0x55fecb72ea50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0328025c20 tx=0x7f0328051000 comp rx=0 tx=0).stop 2024-09-18T01:45:23.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.256+0000 7f033c836800 1 -- 172.21.15.146:0/496963435 shutdown_connections 2024-09-18T01:45:23.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.256+0000 7f033c836800 1 --2- 172.21.15.146:0/496963435 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fecb5b1610 0x55fecb72ea50 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.256+0000 7f033c836800 1 -- 172.21.15.146:0/496963435 >> 172.21.15.146:0/496963435 conn(0x55fecb637de0 msgr2=0x55fecb72a410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:23.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.256+0000 7f033c836800 1 -- 172.21.15.146:0/496963435 shutdown_connections 2024-09-18T01:45:23.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.256+0000 7f033c836800 1 -- 172.21.15.146:0/496963435 wait complete. 2024-09-18T01:45:23.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.256+0000 7f033c836800 1 Processor -- start 2024-09-18T01:45:23.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.256+0000 7f033c836800 1 -- start start 2024-09-18T01:45:23.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.256+0000 7f033c836800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fecb5b1610 0x55fecb736360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.256+0000 7f033c836800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55fecb646990 con 0x55fecb5b1610 2024-09-18T01:45:23.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.256+0000 7f0337b52640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fecb5b1610 0x55fecb736360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.257+0000 7f0337b52640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fecb5b1610 0x55fecb736360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59576/0 (socket says 172.21.15.146:59576) 2024-09-18T01:45:23.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.257+0000 7f0337b52640 1 -- 172.21.15.146:0/4104087810 learned_addr learned my addr 172.21.15.146:0/4104087810 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:23.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.257+0000 7f0337b52640 1 -- 172.21.15.146:0/4104087810 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fecb4eafe0 con 0x55fecb5b1610 2024-09-18T01:45:23.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.257+0000 7f0337b52640 1 --2- 172.21.15.146:0/4104087810 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fecb5b1610 0x55fecb736360 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f032800a330 tx=0x7f0328002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.257+0000 7f021ffff640 1 -- 172.21.15.146:0/4104087810 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f032806c030 con 0x55fecb5b1610 2024-09-18T01:45:23.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.257+0000 7f021ffff640 1 -- 172.21.15.146:0/4104087810 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f032805c580 con 0x55fecb5b1610 2024-09-18T01:45:23.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.257+0000 7f033c836800 1 -- 172.21.15.146:0/4104087810 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fecb7368a0 con 0x55fecb5b1610 2024-09-18T01:45:23.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.257+0000 7f021ffff640 1 -- 172.21.15.146:0/4104087810 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f032805c860 con 0x55fecb5b1610 2024-09-18T01:45:23.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.257+0000 7f033c836800 1 -- 172.21.15.146:0/4104087810 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fecb736e20 con 0x55fecb5b1610 2024-09-18T01:45:23.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.258+0000 7f021ffff640 1 -- 172.21.15.146:0/4104087810 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0328053440 con 0x55fecb5b1610 2024-09-18T01:45:23.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.258+0000 7f021ffff640 1 --2- 172.21.15.146:0/4104087810 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0220036b40 0x7f0220039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.258+0000 7f021ffff640 1 -- 172.21.15.146:0/4104087810 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f0328070020 con 0x55fecb5b1610 2024-09-18T01:45:23.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.258+0000 7f0337351640 1 --2- 172.21.15.146:0/4104087810 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0220036b40 0x7f0220039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.258+0000 7f033c836800 1 --2- 172.21.15.146:0/4104087810 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55fecb642bb0 0x55fecb73d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.258+0000 7f033c836800 1 -- 172.21.15.146:0/4104087810 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fecb73d950 con 0x55fecb642bb0 2024-09-18T01:45:23.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.258+0000 7f0338353640 1 --2- 172.21.15.146:0/4104087810 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55fecb642bb0 0x55fecb73d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.259+0000 7f0337351640 1 --2- 172.21.15.146:0/4104087810 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0220036b40 0x7f0220039000 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f032c000f60 tx=0x7f032c0012b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.259+0000 7f0338353640 1 --2- 172.21.15.146:0/4104087810 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55fecb642bb0 0x55fecb73d3d0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.259+0000 7f0338353640 1 -- 172.21.15.146:0/4104087810 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f033000a4a0 con 0x55fecb642bb0 2024-09-18T01:45:23.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.259+0000 7f033c836800 1 -- 172.21.15.146:0/4104087810 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fecb73a9a0 con 0x55fecb642bb0 2024-09-18T01:45:23.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.259+0000 7f0338353640 1 -- 172.21.15.146:0/4104087810 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f033000a4a0 con 0x55fecb642bb0 2024-09-18T01:45:23.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.259+0000 7f033c836800 1 -- 172.21.15.146:0/4104087810 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fecb73f7c0 con 0x55fecb642bb0 2024-09-18T01:45:23.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.259+0000 7f0338353640 1 -- 172.21.15.146:0/4104087810 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f033000a4a0 con 0x55fecb642bb0 2024-09-18T01:45:23.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.260+0000 7f033c836800 1 -- 172.21.15.146:0/4104087810 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fecb73e9f0 con 0x55fecb642bb0 2024-09-18T01:45:23.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.260+0000 7f0338353640 1 -- 172.21.15.146:0/4104087810 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f033000a4a0 con 0x55fecb642bb0 2024-09-18T01:45:23.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.260+0000 7f033c836800 1 --2- 172.21.15.146:0/4104087810 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55fecb740b70 0x55fecb742f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.260+0000 7f033c836800 1 -- 172.21.15.146:0/4104087810 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fecb7434a0 con 0x55fecb740b70 2024-09-18T01:45:23.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.260+0000 7f0337b52640 1 --2- 172.21.15.146:0/4104087810 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55fecb740b70 0x55fecb742f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.260+0000 7f0337b52640 1 --2- 172.21.15.146:0/4104087810 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55fecb740b70 0x55fecb742f60 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.260+0000 7f0337b52640 1 -- 172.21.15.146:0/4104087810 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f032807b070 con 0x55fecb740b70 2024-09-18T01:45:23.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.261+0000 7f033c836800 1 Processor -- start 2024-09-18T01:45:23.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.261+0000 7f033c836800 1 -- start start 2024-09-18T01:45:23.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.261+0000 7f033c836800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fecb751120 0x55fecb751540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.261+0000 7f033c836800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55fecb4d8580 con 0x55fecb751120 2024-09-18T01:45:23.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.261+0000 7f0338353640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fecb751120 0x55fecb751540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.261+0000 7f0338353640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fecb751120 0x55fecb751540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59582/0 (socket says 172.21.15.146:59582) 2024-09-18T01:45:23.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.261+0000 7f0338353640 1 -- 172.21.15.146:0/1985336710 learned_addr learned my addr 172.21.15.146:0/1985336710 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:23.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.262+0000 7f0338353640 1 -- 172.21.15.146:0/1985336710 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fecb751a80 con 0x55fecb751120 2024-09-18T01:45:23.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.262+0000 7f0338353640 1 --2- 172.21.15.146:0/1985336710 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fecb751120 0x55fecb751540 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x55fecb737580 tx=0x7f03300178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.262+0000 7f021d7fa640 1 -- 172.21.15.146:0/1985336710 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0330013440 con 0x55fecb751120 2024-09-18T01:45:23.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.262+0000 7f021d7fa640 1 -- 172.21.15.146:0/1985336710 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03300135e0 con 0x55fecb751120 2024-09-18T01:45:23.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.262+0000 7f033c836800 1 -- 172.21.15.146:0/1985336710 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fecb751d10 con 0x55fecb751120 2024-09-18T01:45:23.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.262+0000 7f021d7fa640 1 -- 172.21.15.146:0/1985336710 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03300138c0 con 0x55fecb751120 2024-09-18T01:45:23.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.262+0000 7f033c836800 1 -- 172.21.15.146:0/1985336710 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fecb7549f0 con 0x55fecb751120 2024-09-18T01:45:23.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.263+0000 7f021d7fa640 1 -- 172.21.15.146:0/1985336710 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0330011040 con 0x55fecb751120 2024-09-18T01:45:23.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.263+0000 7f021d7fa640 1 --2- 172.21.15.146:0/1985336710 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0210036b40 0x7f0210039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.263+0000 7f021d7fa640 1 -- 172.21.15.146:0/1985336710 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f033001d070 con 0x55fecb751120 2024-09-18T01:45:23.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.263+0000 7f0337b52640 1 --2- 172.21.15.146:0/1985336710 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0210036b40 0x7f0210039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.263+0000 7f033c836800 1 Processor -- start 2024-09-18T01:45:23.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.263+0000 7f0337b52640 1 --2- 172.21.15.146:0/1985336710 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0210036b40 0x7f0210039000 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x55fecb73f720 tx=0x7f0328008310 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.263+0000 7f033c836800 1 -- start start 2024-09-18T01:45:23.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.263+0000 7f033c836800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fecb75dde0 0x55fecb75e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.263+0000 7f033c836800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55fecb72f1a0 con 0x55fecb75dde0 2024-09-18T01:45:23.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.264+0000 7f0338353640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fecb75dde0 0x55fecb75e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.264+0000 7f0338353640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fecb75dde0 0x55fecb75e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59584/0 (socket says 172.21.15.146:59584) 2024-09-18T01:45:23.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.264+0000 7f0338353640 1 -- 172.21.15.146:0/1866429643 learned_addr learned my addr 172.21.15.146:0/1866429643 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:23.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.264+0000 7f0338353640 1 -- 172.21.15.146:0/1866429643 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fecb75e7b0 con 0x55fecb75dde0 2024-09-18T01:45:23.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.264+0000 7f0338353640 1 --2- 172.21.15.146:0/1866429643 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fecb75dde0 0x55fecb75e1e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f033004c8f0 tx=0x7f033004cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9c5c300e5f6ad09 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.264+0000 7f0216ffd640 1 -- 172.21.15.146:0/1866429643 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0330045070 con 0x55fecb75dde0 2024-09-18T01:45:23.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.264+0000 7f0216ffd640 1 -- 172.21.15.146:0/1866429643 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0330012cc0 con 0x55fecb75dde0 2024-09-18T01:45:23.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.264+0000 7f0216ffd640 1 -- 172.21.15.146:0/1866429643 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f033004b250 con 0x55fecb75dde0 2024-09-18T01:45:23.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.265+0000 7f033c836800 1 -- 172.21.15.146:0/1866429643 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fecb75dde0 msgr2=0x55fecb75e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.265+0000 7f033c836800 1 --2- 172.21.15.146:0/1866429643 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fecb75dde0 0x55fecb75e1e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f033004c8f0 tx=0x7f033004cbc0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.265+0000 7f033c836800 1 -- 172.21.15.146:0/1866429643 shutdown_connections 2024-09-18T01:45:23.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.265+0000 7f033c836800 1 --2- 172.21.15.146:0/1866429643 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fecb75dde0 0x55fecb75e1e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.265+0000 7f033c836800 1 -- 172.21.15.146:0/1866429643 >> 172.21.15.146:0/1866429643 conn(0x55fecb75a190 msgr2=0x55fecb758290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:23.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.265+0000 7f033c836800 1 -- 172.21.15.146:0/1866429643 shutdown_connections 2024-09-18T01:45:23.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.265+0000 7f033c836800 1 -- 172.21.15.146:0/1866429643 wait complete. 2024-09-18T01:45:23.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.265+0000 7f033c836800 1 Processor -- start 2024-09-18T01:45:23.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.265+0000 7f033c836800 1 -- start start 2024-09-18T01:45:23.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.265+0000 7f033c836800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fecb75dde0 0x55fecb765270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.265+0000 7f033c836800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55fecb75ed80 con 0x55fecb75dde0 2024-09-18T01:45:23.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.265+0000 7f0338353640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fecb75dde0 0x55fecb765270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.265+0000 7f0338353640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fecb75dde0 0x55fecb765270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59598/0 (socket says 172.21.15.146:59598) 2024-09-18T01:45:23.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.265+0000 7f0338353640 1 -- 172.21.15.146:0/3047914981 learned_addr learned my addr 172.21.15.146:0/3047914981 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:23.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.265+0000 7f0338353640 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fecb7657b0 con 0x55fecb75dde0 2024-09-18T01:45:23.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.266+0000 7f0338353640 1 --2- 172.21.15.146:0/3047914981 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fecb75dde0 0x55fecb765270 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0330043040 tx=0x7f033004c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.266+0000 7f02157fa640 1 -- 172.21.15.146:0/3047914981 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f033003a070 con 0x55fecb75dde0 2024-09-18T01:45:23.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.266+0000 7f02157fa640 1 -- 172.21.15.146:0/3047914981 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f033004e2a0 con 0x55fecb75dde0 2024-09-18T01:45:23.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.266+0000 7f033c836800 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fecb765a40 con 0x55fecb75dde0 2024-09-18T01:45:23.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.266+0000 7f02157fa640 1 -- 172.21.15.146:0/3047914981 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0330045040 con 0x55fecb75dde0 2024-09-18T01:45:23.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.266+0000 7f033c836800 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fecb7686f0 con 0x55fecb75dde0 2024-09-18T01:45:23.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.266+0000 7f02157fa640 1 -- 172.21.15.146:0/3047914981 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f033003d070 con 0x55fecb75dde0 2024-09-18T01:45:23.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.267+0000 7f02157fa640 1 --2- 172.21.15.146:0/3047914981 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0200036b40 0x7f0200039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.267+0000 7f02157fa640 1 -- 172.21.15.146:0/3047914981 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f0330032070 con 0x55fecb75dde0 2024-09-18T01:45:23.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.267+0000 7f0337b52640 1 --2- 172.21.15.146:0/3047914981 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0200036b40 0x7f0200039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.267+0000 7f033c836800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.267+0000 7f033c836800 1 --2- 172.21.15.146:0/3047914981 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55fecb770e40 0x55fecb773300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.267+0000 7f033c836800 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fecb773a50 con 0x55fecb770e40 2024-09-18T01:45:23.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.267+0000 7f0337351640 1 --2- 172.21.15.146:0/3047914981 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55fecb770e40 0x55fecb773300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.267+0000 7f0337b52640 1 --2- 172.21.15.146:0/3047914981 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0200036b40 0x7f0200039000 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f032800a010 tx=0x7f0328087000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.267+0000 7f0337351640 1 --2- 172.21.15.146:0/3047914981 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55fecb770e40 0x55fecb773300 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.268+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f032c009050 con 0x55fecb770e40 2024-09-18T01:45:23.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.268+0000 7f033c836800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.268+0000 7f033c836800 20 realm 2024-09-18T01:45:23.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.268+0000 7f033c836800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.268+0000 7f033c836800 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fecb770290 con 0x55fecb770e40 2024-09-18T01:45:23.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.268+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f032c009050 con 0x55fecb770e40 2024-09-18T01:45:23.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.268+0000 7f033c836800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.268+0000 7f033c836800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:23.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.268+0000 7f033c836800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.268+0000 7f033c836800 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fecb774530 con 0x55fecb770e40 2024-09-18T01:45:23.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.268+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f032c009050 con 0x55fecb770e40 2024-09-18T01:45:23.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.268+0000 7f033c836800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.268+0000 7f033c836800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.268+0000 7f033c836800 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fecb774e00 con 0x55fecb770e40 2024-09-18T01:45:23.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.268+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f032c009050 con 0x55fecb770e40 2024-09-18T01:45:23.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.268+0000 7f033c836800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:23.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.268+0000 7f033c836800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.268+0000 7f033c836800 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fecb7751a0 con 0x55fecb770e40 2024-09-18T01:45:23.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.269+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f032c009050 con 0x55fecb770e40 2024-09-18T01:45:23.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.269+0000 7f033c836800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:23.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.269+0000 7f033c836800 20 searching for the correct realm 2024-09-18T01:45:23.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.269+0000 7f033c836800 1 --2- 172.21.15.146:0/3047914981 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55fecb777080 0x55fecb779470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.269+0000 7f033c836800 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fecb779b20 con 0x55fecb777080 2024-09-18T01:45:23.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.269+0000 7f0338353640 1 --2- 172.21.15.146:0/3047914981 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55fecb777080 0x55fecb779470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.269+0000 7f0338353640 1 --2- 172.21.15.146:0/3047914981 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55fecb777080 0x55fecb779470 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.269+0000 7f0338353640 1 -- 172.21.15.146:0/3047914981 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f033003c030 con 0x55fecb777080 2024-09-18T01:45:23.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.269+0000 7f0338353640 1 --2- 172.21.15.146:0/3047914981 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f03300123a0 0x7f033004ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.269+0000 7f0338353640 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fecb779b20 con 0x7f03300123a0 2024-09-18T01:45:23.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.269+0000 7f0337b52640 1 --2- 172.21.15.146:0/3047914981 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f03300123a0 0x7f033004ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.270+0000 7f0337b52640 1 --2- 172.21.15.146:0/3047914981 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f03300123a0 0x7f033004ea00 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.270+0000 7f0337b52640 1 -- 172.21.15.146:0/3047914981 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f032807b070 con 0x7f03300123a0 2024-09-18T01:45:23.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.270+0000 7f0337b52640 1 --2- 172.21.15.146:0/3047914981 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f032805c070 0x7f0328090300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.270+0000 7f0337b52640 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fecb779b20 con 0x7f032805c070 2024-09-18T01:45:23.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.270+0000 7f0337351640 1 --2- 172.21.15.146:0/3047914981 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f032805c070 0x7f0328090300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.270+0000 7f0337351640 1 --2- 172.21.15.146:0/3047914981 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f032805c070 0x7f0328090300 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.271+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f032c009050 con 0x7f032805c070 2024-09-18T01:45:23.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.271+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fecb779b20 con 0x55fecb770e40 2024-09-18T01:45:23.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.271+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f032c009050 con 0x55fecb770e40 2024-09-18T01:45:23.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.271+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fecb779b20 con 0x55fecb770e40 2024-09-18T01:45:23.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.271+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f032c02a040 con 0x55fecb770e40 2024-09-18T01:45:23.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.271+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fecb779b20 con 0x7f032805c070 2024-09-18T01:45:23.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.271+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f032c02a040 con 0x7f032805c070 2024-09-18T01:45:23.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.271+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fecb779b20 con 0x7f032805c070 2024-09-18T01:45:23.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.271+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f032c02a040 con 0x7f032805c070 2024-09-18T01:45:23.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.271+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fecb779b20 con 0x7f03300123a0 2024-09-18T01:45:23.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.272+0000 7f0337b52640 1 -- 172.21.15.146:0/3047914981 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f032807b070 con 0x7f03300123a0 2024-09-18T01:45:23.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.272+0000 7f0337b52640 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fecb779b20 con 0x55fecb777080 2024-09-18T01:45:23.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.272+0000 7f0338353640 1 -- 172.21.15.146:0/3047914981 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f033003c030 con 0x55fecb777080 2024-09-18T01:45:23.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.272+0000 7f0338353640 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fecb779b20 con 0x55fecb770e40 2024-09-18T01:45:23.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.272+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f032c02a040 con 0x55fecb770e40 2024-09-18T01:45:23.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.272+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fecb779b20 con 0x7f032805c070 2024-09-18T01:45:23.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.272+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f032c02a040 con 0x7f032805c070 2024-09-18T01:45:23.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.272+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fecb779b20 con 0x55fecb770e40 2024-09-18T01:45:23.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.273+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f032c02a040 con 0x55fecb770e40 2024-09-18T01:45:23.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.273+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fecb779b20 con 0x7f03300123a0 2024-09-18T01:45:23.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.273+0000 7f0337b52640 1 -- 172.21.15.146:0/3047914981 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f032807b070 con 0x7f03300123a0 2024-09-18T01:45:23.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.273+0000 7f0337b52640 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fecb779b20 con 0x55fecb777080 2024-09-18T01:45:23.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.273+0000 7f0338353640 1 -- 172.21.15.146:0/3047914981 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f033003c030 con 0x55fecb777080 2024-09-18T01:45:23.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.273+0000 7f0338353640 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fecb779b20 con 0x55fecb777080 2024-09-18T01:45:23.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.273+0000 7f0338353640 1 -- 172.21.15.146:0/3047914981 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f033003c030 con 0x55fecb777080 2024-09-18T01:45:23.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.273+0000 7f0338353640 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fecb779b20 con 0x7f032805c070 2024-09-18T01:45:23.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.274+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f032c02a040 con 0x7f032805c070 2024-09-18T01:45:23.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.274+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fecb779b20 con 0x55fecb777080 2024-09-18T01:45:23.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.274+0000 7f0338353640 1 -- 172.21.15.146:0/3047914981 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f033003c030 con 0x55fecb777080 2024-09-18T01:45:23.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.274+0000 7f0338353640 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fecb779b20 con 0x55fecb777080 2024-09-18T01:45:23.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.274+0000 7f0338353640 1 -- 172.21.15.146:0/3047914981 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f033003c030 con 0x55fecb777080 2024-09-18T01:45:23.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.274+0000 7f0338353640 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fecb779b20 con 0x55fecb770e40 2024-09-18T01:45:23.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.274+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f032c02a040 con 0x55fecb770e40 2024-09-18T01:45:23.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.274+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fecb779b20 con 0x55fecb770e40 2024-09-18T01:45:23.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.275+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f032c02a040 con 0x55fecb770e40 2024-09-18T01:45:23.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.275+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fecb779b20 con 0x7f032805c070 2024-09-18T01:45:23.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.275+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f032c02a040 con 0x7f032805c070 2024-09-18T01:45:23.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.275+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fecb779b20 con 0x55fecb777080 2024-09-18T01:45:23.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.275+0000 7f0338353640 1 -- 172.21.15.146:0/3047914981 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f033003c030 con 0x55fecb777080 2024-09-18T01:45:23.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.275+0000 7f0338353640 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fecb779b20 con 0x7f03300123a0 2024-09-18T01:45:23.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.275+0000 7f0337b52640 1 -- 172.21.15.146:0/3047914981 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f032807b070 con 0x7f03300123a0 2024-09-18T01:45:23.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.275+0000 7f0337b52640 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fecb779b20 con 0x55fecb770e40 2024-09-18T01:45:23.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.275+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f032c02a040 con 0x55fecb770e40 2024-09-18T01:45:23.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.276+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fecb779b20 con 0x7f032805c070 2024-09-18T01:45:23.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.276+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f032c02a040 con 0x7f032805c070 2024-09-18T01:45:23.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.276+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fecb779b20 con 0x55fecb777080 2024-09-18T01:45:23.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.276+0000 7f0338353640 1 -- 172.21.15.146:0/3047914981 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f033003c030 con 0x55fecb777080 2024-09-18T01:45:23.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.276+0000 7f0338353640 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fecb779b20 con 0x7f032805c070 2024-09-18T01:45:23.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.276+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f032c02a040 con 0x7f032805c070 2024-09-18T01:45:23.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.276+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fecb779b20 con 0x7f03300123a0 2024-09-18T01:45:23.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.276+0000 7f0337b52640 1 -- 172.21.15.146:0/3047914981 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f032807b070 con 0x7f03300123a0 2024-09-18T01:45:23.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.276+0000 7f0337b52640 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fecb779b20 con 0x55fecb777080 2024-09-18T01:45:23.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.277+0000 7f0338353640 1 -- 172.21.15.146:0/3047914981 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f033003c030 con 0x55fecb777080 2024-09-18T01:45:23.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.277+0000 7f0338353640 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fecb779b20 con 0x7f032805c070 2024-09-18T01:45:23.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.277+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f032c02a040 con 0x7f032805c070 2024-09-18T01:45:23.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.277+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fecb779b20 con 0x55fecb770e40 2024-09-18T01:45:23.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.277+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f032c02a040 con 0x55fecb770e40 2024-09-18T01:45:23.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.277+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fecb779b20 con 0x7f03300123a0 2024-09-18T01:45:23.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.277+0000 7f0337b52640 1 -- 172.21.15.146:0/3047914981 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03280af040 con 0x7f03300123a0 2024-09-18T01:45:23.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.277+0000 7f033c836800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:23.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.277+0000 7f033c836800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:23.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.277+0000 7f033c836800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:23.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.277+0000 7f033c836800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:23.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.277+0000 7f033c836800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:23.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.277+0000 7f033c836800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:23.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.277+0000 7f033c836800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.277+0000 7f033c836800 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fecb775b50 con 0x55fecb770e40 2024-09-18T01:45:23.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.278+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f032c02a040 con 0x55fecb770e40 2024-09-18T01:45:23.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.278+0000 7f033c836800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.278+0000 7f033c836800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.278+0000 7f033c836800 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fecb7763f0 con 0x55fecb770e40 2024-09-18T01:45:23.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.278+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f032c02a040 con 0x55fecb770e40 2024-09-18T01:45:23.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.278+0000 7f033c836800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:23.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.278+0000 7f033c836800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.278+0000 7f033c836800 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fecb775790 con 0x7f03300123a0 2024-09-18T01:45:23.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.278+0000 7f0337b52640 1 -- 172.21.15.146:0/3047914981 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f03280af040 con 0x7f03300123a0 2024-09-18T01:45:23.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.278+0000 7f033c836800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:23.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.278+0000 7f033c836800 20 zone default found 2024-09-18T01:45:23.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.278+0000 7f033c836800 4 Realm: () 2024-09-18T01:45:23.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.278+0000 7f033c836800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:23.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.278+0000 7f033c836800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:23.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.278+0000 7f033c836800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:23.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.278+0000 7f033c836800 20 zonegroup default 2024-09-18T01:45:23.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.278+0000 7f033c836800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.278+0000 7f033c836800 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fecb77a430 con 0x7f032805c070 2024-09-18T01:45:23.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.278+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f032c02a040 con 0x7f032805c070 2024-09-18T01:45:23.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.278+0000 7f033c836800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.278+0000 7f033c836800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.278+0000 7f033c836800 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fecb77bf90 con 0x55fecb777080 2024-09-18T01:45:23.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.279+0000 7f0338353640 1 -- 172.21.15.146:0/3047914981 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f033003c030 con 0x55fecb777080 2024-09-18T01:45:23.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.279+0000 7f033c836800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.279+0000 7f033c836800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.279+0000 7f033c836800 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fecb77c450 con 0x55fecb777080 2024-09-18T01:45:23.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.279+0000 7f0338353640 1 -- 172.21.15.146:0/3047914981 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f033003c030 con 0x55fecb777080 2024-09-18T01:45:23.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.279+0000 7f033c836800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.279+0000 7f033c836800 20 started sync module instance, tier type = 2024-09-18T01:45:23.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.279+0000 7f033c836800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:23.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.279+0000 7f033c836800 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fecb77ae90 con 0x7f03300123a0 2024-09-18T01:45:23.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.280+0000 7f0337b52640 1 -- 172.21.15.146:0/3047914981 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v31'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03280af040 con 0x7f03300123a0 2024-09-18T01:45:23.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.280+0000 7f033c836800 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94552823673520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fecb77cd60 con 0x7f03300123a0 2024-09-18T01:45:23.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.280+0000 7f033c836800 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fecb77d5b0 con 0x55fecb770e40 2024-09-18T01:45:23.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.281+0000 7f0337b52640 1 -- 172.21.15.146:0/3047914981 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94552823673520] v31'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03280af040 con 0x7f03300123a0 2024-09-18T01:45:23.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.281+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v31'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f032c02a040 con 0x55fecb770e40 2024-09-18T01:45:23.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.281+0000 7f033c836800 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94552823679152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fecb77d610 con 0x55fecb770e40 2024-09-18T01:45:23.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.281+0000 7f033c836800 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fecb77e120 con 0x55fecb777080 2024-09-18T01:45:23.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.282+0000 7f0338353640 1 -- 172.21.15.146:0/3047914981 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v31'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f033003c030 con 0x55fecb777080 2024-09-18T01:45:23.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.282+0000 7f033c836800 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94552823684048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fecb77e120 con 0x55fecb777080 2024-09-18T01:45:23.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.282+0000 7f033c836800 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fecb77f120 con 0x7f03300123a0 2024-09-18T01:45:23.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.282+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94552823679152] v31'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f032c02a040 con 0x55fecb770e40 2024-09-18T01:45:23.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.283+0000 7f0338353640 1 -- 172.21.15.146:0/3047914981 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94552823684048] v31'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f033003c030 con 0x55fecb777080 2024-09-18T01:45:23.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.283+0000 7f0337b52640 1 -- 172.21.15.146:0/3047914981 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v31'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03280af040 con 0x7f03300123a0 2024-09-18T01:45:23.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.283+0000 7f033c836800 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94552823688208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fecb77e510 con 0x7f03300123a0 2024-09-18T01:45:23.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.283+0000 7f033c836800 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fecb77fb30 con 0x55fecb770e40 2024-09-18T01:45:23.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.284+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v31'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f032c02a040 con 0x55fecb770e40 2024-09-18T01:45:23.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.284+0000 7f033c836800 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94552823690880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fecb77ff50 con 0x55fecb770e40 2024-09-18T01:45:23.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.284+0000 7f033c836800 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fecb780a40 con 0x7f032805c070 2024-09-18T01:45:23.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.285+0000 7f0337b52640 1 -- 172.21.15.146:0/3047914981 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94552823688208] v31'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03280af040 con 0x7f03300123a0 2024-09-18T01:45:23.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.285+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94552823690880] v31'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f032c02a040 con 0x55fecb770e40 2024-09-18T01:45:23.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.286+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v31'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f032c02a040 con 0x7f032805c070 2024-09-18T01:45:23.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.286+0000 7f033c836800 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94552823694608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fecb77faa0 con 0x7f032805c070 2024-09-18T01:45:23.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.286+0000 7f033c836800 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fecb7812e0 con 0x7f032805c070 2024-09-18T01:45:23.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.287+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94552823694608] v31'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f032c02a040 con 0x7f032805c070 2024-09-18T01:45:23.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.288+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v31'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f032c02a040 con 0x7f032805c070 2024-09-18T01:45:23.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.288+0000 7f033c836800 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94552823681280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fecb77faa0 con 0x7f032805c070 2024-09-18T01:45:23.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.288+0000 7f033c836800 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fecb781890 con 0x7f032805c070 2024-09-18T01:45:23.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.289+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(58 notify.7 [create] v31'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f032c02a040 con 0x7f032805c070 2024-09-18T01:45:23.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.289+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94552823681280] v31'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f032c02a040 con 0x7f032805c070 2024-09-18T01:45:23.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.289+0000 7f033c836800 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94552823698288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fecb781890 con 0x7f032805c070 2024-09-18T01:45:23.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.289+0000 7f033c836800 20 add_watcher() i=0 2024-09-18T01:45:23.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.289+0000 7f033c836800 20 add_watcher() i=1 2024-09-18T01:45:23.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.289+0000 7f033c836800 20 add_watcher() i=2 2024-09-18T01:45:23.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.289+0000 7f033c836800 20 add_watcher() i=3 2024-09-18T01:45:23.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.289+0000 7f033c836800 20 add_watcher() i=4 2024-09-18T01:45:23.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.289+0000 7f033c836800 20 add_watcher() i=5 2024-09-18T01:45:23.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.289+0000 7f033c836800 20 add_watcher() i=6 2024-09-18T01:45:23.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.289+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94552823698288] v31'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f032c02a040 con 0x7f032805c070 2024-09-18T01:45:23.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.289+0000 7f033c836800 20 add_watcher() i=7 2024-09-18T01:45:23.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.289+0000 7f033c836800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:23.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.290+0000 7f033c836800 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fecb784cf0 con 0x55fecb770e40 2024-09-18T01:45:23.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.290+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f032c02a040 con 0x55fecb770e40 2024-09-18T01:45:23.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.290+0000 7f033c836800 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94552823696672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fecb782210 con 0x55fecb770e40 2024-09-18T01:45:23.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.291+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94552823696672] v31'60 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f032c02a040 con 0x55fecb770e40 2024-09-18T01:45:23.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.291+0000 7f01edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:23.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.291+0000 7f033c836800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:23.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.291+0000 7f033c836800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:23.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.291+0000 7f033c836800 5 note: GC not initialized 2024-09-18T01:45:23.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.291+0000 7f01ecfe1640 20 reqs_thread_entry: start 2024-09-18T01:45:23.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.291+0000 7f033c836800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:23.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.291+0000 7f033c836800 20 Filter name: none 2024-09-18T01:45:23.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.291+0000 7f01667fc640 20 reqs_thread_entry: start 2024-09-18T01:45:23.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.292+0000 7f033c836800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.292+0000 7f033c836800 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fecb7b7cd0 con 0x55fecb770e40 2024-09-18T01:45:23.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.292+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f032c02a040 con 0x55fecb770e40 2024-09-18T01:45:23.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.292+0000 7f033c836800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:45:23.302 INFO:teuthology.orchestra.run.smithi146.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T01:45:23.010714Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:45:23.010705Z","tags":[],"group_ids":[]} 2024-09-18T01:45:23.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.293+0000 7f01edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:23.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.293+0000 7f033c836800 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94552823696672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fecb784650 con 0x55fecb770e40 2024-09-18T01:45:23.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.294+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94552823696672] v31'61 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f032c02a040 con 0x55fecb770e40 2024-09-18T01:45:23.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.294+0000 7f033c836800 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94552823673520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fecb7841a0 con 0x7f03300123a0 2024-09-18T01:45:23.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.295+0000 7f0337b52640 1 -- 172.21.15.146:0/3047914981 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94552823673520] v31'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03280af040 con 0x7f03300123a0 2024-09-18T01:45:23.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.295+0000 7f033c836800 20 remove_watcher() i=0 2024-09-18T01:45:23.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.295+0000 7f033c836800 2 removed watcher, disabling cache 2024-09-18T01:45:23.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.295+0000 7f033c836800 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94552823679152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fecb77b2b0 con 0x55fecb770e40 2024-09-18T01:45:23.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.296+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94552823679152] v31'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f032c02a040 con 0x55fecb770e40 2024-09-18T01:45:23.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.296+0000 7f033c836800 20 remove_watcher() i=1 2024-09-18T01:45:23.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.296+0000 7f033c836800 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94552823684048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fecb77b2b0 con 0x55fecb777080 2024-09-18T01:45:23.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.297+0000 7f0338353640 1 -- 172.21.15.146:0/3047914981 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94552823684048] v31'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f033003c030 con 0x55fecb777080 2024-09-18T01:45:23.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.297+0000 7f033c836800 20 remove_watcher() i=2 2024-09-18T01:45:23.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.297+0000 7f033c836800 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94552823688208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fecb77b2b0 con 0x7f03300123a0 2024-09-18T01:45:23.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.298+0000 7f0337b52640 1 -- 172.21.15.146:0/3047914981 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94552823688208] v31'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03280af040 con 0x7f03300123a0 2024-09-18T01:45:23.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.298+0000 7f033c836800 20 remove_watcher() i=3 2024-09-18T01:45:23.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.298+0000 7f033c836800 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94552823690880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fecb77b2b0 con 0x55fecb770e40 2024-09-18T01:45:23.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.299+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94552823690880] v31'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f032c02a040 con 0x55fecb770e40 2024-09-18T01:45:23.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.299+0000 7f033c836800 20 remove_watcher() i=4 2024-09-18T01:45:23.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.299+0000 7f033c836800 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94552823694608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fecb77f680 con 0x7f032805c070 2024-09-18T01:45:23.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.300+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94552823694608] v31'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f032c02a040 con 0x7f032805c070 2024-09-18T01:45:23.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.300+0000 7f033c836800 20 remove_watcher() i=5 2024-09-18T01:45:23.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.300+0000 7f033c836800 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94552823681280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fecb77b2b0 con 0x7f032805c070 2024-09-18T01:45:23.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.301+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94552823681280] v31'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f032c02a040 con 0x7f032805c070 2024-09-18T01:45:23.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.301+0000 7f033c836800 20 remove_watcher() i=6 2024-09-18T01:45:23.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.301+0000 7f033c836800 1 -- 172.21.15.146:0/3047914981 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94552823698288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fecb77f680 con 0x7f032805c070 2024-09-18T01:45:23.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.302+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94552823698288] v31'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f032c02a040 con 0x7f032805c070 2024-09-18T01:45:23.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.302+0000 7f033c836800 20 remove_watcher() i=7 2024-09-18T01:45:23.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.302+0000 7f033c836800 1 -- 172.21.15.146:0/3047914981 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f032805c070 msgr2=0x7f0328090300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.302+0000 7f033c836800 1 --2- 172.21.15.146:0/3047914981 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f032805c070 0x7f0328090300 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.302+0000 7f033c836800 1 -- 172.21.15.146:0/3047914981 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55fecb770e40 msgr2=0x55fecb773300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.302+0000 7f033c836800 1 --2- 172.21.15.146:0/3047914981 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55fecb770e40 0x55fecb773300 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.302+0000 7f033c836800 1 -- 172.21.15.146:0/3047914981 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f03300123a0 msgr2=0x7f033004ea00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.302+0000 7f033c836800 1 --2- 172.21.15.146:0/3047914981 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f03300123a0 0x7f033004ea00 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.302+0000 7f033c836800 1 -- 172.21.15.146:0/3047914981 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55fecb777080 msgr2=0x55fecb779470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.302+0000 7f033c836800 1 --2- 172.21.15.146:0/3047914981 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55fecb777080 0x55fecb779470 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.302+0000 7f033c836800 1 -- 172.21.15.146:0/3047914981 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0200036b40 msgr2=0x7f0200039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.302+0000 7f033c836800 1 --2- 172.21.15.146:0/3047914981 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0200036b40 0x7f0200039000 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f032800a010 tx=0x7f0328087000 comp rx=0 tx=0).stop 2024-09-18T01:45:23.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.302+0000 7f033c836800 1 -- 172.21.15.146:0/3047914981 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fecb75dde0 msgr2=0x55fecb765270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.302+0000 7f0337351640 1 -- 172.21.15.146:0/3047914981 reap_dead start 2024-09-18T01:45:23.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.302+0000 7f033c836800 1 --2- 172.21.15.146:0/3047914981 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fecb75dde0 0x55fecb765270 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0330043040 tx=0x7f033004c880 comp rx=0 tx=0).stop 2024-09-18T01:45:23.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.302+0000 7f033c836800 1 -- 172.21.15.146:0/3047914981 shutdown_connections 2024-09-18T01:45:23.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.302+0000 7f033c836800 1 --2- 172.21.15.146:0/3047914981 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fecb75dde0 0x55fecb765270 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.302+0000 7f033c836800 1 -- 172.21.15.146:0/3047914981 >> 172.21.15.146:0/3047914981 conn(0x55fecb75a190 msgr2=0x55fecb75f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:23.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.302+0000 7f033c836800 1 -- 172.21.15.146:0/3047914981 shutdown_connections 2024-09-18T01:45:23.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.302+0000 7f033c836800 1 -- 172.21.15.146:0/3047914981 wait complete. 2024-09-18T01:45:23.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.303+0000 7f033c836800 1 -- 172.21.15.146:0/1985336710 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0210036b40 msgr2=0x7f0210039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.303+0000 7f033c836800 1 --2- 172.21.15.146:0/1985336710 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0210036b40 0x7f0210039000 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x55fecb73f720 tx=0x7f0328008310 comp rx=0 tx=0).stop 2024-09-18T01:45:23.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.303+0000 7f033c836800 1 -- 172.21.15.146:0/1985336710 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fecb751120 msgr2=0x55fecb751540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.303+0000 7f033c836800 1 --2- 172.21.15.146:0/1985336710 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fecb751120 0x55fecb751540 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x55fecb737580 tx=0x7f03300178e0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.303+0000 7f033c836800 1 -- 172.21.15.146:0/1985336710 shutdown_connections 2024-09-18T01:45:23.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.303+0000 7f033c836800 1 --2- 172.21.15.146:0/1985336710 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0210036b40 0x7f0210039000 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.303+0000 7f033c836800 1 --2- 172.21.15.146:0/1985336710 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fecb751120 0x55fecb751540 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.303+0000 7f033c836800 1 -- 172.21.15.146:0/1985336710 >> 172.21.15.146:0/1985336710 conn(0x55fecb7460b0 msgr2=0x55fecb748c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:23.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.303+0000 7f033c836800 1 -- 172.21.15.146:0/1985336710 shutdown_connections 2024-09-18T01:45:23.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.303+0000 7f033c836800 1 -- 172.21.15.146:0/1985336710 wait complete. 2024-09-18T01:45:23.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.303+0000 7f033c836800 1 -- 172.21.15.146:0/4104087810 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55fecb642bb0 msgr2=0x55fecb73d3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.303+0000 7f033c836800 1 --2- 172.21.15.146:0/4104087810 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55fecb642bb0 0x55fecb73d3d0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.303+0000 7f033c836800 1 -- 172.21.15.146:0/4104087810 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55fecb740b70 msgr2=0x55fecb742f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.303+0000 7f033c836800 1 --2- 172.21.15.146:0/4104087810 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55fecb740b70 0x55fecb742f60 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.303+0000 7f033c836800 1 -- 172.21.15.146:0/4104087810 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0220036b40 msgr2=0x7f0220039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.303+0000 7f033c836800 1 --2- 172.21.15.146:0/4104087810 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0220036b40 0x7f0220039000 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f032c000f60 tx=0x7f032c0012b0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.303+0000 7f033c836800 1 -- 172.21.15.146:0/4104087810 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fecb5b1610 msgr2=0x55fecb736360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.303+0000 7f033c836800 1 --2- 172.21.15.146:0/4104087810 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fecb5b1610 0x55fecb736360 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f032800a330 tx=0x7f0328002fb0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.303+0000 7f033c836800 1 -- 172.21.15.146:0/4104087810 shutdown_connections 2024-09-18T01:45:23.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.303+0000 7f033c836800 1 --2- 172.21.15.146:0/4104087810 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55fecb740b70 0x55fecb742f60 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.303+0000 7f033c836800 1 --2- 172.21.15.146:0/4104087810 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55fecb642bb0 0x55fecb73d3d0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.303+0000 7f033c836800 1 --2- 172.21.15.146:0/4104087810 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0220036b40 0x7f0220039000 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.303+0000 7f033c836800 1 --2- 172.21.15.146:0/4104087810 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fecb5b1610 0x55fecb736360 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.303+0000 7f033c836800 1 -- 172.21.15.146:0/4104087810 >> 172.21.15.146:0/4104087810 conn(0x55fecb637de0 msgr2=0x55fecb728c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:23.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.303+0000 7f033c836800 1 -- 172.21.15.146:0/4104087810 shutdown_connections 2024-09-18T01:45:23.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.303+0000 7f033c836800 1 -- 172.21.15.146:0/4104087810 wait complete. 2024-09-18T01:45:23.314 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T01:45:23.010714Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:45:23.010705Z', 'tags': [], 'group_ids': []} 2024-09-18T01:45:23.314 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-18T01:45:23.314 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-18T01:45:23.314 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-18T01:45:23.358 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:23.359 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:23.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.359+0000 7f99d620e800 1 Processor -- start 2024-09-18T01:45:23.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.359+0000 7f99d620e800 1 -- start start 2024-09-18T01:45:23.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.359+0000 7f99d620e800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x5647329aea50 0x5647329aee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.359+0000 7f99d620e800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56473286fb30 con 0x5647329af390 2024-09-18T01:45:23.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.359+0000 7f99d620e800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x564732851360 con 0x5647329aea50 2024-09-18T01:45:23.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.359+0000 7f99d1975640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x5647329aea50 0x5647329aee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.359+0000 7f99d1975640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x5647329aea50 0x5647329aee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59606/0 (socket says 172.21.15.146:59606) 2024-09-18T01:45:23.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.359+0000 7f99d1975640 1 -- 172.21.15.146:0/3905194181 learned_addr learned my addr 172.21.15.146:0/3905194181 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:23.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.359+0000 7f99d1174640 1 --1- 172.21.15.146:0/3905194181 >> v1:172.21.15.129:6789/0 conn(0x5647329af390 0x5647329b7ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:38720/0 (socket says 172.21.15.146:38720) 2024-09-18T01:45:23.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.359+0000 7f99d1975640 1 -- 172.21.15.146:0/3905194181 >> v1:172.21.15.129:6789/0 conn(0x5647329af390 legacy=0x5647329b7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.359+0000 7f99d1975640 1 -- 172.21.15.146:0/3905194181 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564732877e00 con 0x5647329aea50 2024-09-18T01:45:23.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.361+0000 7f99d1975640 1 --2- 172.21.15.146:0/3905194181 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5647329aea50 0x5647329aee50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f99c400a520 tx=0x7f99c4045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1179bfceda58b26a server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.361+0000 7f99d0973640 1 -- 172.21.15.146:0/3905194181 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99c4055070 con 0x5647329aea50 2024-09-18T01:45:23.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.361+0000 7f99d0973640 1 -- 172.21.15.146:0/3905194181 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99c40515b0 con 0x5647329aea50 2024-09-18T01:45:23.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.361+0000 7f99d0973640 1 -- 172.21.15.146:0/3905194181 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99c40518d0 con 0x5647329aea50 2024-09-18T01:45:23.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.362+0000 7f99d620e800 1 -- 172.21.15.146:0/3905194181 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5647329aea50 msgr2=0x5647329aee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.362+0000 7f99d620e800 1 --2- 172.21.15.146:0/3905194181 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5647329aea50 0x5647329aee50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f99c400a520 tx=0x7f99c4045ba0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.362+0000 7f99d620e800 1 -- 172.21.15.146:0/3905194181 shutdown_connections 2024-09-18T01:45:23.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.362+0000 7f99d620e800 1 --2- 172.21.15.146:0/3905194181 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5647329aea50 0x5647329aee50 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.362+0000 7f99d620e800 1 -- 172.21.15.146:0/3905194181 >> 172.21.15.146:0/3905194181 conn(0x5647329aa5c0 msgr2=0x5647329ac9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:23.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.362+0000 7f99d620e800 1 -- 172.21.15.146:0/3905194181 shutdown_connections 2024-09-18T01:45:23.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.362+0000 7f99d620e800 1 -- 172.21.15.146:0/3905194181 wait complete. 2024-09-18T01:45:23.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.376+0000 7f99d620e800 1 Processor -- start 2024-09-18T01:45:23.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.376+0000 7f99d620e800 1 -- start start 2024-09-18T01:45:23.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.376+0000 7f99d620e800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5647329aea50 0x564732aa1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.376+0000 7f99d620e800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5647328fc330 con 0x5647329aea50 2024-09-18T01:45:23.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.376+0000 7f99d1975640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5647329aea50 0x564732aa1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.376+0000 7f99d1975640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5647329aea50 0x564732aa1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59614/0 (socket says 172.21.15.146:59614) 2024-09-18T01:45:23.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.376+0000 7f99d1975640 1 -- 172.21.15.146:0/74290207 learned_addr learned my addr 172.21.15.146:0/74290207 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:23.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.377+0000 7f99d1975640 1 -- 172.21.15.146:0/74290207 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564732849bc0 con 0x5647329aea50 2024-09-18T01:45:23.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.377+0000 7f99d1975640 1 --2- 172.21.15.146:0/74290207 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5647329aea50 0x564732aa1a70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f99c4025da0 tx=0x7f99c4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9251ea4a3695415 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.377+0000 7f98bfe07640 1 -- 172.21.15.146:0/74290207 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99c4051890 con 0x5647329aea50 2024-09-18T01:45:23.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.377+0000 7f98bfe07640 1 -- 172.21.15.146:0/74290207 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99c4051ac0 con 0x5647329aea50 2024-09-18T01:45:23.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.377+0000 7f98bfe07640 1 -- 172.21.15.146:0/74290207 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99c4051da0 con 0x5647329aea50 2024-09-18T01:45:23.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.378+0000 7f99d620e800 1 -- 172.21.15.146:0/74290207 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5647329aea50 msgr2=0x564732aa1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.378+0000 7f99d620e800 1 --2- 172.21.15.146:0/74290207 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5647329aea50 0x564732aa1a70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f99c4025da0 tx=0x7f99c4051000 comp rx=0 tx=0).stop 2024-09-18T01:45:23.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.378+0000 7f99d620e800 1 -- 172.21.15.146:0/74290207 shutdown_connections 2024-09-18T01:45:23.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.378+0000 7f99d620e800 1 --2- 172.21.15.146:0/74290207 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5647329aea50 0x564732aa1a70 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.378+0000 7f99d620e800 1 -- 172.21.15.146:0/74290207 >> 172.21.15.146:0/74290207 conn(0x5647329aa5c0 msgr2=0x564732a9d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:23.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.378+0000 7f99d620e800 1 -- 172.21.15.146:0/74290207 shutdown_connections 2024-09-18T01:45:23.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.378+0000 7f99d620e800 1 -- 172.21.15.146:0/74290207 wait complete. 2024-09-18T01:45:23.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.378+0000 7f99d620e800 1 Processor -- start 2024-09-18T01:45:23.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.378+0000 7f99d620e800 1 -- start start 2024-09-18T01:45:23.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.378+0000 7f99d620e800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5647329aea50 0x564732aa9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.378+0000 7f99d620e800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5647329b9910 con 0x5647329aea50 2024-09-18T01:45:23.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.378+0000 7f99d1975640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5647329aea50 0x564732aa9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.379+0000 7f99d1975640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5647329aea50 0x564732aa9330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59616/0 (socket says 172.21.15.146:59616) 2024-09-18T01:45:23.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.379+0000 7f99d1975640 1 -- 172.21.15.146:0/87113527 learned_addr learned my addr 172.21.15.146:0/87113527 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:23.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.379+0000 7f99d1975640 1 -- 172.21.15.146:0/87113527 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56473285dfe0 con 0x5647329aea50 2024-09-18T01:45:23.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.379+0000 7f99d1975640 1 --2- 172.21.15.146:0/87113527 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5647329aea50 0x564732aa9330 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f99c4067040 tx=0x7f99c4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.379+0000 7f98be604640 1 -- 172.21.15.146:0/87113527 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99c4073070 con 0x5647329aea50 2024-09-18T01:45:23.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.379+0000 7f98be604640 1 -- 172.21.15.146:0/87113527 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99c405a580 con 0x5647329aea50 2024-09-18T01:45:23.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.379+0000 7f99d620e800 1 -- 172.21.15.146:0/87113527 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564732aa9870 con 0x5647329aea50 2024-09-18T01:45:23.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.379+0000 7f98be604640 1 -- 172.21.15.146:0/87113527 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99c405a860 con 0x5647329aea50 2024-09-18T01:45:23.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.379+0000 7f99d620e800 1 -- 172.21.15.146:0/87113527 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564732aa9df0 con 0x5647329aea50 2024-09-18T01:45:23.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.380+0000 7f98be604640 1 -- 172.21.15.146:0/87113527 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f99c4076070 con 0x5647329aea50 2024-09-18T01:45:23.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.380+0000 7f98be604640 1 --2- 172.21.15.146:0/87113527 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f98b8036b40 0x7f98b8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.380+0000 7f98be604640 1 -- 172.21.15.146:0/87113527 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f99c4062070 con 0x5647329aea50 2024-09-18T01:45:23.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.380+0000 7f99d1174640 1 --2- 172.21.15.146:0/87113527 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f98b8036b40 0x7f98b8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.380+0000 7f99d620e800 1 --2- 172.21.15.146:0/87113527 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5647329af390 0x564732ab03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.380+0000 7f99d620e800 1 -- 172.21.15.146:0/87113527 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564732ab09f0 con 0x5647329af390 2024-09-18T01:45:23.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.381+0000 7f99d2176640 1 --2- 172.21.15.146:0/87113527 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5647329af390 0x564732ab03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.381+0000 7f99d1174640 1 --2- 172.21.15.146:0/87113527 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f98b8036b40 0x7f98b8039000 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f99c8000f60 tx=0x7f99c8001370 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.381+0000 7f99d2176640 1 --2- 172.21.15.146:0/87113527 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5647329af390 0x564732ab03a0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.381+0000 7f99d2176640 1 -- 172.21.15.146:0/87113527 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f99cc00a4a0 con 0x5647329af390 2024-09-18T01:45:23.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.381+0000 7f99d620e800 1 -- 172.21.15.146:0/87113527 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564732aad970 con 0x5647329af390 2024-09-18T01:45:23.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.381+0000 7f99d2176640 1 -- 172.21.15.146:0/87113527 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f99cc00a4a0 con 0x5647329af390 2024-09-18T01:45:23.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.381+0000 7f99d620e800 1 -- 172.21.15.146:0/87113527 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564732ab2810 con 0x5647329af390 2024-09-18T01:45:23.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.382+0000 7f99d2176640 1 -- 172.21.15.146:0/87113527 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f99cc00a4a0 con 0x5647329af390 2024-09-18T01:45:23.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.382+0000 7f99d620e800 1 -- 172.21.15.146:0/87113527 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564732ab1950 con 0x5647329af390 2024-09-18T01:45:23.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.382+0000 7f99d2176640 1 -- 172.21.15.146:0/87113527 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f99cc00a4a0 con 0x5647329af390 2024-09-18T01:45:23.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.382+0000 7f99d620e800 1 --2- 172.21.15.146:0/87113527 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x564732ab2420 0x564732ab5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.382+0000 7f99d620e800 1 -- 172.21.15.146:0/87113527 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564732ab63f0 con 0x564732ab2420 2024-09-18T01:45:23.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.382+0000 7f99d1975640 1 --2- 172.21.15.146:0/87113527 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x564732ab2420 0x564732ab5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.382+0000 7f99d1975640 1 --2- 172.21.15.146:0/87113527 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x564732ab2420 0x564732ab5c60 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.383+0000 7f99d1975640 1 -- 172.21.15.146:0/87113527 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f99c407f070 con 0x564732ab2420 2024-09-18T01:45:23.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.383+0000 7f99d620e800 1 Processor -- start 2024-09-18T01:45:23.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.383+0000 7f99d620e800 1 -- start start 2024-09-18T01:45:23.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.383+0000 7f99d620e800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564732ac4180 0x564732ac45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.383+0000 7f99d620e800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x56473284b580 con 0x564732ac4180 2024-09-18T01:45:23.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.383+0000 7f99d2176640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564732ac4180 0x564732ac45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.383+0000 7f99d2176640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564732ac4180 0x564732ac45a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59618/0 (socket says 172.21.15.146:59618) 2024-09-18T01:45:23.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.383+0000 7f99d2176640 1 -- 172.21.15.146:0/2271836304 learned_addr learned my addr 172.21.15.146:0/2271836304 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:23.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.384+0000 7f99d2176640 1 -- 172.21.15.146:0/2271836304 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564732ac4ae0 con 0x564732ac4180 2024-09-18T01:45:23.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.384+0000 7f99d2176640 1 --2- 172.21.15.146:0/2271836304 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564732ac4180 0x564732ac45a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x564732ab0dd0 tx=0x7f99cc0178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.384+0000 7f98b77fe640 1 -- 172.21.15.146:0/2271836304 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99cc013440 con 0x564732ac4180 2024-09-18T01:45:23.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.384+0000 7f98b77fe640 1 -- 172.21.15.146:0/2271836304 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99cc0135e0 con 0x564732ac4180 2024-09-18T01:45:23.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.384+0000 7f99d620e800 1 -- 172.21.15.146:0/2271836304 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564732ac4d70 con 0x564732ac4180 2024-09-18T01:45:23.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.384+0000 7f98b77fe640 1 -- 172.21.15.146:0/2271836304 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99cc0138c0 con 0x564732ac4180 2024-09-18T01:45:23.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.384+0000 7f99d620e800 1 -- 172.21.15.146:0/2271836304 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564732ac7a50 con 0x564732ac4180 2024-09-18T01:45:23.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.385+0000 7f98b77fe640 1 -- 172.21.15.146:0/2271836304 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f99cc011040 con 0x564732ac4180 2024-09-18T01:45:23.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.385+0000 7f98b77fe640 1 --2- 172.21.15.146:0/2271836304 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f98ac036b40 0x7f98ac039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.385+0000 7f98b77fe640 1 -- 172.21.15.146:0/2271836304 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f99cc01d070 con 0x564732ac4180 2024-09-18T01:45:23.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.385+0000 7f99d1975640 1 --2- 172.21.15.146:0/2271836304 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f98ac036b40 0x7f98ac039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.385+0000 7f99d620e800 1 Processor -- start 2024-09-18T01:45:23.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.385+0000 7f99d620e800 1 -- start start 2024-09-18T01:45:23.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.385+0000 7f99d1975640 1 --2- 172.21.15.146:0/2271836304 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f98ac036b40 0x7f98ac039000 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f99c408f2b0 tx=0x7f99c408f3f0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.385+0000 7f99d620e800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564732ad0e00 0x564732ad1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.385+0000 7f99d620e800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x564732aa2160 con 0x564732ad0e00 2024-09-18T01:45:23.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.386+0000 7f99d2176640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564732ad0e00 0x564732ad1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.386+0000 7f99d2176640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564732ad0e00 0x564732ad1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59626/0 (socket says 172.21.15.146:59626) 2024-09-18T01:45:23.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.386+0000 7f99d2176640 1 -- 172.21.15.146:0/726170794 learned_addr learned my addr 172.21.15.146:0/726170794 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:23.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.386+0000 7f99d2176640 1 -- 172.21.15.146:0/726170794 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564732ad1740 con 0x564732ad0e00 2024-09-18T01:45:23.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.386+0000 7f99d2176640 1 --2- 172.21.15.146:0/726170794 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564732ad0e00 0x564732ad1200 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f99cc001450 tx=0x7f99cc04caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fd57491ee5aca82 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.386+0000 7f98b57fa640 1 -- 172.21.15.146:0/726170794 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99cc045070 con 0x564732ad0e00 2024-09-18T01:45:23.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.386+0000 7f98b57fa640 1 -- 172.21.15.146:0/726170794 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99cc015560 con 0x564732ad0e00 2024-09-18T01:45:23.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.386+0000 7f98b57fa640 1 -- 172.21.15.146:0/726170794 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99cc02ad80 con 0x564732ad0e00 2024-09-18T01:45:23.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.387+0000 7f99d620e800 1 -- 172.21.15.146:0/726170794 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564732ad0e00 msgr2=0x564732ad1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.387+0000 7f99d620e800 1 --2- 172.21.15.146:0/726170794 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564732ad0e00 0x564732ad1200 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f99cc001450 tx=0x7f99cc04caf0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.387+0000 7f99d620e800 1 -- 172.21.15.146:0/726170794 shutdown_connections 2024-09-18T01:45:23.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.387+0000 7f99d620e800 1 --2- 172.21.15.146:0/726170794 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564732ad0e00 0x564732ad1200 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.387+0000 7f99d620e800 1 -- 172.21.15.146:0/726170794 >> 172.21.15.146:0/726170794 conn(0x564732acd1b0 msgr2=0x564732acb2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:23.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.387+0000 7f99d620e800 1 -- 172.21.15.146:0/726170794 shutdown_connections 2024-09-18T01:45:23.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.387+0000 7f99d620e800 1 -- 172.21.15.146:0/726170794 wait complete. 2024-09-18T01:45:23.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.387+0000 7f99d620e800 1 Processor -- start 2024-09-18T01:45:23.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.387+0000 7f99d620e800 1 -- start start 2024-09-18T01:45:23.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.387+0000 7f99d620e800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564732ad0e00 0x564732ad8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.387+0000 7f99d620e800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x564732ad1de0 con 0x564732ad0e00 2024-09-18T01:45:23.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.387+0000 7f99d2176640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564732ad0e00 0x564732ad8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.387+0000 7f99d2176640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564732ad0e00 0x564732ad8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59632/0 (socket says 172.21.15.146:59632) 2024-09-18T01:45:23.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.387+0000 7f99d2176640 1 -- 172.21.15.146:0/457284914 learned_addr learned my addr 172.21.15.146:0/457284914 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:23.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.387+0000 7f99d2176640 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564732ad87b0 con 0x564732ad0e00 2024-09-18T01:45:23.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.388+0000 7f99d2176640 1 --2- 172.21.15.146:0/457284914 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564732ad0e00 0x564732ad8270 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f99cc043040 tx=0x7f99cc04c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.388+0000 7f98a37fe640 1 -- 172.21.15.146:0/457284914 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99cc03a070 con 0x564732ad0e00 2024-09-18T01:45:23.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.388+0000 7f98a37fe640 1 -- 172.21.15.146:0/457284914 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99cc04b380 con 0x564732ad0e00 2024-09-18T01:45:23.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.388+0000 7f99d620e800 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564732ad8a40 con 0x564732ad0e00 2024-09-18T01:45:23.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.388+0000 7f98a37fe640 1 -- 172.21.15.146:0/457284914 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99cc045040 con 0x564732ad0e00 2024-09-18T01:45:23.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.388+0000 7f99d620e800 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564732adb6f0 con 0x564732ad0e00 2024-09-18T01:45:23.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.388+0000 7f98a37fe640 1 -- 172.21.15.146:0/457284914 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f99cc03d070 con 0x564732ad0e00 2024-09-18T01:45:23.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.389+0000 7f98a37fe640 1 --2- 172.21.15.146:0/457284914 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f989c036b40 0x7f989c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.389+0000 7f98a37fe640 1 -- 172.21.15.146:0/457284914 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f99cc00e040 con 0x564732ad0e00 2024-09-18T01:45:23.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.389+0000 7f99d1975640 1 --2- 172.21.15.146:0/457284914 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f989c036b40 0x7f989c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.389+0000 7f99d1975640 1 --2- 172.21.15.146:0/457284914 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f989c036b40 0x7f989c039000 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x564732ab67f0 tx=0x7f99c408a000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.389+0000 7f99d620e800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.389+0000 7f99d620e800 1 --2- 172.21.15.146:0/457284914 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564732ae3fa0 0x564732ae6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.390+0000 7f99d620e800 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564732ae6bb0 con 0x564732ae3fa0 2024-09-18T01:45:23.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.390+0000 7f99d1174640 1 --2- 172.21.15.146:0/457284914 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564732ae3fa0 0x564732ae6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.390+0000 7f99d1174640 1 --2- 172.21.15.146:0/457284914 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564732ae3fa0 0x564732ae6460 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.390+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f99c800f5c0 con 0x564732ae3fa0 2024-09-18T01:45:23.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.390+0000 7f99d620e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.390+0000 7f99d620e800 20 realm 2024-09-18T01:45:23.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.390+0000 7f99d620e800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.390+0000 7f99d620e800 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564732ae33f0 con 0x564732ae3fa0 2024-09-18T01:45:23.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.390+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f99c800f5c0 con 0x564732ae3fa0 2024-09-18T01:45:23.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.390+0000 7f99d620e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.390+0000 7f99d620e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:23.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.390+0000 7f99d620e800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.390+0000 7f99d620e800 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564732ae76a0 con 0x564732ae3fa0 2024-09-18T01:45:23.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.391+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f99c800f5c0 con 0x564732ae3fa0 2024-09-18T01:45:23.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.391+0000 7f99d620e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.391+0000 7f99d620e800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.391+0000 7f99d620e800 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564732ae7f70 con 0x564732ae3fa0 2024-09-18T01:45:23.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.391+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f99c800f5c0 con 0x564732ae3fa0 2024-09-18T01:45:23.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.391+0000 7f99d620e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:23.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.391+0000 7f99d620e800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.391+0000 7f99d620e800 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564732ae8310 con 0x564732ae3fa0 2024-09-18T01:45:23.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.391+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f99c800f5c0 con 0x564732ae3fa0 2024-09-18T01:45:23.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.391+0000 7f99d620e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:23.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.391+0000 7f99d620e800 20 searching for the correct realm 2024-09-18T01:45:23.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.391+0000 7f99d620e800 1 --2- 172.21.15.146:0/457284914 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x564732aea1f0 0x564732aec5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.391+0000 7f99d620e800 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564732aecc60 con 0x564732aea1f0 2024-09-18T01:45:23.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.391+0000 7f99d2176640 1 --2- 172.21.15.146:0/457284914 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x564732aea1f0 0x564732aec5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.392+0000 7f99d2176640 1 --2- 172.21.15.146:0/457284914 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x564732aea1f0 0x564732aec5e0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.392+0000 7f99d2176640 1 -- 172.21.15.146:0/457284914 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99cc03c030 con 0x564732aea1f0 2024-09-18T01:45:23.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.392+0000 7f99d2176640 1 --2- 172.21.15.146:0/457284914 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f99cc03f060 0x7f99cc00f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.392+0000 7f99d2176640 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564732aecc60 con 0x7f99cc03f060 2024-09-18T01:45:23.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.392+0000 7f99d1975640 1 --2- 172.21.15.146:0/457284914 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f99cc03f060 0x7f99cc00f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.392+0000 7f99d1975640 1 --2- 172.21.15.146:0/457284914 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f99cc03f060 0x7f99cc00f2b0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.392+0000 7f99d1975640 1 -- 172.21.15.146:0/457284914 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99c407f070 con 0x7f99cc03f060 2024-09-18T01:45:23.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.392+0000 7f99d1975640 1 --2- 172.21.15.146:0/457284914 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f99c40a7040 0x7f99c4009410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.392+0000 7f99d1975640 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564732aecc60 con 0x7f99c40a7040 2024-09-18T01:45:23.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.393+0000 7f99d1174640 1 --2- 172.21.15.146:0/457284914 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f99c40a7040 0x7f99c4009410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.393+0000 7f99d1174640 1 --2- 172.21.15.146:0/457284914 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f99c40a7040 0x7f99c4009410 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.393+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99c800f5c0 con 0x7f99c40a7040 2024-09-18T01:45:23.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.393+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564732aecc60 con 0x564732ae3fa0 2024-09-18T01:45:23.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.394+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f99c800f5c0 con 0x564732ae3fa0 2024-09-18T01:45:23.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.394+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564732aecc60 con 0x564732ae3fa0 2024-09-18T01:45:23.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.394+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99c800f5c0 con 0x564732ae3fa0 2024-09-18T01:45:23.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.394+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564732aecc60 con 0x7f99c40a7040 2024-09-18T01:45:23.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.394+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99c800f5c0 con 0x7f99c40a7040 2024-09-18T01:45:23.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.394+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564732aecc60 con 0x7f99c40a7040 2024-09-18T01:45:23.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.394+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99c800f5c0 con 0x7f99c40a7040 2024-09-18T01:45:23.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.394+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564732aecc60 con 0x7f99cc03f060 2024-09-18T01:45:23.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.394+0000 7f99d1975640 1 -- 172.21.15.146:0/457284914 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99c407f070 con 0x7f99cc03f060 2024-09-18T01:45:23.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.394+0000 7f99d1975640 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564732aecc60 con 0x564732aea1f0 2024-09-18T01:45:23.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.395+0000 7f99d2176640 1 -- 172.21.15.146:0/457284914 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99cc03c030 con 0x564732aea1f0 2024-09-18T01:45:23.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.395+0000 7f99d2176640 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564732aecc60 con 0x564732ae3fa0 2024-09-18T01:45:23.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.395+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99c800f5c0 con 0x564732ae3fa0 2024-09-18T01:45:23.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.395+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564732aecc60 con 0x7f99c40a7040 2024-09-18T01:45:23.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.395+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99c800f5c0 con 0x7f99c40a7040 2024-09-18T01:45:23.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.395+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564732aecc60 con 0x564732ae3fa0 2024-09-18T01:45:23.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.395+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99c800f5c0 con 0x564732ae3fa0 2024-09-18T01:45:23.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.395+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564732aecc60 con 0x7f99cc03f060 2024-09-18T01:45:23.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.396+0000 7f99d1975640 1 -- 172.21.15.146:0/457284914 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f99c407f070 con 0x7f99cc03f060 2024-09-18T01:45:23.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.396+0000 7f99d1975640 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564732aecc60 con 0x564732aea1f0 2024-09-18T01:45:23.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.396+0000 7f99d2176640 1 -- 172.21.15.146:0/457284914 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99cc03c030 con 0x564732aea1f0 2024-09-18T01:45:23.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.396+0000 7f99d2176640 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564732aecc60 con 0x564732aea1f0 2024-09-18T01:45:23.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.396+0000 7f99d2176640 1 -- 172.21.15.146:0/457284914 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99cc03c030 con 0x564732aea1f0 2024-09-18T01:45:23.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.396+0000 7f99d2176640 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564732aecc60 con 0x7f99c40a7040 2024-09-18T01:45:23.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.396+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99c800f5c0 con 0x7f99c40a7040 2024-09-18T01:45:23.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.396+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564732aecc60 con 0x564732aea1f0 2024-09-18T01:45:23.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.396+0000 7f99d2176640 1 -- 172.21.15.146:0/457284914 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99cc03c030 con 0x564732aea1f0 2024-09-18T01:45:23.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.396+0000 7f99d2176640 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564732aecc60 con 0x564732aea1f0 2024-09-18T01:45:23.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.397+0000 7f99d2176640 1 -- 172.21.15.146:0/457284914 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99cc03c030 con 0x564732aea1f0 2024-09-18T01:45:23.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.397+0000 7f99d2176640 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564732aecc60 con 0x564732ae3fa0 2024-09-18T01:45:23.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.397+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99c800f5c0 con 0x564732ae3fa0 2024-09-18T01:45:23.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.397+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564732aecc60 con 0x564732ae3fa0 2024-09-18T01:45:23.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.397+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f99c800f5c0 con 0x564732ae3fa0 2024-09-18T01:45:23.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.397+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564732aecc60 con 0x7f99c40a7040 2024-09-18T01:45:23.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.397+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99c800f5c0 con 0x7f99c40a7040 2024-09-18T01:45:23.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.397+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564732aecc60 con 0x564732aea1f0 2024-09-18T01:45:23.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.398+0000 7f99d2176640 1 -- 172.21.15.146:0/457284914 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99cc03c030 con 0x564732aea1f0 2024-09-18T01:45:23.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.398+0000 7f99d2176640 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564732aecc60 con 0x7f99cc03f060 2024-09-18T01:45:23.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.398+0000 7f99d1975640 1 -- 172.21.15.146:0/457284914 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99c407f070 con 0x7f99cc03f060 2024-09-18T01:45:23.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.398+0000 7f99d1975640 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564732aecc60 con 0x564732ae3fa0 2024-09-18T01:45:23.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.398+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99c800f5c0 con 0x564732ae3fa0 2024-09-18T01:45:23.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.398+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564732aecc60 con 0x7f99c40a7040 2024-09-18T01:45:23.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.398+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99c800f5c0 con 0x7f99c40a7040 2024-09-18T01:45:23.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.398+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564732aecc60 con 0x564732aea1f0 2024-09-18T01:45:23.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.398+0000 7f99d2176640 1 -- 172.21.15.146:0/457284914 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99cc03c030 con 0x564732aea1f0 2024-09-18T01:45:23.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.399+0000 7f99d2176640 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564732aecc60 con 0x7f99c40a7040 2024-09-18T01:45:23.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.399+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99c800f5c0 con 0x7f99c40a7040 2024-09-18T01:45:23.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.399+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564732aecc60 con 0x7f99cc03f060 2024-09-18T01:45:23.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.399+0000 7f99d1975640 1 -- 172.21.15.146:0/457284914 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99c407f070 con 0x7f99cc03f060 2024-09-18T01:45:23.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.399+0000 7f99d1975640 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564732aecc60 con 0x564732aea1f0 2024-09-18T01:45:23.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.399+0000 7f99d2176640 1 -- 172.21.15.146:0/457284914 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99cc03c030 con 0x564732aea1f0 2024-09-18T01:45:23.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.399+0000 7f99d2176640 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564732aecc60 con 0x7f99c40a7040 2024-09-18T01:45:23.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.400+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99c800f5c0 con 0x7f99c40a7040 2024-09-18T01:45:23.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.400+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564732aecc60 con 0x564732ae3fa0 2024-09-18T01:45:23.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.400+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f99c800f5c0 con 0x564732ae3fa0 2024-09-18T01:45:23.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.400+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564732aecc60 con 0x7f99cc03f060 2024-09-18T01:45:23.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.400+0000 7f99d1975640 1 -- 172.21.15.146:0/457284914 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99c407f070 con 0x7f99cc03f060 2024-09-18T01:45:23.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.400+0000 7f99d620e800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:23.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.400+0000 7f99d620e800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:23.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.400+0000 7f99d620e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:23.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.400+0000 7f99d620e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:23.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.400+0000 7f99d620e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:23.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.400+0000 7f99d620e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:23.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.400+0000 7f99d620e800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.400+0000 7f99d620e800 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564732ae8cc0 con 0x564732ae3fa0 2024-09-18T01:45:23.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.400+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f99c800f5c0 con 0x564732ae3fa0 2024-09-18T01:45:23.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.400+0000 7f99d620e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.400+0000 7f99d620e800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.400+0000 7f99d620e800 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564732ae9560 con 0x564732ae3fa0 2024-09-18T01:45:23.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.401+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f99c800f5c0 con 0x564732ae3fa0 2024-09-18T01:45:23.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.401+0000 7f99d620e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:23.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.401+0000 7f99d620e800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.401+0000 7f99d620e800 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564732aed0e0 con 0x7f99cc03f060 2024-09-18T01:45:23.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.401+0000 7f99d1975640 1 -- 172.21.15.146:0/457284914 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f99c407f070 con 0x7f99cc03f060 2024-09-18T01:45:23.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.401+0000 7f99d620e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:23.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.401+0000 7f99d620e800 20 zone default found 2024-09-18T01:45:23.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.401+0000 7f99d620e800 4 Realm: () 2024-09-18T01:45:23.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.401+0000 7f99d620e800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:23.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.401+0000 7f99d620e800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:23.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.401+0000 7f99d620e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:23.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.401+0000 7f99d620e800 20 zonegroup default 2024-09-18T01:45:23.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.401+0000 7f99d620e800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.401+0000 7f99d620e800 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564732aed930 con 0x7f99c40a7040 2024-09-18T01:45:23.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.401+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f99c800f5c0 con 0x7f99c40a7040 2024-09-18T01:45:23.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.401+0000 7f99d620e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.401+0000 7f99d620e800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.401+0000 7f99d620e800 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564732aef340 con 0x564732aea1f0 2024-09-18T01:45:23.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.401+0000 7f99d2176640 1 -- 172.21.15.146:0/457284914 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f99cc03c030 con 0x564732aea1f0 2024-09-18T01:45:23.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.402+0000 7f99d620e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.402+0000 7f99d620e800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.402+0000 7f99d620e800 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564732aef7e0 con 0x564732aea1f0 2024-09-18T01:45:23.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.402+0000 7f99d2176640 1 -- 172.21.15.146:0/457284914 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f99cc03c030 con 0x564732aea1f0 2024-09-18T01:45:23.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.402+0000 7f99d620e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.402+0000 7f99d620e800 20 started sync module instance, tier type = 2024-09-18T01:45:23.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.402+0000 7f99d620e800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:23.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.402+0000 7f99d620e800 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564732aee7a0 con 0x7f99cc03f060 2024-09-18T01:45:23.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.403+0000 7f99d1975640 1 -- 172.21.15.146:0/457284914 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v31'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99c407f070 con 0x7f99cc03f060 2024-09-18T01:45:23.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.403+0000 7f99d620e800 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94863792991120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564732af00f0 con 0x7f99cc03f060 2024-09-18T01:45:23.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.403+0000 7f99d620e800 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564732af0940 con 0x564732ae3fa0 2024-09-18T01:45:23.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.404+0000 7f99d1975640 1 -- 172.21.15.146:0/457284914 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94863792991120] v31'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99c407f070 con 0x7f99cc03f060 2024-09-18T01:45:23.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.404+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v31'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99c800f5c0 con 0x564732ae3fa0 2024-09-18T01:45:23.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.404+0000 7f99d620e800 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94863792995392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564732af0980 con 0x564732ae3fa0 2024-09-18T01:45:23.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.404+0000 7f99d620e800 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564732af1490 con 0x564732aea1f0 2024-09-18T01:45:23.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.405+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94863792995392] v31'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99c800f5c0 con 0x564732ae3fa0 2024-09-18T01:45:23.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.406+0000 7f99d2176640 1 -- 172.21.15.146:0/457284914 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v31'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99cc03c030 con 0x564732aea1f0 2024-09-18T01:45:23.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.406+0000 7f99d620e800 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94863793000256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564732af1880 con 0x564732aea1f0 2024-09-18T01:45:23.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.406+0000 7f99d620e800 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564732af22c0 con 0x7f99cc03f060 2024-09-18T01:45:23.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.407+0000 7f99d1975640 1 -- 172.21.15.146:0/457284914 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v31'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99c407f070 con 0x7f99cc03f060 2024-09-18T01:45:23.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.407+0000 7f99d620e800 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94863793003920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564732af2b60 con 0x7f99cc03f060 2024-09-18T01:45:23.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.407+0000 7f99d620e800 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564732af3620 con 0x564732ae3fa0 2024-09-18T01:45:23.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.407+0000 7f99d2176640 1 -- 172.21.15.146:0/457284914 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94863793000256] v31'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99cc03c030 con 0x564732aea1f0 2024-09-18T01:45:23.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.408+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v31'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99c800f5c0 con 0x564732ae3fa0 2024-09-18T01:45:23.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.408+0000 7f99d620e800 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94863793008976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564732af3a40 con 0x564732ae3fa0 2024-09-18T01:45:23.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.408+0000 7f99d620e800 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564732af4460 con 0x7f99c40a7040 2024-09-18T01:45:23.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.409+0000 7f99d1975640 1 -- 172.21.15.146:0/457284914 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94863793003920] v31'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99c407f070 con 0x7f99cc03f060 2024-09-18T01:45:23.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.409+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v31'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99c800f5c0 con 0x7f99c40a7040 2024-09-18T01:45:23.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.409+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94863793008976] v31'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99c800f5c0 con 0x564732ae3fa0 2024-09-18T01:45:23.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.409+0000 7f99d620e800 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94863793012560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564732af4420 con 0x7f99c40a7040 2024-09-18T01:45:23.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.409+0000 7f99d620e800 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564732af4ca0 con 0x7f99c40a7040 2024-09-18T01:45:23.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.410+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94863793012560] v31'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99c800f5c0 con 0x7f99c40a7040 2024-09-18T01:45:23.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.410+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v31'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99c800f5c0 con 0x7f99c40a7040 2024-09-18T01:45:23.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.410+0000 7f99d620e800 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94863793006256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564732af4420 con 0x7f99c40a7040 2024-09-18T01:45:23.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.410+0000 7f99d620e800 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564732af52c0 con 0x7f99c40a7040 2024-09-18T01:45:23.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.412+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94863793006256] v31'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99c800f5c0 con 0x7f99c40a7040 2024-09-18T01:45:23.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.412+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v31'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99c800f5c0 con 0x7f99c40a7040 2024-09-18T01:45:23.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.412+0000 7f99d620e800 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94863793014768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564732af52c0 con 0x7f99c40a7040 2024-09-18T01:45:23.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.412+0000 7f99d620e800 20 add_watcher() i=0 2024-09-18T01:45:23.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.412+0000 7f99d620e800 20 add_watcher() i=1 2024-09-18T01:45:23.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.412+0000 7f99d620e800 20 add_watcher() i=2 2024-09-18T01:45:23.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.412+0000 7f99d620e800 20 add_watcher() i=3 2024-09-18T01:45:23.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.412+0000 7f99d620e800 20 add_watcher() i=4 2024-09-18T01:45:23.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.412+0000 7f99d620e800 20 add_watcher() i=5 2024-09-18T01:45:23.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.412+0000 7f99d620e800 20 add_watcher() i=6 2024-09-18T01:45:23.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.413+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94863793014768] v31'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99c800f5c0 con 0x7f99c40a7040 2024-09-18T01:45:23.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.413+0000 7f99d620e800 20 add_watcher() i=7 2024-09-18T01:45:23.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.413+0000 7f99d620e800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:23.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.413+0000 7f99d620e800 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564732af8710 con 0x564732ae3fa0 2024-09-18T01:45:23.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.413+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f99c800f5c0 con 0x564732ae3fa0 2024-09-18T01:45:23.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.414+0000 7f99d620e800 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94863793016800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564732af5be0 con 0x564732ae3fa0 2024-09-18T01:45:23.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.414+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94863793016800] v31'62 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f99c800f5c0 con 0x564732ae3fa0 2024-09-18T01:45:23.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.415+0000 7f98837fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:23.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.415+0000 7f99d620e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:23.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.415+0000 7f99d620e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:23.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.415+0000 7f99d620e800 5 note: GC not initialized 2024-09-18T01:45:23.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.415+0000 7f98827fc640 20 reqs_thread_entry: start 2024-09-18T01:45:23.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.415+0000 7f99d620e800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:23.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.415+0000 7f99d620e800 20 Filter name: none 2024-09-18T01:45:23.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.415+0000 7f97f3fff640 20 reqs_thread_entry: start 2024-09-18T01:45:23.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.415+0000 7f99d620e800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T01:45:23.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.415+0000 7f99d620e800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.415+0000 7f99d620e800 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564732b2bb50 con 0x564732ae3fa0 2024-09-18T01:45:23.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.415+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f99c800f5c0 con 0x564732ae3fa0 2024-09-18T01:45:23.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.416+0000 7f99d620e800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:45:23.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.416+0000 7f99d620e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T01:45:23.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.416+0000 7f99d620e800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:45:23.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.416+0000 7f99d620e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:45:23.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.416+0000 7f99d620e800 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564732b2e5e0 con 0x7f99cc03f060 2024-09-18T01:45:23.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.416+0000 7f99d1975640 1 -- 172.21.15.146:0/457284914 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f99c407f070 con 0x7f99cc03f060 2024-09-18T01:45:23.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.416+0000 7f99d620e800 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564732b31e60 con 0x564732ae3fa0 2024-09-18T01:45:23.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.417+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v31'2 uv2 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f99c800f5c0 con 0x564732ae3fa0 2024-09-18T01:45:23.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.417+0000 7f99d620e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:45:23.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.417+0000 7f99d620e800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:45:23.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.417+0000 7f99d620e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-18T01:45:23.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.417+0000 7f99d620e800 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94863793264704 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564732b2d5d0 con 0x564732ae3fa0 2024-09-18T01:45:23.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.417+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== watch-notify(notify (1) cookie 94863793008976 notify 133143986177 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f99c8018040 con 0x564732ae3fa0 2024-09-18T01:45:23.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.417+0000 7f98b57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986177 cookie 94863793008976 notifier 4320 bl.length()=567 2024-09-18T01:45:23.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.417+0000 7f98b57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:45:23.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.417+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(65 notify.4 [notify cookie 94863793264704 out=8b] v0'0 uv33 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f99c800f5c0 con 0x564732ae3fa0 2024-09-18T01:45:23.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.417+0000 7f98b57fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:45:23.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.417+0000 7f98b57fa640 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f9894003ea0 con 0x564732ae3fa0 2024-09-18T01:45:23.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.418+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== watch-notify(notify_complete (2) cookie 94863793264704 notify 133143986177 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f99c8009050 con 0x564732ae3fa0 2024-09-18T01:45:23.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.418+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99c800f5c0 con 0x564732ae3fa0 2024-09-18T01:45:23.428 INFO:teuthology.orchestra.run.smithi146.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T01:45:23.010714Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:45:23.010705Z","tags":[],"group_ids":[]} 2024-09-18T01:45:23.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.418+0000 7f98837fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:23.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.418+0000 7f99d620e800 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94863793016800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564732b298a0 con 0x564732ae3fa0 2024-09-18T01:45:23.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.419+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 <== osd.1 v2:172.21.15.146:6808/3930274777 28 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94863793016800] v31'63 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f99c800f5c0 con 0x564732ae3fa0 2024-09-18T01:45:23.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.419+0000 7f99d620e800 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94863792991120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564732b298a0 con 0x7f99cc03f060 2024-09-18T01:45:23.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.420+0000 7f99d1975640 1 -- 172.21.15.146:0/457284914 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94863792991120] v31'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99c407f070 con 0x7f99cc03f060 2024-09-18T01:45:23.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.420+0000 7f99d620e800 20 remove_watcher() i=0 2024-09-18T01:45:23.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.420+0000 7f99d620e800 2 removed watcher, disabling cache 2024-09-18T01:45:23.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.420+0000 7f99d620e800 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94863792995392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564732b298a0 con 0x564732ae3fa0 2024-09-18T01:45:23.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.421+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 <== osd.1 v2:172.21.15.146:6808/3930274777 29 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94863792995392] v31'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99c800f5c0 con 0x564732ae3fa0 2024-09-18T01:45:23.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.421+0000 7f99d620e800 20 remove_watcher() i=1 2024-09-18T01:45:23.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.421+0000 7f99d620e800 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94863793000256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564732b298a0 con 0x564732aea1f0 2024-09-18T01:45:23.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.423+0000 7f99d2176640 1 -- 172.21.15.146:0/457284914 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94863793000256] v31'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99cc03c030 con 0x564732aea1f0 2024-09-18T01:45:23.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.423+0000 7f99d620e800 20 remove_watcher() i=2 2024-09-18T01:45:23.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.423+0000 7f99d620e800 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94863793003920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564732b298a0 con 0x7f99cc03f060 2024-09-18T01:45:23.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.424+0000 7f99d1975640 1 -- 172.21.15.146:0/457284914 <== osd.2 v2:172.21.15.146:6800/3820039304 14 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94863793003920] v31'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99c407f070 con 0x7f99cc03f060 2024-09-18T01:45:23.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.424+0000 7f99d620e800 20 remove_watcher() i=3 2024-09-18T01:45:23.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.424+0000 7f99d620e800 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94863793008976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564732b298a0 con 0x564732ae3fa0 2024-09-18T01:45:23.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.425+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 <== osd.1 v2:172.21.15.146:6808/3930274777 30 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94863793008976] v31'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99c800f5c0 con 0x564732ae3fa0 2024-09-18T01:45:23.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.425+0000 7f99d620e800 20 remove_watcher() i=4 2024-09-18T01:45:23.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.425+0000 7f99d620e800 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94863793012560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564732b298a0 con 0x7f99c40a7040 2024-09-18T01:45:23.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.426+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94863793012560] v31'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99c800f5c0 con 0x7f99c40a7040 2024-09-18T01:45:23.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.426+0000 7f99d620e800 20 remove_watcher() i=5 2024-09-18T01:45:23.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.426+0000 7f99d620e800 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94863793006256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564732b298a0 con 0x7f99c40a7040 2024-09-18T01:45:23.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.427+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94863793006256] v31'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99c800f5c0 con 0x7f99c40a7040 2024-09-18T01:45:23.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.427+0000 7f99d620e800 20 remove_watcher() i=6 2024-09-18T01:45:23.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.427+0000 7f99d620e800 1 -- 172.21.15.146:0/457284914 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94863793014768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564732b298a0 con 0x7f99c40a7040 2024-09-18T01:45:23.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.427+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94863793014768] v31'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99c800f5c0 con 0x7f99c40a7040 2024-09-18T01:45:23.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.427+0000 7f99d620e800 20 remove_watcher() i=7 2024-09-18T01:45:23.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.428+0000 7f99d620e800 1 -- 172.21.15.146:0/457284914 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f99c40a7040 msgr2=0x7f99c4009410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.428+0000 7f99d620e800 1 --2- 172.21.15.146:0/457284914 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f99c40a7040 0x7f99c4009410 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.428+0000 7f99d620e800 1 -- 172.21.15.146:0/457284914 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564732ae3fa0 msgr2=0x564732ae6460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.428+0000 7f99d620e800 1 --2- 172.21.15.146:0/457284914 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564732ae3fa0 0x564732ae6460 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.428+0000 7f99d620e800 1 -- 172.21.15.146:0/457284914 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f99cc03f060 msgr2=0x7f99cc00f2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.428+0000 7f99d620e800 1 --2- 172.21.15.146:0/457284914 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f99cc03f060 0x7f99cc00f2b0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.428+0000 7f99d620e800 1 -- 172.21.15.146:0/457284914 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x564732aea1f0 msgr2=0x564732aec5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.428+0000 7f99d620e800 1 --2- 172.21.15.146:0/457284914 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x564732aea1f0 0x564732aec5e0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.428+0000 7f99d620e800 1 -- 172.21.15.146:0/457284914 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f989c036b40 msgr2=0x7f989c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.428+0000 7f99d620e800 1 --2- 172.21.15.146:0/457284914 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f989c036b40 0x7f989c039000 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x564732ab67f0 tx=0x7f99c408a000 comp rx=0 tx=0).stop 2024-09-18T01:45:23.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.428+0000 7f99d1174640 1 -- 172.21.15.146:0/457284914 reap_dead start 2024-09-18T01:45:23.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.428+0000 7f99d620e800 1 -- 172.21.15.146:0/457284914 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564732ad0e00 msgr2=0x564732ad8270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.428+0000 7f99d620e800 1 --2- 172.21.15.146:0/457284914 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564732ad0e00 0x564732ad8270 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f99cc043040 tx=0x7f99cc04c880 comp rx=0 tx=0).stop 2024-09-18T01:45:23.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.428+0000 7f99d620e800 1 -- 172.21.15.146:0/457284914 shutdown_connections 2024-09-18T01:45:23.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.428+0000 7f99d620e800 1 --2- 172.21.15.146:0/457284914 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564732ad0e00 0x564732ad8270 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.428+0000 7f99d620e800 1 -- 172.21.15.146:0/457284914 >> 172.21.15.146:0/457284914 conn(0x564732acd1b0 msgr2=0x564732acb280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:23.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.428+0000 7f99d620e800 1 -- 172.21.15.146:0/457284914 shutdown_connections 2024-09-18T01:45:23.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.428+0000 7f99d620e800 1 -- 172.21.15.146:0/457284914 wait complete. 2024-09-18T01:45:23.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.428+0000 7f99d620e800 1 -- 172.21.15.146:0/2271836304 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f98ac036b40 msgr2=0x7f98ac039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.428+0000 7f99d620e800 1 --2- 172.21.15.146:0/2271836304 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f98ac036b40 0x7f98ac039000 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f99c408f2b0 tx=0x7f99c408f3f0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.428+0000 7f99d620e800 1 -- 172.21.15.146:0/2271836304 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564732ac4180 msgr2=0x564732ac45a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.428+0000 7f99d620e800 1 --2- 172.21.15.146:0/2271836304 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564732ac4180 0x564732ac45a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x564732ab0dd0 tx=0x7f99cc0178e0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.428+0000 7f99d620e800 1 -- 172.21.15.146:0/2271836304 shutdown_connections 2024-09-18T01:45:23.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.428+0000 7f99d620e800 1 --2- 172.21.15.146:0/2271836304 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f98ac036b40 0x7f98ac039000 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.428+0000 7f99d620e800 1 --2- 172.21.15.146:0/2271836304 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564732ac4180 0x564732ac45a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.428+0000 7f99d620e800 1 -- 172.21.15.146:0/2271836304 >> 172.21.15.146:0/2271836304 conn(0x564732ab9110 msgr2=0x564732abbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:23.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.428+0000 7f99d620e800 1 -- 172.21.15.146:0/2271836304 shutdown_connections 2024-09-18T01:45:23.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.428+0000 7f99d620e800 1 -- 172.21.15.146:0/2271836304 wait complete. 2024-09-18T01:45:23.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.429+0000 7f99d620e800 1 -- 172.21.15.146:0/87113527 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5647329af390 msgr2=0x564732ab03a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.429+0000 7f99d620e800 1 --2- 172.21.15.146:0/87113527 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5647329af390 0x564732ab03a0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.429+0000 7f99d620e800 1 -- 172.21.15.146:0/87113527 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x564732ab2420 msgr2=0x564732ab5c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.429+0000 7f99d620e800 1 --2- 172.21.15.146:0/87113527 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x564732ab2420 0x564732ab5c60 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.429+0000 7f99d620e800 1 -- 172.21.15.146:0/87113527 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f98b8036b40 msgr2=0x7f98b8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.429+0000 7f99d620e800 1 --2- 172.21.15.146:0/87113527 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f98b8036b40 0x7f98b8039000 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f99c8000f60 tx=0x7f99c8001370 comp rx=0 tx=0).stop 2024-09-18T01:45:23.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.429+0000 7f99d620e800 1 -- 172.21.15.146:0/87113527 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5647329aea50 msgr2=0x564732aa9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.429+0000 7f99d620e800 1 --2- 172.21.15.146:0/87113527 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5647329aea50 0x564732aa9330 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f99c4067040 tx=0x7f99c4002fb0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.429+0000 7f99d620e800 1 -- 172.21.15.146:0/87113527 shutdown_connections 2024-09-18T01:45:23.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.429+0000 7f99d620e800 1 --2- 172.21.15.146:0/87113527 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x564732ab2420 0x564732ab5c60 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.429+0000 7f99d620e800 1 --2- 172.21.15.146:0/87113527 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5647329af390 0x564732ab03a0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.429+0000 7f99d620e800 1 --2- 172.21.15.146:0/87113527 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f98b8036b40 0x7f98b8039000 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.429+0000 7f99d620e800 1 --2- 172.21.15.146:0/87113527 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5647329aea50 0x564732aa9330 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.429+0000 7f99d620e800 1 -- 172.21.15.146:0/87113527 >> 172.21.15.146:0/87113527 conn(0x5647329aa5c0 msgr2=0x564732a9bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:23.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.429+0000 7f99d620e800 1 -- 172.21.15.146:0/87113527 shutdown_connections 2024-09-18T01:45:23.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.429+0000 7f99d620e800 1 -- 172.21.15.146:0/87113527 wait complete. 2024-09-18T01:45:23.439 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T01:45:23.010714Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:45:23.010705Z', 'tags': [], 'group_ids': []} 2024-09-18T01:45:23.439 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-18T01:45:23.439 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-18T01:45:23.439 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-18T01:45:23.524 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:23.524 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:23.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.524+0000 7fda51034800 1 Processor -- start 2024-09-18T01:45:23.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.524+0000 7fda51034800 1 -- start start 2024-09-18T01:45:23.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.524+0000 7fda51034800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x562dccd04990 0x562dccd06d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.524+0000 7fda51034800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562dccbc0b30 con 0x562dccd00550 2024-09-18T01:45:23.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.524+0000 7fda51034800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x562dccba2360 con 0x562dccd04990 2024-09-18T01:45:23.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.524+0000 7fda4ba72640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x562dccd04990 0x562dccd06d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.524+0000 7fda4ba72640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x562dccd04990 0x562dccd06d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59640/0 (socket says 172.21.15.146:59640) 2024-09-18T01:45:23.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.524+0000 7fda4c273640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x562dccd00550 0x562dccd00950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:38728/0 (socket says 172.21.15.146:38728) 2024-09-18T01:45:23.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.524+0000 7fda4ba72640 1 -- 172.21.15.146:0/2256414840 learned_addr learned my addr 172.21.15.146:0/2256414840 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:23.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.525+0000 7fda4ba72640 1 -- 172.21.15.146:0/2256414840 >> v1:172.21.15.129:6789/0 conn(0x562dccd00550 legacy=0x562dccd00950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.525+0000 7fda4ba72640 1 -- 172.21.15.146:0/2256414840 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562dccbc8e00 con 0x562dccd04990 2024-09-18T01:45:23.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.526+0000 7fda4ba72640 1 --2- 172.21.15.146:0/2256414840 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562dccd04990 0x562dccd06d80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fda3400a520 tx=0x7fda34045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5323283705fa1bf server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.526+0000 7fda4b271640 1 -- 172.21.15.146:0/2256414840 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda34055070 con 0x562dccd04990 2024-09-18T01:45:23.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.526+0000 7fda4b271640 1 -- 172.21.15.146:0/2256414840 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda340515b0 con 0x562dccd04990 2024-09-18T01:45:23.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.526+0000 7fda4b271640 1 -- 172.21.15.146:0/2256414840 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda340518d0 con 0x562dccd04990 2024-09-18T01:45:23.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.527+0000 7fda51034800 1 -- 172.21.15.146:0/2256414840 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562dccd04990 msgr2=0x562dccd06d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.527+0000 7fda51034800 1 --2- 172.21.15.146:0/2256414840 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562dccd04990 0x562dccd06d80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fda3400a520 tx=0x7fda34045ba0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.527+0000 7fda51034800 1 -- 172.21.15.146:0/2256414840 shutdown_connections 2024-09-18T01:45:23.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.527+0000 7fda51034800 1 --2- 172.21.15.146:0/2256414840 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562dccd04990 0x562dccd06d80 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.527+0000 7fda51034800 1 -- 172.21.15.146:0/2256414840 >> 172.21.15.146:0/2256414840 conn(0x562dcccfbde0 msgr2=0x562dcccfe200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:23.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.527+0000 7fda51034800 1 -- 172.21.15.146:0/2256414840 shutdown_connections 2024-09-18T01:45:23.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.527+0000 7fda51034800 1 -- 172.21.15.146:0/2256414840 wait complete. 2024-09-18T01:45:23.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.541+0000 7fda51034800 1 Processor -- start 2024-09-18T01:45:23.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.541+0000 7fda51034800 1 -- start start 2024-09-18T01:45:23.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.541+0000 7fda51034800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562dccd00550 0x562dccdef780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.541+0000 7fda51034800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x562dccc4d330 con 0x562dccd00550 2024-09-18T01:45:23.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.541+0000 7fda4c273640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562dccd00550 0x562dccdef780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.541+0000 7fda4c273640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562dccd00550 0x562dccdef780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59650/0 (socket says 172.21.15.146:59650) 2024-09-18T01:45:23.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.541+0000 7fda4c273640 1 -- 172.21.15.146:0/4116808583 learned_addr learned my addr 172.21.15.146:0/4116808583 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:23.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.541+0000 7fda4c273640 1 -- 172.21.15.146:0/4116808583 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562dccb9abc0 con 0x562dccd00550 2024-09-18T01:45:23.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.542+0000 7fda4c273640 1 --2- 172.21.15.146:0/4116808583 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562dccd00550 0x562dccdef780 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fda3c00b230 tx=0x7fda3c00b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1dc73c938fd5ef9 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.542+0000 7fd93a60c640 1 -- 172.21.15.146:0/4116808583 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda3c00e5c0 con 0x562dccd00550 2024-09-18T01:45:23.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.542+0000 7fd93a60c640 1 -- 172.21.15.146:0/4116808583 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda3c006070 con 0x562dccd00550 2024-09-18T01:45:23.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.542+0000 7fd93a60c640 1 -- 172.21.15.146:0/4116808583 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda3c00e890 con 0x562dccd00550 2024-09-18T01:45:23.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.542+0000 7fda51034800 1 -- 172.21.15.146:0/4116808583 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562dccd00550 msgr2=0x562dccdef780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.542+0000 7fda51034800 1 --2- 172.21.15.146:0/4116808583 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562dccd00550 0x562dccdef780 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fda3c00b230 tx=0x7fda3c00b6f0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.543+0000 7fda51034800 1 -- 172.21.15.146:0/4116808583 shutdown_connections 2024-09-18T01:45:23.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.543+0000 7fda51034800 1 --2- 172.21.15.146:0/4116808583 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562dccd00550 0x562dccdef780 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.543+0000 7fda51034800 1 -- 172.21.15.146:0/4116808583 >> 172.21.15.146:0/4116808583 conn(0x562dcccfbde0 msgr2=0x562dccdeb140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:23.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.543+0000 7fda51034800 1 -- 172.21.15.146:0/4116808583 shutdown_connections 2024-09-18T01:45:23.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.543+0000 7fda51034800 1 -- 172.21.15.146:0/4116808583 wait complete. 2024-09-18T01:45:23.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.543+0000 7fda51034800 1 Processor -- start 2024-09-18T01:45:23.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.543+0000 7fda51034800 1 -- start start 2024-09-18T01:45:23.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.543+0000 7fda51034800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562dccd00550 0x562dccdfa4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.543+0000 7fda51034800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x562dccd075c0 con 0x562dccd00550 2024-09-18T01:45:23.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.543+0000 7fda4c273640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562dccd00550 0x562dccdfa4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.543+0000 7fda4c273640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562dccd00550 0x562dccdfa4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59662/0 (socket says 172.21.15.146:59662) 2024-09-18T01:45:23.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.543+0000 7fda4c273640 1 -- 172.21.15.146:0/3711175195 learned_addr learned my addr 172.21.15.146:0/3711175195 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:23.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.544+0000 7fda4c273640 1 -- 172.21.15.146:0/3711175195 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562dccbaefe0 con 0x562dccd00550 2024-09-18T01:45:23.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.544+0000 7fda4c273640 1 --2- 172.21.15.146:0/3711175195 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562dccd00550 0x562dccdfa4b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fda3c000c00 tx=0x7fda3c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.544+0000 7fd938e09640 1 -- 172.21.15.146:0/3711175195 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda3c00f8d0 con 0x562dccd00550 2024-09-18T01:45:23.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.544+0000 7fd938e09640 1 -- 172.21.15.146:0/3711175195 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda3c00fa90 con 0x562dccd00550 2024-09-18T01:45:23.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.544+0000 7fd938e09640 1 -- 172.21.15.146:0/3711175195 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda3c00fdb0 con 0x562dccd00550 2024-09-18T01:45:23.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.544+0000 7fda51034800 1 -- 172.21.15.146:0/3711175195 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562dccdfa9f0 con 0x562dccd00550 2024-09-18T01:45:23.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.544+0000 7fda51034800 1 -- 172.21.15.146:0/3711175195 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562dccdfaf10 con 0x562dccd00550 2024-09-18T01:45:23.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.545+0000 7fd938e09640 1 -- 172.21.15.146:0/3711175195 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fda3c017070 con 0x562dccd00550 2024-09-18T01:45:23.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.545+0000 7fd938e09640 1 --2- 172.21.15.146:0/3711175195 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd934036b40 0x7fd934039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.545+0000 7fd938e09640 1 -- 172.21.15.146:0/3711175195 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fda3c015020 con 0x562dccd00550 2024-09-18T01:45:23.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.545+0000 7fda4ba72640 1 --2- 172.21.15.146:0/3711175195 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd934036b40 0x7fd934039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.545+0000 7fda51034800 1 --2- 172.21.15.146:0/3711175195 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x562dccd04990 0x562dcce01520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.545+0000 7fda51034800 1 -- 172.21.15.146:0/3711175195 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562dcce01af0 con 0x562dccd04990 2024-09-18T01:45:23.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.545+0000 7fda4ca74640 1 --2- 172.21.15.146:0/3711175195 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x562dccd04990 0x562dcce01520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.546+0000 7fda4ba72640 1 --2- 172.21.15.146:0/3711175195 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd934036b40 0x7fd934039000 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fda34057000 tx=0x7fda34052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.546+0000 7fda4ca74640 1 --2- 172.21.15.146:0/3711175195 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x562dccd04990 0x562dcce01520 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.546+0000 7fda4ca74640 1 -- 172.21.15.146:0/3711175195 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda4400a4a0 con 0x562dccd04990 2024-09-18T01:45:23.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.546+0000 7fda51034800 1 -- 172.21.15.146:0/3711175195 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562dccdfeaf0 con 0x562dccd04990 2024-09-18T01:45:23.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.546+0000 7fda4ca74640 1 -- 172.21.15.146:0/3711175195 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fda4400a4a0 con 0x562dccd04990 2024-09-18T01:45:23.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.546+0000 7fda51034800 1 -- 172.21.15.146:0/3711175195 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562dcce038e0 con 0x562dccd04990 2024-09-18T01:45:23.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.546+0000 7fda4ca74640 1 -- 172.21.15.146:0/3711175195 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fda4400a4a0 con 0x562dccd04990 2024-09-18T01:45:23.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.547+0000 7fda51034800 1 -- 172.21.15.146:0/3711175195 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562dcce02b10 con 0x562dccd04990 2024-09-18T01:45:23.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.547+0000 7fda4ca74640 1 -- 172.21.15.146:0/3711175195 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fda4400a4a0 con 0x562dccd04990 2024-09-18T01:45:23.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.547+0000 7fda51034800 1 --2- 172.21.15.146:0/3711175195 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x562dcce04c90 0x562dcce07080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.547+0000 7fda51034800 1 -- 172.21.15.146:0/3711175195 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562dcce075c0 con 0x562dcce04c90 2024-09-18T01:45:23.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.547+0000 7fda4c273640 1 --2- 172.21.15.146:0/3711175195 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x562dcce04c90 0x562dcce07080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.547+0000 7fda4c273640 1 --2- 172.21.15.146:0/3711175195 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x562dcce04c90 0x562dcce07080 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.547+0000 7fda4c273640 1 -- 172.21.15.146:0/3711175195 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fda3c02e070 con 0x562dcce04c90 2024-09-18T01:45:23.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.548+0000 7fda51034800 1 Processor -- start 2024-09-18T01:45:23.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.548+0000 7fda51034800 1 -- start start 2024-09-18T01:45:23.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.548+0000 7fda51034800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562dcce15240 0x562dcce15660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.548+0000 7fda51034800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x562dccb9c580 con 0x562dcce15240 2024-09-18T01:45:23.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.548+0000 7fda4ca74640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562dcce15240 0x562dcce15660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.548+0000 7fda4ca74640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562dcce15240 0x562dcce15660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59664/0 (socket says 172.21.15.146:59664) 2024-09-18T01:45:23.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.548+0000 7fda4ca74640 1 -- 172.21.15.146:0/1826445822 learned_addr learned my addr 172.21.15.146:0/1826445822 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:23.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.548+0000 7fda4ca74640 1 -- 172.21.15.146:0/1826445822 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562dcce15ba0 con 0x562dcce15240 2024-09-18T01:45:23.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.548+0000 7fda4ca74640 1 --2- 172.21.15.146:0/1826445822 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562dcce15240 0x562dcce15660 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x562dccdfb100 tx=0x7fda440178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.549+0000 7fd931ffb640 1 -- 172.21.15.146:0/1826445822 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda44013440 con 0x562dcce15240 2024-09-18T01:45:23.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.549+0000 7fd931ffb640 1 -- 172.21.15.146:0/1826445822 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda440135e0 con 0x562dcce15240 2024-09-18T01:45:23.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.549+0000 7fd931ffb640 1 -- 172.21.15.146:0/1826445822 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda440138c0 con 0x562dcce15240 2024-09-18T01:45:23.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.549+0000 7fda51034800 1 -- 172.21.15.146:0/1826445822 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562dcce15e30 con 0x562dcce15240 2024-09-18T01:45:23.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.549+0000 7fda51034800 1 -- 172.21.15.146:0/1826445822 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562dcce18b10 con 0x562dcce15240 2024-09-18T01:45:23.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.549+0000 7fd931ffb640 1 -- 172.21.15.146:0/1826445822 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fda44011040 con 0x562dcce15240 2024-09-18T01:45:23.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.550+0000 7fd931ffb640 1 --2- 172.21.15.146:0/1826445822 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd924036b40 0x7fd924039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.550+0000 7fd931ffb640 1 -- 172.21.15.146:0/1826445822 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fda4401d070 con 0x562dcce15240 2024-09-18T01:45:23.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.550+0000 7fda4c273640 1 --2- 172.21.15.146:0/1826445822 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd924036b40 0x7fd924039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.550+0000 7fda51034800 1 Processor -- start 2024-09-18T01:45:23.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.550+0000 7fda4c273640 1 --2- 172.21.15.146:0/1826445822 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd924036b40 0x7fd924039000 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fda3c0176e0 tx=0x7fda3c04b740 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.550+0000 7fda51034800 1 -- start start 2024-09-18T01:45:23.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.550+0000 7fda51034800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562dcce21ee0 0x562dcce222e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.550+0000 7fda51034800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x562dccdeff00 con 0x562dcce21ee0 2024-09-18T01:45:23.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.550+0000 7fda4ca74640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562dcce21ee0 0x562dcce222e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.550+0000 7fda4ca74640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562dcce21ee0 0x562dcce222e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59676/0 (socket says 172.21.15.146:59676) 2024-09-18T01:45:23.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.550+0000 7fda4ca74640 1 -- 172.21.15.146:0/1105621332 learned_addr learned my addr 172.21.15.146:0/1105621332 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:23.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.551+0000 7fda4ca74640 1 -- 172.21.15.146:0/1105621332 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562dcce228b0 con 0x562dcce21ee0 2024-09-18T01:45:23.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.551+0000 7fda4ca74640 1 --2- 172.21.15.146:0/1105621332 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562dcce21ee0 0x562dcce222e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fda4404c8f0 tx=0x7fda44012860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4016c23e2bfb285 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.551+0000 7fd9237fe640 1 -- 172.21.15.146:0/1105621332 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda44012cc0 con 0x562dcce21ee0 2024-09-18T01:45:23.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.551+0000 7fd9237fe640 1 -- 172.21.15.146:0/1105621332 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda4404b250 con 0x562dcce21ee0 2024-09-18T01:45:23.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.551+0000 7fd9237fe640 1 -- 172.21.15.146:0/1105621332 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda44012e60 con 0x562dcce21ee0 2024-09-18T01:45:23.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.551+0000 7fda51034800 1 -- 172.21.15.146:0/1105621332 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562dcce21ee0 msgr2=0x562dcce222e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.551+0000 7fda51034800 1 --2- 172.21.15.146:0/1105621332 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562dcce21ee0 0x562dcce222e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fda4404c8f0 tx=0x7fda44012860 comp rx=0 tx=0).stop 2024-09-18T01:45:23.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.551+0000 7fda51034800 1 -- 172.21.15.146:0/1105621332 shutdown_connections 2024-09-18T01:45:23.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.551+0000 7fda51034800 1 --2- 172.21.15.146:0/1105621332 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562dcce21ee0 0x562dcce222e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.551+0000 7fda51034800 1 -- 172.21.15.146:0/1105621332 >> 172.21.15.146:0/1105621332 conn(0x562dcce1e240 msgr2=0x562dcce1c390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:23.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.551+0000 7fda51034800 1 -- 172.21.15.146:0/1105621332 shutdown_connections 2024-09-18T01:45:23.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.551+0000 7fda51034800 1 -- 172.21.15.146:0/1105621332 wait complete. 2024-09-18T01:45:23.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.552+0000 7fda51034800 1 Processor -- start 2024-09-18T01:45:23.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.552+0000 7fda51034800 1 -- start start 2024-09-18T01:45:23.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.552+0000 7fda51034800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562dcce21ee0 0x562dcce293b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.552+0000 7fda51034800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x562dcce22e80 con 0x562dcce21ee0 2024-09-18T01:45:23.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.552+0000 7fda4ca74640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562dcce21ee0 0x562dcce293b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.552+0000 7fda4ca74640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562dcce21ee0 0x562dcce293b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59680/0 (socket says 172.21.15.146:59680) 2024-09-18T01:45:23.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.552+0000 7fda4ca74640 1 -- 172.21.15.146:0/1126883107 learned_addr learned my addr 172.21.15.146:0/1126883107 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:23.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.552+0000 7fda4ca74640 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562dcce298f0 con 0x562dcce21ee0 2024-09-18T01:45:23.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.553+0000 7fda4ca74640 1 --2- 172.21.15.146:0/1126883107 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562dcce21ee0 0x562dcce293b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fda4404c8f0 tx=0x7fda4404c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.553+0000 7fd921ffb640 1 -- 172.21.15.146:0/1126883107 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda44046040 con 0x562dcce21ee0 2024-09-18T01:45:23.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.553+0000 7fda51034800 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562dcce29b80 con 0x562dcce21ee0 2024-09-18T01:45:23.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.553+0000 7fd921ffb640 1 -- 172.21.15.146:0/1126883107 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda44041050 con 0x562dcce21ee0 2024-09-18T01:45:23.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.553+0000 7fda51034800 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562dcce2c830 con 0x562dcce21ee0 2024-09-18T01:45:23.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.553+0000 7fd921ffb640 1 -- 172.21.15.146:0/1126883107 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda44013c70 con 0x562dcce21ee0 2024-09-18T01:45:23.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.553+0000 7fd921ffb640 1 -- 172.21.15.146:0/1126883107 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fda4402aa60 con 0x562dcce21ee0 2024-09-18T01:45:23.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.554+0000 7fd921ffb640 1 --2- 172.21.15.146:0/1126883107 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd914036b40 0x7fd914039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.554+0000 7fd921ffb640 1 -- 172.21.15.146:0/1126883107 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fda44034070 con 0x562dcce21ee0 2024-09-18T01:45:23.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.554+0000 7fda4c273640 1 --2- 172.21.15.146:0/1126883107 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd914036b40 0x7fd914039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.554+0000 7fda51034800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.554+0000 7fda51034800 1 --2- 172.21.15.146:0/1126883107 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x562dcce34fa0 0x562dcce37460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.554+0000 7fda51034800 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562dcce37bb0 con 0x562dcce34fa0 2024-09-18T01:45:23.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.554+0000 7fda4ba72640 1 --2- 172.21.15.146:0/1126883107 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x562dcce34fa0 0x562dcce37460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.554+0000 7fda4c273640 1 --2- 172.21.15.146:0/1126883107 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd914036b40 0x7fd914039000 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fda3c04bfd0 tx=0x7fda3c042000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.554+0000 7fda4ba72640 1 --2- 172.21.15.146:0/1126883107 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x562dcce34fa0 0x562dcce37460 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.555+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda34057030 con 0x562dcce34fa0 2024-09-18T01:45:23.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.555+0000 7fda51034800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.555+0000 7fda51034800 20 realm 2024-09-18T01:45:23.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.555+0000 7fda51034800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.555+0000 7fda51034800 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562dcce37fe0 con 0x562dcce34fa0 2024-09-18T01:45:23.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.555+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda34057030 con 0x562dcce34fa0 2024-09-18T01:45:23.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.555+0000 7fda51034800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.555+0000 7fda51034800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:23.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.555+0000 7fda51034800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.555+0000 7fda51034800 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562dcce388b0 con 0x562dcce34fa0 2024-09-18T01:45:23.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.555+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda34057030 con 0x562dcce34fa0 2024-09-18T01:45:23.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.555+0000 7fda51034800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.555+0000 7fda51034800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.555+0000 7fda51034800 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562dcce38c50 con 0x562dcce34fa0 2024-09-18T01:45:23.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.555+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fda34057030 con 0x562dcce34fa0 2024-09-18T01:45:23.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.555+0000 7fda51034800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:23.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.555+0000 7fda51034800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.555+0000 7fda51034800 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562dcce384c0 con 0x562dcce34fa0 2024-09-18T01:45:23.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.556+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fda34057030 con 0x562dcce34fa0 2024-09-18T01:45:23.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.556+0000 7fda51034800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:23.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.556+0000 7fda51034800 20 searching for the correct realm 2024-09-18T01:45:23.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.556+0000 7fda51034800 1 --2- 172.21.15.146:0/1126883107 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x562dcce3b0b0 0x562dcce3d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.556+0000 7fda51034800 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562dcce3dbf0 con 0x562dcce3b0b0 2024-09-18T01:45:23.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.556+0000 7fda4ca74640 1 --2- 172.21.15.146:0/1126883107 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x562dcce3b0b0 0x562dcce3d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.556+0000 7fda4ca74640 1 --2- 172.21.15.146:0/1126883107 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x562dcce3b0b0 0x562dcce3d520 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.556+0000 7fda4ca74640 1 -- 172.21.15.146:0/1126883107 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda4403e020 con 0x562dcce3b0b0 2024-09-18T01:45:23.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.556+0000 7fda4ca74640 1 --2- 172.21.15.146:0/1126883107 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fda4405b040 0x7fda44014030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.556+0000 7fda4ca74640 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562dcce3dbf0 con 0x7fda4405b040 2024-09-18T01:45:23.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.557+0000 7fda4c273640 1 --2- 172.21.15.146:0/1126883107 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fda4405b040 0x7fda44014030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.557+0000 7fda4c273640 1 --2- 172.21.15.146:0/1126883107 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fda4405b040 0x7fda44014030 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.557+0000 7fda4c273640 1 -- 172.21.15.146:0/1126883107 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda3c02e070 con 0x7fda4405b040 2024-09-18T01:45:23.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.557+0000 7fda4c273640 1 --2- 172.21.15.146:0/1126883107 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fda3c00f070 0x7fda3c019860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.557+0000 7fda4c273640 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562dcce3dbf0 con 0x7fda3c00f070 2024-09-18T01:45:23.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.557+0000 7fda4ba72640 1 --2- 172.21.15.146:0/1126883107 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fda3c00f070 0x7fda3c019860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.558+0000 7fda4ba72640 1 --2- 172.21.15.146:0/1126883107 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fda3c00f070 0x7fda3c019860 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.558+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda34057030 con 0x7fda3c00f070 2024-09-18T01:45:23.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.558+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562dcce3dbf0 con 0x562dcce34fa0 2024-09-18T01:45:23.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.558+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fda34057030 con 0x562dcce34fa0 2024-09-18T01:45:23.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.558+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562dcce3dbf0 con 0x562dcce34fa0 2024-09-18T01:45:23.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.558+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda34057030 con 0x562dcce34fa0 2024-09-18T01:45:23.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.558+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562dcce3dbf0 con 0x7fda3c00f070 2024-09-18T01:45:23.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.559+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda34057030 con 0x7fda3c00f070 2024-09-18T01:45:23.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.559+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562dcce3dbf0 con 0x7fda3c00f070 2024-09-18T01:45:23.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.559+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda34057030 con 0x7fda3c00f070 2024-09-18T01:45:23.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.559+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562dcce3dbf0 con 0x7fda4405b040 2024-09-18T01:45:23.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.559+0000 7fda4c273640 1 -- 172.21.15.146:0/1126883107 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda3c02e070 con 0x7fda4405b040 2024-09-18T01:45:23.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.559+0000 7fda4c273640 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562dcce3dbf0 con 0x562dcce3b0b0 2024-09-18T01:45:23.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.559+0000 7fda4ca74640 1 -- 172.21.15.146:0/1126883107 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda4403e020 con 0x562dcce3b0b0 2024-09-18T01:45:23.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.559+0000 7fda4ca74640 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562dcce3dbf0 con 0x562dcce34fa0 2024-09-18T01:45:23.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.559+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda34057030 con 0x562dcce34fa0 2024-09-18T01:45:23.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.559+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562dcce3dbf0 con 0x7fda3c00f070 2024-09-18T01:45:23.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.560+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda34057030 con 0x7fda3c00f070 2024-09-18T01:45:23.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.560+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562dcce3dbf0 con 0x562dcce34fa0 2024-09-18T01:45:23.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.560+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda34057030 con 0x562dcce34fa0 2024-09-18T01:45:23.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.560+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562dcce3dbf0 con 0x7fda4405b040 2024-09-18T01:45:23.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.560+0000 7fda4c273640 1 -- 172.21.15.146:0/1126883107 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fda3c02e070 con 0x7fda4405b040 2024-09-18T01:45:23.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.560+0000 7fda4c273640 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562dcce3dbf0 con 0x562dcce3b0b0 2024-09-18T01:45:23.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.560+0000 7fda4ca74640 1 -- 172.21.15.146:0/1126883107 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda4403e020 con 0x562dcce3b0b0 2024-09-18T01:45:23.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.560+0000 7fda4ca74640 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562dcce3dbf0 con 0x562dcce3b0b0 2024-09-18T01:45:23.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.561+0000 7fda4ca74640 1 -- 172.21.15.146:0/1126883107 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda4403e020 con 0x562dcce3b0b0 2024-09-18T01:45:23.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.561+0000 7fda4ca74640 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562dcce3dbf0 con 0x7fda3c00f070 2024-09-18T01:45:23.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.561+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda34057030 con 0x7fda3c00f070 2024-09-18T01:45:23.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.561+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562dcce3dbf0 con 0x562dcce3b0b0 2024-09-18T01:45:23.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.561+0000 7fda4ca74640 1 -- 172.21.15.146:0/1126883107 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda4403e020 con 0x562dcce3b0b0 2024-09-18T01:45:23.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.561+0000 7fda4ca74640 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562dcce3dbf0 con 0x562dcce3b0b0 2024-09-18T01:45:23.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.561+0000 7fda4ca74640 1 -- 172.21.15.146:0/1126883107 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda4403e020 con 0x562dcce3b0b0 2024-09-18T01:45:23.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.561+0000 7fda4ca74640 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562dcce3dbf0 con 0x562dcce34fa0 2024-09-18T01:45:23.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.562+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda34057030 con 0x562dcce34fa0 2024-09-18T01:45:23.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.562+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562dcce3dbf0 con 0x562dcce34fa0 2024-09-18T01:45:23.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.562+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fda34057030 con 0x562dcce34fa0 2024-09-18T01:45:23.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.562+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562dcce3dbf0 con 0x7fda3c00f070 2024-09-18T01:45:23.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.562+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda34057030 con 0x7fda3c00f070 2024-09-18T01:45:23.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.562+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562dcce3dbf0 con 0x562dcce3b0b0 2024-09-18T01:45:23.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.562+0000 7fda4ca74640 1 -- 172.21.15.146:0/1126883107 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda4403e020 con 0x562dcce3b0b0 2024-09-18T01:45:23.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.562+0000 7fda4ca74640 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562dcce3dbf0 con 0x7fda4405b040 2024-09-18T01:45:23.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.563+0000 7fda4c273640 1 -- 172.21.15.146:0/1126883107 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda3c02e070 con 0x7fda4405b040 2024-09-18T01:45:23.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.563+0000 7fda4c273640 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562dcce3dbf0 con 0x562dcce34fa0 2024-09-18T01:45:23.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.563+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda34057030 con 0x562dcce34fa0 2024-09-18T01:45:23.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.563+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562dcce3dbf0 con 0x7fda3c00f070 2024-09-18T01:45:23.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.563+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda34057030 con 0x7fda3c00f070 2024-09-18T01:45:23.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.563+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562dcce3dbf0 con 0x562dcce3b0b0 2024-09-18T01:45:23.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.564+0000 7fda4ca74640 1 -- 172.21.15.146:0/1126883107 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda4403e020 con 0x562dcce3b0b0 2024-09-18T01:45:23.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.564+0000 7fda4ca74640 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562dcce3dbf0 con 0x7fda3c00f070 2024-09-18T01:45:23.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.564+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda34057030 con 0x7fda3c00f070 2024-09-18T01:45:23.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.564+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562dcce3dbf0 con 0x7fda4405b040 2024-09-18T01:45:23.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.564+0000 7fda4c273640 1 -- 172.21.15.146:0/1126883107 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda3c02e070 con 0x7fda4405b040 2024-09-18T01:45:23.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.564+0000 7fda4c273640 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562dcce3dbf0 con 0x562dcce3b0b0 2024-09-18T01:45:23.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.564+0000 7fda4ca74640 1 -- 172.21.15.146:0/1126883107 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda4403e020 con 0x562dcce3b0b0 2024-09-18T01:45:23.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.564+0000 7fda4ca74640 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562dcce3dbf0 con 0x7fda3c00f070 2024-09-18T01:45:23.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.565+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda34057030 con 0x7fda3c00f070 2024-09-18T01:45:23.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.565+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562dcce3dbf0 con 0x562dcce34fa0 2024-09-18T01:45:23.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.565+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fda34057030 con 0x562dcce34fa0 2024-09-18T01:45:23.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.565+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562dcce3dbf0 con 0x7fda4405b040 2024-09-18T01:45:23.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.565+0000 7fda4c273640 1 -- 172.21.15.146:0/1126883107 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda3c05f040 con 0x7fda4405b040 2024-09-18T01:45:23.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.565+0000 7fda51034800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:23.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.565+0000 7fda51034800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:23.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.565+0000 7fda51034800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:23.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.565+0000 7fda51034800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:23.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.565+0000 7fda51034800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:23.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.565+0000 7fda51034800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:23.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.565+0000 7fda51034800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.565+0000 7fda51034800 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562dcce39b30 con 0x562dcce34fa0 2024-09-18T01:45:23.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.565+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda34057030 con 0x562dcce34fa0 2024-09-18T01:45:23.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.565+0000 7fda51034800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.565+0000 7fda51034800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.565+0000 7fda51034800 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562dcce39770 con 0x562dcce34fa0 2024-09-18T01:45:23.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.566+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fda34057030 con 0x562dcce34fa0 2024-09-18T01:45:23.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.566+0000 7fda51034800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:23.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.566+0000 7fda51034800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.566+0000 7fda51034800 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562dcce3a4d0 con 0x7fda4405b040 2024-09-18T01:45:23.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.566+0000 7fda4c273640 1 -- 172.21.15.146:0/1126883107 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fda3c05f040 con 0x7fda4405b040 2024-09-18T01:45:23.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.566+0000 7fda51034800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:23.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.566+0000 7fda51034800 20 zone default found 2024-09-18T01:45:23.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.566+0000 7fda51034800 4 Realm: () 2024-09-18T01:45:23.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.566+0000 7fda51034800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:23.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.566+0000 7fda51034800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:23.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.566+0000 7fda51034800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:23.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.566+0000 7fda51034800 20 zonegroup default 2024-09-18T01:45:23.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.566+0000 7fda51034800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.566+0000 7fda51034800 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562dcce3e520 con 0x7fda3c00f070 2024-09-18T01:45:23.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.566+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fda34057030 con 0x7fda3c00f070 2024-09-18T01:45:23.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.566+0000 7fda51034800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.566+0000 7fda51034800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.566+0000 7fda51034800 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562dcce40050 con 0x562dcce3b0b0 2024-09-18T01:45:23.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.566+0000 7fda4ca74640 1 -- 172.21.15.146:0/1126883107 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fda4403e020 con 0x562dcce3b0b0 2024-09-18T01:45:23.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.567+0000 7fda51034800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.567+0000 7fda51034800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.567+0000 7fda51034800 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562dcce40510 con 0x562dcce3b0b0 2024-09-18T01:45:23.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.567+0000 7fda4ca74640 1 -- 172.21.15.146:0/1126883107 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fda4403e020 con 0x562dcce3b0b0 2024-09-18T01:45:23.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.567+0000 7fda51034800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.567+0000 7fda51034800 20 started sync module instance, tier type = 2024-09-18T01:45:23.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.567+0000 7fda51034800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:23.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.567+0000 7fda51034800 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562dcce3ef50 con 0x7fda4405b040 2024-09-18T01:45:23.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.568+0000 7fda4c273640 1 -- 172.21.15.146:0/1126883107 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v31'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda3c05f040 con 0x7fda4405b040 2024-09-18T01:45:23.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.568+0000 7fda51034800 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94754711008064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562dcce3ebb0 con 0x7fda4405b040 2024-09-18T01:45:23.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.568+0000 7fda51034800 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562dcce41440 con 0x562dcce34fa0 2024-09-18T01:45:23.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.569+0000 7fda4c273640 1 -- 172.21.15.146:0/1126883107 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94754711008064] v31'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda3c05f040 con 0x7fda4405b040 2024-09-18T01:45:23.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.569+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v31'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda34057030 con 0x562dcce34fa0 2024-09-18T01:45:23.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.569+0000 7fda51034800 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94754711015312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562dcce413b0 con 0x562dcce34fa0 2024-09-18T01:45:23.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.569+0000 7fda51034800 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562dcce42300 con 0x562dcce3b0b0 2024-09-18T01:45:23.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.570+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94754711015312] v31'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda34057030 con 0x562dcce34fa0 2024-09-18T01:45:23.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.570+0000 7fda4ca74640 1 -- 172.21.15.146:0/1126883107 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v31'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda4403e020 con 0x562dcce3b0b0 2024-09-18T01:45:23.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.570+0000 7fda51034800 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94754711017520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562dcce42300 con 0x562dcce3b0b0 2024-09-18T01:45:23.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.570+0000 7fda51034800 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562dcce42d50 con 0x7fda4405b040 2024-09-18T01:45:23.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.571+0000 7fda4ca74640 1 -- 172.21.15.146:0/1126883107 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94754711017520] v31'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda4403e020 con 0x562dcce3b0b0 2024-09-18T01:45:23.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.571+0000 7fda4c273640 1 -- 172.21.15.146:0/1126883107 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v31'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda3c05f040 con 0x7fda4405b040 2024-09-18T01:45:23.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.571+0000 7fda51034800 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94754711019088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562dcce42270 con 0x7fda4405b040 2024-09-18T01:45:23.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.571+0000 7fda51034800 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562dcce43c10 con 0x562dcce34fa0 2024-09-18T01:45:23.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.572+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v31'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda34057030 con 0x562dcce34fa0 2024-09-18T01:45:23.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.572+0000 7fda51034800 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94754711026016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562dcce444b0 con 0x562dcce34fa0 2024-09-18T01:45:23.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.572+0000 7fda51034800 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562dcce44f60 con 0x7fda3c00f070 2024-09-18T01:45:23.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.572+0000 7fda4c273640 1 -- 172.21.15.146:0/1126883107 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94754711019088] v31'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda3c05f040 con 0x7fda4405b040 2024-09-18T01:45:23.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.573+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v31'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda34057030 con 0x7fda3c00f070 2024-09-18T01:45:23.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.573+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94754711026016] v31'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda34057030 con 0x562dcce34fa0 2024-09-18T01:45:23.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.573+0000 7fda51034800 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94754711023936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562dcce44f60 con 0x7fda3c00f070 2024-09-18T01:45:23.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.573+0000 7fda51034800 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562dcce454c0 con 0x7fda3c00f070 2024-09-18T01:45:23.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.574+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(56 notify.6 [create] v31'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda34057030 con 0x7fda3c00f070 2024-09-18T01:45:23.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.574+0000 7fda51034800 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94754711027680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562dcce45970 con 0x7fda3c00f070 2024-09-18T01:45:23.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.574+0000 7fda51034800 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562dcce46330 con 0x7fda3c00f070 2024-09-18T01:45:23.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.574+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94754711023936] v31'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda34057030 con 0x7fda3c00f070 2024-09-18T01:45:23.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.575+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94754711027680] v31'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda34057030 con 0x7fda3c00f070 2024-09-18T01:45:23.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.575+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v31'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda34057030 con 0x7fda3c00f070 2024-09-18T01:45:23.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.575+0000 7fda51034800 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94754711033024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562dcce458e0 con 0x7fda3c00f070 2024-09-18T01:45:23.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.575+0000 7fda51034800 20 add_watcher() i=0 2024-09-18T01:45:23.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.575+0000 7fda51034800 20 add_watcher() i=1 2024-09-18T01:45:23.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.575+0000 7fda51034800 20 add_watcher() i=2 2024-09-18T01:45:23.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.575+0000 7fda51034800 20 add_watcher() i=3 2024-09-18T01:45:23.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.575+0000 7fda51034800 20 add_watcher() i=4 2024-09-18T01:45:23.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.575+0000 7fda51034800 20 add_watcher() i=5 2024-09-18T01:45:23.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.575+0000 7fda51034800 20 add_watcher() i=6 2024-09-18T01:45:23.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.576+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94754711033024] v31'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda34057030 con 0x7fda3c00f070 2024-09-18T01:45:23.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.576+0000 7fda51034800 20 add_watcher() i=7 2024-09-18T01:45:23.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.576+0000 7fda51034800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:23.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.576+0000 7fda51034800 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562dcce49360 con 0x562dcce34fa0 2024-09-18T01:45:23.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.576+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fda34057030 con 0x562dcce34fa0 2024-09-18T01:45:23.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.576+0000 7fda51034800 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94754711035520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562dcce46750 con 0x562dcce34fa0 2024-09-18T01:45:23.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.577+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94754711035520] v31'64 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fda34057030 con 0x562dcce34fa0 2024-09-18T01:45:23.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.578+0000 7fd902fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:23.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.578+0000 7fda51034800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:23.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.578+0000 7fda51034800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:23.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.578+0000 7fda51034800 5 note: GC not initialized 2024-09-18T01:45:23.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.578+0000 7fd901fe3640 20 reqs_thread_entry: start 2024-09-18T01:45:23.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.578+0000 7fda51034800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:23.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.578+0000 7fda51034800 20 Filter name: none 2024-09-18T01:45:23.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.578+0000 7fd8faffd640 20 reqs_thread_entry: start 2024-09-18T01:45:23.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.578+0000 7fda51034800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.578+0000 7fda51034800 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562dcce7c040 con 0x562dcce34fa0 2024-09-18T01:45:23.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.579+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fda34057030 con 0x562dcce34fa0 2024-09-18T01:45:23.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.579+0000 7fda51034800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:45:23.590 INFO:teuthology.orchestra.run.smithi146.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T01:45:23.010714Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:45:23.010705Z","tags":[],"group_ids":[]} 2024-09-18T01:45:23.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.580+0000 7fd902fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:23.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.580+0000 7fda51034800 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94754711035520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562dcce7a9c0 con 0x562dcce34fa0 2024-09-18T01:45:23.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.581+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94754711035520] v31'65 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fda34057030 con 0x562dcce34fa0 2024-09-18T01:45:23.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.581+0000 7fda51034800 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94754711008064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562dcce45e80 con 0x7fda4405b040 2024-09-18T01:45:23.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.582+0000 7fda4c273640 1 -- 172.21.15.146:0/1126883107 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94754711008064] v31'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda3c05f040 con 0x7fda4405b040 2024-09-18T01:45:23.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.582+0000 7fda51034800 20 remove_watcher() i=0 2024-09-18T01:45:23.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.582+0000 7fda51034800 2 removed watcher, disabling cache 2024-09-18T01:45:23.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.582+0000 7fda51034800 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94754711015312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562dcce45e80 con 0x562dcce34fa0 2024-09-18T01:45:23.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.583+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94754711015312] v31'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda34057030 con 0x562dcce34fa0 2024-09-18T01:45:23.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.583+0000 7fda51034800 20 remove_watcher() i=1 2024-09-18T01:45:23.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.583+0000 7fda51034800 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94754711017520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562dcce40f90 con 0x562dcce3b0b0 2024-09-18T01:45:23.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.584+0000 7fda4ca74640 1 -- 172.21.15.146:0/1126883107 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94754711017520] v31'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda4403e020 con 0x562dcce3b0b0 2024-09-18T01:45:23.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.584+0000 7fda51034800 20 remove_watcher() i=2 2024-09-18T01:45:23.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.584+0000 7fda51034800 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94754711019088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562dcce45e80 con 0x7fda4405b040 2024-09-18T01:45:23.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.585+0000 7fda4c273640 1 -- 172.21.15.146:0/1126883107 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94754711019088] v31'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda3c05f040 con 0x7fda4405b040 2024-09-18T01:45:23.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.585+0000 7fda51034800 20 remove_watcher() i=3 2024-09-18T01:45:23.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.585+0000 7fda51034800 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94754711026016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562dcce40f90 con 0x562dcce34fa0 2024-09-18T01:45:23.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.586+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94754711026016] v31'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda34057030 con 0x562dcce34fa0 2024-09-18T01:45:23.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.586+0000 7fda51034800 20 remove_watcher() i=4 2024-09-18T01:45:23.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.586+0000 7fda51034800 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94754711023936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562dcce40f90 con 0x7fda3c00f070 2024-09-18T01:45:23.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.587+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94754711023936] v31'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda34057030 con 0x7fda3c00f070 2024-09-18T01:45:23.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.587+0000 7fda51034800 20 remove_watcher() i=5 2024-09-18T01:45:23.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.587+0000 7fda51034800 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94754711027680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562dcce40f90 con 0x7fda3c00f070 2024-09-18T01:45:23.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.588+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94754711027680] v31'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda34057030 con 0x7fda3c00f070 2024-09-18T01:45:23.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.588+0000 7fda51034800 20 remove_watcher() i=6 2024-09-18T01:45:23.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.588+0000 7fda51034800 1 -- 172.21.15.146:0/1126883107 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94754711033024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562dcce40f90 con 0x7fda3c00f070 2024-09-18T01:45:23.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.588+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94754711033024] v31'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda34057030 con 0x7fda3c00f070 2024-09-18T01:45:23.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.588+0000 7fda51034800 20 remove_watcher() i=7 2024-09-18T01:45:23.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.589+0000 7fda51034800 1 -- 172.21.15.146:0/1126883107 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fda3c00f070 msgr2=0x7fda3c019860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.589+0000 7fda51034800 1 --2- 172.21.15.146:0/1126883107 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fda3c00f070 0x7fda3c019860 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.589+0000 7fda51034800 1 -- 172.21.15.146:0/1126883107 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x562dcce34fa0 msgr2=0x562dcce37460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.589+0000 7fda51034800 1 --2- 172.21.15.146:0/1126883107 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x562dcce34fa0 0x562dcce37460 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.589+0000 7fda51034800 1 -- 172.21.15.146:0/1126883107 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fda4405b040 msgr2=0x7fda44014030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.589+0000 7fda51034800 1 --2- 172.21.15.146:0/1126883107 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fda4405b040 0x7fda44014030 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.589+0000 7fda51034800 1 -- 172.21.15.146:0/1126883107 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x562dcce3b0b0 msgr2=0x562dcce3d520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.589+0000 7fda51034800 1 --2- 172.21.15.146:0/1126883107 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x562dcce3b0b0 0x562dcce3d520 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.589+0000 7fda51034800 1 -- 172.21.15.146:0/1126883107 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd914036b40 msgr2=0x7fd914039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.589+0000 7fda51034800 1 --2- 172.21.15.146:0/1126883107 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd914036b40 0x7fd914039000 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fda3c04bfd0 tx=0x7fda3c042000 comp rx=0 tx=0).stop 2024-09-18T01:45:23.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.589+0000 7fda51034800 1 -- 172.21.15.146:0/1126883107 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562dcce21ee0 msgr2=0x562dcce293b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.589+0000 7fda4ba72640 1 -- 172.21.15.146:0/1126883107 reap_dead start 2024-09-18T01:45:23.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.589+0000 7fda51034800 1 --2- 172.21.15.146:0/1126883107 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562dcce21ee0 0x562dcce293b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fda4404c8f0 tx=0x7fda4404c880 comp rx=0 tx=0).stop 2024-09-18T01:45:23.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.589+0000 7fda51034800 1 -- 172.21.15.146:0/1126883107 shutdown_connections 2024-09-18T01:45:23.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.589+0000 7fda51034800 1 --2- 172.21.15.146:0/1126883107 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562dcce21ee0 0x562dcce293b0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.589+0000 7fda51034800 1 -- 172.21.15.146:0/1126883107 >> 172.21.15.146:0/1126883107 conn(0x562dcce1e240 msgr2=0x562dcce1c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:23.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.589+0000 7fda51034800 1 -- 172.21.15.146:0/1126883107 shutdown_connections 2024-09-18T01:45:23.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.589+0000 7fda51034800 1 -- 172.21.15.146:0/1126883107 wait complete. 2024-09-18T01:45:23.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.589+0000 7fda51034800 1 -- 172.21.15.146:0/1826445822 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd924036b40 msgr2=0x7fd924039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.589+0000 7fda51034800 1 --2- 172.21.15.146:0/1826445822 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd924036b40 0x7fd924039000 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fda3c0176e0 tx=0x7fda3c04b740 comp rx=0 tx=0).stop 2024-09-18T01:45:23.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.589+0000 7fda51034800 1 -- 172.21.15.146:0/1826445822 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562dcce15240 msgr2=0x562dcce15660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.589+0000 7fda51034800 1 --2- 172.21.15.146:0/1826445822 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562dcce15240 0x562dcce15660 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x562dccdfb100 tx=0x7fda440178e0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.589+0000 7fda51034800 1 -- 172.21.15.146:0/1826445822 shutdown_connections 2024-09-18T01:45:23.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.589+0000 7fda51034800 1 --2- 172.21.15.146:0/1826445822 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd924036b40 0x7fd924039000 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.589+0000 7fda51034800 1 --2- 172.21.15.146:0/1826445822 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562dcce15240 0x562dcce15660 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.589+0000 7fda51034800 1 -- 172.21.15.146:0/1826445822 >> 172.21.15.146:0/1826445822 conn(0x562dcce0a1d0 msgr2=0x562dcce0cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:23.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.589+0000 7fda51034800 1 -- 172.21.15.146:0/1826445822 shutdown_connections 2024-09-18T01:45:23.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.589+0000 7fda51034800 1 -- 172.21.15.146:0/1826445822 wait complete. 2024-09-18T01:45:23.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.590+0000 7fda51034800 1 -- 172.21.15.146:0/3711175195 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x562dccd04990 msgr2=0x562dcce01520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.590+0000 7fda51034800 1 --2- 172.21.15.146:0/3711175195 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x562dccd04990 0x562dcce01520 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.590+0000 7fda51034800 1 -- 172.21.15.146:0/3711175195 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x562dcce04c90 msgr2=0x562dcce07080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.590+0000 7fda51034800 1 --2- 172.21.15.146:0/3711175195 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x562dcce04c90 0x562dcce07080 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.590+0000 7fda51034800 1 -- 172.21.15.146:0/3711175195 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd934036b40 msgr2=0x7fd934039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.590+0000 7fda51034800 1 --2- 172.21.15.146:0/3711175195 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd934036b40 0x7fd934039000 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fda34057000 tx=0x7fda34052000 comp rx=0 tx=0).stop 2024-09-18T01:45:23.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.590+0000 7fda51034800 1 -- 172.21.15.146:0/3711175195 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562dccd00550 msgr2=0x562dccdfa4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.590+0000 7fda51034800 1 --2- 172.21.15.146:0/3711175195 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562dccd00550 0x562dccdfa4b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fda3c000c00 tx=0x7fda3c000ed0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.590+0000 7fda51034800 1 -- 172.21.15.146:0/3711175195 shutdown_connections 2024-09-18T01:45:23.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.590+0000 7fda51034800 1 --2- 172.21.15.146:0/3711175195 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x562dcce04c90 0x562dcce07080 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.590+0000 7fda51034800 1 --2- 172.21.15.146:0/3711175195 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x562dccd04990 0x562dcce01520 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.590+0000 7fda51034800 1 --2- 172.21.15.146:0/3711175195 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd934036b40 0x7fd934039000 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.590+0000 7fda51034800 1 --2- 172.21.15.146:0/3711175195 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562dccd00550 0x562dccdfa4b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.590+0000 7fda51034800 1 -- 172.21.15.146:0/3711175195 >> 172.21.15.146:0/3711175195 conn(0x562dcccfbde0 msgr2=0x562dccde99d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:23.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.590+0000 7fda51034800 1 -- 172.21.15.146:0/3711175195 shutdown_connections 2024-09-18T01:45:23.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.590+0000 7fda51034800 1 -- 172.21.15.146:0/3711175195 wait complete. 2024-09-18T01:45:23.601 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T01:45:23.010714Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:45:23.010705Z', 'tags': [], 'group_ids': []} 2024-09-18T01:45:23.601 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-18T01:45:23.601 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-18T01:45:23.601 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-18T01:45:23.645 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:23.645 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:23.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.645+0000 7ff8b8121800 1 Processor -- start 2024-09-18T01:45:23.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.645+0000 7ff8b8121800 1 -- start start 2024-09-18T01:45:23.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.646+0000 7ff8b8121800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x557d2a7e4d90 0x557d2a7e7180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.646+0000 7ff8b8121800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557d2a69db30 con 0x557d2a752610 2024-09-18T01:45:23.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.646+0000 7ff8b8121800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x557d2a67f360 con 0x557d2a7e4d90 2024-09-18T01:45:23.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.646+0000 7ff8b364d640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x557d2a7e4d90 0x557d2a7e7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.646+0000 7ff8b364d640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x557d2a7e4d90 0x557d2a7e7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59696/0 (socket says 172.21.15.146:59696) 2024-09-18T01:45:23.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.646+0000 7ff8b3e4e640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x557d2a752610 0x557d2a7e3670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:38736/0 (socket says 172.21.15.146:38736) 2024-09-18T01:45:23.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.646+0000 7ff8b364d640 1 -- 172.21.15.146:0/1531580329 learned_addr learned my addr 172.21.15.146:0/1531580329 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:23.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.646+0000 7ff8b364d640 1 -- 172.21.15.146:0/1531580329 >> v1:172.21.15.129:6789/0 conn(0x557d2a752610 legacy=0x557d2a7e3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.646+0000 7ff8b364d640 1 -- 172.21.15.146:0/1531580329 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d2a6a5e00 con 0x557d2a7e4d90 2024-09-18T01:45:23.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.646+0000 7ff8b2e4c640 1 -- 172.21.15.146:0/1531580329 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2124202843 0 0) 0x557d2a69db30 con 0x557d2a752610 2024-09-18T01:45:23.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.648+0000 7ff8b364d640 1 --2- 172.21.15.146:0/1531580329 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557d2a7e4d90 0x557d2a7e7180 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff8a800a520 tx=0x7ff8a8045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51f65c4a427227b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.648+0000 7ff8b2e4c640 1 -- 172.21.15.146:0/1531580329 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8a8055070 con 0x557d2a7e4d90 2024-09-18T01:45:23.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.648+0000 7ff8b2e4c640 1 -- 172.21.15.146:0/1531580329 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8a80515b0 con 0x557d2a7e4d90 2024-09-18T01:45:23.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.648+0000 7ff8b2e4c640 1 -- 172.21.15.146:0/1531580329 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8a80518d0 con 0x557d2a7e4d90 2024-09-18T01:45:23.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.649+0000 7ff8b8121800 1 -- 172.21.15.146:0/1531580329 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557d2a7e4d90 msgr2=0x557d2a7e7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.649+0000 7ff8b8121800 1 --2- 172.21.15.146:0/1531580329 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557d2a7e4d90 0x557d2a7e7180 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff8a800a520 tx=0x7ff8a8045ba0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.649+0000 7ff8b8121800 1 -- 172.21.15.146:0/1531580329 shutdown_connections 2024-09-18T01:45:23.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.649+0000 7ff8b8121800 1 --2- 172.21.15.146:0/1531580329 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557d2a7e4d90 0x557d2a7e7180 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.649+0000 7ff8b8121800 1 -- 172.21.15.146:0/1531580329 >> 172.21.15.146:0/1531580329 conn(0x557d2a7d8de0 msgr2=0x557d2a7db200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:23.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.649+0000 7ff8b8121800 1 -- 172.21.15.146:0/1531580329 shutdown_connections 2024-09-18T01:45:23.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.649+0000 7ff8b8121800 1 -- 172.21.15.146:0/1531580329 wait complete. 2024-09-18T01:45:23.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.662+0000 7ff8b8121800 1 Processor -- start 2024-09-18T01:45:23.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.663+0000 7ff8b8121800 1 -- start start 2024-09-18T01:45:23.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.663+0000 7ff8b8121800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557d2a752610 0x557d2a8cf890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.663+0000 7ff8b8121800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x557d2a72a330 con 0x557d2a752610 2024-09-18T01:45:23.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.663+0000 7ff8b3e4e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557d2a752610 0x557d2a8cf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.663+0000 7ff8b3e4e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557d2a752610 0x557d2a8cf890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59708/0 (socket says 172.21.15.146:59708) 2024-09-18T01:45:23.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.663+0000 7ff8b3e4e640 1 -- 172.21.15.146:0/394263790 learned_addr learned my addr 172.21.15.146:0/394263790 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:23.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.663+0000 7ff8b3e4e640 1 -- 172.21.15.146:0/394263790 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d2a677bc0 con 0x557d2a752610 2024-09-18T01:45:23.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.664+0000 7ff8b3e4e640 1 --2- 172.21.15.146:0/394263790 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557d2a752610 0x557d2a8cf890 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4001660 tx=0x7ff8a4001b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3845dffe85d2b816 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.664+0000 7ff7a1e0b640 1 -- 172.21.15.146:0/394263790 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8a4003450 con 0x557d2a752610 2024-09-18T01:45:23.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.664+0000 7ff7a1e0b640 1 -- 172.21.15.146:0/394263790 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8a4003610 con 0x557d2a752610 2024-09-18T01:45:23.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.664+0000 7ff7a1e0b640 1 -- 172.21.15.146:0/394263790 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8a40039b0 con 0x557d2a752610 2024-09-18T01:45:23.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.664+0000 7ff8b8121800 1 -- 172.21.15.146:0/394263790 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557d2a752610 msgr2=0x557d2a8cf890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.664+0000 7ff8b8121800 1 --2- 172.21.15.146:0/394263790 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557d2a752610 0x557d2a8cf890 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4001660 tx=0x7ff8a4001b20 comp rx=0 tx=0).stop 2024-09-18T01:45:23.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.664+0000 7ff8b8121800 1 -- 172.21.15.146:0/394263790 shutdown_connections 2024-09-18T01:45:23.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.664+0000 7ff8b8121800 1 --2- 172.21.15.146:0/394263790 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557d2a752610 0x557d2a8cf890 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.664+0000 7ff8b8121800 1 -- 172.21.15.146:0/394263790 >> 172.21.15.146:0/394263790 conn(0x557d2a7d8de0 msgr2=0x557d2a8cb250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:23.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.664+0000 7ff8b8121800 1 -- 172.21.15.146:0/394263790 shutdown_connections 2024-09-18T01:45:23.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.664+0000 7ff8b8121800 1 -- 172.21.15.146:0/394263790 wait complete. 2024-09-18T01:45:23.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.665+0000 7ff8b8121800 1 Processor -- start 2024-09-18T01:45:23.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.665+0000 7ff8b8121800 1 -- start start 2024-09-18T01:45:23.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.665+0000 7ff8b8121800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557d2a752610 0x557d2a8d72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.665+0000 7ff8b8121800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x557d2a7e7990 con 0x557d2a752610 2024-09-18T01:45:23.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.665+0000 7ff8b3e4e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557d2a752610 0x557d2a8d72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.665+0000 7ff8b3e4e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557d2a752610 0x557d2a8d72b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59714/0 (socket says 172.21.15.146:59714) 2024-09-18T01:45:23.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.665+0000 7ff8b3e4e640 1 -- 172.21.15.146:0/1157822230 learned_addr learned my addr 172.21.15.146:0/1157822230 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:23.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.665+0000 7ff8b3e4e640 1 -- 172.21.15.146:0/1157822230 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d2a68bfe0 con 0x557d2a752610 2024-09-18T01:45:23.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.666+0000 7ff8b3e4e640 1 --2- 172.21.15.146:0/1157822230 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557d2a752610 0x557d2a8d72b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x557d2a8d06f0 tx=0x7ff8a4001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.666+0000 7ff79bfff640 1 -- 172.21.15.146:0/1157822230 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8a4025070 con 0x557d2a752610 2024-09-18T01:45:23.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.666+0000 7ff79bfff640 1 -- 172.21.15.146:0/1157822230 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8a4019040 con 0x557d2a752610 2024-09-18T01:45:23.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.666+0000 7ff8b8121800 1 -- 172.21.15.146:0/1157822230 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557d2a8d77f0 con 0x557d2a752610 2024-09-18T01:45:23.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.666+0000 7ff79bfff640 1 -- 172.21.15.146:0/1157822230 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8a4013970 con 0x557d2a752610 2024-09-18T01:45:23.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.666+0000 7ff8b8121800 1 -- 172.21.15.146:0/1157822230 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d2a8d7d70 con 0x557d2a752610 2024-09-18T01:45:23.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.666+0000 7ff79bfff640 1 -- 172.21.15.146:0/1157822230 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff8a4010070 con 0x557d2a752610 2024-09-18T01:45:23.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.667+0000 7ff79bfff640 1 --2- 172.21.15.146:0/1157822230 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff79c036b40 0x7ff79c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.667+0000 7ff79bfff640 1 -- 172.21.15.146:0/1157822230 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7ff8a404c100 con 0x557d2a752610 2024-09-18T01:45:23.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.667+0000 7ff8b364d640 1 --2- 172.21.15.146:0/1157822230 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff79c036b40 0x7ff79c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.667+0000 7ff8b8121800 1 --2- 172.21.15.146:0/1157822230 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x557d2a7e4d90 0x557d2a8de2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.667+0000 7ff8b8121800 1 -- 172.21.15.146:0/1157822230 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d2a8de8d0 con 0x557d2a7e4d90 2024-09-18T01:45:23.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.667+0000 7ff8b464f640 1 --2- 172.21.15.146:0/1157822230 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x557d2a7e4d90 0x557d2a8de2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.667+0000 7ff8b364d640 1 --2- 172.21.15.146:0/1157822230 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff79c036b40 0x7ff79c039000 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff8a8057000 tx=0x7ff8a8052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.667+0000 7ff8b464f640 1 --2- 172.21.15.146:0/1157822230 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x557d2a7e4d90 0x557d2a8de2d0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.667+0000 7ff8b464f640 1 -- 172.21.15.146:0/1157822230 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff8ac0083e0 con 0x557d2a7e4d90 2024-09-18T01:45:23.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.668+0000 7ff8b8121800 1 -- 172.21.15.146:0/1157822230 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d2a8db880 con 0x557d2a7e4d90 2024-09-18T01:45:23.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.668+0000 7ff8b464f640 1 -- 172.21.15.146:0/1157822230 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff8ac0083e0 con 0x557d2a7e4d90 2024-09-18T01:45:23.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.668+0000 7ff8b8121800 1 -- 172.21.15.146:0/1157822230 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d2a8e06f0 con 0x557d2a7e4d90 2024-09-18T01:45:23.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.668+0000 7ff8b464f640 1 -- 172.21.15.146:0/1157822230 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff8ac0083e0 con 0x557d2a7e4d90 2024-09-18T01:45:23.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.668+0000 7ff8b8121800 1 -- 172.21.15.146:0/1157822230 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d2a8df920 con 0x557d2a7e4d90 2024-09-18T01:45:23.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.668+0000 7ff8b464f640 1 -- 172.21.15.146:0/1157822230 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff8ac0083e0 con 0x557d2a7e4d90 2024-09-18T01:45:23.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.668+0000 7ff8b8121800 1 --2- 172.21.15.146:0/1157822230 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x557d2a8e1aa0 0x557d2a8e3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.668+0000 7ff8b8121800 1 -- 172.21.15.146:0/1157822230 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d2a8e43d0 con 0x557d2a8e1aa0 2024-09-18T01:45:23.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.668+0000 7ff8b3e4e640 1 --2- 172.21.15.146:0/1157822230 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x557d2a8e1aa0 0x557d2a8e3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.669+0000 7ff8b3e4e640 1 --2- 172.21.15.146:0/1157822230 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x557d2a8e1aa0 0x557d2a8e3e90 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.669+0000 7ff8b3e4e640 1 -- 172.21.15.146:0/1157822230 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff8a400f030 con 0x557d2a8e1aa0 2024-09-18T01:45:23.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.669+0000 7ff8b8121800 1 Processor -- start 2024-09-18T01:45:23.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.669+0000 7ff8b8121800 1 -- start start 2024-09-18T01:45:23.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.670+0000 7ff8b8121800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557d2a8f2090 0x557d2a8f24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.670+0000 7ff8b8121800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x557d2a679580 con 0x557d2a8f2090 2024-09-18T01:45:23.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.670+0000 7ff8b464f640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557d2a8f2090 0x557d2a8f24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.670+0000 7ff8b464f640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557d2a8f2090 0x557d2a8f24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59730/0 (socket says 172.21.15.146:59730) 2024-09-18T01:45:23.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.670+0000 7ff8b464f640 1 -- 172.21.15.146:0/2884658890 learned_addr learned my addr 172.21.15.146:0/2884658890 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:23.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.670+0000 7ff8b464f640 1 -- 172.21.15.146:0/2884658890 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d2a8f29f0 con 0x557d2a8f2090 2024-09-18T01:45:23.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.670+0000 7ff8b464f640 1 --2- 172.21.15.146:0/2884658890 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557d2a8f2090 0x557d2a8f24b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x557d2a8d8310 tx=0x7ff8ac00ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.670+0000 7ff7997fa640 1 -- 172.21.15.146:0/2884658890 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8ac01c070 con 0x557d2a8f2090 2024-09-18T01:45:23.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.670+0000 7ff7997fa640 1 -- 172.21.15.146:0/2884658890 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8ac018410 con 0x557d2a8f2090 2024-09-18T01:45:23.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.670+0000 7ff8b8121800 1 -- 172.21.15.146:0/2884658890 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557d2a8f2c80 con 0x557d2a8f2090 2024-09-18T01:45:23.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.671+0000 7ff7997fa640 1 -- 172.21.15.146:0/2884658890 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8ac018730 con 0x557d2a8f2090 2024-09-18T01:45:23.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.671+0000 7ff8b8121800 1 -- 172.21.15.146:0/2884658890 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d2a8f5960 con 0x557d2a8f2090 2024-09-18T01:45:23.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.671+0000 7ff7997fa640 1 -- 172.21.15.146:0/2884658890 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff8ac01f070 con 0x557d2a8f2090 2024-09-18T01:45:23.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.671+0000 7ff7997fa640 1 --2- 172.21.15.146:0/2884658890 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff78c036b40 0x7ff78c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.672+0000 7ff7997fa640 1 -- 172.21.15.146:0/2884658890 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7ff8ac04e540 con 0x557d2a8f2090 2024-09-18T01:45:23.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.672+0000 7ff8b3e4e640 1 --2- 172.21.15.146:0/2884658890 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff78c036b40 0x7ff78c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.672+0000 7ff8b8121800 1 Processor -- start 2024-09-18T01:45:23.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.672+0000 7ff8b8121800 1 -- start start 2024-09-18T01:45:23.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.672+0000 7ff8b3e4e640 1 --2- 172.21.15.146:0/2884658890 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff78c036b40 0x7ff78c039000 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff8a404a7b0 tx=0x7ff8a4013b10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.672+0000 7ff8b8121800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557d2a8feda0 0x557d2a8ff1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.672+0000 7ff8b8121800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x557d2a8cffe0 con 0x557d2a8feda0 2024-09-18T01:45:23.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.672+0000 7ff8b464f640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557d2a8feda0 0x557d2a8ff1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.672+0000 7ff8b464f640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557d2a8feda0 0x557d2a8ff1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59744/0 (socket says 172.21.15.146:59744) 2024-09-18T01:45:23.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.672+0000 7ff8b464f640 1 -- 172.21.15.146:0/907832401 learned_addr learned my addr 172.21.15.146:0/907832401 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:23.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.672+0000 7ff8b464f640 1 -- 172.21.15.146:0/907832401 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d2a8ff770 con 0x557d2a8feda0 2024-09-18T01:45:23.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.673+0000 7ff8b464f640 1 --2- 172.21.15.146:0/907832401 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557d2a8feda0 0x557d2a8ff1a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac014800 tx=0x7ff8ac0146a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bc252af567e1022 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.673+0000 7ff792ffd640 1 -- 172.21.15.146:0/907832401 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8ac016db0 con 0x557d2a8feda0 2024-09-18T01:45:23.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.673+0000 7ff792ffd640 1 -- 172.21.15.146:0/907832401 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8ac040e50 con 0x557d2a8feda0 2024-09-18T01:45:23.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.673+0000 7ff792ffd640 1 -- 172.21.15.146:0/907832401 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8ac04e220 con 0x557d2a8feda0 2024-09-18T01:45:23.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.673+0000 7ff8b8121800 1 -- 172.21.15.146:0/907832401 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557d2a8feda0 msgr2=0x557d2a8ff1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.673+0000 7ff8b8121800 1 --2- 172.21.15.146:0/907832401 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557d2a8feda0 0x557d2a8ff1a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac014800 tx=0x7ff8ac0146a0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.673+0000 7ff8b8121800 1 -- 172.21.15.146:0/907832401 shutdown_connections 2024-09-18T01:45:23.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.673+0000 7ff8b8121800 1 --2- 172.21.15.146:0/907832401 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557d2a8feda0 0x557d2a8ff1a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.673+0000 7ff8b8121800 1 -- 172.21.15.146:0/907832401 >> 172.21.15.146:0/907832401 conn(0x557d2a8fb100 msgr2=0x557d2a8f9200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:23.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.673+0000 7ff8b8121800 1 -- 172.21.15.146:0/907832401 shutdown_connections 2024-09-18T01:45:23.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.673+0000 7ff8b8121800 1 -- 172.21.15.146:0/907832401 wait complete. 2024-09-18T01:45:23.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.673+0000 7ff8b8121800 1 Processor -- start 2024-09-18T01:45:23.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.674+0000 7ff8b8121800 1 -- start start 2024-09-18T01:45:23.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.674+0000 7ff8b8121800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557d2a8feda0 0x557d2a906260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.674+0000 7ff8b8121800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x557d2a8ffde0 con 0x557d2a8feda0 2024-09-18T01:45:23.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.674+0000 7ff8b464f640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557d2a8feda0 0x557d2a906260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.674+0000 7ff8b464f640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557d2a8feda0 0x557d2a906260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59758/0 (socket says 172.21.15.146:59758) 2024-09-18T01:45:23.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.674+0000 7ff8b464f640 1 -- 172.21.15.146:0/693773954 learned_addr learned my addr 172.21.15.146:0/693773954 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:23.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.674+0000 7ff8b464f640 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d2a9067a0 con 0x557d2a8feda0 2024-09-18T01:45:23.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.674+0000 7ff8b464f640 1 --2- 172.21.15.146:0/693773954 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557d2a8feda0 0x557d2a906260 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac014800 tx=0x7ff8ac04c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.674+0000 7ff7917fa640 1 -- 172.21.15.146:0/693773954 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8ac007c30 con 0x557d2a8feda0 2024-09-18T01:45:23.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.674+0000 7ff7917fa640 1 -- 172.21.15.146:0/693773954 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8ac04a030 con 0x557d2a8feda0 2024-09-18T01:45:23.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.674+0000 7ff7917fa640 1 -- 172.21.15.146:0/693773954 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8ac0189a0 con 0x557d2a8feda0 2024-09-18T01:45:23.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.675+0000 7ff8b8121800 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557d2a906a30 con 0x557d2a8feda0 2024-09-18T01:45:23.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.675+0000 7ff8b8121800 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d2a9096e0 con 0x557d2a8feda0 2024-09-18T01:45:23.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.675+0000 7ff7917fa640 1 -- 172.21.15.146:0/693773954 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff8ac018b90 con 0x557d2a8feda0 2024-09-18T01:45:23.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.675+0000 7ff7917fa640 1 --2- 172.21.15.146:0/693773954 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff77c036b40 0x7ff77c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.675+0000 7ff7917fa640 1 -- 172.21.15.146:0/693773954 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7ff8ac033070 con 0x557d2a8feda0 2024-09-18T01:45:23.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.675+0000 7ff8b3e4e640 1 --2- 172.21.15.146:0/693773954 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff77c036b40 0x7ff77c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.676+0000 7ff8b3e4e640 1 --2- 172.21.15.146:0/693773954 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff77c036b40 0x7ff77c039000 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff8a404a550 tx=0x7ff8a4046000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.676+0000 7ff8b8121800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.676+0000 7ff8b8121800 1 --2- 172.21.15.146:0/693773954 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x557d2a911cc0 0x557d2a914180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.676+0000 7ff8b8121800 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d2a9148d0 con 0x557d2a911cc0 2024-09-18T01:45:23.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.676+0000 7ff8b364d640 1 --2- 172.21.15.146:0/693773954 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x557d2a911cc0 0x557d2a914180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.676+0000 7ff8b364d640 1 --2- 172.21.15.146:0/693773954 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x557d2a911cc0 0x557d2a914180 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.677+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff8a8057030 con 0x557d2a911cc0 2024-09-18T01:45:23.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.677+0000 7ff8b8121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.677+0000 7ff8b8121800 20 realm 2024-09-18T01:45:23.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.677+0000 7ff8b8121800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.677+0000 7ff8b8121800 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d2a914d00 con 0x557d2a911cc0 2024-09-18T01:45:23.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.677+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff8a8057030 con 0x557d2a911cc0 2024-09-18T01:45:23.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.677+0000 7ff8b8121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.677+0000 7ff8b8121800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:23.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.677+0000 7ff8b8121800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.677+0000 7ff8b8121800 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d2a9155d0 con 0x557d2a911cc0 2024-09-18T01:45:23.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.677+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff8a8057030 con 0x557d2a911cc0 2024-09-18T01:45:23.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.677+0000 7ff8b8121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.677+0000 7ff8b8121800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.677+0000 7ff8b8121800 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d2a915970 con 0x557d2a911cc0 2024-09-18T01:45:23.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.677+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff8a8057030 con 0x557d2a911cc0 2024-09-18T01:45:23.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.677+0000 7ff8b8121800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:23.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.677+0000 7ff8b8121800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.677+0000 7ff8b8121800 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d2a9161c0 con 0x557d2a911cc0 2024-09-18T01:45:23.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.678+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff8a8057030 con 0x557d2a911cc0 2024-09-18T01:45:23.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.678+0000 7ff8b8121800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:23.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.678+0000 7ff8b8121800 20 searching for the correct realm 2024-09-18T01:45:23.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.678+0000 7ff8b8121800 1 --2- 172.21.15.146:0/693773954 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x557d2a917f30 0x557d2a91a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.678+0000 7ff8b8121800 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d2a91a950 con 0x557d2a917f30 2024-09-18T01:45:23.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.678+0000 7ff8b464f640 1 --2- 172.21.15.146:0/693773954 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x557d2a917f30 0x557d2a91a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.678+0000 7ff8b464f640 1 --2- 172.21.15.146:0/693773954 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x557d2a917f30 0x557d2a91a320 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.678+0000 7ff8b464f640 1 -- 172.21.15.146:0/693773954 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8ac057040 con 0x557d2a917f30 2024-09-18T01:45:23.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.678+0000 7ff8b464f640 1 --2- 172.21.15.146:0/693773954 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7ff8ac021070 0x7ff8ac021450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.678+0000 7ff8b464f640 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d2a91a950 con 0x7ff8ac021070 2024-09-18T01:45:23.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.678+0000 7ff8b3e4e640 1 --2- 172.21.15.146:0/693773954 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7ff8ac021070 0x7ff8ac021450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.679+0000 7ff8b3e4e640 1 --2- 172.21.15.146:0/693773954 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7ff8ac021070 0x7ff8ac021450 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.679+0000 7ff8b3e4e640 1 -- 172.21.15.146:0/693773954 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8a403c070 con 0x7ff8ac021070 2024-09-18T01:45:23.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.679+0000 7ff8b3e4e640 1 --2- 172.21.15.146:0/693773954 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7ff8a4043b20 0x7ff8a404a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.679+0000 7ff8b3e4e640 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d2a91a950 con 0x7ff8a4043b20 2024-09-18T01:45:23.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.679+0000 7ff8b364d640 1 --2- 172.21.15.146:0/693773954 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7ff8a4043b20 0x7ff8a404a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.680+0000 7ff8b364d640 1 --2- 172.21.15.146:0/693773954 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7ff8a4043b20 0x7ff8a404a860 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.680+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8a8057030 con 0x7ff8a4043b20 2024-09-18T01:45:23.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.680+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d2a91a950 con 0x557d2a911cc0 2024-09-18T01:45:23.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.680+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff8a8057030 con 0x557d2a911cc0 2024-09-18T01:45:23.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.680+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d2a91a950 con 0x557d2a911cc0 2024-09-18T01:45:23.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.680+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8a8057030 con 0x557d2a911cc0 2024-09-18T01:45:23.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.680+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d2a91a950 con 0x7ff8a4043b20 2024-09-18T01:45:23.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.681+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8a8057030 con 0x7ff8a4043b20 2024-09-18T01:45:23.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.681+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d2a91a950 con 0x7ff8a4043b20 2024-09-18T01:45:23.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.681+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8a8057030 con 0x7ff8a4043b20 2024-09-18T01:45:23.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.681+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d2a91a950 con 0x7ff8ac021070 2024-09-18T01:45:23.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.681+0000 7ff8b3e4e640 1 -- 172.21.15.146:0/693773954 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8a403c070 con 0x7ff8ac021070 2024-09-18T01:45:23.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.681+0000 7ff8b3e4e640 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d2a91a950 con 0x557d2a917f30 2024-09-18T01:45:23.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.681+0000 7ff8b464f640 1 -- 172.21.15.146:0/693773954 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8ac057040 con 0x557d2a917f30 2024-09-18T01:45:23.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.681+0000 7ff8b464f640 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d2a91a950 con 0x557d2a911cc0 2024-09-18T01:45:23.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.682+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8a8057030 con 0x557d2a911cc0 2024-09-18T01:45:23.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.682+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d2a91a950 con 0x7ff8a4043b20 2024-09-18T01:45:23.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.682+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8a8057030 con 0x7ff8a4043b20 2024-09-18T01:45:23.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.682+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d2a91a950 con 0x557d2a911cc0 2024-09-18T01:45:23.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.682+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8a8057030 con 0x557d2a911cc0 2024-09-18T01:45:23.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.682+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d2a91a950 con 0x7ff8ac021070 2024-09-18T01:45:23.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.682+0000 7ff8b3e4e640 1 -- 172.21.15.146:0/693773954 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7ff8a403c070 con 0x7ff8ac021070 2024-09-18T01:45:23.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.682+0000 7ff8b3e4e640 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d2a91a950 con 0x557d2a917f30 2024-09-18T01:45:23.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.682+0000 7ff8b464f640 1 -- 172.21.15.146:0/693773954 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8ac057040 con 0x557d2a917f30 2024-09-18T01:45:23.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.682+0000 7ff8b464f640 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d2a91a950 con 0x557d2a917f30 2024-09-18T01:45:23.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.683+0000 7ff8b464f640 1 -- 172.21.15.146:0/693773954 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8ac057040 con 0x557d2a917f30 2024-09-18T01:45:23.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.683+0000 7ff8b464f640 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d2a91a950 con 0x7ff8a4043b20 2024-09-18T01:45:23.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.683+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8a8057030 con 0x7ff8a4043b20 2024-09-18T01:45:23.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.683+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d2a91a950 con 0x557d2a917f30 2024-09-18T01:45:23.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.683+0000 7ff8b464f640 1 -- 172.21.15.146:0/693773954 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8ac057040 con 0x557d2a917f30 2024-09-18T01:45:23.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.683+0000 7ff8b464f640 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d2a91a950 con 0x557d2a917f30 2024-09-18T01:45:23.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.683+0000 7ff8b464f640 1 -- 172.21.15.146:0/693773954 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8ac057040 con 0x557d2a917f30 2024-09-18T01:45:23.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.684+0000 7ff8b464f640 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d2a91a950 con 0x557d2a911cc0 2024-09-18T01:45:23.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.684+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8a8057030 con 0x557d2a911cc0 2024-09-18T01:45:23.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.684+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d2a91a950 con 0x557d2a911cc0 2024-09-18T01:45:23.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.684+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff8a8057030 con 0x557d2a911cc0 2024-09-18T01:45:23.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.684+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d2a91a950 con 0x7ff8a4043b20 2024-09-18T01:45:23.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.684+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8a8057030 con 0x7ff8a4043b20 2024-09-18T01:45:23.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.684+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d2a91a950 con 0x557d2a917f30 2024-09-18T01:45:23.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.684+0000 7ff8b464f640 1 -- 172.21.15.146:0/693773954 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8ac057040 con 0x557d2a917f30 2024-09-18T01:45:23.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.684+0000 7ff8b464f640 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d2a91a950 con 0x7ff8ac021070 2024-09-18T01:45:23.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.685+0000 7ff8b3e4e640 1 -- 172.21.15.146:0/693773954 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8a403c070 con 0x7ff8ac021070 2024-09-18T01:45:23.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.685+0000 7ff8b3e4e640 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d2a91a950 con 0x557d2a911cc0 2024-09-18T01:45:23.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.685+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8a8057030 con 0x557d2a911cc0 2024-09-18T01:45:23.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.685+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d2a91a950 con 0x7ff8a4043b20 2024-09-18T01:45:23.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.685+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8a8057030 con 0x7ff8a4043b20 2024-09-18T01:45:23.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.685+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d2a91a950 con 0x557d2a917f30 2024-09-18T01:45:23.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.685+0000 7ff8b464f640 1 -- 172.21.15.146:0/693773954 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8ac057040 con 0x557d2a917f30 2024-09-18T01:45:23.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.685+0000 7ff8b464f640 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d2a91a950 con 0x7ff8a4043b20 2024-09-18T01:45:23.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.686+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8a8057030 con 0x7ff8a4043b20 2024-09-18T01:45:23.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.686+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d2a91a950 con 0x7ff8ac021070 2024-09-18T01:45:23.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.686+0000 7ff8b3e4e640 1 -- 172.21.15.146:0/693773954 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8a403c070 con 0x7ff8ac021070 2024-09-18T01:45:23.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.686+0000 7ff8b3e4e640 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d2a91a950 con 0x557d2a917f30 2024-09-18T01:45:23.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.686+0000 7ff8b464f640 1 -- 172.21.15.146:0/693773954 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8ac057040 con 0x557d2a917f30 2024-09-18T01:45:23.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.686+0000 7ff8b464f640 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d2a91a950 con 0x7ff8a4043b20 2024-09-18T01:45:23.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.686+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8a8057030 con 0x7ff8a4043b20 2024-09-18T01:45:23.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.686+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d2a91a950 con 0x557d2a911cc0 2024-09-18T01:45:23.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.687+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff8a8057030 con 0x557d2a911cc0 2024-09-18T01:45:23.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.687+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d2a91a950 con 0x7ff8ac021070 2024-09-18T01:45:23.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.687+0000 7ff8b3e4e640 1 -- 172.21.15.146:0/693773954 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8a403c070 con 0x7ff8ac021070 2024-09-18T01:45:23.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.687+0000 7ff8b8121800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:23.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.687+0000 7ff8b8121800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:23.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.687+0000 7ff8b8121800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:23.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.687+0000 7ff8b8121800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:23.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.687+0000 7ff8b8121800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:23.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.687+0000 7ff8b8121800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:23.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.687+0000 7ff8b8121800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.687+0000 7ff8b8121800 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d2a916b40 con 0x557d2a911cc0 2024-09-18T01:45:23.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.687+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff8a8057030 con 0x557d2a911cc0 2024-09-18T01:45:23.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.687+0000 7ff8b8121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.687+0000 7ff8b8121800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.687+0000 7ff8b8121800 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d2a9173e0 con 0x557d2a911cc0 2024-09-18T01:45:23.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.687+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff8a8057030 con 0x557d2a911cc0 2024-09-18T01:45:23.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.687+0000 7ff8b8121800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:23.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.687+0000 7ff8b8121800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.687+0000 7ff8b8121800 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d2a91add0 con 0x7ff8ac021070 2024-09-18T01:45:23.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.688+0000 7ff8b3e4e640 1 -- 172.21.15.146:0/693773954 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff8a403c070 con 0x7ff8ac021070 2024-09-18T01:45:23.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.688+0000 7ff8b8121800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:23.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.688+0000 7ff8b8121800 20 zone default found 2024-09-18T01:45:23.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.688+0000 7ff8b8121800 4 Realm: () 2024-09-18T01:45:23.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.688+0000 7ff8b8121800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:23.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.688+0000 7ff8b8121800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:23.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.688+0000 7ff8b8121800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:23.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.688+0000 7ff8b8121800 20 zonegroup default 2024-09-18T01:45:23.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.688+0000 7ff8b8121800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.688+0000 7ff8b8121800 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d2a91b620 con 0x7ff8a4043b20 2024-09-18T01:45:23.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.688+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff8a8057030 con 0x7ff8a4043b20 2024-09-18T01:45:23.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.688+0000 7ff8b8121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.688+0000 7ff8b8121800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.688+0000 7ff8b8121800 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d2a91d000 con 0x557d2a917f30 2024-09-18T01:45:23.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.688+0000 7ff8b464f640 1 -- 172.21.15.146:0/693773954 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff8ac057040 con 0x557d2a917f30 2024-09-18T01:45:23.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.688+0000 7ff8b8121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.688+0000 7ff8b8121800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.688+0000 7ff8b8121800 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d2a91d470 con 0x557d2a917f30 2024-09-18T01:45:23.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.688+0000 7ff8b464f640 1 -- 172.21.15.146:0/693773954 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff8ac057040 con 0x557d2a917f30 2024-09-18T01:45:23.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.688+0000 7ff8b8121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.688+0000 7ff8b8121800 20 started sync module instance, tier type = 2024-09-18T01:45:23.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.688+0000 7ff8b8121800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:23.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.688+0000 7ff8b8121800 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2a91c440 con 0x7ff8ac021070 2024-09-18T01:45:23.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.689+0000 7ff8b3e4e640 1 -- 172.21.15.146:0/693773954 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v31'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8a403c070 con 0x7ff8ac021070 2024-09-18T01:45:23.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.689+0000 7ff8b8121800 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93996073467792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2a91d8d0 con 0x7ff8ac021070 2024-09-18T01:45:23.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.689+0000 7ff8b8121800 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2a91e120 con 0x557d2a911cc0 2024-09-18T01:45:23.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.690+0000 7ff8b3e4e640 1 -- 172.21.15.146:0/693773954 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93996073467792] v31'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8a403c070 con 0x7ff8ac021070 2024-09-18T01:45:23.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.691+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v31'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8a8057030 con 0x557d2a911cc0 2024-09-18T01:45:23.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.691+0000 7ff8b8121800 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93996073475184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2a91e540 con 0x557d2a911cc0 2024-09-18T01:45:23.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.691+0000 7ff8b8121800 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2a91ed90 con 0x557d2a917f30 2024-09-18T01:45:23.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.691+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93996073475184] v31'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8a8057030 con 0x557d2a911cc0 2024-09-18T01:45:23.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.692+0000 7ff8b464f640 1 -- 172.21.15.146:0/693773954 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v31'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8ac057040 con 0x557d2a917f30 2024-09-18T01:45:23.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.692+0000 7ff8b8121800 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93996073477520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2a91ee60 con 0x557d2a917f30 2024-09-18T01:45:23.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.692+0000 7ff8b8121800 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2a91f820 con 0x7ff8ac021070 2024-09-18T01:45:23.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.693+0000 7ff8b464f640 1 -- 172.21.15.146:0/693773954 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93996073477520] v31'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8ac057040 con 0x557d2a917f30 2024-09-18T01:45:23.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.693+0000 7ff8b3e4e640 1 -- 172.21.15.146:0/693773954 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v31'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8a403c070 con 0x7ff8ac021070 2024-09-18T01:45:23.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.693+0000 7ff8b8121800 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93996073478576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2a91edd0 con 0x7ff8ac021070 2024-09-18T01:45:23.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.693+0000 7ff8b8121800 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2a920740 con 0x557d2a911cc0 2024-09-18T01:45:23.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.694+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v31'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8a8057030 con 0x557d2a911cc0 2024-09-18T01:45:23.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.694+0000 7ff8b8121800 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93996073484848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2a920740 con 0x557d2a911cc0 2024-09-18T01:45:23.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.694+0000 7ff8b8121800 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2a921730 con 0x7ff8a4043b20 2024-09-18T01:45:23.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.694+0000 7ff8b3e4e640 1 -- 172.21.15.146:0/693773954 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93996073478576] v31'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8a403c070 con 0x7ff8ac021070 2024-09-18T01:45:23.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.695+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v31'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8a8057030 con 0x7ff8a4043b20 2024-09-18T01:45:23.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.695+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93996073484848] v31'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8a8057030 con 0x557d2a911cc0 2024-09-18T01:45:23.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.695+0000 7ff8b8121800 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93996073488896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2a9216f0 con 0x7ff8a4043b20 2024-09-18T01:45:23.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.695+0000 7ff8b8121800 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2a921c90 con 0x7ff8a4043b20 2024-09-18T01:45:23.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.696+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93996073488896] v31'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8a8057030 con 0x7ff8a4043b20 2024-09-18T01:45:23.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.696+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v31'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8a8057030 con 0x7ff8a4043b20 2024-09-18T01:45:23.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.696+0000 7ff8b8121800 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93996073483280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2a9216f0 con 0x7ff8a4043b20 2024-09-18T01:45:23.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.696+0000 7ff8b8121800 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2a922630 con 0x7ff8a4043b20 2024-09-18T01:45:23.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.697+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93996073483280] v31'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8a8057030 con 0x7ff8a4043b20 2024-09-18T01:45:23.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.697+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v31'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8a8057030 con 0x7ff8a4043b20 2024-09-18T01:45:23.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.697+0000 7ff8b8121800 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93996073491600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2a922560 con 0x7ff8a4043b20 2024-09-18T01:45:23.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.697+0000 7ff8b8121800 20 add_watcher() i=0 2024-09-18T01:45:23.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.697+0000 7ff8b8121800 20 add_watcher() i=1 2024-09-18T01:45:23.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.697+0000 7ff8b8121800 20 add_watcher() i=2 2024-09-18T01:45:23.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.697+0000 7ff8b8121800 20 add_watcher() i=3 2024-09-18T01:45:23.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.697+0000 7ff8b8121800 20 add_watcher() i=4 2024-09-18T01:45:23.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.697+0000 7ff8b8121800 20 add_watcher() i=5 2024-09-18T01:45:23.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.697+0000 7ff8b8121800 20 add_watcher() i=6 2024-09-18T01:45:23.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.698+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93996073491600] v31'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8a8057030 con 0x7ff8a4043b20 2024-09-18T01:45:23.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.698+0000 7ff8b8121800 20 add_watcher() i=7 2024-09-18T01:45:23.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.698+0000 7ff8b8121800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:23.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.698+0000 7ff8b8121800 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d2a925a50 con 0x557d2a911cc0 2024-09-18T01:45:23.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.698+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff8a8057030 con 0x557d2a911cc0 2024-09-18T01:45:23.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.698+0000 7ff8b8121800 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93996073493120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2a922f10 con 0x557d2a911cc0 2024-09-18T01:45:23.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.699+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93996073493120] v31'66 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff8a8057030 con 0x557d2a911cc0 2024-09-18T01:45:23.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.699+0000 7ff769fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:23.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.700+0000 7ff8b8121800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:23.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.700+0000 7ff8b8121800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:23.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.700+0000 7ff8b8121800 5 note: GC not initialized 2024-09-18T01:45:23.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.700+0000 7ff768fe1640 20 reqs_thread_entry: start 2024-09-18T01:45:23.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.700+0000 7ff8b8121800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:23.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.700+0000 7ff8b8121800 20 Filter name: none 2024-09-18T01:45:23.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.700+0000 7ff6e27fc640 20 reqs_thread_entry: start 2024-09-18T01:45:23.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.700+0000 7ff8b8121800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T01:45:23.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.700+0000 7ff8b8121800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.700+0000 7ff8b8121800 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d2a958da0 con 0x557d2a911cc0 2024-09-18T01:45:23.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.701+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ff8a8057030 con 0x557d2a911cc0 2024-09-18T01:45:23.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.701+0000 7ff8b8121800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:45:23.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.701+0000 7ff8b8121800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T01:45:23.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.701+0000 7ff8b8121800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:45:23.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.701+0000 7ff8b8121800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:45:23.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.701+0000 7ff8b8121800 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d2a95b830 con 0x7ff8ac021070 2024-09-18T01:45:23.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.701+0000 7ff8b3e4e640 1 -- 172.21.15.146:0/693773954 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7ff8a403c070 con 0x7ff8ac021070 2024-09-18T01:45:23.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.701+0000 7ff8b8121800 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2a95f080 con 0x557d2a911cc0 2024-09-18T01:45:23.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.702+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v31'3 uv3 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7ff8a8057030 con 0x557d2a911cc0 2024-09-18T01:45:23.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.702+0000 7ff8b8121800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:45:23.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.702+0000 7ff8b8121800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:45:23.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.702+0000 7ff8b8121800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-18T01:45:23.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.702+0000 7ff8b8121800 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 93996073740864 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d2a95db20 con 0x557d2a911cc0 2024-09-18T01:45:23.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.702+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== watch-notify(notify (1) cookie 93996073484848 notify 133143986178 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7ff8a8076040 con 0x557d2a911cc0 2024-09-18T01:45:23.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.702+0000 7ff792ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986178 cookie 93996073484848 notifier 4334 bl.length()=567 2024-09-18T01:45:23.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.702+0000 7ff792ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:45:23.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.702+0000 7ff792ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:45:23.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.702+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(65 notify.4 [notify cookie 93996073740864 out=8b] v0'0 uv39 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff8a8057030 con 0x557d2a911cc0 2024-09-18T01:45:23.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.702+0000 7ff792ffd640 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7ff778003ea0 con 0x557d2a911cc0 2024-09-18T01:45:23.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.703+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8a8057030 con 0x557d2a911cc0 2024-09-18T01:45:23.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.703+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== watch-notify(notify_complete (2) cookie 93996073740864 notify 133143986178 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557d2a6a5e00 con 0x557d2a911cc0 2024-09-18T01:45:23.715 INFO:teuthology.orchestra.run.smithi146.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T01:45:23.010714Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:45:23.010705Z","tags":[],"group_ids":[]} 2024-09-18T01:45:23.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.704+0000 7ff769fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:23.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.704+0000 7ff8b8121800 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93996073493120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2a956b10 con 0x557d2a911cc0 2024-09-18T01:45:23.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.705+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 <== osd.1 v2:172.21.15.146:6808/3930274777 28 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 93996073493120] v31'67 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff8a8057030 con 0x557d2a911cc0 2024-09-18T01:45:23.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.705+0000 7ff8b8121800 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93996073467792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2a956b10 con 0x7ff8ac021070 2024-09-18T01:45:23.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.706+0000 7ff8b3e4e640 1 -- 172.21.15.146:0/693773954 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 93996073467792] v31'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8a403c070 con 0x7ff8ac021070 2024-09-18T01:45:23.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.706+0000 7ff8b8121800 20 remove_watcher() i=0 2024-09-18T01:45:23.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.706+0000 7ff8b8121800 2 removed watcher, disabling cache 2024-09-18T01:45:23.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.706+0000 7ff8b8121800 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93996073475184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2a956b10 con 0x557d2a911cc0 2024-09-18T01:45:23.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.707+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 <== osd.1 v2:172.21.15.146:6808/3930274777 29 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 93996073475184] v31'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8a8057030 con 0x557d2a911cc0 2024-09-18T01:45:23.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.707+0000 7ff8b8121800 20 remove_watcher() i=1 2024-09-18T01:45:23.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.707+0000 7ff8b8121800 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93996073477520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2a956b10 con 0x557d2a917f30 2024-09-18T01:45:23.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.708+0000 7ff8b464f640 1 -- 172.21.15.146:0/693773954 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 93996073477520] v31'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8ac057040 con 0x557d2a917f30 2024-09-18T01:45:23.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.708+0000 7ff8b8121800 20 remove_watcher() i=2 2024-09-18T01:45:23.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.708+0000 7ff8b8121800 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93996073478576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2a956b10 con 0x7ff8ac021070 2024-09-18T01:45:23.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.709+0000 7ff8b3e4e640 1 -- 172.21.15.146:0/693773954 <== osd.2 v2:172.21.15.146:6800/3820039304 14 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 93996073478576] v31'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8a403c070 con 0x7ff8ac021070 2024-09-18T01:45:23.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.709+0000 7ff8b8121800 20 remove_watcher() i=3 2024-09-18T01:45:23.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.709+0000 7ff8b8121800 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93996073484848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2a956b10 con 0x557d2a911cc0 2024-09-18T01:45:23.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.710+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 <== osd.1 v2:172.21.15.146:6808/3930274777 30 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 93996073484848] v31'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8a8057030 con 0x557d2a911cc0 2024-09-18T01:45:23.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.710+0000 7ff8b8121800 20 remove_watcher() i=4 2024-09-18T01:45:23.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.710+0000 7ff8b8121800 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93996073488896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2a956b10 con 0x7ff8a4043b20 2024-09-18T01:45:23.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.711+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 93996073488896] v31'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8a8057030 con 0x7ff8a4043b20 2024-09-18T01:45:23.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.711+0000 7ff8b8121800 20 remove_watcher() i=5 2024-09-18T01:45:23.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.711+0000 7ff8b8121800 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93996073483280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2a956b10 con 0x7ff8a4043b20 2024-09-18T01:45:23.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.712+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 93996073483280] v31'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8a8057030 con 0x7ff8a4043b20 2024-09-18T01:45:23.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.712+0000 7ff8b8121800 20 remove_watcher() i=6 2024-09-18T01:45:23.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.712+0000 7ff8b8121800 1 -- 172.21.15.146:0/693773954 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93996073491600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2a956b10 con 0x7ff8a4043b20 2024-09-18T01:45:23.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.713+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 93996073491600] v31'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8a8057030 con 0x7ff8a4043b20 2024-09-18T01:45:23.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.713+0000 7ff8b8121800 20 remove_watcher() i=7 2024-09-18T01:45:23.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.713+0000 7ff8b8121800 1 -- 172.21.15.146:0/693773954 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7ff8a4043b20 msgr2=0x7ff8a404a860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.713+0000 7ff8b8121800 1 --2- 172.21.15.146:0/693773954 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7ff8a4043b20 0x7ff8a404a860 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.713+0000 7ff8b8121800 1 -- 172.21.15.146:0/693773954 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x557d2a911cc0 msgr2=0x557d2a914180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.713+0000 7ff8b8121800 1 --2- 172.21.15.146:0/693773954 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x557d2a911cc0 0x557d2a914180 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.713+0000 7ff8b8121800 1 -- 172.21.15.146:0/693773954 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7ff8ac021070 msgr2=0x7ff8ac021450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.713+0000 7ff8b8121800 1 --2- 172.21.15.146:0/693773954 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7ff8ac021070 0x7ff8ac021450 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.713+0000 7ff8b8121800 1 -- 172.21.15.146:0/693773954 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x557d2a917f30 msgr2=0x557d2a91a320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.713+0000 7ff8b8121800 1 --2- 172.21.15.146:0/693773954 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x557d2a917f30 0x557d2a91a320 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.713+0000 7ff8b8121800 1 -- 172.21.15.146:0/693773954 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff77c036b40 msgr2=0x7ff77c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.713+0000 7ff8b8121800 1 --2- 172.21.15.146:0/693773954 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff77c036b40 0x7ff77c039000 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff8a404a550 tx=0x7ff8a4046000 comp rx=0 tx=0).stop 2024-09-18T01:45:23.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.713+0000 7ff8b8121800 1 -- 172.21.15.146:0/693773954 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557d2a8feda0 msgr2=0x557d2a906260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.713+0000 7ff8b364d640 1 -- 172.21.15.146:0/693773954 reap_dead start 2024-09-18T01:45:23.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.713+0000 7ff8b8121800 1 --2- 172.21.15.146:0/693773954 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557d2a8feda0 0x557d2a906260 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac014800 tx=0x7ff8ac04c8e0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.713+0000 7ff8b8121800 1 -- 172.21.15.146:0/693773954 shutdown_connections 2024-09-18T01:45:23.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.713+0000 7ff8b8121800 1 --2- 172.21.15.146:0/693773954 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557d2a8feda0 0x557d2a906260 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.713+0000 7ff8b8121800 1 -- 172.21.15.146:0/693773954 >> 172.21.15.146:0/693773954 conn(0x557d2a8fb100 msgr2=0x557d2a8f91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:23.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.713+0000 7ff8b8121800 1 -- 172.21.15.146:0/693773954 shutdown_connections 2024-09-18T01:45:23.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.713+0000 7ff8b8121800 1 -- 172.21.15.146:0/693773954 wait complete. 2024-09-18T01:45:23.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.713+0000 7ff8b8121800 1 -- 172.21.15.146:0/2884658890 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff78c036b40 msgr2=0x7ff78c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.713+0000 7ff8b8121800 1 --2- 172.21.15.146:0/2884658890 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff78c036b40 0x7ff78c039000 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff8a404a7b0 tx=0x7ff8a4013b10 comp rx=0 tx=0).stop 2024-09-18T01:45:23.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.713+0000 7ff8b8121800 1 -- 172.21.15.146:0/2884658890 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557d2a8f2090 msgr2=0x557d2a8f24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.713+0000 7ff8b8121800 1 --2- 172.21.15.146:0/2884658890 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557d2a8f2090 0x557d2a8f24b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x557d2a8d8310 tx=0x7ff8ac00ef30 comp rx=0 tx=0).stop 2024-09-18T01:45:23.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.713+0000 7ff8b8121800 1 -- 172.21.15.146:0/2884658890 shutdown_connections 2024-09-18T01:45:23.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.713+0000 7ff8b8121800 1 --2- 172.21.15.146:0/2884658890 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff78c036b40 0x7ff78c039000 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.713+0000 7ff8b8121800 1 --2- 172.21.15.146:0/2884658890 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557d2a8f2090 0x557d2a8f24b0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.713+0000 7ff8b8121800 1 -- 172.21.15.146:0/2884658890 >> 172.21.15.146:0/2884658890 conn(0x557d2a8e7020 msgr2=0x557d2a8e9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:23.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.713+0000 7ff8b8121800 1 -- 172.21.15.146:0/2884658890 shutdown_connections 2024-09-18T01:45:23.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.713+0000 7ff8b8121800 1 -- 172.21.15.146:0/2884658890 wait complete. 2024-09-18T01:45:23.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.714+0000 7ff8b8121800 1 -- 172.21.15.146:0/1157822230 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x557d2a7e4d90 msgr2=0x557d2a8de2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.714+0000 7ff8b8121800 1 --2- 172.21.15.146:0/1157822230 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x557d2a7e4d90 0x557d2a8de2d0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.714+0000 7ff8b8121800 1 -- 172.21.15.146:0/1157822230 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x557d2a8e1aa0 msgr2=0x557d2a8e3e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.714+0000 7ff8b8121800 1 --2- 172.21.15.146:0/1157822230 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x557d2a8e1aa0 0x557d2a8e3e90 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.714+0000 7ff8b8121800 1 -- 172.21.15.146:0/1157822230 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff79c036b40 msgr2=0x7ff79c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.714+0000 7ff8b8121800 1 --2- 172.21.15.146:0/1157822230 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff79c036b40 0x7ff79c039000 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff8a8057000 tx=0x7ff8a8052000 comp rx=0 tx=0).stop 2024-09-18T01:45:23.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.714+0000 7ff8b8121800 1 -- 172.21.15.146:0/1157822230 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557d2a752610 msgr2=0x557d2a8d72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.714+0000 7ff8b8121800 1 --2- 172.21.15.146:0/1157822230 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557d2a752610 0x557d2a8d72b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x557d2a8d06f0 tx=0x7ff8a4001250 comp rx=0 tx=0).stop 2024-09-18T01:45:23.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.714+0000 7ff8b8121800 1 -- 172.21.15.146:0/1157822230 shutdown_connections 2024-09-18T01:45:23.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.714+0000 7ff8b8121800 1 --2- 172.21.15.146:0/1157822230 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x557d2a8e1aa0 0x557d2a8e3e90 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.714+0000 7ff8b8121800 1 --2- 172.21.15.146:0/1157822230 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x557d2a7e4d90 0x557d2a8de2d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.714+0000 7ff8b8121800 1 --2- 172.21.15.146:0/1157822230 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff79c036b40 0x7ff79c039000 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.714+0000 7ff8b8121800 1 --2- 172.21.15.146:0/1157822230 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557d2a752610 0x557d2a8d72b0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.714+0000 7ff8b8121800 1 -- 172.21.15.146:0/1157822230 >> 172.21.15.146:0/1157822230 conn(0x557d2a7d8de0 msgr2=0x557d2a8c9ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:23.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.714+0000 7ff8b8121800 1 -- 172.21.15.146:0/1157822230 shutdown_connections 2024-09-18T01:45:23.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.714+0000 7ff8b8121800 1 -- 172.21.15.146:0/1157822230 wait complete. 2024-09-18T01:45:23.726 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T01:45:23.010714Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:45:23.010705Z', 'tags': [], 'group_ids': []} 2024-09-18T01:45:23.726 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-18T01:45:23.726 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-18T01:45:23.727 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-18T01:45:23.770 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:23.771 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:23.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.771+0000 7f0e74e30800 1 Processor -- start 2024-09-18T01:45:23.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.771+0000 7f0e74e30800 1 -- start start 2024-09-18T01:45:23.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.771+0000 7f0e74e30800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x559baec00610 0x559baec91670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.771+0000 7f0e74e30800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559baeb4bb30 con 0x559baec91bb0 2024-09-18T01:45:23.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.771+0000 7f0e74e30800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x559baeb2d360 con 0x559baec00610 2024-09-18T01:45:23.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.771+0000 7f0e70167640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x559baec00610 0x559baec91670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.771+0000 7f0e70167640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x559baec00610 0x559baec91670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59762/0 (socket says 172.21.15.146:59762) 2024-09-18T01:45:23.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.771+0000 7f0e70167640 1 -- 172.21.15.146:0/1457582686 learned_addr learned my addr 172.21.15.146:0/1457582686 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:23.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.771+0000 7f0e70167640 1 -- 172.21.15.146:0/1457582686 >> v1:172.21.15.129:6789/0 conn(0x559baec91bb0 legacy=0x559baec93fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.771+0000 7f0e70167640 1 -- 172.21.15.146:0/1457582686 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559baeb53e00 con 0x559baec00610 2024-09-18T01:45:23.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.773+0000 7f0e70167640 1 --2- 172.21.15.146:0/1457582686 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559baec00610 0x559baec91670 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0e6000a520 tx=0x7f0e60045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b06bda8a302665b server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.773+0000 7f0e6f165640 1 -- 172.21.15.146:0/1457582686 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e60055070 con 0x559baec00610 2024-09-18T01:45:23.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.773+0000 7f0e6f165640 1 -- 172.21.15.146:0/1457582686 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e600515b0 con 0x559baec00610 2024-09-18T01:45:23.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.773+0000 7f0e6f165640 1 -- 172.21.15.146:0/1457582686 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e600518d0 con 0x559baec00610 2024-09-18T01:45:23.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.774+0000 7f0e74e30800 1 -- 172.21.15.146:0/1457582686 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559baec00610 msgr2=0x559baec91670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.774+0000 7f0e74e30800 1 --2- 172.21.15.146:0/1457582686 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559baec00610 0x559baec91670 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0e6000a520 tx=0x7f0e60045ba0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.774+0000 7f0e74e30800 1 -- 172.21.15.146:0/1457582686 shutdown_connections 2024-09-18T01:45:23.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.774+0000 7f0e74e30800 1 --2- 172.21.15.146:0/1457582686 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559baec00610 0x559baec91670 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.774+0000 7f0e74e30800 1 -- 172.21.15.146:0/1457582686 >> 172.21.15.146:0/1457582686 conn(0x559baec86de0 msgr2=0x559baec89200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:23.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.774+0000 7f0e74e30800 1 -- 172.21.15.146:0/1457582686 shutdown_connections 2024-09-18T01:45:23.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.774+0000 7f0e74e30800 1 -- 172.21.15.146:0/1457582686 wait complete. 2024-09-18T01:45:23.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.787+0000 7f0e74e30800 1 Processor -- start 2024-09-18T01:45:23.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.788+0000 7f0e74e30800 1 -- start start 2024-09-18T01:45:23.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.788+0000 7f0e74e30800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559baec00610 0x559baed7da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.788+0000 7f0e74e30800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x559baebd8330 con 0x559baec00610 2024-09-18T01:45:23.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.788+0000 7f0e70167640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559baec00610 0x559baed7da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.788+0000 7f0e70167640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559baec00610 0x559baed7da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59772/0 (socket says 172.21.15.146:59772) 2024-09-18T01:45:23.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.788+0000 7f0e70167640 1 -- 172.21.15.146:0/4141466757 learned_addr learned my addr 172.21.15.146:0/4141466757 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:23.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.788+0000 7f0e70167640 1 -- 172.21.15.146:0/4141466757 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559baeb25bc0 con 0x559baec00610 2024-09-18T01:45:23.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.788+0000 7f0e70167640 1 --2- 172.21.15.146:0/4141466757 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559baec00610 0x559baed7da80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0e60025da0 tx=0x7f0e60051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb4191c7ae914fad server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.789+0000 7f0d5e60c640 1 -- 172.21.15.146:0/4141466757 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e60051890 con 0x559baec00610 2024-09-18T01:45:23.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.789+0000 7f0d5e60c640 1 -- 172.21.15.146:0/4141466757 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e60051ac0 con 0x559baec00610 2024-09-18T01:45:23.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.789+0000 7f0d5e60c640 1 -- 172.21.15.146:0/4141466757 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e60051da0 con 0x559baec00610 2024-09-18T01:45:23.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.789+0000 7f0e74e30800 1 -- 172.21.15.146:0/4141466757 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559baec00610 msgr2=0x559baed7da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.789+0000 7f0e74e30800 1 --2- 172.21.15.146:0/4141466757 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559baec00610 0x559baed7da80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0e60025da0 tx=0x7f0e60051000 comp rx=0 tx=0).stop 2024-09-18T01:45:23.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.789+0000 7f0e74e30800 1 -- 172.21.15.146:0/4141466757 shutdown_connections 2024-09-18T01:45:23.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.789+0000 7f0e74e30800 1 --2- 172.21.15.146:0/4141466757 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559baec00610 0x559baed7da80 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.789+0000 7f0e74e30800 1 -- 172.21.15.146:0/4141466757 >> 172.21.15.146:0/4141466757 conn(0x559baec86de0 msgr2=0x559baed79440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:23.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.789+0000 7f0e74e30800 1 -- 172.21.15.146:0/4141466757 shutdown_connections 2024-09-18T01:45:23.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.789+0000 7f0e74e30800 1 -- 172.21.15.146:0/4141466757 wait complete. 2024-09-18T01:45:23.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.790+0000 7f0e74e30800 1 Processor -- start 2024-09-18T01:45:23.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.790+0000 7f0e74e30800 1 -- start start 2024-09-18T01:45:23.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.790+0000 7f0e74e30800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559baec00610 0x559baed85330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.790+0000 7f0e74e30800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x559baec95990 con 0x559baec00610 2024-09-18T01:45:23.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.790+0000 7f0e70167640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559baec00610 0x559baed85330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.790+0000 7f0e70167640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559baec00610 0x559baed85330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59788/0 (socket says 172.21.15.146:59788) 2024-09-18T01:45:23.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.790+0000 7f0e70167640 1 -- 172.21.15.146:0/559597936 learned_addr learned my addr 172.21.15.146:0/559597936 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:23.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.790+0000 7f0e70167640 1 -- 172.21.15.146:0/559597936 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559baeb39fe0 con 0x559baec00610 2024-09-18T01:45:23.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.791+0000 7f0e70167640 1 --2- 172.21.15.146:0/559597936 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559baec00610 0x559baed85330 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0e60025da0 tx=0x7f0e60002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.791+0000 7f0d5ce09640 1 -- 172.21.15.146:0/559597936 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e60073070 con 0x559baec00610 2024-09-18T01:45:23.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.791+0000 7f0d5ce09640 1 -- 172.21.15.146:0/559597936 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e6005a580 con 0x559baec00610 2024-09-18T01:45:23.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.791+0000 7f0e74e30800 1 -- 172.21.15.146:0/559597936 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559baed85870 con 0x559baec00610 2024-09-18T01:45:23.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.791+0000 7f0d5ce09640 1 -- 172.21.15.146:0/559597936 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e6005a860 con 0x559baec00610 2024-09-18T01:45:23.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.791+0000 7f0e74e30800 1 -- 172.21.15.146:0/559597936 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559baed85df0 con 0x559baec00610 2024-09-18T01:45:23.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.791+0000 7f0d5ce09640 1 -- 172.21.15.146:0/559597936 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0e60076070 con 0x559baec00610 2024-09-18T01:45:23.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.792+0000 7f0d5ce09640 1 --2- 172.21.15.146:0/559597936 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0d58036b40 0x7f0d58039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.792+0000 7f0d5ce09640 1 -- 172.21.15.146:0/559597936 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f0e60062070 con 0x559baec00610 2024-09-18T01:45:23.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.792+0000 7f0e6f966640 1 --2- 172.21.15.146:0/559597936 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0d58036b40 0x7f0d58039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.792+0000 7f0e74e30800 1 --2- 172.21.15.146:0/559597936 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559baec91bb0 0x559baed8c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.792+0000 7f0e74e30800 1 -- 172.21.15.146:0/559597936 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559baed8ca10 con 0x559baec91bb0 2024-09-18T01:45:23.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.792+0000 7f0e70968640 1 --2- 172.21.15.146:0/559597936 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559baec91bb0 0x559baed8c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.792+0000 7f0e6f966640 1 --2- 172.21.15.146:0/559597936 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0d58036b40 0x7f0d58039000 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0e58001e10 tx=0x7f0e58001390 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.792+0000 7f0e70968640 1 --2- 172.21.15.146:0/559597936 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559baec91bb0 0x559baed8c3a0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.792+0000 7f0e70968640 1 -- 172.21.15.146:0/559597936 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0e6800a4a0 con 0x559baec91bb0 2024-09-18T01:45:23.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.793+0000 7f0e74e30800 1 -- 172.21.15.146:0/559597936 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559baed89970 con 0x559baec91bb0 2024-09-18T01:45:23.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.793+0000 7f0e70968640 1 -- 172.21.15.146:0/559597936 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0e6800a4a0 con 0x559baec91bb0 2024-09-18T01:45:23.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.793+0000 7f0e74e30800 1 -- 172.21.15.146:0/559597936 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559baed8e850 con 0x559baec91bb0 2024-09-18T01:45:23.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.793+0000 7f0e70968640 1 -- 172.21.15.146:0/559597936 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0e6800a4a0 con 0x559baec91bb0 2024-09-18T01:45:23.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.793+0000 7f0e74e30800 1 -- 172.21.15.146:0/559597936 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559baed8da80 con 0x559baec91bb0 2024-09-18T01:45:23.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.793+0000 7f0e70968640 1 -- 172.21.15.146:0/559597936 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0e6800a4a0 con 0x559baec91bb0 2024-09-18T01:45:23.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.793+0000 7f0e74e30800 1 --2- 172.21.15.146:0/559597936 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x559baed8fc00 0x559baed91ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.793+0000 7f0e74e30800 1 -- 172.21.15.146:0/559597936 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559baed92530 con 0x559baed8fc00 2024-09-18T01:45:23.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.794+0000 7f0e70167640 1 --2- 172.21.15.146:0/559597936 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x559baed8fc00 0x559baed91ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.794+0000 7f0e70167640 1 --2- 172.21.15.146:0/559597936 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x559baed8fc00 0x559baed91ff0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.794+0000 7f0e70167640 1 -- 172.21.15.146:0/559597936 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0e6007f070 con 0x559baed8fc00 2024-09-18T01:45:23.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.794+0000 7f0e74e30800 1 Processor -- start 2024-09-18T01:45:23.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.794+0000 7f0e74e30800 1 -- start start 2024-09-18T01:45:23.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.795+0000 7f0e74e30800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559baeda01b0 0x559baeda05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.795+0000 7f0e74e30800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x559baeb27580 con 0x559baeda01b0 2024-09-18T01:45:23.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.795+0000 7f0e70968640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559baeda01b0 0x559baeda05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.795+0000 7f0e70968640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559baeda01b0 0x559baeda05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59798/0 (socket says 172.21.15.146:59798) 2024-09-18T01:45:23.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.795+0000 7f0e70968640 1 -- 172.21.15.146:0/3096066537 learned_addr learned my addr 172.21.15.146:0/3096066537 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:23.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.795+0000 7f0e70968640 1 -- 172.21.15.146:0/3096066537 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559baeda0b10 con 0x559baeda01b0 2024-09-18T01:45:23.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.795+0000 7f0e70968640 1 --2- 172.21.15.146:0/3096066537 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559baeda01b0 0x559baeda05d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x559baed86550 tx=0x7f0e680178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.795+0000 7f0d55ffb640 1 -- 172.21.15.146:0/3096066537 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e68013440 con 0x559baeda01b0 2024-09-18T01:45:23.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.795+0000 7f0d55ffb640 1 -- 172.21.15.146:0/3096066537 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e680135e0 con 0x559baeda01b0 2024-09-18T01:45:23.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.795+0000 7f0e74e30800 1 -- 172.21.15.146:0/3096066537 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559baeda0da0 con 0x559baeda01b0 2024-09-18T01:45:23.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.795+0000 7f0d55ffb640 1 -- 172.21.15.146:0/3096066537 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e680138c0 con 0x559baeda01b0 2024-09-18T01:45:23.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.795+0000 7f0e74e30800 1 -- 172.21.15.146:0/3096066537 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559baeda3a80 con 0x559baeda01b0 2024-09-18T01:45:23.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.796+0000 7f0d55ffb640 1 -- 172.21.15.146:0/3096066537 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0e68011040 con 0x559baeda01b0 2024-09-18T01:45:23.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.796+0000 7f0d55ffb640 1 --2- 172.21.15.146:0/3096066537 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0d48036b40 0x7f0d48039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.796+0000 7f0d55ffb640 1 -- 172.21.15.146:0/3096066537 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f0e6801d070 con 0x559baeda01b0 2024-09-18T01:45:23.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.796+0000 7f0e70167640 1 --2- 172.21.15.146:0/3096066537 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0d48036b40 0x7f0d48039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.797+0000 7f0e74e30800 1 Processor -- start 2024-09-18T01:45:23.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.797+0000 7f0e74e30800 1 -- start start 2024-09-18T01:45:23.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.797+0000 7f0e70167640 1 --2- 172.21.15.146:0/3096066537 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0d48036b40 0x7f0d48039000 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0e6005cfd0 tx=0x7f0e6008f3d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.797+0000 7f0e74e30800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559baedace50 0x559baedad250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.797+0000 7f0e74e30800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x559baed7e170 con 0x559baedace50 2024-09-18T01:45:23.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.797+0000 7f0e70968640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559baedace50 0x559baedad250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.797+0000 7f0e70968640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559baedace50 0x559baedad250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59800/0 (socket says 172.21.15.146:59800) 2024-09-18T01:45:23.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.797+0000 7f0e70968640 1 -- 172.21.15.146:0/2587126117 learned_addr learned my addr 172.21.15.146:0/2587126117 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:23.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.797+0000 7f0e70968640 1 -- 172.21.15.146:0/2587126117 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559baedad820 con 0x559baedace50 2024-09-18T01:45:23.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.797+0000 7f0e70968640 1 --2- 172.21.15.146:0/2587126117 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559baedace50 0x559baedad250 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0e6804c8f0 tx=0x7f0e6804cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f8c826ee55edfe0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.797+0000 7f0d4f7fe640 1 -- 172.21.15.146:0/2587126117 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e68012cc0 con 0x559baedace50 2024-09-18T01:45:23.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.797+0000 7f0d4f7fe640 1 -- 172.21.15.146:0/2587126117 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e6804b250 con 0x559baedace50 2024-09-18T01:45:23.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.797+0000 7f0d4f7fe640 1 -- 172.21.15.146:0/2587126117 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e68012e60 con 0x559baedace50 2024-09-18T01:45:23.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.798+0000 7f0e74e30800 1 -- 172.21.15.146:0/2587126117 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559baedace50 msgr2=0x559baedad250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.798+0000 7f0e74e30800 1 --2- 172.21.15.146:0/2587126117 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559baedace50 0x559baedad250 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0e6804c8f0 tx=0x7f0e6804cbc0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.798+0000 7f0e74e30800 1 -- 172.21.15.146:0/2587126117 shutdown_connections 2024-09-18T01:45:23.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.798+0000 7f0e74e30800 1 --2- 172.21.15.146:0/2587126117 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559baedace50 0x559baedad250 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.798+0000 7f0e74e30800 1 -- 172.21.15.146:0/2587126117 >> 172.21.15.146:0/2587126117 conn(0x559baeda9200 msgr2=0x559baeda7300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:23.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.798+0000 7f0e74e30800 1 -- 172.21.15.146:0/2587126117 shutdown_connections 2024-09-18T01:45:23.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.798+0000 7f0e74e30800 1 -- 172.21.15.146:0/2587126117 wait complete. 2024-09-18T01:45:23.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.798+0000 7f0e74e30800 1 Processor -- start 2024-09-18T01:45:23.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.798+0000 7f0e74e30800 1 -- start start 2024-09-18T01:45:23.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.798+0000 7f0e74e30800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559baedace50 0x559baedb4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.798+0000 7f0e74e30800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x559baedade30 con 0x559baedace50 2024-09-18T01:45:23.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.799+0000 7f0e70968640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559baedace50 0x559baedb4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.799+0000 7f0e70968640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559baedace50 0x559baedb4320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59812/0 (socket says 172.21.15.146:59812) 2024-09-18T01:45:23.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.799+0000 7f0e70968640 1 -- 172.21.15.146:0/4044381063 learned_addr learned my addr 172.21.15.146:0/4044381063 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:23.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.799+0000 7f0e70968640 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559baedb4860 con 0x559baedace50 2024-09-18T01:45:23.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.799+0000 7f0e70968640 1 --2- 172.21.15.146:0/4044381063 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559baedace50 0x559baedb4320 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0e6804b7c0 tx=0x7f0e6804c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.799+0000 7f0d4dffb640 1 -- 172.21.15.146:0/4044381063 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e6803b070 con 0x559baedace50 2024-09-18T01:45:23.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.799+0000 7f0d4dffb640 1 -- 172.21.15.146:0/4044381063 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e68041040 con 0x559baedace50 2024-09-18T01:45:23.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.799+0000 7f0e74e30800 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559baedb4af0 con 0x559baedace50 2024-09-18T01:45:23.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.799+0000 7f0d4dffb640 1 -- 172.21.15.146:0/4044381063 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e68046070 con 0x559baedace50 2024-09-18T01:45:23.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.799+0000 7f0e74e30800 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559baedb77a0 con 0x559baedace50 2024-09-18T01:45:23.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.800+0000 7f0d4dffb640 1 -- 172.21.15.146:0/4044381063 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0e6803e070 con 0x559baedace50 2024-09-18T01:45:23.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.800+0000 7f0d4dffb640 1 --2- 172.21.15.146:0/4044381063 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0d40036af0 0x7f0d40038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.800+0000 7f0d4dffb640 1 -- 172.21.15.146:0/4044381063 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f0e68033070 con 0x559baedace50 2024-09-18T01:45:23.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.800+0000 7f0e70167640 1 --2- 172.21.15.146:0/4044381063 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0d40036af0 0x7f0d40038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.800+0000 7f0e74e30800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.800+0000 7f0e74e30800 1 --2- 172.21.15.146:0/4044381063 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559baedbff60 0x559baedc2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.801+0000 7f0e74e30800 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559baedc2b70 con 0x559baedbff60 2024-09-18T01:45:23.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.801+0000 7f0e6f966640 1 --2- 172.21.15.146:0/4044381063 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559baedbff60 0x559baedc2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.801+0000 7f0e70167640 1 --2- 172.21.15.146:0/4044381063 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0d40036af0 0x7f0d40038fb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x559baed8e7b0 tx=0x7f0e6008a000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.801+0000 7f0e6f966640 1 --2- 172.21.15.146:0/4044381063 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559baedbff60 0x559baedc2420 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.801+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0e5800bdb0 con 0x559baedbff60 2024-09-18T01:45:23.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.801+0000 7f0e74e30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.801+0000 7f0e74e30800 20 realm 2024-09-18T01:45:23.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.801+0000 7f0e74e30800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.801+0000 7f0e74e30800 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559baedbf3b0 con 0x559baedbff60 2024-09-18T01:45:23.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.801+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0e5800bdb0 con 0x559baedbff60 2024-09-18T01:45:23.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.801+0000 7f0e74e30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.801+0000 7f0e74e30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:23.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.801+0000 7f0e74e30800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.801+0000 7f0e74e30800 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559baedc3650 con 0x559baedbff60 2024-09-18T01:45:23.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.802+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0e5800bdb0 con 0x559baedbff60 2024-09-18T01:45:23.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.802+0000 7f0e74e30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.802+0000 7f0e74e30800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.802+0000 7f0e74e30800 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559baedc3f20 con 0x559baedbff60 2024-09-18T01:45:23.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.802+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0e5800bdb0 con 0x559baedbff60 2024-09-18T01:45:23.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.802+0000 7f0e74e30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:23.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.802+0000 7f0e74e30800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.802+0000 7f0e74e30800 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559baedc42c0 con 0x559baedbff60 2024-09-18T01:45:23.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.802+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0e5800bdb0 con 0x559baedbff60 2024-09-18T01:45:23.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.802+0000 7f0e74e30800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:23.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.802+0000 7f0e74e30800 20 searching for the correct realm 2024-09-18T01:45:23.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.802+0000 7f0e74e30800 1 --2- 172.21.15.146:0/4044381063 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x559baedc61a0 0x559baedc8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.802+0000 7f0e74e30800 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559baedc8c60 con 0x559baedc61a0 2024-09-18T01:45:23.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.802+0000 7f0e70968640 1 --2- 172.21.15.146:0/4044381063 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x559baedc61a0 0x559baedc8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.803+0000 7f0e70968640 1 --2- 172.21.15.146:0/4044381063 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x559baedc61a0 0x559baedc8590 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.803+0000 7f0e70968640 1 -- 172.21.15.146:0/4044381063 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e6803d030 con 0x559baedc61a0 2024-09-18T01:45:23.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.803+0000 7f0e70968640 1 --2- 172.21.15.146:0/4044381063 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f0e680123a0 0x7f0e6804ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.803+0000 7f0e70968640 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559baedc8c60 con 0x7f0e680123a0 2024-09-18T01:45:23.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.803+0000 7f0e70167640 1 --2- 172.21.15.146:0/4044381063 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f0e680123a0 0x7f0e6804ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.803+0000 7f0e70167640 1 --2- 172.21.15.146:0/4044381063 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f0e680123a0 0x7f0e6804ea00 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.803+0000 7f0e70167640 1 -- 172.21.15.146:0/4044381063 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e6007f070 con 0x7f0e680123a0 2024-09-18T01:45:23.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.803+0000 7f0e70167640 1 --2- 172.21.15.146:0/4044381063 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f0e60078070 0x7f0e600643b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.803+0000 7f0e70167640 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559baedc8c60 con 0x7f0e60078070 2024-09-18T01:45:23.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.804+0000 7f0e6f966640 1 --2- 172.21.15.146:0/4044381063 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f0e60078070 0x7f0e600643b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.804+0000 7f0e6f966640 1 --2- 172.21.15.146:0/4044381063 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f0e60078070 0x7f0e600643b0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.804+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e5800bdb0 con 0x7f0e60078070 2024-09-18T01:45:23.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.804+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559baedc8c60 con 0x559baedbff60 2024-09-18T01:45:23.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.804+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0e5800bdb0 con 0x559baedbff60 2024-09-18T01:45:23.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.804+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559baedc8c60 con 0x559baedbff60 2024-09-18T01:45:23.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.805+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e5802b040 con 0x559baedbff60 2024-09-18T01:45:23.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.805+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559baedc8c60 con 0x7f0e60078070 2024-09-18T01:45:23.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.805+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e5802b040 con 0x7f0e60078070 2024-09-18T01:45:23.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.805+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559baedc8c60 con 0x7f0e60078070 2024-09-18T01:45:23.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.805+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e5802b040 con 0x7f0e60078070 2024-09-18T01:45:23.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.805+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559baedc8c60 con 0x7f0e680123a0 2024-09-18T01:45:23.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.805+0000 7f0e70167640 1 -- 172.21.15.146:0/4044381063 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e6007f070 con 0x7f0e680123a0 2024-09-18T01:45:23.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.805+0000 7f0e70167640 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559baedc8c60 con 0x559baedc61a0 2024-09-18T01:45:23.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.806+0000 7f0e70968640 1 -- 172.21.15.146:0/4044381063 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e6803d030 con 0x559baedc61a0 2024-09-18T01:45:23.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.806+0000 7f0e70968640 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559baedc8c60 con 0x559baedbff60 2024-09-18T01:45:23.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.806+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e5802b040 con 0x559baedbff60 2024-09-18T01:45:23.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.806+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559baedc8c60 con 0x7f0e60078070 2024-09-18T01:45:23.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.806+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e5802b040 con 0x7f0e60078070 2024-09-18T01:45:23.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.806+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559baedc8c60 con 0x559baedbff60 2024-09-18T01:45:23.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.806+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e5802b040 con 0x559baedbff60 2024-09-18T01:45:23.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.806+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559baedc8c60 con 0x7f0e680123a0 2024-09-18T01:45:23.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.807+0000 7f0e70167640 1 -- 172.21.15.146:0/4044381063 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f0e6007f070 con 0x7f0e680123a0 2024-09-18T01:45:23.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.807+0000 7f0e70167640 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559baedc8c60 con 0x559baedc61a0 2024-09-18T01:45:23.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.807+0000 7f0e70968640 1 -- 172.21.15.146:0/4044381063 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e6803d030 con 0x559baedc61a0 2024-09-18T01:45:23.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.807+0000 7f0e70968640 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559baedc8c60 con 0x559baedc61a0 2024-09-18T01:45:23.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.807+0000 7f0e70968640 1 -- 172.21.15.146:0/4044381063 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e6803d030 con 0x559baedc61a0 2024-09-18T01:45:23.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.807+0000 7f0e70968640 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559baedc8c60 con 0x7f0e60078070 2024-09-18T01:45:23.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.807+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e5802b040 con 0x7f0e60078070 2024-09-18T01:45:23.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.807+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559baedc8c60 con 0x559baedc61a0 2024-09-18T01:45:23.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.808+0000 7f0e70968640 1 -- 172.21.15.146:0/4044381063 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e6803d030 con 0x559baedc61a0 2024-09-18T01:45:23.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.808+0000 7f0e70968640 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559baedc8c60 con 0x559baedc61a0 2024-09-18T01:45:23.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.808+0000 7f0e70968640 1 -- 172.21.15.146:0/4044381063 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e6803d030 con 0x559baedc61a0 2024-09-18T01:45:23.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.808+0000 7f0e70968640 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559baedc8c60 con 0x559baedbff60 2024-09-18T01:45:23.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.808+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e5802b040 con 0x559baedbff60 2024-09-18T01:45:23.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.808+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559baedc8c60 con 0x559baedbff60 2024-09-18T01:45:23.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.808+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0e5802b040 con 0x559baedbff60 2024-09-18T01:45:23.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.808+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559baedc8c60 con 0x7f0e60078070 2024-09-18T01:45:23.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.809+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e5802b040 con 0x7f0e60078070 2024-09-18T01:45:23.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.809+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559baedc8c60 con 0x559baedc61a0 2024-09-18T01:45:23.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.809+0000 7f0e70968640 1 -- 172.21.15.146:0/4044381063 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e6803d030 con 0x559baedc61a0 2024-09-18T01:45:23.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.809+0000 7f0e70968640 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559baedc8c60 con 0x7f0e680123a0 2024-09-18T01:45:23.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.809+0000 7f0e70167640 1 -- 172.21.15.146:0/4044381063 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e6007f070 con 0x7f0e680123a0 2024-09-18T01:45:23.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.809+0000 7f0e70167640 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559baedc8c60 con 0x559baedbff60 2024-09-18T01:45:23.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.809+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e5802b040 con 0x559baedbff60 2024-09-18T01:45:23.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.809+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559baedc8c60 con 0x7f0e60078070 2024-09-18T01:45:23.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.810+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e5802b040 con 0x7f0e60078070 2024-09-18T01:45:23.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.810+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559baedc8c60 con 0x559baedc61a0 2024-09-18T01:45:23.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.810+0000 7f0e70968640 1 -- 172.21.15.146:0/4044381063 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e6803d030 con 0x559baedc61a0 2024-09-18T01:45:23.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.810+0000 7f0e70968640 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559baedc8c60 con 0x7f0e60078070 2024-09-18T01:45:23.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.810+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e5802b040 con 0x7f0e60078070 2024-09-18T01:45:23.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.810+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559baedc8c60 con 0x7f0e680123a0 2024-09-18T01:45:23.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.810+0000 7f0e70167640 1 -- 172.21.15.146:0/4044381063 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e6007f070 con 0x7f0e680123a0 2024-09-18T01:45:23.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.810+0000 7f0e70167640 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559baedc8c60 con 0x559baedc61a0 2024-09-18T01:45:23.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.811+0000 7f0e70968640 1 -- 172.21.15.146:0/4044381063 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e6803d030 con 0x559baedc61a0 2024-09-18T01:45:23.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.811+0000 7f0e70968640 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559baedc8c60 con 0x7f0e60078070 2024-09-18T01:45:23.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.811+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e5802b040 con 0x7f0e60078070 2024-09-18T01:45:23.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.811+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559baedc8c60 con 0x559baedbff60 2024-09-18T01:45:23.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.811+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0e5803b040 con 0x559baedbff60 2024-09-18T01:45:23.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.811+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559baedc8c60 con 0x7f0e680123a0 2024-09-18T01:45:23.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.811+0000 7f0e70167640 1 -- 172.21.15.146:0/4044381063 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e6007f070 con 0x7f0e680123a0 2024-09-18T01:45:23.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.811+0000 7f0e74e30800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:23.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.811+0000 7f0e74e30800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:23.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.811+0000 7f0e74e30800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:23.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.811+0000 7f0e74e30800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:23.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.811+0000 7f0e74e30800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:23.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.811+0000 7f0e74e30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:23.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.811+0000 7f0e74e30800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.811+0000 7f0e74e30800 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559baedc4c70 con 0x559baedbff60 2024-09-18T01:45:23.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.811+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0e5803b040 con 0x559baedbff60 2024-09-18T01:45:23.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.811+0000 7f0e74e30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.811+0000 7f0e74e30800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.811+0000 7f0e74e30800 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559baedc5510 con 0x559baedbff60 2024-09-18T01:45:23.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.812+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0e5803b040 con 0x559baedbff60 2024-09-18T01:45:23.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.812+0000 7f0e74e30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:23.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.812+0000 7f0e74e30800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.812+0000 7f0e74e30800 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559baedc48b0 con 0x7f0e680123a0 2024-09-18T01:45:23.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.812+0000 7f0e70167640 1 -- 172.21.15.146:0/4044381063 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0e6007f070 con 0x7f0e680123a0 2024-09-18T01:45:23.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.812+0000 7f0e74e30800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:23.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.812+0000 7f0e74e30800 20 zone default found 2024-09-18T01:45:23.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.812+0000 7f0e74e30800 4 Realm: () 2024-09-18T01:45:23.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.812+0000 7f0e74e30800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:23.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.812+0000 7f0e74e30800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:23.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.812+0000 7f0e74e30800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:23.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.812+0000 7f0e74e30800 20 zonegroup default 2024-09-18T01:45:23.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.812+0000 7f0e74e30800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.812+0000 7f0e74e30800 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559baedc9590 con 0x7f0e60078070 2024-09-18T01:45:23.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.812+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0e5803b040 con 0x7f0e60078070 2024-09-18T01:45:23.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.812+0000 7f0e74e30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.812+0000 7f0e74e30800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.812+0000 7f0e74e30800 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559baedcb120 con 0x559baedc61a0 2024-09-18T01:45:23.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.812+0000 7f0e70968640 1 -- 172.21.15.146:0/4044381063 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0e6803d030 con 0x559baedc61a0 2024-09-18T01:45:23.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.813+0000 7f0e74e30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.813+0000 7f0e74e30800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.813+0000 7f0e74e30800 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559baedcb5e0 con 0x559baedc61a0 2024-09-18T01:45:23.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.813+0000 7f0e70968640 1 -- 172.21.15.146:0/4044381063 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0e6803d030 con 0x559baedc61a0 2024-09-18T01:45:23.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.813+0000 7f0e74e30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.813+0000 7f0e74e30800 20 started sync module instance, tier type = 2024-09-18T01:45:23.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.813+0000 7f0e74e30800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:23.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.813+0000 7f0e74e30800 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559baedca020 con 0x7f0e680123a0 2024-09-18T01:45:23.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.814+0000 7f0e70167640 1 -- 172.21.15.146:0/4044381063 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v31'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e6007f070 con 0x7f0e680123a0 2024-09-18T01:45:23.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.814+0000 7f0e74e30800 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94127141987392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559baedcbef0 con 0x7f0e680123a0 2024-09-18T01:45:23.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.814+0000 7f0e74e30800 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559baedcc740 con 0x559baedbff60 2024-09-18T01:45:23.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.815+0000 7f0e70167640 1 -- 172.21.15.146:0/4044381063 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94127141987392] v31'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e6007f070 con 0x7f0e680123a0 2024-09-18T01:45:23.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.815+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v31'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e5803b040 con 0x559baedbff60 2024-09-18T01:45:23.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.815+0000 7f0e74e30800 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94127141993024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559baedcc7e0 con 0x559baedbff60 2024-09-18T01:45:23.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.815+0000 7f0e74e30800 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559baedcd300 con 0x559baedc61a0 2024-09-18T01:45:23.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.816+0000 7f0e70968640 1 -- 172.21.15.146:0/4044381063 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v31'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e6803d030 con 0x559baedc61a0 2024-09-18T01:45:23.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.816+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94127141993024] v31'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e5803b040 con 0x559baedbff60 2024-09-18T01:45:23.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.816+0000 7f0e74e30800 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94127141995152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559baedcd2c0 con 0x559baedc61a0 2024-09-18T01:45:23.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.816+0000 7f0e74e30800 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559baedcdd60 con 0x7f0e680123a0 2024-09-18T01:45:23.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.817+0000 7f0e70968640 1 -- 172.21.15.146:0/4044381063 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94127141995152] v31'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e6803d030 con 0x559baedc61a0 2024-09-18T01:45:23.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.818+0000 7f0e70167640 1 -- 172.21.15.146:0/4044381063 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v31'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e6007f070 con 0x7f0e680123a0 2024-09-18T01:45:23.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.818+0000 7f0e74e30800 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94127142000784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559baedce180 con 0x7f0e680123a0 2024-09-18T01:45:23.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.818+0000 7f0e74e30800 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559baedceb80 con 0x559baedbff60 2024-09-18T01:45:23.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.818+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v31'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e5803b040 con 0x559baedbff60 2024-09-18T01:45:23.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.819+0000 7f0e74e30800 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94127142004368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559baedcf420 con 0x559baedbff60 2024-09-18T01:45:23.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.819+0000 7f0e74e30800 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559baedcff20 con 0x7f0e60078070 2024-09-18T01:45:23.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.819+0000 7f0e70167640 1 -- 172.21.15.146:0/4044381063 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94127142000784] v31'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e6007f070 con 0x7f0e680123a0 2024-09-18T01:45:23.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.819+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v31'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e5803b040 con 0x7f0e60078070 2024-09-18T01:45:23.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.819+0000 7f0e74e30800 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94127142009360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559baedcfee0 con 0x7f0e60078070 2024-09-18T01:45:23.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.820+0000 7f0e74e30800 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559baedd0930 con 0x7f0e60078070 2024-09-18T01:45:23.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.822+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94127142004368] v31'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e5803b040 con 0x559baedbff60 2024-09-18T01:45:23.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.822+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(56 notify.6 [create] v31'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e5803b040 con 0x7f0e60078070 2024-09-18T01:45:23.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.822+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94127142009360] v31'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e5803b040 con 0x7f0e60078070 2024-09-18T01:45:23.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.822+0000 7f0e74e30800 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94127142006640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559baedd0930 con 0x7f0e60078070 2024-09-18T01:45:23.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.822+0000 7f0e74e30800 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559baedccdd0 con 0x7f0e60078070 2024-09-18T01:45:23.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.823+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94127142006640] v31'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e5803b040 con 0x7f0e60078070 2024-09-18T01:45:23.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.825+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v31'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e5803b040 con 0x7f0e60078070 2024-09-18T01:45:23.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.825+0000 7f0e74e30800 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94127142012032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559baedd08a0 con 0x7f0e60078070 2024-09-18T01:45:23.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.825+0000 7f0e74e30800 20 add_watcher() i=0 2024-09-18T01:45:23.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.825+0000 7f0e74e30800 20 add_watcher() i=1 2024-09-18T01:45:23.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.825+0000 7f0e74e30800 20 add_watcher() i=2 2024-09-18T01:45:23.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.825+0000 7f0e74e30800 20 add_watcher() i=3 2024-09-18T01:45:23.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.825+0000 7f0e74e30800 20 add_watcher() i=4 2024-09-18T01:45:23.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.825+0000 7f0e74e30800 20 add_watcher() i=5 2024-09-18T01:45:23.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.825+0000 7f0e74e30800 20 add_watcher() i=6 2024-09-18T01:45:23.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.826+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94127142012032] v31'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e5803b040 con 0x7f0e60078070 2024-09-18T01:45:23.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.826+0000 7f0e74e30800 20 add_watcher() i=7 2024-09-18T01:45:23.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.826+0000 7f0e74e30800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:23.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.826+0000 7f0e74e30800 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559baedd4320 con 0x559baedbff60 2024-09-18T01:45:23.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.826+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0e5803b040 con 0x559baedbff60 2024-09-18T01:45:23.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.826+0000 7f0e74e30800 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94127142014528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559baedd1710 con 0x559baedbff60 2024-09-18T01:45:23.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.827+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94127142014528] v31'68 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0e5803b040 con 0x559baedbff60 2024-09-18T01:45:23.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.827+0000 7f0d267e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:23.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.827+0000 7f0e74e30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:23.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.827+0000 7f0e74e30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:23.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.827+0000 7f0e74e30800 5 note: GC not initialized 2024-09-18T01:45:23.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.828+0000 7f0d257e2640 20 reqs_thread_entry: start 2024-09-18T01:45:23.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.828+0000 7f0e74e30800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:23.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.828+0000 7f0e74e30800 20 Filter name: none 2024-09-18T01:45:23.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.828+0000 7f0c96ffd640 20 reqs_thread_entry: start 2024-09-18T01:45:23.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.828+0000 7f0e74e30800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.828+0000 7f0e74e30800 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559baee071a0 con 0x559baedbff60 2024-09-18T01:45:23.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.828+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f0e5803b040 con 0x559baedbff60 2024-09-18T01:45:23.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.828+0000 7f0e74e30800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:45:23.835 INFO:teuthology.orchestra.run.smithi146.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T01:45:23.010714Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:45:23.010705Z","tags":[],"group_ids":[]} 2024-09-18T01:45:23.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.829+0000 7f0d267e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:23.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.829+0000 7f0e74e30800 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94127142014528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559baee05fb0 con 0x559baedbff60 2024-09-18T01:45:23.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.830+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94127142014528] v31'69 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0e5803b040 con 0x559baedbff60 2024-09-18T01:45:23.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.830+0000 7f0e74e30800 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94127141987392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559baedd0e40 con 0x7f0e680123a0 2024-09-18T01:45:23.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.831+0000 7f0e70167640 1 -- 172.21.15.146:0/4044381063 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94127141987392] v31'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e6007f070 con 0x7f0e680123a0 2024-09-18T01:45:23.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.831+0000 7f0e74e30800 20 remove_watcher() i=0 2024-09-18T01:45:23.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.831+0000 7f0e74e30800 2 removed watcher, disabling cache 2024-09-18T01:45:23.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.831+0000 7f0e74e30800 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94127141993024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559baedd0e40 con 0x559baedbff60 2024-09-18T01:45:23.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.832+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94127141993024] v31'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e5803b040 con 0x559baedbff60 2024-09-18T01:45:23.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.832+0000 7f0e74e30800 20 remove_watcher() i=1 2024-09-18T01:45:23.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.832+0000 7f0e74e30800 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94127141995152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559baedcba40 con 0x559baedc61a0 2024-09-18T01:45:23.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.833+0000 7f0e70968640 1 -- 172.21.15.146:0/4044381063 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94127141995152] v31'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e6803d030 con 0x559baedc61a0 2024-09-18T01:45:23.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.833+0000 7f0e74e30800 20 remove_watcher() i=2 2024-09-18T01:45:23.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.833+0000 7f0e74e30800 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94127142000784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559baedd0e40 con 0x7f0e680123a0 2024-09-18T01:45:23.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.834+0000 7f0e70167640 1 -- 172.21.15.146:0/4044381063 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94127142000784] v31'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e6007f070 con 0x7f0e680123a0 2024-09-18T01:45:23.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.834+0000 7f0e74e30800 20 remove_watcher() i=3 2024-09-18T01:45:23.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.834+0000 7f0e74e30800 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94127142004368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559baedcd890 con 0x559baedbff60 2024-09-18T01:45:23.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.835+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94127142004368] v31'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e5803b040 con 0x559baedbff60 2024-09-18T01:45:23.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.835+0000 7f0e74e30800 20 remove_watcher() i=4 2024-09-18T01:45:23.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.835+0000 7f0e74e30800 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94127142009360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559baedd0e40 con 0x7f0e60078070 2024-09-18T01:45:23.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.836+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94127142009360] v31'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e5803b040 con 0x7f0e60078070 2024-09-18T01:45:23.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.836+0000 7f0e74e30800 20 remove_watcher() i=5 2024-09-18T01:45:23.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.836+0000 7f0e74e30800 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94127142006640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559baedcd890 con 0x7f0e60078070 2024-09-18T01:45:23.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.837+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94127142006640] v31'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e5803b040 con 0x7f0e60078070 2024-09-18T01:45:23.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.837+0000 7f0e74e30800 20 remove_watcher() i=6 2024-09-18T01:45:23.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.837+0000 7f0e74e30800 1 -- 172.21.15.146:0/4044381063 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94127142012032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559baedcd890 con 0x7f0e60078070 2024-09-18T01:45:23.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.838+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94127142012032] v31'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e5803b040 con 0x7f0e60078070 2024-09-18T01:45:23.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.838+0000 7f0e74e30800 20 remove_watcher() i=7 2024-09-18T01:45:23.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.838+0000 7f0e74e30800 1 -- 172.21.15.146:0/4044381063 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f0e60078070 msgr2=0x7f0e600643b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.838+0000 7f0e74e30800 1 --2- 172.21.15.146:0/4044381063 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f0e60078070 0x7f0e600643b0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.838+0000 7f0e74e30800 1 -- 172.21.15.146:0/4044381063 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559baedbff60 msgr2=0x559baedc2420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.838+0000 7f0e74e30800 1 --2- 172.21.15.146:0/4044381063 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559baedbff60 0x559baedc2420 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.838+0000 7f0e74e30800 1 -- 172.21.15.146:0/4044381063 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f0e680123a0 msgr2=0x7f0e6804ea00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.838+0000 7f0e74e30800 1 --2- 172.21.15.146:0/4044381063 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f0e680123a0 0x7f0e6804ea00 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.838+0000 7f0e74e30800 1 -- 172.21.15.146:0/4044381063 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x559baedc61a0 msgr2=0x559baedc8590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.838+0000 7f0e74e30800 1 --2- 172.21.15.146:0/4044381063 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x559baedc61a0 0x559baedc8590 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.838+0000 7f0e74e30800 1 -- 172.21.15.146:0/4044381063 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0d40036af0 msgr2=0x7f0d40038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.838+0000 7f0e74e30800 1 --2- 172.21.15.146:0/4044381063 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0d40036af0 0x7f0d40038fb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x559baed8e7b0 tx=0x7f0e6008a000 comp rx=0 tx=0).stop 2024-09-18T01:45:23.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.838+0000 7f0e74e30800 1 -- 172.21.15.146:0/4044381063 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559baedace50 msgr2=0x559baedb4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.838+0000 7f0e6f966640 1 -- 172.21.15.146:0/4044381063 reap_dead start 2024-09-18T01:45:23.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.838+0000 7f0e74e30800 1 --2- 172.21.15.146:0/4044381063 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559baedace50 0x559baedb4320 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0e6804b7c0 tx=0x7f0e6804c880 comp rx=0 tx=0).stop 2024-09-18T01:45:23.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.838+0000 7f0e74e30800 1 -- 172.21.15.146:0/4044381063 shutdown_connections 2024-09-18T01:45:23.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.838+0000 7f0e74e30800 1 --2- 172.21.15.146:0/4044381063 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559baedace50 0x559baedb4320 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.838+0000 7f0e74e30800 1 -- 172.21.15.146:0/4044381063 >> 172.21.15.146:0/4044381063 conn(0x559baeda9200 msgr2=0x559baedae590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:23.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.838+0000 7f0e74e30800 1 -- 172.21.15.146:0/4044381063 shutdown_connections 2024-09-18T01:45:23.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.839+0000 7f0e74e30800 1 -- 172.21.15.146:0/4044381063 wait complete. 2024-09-18T01:45:23.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.839+0000 7f0e74e30800 1 -- 172.21.15.146:0/3096066537 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0d48036b40 msgr2=0x7f0d48039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.839+0000 7f0e74e30800 1 --2- 172.21.15.146:0/3096066537 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0d48036b40 0x7f0d48039000 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0e6005cfd0 tx=0x7f0e6008f3d0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.839+0000 7f0e74e30800 1 -- 172.21.15.146:0/3096066537 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559baeda01b0 msgr2=0x559baeda05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.839+0000 7f0e74e30800 1 --2- 172.21.15.146:0/3096066537 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559baeda01b0 0x559baeda05d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x559baed86550 tx=0x7f0e680178e0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.839+0000 7f0e74e30800 1 -- 172.21.15.146:0/3096066537 shutdown_connections 2024-09-18T01:45:23.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.839+0000 7f0e74e30800 1 --2- 172.21.15.146:0/3096066537 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0d48036b40 0x7f0d48039000 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.839+0000 7f0e74e30800 1 --2- 172.21.15.146:0/3096066537 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559baeda01b0 0x559baeda05d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.839+0000 7f0e74e30800 1 -- 172.21.15.146:0/3096066537 >> 172.21.15.146:0/3096066537 conn(0x559baed95140 msgr2=0x559baed97cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:23.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.839+0000 7f0e74e30800 1 -- 172.21.15.146:0/3096066537 shutdown_connections 2024-09-18T01:45:23.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.839+0000 7f0e74e30800 1 -- 172.21.15.146:0/3096066537 wait complete. 2024-09-18T01:45:23.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.839+0000 7f0e74e30800 1 -- 172.21.15.146:0/559597936 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559baec91bb0 msgr2=0x559baed8c3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.839+0000 7f0e74e30800 1 --2- 172.21.15.146:0/559597936 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559baec91bb0 0x559baed8c3a0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.839+0000 7f0e74e30800 1 -- 172.21.15.146:0/559597936 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x559baed8fc00 msgr2=0x559baed91ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.839+0000 7f0e74e30800 1 --2- 172.21.15.146:0/559597936 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x559baed8fc00 0x559baed91ff0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.839+0000 7f0e74e30800 1 -- 172.21.15.146:0/559597936 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0d58036b40 msgr2=0x7f0d58039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.839+0000 7f0e74e30800 1 --2- 172.21.15.146:0/559597936 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0d58036b40 0x7f0d58039000 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0e58001e10 tx=0x7f0e58001390 comp rx=0 tx=0).stop 2024-09-18T01:45:23.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.839+0000 7f0e74e30800 1 -- 172.21.15.146:0/559597936 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559baec00610 msgr2=0x559baed85330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.839+0000 7f0e74e30800 1 --2- 172.21.15.146:0/559597936 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559baec00610 0x559baed85330 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0e60025da0 tx=0x7f0e60002fb0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.839+0000 7f0e74e30800 1 -- 172.21.15.146:0/559597936 shutdown_connections 2024-09-18T01:45:23.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.839+0000 7f0e74e30800 1 --2- 172.21.15.146:0/559597936 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x559baed8fc00 0x559baed91ff0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.839+0000 7f0e74e30800 1 --2- 172.21.15.146:0/559597936 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559baec91bb0 0x559baed8c3a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.839+0000 7f0e74e30800 1 --2- 172.21.15.146:0/559597936 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0d58036b40 0x7f0d58039000 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.839+0000 7f0e74e30800 1 --2- 172.21.15.146:0/559597936 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559baec00610 0x559baed85330 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.839+0000 7f0e74e30800 1 -- 172.21.15.146:0/559597936 >> 172.21.15.146:0/559597936 conn(0x559baec86de0 msgr2=0x559baed77cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:23.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.839+0000 7f0e74e30800 1 -- 172.21.15.146:0/559597936 shutdown_connections 2024-09-18T01:45:23.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.839+0000 7f0e74e30800 1 -- 172.21.15.146:0/559597936 wait complete. 2024-09-18T01:45:23.849 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T01:45:23.010714Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:45:23.010705Z', 'tags': [], 'group_ids': []} 2024-09-18T01:45:23.849 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-18T01:45:23.849 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-18T01:45:23.849 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key create --uid foo --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh 2024-09-18T01:45:23.897 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:23.897 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:23.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.897+0000 7f642c13d800 1 Processor -- start 2024-09-18T01:45:23.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.898+0000 7f642c13d800 1 -- start start 2024-09-18T01:45:23.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.898+0000 7f642c13d800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x56341cb0f780 0x56341cb0fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.898+0000 7f642c13d800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56341c9ceb30 con 0x56341cb100c0 2024-09-18T01:45:23.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.898+0000 7f642c13d800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x56341c9b0360 con 0x56341cb0f780 2024-09-18T01:45:23.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.898+0000 7f6427e90640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x56341cb0f780 0x56341cb0fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.898+0000 7f6427e90640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x56341cb0f780 0x56341cb0fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59814/0 (socket says 172.21.15.146:59814) 2024-09-18T01:45:23.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.898+0000 7f6427e90640 1 -- 172.21.15.146:0/3916157675 learned_addr learned my addr 172.21.15.146:0/3916157675 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:23.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.898+0000 7f641f68f640 1 --1- 172.21.15.146:0/3916157675 >> v1:172.21.15.129:6789/0 conn(0x56341cb100c0 0x56341cb14b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:38764/0 (socket says 172.21.15.146:38764) 2024-09-18T01:45:23.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.898+0000 7f6427e90640 1 -- 172.21.15.146:0/3916157675 >> v1:172.21.15.129:6789/0 conn(0x56341cb100c0 legacy=0x56341cb14b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.898+0000 7f642768f640 1 -- 172.21.15.146:0/3916157675 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 88192481 0 0) 0x56341c9ceb30 con 0x56341cb100c0 2024-09-18T01:45:23.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.898+0000 7f6427e90640 1 -- 172.21.15.146:0/3916157675 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56341c9d6e00 con 0x56341cb0f780 2024-09-18T01:45:23.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.900+0000 7f6427e90640 1 --2- 172.21.15.146:0/3916157675 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56341cb0f780 0x56341cb0fb80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f641800a520 tx=0x7f6418045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7d5cf2f0cd5ba58 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.900+0000 7f642768f640 1 -- 172.21.15.146:0/3916157675 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6418055070 con 0x56341cb0f780 2024-09-18T01:45:23.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.900+0000 7f642768f640 1 -- 172.21.15.146:0/3916157675 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64180515b0 con 0x56341cb0f780 2024-09-18T01:45:23.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.900+0000 7f642768f640 1 -- 172.21.15.146:0/3916157675 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64180518d0 con 0x56341cb0f780 2024-09-18T01:45:23.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.901+0000 7f642c13d800 1 -- 172.21.15.146:0/3916157675 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56341cb0f780 msgr2=0x56341cb0fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.901+0000 7f642c13d800 1 --2- 172.21.15.146:0/3916157675 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56341cb0f780 0x56341cb0fb80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f641800a520 tx=0x7f6418045ba0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.901+0000 7f642c13d800 1 -- 172.21.15.146:0/3916157675 shutdown_connections 2024-09-18T01:45:23.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.901+0000 7f642c13d800 1 --2- 172.21.15.146:0/3916157675 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56341cb0f780 0x56341cb0fb80 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.901+0000 7f642c13d800 1 -- 172.21.15.146:0/3916157675 >> 172.21.15.146:0/3916157675 conn(0x56341cb0b010 msgr2=0x56341cb0d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:23.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.901+0000 7f642c13d800 1 -- 172.21.15.146:0/3916157675 shutdown_connections 2024-09-18T01:45:23.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.901+0000 7f642c13d800 1 -- 172.21.15.146:0/3916157675 wait complete. 2024-09-18T01:45:23.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.915+0000 7f642c13d800 1 Processor -- start 2024-09-18T01:45:23.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.915+0000 7f642c13d800 1 -- start start 2024-09-18T01:45:23.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.915+0000 7f642c13d800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56341cb0f780 0x56341cbfe740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.915+0000 7f642c13d800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x56341ca5b350 con 0x56341cb0f780 2024-09-18T01:45:23.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.915+0000 7f6427e90640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56341cb0f780 0x56341cbfe740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.915+0000 7f6427e90640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56341cb0f780 0x56341cbfe740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59818/0 (socket says 172.21.15.146:59818) 2024-09-18T01:45:23.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.915+0000 7f6427e90640 1 -- 172.21.15.146:0/1016336755 learned_addr learned my addr 172.21.15.146:0/1016336755 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:23.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.915+0000 7f6427e90640 1 -- 172.21.15.146:0/1016336755 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56341c9a8bc0 con 0x56341cb0f780 2024-09-18T01:45:23.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.916+0000 7f6427e90640 1 --2- 172.21.15.146:0/1016336755 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56341cb0f780 0x56341cbfe740 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6418025da0 tx=0x7f6418051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c00c7512638562af server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.916+0000 7f6315e0b640 1 -- 172.21.15.146:0/1016336755 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6418051ac0 con 0x56341cb0f780 2024-09-18T01:45:23.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.916+0000 7f6315e0b640 1 -- 172.21.15.146:0/1016336755 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6418051c60 con 0x56341cb0f780 2024-09-18T01:45:23.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.916+0000 7f6315e0b640 1 -- 172.21.15.146:0/1016336755 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6418066460 con 0x56341cb0f780 2024-09-18T01:45:23.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.916+0000 7f642c13d800 1 -- 172.21.15.146:0/1016336755 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56341cb0f780 msgr2=0x56341cbfe740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.916+0000 7f642c13d800 1 --2- 172.21.15.146:0/1016336755 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56341cb0f780 0x56341cbfe740 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6418025da0 tx=0x7f6418051000 comp rx=0 tx=0).stop 2024-09-18T01:45:23.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.916+0000 7f642c13d800 1 -- 172.21.15.146:0/1016336755 shutdown_connections 2024-09-18T01:45:23.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.916+0000 7f642c13d800 1 --2- 172.21.15.146:0/1016336755 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56341cb0f780 0x56341cbfe740 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.916+0000 7f642c13d800 1 -- 172.21.15.146:0/1016336755 >> 172.21.15.146:0/1016336755 conn(0x56341cb0b010 msgr2=0x56341cbfa100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:23.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.917+0000 7f642c13d800 1 -- 172.21.15.146:0/1016336755 shutdown_connections 2024-09-18T01:45:23.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.917+0000 7f642c13d800 1 -- 172.21.15.146:0/1016336755 wait complete. 2024-09-18T01:45:23.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.917+0000 7f642c13d800 1 Processor -- start 2024-09-18T01:45:23.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.917+0000 7f642c13d800 1 -- start start 2024-09-18T01:45:23.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.917+0000 7f642c13d800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56341cb0f780 0x56341cc05fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.917+0000 7f642c13d800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x56341cb16660 con 0x56341cb0f780 2024-09-18T01:45:23.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.917+0000 7f6427e90640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56341cb0f780 0x56341cc05fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.917+0000 7f6427e90640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56341cb0f780 0x56341cc05fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59820/0 (socket says 172.21.15.146:59820) 2024-09-18T01:45:23.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.917+0000 7f6427e90640 1 -- 172.21.15.146:0/3526071605 learned_addr learned my addr 172.21.15.146:0/3526071605 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:23.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.917+0000 7f6427e90640 1 -- 172.21.15.146:0/3526071605 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56341c9bcfe0 con 0x56341cb0f780 2024-09-18T01:45:23.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.918+0000 7f6427e90640 1 --2- 172.21.15.146:0/3526071605 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56341cb0f780 0x56341cc05fe0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f64180460a0 tx=0x7f6418003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.918+0000 7f630ffff640 1 -- 172.21.15.146:0/3526071605 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6418066650 con 0x56341cb0f780 2024-09-18T01:45:23.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.918+0000 7f630ffff640 1 -- 172.21.15.146:0/3526071605 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64180667f0 con 0x56341cb0f780 2024-09-18T01:45:23.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.918+0000 7f642c13d800 1 -- 172.21.15.146:0/3526071605 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56341cc06520 con 0x56341cb0f780 2024-09-18T01:45:23.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.918+0000 7f630ffff640 1 -- 172.21.15.146:0/3526071605 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6418066af0 con 0x56341cb0f780 2024-09-18T01:45:23.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.918+0000 7f642c13d800 1 -- 172.21.15.146:0/3526071605 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56341cc06a40 con 0x56341cb0f780 2024-09-18T01:45:23.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.918+0000 7f630ffff640 1 -- 172.21.15.146:0/3526071605 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6418079060 con 0x56341cb0f780 2024-09-18T01:45:23.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.919+0000 7f630ffff640 1 --2- 172.21.15.146:0/3526071605 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6310036b40 0x7f6310039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.919+0000 7f630ffff640 1 -- 172.21.15.146:0/3526071605 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f6418062070 con 0x56341cb0f780 2024-09-18T01:45:23.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.919+0000 7f641f68f640 1 --2- 172.21.15.146:0/3526071605 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6310036b40 0x7f6310039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.919+0000 7f642c13d800 1 --2- 172.21.15.146:0/3526071605 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56341cb100c0 0x56341cc0d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.919+0000 7f642c13d800 1 -- 172.21.15.146:0/3526071605 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56341cc0d5d0 con 0x56341cb100c0 2024-09-18T01:45:23.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.919+0000 7f6428691640 1 --2- 172.21.15.146:0/3526071605 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56341cb100c0 0x56341cc0d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.919+0000 7f641f68f640 1 --2- 172.21.15.146:0/3526071605 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6310036b40 0x7f6310039000 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6410000c00 tx=0x7f64100013b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.919+0000 7f6428691640 1 --2- 172.21.15.146:0/3526071605 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56341cb100c0 0x56341cc0d050 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.920+0000 7f6428691640 1 -- 172.21.15.146:0/3526071605 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f642000a4a0 con 0x56341cb100c0 2024-09-18T01:45:23.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.920+0000 7f642c13d800 1 -- 172.21.15.146:0/3526071605 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56341cc0a5e0 con 0x56341cb100c0 2024-09-18T01:45:23.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.920+0000 7f6428691640 1 -- 172.21.15.146:0/3526071605 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f642000a4a0 con 0x56341cb100c0 2024-09-18T01:45:23.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.920+0000 7f642c13d800 1 -- 172.21.15.146:0/3526071605 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56341cc0f3f0 con 0x56341cb100c0 2024-09-18T01:45:23.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.920+0000 7f6428691640 1 -- 172.21.15.146:0/3526071605 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f642000a4a0 con 0x56341cb100c0 2024-09-18T01:45:23.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.920+0000 7f642c13d800 1 -- 172.21.15.146:0/3526071605 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56341cc0e530 con 0x56341cb100c0 2024-09-18T01:45:23.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.920+0000 7f6428691640 1 -- 172.21.15.146:0/3526071605 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f642000a4a0 con 0x56341cb100c0 2024-09-18T01:45:23.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.920+0000 7f642c13d800 1 --2- 172.21.15.146:0/3526071605 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x56341cc0efd0 0x56341cc127f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.920+0000 7f642c13d800 1 -- 172.21.15.146:0/3526071605 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56341cc12f80 con 0x56341cc0efd0 2024-09-18T01:45:23.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.921+0000 7f6427e90640 1 --2- 172.21.15.146:0/3526071605 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x56341cc0efd0 0x56341cc127f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.921+0000 7f6427e90640 1 --2- 172.21.15.146:0/3526071605 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x56341cc0efd0 0x56341cc127f0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.921+0000 7f6427e90640 1 -- 172.21.15.146:0/3526071605 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6418057030 con 0x56341cc0efd0 2024-09-18T01:45:23.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.921+0000 7f642c13d800 1 Processor -- start 2024-09-18T01:45:23.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.921+0000 7f642c13d800 1 -- start start 2024-09-18T01:45:23.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.922+0000 7f642c13d800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56341cc20d30 0x56341cc21150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.922+0000 7f642c13d800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x56341c9aa580 con 0x56341cc20d30 2024-09-18T01:45:23.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.922+0000 7f6428691640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56341cc20d30 0x56341cc21150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.922+0000 7f6428691640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56341cc20d30 0x56341cc21150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59822/0 (socket says 172.21.15.146:59822) 2024-09-18T01:45:23.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.922+0000 7f6428691640 1 -- 172.21.15.146:0/3961469756 learned_addr learned my addr 172.21.15.146:0/3961469756 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:23.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.922+0000 7f6428691640 1 -- 172.21.15.146:0/3961469756 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56341cc21690 con 0x56341cc20d30 2024-09-18T01:45:23.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.922+0000 7f6428691640 1 --2- 172.21.15.146:0/3961469756 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56341cc20d30 0x56341cc21150 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x56341cc0d9d0 tx=0x7f64200178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.922+0000 7f630d7fa640 1 -- 172.21.15.146:0/3961469756 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6420013440 con 0x56341cc20d30 2024-09-18T01:45:23.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.922+0000 7f630d7fa640 1 -- 172.21.15.146:0/3961469756 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64200135e0 con 0x56341cc20d30 2024-09-18T01:45:23.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.922+0000 7f642c13d800 1 -- 172.21.15.146:0/3961469756 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56341cc21920 con 0x56341cc20d30 2024-09-18T01:45:23.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.922+0000 7f630d7fa640 1 -- 172.21.15.146:0/3961469756 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64200138c0 con 0x56341cc20d30 2024-09-18T01:45:23.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.923+0000 7f642c13d800 1 -- 172.21.15.146:0/3961469756 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56341cc24600 con 0x56341cc20d30 2024-09-18T01:45:23.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.923+0000 7f630d7fa640 1 -- 172.21.15.146:0/3961469756 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6420011040 con 0x56341cc20d30 2024-09-18T01:45:23.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.923+0000 7f630d7fa640 1 --2- 172.21.15.146:0/3961469756 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6300036b40 0x7f6300039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.923+0000 7f630d7fa640 1 -- 172.21.15.146:0/3961469756 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f642001d070 con 0x56341cc20d30 2024-09-18T01:45:23.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.923+0000 7f6427e90640 1 --2- 172.21.15.146:0/3961469756 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6300036b40 0x7f6300039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.924+0000 7f642c13d800 1 Processor -- start 2024-09-18T01:45:23.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.924+0000 7f642c13d800 1 -- start start 2024-09-18T01:45:23.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.924+0000 7f6427e90640 1 --2- 172.21.15.146:0/3961469756 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6300036b40 0x7f6300039000 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x56341cc0e8d0 tx=0x7f641808e6c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.924+0000 7f642c13d800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56341ca83de0 0x56341ca841e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.924+0000 7f642c13d800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x56341cbfee30 con 0x56341ca83de0 2024-09-18T01:45:23.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.924+0000 7f6428691640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56341ca83de0 0x56341ca841e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.924+0000 7f6428691640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56341ca83de0 0x56341ca841e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59834/0 (socket says 172.21.15.146:59834) 2024-09-18T01:45:23.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.924+0000 7f6428691640 1 -- 172.21.15.146:0/603433891 learned_addr learned my addr 172.21.15.146:0/603433891 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:23.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.924+0000 7f6428691640 1 -- 172.21.15.146:0/603433891 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56341ca84720 con 0x56341ca83de0 2024-09-18T01:45:23.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.924+0000 7f6428691640 1 --2- 172.21.15.146:0/603433891 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56341ca83de0 0x56341ca841e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f642004cb30 tx=0x7f6420012a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83d819ce31ae3254 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.925+0000 7f6306ffd640 1 -- 172.21.15.146:0/603433891 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6420045070 con 0x56341ca83de0 2024-09-18T01:45:23.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.925+0000 7f6306ffd640 1 -- 172.21.15.146:0/603433891 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6420015430 con 0x56341ca83de0 2024-09-18T01:45:23.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.925+0000 7f6306ffd640 1 -- 172.21.15.146:0/603433891 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f642002ac50 con 0x56341ca83de0 2024-09-18T01:45:23.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.925+0000 7f642c13d800 1 -- 172.21.15.146:0/603433891 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56341ca83de0 msgr2=0x56341ca841e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.925+0000 7f642c13d800 1 --2- 172.21.15.146:0/603433891 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56341ca83de0 0x56341ca841e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f642004cb30 tx=0x7f6420012a30 comp rx=0 tx=0).stop 2024-09-18T01:45:23.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.925+0000 7f642c13d800 1 -- 172.21.15.146:0/603433891 shutdown_connections 2024-09-18T01:45:23.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.925+0000 7f642c13d800 1 --2- 172.21.15.146:0/603433891 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56341ca83de0 0x56341ca841e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.925+0000 7f642c13d800 1 -- 172.21.15.146:0/603433891 >> 172.21.15.146:0/603433891 conn(0x56341cc29d60 msgr2=0x56341cc27e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:23.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.925+0000 7f642c13d800 1 -- 172.21.15.146:0/603433891 shutdown_connections 2024-09-18T01:45:23.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.925+0000 7f642c13d800 1 -- 172.21.15.146:0/603433891 wait complete. 2024-09-18T01:45:23.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.925+0000 7f642c13d800 1 Processor -- start 2024-09-18T01:45:23.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.925+0000 7f642c13d800 1 -- start start 2024-09-18T01:45:23.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.926+0000 7f642c13d800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56341ca83de0 0x56341cc370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.926+0000 7f642c13d800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x56341ca84e60 con 0x56341ca83de0 2024-09-18T01:45:23.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.926+0000 7f6428691640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56341ca83de0 0x56341cc370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.926+0000 7f6428691640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56341ca83de0 0x56341cc370c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59844/0 (socket says 172.21.15.146:59844) 2024-09-18T01:45:23.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.926+0000 7f6428691640 1 -- 172.21.15.146:0/1738577794 learned_addr learned my addr 172.21.15.146:0/1738577794 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:23.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.926+0000 7f6428691640 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56341cc37600 con 0x56341ca83de0 2024-09-18T01:45:23.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.926+0000 7f6428691640 1 --2- 172.21.15.146:0/1738577794 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56341ca83de0 0x56341cc370c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f642004b780 tx=0x7f642004c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.926+0000 7f63057fa640 1 -- 172.21.15.146:0/1738577794 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6420039070 con 0x56341ca83de0 2024-09-18T01:45:23.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.926+0000 7f63057fa640 1 -- 172.21.15.146:0/1738577794 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6420046040 con 0x56341ca83de0 2024-09-18T01:45:23.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.926+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56341cc37890 con 0x56341ca83de0 2024-09-18T01:45:23.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.926+0000 7f63057fa640 1 -- 172.21.15.146:0/1738577794 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6420045070 con 0x56341ca83de0 2024-09-18T01:45:23.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.926+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56341cc3a540 con 0x56341ca83de0 2024-09-18T01:45:23.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.927+0000 7f63057fa640 1 -- 172.21.15.146:0/1738577794 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f642003c070 con 0x56341ca83de0 2024-09-18T01:45:23.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.927+0000 7f63057fa640 1 --2- 172.21.15.146:0/1738577794 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f62f0036b40 0x7f62f0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.927+0000 7f63057fa640 1 -- 172.21.15.146:0/1738577794 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f642000e040 con 0x56341ca83de0 2024-09-18T01:45:23.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.927+0000 7f6427e90640 1 --2- 172.21.15.146:0/1738577794 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f62f0036b40 0x7f62f0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.928+0000 7f6427e90640 1 --2- 172.21.15.146:0/1738577794 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f62f0036b40 0x7f62f0039000 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f641808efd0 tx=0x7f641808b000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.928+0000 7f642c13d800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.928+0000 7f642c13d800 1 --2- 172.21.15.146:0/1738577794 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56341cc42de0 0x56341cc452a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.928+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56341cc459f0 con 0x56341cc42de0 2024-09-18T01:45:23.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.928+0000 7f641f68f640 1 --2- 172.21.15.146:0/1738577794 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56341cc42de0 0x56341cc452a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.929+0000 7f641f68f640 1 --2- 172.21.15.146:0/1738577794 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56341cc42de0 0x56341cc452a0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.929+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f641000f5f0 con 0x56341cc42de0 2024-09-18T01:45:23.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.929+0000 7f642c13d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.929+0000 7f642c13d800 20 realm 2024-09-18T01:45:23.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.929+0000 7f642c13d800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.929+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56341cc42230 con 0x56341cc42de0 2024-09-18T01:45:23.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.929+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f641000f5f0 con 0x56341cc42de0 2024-09-18T01:45:23.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.929+0000 7f642c13d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.929+0000 7f642c13d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:23.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.929+0000 7f642c13d800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.929+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56341cc464e0 con 0x56341cc42de0 2024-09-18T01:45:23.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.929+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f641000f5f0 con 0x56341cc42de0 2024-09-18T01:45:23.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.929+0000 7f642c13d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.929+0000 7f642c13d800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.929+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56341cc46db0 con 0x56341cc42de0 2024-09-18T01:45:23.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.930+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f641000f5f0 con 0x56341cc42de0 2024-09-18T01:45:23.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.930+0000 7f642c13d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:23.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.930+0000 7f642c13d800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.930+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56341cc47150 con 0x56341cc42de0 2024-09-18T01:45:23.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.930+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f641000f5f0 con 0x56341cc42de0 2024-09-18T01:45:23.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.930+0000 7f642c13d800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:23.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.930+0000 7f642c13d800 20 searching for the correct realm 2024-09-18T01:45:23.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.930+0000 7f642c13d800 1 --2- 172.21.15.146:0/1738577794 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x56341cc49080 0x56341cc4b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.930+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56341cc4bb60 con 0x56341cc49080 2024-09-18T01:45:23.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.930+0000 7f6428691640 1 --2- 172.21.15.146:0/1738577794 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x56341cc49080 0x56341cc4b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.930+0000 7f6428691640 1 --2- 172.21.15.146:0/1738577794 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x56341cc49080 0x56341cc4b490 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.930+0000 7f6428691640 1 -- 172.21.15.146:0/1738577794 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f642003b030 con 0x56341cc49080 2024-09-18T01:45:23.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.930+0000 7f6428691640 1 --2- 172.21.15.146:0/1738577794 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f642003e060 0x7f6420013aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.930+0000 7f6428691640 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56341cc4bb60 con 0x7f642003e060 2024-09-18T01:45:23.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.931+0000 7f6427e90640 1 --2- 172.21.15.146:0/1738577794 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f642003e060 0x7f6420013aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.931+0000 7f6427e90640 1 --2- 172.21.15.146:0/1738577794 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f642003e060 0x7f6420013aa0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.931+0000 7f6427e90640 1 -- 172.21.15.146:0/1738577794 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6418057030 con 0x7f642003e060 2024-09-18T01:45:23.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.931+0000 7f6427e90640 1 --2- 172.21.15.146:0/1738577794 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f641809e040 0x7f641805b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:23.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.931+0000 7f6427e90640 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56341cc4bb60 con 0x7f641809e040 2024-09-18T01:45:23.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.931+0000 7f641f68f640 1 --2- 172.21.15.146:0/1738577794 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f641809e040 0x7f641805b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:23.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.932+0000 7f641f68f640 1 --2- 172.21.15.146:0/1738577794 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f641809e040 0x7f641805b030 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:23.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.932+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f641000f5f0 con 0x7f641809e040 2024-09-18T01:45:23.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.932+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56341cc4bb60 con 0x56341cc42de0 2024-09-18T01:45:23.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.932+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f641000f5f0 con 0x56341cc42de0 2024-09-18T01:45:23.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.932+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56341cc4bb60 con 0x56341cc42de0 2024-09-18T01:45:23.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.932+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f641000f5f0 con 0x56341cc42de0 2024-09-18T01:45:23.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.932+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56341cc4bb60 con 0x7f641809e040 2024-09-18T01:45:23.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.933+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f641000f5f0 con 0x7f641809e040 2024-09-18T01:45:23.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.933+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56341cc4bb60 con 0x7f641809e040 2024-09-18T01:45:23.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.933+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f641000f5f0 con 0x7f641809e040 2024-09-18T01:45:23.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.933+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56341cc4bb60 con 0x7f642003e060 2024-09-18T01:45:23.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.933+0000 7f6427e90640 1 -- 172.21.15.146:0/1738577794 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6418057030 con 0x7f642003e060 2024-09-18T01:45:23.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.933+0000 7f6427e90640 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56341cc4bb60 con 0x56341cc49080 2024-09-18T01:45:23.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.933+0000 7f6428691640 1 -- 172.21.15.146:0/1738577794 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f642003b030 con 0x56341cc49080 2024-09-18T01:45:23.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.933+0000 7f6428691640 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56341cc4bb60 con 0x56341cc42de0 2024-09-18T01:45:23.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.933+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f641000f5f0 con 0x56341cc42de0 2024-09-18T01:45:23.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.934+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56341cc4bb60 con 0x7f641809e040 2024-09-18T01:45:23.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.934+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f641000f5f0 con 0x7f641809e040 2024-09-18T01:45:23.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.934+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56341cc4bb60 con 0x56341cc42de0 2024-09-18T01:45:23.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.934+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f641000f5f0 con 0x56341cc42de0 2024-09-18T01:45:23.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.934+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56341cc4bb60 con 0x7f642003e060 2024-09-18T01:45:23.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.935+0000 7f6427e90640 1 -- 172.21.15.146:0/1738577794 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f6418057030 con 0x7f642003e060 2024-09-18T01:45:23.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.935+0000 7f6427e90640 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56341cc4bb60 con 0x56341cc49080 2024-09-18T01:45:23.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.935+0000 7f6428691640 1 -- 172.21.15.146:0/1738577794 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f642003b030 con 0x56341cc49080 2024-09-18T01:45:23.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.935+0000 7f6428691640 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56341cc4bb60 con 0x56341cc49080 2024-09-18T01:45:23.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.935+0000 7f6428691640 1 -- 172.21.15.146:0/1738577794 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f642003b030 con 0x56341cc49080 2024-09-18T01:45:23.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.935+0000 7f6428691640 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56341cc4bb60 con 0x7f641809e040 2024-09-18T01:45:23.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.935+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f641000f5f0 con 0x7f641809e040 2024-09-18T01:45:23.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.935+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56341cc4bb60 con 0x56341cc49080 2024-09-18T01:45:23.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.936+0000 7f6428691640 1 -- 172.21.15.146:0/1738577794 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f642003b030 con 0x56341cc49080 2024-09-18T01:45:23.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.936+0000 7f6428691640 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56341cc4bb60 con 0x56341cc49080 2024-09-18T01:45:23.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.936+0000 7f6428691640 1 -- 172.21.15.146:0/1738577794 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f642003b030 con 0x56341cc49080 2024-09-18T01:45:23.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.936+0000 7f6428691640 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56341cc4bb60 con 0x56341cc42de0 2024-09-18T01:45:23.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.936+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f641000f5f0 con 0x56341cc42de0 2024-09-18T01:45:23.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.936+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56341cc4bb60 con 0x56341cc42de0 2024-09-18T01:45:23.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.936+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f641000f5f0 con 0x56341cc42de0 2024-09-18T01:45:23.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.936+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56341cc4bb60 con 0x7f641809e040 2024-09-18T01:45:23.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.936+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f641000f5f0 con 0x7f641809e040 2024-09-18T01:45:23.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.937+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56341cc4bb60 con 0x56341cc49080 2024-09-18T01:45:23.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.937+0000 7f6428691640 1 -- 172.21.15.146:0/1738577794 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f642003b030 con 0x56341cc49080 2024-09-18T01:45:23.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.937+0000 7f6428691640 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56341cc4bb60 con 0x7f642003e060 2024-09-18T01:45:23.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.937+0000 7f6427e90640 1 -- 172.21.15.146:0/1738577794 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6418057030 con 0x7f642003e060 2024-09-18T01:45:23.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.937+0000 7f6427e90640 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56341cc4bb60 con 0x56341cc42de0 2024-09-18T01:45:23.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.937+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f641000f5f0 con 0x56341cc42de0 2024-09-18T01:45:23.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.937+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56341cc4bb60 con 0x7f641809e040 2024-09-18T01:45:23.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.938+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f641003b040 con 0x7f641809e040 2024-09-18T01:45:23.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.938+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56341cc4bb60 con 0x56341cc49080 2024-09-18T01:45:23.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.938+0000 7f6428691640 1 -- 172.21.15.146:0/1738577794 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f642003b030 con 0x56341cc49080 2024-09-18T01:45:23.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.938+0000 7f6428691640 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56341cc4bb60 con 0x7f641809e040 2024-09-18T01:45:23.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.938+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f641003b040 con 0x7f641809e040 2024-09-18T01:45:23.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.938+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56341cc4bb60 con 0x7f642003e060 2024-09-18T01:45:23.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.939+0000 7f6427e90640 1 -- 172.21.15.146:0/1738577794 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6418057030 con 0x7f642003e060 2024-09-18T01:45:23.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.939+0000 7f6427e90640 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56341cc4bb60 con 0x56341cc49080 2024-09-18T01:45:23.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.939+0000 7f6428691640 1 -- 172.21.15.146:0/1738577794 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f642003b030 con 0x56341cc49080 2024-09-18T01:45:23.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.939+0000 7f6428691640 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56341cc4bb60 con 0x7f641809e040 2024-09-18T01:45:23.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.939+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f641003b040 con 0x7f641809e040 2024-09-18T01:45:23.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.939+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56341cc4bb60 con 0x56341cc42de0 2024-09-18T01:45:23.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.939+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f641003b040 con 0x56341cc42de0 2024-09-18T01:45:23.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.939+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56341cc4bb60 con 0x7f642003e060 2024-09-18T01:45:23.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.940+0000 7f6427e90640 1 -- 172.21.15.146:0/1738577794 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64180ad040 con 0x7f642003e060 2024-09-18T01:45:23.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.940+0000 7f642c13d800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:23.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.940+0000 7f642c13d800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:23.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.940+0000 7f642c13d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:23.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.940+0000 7f642c13d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:23.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.940+0000 7f642c13d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:23.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.940+0000 7f642c13d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:23.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.940+0000 7f642c13d800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.940+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56341cc47b20 con 0x56341cc42de0 2024-09-18T01:45:23.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.940+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f641003b040 con 0x56341cc42de0 2024-09-18T01:45:23.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.940+0000 7f642c13d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.940+0000 7f642c13d800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.940+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56341cc483c0 con 0x56341cc42de0 2024-09-18T01:45:23.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.940+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f641003b040 con 0x56341cc42de0 2024-09-18T01:45:23.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.940+0000 7f642c13d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:23.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.940+0000 7f642c13d800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.940+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56341cc483c0 con 0x7f642003e060 2024-09-18T01:45:23.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.940+0000 7f6427e90640 1 -- 172.21.15.146:0/1738577794 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f64180ad040 con 0x7f642003e060 2024-09-18T01:45:23.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.940+0000 7f642c13d800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:23.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.940+0000 7f642c13d800 20 zone default found 2024-09-18T01:45:23.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.940+0000 7f642c13d800 4 Realm: () 2024-09-18T01:45:23.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.940+0000 7f642c13d800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:23.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.940+0000 7f642c13d800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:23.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.940+0000 7f642c13d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:23.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.940+0000 7f642c13d800 20 zonegroup default 2024-09-18T01:45:23.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.940+0000 7f642c13d800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.940+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56341cc4c490 con 0x7f641809e040 2024-09-18T01:45:23.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.941+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f641003b040 con 0x7f641809e040 2024-09-18T01:45:23.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.941+0000 7f642c13d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.941+0000 7f642c13d800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.941+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56341cc4de70 con 0x56341cc49080 2024-09-18T01:45:23.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.941+0000 7f6428691640 1 -- 172.21.15.146:0/1738577794 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f642003b030 con 0x56341cc49080 2024-09-18T01:45:23.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.941+0000 7f642c13d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.941+0000 7f642c13d800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.941+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56341cc4e2f0 con 0x56341cc49080 2024-09-18T01:45:23.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.941+0000 7f6428691640 1 -- 172.21.15.146:0/1738577794 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f642003b030 con 0x56341cc49080 2024-09-18T01:45:23.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.941+0000 7f642c13d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.941+0000 7f642c13d800 20 started sync module instance, tier type = 2024-09-18T01:45:23.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.941+0000 7f642c13d800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:23.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.941+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56341cc4d300 con 0x7f642003e060 2024-09-18T01:45:23.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.942+0000 7f6427e90640 1 -- 172.21.15.146:0/1738577794 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v31'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64180ad040 con 0x7f642003e060 2024-09-18T01:45:23.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.942+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94781820950256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56341cc4cf60 con 0x7f642003e060 2024-09-18T01:45:23.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.942+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56341cc4f130 con 0x56341cc42de0 2024-09-18T01:45:23.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.945+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v31'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f641003b040 con 0x56341cc42de0 2024-09-18T01:45:23.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.945+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94781820955648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56341cc4f9d0 con 0x56341cc42de0 2024-09-18T01:45:23.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.945+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56341cc504b0 con 0x56341cc49080 2024-09-18T01:45:23.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.945+0000 7f6427e90640 1 -- 172.21.15.146:0/1738577794 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94781820950256] v31'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64180ad040 con 0x7f642003e060 2024-09-18T01:45:23.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.946+0000 7f6428691640 1 -- 172.21.15.146:0/1738577794 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v31'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f642003b030 con 0x56341cc49080 2024-09-18T01:45:23.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.946+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94781820960704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56341cc508a0 con 0x56341cc49080 2024-09-18T01:45:23.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.946+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56341cc51300 con 0x7f642003e060 2024-09-18T01:45:23.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.946+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94781820955648] v31'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f641003b040 con 0x56341cc42de0 2024-09-18T01:45:23.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.947+0000 7f6427e90640 1 -- 172.21.15.146:0/1738577794 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v31'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64180ad040 con 0x7f642003e060 2024-09-18T01:45:23.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.947+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94781820957984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56341cc516f0 con 0x7f642003e060 2024-09-18T01:45:23.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.947+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56341cc52110 con 0x56341cc42de0 2024-09-18T01:45:23.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.947+0000 7f6428691640 1 -- 172.21.15.146:0/1738577794 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94781820960704] v31'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f642003b030 con 0x56341cc49080 2024-09-18T01:45:23.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.948+0000 7f6427e90640 1 -- 172.21.15.146:0/1738577794 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94781820957984] v31'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64180ad040 con 0x7f642003e060 2024-09-18T01:45:23.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.948+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v31'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f641003b040 con 0x56341cc42de0 2024-09-18T01:45:23.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.948+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94781820967936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56341cc50de0 con 0x56341cc42de0 2024-09-18T01:45:23.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.948+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56341cc529e0 con 0x7f641809e040 2024-09-18T01:45:23.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.949+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94781820967936] v31'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f641003b040 con 0x56341cc42de0 2024-09-18T01:45:23.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.949+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v31'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f641003b040 con 0x7f641809e040 2024-09-18T01:45:23.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.949+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94781820954448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56341cc52990 con 0x7f641809e040 2024-09-18T01:45:23.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.949+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56341cc533f0 con 0x7f641809e040 2024-09-18T01:45:23.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.950+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94781820954448] v31'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f641003b040 con 0x7f641809e040 2024-09-18T01:45:23.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.951+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v31'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f641003b040 con 0x7f641809e040 2024-09-18T01:45:23.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.951+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94781820970688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56341cc533f0 con 0x7f641809e040 2024-09-18T01:45:23.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.952+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56341cc53db0 con 0x7f641809e040 2024-09-18T01:45:23.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.952+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(58 notify.7 [create] v31'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f641003b040 con 0x7f641809e040 2024-09-18T01:45:23.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.952+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94781820975360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56341cc541d0 con 0x7f641809e040 2024-09-18T01:45:23.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.952+0000 7f642c13d800 20 add_watcher() i=0 2024-09-18T01:45:23.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.952+0000 7f642c13d800 20 add_watcher() i=1 2024-09-18T01:45:23.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.952+0000 7f642c13d800 20 add_watcher() i=2 2024-09-18T01:45:23.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.952+0000 7f642c13d800 20 add_watcher() i=3 2024-09-18T01:45:23.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.952+0000 7f642c13d800 20 add_watcher() i=4 2024-09-18T01:45:23.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.952+0000 7f642c13d800 20 add_watcher() i=5 2024-09-18T01:45:23.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.952+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94781820970688] v31'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f641003b040 con 0x7f641809e040 2024-09-18T01:45:23.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.952+0000 7f642c13d800 20 add_watcher() i=6 2024-09-18T01:45:23.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.953+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94781820975360] v31'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f641003b040 con 0x7f641809e040 2024-09-18T01:45:23.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.953+0000 7f642c13d800 20 add_watcher() i=7 2024-09-18T01:45:23.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.953+0000 7f642c13d800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:23.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.953+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56341cc541d0 con 0x56341cc42de0 2024-09-18T01:45:23.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.953+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f641003b040 con 0x56341cc42de0 2024-09-18T01:45:23.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.954+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94781820976416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56341cc54140 con 0x56341cc42de0 2024-09-18T01:45:23.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.954+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94781820976416] v31'70 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f641003b040 con 0x56341cc42de0 2024-09-18T01:45:23.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.955+0000 7f62ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:23.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.955+0000 7f642c13d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:23.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.955+0000 7f642c13d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:23.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.955+0000 7f642c13d800 5 note: GC not initialized 2024-09-18T01:45:23.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.955+0000 7f62dcfe1640 20 reqs_thread_entry: start 2024-09-18T01:45:23.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.955+0000 7f642c13d800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:23.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.955+0000 7f642c13d800 20 Filter name: none 2024-09-18T01:45:23.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.955+0000 7f62567fc640 20 reqs_thread_entry: start 2024-09-18T01:45:23.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.955+0000 7f642c13d800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T01:45:23.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.955+0000 7f642c13d800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.955+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56341cc8a6f0 con 0x56341cc42de0 2024-09-18T01:45:23.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.956+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f641003b040 con 0x56341cc42de0 2024-09-18T01:45:23.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.956+0000 7f642c13d800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:45:23.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.956+0000 7f642c13d800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T01:45:23.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.956+0000 7f642c13d800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:45:23.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.956+0000 7f642c13d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:45:23.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.956+0000 7f642c13d800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-18T01:45:23.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.956+0000 7f642c13d800 20 rados->read ofs=0 len=0 2024-09-18T01:45:23.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.956+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56341cc8b160 con 0x7f641809e040 2024-09-18T01:45:23.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.956+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f641003b040 con 0x7f641809e040 2024-09-18T01:45:23.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.956+0000 7f642c13d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:23.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.956+0000 7f642c13d800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-18T01:45:23.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.956+0000 7f642c13d800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-18T01:45:23.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.956+0000 7f642c13d800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-18T01:45:23.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.956+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~502 in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56341cc90b40 con 0x56341cc42de0 2024-09-18T01:45:23.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.957+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~502] v31'4 uv4 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f641003b040 con 0x56341cc42de0 2024-09-18T01:45:23.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.957+0000 7f642c13d800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:45:23.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.957+0000 7f642c13d800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:45:23.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.957+0000 7f642c13d800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-18T01:45:23.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.957+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94781821224192 in=690b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56341cc8c1a0 con 0x56341cc42de0 2024-09-18T01:45:23.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.957+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== watch-notify(notify (1) cookie 94781820967936 notify 133143986179 ret 0) ==== 720+0+0 (crc 0 0 0) 0x7f6410018040 con 0x56341cc42de0 2024-09-18T01:45:23.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.957+0000 7f6306ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986179 cookie 94781820967936 notifier 4348 bl.length()=678 2024-09-18T01:45:23.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.957+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(65 notify.4 [notify cookie 94781821224192 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f641003b040 con 0x56341cc42de0 2024-09-18T01:45:23.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.957+0000 7f6306ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:45:23.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.957+0000 7f6306ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:45:23.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.957+0000 7f6306ffd640 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f62ec003ea0 con 0x56341cc42de0 2024-09-18T01:45:23.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.958+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f641003b040 con 0x56341cc42de0 2024-09-18T01:45:23.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.958+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== watch-notify(notify_complete (2) cookie 94781821224192 notify 133143986179 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f641001d440 con 0x56341cc42de0 2024-09-18T01:45:23.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.958+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56341cc90500 con 0x7f641809e040 2024-09-18T01:45:23.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.959+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v31'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f6410020040 con 0x7f641809e040 2024-09-18T01:45:23.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.959+0000 7f642c13d800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-18T01:45:23.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.959+0000 7f642c13d800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-18T01:45:23.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.959+0000 7f642c13d800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-18T01:45:23.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.959+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94781821224192 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56341cc8bcf0 con 0x56341cc49080 2024-09-18T01:45:23.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.960+0000 7f6428691640 1 -- 172.21.15.146:0/1738577794 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== watch-notify(notify (1) cookie 94781820960704 notify 133143986176 ret 0) ==== 219+0+0 (crc 0 0 0) 0x56341cc3a540 con 0x56341cc49080 2024-09-18T01:45:23.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.960+0000 7f6306ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986176 cookie 94781820960704 notifier 4348 bl.length()=177 2024-09-18T01:45:23.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.960+0000 7f6306ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-18T01:45:23.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.960+0000 7f6306ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-18T01:45:23.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.960+0000 7f6306ffd640 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f62ec003ea0 con 0x56341cc49080 2024-09-18T01:45:23.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.960+0000 7f6428691640 1 -- 172.21.15.146:0/1738577794 <== osd.3 v2:172.21.15.146:6809/4106661138 15 ==== osd_op_reply(68 notify.2 [notify cookie 94781821224192 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f642003b030 con 0x56341cc49080 2024-09-18T01:45:23.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.960+0000 7f6428691640 1 -- 172.21.15.146:0/1738577794 <== osd.3 v2:172.21.15.146:6809/4106661138 16 ==== watch-notify(notify_complete (2) cookie 94781821224192 notify 133143986176 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56341cc37890 con 0x56341cc49080 2024-09-18T01:45:23.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.960+0000 7f6428691640 1 -- 172.21.15.146:0/1738577794 <== osd.3 v2:172.21.15.146:6809/4106661138 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f642003b030 con 0x56341cc49080 2024-09-18T01:45:23.967 INFO:teuthology.orchestra.run.smithi146.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T01:45:23.010714Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-18T01:45:23.956893Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:45:23.010705Z","tags":[],"group_ids":[]} 2024-09-18T01:45:23.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.961+0000 7f62ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:23.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.961+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94781820976416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56341cc8bf30 con 0x56341cc42de0 2024-09-18T01:45:23.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.962+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 <== osd.1 v2:172.21.15.146:6808/3930274777 28 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94781820976416] v31'71 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6410020040 con 0x56341cc42de0 2024-09-18T01:45:23.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.962+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94781820950256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56341cc883b0 con 0x7f642003e060 2024-09-18T01:45:23.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.963+0000 7f6427e90640 1 -- 172.21.15.146:0/1738577794 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94781820950256] v31'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64180ad040 con 0x7f642003e060 2024-09-18T01:45:23.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.963+0000 7f642c13d800 20 remove_watcher() i=0 2024-09-18T01:45:23.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.963+0000 7f642c13d800 2 removed watcher, disabling cache 2024-09-18T01:45:23.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.963+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94781820955648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56341cc883b0 con 0x56341cc42de0 2024-09-18T01:45:23.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.964+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 <== osd.1 v2:172.21.15.146:6808/3930274777 29 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94781820955648] v31'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6410020040 con 0x56341cc42de0 2024-09-18T01:45:23.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.964+0000 7f642c13d800 20 remove_watcher() i=1 2024-09-18T01:45:23.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.964+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94781820960704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56341cc883b0 con 0x56341cc49080 2024-09-18T01:45:23.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.965+0000 7f6428691640 1 -- 172.21.15.146:0/1738577794 <== osd.3 v2:172.21.15.146:6809/4106661138 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94781820960704] v31'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f642003b030 con 0x56341cc49080 2024-09-18T01:45:23.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.965+0000 7f642c13d800 20 remove_watcher() i=2 2024-09-18T01:45:23.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.965+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94781820957984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56341cc883b0 con 0x7f642003e060 2024-09-18T01:45:23.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.966+0000 7f6427e90640 1 -- 172.21.15.146:0/1738577794 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94781820957984] v31'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64180ad040 con 0x7f642003e060 2024-09-18T01:45:23.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.966+0000 7f642c13d800 20 remove_watcher() i=3 2024-09-18T01:45:23.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.966+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94781820967936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56341cc883b0 con 0x56341cc42de0 2024-09-18T01:45:23.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.967+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 <== osd.1 v2:172.21.15.146:6808/3930274777 30 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94781820967936] v31'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6410020040 con 0x56341cc42de0 2024-09-18T01:45:23.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.967+0000 7f642c13d800 20 remove_watcher() i=4 2024-09-18T01:45:23.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.967+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94781820954448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56341cc883b0 con 0x7f641809e040 2024-09-18T01:45:23.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.968+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94781820954448] v31'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6410020040 con 0x7f641809e040 2024-09-18T01:45:23.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.968+0000 7f642c13d800 20 remove_watcher() i=5 2024-09-18T01:45:23.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.968+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94781820970688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56341cc883b0 con 0x7f641809e040 2024-09-18T01:45:23.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.969+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94781820970688] v31'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6410020040 con 0x7f641809e040 2024-09-18T01:45:23.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.969+0000 7f642c13d800 20 remove_watcher() i=6 2024-09-18T01:45:23.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.969+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94781820975360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56341cc883b0 con 0x7f641809e040 2024-09-18T01:45:23.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.970+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94781820975360] v31'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6410020040 con 0x7f641809e040 2024-09-18T01:45:23.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.970+0000 7f642c13d800 20 remove_watcher() i=7 2024-09-18T01:45:23.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.970+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f641809e040 msgr2=0x7f641805b030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.970+0000 7f642c13d800 1 --2- 172.21.15.146:0/1738577794 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f641809e040 0x7f641805b030 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.970+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56341cc42de0 msgr2=0x56341cc452a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.970+0000 7f642c13d800 1 --2- 172.21.15.146:0/1738577794 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56341cc42de0 0x56341cc452a0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.970+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f642003e060 msgr2=0x7f6420013aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.970+0000 7f642c13d800 1 --2- 172.21.15.146:0/1738577794 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f642003e060 0x7f6420013aa0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.970+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x56341cc49080 msgr2=0x56341cc4b490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.970+0000 7f642c13d800 1 --2- 172.21.15.146:0/1738577794 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x56341cc49080 0x56341cc4b490 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.971+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f62f0036b40 msgr2=0x7f62f0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.971+0000 7f642c13d800 1 --2- 172.21.15.146:0/1738577794 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f62f0036b40 0x7f62f0039000 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f641808efd0 tx=0x7f641808b000 comp rx=0 tx=0).stop 2024-09-18T01:45:23.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.971+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56341ca83de0 msgr2=0x56341cc370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.971+0000 7f641f68f640 1 -- 172.21.15.146:0/1738577794 reap_dead start 2024-09-18T01:45:23.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.971+0000 7f642c13d800 1 --2- 172.21.15.146:0/1738577794 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56341ca83de0 0x56341cc370c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f642004b780 tx=0x7f642004c840 comp rx=0 tx=0).stop 2024-09-18T01:45:23.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.971+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 shutdown_connections 2024-09-18T01:45:23.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.971+0000 7f642c13d800 1 --2- 172.21.15.146:0/1738577794 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56341ca83de0 0x56341cc370c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.971+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 >> 172.21.15.146:0/1738577794 conn(0x56341cc29d60 msgr2=0x56341cc27e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:23.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.971+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 shutdown_connections 2024-09-18T01:45:23.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.971+0000 7f642c13d800 1 -- 172.21.15.146:0/1738577794 wait complete. 2024-09-18T01:45:23.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.971+0000 7f642c13d800 1 -- 172.21.15.146:0/3961469756 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6300036b40 msgr2=0x7f6300039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.971+0000 7f642c13d800 1 --2- 172.21.15.146:0/3961469756 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6300036b40 0x7f6300039000 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x56341cc0e8d0 tx=0x7f641808e6c0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.971+0000 7f642c13d800 1 -- 172.21.15.146:0/3961469756 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56341cc20d30 msgr2=0x56341cc21150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.971+0000 7f642c13d800 1 --2- 172.21.15.146:0/3961469756 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56341cc20d30 0x56341cc21150 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x56341cc0d9d0 tx=0x7f64200178e0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.971+0000 7f642c13d800 1 -- 172.21.15.146:0/3961469756 shutdown_connections 2024-09-18T01:45:23.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.971+0000 7f642c13d800 1 --2- 172.21.15.146:0/3961469756 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6300036b40 0x7f6300039000 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.971+0000 7f642c13d800 1 --2- 172.21.15.146:0/3961469756 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56341cc20d30 0x56341cc21150 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.971+0000 7f642c13d800 1 -- 172.21.15.146:0/3961469756 >> 172.21.15.146:0/3961469756 conn(0x56341cc15cc0 msgr2=0x56341cc18840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:23.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.971+0000 7f642c13d800 1 -- 172.21.15.146:0/3961469756 shutdown_connections 2024-09-18T01:45:23.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.971+0000 7f642c13d800 1 -- 172.21.15.146:0/3961469756 wait complete. 2024-09-18T01:45:23.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.971+0000 7f642c13d800 1 -- 172.21.15.146:0/3526071605 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56341cb100c0 msgr2=0x56341cc0d050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.971+0000 7f642c13d800 1 --2- 172.21.15.146:0/3526071605 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56341cb100c0 0x56341cc0d050 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.971+0000 7f642c13d800 1 -- 172.21.15.146:0/3526071605 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x56341cc0efd0 msgr2=0x56341cc127f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.971+0000 7f642c13d800 1 --2- 172.21.15.146:0/3526071605 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x56341cc0efd0 0x56341cc127f0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.972+0000 7f642c13d800 1 -- 172.21.15.146:0/3526071605 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6310036b40 msgr2=0x7f6310039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.972+0000 7f642c13d800 1 --2- 172.21.15.146:0/3526071605 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6310036b40 0x7f6310039000 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6410000c00 tx=0x7f64100013b0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.972+0000 7f642c13d800 1 -- 172.21.15.146:0/3526071605 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56341cb0f780 msgr2=0x56341cc05fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:23.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.972+0000 7f642c13d800 1 --2- 172.21.15.146:0/3526071605 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56341cb0f780 0x56341cc05fe0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f64180460a0 tx=0x7f6418003020 comp rx=0 tx=0).stop 2024-09-18T01:45:23.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.972+0000 7f642c13d800 1 -- 172.21.15.146:0/3526071605 shutdown_connections 2024-09-18T01:45:23.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.972+0000 7f642c13d800 1 --2- 172.21.15.146:0/3526071605 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x56341cc0efd0 0x56341cc127f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.972+0000 7f642c13d800 1 --2- 172.21.15.146:0/3526071605 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56341cb100c0 0x56341cc0d050 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.972+0000 7f642c13d800 1 --2- 172.21.15.146:0/3526071605 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6310036b40 0x7f6310039000 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.972+0000 7f642c13d800 1 --2- 172.21.15.146:0/3526071605 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56341cb0f780 0x56341cc05fe0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:23.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.972+0000 7f642c13d800 1 -- 172.21.15.146:0/3526071605 >> 172.21.15.146:0/3526071605 conn(0x56341cb0b010 msgr2=0x56341cbf8970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:23.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.972+0000 7f642c13d800 1 -- 172.21.15.146:0/3526071605 shutdown_connections 2024-09-18T01:45:23.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:23.972+0000 7f642c13d800 1 -- 172.21.15.146:0/3526071605 wait complete. 2024-09-18T01:45:23.981 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T01:45:23.010714Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-18T01:45:23.956893Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:45:23.010705Z', 'tags': [], 'group_ids': []} 2024-09-18T01:45:23.981 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-18T01:45:23.981 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-18T01:45:23.981 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-18T01:45:24.025 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:24.025 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:24.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.025+0000 7f206e52d800 1 Processor -- start 2024-09-18T01:45:24.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.025+0000 7f206e52d800 1 -- start start 2024-09-18T01:45:24.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.026+0000 7f206e52d800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x557eeee1d9b0 0x557eeee1ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.026+0000 7f206e52d800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557eeecdeb30 con 0x557eeee1e2f0 2024-09-18T01:45:24.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.026+0000 7f206e52d800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x557eeecc0360 con 0x557eeee1d9b0 2024-09-18T01:45:24.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.026+0000 7f206a280640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x557eeee1d9b0 0x557eeee1ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.026+0000 7f206a280640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x557eeee1d9b0 0x557eeee1ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59856/0 (socket says 172.21.15.146:59856) 2024-09-18T01:45:24.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.026+0000 7f206a280640 1 -- 172.21.15.146:0/2831379744 learned_addr learned my addr 172.21.15.146:0/2831379744 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:24.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.026+0000 7f2063fff640 1 --1- 172.21.15.146:0/2831379744 >> v1:172.21.15.129:6789/0 conn(0x557eeee1e2f0 0x557eeee24af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:38770/0 (socket says 172.21.15.146:38770) 2024-09-18T01:45:24.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.026+0000 7f206a280640 1 -- 172.21.15.146:0/2831379744 >> v1:172.21.15.129:6789/0 conn(0x557eeee1e2f0 legacy=0x557eeee24af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.026+0000 7f206a280640 1 -- 172.21.15.146:0/2831379744 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557eeece6e00 con 0x557eeee1d9b0 2024-09-18T01:45:24.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.028+0000 7f206a280640 1 --2- 172.21.15.146:0/2831379744 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557eeee1d9b0 0x557eeee1ddb0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f205c00a520 tx=0x7f205c045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dab5c77e3dbdb6d server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.028+0000 7f2069a7f640 1 -- 172.21.15.146:0/2831379744 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f205c055070 con 0x557eeee1d9b0 2024-09-18T01:45:24.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.028+0000 7f2069a7f640 1 -- 172.21.15.146:0/2831379744 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f205c0515b0 con 0x557eeee1d9b0 2024-09-18T01:45:24.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.028+0000 7f2069a7f640 1 -- 172.21.15.146:0/2831379744 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f205c0518d0 con 0x557eeee1d9b0 2024-09-18T01:45:24.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.029+0000 7f206e52d800 1 -- 172.21.15.146:0/2831379744 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557eeee1d9b0 msgr2=0x557eeee1ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.029+0000 7f206e52d800 1 --2- 172.21.15.146:0/2831379744 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557eeee1d9b0 0x557eeee1ddb0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f205c00a520 tx=0x7f205c045ba0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.029+0000 7f206e52d800 1 -- 172.21.15.146:0/2831379744 shutdown_connections 2024-09-18T01:45:24.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.029+0000 7f206e52d800 1 --2- 172.21.15.146:0/2831379744 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557eeee1d9b0 0x557eeee1ddb0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.029+0000 7f206e52d800 1 -- 172.21.15.146:0/2831379744 >> 172.21.15.146:0/2831379744 conn(0x557eeee195c0 msgr2=0x557eeee1b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:24.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.029+0000 7f206e52d800 1 -- 172.21.15.146:0/2831379744 shutdown_connections 2024-09-18T01:45:24.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.029+0000 7f206e52d800 1 -- 172.21.15.146:0/2831379744 wait complete. 2024-09-18T01:45:24.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.042+0000 7f206e52d800 1 Processor -- start 2024-09-18T01:45:24.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.043+0000 7f206e52d800 1 -- start start 2024-09-18T01:45:24.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.043+0000 7f206e52d800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557eeee1d9b0 0x557eeef0e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.043+0000 7f206e52d800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x557eeed6b330 con 0x557eeee1d9b0 2024-09-18T01:45:24.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.043+0000 7f206a280640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557eeee1d9b0 0x557eeef0e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.043+0000 7f206a280640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557eeee1d9b0 0x557eeef0e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59864/0 (socket says 172.21.15.146:59864) 2024-09-18T01:45:24.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.043+0000 7f206a280640 1 -- 172.21.15.146:0/451230205 learned_addr learned my addr 172.21.15.146:0/451230205 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:24.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.043+0000 7f206a280640 1 -- 172.21.15.146:0/451230205 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557eeecb8bc0 con 0x557eeee1d9b0 2024-09-18T01:45:24.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.044+0000 7f206a280640 1 --2- 172.21.15.146:0/451230205 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557eeee1d9b0 0x557eeef0e870 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f205c025da0 tx=0x7f205c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c382ec6402d2d9f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.044+0000 7f1f58608640 1 -- 172.21.15.146:0/451230205 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f205c051950 con 0x557eeee1d9b0 2024-09-18T01:45:24.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.044+0000 7f1f58608640 1 -- 172.21.15.146:0/451230205 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f205c051af0 con 0x557eeee1d9b0 2024-09-18T01:45:24.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.044+0000 7f1f58608640 1 -- 172.21.15.146:0/451230205 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f205c051dd0 con 0x557eeee1d9b0 2024-09-18T01:45:24.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.044+0000 7f206e52d800 1 -- 172.21.15.146:0/451230205 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557eeee1d9b0 msgr2=0x557eeef0e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.044+0000 7f206e52d800 1 --2- 172.21.15.146:0/451230205 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557eeee1d9b0 0x557eeef0e870 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f205c025da0 tx=0x7f205c051000 comp rx=0 tx=0).stop 2024-09-18T01:45:24.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.044+0000 7f206e52d800 1 -- 172.21.15.146:0/451230205 shutdown_connections 2024-09-18T01:45:24.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.044+0000 7f206e52d800 1 --2- 172.21.15.146:0/451230205 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557eeee1d9b0 0x557eeef0e870 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.044+0000 7f206e52d800 1 -- 172.21.15.146:0/451230205 >> 172.21.15.146:0/451230205 conn(0x557eeee195c0 msgr2=0x557eeef0a230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:24.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.044+0000 7f206e52d800 1 -- 172.21.15.146:0/451230205 shutdown_connections 2024-09-18T01:45:24.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.044+0000 7f206e52d800 1 -- 172.21.15.146:0/451230205 wait complete. 2024-09-18T01:45:24.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.045+0000 7f206e52d800 1 Processor -- start 2024-09-18T01:45:24.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.045+0000 7f206e52d800 1 -- start start 2024-09-18T01:45:24.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.045+0000 7f206e52d800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557eeee1d9b0 0x557eeef160d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.045+0000 7f206e52d800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x557eeee26650 con 0x557eeee1d9b0 2024-09-18T01:45:24.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.045+0000 7f206a280640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557eeee1d9b0 0x557eeef160d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.045+0000 7f206a280640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557eeee1d9b0 0x557eeef160d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59870/0 (socket says 172.21.15.146:59870) 2024-09-18T01:45:24.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.045+0000 7f206a280640 1 -- 172.21.15.146:0/1931712997 learned_addr learned my addr 172.21.15.146:0/1931712997 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:24.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.045+0000 7f206a280640 1 -- 172.21.15.146:0/1931712997 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557eeecccfe0 con 0x557eeee1d9b0 2024-09-18T01:45:24.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.045+0000 7f206a280640 1 --2- 172.21.15.146:0/1931712997 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557eeee1d9b0 0x557eeef160d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f205c067040 tx=0x7f205c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.046+0000 7f1f56e05640 1 -- 172.21.15.146:0/1931712997 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f205c073070 con 0x557eeee1d9b0 2024-09-18T01:45:24.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.046+0000 7f1f56e05640 1 -- 172.21.15.146:0/1931712997 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f205c05a450 con 0x557eeee1d9b0 2024-09-18T01:45:24.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.046+0000 7f206e52d800 1 -- 172.21.15.146:0/1931712997 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557eeef16610 con 0x557eeee1d9b0 2024-09-18T01:45:24.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.046+0000 7f1f56e05640 1 -- 172.21.15.146:0/1931712997 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f205c05a730 con 0x557eeee1d9b0 2024-09-18T01:45:24.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.046+0000 7f206e52d800 1 -- 172.21.15.146:0/1931712997 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557eeef16b90 con 0x557eeee1d9b0 2024-09-18T01:45:24.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.046+0000 7f1f56e05640 1 -- 172.21.15.146:0/1931712997 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f205c076070 con 0x557eeee1d9b0 2024-09-18T01:45:24.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.047+0000 7f1f56e05640 1 --2- 172.21.15.146:0/1931712997 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1f50036b40 0x7f1f50039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.047+0000 7f1f56e05640 1 -- 172.21.15.146:0/1931712997 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f205c062070 con 0x557eeee1d9b0 2024-09-18T01:45:24.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.047+0000 7f2063fff640 1 --2- 172.21.15.146:0/1931712997 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1f50036b40 0x7f1f50039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.047+0000 7f206e52d800 1 --2- 172.21.15.146:0/1931712997 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x557eeee1e2f0 0x557eeef1d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.047+0000 7f206e52d800 1 -- 172.21.15.146:0/1931712997 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557eeef1d6c0 con 0x557eeee1e2f0 2024-09-18T01:45:24.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.047+0000 7f206aa81640 1 --2- 172.21.15.146:0/1931712997 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x557eeee1e2f0 0x557eeef1d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.047+0000 7f2063fff640 1 --2- 172.21.15.146:0/1931712997 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1f50036b40 0x7f1f50039000 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2054000f60 tx=0x7f2054001370 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.047+0000 7f206aa81640 1 --2- 172.21.15.146:0/1931712997 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x557eeee1e2f0 0x557eeef1d140 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.047+0000 7f206aa81640 1 -- 172.21.15.146:0/1931712997 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f206400a4a0 con 0x557eeee1e2f0 2024-09-18T01:45:24.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.047+0000 7f206e52d800 1 -- 172.21.15.146:0/1931712997 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557eeef1a710 con 0x557eeee1e2f0 2024-09-18T01:45:24.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.048+0000 7f206aa81640 1 -- 172.21.15.146:0/1931712997 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f206400a4a0 con 0x557eeee1e2f0 2024-09-18T01:45:24.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.048+0000 7f206e52d800 1 -- 172.21.15.146:0/1931712997 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557eeef1f4e0 con 0x557eeee1e2f0 2024-09-18T01:45:24.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.048+0000 7f206aa81640 1 -- 172.21.15.146:0/1931712997 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f206400a4a0 con 0x557eeee1e2f0 2024-09-18T01:45:24.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.048+0000 7f206e52d800 1 -- 172.21.15.146:0/1931712997 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557eeef1e620 con 0x557eeee1e2f0 2024-09-18T01:45:24.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.048+0000 7f206aa81640 1 -- 172.21.15.146:0/1931712997 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f206400a4a0 con 0x557eeee1e2f0 2024-09-18T01:45:24.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.048+0000 7f206e52d800 1 --2- 172.21.15.146:0/1931712997 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x557eeef1f0f0 0x557eeef22930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.048+0000 7f206e52d800 1 -- 172.21.15.146:0/1931712997 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557eeef230c0 con 0x557eeef1f0f0 2024-09-18T01:45:24.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.048+0000 7f206a280640 1 --2- 172.21.15.146:0/1931712997 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x557eeef1f0f0 0x557eeef22930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.049+0000 7f206a280640 1 --2- 172.21.15.146:0/1931712997 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x557eeef1f0f0 0x557eeef22930 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.049+0000 7f206a280640 1 -- 172.21.15.146:0/1931712997 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f205c07f070 con 0x557eeef1f0f0 2024-09-18T01:45:24.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.049+0000 7f206e52d800 1 Processor -- start 2024-09-18T01:45:24.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.049+0000 7f206e52d800 1 -- start start 2024-09-18T01:45:24.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.049+0000 7f206e52d800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557eeee203f0 0x557eeee1ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.050+0000 7f206e52d800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x557eeecba580 con 0x557eeee203f0 2024-09-18T01:45:24.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.050+0000 7f206aa81640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557eeee203f0 0x557eeee1ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.050+0000 7f206aa81640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557eeee203f0 0x557eeee1ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59884/0 (socket says 172.21.15.146:59884) 2024-09-18T01:45:24.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.050+0000 7f206aa81640 1 -- 172.21.15.146:0/2619290730 learned_addr learned my addr 172.21.15.146:0/2619290730 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:24.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.050+0000 7f206aa81640 1 -- 172.21.15.146:0/2619290730 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557eeee20810 con 0x557eeee203f0 2024-09-18T01:45:24.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.050+0000 7f206aa81640 1 --2- 172.21.15.146:0/2619290730 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557eeee203f0 0x557eeee1ea40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x557eeef1daa0 tx=0x7f20640178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.050+0000 7f1f4ffff640 1 -- 172.21.15.146:0/2619290730 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2064013440 con 0x557eeee203f0 2024-09-18T01:45:24.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.050+0000 7f1f4ffff640 1 -- 172.21.15.146:0/2619290730 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20640135e0 con 0x557eeee203f0 2024-09-18T01:45:24.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.050+0000 7f1f4ffff640 1 -- 172.21.15.146:0/2619290730 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20640138c0 con 0x557eeee203f0 2024-09-18T01:45:24.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.050+0000 7f206e52d800 1 -- 172.21.15.146:0/2619290730 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557eeee1f040 con 0x557eeee203f0 2024-09-18T01:45:24.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.051+0000 7f206e52d800 1 -- 172.21.15.146:0/2619290730 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557eeee1f540 con 0x557eeee203f0 2024-09-18T01:45:24.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.051+0000 7f1f4ffff640 1 -- 172.21.15.146:0/2619290730 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2064011040 con 0x557eeee203f0 2024-09-18T01:45:24.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.051+0000 7f1f4ffff640 1 --2- 172.21.15.146:0/2619290730 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1f44036b90 0x7f1f44039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.051+0000 7f1f4ffff640 1 -- 172.21.15.146:0/2619290730 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f206401d070 con 0x557eeee203f0 2024-09-18T01:45:24.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.051+0000 7f206a280640 1 --2- 172.21.15.146:0/2619290730 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1f44036b90 0x7f1f44039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.052+0000 7f206e52d800 1 Processor -- start 2024-09-18T01:45:24.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.052+0000 7f206e52d800 1 -- start start 2024-09-18T01:45:24.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.052+0000 7f206a280640 1 --2- 172.21.15.146:0/2619290730 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1f44036b90 0x7f1f44039050 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x557eeef234c0 tx=0x7f205c08f220 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.052+0000 7f206e52d800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557eeef3fc70 0x557eeef40070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.052+0000 7f206e52d800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x557eeef0ef60 con 0x557eeef3fc70 2024-09-18T01:45:24.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.052+0000 7f206aa81640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557eeef3fc70 0x557eeef40070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.052+0000 7f206aa81640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557eeef3fc70 0x557eeef40070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59892/0 (socket says 172.21.15.146:59892) 2024-09-18T01:45:24.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.052+0000 7f206aa81640 1 -- 172.21.15.146:0/828154040 learned_addr learned my addr 172.21.15.146:0/828154040 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:24.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.052+0000 7f206aa81640 1 -- 172.21.15.146:0/828154040 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557eeef405b0 con 0x557eeef3fc70 2024-09-18T01:45:24.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.052+0000 7f206aa81640 1 --2- 172.21.15.146:0/828154040 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557eeef3fc70 0x557eeef40070 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f206404c890 tx=0x7f206404c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f8b1d966e5b4512 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.053+0000 7f1f4dffb640 1 -- 172.21.15.146:0/828154040 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2064045070 con 0x557eeef3fc70 2024-09-18T01:45:24.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.053+0000 7f1f4dffb640 1 -- 172.21.15.146:0/828154040 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2064012df0 con 0x557eeef3fc70 2024-09-18T01:45:24.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.053+0000 7f1f4dffb640 1 -- 172.21.15.146:0/828154040 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2064021b80 con 0x557eeef3fc70 2024-09-18T01:45:24.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.053+0000 7f206e52d800 1 -- 172.21.15.146:0/828154040 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557eeef3fc70 msgr2=0x557eeef40070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.053+0000 7f206e52d800 1 --2- 172.21.15.146:0/828154040 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557eeef3fc70 0x557eeef40070 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f206404c890 tx=0x7f206404c9d0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.053+0000 7f206e52d800 1 -- 172.21.15.146:0/828154040 shutdown_connections 2024-09-18T01:45:24.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.053+0000 7f206e52d800 1 --2- 172.21.15.146:0/828154040 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557eeef3fc70 0x557eeef40070 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.053+0000 7f206e52d800 1 -- 172.21.15.146:0/828154040 >> 172.21.15.146:0/828154040 conn(0x557eeef3c020 msgr2=0x557eeef3a120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:24.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.053+0000 7f206e52d800 1 -- 172.21.15.146:0/828154040 shutdown_connections 2024-09-18T01:45:24.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.053+0000 7f206e52d800 1 -- 172.21.15.146:0/828154040 wait complete. 2024-09-18T01:45:24.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.053+0000 7f206e52d800 1 Processor -- start 2024-09-18T01:45:24.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.053+0000 7f206e52d800 1 -- start start 2024-09-18T01:45:24.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.054+0000 7f206e52d800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557eeef3fc70 0x557eeef471a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.054+0000 7f206e52d800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x557eeef40c50 con 0x557eeef3fc70 2024-09-18T01:45:24.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.054+0000 7f206aa81640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557eeef3fc70 0x557eeef471a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.054+0000 7f206aa81640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557eeef3fc70 0x557eeef471a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59906/0 (socket says 172.21.15.146:59906) 2024-09-18T01:45:24.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.054+0000 7f206aa81640 1 -- 172.21.15.146:0/2001629092 learned_addr learned my addr 172.21.15.146:0/2001629092 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:24.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.054+0000 7f206aa81640 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557eeef476e0 con 0x557eeef3fc70 2024-09-18T01:45:24.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.054+0000 7f206aa81640 1 --2- 172.21.15.146:0/2001629092 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557eeef3fc70 0x557eeef471a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f206404ca10 tx=0x7f206404c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.054+0000 7f1f3bfff640 1 -- 172.21.15.146:0/2001629092 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f206403a070 con 0x557eeef3fc70 2024-09-18T01:45:24.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.054+0000 7f1f3bfff640 1 -- 172.21.15.146:0/2001629092 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f206404e2a0 con 0x557eeef3fc70 2024-09-18T01:45:24.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.054+0000 7f206e52d800 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557eeef47970 con 0x557eeef3fc70 2024-09-18T01:45:24.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.054+0000 7f1f3bfff640 1 -- 172.21.15.146:0/2001629092 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2064045040 con 0x557eeef3fc70 2024-09-18T01:45:24.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.054+0000 7f206e52d800 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557eeef4a620 con 0x557eeef3fc70 2024-09-18T01:45:24.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.055+0000 7f1f3bfff640 1 -- 172.21.15.146:0/2001629092 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f206403d070 con 0x557eeef3fc70 2024-09-18T01:45:24.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.055+0000 7f1f3bfff640 1 --2- 172.21.15.146:0/2001629092 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1f34036b90 0x7f1f34039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.055+0000 7f1f3bfff640 1 -- 172.21.15.146:0/2001629092 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f206400e040 con 0x557eeef3fc70 2024-09-18T01:45:24.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.055+0000 7f206a280640 1 --2- 172.21.15.146:0/2001629092 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1f34036b90 0x7f1f34039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.056+0000 7f206e52d800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.056+0000 7f206e52d800 1 --2- 172.21.15.146:0/2001629092 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x557eeef52df0 0x557eeef552b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.056+0000 7f206e52d800 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557eeef55a00 con 0x557eeef52df0 2024-09-18T01:45:24.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.056+0000 7f2063fff640 1 --2- 172.21.15.146:0/2001629092 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x557eeef52df0 0x557eeef552b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.056+0000 7f206a280640 1 --2- 172.21.15.146:0/2001629092 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1f34036b90 0x7f1f34039050 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f205c051840 tx=0x7f205c05ab40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.056+0000 7f2063fff640 1 --2- 172.21.15.146:0/2001629092 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x557eeef52df0 0x557eeef552b0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.056+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f205400f610 con 0x557eeef52df0 2024-09-18T01:45:24.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.056+0000 7f206e52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.056+0000 7f206e52d800 20 realm 2024-09-18T01:45:24.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.056+0000 7f206e52d800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.056+0000 7f206e52d800 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557eeef52240 con 0x557eeef52df0 2024-09-18T01:45:24.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.057+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f205400f610 con 0x557eeef52df0 2024-09-18T01:45:24.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.057+0000 7f206e52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.057+0000 7f206e52d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:24.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.057+0000 7f206e52d800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.057+0000 7f206e52d800 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557eeef564e0 con 0x557eeef52df0 2024-09-18T01:45:24.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.057+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f205400f610 con 0x557eeef52df0 2024-09-18T01:45:24.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.057+0000 7f206e52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.057+0000 7f206e52d800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.057+0000 7f206e52d800 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557eeef56db0 con 0x557eeef52df0 2024-09-18T01:45:24.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.057+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f205400f610 con 0x557eeef52df0 2024-09-18T01:45:24.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.057+0000 7f206e52d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:24.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.057+0000 7f206e52d800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.057+0000 7f206e52d800 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557eeef57150 con 0x557eeef52df0 2024-09-18T01:45:24.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.057+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f205400f610 con 0x557eeef52df0 2024-09-18T01:45:24.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.057+0000 7f206e52d800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:24.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.057+0000 7f206e52d800 20 searching for the correct realm 2024-09-18T01:45:24.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.057+0000 7f206e52d800 1 --2- 172.21.15.146:0/2001629092 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x557eeef59030 0x557eeef5b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.057+0000 7f206e52d800 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557eeef5bad0 con 0x557eeef59030 2024-09-18T01:45:24.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.058+0000 7f206aa81640 1 --2- 172.21.15.146:0/2001629092 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x557eeef59030 0x557eeef5b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.058+0000 7f206aa81640 1 --2- 172.21.15.146:0/2001629092 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x557eeef59030 0x557eeef5b420 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.058+0000 7f206aa81640 1 -- 172.21.15.146:0/2001629092 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f206403c030 con 0x557eeef59030 2024-09-18T01:45:24.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.058+0000 7f206aa81640 1 --2- 172.21.15.146:0/2001629092 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f206403f060 0x7f2064023070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.058+0000 7f206aa81640 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557eeef5bad0 con 0x7f206403f060 2024-09-18T01:45:24.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.058+0000 7f206a280640 1 --2- 172.21.15.146:0/2001629092 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f206403f060 0x7f2064023070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.059+0000 7f206a280640 1 --2- 172.21.15.146:0/2001629092 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f206403f060 0x7f2064023070 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.059+0000 7f206a280640 1 -- 172.21.15.146:0/2001629092 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205c07f070 con 0x7f206403f060 2024-09-18T01:45:24.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.059+0000 7f206a280640 1 --2- 172.21.15.146:0/2001629092 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f205c078070 0x7f205c08f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.059+0000 7f206a280640 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557eeef5bad0 con 0x7f205c078070 2024-09-18T01:45:24.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.059+0000 7f2063fff640 1 --2- 172.21.15.146:0/2001629092 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f205c078070 0x7f205c08f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.059+0000 7f2063fff640 1 --2- 172.21.15.146:0/2001629092 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f205c078070 0x7f205c08f670 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.059+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205400f610 con 0x7f205c078070 2024-09-18T01:45:24.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.059+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557eeef5bad0 con 0x557eeef52df0 2024-09-18T01:45:24.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.060+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f205400f610 con 0x557eeef52df0 2024-09-18T01:45:24.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.060+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557eeef5bad0 con 0x557eeef52df0 2024-09-18T01:45:24.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.060+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205400f610 con 0x557eeef52df0 2024-09-18T01:45:24.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.060+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557eeef5bad0 con 0x7f205c078070 2024-09-18T01:45:24.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.060+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205400f610 con 0x7f205c078070 2024-09-18T01:45:24.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.060+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557eeef5bad0 con 0x7f205c078070 2024-09-18T01:45:24.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.060+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205400f610 con 0x7f205c078070 2024-09-18T01:45:24.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.060+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557eeef5bad0 con 0x7f206403f060 2024-09-18T01:45:24.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.061+0000 7f206a280640 1 -- 172.21.15.146:0/2001629092 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205c07f070 con 0x7f206403f060 2024-09-18T01:45:24.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.061+0000 7f206a280640 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557eeef5bad0 con 0x557eeef59030 2024-09-18T01:45:24.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.061+0000 7f206aa81640 1 -- 172.21.15.146:0/2001629092 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f206403c030 con 0x557eeef59030 2024-09-18T01:45:24.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.061+0000 7f206aa81640 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557eeef5bad0 con 0x557eeef52df0 2024-09-18T01:45:24.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.061+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205400f610 con 0x557eeef52df0 2024-09-18T01:45:24.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.061+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557eeef5bad0 con 0x7f205c078070 2024-09-18T01:45:24.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.061+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205400f610 con 0x7f205c078070 2024-09-18T01:45:24.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.061+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557eeef5bad0 con 0x557eeef52df0 2024-09-18T01:45:24.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.062+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205400f610 con 0x557eeef52df0 2024-09-18T01:45:24.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.062+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557eeef5bad0 con 0x7f206403f060 2024-09-18T01:45:24.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.062+0000 7f206a280640 1 -- 172.21.15.146:0/2001629092 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f205c07f070 con 0x7f206403f060 2024-09-18T01:45:24.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.062+0000 7f206a280640 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557eeef5bad0 con 0x557eeef59030 2024-09-18T01:45:24.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.062+0000 7f206aa81640 1 -- 172.21.15.146:0/2001629092 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f206403c030 con 0x557eeef59030 2024-09-18T01:45:24.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.062+0000 7f206aa81640 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557eeef5bad0 con 0x557eeef59030 2024-09-18T01:45:24.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.062+0000 7f206aa81640 1 -- 172.21.15.146:0/2001629092 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f206403c030 con 0x557eeef59030 2024-09-18T01:45:24.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.062+0000 7f206aa81640 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557eeef5bad0 con 0x7f205c078070 2024-09-18T01:45:24.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.063+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205400f610 con 0x7f205c078070 2024-09-18T01:45:24.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.063+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557eeef5bad0 con 0x557eeef59030 2024-09-18T01:45:24.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.063+0000 7f206aa81640 1 -- 172.21.15.146:0/2001629092 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f206403c030 con 0x557eeef59030 2024-09-18T01:45:24.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.063+0000 7f206aa81640 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557eeef5bad0 con 0x557eeef59030 2024-09-18T01:45:24.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.063+0000 7f206aa81640 1 -- 172.21.15.146:0/2001629092 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f206403c030 con 0x557eeef59030 2024-09-18T01:45:24.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.063+0000 7f206aa81640 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557eeef5bad0 con 0x557eeef52df0 2024-09-18T01:45:24.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.063+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205400f610 con 0x557eeef52df0 2024-09-18T01:45:24.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.063+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557eeef5bad0 con 0x557eeef52df0 2024-09-18T01:45:24.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.064+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f205400f610 con 0x557eeef52df0 2024-09-18T01:45:24.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.064+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557eeef5bad0 con 0x7f205c078070 2024-09-18T01:45:24.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.064+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205400f610 con 0x7f205c078070 2024-09-18T01:45:24.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.064+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557eeef5bad0 con 0x557eeef59030 2024-09-18T01:45:24.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.064+0000 7f206aa81640 1 -- 172.21.15.146:0/2001629092 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f206403c030 con 0x557eeef59030 2024-09-18T01:45:24.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.064+0000 7f206aa81640 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557eeef5bad0 con 0x7f206403f060 2024-09-18T01:45:24.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.064+0000 7f206a280640 1 -- 172.21.15.146:0/2001629092 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205c07f070 con 0x7f206403f060 2024-09-18T01:45:24.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.065+0000 7f206a280640 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557eeef5bad0 con 0x557eeef52df0 2024-09-18T01:45:24.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.065+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205400f610 con 0x557eeef52df0 2024-09-18T01:45:24.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.065+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557eeef5bad0 con 0x7f205c078070 2024-09-18T01:45:24.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.065+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205400f610 con 0x7f205c078070 2024-09-18T01:45:24.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.065+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557eeef5bad0 con 0x557eeef59030 2024-09-18T01:45:24.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.065+0000 7f206aa81640 1 -- 172.21.15.146:0/2001629092 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f206403c030 con 0x557eeef59030 2024-09-18T01:45:24.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.065+0000 7f206aa81640 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557eeef5bad0 con 0x7f205c078070 2024-09-18T01:45:24.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.066+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205400f610 con 0x7f205c078070 2024-09-18T01:45:24.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.066+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557eeef5bad0 con 0x7f206403f060 2024-09-18T01:45:24.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.066+0000 7f206a280640 1 -- 172.21.15.146:0/2001629092 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205c07f070 con 0x7f206403f060 2024-09-18T01:45:24.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.066+0000 7f206a280640 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557eeef5bad0 con 0x557eeef59030 2024-09-18T01:45:24.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.066+0000 7f206aa81640 1 -- 172.21.15.146:0/2001629092 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f206403c030 con 0x557eeef59030 2024-09-18T01:45:24.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.066+0000 7f206aa81640 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557eeef5bad0 con 0x7f205c078070 2024-09-18T01:45:24.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.066+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205400f610 con 0x7f205c078070 2024-09-18T01:45:24.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.066+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557eeef5bad0 con 0x557eeef52df0 2024-09-18T01:45:24.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.067+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f205400f610 con 0x557eeef52df0 2024-09-18T01:45:24.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.067+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557eeef5bad0 con 0x7f206403f060 2024-09-18T01:45:24.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.067+0000 7f206a280640 1 -- 172.21.15.146:0/2001629092 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205c07f070 con 0x7f206403f060 2024-09-18T01:45:24.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.067+0000 7f206e52d800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:24.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.067+0000 7f206e52d800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:24.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.067+0000 7f206e52d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:24.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.067+0000 7f206e52d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:24.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.067+0000 7f206e52d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:24.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.067+0000 7f206e52d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:24.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.067+0000 7f206e52d800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.067+0000 7f206e52d800 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557eeef57b00 con 0x557eeef52df0 2024-09-18T01:45:24.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.067+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f205400f610 con 0x557eeef52df0 2024-09-18T01:45:24.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.067+0000 7f206e52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.067+0000 7f206e52d800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.067+0000 7f206e52d800 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557eeef583a0 con 0x557eeef52df0 2024-09-18T01:45:24.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.067+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f205400f610 con 0x557eeef52df0 2024-09-18T01:45:24.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.067+0000 7f206e52d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:24.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.067+0000 7f206e52d800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.067+0000 7f206e52d800 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557eeef57740 con 0x7f206403f060 2024-09-18T01:45:24.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.067+0000 7f206a280640 1 -- 172.21.15.146:0/2001629092 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f205c07f070 con 0x7f206403f060 2024-09-18T01:45:24.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.068+0000 7f206e52d800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:24.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.068+0000 7f206e52d800 20 zone default found 2024-09-18T01:45:24.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.068+0000 7f206e52d800 4 Realm: () 2024-09-18T01:45:24.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.068+0000 7f206e52d800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:24.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.068+0000 7f206e52d800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:24.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.068+0000 7f206e52d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:24.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.068+0000 7f206e52d800 20 zonegroup default 2024-09-18T01:45:24.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.068+0000 7f206e52d800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.068+0000 7f206e52d800 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557eeef5c400 con 0x7f205c078070 2024-09-18T01:45:24.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.068+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f205400f610 con 0x7f205c078070 2024-09-18T01:45:24.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.068+0000 7f206e52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.068+0000 7f206e52d800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.068+0000 7f206e52d800 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557eeef5df60 con 0x557eeef59030 2024-09-18T01:45:24.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.068+0000 7f206aa81640 1 -- 172.21.15.146:0/2001629092 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f206403c030 con 0x557eeef59030 2024-09-18T01:45:24.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.068+0000 7f206e52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.068+0000 7f206e52d800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.068+0000 7f206e52d800 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557eeef5e440 con 0x557eeef59030 2024-09-18T01:45:24.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.069+0000 7f206aa81640 1 -- 172.21.15.146:0/2001629092 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f206403c030 con 0x557eeef59030 2024-09-18T01:45:24.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.069+0000 7f206e52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.069+0000 7f206e52d800 20 started sync module instance, tier type = 2024-09-18T01:45:24.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.069+0000 7f206e52d800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:24.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.069+0000 7f206e52d800 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557eeef5ce60 con 0x7f206403f060 2024-09-18T01:45:24.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.070+0000 7f206a280640 1 -- 172.21.15.146:0/2001629092 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v31'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205c07f070 con 0x7f206403f060 2024-09-18T01:45:24.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.070+0000 7f206e52d800 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94003663327872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557eeef5ed50 con 0x7f206403f060 2024-09-18T01:45:24.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.070+0000 7f206e52d800 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557eeef5f5a0 con 0x557eeef52df0 2024-09-18T01:45:24.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.070+0000 7f206a280640 1 -- 172.21.15.146:0/2001629092 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94003663327872] v31'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205c07f070 con 0x7f206403f060 2024-09-18T01:45:24.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.071+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v31'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205400f610 con 0x557eeef52df0 2024-09-18T01:45:24.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.071+0000 7f206e52d800 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94003663333536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557eeef5f600 con 0x557eeef52df0 2024-09-18T01:45:24.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.071+0000 7f206e52d800 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557eeef600e0 con 0x557eeef59030 2024-09-18T01:45:24.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.072+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94003663333536] v31'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205400f610 con 0x557eeef52df0 2024-09-18T01:45:24.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.072+0000 7f206aa81640 1 -- 172.21.15.146:0/2001629092 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v31'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f206403c030 con 0x557eeef59030 2024-09-18T01:45:24.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.072+0000 7f206e52d800 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94003663338384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557eeef604d0 con 0x557eeef59030 2024-09-18T01:45:24.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.072+0000 7f206e52d800 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557eeef60f10 con 0x7f206403f060 2024-09-18T01:45:24.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.073+0000 7f206aa81640 1 -- 172.21.15.146:0/2001629092 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94003663338384] v31'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f206403c030 con 0x557eeef59030 2024-09-18T01:45:24.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.073+0000 7f206a280640 1 -- 172.21.15.146:0/2001629092 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v31'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205c07f070 con 0x7f206403f060 2024-09-18T01:45:24.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.073+0000 7f206e52d800 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94003663342048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557eeef61300 con 0x7f206403f060 2024-09-18T01:45:24.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.073+0000 7f206e52d800 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557eeef61d40 con 0x557eeef52df0 2024-09-18T01:45:24.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.074+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v31'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205400f610 con 0x557eeef52df0 2024-09-18T01:45:24.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.074+0000 7f206e52d800 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94003663345680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557eeef625e0 con 0x557eeef52df0 2024-09-18T01:45:24.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.074+0000 7f206e52d800 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557eeef630e0 con 0x7f205c078070 2024-09-18T01:45:24.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.074+0000 7f206a280640 1 -- 172.21.15.146:0/2001629092 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94003663342048] v31'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205c07f070 con 0x7f206403f060 2024-09-18T01:45:24.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.075+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94003663345680] v31'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205400f610 con 0x557eeef52df0 2024-09-18T01:45:24.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.075+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v31'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205400f610 con 0x7f205c078070 2024-09-18T01:45:24.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.075+0000 7f206e52d800 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94003663350736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557eeef620e0 con 0x7f205c078070 2024-09-18T01:45:24.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.075+0000 7f206e52d800 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557eeef63980 con 0x7f205c078070 2024-09-18T01:45:24.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.076+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94003663350736] v31'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205400f610 con 0x7f205c078070 2024-09-18T01:45:24.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.076+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v31'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205400f610 con 0x7f205c078070 2024-09-18T01:45:24.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.076+0000 7f206e52d800 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94003663335664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557eeef620e0 con 0x7f205c078070 2024-09-18T01:45:24.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.076+0000 7f206e52d800 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557eeef63fa0 con 0x7f205c078070 2024-09-18T01:45:24.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.077+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(58 notify.7 [create] v31'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205400f610 con 0x7f205c078070 2024-09-18T01:45:24.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.077+0000 7f206e52d800 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94003663354608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557eeef643c0 con 0x7f205c078070 2024-09-18T01:45:24.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.077+0000 7f206e52d800 20 add_watcher() i=0 2024-09-18T01:45:24.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.077+0000 7f206e52d800 20 add_watcher() i=1 2024-09-18T01:45:24.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.077+0000 7f206e52d800 20 add_watcher() i=2 2024-09-18T01:45:24.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.077+0000 7f206e52d800 20 add_watcher() i=3 2024-09-18T01:45:24.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.077+0000 7f206e52d800 20 add_watcher() i=4 2024-09-18T01:45:24.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.077+0000 7f206e52d800 20 add_watcher() i=5 2024-09-18T01:45:24.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.077+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94003663335664] v31'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205400f610 con 0x7f205c078070 2024-09-18T01:45:24.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.077+0000 7f206e52d800 20 add_watcher() i=6 2024-09-18T01:45:24.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.078+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94003663354608] v31'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205400f610 con 0x7f205c078070 2024-09-18T01:45:24.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.078+0000 7f206e52d800 20 add_watcher() i=7 2024-09-18T01:45:24.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.078+0000 7f206e52d800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:24.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.078+0000 7f206e52d800 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557eeef643c0 con 0x557eeef52df0 2024-09-18T01:45:24.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.078+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f205400f610 con 0x557eeef52df0 2024-09-18T01:45:24.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.078+0000 7f206e52d800 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94003663355664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557eeef64330 con 0x557eeef52df0 2024-09-18T01:45:24.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.079+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94003663355664] v31'72 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f205400f610 con 0x557eeef52df0 2024-09-18T01:45:24.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.079+0000 7f1f20fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:24.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.079+0000 7f206e52d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:24.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.079+0000 7f206e52d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:24.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.079+0000 7f206e52d800 5 note: GC not initialized 2024-09-18T01:45:24.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.079+0000 7f1e9b7fe640 20 reqs_thread_entry: start 2024-09-18T01:45:24.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.079+0000 7f206e52d800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:24.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.080+0000 7f206e52d800 20 Filter name: none 2024-09-18T01:45:24.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.080+0000 7f1e997fa640 20 reqs_thread_entry: start 2024-09-18T01:45:24.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.080+0000 7f206e52d800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.080+0000 7f206e52d800 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557eeef9a250 con 0x557eeef52df0 2024-09-18T01:45:24.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.080+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f205400f610 con 0x557eeef52df0 2024-09-18T01:45:24.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.080+0000 7f206e52d800 20 rados_obj.operate() r=0 bl.length=502 2024-09-18T01:45:24.090 INFO:teuthology.orchestra.run.smithi146.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T01:45:23.010714Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-18T01:45:23.956893Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:45:23.010705Z","tags":[],"group_ids":[]} 2024-09-18T01:45:24.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.081+0000 7f1f20fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:24.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.081+0000 7f206e52d800 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94003663355664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557eeef98ca0 con 0x557eeef52df0 2024-09-18T01:45:24.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.082+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94003663355664] v31'73 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f205400f610 con 0x557eeef52df0 2024-09-18T01:45:24.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.082+0000 7f206e52d800 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94003663327872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557eeef98020 con 0x7f206403f060 2024-09-18T01:45:24.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.083+0000 7f206a280640 1 -- 172.21.15.146:0/2001629092 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94003663327872] v31'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205c07f070 con 0x7f206403f060 2024-09-18T01:45:24.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.083+0000 7f206e52d800 20 remove_watcher() i=0 2024-09-18T01:45:24.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.083+0000 7f206e52d800 2 removed watcher, disabling cache 2024-09-18T01:45:24.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.083+0000 7f206e52d800 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94003663333536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557eeef98020 con 0x557eeef52df0 2024-09-18T01:45:24.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.084+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94003663333536] v31'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205400f610 con 0x557eeef52df0 2024-09-18T01:45:24.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.084+0000 7f206e52d800 20 remove_watcher() i=1 2024-09-18T01:45:24.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.084+0000 7f206e52d800 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94003663338384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557eeef98020 con 0x557eeef59030 2024-09-18T01:45:24.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.085+0000 7f206aa81640 1 -- 172.21.15.146:0/2001629092 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94003663338384] v31'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f206403c030 con 0x557eeef59030 2024-09-18T01:45:24.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.085+0000 7f206e52d800 20 remove_watcher() i=2 2024-09-18T01:45:24.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.085+0000 7f206e52d800 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94003663342048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557eeef98020 con 0x7f206403f060 2024-09-18T01:45:24.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.086+0000 7f206a280640 1 -- 172.21.15.146:0/2001629092 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94003663342048] v31'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205c07f070 con 0x7f206403f060 2024-09-18T01:45:24.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.086+0000 7f206e52d800 20 remove_watcher() i=3 2024-09-18T01:45:24.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.086+0000 7f206e52d800 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94003663345680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557eeef98020 con 0x557eeef52df0 2024-09-18T01:45:24.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.087+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94003663345680] v31'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205400f610 con 0x557eeef52df0 2024-09-18T01:45:24.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.087+0000 7f206e52d800 20 remove_watcher() i=4 2024-09-18T01:45:24.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.087+0000 7f206e52d800 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94003663350736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557eeef98020 con 0x7f205c078070 2024-09-18T01:45:24.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.088+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94003663350736] v31'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205400f610 con 0x7f205c078070 2024-09-18T01:45:24.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.088+0000 7f206e52d800 20 remove_watcher() i=5 2024-09-18T01:45:24.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.088+0000 7f206e52d800 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94003663335664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557eeef98020 con 0x7f205c078070 2024-09-18T01:45:24.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.089+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94003663335664] v31'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205400f610 con 0x7f205c078070 2024-09-18T01:45:24.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.089+0000 7f206e52d800 20 remove_watcher() i=6 2024-09-18T01:45:24.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.089+0000 7f206e52d800 1 -- 172.21.15.146:0/2001629092 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94003663354608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557eeef98020 con 0x7f205c078070 2024-09-18T01:45:24.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.090+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94003663354608] v31'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205400f610 con 0x7f205c078070 2024-09-18T01:45:24.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.090+0000 7f206e52d800 20 remove_watcher() i=7 2024-09-18T01:45:24.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.090+0000 7f206e52d800 1 -- 172.21.15.146:0/2001629092 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f205c078070 msgr2=0x7f205c08f670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.090+0000 7f206e52d800 1 --2- 172.21.15.146:0/2001629092 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f205c078070 0x7f205c08f670 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.090+0000 7f206e52d800 1 -- 172.21.15.146:0/2001629092 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x557eeef52df0 msgr2=0x557eeef552b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.090+0000 7f206e52d800 1 --2- 172.21.15.146:0/2001629092 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x557eeef52df0 0x557eeef552b0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.090+0000 7f206e52d800 1 -- 172.21.15.146:0/2001629092 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f206403f060 msgr2=0x7f2064023070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.090+0000 7f206e52d800 1 --2- 172.21.15.146:0/2001629092 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f206403f060 0x7f2064023070 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.090+0000 7f206e52d800 1 -- 172.21.15.146:0/2001629092 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x557eeef59030 msgr2=0x557eeef5b420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.090+0000 7f206e52d800 1 --2- 172.21.15.146:0/2001629092 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x557eeef59030 0x557eeef5b420 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.091+0000 7f206e52d800 1 -- 172.21.15.146:0/2001629092 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1f34036b90 msgr2=0x7f1f34039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.091+0000 7f206e52d800 1 --2- 172.21.15.146:0/2001629092 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1f34036b90 0x7f1f34039050 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f205c051840 tx=0x7f205c05ab40 comp rx=0 tx=0).stop 2024-09-18T01:45:24.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.091+0000 7f206e52d800 1 -- 172.21.15.146:0/2001629092 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557eeef3fc70 msgr2=0x557eeef471a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.091+0000 7f206e52d800 1 --2- 172.21.15.146:0/2001629092 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557eeef3fc70 0x557eeef471a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f206404ca10 tx=0x7f206404c820 comp rx=0 tx=0).stop 2024-09-18T01:45:24.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.091+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 reap_dead start 2024-09-18T01:45:24.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.091+0000 7f2063fff640 1 -- 172.21.15.146:0/2001629092 reap_dead start 2024-09-18T01:45:24.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.091+0000 7f206e52d800 1 -- 172.21.15.146:0/2001629092 shutdown_connections 2024-09-18T01:45:24.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.091+0000 7f206e52d800 1 -- 172.21.15.146:0/2001629092 >> 172.21.15.146:0/2001629092 conn(0x557eeef3c020 msgr2=0x557eeef3a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:24.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.091+0000 7f206e52d800 1 -- 172.21.15.146:0/2001629092 shutdown_connections 2024-09-18T01:45:24.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.091+0000 7f206e52d800 1 -- 172.21.15.146:0/2001629092 wait complete. 2024-09-18T01:45:24.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.091+0000 7f206e52d800 1 -- 172.21.15.146:0/2619290730 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1f44036b90 msgr2=0x7f1f44039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.091+0000 7f206e52d800 1 --2- 172.21.15.146:0/2619290730 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1f44036b90 0x7f1f44039050 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x557eeef234c0 tx=0x7f205c08f220 comp rx=0 tx=0).stop 2024-09-18T01:45:24.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.091+0000 7f206e52d800 1 -- 172.21.15.146:0/2619290730 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557eeee203f0 msgr2=0x557eeee1ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.091+0000 7f206e52d800 1 --2- 172.21.15.146:0/2619290730 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557eeee203f0 0x557eeee1ea40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x557eeef1daa0 tx=0x7f20640178e0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.091+0000 7f206e52d800 1 -- 172.21.15.146:0/2619290730 shutdown_connections 2024-09-18T01:45:24.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.091+0000 7f206e52d800 1 --2- 172.21.15.146:0/2619290730 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1f44036b90 0x7f1f44039050 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.091+0000 7f206e52d800 1 --2- 172.21.15.146:0/2619290730 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557eeee203f0 0x557eeee1ea40 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.091+0000 7f206e52d800 1 -- 172.21.15.146:0/2619290730 >> 172.21.15.146:0/2619290730 conn(0x557eeef25de0 msgr2=0x557eeef28960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:24.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.091+0000 7f206e52d800 1 -- 172.21.15.146:0/2619290730 shutdown_connections 2024-09-18T01:45:24.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.091+0000 7f206e52d800 1 -- 172.21.15.146:0/2619290730 wait complete. 2024-09-18T01:45:24.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.091+0000 7f206e52d800 1 -- 172.21.15.146:0/1931712997 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x557eeee1e2f0 msgr2=0x557eeef1d140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.091+0000 7f206e52d800 1 --2- 172.21.15.146:0/1931712997 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x557eeee1e2f0 0x557eeef1d140 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.091+0000 7f206e52d800 1 -- 172.21.15.146:0/1931712997 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x557eeef1f0f0 msgr2=0x557eeef22930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.091+0000 7f206e52d800 1 --2- 172.21.15.146:0/1931712997 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x557eeef1f0f0 0x557eeef22930 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.092+0000 7f206e52d800 1 -- 172.21.15.146:0/1931712997 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1f50036b40 msgr2=0x7f1f50039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.092+0000 7f206e52d800 1 --2- 172.21.15.146:0/1931712997 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1f50036b40 0x7f1f50039000 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2054000f60 tx=0x7f2054001370 comp rx=0 tx=0).stop 2024-09-18T01:45:24.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.092+0000 7f206e52d800 1 -- 172.21.15.146:0/1931712997 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557eeee1d9b0 msgr2=0x557eeef160d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.092+0000 7f206e52d800 1 --2- 172.21.15.146:0/1931712997 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557eeee1d9b0 0x557eeef160d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f205c067040 tx=0x7f205c002fb0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.092+0000 7f206e52d800 1 -- 172.21.15.146:0/1931712997 shutdown_connections 2024-09-18T01:45:24.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.092+0000 7f206e52d800 1 --2- 172.21.15.146:0/1931712997 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x557eeef1f0f0 0x557eeef22930 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.092+0000 7f206e52d800 1 --2- 172.21.15.146:0/1931712997 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x557eeee1e2f0 0x557eeef1d140 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.092+0000 7f206e52d800 1 --2- 172.21.15.146:0/1931712997 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1f50036b40 0x7f1f50039000 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.092+0000 7f206e52d800 1 --2- 172.21.15.146:0/1931712997 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557eeee1d9b0 0x557eeef160d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.092+0000 7f206e52d800 1 -- 172.21.15.146:0/1931712997 >> 172.21.15.146:0/1931712997 conn(0x557eeee195c0 msgr2=0x557eeef08aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:24.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.092+0000 7f206e52d800 1 -- 172.21.15.146:0/1931712997 shutdown_connections 2024-09-18T01:45:24.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.092+0000 7f206e52d800 1 -- 172.21.15.146:0/1931712997 wait complete. 2024-09-18T01:45:24.101 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T01:45:23.010714Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-18T01:45:23.956893Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:45:23.010705Z', 'tags': [], 'group_ids': []} 2024-09-18T01:45:24.101 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-18T01:45:24.101 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-18T01:45:24.102 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --uid foo --access-key p5YnriCv1nAtykxBrupQ 2024-09-18T01:45:24.148 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:24.148 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:24.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.148+0000 7f09d7436800 1 Processor -- start 2024-09-18T01:45:24.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.148+0000 7f09d7436800 1 -- start start 2024-09-18T01:45:24.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.148+0000 7f09d7436800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55b856775a40 0x55b856775e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.148+0000 7f09d7436800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b856636b30 con 0x55b856776380 2024-09-18T01:45:24.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.148+0000 7f09d7436800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x55b856618360 con 0x55b856775a40 2024-09-18T01:45:24.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.148+0000 7f09d2752640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55b856775a40 0x55b856775e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.148+0000 7f09cbfff640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x55b856776380 0x55b85677cae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:38776/0 (socket says 172.21.15.146:38776) 2024-09-18T01:45:24.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.148+0000 7f09cbfff640 1 -- 172.21.15.146:0/1390691512 learned_addr learned my addr 172.21.15.146:0/1390691512 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:45:24.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.148+0000 7f09d2752640 1 -- 172.21.15.146:0/1390691512 >> v1:172.21.15.129:6789/0 conn(0x55b856776380 legacy=0x55b85677cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.148+0000 7f09d2752640 1 -- 172.21.15.146:0/1390691512 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b85663ee00 con 0x55b856775a40 2024-09-18T01:45:24.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.150+0000 7f09d2752640 1 --2- 172.21.15.146:0/1390691512 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b856775a40 0x55b856775e40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f09c400a470 tx=0x7f09c4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e291bcb011cb355 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.150+0000 7f09d1f51640 1 -- 172.21.15.146:0/1390691512 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09c4053570 con 0x55b856775a40 2024-09-18T01:45:24.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.150+0000 7f09d1f51640 1 -- 172.21.15.146:0/1390691512 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09c4058070 con 0x55b856775a40 2024-09-18T01:45:24.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.150+0000 7f09d1f51640 1 -- 172.21.15.146:0/1390691512 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09c4053880 con 0x55b856775a40 2024-09-18T01:45:24.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.151+0000 7f09d7436800 1 -- 172.21.15.146:0/1390691512 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b856775a40 msgr2=0x55b856775e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.151+0000 7f09d7436800 1 --2- 172.21.15.146:0/1390691512 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b856775a40 0x55b856775e40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f09c400a470 tx=0x7f09c4045a20 comp rx=0 tx=0).stop 2024-09-18T01:45:24.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.151+0000 7f09d7436800 1 -- 172.21.15.146:0/1390691512 shutdown_connections 2024-09-18T01:45:24.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.151+0000 7f09d7436800 1 --2- 172.21.15.146:0/1390691512 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b856775a40 0x55b856775e40 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.151+0000 7f09d7436800 1 -- 172.21.15.146:0/1390691512 >> 172.21.15.146:0/1390691512 conn(0x55b856771550 msgr2=0x55b856773970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:24.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.151+0000 7f09d7436800 1 -- 172.21.15.146:0/1390691512 shutdown_connections 2024-09-18T01:45:24.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.151+0000 7f09d7436800 1 -- 172.21.15.146:0/1390691512 wait complete. 2024-09-18T01:45:24.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.165+0000 7f09d7436800 1 Processor -- start 2024-09-18T01:45:24.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.165+0000 7f09d7436800 1 -- start start 2024-09-18T01:45:24.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.165+0000 7f09d7436800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b856775a40 0x55b8568668e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.165+0000 7f09d7436800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55b8566c3360 con 0x55b856775a40 2024-09-18T01:45:24.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.165+0000 7f09d2752640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b856775a40 0x55b8568668e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.165+0000 7f09d2752640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b856775a40 0x55b8568668e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59922/0 (socket says 172.21.15.146:59922) 2024-09-18T01:45:24.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.165+0000 7f09d2752640 1 -- 172.21.15.146:0/1046785062 learned_addr learned my addr 172.21.15.146:0/1046785062 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:24.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.165+0000 7f09d2752640 1 -- 172.21.15.146:0/1046785062 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b856610bc0 con 0x55b856775a40 2024-09-18T01:45:24.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.165+0000 7f09d2752640 1 --2- 172.21.15.146:0/1046785062 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b856775a40 0x55b8568668e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f09c4025c20 tx=0x7f09c4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c3cad73b64eeb56 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.166+0000 7f08c0608640 1 -- 172.21.15.146:0/1046785062 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09c4053ba0 con 0x55b856775a40 2024-09-18T01:45:24.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.166+0000 7f08c0608640 1 -- 172.21.15.146:0/1046785062 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09c4063030 con 0x55b856775a40 2024-09-18T01:45:24.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.166+0000 7f08c0608640 1 -- 172.21.15.146:0/1046785062 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09c4053440 con 0x55b856775a40 2024-09-18T01:45:24.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.166+0000 7f09d7436800 1 -- 172.21.15.146:0/1046785062 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b856775a40 msgr2=0x55b8568668e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.166+0000 7f09d7436800 1 --2- 172.21.15.146:0/1046785062 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b856775a40 0x55b8568668e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f09c4025c20 tx=0x7f09c4051000 comp rx=0 tx=0).stop 2024-09-18T01:45:24.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.166+0000 7f09d7436800 1 -- 172.21.15.146:0/1046785062 shutdown_connections 2024-09-18T01:45:24.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.166+0000 7f09d7436800 1 --2- 172.21.15.146:0/1046785062 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b856775a40 0x55b8568668e0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.166+0000 7f09d7436800 1 -- 172.21.15.146:0/1046785062 >> 172.21.15.146:0/1046785062 conn(0x55b856771550 msgr2=0x55b8568622a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:24.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.166+0000 7f09d7436800 1 -- 172.21.15.146:0/1046785062 shutdown_connections 2024-09-18T01:45:24.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.166+0000 7f09d7436800 1 -- 172.21.15.146:0/1046785062 wait complete. 2024-09-18T01:45:24.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.167+0000 7f09d7436800 1 Processor -- start 2024-09-18T01:45:24.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.167+0000 7f09d7436800 1 -- start start 2024-09-18T01:45:24.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.167+0000 7f09d7436800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b856775a40 0x55b856778400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.167+0000 7f09d7436800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55b85677e620 con 0x55b856775a40 2024-09-18T01:45:24.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.167+0000 7f09d2752640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b856775a40 0x55b856778400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.167+0000 7f09d2752640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b856775a40 0x55b856778400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59936/0 (socket says 172.21.15.146:59936) 2024-09-18T01:45:24.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.167+0000 7f09d2752640 1 -- 172.21.15.146:0/3141732762 learned_addr learned my addr 172.21.15.146:0/3141732762 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:24.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.167+0000 7f09d2752640 1 -- 172.21.15.146:0/3141732762 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b856624fe0 con 0x55b856775a40 2024-09-18T01:45:24.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.167+0000 7f09d2752640 1 --2- 172.21.15.146:0/3141732762 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b856775a40 0x55b856778400 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x55b856867740 tx=0x7f09c4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.168+0000 7f08bee05640 1 -- 172.21.15.146:0/3141732762 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09c4078070 con 0x55b856775a40 2024-09-18T01:45:24.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.168+0000 7f08bee05640 1 -- 172.21.15.146:0/3141732762 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09c4053570 con 0x55b856775a40 2024-09-18T01:45:24.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.168+0000 7f09d7436800 1 -- 172.21.15.146:0/3141732762 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b856776af0 con 0x55b856775a40 2024-09-18T01:45:24.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.168+0000 7f08bee05640 1 -- 172.21.15.146:0/3141732762 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09c4053850 con 0x55b856775a40 2024-09-18T01:45:24.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.168+0000 7f09d7436800 1 -- 172.21.15.146:0/3141732762 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b856777070 con 0x55b856775a40 2024-09-18T01:45:24.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.168+0000 7f08bee05640 1 -- 172.21.15.146:0/3141732762 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f09c407b070 con 0x55b856775a40 2024-09-18T01:45:24.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.169+0000 7f08bee05640 1 --2- 172.21.15.146:0/3141732762 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f08b8036b40 0x7f08b8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.169+0000 7f08bee05640 1 -- 172.21.15.146:0/3141732762 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f09c4070070 con 0x55b856775a40 2024-09-18T01:45:24.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.169+0000 7f09cbfff640 1 --2- 172.21.15.146:0/3141732762 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f08b8036b40 0x7f08b8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.169+0000 7f09d7436800 1 --2- 172.21.15.146:0/3141732762 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55b856776380 0x55b856877610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.169+0000 7f09d7436800 1 -- 172.21.15.146:0/3141732762 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b856877b50 con 0x55b856776380 2024-09-18T01:45:24.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.169+0000 7f09d2f53640 1 --2- 172.21.15.146:0/3141732762 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55b856776380 0x55b856877610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.169+0000 7f09cbfff640 1 --2- 172.21.15.146:0/3141732762 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f08b8036b40 0x7f08b8039000 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f09bc000f60 tx=0x7f09bc0012b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.169+0000 7f09d2f53640 1 --2- 172.21.15.146:0/3141732762 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55b856776380 0x55b856877610 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.169+0000 7f09d2f53640 1 -- 172.21.15.146:0/3141732762 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f09cc00a4a0 con 0x55b856776380 2024-09-18T01:45:24.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.169+0000 7f09d7436800 1 -- 172.21.15.146:0/3141732762 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b856878420 con 0x55b856776380 2024-09-18T01:45:24.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.170+0000 7f09d2f53640 1 -- 172.21.15.146:0/3141732762 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f09cc00a4a0 con 0x55b856776380 2024-09-18T01:45:24.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.170+0000 7f09d7436800 1 -- 172.21.15.146:0/3141732762 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b856879810 con 0x55b856776380 2024-09-18T01:45:24.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.170+0000 7f09d2f53640 1 -- 172.21.15.146:0/3141732762 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f09cc00a4a0 con 0x55b856776380 2024-09-18T01:45:24.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.170+0000 7f09d7436800 1 -- 172.21.15.146:0/3141732762 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b856878c70 con 0x55b856776380 2024-09-18T01:45:24.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.170+0000 7f09d2f53640 1 -- 172.21.15.146:0/3141732762 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f09cc00a4a0 con 0x55b856776380 2024-09-18T01:45:24.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.170+0000 7f09d7436800 1 --2- 172.21.15.146:0/3141732762 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55b85687aca0 0x55b85687d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.170+0000 7f09d7436800 1 -- 172.21.15.146:0/3141732762 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b85687d610 con 0x55b85687aca0 2024-09-18T01:45:24.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.171+0000 7f09d2752640 1 --2- 172.21.15.146:0/3141732762 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55b85687aca0 0x55b85687d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.171+0000 7f09d2752640 1 --2- 172.21.15.146:0/3141732762 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55b85687aca0 0x55b85687d090 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.171+0000 7f09d2752640 1 -- 172.21.15.146:0/3141732762 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f09c407a030 con 0x55b85687aca0 2024-09-18T01:45:24.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.171+0000 7f09d7436800 1 Processor -- start 2024-09-18T01:45:24.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.171+0000 7f09d7436800 1 -- start start 2024-09-18T01:45:24.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.172+0000 7f09d7436800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b85688b2e0 0x55b85688b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.172+0000 7f09d7436800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55b856778940 con 0x55b85688b2e0 2024-09-18T01:45:24.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.172+0000 7f09d2f53640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b85688b2e0 0x55b85688b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.172+0000 7f09d2f53640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b85688b2e0 0x55b85688b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59950/0 (socket says 172.21.15.146:59950) 2024-09-18T01:45:24.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.172+0000 7f09d2f53640 1 -- 172.21.15.146:0/795623368 learned_addr learned my addr 172.21.15.146:0/795623368 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:24.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.172+0000 7f09d2f53640 1 -- 172.21.15.146:0/795623368 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b85688bc40 con 0x55b85688b2e0 2024-09-18T01:45:24.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.172+0000 7f09d2f53640 1 --2- 172.21.15.146:0/795623368 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b85688b2e0 0x55b85688b700 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x55b856777f60 tx=0x7f09cc0178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.173+0000 7f08b7fff640 1 -- 172.21.15.146:0/795623368 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09cc013440 con 0x55b85688b2e0 2024-09-18T01:45:24.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.173+0000 7f08b7fff640 1 -- 172.21.15.146:0/795623368 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09cc0135e0 con 0x55b85688b2e0 2024-09-18T01:45:24.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.173+0000 7f09d7436800 1 -- 172.21.15.146:0/795623368 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b85688bed0 con 0x55b85688b2e0 2024-09-18T01:45:24.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.173+0000 7f08b7fff640 1 -- 172.21.15.146:0/795623368 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09cc0138c0 con 0x55b85688b2e0 2024-09-18T01:45:24.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.173+0000 7f09d7436800 1 -- 172.21.15.146:0/795623368 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b85688ebb0 con 0x55b85688b2e0 2024-09-18T01:45:24.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.173+0000 7f08b7fff640 1 -- 172.21.15.146:0/795623368 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f09cc011040 con 0x55b85688b2e0 2024-09-18T01:45:24.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.173+0000 7f08b7fff640 1 --2- 172.21.15.146:0/795623368 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f08ac036be0 0x7f08ac0390a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.174+0000 7f08b7fff640 1 -- 172.21.15.146:0/795623368 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f09cc01d070 con 0x55b85688b2e0 2024-09-18T01:45:24.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.174+0000 7f09d2752640 1 --2- 172.21.15.146:0/795623368 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f08ac036be0 0x7f08ac0390a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.174+0000 7f09d7436800 1 Processor -- start 2024-09-18T01:45:24.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.174+0000 7f09d7436800 1 -- start start 2024-09-18T01:45:24.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.174+0000 7f09d2752640 1 --2- 172.21.15.146:0/795623368 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f08ac036be0 0x7f08ac0390a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f09c4090010 tx=0x7f09c408ec10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.174+0000 7f09d7436800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b856897f50 0x55b856898350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.174+0000 7f09d7436800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55b856612580 con 0x55b856897f50 2024-09-18T01:45:24.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.174+0000 7f09d2f53640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b856897f50 0x55b856898350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.174+0000 7f09d2f53640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b856897f50 0x55b856898350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59956/0 (socket says 172.21.15.146:59956) 2024-09-18T01:45:24.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.174+0000 7f09d2f53640 1 -- 172.21.15.146:0/1696309271 learned_addr learned my addr 172.21.15.146:0/1696309271 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:24.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.175+0000 7f09d2f53640 1 -- 172.21.15.146:0/1696309271 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b856898920 con 0x55b856897f50 2024-09-18T01:45:24.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.175+0000 7f09d2f53640 1 --2- 172.21.15.146:0/1696309271 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b856897f50 0x55b856898350 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f09cc04c850 tx=0x7f09cc001b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa3cef9ce43d5632 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.175+0000 7f08b5ffb640 1 -- 172.21.15.146:0/1696309271 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09cc012c90 con 0x55b856897f50 2024-09-18T01:45:24.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.175+0000 7f08b5ffb640 1 -- 172.21.15.146:0/1696309271 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09cc012e50 con 0x55b856897f50 2024-09-18T01:45:24.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.175+0000 7f08b5ffb640 1 -- 172.21.15.146:0/1696309271 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09cc012510 con 0x55b856897f50 2024-09-18T01:45:24.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.175+0000 7f09d7436800 1 -- 172.21.15.146:0/1696309271 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b856897f50 msgr2=0x55b856898350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.175+0000 7f09d7436800 1 --2- 172.21.15.146:0/1696309271 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b856897f50 0x55b856898350 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f09cc04c850 tx=0x7f09cc001b20 comp rx=0 tx=0).stop 2024-09-18T01:45:24.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.175+0000 7f09d7436800 1 -- 172.21.15.146:0/1696309271 shutdown_connections 2024-09-18T01:45:24.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.175+0000 7f09d7436800 1 --2- 172.21.15.146:0/1696309271 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b856897f50 0x55b856898350 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.175+0000 7f09d7436800 1 -- 172.21.15.146:0/1696309271 >> 172.21.15.146:0/1696309271 conn(0x55b856894300 msgr2=0x55b856892400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:24.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.175+0000 7f09d7436800 1 -- 172.21.15.146:0/1696309271 shutdown_connections 2024-09-18T01:45:24.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.175+0000 7f09d7436800 1 -- 172.21.15.146:0/1696309271 wait complete. 2024-09-18T01:45:24.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.176+0000 7f09d7436800 1 Processor -- start 2024-09-18T01:45:24.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.176+0000 7f09d7436800 1 -- start start 2024-09-18T01:45:24.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.176+0000 7f09d7436800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b856897f50 0x55b85689f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.176+0000 7f09d7436800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55b856898d10 con 0x55b856897f50 2024-09-18T01:45:24.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.176+0000 7f09d2f53640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b856897f50 0x55b85689f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.176+0000 7f09d2f53640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b856897f50 0x55b85689f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59962/0 (socket says 172.21.15.146:59962) 2024-09-18T01:45:24.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.176+0000 7f09d2f53640 1 -- 172.21.15.146:0/4224400297 learned_addr learned my addr 172.21.15.146:0/4224400297 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:24.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.176+0000 7f09d2f53640 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b85689f760 con 0x55b856897f50 2024-09-18T01:45:24.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.176+0000 7f09d2f53640 1 --2- 172.21.15.146:0/4224400297 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b856897f50 0x55b85689f220 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f09cc012be0 tx=0x7f09cc04c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.176+0000 7f08a3fff640 1 -- 172.21.15.146:0/4224400297 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09cc012c90 con 0x55b856897f50 2024-09-18T01:45:24.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.177+0000 7f08a3fff640 1 -- 172.21.15.146:0/4224400297 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09cc013a60 con 0x55b856897f50 2024-09-18T01:45:24.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.177+0000 7f09d7436800 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b85689f9f0 con 0x55b856897f50 2024-09-18T01:45:24.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.177+0000 7f08a3fff640 1 -- 172.21.15.146:0/4224400297 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09cc013d80 con 0x55b856897f50 2024-09-18T01:45:24.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.177+0000 7f09d7436800 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8568a26a0 con 0x55b856897f50 2024-09-18T01:45:24.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.177+0000 7f08a3fff640 1 -- 172.21.15.146:0/4224400297 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f09cc02aa60 con 0x55b856897f50 2024-09-18T01:45:24.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.177+0000 7f08a3fff640 1 --2- 172.21.15.146:0/4224400297 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f089c036b90 0x7f089c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.178+0000 7f08a3fff640 1 -- 172.21.15.146:0/4224400297 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f09cc034070 con 0x55b856897f50 2024-09-18T01:45:24.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.178+0000 7f09d2752640 1 --2- 172.21.15.146:0/4224400297 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f089c036b90 0x7f089c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.178+0000 7f09d2752640 1 --2- 172.21.15.146:0/4224400297 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f089c036b90 0x7f089c039050 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x55b85687d9f0 tx=0x7f09c4094000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.178+0000 7f09d7436800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.178+0000 7f09d7436800 1 --2- 172.21.15.146:0/4224400297 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55b8568aaeb0 0x55b8568ad370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.178+0000 7f09d7436800 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b8568adac0 con 0x55b8568aaeb0 2024-09-18T01:45:24.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.178+0000 7f09cbfff640 1 --2- 172.21.15.146:0/4224400297 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55b8568aaeb0 0x55b8568ad370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.179+0000 7f09cbfff640 1 --2- 172.21.15.146:0/4224400297 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55b8568aaeb0 0x55b8568ad370 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.179+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f09bc009050 con 0x55b8568aaeb0 2024-09-18T01:45:24.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.179+0000 7f09d7436800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.179+0000 7f09d7436800 20 realm 2024-09-18T01:45:24.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.179+0000 7f09d7436800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.179+0000 7f09d7436800 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b8568aa300 con 0x55b8568aaeb0 2024-09-18T01:45:24.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.179+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f09bc009050 con 0x55b8568aaeb0 2024-09-18T01:45:24.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.179+0000 7f09d7436800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.179+0000 7f09d7436800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:24.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.179+0000 7f09d7436800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.179+0000 7f09d7436800 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b8568ae5b0 con 0x55b8568aaeb0 2024-09-18T01:45:24.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.179+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f09bc009050 con 0x55b8568aaeb0 2024-09-18T01:45:24.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.179+0000 7f09d7436800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.179+0000 7f09d7436800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.179+0000 7f09d7436800 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b8568aee80 con 0x55b8568aaeb0 2024-09-18T01:45:24.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.180+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f09bc009050 con 0x55b8568aaeb0 2024-09-18T01:45:24.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.180+0000 7f09d7436800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:24.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.180+0000 7f09d7436800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.180+0000 7f09d7436800 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b8568af220 con 0x55b8568aaeb0 2024-09-18T01:45:24.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.180+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f09bc009050 con 0x55b8568aaeb0 2024-09-18T01:45:24.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.180+0000 7f09d7436800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:24.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.180+0000 7f09d7436800 20 searching for the correct realm 2024-09-18T01:45:24.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.180+0000 7f09d7436800 1 --2- 172.21.15.146:0/4224400297 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55b8568b1100 0x55b8568b34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.180+0000 7f09d7436800 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b8568b3ba0 con 0x55b8568b1100 2024-09-18T01:45:24.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.180+0000 7f09d2f53640 1 --2- 172.21.15.146:0/4224400297 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55b8568b1100 0x55b8568b34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.180+0000 7f09d2f53640 1 --2- 172.21.15.146:0/4224400297 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55b8568b1100 0x55b8568b34f0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.180+0000 7f09d2f53640 1 -- 172.21.15.146:0/4224400297 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09cc03e020 con 0x55b8568b1100 2024-09-18T01:45:24.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.180+0000 7f09d2f53640 1 --2- 172.21.15.146:0/4224400297 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f09cc02b5a0 0x7f09cc0379b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.180+0000 7f09d2f53640 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b8568b3ba0 con 0x7f09cc02b5a0 2024-09-18T01:45:24.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.181+0000 7f09d2752640 1 --2- 172.21.15.146:0/4224400297 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f09cc02b5a0 0x7f09cc0379b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.181+0000 7f09d2752640 1 --2- 172.21.15.146:0/4224400297 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f09cc02b5a0 0x7f09cc0379b0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.181+0000 7f09d2752640 1 -- 172.21.15.146:0/4224400297 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09c409a040 con 0x7f09cc02b5a0 2024-09-18T01:45:24.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.181+0000 7f09d2752640 1 --2- 172.21.15.146:0/4224400297 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f09c407d060 0x7f09c40908c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.181+0000 7f09d2752640 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b8568b3ba0 con 0x7f09c407d060 2024-09-18T01:45:24.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.181+0000 7f09cbfff640 1 --2- 172.21.15.146:0/4224400297 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f09c407d060 0x7f09c40908c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.182+0000 7f09cbfff640 1 --2- 172.21.15.146:0/4224400297 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f09c407d060 0x7f09c40908c0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.182+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09bc009050 con 0x7f09c407d060 2024-09-18T01:45:24.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.182+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b8568b3ba0 con 0x55b8568aaeb0 2024-09-18T01:45:24.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.182+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f09bc009050 con 0x55b8568aaeb0 2024-09-18T01:45:24.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.182+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b8568b3ba0 con 0x55b8568aaeb0 2024-09-18T01:45:24.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.182+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09bc02a040 con 0x55b8568aaeb0 2024-09-18T01:45:24.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.182+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b8568b3ba0 con 0x7f09c407d060 2024-09-18T01:45:24.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.183+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09bc02a040 con 0x7f09c407d060 2024-09-18T01:45:24.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.183+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b8568b3ba0 con 0x7f09c407d060 2024-09-18T01:45:24.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.183+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09bc02a040 con 0x7f09c407d060 2024-09-18T01:45:24.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.183+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b8568b3ba0 con 0x7f09cc02b5a0 2024-09-18T01:45:24.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.183+0000 7f09d2752640 1 -- 172.21.15.146:0/4224400297 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09c409a040 con 0x7f09cc02b5a0 2024-09-18T01:45:24.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.183+0000 7f09d2752640 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b8568b3ba0 con 0x55b8568b1100 2024-09-18T01:45:24.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.183+0000 7f09d2f53640 1 -- 172.21.15.146:0/4224400297 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09cc03e020 con 0x55b8568b1100 2024-09-18T01:45:24.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.183+0000 7f09d2f53640 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b8568b3ba0 con 0x55b8568aaeb0 2024-09-18T01:45:24.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.183+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09bc02a040 con 0x55b8568aaeb0 2024-09-18T01:45:24.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.184+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b8568b3ba0 con 0x7f09c407d060 2024-09-18T01:45:24.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.184+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09bc02a040 con 0x7f09c407d060 2024-09-18T01:45:24.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.184+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b8568b3ba0 con 0x55b8568aaeb0 2024-09-18T01:45:24.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.184+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09bc02a040 con 0x55b8568aaeb0 2024-09-18T01:45:24.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.184+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b8568b3ba0 con 0x7f09cc02b5a0 2024-09-18T01:45:24.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.184+0000 7f09d2752640 1 -- 172.21.15.146:0/4224400297 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f09c409a040 con 0x7f09cc02b5a0 2024-09-18T01:45:24.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.184+0000 7f09d2752640 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b8568b3ba0 con 0x55b8568b1100 2024-09-18T01:45:24.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.184+0000 7f09d2f53640 1 -- 172.21.15.146:0/4224400297 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09cc03e020 con 0x55b8568b1100 2024-09-18T01:45:24.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.184+0000 7f09d2f53640 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b8568b3ba0 con 0x55b8568b1100 2024-09-18T01:45:24.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.185+0000 7f09d2f53640 1 -- 172.21.15.146:0/4224400297 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09cc03e020 con 0x55b8568b1100 2024-09-18T01:45:24.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.185+0000 7f09d2f53640 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b8568b3ba0 con 0x7f09c407d060 2024-09-18T01:45:24.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.185+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09bc02a040 con 0x7f09c407d060 2024-09-18T01:45:24.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.185+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b8568b3ba0 con 0x55b8568b1100 2024-09-18T01:45:24.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.185+0000 7f09d2f53640 1 -- 172.21.15.146:0/4224400297 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09cc03e020 con 0x55b8568b1100 2024-09-18T01:45:24.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.186+0000 7f09d2f53640 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b8568b3ba0 con 0x55b8568b1100 2024-09-18T01:45:24.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.186+0000 7f09d2f53640 1 -- 172.21.15.146:0/4224400297 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09cc03e020 con 0x55b8568b1100 2024-09-18T01:45:24.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.186+0000 7f09d2f53640 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b8568b3ba0 con 0x55b8568aaeb0 2024-09-18T01:45:24.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.186+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09bc02a040 con 0x55b8568aaeb0 2024-09-18T01:45:24.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.186+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b8568b3ba0 con 0x55b8568aaeb0 2024-09-18T01:45:24.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.186+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f09bc02a040 con 0x55b8568aaeb0 2024-09-18T01:45:24.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.186+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b8568b3ba0 con 0x7f09c407d060 2024-09-18T01:45:24.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.186+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09bc02a040 con 0x7f09c407d060 2024-09-18T01:45:24.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.186+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b8568b3ba0 con 0x55b8568b1100 2024-09-18T01:45:24.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.187+0000 7f09d2f53640 1 -- 172.21.15.146:0/4224400297 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09cc03e020 con 0x55b8568b1100 2024-09-18T01:45:24.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.187+0000 7f09d2f53640 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b8568b3ba0 con 0x7f09cc02b5a0 2024-09-18T01:45:24.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.187+0000 7f09d2752640 1 -- 172.21.15.146:0/4224400297 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09c409a040 con 0x7f09cc02b5a0 2024-09-18T01:45:24.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.187+0000 7f09d2752640 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b8568b3ba0 con 0x55b8568aaeb0 2024-09-18T01:45:24.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.187+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09bc02a040 con 0x55b8568aaeb0 2024-09-18T01:45:24.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.187+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b8568b3ba0 con 0x7f09c407d060 2024-09-18T01:45:24.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.188+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09bc02a040 con 0x7f09c407d060 2024-09-18T01:45:24.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.188+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b8568b3ba0 con 0x55b8568b1100 2024-09-18T01:45:24.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.188+0000 7f09d2f53640 1 -- 172.21.15.146:0/4224400297 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09cc03e020 con 0x55b8568b1100 2024-09-18T01:45:24.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.188+0000 7f09d2f53640 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b8568b3ba0 con 0x7f09c407d060 2024-09-18T01:45:24.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.188+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09bc02a040 con 0x7f09c407d060 2024-09-18T01:45:24.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.188+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b8568b3ba0 con 0x7f09cc02b5a0 2024-09-18T01:45:24.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.188+0000 7f09d2752640 1 -- 172.21.15.146:0/4224400297 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09c409a040 con 0x7f09cc02b5a0 2024-09-18T01:45:24.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.188+0000 7f09d2752640 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b8568b3ba0 con 0x55b8568b1100 2024-09-18T01:45:24.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.189+0000 7f09d2f53640 1 -- 172.21.15.146:0/4224400297 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09cc03e020 con 0x55b8568b1100 2024-09-18T01:45:24.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.189+0000 7f09d2f53640 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b8568b3ba0 con 0x7f09c407d060 2024-09-18T01:45:24.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.189+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09bc02a040 con 0x7f09c407d060 2024-09-18T01:45:24.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.189+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b8568b3ba0 con 0x55b8568aaeb0 2024-09-18T01:45:24.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.189+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f09bc02a040 con 0x55b8568aaeb0 2024-09-18T01:45:24.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.189+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b8568b3ba0 con 0x7f09cc02b5a0 2024-09-18T01:45:24.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.189+0000 7f09d2752640 1 -- 172.21.15.146:0/4224400297 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09c40b1040 con 0x7f09cc02b5a0 2024-09-18T01:45:24.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.189+0000 7f09d7436800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:24.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.189+0000 7f09d7436800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:24.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.189+0000 7f09d7436800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:24.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.189+0000 7f09d7436800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:24.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.189+0000 7f09d7436800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:24.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.189+0000 7f09d7436800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:24.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.189+0000 7f09d7436800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.189+0000 7f09d7436800 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b8568afbd0 con 0x55b8568aaeb0 2024-09-18T01:45:24.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.190+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f09bc02a040 con 0x55b8568aaeb0 2024-09-18T01:45:24.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.190+0000 7f09d7436800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.190+0000 7f09d7436800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.190+0000 7f09d7436800 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b8568b0470 con 0x55b8568aaeb0 2024-09-18T01:45:24.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.190+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f09bc02a040 con 0x55b8568aaeb0 2024-09-18T01:45:24.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.190+0000 7f09d7436800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:24.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.190+0000 7f09d7436800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.190+0000 7f09d7436800 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b8568b4020 con 0x7f09cc02b5a0 2024-09-18T01:45:24.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.190+0000 7f09d2752640 1 -- 172.21.15.146:0/4224400297 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f09c40b1040 con 0x7f09cc02b5a0 2024-09-18T01:45:24.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.190+0000 7f09d7436800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:24.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.190+0000 7f09d7436800 20 zone default found 2024-09-18T01:45:24.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.190+0000 7f09d7436800 4 Realm: () 2024-09-18T01:45:24.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.190+0000 7f09d7436800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:24.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.190+0000 7f09d7436800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:24.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.190+0000 7f09d7436800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:24.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.190+0000 7f09d7436800 20 zonegroup default 2024-09-18T01:45:24.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.190+0000 7f09d7436800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.190+0000 7f09d7436800 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b8568b4870 con 0x7f09c407d060 2024-09-18T01:45:24.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.191+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f09bc02a040 con 0x7f09c407d060 2024-09-18T01:45:24.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.191+0000 7f09d7436800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.191+0000 7f09d7436800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.191+0000 7f09d7436800 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b8568b62e0 con 0x55b8568b1100 2024-09-18T01:45:24.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.191+0000 7f09d2f53640 1 -- 172.21.15.146:0/4224400297 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f09cc03e020 con 0x55b8568b1100 2024-09-18T01:45:24.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.192+0000 7f09d7436800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.192+0000 7f09d7436800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.192+0000 7f09d7436800 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b8568b6850 con 0x55b8568b1100 2024-09-18T01:45:24.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.192+0000 7f09d2f53640 1 -- 172.21.15.146:0/4224400297 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f09cc03e020 con 0x55b8568b1100 2024-09-18T01:45:24.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.192+0000 7f09d7436800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.192+0000 7f09d7436800 20 started sync module instance, tier type = 2024-09-18T01:45:24.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.192+0000 7f09d7436800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:24.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.192+0000 7f09d7436800 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b8568b5690 con 0x7f09cc02b5a0 2024-09-18T01:45:24.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.193+0000 7f09d2752640 1 -- 172.21.15.146:0/4224400297 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v31'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09c40b1040 con 0x7f09cc02b5a0 2024-09-18T01:45:24.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.193+0000 7f09d7436800 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94250214314464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b8568b6cb0 con 0x7f09cc02b5a0 2024-09-18T01:45:24.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.193+0000 7f09d7436800 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b8568b7500 con 0x55b8568aaeb0 2024-09-18T01:45:24.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.194+0000 7f09d2752640 1 -- 172.21.15.146:0/4224400297 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94250214314464] v31'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09c40b1040 con 0x7f09cc02b5a0 2024-09-18T01:45:24.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.194+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v31'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09bc02a040 con 0x55b8568aaeb0 2024-09-18T01:45:24.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.194+0000 7f09d7436800 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94250214322256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b8568b7920 con 0x55b8568aaeb0 2024-09-18T01:45:24.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.194+0000 7f09d7436800 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b8568b81b0 con 0x55b8568b1100 2024-09-18T01:45:24.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.196+0000 7f09d2f53640 1 -- 172.21.15.146:0/4224400297 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v31'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09cc03e020 con 0x55b8568b1100 2024-09-18T01:45:24.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.196+0000 7f09d7436800 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94250214324512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b8568b7dc0 con 0x55b8568b1100 2024-09-18T01:45:24.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.196+0000 7f09d7436800 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b8568b9180 con 0x7f09cc02b5a0 2024-09-18T01:45:24.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.196+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94250214322256] v31'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09bc02a040 con 0x55b8568aaeb0 2024-09-18T01:45:24.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.197+0000 7f09d2752640 1 -- 172.21.15.146:0/4224400297 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v31'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09c40b1040 con 0x7f09cc02b5a0 2024-09-18T01:45:24.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.197+0000 7f09d2f53640 1 -- 172.21.15.146:0/4224400297 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94250214324512] v31'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09cc03e020 con 0x55b8568b1100 2024-09-18T01:45:24.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.197+0000 7f09d7436800 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94250214329456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b8568b7470 con 0x7f09cc02b5a0 2024-09-18T01:45:24.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.197+0000 7f09d7436800 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b8568b9a20 con 0x55b8568aaeb0 2024-09-18T01:45:24.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.198+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v31'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09bc02a040 con 0x55b8568aaeb0 2024-09-18T01:45:24.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.198+0000 7f09d7436800 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94250214331760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b8568b99d0 con 0x55b8568aaeb0 2024-09-18T01:45:24.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.198+0000 7f09d7436800 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b8568ba9e0 con 0x7f09c407d060 2024-09-18T01:45:24.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.198+0000 7f09d2752640 1 -- 172.21.15.146:0/4224400297 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94250214329456] v31'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09c40b1040 con 0x7f09cc02b5a0 2024-09-18T01:45:24.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.198+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94250214331760] v31'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09bc02a040 con 0x55b8568aaeb0 2024-09-18T01:45:24.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.199+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v31'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09bc02a040 con 0x7f09c407d060 2024-09-18T01:45:24.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.199+0000 7f09d7436800 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94250214335632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b8568ba9a0 con 0x7f09c407d060 2024-09-18T01:45:24.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.199+0000 7f09d7436800 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b8568b9f30 con 0x7f09c407d060 2024-09-18T01:45:24.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.200+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94250214335632] v31'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09bc02a040 con 0x7f09c407d060 2024-09-18T01:45:24.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.200+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v31'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09bc02a040 con 0x7f09c407d060 2024-09-18T01:45:24.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.200+0000 7f09d7436800 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94250214327712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b8568b9f30 con 0x7f09c407d060 2024-09-18T01:45:24.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.200+0000 7f09d7436800 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b8568bb850 con 0x7f09c407d060 2024-09-18T01:45:24.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.201+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94250214327712] v31'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09bc02a040 con 0x7f09c407d060 2024-09-18T01:45:24.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.201+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v31'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09bc02a040 con 0x7f09c407d060 2024-09-18T01:45:24.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.201+0000 7f09d7436800 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94250214337920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b8568bb850 con 0x7f09c407d060 2024-09-18T01:45:24.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.201+0000 7f09d7436800 20 add_watcher() i=0 2024-09-18T01:45:24.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.201+0000 7f09d7436800 20 add_watcher() i=1 2024-09-18T01:45:24.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.201+0000 7f09d7436800 20 add_watcher() i=2 2024-09-18T01:45:24.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.201+0000 7f09d7436800 20 add_watcher() i=3 2024-09-18T01:45:24.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.201+0000 7f09d7436800 20 add_watcher() i=4 2024-09-18T01:45:24.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.201+0000 7f09d7436800 20 add_watcher() i=5 2024-09-18T01:45:24.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.201+0000 7f09d7436800 20 add_watcher() i=6 2024-09-18T01:45:24.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.202+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94250214337920] v31'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09bc02a040 con 0x7f09c407d060 2024-09-18T01:45:24.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.202+0000 7f09d7436800 20 add_watcher() i=7 2024-09-18T01:45:24.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.202+0000 7f09d7436800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:24.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.202+0000 7f09d7436800 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b8568bec80 con 0x55b8568aaeb0 2024-09-18T01:45:24.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.202+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f09bc02a040 con 0x55b8568aaeb0 2024-09-18T01:45:24.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.202+0000 7f09d7436800 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94250214339952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b8568bc1d0 con 0x55b8568aaeb0 2024-09-18T01:45:24.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.203+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94250214339952] v31'74 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f09bc02a040 con 0x55b8568aaeb0 2024-09-18T01:45:24.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.203+0000 7f0888fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:24.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.203+0000 7f09d7436800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:24.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.203+0000 7f09d7436800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:24.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.203+0000 7f09d7436800 5 note: GC not initialized 2024-09-18T01:45:24.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.203+0000 7f08037fe640 20 reqs_thread_entry: start 2024-09-18T01:45:24.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.204+0000 7f09d7436800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:24.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.204+0000 7f09d7436800 20 Filter name: none 2024-09-18T01:45:24.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.204+0000 7f08017fa640 20 reqs_thread_entry: start 2024-09-18T01:45:24.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.204+0000 7f09d7436800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T01:45:24.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.204+0000 7f09d7436800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.204+0000 7f09d7436800 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b8568f2140 con 0x55b8568aaeb0 2024-09-18T01:45:24.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.204+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f09bc02a040 con 0x55b8568aaeb0 2024-09-18T01:45:24.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.204+0000 7f09d7436800 20 rados_obj.operate() r=0 bl.length=502 2024-09-18T01:45:24.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.204+0000 7f09d7436800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T01:45:24.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.204+0000 7f09d7436800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:45:24.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.204+0000 7f09d7436800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:45:24.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.204+0000 7f09d7436800 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b8568f88b0 con 0x55b8568aaeb0 2024-09-18T01:45:24.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.205+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v31'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f09bc02a040 con 0x55b8568aaeb0 2024-09-18T01:45:24.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.205+0000 7f09d7436800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:45:24.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.205+0000 7f09d7436800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:45:24.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.205+0000 7f09d7436800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-18T01:45:24.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.205+0000 7f09d7436800 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94250214589040 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b8568f3ed0 con 0x55b8568aaeb0 2024-09-18T01:45:24.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.206+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== watch-notify(notify (1) cookie 94250214331760 notify 133143986180 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55b856636b30 con 0x55b8568aaeb0 2024-09-18T01:45:24.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.206+0000 7f08b5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986180 cookie 94250214331760 notifier 4362 bl.length()=567 2024-09-18T01:45:24.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.206+0000 7f08b5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:45:24.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.206+0000 7f08b5ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:45:24.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.206+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(64 notify.4 [notify cookie 94250214589040 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f09bc02a040 con 0x55b8568aaeb0 2024-09-18T01:45:24.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.206+0000 7f08b5ffb640 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f0898003ea0 con 0x55b8568aaeb0 2024-09-18T01:45:24.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.206+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09bc02a040 con 0x55b8568aaeb0 2024-09-18T01:45:24.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.206+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== watch-notify(notify_complete (2) cookie 94250214589040 notify 133143986180 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f09bc02eac0 con 0x55b8568aaeb0 2024-09-18T01:45:24.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.206+0000 7f09d7436800 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:66 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b8568f8270 con 0x7f09c407d060 2024-09-18T01:45:24.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.207+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(66 p5YnriCv1nAtykxBrupQ [delete] v31'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f09bc02a040 con 0x7f09c407d060 2024-09-18T01:45:24.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.207+0000 7f09d7436800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-18T01:45:24.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.207+0000 7f09d7436800 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 94250214589040 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b8568f3a20 con 0x55b8568b1100 2024-09-18T01:45:24.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.208+0000 7f09d2f53640 1 -- 172.21.15.146:0/4224400297 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== watch-notify(notify (1) cookie 94250214324512 notify 133143986177 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55b8568a26a0 con 0x55b8568b1100 2024-09-18T01:45:24.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.208+0000 7f08b57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986177 cookie 94250214324512 notifier 4362 bl.length()=170 2024-09-18T01:45:24.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.208+0000 7f08b57fa640 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f08080032c0 con 0x55b8568b1100 2024-09-18T01:45:24.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.208+0000 7f09d2f53640 1 -- 172.21.15.146:0/4224400297 <== osd.3 v2:172.21.15.146:6809/4106661138 15 ==== osd_op_reply(67 notify.2 [notify cookie 94250214589040 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f09cc03e020 con 0x55b8568b1100 2024-09-18T01:45:24.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.208+0000 7f09d2f53640 1 -- 172.21.15.146:0/4224400297 <== osd.3 v2:172.21.15.146:6809/4106661138 16 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09cc03e020 con 0x55b8568b1100 2024-09-18T01:45:24.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.208+0000 7f09d2f53640 1 -- 172.21.15.146:0/4224400297 <== osd.3 v2:172.21.15.146:6809/4106661138 17 ==== watch-notify(notify_complete (2) cookie 94250214589040 notify 133143986177 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b85689f9f0 con 0x55b8568b1100 2024-09-18T01:45:24.220 INFO:teuthology.orchestra.run.smithi146.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T01:45:23.010714Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:45:23.010705Z","tags":[],"group_ids":[]} 2024-09-18T01:45:24.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.209+0000 7f0888fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:24.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.209+0000 7f09d7436800 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94250214339952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b8568efe40 con 0x55b8568aaeb0 2024-09-18T01:45:24.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.210+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 <== osd.1 v2:172.21.15.146:6808/3930274777 28 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94250214339952] v31'75 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f09bc02a040 con 0x55b8568aaeb0 2024-09-18T01:45:24.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.210+0000 7f09d7436800 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94250214314464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b8568efe40 con 0x7f09cc02b5a0 2024-09-18T01:45:24.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.211+0000 7f09d2752640 1 -- 172.21.15.146:0/4224400297 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94250214314464] v31'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09c40b1040 con 0x7f09cc02b5a0 2024-09-18T01:45:24.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.211+0000 7f09d7436800 20 remove_watcher() i=0 2024-09-18T01:45:24.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.211+0000 7f09d7436800 2 removed watcher, disabling cache 2024-09-18T01:45:24.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.211+0000 7f09d7436800 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94250214322256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b8568efe40 con 0x55b8568aaeb0 2024-09-18T01:45:24.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.212+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 <== osd.1 v2:172.21.15.146:6808/3930274777 29 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94250214322256] v31'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09bc02a040 con 0x55b8568aaeb0 2024-09-18T01:45:24.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.212+0000 7f09d7436800 20 remove_watcher() i=1 2024-09-18T01:45:24.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.212+0000 7f09d7436800 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94250214324512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b8568efe40 con 0x55b8568b1100 2024-09-18T01:45:24.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.213+0000 7f09d2f53640 1 -- 172.21.15.146:0/4224400297 <== osd.3 v2:172.21.15.146:6809/4106661138 18 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94250214324512] v31'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09cc03e020 con 0x55b8568b1100 2024-09-18T01:45:24.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.213+0000 7f09d7436800 20 remove_watcher() i=2 2024-09-18T01:45:24.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.213+0000 7f09d7436800 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94250214329456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b8568efe40 con 0x7f09cc02b5a0 2024-09-18T01:45:24.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.214+0000 7f09d2752640 1 -- 172.21.15.146:0/4224400297 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94250214329456] v31'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09c40b1040 con 0x7f09cc02b5a0 2024-09-18T01:45:24.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.214+0000 7f09d7436800 20 remove_watcher() i=3 2024-09-18T01:45:24.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.214+0000 7f09d7436800 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94250214331760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b8568efe40 con 0x55b8568aaeb0 2024-09-18T01:45:24.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.215+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 <== osd.1 v2:172.21.15.146:6808/3930274777 30 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94250214331760] v31'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09bc02a040 con 0x55b8568aaeb0 2024-09-18T01:45:24.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.215+0000 7f09d7436800 20 remove_watcher() i=4 2024-09-18T01:45:24.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.215+0000 7f09d7436800 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94250214335632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b8568efe40 con 0x7f09c407d060 2024-09-18T01:45:24.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.216+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94250214335632] v31'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09bc02a040 con 0x7f09c407d060 2024-09-18T01:45:24.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.216+0000 7f09d7436800 20 remove_watcher() i=5 2024-09-18T01:45:24.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.216+0000 7f09d7436800 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94250214327712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b8568efe40 con 0x7f09c407d060 2024-09-18T01:45:24.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.217+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94250214327712] v31'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09bc02a040 con 0x7f09c407d060 2024-09-18T01:45:24.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.217+0000 7f09d7436800 20 remove_watcher() i=6 2024-09-18T01:45:24.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.217+0000 7f09d7436800 1 -- 172.21.15.146:0/4224400297 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94250214337920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b8568efe40 con 0x7f09c407d060 2024-09-18T01:45:24.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.218+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94250214337920] v31'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09bc02a040 con 0x7f09c407d060 2024-09-18T01:45:24.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.218+0000 7f09d7436800 20 remove_watcher() i=7 2024-09-18T01:45:24.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.218+0000 7f09d7436800 1 -- 172.21.15.146:0/4224400297 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f09c407d060 msgr2=0x7f09c40908c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.218+0000 7f09d7436800 1 --2- 172.21.15.146:0/4224400297 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f09c407d060 0x7f09c40908c0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.218+0000 7f09d7436800 1 -- 172.21.15.146:0/4224400297 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55b8568aaeb0 msgr2=0x55b8568ad370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.218+0000 7f09d7436800 1 --2- 172.21.15.146:0/4224400297 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55b8568aaeb0 0x55b8568ad370 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.218+0000 7f09d7436800 1 -- 172.21.15.146:0/4224400297 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f09cc02b5a0 msgr2=0x7f09cc0379b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.218+0000 7f09d7436800 1 --2- 172.21.15.146:0/4224400297 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f09cc02b5a0 0x7f09cc0379b0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.218+0000 7f09d7436800 1 -- 172.21.15.146:0/4224400297 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55b8568b1100 msgr2=0x55b8568b34f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.218+0000 7f09d7436800 1 --2- 172.21.15.146:0/4224400297 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55b8568b1100 0x55b8568b34f0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.218+0000 7f09d7436800 1 -- 172.21.15.146:0/4224400297 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f089c036b90 msgr2=0x7f089c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.218+0000 7f09d7436800 1 --2- 172.21.15.146:0/4224400297 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f089c036b90 0x7f089c039050 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x55b85687d9f0 tx=0x7f09c4094000 comp rx=0 tx=0).stop 2024-09-18T01:45:24.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.218+0000 7f09d7436800 1 -- 172.21.15.146:0/4224400297 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b856897f50 msgr2=0x55b85689f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.218+0000 7f09cbfff640 1 -- 172.21.15.146:0/4224400297 reap_dead start 2024-09-18T01:45:24.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.218+0000 7f09d7436800 1 --2- 172.21.15.146:0/4224400297 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b856897f50 0x55b85689f220 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f09cc012be0 tx=0x7f09cc04c7e0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.218+0000 7f09d7436800 1 -- 172.21.15.146:0/4224400297 shutdown_connections 2024-09-18T01:45:24.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.218+0000 7f09d7436800 1 --2- 172.21.15.146:0/4224400297 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b856897f50 0x55b85689f220 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.218+0000 7f09d7436800 1 -- 172.21.15.146:0/4224400297 >> 172.21.15.146:0/4224400297 conn(0x55b856894300 msgr2=0x55b8568923d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:24.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.218+0000 7f09d7436800 1 -- 172.21.15.146:0/4224400297 shutdown_connections 2024-09-18T01:45:24.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.218+0000 7f09d7436800 1 -- 172.21.15.146:0/4224400297 wait complete. 2024-09-18T01:45:24.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.219+0000 7f09d7436800 1 -- 172.21.15.146:0/795623368 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f08ac036be0 msgr2=0x7f08ac0390a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.219+0000 7f09d7436800 1 --2- 172.21.15.146:0/795623368 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f08ac036be0 0x7f08ac0390a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f09c4090010 tx=0x7f09c408ec10 comp rx=0 tx=0).stop 2024-09-18T01:45:24.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.219+0000 7f09d7436800 1 -- 172.21.15.146:0/795623368 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b85688b2e0 msgr2=0x55b85688b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.219+0000 7f09d7436800 1 --2- 172.21.15.146:0/795623368 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b85688b2e0 0x55b85688b700 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x55b856777f60 tx=0x7f09cc0178e0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.219+0000 7f09d7436800 1 -- 172.21.15.146:0/795623368 shutdown_connections 2024-09-18T01:45:24.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.219+0000 7f09d7436800 1 --2- 172.21.15.146:0/795623368 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f08ac036be0 0x7f08ac0390a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.219+0000 7f09d7436800 1 --2- 172.21.15.146:0/795623368 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b85688b2e0 0x55b85688b700 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.219+0000 7f09d7436800 1 -- 172.21.15.146:0/795623368 >> 172.21.15.146:0/795623368 conn(0x55b856880270 msgr2=0x55b856882df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:24.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.219+0000 7f09d7436800 1 -- 172.21.15.146:0/795623368 shutdown_connections 2024-09-18T01:45:24.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.219+0000 7f09d7436800 1 -- 172.21.15.146:0/795623368 wait complete. 2024-09-18T01:45:24.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.219+0000 7f09d7436800 1 -- 172.21.15.146:0/3141732762 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55b856776380 msgr2=0x55b856877610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.219+0000 7f09d7436800 1 --2- 172.21.15.146:0/3141732762 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55b856776380 0x55b856877610 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.219+0000 7f09d7436800 1 -- 172.21.15.146:0/3141732762 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55b85687aca0 msgr2=0x55b85687d090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.219+0000 7f09d7436800 1 --2- 172.21.15.146:0/3141732762 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55b85687aca0 0x55b85687d090 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.219+0000 7f09d7436800 1 -- 172.21.15.146:0/3141732762 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f08b8036b40 msgr2=0x7f08b8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.219+0000 7f09d7436800 1 --2- 172.21.15.146:0/3141732762 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f08b8036b40 0x7f08b8039000 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f09bc000f60 tx=0x7f09bc0012b0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.219+0000 7f09d7436800 1 -- 172.21.15.146:0/3141732762 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b856775a40 msgr2=0x55b856778400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.219+0000 7f09d7436800 1 --2- 172.21.15.146:0/3141732762 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b856775a40 0x55b856778400 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x55b856867740 tx=0x7f09c4002fb0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.219+0000 7f09d7436800 1 -- 172.21.15.146:0/3141732762 shutdown_connections 2024-09-18T01:45:24.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.219+0000 7f09d7436800 1 --2- 172.21.15.146:0/3141732762 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55b85687aca0 0x55b85687d090 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.219+0000 7f09d7436800 1 --2- 172.21.15.146:0/3141732762 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55b856776380 0x55b856877610 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.219+0000 7f09d7436800 1 --2- 172.21.15.146:0/3141732762 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f08b8036b40 0x7f08b8039000 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.219+0000 7f09d7436800 1 --2- 172.21.15.146:0/3141732762 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b856775a40 0x55b856778400 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.219+0000 7f09d7436800 1 -- 172.21.15.146:0/3141732762 >> 172.21.15.146:0/3141732762 conn(0x55b856771550 msgr2=0x55b856860b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:24.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.219+0000 7f09d7436800 1 -- 172.21.15.146:0/3141732762 shutdown_connections 2024-09-18T01:45:24.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.219+0000 7f09d7436800 1 -- 172.21.15.146:0/3141732762 wait complete. 2024-09-18T01:45:24.231 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T01:45:23.010714Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:45:23.010705Z', 'tags': [], 'group_ids': []} 2024-09-18T01:45:24.231 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-18T01:45:24.231 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-18T01:45:24.231 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo1 --access full 2024-09-18T01:45:24.278 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:24.278 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:24.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.278+0000 7fc4f8a40800 1 Processor -- start 2024-09-18T01:45:24.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.278+0000 7fc4f8a40800 1 -- start start 2024-09-18T01:45:24.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.278+0000 7fc4f8a40800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55db42a5c4e0 0x55db42a5c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.278+0000 7fc4f8a40800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55db4291cb30 con 0x55db42a5ce20 2024-09-18T01:45:24.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.278+0000 7fc4f8a40800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x55db428fe360 con 0x55db42a5c4e0 2024-09-18T01:45:24.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.278+0000 7fc4f6534640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55db42a5c4e0 0x55db42a5c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.278+0000 7fc4f6534640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55db42a5c4e0 0x55db42a5c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59964/0 (socket says 172.21.15.146:59964) 2024-09-18T01:45:24.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.278+0000 7fc4f5d33640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x55db42a5ce20 0x55db42a619a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:38792/0 (socket says 172.21.15.146:38792) 2024-09-18T01:45:24.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.278+0000 7fc4f6534640 1 -- 172.21.15.146:0/3828872088 learned_addr learned my addr 172.21.15.146:0/3828872088 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:24.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.278+0000 7fc4f6534640 1 -- 172.21.15.146:0/3828872088 >> v1:172.21.15.129:6789/0 conn(0x55db42a5ce20 legacy=0x55db42a619a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.279+0000 7fc4f5532640 1 -- 172.21.15.146:0/3828872088 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 474708438 0 0) 0x55db4291cb30 con 0x55db42a5ce20 2024-09-18T01:45:24.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.279+0000 7fc4f6534640 1 -- 172.21.15.146:0/3828872088 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db42924e00 con 0x55db42a5c4e0 2024-09-18T01:45:24.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.280+0000 7fc4f6534640 1 --2- 172.21.15.146:0/3828872088 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db42a5c4e0 0x55db42a5c8e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc4f0005fd0 tx=0x7fc4f0045cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c37afe1b71989dce server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.280+0000 7fc4f5532640 1 -- 172.21.15.146:0/3828872088 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4f004e600 con 0x55db42a5c4e0 2024-09-18T01:45:24.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.280+0000 7fc4f5532640 1 -- 172.21.15.146:0/3828872088 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4f004e7a0 con 0x55db42a5c4e0 2024-09-18T01:45:24.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.281+0000 7fc4f5532640 1 -- 172.21.15.146:0/3828872088 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4f004eaa0 con 0x55db42a5c4e0 2024-09-18T01:45:24.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.281+0000 7fc4f8a40800 1 -- 172.21.15.146:0/3828872088 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db42a5c4e0 msgr2=0x55db42a5c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.281+0000 7fc4f8a40800 1 --2- 172.21.15.146:0/3828872088 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db42a5c4e0 0x55db42a5c8e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc4f0005fd0 tx=0x7fc4f0045cf0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.281+0000 7fc4f8a40800 1 -- 172.21.15.146:0/3828872088 shutdown_connections 2024-09-18T01:45:24.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.281+0000 7fc4f8a40800 1 --2- 172.21.15.146:0/3828872088 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db42a5c4e0 0x55db42a5c8e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.281+0000 7fc4f8a40800 1 -- 172.21.15.146:0/3828872088 >> 172.21.15.146:0/3828872088 conn(0x55db42a57db0 msgr2=0x55db42a5a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:24.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.281+0000 7fc4f8a40800 1 -- 172.21.15.146:0/3828872088 shutdown_connections 2024-09-18T01:45:24.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.281+0000 7fc4f8a40800 1 -- 172.21.15.146:0/3828872088 wait complete. 2024-09-18T01:45:24.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.296+0000 7fc4f8a40800 1 Processor -- start 2024-09-18T01:45:24.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.296+0000 7fc4f8a40800 1 -- start start 2024-09-18T01:45:24.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.297+0000 7fc4f8a40800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db42a5c4e0 0x55db429d15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.297+0000 7fc4f8a40800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55db429a9360 con 0x55db42a5c4e0 2024-09-18T01:45:24.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.297+0000 7fc4f6534640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db42a5c4e0 0x55db429d15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.297+0000 7fc4f6534640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db42a5c4e0 0x55db429d15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59976/0 (socket says 172.21.15.146:59976) 2024-09-18T01:45:24.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.297+0000 7fc4f6534640 1 -- 172.21.15.146:0/1141861419 learned_addr learned my addr 172.21.15.146:0/1141861419 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:24.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.297+0000 7fc4f6534640 1 -- 172.21.15.146:0/1141861419 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db428f6bc0 con 0x55db42a5c4e0 2024-09-18T01:45:24.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.297+0000 7fc4f6534640 1 --2- 172.21.15.146:0/1141861419 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db42a5c4e0 0x55db429d15c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc4f000a4b0 tx=0x7fc4f0050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de4bafc4fcd61274 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.297+0000 7fc3e4608640 1 -- 172.21.15.146:0/1141861419 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4f004ea80 con 0x55db42a5c4e0 2024-09-18T01:45:24.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.298+0000 7fc3e4608640 1 -- 172.21.15.146:0/1141861419 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4f0066070 con 0x55db42a5c4e0 2024-09-18T01:45:24.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.298+0000 7fc3e4608640 1 -- 172.21.15.146:0/1141861419 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4f004edc0 con 0x55db42a5c4e0 2024-09-18T01:45:24.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.298+0000 7fc4f8a40800 1 -- 172.21.15.146:0/1141861419 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db42a5c4e0 msgr2=0x55db429d15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.298+0000 7fc4f8a40800 1 --2- 172.21.15.146:0/1141861419 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db42a5c4e0 0x55db429d15c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc4f000a4b0 tx=0x7fc4f0050000 comp rx=0 tx=0).stop 2024-09-18T01:45:24.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.298+0000 7fc4f8a40800 1 -- 172.21.15.146:0/1141861419 shutdown_connections 2024-09-18T01:45:24.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.298+0000 7fc4f8a40800 1 --2- 172.21.15.146:0/1141861419 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db42a5c4e0 0x55db429d15c0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.298+0000 7fc4f8a40800 1 -- 172.21.15.146:0/1141861419 >> 172.21.15.146:0/1141861419 conn(0x55db42a57db0 msgr2=0x55db42b46f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:24.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.298+0000 7fc4f8a40800 1 -- 172.21.15.146:0/1141861419 shutdown_connections 2024-09-18T01:45:24.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.298+0000 7fc4f8a40800 1 -- 172.21.15.146:0/1141861419 wait complete. 2024-09-18T01:45:24.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.299+0000 7fc4f8a40800 1 Processor -- start 2024-09-18T01:45:24.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.299+0000 7fc4f8a40800 1 -- start start 2024-09-18T01:45:24.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.299+0000 7fc4f8a40800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db42a5c4e0 0x55db42b53f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.299+0000 7fc4f8a40800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55db42a63500 con 0x55db42a5c4e0 2024-09-18T01:45:24.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.299+0000 7fc4f6534640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db42a5c4e0 0x55db42b53f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.299+0000 7fc4f6534640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db42a5c4e0 0x55db42b53f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59988/0 (socket says 172.21.15.146:59988) 2024-09-18T01:45:24.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.299+0000 7fc4f6534640 1 -- 172.21.15.146:0/1098579643 learned_addr learned my addr 172.21.15.146:0/1098579643 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:24.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.299+0000 7fc4f6534640 1 -- 172.21.15.146:0/1098579643 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db4290afe0 con 0x55db42a5c4e0 2024-09-18T01:45:24.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.299+0000 7fc4f6534640 1 --2- 172.21.15.146:0/1098579643 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db42a5c4e0 0x55db42b53f00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc4f0063040 tx=0x7fc4f0003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.300+0000 7fc3e2e05640 1 -- 172.21.15.146:0/1098579643 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4f0076470 con 0x55db42a5c4e0 2024-09-18T01:45:24.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.300+0000 7fc3e2e05640 1 -- 172.21.15.146:0/1098579643 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4f0071070 con 0x55db42a5c4e0 2024-09-18T01:45:24.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.300+0000 7fc4f8a40800 1 -- 172.21.15.146:0/1098579643 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55db42b54440 con 0x55db42a5c4e0 2024-09-18T01:45:24.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.300+0000 7fc3e2e05640 1 -- 172.21.15.146:0/1098579643 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4f0076740 con 0x55db42a5c4e0 2024-09-18T01:45:24.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.300+0000 7fc4f8a40800 1 -- 172.21.15.146:0/1098579643 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db42b54960 con 0x55db42a5c4e0 2024-09-18T01:45:24.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.300+0000 7fc3e2e05640 1 -- 172.21.15.146:0/1098579643 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc4f006d420 con 0x55db42a5c4e0 2024-09-18T01:45:24.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.300+0000 7fc3e2e05640 1 --2- 172.21.15.146:0/1098579643 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc3dc036b40 0x7fc3dc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.301+0000 7fc3e2e05640 1 -- 172.21.15.146:0/1098579643 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fc4f0091660 con 0x55db42a5c4e0 2024-09-18T01:45:24.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.301+0000 7fc4f5d33640 1 --2- 172.21.15.146:0/1098579643 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc3dc036b40 0x7fc3dc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.301+0000 7fc4f8a40800 1 --2- 172.21.15.146:0/1098579643 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55db42a5ce20 0x55db42b5af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.301+0000 7fc4f8a40800 1 -- 172.21.15.146:0/1098579643 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55db42b5b540 con 0x55db42a5ce20 2024-09-18T01:45:24.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.301+0000 7fc4f6d35640 1 --2- 172.21.15.146:0/1098579643 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55db42a5ce20 0x55db42b5af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.301+0000 7fc4f6d35640 1 --2- 172.21.15.146:0/1098579643 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55db42a5ce20 0x55db42b5af70 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.301+0000 7fc4f5d33640 1 --2- 172.21.15.146:0/1098579643 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc3dc036b40 0x7fc3dc039000 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc4e0000c00 tx=0x7fc4e00013b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.301+0000 7fc4f6d35640 1 -- 172.21.15.146:0/1098579643 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4e80083e0 con 0x55db42a5ce20 2024-09-18T01:45:24.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.301+0000 7fc4f8a40800 1 -- 172.21.15.146:0/1098579643 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55db42b58500 con 0x55db42a5ce20 2024-09-18T01:45:24.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.302+0000 7fc4f6d35640 1 -- 172.21.15.146:0/1098579643 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc4e80083e0 con 0x55db42a5ce20 2024-09-18T01:45:24.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.302+0000 7fc4f8a40800 1 -- 172.21.15.146:0/1098579643 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55db42b5d390 con 0x55db42a5ce20 2024-09-18T01:45:24.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.302+0000 7fc4f6d35640 1 -- 172.21.15.146:0/1098579643 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc4e80083e0 con 0x55db42a5ce20 2024-09-18T01:45:24.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.302+0000 7fc4f8a40800 1 -- 172.21.15.146:0/1098579643 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55db42b5c5c0 con 0x55db42a5ce20 2024-09-18T01:45:24.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.302+0000 7fc4f6d35640 1 -- 172.21.15.146:0/1098579643 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc4e80083e0 con 0x55db42a5ce20 2024-09-18T01:45:24.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.302+0000 7fc4f8a40800 1 --2- 172.21.15.146:0/1098579643 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55db42b5e740 0x55db42b60b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.302+0000 7fc4f8a40800 1 -- 172.21.15.146:0/1098579643 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55db42b61070 con 0x55db42b5e740 2024-09-18T01:45:24.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.302+0000 7fc4f6534640 1 --2- 172.21.15.146:0/1098579643 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55db42b5e740 0x55db42b60b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.303+0000 7fc4f6534640 1 --2- 172.21.15.146:0/1098579643 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55db42b5e740 0x55db42b60b30 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.303+0000 7fc4f6534640 1 -- 172.21.15.146:0/1098579643 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc4f006c420 con 0x55db42b5e740 2024-09-18T01:45:24.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.303+0000 7fc4f8a40800 1 Processor -- start 2024-09-18T01:45:24.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.303+0000 7fc4f8a40800 1 -- start start 2024-09-18T01:45:24.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.303+0000 7fc4f8a40800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db42b6edc0 0x55db42b6f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.303+0000 7fc4f8a40800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55db428f8580 con 0x55db42b6edc0 2024-09-18T01:45:24.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.304+0000 7fc4f6d35640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db42b6edc0 0x55db42b6f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.304+0000 7fc4f6d35640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db42b6edc0 0x55db42b6f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59992/0 (socket says 172.21.15.146:59992) 2024-09-18T01:45:24.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.304+0000 7fc4f6d35640 1 -- 172.21.15.146:0/3949444941 learned_addr learned my addr 172.21.15.146:0/3949444941 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:24.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.304+0000 7fc4f6d35640 1 -- 172.21.15.146:0/3949444941 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db42b6f720 con 0x55db42b6edc0 2024-09-18T01:45:24.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.304+0000 7fc4f6d35640 1 --2- 172.21.15.146:0/3949444941 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db42b6edc0 0x55db42b6f1e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x55db42b55120 tx=0x7fc4e800ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.304+0000 7fc3dbfff640 1 -- 172.21.15.146:0/3949444941 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4e801c070 con 0x55db42b6edc0 2024-09-18T01:45:24.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.304+0000 7fc3dbfff640 1 -- 172.21.15.146:0/3949444941 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4e800bdc0 con 0x55db42b6edc0 2024-09-18T01:45:24.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.304+0000 7fc4f8a40800 1 -- 172.21.15.146:0/3949444941 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55db42b6f9b0 con 0x55db42b6edc0 2024-09-18T01:45:24.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.304+0000 7fc3dbfff640 1 -- 172.21.15.146:0/3949444941 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4e8018540 con 0x55db42b6edc0 2024-09-18T01:45:24.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.304+0000 7fc4f8a40800 1 -- 172.21.15.146:0/3949444941 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db42b72690 con 0x55db42b6edc0 2024-09-18T01:45:24.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.305+0000 7fc3dbfff640 1 -- 172.21.15.146:0/3949444941 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc4e801f070 con 0x55db42b6edc0 2024-09-18T01:45:24.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.305+0000 7fc3dbfff640 1 --2- 172.21.15.146:0/3949444941 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc3d0036b40 0x7fc3d0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.305+0000 7fc3dbfff640 1 -- 172.21.15.146:0/3949444941 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fc4e804e630 con 0x55db42b6edc0 2024-09-18T01:45:24.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.305+0000 7fc4f6534640 1 --2- 172.21.15.146:0/3949444941 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc3d0036b40 0x7fc3d0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.306+0000 7fc4f8a40800 1 Processor -- start 2024-09-18T01:45:24.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.306+0000 7fc4f8a40800 1 -- start start 2024-09-18T01:45:24.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.306+0000 7fc4f6534640 1 --2- 172.21.15.146:0/3949444941 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc3d0036b40 0x7fc3d0039000 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x55db42b5c960 tx=0x7fc4f007f9e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.306+0000 7fc4f8a40800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db42b4c5f0 0x55db42b4c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.306+0000 7fc4f8a40800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55db42b4f460 con 0x55db42b4c5f0 2024-09-18T01:45:24.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.306+0000 7fc4f6d35640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db42b4c5f0 0x55db42b4c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.306+0000 7fc4f6d35640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db42b4c5f0 0x55db42b4c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:59998/0 (socket says 172.21.15.146:59998) 2024-09-18T01:45:24.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.306+0000 7fc4f6d35640 1 -- 172.21.15.146:0/2342918445 learned_addr learned my addr 172.21.15.146:0/2342918445 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:24.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.306+0000 7fc4f6d35640 1 -- 172.21.15.146:0/2342918445 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db42b4cfc0 con 0x55db42b4c5f0 2024-09-18T01:45:24.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.306+0000 7fc4f6d35640 1 --2- 172.21.15.146:0/2342918445 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db42b4c5f0 0x55db42b4c9f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc4e804cc00 tx=0x7fc4e8017460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d9fb9966c2561b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.306+0000 7fc3d9ffb640 1 -- 172.21.15.146:0/2342918445 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4e804a020 con 0x55db42b4c5f0 2024-09-18T01:45:24.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.306+0000 7fc3d9ffb640 1 -- 172.21.15.146:0/2342918445 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4e8029c70 con 0x55db42b4c5f0 2024-09-18T01:45:24.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.306+0000 7fc3d9ffb640 1 -- 172.21.15.146:0/2342918445 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4e8026070 con 0x55db42b4c5f0 2024-09-18T01:45:24.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.307+0000 7fc4f8a40800 1 -- 172.21.15.146:0/2342918445 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db42b4c5f0 msgr2=0x55db42b4c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.307+0000 7fc4f8a40800 1 --2- 172.21.15.146:0/2342918445 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db42b4c5f0 0x55db42b4c9f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc4e804cc00 tx=0x7fc4e8017460 comp rx=0 tx=0).stop 2024-09-18T01:45:24.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.307+0000 7fc4f8a40800 1 -- 172.21.15.146:0/2342918445 shutdown_connections 2024-09-18T01:45:24.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.307+0000 7fc4f8a40800 1 --2- 172.21.15.146:0/2342918445 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db42b4c5f0 0x55db42b4c9f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.307+0000 7fc4f8a40800 1 -- 172.21.15.146:0/2342918445 >> 172.21.15.146:0/2342918445 conn(0x55db42b77e30 msgr2=0x55db42b75f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:24.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.307+0000 7fc4f8a40800 1 -- 172.21.15.146:0/2342918445 shutdown_connections 2024-09-18T01:45:24.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.307+0000 7fc4f8a40800 1 -- 172.21.15.146:0/2342918445 wait complete. 2024-09-18T01:45:24.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.307+0000 7fc4f8a40800 1 Processor -- start 2024-09-18T01:45:24.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.307+0000 7fc4f8a40800 1 -- start start 2024-09-18T01:45:24.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.307+0000 7fc4f8a40800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db42b4c5f0 0x55db42b850b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.307+0000 7fc4f8a40800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55db42b4b2d0 con 0x55db42b4c5f0 2024-09-18T01:45:24.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.308+0000 7fc4f6d35640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db42b4c5f0 0x55db42b850b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.308+0000 7fc4f6d35640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db42b4c5f0 0x55db42b850b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60014/0 (socket says 172.21.15.146:60014) 2024-09-18T01:45:24.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.308+0000 7fc4f6d35640 1 -- 172.21.15.146:0/4246174978 learned_addr learned my addr 172.21.15.146:0/4246174978 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:24.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.308+0000 7fc4f6d35640 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db42b855f0 con 0x55db42b4c5f0 2024-09-18T01:45:24.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.308+0000 7fc4f6d35640 1 --2- 172.21.15.146:0/4246174978 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db42b4c5f0 0x55db42b850b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc4e8014fb0 tx=0x7fc4e804c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.308+0000 7fc3c7fff640 1 -- 172.21.15.146:0/4246174978 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4e8016c50 con 0x55db42b4c5f0 2024-09-18T01:45:24.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.308+0000 7fc3c7fff640 1 -- 172.21.15.146:0/4246174978 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4e8046040 con 0x55db42b4c5f0 2024-09-18T01:45:24.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.308+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55db42b85880 con 0x55db42b4c5f0 2024-09-18T01:45:24.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.308+0000 7fc3c7fff640 1 -- 172.21.15.146:0/4246174978 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4e804b220 con 0x55db42b4c5f0 2024-09-18T01:45:24.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.308+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db42b88530 con 0x55db42b4c5f0 2024-09-18T01:45:24.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.309+0000 7fc3c7fff640 1 -- 172.21.15.146:0/4246174978 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc4e804b490 con 0x55db42b4c5f0 2024-09-18T01:45:24.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.309+0000 7fc3c7fff640 1 --2- 172.21.15.146:0/4246174978 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc3c0036b40 0x7fc3c0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.309+0000 7fc3c7fff640 1 -- 172.21.15.146:0/4246174978 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fc4e8035c80 con 0x55db42b4c5f0 2024-09-18T01:45:24.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.309+0000 7fc4f6534640 1 --2- 172.21.15.146:0/4246174978 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc3c0036b40 0x7fc3c0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.309+0000 7fc4f6534640 1 --2- 172.21.15.146:0/4246174978 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc3c0036b40 0x7fc3c0039000 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc4f006c730 tx=0x7fc4f0092000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.310+0000 7fc4f8a40800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.310+0000 7fc4f8a40800 1 --2- 172.21.15.146:0/4246174978 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55db42b90b90 0x55db42b93050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.310+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55db42b937a0 con 0x55db42b90b90 2024-09-18T01:45:24.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.310+0000 7fc4f5d33640 1 --2- 172.21.15.146:0/4246174978 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55db42b90b90 0x55db42b93050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.310+0000 7fc4f5d33640 1 --2- 172.21.15.146:0/4246174978 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55db42b90b90 0x55db42b93050 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.310+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4e000f5f0 con 0x55db42b90b90 2024-09-18T01:45:24.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.310+0000 7fc4f8a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.310+0000 7fc4f8a40800 20 realm 2024-09-18T01:45:24.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.310+0000 7fc4f8a40800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.311+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55db42b8ffe0 con 0x55db42b90b90 2024-09-18T01:45:24.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.311+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4e000f5f0 con 0x55db42b90b90 2024-09-18T01:45:24.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.311+0000 7fc4f8a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.311+0000 7fc4f8a40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:24.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.311+0000 7fc4f8a40800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.311+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55db42b94290 con 0x55db42b90b90 2024-09-18T01:45:24.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.311+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4e000f5f0 con 0x55db42b90b90 2024-09-18T01:45:24.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.311+0000 7fc4f8a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.311+0000 7fc4f8a40800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.311+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55db42b94b60 con 0x55db42b90b90 2024-09-18T01:45:24.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.311+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc4e000f5f0 con 0x55db42b90b90 2024-09-18T01:45:24.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.311+0000 7fc4f8a40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:24.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.311+0000 7fc4f8a40800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.311+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55db42b94f00 con 0x55db42b90b90 2024-09-18T01:45:24.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.311+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc4e000f5f0 con 0x55db42b90b90 2024-09-18T01:45:24.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.311+0000 7fc4f8a40800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:24.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.311+0000 7fc4f8a40800 20 searching for the correct realm 2024-09-18T01:45:24.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.311+0000 7fc4f8a40800 1 --2- 172.21.15.146:0/4246174978 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55db42b96e30 0x55db42b99240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.311+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55db42b99910 con 0x55db42b96e30 2024-09-18T01:45:24.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.312+0000 7fc4f6d35640 1 --2- 172.21.15.146:0/4246174978 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55db42b96e30 0x55db42b99240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.312+0000 7fc4f6d35640 1 --2- 172.21.15.146:0/4246174978 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55db42b96e30 0x55db42b99240 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.312+0000 7fc4f6d35640 1 -- 172.21.15.146:0/4246174978 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4e803a020 con 0x55db42b96e30 2024-09-18T01:45:24.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.312+0000 7fc4f6d35640 1 --2- 172.21.15.146:0/4246174978 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fc4e8021070 0x7fc4e803d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.312+0000 7fc4f6d35640 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55db42b99910 con 0x7fc4e8021070 2024-09-18T01:45:24.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.312+0000 7fc4f6534640 1 --2- 172.21.15.146:0/4246174978 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fc4e8021070 0x7fc4e803d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.312+0000 7fc4f6534640 1 --2- 172.21.15.146:0/4246174978 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fc4e8021070 0x7fc4e803d440 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.313+0000 7fc4f6534640 1 -- 172.21.15.146:0/4246174978 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4f006c420 con 0x7fc4e8021070 2024-09-18T01:45:24.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.313+0000 7fc4f6534640 1 --2- 172.21.15.146:0/4246174978 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fc4f006d040 0x7fc4f006aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.313+0000 7fc4f6534640 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55db42b99910 con 0x7fc4f006d040 2024-09-18T01:45:24.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.313+0000 7fc4f5d33640 1 --2- 172.21.15.146:0/4246174978 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fc4f006d040 0x7fc4f006aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.313+0000 7fc4f5d33640 1 --2- 172.21.15.146:0/4246174978 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fc4f006d040 0x7fc4f006aab0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.313+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4e000f5f0 con 0x7fc4f006d040 2024-09-18T01:45:24.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.313+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55db42b99910 con 0x55db42b90b90 2024-09-18T01:45:24.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.314+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc4e000f5f0 con 0x55db42b90b90 2024-09-18T01:45:24.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.314+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55db42b99910 con 0x55db42b90b90 2024-09-18T01:45:24.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.314+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4e000f5f0 con 0x55db42b90b90 2024-09-18T01:45:24.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.314+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55db42b99910 con 0x7fc4f006d040 2024-09-18T01:45:24.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.314+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4e000f5f0 con 0x7fc4f006d040 2024-09-18T01:45:24.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.314+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55db42b99910 con 0x7fc4f006d040 2024-09-18T01:45:24.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.314+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4e000f5f0 con 0x7fc4f006d040 2024-09-18T01:45:24.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.314+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55db42b99910 con 0x7fc4e8021070 2024-09-18T01:45:24.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.315+0000 7fc4f6534640 1 -- 172.21.15.146:0/4246174978 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4f006c420 con 0x7fc4e8021070 2024-09-18T01:45:24.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.315+0000 7fc4f6534640 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55db42b99910 con 0x55db42b96e30 2024-09-18T01:45:24.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.315+0000 7fc4f6d35640 1 -- 172.21.15.146:0/4246174978 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4e803a020 con 0x55db42b96e30 2024-09-18T01:45:24.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.315+0000 7fc4f6d35640 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55db42b99910 con 0x55db42b90b90 2024-09-18T01:45:24.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.315+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4e000f5f0 con 0x55db42b90b90 2024-09-18T01:45:24.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.315+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55db42b99910 con 0x7fc4f006d040 2024-09-18T01:45:24.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.315+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4e000f5f0 con 0x7fc4f006d040 2024-09-18T01:45:24.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.315+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55db42b99910 con 0x55db42b90b90 2024-09-18T01:45:24.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.315+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4e000f5f0 con 0x55db42b90b90 2024-09-18T01:45:24.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.315+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55db42b99910 con 0x7fc4e8021070 2024-09-18T01:45:24.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.316+0000 7fc4f6534640 1 -- 172.21.15.146:0/4246174978 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fc4f006c420 con 0x7fc4e8021070 2024-09-18T01:45:24.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.316+0000 7fc4f6534640 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55db42b99910 con 0x55db42b96e30 2024-09-18T01:45:24.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.316+0000 7fc4f6d35640 1 -- 172.21.15.146:0/4246174978 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4e803a020 con 0x55db42b96e30 2024-09-18T01:45:24.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.316+0000 7fc4f6d35640 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55db42b99910 con 0x55db42b96e30 2024-09-18T01:45:24.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.316+0000 7fc4f6d35640 1 -- 172.21.15.146:0/4246174978 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4e803a020 con 0x55db42b96e30 2024-09-18T01:45:24.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.316+0000 7fc4f6d35640 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55db42b99910 con 0x7fc4f006d040 2024-09-18T01:45:24.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.316+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4e000f5f0 con 0x7fc4f006d040 2024-09-18T01:45:24.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.316+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55db42b99910 con 0x55db42b96e30 2024-09-18T01:45:24.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.316+0000 7fc4f6d35640 1 -- 172.21.15.146:0/4246174978 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4e803a020 con 0x55db42b96e30 2024-09-18T01:45:24.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.317+0000 7fc4f6d35640 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55db42b99910 con 0x55db42b96e30 2024-09-18T01:45:24.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.317+0000 7fc4f6d35640 1 -- 172.21.15.146:0/4246174978 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4e803a020 con 0x55db42b96e30 2024-09-18T01:45:24.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.317+0000 7fc4f6d35640 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55db42b99910 con 0x55db42b90b90 2024-09-18T01:45:24.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.317+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4e000f5f0 con 0x55db42b90b90 2024-09-18T01:45:24.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.317+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55db42b99910 con 0x55db42b90b90 2024-09-18T01:45:24.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.317+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc4e000f5f0 con 0x55db42b90b90 2024-09-18T01:45:24.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.317+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55db42b99910 con 0x7fc4f006d040 2024-09-18T01:45:24.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.317+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4e000f5f0 con 0x7fc4f006d040 2024-09-18T01:45:24.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.317+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55db42b99910 con 0x55db42b96e30 2024-09-18T01:45:24.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.318+0000 7fc4f6d35640 1 -- 172.21.15.146:0/4246174978 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4e803a020 con 0x55db42b96e30 2024-09-18T01:45:24.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.318+0000 7fc4f6d35640 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55db42b99910 con 0x7fc4e8021070 2024-09-18T01:45:24.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.318+0000 7fc4f6534640 1 -- 172.21.15.146:0/4246174978 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4f006c420 con 0x7fc4e8021070 2024-09-18T01:45:24.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.318+0000 7fc4f6534640 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55db42b99910 con 0x55db42b90b90 2024-09-18T01:45:24.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.318+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4e000f5f0 con 0x55db42b90b90 2024-09-18T01:45:24.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.318+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55db42b99910 con 0x7fc4f006d040 2024-09-18T01:45:24.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.318+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4e003b040 con 0x7fc4f006d040 2024-09-18T01:45:24.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.318+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55db42b99910 con 0x55db42b96e30 2024-09-18T01:45:24.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.318+0000 7fc4f6d35640 1 -- 172.21.15.146:0/4246174978 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4e803a020 con 0x55db42b96e30 2024-09-18T01:45:24.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.319+0000 7fc4f6d35640 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55db42b99910 con 0x7fc4f006d040 2024-09-18T01:45:24.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.319+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4e003b040 con 0x7fc4f006d040 2024-09-18T01:45:24.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.319+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55db42b99910 con 0x7fc4e8021070 2024-09-18T01:45:24.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.319+0000 7fc4f6534640 1 -- 172.21.15.146:0/4246174978 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4f006c420 con 0x7fc4e8021070 2024-09-18T01:45:24.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.319+0000 7fc4f6534640 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55db42b99910 con 0x55db42b96e30 2024-09-18T01:45:24.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.319+0000 7fc4f6d35640 1 -- 172.21.15.146:0/4246174978 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4e803a020 con 0x55db42b96e30 2024-09-18T01:45:24.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.319+0000 7fc4f6d35640 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55db42b99910 con 0x7fc4f006d040 2024-09-18T01:45:24.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.320+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4e003b040 con 0x7fc4f006d040 2024-09-18T01:45:24.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.320+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55db42b99910 con 0x55db42b90b90 2024-09-18T01:45:24.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.320+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc4e003b040 con 0x55db42b90b90 2024-09-18T01:45:24.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.320+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55db42b99910 con 0x7fc4e8021070 2024-09-18T01:45:24.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.320+0000 7fc4f6534640 1 -- 172.21.15.146:0/4246174978 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4f00b2040 con 0x7fc4e8021070 2024-09-18T01:45:24.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.320+0000 7fc4f8a40800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:24.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.320+0000 7fc4f8a40800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:24.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.320+0000 7fc4f8a40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:24.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.320+0000 7fc4f8a40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:24.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.320+0000 7fc4f8a40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:24.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.320+0000 7fc4f8a40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:24.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.320+0000 7fc4f8a40800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.320+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55db42b958d0 con 0x55db42b90b90 2024-09-18T01:45:24.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.321+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4e003b040 con 0x55db42b90b90 2024-09-18T01:45:24.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.321+0000 7fc4f8a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.321+0000 7fc4f8a40800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.321+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55db42b96170 con 0x55db42b90b90 2024-09-18T01:45:24.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.321+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc4e003b040 con 0x55db42b90b90 2024-09-18T01:45:24.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.321+0000 7fc4f8a40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:24.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.321+0000 7fc4f8a40800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.321+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55db42b96170 con 0x7fc4e8021070 2024-09-18T01:45:24.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.321+0000 7fc4f6534640 1 -- 172.21.15.146:0/4246174978 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc4f00b2040 con 0x7fc4e8021070 2024-09-18T01:45:24.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.321+0000 7fc4f8a40800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:24.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.321+0000 7fc4f8a40800 20 zone default found 2024-09-18T01:45:24.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.321+0000 7fc4f8a40800 4 Realm: () 2024-09-18T01:45:24.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.321+0000 7fc4f8a40800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:24.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.321+0000 7fc4f8a40800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:24.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.321+0000 7fc4f8a40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:24.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.321+0000 7fc4f8a40800 20 zonegroup default 2024-09-18T01:45:24.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.321+0000 7fc4f8a40800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.321+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55db42b9a240 con 0x7fc4f006d040 2024-09-18T01:45:24.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.322+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc4e003b040 con 0x7fc4f006d040 2024-09-18T01:45:24.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.322+0000 7fc4f8a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.322+0000 7fc4f8a40800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.322+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55db42b9bc20 con 0x55db42b96e30 2024-09-18T01:45:24.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.322+0000 7fc4f6d35640 1 -- 172.21.15.146:0/4246174978 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc4e803a020 con 0x55db42b96e30 2024-09-18T01:45:24.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.322+0000 7fc4f8a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.322+0000 7fc4f8a40800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.322+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55db42b9c0f0 con 0x55db42b96e30 2024-09-18T01:45:24.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.322+0000 7fc4f6d35640 1 -- 172.21.15.146:0/4246174978 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc4e803a020 con 0x55db42b96e30 2024-09-18T01:45:24.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.322+0000 7fc4f8a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.322+0000 7fc4f8a40800 20 started sync module instance, tier type = 2024-09-18T01:45:24.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.322+0000 7fc4f8a40800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:24.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.322+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55db42b9b0b0 con 0x7fc4e8021070 2024-09-18T01:45:24.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.323+0000 7fc4f6534640 1 -- 172.21.15.146:0/4246174978 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v31'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4f00b2040 con 0x7fc4e8021070 2024-09-18T01:45:24.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.323+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94400205665440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55db42b9ca00 con 0x7fc4e8021070 2024-09-18T01:45:24.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.323+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55db42b9d250 con 0x55db42b90b90 2024-09-18T01:45:24.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.324+0000 7fc4f6534640 1 -- 172.21.15.146:0/4246174978 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94400205665440] v31'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4f00b2040 con 0x7fc4e8021070 2024-09-18T01:45:24.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.324+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v31'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4e003b040 con 0x55db42b90b90 2024-09-18T01:45:24.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.324+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94400205669712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55db42b9d250 con 0x55db42b90b90 2024-09-18T01:45:24.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.324+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55db42b9dc70 con 0x55db42b96e30 2024-09-18T01:45:24.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.326+0000 7fc4f6d35640 1 -- 172.21.15.146:0/4246174978 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v31'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4e803a020 con 0x55db42b96e30 2024-09-18T01:45:24.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.326+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94400205674336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55db42b9dc70 con 0x55db42b96e30 2024-09-18T01:45:24.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.326+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55db42b9ec50 con 0x7fc4e8021070 2024-09-18T01:45:24.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.326+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94400205669712] v31'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4e003b040 con 0x55db42b90b90 2024-09-18T01:45:24.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.327+0000 7fc4f6d35640 1 -- 172.21.15.146:0/4246174978 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94400205674336] v31'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4e803a020 con 0x55db42b96e30 2024-09-18T01:45:24.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.327+0000 7fc4f6534640 1 -- 172.21.15.146:0/4246174978 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v31'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4f00b2040 con 0x7fc4e8021070 2024-09-18T01:45:24.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.327+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94400205676688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55db42b9e760 con 0x7fc4e8021070 2024-09-18T01:45:24.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.327+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55db42b9f520 con 0x55db42b90b90 2024-09-18T01:45:24.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.328+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v31'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4e003b040 con 0x55db42b90b90 2024-09-18T01:45:24.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.328+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94400205680752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55db42b9f940 con 0x55db42b90b90 2024-09-18T01:45:24.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.328+0000 7fc4f6534640 1 -- 172.21.15.146:0/4246174978 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94400205676688] v31'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4f00b2040 con 0x7fc4e8021070 2024-09-18T01:45:24.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.328+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55db42ba0190 con 0x7fc4f006d040 2024-09-18T01:45:24.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.329+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94400205680752] v31'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4e003b040 con 0x55db42b90b90 2024-09-18T01:45:24.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.329+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v31'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4e003b040 con 0x7fc4f006d040 2024-09-18T01:45:24.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.329+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94400205681808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55db42b9fd60 con 0x7fc4f006d040 2024-09-18T01:45:24.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.329+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55db42ba05f0 con 0x7fc4f006d040 2024-09-18T01:45:24.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.330+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94400205681808] v31'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4e003b040 con 0x7fc4f006d040 2024-09-18T01:45:24.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.330+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v31'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4e003b040 con 0x7fc4f006d040 2024-09-18T01:45:24.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.330+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94400205682864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55db42ba07d0 con 0x7fc4f006d040 2024-09-18T01:45:24.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.330+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55db42ba1020 con 0x7fc4f006d040 2024-09-18T01:45:24.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.331+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94400205682864] v31'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4e003b040 con 0x7fc4f006d040 2024-09-18T01:45:24.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.334+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v31'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4e003b040 con 0x7fc4f006d040 2024-09-18T01:45:24.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.334+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94400205686736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55db42ba10a0 con 0x7fc4f006d040 2024-09-18T01:45:24.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.334+0000 7fc4f8a40800 20 add_watcher() i=0 2024-09-18T01:45:24.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.334+0000 7fc4f8a40800 20 add_watcher() i=1 2024-09-18T01:45:24.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.334+0000 7fc4f8a40800 20 add_watcher() i=2 2024-09-18T01:45:24.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.334+0000 7fc4f8a40800 20 add_watcher() i=3 2024-09-18T01:45:24.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.334+0000 7fc4f8a40800 20 add_watcher() i=4 2024-09-18T01:45:24.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.334+0000 7fc4f8a40800 20 add_watcher() i=5 2024-09-18T01:45:24.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.334+0000 7fc4f8a40800 20 add_watcher() i=6 2024-09-18T01:45:24.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.334+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94400205686736] v31'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4e003b040 con 0x7fc4f006d040 2024-09-18T01:45:24.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.334+0000 7fc4f8a40800 20 add_watcher() i=7 2024-09-18T01:45:24.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.334+0000 7fc4f8a40800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:24.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.334+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55db42ba4370 con 0x55db42b90b90 2024-09-18T01:45:24.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.335+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc4e003b040 con 0x55db42b90b90 2024-09-18T01:45:24.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.335+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94400205688160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55db42ba1630 con 0x55db42b90b90 2024-09-18T01:45:24.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.336+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94400205688160] v31'76 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc4e003b040 con 0x55db42b90b90 2024-09-18T01:45:24.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.336+0000 7fc3acfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:24.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.336+0000 7fc4f8a40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:24.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.336+0000 7fc4f8a40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:24.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.336+0000 7fc4f8a40800 5 note: GC not initialized 2024-09-18T01:45:24.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.336+0000 7fc3277fe640 20 reqs_thread_entry: start 2024-09-18T01:45:24.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.336+0000 7fc4f8a40800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:24.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.336+0000 7fc4f8a40800 20 Filter name: none 2024-09-18T01:45:24.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.336+0000 7fc3257fa640 20 reqs_thread_entry: start 2024-09-18T01:45:24.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.336+0000 7fc4f8a40800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T01:45:24.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.336+0000 7fc4f8a40800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.337+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55db42bd77d0 con 0x55db42b90b90 2024-09-18T01:45:24.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.337+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc4e003b040 con 0x55db42b90b90 2024-09-18T01:45:24.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.337+0000 7fc4f8a40800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:45:24.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.337+0000 7fc4f8a40800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T01:45:24.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.337+0000 7fc4f8a40800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:45:24.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.337+0000 7fc4f8a40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:45:24.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.337+0000 7fc4f8a40800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : miss 2024-09-18T01:45:24.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.337+0000 7fc4f8a40800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.337+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:63 8.8 8:17d68d04:users.swift::foo%3afoo1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55db42bd8240 con 0x55db42b90b90 2024-09-18T01:45:24.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.337+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(63 foo:foo1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7fc4e003b040 con 0x55db42b90b90 2024-09-18T01:45:24.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.337+0000 7fc4f8a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.337+0000 7fc4f8a40800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x0 2024-09-18T01:45:24.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.337+0000 7fc4f8a40800 10 adding default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-18T01:45:24.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.337+0000 7fc4f8a40800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : hit (negative entry) 2024-09-18T01:45:24.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.337+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55db42bddcc0 con 0x55db42b90b90 2024-09-18T01:45:24.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.338+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~556] v31'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fc4e003b040 con 0x55db42b90b90 2024-09-18T01:45:24.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.338+0000 7fc4f8a40800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:45:24.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.338+0000 7fc4f8a40800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:45:24.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.338+0000 7fc4f8a40800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-18T01:45:24.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.338+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94400205936256 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55db42bd9280 con 0x55db42b90b90 2024-09-18T01:45:24.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.339+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== watch-notify(notify (1) cookie 94400205680752 notify 133143986181 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7fc4e0018040 con 0x55db42b90b90 2024-09-18T01:45:24.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.339+0000 7fc3d9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986181 cookie 94400205680752 notifier 4369 bl.length()=732 2024-09-18T01:45:24.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.339+0000 7fc3d9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:45:24.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.339+0000 7fc3d9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:45:24.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.339+0000 7fc3d9ffb640 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fc3bc003ea0 con 0x55db42b90b90 2024-09-18T01:45:24.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.339+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(65 notify.4 [notify cookie 94400205936256 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc4e003b040 con 0x55db42b90b90 2024-09-18T01:45:24.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.339+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4e003b040 con 0x55db42b90b90 2024-09-18T01:45:24.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.339+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 <== osd.1 v2:172.21.15.146:6808/3930274777 28 ==== watch-notify(notify_complete (2) cookie 94400205936256 notify 133143986181 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc4e0004b50 con 0x55db42b90b90 2024-09-18T01:45:24.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.339+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:67 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55db42bdd680 con 0x55db42b90b90 2024-09-18T01:45:24.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.340+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 <== osd.1 v2:172.21.15.146:6808/3930274777 29 ==== osd_op_reply(67 foo:foo1 [delete,create,writefull 0~7] v31'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7fc4e0020040 con 0x55db42b90b90 2024-09-18T01:45:24.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.340+0000 7fc4f8a40800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-18T01:45:24.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.340+0000 7fc4f8a40800 10 moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-18T01:45:24.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.340+0000 7fc4f8a40800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-18T01:45:24.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.340+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94400205936256 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55db42bd8dd0 con 0x7fc4e8021070 2024-09-18T01:45:24.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.341+0000 7fc4f6534640 1 -- 172.21.15.146:0/4246174978 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== watch-notify(notify (1) cookie 94400205665440 notify 133143986178 ret 0) ==== 208+0+0 (crc 0 0 0) 0x7fc4f0085040 con 0x7fc4e8021070 2024-09-18T01:45:24.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.341+0000 7fc3d97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986178 cookie 94400205665440 notifier 4369 bl.length()=166 2024-09-18T01:45:24.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.341+0000 7fc3d97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-18T01:45:24.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.341+0000 7fc3d97fa640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-18T01:45:24.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.341+0000 7fc3d97fa640 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fc32c003400 con 0x7fc4e8021070 2024-09-18T01:45:24.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.341+0000 7fc4f6534640 1 -- 172.21.15.146:0/4246174978 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(68 notify.0 [notify cookie 94400205936256 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc4f00b2040 con 0x7fc4e8021070 2024-09-18T01:45:24.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.341+0000 7fc4f6534640 1 -- 172.21.15.146:0/4246174978 <== osd.2 v2:172.21.15.146:6800/3820039304 14 ==== watch-notify(notify_complete (2) cookie 94400205936256 notify 133143986178 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55db42b54960 con 0x7fc4e8021070 2024-09-18T01:45:24.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.341+0000 7fc4f6534640 1 -- 172.21.15.146:0/4246174978 <== osd.2 v2:172.21.15.146:6800/3820039304 15 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4f00b2040 con 0x7fc4e8021070 2024-09-18T01:45:24.352 INFO:teuthology.orchestra.run.smithi146.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T01:45:23.010714Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"M3SRTaie7mLgNwmHijF0lk25CniS3ioZdx5rsBJv","active":true,"create_date":"2024-09-18T01:45:24.338233Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:45:23.010705Z","tags":[],"group_ids":[]} 2024-09-18T01:45:24.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.342+0000 7fc3acfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:24.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.342+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94400205688160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55db42bd5540 con 0x55db42b90b90 2024-09-18T01:45:24.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.343+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 <== osd.1 v2:172.21.15.146:6808/3930274777 30 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94400205688160] v31'77 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc4e0020040 con 0x55db42b90b90 2024-09-18T01:45:24.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.343+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94400205665440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55db42bd5540 con 0x7fc4e8021070 2024-09-18T01:45:24.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.344+0000 7fc4f6534640 1 -- 172.21.15.146:0/4246174978 <== osd.2 v2:172.21.15.146:6800/3820039304 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94400205665440] v31'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4f00b2040 con 0x7fc4e8021070 2024-09-18T01:45:24.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.344+0000 7fc4f8a40800 20 remove_watcher() i=0 2024-09-18T01:45:24.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.344+0000 7fc4f8a40800 2 removed watcher, disabling cache 2024-09-18T01:45:24.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.344+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94400205669712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55db42bd5540 con 0x55db42b90b90 2024-09-18T01:45:24.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.345+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 <== osd.1 v2:172.21.15.146:6808/3930274777 31 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94400205669712] v31'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4e0020040 con 0x55db42b90b90 2024-09-18T01:45:24.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.345+0000 7fc4f8a40800 20 remove_watcher() i=1 2024-09-18T01:45:24.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.345+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94400205674336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55db42bd5540 con 0x55db42b96e30 2024-09-18T01:45:24.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.346+0000 7fc4f6d35640 1 -- 172.21.15.146:0/4246174978 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94400205674336] v31'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4e803a020 con 0x55db42b96e30 2024-09-18T01:45:24.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.346+0000 7fc4f8a40800 20 remove_watcher() i=2 2024-09-18T01:45:24.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.346+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94400205676688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55db42bd5540 con 0x7fc4e8021070 2024-09-18T01:45:24.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.347+0000 7fc4f6534640 1 -- 172.21.15.146:0/4246174978 <== osd.2 v2:172.21.15.146:6800/3820039304 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94400205676688] v31'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4f00b2040 con 0x7fc4e8021070 2024-09-18T01:45:24.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.347+0000 7fc4f8a40800 20 remove_watcher() i=3 2024-09-18T01:45:24.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.347+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94400205680752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55db42bd5540 con 0x55db42b90b90 2024-09-18T01:45:24.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.348+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 <== osd.1 v2:172.21.15.146:6808/3930274777 32 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94400205680752] v31'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4e0020040 con 0x55db42b90b90 2024-09-18T01:45:24.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.348+0000 7fc4f8a40800 20 remove_watcher() i=4 2024-09-18T01:45:24.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.348+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94400205681808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55db42bd5540 con 0x7fc4f006d040 2024-09-18T01:45:24.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.349+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94400205681808] v31'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4e0020040 con 0x7fc4f006d040 2024-09-18T01:45:24.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.349+0000 7fc4f8a40800 20 remove_watcher() i=5 2024-09-18T01:45:24.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.349+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94400205682864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55db42bd5540 con 0x7fc4f006d040 2024-09-18T01:45:24.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.350+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94400205682864] v31'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4e0020040 con 0x7fc4f006d040 2024-09-18T01:45:24.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.350+0000 7fc4f8a40800 20 remove_watcher() i=6 2024-09-18T01:45:24.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.350+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94400205686736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55db42bd5540 con 0x7fc4f006d040 2024-09-18T01:45:24.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.351+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94400205686736] v31'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4e0020040 con 0x7fc4f006d040 2024-09-18T01:45:24.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.351+0000 7fc4f8a40800 20 remove_watcher() i=7 2024-09-18T01:45:24.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.351+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fc4f006d040 msgr2=0x7fc4f006aab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.351+0000 7fc4f8a40800 1 --2- 172.21.15.146:0/4246174978 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fc4f006d040 0x7fc4f006aab0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.351+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55db42b90b90 msgr2=0x55db42b93050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.351+0000 7fc4f8a40800 1 --2- 172.21.15.146:0/4246174978 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55db42b90b90 0x55db42b93050 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.351+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fc4e8021070 msgr2=0x7fc4e803d440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.351+0000 7fc4f8a40800 1 --2- 172.21.15.146:0/4246174978 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fc4e8021070 0x7fc4e803d440 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.351+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55db42b96e30 msgr2=0x55db42b99240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.351+0000 7fc4f8a40800 1 --2- 172.21.15.146:0/4246174978 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55db42b96e30 0x55db42b99240 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.351+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc3c0036b40 msgr2=0x7fc3c0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.351+0000 7fc4f8a40800 1 --2- 172.21.15.146:0/4246174978 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc3c0036b40 0x7fc3c0039000 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc4f006c730 tx=0x7fc4f0092000 comp rx=0 tx=0).stop 2024-09-18T01:45:24.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.351+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db42b4c5f0 msgr2=0x55db42b850b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.351+0000 7fc4f8a40800 1 --2- 172.21.15.146:0/4246174978 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db42b4c5f0 0x55db42b850b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc4e8014fb0 tx=0x7fc4e804c910 comp rx=0 tx=0).stop 2024-09-18T01:45:24.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.351+0000 7fc4f5d33640 1 -- 172.21.15.146:0/4246174978 reap_dead start 2024-09-18T01:45:24.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.351+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 shutdown_connections 2024-09-18T01:45:24.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.351+0000 7fc4f8a40800 1 --2- 172.21.15.146:0/4246174978 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db42b4c5f0 0x55db42b850b0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.351+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 >> 172.21.15.146:0/4246174978 conn(0x55db42b77e30 msgr2=0x55db42b75f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:24.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.351+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 shutdown_connections 2024-09-18T01:45:24.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.351+0000 7fc4f8a40800 1 -- 172.21.15.146:0/4246174978 wait complete. 2024-09-18T01:45:24.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.352+0000 7fc4f8a40800 1 -- 172.21.15.146:0/3949444941 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc3d0036b40 msgr2=0x7fc3d0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.352+0000 7fc4f8a40800 1 --2- 172.21.15.146:0/3949444941 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc3d0036b40 0x7fc3d0039000 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x55db42b5c960 tx=0x7fc4f007f9e0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.352+0000 7fc4f8a40800 1 -- 172.21.15.146:0/3949444941 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db42b6edc0 msgr2=0x55db42b6f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.352+0000 7fc4f8a40800 1 --2- 172.21.15.146:0/3949444941 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db42b6edc0 0x55db42b6f1e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x55db42b55120 tx=0x7fc4e800ef30 comp rx=0 tx=0).stop 2024-09-18T01:45:24.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.352+0000 7fc4f8a40800 1 -- 172.21.15.146:0/3949444941 shutdown_connections 2024-09-18T01:45:24.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.352+0000 7fc4f8a40800 1 --2- 172.21.15.146:0/3949444941 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc3d0036b40 0x7fc3d0039000 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.352+0000 7fc4f8a40800 1 --2- 172.21.15.146:0/3949444941 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db42b6edc0 0x55db42b6f1e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.352+0000 7fc4f8a40800 1 -- 172.21.15.146:0/3949444941 >> 172.21.15.146:0/3949444941 conn(0x55db42b63d50 msgr2=0x55db42b668d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:24.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.352+0000 7fc4f8a40800 1 -- 172.21.15.146:0/3949444941 shutdown_connections 2024-09-18T01:45:24.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.352+0000 7fc4f8a40800 1 -- 172.21.15.146:0/3949444941 wait complete. 2024-09-18T01:45:24.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.352+0000 7fc4f8a40800 1 -- 172.21.15.146:0/1098579643 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55db42a5ce20 msgr2=0x55db42b5af70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.352+0000 7fc4f8a40800 1 --2- 172.21.15.146:0/1098579643 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55db42a5ce20 0x55db42b5af70 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.352+0000 7fc4f8a40800 1 -- 172.21.15.146:0/1098579643 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55db42b5e740 msgr2=0x55db42b60b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.352+0000 7fc4f8a40800 1 --2- 172.21.15.146:0/1098579643 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55db42b5e740 0x55db42b60b30 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.352+0000 7fc4f8a40800 1 -- 172.21.15.146:0/1098579643 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc3dc036b40 msgr2=0x7fc3dc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.352+0000 7fc4f8a40800 1 --2- 172.21.15.146:0/1098579643 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc3dc036b40 0x7fc3dc039000 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc4e0000c00 tx=0x7fc4e00013b0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.352+0000 7fc4f8a40800 1 -- 172.21.15.146:0/1098579643 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db42a5c4e0 msgr2=0x55db42b53f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.352+0000 7fc4f8a40800 1 --2- 172.21.15.146:0/1098579643 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db42a5c4e0 0x55db42b53f00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc4f0063040 tx=0x7fc4f0003330 comp rx=0 tx=0).stop 2024-09-18T01:45:24.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.352+0000 7fc4f8a40800 1 -- 172.21.15.146:0/1098579643 shutdown_connections 2024-09-18T01:45:24.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.352+0000 7fc4f8a40800 1 --2- 172.21.15.146:0/1098579643 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55db42b5e740 0x55db42b60b30 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.352+0000 7fc4f8a40800 1 --2- 172.21.15.146:0/1098579643 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55db42a5ce20 0x55db42b5af70 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.352+0000 7fc4f8a40800 1 --2- 172.21.15.146:0/1098579643 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc3dc036b40 0x7fc3dc039000 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.352+0000 7fc4f8a40800 1 --2- 172.21.15.146:0/1098579643 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db42a5c4e0 0x55db42b53f00 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.352+0000 7fc4f8a40800 1 -- 172.21.15.146:0/1098579643 >> 172.21.15.146:0/1098579643 conn(0x55db42a57db0 msgr2=0x55db42b457f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:24.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.352+0000 7fc4f8a40800 1 -- 172.21.15.146:0/1098579643 shutdown_connections 2024-09-18T01:45:24.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.352+0000 7fc4f8a40800 1 -- 172.21.15.146:0/1098579643 wait complete. 2024-09-18T01:45:24.363 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T01:45:23.010714Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'M3SRTaie7mLgNwmHijF0lk25CniS3ioZdx5rsBJv', 'active': True, 'create_date': '2024-09-18T01:45:24.338233Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:45:23.010705Z', 'tags': [], 'group_ids': []} 2024-09-18T01:45:24.363 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-18T01:45:24.363 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-18T01:45:24.364 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser modify --subuser foo:foo1 --secret gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL --key-type swift 2024-09-18T01:45:24.412 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:24.412 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:24.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.412+0000 7f84bae36800 1 Processor -- start 2024-09-18T01:45:24.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.412+0000 7f84bae36800 1 -- start start 2024-09-18T01:45:24.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.412+0000 7f84bae36800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x564dc39f5570 0x564dc39f5970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.412+0000 7f84bae36800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564dc38b5b30 con 0x564dc39f5eb0 2024-09-18T01:45:24.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.412+0000 7f84bae36800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x564dc3897360 con 0x564dc39f5570 2024-09-18T01:45:24.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.413+0000 7f84b6152640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x564dc39f5570 0x564dc39f5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.413+0000 7f84b5951640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x564dc39f5eb0 0x564dc39faa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:38802/0 (socket says 172.21.15.146:38802) 2024-09-18T01:45:24.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.413+0000 7f84b5951640 1 -- 172.21.15.146:0/4191745060 learned_addr learned my addr 172.21.15.146:0/4191745060 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:45:24.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.413+0000 7f84b6152640 1 -- 172.21.15.146:0/4191745060 >> v1:172.21.15.129:6789/0 conn(0x564dc39f5eb0 legacy=0x564dc39faa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.413+0000 7f84b6152640 1 -- 172.21.15.146:0/4191745060 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564dc38bde00 con 0x564dc39f5570 2024-09-18T01:45:24.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.415+0000 7f84b6152640 1 --2- 172.21.15.146:0/4191745060 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564dc39f5570 0x564dc39f5970 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f84a8005fd0 tx=0x7f84a8045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8599264afcdfc743 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.415+0000 7f84b5150640 1 -- 172.21.15.146:0/4191745060 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84a8058530 con 0x564dc39f5570 2024-09-18T01:45:24.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.415+0000 7f84b5150640 1 -- 172.21.15.146:0/4191745060 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84a80586d0 con 0x564dc39f5570 2024-09-18T01:45:24.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.415+0000 7f84b5150640 1 -- 172.21.15.146:0/4191745060 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84a80589d0 con 0x564dc39f5570 2024-09-18T01:45:24.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.415+0000 7f84bae36800 1 -- 172.21.15.146:0/4191745060 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564dc39f5570 msgr2=0x564dc39f5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.415+0000 7f84bae36800 1 --2- 172.21.15.146:0/4191745060 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564dc39f5570 0x564dc39f5970 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f84a8005fd0 tx=0x7f84a8045c30 comp rx=0 tx=0).stop 2024-09-18T01:45:24.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.415+0000 7f84bae36800 1 -- 172.21.15.146:0/4191745060 shutdown_connections 2024-09-18T01:45:24.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.415+0000 7f84bae36800 1 --2- 172.21.15.146:0/4191745060 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564dc39f5570 0x564dc39f5970 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.415+0000 7f84bae36800 1 -- 172.21.15.146:0/4191745060 >> 172.21.15.146:0/4191745060 conn(0x564dc39f0e00 msgr2=0x564dc39f3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:24.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.416+0000 7f84bae36800 1 -- 172.21.15.146:0/4191745060 shutdown_connections 2024-09-18T01:45:24.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.416+0000 7f84bae36800 1 -- 172.21.15.146:0/4191745060 wait complete. 2024-09-18T01:45:24.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.430+0000 7f84bae36800 1 Processor -- start 2024-09-18T01:45:24.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.430+0000 7f84bae36800 1 -- start start 2024-09-18T01:45:24.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.430+0000 7f84bae36800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564dc39f5570 0x564dc3ae4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.430+0000 7f84bae36800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x564dc3942350 con 0x564dc39f5570 2024-09-18T01:45:24.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.430+0000 7f84b6152640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564dc39f5570 0x564dc3ae4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.430+0000 7f84b6152640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564dc39f5570 0x564dc3ae4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60028/0 (socket says 172.21.15.146:60028) 2024-09-18T01:45:24.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.430+0000 7f84b6152640 1 -- 172.21.15.146:0/3432360914 learned_addr learned my addr 172.21.15.146:0/3432360914 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:24.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.431+0000 7f84b6152640 1 -- 172.21.15.146:0/3432360914 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564dc388fbc0 con 0x564dc39f5570 2024-09-18T01:45:24.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.431+0000 7f84b6152640 1 --2- 172.21.15.146:0/3432360914 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564dc39f5570 0x564dc3ae4890 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f84a800a3f0 tx=0x7f84a8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d85351e9ab03da07 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.431+0000 7f83a4608640 1 -- 172.21.15.146:0/3432360914 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84a80589b0 con 0x564dc39f5570 2024-09-18T01:45:24.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.431+0000 7f83a4608640 1 -- 172.21.15.146:0/3432360914 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84a8068070 con 0x564dc39f5570 2024-09-18T01:45:24.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.431+0000 7f83a4608640 1 -- 172.21.15.146:0/3432360914 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84a8058c80 con 0x564dc39f5570 2024-09-18T01:45:24.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.432+0000 7f84bae36800 1 -- 172.21.15.146:0/3432360914 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564dc39f5570 msgr2=0x564dc3ae4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.432+0000 7f84bae36800 1 --2- 172.21.15.146:0/3432360914 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564dc39f5570 0x564dc3ae4890 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f84a800a3f0 tx=0x7f84a8051000 comp rx=0 tx=0).stop 2024-09-18T01:45:24.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.432+0000 7f84bae36800 1 -- 172.21.15.146:0/3432360914 shutdown_connections 2024-09-18T01:45:24.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.432+0000 7f84bae36800 1 --2- 172.21.15.146:0/3432360914 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564dc39f5570 0x564dc3ae4890 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.432+0000 7f84bae36800 1 -- 172.21.15.146:0/3432360914 >> 172.21.15.146:0/3432360914 conn(0x564dc39f0e00 msgr2=0x564dc3ae0250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:24.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.432+0000 7f84bae36800 1 -- 172.21.15.146:0/3432360914 shutdown_connections 2024-09-18T01:45:24.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.432+0000 7f84bae36800 1 -- 172.21.15.146:0/3432360914 wait complete. 2024-09-18T01:45:24.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.432+0000 7f84bae36800 1 Processor -- start 2024-09-18T01:45:24.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.432+0000 7f84bae36800 1 -- start start 2024-09-18T01:45:24.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.432+0000 7f84bae36800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564dc39f5570 0x564dc396a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.432+0000 7f84bae36800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x564dc39fc590 con 0x564dc39f5570 2024-09-18T01:45:24.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.432+0000 7f84b6152640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564dc39f5570 0x564dc396a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.432+0000 7f84b6152640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564dc39f5570 0x564dc396a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60036/0 (socket says 172.21.15.146:60036) 2024-09-18T01:45:24.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.432+0000 7f84b6152640 1 -- 172.21.15.146:0/1624690596 learned_addr learned my addr 172.21.15.146:0/1624690596 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:24.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.433+0000 7f84b6152640 1 -- 172.21.15.146:0/1624690596 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564dc38a3fe0 con 0x564dc39f5570 2024-09-18T01:45:24.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.433+0000 7f84b6152640 1 --2- 172.21.15.146:0/1624690596 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564dc39f5570 0x564dc396a560 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f84a8065040 tx=0x7f84a8003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.433+0000 7f83a2e05640 1 -- 172.21.15.146:0/1624690596 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84a8063570 con 0x564dc39f5570 2024-09-18T01:45:24.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.433+0000 7f83a2e05640 1 -- 172.21.15.146:0/1624690596 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84a8063710 con 0x564dc39f5570 2024-09-18T01:45:24.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.433+0000 7f84bae36800 1 -- 172.21.15.146:0/1624690596 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564dc3aefee0 con 0x564dc39f5570 2024-09-18T01:45:24.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.433+0000 7f83a2e05640 1 -- 172.21.15.146:0/1624690596 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84a8063a10 con 0x564dc39f5570 2024-09-18T01:45:24.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.433+0000 7f84bae36800 1 -- 172.21.15.146:0/1624690596 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564dc3af0340 con 0x564dc39f5570 2024-09-18T01:45:24.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.434+0000 7f83a2e05640 1 -- 172.21.15.146:0/1624690596 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f84a8075020 con 0x564dc39f5570 2024-09-18T01:45:24.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.434+0000 7f83a2e05640 1 --2- 172.21.15.146:0/1624690596 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f839c036b40 0x7f839c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.434+0000 7f83a2e05640 1 -- 172.21.15.146:0/1624690596 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f84a8090d10 con 0x564dc39f5570 2024-09-18T01:45:24.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.434+0000 7f84b5951640 1 --2- 172.21.15.146:0/1624690596 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f839c036b40 0x7f839c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.434+0000 7f84bae36800 1 --2- 172.21.15.146:0/1624690596 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564dc39f5eb0 0x564dc3af41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.434+0000 7f84bae36800 1 -- 172.21.15.146:0/1624690596 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564dc3af4780 con 0x564dc39f5eb0 2024-09-18T01:45:24.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.434+0000 7f84b6953640 1 --2- 172.21.15.146:0/1624690596 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564dc39f5eb0 0x564dc3af41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.434+0000 7f84b5951640 1 --2- 172.21.15.146:0/1624690596 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f839c036b40 0x7f839c039000 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f84ac000f60 tx=0x7f84ac0012b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.435+0000 7f84b6953640 1 --2- 172.21.15.146:0/1624690596 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564dc39f5eb0 0x564dc3af41b0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.435+0000 7f84b6953640 1 -- 172.21.15.146:0/1624690596 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f84b00083e0 con 0x564dc39f5eb0 2024-09-18T01:45:24.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.435+0000 7f84bae36800 1 -- 172.21.15.146:0/1624690596 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564dc3af1760 con 0x564dc39f5eb0 2024-09-18T01:45:24.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.435+0000 7f84b6953640 1 -- 172.21.15.146:0/1624690596 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f84b00083e0 con 0x564dc39f5eb0 2024-09-18T01:45:24.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.435+0000 7f84bae36800 1 -- 172.21.15.146:0/1624690596 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564dc3af65a0 con 0x564dc39f5eb0 2024-09-18T01:45:24.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.435+0000 7f84b6953640 1 -- 172.21.15.146:0/1624690596 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f84b00083e0 con 0x564dc39f5eb0 2024-09-18T01:45:24.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.436+0000 7f84bae36800 1 -- 172.21.15.146:0/1624690596 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564dc3af57d0 con 0x564dc39f5eb0 2024-09-18T01:45:24.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.436+0000 7f84b6953640 1 -- 172.21.15.146:0/1624690596 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f84b00083e0 con 0x564dc39f5eb0 2024-09-18T01:45:24.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.436+0000 7f84bae36800 1 --2- 172.21.15.146:0/1624690596 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x564dc3af7950 0x564dc3af9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.436+0000 7f84bae36800 1 -- 172.21.15.146:0/1624690596 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564dc3afa280 con 0x564dc3af7950 2024-09-18T01:45:24.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.436+0000 7f84b6152640 1 --2- 172.21.15.146:0/1624690596 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x564dc3af7950 0x564dc3af9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.436+0000 7f84b6152640 1 --2- 172.21.15.146:0/1624690596 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x564dc3af7950 0x564dc3af9d40 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.436+0000 7f84b6152640 1 -- 172.21.15.146:0/1624690596 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f84a8077930 con 0x564dc3af7950 2024-09-18T01:45:24.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.437+0000 7f84bae36800 1 Processor -- start 2024-09-18T01:45:24.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.437+0000 7f84bae36800 1 -- start start 2024-09-18T01:45:24.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.437+0000 7f84bae36800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564dc3b07f40 0x564dc3b08360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.437+0000 7f84bae36800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x564dc3891580 con 0x564dc3b07f40 2024-09-18T01:45:24.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.437+0000 7f84b6953640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564dc3b07f40 0x564dc3b08360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.437+0000 7f84b6953640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564dc3b07f40 0x564dc3b08360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60046/0 (socket says 172.21.15.146:60046) 2024-09-18T01:45:24.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.437+0000 7f84b6953640 1 -- 172.21.15.146:0/3702666899 learned_addr learned my addr 172.21.15.146:0/3702666899 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:24.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.438+0000 7f84b6953640 1 -- 172.21.15.146:0/3702666899 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564dc3b088a0 con 0x564dc3b07f40 2024-09-18T01:45:24.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.438+0000 7f84b6953640 1 --2- 172.21.15.146:0/3702666899 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564dc3b07f40 0x564dc3b08360 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x564dc396a2a0 tx=0x7f84b000ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.438+0000 7f839bfff640 1 -- 172.21.15.146:0/3702666899 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84b001c070 con 0x564dc3b07f40 2024-09-18T01:45:24.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.438+0000 7f839bfff640 1 -- 172.21.15.146:0/3702666899 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84b000bdc0 con 0x564dc3b07f40 2024-09-18T01:45:24.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.438+0000 7f839bfff640 1 -- 172.21.15.146:0/3702666899 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84b0018540 con 0x564dc3b07f40 2024-09-18T01:45:24.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.438+0000 7f84bae36800 1 -- 172.21.15.146:0/3702666899 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564dc3b08b30 con 0x564dc3b07f40 2024-09-18T01:45:24.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.438+0000 7f84bae36800 1 -- 172.21.15.146:0/3702666899 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564dc3b0b810 con 0x564dc3b07f40 2024-09-18T01:45:24.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.439+0000 7f839bfff640 1 -- 172.21.15.146:0/3702666899 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f84b001f070 con 0x564dc3b07f40 2024-09-18T01:45:24.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.439+0000 7f839bfff640 1 --2- 172.21.15.146:0/3702666899 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8390036b40 0x7f8390039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.439+0000 7f839bfff640 1 -- 172.21.15.146:0/3702666899 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f84b004e5f0 con 0x564dc3b07f40 2024-09-18T01:45:24.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.439+0000 7f84b6152640 1 --2- 172.21.15.146:0/3702666899 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8390036b40 0x7f8390039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.439+0000 7f84bae36800 1 Processor -- start 2024-09-18T01:45:24.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.439+0000 7f84bae36800 1 -- start start 2024-09-18T01:45:24.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.439+0000 7f84b6152640 1 --2- 172.21.15.146:0/3702666899 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8390036b40 0x7f8390039000 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f84a804ffd0 tx=0x7f84a8077be0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.439+0000 7f84bae36800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564dc3b14c30 0x564dc3b15030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.439+0000 7f84bae36800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x564dc3ae4f80 con 0x564dc3b14c30 2024-09-18T01:45:24.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.440+0000 7f84b6953640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564dc3b14c30 0x564dc3b15030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.440+0000 7f84b6953640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564dc3b14c30 0x564dc3b15030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60050/0 (socket says 172.21.15.146:60050) 2024-09-18T01:45:24.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.440+0000 7f84b6953640 1 -- 172.21.15.146:0/3481726067 learned_addr learned my addr 172.21.15.146:0/3481726067 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:24.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.440+0000 7f84b6953640 1 -- 172.21.15.146:0/3481726067 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564dc3b15600 con 0x564dc3b14c30 2024-09-18T01:45:24.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.440+0000 7f84b6953640 1 --2- 172.21.15.146:0/3481726067 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564dc3b14c30 0x564dc3b15030 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f84b004c940 tx=0x7f84b004cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4819bd9e03a0f4d server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.440+0000 7f8399ffb640 1 -- 172.21.15.146:0/3481726067 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84b0017520 con 0x564dc3b14c30 2024-09-18T01:45:24.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.440+0000 7f8399ffb640 1 -- 172.21.15.146:0/3481726067 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84b004a030 con 0x564dc3b14c30 2024-09-18T01:45:24.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.440+0000 7f8399ffb640 1 -- 172.21.15.146:0/3481726067 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84b0029da0 con 0x564dc3b14c30 2024-09-18T01:45:24.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.440+0000 7f84bae36800 1 -- 172.21.15.146:0/3481726067 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564dc3b14c30 msgr2=0x564dc3b15030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.441+0000 7f84bae36800 1 --2- 172.21.15.146:0/3481726067 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564dc3b14c30 0x564dc3b15030 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f84b004c940 tx=0x7f84b004cbf0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.441+0000 7f84bae36800 1 -- 172.21.15.146:0/3481726067 shutdown_connections 2024-09-18T01:45:24.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.441+0000 7f84bae36800 1 --2- 172.21.15.146:0/3481726067 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564dc3b14c30 0x564dc3b15030 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.441+0000 7f84bae36800 1 -- 172.21.15.146:0/3481726067 >> 172.21.15.146:0/3481726067 conn(0x564dc3b10f90 msgr2=0x564dc3b0f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:24.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.441+0000 7f84bae36800 1 -- 172.21.15.146:0/3481726067 shutdown_connections 2024-09-18T01:45:24.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.441+0000 7f84bae36800 1 -- 172.21.15.146:0/3481726067 wait complete. 2024-09-18T01:45:24.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.441+0000 7f84bae36800 1 Processor -- start 2024-09-18T01:45:24.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.441+0000 7f84bae36800 1 -- start start 2024-09-18T01:45:24.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.441+0000 7f84bae36800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564dc3b14c30 0x564dc3b1c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.441+0000 7f84bae36800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x564dc3b15c70 con 0x564dc3b14c30 2024-09-18T01:45:24.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.441+0000 7f84b6953640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564dc3b14c30 0x564dc3b1c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.441+0000 7f84b6953640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564dc3b14c30 0x564dc3b1c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60062/0 (socket says 172.21.15.146:60062) 2024-09-18T01:45:24.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.441+0000 7f84b6953640 1 -- 172.21.15.146:0/2971182954 learned_addr learned my addr 172.21.15.146:0/2971182954 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:24.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.442+0000 7f84b6953640 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564dc3b1c620 con 0x564dc3b14c30 2024-09-18T01:45:24.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.442+0000 7f84b6953640 1 --2- 172.21.15.146:0/2971182954 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564dc3b14c30 0x564dc3b1c0e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f84b004c940 tx=0x7f84b004c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.442+0000 7f8387fff640 1 -- 172.21.15.146:0/2971182954 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84b0016b90 con 0x564dc3b14c30 2024-09-18T01:45:24.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.442+0000 7f8387fff640 1 -- 172.21.15.146:0/2971182954 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84b0016d30 con 0x564dc3b14c30 2024-09-18T01:45:24.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.442+0000 7f84bae36800 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564dc3b1c8b0 con 0x564dc3b14c30 2024-09-18T01:45:24.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.442+0000 7f8387fff640 1 -- 172.21.15.146:0/2971182954 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84b0018730 con 0x564dc3b14c30 2024-09-18T01:45:24.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.442+0000 7f84bae36800 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564dc3b1f560 con 0x564dc3b14c30 2024-09-18T01:45:24.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.443+0000 7f8387fff640 1 -- 172.21.15.146:0/2971182954 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f84b00189c0 con 0x564dc3b14c30 2024-09-18T01:45:24.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.443+0000 7f8387fff640 1 --2- 172.21.15.146:0/2971182954 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8380036b40 0x7f8380039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.443+0000 7f8387fff640 1 -- 172.21.15.146:0/2971182954 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f84b0033070 con 0x564dc3b14c30 2024-09-18T01:45:24.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.443+0000 7f84b6152640 1 --2- 172.21.15.146:0/2971182954 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8380036b40 0x7f8380039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.443+0000 7f84b6152640 1 --2- 172.21.15.146:0/2971182954 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8380036b40 0x7f8380039000 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f84a800a3f0 tx=0x7f84a8096000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.443+0000 7f84bae36800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.444+0000 7f84bae36800 1 --2- 172.21.15.146:0/2971182954 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564dc3b27b40 0x564dc3b2a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.444+0000 7f84bae36800 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b2a750 con 0x564dc3b27b40 2024-09-18T01:45:24.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.444+0000 7f84b5951640 1 --2- 172.21.15.146:0/2971182954 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564dc3b27b40 0x564dc3b2a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.444+0000 7f84b5951640 1 --2- 172.21.15.146:0/2971182954 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564dc3b27b40 0x564dc3b2a000 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.444+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f84ac009050 con 0x564dc3b27b40 2024-09-18T01:45:24.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.444+0000 7f84bae36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.444+0000 7f84bae36800 20 realm 2024-09-18T01:45:24.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.444+0000 7f84bae36800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.444+0000 7f84bae36800 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b26f90 con 0x564dc3b27b40 2024-09-18T01:45:24.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.444+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f84ac009050 con 0x564dc3b27b40 2024-09-18T01:45:24.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.444+0000 7f84bae36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.444+0000 7f84bae36800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:24.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.444+0000 7f84bae36800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.444+0000 7f84bae36800 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b2b240 con 0x564dc3b27b40 2024-09-18T01:45:24.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.445+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f84ac009050 con 0x564dc3b27b40 2024-09-18T01:45:24.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.445+0000 7f84bae36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.445+0000 7f84bae36800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.445+0000 7f84bae36800 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b2bb10 con 0x564dc3b27b40 2024-09-18T01:45:24.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.445+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f84ac009050 con 0x564dc3b27b40 2024-09-18T01:45:24.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.445+0000 7f84bae36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:24.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.445+0000 7f84bae36800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.445+0000 7f84bae36800 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b2beb0 con 0x564dc3b27b40 2024-09-18T01:45:24.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.445+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f84ac009050 con 0x564dc3b27b40 2024-09-18T01:45:24.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.445+0000 7f84bae36800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:24.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.445+0000 7f84bae36800 20 searching for the correct realm 2024-09-18T01:45:24.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.445+0000 7f84bae36800 1 --2- 172.21.15.146:0/2971182954 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x564dc3b2dd90 0x564dc3b30180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.445+0000 7f84bae36800 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b30830 con 0x564dc3b2dd90 2024-09-18T01:45:24.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.445+0000 7f84b6953640 1 --2- 172.21.15.146:0/2971182954 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x564dc3b2dd90 0x564dc3b30180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.446+0000 7f84b6953640 1 --2- 172.21.15.146:0/2971182954 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x564dc3b2dd90 0x564dc3b30180 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.446+0000 7f84b6953640 1 -- 172.21.15.146:0/2971182954 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84b003d020 con 0x564dc3b2dd90 2024-09-18T01:45:24.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.446+0000 7f84b6953640 1 --2- 172.21.15.146:0/2971182954 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f84b00163a0 0x7f84b0040390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.446+0000 7f84b6953640 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b30830 con 0x7f84b00163a0 2024-09-18T01:45:24.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.446+0000 7f84b6152640 1 --2- 172.21.15.146:0/2971182954 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f84b00163a0 0x7f84b0040390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.446+0000 7f84b6152640 1 --2- 172.21.15.146:0/2971182954 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f84b00163a0 0x7f84b0040390 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.446+0000 7f84b6152640 1 -- 172.21.15.146:0/2971182954 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84a8077930 con 0x7f84b00163a0 2024-09-18T01:45:24.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.446+0000 7f84b6152640 1 --2- 172.21.15.146:0/2971182954 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f84a804f3f0 0x7f84a806c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.446+0000 7f84b6152640 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b30830 con 0x7f84a804f3f0 2024-09-18T01:45:24.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.447+0000 7f84b5951640 1 --2- 172.21.15.146:0/2971182954 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f84a804f3f0 0x7f84a806c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.447+0000 7f84b5951640 1 --2- 172.21.15.146:0/2971182954 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f84a804f3f0 0x7f84a806c590 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.447+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84ac009050 con 0x7f84a804f3f0 2024-09-18T01:45:24.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.447+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b30830 con 0x564dc3b27b40 2024-09-18T01:45:24.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.447+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f84ac009050 con 0x564dc3b27b40 2024-09-18T01:45:24.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.447+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b30830 con 0x564dc3b27b40 2024-09-18T01:45:24.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.448+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84ac02a040 con 0x564dc3b27b40 2024-09-18T01:45:24.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.448+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b30830 con 0x7f84a804f3f0 2024-09-18T01:45:24.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.448+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84ac02a040 con 0x7f84a804f3f0 2024-09-18T01:45:24.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.448+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b30830 con 0x7f84a804f3f0 2024-09-18T01:45:24.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.448+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84ac02a040 con 0x7f84a804f3f0 2024-09-18T01:45:24.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.448+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b30830 con 0x7f84b00163a0 2024-09-18T01:45:24.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.448+0000 7f84b6152640 1 -- 172.21.15.146:0/2971182954 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84a8077930 con 0x7f84b00163a0 2024-09-18T01:45:24.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.448+0000 7f84b6152640 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b30830 con 0x564dc3b2dd90 2024-09-18T01:45:24.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.449+0000 7f84b6953640 1 -- 172.21.15.146:0/2971182954 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84b003d020 con 0x564dc3b2dd90 2024-09-18T01:45:24.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.449+0000 7f84b6953640 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b30830 con 0x564dc3b27b40 2024-09-18T01:45:24.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.449+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84ac02a040 con 0x564dc3b27b40 2024-09-18T01:45:24.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.449+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b30830 con 0x7f84a804f3f0 2024-09-18T01:45:24.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.449+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84ac02a040 con 0x7f84a804f3f0 2024-09-18T01:45:24.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.449+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b30830 con 0x564dc3b27b40 2024-09-18T01:45:24.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.449+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84ac02a040 con 0x564dc3b27b40 2024-09-18T01:45:24.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.449+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b30830 con 0x7f84b00163a0 2024-09-18T01:45:24.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.449+0000 7f84b6152640 1 -- 172.21.15.146:0/2971182954 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f84a8077930 con 0x7f84b00163a0 2024-09-18T01:45:24.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.449+0000 7f84b6152640 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b30830 con 0x564dc3b2dd90 2024-09-18T01:45:24.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.450+0000 7f84b6953640 1 -- 172.21.15.146:0/2971182954 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84b003d020 con 0x564dc3b2dd90 2024-09-18T01:45:24.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.450+0000 7f84b6953640 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b30830 con 0x564dc3b2dd90 2024-09-18T01:45:24.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.450+0000 7f84b6953640 1 -- 172.21.15.146:0/2971182954 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84b003d020 con 0x564dc3b2dd90 2024-09-18T01:45:24.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.450+0000 7f84b6953640 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b30830 con 0x7f84a804f3f0 2024-09-18T01:45:24.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.450+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84ac02a040 con 0x7f84a804f3f0 2024-09-18T01:45:24.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.450+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b30830 con 0x564dc3b2dd90 2024-09-18T01:45:24.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.450+0000 7f84b6953640 1 -- 172.21.15.146:0/2971182954 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84b003d020 con 0x564dc3b2dd90 2024-09-18T01:45:24.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.450+0000 7f84b6953640 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b30830 con 0x564dc3b2dd90 2024-09-18T01:45:24.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.450+0000 7f84b6953640 1 -- 172.21.15.146:0/2971182954 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84b003d020 con 0x564dc3b2dd90 2024-09-18T01:45:24.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.450+0000 7f84b6953640 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b30830 con 0x564dc3b27b40 2024-09-18T01:45:24.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.451+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84ac02a040 con 0x564dc3b27b40 2024-09-18T01:45:24.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.451+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b30830 con 0x564dc3b27b40 2024-09-18T01:45:24.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.451+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f84ac02a040 con 0x564dc3b27b40 2024-09-18T01:45:24.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.451+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b30830 con 0x7f84a804f3f0 2024-09-18T01:45:24.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.451+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84ac02a040 con 0x7f84a804f3f0 2024-09-18T01:45:24.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.451+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b30830 con 0x564dc3b2dd90 2024-09-18T01:45:24.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.451+0000 7f84b6953640 1 -- 172.21.15.146:0/2971182954 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84b003d020 con 0x564dc3b2dd90 2024-09-18T01:45:24.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.451+0000 7f84b6953640 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b30830 con 0x7f84b00163a0 2024-09-18T01:45:24.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.452+0000 7f84b6152640 1 -- 172.21.15.146:0/2971182954 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84a8077930 con 0x7f84b00163a0 2024-09-18T01:45:24.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.452+0000 7f84b6152640 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b30830 con 0x564dc3b27b40 2024-09-18T01:45:24.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.452+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84ac02a040 con 0x564dc3b27b40 2024-09-18T01:45:24.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.452+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b30830 con 0x7f84a804f3f0 2024-09-18T01:45:24.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.452+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84ac02a040 con 0x7f84a804f3f0 2024-09-18T01:45:24.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.452+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b30830 con 0x564dc3b2dd90 2024-09-18T01:45:24.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.452+0000 7f84b6953640 1 -- 172.21.15.146:0/2971182954 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84b003d020 con 0x564dc3b2dd90 2024-09-18T01:45:24.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.452+0000 7f84b6953640 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b30830 con 0x7f84a804f3f0 2024-09-18T01:45:24.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.453+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84ac02a040 con 0x7f84a804f3f0 2024-09-18T01:45:24.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.453+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b30830 con 0x7f84b00163a0 2024-09-18T01:45:24.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.453+0000 7f84b6152640 1 -- 172.21.15.146:0/2971182954 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84a8077930 con 0x7f84b00163a0 2024-09-18T01:45:24.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.453+0000 7f84b6152640 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b30830 con 0x564dc3b2dd90 2024-09-18T01:45:24.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.453+0000 7f84b6953640 1 -- 172.21.15.146:0/2971182954 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84b003d020 con 0x564dc3b2dd90 2024-09-18T01:45:24.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.453+0000 7f84b6953640 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b30830 con 0x7f84a804f3f0 2024-09-18T01:45:24.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.453+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84ac02a040 con 0x7f84a804f3f0 2024-09-18T01:45:24.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.453+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b30830 con 0x564dc3b27b40 2024-09-18T01:45:24.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.454+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f84ac02a040 con 0x564dc3b27b40 2024-09-18T01:45:24.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.454+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b30830 con 0x7f84b00163a0 2024-09-18T01:45:24.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.454+0000 7f84b6152640 1 -- 172.21.15.146:0/2971182954 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84a8077930 con 0x7f84b00163a0 2024-09-18T01:45:24.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.454+0000 7f84bae36800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:24.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.454+0000 7f84bae36800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:24.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.454+0000 7f84bae36800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:24.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.454+0000 7f84bae36800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:24.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.454+0000 7f84bae36800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:24.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.454+0000 7f84bae36800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:24.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.454+0000 7f84bae36800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.454+0000 7f84bae36800 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b2c860 con 0x564dc3b27b40 2024-09-18T01:45:24.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.454+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f84ac02a040 con 0x564dc3b27b40 2024-09-18T01:45:24.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.454+0000 7f84bae36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.454+0000 7f84bae36800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.454+0000 7f84bae36800 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b2d100 con 0x564dc3b27b40 2024-09-18T01:45:24.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.454+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f84ac02a040 con 0x564dc3b27b40 2024-09-18T01:45:24.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.454+0000 7f84bae36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:24.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.454+0000 7f84bae36800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.454+0000 7f84bae36800 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b30cb0 con 0x7f84b00163a0 2024-09-18T01:45:24.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.455+0000 7f84b6152640 1 -- 172.21.15.146:0/2971182954 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f84a8077930 con 0x7f84b00163a0 2024-09-18T01:45:24.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.455+0000 7f84bae36800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:24.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.455+0000 7f84bae36800 20 zone default found 2024-09-18T01:45:24.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.455+0000 7f84bae36800 4 Realm: () 2024-09-18T01:45:24.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.455+0000 7f84bae36800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:24.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.455+0000 7f84bae36800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:24.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.455+0000 7f84bae36800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:24.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.455+0000 7f84bae36800 20 zonegroup default 2024-09-18T01:45:24.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.455+0000 7f84bae36800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.455+0000 7f84bae36800 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b31500 con 0x7f84a804f3f0 2024-09-18T01:45:24.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.455+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f84ac02a040 con 0x7f84a804f3f0 2024-09-18T01:45:24.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.455+0000 7f84bae36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.455+0000 7f84bae36800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.455+0000 7f84bae36800 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b32f40 con 0x564dc3b2dd90 2024-09-18T01:45:24.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.455+0000 7f84b6953640 1 -- 172.21.15.146:0/2971182954 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f84b003d020 con 0x564dc3b2dd90 2024-09-18T01:45:24.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.455+0000 7f84bae36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.455+0000 7f84bae36800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.455+0000 7f84bae36800 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b33480 con 0x564dc3b2dd90 2024-09-18T01:45:24.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.456+0000 7f84b6953640 1 -- 172.21.15.146:0/2971182954 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f84b003d020 con 0x564dc3b2dd90 2024-09-18T01:45:24.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.456+0000 7f84bae36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.456+0000 7f84bae36800 20 started sync module instance, tier type = 2024-09-18T01:45:24.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.456+0000 7f84bae36800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:24.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.456+0000 7f84bae36800 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b32320 con 0x7f84b00163a0 2024-09-18T01:45:24.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.457+0000 7f84b6152640 1 -- 172.21.15.146:0/2971182954 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v31'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84a8077930 con 0x7f84b00163a0 2024-09-18T01:45:24.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.457+0000 7f84bae36800 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94891995766384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b338e0 con 0x7f84b00163a0 2024-09-18T01:45:24.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.457+0000 7f84bae36800 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b34130 con 0x564dc3b27b40 2024-09-18T01:45:24.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.458+0000 7f84b6152640 1 -- 172.21.15.146:0/2971182954 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94891995766384] v31'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84a8077930 con 0x7f84b00163a0 2024-09-18T01:45:24.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.458+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v31'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84ac02a040 con 0x564dc3b27b40 2024-09-18T01:45:24.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.458+0000 7f84bae36800 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94891995774080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b34550 con 0x564dc3b27b40 2024-09-18T01:45:24.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.458+0000 7f84bae36800 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b34de0 con 0x564dc3b2dd90 2024-09-18T01:45:24.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.459+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94891995774080] v31'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84ac02a040 con 0x564dc3b27b40 2024-09-18T01:45:24.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.459+0000 7f84b6953640 1 -- 172.21.15.146:0/2971182954 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v31'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84b003d020 con 0x564dc3b2dd90 2024-09-18T01:45:24.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.459+0000 7f84bae36800 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94891995775136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b34970 con 0x564dc3b2dd90 2024-09-18T01:45:24.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.459+0000 7f84bae36800 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b35880 con 0x7f84b00163a0 2024-09-18T01:45:24.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.460+0000 7f84b6953640 1 -- 172.21.15.146:0/2971182954 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94891995775136] v31'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84b003d020 con 0x564dc3b2dd90 2024-09-18T01:45:24.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.460+0000 7f84b6152640 1 -- 172.21.15.146:0/2971182954 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v31'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84a8077930 con 0x7f84b00163a0 2024-09-18T01:45:24.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.460+0000 7f84bae36800 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94891995776192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b348e0 con 0x7f84b00163a0 2024-09-18T01:45:24.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.460+0000 7f84bae36800 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b36740 con 0x564dc3b27b40 2024-09-18T01:45:24.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.461+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v31'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84ac02a040 con 0x564dc3b27b40 2024-09-18T01:45:24.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.461+0000 7f84bae36800 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94891995783824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b36b60 con 0x564dc3b27b40 2024-09-18T01:45:24.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.461+0000 7f84bae36800 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b37660 con 0x7f84a804f3f0 2024-09-18T01:45:24.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.463+0000 7f84b6152640 1 -- 172.21.15.146:0/2971182954 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94891995776192] v31'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84a8077930 con 0x7f84b00163a0 2024-09-18T01:45:24.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.463+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94891995783824] v31'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84ac02a040 con 0x564dc3b27b40 2024-09-18T01:45:24.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.463+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v31'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84ac02a040 con 0x7f84a804f3f0 2024-09-18T01:45:24.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.463+0000 7f84bae36800 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94891995787600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b366b0 con 0x7f84a804f3f0 2024-09-18T01:45:24.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.463+0000 7f84bae36800 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b37f30 con 0x7f84a804f3f0 2024-09-18T01:45:24.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.464+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94891995787600] v31'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84ac02a040 con 0x7f84a804f3f0 2024-09-18T01:45:24.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.464+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v31'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84ac02a040 con 0x7f84a804f3f0 2024-09-18T01:45:24.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.464+0000 7f84bae36800 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94891995782256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b366b0 con 0x7f84a804f3f0 2024-09-18T01:45:24.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.464+0000 7f84bae36800 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b384b0 con 0x7f84a804f3f0 2024-09-18T01:45:24.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.465+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94891995782256] v31'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84ac02a040 con 0x7f84a804f3f0 2024-09-18T01:45:24.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.465+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v31'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84ac02a040 con 0x7f84a804f3f0 2024-09-18T01:45:24.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.465+0000 7f84bae36800 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94891995791232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b38470 con 0x7f84a804f3f0 2024-09-18T01:45:24.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.465+0000 7f84bae36800 20 add_watcher() i=0 2024-09-18T01:45:24.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.465+0000 7f84bae36800 20 add_watcher() i=1 2024-09-18T01:45:24.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.465+0000 7f84bae36800 20 add_watcher() i=2 2024-09-18T01:45:24.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.465+0000 7f84bae36800 20 add_watcher() i=3 2024-09-18T01:45:24.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.465+0000 7f84bae36800 20 add_watcher() i=4 2024-09-18T01:45:24.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.465+0000 7f84bae36800 20 add_watcher() i=5 2024-09-18T01:45:24.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.465+0000 7f84bae36800 20 add_watcher() i=6 2024-09-18T01:45:24.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.466+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94891995791232] v31'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84ac02a040 con 0x7f84a804f3f0 2024-09-18T01:45:24.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.467+0000 7f84bae36800 20 add_watcher() i=7 2024-09-18T01:45:24.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.467+0000 7f84bae36800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:24.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.467+0000 7f84bae36800 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b3b8d0 con 0x564dc3b27b40 2024-09-18T01:45:24.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.467+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f84ac02a040 con 0x564dc3b27b40 2024-09-18T01:45:24.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.467+0000 7f84bae36800 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94891995789616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b38df0 con 0x564dc3b27b40 2024-09-18T01:45:24.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.468+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94891995789616] v31'78 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f84ac02a040 con 0x564dc3b27b40 2024-09-18T01:45:24.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.468+0000 7f836cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:24.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.468+0000 7f84bae36800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:24.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.468+0000 7f84bae36800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:24.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.468+0000 7f84bae36800 5 note: GC not initialized 2024-09-18T01:45:24.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.468+0000 7f82e77fe640 20 reqs_thread_entry: start 2024-09-18T01:45:24.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.468+0000 7f84bae36800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:24.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.468+0000 7f84bae36800 20 Filter name: none 2024-09-18T01:45:24.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.469+0000 7f82e57fa640 20 reqs_thread_entry: start 2024-09-18T01:45:24.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.469+0000 7f84bae36800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T01:45:24.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.469+0000 7f84bae36800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.469+0000 7f84bae36800 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b6ed20 con 0x564dc3b27b40 2024-09-18T01:45:24.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.469+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f84ac02a040 con 0x564dc3b27b40 2024-09-18T01:45:24.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.469+0000 7f84bae36800 20 rados_obj.operate() r=0 bl.length=556 2024-09-18T01:45:24.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.469+0000 7f84bae36800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T01:45:24.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.469+0000 7f84bae36800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:45:24.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.469+0000 7f84bae36800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:45:24.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.469+0000 7f84bae36800 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b75520 con 0x564dc3b27b40 2024-09-18T01:45:24.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.470+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v31'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f84ac02a040 con 0x564dc3b27b40 2024-09-18T01:45:24.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.470+0000 7f84bae36800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:45:24.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.470+0000 7f84bae36800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:45:24.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.470+0000 7f84bae36800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-18T01:45:24.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.470+0000 7f84bae36800 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94891996040928 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b70ba0 con 0x564dc3b27b40 2024-09-18T01:45:24.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.470+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== watch-notify(notify (1) cookie 94891995783824 notify 133143986182 ret 0) ==== 774+0+0 (crc 0 0 0) 0x564dc38b5b30 con 0x564dc3b27b40 2024-09-18T01:45:24.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.470+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(64 notify.4 [notify cookie 94891996040928 out=8b] v0'0 uv57 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f84ac02a040 con 0x564dc3b27b40 2024-09-18T01:45:24.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.470+0000 7f8399ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986182 cookie 94891995783824 notifier 4376 bl.length()=732 2024-09-18T01:45:24.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.470+0000 7f8399ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:45:24.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.470+0000 7f8399ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:45:24.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.470+0000 7f8399ffb640 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f837c003ea0 con 0x564dc3b27b40 2024-09-18T01:45:24.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.471+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== watch-notify(notify_complete (2) cookie 94891996040928 notify 133143986182 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f84ac02eb60 con 0x564dc3b27b40 2024-09-18T01:45:24.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.471+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84ac02a040 con 0x564dc3b27b40 2024-09-18T01:45:24.481 INFO:teuthology.orchestra.run.smithi146.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T01:45:23.010714Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:45:23.010705Z","tags":[],"group_ids":[]} 2024-09-18T01:45:24.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.472+0000 7f836cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:24.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.472+0000 7f84bae36800 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94891995789616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b706f0 con 0x564dc3b27b40 2024-09-18T01:45:24.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.473+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 <== osd.1 v2:172.21.15.146:6808/3930274777 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94891995789616] v31'79 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f84ac02a040 con 0x564dc3b27b40 2024-09-18T01:45:24.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.473+0000 7f84bae36800 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94891995766384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b6ca50 con 0x7f84b00163a0 2024-09-18T01:45:24.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.474+0000 7f84b6152640 1 -- 172.21.15.146:0/2971182954 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94891995766384] v31'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84a8077930 con 0x7f84b00163a0 2024-09-18T01:45:24.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.474+0000 7f84bae36800 20 remove_watcher() i=0 2024-09-18T01:45:24.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.474+0000 7f84bae36800 2 removed watcher, disabling cache 2024-09-18T01:45:24.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.474+0000 7f84bae36800 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94891995774080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b6ca50 con 0x564dc3b27b40 2024-09-18T01:45:24.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.475+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 <== osd.1 v2:172.21.15.146:6808/3930274777 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94891995774080] v31'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84ac02a040 con 0x564dc3b27b40 2024-09-18T01:45:24.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.475+0000 7f84bae36800 20 remove_watcher() i=1 2024-09-18T01:45:24.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.475+0000 7f84bae36800 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94891995775136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b6ca50 con 0x564dc3b2dd90 2024-09-18T01:45:24.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.476+0000 7f84b6953640 1 -- 172.21.15.146:0/2971182954 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94891995775136] v31'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84b003d020 con 0x564dc3b2dd90 2024-09-18T01:45:24.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.476+0000 7f84bae36800 20 remove_watcher() i=2 2024-09-18T01:45:24.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.476+0000 7f84bae36800 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94891995776192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b6ca50 con 0x7f84b00163a0 2024-09-18T01:45:24.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.477+0000 7f84b6152640 1 -- 172.21.15.146:0/2971182954 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94891995776192] v31'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84a8077930 con 0x7f84b00163a0 2024-09-18T01:45:24.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.477+0000 7f84bae36800 20 remove_watcher() i=3 2024-09-18T01:45:24.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.477+0000 7f84bae36800 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94891995783824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b6ca50 con 0x564dc3b27b40 2024-09-18T01:45:24.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.478+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 <== osd.1 v2:172.21.15.146:6808/3930274777 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94891995783824] v31'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84ac02a040 con 0x564dc3b27b40 2024-09-18T01:45:24.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.478+0000 7f84bae36800 20 remove_watcher() i=4 2024-09-18T01:45:24.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.478+0000 7f84bae36800 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94891995787600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b6ca50 con 0x7f84a804f3f0 2024-09-18T01:45:24.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.479+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94891995787600] v31'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84ac02a040 con 0x7f84a804f3f0 2024-09-18T01:45:24.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.479+0000 7f84bae36800 20 remove_watcher() i=5 2024-09-18T01:45:24.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.479+0000 7f84bae36800 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94891995782256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b6ca50 con 0x7f84a804f3f0 2024-09-18T01:45:24.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.480+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94891995782256] v31'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84ac02a040 con 0x7f84a804f3f0 2024-09-18T01:45:24.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.480+0000 7f84bae36800 20 remove_watcher() i=6 2024-09-18T01:45:24.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.480+0000 7f84bae36800 1 -- 172.21.15.146:0/2971182954 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94891995791232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564dc3b6ca50 con 0x7f84a804f3f0 2024-09-18T01:45:24.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.481+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94891995791232] v31'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84ac02a040 con 0x7f84a804f3f0 2024-09-18T01:45:24.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.481+0000 7f84bae36800 20 remove_watcher() i=7 2024-09-18T01:45:24.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.481+0000 7f84bae36800 1 -- 172.21.15.146:0/2971182954 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f84a804f3f0 msgr2=0x7f84a806c590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.481+0000 7f84bae36800 1 --2- 172.21.15.146:0/2971182954 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f84a804f3f0 0x7f84a806c590 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.481+0000 7f84bae36800 1 -- 172.21.15.146:0/2971182954 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564dc3b27b40 msgr2=0x564dc3b2a000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.481+0000 7f84bae36800 1 --2- 172.21.15.146:0/2971182954 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564dc3b27b40 0x564dc3b2a000 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.481+0000 7f84bae36800 1 -- 172.21.15.146:0/2971182954 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f84b00163a0 msgr2=0x7f84b0040390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.481+0000 7f84bae36800 1 --2- 172.21.15.146:0/2971182954 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f84b00163a0 0x7f84b0040390 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.481+0000 7f84bae36800 1 -- 172.21.15.146:0/2971182954 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x564dc3b2dd90 msgr2=0x564dc3b30180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.481+0000 7f84bae36800 1 --2- 172.21.15.146:0/2971182954 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x564dc3b2dd90 0x564dc3b30180 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.481+0000 7f84bae36800 1 -- 172.21.15.146:0/2971182954 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8380036b40 msgr2=0x7f8380039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.481+0000 7f84bae36800 1 --2- 172.21.15.146:0/2971182954 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8380036b40 0x7f8380039000 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f84a800a3f0 tx=0x7f84a8096000 comp rx=0 tx=0).stop 2024-09-18T01:45:24.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.481+0000 7f84bae36800 1 -- 172.21.15.146:0/2971182954 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564dc3b14c30 msgr2=0x564dc3b1c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.481+0000 7f84b5951640 1 -- 172.21.15.146:0/2971182954 reap_dead start 2024-09-18T01:45:24.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.481+0000 7f84bae36800 1 --2- 172.21.15.146:0/2971182954 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564dc3b14c30 0x564dc3b1c0e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f84b004c940 tx=0x7f84b004c8d0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.481+0000 7f84bae36800 1 -- 172.21.15.146:0/2971182954 shutdown_connections 2024-09-18T01:45:24.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.481+0000 7f84bae36800 1 --2- 172.21.15.146:0/2971182954 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564dc3b14c30 0x564dc3b1c0e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.481+0000 7f84bae36800 1 -- 172.21.15.146:0/2971182954 >> 172.21.15.146:0/2971182954 conn(0x564dc3b10f90 msgr2=0x564dc3b0f060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:24.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.481+0000 7f84bae36800 1 -- 172.21.15.146:0/2971182954 shutdown_connections 2024-09-18T01:45:24.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.481+0000 7f84bae36800 1 -- 172.21.15.146:0/2971182954 wait complete. 2024-09-18T01:45:24.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.481+0000 7f84bae36800 1 -- 172.21.15.146:0/3702666899 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8390036b40 msgr2=0x7f8390039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.481+0000 7f84bae36800 1 --2- 172.21.15.146:0/3702666899 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8390036b40 0x7f8390039000 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f84a804ffd0 tx=0x7f84a8077be0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.481+0000 7f84bae36800 1 -- 172.21.15.146:0/3702666899 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564dc3b07f40 msgr2=0x564dc3b08360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.481+0000 7f84bae36800 1 --2- 172.21.15.146:0/3702666899 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564dc3b07f40 0x564dc3b08360 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x564dc396a2a0 tx=0x7f84b000ef30 comp rx=0 tx=0).stop 2024-09-18T01:45:24.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.481+0000 7f84bae36800 1 -- 172.21.15.146:0/3702666899 shutdown_connections 2024-09-18T01:45:24.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.481+0000 7f84bae36800 1 --2- 172.21.15.146:0/3702666899 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8390036b40 0x7f8390039000 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.481+0000 7f84bae36800 1 --2- 172.21.15.146:0/3702666899 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564dc3b07f40 0x564dc3b08360 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.481+0000 7f84bae36800 1 -- 172.21.15.146:0/3702666899 >> 172.21.15.146:0/3702666899 conn(0x564dc3afced0 msgr2=0x564dc3affa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:24.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.482+0000 7f84bae36800 1 -- 172.21.15.146:0/3702666899 shutdown_connections 2024-09-18T01:45:24.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.482+0000 7f84bae36800 1 -- 172.21.15.146:0/3702666899 wait complete. 2024-09-18T01:45:24.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.482+0000 7f84bae36800 1 -- 172.21.15.146:0/1624690596 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564dc39f5eb0 msgr2=0x564dc3af41b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.482+0000 7f84bae36800 1 --2- 172.21.15.146:0/1624690596 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564dc39f5eb0 0x564dc3af41b0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.482+0000 7f84bae36800 1 -- 172.21.15.146:0/1624690596 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x564dc3af7950 msgr2=0x564dc3af9d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.482+0000 7f84bae36800 1 --2- 172.21.15.146:0/1624690596 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x564dc3af7950 0x564dc3af9d40 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.482+0000 7f84bae36800 1 -- 172.21.15.146:0/1624690596 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f839c036b40 msgr2=0x7f839c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.482+0000 7f84bae36800 1 --2- 172.21.15.146:0/1624690596 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f839c036b40 0x7f839c039000 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f84ac000f60 tx=0x7f84ac0012b0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.482+0000 7f84bae36800 1 -- 172.21.15.146:0/1624690596 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564dc39f5570 msgr2=0x564dc396a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.482+0000 7f84bae36800 1 --2- 172.21.15.146:0/1624690596 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564dc39f5570 0x564dc396a560 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f84a8065040 tx=0x7f84a8003330 comp rx=0 tx=0).stop 2024-09-18T01:45:24.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.482+0000 7f84bae36800 1 -- 172.21.15.146:0/1624690596 shutdown_connections 2024-09-18T01:45:24.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.482+0000 7f84bae36800 1 --2- 172.21.15.146:0/1624690596 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x564dc3af7950 0x564dc3af9d40 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.482+0000 7f84bae36800 1 --2- 172.21.15.146:0/1624690596 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564dc39f5eb0 0x564dc3af41b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.482+0000 7f84bae36800 1 --2- 172.21.15.146:0/1624690596 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f839c036b40 0x7f839c039000 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.482+0000 7f84bae36800 1 --2- 172.21.15.146:0/1624690596 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564dc39f5570 0x564dc396a560 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.482+0000 7f84bae36800 1 -- 172.21.15.146:0/1624690596 >> 172.21.15.146:0/1624690596 conn(0x564dc39f0e00 msgr2=0x564dc3adeac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:24.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.482+0000 7f84bae36800 1 -- 172.21.15.146:0/1624690596 shutdown_connections 2024-09-18T01:45:24.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.482+0000 7f84bae36800 1 -- 172.21.15.146:0/1624690596 wait complete. 2024-09-18T01:45:24.492 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T01:45:23.010714Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:45:23.010705Z', 'tags': [], 'group_ids': []} 2024-09-18T01:45:24.492 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-18T01:45:24.493 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-18T01:45:24.493 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-18T01:45:24.537 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:24.537 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:24.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.537+0000 7fc3ad030800 1 Processor -- start 2024-09-18T01:45:24.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.537+0000 7fc3ad030800 1 -- start start 2024-09-18T01:45:24.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.537+0000 7fc3ad030800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55c26736cd90 0x55c2673fc240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.537+0000 7fc3ad030800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c2672b8b30 con 0x55c2673fc780 2024-09-18T01:45:24.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.537+0000 7fc3ad030800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x55c26729a360 con 0x55c26736cd90 2024-09-18T01:45:24.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.537+0000 7fc3a8273640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55c26736cd90 0x55c2673fc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.537+0000 7fc39ffff640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x55c2673fc780 0x55c2673feb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:38818/0 (socket says 172.21.15.146:38818) 2024-09-18T01:45:24.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.537+0000 7fc3a8273640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55c26736cd90 0x55c2673fc240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60064/0 (socket says 172.21.15.146:60064) 2024-09-18T01:45:24.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.537+0000 7fc39ffff640 1 -- 172.21.15.146:0/846285688 learned_addr learned my addr 172.21.15.146:0/846285688 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:45:24.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.538+0000 7fc3a8273640 1 -- 172.21.15.146:0/846285688 >> v1:172.21.15.129:6789/0 conn(0x55c2673fc780 legacy=0x55c2673feb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.538+0000 7fc3a8273640 1 -- 172.21.15.146:0/846285688 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2672c0e00 con 0x55c26736cd90 2024-09-18T01:45:24.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.539+0000 7fc3a8273640 1 --2- 172.21.15.146:0/846285688 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c26736cd90 0x55c2673fc240 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc39800a470 tx=0x7fc398045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46b875b7d5903cae server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.540+0000 7fc3a7a72640 1 -- 172.21.15.146:0/846285688 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc398053570 con 0x55c26736cd90 2024-09-18T01:45:24.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.540+0000 7fc3a7a72640 1 -- 172.21.15.146:0/846285688 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc398058070 con 0x55c26736cd90 2024-09-18T01:45:24.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.540+0000 7fc3a7a72640 1 -- 172.21.15.146:0/846285688 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc398053880 con 0x55c26736cd90 2024-09-18T01:45:24.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.540+0000 7fc3ad030800 1 -- 172.21.15.146:0/846285688 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c26736cd90 msgr2=0x55c2673fc240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.540+0000 7fc3ad030800 1 --2- 172.21.15.146:0/846285688 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c26736cd90 0x55c2673fc240 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc39800a470 tx=0x7fc398045a20 comp rx=0 tx=0).stop 2024-09-18T01:45:24.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.540+0000 7fc3ad030800 1 -- 172.21.15.146:0/846285688 shutdown_connections 2024-09-18T01:45:24.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.540+0000 7fc3ad030800 1 --2- 172.21.15.146:0/846285688 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c26736cd90 0x55c2673fc240 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.540+0000 7fc3ad030800 1 -- 172.21.15.146:0/846285688 >> 172.21.15.146:0/846285688 conn(0x55c2673f3df0 msgr2=0x55c2673f6210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:24.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.540+0000 7fc3ad030800 1 -- 172.21.15.146:0/846285688 shutdown_connections 2024-09-18T01:45:24.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.540+0000 7fc3ad030800 1 -- 172.21.15.146:0/846285688 wait complete. 2024-09-18T01:45:24.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.554+0000 7fc3ad030800 1 Processor -- start 2024-09-18T01:45:24.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.555+0000 7fc3ad030800 1 -- start start 2024-09-18T01:45:24.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.555+0000 7fc3ad030800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c26736cd90 0x55c2673f9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.555+0000 7fc3ad030800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55c267345330 con 0x55c26736cd90 2024-09-18T01:45:24.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.555+0000 7fc3a8273640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c26736cd90 0x55c2673f9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.555+0000 7fc3a8273640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c26736cd90 0x55c2673f9b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60066/0 (socket says 172.21.15.146:60066) 2024-09-18T01:45:24.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.555+0000 7fc3a8273640 1 -- 172.21.15.146:0/2565555866 learned_addr learned my addr 172.21.15.146:0/2565555866 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:24.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.555+0000 7fc3a8273640 1 -- 172.21.15.146:0/2565555866 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c267292bc0 con 0x55c26736cd90 2024-09-18T01:45:24.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.555+0000 7fc3a8273640 1 --2- 172.21.15.146:0/2565555866 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c26736cd90 0x55c2673f9b70 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc398025c20 tx=0x7fc398051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b71a4e28639c1a37 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.556+0000 7fc29660c640 1 -- 172.21.15.146:0/2565555866 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc39805c580 con 0x55c26736cd90 2024-09-18T01:45:24.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.556+0000 7fc29660c640 1 -- 172.21.15.146:0/2565555866 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc398063030 con 0x55c26736cd90 2024-09-18T01:45:24.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.556+0000 7fc29660c640 1 -- 172.21.15.146:0/2565555866 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc39805c850 con 0x55c26736cd90 2024-09-18T01:45:24.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.556+0000 7fc3ad030800 1 -- 172.21.15.146:0/2565555866 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c26736cd90 msgr2=0x55c2673f9b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.556+0000 7fc3ad030800 1 --2- 172.21.15.146:0/2565555866 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c26736cd90 0x55c2673f9b70 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc398025c20 tx=0x7fc398051000 comp rx=0 tx=0).stop 2024-09-18T01:45:24.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.556+0000 7fc3ad030800 1 -- 172.21.15.146:0/2565555866 shutdown_connections 2024-09-18T01:45:24.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.556+0000 7fc3ad030800 1 --2- 172.21.15.146:0/2565555866 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c26736cd90 0x55c2673f9b70 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.556+0000 7fc3ad030800 1 -- 172.21.15.146:0/2565555866 >> 172.21.15.146:0/2565555866 conn(0x55c2673f3df0 msgr2=0x55c2674e4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:24.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.556+0000 7fc3ad030800 1 -- 172.21.15.146:0/2565555866 shutdown_connections 2024-09-18T01:45:24.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.556+0000 7fc3ad030800 1 -- 172.21.15.146:0/2565555866 wait complete. 2024-09-18T01:45:24.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.557+0000 7fc3ad030800 1 Processor -- start 2024-09-18T01:45:24.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.557+0000 7fc3ad030800 1 -- start start 2024-09-18T01:45:24.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.557+0000 7fc3ad030800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c26736cd90 0x55c2674f2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.557+0000 7fc3ad030800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55c267400620 con 0x55c26736cd90 2024-09-18T01:45:24.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.557+0000 7fc3a8273640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c26736cd90 0x55c2674f2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.557+0000 7fc3a8273640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c26736cd90 0x55c2674f2320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60076/0 (socket says 172.21.15.146:60076) 2024-09-18T01:45:24.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.557+0000 7fc3a8273640 1 -- 172.21.15.146:0/916178702 learned_addr learned my addr 172.21.15.146:0/916178702 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:24.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.557+0000 7fc3a8273640 1 -- 172.21.15.146:0/916178702 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2672a6fe0 con 0x55c26736cd90 2024-09-18T01:45:24.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.558+0000 7fc3a8273640 1 --2- 172.21.15.146:0/916178702 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c26736cd90 0x55c2674f2320 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc39800a330 tx=0x7fc398002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.558+0000 7fc294e09640 1 -- 172.21.15.146:0/916178702 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc39806c030 con 0x55c26736cd90 2024-09-18T01:45:24.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.558+0000 7fc294e09640 1 -- 172.21.15.146:0/916178702 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc39805c580 con 0x55c26736cd90 2024-09-18T01:45:24.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.558+0000 7fc3ad030800 1 -- 172.21.15.146:0/916178702 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c2674f2860 con 0x55c26736cd90 2024-09-18T01:45:24.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.558+0000 7fc294e09640 1 -- 172.21.15.146:0/916178702 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc39805c860 con 0x55c26736cd90 2024-09-18T01:45:24.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.558+0000 7fc3ad030800 1 -- 172.21.15.146:0/916178702 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2674f2de0 con 0x55c26736cd90 2024-09-18T01:45:24.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.559+0000 7fc294e09640 1 -- 172.21.15.146:0/916178702 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc398053440 con 0x55c26736cd90 2024-09-18T01:45:24.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.559+0000 7fc294e09640 1 --2- 172.21.15.146:0/916178702 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc290036b40 0x7fc290039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.559+0000 7fc294e09640 1 -- 172.21.15.146:0/916178702 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fc398070020 con 0x55c26736cd90 2024-09-18T01:45:24.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.559+0000 7fc39ffff640 1 --2- 172.21.15.146:0/916178702 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc290036b40 0x7fc290039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.559+0000 7fc3ad030800 1 --2- 172.21.15.146:0/916178702 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55c2673fc780 0x55c2674f9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.559+0000 7fc3ad030800 1 -- 172.21.15.146:0/916178702 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c2674f9910 con 0x55c2673fc780 2024-09-18T01:45:24.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.559+0000 7fc3a8a74640 1 --2- 172.21.15.146:0/916178702 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55c2673fc780 0x55c2674f9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.559+0000 7fc39ffff640 1 --2- 172.21.15.146:0/916178702 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc290036b40 0x7fc290039000 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc390000f60 tx=0x7fc3900012b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.559+0000 7fc3a8a74640 1 --2- 172.21.15.146:0/916178702 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55c2673fc780 0x55c2674f9390 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.560+0000 7fc3a8a74640 1 -- 172.21.15.146:0/916178702 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc3a000a4a0 con 0x55c2673fc780 2024-09-18T01:45:24.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.560+0000 7fc3ad030800 1 -- 172.21.15.146:0/916178702 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c2674f6960 con 0x55c2673fc780 2024-09-18T01:45:24.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.560+0000 7fc3a8a74640 1 -- 172.21.15.146:0/916178702 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc3a000a4a0 con 0x55c2673fc780 2024-09-18T01:45:24.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.560+0000 7fc3ad030800 1 -- 172.21.15.146:0/916178702 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c2674fb780 con 0x55c2673fc780 2024-09-18T01:45:24.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.560+0000 7fc3a8a74640 1 -- 172.21.15.146:0/916178702 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc3a000a4a0 con 0x55c2673fc780 2024-09-18T01:45:24.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.560+0000 7fc3ad030800 1 -- 172.21.15.146:0/916178702 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c2674fa9b0 con 0x55c2673fc780 2024-09-18T01:45:24.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.560+0000 7fc3a8a74640 1 -- 172.21.15.146:0/916178702 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc3a000a4a0 con 0x55c2673fc780 2024-09-18T01:45:24.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.561+0000 7fc3ad030800 1 --2- 172.21.15.146:0/916178702 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55c2674fcb30 0x55c2674fef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.561+0000 7fc3ad030800 1 -- 172.21.15.146:0/916178702 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c2674ff460 con 0x55c2674fcb30 2024-09-18T01:45:24.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.561+0000 7fc3a8273640 1 --2- 172.21.15.146:0/916178702 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55c2674fcb30 0x55c2674fef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.561+0000 7fc3a8273640 1 --2- 172.21.15.146:0/916178702 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55c2674fcb30 0x55c2674fef20 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.561+0000 7fc3a8273640 1 -- 172.21.15.146:0/916178702 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc39807b070 con 0x55c2674fcb30 2024-09-18T01:45:24.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.561+0000 7fc3ad030800 1 Processor -- start 2024-09-18T01:45:24.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.562+0000 7fc3ad030800 1 -- start start 2024-09-18T01:45:24.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.562+0000 7fc3ad030800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c26750d0e0 0x55c26750d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.562+0000 7fc3ad030800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55c267294580 con 0x55c26750d0e0 2024-09-18T01:45:24.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.562+0000 7fc3a8a74640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c26750d0e0 0x55c26750d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.562+0000 7fc3a8a74640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c26750d0e0 0x55c26750d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60080/0 (socket says 172.21.15.146:60080) 2024-09-18T01:45:24.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.562+0000 7fc3a8a74640 1 -- 172.21.15.146:0/3199896980 learned_addr learned my addr 172.21.15.146:0/3199896980 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:24.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.562+0000 7fc3a8a74640 1 -- 172.21.15.146:0/3199896980 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c26750da40 con 0x55c26750d0e0 2024-09-18T01:45:24.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.562+0000 7fc3a8a74640 1 --2- 172.21.15.146:0/3199896980 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c26750d0e0 0x55c26750d500 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x55c2674f3540 tx=0x7fc3a00178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.562+0000 7fc28dffb640 1 -- 172.21.15.146:0/3199896980 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3a0013440 con 0x55c26750d0e0 2024-09-18T01:45:24.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.562+0000 7fc28dffb640 1 -- 172.21.15.146:0/3199896980 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3a00135e0 con 0x55c26750d0e0 2024-09-18T01:45:24.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.563+0000 7fc3ad030800 1 -- 172.21.15.146:0/3199896980 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c26750dcd0 con 0x55c26750d0e0 2024-09-18T01:45:24.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.563+0000 7fc28dffb640 1 -- 172.21.15.146:0/3199896980 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3a00138c0 con 0x55c26750d0e0 2024-09-18T01:45:24.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.563+0000 7fc3ad030800 1 -- 172.21.15.146:0/3199896980 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2675109b0 con 0x55c26750d0e0 2024-09-18T01:45:24.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.563+0000 7fc28dffb640 1 -- 172.21.15.146:0/3199896980 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc3a0011040 con 0x55c26750d0e0 2024-09-18T01:45:24.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.563+0000 7fc28dffb640 1 --2- 172.21.15.146:0/3199896980 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc280036b40 0x7fc280039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.563+0000 7fc28dffb640 1 -- 172.21.15.146:0/3199896980 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fc3a001d070 con 0x55c26750d0e0 2024-09-18T01:45:24.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.563+0000 7fc3a8273640 1 --2- 172.21.15.146:0/3199896980 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc280036b40 0x7fc280039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.564+0000 7fc3ad030800 1 Processor -- start 2024-09-18T01:45:24.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.564+0000 7fc3a8273640 1 --2- 172.21.15.146:0/3199896980 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc280036b40 0x7fc280039000 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc39800a010 tx=0x7fc39808ee50 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.564+0000 7fc3ad030800 1 -- start start 2024-09-18T01:45:24.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.564+0000 7fc3ad030800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c267519da0 0x55c26751a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.564+0000 7fc3ad030800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55c2673f81e0 con 0x55c267519da0 2024-09-18T01:45:24.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.564+0000 7fc3a8a74640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c267519da0 0x55c26751a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.564+0000 7fc3a8a74640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c267519da0 0x55c26751a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60082/0 (socket says 172.21.15.146:60082) 2024-09-18T01:45:24.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.564+0000 7fc3a8a74640 1 -- 172.21.15.146:0/2737132285 learned_addr learned my addr 172.21.15.146:0/2737132285 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:24.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.564+0000 7fc3a8a74640 1 -- 172.21.15.146:0/2737132285 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c26751a770 con 0x55c267519da0 2024-09-18T01:45:24.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.564+0000 7fc3a8a74640 1 --2- 172.21.15.146:0/2737132285 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c267519da0 0x55c26751a1a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc3a004c8f0 tx=0x7fc3a004cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df170829c5d94f77 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.565+0000 7fc27f7fe640 1 -- 172.21.15.146:0/2737132285 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3a0012cc0 con 0x55c267519da0 2024-09-18T01:45:24.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.565+0000 7fc27f7fe640 1 -- 172.21.15.146:0/2737132285 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3a004b250 con 0x55c267519da0 2024-09-18T01:45:24.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.565+0000 7fc27f7fe640 1 -- 172.21.15.146:0/2737132285 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3a0012e60 con 0x55c267519da0 2024-09-18T01:45:24.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.565+0000 7fc3ad030800 1 -- 172.21.15.146:0/2737132285 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c267519da0 msgr2=0x55c26751a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.565+0000 7fc3ad030800 1 --2- 172.21.15.146:0/2737132285 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c267519da0 0x55c26751a1a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc3a004c8f0 tx=0x7fc3a004cbc0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.565+0000 7fc3ad030800 1 -- 172.21.15.146:0/2737132285 shutdown_connections 2024-09-18T01:45:24.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.565+0000 7fc3ad030800 1 --2- 172.21.15.146:0/2737132285 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c267519da0 0x55c26751a1a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.565+0000 7fc3ad030800 1 -- 172.21.15.146:0/2737132285 >> 172.21.15.146:0/2737132285 conn(0x55c267516150 msgr2=0x55c267514250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:24.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.565+0000 7fc3ad030800 1 -- 172.21.15.146:0/2737132285 shutdown_connections 2024-09-18T01:45:24.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.565+0000 7fc3ad030800 1 -- 172.21.15.146:0/2737132285 wait complete. 2024-09-18T01:45:24.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.565+0000 7fc3ad030800 1 Processor -- start 2024-09-18T01:45:24.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.565+0000 7fc3ad030800 1 -- start start 2024-09-18T01:45:24.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.566+0000 7fc3ad030800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c267519da0 0x55c267521230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.566+0000 7fc3ad030800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55c26751ad40 con 0x55c267519da0 2024-09-18T01:45:24.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.566+0000 7fc3a8a74640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c267519da0 0x55c267521230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.566+0000 7fc3a8a74640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c267519da0 0x55c267521230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60086/0 (socket says 172.21.15.146:60086) 2024-09-18T01:45:24.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.566+0000 7fc3a8a74640 1 -- 172.21.15.146:0/1163505122 learned_addr learned my addr 172.21.15.146:0/1163505122 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:24.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.566+0000 7fc3a8a74640 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c267521770 con 0x55c267519da0 2024-09-18T01:45:24.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.566+0000 7fc3a8a74640 1 --2- 172.21.15.146:0/1163505122 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c267519da0 0x55c267521230 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0044040 tx=0x7fc3a004c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.566+0000 7fc27dffb640 1 -- 172.21.15.146:0/1163505122 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3a0046040 con 0x55c267519da0 2024-09-18T01:45:24.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.566+0000 7fc27dffb640 1 -- 172.21.15.146:0/1163505122 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3a0041050 con 0x55c267519da0 2024-09-18T01:45:24.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.566+0000 7fc27dffb640 1 -- 172.21.15.146:0/1163505122 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3a0013c70 con 0x55c267519da0 2024-09-18T01:45:24.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.566+0000 7fc3ad030800 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c267521a00 con 0x55c267519da0 2024-09-18T01:45:24.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.566+0000 7fc3ad030800 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2675246b0 con 0x55c267519da0 2024-09-18T01:45:24.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.567+0000 7fc27dffb640 1 -- 172.21.15.146:0/1163505122 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc3a002aa60 con 0x55c267519da0 2024-09-18T01:45:24.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.567+0000 7fc27dffb640 1 --2- 172.21.15.146:0/1163505122 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc270036b40 0x7fc270039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.567+0000 7fc27dffb640 1 -- 172.21.15.146:0/1163505122 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fc3a0034070 con 0x55c267519da0 2024-09-18T01:45:24.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.567+0000 7fc3a8273640 1 --2- 172.21.15.146:0/1163505122 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc270036b40 0x7fc270039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.567+0000 7fc3ad030800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.567+0000 7fc3ad030800 1 --2- 172.21.15.146:0/1163505122 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55c26752ce00 0x55c26752f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.568+0000 7fc3ad030800 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c26752fa10 con 0x55c26752ce00 2024-09-18T01:45:24.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.568+0000 7fc39ffff640 1 --2- 172.21.15.146:0/1163505122 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55c26752ce00 0x55c26752f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.568+0000 7fc3a8273640 1 --2- 172.21.15.146:0/1163505122 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc270036b40 0x7fc270039000 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x55c2674fb6e0 tx=0x7fc398091000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.568+0000 7fc39ffff640 1 --2- 172.21.15.146:0/1163505122 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55c26752ce00 0x55c26752f2c0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.568+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc390009050 con 0x55c26752ce00 2024-09-18T01:45:24.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.568+0000 7fc3ad030800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.568+0000 7fc3ad030800 20 realm 2024-09-18T01:45:24.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.568+0000 7fc3ad030800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.568+0000 7fc3ad030800 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c26752c250 con 0x55c26752ce00 2024-09-18T01:45:24.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.568+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc390009050 con 0x55c26752ce00 2024-09-18T01:45:24.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.568+0000 7fc3ad030800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.568+0000 7fc3ad030800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:24.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.568+0000 7fc3ad030800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.568+0000 7fc3ad030800 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c2675304f0 con 0x55c26752ce00 2024-09-18T01:45:24.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.569+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc390009050 con 0x55c26752ce00 2024-09-18T01:45:24.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.569+0000 7fc3ad030800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.569+0000 7fc3ad030800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.569+0000 7fc3ad030800 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c267530dc0 con 0x55c26752ce00 2024-09-18T01:45:24.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.569+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc390009050 con 0x55c26752ce00 2024-09-18T01:45:24.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.569+0000 7fc3ad030800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:24.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.569+0000 7fc3ad030800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.569+0000 7fc3ad030800 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c267531160 con 0x55c26752ce00 2024-09-18T01:45:24.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.569+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc390009050 con 0x55c26752ce00 2024-09-18T01:45:24.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.569+0000 7fc3ad030800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:24.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.569+0000 7fc3ad030800 20 searching for the correct realm 2024-09-18T01:45:24.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.569+0000 7fc3ad030800 1 --2- 172.21.15.146:0/1163505122 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55c267533040 0x55c267535430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.569+0000 7fc3ad030800 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c267535ae0 con 0x55c267533040 2024-09-18T01:45:24.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.569+0000 7fc3a8a74640 1 --2- 172.21.15.146:0/1163505122 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55c267533040 0x55c267535430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.569+0000 7fc3a8a74640 1 --2- 172.21.15.146:0/1163505122 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55c267533040 0x55c267535430 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.570+0000 7fc3a8a74640 1 -- 172.21.15.146:0/1163505122 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3a003e020 con 0x55c267533040 2024-09-18T01:45:24.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.570+0000 7fc3a8a74640 1 --2- 172.21.15.146:0/1163505122 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fc3a00123a0 0x7fc3a0041200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.570+0000 7fc3a8a74640 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c267535ae0 con 0x7fc3a00123a0 2024-09-18T01:45:24.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.570+0000 7fc3a8273640 1 --2- 172.21.15.146:0/1163505122 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fc3a00123a0 0x7fc3a0041200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.570+0000 7fc3a8273640 1 --2- 172.21.15.146:0/1163505122 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fc3a00123a0 0x7fc3a0041200 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.570+0000 7fc3a8273640 1 -- 172.21.15.146:0/1163505122 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc39807b070 con 0x7fc3a00123a0 2024-09-18T01:45:24.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.570+0000 7fc3a8273640 1 --2- 172.21.15.146:0/1163505122 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fc39805c070 0x7fc39805f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.570+0000 7fc3a8273640 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c267535ae0 con 0x7fc39805c070 2024-09-18T01:45:24.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.571+0000 7fc39ffff640 1 --2- 172.21.15.146:0/1163505122 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fc39805c070 0x7fc39805f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.571+0000 7fc39ffff640 1 --2- 172.21.15.146:0/1163505122 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fc39805c070 0x7fc39805f760 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.571+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc390009050 con 0x7fc39805c070 2024-09-18T01:45:24.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.571+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c267535ae0 con 0x55c26752ce00 2024-09-18T01:45:24.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.571+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc390009050 con 0x55c26752ce00 2024-09-18T01:45:24.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.571+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c267535ae0 con 0x55c26752ce00 2024-09-18T01:45:24.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.572+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc39002a040 con 0x55c26752ce00 2024-09-18T01:45:24.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.572+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c267535ae0 con 0x7fc39805c070 2024-09-18T01:45:24.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.572+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc39002a040 con 0x7fc39805c070 2024-09-18T01:45:24.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.572+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c267535ae0 con 0x7fc39805c070 2024-09-18T01:45:24.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.572+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc39002a040 con 0x7fc39805c070 2024-09-18T01:45:24.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.572+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c267535ae0 con 0x7fc3a00123a0 2024-09-18T01:45:24.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.572+0000 7fc3a8273640 1 -- 172.21.15.146:0/1163505122 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc39807b070 con 0x7fc3a00123a0 2024-09-18T01:45:24.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.572+0000 7fc3a8273640 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c267535ae0 con 0x55c267533040 2024-09-18T01:45:24.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.573+0000 7fc3a8a74640 1 -- 172.21.15.146:0/1163505122 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3a003e020 con 0x55c267533040 2024-09-18T01:45:24.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.573+0000 7fc3a8a74640 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c267535ae0 con 0x55c26752ce00 2024-09-18T01:45:24.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.573+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc39002a040 con 0x55c26752ce00 2024-09-18T01:45:24.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.573+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c267535ae0 con 0x7fc39805c070 2024-09-18T01:45:24.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.573+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc39002a040 con 0x7fc39805c070 2024-09-18T01:45:24.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.573+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c267535ae0 con 0x55c26752ce00 2024-09-18T01:45:24.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.573+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc39002a040 con 0x55c26752ce00 2024-09-18T01:45:24.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.573+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c267535ae0 con 0x7fc3a00123a0 2024-09-18T01:45:24.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.574+0000 7fc3a8273640 1 -- 172.21.15.146:0/1163505122 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fc39807b070 con 0x7fc3a00123a0 2024-09-18T01:45:24.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.574+0000 7fc3a8273640 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c267535ae0 con 0x55c267533040 2024-09-18T01:45:24.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.574+0000 7fc3a8a74640 1 -- 172.21.15.146:0/1163505122 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3a003e020 con 0x55c267533040 2024-09-18T01:45:24.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.574+0000 7fc3a8a74640 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c267535ae0 con 0x55c267533040 2024-09-18T01:45:24.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.574+0000 7fc3a8a74640 1 -- 172.21.15.146:0/1163505122 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3a003e020 con 0x55c267533040 2024-09-18T01:45:24.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.574+0000 7fc3a8a74640 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c267535ae0 con 0x7fc39805c070 2024-09-18T01:45:24.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.574+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc39002a040 con 0x7fc39805c070 2024-09-18T01:45:24.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.574+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c267535ae0 con 0x55c267533040 2024-09-18T01:45:24.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.574+0000 7fc3a8a74640 1 -- 172.21.15.146:0/1163505122 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3a003e020 con 0x55c267533040 2024-09-18T01:45:24.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.574+0000 7fc3a8a74640 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c267535ae0 con 0x55c267533040 2024-09-18T01:45:24.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.575+0000 7fc3a8a74640 1 -- 172.21.15.146:0/1163505122 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3a003e020 con 0x55c267533040 2024-09-18T01:45:24.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.575+0000 7fc3a8a74640 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c267535ae0 con 0x55c26752ce00 2024-09-18T01:45:24.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.575+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc39002a040 con 0x55c26752ce00 2024-09-18T01:45:24.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.575+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c267535ae0 con 0x55c26752ce00 2024-09-18T01:45:24.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.575+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc39002a040 con 0x55c26752ce00 2024-09-18T01:45:24.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.575+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c267535ae0 con 0x7fc39805c070 2024-09-18T01:45:24.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.575+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc39002a040 con 0x7fc39805c070 2024-09-18T01:45:24.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.575+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c267535ae0 con 0x55c267533040 2024-09-18T01:45:24.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.576+0000 7fc3a8a74640 1 -- 172.21.15.146:0/1163505122 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3a003e020 con 0x55c267533040 2024-09-18T01:45:24.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.576+0000 7fc3a8a74640 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c267535ae0 con 0x7fc3a00123a0 2024-09-18T01:45:24.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.576+0000 7fc3a8273640 1 -- 172.21.15.146:0/1163505122 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc39807b070 con 0x7fc3a00123a0 2024-09-18T01:45:24.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.576+0000 7fc3a8273640 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c267535ae0 con 0x55c26752ce00 2024-09-18T01:45:24.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.576+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc39002a040 con 0x55c26752ce00 2024-09-18T01:45:24.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.576+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c267535ae0 con 0x7fc39805c070 2024-09-18T01:45:24.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.576+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc39002a040 con 0x7fc39805c070 2024-09-18T01:45:24.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.576+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c267535ae0 con 0x55c267533040 2024-09-18T01:45:24.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.577+0000 7fc3a8a74640 1 -- 172.21.15.146:0/1163505122 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3a003e020 con 0x55c267533040 2024-09-18T01:45:24.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.577+0000 7fc3a8a74640 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c267535ae0 con 0x7fc39805c070 2024-09-18T01:45:24.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.577+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc39002a040 con 0x7fc39805c070 2024-09-18T01:45:24.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.577+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c267535ae0 con 0x7fc3a00123a0 2024-09-18T01:45:24.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.577+0000 7fc3a8273640 1 -- 172.21.15.146:0/1163505122 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc39807b070 con 0x7fc3a00123a0 2024-09-18T01:45:24.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.577+0000 7fc3a8273640 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c267535ae0 con 0x55c267533040 2024-09-18T01:45:24.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.577+0000 7fc3a8a74640 1 -- 172.21.15.146:0/1163505122 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3a003e020 con 0x55c267533040 2024-09-18T01:45:24.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.577+0000 7fc3a8a74640 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c267535ae0 con 0x7fc39805c070 2024-09-18T01:45:24.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.578+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc39002a040 con 0x7fc39805c070 2024-09-18T01:45:24.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.578+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c267535ae0 con 0x55c26752ce00 2024-09-18T01:45:24.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.578+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc39002a040 con 0x55c26752ce00 2024-09-18T01:45:24.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.578+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c267535ae0 con 0x7fc3a00123a0 2024-09-18T01:45:24.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.578+0000 7fc3a8273640 1 -- 172.21.15.146:0/1163505122 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3980b1040 con 0x7fc3a00123a0 2024-09-18T01:45:24.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.578+0000 7fc3ad030800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:24.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.578+0000 7fc3ad030800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:24.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.578+0000 7fc3ad030800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:24.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.578+0000 7fc3ad030800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:24.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.578+0000 7fc3ad030800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:24.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.578+0000 7fc3ad030800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:24.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.578+0000 7fc3ad030800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.578+0000 7fc3ad030800 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c267531b10 con 0x55c26752ce00 2024-09-18T01:45:24.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.578+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc39002a040 con 0x55c26752ce00 2024-09-18T01:45:24.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.578+0000 7fc3ad030800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.578+0000 7fc3ad030800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.578+0000 7fc3ad030800 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c2675323b0 con 0x55c26752ce00 2024-09-18T01:45:24.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.579+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc39002a040 con 0x55c26752ce00 2024-09-18T01:45:24.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.579+0000 7fc3ad030800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:24.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.579+0000 7fc3ad030800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.579+0000 7fc3ad030800 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c267531750 con 0x7fc3a00123a0 2024-09-18T01:45:24.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.579+0000 7fc3a8273640 1 -- 172.21.15.146:0/1163505122 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc3980b1040 con 0x7fc3a00123a0 2024-09-18T01:45:24.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.579+0000 7fc3ad030800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:24.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.579+0000 7fc3ad030800 20 zone default found 2024-09-18T01:45:24.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.579+0000 7fc3ad030800 4 Realm: () 2024-09-18T01:45:24.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.579+0000 7fc3ad030800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:24.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.579+0000 7fc3ad030800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:24.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.579+0000 7fc3ad030800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:24.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.579+0000 7fc3ad030800 20 zonegroup default 2024-09-18T01:45:24.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.579+0000 7fc3ad030800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.579+0000 7fc3ad030800 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c2675363f0 con 0x7fc39805c070 2024-09-18T01:45:24.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.579+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc39002a040 con 0x7fc39805c070 2024-09-18T01:45:24.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.579+0000 7fc3ad030800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.579+0000 7fc3ad030800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.579+0000 7fc3ad030800 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c267537f80 con 0x55c267533040 2024-09-18T01:45:24.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.580+0000 7fc3a8a74640 1 -- 172.21.15.146:0/1163505122 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc3a003e020 con 0x55c267533040 2024-09-18T01:45:24.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.580+0000 7fc3ad030800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.580+0000 7fc3ad030800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.580+0000 7fc3ad030800 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c267538450 con 0x55c267533040 2024-09-18T01:45:24.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.580+0000 7fc3a8a74640 1 -- 172.21.15.146:0/1163505122 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc3a003e020 con 0x55c267533040 2024-09-18T01:45:24.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.580+0000 7fc3ad030800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.580+0000 7fc3ad030800 20 started sync module instance, tier type = 2024-09-18T01:45:24.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.580+0000 7fc3ad030800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:24.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.580+0000 7fc3ad030800 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c267536e80 con 0x7fc3a00123a0 2024-09-18T01:45:24.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.581+0000 7fc3a8273640 1 -- 172.21.15.146:0/1163505122 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v31'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3980b1040 con 0x7fc3a00123a0 2024-09-18T01:45:24.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.581+0000 7fc3ad030800 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94293445538416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c267536ae0 con 0x7fc3a00123a0 2024-09-18T01:45:24.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.581+0000 7fc3ad030800 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c2675393c0 con 0x55c26752ce00 2024-09-18T01:45:24.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.582+0000 7fc3a8273640 1 -- 172.21.15.146:0/1163505122 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94293445538416] v31'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3980b1040 con 0x7fc3a00123a0 2024-09-18T01:45:24.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.582+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v31'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc39002a040 con 0x55c26752ce00 2024-09-18T01:45:24.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.582+0000 7fc3ad030800 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94293445544112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c2675397b0 con 0x55c26752ce00 2024-09-18T01:45:24.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.582+0000 7fc3ad030800 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c26753a1f0 con 0x55c267533040 2024-09-18T01:45:24.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.583+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94293445544112] v31'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc39002a040 con 0x55c26752ce00 2024-09-18T01:45:24.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.583+0000 7fc3a8a74640 1 -- 172.21.15.146:0/1163505122 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v31'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3a003e020 con 0x55c267533040 2024-09-18T01:45:24.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.583+0000 7fc3ad030800 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94293445549248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c26753a1b0 con 0x55c267533040 2024-09-18T01:45:24.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.583+0000 7fc3ad030800 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c26753ac50 con 0x7fc3a00123a0 2024-09-18T01:45:24.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.584+0000 7fc3a8a74640 1 -- 172.21.15.146:0/1163505122 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94293445549248] v31'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3a003e020 con 0x55c267533040 2024-09-18T01:45:24.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.585+0000 7fc3a8273640 1 -- 172.21.15.146:0/1163505122 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v31'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3980b1040 con 0x7fc3a00123a0 2024-09-18T01:45:24.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.585+0000 7fc3ad030800 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94293445545680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c26753b040 con 0x7fc3a00123a0 2024-09-18T01:45:24.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.585+0000 7fc3ad030800 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c26753ba40 con 0x55c26752ce00 2024-09-18T01:45:24.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.586+0000 7fc3a8273640 1 -- 172.21.15.146:0/1163505122 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94293445545680] v31'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3980b1040 con 0x7fc3a00123a0 2024-09-18T01:45:24.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.586+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v31'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc39002a040 con 0x55c26752ce00 2024-09-18T01:45:24.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.586+0000 7fc3ad030800 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94293445551952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c26753ba00 con 0x55c26752ce00 2024-09-18T01:45:24.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.586+0000 7fc3ad030800 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c26753c4c0 con 0x7fc39805c070 2024-09-18T01:45:24.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.587+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94293445551952] v31'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc39002a040 con 0x55c26752ce00 2024-09-18T01:45:24.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.587+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v31'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc39002a040 con 0x7fc39805c070 2024-09-18T01:45:24.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.587+0000 7fc3ad030800 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94293445558224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c26753ba00 con 0x7fc39805c070 2024-09-18T01:45:24.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.587+0000 7fc3ad030800 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c26753cf00 con 0x7fc39805c070 2024-09-18T01:45:24.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.588+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94293445558224] v31'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc39002a040 con 0x7fc39805c070 2024-09-18T01:45:24.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.588+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v31'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc39002a040 con 0x7fc39805c070 2024-09-18T01:45:24.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.588+0000 7fc3ad030800 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94293445555536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c26753d0e0 con 0x7fc39805c070 2024-09-18T01:45:24.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.588+0000 7fc3ad030800 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c26753d930 con 0x7fc39805c070 2024-09-18T01:45:24.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.589+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94293445555536] v31'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc39002a040 con 0x7fc39805c070 2024-09-18T01:45:24.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.589+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v31'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc39002a040 con 0x7fc39805c070 2024-09-18T01:45:24.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.589+0000 7fc3ad030800 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94293445561664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c26753d770 con 0x7fc39805c070 2024-09-18T01:45:24.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.589+0000 7fc3ad030800 20 add_watcher() i=0 2024-09-18T01:45:24.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.589+0000 7fc3ad030800 20 add_watcher() i=1 2024-09-18T01:45:24.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.589+0000 7fc3ad030800 20 add_watcher() i=2 2024-09-18T01:45:24.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.589+0000 7fc3ad030800 20 add_watcher() i=3 2024-09-18T01:45:24.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.589+0000 7fc3ad030800 20 add_watcher() i=4 2024-09-18T01:45:24.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.589+0000 7fc3ad030800 20 add_watcher() i=5 2024-09-18T01:45:24.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.589+0000 7fc3ad030800 20 add_watcher() i=6 2024-09-18T01:45:24.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.590+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94293445561664] v31'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc39002a040 con 0x7fc39805c070 2024-09-18T01:45:24.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.590+0000 7fc3ad030800 20 add_watcher() i=7 2024-09-18T01:45:24.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.590+0000 7fc3ad030800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:24.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.590+0000 7fc3ad030800 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c267540c80 con 0x55c26752ce00 2024-09-18T01:45:24.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.590+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc39002a040 con 0x55c26752ce00 2024-09-18T01:45:24.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.590+0000 7fc3ad030800 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94293445562880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c26753e140 con 0x55c26752ce00 2024-09-18T01:45:24.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.591+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94293445562880] v31'80 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc39002a040 con 0x55c26752ce00 2024-09-18T01:45:24.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.591+0000 7fc25efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:24.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.591+0000 7fc3ad030800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:24.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.591+0000 7fc3ad030800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:24.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.591+0000 7fc3ad030800 5 note: GC not initialized 2024-09-18T01:45:24.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.592+0000 7fc25dfdb640 20 reqs_thread_entry: start 2024-09-18T01:45:24.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.592+0000 7fc3ad030800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:24.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.592+0000 7fc3ad030800 20 Filter name: none 2024-09-18T01:45:24.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.592+0000 7fc1cf7fe640 20 reqs_thread_entry: start 2024-09-18T01:45:24.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.592+0000 7fc3ad030800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.592+0000 7fc3ad030800 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c267573ba0 con 0x55c26752ce00 2024-09-18T01:45:24.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.592+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fc39002a040 con 0x55c26752ce00 2024-09-18T01:45:24.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.592+0000 7fc3ad030800 20 rados_obj.operate() r=0 bl.length=556 2024-09-18T01:45:24.604 INFO:teuthology.orchestra.run.smithi146.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T01:45:23.010714Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:45:23.010705Z","tags":[],"group_ids":[]} 2024-09-18T01:45:24.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.593+0000 7fc25efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:24.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.593+0000 7fc3ad030800 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94293445562880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c267572650 con 0x55c26752ce00 2024-09-18T01:45:24.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.594+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94293445562880] v31'81 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc39002a040 con 0x55c26752ce00 2024-09-18T01:45:24.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.594+0000 7fc3ad030800 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94293445538416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c26752a520 con 0x7fc3a00123a0 2024-09-18T01:45:24.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.595+0000 7fc3a8273640 1 -- 172.21.15.146:0/1163505122 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94293445538416] v31'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3980b1040 con 0x7fc3a00123a0 2024-09-18T01:45:24.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.595+0000 7fc3ad030800 20 remove_watcher() i=0 2024-09-18T01:45:24.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.595+0000 7fc3ad030800 2 removed watcher, disabling cache 2024-09-18T01:45:24.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.595+0000 7fc3ad030800 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94293445544112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c267537270 con 0x55c26752ce00 2024-09-18T01:45:24.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.596+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94293445544112] v31'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc39002a040 con 0x55c26752ce00 2024-09-18T01:45:24.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.596+0000 7fc3ad030800 20 remove_watcher() i=1 2024-09-18T01:45:24.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.596+0000 7fc3ad030800 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94293445549248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c2675388b0 con 0x55c267533040 2024-09-18T01:45:24.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.597+0000 7fc3a8a74640 1 -- 172.21.15.146:0/1163505122 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94293445549248] v31'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3a003e020 con 0x55c267533040 2024-09-18T01:45:24.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.597+0000 7fc3ad030800 20 remove_watcher() i=2 2024-09-18T01:45:24.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.597+0000 7fc3ad030800 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94293445545680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c2675388b0 con 0x7fc3a00123a0 2024-09-18T01:45:24.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.598+0000 7fc3a8273640 1 -- 172.21.15.146:0/1163505122 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94293445545680] v31'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3980b1040 con 0x7fc3a00123a0 2024-09-18T01:45:24.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.598+0000 7fc3ad030800 20 remove_watcher() i=3 2024-09-18T01:45:24.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.598+0000 7fc3ad030800 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94293445551952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c267538ed0 con 0x55c26752ce00 2024-09-18T01:45:24.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.599+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94293445551952] v31'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc39002a040 con 0x55c26752ce00 2024-09-18T01:45:24.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.599+0000 7fc3ad030800 20 remove_watcher() i=4 2024-09-18T01:45:24.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.599+0000 7fc3ad030800 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94293445558224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c2675388b0 con 0x7fc39805c070 2024-09-18T01:45:24.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.600+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94293445558224] v31'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc39002a040 con 0x7fc39805c070 2024-09-18T01:45:24.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.600+0000 7fc3ad030800 20 remove_watcher() i=5 2024-09-18T01:45:24.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.600+0000 7fc3ad030800 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94293445555536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c26753a750 con 0x7fc39805c070 2024-09-18T01:45:24.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.601+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94293445555536] v31'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc39002a040 con 0x7fc39805c070 2024-09-18T01:45:24.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.601+0000 7fc3ad030800 20 remove_watcher() i=6 2024-09-18T01:45:24.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.601+0000 7fc3ad030800 1 -- 172.21.15.146:0/1163505122 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94293445561664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c267538ed0 con 0x7fc39805c070 2024-09-18T01:45:24.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.602+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94293445561664] v31'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc39002a040 con 0x7fc39805c070 2024-09-18T01:45:24.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.602+0000 7fc3ad030800 20 remove_watcher() i=7 2024-09-18T01:45:24.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.602+0000 7fc3ad030800 1 -- 172.21.15.146:0/1163505122 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fc39805c070 msgr2=0x7fc39805f760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.602+0000 7fc3ad030800 1 --2- 172.21.15.146:0/1163505122 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fc39805c070 0x7fc39805f760 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.602+0000 7fc3ad030800 1 -- 172.21.15.146:0/1163505122 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55c26752ce00 msgr2=0x55c26752f2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.602+0000 7fc3ad030800 1 --2- 172.21.15.146:0/1163505122 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55c26752ce00 0x55c26752f2c0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.602+0000 7fc3ad030800 1 -- 172.21.15.146:0/1163505122 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fc3a00123a0 msgr2=0x7fc3a0041200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.602+0000 7fc3ad030800 1 --2- 172.21.15.146:0/1163505122 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fc3a00123a0 0x7fc3a0041200 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.602+0000 7fc3ad030800 1 -- 172.21.15.146:0/1163505122 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55c267533040 msgr2=0x55c267535430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.602+0000 7fc3ad030800 1 --2- 172.21.15.146:0/1163505122 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55c267533040 0x55c267535430 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.602+0000 7fc3ad030800 1 -- 172.21.15.146:0/1163505122 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc270036b40 msgr2=0x7fc270039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.602+0000 7fc3ad030800 1 --2- 172.21.15.146:0/1163505122 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc270036b40 0x7fc270039000 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x55c2674fb6e0 tx=0x7fc398091000 comp rx=0 tx=0).stop 2024-09-18T01:45:24.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.602+0000 7fc3ad030800 1 -- 172.21.15.146:0/1163505122 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c267519da0 msgr2=0x55c267521230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.602+0000 7fc3ad030800 1 --2- 172.21.15.146:0/1163505122 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c267519da0 0x55c267521230 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0044040 tx=0x7fc3a004c880 comp rx=0 tx=0).stop 2024-09-18T01:45:24.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.602+0000 7fc39ffff640 1 -- 172.21.15.146:0/1163505122 reap_dead start 2024-09-18T01:45:24.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.602+0000 7fc3ad030800 1 -- 172.21.15.146:0/1163505122 shutdown_connections 2024-09-18T01:45:24.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.602+0000 7fc3ad030800 1 --2- 172.21.15.146:0/1163505122 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c267519da0 0x55c267521230 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.602+0000 7fc3ad030800 1 -- 172.21.15.146:0/1163505122 >> 172.21.15.146:0/1163505122 conn(0x55c267516150 msgr2=0x55c26751b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:24.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.602+0000 7fc3ad030800 1 -- 172.21.15.146:0/1163505122 shutdown_connections 2024-09-18T01:45:24.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.602+0000 7fc3ad030800 1 -- 172.21.15.146:0/1163505122 wait complete. 2024-09-18T01:45:24.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.603+0000 7fc3ad030800 1 -- 172.21.15.146:0/3199896980 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc280036b40 msgr2=0x7fc280039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.603+0000 7fc3ad030800 1 --2- 172.21.15.146:0/3199896980 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc280036b40 0x7fc280039000 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc39800a010 tx=0x7fc39808ee50 comp rx=0 tx=0).stop 2024-09-18T01:45:24.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.603+0000 7fc3ad030800 1 -- 172.21.15.146:0/3199896980 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c26750d0e0 msgr2=0x55c26750d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.603+0000 7fc3ad030800 1 --2- 172.21.15.146:0/3199896980 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c26750d0e0 0x55c26750d500 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x55c2674f3540 tx=0x7fc3a00178e0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.603+0000 7fc3ad030800 1 -- 172.21.15.146:0/3199896980 shutdown_connections 2024-09-18T01:45:24.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.603+0000 7fc3ad030800 1 --2- 172.21.15.146:0/3199896980 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc280036b40 0x7fc280039000 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.603+0000 7fc3ad030800 1 --2- 172.21.15.146:0/3199896980 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c26750d0e0 0x55c26750d500 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.603+0000 7fc3ad030800 1 -- 172.21.15.146:0/3199896980 >> 172.21.15.146:0/3199896980 conn(0x55c267502070 msgr2=0x55c267504bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:24.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.603+0000 7fc3ad030800 1 -- 172.21.15.146:0/3199896980 shutdown_connections 2024-09-18T01:45:24.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.603+0000 7fc3ad030800 1 -- 172.21.15.146:0/3199896980 wait complete. 2024-09-18T01:45:24.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.603+0000 7fc3ad030800 1 -- 172.21.15.146:0/916178702 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55c2673fc780 msgr2=0x55c2674f9390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.603+0000 7fc3ad030800 1 --2- 172.21.15.146:0/916178702 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55c2673fc780 0x55c2674f9390 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.603+0000 7fc3ad030800 1 -- 172.21.15.146:0/916178702 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55c2674fcb30 msgr2=0x55c2674fef20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.603+0000 7fc3ad030800 1 --2- 172.21.15.146:0/916178702 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55c2674fcb30 0x55c2674fef20 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.603+0000 7fc3ad030800 1 -- 172.21.15.146:0/916178702 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc290036b40 msgr2=0x7fc290039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.603+0000 7fc3ad030800 1 --2- 172.21.15.146:0/916178702 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc290036b40 0x7fc290039000 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc390000f60 tx=0x7fc3900012b0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.603+0000 7fc3ad030800 1 -- 172.21.15.146:0/916178702 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c26736cd90 msgr2=0x55c2674f2320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.603+0000 7fc3ad030800 1 --2- 172.21.15.146:0/916178702 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c26736cd90 0x55c2674f2320 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc39800a330 tx=0x7fc398002fb0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.603+0000 7fc3ad030800 1 -- 172.21.15.146:0/916178702 shutdown_connections 2024-09-18T01:45:24.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.603+0000 7fc3ad030800 1 --2- 172.21.15.146:0/916178702 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55c2674fcb30 0x55c2674fef20 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.603+0000 7fc3ad030800 1 --2- 172.21.15.146:0/916178702 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55c2673fc780 0x55c2674f9390 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.603+0000 7fc3ad030800 1 --2- 172.21.15.146:0/916178702 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc290036b40 0x7fc290039000 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.603+0000 7fc3ad030800 1 --2- 172.21.15.146:0/916178702 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c26736cd90 0x55c2674f2320 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.603+0000 7fc3ad030800 1 -- 172.21.15.146:0/916178702 >> 172.21.15.146:0/916178702 conn(0x55c2673f3df0 msgr2=0x55c2674e3de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:24.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.603+0000 7fc3ad030800 1 -- 172.21.15.146:0/916178702 shutdown_connections 2024-09-18T01:45:24.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.603+0000 7fc3ad030800 1 -- 172.21.15.146:0/916178702 wait complete. 2024-09-18T01:45:24.615 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T01:45:23.010714Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:45:23.010705Z', 'tags': [], 'group_ids': []} 2024-09-18T01:45:24.615 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-18T01:45:24.615 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-18T01:45:24.615 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-18T01:45:24.659 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:24.659 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:24.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.659+0000 7f98e2d35800 1 Processor -- start 2024-09-18T01:45:24.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.659+0000 7f98e2d35800 1 -- start start 2024-09-18T01:45:24.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.659+0000 7f98e2d35800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x556b7e96b610 0x556b7e9fa270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.659+0000 7f98e2d35800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556b7e8b6b30 con 0x556b7e9fa7b0 2024-09-18T01:45:24.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.659+0000 7f98e2d35800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x556b7e898360 con 0x556b7e96b610 2024-09-18T01:45:24.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.660+0000 7f98deaee640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x556b7e96b610 0x556b7e9fa270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.660+0000 7f98deaee640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x556b7e96b610 0x556b7e9fa270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60096/0 (socket says 172.21.15.146:60096) 2024-09-18T01:45:24.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.660+0000 7f98deaee640 1 -- 172.21.15.146:0/984340751 learned_addr learned my addr 172.21.15.146:0/984340751 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:24.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.660+0000 7f98deaee640 1 -- 172.21.15.146:0/984340751 >> v1:172.21.15.129:6789/0 conn(0x556b7e9fa7b0 legacy=0x556b7e9fcba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.660+0000 7f98deaee640 1 -- 172.21.15.146:0/984340751 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b7e8bee00 con 0x556b7e96b610 2024-09-18T01:45:24.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.662+0000 7f98deaee640 1 --2- 172.21.15.146:0/984340751 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556b7e96b610 0x556b7e9fa270 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f98d000a520 tx=0x7f98d0045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34d616d2539109d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.662+0000 7f98ddaec640 1 -- 172.21.15.146:0/984340751 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98d0055070 con 0x556b7e96b610 2024-09-18T01:45:24.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.662+0000 7f98ddaec640 1 -- 172.21.15.146:0/984340751 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98d00515b0 con 0x556b7e96b610 2024-09-18T01:45:24.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.662+0000 7f98ddaec640 1 -- 172.21.15.146:0/984340751 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98d00518d0 con 0x556b7e96b610 2024-09-18T01:45:24.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.662+0000 7f98e2d35800 1 -- 172.21.15.146:0/984340751 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556b7e96b610 msgr2=0x556b7e9fa270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.662+0000 7f98e2d35800 1 --2- 172.21.15.146:0/984340751 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556b7e96b610 0x556b7e9fa270 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f98d000a520 tx=0x7f98d0045ba0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.662+0000 7f98e2d35800 1 -- 172.21.15.146:0/984340751 shutdown_connections 2024-09-18T01:45:24.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.662+0000 7f98e2d35800 1 --2- 172.21.15.146:0/984340751 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556b7e96b610 0x556b7e9fa270 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.662+0000 7f98e2d35800 1 -- 172.21.15.146:0/984340751 >> 172.21.15.146:0/984340751 conn(0x556b7e9f1de0 msgr2=0x556b7e9f4200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:24.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.662+0000 7f98e2d35800 1 -- 172.21.15.146:0/984340751 shutdown_connections 2024-09-18T01:45:24.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.662+0000 7f98e2d35800 1 -- 172.21.15.146:0/984340751 wait complete. 2024-09-18T01:45:24.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.676+0000 7f98e2d35800 1 Processor -- start 2024-09-18T01:45:24.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.676+0000 7f98e2d35800 1 -- start start 2024-09-18T01:45:24.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.676+0000 7f98e2d35800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556b7e96b610 0x556b7e9f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.676+0000 7f98e2d35800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x556b7e943330 con 0x556b7e96b610 2024-09-18T01:45:24.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.676+0000 7f98deaee640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556b7e96b610 0x556b7e9f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.677+0000 7f98deaee640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556b7e96b610 0x556b7e9f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60108/0 (socket says 172.21.15.146:60108) 2024-09-18T01:45:24.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.677+0000 7f98deaee640 1 -- 172.21.15.146:0/3812694113 learned_addr learned my addr 172.21.15.146:0/3812694113 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:24.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.677+0000 7f98deaee640 1 -- 172.21.15.146:0/3812694113 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b7e890bc0 con 0x556b7e96b610 2024-09-18T01:45:24.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.677+0000 7f98deaee640 1 --2- 172.21.15.146:0/3812694113 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556b7e96b610 0x556b7e9f7ba0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f98d0025da0 tx=0x7f98d0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d38999248f2696a server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.677+0000 7f97cce09640 1 -- 172.21.15.146:0/3812694113 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98d0051950 con 0x556b7e96b610 2024-09-18T01:45:24.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.677+0000 7f97cce09640 1 -- 172.21.15.146:0/3812694113 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98d0051af0 con 0x556b7e96b610 2024-09-18T01:45:24.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.677+0000 7f97cce09640 1 -- 172.21.15.146:0/3812694113 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98d0051dd0 con 0x556b7e96b610 2024-09-18T01:45:24.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.678+0000 7f98e2d35800 1 -- 172.21.15.146:0/3812694113 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556b7e96b610 msgr2=0x556b7e9f7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.678+0000 7f98e2d35800 1 --2- 172.21.15.146:0/3812694113 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556b7e96b610 0x556b7e9f7ba0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f98d0025da0 tx=0x7f98d0051000 comp rx=0 tx=0).stop 2024-09-18T01:45:24.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.678+0000 7f98e2d35800 1 -- 172.21.15.146:0/3812694113 shutdown_connections 2024-09-18T01:45:24.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.678+0000 7f98e2d35800 1 --2- 172.21.15.146:0/3812694113 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556b7e96b610 0x556b7e9f7ba0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.678+0000 7f98e2d35800 1 -- 172.21.15.146:0/3812694113 >> 172.21.15.146:0/3812694113 conn(0x556b7e9f1de0 msgr2=0x556b7eae2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:24.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.678+0000 7f98e2d35800 1 -- 172.21.15.146:0/3812694113 shutdown_connections 2024-09-18T01:45:24.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.678+0000 7f98e2d35800 1 -- 172.21.15.146:0/3812694113 wait complete. 2024-09-18T01:45:24.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.678+0000 7f98e2d35800 1 Processor -- start 2024-09-18T01:45:24.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.678+0000 7f98e2d35800 1 -- start start 2024-09-18T01:45:24.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.678+0000 7f98e2d35800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556b7e96b610 0x556b7eaf0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.678+0000 7f98e2d35800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x556b7e9fe680 con 0x556b7e96b610 2024-09-18T01:45:24.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.679+0000 7f98deaee640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556b7e96b610 0x556b7eaf0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.679+0000 7f98deaee640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556b7e96b610 0x556b7eaf0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60110/0 (socket says 172.21.15.146:60110) 2024-09-18T01:45:24.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.679+0000 7f98deaee640 1 -- 172.21.15.146:0/3424777447 learned_addr learned my addr 172.21.15.146:0/3424777447 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:24.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.679+0000 7f98deaee640 1 -- 172.21.15.146:0/3424777447 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b7e8a4fe0 con 0x556b7e96b610 2024-09-18T01:45:24.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.679+0000 7f98deaee640 1 --2- 172.21.15.146:0/3424777447 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556b7e96b610 0x556b7eaf0330 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f98d0067040 tx=0x7f98d0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.679+0000 7f97cb606640 1 -- 172.21.15.146:0/3424777447 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98d0073070 con 0x556b7e96b610 2024-09-18T01:45:24.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.679+0000 7f97cb606640 1 -- 172.21.15.146:0/3424777447 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98d005a450 con 0x556b7e96b610 2024-09-18T01:45:24.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.679+0000 7f97cb606640 1 -- 172.21.15.146:0/3424777447 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98d005a730 con 0x556b7e96b610 2024-09-18T01:45:24.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.679+0000 7f98e2d35800 1 -- 172.21.15.146:0/3424777447 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556b7eaf0870 con 0x556b7e96b610 2024-09-18T01:45:24.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.679+0000 7f98e2d35800 1 -- 172.21.15.146:0/3424777447 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b7eaf0df0 con 0x556b7e96b610 2024-09-18T01:45:24.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.680+0000 7f97cb606640 1 -- 172.21.15.146:0/3424777447 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f98d0076070 con 0x556b7e96b610 2024-09-18T01:45:24.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.680+0000 7f97cb606640 1 --2- 172.21.15.146:0/3424777447 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f97c4036b40 0x7f97c4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.680+0000 7f97cb606640 1 -- 172.21.15.146:0/3424777447 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f98d0062070 con 0x556b7e96b610 2024-09-18T01:45:24.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.680+0000 7f98de2ed640 1 --2- 172.21.15.146:0/3424777447 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f97c4036b40 0x7f97c4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.680+0000 7f98e2d35800 1 --2- 172.21.15.146:0/3424777447 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x556b7e9fa7b0 0x556b7eaf73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.680+0000 7f98e2d35800 1 -- 172.21.15.146:0/3424777447 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7eaf7920 con 0x556b7e9fa7b0 2024-09-18T01:45:24.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.680+0000 7f98df2ef640 1 --2- 172.21.15.146:0/3424777447 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x556b7e9fa7b0 0x556b7eaf73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.681+0000 7f98de2ed640 1 --2- 172.21.15.146:0/3424777447 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f97c4036b40 0x7f97c4039000 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f98d4001e10 tx=0x7f98d4001390 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.681+0000 7f98df2ef640 1 --2- 172.21.15.146:0/3424777447 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x556b7e9fa7b0 0x556b7eaf73a0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.681+0000 7f98df2ef640 1 -- 172.21.15.146:0/3424777447 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98d800a4a0 con 0x556b7e9fa7b0 2024-09-18T01:45:24.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.681+0000 7f98e2d35800 1 -- 172.21.15.146:0/3424777447 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7eaf81e0 con 0x556b7e9fa7b0 2024-09-18T01:45:24.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.681+0000 7f98df2ef640 1 -- 172.21.15.146:0/3424777447 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f98d800a4a0 con 0x556b7e9fa7b0 2024-09-18T01:45:24.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.681+0000 7f98e2d35800 1 -- 172.21.15.146:0/3424777447 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7eaf9590 con 0x556b7e9fa7b0 2024-09-18T01:45:24.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.682+0000 7f98df2ef640 1 -- 172.21.15.146:0/3424777447 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f98d800a4a0 con 0x556b7e9fa7b0 2024-09-18T01:45:24.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.682+0000 7f98e2d35800 1 -- 172.21.15.146:0/3424777447 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7eaf8a30 con 0x556b7e9fa7b0 2024-09-18T01:45:24.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.682+0000 7f98df2ef640 1 -- 172.21.15.146:0/3424777447 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f98d800a4a0 con 0x556b7e9fa7b0 2024-09-18T01:45:24.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.682+0000 7f98e2d35800 1 --2- 172.21.15.146:0/3424777447 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x556b7eafa940 0x556b7eafcd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.682+0000 7f98e2d35800 1 -- 172.21.15.146:0/3424777447 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7eafd340 con 0x556b7eafa940 2024-09-18T01:45:24.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.682+0000 7f98deaee640 1 --2- 172.21.15.146:0/3424777447 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x556b7eafa940 0x556b7eafcd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.682+0000 7f98deaee640 1 --2- 172.21.15.146:0/3424777447 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x556b7eafa940 0x556b7eafcd30 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.683+0000 7f98deaee640 1 -- 172.21.15.146:0/3424777447 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f98d0075030 con 0x556b7eafa940 2024-09-18T01:45:24.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.683+0000 7f98e2d35800 1 Processor -- start 2024-09-18T01:45:24.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.683+0000 7f98e2d35800 1 -- start start 2024-09-18T01:45:24.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.683+0000 7f98e2d35800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556b7eb0b0f0 0x556b7eb0b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.683+0000 7f98e2d35800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x556b7e892580 con 0x556b7eb0b0f0 2024-09-18T01:45:24.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.683+0000 7f98df2ef640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556b7eb0b0f0 0x556b7eb0b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.683+0000 7f98df2ef640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556b7eb0b0f0 0x556b7eb0b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60122/0 (socket says 172.21.15.146:60122) 2024-09-18T01:45:24.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.683+0000 7f98df2ef640 1 -- 172.21.15.146:0/423125539 learned_addr learned my addr 172.21.15.146:0/423125539 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:24.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.684+0000 7f98df2ef640 1 -- 172.21.15.146:0/423125539 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b7eb0ba50 con 0x556b7eb0b0f0 2024-09-18T01:45:24.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.684+0000 7f98df2ef640 1 --2- 172.21.15.146:0/423125539 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556b7eb0b0f0 0x556b7eb0b510 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x556b7eaf7d00 tx=0x7f98d80178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.684+0000 7f97c8e01640 1 -- 172.21.15.146:0/423125539 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98d8013440 con 0x556b7eb0b0f0 2024-09-18T01:45:24.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.684+0000 7f97c8e01640 1 -- 172.21.15.146:0/423125539 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98d80135e0 con 0x556b7eb0b0f0 2024-09-18T01:45:24.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.684+0000 7f97c8e01640 1 -- 172.21.15.146:0/423125539 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98d80138c0 con 0x556b7eb0b0f0 2024-09-18T01:45:24.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.684+0000 7f98e2d35800 1 -- 172.21.15.146:0/423125539 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556b7eb0bce0 con 0x556b7eb0b0f0 2024-09-18T01:45:24.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.684+0000 7f98e2d35800 1 -- 172.21.15.146:0/423125539 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b7eb0e9c0 con 0x556b7eb0b0f0 2024-09-18T01:45:24.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.685+0000 7f97c8e01640 1 -- 172.21.15.146:0/423125539 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f98d8011040 con 0x556b7eb0b0f0 2024-09-18T01:45:24.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.685+0000 7f97c8e01640 1 --2- 172.21.15.146:0/423125539 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f97b8036b40 0x7f97b8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.685+0000 7f97c8e01640 1 -- 172.21.15.146:0/423125539 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f98d801d070 con 0x556b7eb0b0f0 2024-09-18T01:45:24.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.685+0000 7f98deaee640 1 --2- 172.21.15.146:0/423125539 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f97b8036b40 0x7f97b8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.685+0000 7f98e2d35800 1 Processor -- start 2024-09-18T01:45:24.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.685+0000 7f98deaee640 1 --2- 172.21.15.146:0/423125539 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f97b8036b40 0x7f97b8039000 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x556b7eaf8dd0 tx=0x7f98d008f2f0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.685+0000 7f98e2d35800 1 -- start start 2024-09-18T01:45:24.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.685+0000 7f98e2d35800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556b7eb17d90 0x556b7eb18190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.685+0000 7f98e2d35800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x556b7e9f6180 con 0x556b7eb17d90 2024-09-18T01:45:24.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.686+0000 7f98df2ef640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556b7eb17d90 0x556b7eb18190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.686+0000 7f98df2ef640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556b7eb17d90 0x556b7eb18190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60132/0 (socket says 172.21.15.146:60132) 2024-09-18T01:45:24.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.686+0000 7f98df2ef640 1 -- 172.21.15.146:0/70488464 learned_addr learned my addr 172.21.15.146:0/70488464 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:24.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.686+0000 7f98df2ef640 1 -- 172.21.15.146:0/70488464 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b7eb18760 con 0x556b7eb17d90 2024-09-18T01:45:24.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.686+0000 7f98df2ef640 1 --2- 172.21.15.146:0/70488464 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556b7eb17d90 0x556b7eb18190 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f98d8001450 tx=0x7f98d804caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cadbd9c123fe155c server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.686+0000 7f97c27fc640 1 -- 172.21.15.146:0/70488464 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98d8045070 con 0x556b7eb17d90 2024-09-18T01:45:24.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.686+0000 7f97c27fc640 1 -- 172.21.15.146:0/70488464 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98d8015560 con 0x556b7eb17d90 2024-09-18T01:45:24.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.686+0000 7f97c27fc640 1 -- 172.21.15.146:0/70488464 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98d802ad80 con 0x556b7eb17d90 2024-09-18T01:45:24.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.686+0000 7f98e2d35800 1 -- 172.21.15.146:0/70488464 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556b7eb17d90 msgr2=0x556b7eb18190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.686+0000 7f98e2d35800 1 --2- 172.21.15.146:0/70488464 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556b7eb17d90 0x556b7eb18190 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f98d8001450 tx=0x7f98d804caf0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.687+0000 7f98e2d35800 1 -- 172.21.15.146:0/70488464 shutdown_connections 2024-09-18T01:45:24.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.687+0000 7f98e2d35800 1 --2- 172.21.15.146:0/70488464 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556b7eb17d90 0x556b7eb18190 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.687+0000 7f98e2d35800 1 -- 172.21.15.146:0/70488464 >> 172.21.15.146:0/70488464 conn(0x556b7eb14140 msgr2=0x556b7eb12240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:24.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.687+0000 7f98e2d35800 1 -- 172.21.15.146:0/70488464 shutdown_connections 2024-09-18T01:45:24.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.687+0000 7f98e2d35800 1 -- 172.21.15.146:0/70488464 wait complete. 2024-09-18T01:45:24.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.687+0000 7f98e2d35800 1 Processor -- start 2024-09-18T01:45:24.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.687+0000 7f98e2d35800 1 -- start start 2024-09-18T01:45:24.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.687+0000 7f98e2d35800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556b7eb17d90 0x556b7eb1f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.687+0000 7f98e2d35800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x556b7eb18d30 con 0x556b7eb17d90 2024-09-18T01:45:24.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.687+0000 7f98df2ef640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556b7eb17d90 0x556b7eb1f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.687+0000 7f98df2ef640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556b7eb17d90 0x556b7eb1f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60136/0 (socket says 172.21.15.146:60136) 2024-09-18T01:45:24.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.687+0000 7f98df2ef640 1 -- 172.21.15.146:0/1565266069 learned_addr learned my addr 172.21.15.146:0/1565266069 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:24.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.687+0000 7f98df2ef640 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b7eb1f6c0 con 0x556b7eb17d90 2024-09-18T01:45:24.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.688+0000 7f98df2ef640 1 --2- 172.21.15.146:0/1565266069 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556b7eb17d90 0x556b7eb1f180 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f98d8043040 tx=0x7f98d804c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.688+0000 7f97c0ff9640 1 -- 172.21.15.146:0/1565266069 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98d803a070 con 0x556b7eb17d90 2024-09-18T01:45:24.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.688+0000 7f97c0ff9640 1 -- 172.21.15.146:0/1565266069 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98d804b380 con 0x556b7eb17d90 2024-09-18T01:45:24.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.688+0000 7f98e2d35800 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556b7eb1f950 con 0x556b7eb17d90 2024-09-18T01:45:24.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.688+0000 7f97c0ff9640 1 -- 172.21.15.146:0/1565266069 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98d8045040 con 0x556b7eb17d90 2024-09-18T01:45:24.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.688+0000 7f98e2d35800 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b7eb22600 con 0x556b7eb17d90 2024-09-18T01:45:24.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.688+0000 7f97c0ff9640 1 -- 172.21.15.146:0/1565266069 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f98d803d070 con 0x556b7eb17d90 2024-09-18T01:45:24.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.688+0000 7f97c0ff9640 1 --2- 172.21.15.146:0/1565266069 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f97a8036b40 0x7f97a8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.689+0000 7f97c0ff9640 1 -- 172.21.15.146:0/1565266069 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f98d800e040 con 0x556b7eb17d90 2024-09-18T01:45:24.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.689+0000 7f98deaee640 1 --2- 172.21.15.146:0/1565266069 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f97a8036b40 0x7f97a8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.689+0000 7f98e2d35800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.689+0000 7f98e2d35800 1 --2- 172.21.15.146:0/1565266069 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x556b7eb2ae60 0x556b7eb2d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.689+0000 7f98e2d35800 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb2da70 con 0x556b7eb2ae60 2024-09-18T01:45:24.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.689+0000 7f98deaee640 1 --2- 172.21.15.146:0/1565266069 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f97a8036b40 0x7f97a8039000 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x556b7eafd740 tx=0x7f98d008e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.689+0000 7f98de2ed640 1 --2- 172.21.15.146:0/1565266069 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x556b7eb2ae60 0x556b7eb2d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.689+0000 7f98de2ed640 1 --2- 172.21.15.146:0/1565266069 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x556b7eb2ae60 0x556b7eb2d320 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.690+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98d400bdb0 con 0x556b7eb2ae60 2024-09-18T01:45:24.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.690+0000 7f98e2d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.690+0000 7f98e2d35800 20 realm 2024-09-18T01:45:24.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.690+0000 7f98e2d35800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.690+0000 7f98e2d35800 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb2a2b0 con 0x556b7eb2ae60 2024-09-18T01:45:24.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.690+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98d400bdb0 con 0x556b7eb2ae60 2024-09-18T01:45:24.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.690+0000 7f98e2d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.690+0000 7f98e2d35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:24.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.690+0000 7f98e2d35800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.690+0000 7f98e2d35800 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb2e550 con 0x556b7eb2ae60 2024-09-18T01:45:24.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.690+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98d400bdb0 con 0x556b7eb2ae60 2024-09-18T01:45:24.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.690+0000 7f98e2d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.690+0000 7f98e2d35800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.690+0000 7f98e2d35800 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb2ee20 con 0x556b7eb2ae60 2024-09-18T01:45:24.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.690+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f98d400bdb0 con 0x556b7eb2ae60 2024-09-18T01:45:24.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.690+0000 7f98e2d35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:24.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.690+0000 7f98e2d35800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.690+0000 7f98e2d35800 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb2f1c0 con 0x556b7eb2ae60 2024-09-18T01:45:24.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.691+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f98d400bdb0 con 0x556b7eb2ae60 2024-09-18T01:45:24.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.691+0000 7f98e2d35800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:24.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.691+0000 7f98e2d35800 20 searching for the correct realm 2024-09-18T01:45:24.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.691+0000 7f98e2d35800 1 --2- 172.21.15.146:0/1565266069 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x556b7eb310a0 0x556b7eb33490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.691+0000 7f98e2d35800 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb33b60 con 0x556b7eb310a0 2024-09-18T01:45:24.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.691+0000 7f98df2ef640 1 --2- 172.21.15.146:0/1565266069 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x556b7eb310a0 0x556b7eb33490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.691+0000 7f98df2ef640 1 --2- 172.21.15.146:0/1565266069 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x556b7eb310a0 0x556b7eb33490 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.691+0000 7f98df2ef640 1 -- 172.21.15.146:0/1565266069 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98d803c030 con 0x556b7eb310a0 2024-09-18T01:45:24.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.691+0000 7f98df2ef640 1 --2- 172.21.15.146:0/1565266069 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f98d803f060 0x7f98d800f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.691+0000 7f98df2ef640 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb33b60 con 0x7f98d803f060 2024-09-18T01:45:24.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.691+0000 7f98deaee640 1 --2- 172.21.15.146:0/1565266069 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f98d803f060 0x7f98d800f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.692+0000 7f98deaee640 1 --2- 172.21.15.146:0/1565266069 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f98d803f060 0x7f98d800f2b0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.692+0000 7f98deaee640 1 -- 172.21.15.146:0/1565266069 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98d008f040 con 0x7f98d803f060 2024-09-18T01:45:24.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.692+0000 7f98deaee640 1 --2- 172.21.15.146:0/1565266069 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f98d0095070 0x7f98d008f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.692+0000 7f98deaee640 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb33b60 con 0x7f98d0095070 2024-09-18T01:45:24.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.692+0000 7f98de2ed640 1 --2- 172.21.15.146:0/1565266069 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f98d0095070 0x7f98d008f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.692+0000 7f98de2ed640 1 --2- 172.21.15.146:0/1565266069 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f98d0095070 0x7f98d008f920 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.693+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98d400bdb0 con 0x7f98d0095070 2024-09-18T01:45:24.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.693+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb33b60 con 0x556b7eb2ae60 2024-09-18T01:45:24.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.693+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f98d400bdb0 con 0x556b7eb2ae60 2024-09-18T01:45:24.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.693+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb33b60 con 0x556b7eb2ae60 2024-09-18T01:45:24.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.693+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98d402b040 con 0x556b7eb2ae60 2024-09-18T01:45:24.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.693+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb33b60 con 0x7f98d0095070 2024-09-18T01:45:24.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.693+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98d402b040 con 0x7f98d0095070 2024-09-18T01:45:24.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.693+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb33b60 con 0x7f98d0095070 2024-09-18T01:45:24.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.693+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98d402b040 con 0x7f98d0095070 2024-09-18T01:45:24.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.694+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb33b60 con 0x7f98d803f060 2024-09-18T01:45:24.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.694+0000 7f98deaee640 1 -- 172.21.15.146:0/1565266069 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98d008f040 con 0x7f98d803f060 2024-09-18T01:45:24.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.694+0000 7f98deaee640 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb33b60 con 0x556b7eb310a0 2024-09-18T01:45:24.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.694+0000 7f98df2ef640 1 -- 172.21.15.146:0/1565266069 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98d803c030 con 0x556b7eb310a0 2024-09-18T01:45:24.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.694+0000 7f98df2ef640 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb33b60 con 0x556b7eb2ae60 2024-09-18T01:45:24.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.694+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98d402b040 con 0x556b7eb2ae60 2024-09-18T01:45:24.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.694+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb33b60 con 0x7f98d0095070 2024-09-18T01:45:24.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.694+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98d402b040 con 0x7f98d0095070 2024-09-18T01:45:24.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.694+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb33b60 con 0x556b7eb2ae60 2024-09-18T01:45:24.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.695+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98d402b040 con 0x556b7eb2ae60 2024-09-18T01:45:24.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.695+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb33b60 con 0x7f98d803f060 2024-09-18T01:45:24.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.695+0000 7f98deaee640 1 -- 172.21.15.146:0/1565266069 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f98d00ae040 con 0x7f98d803f060 2024-09-18T01:45:24.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.695+0000 7f98deaee640 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb33b60 con 0x556b7eb310a0 2024-09-18T01:45:24.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.695+0000 7f98df2ef640 1 -- 172.21.15.146:0/1565266069 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98d803c030 con 0x556b7eb310a0 2024-09-18T01:45:24.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.695+0000 7f98df2ef640 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb33b60 con 0x556b7eb310a0 2024-09-18T01:45:24.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.695+0000 7f98df2ef640 1 -- 172.21.15.146:0/1565266069 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98d803c030 con 0x556b7eb310a0 2024-09-18T01:45:24.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.695+0000 7f98df2ef640 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb33b60 con 0x7f98d0095070 2024-09-18T01:45:24.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.696+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98d402b040 con 0x7f98d0095070 2024-09-18T01:45:24.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.696+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb33b60 con 0x556b7eb310a0 2024-09-18T01:45:24.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.696+0000 7f98df2ef640 1 -- 172.21.15.146:0/1565266069 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98d803c030 con 0x556b7eb310a0 2024-09-18T01:45:24.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.696+0000 7f98df2ef640 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb33b60 con 0x556b7eb310a0 2024-09-18T01:45:24.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.696+0000 7f98df2ef640 1 -- 172.21.15.146:0/1565266069 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98d803c030 con 0x556b7eb310a0 2024-09-18T01:45:24.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.696+0000 7f98df2ef640 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb33b60 con 0x556b7eb2ae60 2024-09-18T01:45:24.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.696+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98d402b040 con 0x556b7eb2ae60 2024-09-18T01:45:24.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.696+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb33b60 con 0x556b7eb2ae60 2024-09-18T01:45:24.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.697+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f98d402b040 con 0x556b7eb2ae60 2024-09-18T01:45:24.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.697+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb33b60 con 0x7f98d0095070 2024-09-18T01:45:24.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.697+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98d402b040 con 0x7f98d0095070 2024-09-18T01:45:24.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.697+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb33b60 con 0x556b7eb310a0 2024-09-18T01:45:24.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.697+0000 7f98df2ef640 1 -- 172.21.15.146:0/1565266069 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98d803c030 con 0x556b7eb310a0 2024-09-18T01:45:24.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.697+0000 7f98df2ef640 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb33b60 con 0x7f98d803f060 2024-09-18T01:45:24.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.697+0000 7f98deaee640 1 -- 172.21.15.146:0/1565266069 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98d00ae040 con 0x7f98d803f060 2024-09-18T01:45:24.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.697+0000 7f98deaee640 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb33b60 con 0x556b7eb2ae60 2024-09-18T01:45:24.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.698+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98d402b040 con 0x556b7eb2ae60 2024-09-18T01:45:24.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.698+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb33b60 con 0x7f98d0095070 2024-09-18T01:45:24.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.698+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98d402b040 con 0x7f98d0095070 2024-09-18T01:45:24.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.698+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb33b60 con 0x556b7eb310a0 2024-09-18T01:45:24.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.698+0000 7f98df2ef640 1 -- 172.21.15.146:0/1565266069 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98d803c030 con 0x556b7eb310a0 2024-09-18T01:45:24.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.698+0000 7f98df2ef640 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb33b60 con 0x7f98d0095070 2024-09-18T01:45:24.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.699+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98d402b040 con 0x7f98d0095070 2024-09-18T01:45:24.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.699+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb33b60 con 0x7f98d803f060 2024-09-18T01:45:24.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.699+0000 7f98deaee640 1 -- 172.21.15.146:0/1565266069 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98d00ae040 con 0x7f98d803f060 2024-09-18T01:45:24.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.699+0000 7f98deaee640 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb33b60 con 0x556b7eb310a0 2024-09-18T01:45:24.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.699+0000 7f98df2ef640 1 -- 172.21.15.146:0/1565266069 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98d803c030 con 0x556b7eb310a0 2024-09-18T01:45:24.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.699+0000 7f98df2ef640 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb33b60 con 0x7f98d0095070 2024-09-18T01:45:24.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.699+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98d402b040 con 0x7f98d0095070 2024-09-18T01:45:24.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.699+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb33b60 con 0x556b7eb2ae60 2024-09-18T01:45:24.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.699+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f98d403b040 con 0x556b7eb2ae60 2024-09-18T01:45:24.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.699+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb33b60 con 0x7f98d803f060 2024-09-18T01:45:24.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.700+0000 7f98deaee640 1 -- 172.21.15.146:0/1565266069 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98d00ae040 con 0x7f98d803f060 2024-09-18T01:45:24.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.700+0000 7f98e2d35800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:24.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.700+0000 7f98e2d35800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:24.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.700+0000 7f98e2d35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:24.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.700+0000 7f98e2d35800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:24.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.700+0000 7f98e2d35800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:24.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.700+0000 7f98e2d35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:24.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.700+0000 7f98e2d35800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.700+0000 7f98e2d35800 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb2fb70 con 0x556b7eb2ae60 2024-09-18T01:45:24.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.700+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98d403b040 con 0x556b7eb2ae60 2024-09-18T01:45:24.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.700+0000 7f98e2d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.700+0000 7f98e2d35800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.700+0000 7f98e2d35800 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb30410 con 0x556b7eb2ae60 2024-09-18T01:45:24.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.700+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f98d403b040 con 0x556b7eb2ae60 2024-09-18T01:45:24.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.700+0000 7f98e2d35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:24.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.700+0000 7f98e2d35800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.700+0000 7f98e2d35800 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb2f7b0 con 0x7f98d803f060 2024-09-18T01:45:24.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.700+0000 7f98deaee640 1 -- 172.21.15.146:0/1565266069 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f98d00ae040 con 0x7f98d803f060 2024-09-18T01:45:24.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.700+0000 7f98e2d35800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:24.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.700+0000 7f98e2d35800 20 zone default found 2024-09-18T01:45:24.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.700+0000 7f98e2d35800 4 Realm: () 2024-09-18T01:45:24.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.700+0000 7f98e2d35800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:24.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.700+0000 7f98e2d35800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:24.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.700+0000 7f98e2d35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:24.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.700+0000 7f98e2d35800 20 zonegroup default 2024-09-18T01:45:24.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.700+0000 7f98e2d35800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.700+0000 7f98e2d35800 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb34490 con 0x7f98d0095070 2024-09-18T01:45:24.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.701+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f98d403b040 con 0x7f98d0095070 2024-09-18T01:45:24.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.701+0000 7f98e2d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.701+0000 7f98e2d35800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.701+0000 7f98e2d35800 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb35ff0 con 0x556b7eb310a0 2024-09-18T01:45:24.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.701+0000 7f98df2ef640 1 -- 172.21.15.146:0/1565266069 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f98d803c030 con 0x556b7eb310a0 2024-09-18T01:45:24.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.701+0000 7f98e2d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.701+0000 7f98e2d35800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.701+0000 7f98e2d35800 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb36480 con 0x556b7eb310a0 2024-09-18T01:45:24.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.701+0000 7f98df2ef640 1 -- 172.21.15.146:0/1565266069 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f98d803c030 con 0x556b7eb310a0 2024-09-18T01:45:24.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.701+0000 7f98e2d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.701+0000 7f98e2d35800 20 started sync module instance, tier type = 2024-09-18T01:45:24.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.701+0000 7f98e2d35800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:24.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.701+0000 7f98e2d35800 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb34ef0 con 0x7f98d803f060 2024-09-18T01:45:24.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.702+0000 7f98deaee640 1 -- 172.21.15.146:0/1565266069 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v31'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98d00ae040 con 0x7f98d803f060 2024-09-18T01:45:24.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.702+0000 7f98e2d35800 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93920175543008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb36d90 con 0x7f98d803f060 2024-09-18T01:45:24.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.702+0000 7f98e2d35800 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb375e0 con 0x556b7eb2ae60 2024-09-18T01:45:24.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.703+0000 7f98deaee640 1 -- 172.21.15.146:0/1565266069 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93920175543008] v31'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98d00ae040 con 0x7f98d803f060 2024-09-18T01:45:24.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.703+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v31'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98d403b040 con 0x556b7eb2ae60 2024-09-18T01:45:24.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.704+0000 7f98e2d35800 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93920175548640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb37640 con 0x556b7eb2ae60 2024-09-18T01:45:24.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.704+0000 7f98e2d35800 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb38150 con 0x556b7eb310a0 2024-09-18T01:45:24.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.705+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93920175548640] v31'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98d403b040 con 0x556b7eb2ae60 2024-09-18T01:45:24.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.705+0000 7f98df2ef640 1 -- 172.21.15.146:0/1565266069 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v31'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98d803c030 con 0x556b7eb310a0 2024-09-18T01:45:24.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.705+0000 7f98e2d35800 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93920175553536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb38540 con 0x556b7eb310a0 2024-09-18T01:45:24.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.705+0000 7f98e2d35800 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb38f80 con 0x7f98d803f060 2024-09-18T01:45:24.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.706+0000 7f98df2ef640 1 -- 172.21.15.146:0/1565266069 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93920175553536] v31'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98d803c030 con 0x556b7eb310a0 2024-09-18T01:45:24.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.706+0000 7f98deaee640 1 -- 172.21.15.146:0/1565266069 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v31'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98d00ae040 con 0x7f98d803f060 2024-09-18T01:45:24.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.706+0000 7f98e2d35800 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93920175557200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb39370 con 0x7f98d803f060 2024-09-18T01:45:24.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.706+0000 7f98e2d35800 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb39d90 con 0x556b7eb2ae60 2024-09-18T01:45:24.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.707+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v31'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98d403b040 con 0x556b7eb2ae60 2024-09-18T01:45:24.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.707+0000 7f98e2d35800 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93920175560832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb3a660 con 0x556b7eb2ae60 2024-09-18T01:45:24.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.707+0000 7f98e2d35800 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb3b130 con 0x7f98d0095070 2024-09-18T01:45:24.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.707+0000 7f98deaee640 1 -- 172.21.15.146:0/1565266069 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93920175557200] v31'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98d00ae040 con 0x7f98d803f060 2024-09-18T01:45:24.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.708+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v31'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98d403b040 con 0x7f98d0095070 2024-09-18T01:45:24.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.708+0000 7f98e2d35800 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93920175565856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb3b0f0 con 0x7f98d0095070 2024-09-18T01:45:24.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.708+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93920175560832] v31'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98d403b040 con 0x556b7eb2ae60 2024-09-18T01:45:24.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.708+0000 7f98e2d35800 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb3a1b0 con 0x7f98d0095070 2024-09-18T01:45:24.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.709+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93920175565856] v31'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98d403b040 con 0x7f98d0095070 2024-09-18T01:45:24.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.709+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v31'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98d403b040 con 0x7f98d0095070 2024-09-18T01:45:24.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.709+0000 7f98e2d35800 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93920175563184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb3b690 con 0x7f98d0095070 2024-09-18T01:45:24.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.709+0000 7f98e2d35800 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb3c050 con 0x7f98d0095070 2024-09-18T01:45:24.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.710+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93920175563184] v31'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98d403b040 con 0x7f98d0095070 2024-09-18T01:45:24.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.710+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v31'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98d403b040 con 0x7f98d0095070 2024-09-18T01:45:24.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.710+0000 7f98e2d35800 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93920175550768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb3c050 con 0x7f98d0095070 2024-09-18T01:45:24.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.710+0000 7f98e2d35800 20 add_watcher() i=0 2024-09-18T01:45:24.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.710+0000 7f98e2d35800 20 add_watcher() i=1 2024-09-18T01:45:24.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.710+0000 7f98e2d35800 20 add_watcher() i=2 2024-09-18T01:45:24.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.710+0000 7f98e2d35800 20 add_watcher() i=3 2024-09-18T01:45:24.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.710+0000 7f98e2d35800 20 add_watcher() i=4 2024-09-18T01:45:24.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.710+0000 7f98e2d35800 20 add_watcher() i=5 2024-09-18T01:45:24.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.710+0000 7f98e2d35800 20 add_watcher() i=6 2024-09-18T01:45:24.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.711+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93920175550768] v31'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98d403b040 con 0x7f98d0095070 2024-09-18T01:45:24.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.711+0000 7f98e2d35800 20 add_watcher() i=7 2024-09-18T01:45:24.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.711+0000 7f98e2d35800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:24.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.711+0000 7f98e2d35800 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb3f390 con 0x556b7eb2ae60 2024-09-18T01:45:24.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.711+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f98d403b040 con 0x556b7eb2ae60 2024-09-18T01:45:24.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.711+0000 7f98e2d35800 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93920175570192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb3c5e0 con 0x556b7eb2ae60 2024-09-18T01:45:24.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.712+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93920175570192] v31'82 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f98d403b040 con 0x556b7eb2ae60 2024-09-18T01:45:24.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.712+0000 7f97957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:24.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.712+0000 7f98e2d35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:24.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.712+0000 7f98e2d35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:24.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.712+0000 7f98e2d35800 5 note: GC not initialized 2024-09-18T01:45:24.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.712+0000 7f970ffff640 20 reqs_thread_entry: start 2024-09-18T01:45:24.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.712+0000 7f98e2d35800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:24.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.712+0000 7f98e2d35800 20 Filter name: none 2024-09-18T01:45:24.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.713+0000 7f970dffb640 20 reqs_thread_entry: start 2024-09-18T01:45:24.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.713+0000 7f98e2d35800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.713+0000 7f98e2d35800 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb723b0 con 0x556b7eb2ae60 2024-09-18T01:45:24.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.713+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f98d403b040 con 0x556b7eb2ae60 2024-09-18T01:45:24.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.713+0000 7f98e2d35800 20 rados_obj.operate() r=0 bl.length=556 2024-09-18T01:45:24.725 INFO:teuthology.orchestra.run.smithi146.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T01:45:23.010714Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:45:23.010705Z","tags":[],"group_ids":[]} 2024-09-18T01:45:24.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.714+0000 7f97957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:24.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.714+0000 7f98e2d35800 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93920175570192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb70e60 con 0x556b7eb2ae60 2024-09-18T01:45:24.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.715+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93920175570192] v31'83 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f98d403b040 con 0x556b7eb2ae60 2024-09-18T01:45:24.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.715+0000 7f98e2d35800 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93920175543008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb3bd10 con 0x7f98d803f060 2024-09-18T01:45:24.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.716+0000 7f98deaee640 1 -- 172.21.15.146:0/1565266069 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93920175543008] v31'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98d00ae040 con 0x7f98d803f060 2024-09-18T01:45:24.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.716+0000 7f98e2d35800 20 remove_watcher() i=0 2024-09-18T01:45:24.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.716+0000 7f98e2d35800 2 removed watcher, disabling cache 2024-09-18T01:45:24.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.716+0000 7f98e2d35800 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93920175548640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb3bd10 con 0x556b7eb2ae60 2024-09-18T01:45:24.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.717+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93920175548640] v31'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98d403b040 con 0x556b7eb2ae60 2024-09-18T01:45:24.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.717+0000 7f98e2d35800 20 remove_watcher() i=1 2024-09-18T01:45:24.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.717+0000 7f98e2d35800 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93920175553536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb368e0 con 0x556b7eb310a0 2024-09-18T01:45:24.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.718+0000 7f98df2ef640 1 -- 172.21.15.146:0/1565266069 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93920175553536] v31'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98d803c030 con 0x556b7eb310a0 2024-09-18T01:45:24.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.718+0000 7f98e2d35800 20 remove_watcher() i=2 2024-09-18T01:45:24.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.718+0000 7f98e2d35800 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93920175557200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb3bd10 con 0x7f98d803f060 2024-09-18T01:45:24.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.719+0000 7f98deaee640 1 -- 172.21.15.146:0/1565266069 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93920175557200] v31'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98d00ae040 con 0x7f98d803f060 2024-09-18T01:45:24.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.719+0000 7f98e2d35800 20 remove_watcher() i=3 2024-09-18T01:45:24.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.719+0000 7f98e2d35800 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93920175560832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb37c00 con 0x556b7eb2ae60 2024-09-18T01:45:24.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.720+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93920175560832] v31'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98d403b040 con 0x556b7eb2ae60 2024-09-18T01:45:24.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.720+0000 7f98e2d35800 20 remove_watcher() i=4 2024-09-18T01:45:24.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.720+0000 7f98e2d35800 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93920175565856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb368e0 con 0x7f98d0095070 2024-09-18T01:45:24.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.721+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93920175565856] v31'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98d403b040 con 0x7f98d0095070 2024-09-18T01:45:24.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.721+0000 7f98e2d35800 20 remove_watcher() i=5 2024-09-18T01:45:24.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.721+0000 7f98e2d35800 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93920175563184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb38a50 con 0x7f98d0095070 2024-09-18T01:45:24.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.722+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93920175563184] v31'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98d403b040 con 0x7f98d0095070 2024-09-18T01:45:24.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.722+0000 7f98e2d35800 20 remove_watcher() i=6 2024-09-18T01:45:24.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.722+0000 7f98e2d35800 1 -- 172.21.15.146:0/1565266069 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93920175550768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7eb3bd10 con 0x7f98d0095070 2024-09-18T01:45:24.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.723+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93920175550768] v31'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98d403b040 con 0x7f98d0095070 2024-09-18T01:45:24.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.723+0000 7f98e2d35800 20 remove_watcher() i=7 2024-09-18T01:45:24.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.723+0000 7f98e2d35800 1 -- 172.21.15.146:0/1565266069 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f98d0095070 msgr2=0x7f98d008f920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.723+0000 7f98e2d35800 1 --2- 172.21.15.146:0/1565266069 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f98d0095070 0x7f98d008f920 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.723+0000 7f98e2d35800 1 -- 172.21.15.146:0/1565266069 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x556b7eb2ae60 msgr2=0x556b7eb2d320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.723+0000 7f98e2d35800 1 --2- 172.21.15.146:0/1565266069 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x556b7eb2ae60 0x556b7eb2d320 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.723+0000 7f98e2d35800 1 -- 172.21.15.146:0/1565266069 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f98d803f060 msgr2=0x7f98d800f2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.723+0000 7f98e2d35800 1 --2- 172.21.15.146:0/1565266069 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f98d803f060 0x7f98d800f2b0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.723+0000 7f98e2d35800 1 -- 172.21.15.146:0/1565266069 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x556b7eb310a0 msgr2=0x556b7eb33490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.723+0000 7f98e2d35800 1 --2- 172.21.15.146:0/1565266069 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x556b7eb310a0 0x556b7eb33490 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.723+0000 7f98e2d35800 1 -- 172.21.15.146:0/1565266069 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f97a8036b40 msgr2=0x7f97a8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.723+0000 7f98e2d35800 1 --2- 172.21.15.146:0/1565266069 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f97a8036b40 0x7f97a8039000 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x556b7eafd740 tx=0x7f98d008e000 comp rx=0 tx=0).stop 2024-09-18T01:45:24.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.723+0000 7f98e2d35800 1 -- 172.21.15.146:0/1565266069 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556b7eb17d90 msgr2=0x556b7eb1f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.723+0000 7f98e2d35800 1 --2- 172.21.15.146:0/1565266069 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556b7eb17d90 0x556b7eb1f180 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f98d8043040 tx=0x7f98d804c880 comp rx=0 tx=0).stop 2024-09-18T01:45:24.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.723+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 reap_dead start 2024-09-18T01:45:24.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.723+0000 7f98de2ed640 1 -- 172.21.15.146:0/1565266069 reap_dead start 2024-09-18T01:45:24.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.723+0000 7f98e2d35800 1 -- 172.21.15.146:0/1565266069 shutdown_connections 2024-09-18T01:45:24.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.723+0000 7f98e2d35800 1 -- 172.21.15.146:0/1565266069 >> 172.21.15.146:0/1565266069 conn(0x556b7eb14140 msgr2=0x556b7eb194a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:24.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.723+0000 7f98e2d35800 1 -- 172.21.15.146:0/1565266069 shutdown_connections 2024-09-18T01:45:24.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.723+0000 7f98e2d35800 1 -- 172.21.15.146:0/1565266069 wait complete. 2024-09-18T01:45:24.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.724+0000 7f98e2d35800 1 -- 172.21.15.146:0/423125539 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f97b8036b40 msgr2=0x7f97b8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.724+0000 7f98e2d35800 1 --2- 172.21.15.146:0/423125539 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f97b8036b40 0x7f97b8039000 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x556b7eaf8dd0 tx=0x7f98d008f2f0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.724+0000 7f98e2d35800 1 -- 172.21.15.146:0/423125539 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556b7eb0b0f0 msgr2=0x556b7eb0b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.724+0000 7f98e2d35800 1 --2- 172.21.15.146:0/423125539 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556b7eb0b0f0 0x556b7eb0b510 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x556b7eaf7d00 tx=0x7f98d80178e0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.724+0000 7f98e2d35800 1 -- 172.21.15.146:0/423125539 shutdown_connections 2024-09-18T01:45:24.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.724+0000 7f98e2d35800 1 --2- 172.21.15.146:0/423125539 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f97b8036b40 0x7f97b8039000 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.724+0000 7f98e2d35800 1 --2- 172.21.15.146:0/423125539 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556b7eb0b0f0 0x556b7eb0b510 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.724+0000 7f98e2d35800 1 -- 172.21.15.146:0/423125539 >> 172.21.15.146:0/423125539 conn(0x556b7eb00080 msgr2=0x556b7eb02c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:24.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.724+0000 7f98e2d35800 1 -- 172.21.15.146:0/423125539 shutdown_connections 2024-09-18T01:45:24.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.724+0000 7f98e2d35800 1 -- 172.21.15.146:0/423125539 wait complete. 2024-09-18T01:45:24.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.724+0000 7f98e2d35800 1 -- 172.21.15.146:0/3424777447 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x556b7e9fa7b0 msgr2=0x556b7eaf73a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.724+0000 7f98e2d35800 1 --2- 172.21.15.146:0/3424777447 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x556b7e9fa7b0 0x556b7eaf73a0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.724+0000 7f98e2d35800 1 -- 172.21.15.146:0/3424777447 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x556b7eafa940 msgr2=0x556b7eafcd30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.724+0000 7f98e2d35800 1 --2- 172.21.15.146:0/3424777447 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x556b7eafa940 0x556b7eafcd30 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.724+0000 7f98e2d35800 1 -- 172.21.15.146:0/3424777447 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f97c4036b40 msgr2=0x7f97c4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.724+0000 7f98e2d35800 1 --2- 172.21.15.146:0/3424777447 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f97c4036b40 0x7f97c4039000 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f98d4001e10 tx=0x7f98d4001390 comp rx=0 tx=0).stop 2024-09-18T01:45:24.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.724+0000 7f98e2d35800 1 -- 172.21.15.146:0/3424777447 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556b7e96b610 msgr2=0x556b7eaf0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.724+0000 7f98e2d35800 1 --2- 172.21.15.146:0/3424777447 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556b7e96b610 0x556b7eaf0330 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f98d0067040 tx=0x7f98d0002fb0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.724+0000 7f98e2d35800 1 -- 172.21.15.146:0/3424777447 shutdown_connections 2024-09-18T01:45:24.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.724+0000 7f98e2d35800 1 --2- 172.21.15.146:0/3424777447 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x556b7eafa940 0x556b7eafcd30 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.724+0000 7f98e2d35800 1 --2- 172.21.15.146:0/3424777447 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x556b7e9fa7b0 0x556b7eaf73a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.724+0000 7f98e2d35800 1 --2- 172.21.15.146:0/3424777447 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f97c4036b40 0x7f97c4039000 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.724+0000 7f98e2d35800 1 --2- 172.21.15.146:0/3424777447 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556b7e96b610 0x556b7eaf0330 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.724+0000 7f98e2d35800 1 -- 172.21.15.146:0/3424777447 >> 172.21.15.146:0/3424777447 conn(0x556b7e9f1de0 msgr2=0x556b7e9f66b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:24.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.724+0000 7f98e2d35800 1 -- 172.21.15.146:0/3424777447 shutdown_connections 2024-09-18T01:45:24.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.724+0000 7f98e2d35800 1 -- 172.21.15.146:0/3424777447 wait complete. 2024-09-18T01:45:24.736 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T01:45:23.010714Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:45:23.010705Z', 'tags': [], 'group_ids': []} 2024-09-18T01:45:24.736 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-18T01:45:24.736 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-18T01:45:24.736 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo2 --secret ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy --key-type swift 2024-09-18T01:45:24.785 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:24.785 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:24.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.785+0000 7f0fd4b26800 1 Processor -- start 2024-09-18T01:45:24.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.785+0000 7f0fd4b26800 1 -- start start 2024-09-18T01:45:24.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.785+0000 7f0fd4b26800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55ff41d219b0 0x55ff41d23da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.785+0000 7f0fd4b26800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ff41bdcb30 con 0x55ff41c91630 2024-09-18T01:45:24.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.785+0000 7f0fd4b26800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x55ff41bbe360 con 0x55ff41d219b0 2024-09-18T01:45:24.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.785+0000 7f0fc7fbe640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55ff41d219b0 0x55ff41d23da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.785+0000 7f0fc7fbe640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55ff41d219b0 0x55ff41d23da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60138/0 (socket says 172.21.15.146:60138) 2024-09-18T01:45:24.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.785+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/2963005850 learned_addr learned my addr 172.21.15.146:0/2963005850 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:24.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.785+0000 7f0fd07bf640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x55ff41c91630 0x55ff41d20290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:38828/0 (socket says 172.21.15.146:38828) 2024-09-18T01:45:24.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.786+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/2963005850 >> v1:172.21.15.129:6789/0 conn(0x55ff41c91630 legacy=0x55ff41d20290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.786+0000 7f0fcffbe640 1 -- 172.21.15.146:0/2963005850 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2698879469 0 0) 0x55ff41bdcb30 con 0x55ff41c91630 2024-09-18T01:45:24.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.786+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/2963005850 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff41be4e00 con 0x55ff41d219b0 2024-09-18T01:45:24.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.787+0000 7f0fc7fbe640 1 --2- 172.21.15.146:0/2963005850 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ff41d219b0 0x55ff41d23da0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0fb800a520 tx=0x7f0fb8045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc2428d003599e03 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.788+0000 7f0fcffbe640 1 -- 172.21.15.146:0/2963005850 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fb8055070 con 0x55ff41d219b0 2024-09-18T01:45:24.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.788+0000 7f0fcffbe640 1 -- 172.21.15.146:0/2963005850 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fb80515b0 con 0x55ff41d219b0 2024-09-18T01:45:24.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.788+0000 7f0fcffbe640 1 -- 172.21.15.146:0/2963005850 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fb80518d0 con 0x55ff41d219b0 2024-09-18T01:45:24.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.788+0000 7f0fd4b26800 1 -- 172.21.15.146:0/2963005850 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ff41d219b0 msgr2=0x55ff41d23da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.788+0000 7f0fd4b26800 1 --2- 172.21.15.146:0/2963005850 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ff41d219b0 0x55ff41d23da0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0fb800a520 tx=0x7f0fb8045ba0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.788+0000 7f0fd4b26800 1 -- 172.21.15.146:0/2963005850 shutdown_connections 2024-09-18T01:45:24.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.788+0000 7f0fd4b26800 1 --2- 172.21.15.146:0/2963005850 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ff41d219b0 0x55ff41d23da0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.788+0000 7f0fd4b26800 1 -- 172.21.15.146:0/2963005850 >> 172.21.15.146:0/2963005850 conn(0x55ff41d17e00 msgr2=0x55ff41d1a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:24.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.788+0000 7f0fd4b26800 1 -- 172.21.15.146:0/2963005850 shutdown_connections 2024-09-18T01:45:24.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.788+0000 7f0fd4b26800 1 -- 172.21.15.146:0/2963005850 wait complete. 2024-09-18T01:45:24.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.802+0000 7f0fd4b26800 1 Processor -- start 2024-09-18T01:45:24.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.802+0000 7f0fd4b26800 1 -- start start 2024-09-18T01:45:24.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.802+0000 7f0fd4b26800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ff41c91630 0x55ff41e0c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.802+0000 7f0fd4b26800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55ff41c69350 con 0x55ff41c91630 2024-09-18T01:45:24.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.802+0000 7f0fd07bf640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ff41c91630 0x55ff41e0c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.802+0000 7f0fd07bf640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ff41c91630 0x55ff41e0c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60148/0 (socket says 172.21.15.146:60148) 2024-09-18T01:45:24.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.802+0000 7f0fd07bf640 1 -- 172.21.15.146:0/808621621 learned_addr learned my addr 172.21.15.146:0/808621621 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:24.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.802+0000 7f0fd07bf640 1 -- 172.21.15.146:0/808621621 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff41bb6bc0 con 0x55ff41c91630 2024-09-18T01:45:24.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.803+0000 7f0fd07bf640 1 --2- 172.21.15.146:0/808621621 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ff41c91630 0x55ff41e0c6d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0fc000b240 tx=0x7f0fc000b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2232bac9d842935 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.803+0000 7f0ebe60c640 1 -- 172.21.15.146:0/808621621 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fc0008070 con 0x55ff41c91630 2024-09-18T01:45:24.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.803+0000 7f0ebe60c640 1 -- 172.21.15.146:0/808621621 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fc000d500 con 0x55ff41c91630 2024-09-18T01:45:24.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.803+0000 7f0ebe60c640 1 -- 172.21.15.146:0/808621621 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fc000d860 con 0x55ff41c91630 2024-09-18T01:45:24.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.803+0000 7f0fd4b26800 1 -- 172.21.15.146:0/808621621 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ff41c91630 msgr2=0x55ff41e0c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.803+0000 7f0fd4b26800 1 --2- 172.21.15.146:0/808621621 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ff41c91630 0x55ff41e0c6d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0fc000b240 tx=0x7f0fc000b700 comp rx=0 tx=0).stop 2024-09-18T01:45:24.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.803+0000 7f0fd4b26800 1 -- 172.21.15.146:0/808621621 shutdown_connections 2024-09-18T01:45:24.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.803+0000 7f0fd4b26800 1 --2- 172.21.15.146:0/808621621 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ff41c91630 0x55ff41e0c6d0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.804+0000 7f0fd4b26800 1 -- 172.21.15.146:0/808621621 >> 172.21.15.146:0/808621621 conn(0x55ff41d17e00 msgr2=0x55ff41e08090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:24.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.804+0000 7f0fd4b26800 1 -- 172.21.15.146:0/808621621 shutdown_connections 2024-09-18T01:45:24.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.804+0000 7f0fd4b26800 1 -- 172.21.15.146:0/808621621 wait complete. 2024-09-18T01:45:24.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.804+0000 7f0fd4b26800 1 Processor -- start 2024-09-18T01:45:24.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.804+0000 7f0fd4b26800 1 -- start start 2024-09-18T01:45:24.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.804+0000 7f0fd4b26800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ff41c91630 0x55ff41d1dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.804+0000 7f0fd4b26800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55ff41d246a0 con 0x55ff41c91630 2024-09-18T01:45:24.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.804+0000 7f0fd07bf640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ff41c91630 0x55ff41d1dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.804+0000 7f0fd07bf640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ff41c91630 0x55ff41d1dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60154/0 (socket says 172.21.15.146:60154) 2024-09-18T01:45:24.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.804+0000 7f0fd07bf640 1 -- 172.21.15.146:0/2009922533 learned_addr learned my addr 172.21.15.146:0/2009922533 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:24.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.805+0000 7f0fd07bf640 1 -- 172.21.15.146:0/2009922533 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff41bcafe0 con 0x55ff41c91630 2024-09-18T01:45:24.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.805+0000 7f0fd07bf640 1 --2- 172.21.15.146:0/2009922533 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ff41c91630 0x55ff41d1dbc0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0000f60 tx=0x7f0fc0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.805+0000 7f0ebce09640 1 -- 172.21.15.146:0/2009922533 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fc0019870 con 0x55ff41c91630 2024-09-18T01:45:24.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.805+0000 7f0ebce09640 1 -- 172.21.15.146:0/2009922533 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fc0019a10 con 0x55ff41c91630 2024-09-18T01:45:24.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.805+0000 7f0fd4b26800 1 -- 172.21.15.146:0/2009922533 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ff41d1c2b0 con 0x55ff41c91630 2024-09-18T01:45:24.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.805+0000 7f0ebce09640 1 -- 172.21.15.146:0/2009922533 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fc0019d10 con 0x55ff41c91630 2024-09-18T01:45:24.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.805+0000 7f0fd4b26800 1 -- 172.21.15.146:0/2009922533 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff41d1c7d0 con 0x55ff41c91630 2024-09-18T01:45:24.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.806+0000 7f0ebce09640 1 -- 172.21.15.146:0/2009922533 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0fc0017040 con 0x55ff41c91630 2024-09-18T01:45:24.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.806+0000 7f0ebce09640 1 --2- 172.21.15.146:0/2009922533 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0eb8036b40 0x7f0eb8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.806+0000 7f0ebce09640 1 -- 172.21.15.146:0/2009922533 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f0fc0015020 con 0x55ff41c91630 2024-09-18T01:45:24.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.806+0000 7f0fc7fbe640 1 --2- 172.21.15.146:0/2009922533 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0eb8036b40 0x7f0eb8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.806+0000 7f0fd4b26800 1 --2- 172.21.15.146:0/2009922533 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55ff41d219b0 0x55ff41e1d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.806+0000 7f0fd4b26800 1 -- 172.21.15.146:0/2009922533 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e1da90 con 0x55ff41d219b0 2024-09-18T01:45:24.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.807+0000 7f0fd0fc0640 1 --2- 172.21.15.146:0/2009922533 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55ff41d219b0 0x55ff41e1d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.807+0000 7f0fc7fbe640 1 --2- 172.21.15.146:0/2009922533 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0eb8036b40 0x7f0eb8039000 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8057000 tx=0x7f0fb8052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.807+0000 7f0fd0fc0640 1 --2- 172.21.15.146:0/2009922533 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55ff41d219b0 0x55ff41e1d550 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.807+0000 7f0fd0fc0640 1 -- 172.21.15.146:0/2009922533 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0fc800a4a0 con 0x55ff41d219b0 2024-09-18T01:45:24.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.807+0000 7f0fd4b26800 1 -- 172.21.15.146:0/2009922533 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e1e2e0 con 0x55ff41d219b0 2024-09-18T01:45:24.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.807+0000 7f0fd0fc0640 1 -- 172.21.15.146:0/2009922533 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0fc800a4a0 con 0x55ff41d219b0 2024-09-18T01:45:24.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.807+0000 7f0fd4b26800 1 -- 172.21.15.146:0/2009922533 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e1f690 con 0x55ff41d219b0 2024-09-18T01:45:24.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.808+0000 7f0fd0fc0640 1 -- 172.21.15.146:0/2009922533 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0fc800a4a0 con 0x55ff41d219b0 2024-09-18T01:45:24.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.808+0000 7f0fd4b26800 1 -- 172.21.15.146:0/2009922533 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e1eb30 con 0x55ff41d219b0 2024-09-18T01:45:24.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.808+0000 7f0fd0fc0640 1 -- 172.21.15.146:0/2009922533 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0fc800a4a0 con 0x55ff41d219b0 2024-09-18T01:45:24.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.808+0000 7f0fd4b26800 1 --2- 172.21.15.146:0/2009922533 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55ff41e20a40 0x55ff41e22e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.808+0000 7f0fd4b26800 1 -- 172.21.15.146:0/2009922533 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e23440 con 0x55ff41e20a40 2024-09-18T01:45:24.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.808+0000 7f0fd07bf640 1 --2- 172.21.15.146:0/2009922533 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55ff41e20a40 0x55ff41e22e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.808+0000 7f0fd07bf640 1 --2- 172.21.15.146:0/2009922533 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55ff41e20a40 0x55ff41e22e30 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.809+0000 7f0fd07bf640 1 -- 172.21.15.146:0/2009922533 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0fc002d070 con 0x55ff41e20a40 2024-09-18T01:45:24.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.809+0000 7f0fd4b26800 1 Processor -- start 2024-09-18T01:45:24.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.809+0000 7f0fd4b26800 1 -- start start 2024-09-18T01:45:24.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.809+0000 7f0fd4b26800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ff41e311f0 0x55ff41e31610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.809+0000 7f0fd4b26800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55ff41d1e100 con 0x55ff41e311f0 2024-09-18T01:45:24.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.809+0000 7f0fd0fc0640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ff41e311f0 0x55ff41e31610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.809+0000 7f0fd0fc0640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ff41e311f0 0x55ff41e31610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60158/0 (socket says 172.21.15.146:60158) 2024-09-18T01:45:24.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.809+0000 7f0fd0fc0640 1 -- 172.21.15.146:0/1863385172 learned_addr learned my addr 172.21.15.146:0/1863385172 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:24.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.810+0000 7f0fd0fc0640 1 -- 172.21.15.146:0/1863385172 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff41e31b50 con 0x55ff41e311f0 2024-09-18T01:45:24.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.810+0000 7f0fd0fc0640 1 --2- 172.21.15.146:0/1863385172 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ff41e311f0 0x55ff41e31610 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x55ff41d1d1d0 tx=0x7f0fc80178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.810+0000 7f0eb5ffb640 1 -- 172.21.15.146:0/1863385172 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fc8013440 con 0x55ff41e311f0 2024-09-18T01:45:24.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.810+0000 7f0eb5ffb640 1 -- 172.21.15.146:0/1863385172 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fc80135e0 con 0x55ff41e311f0 2024-09-18T01:45:24.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.810+0000 7f0eb5ffb640 1 -- 172.21.15.146:0/1863385172 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fc80138c0 con 0x55ff41e311f0 2024-09-18T01:45:24.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.810+0000 7f0fd4b26800 1 -- 172.21.15.146:0/1863385172 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ff41e31de0 con 0x55ff41e311f0 2024-09-18T01:45:24.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.810+0000 7f0fd4b26800 1 -- 172.21.15.146:0/1863385172 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff41e34ac0 con 0x55ff41e311f0 2024-09-18T01:45:24.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.811+0000 7f0eb5ffb640 1 -- 172.21.15.146:0/1863385172 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0fc8011040 con 0x55ff41e311f0 2024-09-18T01:45:24.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.811+0000 7f0eb5ffb640 1 --2- 172.21.15.146:0/1863385172 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0ea8036b40 0x7f0ea8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.811+0000 7f0eb5ffb640 1 -- 172.21.15.146:0/1863385172 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f0fc801d070 con 0x55ff41e311f0 2024-09-18T01:45:24.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.811+0000 7f0fd07bf640 1 --2- 172.21.15.146:0/1863385172 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0ea8036b40 0x7f0ea8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.811+0000 7f0fd4b26800 1 Processor -- start 2024-09-18T01:45:24.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.811+0000 7f0fd07bf640 1 --2- 172.21.15.146:0/1863385172 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0ea8036b40 0x7f0ea8039000 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x55ff41e1eed0 tx=0x7f0fc00015f0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.811+0000 7f0fd4b26800 1 -- start start 2024-09-18T01:45:24.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.812+0000 7f0fd4b26800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ff41e3dec0 0x55ff41e3e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.812+0000 7f0fd4b26800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55ff41bb8580 con 0x55ff41e3dec0 2024-09-18T01:45:24.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.812+0000 7f0fd0fc0640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ff41e3dec0 0x55ff41e3e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.812+0000 7f0fd0fc0640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ff41e3dec0 0x55ff41e3e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60172/0 (socket says 172.21.15.146:60172) 2024-09-18T01:45:24.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.812+0000 7f0fd0fc0640 1 -- 172.21.15.146:0/1613397523 learned_addr learned my addr 172.21.15.146:0/1613397523 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:24.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.812+0000 7f0fd0fc0640 1 -- 172.21.15.146:0/1613397523 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff41e3e890 con 0x55ff41e3dec0 2024-09-18T01:45:24.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.812+0000 7f0fd0fc0640 1 --2- 172.21.15.146:0/1613397523 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ff41e3dec0 0x55ff41e3e2c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0fc804cb30 tx=0x7f0fc8012a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b8dd4300a954a62 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.812+0000 7f0ea77fe640 1 -- 172.21.15.146:0/1613397523 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fc8045070 con 0x55ff41e3dec0 2024-09-18T01:45:24.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.812+0000 7f0ea77fe640 1 -- 172.21.15.146:0/1613397523 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fc8015430 con 0x55ff41e3dec0 2024-09-18T01:45:24.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.812+0000 7f0ea77fe640 1 -- 172.21.15.146:0/1613397523 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fc802ac50 con 0x55ff41e3dec0 2024-09-18T01:45:24.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.813+0000 7f0fd4b26800 1 -- 172.21.15.146:0/1613397523 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ff41e3dec0 msgr2=0x55ff41e3e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.813+0000 7f0fd4b26800 1 --2- 172.21.15.146:0/1613397523 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ff41e3dec0 0x55ff41e3e2c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0fc804cb30 tx=0x7f0fc8012a30 comp rx=0 tx=0).stop 2024-09-18T01:45:24.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.813+0000 7f0fd4b26800 1 -- 172.21.15.146:0/1613397523 shutdown_connections 2024-09-18T01:45:24.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.813+0000 7f0fd4b26800 1 --2- 172.21.15.146:0/1613397523 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ff41e3dec0 0x55ff41e3e2c0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.813+0000 7f0fd4b26800 1 -- 172.21.15.146:0/1613397523 >> 172.21.15.146:0/1613397523 conn(0x55ff41e3a220 msgr2=0x55ff41e38320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:24.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.813+0000 7f0fd4b26800 1 -- 172.21.15.146:0/1613397523 shutdown_connections 2024-09-18T01:45:24.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.813+0000 7f0fd4b26800 1 -- 172.21.15.146:0/1613397523 wait complete. 2024-09-18T01:45:24.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.813+0000 7f0fd4b26800 1 Processor -- start 2024-09-18T01:45:24.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.813+0000 7f0fd4b26800 1 -- start start 2024-09-18T01:45:24.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.813+0000 7f0fd4b26800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ff41e3dec0 0x55ff41e45190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.813+0000 7f0fd4b26800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55ff41e3ed80 con 0x55ff41e3dec0 2024-09-18T01:45:24.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.814+0000 7f0fd0fc0640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ff41e3dec0 0x55ff41e45190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.814+0000 7f0fd0fc0640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ff41e3dec0 0x55ff41e45190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60186/0 (socket says 172.21.15.146:60186) 2024-09-18T01:45:24.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.814+0000 7f0fd0fc0640 1 -- 172.21.15.146:0/3519790803 learned_addr learned my addr 172.21.15.146:0/3519790803 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:24.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.814+0000 7f0fd0fc0640 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff41e456d0 con 0x55ff41e3dec0 2024-09-18T01:45:24.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.814+0000 7f0fd0fc0640 1 --2- 172.21.15.146:0/3519790803 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ff41e3dec0 0x55ff41e45190 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0fc804cb30 tx=0x7f0fc804c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.814+0000 7f0ea5ffb640 1 -- 172.21.15.146:0/3519790803 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fc8045030 con 0x55ff41e3dec0 2024-09-18T01:45:24.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.814+0000 7f0ea5ffb640 1 -- 172.21.15.146:0/3519790803 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fc8001700 con 0x55ff41e3dec0 2024-09-18T01:45:24.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.814+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ff41e45960 con 0x55ff41e3dec0 2024-09-18T01:45:24.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.814+0000 7f0ea5ffb640 1 -- 172.21.15.146:0/3519790803 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fc8013af0 con 0x55ff41e3dec0 2024-09-18T01:45:24.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.814+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff41e48610 con 0x55ff41e3dec0 2024-09-18T01:45:24.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.815+0000 7f0ea5ffb640 1 -- 172.21.15.146:0/3519790803 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0fc8013c90 con 0x55ff41e3dec0 2024-09-18T01:45:24.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.815+0000 7f0ea5ffb640 1 --2- 172.21.15.146:0/3519790803 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0e98036b40 0x7f0e98039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.815+0000 7f0ea5ffb640 1 -- 172.21.15.146:0/3519790803 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f0fc8046070 con 0x55ff41e3dec0 2024-09-18T01:45:24.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.815+0000 7f0fd07bf640 1 --2- 172.21.15.146:0/3519790803 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0e98036b40 0x7f0e98039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.815+0000 7f0fd07bf640 1 --2- 172.21.15.146:0/3519790803 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0e98036b40 0x7f0e98039000 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0fc000eb40 tx=0x7f0fc0035000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.816+0000 7f0fd4b26800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.816+0000 7f0fd4b26800 1 --2- 172.21.15.146:0/3519790803 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55ff41e50eb0 0x55ff41e53370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.816+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e53ac0 con 0x55ff41e50eb0 2024-09-18T01:45:24.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.816+0000 7f0fc7fbe640 1 --2- 172.21.15.146:0/3519790803 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55ff41e50eb0 0x55ff41e53370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.816+0000 7f0fc7fbe640 1 --2- 172.21.15.146:0/3519790803 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55ff41e50eb0 0x55ff41e53370 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.816+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0fb8057030 con 0x55ff41e50eb0 2024-09-18T01:45:24.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.816+0000 7f0fd4b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.816+0000 7f0fd4b26800 20 realm 2024-09-18T01:45:24.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.816+0000 7f0fd4b26800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.816+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e53ef0 con 0x55ff41e50eb0 2024-09-18T01:45:24.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.817+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0fb8057030 con 0x55ff41e50eb0 2024-09-18T01:45:24.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.817+0000 7f0fd4b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.817+0000 7f0fd4b26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:24.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.817+0000 7f0fd4b26800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.817+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e547c0 con 0x55ff41e50eb0 2024-09-18T01:45:24.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.817+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0fb8057030 con 0x55ff41e50eb0 2024-09-18T01:45:24.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.817+0000 7f0fd4b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.817+0000 7f0fd4b26800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.817+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e54b60 con 0x55ff41e50eb0 2024-09-18T01:45:24.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.817+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0fb8057030 con 0x55ff41e50eb0 2024-09-18T01:45:24.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.817+0000 7f0fd4b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:24.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.817+0000 7f0fd4b26800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.817+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e553b0 con 0x55ff41e50eb0 2024-09-18T01:45:24.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.817+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0fb8057030 con 0x55ff41e50eb0 2024-09-18T01:45:24.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.817+0000 7f0fd4b26800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:24.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.817+0000 7f0fd4b26800 20 searching for the correct realm 2024-09-18T01:45:24.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.817+0000 7f0fd4b26800 1 --2- 172.21.15.146:0/3519790803 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55ff41e57120 0x55ff41e59510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.817+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e59b40 con 0x55ff41e57120 2024-09-18T01:45:24.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.818+0000 7f0fd0fc0640 1 --2- 172.21.15.146:0/3519790803 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55ff41e57120 0x55ff41e59510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.818+0000 7f0fd0fc0640 1 --2- 172.21.15.146:0/3519790803 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55ff41e57120 0x55ff41e59510 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.818+0000 7f0fd0fc0640 1 -- 172.21.15.146:0/3519790803 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fc803c020 con 0x55ff41e57120 2024-09-18T01:45:24.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.818+0000 7f0fd0fc0640 1 --2- 172.21.15.146:0/3519790803 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f0fc80500c0 0x7f0fc802b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.818+0000 7f0fd0fc0640 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e59b40 con 0x7f0fc80500c0 2024-09-18T01:45:24.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.818+0000 7f0fd07bf640 1 --2- 172.21.15.146:0/3519790803 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f0fc80500c0 0x7f0fc802b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.818+0000 7f0fd07bf640 1 --2- 172.21.15.146:0/3519790803 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f0fc80500c0 0x7f0fc802b600 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.819+0000 7f0fd07bf640 1 -- 172.21.15.146:0/3519790803 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fc002d070 con 0x7f0fc80500c0 2024-09-18T01:45:24.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.819+0000 7f0fd07bf640 1 --2- 172.21.15.146:0/3519790803 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f0fc0018ab0 0x7f0fc000f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.819+0000 7f0fd07bf640 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e59b40 con 0x7f0fc0018ab0 2024-09-18T01:45:24.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.819+0000 7f0fc7fbe640 1 --2- 172.21.15.146:0/3519790803 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f0fc0018ab0 0x7f0fc000f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.819+0000 7f0fc7fbe640 1 --2- 172.21.15.146:0/3519790803 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f0fc0018ab0 0x7f0fc000f470 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.819+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fb8057030 con 0x7f0fc0018ab0 2024-09-18T01:45:24.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.819+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e59b40 con 0x55ff41e50eb0 2024-09-18T01:45:24.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.820+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0fb8057030 con 0x55ff41e50eb0 2024-09-18T01:45:24.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.820+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e59b40 con 0x55ff41e50eb0 2024-09-18T01:45:24.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.820+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fb8057030 con 0x55ff41e50eb0 2024-09-18T01:45:24.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.820+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e59b40 con 0x7f0fc0018ab0 2024-09-18T01:45:24.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.820+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fb8057030 con 0x7f0fc0018ab0 2024-09-18T01:45:24.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.820+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e59b40 con 0x7f0fc0018ab0 2024-09-18T01:45:24.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.820+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fb8057030 con 0x7f0fc0018ab0 2024-09-18T01:45:24.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.820+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e59b40 con 0x7f0fc80500c0 2024-09-18T01:45:24.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.820+0000 7f0fd07bf640 1 -- 172.21.15.146:0/3519790803 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fc002d070 con 0x7f0fc80500c0 2024-09-18T01:45:24.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.820+0000 7f0fd07bf640 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e59b40 con 0x55ff41e57120 2024-09-18T01:45:24.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.821+0000 7f0fd0fc0640 1 -- 172.21.15.146:0/3519790803 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fc803c020 con 0x55ff41e57120 2024-09-18T01:45:24.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.821+0000 7f0fd0fc0640 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e59b40 con 0x55ff41e50eb0 2024-09-18T01:45:24.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.821+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fb8057030 con 0x55ff41e50eb0 2024-09-18T01:45:24.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.821+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e59b40 con 0x7f0fc0018ab0 2024-09-18T01:45:24.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.821+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fb8057030 con 0x7f0fc0018ab0 2024-09-18T01:45:24.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.821+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e59b40 con 0x55ff41e50eb0 2024-09-18T01:45:24.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.821+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fb8057030 con 0x55ff41e50eb0 2024-09-18T01:45:24.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.821+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e59b40 con 0x7f0fc80500c0 2024-09-18T01:45:24.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.822+0000 7f0fd07bf640 1 -- 172.21.15.146:0/3519790803 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f0fc002d070 con 0x7f0fc80500c0 2024-09-18T01:45:24.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.822+0000 7f0fd07bf640 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e59b40 con 0x55ff41e57120 2024-09-18T01:45:24.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.822+0000 7f0fd0fc0640 1 -- 172.21.15.146:0/3519790803 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fc803c020 con 0x55ff41e57120 2024-09-18T01:45:24.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.822+0000 7f0fd0fc0640 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e59b40 con 0x55ff41e57120 2024-09-18T01:45:24.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.822+0000 7f0fd0fc0640 1 -- 172.21.15.146:0/3519790803 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fc803c020 con 0x55ff41e57120 2024-09-18T01:45:24.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.822+0000 7f0fd0fc0640 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e59b40 con 0x7f0fc0018ab0 2024-09-18T01:45:24.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.822+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fb8057030 con 0x7f0fc0018ab0 2024-09-18T01:45:24.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.822+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e59b40 con 0x55ff41e57120 2024-09-18T01:45:24.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.823+0000 7f0fd0fc0640 1 -- 172.21.15.146:0/3519790803 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fc803c020 con 0x55ff41e57120 2024-09-18T01:45:24.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.823+0000 7f0fd0fc0640 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e59b40 con 0x55ff41e57120 2024-09-18T01:45:24.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.823+0000 7f0fd0fc0640 1 -- 172.21.15.146:0/3519790803 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fc803c020 con 0x55ff41e57120 2024-09-18T01:45:24.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.823+0000 7f0fd0fc0640 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e59b40 con 0x55ff41e50eb0 2024-09-18T01:45:24.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.823+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fb8057030 con 0x55ff41e50eb0 2024-09-18T01:45:24.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.823+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e59b40 con 0x55ff41e50eb0 2024-09-18T01:45:24.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.823+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0fb8057030 con 0x55ff41e50eb0 2024-09-18T01:45:24.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.823+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e59b40 con 0x7f0fc0018ab0 2024-09-18T01:45:24.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.823+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fb8057030 con 0x7f0fc0018ab0 2024-09-18T01:45:24.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.823+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e59b40 con 0x55ff41e57120 2024-09-18T01:45:24.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.824+0000 7f0fd0fc0640 1 -- 172.21.15.146:0/3519790803 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fc803c020 con 0x55ff41e57120 2024-09-18T01:45:24.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.824+0000 7f0fd0fc0640 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e59b40 con 0x7f0fc80500c0 2024-09-18T01:45:24.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.824+0000 7f0fd07bf640 1 -- 172.21.15.146:0/3519790803 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fc002d070 con 0x7f0fc80500c0 2024-09-18T01:45:24.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.824+0000 7f0fd07bf640 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e59b40 con 0x55ff41e50eb0 2024-09-18T01:45:24.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.824+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fb8057030 con 0x55ff41e50eb0 2024-09-18T01:45:24.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.824+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e59b40 con 0x7f0fc0018ab0 2024-09-18T01:45:24.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.825+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fb8057030 con 0x7f0fc0018ab0 2024-09-18T01:45:24.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.825+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e59b40 con 0x55ff41e57120 2024-09-18T01:45:24.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.825+0000 7f0fd0fc0640 1 -- 172.21.15.146:0/3519790803 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fc803c020 con 0x55ff41e57120 2024-09-18T01:45:24.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.825+0000 7f0fd0fc0640 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e59b40 con 0x7f0fc0018ab0 2024-09-18T01:45:24.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.825+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fb8057030 con 0x7f0fc0018ab0 2024-09-18T01:45:24.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.825+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e59b40 con 0x7f0fc80500c0 2024-09-18T01:45:24.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.825+0000 7f0fd07bf640 1 -- 172.21.15.146:0/3519790803 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fc002d070 con 0x7f0fc80500c0 2024-09-18T01:45:24.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.825+0000 7f0fd07bf640 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e59b40 con 0x55ff41e57120 2024-09-18T01:45:24.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.825+0000 7f0fd0fc0640 1 -- 172.21.15.146:0/3519790803 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fc803c020 con 0x55ff41e57120 2024-09-18T01:45:24.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.825+0000 7f0fd0fc0640 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e59b40 con 0x7f0fc0018ab0 2024-09-18T01:45:24.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.826+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fb8057030 con 0x7f0fc0018ab0 2024-09-18T01:45:24.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.826+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e59b40 con 0x55ff41e50eb0 2024-09-18T01:45:24.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.826+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0fb8057030 con 0x55ff41e50eb0 2024-09-18T01:45:24.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.826+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e59b40 con 0x7f0fc80500c0 2024-09-18T01:45:24.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.826+0000 7f0fd07bf640 1 -- 172.21.15.146:0/3519790803 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fc0062040 con 0x7f0fc80500c0 2024-09-18T01:45:24.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.826+0000 7f0fd4b26800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:24.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.826+0000 7f0fd4b26800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:24.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.826+0000 7f0fd4b26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:24.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.826+0000 7f0fd4b26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:24.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.826+0000 7f0fd4b26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:24.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.826+0000 7f0fd4b26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:24.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.826+0000 7f0fd4b26800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.826+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e55d60 con 0x55ff41e50eb0 2024-09-18T01:45:24.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.826+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0fb8057030 con 0x55ff41e50eb0 2024-09-18T01:45:24.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.826+0000 7f0fd4b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.826+0000 7f0fd4b26800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.826+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e56600 con 0x55ff41e50eb0 2024-09-18T01:45:24.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.827+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0fb8057030 con 0x55ff41e50eb0 2024-09-18T01:45:24.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.827+0000 7f0fd4b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:24.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.827+0000 7f0fd4b26800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.827+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e59fc0 con 0x7f0fc80500c0 2024-09-18T01:45:24.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.827+0000 7f0fd07bf640 1 -- 172.21.15.146:0/3519790803 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0fc0062040 con 0x7f0fc80500c0 2024-09-18T01:45:24.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.827+0000 7f0fd4b26800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:24.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.827+0000 7f0fd4b26800 20 zone default found 2024-09-18T01:45:24.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.827+0000 7f0fd4b26800 4 Realm: () 2024-09-18T01:45:24.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.827+0000 7f0fd4b26800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:24.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.827+0000 7f0fd4b26800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:24.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.827+0000 7f0fd4b26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:24.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.827+0000 7f0fd4b26800 20 zonegroup default 2024-09-18T01:45:24.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.827+0000 7f0fd4b26800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.827+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e5a810 con 0x7f0fc0018ab0 2024-09-18T01:45:24.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.827+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0fb8057030 con 0x7f0fc0018ab0 2024-09-18T01:45:24.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.827+0000 7f0fd4b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.827+0000 7f0fd4b26800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.827+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e5c1f0 con 0x55ff41e57120 2024-09-18T01:45:24.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.828+0000 7f0fd0fc0640 1 -- 172.21.15.146:0/3519790803 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0fc803c020 con 0x55ff41e57120 2024-09-18T01:45:24.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.828+0000 7f0fd4b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.828+0000 7f0fd4b26800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.828+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e5c730 con 0x55ff41e57120 2024-09-18T01:45:24.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.828+0000 7f0fd0fc0640 1 -- 172.21.15.146:0/3519790803 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0fc803c020 con 0x55ff41e57120 2024-09-18T01:45:24.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.828+0000 7f0fd4b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.828+0000 7f0fd4b26800 20 started sync module instance, tier type = 2024-09-18T01:45:24.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.828+0000 7f0fd4b26800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:24.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.828+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e5b680 con 0x7f0fc80500c0 2024-09-18T01:45:24.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.829+0000 7f0fd07bf640 1 -- 172.21.15.146:0/3519790803 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v31'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fc0062040 con 0x7f0fc80500c0 2024-09-18T01:45:24.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.829+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94554810595952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e5d040 con 0x7f0fc80500c0 2024-09-18T01:45:24.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.829+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e5d890 con 0x55ff41e50eb0 2024-09-18T01:45:24.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.830+0000 7f0fd07bf640 1 -- 172.21.15.146:0/3519790803 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94554810595952] v31'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fc0062040 con 0x7f0fc80500c0 2024-09-18T01:45:24.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.830+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v31'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fb8057030 con 0x55ff41e50eb0 2024-09-18T01:45:24.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.830+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94554810600336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e5d890 con 0x55ff41e50eb0 2024-09-18T01:45:24.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.830+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e5e380 con 0x55ff41e57120 2024-09-18T01:45:24.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.831+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94554810600336] v31'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fb8057030 con 0x55ff41e50eb0 2024-09-18T01:45:24.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.831+0000 7f0fd0fc0640 1 -- 172.21.15.146:0/3519790803 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v31'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fc803c020 con 0x55ff41e57120 2024-09-18T01:45:24.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.831+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94554810602464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e5d800 con 0x55ff41e57120 2024-09-18T01:45:24.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.831+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e5f240 con 0x7f0fc80500c0 2024-09-18T01:45:24.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.832+0000 7f0fd07bf640 1 -- 172.21.15.146:0/3519790803 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v31'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fc0062040 con 0x7f0fc80500c0 2024-09-18T01:45:24.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.832+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94554810609040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e5fae0 con 0x7f0fc80500c0 2024-09-18T01:45:24.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.832+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e60590 con 0x55ff41e50eb0 2024-09-18T01:45:24.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.832+0000 7f0fd0fc0640 1 -- 172.21.15.146:0/3519790803 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94554810602464] v31'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fc803c020 con 0x55ff41e57120 2024-09-18T01:45:24.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.833+0000 7f0fd07bf640 1 -- 172.21.15.146:0/3519790803 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94554810609040] v31'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fc0062040 con 0x7f0fc80500c0 2024-09-18T01:45:24.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.833+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v31'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fb8057030 con 0x55ff41e50eb0 2024-09-18T01:45:24.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.833+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94554810611248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e600a0 con 0x55ff41e50eb0 2024-09-18T01:45:24.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.833+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e60ea0 con 0x7f0fc0018ab0 2024-09-18T01:45:24.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.834+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94554810611248] v31'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fb8057030 con 0x55ff41e50eb0 2024-09-18T01:45:24.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.834+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v31'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fb8057030 con 0x7f0fc0018ab0 2024-09-18T01:45:24.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.835+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94554810607472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e60e10 con 0x7f0fc0018ab0 2024-09-18T01:45:24.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.835+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e618b0 con 0x7f0fc0018ab0 2024-09-18T01:45:24.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.835+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94554810607472] v31'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fb8057030 con 0x7f0fc0018ab0 2024-09-18T01:45:24.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.836+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v31'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fb8057030 con 0x7f0fc0018ab0 2024-09-18T01:45:24.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.836+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94554810616640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e618b0 con 0x7f0fc0018ab0 2024-09-18T01:45:24.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.836+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e62270 con 0x7f0fc0018ab0 2024-09-18T01:45:24.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.837+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94554810616640] v31'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fb8057030 con 0x7f0fc0018ab0 2024-09-18T01:45:24.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.837+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v31'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fb8057030 con 0x7f0fc0018ab0 2024-09-18T01:45:24.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.837+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94554810619360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e62270 con 0x7f0fc0018ab0 2024-09-18T01:45:24.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.837+0000 7f0fd4b26800 20 add_watcher() i=0 2024-09-18T01:45:24.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.837+0000 7f0fd4b26800 20 add_watcher() i=1 2024-09-18T01:45:24.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.837+0000 7f0fd4b26800 20 add_watcher() i=2 2024-09-18T01:45:24.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.837+0000 7f0fd4b26800 20 add_watcher() i=3 2024-09-18T01:45:24.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.837+0000 7f0fd4b26800 20 add_watcher() i=4 2024-09-18T01:45:24.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.837+0000 7f0fd4b26800 20 add_watcher() i=5 2024-09-18T01:45:24.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.837+0000 7f0fd4b26800 20 add_watcher() i=6 2024-09-18T01:45:24.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.837+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94554810619360] v31'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fb8057030 con 0x7f0fc0018ab0 2024-09-18T01:45:24.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.837+0000 7f0fd4b26800 20 add_watcher() i=7 2024-09-18T01:45:24.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.837+0000 7f0fd4b26800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:24.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.837+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e65600 con 0x55ff41e50eb0 2024-09-18T01:45:24.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.838+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0fb8057030 con 0x55ff41e50eb0 2024-09-18T01:45:24.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.838+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94554810634192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e623e0 con 0x55ff41e50eb0 2024-09-18T01:45:24.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.839+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94554810634192] v31'84 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0fb8057030 con 0x55ff41e50eb0 2024-09-18T01:45:24.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.839+0000 7f0e867e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:24.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.839+0000 7f0fd4b26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:24.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.839+0000 7f0fd4b26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:24.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.839+0000 7f0fd4b26800 5 note: GC not initialized 2024-09-18T01:45:24.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.839+0000 7f0e857e2640 20 reqs_thread_entry: start 2024-09-18T01:45:24.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.839+0000 7f0fd4b26800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:24.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.839+0000 7f0fd4b26800 20 Filter name: none 2024-09-18T01:45:24.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.840+0000 7f0df6ffd640 20 reqs_thread_entry: start 2024-09-18T01:45:24.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.840+0000 7f0fd4b26800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T01:45:24.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.840+0000 7f0fd4b26800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.840+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e98a60 con 0x55ff41e50eb0 2024-09-18T01:45:24.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.840+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f0fb8057030 con 0x55ff41e50eb0 2024-09-18T01:45:24.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.840+0000 7f0fd4b26800 20 rados_obj.operate() r=0 bl.length=556 2024-09-18T01:45:24.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.840+0000 7f0fd4b26800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T01:45:24.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.840+0000 7f0fd4b26800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:45:24.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.840+0000 7f0fd4b26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:45:24.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.840+0000 7f0fd4b26800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : miss 2024-09-18T01:45:24.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.840+0000 7f0fd4b26800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.840+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:63 8.2 8:45671577:users.swift::foo%3afoo2:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e997a0 con 0x7f0fc80500c0 2024-09-18T01:45:24.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.840+0000 7f0fd07bf640 1 -- 172.21.15.146:0/3519790803 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(63 foo:foo2 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7f0fc0062040 con 0x7f0fc80500c0 2024-09-18T01:45:24.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.840+0000 7f0fd4b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.840+0000 7f0fd4b26800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x0 2024-09-18T01:45:24.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.840+0000 7f0fd4b26800 10 adding default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-18T01:45:24.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.840+0000 7f0fd4b26800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : hit (negative entry) 2024-09-18T01:45:24.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.840+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~673 in=673b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e9f4b0 con 0x55ff41e50eb0 2024-09-18T01:45:24.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.841+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~673] v31'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f0fb8057030 con 0x55ff41e50eb0 2024-09-18T01:45:24.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.841+0000 7f0fd4b26800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:45:24.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.841+0000 7f0fd4b26800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:45:24.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.841+0000 7f0fd4b26800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-18T01:45:24.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.842+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94554810871616 in=861b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e9c040 con 0x55ff41e50eb0 2024-09-18T01:45:24.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.842+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== watch-notify(notify (1) cookie 94554810611248 notify 133143986183 ret 0) ==== 891+0+0 (crc 0 0 0) 0x7f0fb8076040 con 0x55ff41e50eb0 2024-09-18T01:45:24.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.842+0000 7f0ea77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986183 cookie 94554810611248 notifier 4397 bl.length()=849 2024-09-18T01:45:24.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.842+0000 7f0ea77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:45:24.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.842+0000 7f0ea77fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:45:24.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.842+0000 7f0ea77fe640 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f0e94003ea0 con 0x55ff41e50eb0 2024-09-18T01:45:24.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.842+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(65 notify.4 [notify cookie 94554810871616 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0fb8057030 con 0x55ff41e50eb0 2024-09-18T01:45:24.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.842+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fb8057030 con 0x55ff41e50eb0 2024-09-18T01:45:24.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.842+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== watch-notify(notify_complete (2) cookie 94554810871616 notify 133143986183 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ff41be4e00 con 0x55ff41e50eb0 2024-09-18T01:45:24.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.842+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:67 8.2 8:45671577:users.swift::foo%3afoo2:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e9ef40 con 0x7f0fc80500c0 2024-09-18T01:45:24.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.844+0000 7f0fd07bf640 1 -- 172.21.15.146:0/3519790803 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(67 foo:foo2 [delete,create,writefull 0~7] v31'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7f0fc0062040 con 0x7f0fc80500c0 2024-09-18T01:45:24.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.844+0000 7f0fd4b26800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-18T01:45:24.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.844+0000 7f0fd4b26800 10 moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-18T01:45:24.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.844+0000 7f0fd4b26800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-18T01:45:24.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.844+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94554810871616 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e99b70 con 0x7f0fc80500c0 2024-09-18T01:45:24.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.844+0000 7f0fd07bf640 1 -- 172.21.15.146:0/3519790803 <== osd.2 v2:172.21.15.146:6800/3820039304 14 ==== watch-notify(notify (1) cookie 94554810595952 notify 133143986179 ret 0) ==== 208+0+0 (crc 0 0 0) 0x55ff41d1c7d0 con 0x7f0fc80500c0 2024-09-18T01:45:24.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.844+0000 7f0fd07bf640 1 -- 172.21.15.146:0/3519790803 <== osd.2 v2:172.21.15.146:6800/3820039304 15 ==== osd_op_reply(68 notify.0 [notify cookie 94554810871616 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0fc0062040 con 0x7f0fc80500c0 2024-09-18T01:45:24.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.844+0000 7f0ea6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986179 cookie 94554810595952 notifier 4397 bl.length()=166 2024-09-18T01:45:24.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.844+0000 7f0ea6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-18T01:45:24.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.844+0000 7f0ea6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-18T01:45:24.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.844+0000 7f0ea6ffd640 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f0e04003400 con 0x7f0fc80500c0 2024-09-18T01:45:24.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.844+0000 7f0fd07bf640 1 -- 172.21.15.146:0/3519790803 <== osd.2 v2:172.21.15.146:6800/3820039304 16 ==== watch-notify(notify_complete (2) cookie 94554810871616 notify 133143986179 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ff41d1c2b0 con 0x7f0fc80500c0 2024-09-18T01:45:24.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.844+0000 7f0fd07bf640 1 -- 172.21.15.146:0/3519790803 <== osd.2 v2:172.21.15.146:6800/3820039304 17 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fc0062040 con 0x7f0fc80500c0 2024-09-18T01:45:24.859 INFO:teuthology.orchestra.run.smithi146.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T01:45:23.010714Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-18T01:45:24.841201Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:45:23.010705Z","tags":[],"group_ids":[]} 2024-09-18T01:45:24.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.845+0000 7f0e867e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:24.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.845+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94554810634192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e96770 con 0x55ff41e50eb0 2024-09-18T01:45:24.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.846+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 <== osd.1 v2:172.21.15.146:6808/3930274777 28 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94554810634192] v31'85 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0fb8057030 con 0x55ff41e50eb0 2024-09-18T01:45:24.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.846+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94554810595952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e96770 con 0x7f0fc80500c0 2024-09-18T01:45:24.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.847+0000 7f0fd07bf640 1 -- 172.21.15.146:0/3519790803 <== osd.2 v2:172.21.15.146:6800/3820039304 18 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94554810595952] v31'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fc0062040 con 0x7f0fc80500c0 2024-09-18T01:45:24.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.847+0000 7f0fd4b26800 20 remove_watcher() i=0 2024-09-18T01:45:24.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.847+0000 7f0fd4b26800 2 removed watcher, disabling cache 2024-09-18T01:45:24.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.847+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94554810600336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e96770 con 0x55ff41e50eb0 2024-09-18T01:45:24.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.848+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 <== osd.1 v2:172.21.15.146:6808/3930274777 29 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94554810600336] v31'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fb8057030 con 0x55ff41e50eb0 2024-09-18T01:45:24.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.848+0000 7f0fd4b26800 20 remove_watcher() i=1 2024-09-18T01:45:24.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.848+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94554810602464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e96770 con 0x55ff41e57120 2024-09-18T01:45:24.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.849+0000 7f0fd0fc0640 1 -- 172.21.15.146:0/3519790803 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94554810602464] v31'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fc803c020 con 0x55ff41e57120 2024-09-18T01:45:24.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.849+0000 7f0fd4b26800 20 remove_watcher() i=2 2024-09-18T01:45:24.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.849+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94554810609040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e96770 con 0x7f0fc80500c0 2024-09-18T01:45:24.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.850+0000 7f0fd07bf640 1 -- 172.21.15.146:0/3519790803 <== osd.2 v2:172.21.15.146:6800/3820039304 19 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94554810609040] v31'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fc0062040 con 0x7f0fc80500c0 2024-09-18T01:45:24.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.850+0000 7f0fd4b26800 20 remove_watcher() i=3 2024-09-18T01:45:24.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.850+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94554810611248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e96770 con 0x55ff41e50eb0 2024-09-18T01:45:24.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.851+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 <== osd.1 v2:172.21.15.146:6808/3930274777 30 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94554810611248] v31'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fb8057030 con 0x55ff41e50eb0 2024-09-18T01:45:24.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.851+0000 7f0fd4b26800 20 remove_watcher() i=4 2024-09-18T01:45:24.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.851+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94554810607472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e96770 con 0x7f0fc0018ab0 2024-09-18T01:45:24.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.852+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94554810607472] v31'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fb8057030 con 0x7f0fc0018ab0 2024-09-18T01:45:24.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.852+0000 7f0fd4b26800 20 remove_watcher() i=5 2024-09-18T01:45:24.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.852+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94554810616640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e96770 con 0x7f0fc0018ab0 2024-09-18T01:45:24.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.853+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94554810616640] v31'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fb8057030 con 0x7f0fc0018ab0 2024-09-18T01:45:24.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.853+0000 7f0fd4b26800 20 remove_watcher() i=6 2024-09-18T01:45:24.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.853+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94554810619360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff41e96770 con 0x7f0fc0018ab0 2024-09-18T01:45:24.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.854+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94554810619360] v31'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fb8057030 con 0x7f0fc0018ab0 2024-09-18T01:45:24.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.854+0000 7f0fd4b26800 20 remove_watcher() i=7 2024-09-18T01:45:24.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.854+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f0fc0018ab0 msgr2=0x7f0fc000f470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.854+0000 7f0fd4b26800 1 --2- 172.21.15.146:0/3519790803 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f0fc0018ab0 0x7f0fc000f470 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.854+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55ff41e50eb0 msgr2=0x55ff41e53370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.854+0000 7f0fd4b26800 1 --2- 172.21.15.146:0/3519790803 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55ff41e50eb0 0x55ff41e53370 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.854+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f0fc80500c0 msgr2=0x7f0fc802b600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.854+0000 7f0fd4b26800 1 --2- 172.21.15.146:0/3519790803 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f0fc80500c0 0x7f0fc802b600 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.854+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55ff41e57120 msgr2=0x55ff41e59510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.854+0000 7f0fd4b26800 1 --2- 172.21.15.146:0/3519790803 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55ff41e57120 0x55ff41e59510 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.854+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0e98036b40 msgr2=0x7f0e98039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.854+0000 7f0fd4b26800 1 --2- 172.21.15.146:0/3519790803 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0e98036b40 0x7f0e98039000 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0fc000eb40 tx=0x7f0fc0035000 comp rx=0 tx=0).stop 2024-09-18T01:45:24.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.854+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ff41e3dec0 msgr2=0x55ff41e45190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.854+0000 7f0fd4b26800 1 --2- 172.21.15.146:0/3519790803 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ff41e3dec0 0x55ff41e45190 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0fc804cb30 tx=0x7f0fc804c840 comp rx=0 tx=0).stop 2024-09-18T01:45:24.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.854+0000 7f0fc7fbe640 1 -- 172.21.15.146:0/3519790803 reap_dead start 2024-09-18T01:45:24.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.854+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 shutdown_connections 2024-09-18T01:45:24.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.854+0000 7f0fd4b26800 1 --2- 172.21.15.146:0/3519790803 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ff41e3dec0 0x55ff41e45190 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.854+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 >> 172.21.15.146:0/3519790803 conn(0x55ff41e3a220 msgr2=0x55ff41e382f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:24.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.854+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 shutdown_connections 2024-09-18T01:45:24.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.854+0000 7f0fd4b26800 1 -- 172.21.15.146:0/3519790803 wait complete. 2024-09-18T01:45:24.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.855+0000 7f0fd4b26800 1 -- 172.21.15.146:0/1863385172 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0ea8036b40 msgr2=0x7f0ea8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.855+0000 7f0fd4b26800 1 --2- 172.21.15.146:0/1863385172 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0ea8036b40 0x7f0ea8039000 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x55ff41e1eed0 tx=0x7f0fc00015f0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.855+0000 7f0fd4b26800 1 -- 172.21.15.146:0/1863385172 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ff41e311f0 msgr2=0x55ff41e31610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.855+0000 7f0fd4b26800 1 --2- 172.21.15.146:0/1863385172 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ff41e311f0 0x55ff41e31610 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x55ff41d1d1d0 tx=0x7f0fc80178e0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.855+0000 7f0fd4b26800 1 -- 172.21.15.146:0/1863385172 shutdown_connections 2024-09-18T01:45:24.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.855+0000 7f0fd4b26800 1 --2- 172.21.15.146:0/1863385172 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0ea8036b40 0x7f0ea8039000 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.855+0000 7f0fd4b26800 1 --2- 172.21.15.146:0/1863385172 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ff41e311f0 0x55ff41e31610 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.855+0000 7f0fd4b26800 1 -- 172.21.15.146:0/1863385172 >> 172.21.15.146:0/1863385172 conn(0x55ff41e26180 msgr2=0x55ff41e28d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:24.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.855+0000 7f0fd4b26800 1 -- 172.21.15.146:0/1863385172 shutdown_connections 2024-09-18T01:45:24.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.855+0000 7f0fd4b26800 1 -- 172.21.15.146:0/1863385172 wait complete. 2024-09-18T01:45:24.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.855+0000 7f0fd4b26800 1 -- 172.21.15.146:0/2009922533 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55ff41d219b0 msgr2=0x55ff41e1d550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.855+0000 7f0fd4b26800 1 --2- 172.21.15.146:0/2009922533 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55ff41d219b0 0x55ff41e1d550 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.855+0000 7f0fd4b26800 1 -- 172.21.15.146:0/2009922533 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55ff41e20a40 msgr2=0x55ff41e22e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.855+0000 7f0fd4b26800 1 --2- 172.21.15.146:0/2009922533 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55ff41e20a40 0x55ff41e22e30 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.855+0000 7f0fd4b26800 1 -- 172.21.15.146:0/2009922533 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0eb8036b40 msgr2=0x7f0eb8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.855+0000 7f0fd4b26800 1 --2- 172.21.15.146:0/2009922533 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0eb8036b40 0x7f0eb8039000 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8057000 tx=0x7f0fb8052000 comp rx=0 tx=0).stop 2024-09-18T01:45:24.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.855+0000 7f0fd4b26800 1 -- 172.21.15.146:0/2009922533 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ff41c91630 msgr2=0x55ff41d1dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.855+0000 7f0fd4b26800 1 --2- 172.21.15.146:0/2009922533 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ff41c91630 0x55ff41d1dbc0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0000f60 tx=0x7f0fc0000ed0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.855+0000 7f0fd4b26800 1 -- 172.21.15.146:0/2009922533 shutdown_connections 2024-09-18T01:45:24.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.855+0000 7f0fd4b26800 1 --2- 172.21.15.146:0/2009922533 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55ff41e20a40 0x55ff41e22e30 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.855+0000 7f0fd4b26800 1 --2- 172.21.15.146:0/2009922533 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55ff41d219b0 0x55ff41e1d550 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.855+0000 7f0fd4b26800 1 --2- 172.21.15.146:0/2009922533 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0eb8036b40 0x7f0eb8039000 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.855+0000 7f0fd4b26800 1 --2- 172.21.15.146:0/2009922533 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ff41c91630 0x55ff41d1dbc0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.855+0000 7f0fd4b26800 1 -- 172.21.15.146:0/2009922533 >> 172.21.15.146:0/2009922533 conn(0x55ff41d17e00 msgr2=0x55ff41e06960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:24.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.855+0000 7f0fd4b26800 1 -- 172.21.15.146:0/2009922533 shutdown_connections 2024-09-18T01:45:24.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.855+0000 7f0fd4b26800 1 -- 172.21.15.146:0/2009922533 wait complete. 2024-09-18T01:45:24.871 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T01:45:23.010714Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-18T01:45:24.841201Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:45:23.010705Z', 'tags': [], 'group_ids': []} 2024-09-18T01:45:24.871 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-18T01:45:24.871 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-18T01:45:24.871 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-18T01:45:24.915 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:24.915 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:24.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.915+0000 7f9b19415800 1 Processor -- start 2024-09-18T01:45:24.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.915+0000 7f9b19415800 1 -- start start 2024-09-18T01:45:24.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.915+0000 7f9b19415800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x557cdd710610 0x557cdd7a1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.915+0000 7f9b19415800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557cdd65bb30 con 0x557cdd7a1bb0 2024-09-18T01:45:24.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.915+0000 7f9b19415800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x557cdd63d360 con 0x557cdd710610 2024-09-18T01:45:24.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.916+0000 7f9b14b9c640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x557cdd710610 0x557cdd7a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.916+0000 7f9b14b9c640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x557cdd710610 0x557cdd7a1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60198/0 (socket says 172.21.15.146:60198) 2024-09-18T01:45:24.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.916+0000 7f9b14b9c640 1 -- 172.21.15.146:0/498196206 learned_addr learned my addr 172.21.15.146:0/498196206 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:24.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.916+0000 7f9b1439b640 1 --1- 172.21.15.146:0/498196206 >> v1:172.21.15.129:6789/0 conn(0x557cdd7a1bb0 0x557cdd7a3fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:38844/0 (socket says 172.21.15.146:38844) 2024-09-18T01:45:24.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.916+0000 7f9b14b9c640 1 -- 172.21.15.146:0/498196206 >> v1:172.21.15.129:6789/0 conn(0x557cdd7a1bb0 legacy=0x557cdd7a3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.916+0000 7f9b14b9c640 1 -- 172.21.15.146:0/498196206 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cdd663e00 con 0x557cdd710610 2024-09-18T01:45:24.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.918+0000 7f9b14b9c640 1 --2- 172.21.15.146:0/498196206 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557cdd710610 0x557cdd7a1670 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9b04005fd0 tx=0x7f9b04045cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54e97949048ec7cc server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.918+0000 7f9b13b9a640 1 -- 172.21.15.146:0/498196206 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b0404e600 con 0x557cdd710610 2024-09-18T01:45:24.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.918+0000 7f9b13b9a640 1 -- 172.21.15.146:0/498196206 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b0404e7a0 con 0x557cdd710610 2024-09-18T01:45:24.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.918+0000 7f9b13b9a640 1 -- 172.21.15.146:0/498196206 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b0404eaa0 con 0x557cdd710610 2024-09-18T01:45:24.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.918+0000 7f9b19415800 1 -- 172.21.15.146:0/498196206 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557cdd710610 msgr2=0x557cdd7a1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.918+0000 7f9b19415800 1 --2- 172.21.15.146:0/498196206 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557cdd710610 0x557cdd7a1670 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9b04005fd0 tx=0x7f9b04045cf0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.918+0000 7f9b19415800 1 -- 172.21.15.146:0/498196206 shutdown_connections 2024-09-18T01:45:24.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.918+0000 7f9b19415800 1 --2- 172.21.15.146:0/498196206 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557cdd710610 0x557cdd7a1670 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.918+0000 7f9b19415800 1 -- 172.21.15.146:0/498196206 >> 172.21.15.146:0/498196206 conn(0x557cdd796de0 msgr2=0x557cdd799200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:24.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.918+0000 7f9b19415800 1 -- 172.21.15.146:0/498196206 shutdown_connections 2024-09-18T01:45:24.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.918+0000 7f9b19415800 1 -- 172.21.15.146:0/498196206 wait complete. 2024-09-18T01:45:24.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.932+0000 7f9b19415800 1 Processor -- start 2024-09-18T01:45:24.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.932+0000 7f9b19415800 1 -- start start 2024-09-18T01:45:24.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.932+0000 7f9b19415800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557cdd710610 0x557cdd88da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.932+0000 7f9b19415800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x557cdd6e8330 con 0x557cdd710610 2024-09-18T01:45:24.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.932+0000 7f9b14b9c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557cdd710610 0x557cdd88da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.932+0000 7f9b14b9c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557cdd710610 0x557cdd88da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60202/0 (socket says 172.21.15.146:60202) 2024-09-18T01:45:24.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.932+0000 7f9b14b9c640 1 -- 172.21.15.146:0/3139053931 learned_addr learned my addr 172.21.15.146:0/3139053931 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:24.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.933+0000 7f9b14b9c640 1 -- 172.21.15.146:0/3139053931 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cdd635bc0 con 0x557cdd710610 2024-09-18T01:45:24.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.933+0000 7f9b14b9c640 1 --2- 172.21.15.146:0/3139053931 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557cdd710610 0x557cdd88da80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f9b0400a4b0 tx=0x7f9b04050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20a5c93bc5e6427c server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.933+0000 7f9a02e0d640 1 -- 172.21.15.146:0/3139053931 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b0404ea80 con 0x557cdd710610 2024-09-18T01:45:24.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.933+0000 7f9a02e0d640 1 -- 172.21.15.146:0/3139053931 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b04066070 con 0x557cdd710610 2024-09-18T01:45:24.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.933+0000 7f9a02e0d640 1 -- 172.21.15.146:0/3139053931 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b0404edc0 con 0x557cdd710610 2024-09-18T01:45:24.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.934+0000 7f9b19415800 1 -- 172.21.15.146:0/3139053931 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557cdd710610 msgr2=0x557cdd88da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.934+0000 7f9b19415800 1 --2- 172.21.15.146:0/3139053931 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557cdd710610 0x557cdd88da80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f9b0400a4b0 tx=0x7f9b04050000 comp rx=0 tx=0).stop 2024-09-18T01:45:24.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.934+0000 7f9b19415800 1 -- 172.21.15.146:0/3139053931 shutdown_connections 2024-09-18T01:45:24.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.934+0000 7f9b19415800 1 --2- 172.21.15.146:0/3139053931 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557cdd710610 0x557cdd88da80 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.934+0000 7f9b19415800 1 -- 172.21.15.146:0/3139053931 >> 172.21.15.146:0/3139053931 conn(0x557cdd796de0 msgr2=0x557cdd889440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:24.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.934+0000 7f9b19415800 1 -- 172.21.15.146:0/3139053931 shutdown_connections 2024-09-18T01:45:24.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.934+0000 7f9b19415800 1 -- 172.21.15.146:0/3139053931 wait complete. 2024-09-18T01:45:24.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.934+0000 7f9b19415800 1 Processor -- start 2024-09-18T01:45:24.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.934+0000 7f9b19415800 1 -- start start 2024-09-18T01:45:24.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.934+0000 7f9b19415800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557cdd710610 0x557cdd8952f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.934+0000 7f9b19415800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x557cdd7a5990 con 0x557cdd710610 2024-09-18T01:45:24.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.935+0000 7f9b14b9c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557cdd710610 0x557cdd8952f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.935+0000 7f9b14b9c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557cdd710610 0x557cdd8952f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60208/0 (socket says 172.21.15.146:60208) 2024-09-18T01:45:24.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.935+0000 7f9b14b9c640 1 -- 172.21.15.146:0/783374935 learned_addr learned my addr 172.21.15.146:0/783374935 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:24.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.935+0000 7f9b14b9c640 1 -- 172.21.15.146:0/783374935 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cdd649fe0 con 0x557cdd710610 2024-09-18T01:45:24.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.935+0000 7f9b14b9c640 1 --2- 172.21.15.146:0/783374935 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557cdd710610 0x557cdd8952f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9b0400a4b0 tx=0x7f9b04003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.935+0000 7f9a0160a640 1 -- 172.21.15.146:0/783374935 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b04076470 con 0x557cdd710610 2024-09-18T01:45:24.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.935+0000 7f9a0160a640 1 -- 172.21.15.146:0/783374935 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b04071070 con 0x557cdd710610 2024-09-18T01:45:24.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.935+0000 7f9b19415800 1 -- 172.21.15.146:0/783374935 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557cdd895830 con 0x557cdd710610 2024-09-18T01:45:24.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.935+0000 7f9a0160a640 1 -- 172.21.15.146:0/783374935 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b04076740 con 0x557cdd710610 2024-09-18T01:45:24.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.935+0000 7f9b19415800 1 -- 172.21.15.146:0/783374935 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557cdd895d50 con 0x557cdd710610 2024-09-18T01:45:24.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.936+0000 7f9a0160a640 1 -- 172.21.15.146:0/783374935 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9b040768e0 con 0x557cdd710610 2024-09-18T01:45:24.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.936+0000 7f9a0160a640 1 --2- 172.21.15.146:0/783374935 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f99fc036b90 0x7f99fc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.936+0000 7f9a0160a640 1 -- 172.21.15.146:0/783374935 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f9b04091640 con 0x557cdd710610 2024-09-18T01:45:24.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.936+0000 7f9b1439b640 1 --2- 172.21.15.146:0/783374935 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f99fc036b90 0x7f99fc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.936+0000 7f9b19415800 1 --2- 172.21.15.146:0/783374935 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x557cdd7a1bb0 0x557cdd89c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.936+0000 7f9b19415800 1 -- 172.21.15.146:0/783374935 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557cdd89c8e0 con 0x557cdd7a1bb0 2024-09-18T01:45:24.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.936+0000 7f9b1539d640 1 --2- 172.21.15.146:0/783374935 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x557cdd7a1bb0 0x557cdd89c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.937+0000 7f9b1439b640 1 --2- 172.21.15.146:0/783374935 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f99fc036b90 0x7f99fc039050 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9b08000f60 tx=0x7f9b08001370 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.937+0000 7f9b1539d640 1 --2- 172.21.15.146:0/783374935 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x557cdd7a1bb0 0x557cdd89c360 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.937+0000 7f9b1539d640 1 -- 172.21.15.146:0/783374935 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9b0c0083e0 con 0x557cdd7a1bb0 2024-09-18T01:45:24.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.937+0000 7f9b19415800 1 -- 172.21.15.146:0/783374935 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557cdd899910 con 0x557cdd7a1bb0 2024-09-18T01:45:24.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.937+0000 7f9b1539d640 1 -- 172.21.15.146:0/783374935 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9b0c0083e0 con 0x557cdd7a1bb0 2024-09-18T01:45:24.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.937+0000 7f9b19415800 1 -- 172.21.15.146:0/783374935 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557cdd89e750 con 0x557cdd7a1bb0 2024-09-18T01:45:24.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.938+0000 7f9b1539d640 1 -- 172.21.15.146:0/783374935 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9b0c0083e0 con 0x557cdd7a1bb0 2024-09-18T01:45:24.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.938+0000 7f9b19415800 1 -- 172.21.15.146:0/783374935 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557cdd89d980 con 0x557cdd7a1bb0 2024-09-18T01:45:24.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.938+0000 7f9b1539d640 1 -- 172.21.15.146:0/783374935 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9b0c0083e0 con 0x557cdd7a1bb0 2024-09-18T01:45:24.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.938+0000 7f9b19415800 1 --2- 172.21.15.146:0/783374935 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x557cdd89fb00 0x557cdd8a1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.938+0000 7f9b19415800 1 -- 172.21.15.146:0/783374935 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8a2430 con 0x557cdd89fb00 2024-09-18T01:45:24.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.938+0000 7f9b14b9c640 1 --2- 172.21.15.146:0/783374935 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x557cdd89fb00 0x557cdd8a1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.938+0000 7f9b14b9c640 1 --2- 172.21.15.146:0/783374935 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x557cdd89fb00 0x557cdd8a1ef0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.939+0000 7f9b14b9c640 1 -- 172.21.15.146:0/783374935 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9b0406ad10 con 0x557cdd89fb00 2024-09-18T01:45:24.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.939+0000 7f9b19415800 1 Processor -- start 2024-09-18T01:45:24.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.939+0000 7f9b19415800 1 -- start start 2024-09-18T01:45:24.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.939+0000 7f9b19415800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557cdd8b00b0 0x557cdd8b04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.939+0000 7f9b19415800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x557cdd637580 con 0x557cdd8b00b0 2024-09-18T01:45:24.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.939+0000 7f9b1539d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557cdd8b00b0 0x557cdd8b04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.939+0000 7f9b1539d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557cdd8b00b0 0x557cdd8b04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60210/0 (socket says 172.21.15.146:60210) 2024-09-18T01:45:24.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.939+0000 7f9b1539d640 1 -- 172.21.15.146:0/2821903991 learned_addr learned my addr 172.21.15.146:0/2821903991 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:24.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.940+0000 7f9b1539d640 1 -- 172.21.15.146:0/2821903991 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cdd8b0a10 con 0x557cdd8b00b0 2024-09-18T01:45:24.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.940+0000 7f9b1539d640 1 --2- 172.21.15.146:0/2821903991 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557cdd8b00b0 0x557cdd8b04d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x557cdd896510 tx=0x7f9b0c00ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.940+0000 7f99fa7fc640 1 -- 172.21.15.146:0/2821903991 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b0c01c070 con 0x557cdd8b00b0 2024-09-18T01:45:24.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.940+0000 7f99fa7fc640 1 -- 172.21.15.146:0/2821903991 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b0c018410 con 0x557cdd8b00b0 2024-09-18T01:45:24.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.940+0000 7f99fa7fc640 1 -- 172.21.15.146:0/2821903991 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b0c018730 con 0x557cdd8b00b0 2024-09-18T01:45:24.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.940+0000 7f9b19415800 1 -- 172.21.15.146:0/2821903991 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557cdd8b0ca0 con 0x557cdd8b00b0 2024-09-18T01:45:24.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.940+0000 7f9b19415800 1 -- 172.21.15.146:0/2821903991 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557cdd8b3980 con 0x557cdd8b00b0 2024-09-18T01:45:24.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.941+0000 7f99fa7fc640 1 -- 172.21.15.146:0/2821903991 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9b0c01f070 con 0x557cdd8b00b0 2024-09-18T01:45:24.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.941+0000 7f99fa7fc640 1 --2- 172.21.15.146:0/2821903991 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f99ec036b40 0x7f99ec039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.941+0000 7f99fa7fc640 1 -- 172.21.15.146:0/2821903991 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f9b0c04e540 con 0x557cdd8b00b0 2024-09-18T01:45:24.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.941+0000 7f9b14b9c640 1 --2- 172.21.15.146:0/2821903991 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f99ec036b40 0x7f99ec039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.941+0000 7f9b19415800 1 Processor -- start 2024-09-18T01:45:24.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.941+0000 7f9b19415800 1 -- start start 2024-09-18T01:45:24.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.941+0000 7f9b14b9c640 1 --2- 172.21.15.146:0/2821903991 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f99ec036b40 0x7f99ec039000 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x557cdd89e6e0 tx=0x7f9b0404eb70 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.941+0000 7f9b19415800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557cdd8bcdc0 0x557cdd8bd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.941+0000 7f9b19415800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x557cdd88e170 con 0x557cdd8bcdc0 2024-09-18T01:45:24.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.942+0000 7f9b1539d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557cdd8bcdc0 0x557cdd8bd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.942+0000 7f9b1539d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557cdd8bcdc0 0x557cdd8bd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60222/0 (socket says 172.21.15.146:60222) 2024-09-18T01:45:24.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.942+0000 7f9b1539d640 1 -- 172.21.15.146:0/2268148994 learned_addr learned my addr 172.21.15.146:0/2268148994 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:24.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.942+0000 7f9b1539d640 1 -- 172.21.15.146:0/2268148994 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cdd8bd790 con 0x557cdd8bcdc0 2024-09-18T01:45:24.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.942+0000 7f9b1539d640 1 --2- 172.21.15.146:0/2268148994 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557cdd8bcdc0 0x557cdd8bd1c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c014800 tx=0x7f9b0c0146a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c65b36d40384b87 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.942+0000 7f99ebfff640 1 -- 172.21.15.146:0/2268148994 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b0c016db0 con 0x557cdd8bcdc0 2024-09-18T01:45:24.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.942+0000 7f99ebfff640 1 -- 172.21.15.146:0/2268148994 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b0c040e50 con 0x557cdd8bcdc0 2024-09-18T01:45:24.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.942+0000 7f99ebfff640 1 -- 172.21.15.146:0/2268148994 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b0c04e220 con 0x557cdd8bcdc0 2024-09-18T01:45:24.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.943+0000 7f9b19415800 1 -- 172.21.15.146:0/2268148994 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557cdd8bcdc0 msgr2=0x557cdd8bd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.943+0000 7f9b19415800 1 --2- 172.21.15.146:0/2268148994 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557cdd8bcdc0 0x557cdd8bd1c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c014800 tx=0x7f9b0c0146a0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.943+0000 7f9b19415800 1 -- 172.21.15.146:0/2268148994 shutdown_connections 2024-09-18T01:45:24.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.943+0000 7f9b19415800 1 --2- 172.21.15.146:0/2268148994 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557cdd8bcdc0 0x557cdd8bd1c0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.943+0000 7f9b19415800 1 -- 172.21.15.146:0/2268148994 >> 172.21.15.146:0/2268148994 conn(0x557cdd8b9120 msgr2=0x557cdd8b7220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:24.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.943+0000 7f9b19415800 1 -- 172.21.15.146:0/2268148994 shutdown_connections 2024-09-18T01:45:24.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.943+0000 7f9b19415800 1 -- 172.21.15.146:0/2268148994 wait complete. 2024-09-18T01:45:24.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.943+0000 7f9b19415800 1 Processor -- start 2024-09-18T01:45:24.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.943+0000 7f9b19415800 1 -- start start 2024-09-18T01:45:24.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.943+0000 7f9b19415800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557cdd8bcdc0 0x557cdd8c42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.943+0000 7f9b19415800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x557cdd8bde40 con 0x557cdd8bcdc0 2024-09-18T01:45:24.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.943+0000 7f9b1539d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557cdd8bcdc0 0x557cdd8c42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.943+0000 7f9b1539d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557cdd8bcdc0 0x557cdd8c42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60236/0 (socket says 172.21.15.146:60236) 2024-09-18T01:45:24.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.943+0000 7f9b1539d640 1 -- 172.21.15.146:0/2380428138 learned_addr learned my addr 172.21.15.146:0/2380428138 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:24.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.943+0000 7f9b1539d640 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cdd8c47e0 con 0x557cdd8bcdc0 2024-09-18T01:45:24.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.944+0000 7f9b1539d640 1 --2- 172.21.15.146:0/2380428138 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557cdd8bcdc0 0x557cdd8c42a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c014800 tx=0x7f9b0c04c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.944+0000 7f99ea7fc640 1 -- 172.21.15.146:0/2380428138 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b0c007c30 con 0x557cdd8bcdc0 2024-09-18T01:45:24.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.944+0000 7f99ea7fc640 1 -- 172.21.15.146:0/2380428138 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b0c04a030 con 0x557cdd8bcdc0 2024-09-18T01:45:24.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.944+0000 7f9b19415800 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557cdd8c4a70 con 0x557cdd8bcdc0 2024-09-18T01:45:24.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.944+0000 7f99ea7fc640 1 -- 172.21.15.146:0/2380428138 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b0c0189a0 con 0x557cdd8bcdc0 2024-09-18T01:45:24.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.944+0000 7f9b19415800 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557cdd8c7720 con 0x557cdd8bcdc0 2024-09-18T01:45:24.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.944+0000 7f99ea7fc640 1 -- 172.21.15.146:0/2380428138 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9b0c018b90 con 0x557cdd8bcdc0 2024-09-18T01:45:24.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.945+0000 7f99ea7fc640 1 --2- 172.21.15.146:0/2380428138 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f99e0036b40 0x7f99e0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.945+0000 7f99ea7fc640 1 -- 172.21.15.146:0/2380428138 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f9b0c033070 con 0x557cdd8bcdc0 2024-09-18T01:45:24.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.945+0000 7f9b14b9c640 1 --2- 172.21.15.146:0/2380428138 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f99e0036b40 0x7f99e0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.945+0000 7f9b19415800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.945+0000 7f9b19415800 1 --2- 172.21.15.146:0/2380428138 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x557cdd8cfce0 0x557cdd8d21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.945+0000 7f9b19415800 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8d28f0 con 0x557cdd8cfce0 2024-09-18T01:45:24.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.945+0000 7f9b1439b640 1 --2- 172.21.15.146:0/2380428138 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x557cdd8cfce0 0x557cdd8d21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.945+0000 7f9b14b9c640 1 --2- 172.21.15.146:0/2380428138 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f99e0036b40 0x7f99e0039000 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9b0407f7e0 tx=0x7f9b04082000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.946+0000 7f9b1439b640 1 --2- 172.21.15.146:0/2380428138 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x557cdd8cfce0 0x557cdd8d21a0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.946+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9b0800f610 con 0x557cdd8cfce0 2024-09-18T01:45:24.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.946+0000 7f9b19415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.946+0000 7f9b19415800 20 realm 2024-09-18T01:45:24.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.946+0000 7f9b19415800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.946+0000 7f9b19415800 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8cf130 con 0x557cdd8cfce0 2024-09-18T01:45:24.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.946+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9b0800f610 con 0x557cdd8cfce0 2024-09-18T01:45:24.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.946+0000 7f9b19415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.946+0000 7f9b19415800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:24.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.946+0000 7f9b19415800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.946+0000 7f9b19415800 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8d33d0 con 0x557cdd8cfce0 2024-09-18T01:45:24.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.946+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9b0800f610 con 0x557cdd8cfce0 2024-09-18T01:45:24.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.946+0000 7f9b19415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.946+0000 7f9b19415800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.946+0000 7f9b19415800 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8d3ca0 con 0x557cdd8cfce0 2024-09-18T01:45:24.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.946+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9b0800f610 con 0x557cdd8cfce0 2024-09-18T01:45:24.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.947+0000 7f9b19415800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:24.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.947+0000 7f9b19415800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.947+0000 7f9b19415800 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8d4040 con 0x557cdd8cfce0 2024-09-18T01:45:24.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.947+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9b0800f610 con 0x557cdd8cfce0 2024-09-18T01:45:24.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.947+0000 7f9b19415800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:24.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.947+0000 7f9b19415800 20 searching for the correct realm 2024-09-18T01:45:24.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.947+0000 7f9b19415800 1 --2- 172.21.15.146:0/2380428138 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x557cdd8d5f20 0x557cdd8d8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.947+0000 7f9b19415800 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8d89c0 con 0x557cdd8d5f20 2024-09-18T01:45:24.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.947+0000 7f9b1539d640 1 --2- 172.21.15.146:0/2380428138 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x557cdd8d5f20 0x557cdd8d8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.947+0000 7f9b1539d640 1 --2- 172.21.15.146:0/2380428138 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x557cdd8d5f20 0x557cdd8d8310 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.947+0000 7f9b1539d640 1 -- 172.21.15.146:0/2380428138 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b0c057040 con 0x557cdd8d5f20 2024-09-18T01:45:24.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.947+0000 7f9b1539d640 1 --2- 172.21.15.146:0/2380428138 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f9b0c021070 0x7f9b0c0369a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.947+0000 7f9b1539d640 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8d89c0 con 0x7f9b0c021070 2024-09-18T01:45:24.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.948+0000 7f9b14b9c640 1 --2- 172.21.15.146:0/2380428138 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f9b0c021070 0x7f9b0c0369a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.948+0000 7f9b14b9c640 1 --2- 172.21.15.146:0/2380428138 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f9b0c021070 0x7f9b0c0369a0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.948+0000 7f9b14b9c640 1 -- 172.21.15.146:0/2380428138 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b0406ad10 con 0x7f9b0c021070 2024-09-18T01:45:24.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.948+0000 7f9b14b9c640 1 --2- 172.21.15.146:0/2380428138 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f9b0406d040 0x7f9b0408f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:24.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.948+0000 7f9b14b9c640 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8d89c0 con 0x7f9b0406d040 2024-09-18T01:45:24.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.948+0000 7f9b1439b640 1 --2- 172.21.15.146:0/2380428138 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f9b0406d040 0x7f9b0408f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:24.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.948+0000 7f9b1439b640 1 --2- 172.21.15.146:0/2380428138 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f9b0406d040 0x7f9b0408f430 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:24.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.949+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b0800f610 con 0x7f9b0406d040 2024-09-18T01:45:24.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.949+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8d89c0 con 0x557cdd8cfce0 2024-09-18T01:45:24.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.949+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9b0800f610 con 0x557cdd8cfce0 2024-09-18T01:45:24.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.949+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8d89c0 con 0x557cdd8cfce0 2024-09-18T01:45:24.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.949+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b0800f610 con 0x557cdd8cfce0 2024-09-18T01:45:24.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.949+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8d89c0 con 0x7f9b0406d040 2024-09-18T01:45:24.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.949+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b0800f610 con 0x7f9b0406d040 2024-09-18T01:45:24.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.949+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8d89c0 con 0x7f9b0406d040 2024-09-18T01:45:24.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.950+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b0800f610 con 0x7f9b0406d040 2024-09-18T01:45:24.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.950+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8d89c0 con 0x7f9b0c021070 2024-09-18T01:45:24.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.950+0000 7f9b14b9c640 1 -- 172.21.15.146:0/2380428138 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b0406ad10 con 0x7f9b0c021070 2024-09-18T01:45:24.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.950+0000 7f9b14b9c640 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8d89c0 con 0x557cdd8d5f20 2024-09-18T01:45:24.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.950+0000 7f9b1539d640 1 -- 172.21.15.146:0/2380428138 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b0c057040 con 0x557cdd8d5f20 2024-09-18T01:45:24.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.950+0000 7f9b1539d640 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8d89c0 con 0x557cdd8cfce0 2024-09-18T01:45:24.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.950+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b0800f610 con 0x557cdd8cfce0 2024-09-18T01:45:24.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.950+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8d89c0 con 0x7f9b0406d040 2024-09-18T01:45:24.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.950+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b0800f610 con 0x7f9b0406d040 2024-09-18T01:45:24.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.950+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8d89c0 con 0x557cdd8cfce0 2024-09-18T01:45:24.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.951+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b0800f610 con 0x557cdd8cfce0 2024-09-18T01:45:24.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.951+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8d89c0 con 0x7f9b0c021070 2024-09-18T01:45:24.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.951+0000 7f9b14b9c640 1 -- 172.21.15.146:0/2380428138 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f9b0406ad10 con 0x7f9b0c021070 2024-09-18T01:45:24.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.951+0000 7f9b14b9c640 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8d89c0 con 0x557cdd8d5f20 2024-09-18T01:45:24.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.951+0000 7f9b1539d640 1 -- 172.21.15.146:0/2380428138 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b0c057040 con 0x557cdd8d5f20 2024-09-18T01:45:24.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.951+0000 7f9b1539d640 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8d89c0 con 0x557cdd8d5f20 2024-09-18T01:45:24.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.951+0000 7f9b1539d640 1 -- 172.21.15.146:0/2380428138 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b0c057040 con 0x557cdd8d5f20 2024-09-18T01:45:24.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.951+0000 7f9b1539d640 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8d89c0 con 0x7f9b0406d040 2024-09-18T01:45:24.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.952+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b0800f610 con 0x7f9b0406d040 2024-09-18T01:45:24.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.952+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8d89c0 con 0x557cdd8d5f20 2024-09-18T01:45:24.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.952+0000 7f9b1539d640 1 -- 172.21.15.146:0/2380428138 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b0c057040 con 0x557cdd8d5f20 2024-09-18T01:45:24.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.952+0000 7f9b1539d640 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8d89c0 con 0x557cdd8d5f20 2024-09-18T01:45:24.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.952+0000 7f9b1539d640 1 -- 172.21.15.146:0/2380428138 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b0c057040 con 0x557cdd8d5f20 2024-09-18T01:45:24.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.952+0000 7f9b1539d640 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8d89c0 con 0x557cdd8cfce0 2024-09-18T01:45:24.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.952+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b0800f610 con 0x557cdd8cfce0 2024-09-18T01:45:24.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.952+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8d89c0 con 0x557cdd8cfce0 2024-09-18T01:45:24.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.953+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9b0800f610 con 0x557cdd8cfce0 2024-09-18T01:45:24.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.953+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8d89c0 con 0x7f9b0406d040 2024-09-18T01:45:24.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.953+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b0800f610 con 0x7f9b0406d040 2024-09-18T01:45:24.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.953+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8d89c0 con 0x557cdd8d5f20 2024-09-18T01:45:24.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.953+0000 7f9b1539d640 1 -- 172.21.15.146:0/2380428138 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b0c057040 con 0x557cdd8d5f20 2024-09-18T01:45:24.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.953+0000 7f9b1539d640 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8d89c0 con 0x7f9b0c021070 2024-09-18T01:45:24.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.953+0000 7f9b14b9c640 1 -- 172.21.15.146:0/2380428138 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b0406ad10 con 0x7f9b0c021070 2024-09-18T01:45:24.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.953+0000 7f9b14b9c640 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8d89c0 con 0x557cdd8cfce0 2024-09-18T01:45:24.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.954+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b0800f610 con 0x557cdd8cfce0 2024-09-18T01:45:24.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.954+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8d89c0 con 0x7f9b0406d040 2024-09-18T01:45:24.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.954+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b0800f610 con 0x7f9b0406d040 2024-09-18T01:45:24.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.954+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8d89c0 con 0x557cdd8d5f20 2024-09-18T01:45:24.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.954+0000 7f9b1539d640 1 -- 172.21.15.146:0/2380428138 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b0c057040 con 0x557cdd8d5f20 2024-09-18T01:45:24.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.954+0000 7f9b1539d640 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8d89c0 con 0x7f9b0406d040 2024-09-18T01:45:24.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.954+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b0800f610 con 0x7f9b0406d040 2024-09-18T01:45:24.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.954+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8d89c0 con 0x7f9b0c021070 2024-09-18T01:45:24.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.955+0000 7f9b14b9c640 1 -- 172.21.15.146:0/2380428138 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b0406ad10 con 0x7f9b0c021070 2024-09-18T01:45:24.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.955+0000 7f9b14b9c640 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8d89c0 con 0x557cdd8d5f20 2024-09-18T01:45:24.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.955+0000 7f9b1539d640 1 -- 172.21.15.146:0/2380428138 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b0c057040 con 0x557cdd8d5f20 2024-09-18T01:45:24.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.955+0000 7f9b1539d640 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8d89c0 con 0x7f9b0406d040 2024-09-18T01:45:24.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.955+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b0800f610 con 0x7f9b0406d040 2024-09-18T01:45:24.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.955+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8d89c0 con 0x557cdd8cfce0 2024-09-18T01:45:24.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.955+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9b0800f610 con 0x557cdd8cfce0 2024-09-18T01:45:24.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.956+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8d89c0 con 0x7f9b0c021070 2024-09-18T01:45:24.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.956+0000 7f9b14b9c640 1 -- 172.21.15.146:0/2380428138 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b0406ad10 con 0x7f9b0c021070 2024-09-18T01:45:24.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.956+0000 7f9b19415800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:24.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.956+0000 7f9b19415800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:24.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.956+0000 7f9b19415800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:24.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.956+0000 7f9b19415800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:24.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.956+0000 7f9b19415800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:24.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.956+0000 7f9b19415800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:24.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.956+0000 7f9b19415800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.956+0000 7f9b19415800 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8d49f0 con 0x557cdd8cfce0 2024-09-18T01:45:24.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.956+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9b0800f610 con 0x557cdd8cfce0 2024-09-18T01:45:24.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.956+0000 7f9b19415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.956+0000 7f9b19415800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.956+0000 7f9b19415800 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8d5290 con 0x557cdd8cfce0 2024-09-18T01:45:24.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.956+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9b0800f610 con 0x557cdd8cfce0 2024-09-18T01:45:24.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.956+0000 7f9b19415800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:24.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.956+0000 7f9b19415800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.956+0000 7f9b19415800 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8d4630 con 0x7f9b0c021070 2024-09-18T01:45:24.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.956+0000 7f9b14b9c640 1 -- 172.21.15.146:0/2380428138 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9b0406ad10 con 0x7f9b0c021070 2024-09-18T01:45:24.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.956+0000 7f9b19415800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:24.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.956+0000 7f9b19415800 20 zone default found 2024-09-18T01:45:24.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.957+0000 7f9b19415800 4 Realm: () 2024-09-18T01:45:24.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.957+0000 7f9b19415800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:24.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.957+0000 7f9b19415800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:24.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.957+0000 7f9b19415800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:24.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.957+0000 7f9b19415800 20 zonegroup default 2024-09-18T01:45:24.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.957+0000 7f9b19415800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.957+0000 7f9b19415800 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8d92f0 con 0x7f9b0406d040 2024-09-18T01:45:24.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.957+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9b0800f610 con 0x7f9b0406d040 2024-09-18T01:45:24.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.957+0000 7f9b19415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.957+0000 7f9b19415800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.957+0000 7f9b19415800 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8dae80 con 0x557cdd8d5f20 2024-09-18T01:45:24.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.957+0000 7f9b1539d640 1 -- 172.21.15.146:0/2380428138 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9b0c057040 con 0x557cdd8d5f20 2024-09-18T01:45:24.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.957+0000 7f9b19415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.957+0000 7f9b19415800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.957+0000 7f9b19415800 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8db350 con 0x557cdd8d5f20 2024-09-18T01:45:24.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.957+0000 7f9b1539d640 1 -- 172.21.15.146:0/2380428138 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9b0c057040 con 0x557cdd8d5f20 2024-09-18T01:45:24.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.957+0000 7f9b19415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:24.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.957+0000 7f9b19415800 20 started sync module instance, tier type = 2024-09-18T01:45:24.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.957+0000 7f9b19415800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:24.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.957+0000 7f9b19415800 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8d9d80 con 0x7f9b0c021070 2024-09-18T01:45:24.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.958+0000 7f9b14b9c640 1 -- 172.21.15.146:0/2380428138 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v31'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b0406ad10 con 0x7f9b0c021070 2024-09-18T01:45:24.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.958+0000 7f9b19415800 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93994781350096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8db7b0 con 0x7f9b0c021070 2024-09-18T01:45:24.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.958+0000 7f9b19415800 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8dc000 con 0x557cdd8cfce0 2024-09-18T01:45:24.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.959+0000 7f9b14b9c640 1 -- 172.21.15.146:0/2380428138 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93994781350096] v31'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b0406ad10 con 0x7f9b0c021070 2024-09-18T01:45:24.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.959+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v31'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b0800f610 con 0x557cdd8cfce0 2024-09-18T01:45:24.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.959+0000 7f9b19415800 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93994781358928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8dc420 con 0x557cdd8cfce0 2024-09-18T01:45:24.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.959+0000 7f9b19415800 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8dccd0 con 0x557cdd8d5f20 2024-09-18T01:45:24.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.960+0000 7f9b1539d640 1 -- 172.21.15.146:0/2380428138 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v31'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b0c057040 con 0x557cdd8d5f20 2024-09-18T01:45:24.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.960+0000 7f9b19415800 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93994781361184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8dc880 con 0x557cdd8d5f20 2024-09-18T01:45:24.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.960+0000 7f9b19415800 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8ddca0 con 0x7f9b0c021070 2024-09-18T01:45:24.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.961+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93994781358928] v31'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b0800f610 con 0x557cdd8cfce0 2024-09-18T01:45:24.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.961+0000 7f9b1539d640 1 -- 172.21.15.146:0/2380428138 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93994781361184] v31'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b0c057040 con 0x557cdd8d5f20 2024-09-18T01:45:24.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.962+0000 7f9b14b9c640 1 -- 172.21.15.146:0/2380428138 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v31'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b0406ad10 con 0x7f9b0c021070 2024-09-18T01:45:24.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.962+0000 7f9b19415800 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93994781364416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8ddc60 con 0x7f9b0c021070 2024-09-18T01:45:24.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.962+0000 7f9b19415800 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8de540 con 0x557cdd8cfce0 2024-09-18T01:45:24.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.962+0000 7f9b14b9c640 1 -- 172.21.15.146:0/2380428138 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93994781364416] v31'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b0406ad10 con 0x7f9b0c021070 2024-09-18T01:45:24.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.963+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v31'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b0800f610 con 0x557cdd8cfce0 2024-09-18T01:45:24.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.963+0000 7f9b19415800 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93994781366160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8ddc60 con 0x557cdd8cfce0 2024-09-18T01:45:24.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.963+0000 7f9b19415800 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8dec20 con 0x7f9b0406d040 2024-09-18T01:45:24.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.963+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93994781366160] v31'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b0800f610 con 0x557cdd8cfce0 2024-09-18T01:45:24.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.964+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v31'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b0800f610 con 0x7f9b0406d040 2024-09-18T01:45:24.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.964+0000 7f9b19415800 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93994781370160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8dec20 con 0x7f9b0406d040 2024-09-18T01:45:24.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.964+0000 7f9b19415800 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8dec20 con 0x7f9b0406d040 2024-09-18T01:45:24.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.966+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93994781370160] v31'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b0800f610 con 0x7f9b0406d040 2024-09-18T01:45:24.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.966+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v31'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b0800f610 con 0x7f9b0406d040 2024-09-18T01:45:24.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.966+0000 7f9b19415800 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93994781368464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8df660 con 0x7f9b0406d040 2024-09-18T01:45:24.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.967+0000 7f9b19415800 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8e0020 con 0x7f9b0406d040 2024-09-18T01:45:24.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.967+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93994781368464] v31'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b0800f610 con 0x7f9b0406d040 2024-09-18T01:45:24.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.967+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v31'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b0800f610 con 0x7f9b0406d040 2024-09-18T01:45:24.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.967+0000 7f9b19415800 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93994781373328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8e0020 con 0x7f9b0406d040 2024-09-18T01:45:24.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.967+0000 7f9b19415800 20 add_watcher() i=0 2024-09-18T01:45:24.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.967+0000 7f9b19415800 20 add_watcher() i=1 2024-09-18T01:45:24.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.967+0000 7f9b19415800 20 add_watcher() i=2 2024-09-18T01:45:24.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.967+0000 7f9b19415800 20 add_watcher() i=3 2024-09-18T01:45:24.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.967+0000 7f9b19415800 20 add_watcher() i=4 2024-09-18T01:45:24.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.967+0000 7f9b19415800 20 add_watcher() i=5 2024-09-18T01:45:24.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.967+0000 7f9b19415800 20 add_watcher() i=6 2024-09-18T01:45:24.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.969+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93994781373328] v31'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b0800f610 con 0x7f9b0406d040 2024-09-18T01:45:24.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.969+0000 7f9b19415800 20 add_watcher() i=7 2024-09-18T01:45:24.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.969+0000 7f9b19415800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:24.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.969+0000 7f9b19415800 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8e3420 con 0x557cdd8cfce0 2024-09-18T01:45:24.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.970+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9b0800f610 con 0x557cdd8cfce0 2024-09-18T01:45:24.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.970+0000 7f9b19415800 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93994781375808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8e08e0 con 0x557cdd8cfce0 2024-09-18T01:45:24.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.971+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93994781375808] v31'86 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9b0800f610 con 0x557cdd8cfce0 2024-09-18T01:45:24.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.971+0000 7f99cafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:24.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.971+0000 7f9b19415800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:24.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.971+0000 7f9b19415800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:24.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.971+0000 7f9b19415800 5 note: GC not initialized 2024-09-18T01:45:24.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.971+0000 7f99c9fe3640 20 reqs_thread_entry: start 2024-09-18T01:45:24.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.971+0000 7f9b19415800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:24.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.971+0000 7f9b19415800 20 Filter name: none 2024-09-18T01:45:24.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.971+0000 7f993b7fe640 20 reqs_thread_entry: start 2024-09-18T01:45:24.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.971+0000 7f9b19415800 20 rados->read ofs=0 len=0 2024-09-18T01:45:24.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.971+0000 7f9b19415800 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557cdd916390 con 0x557cdd8cfce0 2024-09-18T01:45:24.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.972+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f9b0800f610 con 0x557cdd8cfce0 2024-09-18T01:45:24.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.972+0000 7f9b19415800 20 rados_obj.operate() r=0 bl.length=673 2024-09-18T01:45:24.984 INFO:teuthology.orchestra.run.smithi146.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T01:45:23.010714Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-18T01:45:24.841201Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:45:23.010705Z","tags":[],"group_ids":[]} 2024-09-18T01:45:24.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.973+0000 7f99cafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:24.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.973+0000 7f9b19415800 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93994781375808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557cdd9168d0 con 0x557cdd8cfce0 2024-09-18T01:45:24.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.974+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93994781375808] v31'87 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9b0800f610 con 0x557cdd8cfce0 2024-09-18T01:45:24.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.974+0000 7f9b19415800 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93994781350096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8dfd10 con 0x7f9b0c021070 2024-09-18T01:45:24.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.975+0000 7f9b14b9c640 1 -- 172.21.15.146:0/2380428138 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93994781350096] v31'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b0406ad10 con 0x7f9b0c021070 2024-09-18T01:45:24.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.975+0000 7f9b19415800 20 remove_watcher() i=0 2024-09-18T01:45:24.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.975+0000 7f9b19415800 2 removed watcher, disabling cache 2024-09-18T01:45:24.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.975+0000 7f9b19415800 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93994781358928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8d98d0 con 0x557cdd8cfce0 2024-09-18T01:45:24.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.976+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93994781358928] v31'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b0800f610 con 0x557cdd8cfce0 2024-09-18T01:45:24.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.976+0000 7f9b19415800 20 remove_watcher() i=1 2024-09-18T01:45:24.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.976+0000 7f9b19415800 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93994781361184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8d98d0 con 0x557cdd8d5f20 2024-09-18T01:45:24.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.977+0000 7f9b1539d640 1 -- 172.21.15.146:0/2380428138 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93994781361184] v31'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b0c057040 con 0x557cdd8d5f20 2024-09-18T01:45:24.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.977+0000 7f9b19415800 20 remove_watcher() i=2 2024-09-18T01:45:24.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.977+0000 7f9b19415800 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93994781364416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8dc420 con 0x7f9b0c021070 2024-09-18T01:45:24.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.978+0000 7f9b14b9c640 1 -- 172.21.15.146:0/2380428138 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93994781364416] v31'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b0406ad10 con 0x7f9b0c021070 2024-09-18T01:45:24.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.978+0000 7f9b19415800 20 remove_watcher() i=3 2024-09-18T01:45:24.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.978+0000 7f9b19415800 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93994781366160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8d98d0 con 0x557cdd8cfce0 2024-09-18T01:45:24.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.979+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93994781366160] v31'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b0800f610 con 0x557cdd8cfce0 2024-09-18T01:45:24.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.979+0000 7f9b19415800 20 remove_watcher() i=4 2024-09-18T01:45:24.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.979+0000 7f9b19415800 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93994781370160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8dc420 con 0x7f9b0406d040 2024-09-18T01:45:24.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.980+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93994781370160] v31'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b0800f610 con 0x7f9b0406d040 2024-09-18T01:45:24.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.980+0000 7f9b19415800 20 remove_watcher() i=5 2024-09-18T01:45:24.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.980+0000 7f9b19415800 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93994781368464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8dd790 con 0x7f9b0406d040 2024-09-18T01:45:24.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.981+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93994781368464] v31'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b0800f610 con 0x7f9b0406d040 2024-09-18T01:45:24.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.981+0000 7f9b19415800 20 remove_watcher() i=6 2024-09-18T01:45:24.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.981+0000 7f9b19415800 1 -- 172.21.15.146:0/2380428138 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93994781373328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557cdd8dd790 con 0x7f9b0406d040 2024-09-18T01:45:24.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.981+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93994781373328] v31'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b0800f610 con 0x7f9b0406d040 2024-09-18T01:45:24.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.981+0000 7f9b19415800 20 remove_watcher() i=7 2024-09-18T01:45:24.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.982+0000 7f9b19415800 1 -- 172.21.15.146:0/2380428138 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f9b0406d040 msgr2=0x7f9b0408f430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.982+0000 7f9b19415800 1 --2- 172.21.15.146:0/2380428138 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f9b0406d040 0x7f9b0408f430 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.982+0000 7f9b19415800 1 -- 172.21.15.146:0/2380428138 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x557cdd8cfce0 msgr2=0x557cdd8d21a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.982+0000 7f9b19415800 1 --2- 172.21.15.146:0/2380428138 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x557cdd8cfce0 0x557cdd8d21a0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.982+0000 7f9b19415800 1 -- 172.21.15.146:0/2380428138 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f9b0c021070 msgr2=0x7f9b0c0369a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.982+0000 7f9b19415800 1 --2- 172.21.15.146:0/2380428138 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f9b0c021070 0x7f9b0c0369a0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.982+0000 7f9b19415800 1 -- 172.21.15.146:0/2380428138 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x557cdd8d5f20 msgr2=0x557cdd8d8310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.982+0000 7f9b19415800 1 --2- 172.21.15.146:0/2380428138 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x557cdd8d5f20 0x557cdd8d8310 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.982+0000 7f9b19415800 1 -- 172.21.15.146:0/2380428138 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f99e0036b40 msgr2=0x7f99e0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.982+0000 7f9b19415800 1 --2- 172.21.15.146:0/2380428138 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f99e0036b40 0x7f99e0039000 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9b0407f7e0 tx=0x7f9b04082000 comp rx=0 tx=0).stop 2024-09-18T01:45:24.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.982+0000 7f9b19415800 1 -- 172.21.15.146:0/2380428138 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557cdd8bcdc0 msgr2=0x557cdd8c42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.982+0000 7f9b19415800 1 --2- 172.21.15.146:0/2380428138 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557cdd8bcdc0 0x557cdd8c42a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c014800 tx=0x7f9b0c04c8e0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.982+0000 7f9b1439b640 1 -- 172.21.15.146:0/2380428138 reap_dead start 2024-09-18T01:45:24.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.982+0000 7f9b19415800 1 -- 172.21.15.146:0/2380428138 shutdown_connections 2024-09-18T01:45:24.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.982+0000 7f9b19415800 1 --2- 172.21.15.146:0/2380428138 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557cdd8bcdc0 0x557cdd8c42a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.982+0000 7f9b19415800 1 -- 172.21.15.146:0/2380428138 >> 172.21.15.146:0/2380428138 conn(0x557cdd8b9120 msgr2=0x557cdd8b71f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:24.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.982+0000 7f9b19415800 1 -- 172.21.15.146:0/2380428138 shutdown_connections 2024-09-18T01:45:24.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.982+0000 7f9b19415800 1 -- 172.21.15.146:0/2380428138 wait complete. 2024-09-18T01:45:24.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.982+0000 7f9b19415800 1 -- 172.21.15.146:0/2821903991 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f99ec036b40 msgr2=0x7f99ec039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.982+0000 7f9b19415800 1 --2- 172.21.15.146:0/2821903991 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f99ec036b40 0x7f99ec039000 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x557cdd89e6e0 tx=0x7f9b0404eb70 comp rx=0 tx=0).stop 2024-09-18T01:45:24.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.982+0000 7f9b19415800 1 -- 172.21.15.146:0/2821903991 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557cdd8b00b0 msgr2=0x557cdd8b04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.982+0000 7f9b19415800 1 --2- 172.21.15.146:0/2821903991 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557cdd8b00b0 0x557cdd8b04d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x557cdd896510 tx=0x7f9b0c00ef30 comp rx=0 tx=0).stop 2024-09-18T01:45:24.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.982+0000 7f9b19415800 1 -- 172.21.15.146:0/2821903991 shutdown_connections 2024-09-18T01:45:24.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.982+0000 7f9b19415800 1 --2- 172.21.15.146:0/2821903991 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f99ec036b40 0x7f99ec039000 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.982+0000 7f9b19415800 1 --2- 172.21.15.146:0/2821903991 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557cdd8b00b0 0x557cdd8b04d0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.982+0000 7f9b19415800 1 -- 172.21.15.146:0/2821903991 >> 172.21.15.146:0/2821903991 conn(0x557cdd8a5040 msgr2=0x557cdd8a7bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:24.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.982+0000 7f9b19415800 1 -- 172.21.15.146:0/2821903991 shutdown_connections 2024-09-18T01:45:24.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.982+0000 7f9b19415800 1 -- 172.21.15.146:0/2821903991 wait complete. 2024-09-18T01:45:24.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.983+0000 7f9b19415800 1 -- 172.21.15.146:0/783374935 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x557cdd7a1bb0 msgr2=0x557cdd89c360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.983+0000 7f9b19415800 1 --2- 172.21.15.146:0/783374935 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x557cdd7a1bb0 0x557cdd89c360 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.983+0000 7f9b19415800 1 -- 172.21.15.146:0/783374935 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x557cdd89fb00 msgr2=0x557cdd8a1ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.983+0000 7f9b19415800 1 --2- 172.21.15.146:0/783374935 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x557cdd89fb00 0x557cdd8a1ef0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.983+0000 7f9b19415800 1 -- 172.21.15.146:0/783374935 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f99fc036b90 msgr2=0x7f99fc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.983+0000 7f9b19415800 1 --2- 172.21.15.146:0/783374935 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f99fc036b90 0x7f99fc039050 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9b08000f60 tx=0x7f9b08001370 comp rx=0 tx=0).stop 2024-09-18T01:45:24.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.983+0000 7f9b19415800 1 -- 172.21.15.146:0/783374935 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557cdd710610 msgr2=0x557cdd8952f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:24.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.983+0000 7f9b19415800 1 --2- 172.21.15.146:0/783374935 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557cdd710610 0x557cdd8952f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9b0400a4b0 tx=0x7f9b04003330 comp rx=0 tx=0).stop 2024-09-18T01:45:24.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.983+0000 7f9b19415800 1 -- 172.21.15.146:0/783374935 shutdown_connections 2024-09-18T01:45:24.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.983+0000 7f9b19415800 1 --2- 172.21.15.146:0/783374935 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x557cdd89fb00 0x557cdd8a1ef0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.983+0000 7f9b19415800 1 --2- 172.21.15.146:0/783374935 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x557cdd7a1bb0 0x557cdd89c360 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.983+0000 7f9b19415800 1 --2- 172.21.15.146:0/783374935 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f99fc036b90 0x7f99fc039050 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.983+0000 7f9b19415800 1 --2- 172.21.15.146:0/783374935 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x557cdd710610 0x557cdd8952f0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:24.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.983+0000 7f9b19415800 1 -- 172.21.15.146:0/783374935 >> 172.21.15.146:0/783374935 conn(0x557cdd796de0 msgr2=0x557cdd887cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:24.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.983+0000 7f9b19415800 1 -- 172.21.15.146:0/783374935 shutdown_connections 2024-09-18T01:45:24.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:24.983+0000 7f9b19415800 1 -- 172.21.15.146:0/783374935 wait complete. 2024-09-18T01:45:24.995 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T01:45:23.010714Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-18T01:45:24.841201Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:45:23.010705Z', 'tags': [], 'group_ids': []} 2024-09-18T01:45:24.995 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-18T01:45:24.995 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-18T01:45:24.995 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --subuser foo:foo1 --key-type swift 2024-09-18T01:45:25.041 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:25.041 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:25.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.041+0000 7f3c1293f800 1 Processor -- start 2024-09-18T01:45:25.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.041+0000 7f3c1293f800 1 -- start start 2024-09-18T01:45:25.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.041+0000 7f3c1293f800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55c39c710920 0x55c39c712d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.041+0000 7f3c1293f800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c39c5cbb30 con 0x55c39c680630 2024-09-18T01:45:25.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.041+0000 7f3c1293f800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x55c39c5ad360 con 0x55c39c710920 2024-09-18T01:45:25.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.042+0000 7f3c0de8f640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55c39c710920 0x55c39c712d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.042+0000 7f3c0de8f640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55c39c710920 0x55c39c712d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60246/0 (socket says 172.21.15.146:60246) 2024-09-18T01:45:25.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.042+0000 7f3c0de8f640 1 -- 172.21.15.146:0/2310724233 learned_addr learned my addr 172.21.15.146:0/2310724233 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:25.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.042+0000 7f3c0e690640 1 --1- 172.21.15.146:0/2310724233 >> v1:172.21.15.129:6789/0 conn(0x55c39c680630 0x55c39c70f200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:38854/0 (socket says 172.21.15.146:38854) 2024-09-18T01:45:25.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.042+0000 7f3c0de8f640 1 -- 172.21.15.146:0/2310724233 >> v1:172.21.15.129:6789/0 conn(0x55c39c680630 legacy=0x55c39c70f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.042+0000 7f3c0de8f640 1 -- 172.21.15.146:0/2310724233 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c39c5d3e00 con 0x55c39c710920 2024-09-18T01:45:25.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.044+0000 7f3c0de8f640 1 --2- 172.21.15.146:0/2310724233 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c39c710920 0x55c39c712d10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3c0400a520 tx=0x7f3c04045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=976eb1e26b08b9d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.044+0000 7f3c0d68e640 1 -- 172.21.15.146:0/2310724233 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c04055070 con 0x55c39c710920 2024-09-18T01:45:25.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.044+0000 7f3c0d68e640 1 -- 172.21.15.146:0/2310724233 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c040515b0 con 0x55c39c710920 2024-09-18T01:45:25.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.044+0000 7f3c0d68e640 1 -- 172.21.15.146:0/2310724233 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c040518d0 con 0x55c39c710920 2024-09-18T01:45:25.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.044+0000 7f3c1293f800 1 -- 172.21.15.146:0/2310724233 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c39c710920 msgr2=0x55c39c712d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.044+0000 7f3c1293f800 1 --2- 172.21.15.146:0/2310724233 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c39c710920 0x55c39c712d10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3c0400a520 tx=0x7f3c04045ba0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.044+0000 7f3c1293f800 1 -- 172.21.15.146:0/2310724233 shutdown_connections 2024-09-18T01:45:25.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.044+0000 7f3c1293f800 1 --2- 172.21.15.146:0/2310724233 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c39c710920 0x55c39c712d10 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.044+0000 7f3c1293f800 1 -- 172.21.15.146:0/2310724233 >> 172.21.15.146:0/2310724233 conn(0x55c39c706db0 msgr2=0x55c39c7091d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:25.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.044+0000 7f3c1293f800 1 -- 172.21.15.146:0/2310724233 shutdown_connections 2024-09-18T01:45:25.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.044+0000 7f3c1293f800 1 -- 172.21.15.146:0/2310724233 wait complete. 2024-09-18T01:45:25.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.058+0000 7f3c1293f800 1 Processor -- start 2024-09-18T01:45:25.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.058+0000 7f3c1293f800 1 -- start start 2024-09-18T01:45:25.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.058+0000 7f3c1293f800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c39c680630 0x55c39c7fb870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.058+0000 7f3c1293f800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55c39c658360 con 0x55c39c680630 2024-09-18T01:45:25.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.059+0000 7f3c0e690640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c39c680630 0x55c39c7fb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.059+0000 7f3c0e690640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c39c680630 0x55c39c7fb870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60260/0 (socket says 172.21.15.146:60260) 2024-09-18T01:45:25.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.059+0000 7f3c0e690640 1 -- 172.21.15.146:0/1522761873 learned_addr learned my addr 172.21.15.146:0/1522761873 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:25.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.059+0000 7f3c0e690640 1 -- 172.21.15.146:0/1522761873 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c39c5a5bc0 con 0x55c39c680630 2024-09-18T01:45:25.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.059+0000 7f3c0e690640 1 --2- 172.21.15.146:0/1522761873 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c39c680630 0x55c39c7fb870 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3c0000b230 tx=0x7f3c0000b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d802292f8bc8d96 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.059+0000 7f3afc608640 1 -- 172.21.15.146:0/1522761873 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c0000e5c0 con 0x55c39c680630 2024-09-18T01:45:25.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.059+0000 7f3afc608640 1 -- 172.21.15.146:0/1522761873 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c00006070 con 0x55c39c680630 2024-09-18T01:45:25.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.059+0000 7f3afc608640 1 -- 172.21.15.146:0/1522761873 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c0000e890 con 0x55c39c680630 2024-09-18T01:45:25.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.060+0000 7f3c1293f800 1 -- 172.21.15.146:0/1522761873 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c39c680630 msgr2=0x55c39c7fb870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.060+0000 7f3c1293f800 1 --2- 172.21.15.146:0/1522761873 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c39c680630 0x55c39c7fb870 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3c0000b230 tx=0x7f3c0000b6f0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.060+0000 7f3c1293f800 1 -- 172.21.15.146:0/1522761873 shutdown_connections 2024-09-18T01:45:25.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.060+0000 7f3c1293f800 1 --2- 172.21.15.146:0/1522761873 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c39c680630 0x55c39c7fb870 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.060+0000 7f3c1293f800 1 -- 172.21.15.146:0/1522761873 >> 172.21.15.146:0/1522761873 conn(0x55c39c706db0 msgr2=0x55c39c7f7230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:25.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.060+0000 7f3c1293f800 1 -- 172.21.15.146:0/1522761873 shutdown_connections 2024-09-18T01:45:25.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.060+0000 7f3c1293f800 1 -- 172.21.15.146:0/1522761873 wait complete. 2024-09-18T01:45:25.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.060+0000 7f3c1293f800 1 Processor -- start 2024-09-18T01:45:25.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.060+0000 7f3c1293f800 1 -- start start 2024-09-18T01:45:25.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.060+0000 7f3c1293f800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c39c680630 0x55c39c70cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.060+0000 7f3c1293f800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55c39c713610 con 0x55c39c680630 2024-09-18T01:45:25.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.061+0000 7f3c0e690640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c39c680630 0x55c39c70cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.061+0000 7f3c0e690640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c39c680630 0x55c39c70cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60274/0 (socket says 172.21.15.146:60274) 2024-09-18T01:45:25.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.061+0000 7f3c0e690640 1 -- 172.21.15.146:0/875445988 learned_addr learned my addr 172.21.15.146:0/875445988 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:25.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.061+0000 7f3c0e690640 1 -- 172.21.15.146:0/875445988 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c39c5b9fe0 con 0x55c39c680630 2024-09-18T01:45:25.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.061+0000 7f3c0e690640 1 --2- 172.21.15.146:0/875445988 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c39c680630 0x55c39c70cb30 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3c00000c00 tx=0x7f3c00000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.061+0000 7f3afae05640 1 -- 172.21.15.146:0/875445988 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c0000f8d0 con 0x55c39c680630 2024-09-18T01:45:25.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.061+0000 7f3afae05640 1 -- 172.21.15.146:0/875445988 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c0000fa90 con 0x55c39c680630 2024-09-18T01:45:25.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.061+0000 7f3afae05640 1 -- 172.21.15.146:0/875445988 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c0000fdb0 con 0x55c39c680630 2024-09-18T01:45:25.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.061+0000 7f3c1293f800 1 -- 172.21.15.146:0/875445988 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c39c70b220 con 0x55c39c680630 2024-09-18T01:45:25.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.061+0000 7f3c1293f800 1 -- 172.21.15.146:0/875445988 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c39c70b740 con 0x55c39c680630 2024-09-18T01:45:25.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.062+0000 7f3afae05640 1 -- 172.21.15.146:0/875445988 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3c00017070 con 0x55c39c680630 2024-09-18T01:45:25.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.062+0000 7f3afae05640 1 --2- 172.21.15.146:0/875445988 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f3af4036b40 0x7f3af4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.062+0000 7f3afae05640 1 -- 172.21.15.146:0/875445988 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f3c00015020 con 0x55c39c680630 2024-09-18T01:45:25.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.062+0000 7f3c0de8f640 1 --2- 172.21.15.146:0/875445988 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f3af4036b40 0x7f3af4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.062+0000 7f3c1293f800 1 --2- 172.21.15.146:0/875445988 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55c39c710920 0x55c39c80c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.062+0000 7f3c1293f800 1 -- 172.21.15.146:0/875445988 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c39c80cbb0 con 0x55c39c710920 2024-09-18T01:45:25.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.063+0000 7f3c0ee91640 1 --2- 172.21.15.146:0/875445988 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55c39c710920 0x55c39c80c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.063+0000 7f3c0de8f640 1 --2- 172.21.15.146:0/875445988 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f3af4036b40 0x7f3af4039000 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3c04057000 tx=0x7f3c04052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.063+0000 7f3c0ee91640 1 --2- 172.21.15.146:0/875445988 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55c39c710920 0x55c39c80c670 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.063+0000 7f3c0ee91640 1 -- 172.21.15.146:0/875445988 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c0800a4a0 con 0x55c39c710920 2024-09-18T01:45:25.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.063+0000 7f3c1293f800 1 -- 172.21.15.146:0/875445988 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c39c80d400 con 0x55c39c710920 2024-09-18T01:45:25.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.063+0000 7f3c0ee91640 1 -- 172.21.15.146:0/875445988 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3c0800a4a0 con 0x55c39c710920 2024-09-18T01:45:25.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.063+0000 7f3c1293f800 1 -- 172.21.15.146:0/875445988 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c39c80e7b0 con 0x55c39c710920 2024-09-18T01:45:25.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.064+0000 7f3c0ee91640 1 -- 172.21.15.146:0/875445988 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3c0800a4a0 con 0x55c39c710920 2024-09-18T01:45:25.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.064+0000 7f3c1293f800 1 -- 172.21.15.146:0/875445988 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c39c80dc50 con 0x55c39c710920 2024-09-18T01:45:25.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.064+0000 7f3c0ee91640 1 -- 172.21.15.146:0/875445988 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3c0800a4a0 con 0x55c39c710920 2024-09-18T01:45:25.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.064+0000 7f3c1293f800 1 --2- 172.21.15.146:0/875445988 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55c39c80fc00 0x55c39c811ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.064+0000 7f3c1293f800 1 -- 172.21.15.146:0/875445988 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c39c812640 con 0x55c39c80fc00 2024-09-18T01:45:25.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.064+0000 7f3c0e690640 1 --2- 172.21.15.146:0/875445988 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55c39c80fc00 0x55c39c811ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.064+0000 7f3c0e690640 1 --2- 172.21.15.146:0/875445988 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55c39c80fc00 0x55c39c811ff0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.065+0000 7f3c0e690640 1 -- 172.21.15.146:0/875445988 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3c0002e070 con 0x55c39c80fc00 2024-09-18T01:45:25.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.065+0000 7f3c1293f800 1 Processor -- start 2024-09-18T01:45:25.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.065+0000 7f3c1293f800 1 -- start start 2024-09-18T01:45:25.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.065+0000 7f3c1293f800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c39c8203d0 0x55c39c8207f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.065+0000 7f3c1293f800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55c39c70d070 con 0x55c39c8203d0 2024-09-18T01:45:25.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.065+0000 7f3c0ee91640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c39c8203d0 0x55c39c8207f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.065+0000 7f3c0ee91640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c39c8203d0 0x55c39c8207f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60280/0 (socket says 172.21.15.146:60280) 2024-09-18T01:45:25.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.065+0000 7f3c0ee91640 1 -- 172.21.15.146:0/83352993 learned_addr learned my addr 172.21.15.146:0/83352993 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:25.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.066+0000 7f3c0ee91640 1 -- 172.21.15.146:0/83352993 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c39c820d30 con 0x55c39c8203d0 2024-09-18T01:45:25.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.066+0000 7f3c0ee91640 1 --2- 172.21.15.146:0/83352993 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c39c8203d0 0x55c39c8207f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x55c39c70c870 tx=0x7f3c080178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.066+0000 7f3af3fff640 1 -- 172.21.15.146:0/83352993 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c08013440 con 0x55c39c8203d0 2024-09-18T01:45:25.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.066+0000 7f3af3fff640 1 -- 172.21.15.146:0/83352993 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c080135e0 con 0x55c39c8203d0 2024-09-18T01:45:25.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.066+0000 7f3af3fff640 1 -- 172.21.15.146:0/83352993 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c080138c0 con 0x55c39c8203d0 2024-09-18T01:45:25.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.066+0000 7f3c1293f800 1 -- 172.21.15.146:0/83352993 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c39c820fc0 con 0x55c39c8203d0 2024-09-18T01:45:25.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.066+0000 7f3c1293f800 1 -- 172.21.15.146:0/83352993 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c39c823ca0 con 0x55c39c8203d0 2024-09-18T01:45:25.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.067+0000 7f3af3fff640 1 -- 172.21.15.146:0/83352993 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3c08011040 con 0x55c39c8203d0 2024-09-18T01:45:25.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.067+0000 7f3af3fff640 1 --2- 172.21.15.146:0/83352993 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f3ae8036b90 0x7f3ae8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.067+0000 7f3af3fff640 1 -- 172.21.15.146:0/83352993 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f3c0801d070 con 0x55c39c8203d0 2024-09-18T01:45:25.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.067+0000 7f3c0e690640 1 --2- 172.21.15.146:0/83352993 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f3ae8036b90 0x7f3ae8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.067+0000 7f3c1293f800 1 Processor -- start 2024-09-18T01:45:25.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.067+0000 7f3c0e690640 1 --2- 172.21.15.146:0/83352993 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f3ae8036b90 0x7f3ae8039050 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3c000176e0 tx=0x7f3c0004b740 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.067+0000 7f3c1293f800 1 -- start start 2024-09-18T01:45:25.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.067+0000 7f3c1293f800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c39c82d020 0x55c39c82d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.067+0000 7f3c1293f800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55c39c5a7580 con 0x55c39c82d020 2024-09-18T01:45:25.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.068+0000 7f3c0ee91640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c39c82d020 0x55c39c82d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.068+0000 7f3c0ee91640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c39c82d020 0x55c39c82d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60286/0 (socket says 172.21.15.146:60286) 2024-09-18T01:45:25.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.068+0000 7f3c0ee91640 1 -- 172.21.15.146:0/2906960010 learned_addr learned my addr 172.21.15.146:0/2906960010 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:25.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.068+0000 7f3c0ee91640 1 -- 172.21.15.146:0/2906960010 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c39c82d9f0 con 0x55c39c82d020 2024-09-18T01:45:25.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.068+0000 7f3c0ee91640 1 --2- 172.21.15.146:0/2906960010 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c39c82d020 0x55c39c82d420 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3c0804c890 tx=0x7f3c08001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=678f150c2722ebf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.068+0000 7f3af1ffb640 1 -- 172.21.15.146:0/2906960010 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c08027040 con 0x55c39c82d020 2024-09-18T01:45:25.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.068+0000 7f3af1ffb640 1 -- 172.21.15.146:0/2906960010 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c08012cc0 con 0x55c39c82d020 2024-09-18T01:45:25.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.068+0000 7f3af1ffb640 1 -- 172.21.15.146:0/2906960010 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c0804b250 con 0x55c39c82d020 2024-09-18T01:45:25.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.069+0000 7f3c1293f800 1 -- 172.21.15.146:0/2906960010 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c39c82d020 msgr2=0x55c39c82d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.069+0000 7f3c1293f800 1 --2- 172.21.15.146:0/2906960010 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c39c82d020 0x55c39c82d420 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3c0804c890 tx=0x7f3c08001940 comp rx=0 tx=0).stop 2024-09-18T01:45:25.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.069+0000 7f3c1293f800 1 -- 172.21.15.146:0/2906960010 shutdown_connections 2024-09-18T01:45:25.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.069+0000 7f3c1293f800 1 --2- 172.21.15.146:0/2906960010 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c39c82d020 0x55c39c82d420 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.069+0000 7f3c1293f800 1 -- 172.21.15.146:0/2906960010 >> 172.21.15.146:0/2906960010 conn(0x55c39c829380 msgr2=0x55c39c8274d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:25.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.069+0000 7f3c1293f800 1 -- 172.21.15.146:0/2906960010 shutdown_connections 2024-09-18T01:45:25.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.069+0000 7f3c1293f800 1 -- 172.21.15.146:0/2906960010 wait complete. 2024-09-18T01:45:25.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.069+0000 7f3c1293f800 1 Processor -- start 2024-09-18T01:45:25.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.069+0000 7f3c1293f800 1 -- start start 2024-09-18T01:45:25.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.069+0000 7f3c1293f800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c39c82d020 0x55c39c834360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.069+0000 7f3c1293f800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55c39c82de40 con 0x55c39c82d020 2024-09-18T01:45:25.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.069+0000 7f3c0ee91640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c39c82d020 0x55c39c834360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.069+0000 7f3c0ee91640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c39c82d020 0x55c39c834360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60292/0 (socket says 172.21.15.146:60292) 2024-09-18T01:45:25.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.069+0000 7f3c0ee91640 1 -- 172.21.15.146:0/3071964799 learned_addr learned my addr 172.21.15.146:0/3071964799 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:25.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.069+0000 7f3c0ee91640 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c39c8348a0 con 0x55c39c82d020 2024-09-18T01:45:25.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.070+0000 7f3c0ee91640 1 --2- 172.21.15.146:0/3071964799 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c39c82d020 0x55c39c834360 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3c08001bc0 tx=0x7f3c0804c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.070+0000 7f3adffff640 1 -- 172.21.15.146:0/3071964799 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c08027070 con 0x55c39c82d020 2024-09-18T01:45:25.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.070+0000 7f3adffff640 1 -- 172.21.15.146:0/3071964799 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c0802aa60 con 0x55c39c82d020 2024-09-18T01:45:25.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.070+0000 7f3c1293f800 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c39c834b30 con 0x55c39c82d020 2024-09-18T01:45:25.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.070+0000 7f3adffff640 1 -- 172.21.15.146:0/3071964799 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c0802ad80 con 0x55c39c82d020 2024-09-18T01:45:25.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.070+0000 7f3c1293f800 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c39c8377e0 con 0x55c39c82d020 2024-09-18T01:45:25.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.070+0000 7f3adffff640 1 -- 172.21.15.146:0/3071964799 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3c08021a50 con 0x55c39c82d020 2024-09-18T01:45:25.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.071+0000 7f3adffff640 1 --2- 172.21.15.146:0/3071964799 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f3ad8036b40 0x7f3ad8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.071+0000 7f3adffff640 1 -- 172.21.15.146:0/3071964799 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f3c08033070 con 0x55c39c82d020 2024-09-18T01:45:25.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.071+0000 7f3c0e690640 1 --2- 172.21.15.146:0/3071964799 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f3ad8036b40 0x7f3ad8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.071+0000 7f3c0e690640 1 --2- 172.21.15.146:0/3071964799 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f3ad8036b40 0x7f3ad8039000 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3c0004bfd0 tx=0x7f3c00042000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.071+0000 7f3c1293f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.071+0000 7f3c1293f800 1 --2- 172.21.15.146:0/3071964799 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55c39c840020 0x55c39c8424e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.072+0000 7f3c1293f800 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c39c842c30 con 0x55c39c840020 2024-09-18T01:45:25.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.072+0000 7f3c0de8f640 1 --2- 172.21.15.146:0/3071964799 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55c39c840020 0x55c39c8424e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.072+0000 7f3c0de8f640 1 --2- 172.21.15.146:0/3071964799 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55c39c840020 0x55c39c8424e0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.072+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c04057030 con 0x55c39c840020 2024-09-18T01:45:25.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.072+0000 7f3c1293f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:25.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.072+0000 7f3c1293f800 20 realm 2024-09-18T01:45:25.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.072+0000 7f3c1293f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.072+0000 7f3c1293f800 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c39c843060 con 0x55c39c840020 2024-09-18T01:45:25.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.072+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c04057030 con 0x55c39c840020 2024-09-18T01:45:25.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.072+0000 7f3c1293f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:25.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.072+0000 7f3c1293f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:25.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.072+0000 7f3c1293f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.072+0000 7f3c1293f800 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c39c843930 con 0x55c39c840020 2024-09-18T01:45:25.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.073+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c04057030 con 0x55c39c840020 2024-09-18T01:45:25.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.073+0000 7f3c1293f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:25.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.073+0000 7f3c1293f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.073+0000 7f3c1293f800 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c39c843cd0 con 0x55c39c840020 2024-09-18T01:45:25.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.073+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3c04057030 con 0x55c39c840020 2024-09-18T01:45:25.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.073+0000 7f3c1293f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:25.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.073+0000 7f3c1293f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.073+0000 7f3c1293f800 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c39c844520 con 0x55c39c840020 2024-09-18T01:45:25.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.073+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3c04057030 con 0x55c39c840020 2024-09-18T01:45:25.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.073+0000 7f3c1293f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:25.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.073+0000 7f3c1293f800 20 searching for the correct realm 2024-09-18T01:45:25.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.073+0000 7f3c1293f800 1 --2- 172.21.15.146:0/3071964799 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55c39c846290 0x55c39c848680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.073+0000 7f3c1293f800 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c39c848c90 con 0x55c39c846290 2024-09-18T01:45:25.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.073+0000 7f3c0ee91640 1 --2- 172.21.15.146:0/3071964799 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55c39c846290 0x55c39c848680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.074+0000 7f3c0ee91640 1 --2- 172.21.15.146:0/3071964799 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55c39c846290 0x55c39c848680 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.074+0000 7f3c0ee91640 1 -- 172.21.15.146:0/3071964799 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c08057040 con 0x55c39c846290 2024-09-18T01:45:25.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.074+0000 7f3c0ee91640 1 --2- 172.21.15.146:0/3071964799 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f3c080123a0 0x7f3c080168c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.074+0000 7f3c0ee91640 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c39c848c90 con 0x7f3c080123a0 2024-09-18T01:45:25.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.074+0000 7f3c0e690640 1 --2- 172.21.15.146:0/3071964799 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f3c080123a0 0x7f3c080168c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.074+0000 7f3c0e690640 1 --2- 172.21.15.146:0/3071964799 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f3c080123a0 0x7f3c080168c0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.074+0000 7f3c0e690640 1 -- 172.21.15.146:0/3071964799 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c0002e070 con 0x7f3c080123a0 2024-09-18T01:45:25.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.074+0000 7f3c0e690640 1 --2- 172.21.15.146:0/3071964799 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f3c0000f070 0x7f3c00019860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.074+0000 7f3c0e690640 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c39c848c90 con 0x7f3c0000f070 2024-09-18T01:45:25.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.075+0000 7f3c0de8f640 1 --2- 172.21.15.146:0/3071964799 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f3c0000f070 0x7f3c00019860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.075+0000 7f3c0de8f640 1 --2- 172.21.15.146:0/3071964799 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f3c0000f070 0x7f3c00019860 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.075+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c04057030 con 0x7f3c0000f070 2024-09-18T01:45:25.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.075+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c39c848c90 con 0x55c39c840020 2024-09-18T01:45:25.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.075+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3c04057030 con 0x55c39c840020 2024-09-18T01:45:25.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.075+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c39c848c90 con 0x55c39c840020 2024-09-18T01:45:25.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.076+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c04057030 con 0x55c39c840020 2024-09-18T01:45:25.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.076+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c39c848c90 con 0x7f3c0000f070 2024-09-18T01:45:25.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.076+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c04057030 con 0x7f3c0000f070 2024-09-18T01:45:25.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.076+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c39c848c90 con 0x7f3c0000f070 2024-09-18T01:45:25.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.076+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c04057030 con 0x7f3c0000f070 2024-09-18T01:45:25.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.076+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c39c848c90 con 0x7f3c080123a0 2024-09-18T01:45:25.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.076+0000 7f3c0e690640 1 -- 172.21.15.146:0/3071964799 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c0002e070 con 0x7f3c080123a0 2024-09-18T01:45:25.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.076+0000 7f3c0e690640 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c39c848c90 con 0x55c39c846290 2024-09-18T01:45:25.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.077+0000 7f3c0ee91640 1 -- 172.21.15.146:0/3071964799 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c08057040 con 0x55c39c846290 2024-09-18T01:45:25.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.077+0000 7f3c0ee91640 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c39c848c90 con 0x55c39c840020 2024-09-18T01:45:25.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.077+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c04057030 con 0x55c39c840020 2024-09-18T01:45:25.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.077+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c39c848c90 con 0x7f3c0000f070 2024-09-18T01:45:25.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.077+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c04057030 con 0x7f3c0000f070 2024-09-18T01:45:25.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.077+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c39c848c90 con 0x55c39c840020 2024-09-18T01:45:25.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.077+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c04057030 con 0x55c39c840020 2024-09-18T01:45:25.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.077+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c39c848c90 con 0x7f3c080123a0 2024-09-18T01:45:25.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.078+0000 7f3c0e690640 1 -- 172.21.15.146:0/3071964799 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f3c0002e070 con 0x7f3c080123a0 2024-09-18T01:45:25.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.078+0000 7f3c0e690640 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c39c848c90 con 0x55c39c846290 2024-09-18T01:45:25.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.078+0000 7f3c0ee91640 1 -- 172.21.15.146:0/3071964799 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c08057040 con 0x55c39c846290 2024-09-18T01:45:25.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.078+0000 7f3c0ee91640 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c39c848c90 con 0x55c39c846290 2024-09-18T01:45:25.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.078+0000 7f3c0ee91640 1 -- 172.21.15.146:0/3071964799 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c08057040 con 0x55c39c846290 2024-09-18T01:45:25.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.078+0000 7f3c0ee91640 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c39c848c90 con 0x7f3c0000f070 2024-09-18T01:45:25.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.078+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c04057030 con 0x7f3c0000f070 2024-09-18T01:45:25.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.078+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c39c848c90 con 0x55c39c846290 2024-09-18T01:45:25.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.078+0000 7f3c0ee91640 1 -- 172.21.15.146:0/3071964799 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c08057040 con 0x55c39c846290 2024-09-18T01:45:25.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.078+0000 7f3c0ee91640 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c39c848c90 con 0x55c39c846290 2024-09-18T01:45:25.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.079+0000 7f3c0ee91640 1 -- 172.21.15.146:0/3071964799 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c08057040 con 0x55c39c846290 2024-09-18T01:45:25.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.079+0000 7f3c0ee91640 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c39c848c90 con 0x55c39c840020 2024-09-18T01:45:25.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.079+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c04057030 con 0x55c39c840020 2024-09-18T01:45:25.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.079+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c39c848c90 con 0x55c39c840020 2024-09-18T01:45:25.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.079+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3c04057030 con 0x55c39c840020 2024-09-18T01:45:25.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.079+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c39c848c90 con 0x7f3c0000f070 2024-09-18T01:45:25.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.079+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c04057030 con 0x7f3c0000f070 2024-09-18T01:45:25.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.079+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c39c848c90 con 0x55c39c846290 2024-09-18T01:45:25.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.079+0000 7f3c0ee91640 1 -- 172.21.15.146:0/3071964799 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c08057040 con 0x55c39c846290 2024-09-18T01:45:25.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.079+0000 7f3c0ee91640 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c39c848c90 con 0x7f3c080123a0 2024-09-18T01:45:25.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.080+0000 7f3c0e690640 1 -- 172.21.15.146:0/3071964799 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c0002e070 con 0x7f3c080123a0 2024-09-18T01:45:25.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.080+0000 7f3c0e690640 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c39c848c90 con 0x55c39c840020 2024-09-18T01:45:25.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.080+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c04057030 con 0x55c39c840020 2024-09-18T01:45:25.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.080+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c39c848c90 con 0x7f3c0000f070 2024-09-18T01:45:25.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.080+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c04057030 con 0x7f3c0000f070 2024-09-18T01:45:25.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.080+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c39c848c90 con 0x55c39c846290 2024-09-18T01:45:25.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.080+0000 7f3c0ee91640 1 -- 172.21.15.146:0/3071964799 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c08057040 con 0x55c39c846290 2024-09-18T01:45:25.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.080+0000 7f3c0ee91640 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c39c848c90 con 0x7f3c0000f070 2024-09-18T01:45:25.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.081+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c04057030 con 0x7f3c0000f070 2024-09-18T01:45:25.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.081+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c39c848c90 con 0x7f3c080123a0 2024-09-18T01:45:25.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.081+0000 7f3c0e690640 1 -- 172.21.15.146:0/3071964799 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c0002e070 con 0x7f3c080123a0 2024-09-18T01:45:25.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.081+0000 7f3c0e690640 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c39c848c90 con 0x55c39c846290 2024-09-18T01:45:25.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.081+0000 7f3c0ee91640 1 -- 172.21.15.146:0/3071964799 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c08057040 con 0x55c39c846290 2024-09-18T01:45:25.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.081+0000 7f3c0ee91640 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c39c848c90 con 0x7f3c0000f070 2024-09-18T01:45:25.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.081+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c04057030 con 0x7f3c0000f070 2024-09-18T01:45:25.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.081+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c39c848c90 con 0x55c39c840020 2024-09-18T01:45:25.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.082+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3c04057030 con 0x55c39c840020 2024-09-18T01:45:25.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.082+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c39c848c90 con 0x7f3c080123a0 2024-09-18T01:45:25.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.082+0000 7f3c0e690640 1 -- 172.21.15.146:0/3071964799 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c0005f040 con 0x7f3c080123a0 2024-09-18T01:45:25.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.082+0000 7f3c1293f800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:25.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.082+0000 7f3c1293f800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:25.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.082+0000 7f3c1293f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:25.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.082+0000 7f3c1293f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:25.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.082+0000 7f3c1293f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:25.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.082+0000 7f3c1293f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:25.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.082+0000 7f3c1293f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.082+0000 7f3c1293f800 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c39c844ed0 con 0x55c39c840020 2024-09-18T01:45:25.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.082+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c04057030 con 0x55c39c840020 2024-09-18T01:45:25.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.082+0000 7f3c1293f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:25.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.082+0000 7f3c1293f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.082+0000 7f3c1293f800 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c39c845770 con 0x55c39c840020 2024-09-18T01:45:25.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.083+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3c04057030 con 0x55c39c840020 2024-09-18T01:45:25.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.083+0000 7f3c1293f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:25.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.083+0000 7f3c1293f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.083+0000 7f3c1293f800 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c39c849110 con 0x7f3c080123a0 2024-09-18T01:45:25.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.083+0000 7f3c0e690640 1 -- 172.21.15.146:0/3071964799 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3c0005f040 con 0x7f3c080123a0 2024-09-18T01:45:25.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.083+0000 7f3c1293f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:25.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.083+0000 7f3c1293f800 20 zone default found 2024-09-18T01:45:25.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.083+0000 7f3c1293f800 4 Realm: () 2024-09-18T01:45:25.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.083+0000 7f3c1293f800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:25.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.083+0000 7f3c1293f800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:25.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.083+0000 7f3c1293f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:25.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.083+0000 7f3c1293f800 20 zonegroup default 2024-09-18T01:45:25.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.083+0000 7f3c1293f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.083+0000 7f3c1293f800 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c39c849960 con 0x7f3c0000f070 2024-09-18T01:45:25.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.083+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3c04057030 con 0x7f3c0000f070 2024-09-18T01:45:25.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.083+0000 7f3c1293f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:25.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.083+0000 7f3c1293f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.083+0000 7f3c1293f800 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c39c84b340 con 0x55c39c846290 2024-09-18T01:45:25.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.083+0000 7f3c0ee91640 1 -- 172.21.15.146:0/3071964799 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3c08057040 con 0x55c39c846290 2024-09-18T01:45:25.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.084+0000 7f3c1293f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:25.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.084+0000 7f3c1293f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.084+0000 7f3c1293f800 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c39c84b830 con 0x55c39c846290 2024-09-18T01:45:25.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.084+0000 7f3c0ee91640 1 -- 172.21.15.146:0/3071964799 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3c08057040 con 0x55c39c846290 2024-09-18T01:45:25.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.084+0000 7f3c1293f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:25.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.084+0000 7f3c1293f800 20 started sync module instance, tier type = 2024-09-18T01:45:25.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.084+0000 7f3c1293f800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:25.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.084+0000 7f3c1293f800 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c39c84a7d0 con 0x7f3c080123a0 2024-09-18T01:45:25.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.085+0000 7f3c0e690640 1 -- 172.21.15.146:0/3071964799 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v31'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c0005f040 con 0x7f3c080123a0 2024-09-18T01:45:25.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.085+0000 7f3c1293f800 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94298632924096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c39c84c140 con 0x7f3c080123a0 2024-09-18T01:45:25.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.085+0000 7f3c1293f800 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c39c84c990 con 0x55c39c840020 2024-09-18T01:45:25.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.086+0000 7f3c0e690640 1 -- 172.21.15.146:0/3071964799 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94298632924096] v31'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c0005f040 con 0x7f3c080123a0 2024-09-18T01:45:25.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.086+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v31'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c04057030 con 0x55c39c840020 2024-09-18T01:45:25.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.086+0000 7f3c1293f800 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94298632928400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c39c84c9d0 con 0x55c39c840020 2024-09-18T01:45:25.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.086+0000 7f3c1293f800 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c39c84d4d0 con 0x55c39c846290 2024-09-18T01:45:25.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.087+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94298632928400] v31'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c04057030 con 0x55c39c840020 2024-09-18T01:45:25.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.087+0000 7f3c0ee91640 1 -- 172.21.15.146:0/3071964799 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v31'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c08057040 con 0x55c39c846290 2024-09-18T01:45:25.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.087+0000 7f3c1293f800 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94298632933312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c39c84d490 con 0x55c39c846290 2024-09-18T01:45:25.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.087+0000 7f3c1293f800 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c39c84df40 con 0x7f3c080123a0 2024-09-18T01:45:25.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.088+0000 7f3c0ee91640 1 -- 172.21.15.146:0/3071964799 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94298632933312] v31'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c08057040 con 0x55c39c846290 2024-09-18T01:45:25.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.088+0000 7f3c0e690640 1 -- 172.21.15.146:0/3071964799 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v31'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c0005f040 con 0x7f3c080123a0 2024-09-18T01:45:25.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.088+0000 7f3c1293f800 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94298632936080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c39c84e360 con 0x7f3c080123a0 2024-09-18T01:45:25.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.088+0000 7f3c1293f800 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c39c84eda0 con 0x55c39c840020 2024-09-18T01:45:25.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.089+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v31'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c04057030 con 0x55c39c840020 2024-09-18T01:45:25.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.089+0000 7f3c1293f800 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94298632939632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c39c84f640 con 0x55c39c840020 2024-09-18T01:45:25.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.089+0000 7f3c1293f800 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c39c850120 con 0x7f3c0000f070 2024-09-18T01:45:25.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.090+0000 7f3c0e690640 1 -- 172.21.15.146:0/3071964799 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94298632936080] v31'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c0005f040 con 0x7f3c080123a0 2024-09-18T01:45:25.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.090+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94298632939632] v31'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c04057030 con 0x55c39c840020 2024-09-18T01:45:25.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.090+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v31'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c04057030 con 0x7f3c0000f070 2024-09-18T01:45:25.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.090+0000 7f3c1293f800 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94298632930528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c39c84f140 con 0x7f3c0000f070 2024-09-18T01:45:25.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.090+0000 7f3c1293f800 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c39c8509f0 con 0x7f3c0000f070 2024-09-18T01:45:25.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.091+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(56 notify.6 [create] v31'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c04057030 con 0x7f3c0000f070 2024-09-18T01:45:25.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.091+0000 7f3c1293f800 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94298632947008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c39c84f140 con 0x7f3c0000f070 2024-09-18T01:45:25.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.091+0000 7f3c1293f800 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c39c851540 con 0x7f3c0000f070 2024-09-18T01:45:25.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.093+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94298632930528] v31'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c04057030 con 0x7f3c0000f070 2024-09-18T01:45:25.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.093+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(58 notify.7 [create] v31'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c04057030 con 0x7f3c0000f070 2024-09-18T01:45:25.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.093+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94298632947008] v31'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c04057030 con 0x7f3c0000f070 2024-09-18T01:45:25.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.093+0000 7f3c1293f800 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94298632949808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c39c851500 con 0x7f3c0000f070 2024-09-18T01:45:25.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.093+0000 7f3c1293f800 20 add_watcher() i=0 2024-09-18T01:45:25.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.093+0000 7f3c1293f800 20 add_watcher() i=1 2024-09-18T01:45:25.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.093+0000 7f3c1293f800 20 add_watcher() i=2 2024-09-18T01:45:25.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.093+0000 7f3c1293f800 20 add_watcher() i=3 2024-09-18T01:45:25.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.093+0000 7f3c1293f800 20 add_watcher() i=4 2024-09-18T01:45:25.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.093+0000 7f3c1293f800 20 add_watcher() i=5 2024-09-18T01:45:25.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.093+0000 7f3c1293f800 20 add_watcher() i=6 2024-09-18T01:45:25.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.094+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94298632949808] v31'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c04057030 con 0x7f3c0000f070 2024-09-18T01:45:25.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.094+0000 7f3c1293f800 20 add_watcher() i=7 2024-09-18T01:45:25.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.094+0000 7f3c1293f800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:25.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.094+0000 7f3c1293f800 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c39c854530 con 0x55c39c840020 2024-09-18T01:45:25.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.094+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3c04057030 con 0x55c39c840020 2024-09-18T01:45:25.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.094+0000 7f3c1293f800 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94298632944688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c39c8519b0 con 0x55c39c840020 2024-09-18T01:45:25.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.095+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94298632944688] v31'88 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3c04057030 con 0x55c39c840020 2024-09-18T01:45:25.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.096+0000 7f3ac4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:25.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.096+0000 7f3c1293f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:25.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.096+0000 7f3c1293f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:25.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.096+0000 7f3c1293f800 5 note: GC not initialized 2024-09-18T01:45:25.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.096+0000 7f3a3f7fe640 20 reqs_thread_entry: start 2024-09-18T01:45:25.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.096+0000 7f3c1293f800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:25.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.096+0000 7f3c1293f800 20 Filter name: none 2024-09-18T01:45:25.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.096+0000 7f3a3d7fa640 20 reqs_thread_entry: start 2024-09-18T01:45:25.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.096+0000 7f3c1293f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T01:45:25.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.096+0000 7f3c1293f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.096+0000 7f3c1293f800 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c39c887790 con 0x55c39c840020 2024-09-18T01:45:25.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.097+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f3c04057030 con 0x55c39c840020 2024-09-18T01:45:25.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.097+0000 7f3c1293f800 20 rados_obj.operate() r=0 bl.length=673 2024-09-18T01:45:25.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.097+0000 7f3c1293f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T01:45:25.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.097+0000 7f3c1293f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:45:25.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.097+0000 7f3c1293f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:45:25.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.097+0000 7f3c1293f800 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c39c88e430 con 0x55c39c840020 2024-09-18T01:45:25.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.098+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~582] v31'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f3c04057030 con 0x55c39c840020 2024-09-18T01:45:25.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.098+0000 7f3c1293f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:45:25.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.098+0000 7f3c1293f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:45:25.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.098+0000 7f3c1293f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-18T01:45:25.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.098+0000 7f3c1293f800 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94298633199088 in=770b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c39c889ad0 con 0x55c39c840020 2024-09-18T01:45:25.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.098+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== watch-notify(notify (1) cookie 94298632939632 notify 133143986184 ret 0) ==== 800+0+0 (crc 0 0 0) 0x55c39c5d3e00 con 0x55c39c840020 2024-09-18T01:45:25.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.098+0000 7f3af1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986184 cookie 94298632939632 notifier 4411 bl.length()=758 2024-09-18T01:45:25.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.098+0000 7f3af1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:45:25.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.098+0000 7f3af1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:45:25.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.098+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(64 notify.4 [notify cookie 94298633199088 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3c04087020 con 0x55c39c840020 2024-09-18T01:45:25.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.098+0000 7f3af1ffb640 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f3ad4003ea0 con 0x55c39c840020 2024-09-18T01:45:25.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.098+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c04087020 con 0x55c39c840020 2024-09-18T01:45:25.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.099+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== watch-notify(notify_complete (2) cookie 94298633199088 notify 133143986184 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f3c0405b460 con 0x55c39c840020 2024-09-18T01:45:25.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.099+0000 7f3c1293f800 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:66 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c39c88ddf0 con 0x55c39c840020 2024-09-18T01:45:25.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.099+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 <== osd.1 v2:172.21.15.146:6808/3930274777 28 ==== osd_op_reply(66 foo:foo1 [delete] v31'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c04087020 con 0x55c39c840020 2024-09-18T01:45:25.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.099+0000 7f3c1293f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-18T01:45:25.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.099+0000 7f3c1293f800 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94298633199088 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c39c889620 con 0x7f3c080123a0 2024-09-18T01:45:25.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.100+0000 7f3c0e690640 1 -- 172.21.15.146:0/3071964799 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== watch-notify(notify (1) cookie 94298632924096 notify 133143986180 ret 0) ==== 201+0+0 (crc 0 0 0) 0x55c39c70b740 con 0x7f3c080123a0 2024-09-18T01:45:25.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.100+0000 7f3af1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986180 cookie 94298632924096 notifier 4411 bl.length()=159 2024-09-18T01:45:25.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.100+0000 7f3af1ffb640 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f3ad4003ea0 con 0x7f3c080123a0 2024-09-18T01:45:25.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.100+0000 7f3c0e690640 1 -- 172.21.15.146:0/3071964799 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(67 notify.0 [notify cookie 94298633199088 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3c0005f040 con 0x7f3c080123a0 2024-09-18T01:45:25.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.100+0000 7f3c0e690640 1 -- 172.21.15.146:0/3071964799 <== osd.2 v2:172.21.15.146:6800/3820039304 14 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c0005f040 con 0x7f3c080123a0 2024-09-18T01:45:25.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.100+0000 7f3c0e690640 1 -- 172.21.15.146:0/3071964799 <== osd.2 v2:172.21.15.146:6800/3820039304 15 ==== watch-notify(notify_complete (2) cookie 94298633199088 notify 133143986180 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c39c70b220 con 0x7f3c080123a0 2024-09-18T01:45:25.113 INFO:teuthology.orchestra.run.smithi146.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T01:45:23.010714Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-18T01:45:24.841201Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:45:23.010705Z","tags":[],"group_ids":[]} 2024-09-18T01:45:25.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.101+0000 7f3ac4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:25.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.101+0000 7f3c1293f800 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94298632944688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c39c8854e0 con 0x55c39c840020 2024-09-18T01:45:25.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.102+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 <== osd.1 v2:172.21.15.146:6808/3930274777 29 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94298632944688] v31'89 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3c04087020 con 0x55c39c840020 2024-09-18T01:45:25.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.102+0000 7f3c1293f800 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94298632924096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c39c8854e0 con 0x7f3c080123a0 2024-09-18T01:45:25.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.103+0000 7f3c0e690640 1 -- 172.21.15.146:0/3071964799 <== osd.2 v2:172.21.15.146:6800/3820039304 16 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94298632924096] v31'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c0005f040 con 0x7f3c080123a0 2024-09-18T01:45:25.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.103+0000 7f3c1293f800 20 remove_watcher() i=0 2024-09-18T01:45:25.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.103+0000 7f3c1293f800 2 removed watcher, disabling cache 2024-09-18T01:45:25.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.103+0000 7f3c1293f800 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94298632928400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c39c8854e0 con 0x55c39c840020 2024-09-18T01:45:25.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.104+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 <== osd.1 v2:172.21.15.146:6808/3930274777 30 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94298632928400] v31'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c04087020 con 0x55c39c840020 2024-09-18T01:45:25.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.104+0000 7f3c1293f800 20 remove_watcher() i=1 2024-09-18T01:45:25.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.104+0000 7f3c1293f800 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94298632933312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c39c8854e0 con 0x55c39c846290 2024-09-18T01:45:25.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.105+0000 7f3c0ee91640 1 -- 172.21.15.146:0/3071964799 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94298632933312] v31'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c08057040 con 0x55c39c846290 2024-09-18T01:45:25.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.105+0000 7f3c1293f800 20 remove_watcher() i=2 2024-09-18T01:45:25.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.105+0000 7f3c1293f800 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94298632936080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c39c8854e0 con 0x7f3c080123a0 2024-09-18T01:45:25.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.106+0000 7f3c0e690640 1 -- 172.21.15.146:0/3071964799 <== osd.2 v2:172.21.15.146:6800/3820039304 17 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94298632936080] v31'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c0005f040 con 0x7f3c080123a0 2024-09-18T01:45:25.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.106+0000 7f3c1293f800 20 remove_watcher() i=3 2024-09-18T01:45:25.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.106+0000 7f3c1293f800 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94298632939632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c39c8854e0 con 0x55c39c840020 2024-09-18T01:45:25.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.107+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 <== osd.1 v2:172.21.15.146:6808/3930274777 31 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94298632939632] v31'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c04087020 con 0x55c39c840020 2024-09-18T01:45:25.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.107+0000 7f3c1293f800 20 remove_watcher() i=4 2024-09-18T01:45:25.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.107+0000 7f3c1293f800 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94298632930528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c39c8854e0 con 0x7f3c0000f070 2024-09-18T01:45:25.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.108+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94298632930528] v31'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c04087020 con 0x7f3c0000f070 2024-09-18T01:45:25.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.108+0000 7f3c1293f800 20 remove_watcher() i=5 2024-09-18T01:45:25.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.108+0000 7f3c1293f800 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94298632947008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c39c8854e0 con 0x7f3c0000f070 2024-09-18T01:45:25.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.109+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94298632947008] v31'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c04087020 con 0x7f3c0000f070 2024-09-18T01:45:25.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.109+0000 7f3c1293f800 20 remove_watcher() i=6 2024-09-18T01:45:25.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.109+0000 7f3c1293f800 1 -- 172.21.15.146:0/3071964799 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94298632949808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c39c8854e0 con 0x7f3c0000f070 2024-09-18T01:45:25.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.110+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94298632949808] v31'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c04087020 con 0x7f3c0000f070 2024-09-18T01:45:25.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.110+0000 7f3c1293f800 20 remove_watcher() i=7 2024-09-18T01:45:25.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.110+0000 7f3c1293f800 1 -- 172.21.15.146:0/3071964799 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f3c0000f070 msgr2=0x7f3c00019860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.110+0000 7f3c1293f800 1 --2- 172.21.15.146:0/3071964799 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f3c0000f070 0x7f3c00019860 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.110+0000 7f3c1293f800 1 -- 172.21.15.146:0/3071964799 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55c39c840020 msgr2=0x55c39c8424e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.110+0000 7f3c1293f800 1 --2- 172.21.15.146:0/3071964799 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55c39c840020 0x55c39c8424e0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.110+0000 7f3c1293f800 1 -- 172.21.15.146:0/3071964799 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f3c080123a0 msgr2=0x7f3c080168c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.110+0000 7f3c1293f800 1 --2- 172.21.15.146:0/3071964799 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f3c080123a0 0x7f3c080168c0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.110+0000 7f3c1293f800 1 -- 172.21.15.146:0/3071964799 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55c39c846290 msgr2=0x55c39c848680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.110+0000 7f3c1293f800 1 --2- 172.21.15.146:0/3071964799 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55c39c846290 0x55c39c848680 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.110+0000 7f3c1293f800 1 -- 172.21.15.146:0/3071964799 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f3ad8036b40 msgr2=0x7f3ad8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.110+0000 7f3c1293f800 1 --2- 172.21.15.146:0/3071964799 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f3ad8036b40 0x7f3ad8039000 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3c0004bfd0 tx=0x7f3c00042000 comp rx=0 tx=0).stop 2024-09-18T01:45:25.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.110+0000 7f3c1293f800 1 -- 172.21.15.146:0/3071964799 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c39c82d020 msgr2=0x55c39c834360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.110+0000 7f3c1293f800 1 --2- 172.21.15.146:0/3071964799 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c39c82d020 0x55c39c834360 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3c08001bc0 tx=0x7f3c0804c820 comp rx=0 tx=0).stop 2024-09-18T01:45:25.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.110+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 reap_dead start 2024-09-18T01:45:25.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.110+0000 7f3c0de8f640 1 -- 172.21.15.146:0/3071964799 reap_dead start 2024-09-18T01:45:25.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.110+0000 7f3c1293f800 1 -- 172.21.15.146:0/3071964799 shutdown_connections 2024-09-18T01:45:25.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.110+0000 7f3c1293f800 1 -- 172.21.15.146:0/3071964799 >> 172.21.15.146:0/3071964799 conn(0x55c39c829380 msgr2=0x55c39c827440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:25.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.110+0000 7f3c1293f800 1 -- 172.21.15.146:0/3071964799 shutdown_connections 2024-09-18T01:45:25.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.110+0000 7f3c1293f800 1 -- 172.21.15.146:0/3071964799 wait complete. 2024-09-18T01:45:25.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.111+0000 7f3c1293f800 1 -- 172.21.15.146:0/83352993 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f3ae8036b90 msgr2=0x7f3ae8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.111+0000 7f3c1293f800 1 --2- 172.21.15.146:0/83352993 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f3ae8036b90 0x7f3ae8039050 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3c000176e0 tx=0x7f3c0004b740 comp rx=0 tx=0).stop 2024-09-18T01:45:25.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.111+0000 7f3c1293f800 1 -- 172.21.15.146:0/83352993 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c39c8203d0 msgr2=0x55c39c8207f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.111+0000 7f3c1293f800 1 --2- 172.21.15.146:0/83352993 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c39c8203d0 0x55c39c8207f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x55c39c70c870 tx=0x7f3c080178e0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.111+0000 7f3c1293f800 1 -- 172.21.15.146:0/83352993 shutdown_connections 2024-09-18T01:45:25.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.111+0000 7f3c1293f800 1 --2- 172.21.15.146:0/83352993 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f3ae8036b90 0x7f3ae8039050 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.111+0000 7f3c1293f800 1 --2- 172.21.15.146:0/83352993 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c39c8203d0 0x55c39c8207f0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.111+0000 7f3c1293f800 1 -- 172.21.15.146:0/83352993 >> 172.21.15.146:0/83352993 conn(0x55c39c815360 msgr2=0x55c39c817ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:25.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.111+0000 7f3c1293f800 1 -- 172.21.15.146:0/83352993 shutdown_connections 2024-09-18T01:45:25.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.111+0000 7f3c1293f800 1 -- 172.21.15.146:0/83352993 wait complete. 2024-09-18T01:45:25.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.111+0000 7f3c1293f800 1 -- 172.21.15.146:0/875445988 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55c39c710920 msgr2=0x55c39c80c670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.111+0000 7f3c1293f800 1 --2- 172.21.15.146:0/875445988 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55c39c710920 0x55c39c80c670 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.111+0000 7f3c1293f800 1 -- 172.21.15.146:0/875445988 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55c39c80fc00 msgr2=0x55c39c811ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.111+0000 7f3c1293f800 1 --2- 172.21.15.146:0/875445988 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55c39c80fc00 0x55c39c811ff0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.111+0000 7f3c1293f800 1 -- 172.21.15.146:0/875445988 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f3af4036b40 msgr2=0x7f3af4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.111+0000 7f3c1293f800 1 --2- 172.21.15.146:0/875445988 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f3af4036b40 0x7f3af4039000 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3c04057000 tx=0x7f3c04052000 comp rx=0 tx=0).stop 2024-09-18T01:45:25.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.111+0000 7f3c1293f800 1 -- 172.21.15.146:0/875445988 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c39c680630 msgr2=0x55c39c70cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.111+0000 7f3c1293f800 1 --2- 172.21.15.146:0/875445988 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c39c680630 0x55c39c70cb30 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3c00000c00 tx=0x7f3c00000ed0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.111+0000 7f3c1293f800 1 -- 172.21.15.146:0/875445988 shutdown_connections 2024-09-18T01:45:25.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.111+0000 7f3c1293f800 1 --2- 172.21.15.146:0/875445988 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55c39c80fc00 0x55c39c811ff0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.111+0000 7f3c1293f800 1 --2- 172.21.15.146:0/875445988 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55c39c710920 0x55c39c80c670 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.111+0000 7f3c1293f800 1 --2- 172.21.15.146:0/875445988 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f3af4036b40 0x7f3af4039000 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.111+0000 7f3c1293f800 1 --2- 172.21.15.146:0/875445988 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c39c680630 0x55c39c70cb30 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.111+0000 7f3c1293f800 1 -- 172.21.15.146:0/875445988 >> 172.21.15.146:0/875445988 conn(0x55c39c706db0 msgr2=0x55c39c7f5b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:25.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.111+0000 7f3c1293f800 1 -- 172.21.15.146:0/875445988 shutdown_connections 2024-09-18T01:45:25.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.111+0000 7f3c1293f800 1 -- 172.21.15.146:0/875445988 wait complete. 2024-09-18T01:45:25.125 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T01:45:23.010714Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-18T01:45:24.841201Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:45:23.010705Z', 'tags': [], 'group_ids': []} 2024-09-18T01:45:25.125 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-18T01:45:25.125 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-18T01:45:25.125 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo1 2024-09-18T01:45:25.170 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:25.170 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:25.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.170+0000 7fc735320800 1 Processor -- start 2024-09-18T01:45:25.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.170+0000 7fc735320800 1 -- start start 2024-09-18T01:45:25.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.170+0000 7fc735320800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x5636a15cf630 0x5636a165e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.170+0000 7fc735320800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5636a151ab30 con 0x5636a165e790 2024-09-18T01:45:25.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.170+0000 7fc735320800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x5636a14fc360 con 0x5636a15cf630 2024-09-18T01:45:25.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.170+0000 7fc731016640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x5636a15cf630 0x5636a165e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.170+0000 7fc731016640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x5636a15cf630 0x5636a165e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60306/0 (socket says 172.21.15.146:60306) 2024-09-18T01:45:25.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.170+0000 7fc72bfff640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x5636a165e790 0x5636a1660b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:38868/0 (socket says 172.21.15.146:38868) 2024-09-18T01:45:25.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.170+0000 7fc731016640 1 -- 172.21.15.146:0/2013603283 learned_addr learned my addr 172.21.15.146:0/2013603283 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:25.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.171+0000 7fc731016640 1 -- 172.21.15.146:0/2013603283 >> v1:172.21.15.129:6789/0 conn(0x5636a165e790 legacy=0x5636a1660b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.171+0000 7fc730815640 1 -- 172.21.15.146:0/2013603283 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3315746310 0 0) 0x5636a151ab30 con 0x5636a165e790 2024-09-18T01:45:25.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.171+0000 7fc731016640 1 -- 172.21.15.146:0/2013603283 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636a1522e00 con 0x5636a15cf630 2024-09-18T01:45:25.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.172+0000 7fc731016640 1 --2- 172.21.15.146:0/2013603283 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5636a15cf630 0x5636a165e250 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc72400a520 tx=0x7fc724045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb423c6da617b35 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.172+0000 7fc730815640 1 -- 172.21.15.146:0/2013603283 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc724055070 con 0x5636a15cf630 2024-09-18T01:45:25.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.172+0000 7fc730815640 1 -- 172.21.15.146:0/2013603283 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7240515b0 con 0x5636a15cf630 2024-09-18T01:45:25.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.173+0000 7fc730815640 1 -- 172.21.15.146:0/2013603283 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7240518d0 con 0x5636a15cf630 2024-09-18T01:45:25.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.173+0000 7fc735320800 1 -- 172.21.15.146:0/2013603283 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5636a15cf630 msgr2=0x5636a165e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.173+0000 7fc735320800 1 --2- 172.21.15.146:0/2013603283 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5636a15cf630 0x5636a165e250 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc72400a520 tx=0x7fc724045ba0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.173+0000 7fc735320800 1 -- 172.21.15.146:0/2013603283 shutdown_connections 2024-09-18T01:45:25.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.173+0000 7fc735320800 1 --2- 172.21.15.146:0/2013603283 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5636a15cf630 0x5636a165e250 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.173+0000 7fc735320800 1 -- 172.21.15.146:0/2013603283 >> 172.21.15.146:0/2013603283 conn(0x5636a1655de0 msgr2=0x5636a1658200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:25.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.173+0000 7fc735320800 1 -- 172.21.15.146:0/2013603283 shutdown_connections 2024-09-18T01:45:25.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.173+0000 7fc735320800 1 -- 172.21.15.146:0/2013603283 wait complete. 2024-09-18T01:45:25.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.187+0000 7fc735320800 1 Processor -- start 2024-09-18T01:45:25.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.187+0000 7fc735320800 1 -- start start 2024-09-18T01:45:25.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.187+0000 7fc735320800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5636a15cf630 0x5636a174a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.187+0000 7fc735320800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5636a15a7330 con 0x5636a15cf630 2024-09-18T01:45:25.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.187+0000 7fc731016640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5636a15cf630 0x5636a174a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.187+0000 7fc731016640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5636a15cf630 0x5636a174a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60322/0 (socket says 172.21.15.146:60322) 2024-09-18T01:45:25.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.187+0000 7fc731016640 1 -- 172.21.15.146:0/1864313132 learned_addr learned my addr 172.21.15.146:0/1864313132 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:25.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.188+0000 7fc731016640 1 -- 172.21.15.146:0/1864313132 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636a14f4bc0 con 0x5636a15cf630 2024-09-18T01:45:25.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.188+0000 7fc731016640 1 --2- 172.21.15.146:0/1864313132 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5636a15cf630 0x5636a174a640 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc724025da0 tx=0x7fc724051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ea8ecd40e06fd18 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.188+0000 7fc61f606640 1 -- 172.21.15.146:0/1864313132 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc724051ac0 con 0x5636a15cf630 2024-09-18T01:45:25.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.188+0000 7fc61f606640 1 -- 172.21.15.146:0/1864313132 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc724051c60 con 0x5636a15cf630 2024-09-18T01:45:25.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.188+0000 7fc61f606640 1 -- 172.21.15.146:0/1864313132 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc724066460 con 0x5636a15cf630 2024-09-18T01:45:25.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.189+0000 7fc735320800 1 -- 172.21.15.146:0/1864313132 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5636a15cf630 msgr2=0x5636a174a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.189+0000 7fc735320800 1 --2- 172.21.15.146:0/1864313132 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5636a15cf630 0x5636a174a640 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc724025da0 tx=0x7fc724051000 comp rx=0 tx=0).stop 2024-09-18T01:45:25.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.189+0000 7fc735320800 1 -- 172.21.15.146:0/1864313132 shutdown_connections 2024-09-18T01:45:25.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.189+0000 7fc735320800 1 --2- 172.21.15.146:0/1864313132 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5636a15cf630 0x5636a174a640 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.189+0000 7fc735320800 1 -- 172.21.15.146:0/1864313132 >> 172.21.15.146:0/1864313132 conn(0x5636a1655de0 msgr2=0x5636a1746000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:25.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.189+0000 7fc735320800 1 -- 172.21.15.146:0/1864313132 shutdown_connections 2024-09-18T01:45:25.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.189+0000 7fc735320800 1 -- 172.21.15.146:0/1864313132 wait complete. 2024-09-18T01:45:25.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.189+0000 7fc735320800 1 Processor -- start 2024-09-18T01:45:25.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.189+0000 7fc735320800 1 -- start start 2024-09-18T01:45:25.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.189+0000 7fc735320800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5636a15cf630 0x5636a1751ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.189+0000 7fc735320800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5636a1662690 con 0x5636a15cf630 2024-09-18T01:45:25.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.189+0000 7fc731016640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5636a15cf630 0x5636a1751ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.189+0000 7fc731016640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5636a15cf630 0x5636a1751ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60328/0 (socket says 172.21.15.146:60328) 2024-09-18T01:45:25.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.189+0000 7fc731016640 1 -- 172.21.15.146:0/2670738612 learned_addr learned my addr 172.21.15.146:0/2670738612 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:25.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.190+0000 7fc731016640 1 -- 172.21.15.146:0/2670738612 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636a1508fe0 con 0x5636a15cf630 2024-09-18T01:45:25.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.190+0000 7fc731016640 1 --2- 172.21.15.146:0/2670738612 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5636a15cf630 0x5636a1751ee0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc7240460a0 tx=0x7fc724003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.190+0000 7fc61de03640 1 -- 172.21.15.146:0/2670738612 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc724066650 con 0x5636a15cf630 2024-09-18T01:45:25.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.190+0000 7fc61de03640 1 -- 172.21.15.146:0/2670738612 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7240667f0 con 0x5636a15cf630 2024-09-18T01:45:25.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.190+0000 7fc735320800 1 -- 172.21.15.146:0/2670738612 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5636a1752420 con 0x5636a15cf630 2024-09-18T01:45:25.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.190+0000 7fc61de03640 1 -- 172.21.15.146:0/2670738612 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc724066af0 con 0x5636a15cf630 2024-09-18T01:45:25.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.190+0000 7fc735320800 1 -- 172.21.15.146:0/2670738612 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636a1752940 con 0x5636a15cf630 2024-09-18T01:45:25.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.191+0000 7fc61de03640 1 -- 172.21.15.146:0/2670738612 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc724079060 con 0x5636a15cf630 2024-09-18T01:45:25.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.191+0000 7fc61de03640 1 --2- 172.21.15.146:0/2670738612 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc618036b40 0x7fc618039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.191+0000 7fc61de03640 1 -- 172.21.15.146:0/2670738612 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fc724062070 con 0x5636a15cf630 2024-09-18T01:45:25.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.191+0000 7fc72bfff640 1 --2- 172.21.15.146:0/2670738612 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc618036b40 0x7fc618039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.191+0000 7fc735320800 1 --2- 172.21.15.146:0/2670738612 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5636a165e790 0x5636a1758f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.191+0000 7fc735320800 1 -- 172.21.15.146:0/2670738612 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5636a17594d0 con 0x5636a165e790 2024-09-18T01:45:25.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.191+0000 7fc731817640 1 --2- 172.21.15.146:0/2670738612 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5636a165e790 0x5636a1758f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.191+0000 7fc72bfff640 1 --2- 172.21.15.146:0/2670738612 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc618036b40 0x7fc618039000 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc71c000c00 tx=0x7fc71c0013b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.192+0000 7fc731817640 1 --2- 172.21.15.146:0/2670738612 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5636a165e790 0x5636a1758f50 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.192+0000 7fc731817640 1 -- 172.21.15.146:0/2670738612 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc72c00a4a0 con 0x5636a165e790 2024-09-18T01:45:25.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.192+0000 7fc735320800 1 -- 172.21.15.146:0/2670738612 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5636a1756500 con 0x5636a165e790 2024-09-18T01:45:25.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.192+0000 7fc731817640 1 -- 172.21.15.146:0/2670738612 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc72c00a4a0 con 0x5636a165e790 2024-09-18T01:45:25.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.192+0000 7fc735320800 1 -- 172.21.15.146:0/2670738612 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5636a175b2b0 con 0x5636a165e790 2024-09-18T01:45:25.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.192+0000 7fc731817640 1 -- 172.21.15.146:0/2670738612 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc72c00a4a0 con 0x5636a165e790 2024-09-18T01:45:25.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.192+0000 7fc735320800 1 -- 172.21.15.146:0/2670738612 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5636a175a3f0 con 0x5636a165e790 2024-09-18T01:45:25.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.193+0000 7fc731817640 1 -- 172.21.15.146:0/2670738612 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc72c00a4a0 con 0x5636a165e790 2024-09-18T01:45:25.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.193+0000 7fc735320800 1 --2- 172.21.15.146:0/2670738612 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5636a175ae90 0x5636a175e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.193+0000 7fc735320800 1 -- 172.21.15.146:0/2670738612 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5636a175ee80 con 0x5636a175ae90 2024-09-18T01:45:25.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.193+0000 7fc731016640 1 --2- 172.21.15.146:0/2670738612 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5636a175ae90 0x5636a175e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.193+0000 7fc731016640 1 --2- 172.21.15.146:0/2670738612 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5636a175ae90 0x5636a175e6f0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.193+0000 7fc731016640 1 -- 172.21.15.146:0/2670738612 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc724057030 con 0x5636a175ae90 2024-09-18T01:45:25.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.194+0000 7fc735320800 1 Processor -- start 2024-09-18T01:45:25.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.194+0000 7fc735320800 1 -- start start 2024-09-18T01:45:25.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.194+0000 7fc735320800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5636a165bc00 0x5636a165a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.194+0000 7fc735320800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5636a14f6580 con 0x5636a165bc00 2024-09-18T01:45:25.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.194+0000 7fc731817640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5636a165bc00 0x5636a165a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.194+0000 7fc731817640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5636a165bc00 0x5636a165a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60340/0 (socket says 172.21.15.146:60340) 2024-09-18T01:45:25.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.194+0000 7fc731817640 1 -- 172.21.15.146:0/2426095130 learned_addr learned my addr 172.21.15.146:0/2426095130 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:25.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.194+0000 7fc731817640 1 -- 172.21.15.146:0/2426095130 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636a165c020 con 0x5636a165bc00 2024-09-18T01:45:25.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.194+0000 7fc731817640 1 --2- 172.21.15.146:0/2426095130 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5636a165bc00 0x5636a165a250 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x5636a1759890 tx=0x7fc72c0178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.195+0000 7fc616ffd640 1 -- 172.21.15.146:0/2426095130 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc72c013440 con 0x5636a165bc00 2024-09-18T01:45:25.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.195+0000 7fc616ffd640 1 -- 172.21.15.146:0/2426095130 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc72c0135e0 con 0x5636a165bc00 2024-09-18T01:45:25.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.195+0000 7fc735320800 1 -- 172.21.15.146:0/2426095130 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5636a165a850 con 0x5636a165bc00 2024-09-18T01:45:25.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.195+0000 7fc616ffd640 1 -- 172.21.15.146:0/2426095130 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc72c0138c0 con 0x5636a165bc00 2024-09-18T01:45:25.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.195+0000 7fc735320800 1 -- 172.21.15.146:0/2426095130 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636a165ad50 con 0x5636a165bc00 2024-09-18T01:45:25.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.195+0000 7fc616ffd640 1 -- 172.21.15.146:0/2426095130 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc72c011040 con 0x5636a165bc00 2024-09-18T01:45:25.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.196+0000 7fc616ffd640 1 --2- 172.21.15.146:0/2426095130 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc608036b40 0x7fc608039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.196+0000 7fc616ffd640 1 -- 172.21.15.146:0/2426095130 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fc72c01d070 con 0x5636a165bc00 2024-09-18T01:45:25.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.196+0000 7fc731016640 1 --2- 172.21.15.146:0/2426095130 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc608036b40 0x7fc608039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.196+0000 7fc735320800 1 Processor -- start 2024-09-18T01:45:25.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.196+0000 7fc731016640 1 --2- 172.21.15.146:0/2426095130 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc608036b40 0x7fc608039000 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x5636a175a790 tx=0x7fc72408e6d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.196+0000 7fc735320800 1 -- start start 2024-09-18T01:45:25.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.196+0000 7fc735320800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5636a177baf0 0x5636a177bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.196+0000 7fc735320800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5636a174ad30 con 0x5636a177baf0 2024-09-18T01:45:25.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.196+0000 7fc731817640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5636a177baf0 0x5636a177bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.196+0000 7fc731817640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5636a177baf0 0x5636a177bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60356/0 (socket says 172.21.15.146:60356) 2024-09-18T01:45:25.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.196+0000 7fc731817640 1 -- 172.21.15.146:0/3963866324 learned_addr learned my addr 172.21.15.146:0/3963866324 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:25.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.197+0000 7fc731817640 1 -- 172.21.15.146:0/3963866324 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636a177c4c0 con 0x5636a177baf0 2024-09-18T01:45:25.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.197+0000 7fc731817640 1 --2- 172.21.15.146:0/3963866324 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5636a177baf0 0x5636a177bef0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc72c04cb30 tx=0x7fc72c012a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90d81df3f5cee4a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.197+0000 7fc614ff9640 1 -- 172.21.15.146:0/3963866324 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc72c045070 con 0x5636a177baf0 2024-09-18T01:45:25.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.197+0000 7fc614ff9640 1 -- 172.21.15.146:0/3963866324 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc72c015430 con 0x5636a177baf0 2024-09-18T01:45:25.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.197+0000 7fc614ff9640 1 -- 172.21.15.146:0/3963866324 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc72c02ac50 con 0x5636a177baf0 2024-09-18T01:45:25.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.197+0000 7fc735320800 1 -- 172.21.15.146:0/3963866324 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5636a177baf0 msgr2=0x5636a177bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.197+0000 7fc735320800 1 --2- 172.21.15.146:0/3963866324 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5636a177baf0 0x5636a177bef0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc72c04cb30 tx=0x7fc72c012a30 comp rx=0 tx=0).stop 2024-09-18T01:45:25.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.197+0000 7fc735320800 1 -- 172.21.15.146:0/3963866324 shutdown_connections 2024-09-18T01:45:25.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.197+0000 7fc735320800 1 --2- 172.21.15.146:0/3963866324 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5636a177baf0 0x5636a177bef0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.197+0000 7fc735320800 1 -- 172.21.15.146:0/3963866324 >> 172.21.15.146:0/3963866324 conn(0x5636a1777e50 msgr2=0x5636a1775f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:25.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.197+0000 7fc735320800 1 -- 172.21.15.146:0/3963866324 shutdown_connections 2024-09-18T01:45:25.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.197+0000 7fc735320800 1 -- 172.21.15.146:0/3963866324 wait complete. 2024-09-18T01:45:25.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.198+0000 7fc735320800 1 Processor -- start 2024-09-18T01:45:25.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.198+0000 7fc735320800 1 -- start start 2024-09-18T01:45:25.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.198+0000 7fc735320800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5636a177baf0 0x5636a1782f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.198+0000 7fc735320800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5636a177cb30 con 0x5636a177baf0 2024-09-18T01:45:25.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.198+0000 7fc731817640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5636a177baf0 0x5636a1782f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.198+0000 7fc731817640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5636a177baf0 0x5636a1782f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60372/0 (socket says 172.21.15.146:60372) 2024-09-18T01:45:25.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.198+0000 7fc731817640 1 -- 172.21.15.146:0/2803727724 learned_addr learned my addr 172.21.15.146:0/2803727724 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:25.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.198+0000 7fc731817640 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636a17834a0 con 0x5636a177baf0 2024-09-18T01:45:25.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.198+0000 7fc731817640 1 --2- 172.21.15.146:0/2803727724 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5636a177baf0 0x5636a1782f60 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc72c012b80 tx=0x7fc72c04c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.199+0000 7fc606ffd640 1 -- 172.21.15.146:0/2803727724 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc72c045030 con 0x5636a177baf0 2024-09-18T01:45:25.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.199+0000 7fc606ffd640 1 -- 172.21.15.146:0/2803727724 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc72c04b500 con 0x5636a177baf0 2024-09-18T01:45:25.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.199+0000 7fc735320800 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5636a1783730 con 0x5636a177baf0 2024-09-18T01:45:25.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.199+0000 7fc606ffd640 1 -- 172.21.15.146:0/2803727724 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc72c013af0 con 0x5636a177baf0 2024-09-18T01:45:25.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.199+0000 7fc735320800 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636a17863e0 con 0x5636a177baf0 2024-09-18T01:45:25.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.199+0000 7fc606ffd640 1 -- 172.21.15.146:0/2803727724 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc72c013c90 con 0x5636a177baf0 2024-09-18T01:45:25.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.199+0000 7fc606ffd640 1 --2- 172.21.15.146:0/2803727724 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc5fc036b40 0x7fc5fc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.199+0000 7fc606ffd640 1 -- 172.21.15.146:0/2803727724 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fc72c046070 con 0x5636a177baf0 2024-09-18T01:45:25.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.200+0000 7fc731016640 1 --2- 172.21.15.146:0/2803727724 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc5fc036b40 0x7fc5fc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.200+0000 7fc731016640 1 --2- 172.21.15.146:0/2803727724 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc5fc036b40 0x7fc5fc039000 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc72404ffd0 tx=0x7fc72408ea20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.200+0000 7fc735320800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.200+0000 7fc735320800 1 --2- 172.21.15.146:0/2803727724 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5636a178ebb0 0x5636a1791070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.200+0000 7fc735320800 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5636a17917c0 con 0x5636a178ebb0 2024-09-18T01:45:25.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.200+0000 7fc72bfff640 1 --2- 172.21.15.146:0/2803727724 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5636a178ebb0 0x5636a1791070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.201+0000 7fc72bfff640 1 --2- 172.21.15.146:0/2803727724 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5636a178ebb0 0x5636a1791070 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.201+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc71c00f5f0 con 0x5636a178ebb0 2024-09-18T01:45:25.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.201+0000 7fc735320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:25.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.201+0000 7fc735320800 20 realm 2024-09-18T01:45:25.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.201+0000 7fc735320800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.201+0000 7fc735320800 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5636a178e000 con 0x5636a178ebb0 2024-09-18T01:45:25.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.201+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc71c00f5f0 con 0x5636a178ebb0 2024-09-18T01:45:25.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.201+0000 7fc735320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:25.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.201+0000 7fc735320800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:25.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.201+0000 7fc735320800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.201+0000 7fc735320800 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5636a17922b0 con 0x5636a178ebb0 2024-09-18T01:45:25.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.201+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc71c00f5f0 con 0x5636a178ebb0 2024-09-18T01:45:25.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.201+0000 7fc735320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:25.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.201+0000 7fc735320800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.201+0000 7fc735320800 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5636a1792b80 con 0x5636a178ebb0 2024-09-18T01:45:25.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.202+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc71c00f5f0 con 0x5636a178ebb0 2024-09-18T01:45:25.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.202+0000 7fc735320800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:25.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.202+0000 7fc735320800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.202+0000 7fc735320800 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5636a1792f20 con 0x5636a178ebb0 2024-09-18T01:45:25.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.202+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc71c00f5f0 con 0x5636a178ebb0 2024-09-18T01:45:25.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.202+0000 7fc735320800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:25.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.202+0000 7fc735320800 20 searching for the correct realm 2024-09-18T01:45:25.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.202+0000 7fc735320800 1 --2- 172.21.15.146:0/2803727724 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5636a1794e50 0x5636a1797260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.202+0000 7fc735320800 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5636a1797930 con 0x5636a1794e50 2024-09-18T01:45:25.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.202+0000 7fc731817640 1 --2- 172.21.15.146:0/2803727724 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5636a1794e50 0x5636a1797260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.202+0000 7fc731817640 1 --2- 172.21.15.146:0/2803727724 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5636a1794e50 0x5636a1797260 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.203+0000 7fc731817640 1 -- 172.21.15.146:0/2803727724 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc72c03c020 con 0x5636a1794e50 2024-09-18T01:45:25.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.203+0000 7fc731817640 1 --2- 172.21.15.146:0/2803727724 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fc72c0080c0 0x7fc72c0123a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.203+0000 7fc731817640 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5636a1797930 con 0x7fc72c0080c0 2024-09-18T01:45:25.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.203+0000 7fc731016640 1 --2- 172.21.15.146:0/2803727724 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fc72c0080c0 0x7fc72c0123a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.203+0000 7fc731016640 1 --2- 172.21.15.146:0/2803727724 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fc72c0080c0 0x7fc72c0123a0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.203+0000 7fc731016640 1 -- 172.21.15.146:0/2803727724 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc724057030 con 0x7fc72c0080c0 2024-09-18T01:45:25.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.203+0000 7fc731016640 1 --2- 172.21.15.146:0/2803727724 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fc72409e040 0x7fc7240713e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.203+0000 7fc731016640 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5636a1797930 con 0x7fc72409e040 2024-09-18T01:45:25.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.203+0000 7fc72bfff640 1 --2- 172.21.15.146:0/2803727724 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fc72409e040 0x7fc7240713e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.204+0000 7fc72bfff640 1 --2- 172.21.15.146:0/2803727724 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fc72409e040 0x7fc7240713e0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.204+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc71c00f5f0 con 0x7fc72409e040 2024-09-18T01:45:25.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.204+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5636a1797930 con 0x5636a178ebb0 2024-09-18T01:45:25.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.204+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc71c00f5f0 con 0x5636a178ebb0 2024-09-18T01:45:25.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.204+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5636a1797930 con 0x5636a178ebb0 2024-09-18T01:45:25.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.204+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc71c00f5f0 con 0x5636a178ebb0 2024-09-18T01:45:25.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.204+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5636a1797930 con 0x7fc72409e040 2024-09-18T01:45:25.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.205+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc71c00f5f0 con 0x7fc72409e040 2024-09-18T01:45:25.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.205+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5636a1797930 con 0x7fc72409e040 2024-09-18T01:45:25.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.205+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc71c00f5f0 con 0x7fc72409e040 2024-09-18T01:45:25.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.205+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5636a1797930 con 0x7fc72c0080c0 2024-09-18T01:45:25.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.205+0000 7fc731016640 1 -- 172.21.15.146:0/2803727724 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc724057030 con 0x7fc72c0080c0 2024-09-18T01:45:25.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.205+0000 7fc731016640 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5636a1797930 con 0x5636a1794e50 2024-09-18T01:45:25.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.205+0000 7fc731817640 1 -- 172.21.15.146:0/2803727724 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc72c03c020 con 0x5636a1794e50 2024-09-18T01:45:25.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.205+0000 7fc731817640 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5636a1797930 con 0x5636a178ebb0 2024-09-18T01:45:25.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.206+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc71c00f5f0 con 0x5636a178ebb0 2024-09-18T01:45:25.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.206+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5636a1797930 con 0x7fc72409e040 2024-09-18T01:45:25.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.206+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc71c00f5f0 con 0x7fc72409e040 2024-09-18T01:45:25.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.206+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5636a1797930 con 0x5636a178ebb0 2024-09-18T01:45:25.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.206+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc71c00f5f0 con 0x5636a178ebb0 2024-09-18T01:45:25.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.206+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5636a1797930 con 0x7fc72c0080c0 2024-09-18T01:45:25.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.207+0000 7fc731016640 1 -- 172.21.15.146:0/2803727724 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fc724057030 con 0x7fc72c0080c0 2024-09-18T01:45:25.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.207+0000 7fc731016640 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5636a1797930 con 0x5636a1794e50 2024-09-18T01:45:25.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.207+0000 7fc731817640 1 -- 172.21.15.146:0/2803727724 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc72c03c020 con 0x5636a1794e50 2024-09-18T01:45:25.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.207+0000 7fc731817640 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5636a1797930 con 0x5636a1794e50 2024-09-18T01:45:25.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.207+0000 7fc731817640 1 -- 172.21.15.146:0/2803727724 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc72c03c020 con 0x5636a1794e50 2024-09-18T01:45:25.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.207+0000 7fc731817640 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5636a1797930 con 0x7fc72409e040 2024-09-18T01:45:25.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.207+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc71c00f5f0 con 0x7fc72409e040 2024-09-18T01:45:25.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.207+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5636a1797930 con 0x5636a1794e50 2024-09-18T01:45:25.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.208+0000 7fc731817640 1 -- 172.21.15.146:0/2803727724 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc72c03c020 con 0x5636a1794e50 2024-09-18T01:45:25.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.208+0000 7fc731817640 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5636a1797930 con 0x5636a1794e50 2024-09-18T01:45:25.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.208+0000 7fc731817640 1 -- 172.21.15.146:0/2803727724 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc72c03c020 con 0x5636a1794e50 2024-09-18T01:45:25.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.208+0000 7fc731817640 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5636a1797930 con 0x5636a178ebb0 2024-09-18T01:45:25.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.208+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc71c00f5f0 con 0x5636a178ebb0 2024-09-18T01:45:25.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.208+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5636a1797930 con 0x5636a178ebb0 2024-09-18T01:45:25.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.208+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc71c00f5f0 con 0x5636a178ebb0 2024-09-18T01:45:25.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.208+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5636a1797930 con 0x7fc72409e040 2024-09-18T01:45:25.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.209+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc71c00f5f0 con 0x7fc72409e040 2024-09-18T01:45:25.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.209+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5636a1797930 con 0x5636a1794e50 2024-09-18T01:45:25.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.209+0000 7fc731817640 1 -- 172.21.15.146:0/2803727724 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc72c03c020 con 0x5636a1794e50 2024-09-18T01:45:25.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.209+0000 7fc731817640 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5636a1797930 con 0x7fc72c0080c0 2024-09-18T01:45:25.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.209+0000 7fc731016640 1 -- 172.21.15.146:0/2803727724 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc724057030 con 0x7fc72c0080c0 2024-09-18T01:45:25.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.209+0000 7fc731016640 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5636a1797930 con 0x5636a178ebb0 2024-09-18T01:45:25.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.210+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc71c00f5f0 con 0x5636a178ebb0 2024-09-18T01:45:25.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.210+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5636a1797930 con 0x7fc72409e040 2024-09-18T01:45:25.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.210+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc71c03b040 con 0x7fc72409e040 2024-09-18T01:45:25.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.210+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5636a1797930 con 0x5636a1794e50 2024-09-18T01:45:25.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.210+0000 7fc731817640 1 -- 172.21.15.146:0/2803727724 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc72c03c020 con 0x5636a1794e50 2024-09-18T01:45:25.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.210+0000 7fc731817640 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5636a1797930 con 0x7fc72409e040 2024-09-18T01:45:25.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.211+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc71c03b040 con 0x7fc72409e040 2024-09-18T01:45:25.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.211+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5636a1797930 con 0x7fc72c0080c0 2024-09-18T01:45:25.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.211+0000 7fc731016640 1 -- 172.21.15.146:0/2803727724 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc724057030 con 0x7fc72c0080c0 2024-09-18T01:45:25.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.211+0000 7fc731016640 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5636a1797930 con 0x5636a1794e50 2024-09-18T01:45:25.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.211+0000 7fc731817640 1 -- 172.21.15.146:0/2803727724 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc72c03c020 con 0x5636a1794e50 2024-09-18T01:45:25.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.211+0000 7fc731817640 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5636a1797930 con 0x7fc72409e040 2024-09-18T01:45:25.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.212+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc71c03b040 con 0x7fc72409e040 2024-09-18T01:45:25.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.212+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5636a1797930 con 0x5636a178ebb0 2024-09-18T01:45:25.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.212+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc71c03b040 con 0x5636a178ebb0 2024-09-18T01:45:25.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.212+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5636a1797930 con 0x7fc72c0080c0 2024-09-18T01:45:25.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.212+0000 7fc731016640 1 -- 172.21.15.146:0/2803727724 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc724057030 con 0x7fc72c0080c0 2024-09-18T01:45:25.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.212+0000 7fc735320800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:25.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.212+0000 7fc735320800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:25.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.212+0000 7fc735320800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:25.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.212+0000 7fc735320800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:25.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.212+0000 7fc735320800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:25.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.212+0000 7fc735320800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:25.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.212+0000 7fc735320800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.212+0000 7fc735320800 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5636a17938f0 con 0x5636a178ebb0 2024-09-18T01:45:25.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.212+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc71c03b040 con 0x5636a178ebb0 2024-09-18T01:45:25.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.212+0000 7fc735320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:25.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.212+0000 7fc735320800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.212+0000 7fc735320800 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5636a1794190 con 0x5636a178ebb0 2024-09-18T01:45:25.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.212+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc71c03b040 con 0x5636a178ebb0 2024-09-18T01:45:25.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.212+0000 7fc735320800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:25.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.213+0000 7fc735320800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.213+0000 7fc735320800 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5636a1794190 con 0x7fc72c0080c0 2024-09-18T01:45:25.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.213+0000 7fc731016640 1 -- 172.21.15.146:0/2803727724 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc724057030 con 0x7fc72c0080c0 2024-09-18T01:45:25.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.213+0000 7fc735320800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:25.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.213+0000 7fc735320800 20 zone default found 2024-09-18T01:45:25.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.213+0000 7fc735320800 4 Realm: () 2024-09-18T01:45:25.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.213+0000 7fc735320800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:25.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.213+0000 7fc735320800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:25.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.213+0000 7fc735320800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:25.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.213+0000 7fc735320800 20 zonegroup default 2024-09-18T01:45:25.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.213+0000 7fc735320800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.213+0000 7fc735320800 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5636a1798260 con 0x7fc72409e040 2024-09-18T01:45:25.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.213+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc71c03b040 con 0x7fc72409e040 2024-09-18T01:45:25.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.213+0000 7fc735320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:25.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.213+0000 7fc735320800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.213+0000 7fc735320800 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5636a1799c40 con 0x5636a1794e50 2024-09-18T01:45:25.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.214+0000 7fc731817640 1 -- 172.21.15.146:0/2803727724 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc72c03c020 con 0x5636a1794e50 2024-09-18T01:45:25.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.214+0000 7fc735320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:25.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.214+0000 7fc735320800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.214+0000 7fc735320800 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5636a179a0a0 con 0x5636a1794e50 2024-09-18T01:45:25.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.214+0000 7fc731817640 1 -- 172.21.15.146:0/2803727724 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc72c03c020 con 0x5636a1794e50 2024-09-18T01:45:25.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.214+0000 7fc735320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:25.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.214+0000 7fc735320800 20 started sync module instance, tier type = 2024-09-18T01:45:25.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.214+0000 7fc735320800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:25.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.214+0000 7fc735320800 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5636a17990d0 con 0x7fc72c0080c0 2024-09-18T01:45:25.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.215+0000 7fc731016640 1 -- 172.21.15.146:0/2803727724 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v31'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc724057030 con 0x7fc72c0080c0 2024-09-18T01:45:25.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.215+0000 7fc735320800 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94792637322432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5636a1798d30 con 0x7fc72c0080c0 2024-09-18T01:45:25.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.215+0000 7fc735320800 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5636a179afd0 con 0x5636a178ebb0 2024-09-18T01:45:25.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.216+0000 7fc731016640 1 -- 172.21.15.146:0/2803727724 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94792637322432] v31'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc724057030 con 0x7fc72c0080c0 2024-09-18T01:45:25.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.216+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v31'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc71c03b040 con 0x5636a178ebb0 2024-09-18T01:45:25.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.216+0000 7fc735320800 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94792637328160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5636a179b3f0 con 0x5636a178ebb0 2024-09-18T01:45:25.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.216+0000 7fc735320800 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5636a179bdb0 con 0x5636a1794e50 2024-09-18T01:45:25.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.217+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94792637328160] v31'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc71c03b040 con 0x5636a178ebb0 2024-09-18T01:45:25.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.217+0000 7fc731817640 1 -- 172.21.15.146:0/2803727724 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v31'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc72c03c020 con 0x5636a1794e50 2024-09-18T01:45:25.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.217+0000 7fc735320800 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94792637329216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5636a179b360 con 0x5636a1794e50 2024-09-18T01:45:25.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.217+0000 7fc735320800 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5636a179cc20 con 0x7fc72c0080c0 2024-09-18T01:45:25.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.220+0000 7fc731817640 1 -- 172.21.15.146:0/2803727724 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94792637329216] v31'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc72c03c020 con 0x5636a1794e50 2024-09-18T01:45:25.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.220+0000 7fc731016640 1 -- 172.21.15.146:0/2803727724 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v31'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc724057030 con 0x7fc72c0080c0 2024-09-18T01:45:25.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.220+0000 7fc735320800 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94792637335408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5636a179cfc0 con 0x7fc72c0080c0 2024-09-18T01:45:25.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.220+0000 7fc735320800 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5636a179d980 con 0x5636a178ebb0 2024-09-18T01:45:25.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.221+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v31'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc71c03b040 con 0x5636a178ebb0 2024-09-18T01:45:25.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.221+0000 7fc731016640 1 -- 172.21.15.146:0/2803727724 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94792637335408] v31'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc724057030 con 0x7fc72c0080c0 2024-09-18T01:45:25.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.221+0000 7fc735320800 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94792637339312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5636a179e220 con 0x5636a178ebb0 2024-09-18T01:45:25.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.221+0000 7fc735320800 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5636a179c150 con 0x7fc72409e040 2024-09-18T01:45:25.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.222+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v31'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc71c03b040 con 0x7fc72409e040 2024-09-18T01:45:25.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.222+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94792637339312] v31'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc71c03b040 con 0x5636a178ebb0 2024-09-18T01:45:25.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.222+0000 7fc735320800 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94792637343712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5636a179c150 con 0x7fc72409e040 2024-09-18T01:45:25.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.222+0000 7fc735320800 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5636a179dd70 con 0x7fc72409e040 2024-09-18T01:45:25.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.223+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(56 notify.6 [create] v31'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc71c03b040 con 0x7fc72409e040 2024-09-18T01:45:25.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.223+0000 7fc735320800 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94792637341040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5636a179f6d0 con 0x7fc72409e040 2024-09-18T01:45:25.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.223+0000 7fc735320800 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5636a17a00f0 con 0x7fc72409e040 2024-09-18T01:45:25.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.223+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94792637343712] v31'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc71c03b040 con 0x7fc72409e040 2024-09-18T01:45:25.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.224+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94792637341040] v31'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc71c03b040 con 0x7fc72409e040 2024-09-18T01:45:25.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.224+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v31'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc71c03b040 con 0x7fc72409e040 2024-09-18T01:45:25.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.224+0000 7fc735320800 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94792637348832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5636a179f220 con 0x7fc72409e040 2024-09-18T01:45:25.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.224+0000 7fc735320800 20 add_watcher() i=0 2024-09-18T01:45:25.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.224+0000 7fc735320800 20 add_watcher() i=1 2024-09-18T01:45:25.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.224+0000 7fc735320800 20 add_watcher() i=2 2024-09-18T01:45:25.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.224+0000 7fc735320800 20 add_watcher() i=3 2024-09-18T01:45:25.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.224+0000 7fc735320800 20 add_watcher() i=4 2024-09-18T01:45:25.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.224+0000 7fc735320800 20 add_watcher() i=5 2024-09-18T01:45:25.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.224+0000 7fc735320800 20 add_watcher() i=6 2024-09-18T01:45:25.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.225+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94792637348832] v31'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc71c03b040 con 0x7fc72409e040 2024-09-18T01:45:25.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.225+0000 7fc735320800 20 add_watcher() i=7 2024-09-18T01:45:25.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.225+0000 7fc735320800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:25.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.225+0000 7fc735320800 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5636a17a31f0 con 0x5636a178ebb0 2024-09-18T01:45:25.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.225+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc71c03b040 con 0x5636a178ebb0 2024-09-18T01:45:25.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.225+0000 7fc735320800 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94792637344768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5636a17a0670 con 0x5636a178ebb0 2024-09-18T01:45:25.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.226+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94792637344768] v31'90 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc71c03b040 con 0x5636a178ebb0 2024-09-18T01:45:25.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.226+0000 7fc5e77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:25.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.226+0000 7fc735320800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:25.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.226+0000 7fc735320800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:25.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.226+0000 7fc735320800 5 note: GC not initialized 2024-09-18T01:45:25.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.227+0000 7fc5e67e4640 20 reqs_thread_entry: start 2024-09-18T01:45:25.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.227+0000 7fc735320800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:25.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.227+0000 7fc735320800 20 Filter name: none 2024-09-18T01:45:25.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.227+0000 7fc557fff640 20 reqs_thread_entry: start 2024-09-18T01:45:25.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.227+0000 7fc735320800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T01:45:25.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.227+0000 7fc735320800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.227+0000 7fc735320800 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5636a17d6380 con 0x5636a178ebb0 2024-09-18T01:45:25.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.227+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 foo [call out=48b,read 0~582 out=582b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+705 (crc 0 0 0) 0x7fc71c03b040 con 0x5636a178ebb0 2024-09-18T01:45:25.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.227+0000 7fc735320800 20 rados_obj.operate() r=0 bl.length=582 2024-09-18T01:45:25.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.227+0000 7fc735320800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T01:45:25.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.227+0000 7fc735320800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:45:25.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.227+0000 7fc735320800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:45:25.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.227+0000 7fc735320800 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5636a17dca90 con 0x5636a178ebb0 2024-09-18T01:45:25.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.228+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v31'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fc71c03b040 con 0x5636a178ebb0 2024-09-18T01:45:25.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.229+0000 7fc735320800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:45:25.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.229+0000 7fc735320800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:45:25.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.229+0000 7fc735320800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-18T01:45:25.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.229+0000 7fc735320800 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94792637596752 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5636a17d8380 con 0x5636a178ebb0 2024-09-18T01:45:25.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.229+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== watch-notify(notify (1) cookie 94792637339312 notify 133143986185 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7fc71c018040 con 0x5636a178ebb0 2024-09-18T01:45:25.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.229+0000 7fc614ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986185 cookie 94792637339312 notifier 4418 bl.length()=732 2024-09-18T01:45:25.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.229+0000 7fc614ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:45:25.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.229+0000 7fc614ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:45:25.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.229+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(64 notify.4 [notify cookie 94792637596752 out=8b] v0'0 uv75 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc71c03b040 con 0x5636a178ebb0 2024-09-18T01:45:25.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.229+0000 7fc614ff9640 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fc5f4003ea0 con 0x5636a178ebb0 2024-09-18T01:45:25.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.229+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc71c03b040 con 0x5636a178ebb0 2024-09-18T01:45:25.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.229+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== watch-notify(notify_complete (2) cookie 94792637596752 notify 133143986185 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc71c004a80 con 0x5636a178ebb0 2024-09-18T01:45:25.239 INFO:teuthology.orchestra.run.smithi146.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T01:45:23.010714Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-18T01:45:24.841201Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:45:23.010705Z","tags":[],"group_ids":[]} 2024-09-18T01:45:25.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.230+0000 7fc5e77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:25.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.230+0000 7fc735320800 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94792637344768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5636a17d40d0 con 0x5636a178ebb0 2024-09-18T01:45:25.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.231+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 <== osd.1 v2:172.21.15.146:6808/3930274777 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94792637344768] v31'91 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc71c03b040 con 0x5636a178ebb0 2024-09-18T01:45:25.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.231+0000 7fc735320800 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94792637322432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5636a17d40d0 con 0x7fc72c0080c0 2024-09-18T01:45:25.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.232+0000 7fc731016640 1 -- 172.21.15.146:0/2803727724 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94792637322432] v31'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc724057030 con 0x7fc72c0080c0 2024-09-18T01:45:25.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.232+0000 7fc735320800 20 remove_watcher() i=0 2024-09-18T01:45:25.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.232+0000 7fc735320800 2 removed watcher, disabling cache 2024-09-18T01:45:25.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.232+0000 7fc735320800 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94792637328160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5636a17d40d0 con 0x5636a178ebb0 2024-09-18T01:45:25.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.233+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 <== osd.1 v2:172.21.15.146:6808/3930274777 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94792637328160] v31'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc71c03b040 con 0x5636a178ebb0 2024-09-18T01:45:25.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.233+0000 7fc735320800 20 remove_watcher() i=1 2024-09-18T01:45:25.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.233+0000 7fc735320800 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94792637329216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5636a17d40d0 con 0x5636a1794e50 2024-09-18T01:45:25.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.234+0000 7fc731817640 1 -- 172.21.15.146:0/2803727724 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94792637329216] v31'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc72c03c020 con 0x5636a1794e50 2024-09-18T01:45:25.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.234+0000 7fc735320800 20 remove_watcher() i=2 2024-09-18T01:45:25.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.234+0000 7fc735320800 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94792637335408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5636a17d40d0 con 0x7fc72c0080c0 2024-09-18T01:45:25.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.235+0000 7fc731016640 1 -- 172.21.15.146:0/2803727724 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94792637335408] v31'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc724057030 con 0x7fc72c0080c0 2024-09-18T01:45:25.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.235+0000 7fc735320800 20 remove_watcher() i=3 2024-09-18T01:45:25.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.235+0000 7fc735320800 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94792637339312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5636a17d40d0 con 0x5636a178ebb0 2024-09-18T01:45:25.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.236+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 <== osd.1 v2:172.21.15.146:6808/3930274777 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94792637339312] v31'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc71c03b040 con 0x5636a178ebb0 2024-09-18T01:45:25.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.236+0000 7fc735320800 20 remove_watcher() i=4 2024-09-18T01:45:25.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.236+0000 7fc735320800 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94792637343712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5636a17d40d0 con 0x7fc72409e040 2024-09-18T01:45:25.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.237+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94792637343712] v31'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc71c03b040 con 0x7fc72409e040 2024-09-18T01:45:25.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.237+0000 7fc735320800 20 remove_watcher() i=5 2024-09-18T01:45:25.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.237+0000 7fc735320800 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94792637341040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5636a17d40d0 con 0x7fc72409e040 2024-09-18T01:45:25.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.238+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94792637341040] v31'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc71c03b040 con 0x7fc72409e040 2024-09-18T01:45:25.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.238+0000 7fc735320800 20 remove_watcher() i=6 2024-09-18T01:45:25.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.238+0000 7fc735320800 1 -- 172.21.15.146:0/2803727724 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94792637348832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5636a17d40d0 con 0x7fc72409e040 2024-09-18T01:45:25.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.239+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94792637348832] v31'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc71c03b040 con 0x7fc72409e040 2024-09-18T01:45:25.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.239+0000 7fc735320800 20 remove_watcher() i=7 2024-09-18T01:45:25.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.239+0000 7fc735320800 1 -- 172.21.15.146:0/2803727724 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fc72409e040 msgr2=0x7fc7240713e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.239+0000 7fc735320800 1 --2- 172.21.15.146:0/2803727724 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fc72409e040 0x7fc7240713e0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.239+0000 7fc735320800 1 -- 172.21.15.146:0/2803727724 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5636a178ebb0 msgr2=0x5636a1791070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.239+0000 7fc735320800 1 --2- 172.21.15.146:0/2803727724 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5636a178ebb0 0x5636a1791070 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.239+0000 7fc735320800 1 -- 172.21.15.146:0/2803727724 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fc72c0080c0 msgr2=0x7fc72c0123a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.239+0000 7fc735320800 1 --2- 172.21.15.146:0/2803727724 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fc72c0080c0 0x7fc72c0123a0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.239+0000 7fc735320800 1 -- 172.21.15.146:0/2803727724 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5636a1794e50 msgr2=0x5636a1797260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.239+0000 7fc735320800 1 --2- 172.21.15.146:0/2803727724 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5636a1794e50 0x5636a1797260 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.239+0000 7fc735320800 1 -- 172.21.15.146:0/2803727724 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc5fc036b40 msgr2=0x7fc5fc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.239+0000 7fc735320800 1 --2- 172.21.15.146:0/2803727724 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc5fc036b40 0x7fc5fc039000 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc72404ffd0 tx=0x7fc72408ea20 comp rx=0 tx=0).stop 2024-09-18T01:45:25.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.239+0000 7fc735320800 1 -- 172.21.15.146:0/2803727724 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5636a177baf0 msgr2=0x5636a1782f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.239+0000 7fc735320800 1 --2- 172.21.15.146:0/2803727724 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5636a177baf0 0x5636a1782f60 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc72c012b80 tx=0x7fc72c04c840 comp rx=0 tx=0).stop 2024-09-18T01:45:25.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.239+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 reap_dead start 2024-09-18T01:45:25.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.239+0000 7fc72bfff640 1 -- 172.21.15.146:0/2803727724 reap_dead start 2024-09-18T01:45:25.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.239+0000 7fc735320800 1 -- 172.21.15.146:0/2803727724 shutdown_connections 2024-09-18T01:45:25.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.239+0000 7fc735320800 1 -- 172.21.15.146:0/2803727724 >> 172.21.15.146:0/2803727724 conn(0x5636a1777e50 msgr2=0x5636a1775f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:25.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.239+0000 7fc735320800 1 -- 172.21.15.146:0/2803727724 shutdown_connections 2024-09-18T01:45:25.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.239+0000 7fc735320800 1 -- 172.21.15.146:0/2803727724 wait complete. 2024-09-18T01:45:25.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.240+0000 7fc735320800 1 -- 172.21.15.146:0/2426095130 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc608036b40 msgr2=0x7fc608039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.240+0000 7fc735320800 1 --2- 172.21.15.146:0/2426095130 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc608036b40 0x7fc608039000 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x5636a175a790 tx=0x7fc72408e6d0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.240+0000 7fc735320800 1 -- 172.21.15.146:0/2426095130 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5636a165bc00 msgr2=0x5636a165a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.240+0000 7fc735320800 1 --2- 172.21.15.146:0/2426095130 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5636a165bc00 0x5636a165a250 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x5636a1759890 tx=0x7fc72c0178e0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.240+0000 7fc735320800 1 -- 172.21.15.146:0/2426095130 shutdown_connections 2024-09-18T01:45:25.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.240+0000 7fc735320800 1 --2- 172.21.15.146:0/2426095130 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc608036b40 0x7fc608039000 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.240+0000 7fc735320800 1 --2- 172.21.15.146:0/2426095130 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5636a165bc00 0x5636a165a250 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.240+0000 7fc735320800 1 -- 172.21.15.146:0/2426095130 >> 172.21.15.146:0/2426095130 conn(0x5636a1761bc0 msgr2=0x5636a1764740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:25.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.240+0000 7fc735320800 1 -- 172.21.15.146:0/2426095130 shutdown_connections 2024-09-18T01:45:25.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.240+0000 7fc735320800 1 -- 172.21.15.146:0/2426095130 wait complete. 2024-09-18T01:45:25.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.240+0000 7fc735320800 1 -- 172.21.15.146:0/2670738612 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5636a165e790 msgr2=0x5636a1758f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.240+0000 7fc735320800 1 --2- 172.21.15.146:0/2670738612 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5636a165e790 0x5636a1758f50 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.240+0000 7fc735320800 1 -- 172.21.15.146:0/2670738612 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5636a175ae90 msgr2=0x5636a175e6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.240+0000 7fc735320800 1 --2- 172.21.15.146:0/2670738612 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5636a175ae90 0x5636a175e6f0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.240+0000 7fc735320800 1 -- 172.21.15.146:0/2670738612 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc618036b40 msgr2=0x7fc618039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.240+0000 7fc735320800 1 --2- 172.21.15.146:0/2670738612 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc618036b40 0x7fc618039000 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc71c000c00 tx=0x7fc71c0013b0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.240+0000 7fc735320800 1 -- 172.21.15.146:0/2670738612 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5636a15cf630 msgr2=0x5636a1751ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.240+0000 7fc735320800 1 --2- 172.21.15.146:0/2670738612 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5636a15cf630 0x5636a1751ee0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc7240460a0 tx=0x7fc724003020 comp rx=0 tx=0).stop 2024-09-18T01:45:25.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.240+0000 7fc735320800 1 -- 172.21.15.146:0/2670738612 shutdown_connections 2024-09-18T01:45:25.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.240+0000 7fc735320800 1 --2- 172.21.15.146:0/2670738612 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5636a175ae90 0x5636a175e6f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.240+0000 7fc735320800 1 --2- 172.21.15.146:0/2670738612 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5636a165e790 0x5636a1758f50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.240+0000 7fc735320800 1 --2- 172.21.15.146:0/2670738612 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc618036b40 0x7fc618039000 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.240+0000 7fc735320800 1 --2- 172.21.15.146:0/2670738612 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5636a15cf630 0x5636a1751ee0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.240+0000 7fc735320800 1 -- 172.21.15.146:0/2670738612 >> 172.21.15.146:0/2670738612 conn(0x5636a1655de0 msgr2=0x5636a1744870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:25.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.240+0000 7fc735320800 1 -- 172.21.15.146:0/2670738612 shutdown_connections 2024-09-18T01:45:25.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.240+0000 7fc735320800 1 -- 172.21.15.146:0/2670738612 wait complete. 2024-09-18T01:45:25.251 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T01:45:23.010714Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-18T01:45:24.841201Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:45:23.010705Z', 'tags': [], 'group_ids': []} 2024-09-18T01:45:25.251 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-18T01:45:25.251 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-18T01:45:25.251 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo2 --key-type swift --purge-keys 2024-09-18T01:45:25.298 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:25.298 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:25.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.298+0000 7f2cf7f37800 1 Processor -- start 2024-09-18T01:45:25.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.298+0000 7f2cf7f37800 1 -- start start 2024-09-18T01:45:25.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.299+0000 7f2cf7f37800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55a540efa630 0x55a540f8b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.299+0000 7f2cf7f37800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a540e45b30 con 0x55a540f8bbd0 2024-09-18T01:45:25.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.299+0000 7f2cf7f37800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x55a540e27360 con 0x55a540efa630 2024-09-18T01:45:25.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.299+0000 7f2cf3c2b640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55a540efa630 0x55a540f8b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.299+0000 7f2cf3c2b640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55a540efa630 0x55a540f8b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60376/0 (socket says 172.21.15.146:60376) 2024-09-18T01:45:25.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.299+0000 7f2cf3c2b640 1 -- 172.21.15.146:0/676585134 learned_addr learned my addr 172.21.15.146:0/676585134 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:25.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.299+0000 7f2cebfff640 1 --1- 172.21.15.146:0/676585134 >> v1:172.21.15.129:6789/0 conn(0x55a540f8bbd0 0x55a540f8dfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:38876/0 (socket says 172.21.15.146:38876) 2024-09-18T01:45:25.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.299+0000 7f2cf3c2b640 1 -- 172.21.15.146:0/676585134 >> v1:172.21.15.129:6789/0 conn(0x55a540f8bbd0 legacy=0x55a540f8dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.299+0000 7f2cf3c2b640 1 -- 172.21.15.146:0/676585134 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a540e4de00 con 0x55a540efa630 2024-09-18T01:45:25.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.299+0000 7f2cf342a640 1 -- 172.21.15.146:0/676585134 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2134708731 0 0) 0x55a540e45b30 con 0x55a540f8bbd0 2024-09-18T01:45:25.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.301+0000 7f2cf3c2b640 1 --2- 172.21.15.146:0/676585134 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a540efa630 0x55a540f8b690 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2ce400a520 tx=0x7f2ce4045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70e15747f0ceced8 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.301+0000 7f2cf342a640 1 -- 172.21.15.146:0/676585134 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ce4055070 con 0x55a540efa630 2024-09-18T01:45:25.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.301+0000 7f2cf342a640 1 -- 172.21.15.146:0/676585134 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ce40515b0 con 0x55a540efa630 2024-09-18T01:45:25.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.301+0000 7f2cf342a640 1 -- 172.21.15.146:0/676585134 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ce40518d0 con 0x55a540efa630 2024-09-18T01:45:25.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.302+0000 7f2cf7f37800 1 -- 172.21.15.146:0/676585134 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a540efa630 msgr2=0x55a540f8b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.302+0000 7f2cf7f37800 1 --2- 172.21.15.146:0/676585134 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a540efa630 0x55a540f8b690 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2ce400a520 tx=0x7f2ce4045ba0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.302+0000 7f2cf7f37800 1 -- 172.21.15.146:0/676585134 shutdown_connections 2024-09-18T01:45:25.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.302+0000 7f2cf7f37800 1 --2- 172.21.15.146:0/676585134 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a540efa630 0x55a540f8b690 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.302+0000 7f2cf7f37800 1 -- 172.21.15.146:0/676585134 >> 172.21.15.146:0/676585134 conn(0x55a540f80e00 msgr2=0x55a540f83220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:25.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.302+0000 7f2cf7f37800 1 -- 172.21.15.146:0/676585134 shutdown_connections 2024-09-18T01:45:25.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.302+0000 7f2cf7f37800 1 -- 172.21.15.146:0/676585134 wait complete. 2024-09-18T01:45:25.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.316+0000 7f2cf7f37800 1 Processor -- start 2024-09-18T01:45:25.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.316+0000 7f2cf7f37800 1 -- start start 2024-09-18T01:45:25.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.316+0000 7f2cf7f37800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a540efa630 0x55a541077860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.316+0000 7f2cf7f37800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55a540ed2350 con 0x55a540efa630 2024-09-18T01:45:25.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.317+0000 7f2cf3c2b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a540efa630 0x55a541077860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.317+0000 7f2cf3c2b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a540efa630 0x55a541077860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60388/0 (socket says 172.21.15.146:60388) 2024-09-18T01:45:25.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.317+0000 7f2cf3c2b640 1 -- 172.21.15.146:0/1315090027 learned_addr learned my addr 172.21.15.146:0/1315090027 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:25.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.317+0000 7f2cf3c2b640 1 -- 172.21.15.146:0/1315090027 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a540e1fbc0 con 0x55a540efa630 2024-09-18T01:45:25.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.317+0000 7f2cf3c2b640 1 --2- 172.21.15.146:0/1315090027 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a540efa630 0x55a541077860 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2ce4025da0 tx=0x7f2ce4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ed7f9c7ef41fa4a server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.317+0000 7f2be1e0b640 1 -- 172.21.15.146:0/1315090027 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ce4051ac0 con 0x55a540efa630 2024-09-18T01:45:25.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.317+0000 7f2be1e0b640 1 -- 172.21.15.146:0/1315090027 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ce4051c60 con 0x55a540efa630 2024-09-18T01:45:25.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.317+0000 7f2be1e0b640 1 -- 172.21.15.146:0/1315090027 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ce4066460 con 0x55a540efa630 2024-09-18T01:45:25.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.318+0000 7f2cf7f37800 1 -- 172.21.15.146:0/1315090027 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a540efa630 msgr2=0x55a541077860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.318+0000 7f2cf7f37800 1 --2- 172.21.15.146:0/1315090027 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a540efa630 0x55a541077860 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2ce4025da0 tx=0x7f2ce4051000 comp rx=0 tx=0).stop 2024-09-18T01:45:25.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.318+0000 7f2cf7f37800 1 -- 172.21.15.146:0/1315090027 shutdown_connections 2024-09-18T01:45:25.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.318+0000 7f2cf7f37800 1 --2- 172.21.15.146:0/1315090027 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a540efa630 0x55a541077860 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.318+0000 7f2cf7f37800 1 -- 172.21.15.146:0/1315090027 >> 172.21.15.146:0/1315090027 conn(0x55a540f80e00 msgr2=0x55a541073220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:25.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.318+0000 7f2cf7f37800 1 -- 172.21.15.146:0/1315090027 shutdown_connections 2024-09-18T01:45:25.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.318+0000 7f2cf7f37800 1 -- 172.21.15.146:0/1315090027 wait complete. 2024-09-18T01:45:25.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.318+0000 7f2cf7f37800 1 Processor -- start 2024-09-18T01:45:25.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.319+0000 7f2cf7f37800 1 -- start start 2024-09-18T01:45:25.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.319+0000 7f2cf7f37800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a540efa630 0x55a54107f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.319+0000 7f2cf7f37800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55a540f8f9b0 con 0x55a540efa630 2024-09-18T01:45:25.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.319+0000 7f2cf3c2b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a540efa630 0x55a54107f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.319+0000 7f2cf3c2b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a540efa630 0x55a54107f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60396/0 (socket says 172.21.15.146:60396) 2024-09-18T01:45:25.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.319+0000 7f2cf3c2b640 1 -- 172.21.15.146:0/2647267765 learned_addr learned my addr 172.21.15.146:0/2647267765 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:25.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.319+0000 7f2cf3c2b640 1 -- 172.21.15.146:0/2647267765 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a540e33fe0 con 0x55a540efa630 2024-09-18T01:45:25.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.319+0000 7f2cf3c2b640 1 --2- 172.21.15.146:0/2647267765 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a540efa630 0x55a54107f1b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2ce40460a0 tx=0x7f2ce4003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.320+0000 7f2bdbfff640 1 -- 172.21.15.146:0/2647267765 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ce4066650 con 0x55a540efa630 2024-09-18T01:45:25.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.320+0000 7f2bdbfff640 1 -- 172.21.15.146:0/2647267765 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ce40667f0 con 0x55a540efa630 2024-09-18T01:45:25.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.320+0000 7f2cf7f37800 1 -- 172.21.15.146:0/2647267765 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a54107f6f0 con 0x55a540efa630 2024-09-18T01:45:25.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.320+0000 7f2bdbfff640 1 -- 172.21.15.146:0/2647267765 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ce4066af0 con 0x55a540efa630 2024-09-18T01:45:25.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.320+0000 7f2cf7f37800 1 -- 172.21.15.146:0/2647267765 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a54107fc10 con 0x55a540efa630 2024-09-18T01:45:25.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.320+0000 7f2bdbfff640 1 -- 172.21.15.146:0/2647267765 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2ce4079060 con 0x55a540efa630 2024-09-18T01:45:25.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.321+0000 7f2bdbfff640 1 --2- 172.21.15.146:0/2647267765 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2bdc036b40 0x7f2bdc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.321+0000 7f2bdbfff640 1 -- 172.21.15.146:0/2647267765 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f2ce4062070 con 0x55a540efa630 2024-09-18T01:45:25.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.321+0000 7f2cebfff640 1 --2- 172.21.15.146:0/2647267765 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2bdc036b40 0x7f2bdc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.321+0000 7f2cf7f37800 1 --2- 172.21.15.146:0/2647267765 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a540f8bbd0 0x55a541086220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.321+0000 7f2cf7f37800 1 -- 172.21.15.146:0/2647267765 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a541086760 con 0x55a540f8bbd0 2024-09-18T01:45:25.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.321+0000 7f2cf442c640 1 --2- 172.21.15.146:0/2647267765 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a540f8bbd0 0x55a541086220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.321+0000 7f2cebfff640 1 --2- 172.21.15.146:0/2647267765 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2bdc036b40 0x7f2bdc039000 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc000c00 tx=0x7f2cdc0013b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.321+0000 7f2cf442c640 1 --2- 172.21.15.146:0/2647267765 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a540f8bbd0 0x55a541086220 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.321+0000 7f2cf442c640 1 -- 172.21.15.146:0/2647267765 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2cec00a4a0 con 0x55a540f8bbd0 2024-09-18T01:45:25.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.321+0000 7f2cf7f37800 1 -- 172.21.15.146:0/2647267765 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a5410837d0 con 0x55a540f8bbd0 2024-09-18T01:45:25.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.322+0000 7f2cf442c640 1 -- 172.21.15.146:0/2647267765 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2cec00a4a0 con 0x55a540f8bbd0 2024-09-18T01:45:25.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.322+0000 7f2cf7f37800 1 -- 172.21.15.146:0/2647267765 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a541088580 con 0x55a540f8bbd0 2024-09-18T01:45:25.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.322+0000 7f2cf442c640 1 -- 172.21.15.146:0/2647267765 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2cec00a4a0 con 0x55a540f8bbd0 2024-09-18T01:45:25.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.322+0000 7f2cf7f37800 1 -- 172.21.15.146:0/2647267765 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a5410877b0 con 0x55a540f8bbd0 2024-09-18T01:45:25.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.322+0000 7f2cf442c640 1 -- 172.21.15.146:0/2647267765 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2cec00a4a0 con 0x55a540f8bbd0 2024-09-18T01:45:25.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.322+0000 7f2cf7f37800 1 --2- 172.21.15.146:0/2647267765 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55a541089930 0x55a54108bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.322+0000 7f2cf7f37800 1 -- 172.21.15.146:0/2647267765 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a54108c260 con 0x55a541089930 2024-09-18T01:45:25.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.322+0000 7f2cf3c2b640 1 --2- 172.21.15.146:0/2647267765 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55a541089930 0x55a54108bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.323+0000 7f2cf3c2b640 1 --2- 172.21.15.146:0/2647267765 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55a541089930 0x55a54108bd20 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.323+0000 7f2cf3c2b640 1 -- 172.21.15.146:0/2647267765 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2ce4057030 con 0x55a541089930 2024-09-18T01:45:25.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.323+0000 7f2cf7f37800 1 Processor -- start 2024-09-18T01:45:25.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.323+0000 7f2cf7f37800 1 -- start start 2024-09-18T01:45:25.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.324+0000 7f2cf7f37800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a541099ea0 0x55a54109a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.324+0000 7f2cf7f37800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55a540e21580 con 0x55a541099ea0 2024-09-18T01:45:25.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.324+0000 7f2cf442c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a541099ea0 0x55a54109a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.324+0000 7f2cf442c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a541099ea0 0x55a54109a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60402/0 (socket says 172.21.15.146:60402) 2024-09-18T01:45:25.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.324+0000 7f2cf442c640 1 -- 172.21.15.146:0/3549219614 learned_addr learned my addr 172.21.15.146:0/3549219614 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:25.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.324+0000 7f2cf442c640 1 -- 172.21.15.146:0/3549219614 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a54109a800 con 0x55a541099ea0 2024-09-18T01:45:25.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.324+0000 7f2cf442c640 1 --2- 172.21.15.146:0/3549219614 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a541099ea0 0x55a54109a2c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x55a54107ffd0 tx=0x7f2cec0178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.324+0000 7f2bd97fa640 1 -- 172.21.15.146:0/3549219614 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cec013440 con 0x55a541099ea0 2024-09-18T01:45:25.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.324+0000 7f2bd97fa640 1 -- 172.21.15.146:0/3549219614 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cec0135e0 con 0x55a541099ea0 2024-09-18T01:45:25.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.324+0000 7f2cf7f37800 1 -- 172.21.15.146:0/3549219614 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a54109aa90 con 0x55a541099ea0 2024-09-18T01:45:25.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.324+0000 7f2bd97fa640 1 -- 172.21.15.146:0/3549219614 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cec0138c0 con 0x55a541099ea0 2024-09-18T01:45:25.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.324+0000 7f2cf7f37800 1 -- 172.21.15.146:0/3549219614 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a54109d770 con 0x55a541099ea0 2024-09-18T01:45:25.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.325+0000 7f2bd97fa640 1 -- 172.21.15.146:0/3549219614 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2cec011040 con 0x55a541099ea0 2024-09-18T01:45:25.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.325+0000 7f2bd97fa640 1 --2- 172.21.15.146:0/3549219614 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2bcc036b40 0x7f2bcc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.325+0000 7f2bd97fa640 1 -- 172.21.15.146:0/3549219614 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f2cec01d070 con 0x55a541099ea0 2024-09-18T01:45:25.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.325+0000 7f2cf3c2b640 1 --2- 172.21.15.146:0/3549219614 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2bcc036b40 0x7f2bcc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.326+0000 7f2cf7f37800 1 Processor -- start 2024-09-18T01:45:25.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.326+0000 7f2cf3c2b640 1 --2- 172.21.15.146:0/3549219614 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2bcc036b40 0x7f2bcc039000 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x55a541087b50 tx=0x7f2ce408e6d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.326+0000 7f2cf7f37800 1 -- start start 2024-09-18T01:45:25.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.326+0000 7f2cf7f37800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a5410a6b90 0x55a5410a6f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.326+0000 7f2cf7f37800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55a541077f50 con 0x55a5410a6b90 2024-09-18T01:45:25.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.326+0000 7f2cf442c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a5410a6b90 0x55a5410a6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.326+0000 7f2cf442c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a5410a6b90 0x55a5410a6f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60412/0 (socket says 172.21.15.146:60412) 2024-09-18T01:45:25.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.326+0000 7f2cf442c640 1 -- 172.21.15.146:0/1477821389 learned_addr learned my addr 172.21.15.146:0/1477821389 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:25.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.326+0000 7f2cf442c640 1 -- 172.21.15.146:0/1477821389 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5410a7560 con 0x55a5410a6b90 2024-09-18T01:45:25.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.327+0000 7f2cf442c640 1 --2- 172.21.15.146:0/1477821389 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a5410a6b90 0x55a5410a6f90 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2cec04c920 tx=0x7f2cec012830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80e70bfd7dee7f8b server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.327+0000 7f2bd2ffd640 1 -- 172.21.15.146:0/1477821389 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cec012c90 con 0x55a5410a6b90 2024-09-18T01:45:25.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.327+0000 7f2bd2ffd640 1 -- 172.21.15.146:0/1477821389 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cec012e30 con 0x55a5410a6b90 2024-09-18T01:45:25.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.327+0000 7f2bd2ffd640 1 -- 172.21.15.146:0/1477821389 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cec0123a0 con 0x55a5410a6b90 2024-09-18T01:45:25.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.327+0000 7f2cf7f37800 1 -- 172.21.15.146:0/1477821389 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a5410a6b90 msgr2=0x55a5410a6f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.327+0000 7f2cf7f37800 1 --2- 172.21.15.146:0/1477821389 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a5410a6b90 0x55a5410a6f90 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2cec04c920 tx=0x7f2cec012830 comp rx=0 tx=0).stop 2024-09-18T01:45:25.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.327+0000 7f2cf7f37800 1 -- 172.21.15.146:0/1477821389 shutdown_connections 2024-09-18T01:45:25.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.327+0000 7f2cf7f37800 1 --2- 172.21.15.146:0/1477821389 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a5410a6b90 0x55a5410a6f90 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.327+0000 7f2cf7f37800 1 -- 172.21.15.146:0/1477821389 >> 172.21.15.146:0/1477821389 conn(0x55a5410a2ef0 msgr2=0x55a5410a0ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:25.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.327+0000 7f2cf7f37800 1 -- 172.21.15.146:0/1477821389 shutdown_connections 2024-09-18T01:45:25.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.327+0000 7f2cf7f37800 1 -- 172.21.15.146:0/1477821389 wait complete. 2024-09-18T01:45:25.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.327+0000 7f2cf7f37800 1 Processor -- start 2024-09-18T01:45:25.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.328+0000 7f2cf7f37800 1 -- start start 2024-09-18T01:45:25.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.328+0000 7f2cf7f37800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a5410a6b90 0x55a5410adfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.328+0000 7f2cf7f37800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55a5410a7bd0 con 0x55a5410a6b90 2024-09-18T01:45:25.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.328+0000 7f2cf442c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a5410a6b90 0x55a5410adfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.328+0000 7f2cf442c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a5410a6b90 0x55a5410adfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60428/0 (socket says 172.21.15.146:60428) 2024-09-18T01:45:25.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.328+0000 7f2cf442c640 1 -- 172.21.15.146:0/533487776 learned_addr learned my addr 172.21.15.146:0/533487776 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:25.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.328+0000 7f2cf442c640 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5410ae510 con 0x55a5410a6b90 2024-09-18T01:45:25.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.328+0000 7f2cf442c640 1 --2- 172.21.15.146:0/533487776 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a5410a6b90 0x55a5410adfd0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2cec04c850 tx=0x7f2cec04c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.328+0000 7f2bd17fa640 1 -- 172.21.15.146:0/533487776 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cec03b070 con 0x55a5410a6b90 2024-09-18T01:45:25.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.328+0000 7f2bd17fa640 1 -- 172.21.15.146:0/533487776 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cec041040 con 0x55a5410a6b90 2024-09-18T01:45:25.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.328+0000 7f2cf7f37800 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a5410ae7a0 con 0x55a5410a6b90 2024-09-18T01:45:25.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.328+0000 7f2bd17fa640 1 -- 172.21.15.146:0/533487776 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cec046070 con 0x55a5410a6b90 2024-09-18T01:45:25.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.328+0000 7f2cf7f37800 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5410b1450 con 0x55a5410a6b90 2024-09-18T01:45:25.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.329+0000 7f2bd17fa640 1 -- 172.21.15.146:0/533487776 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2cec03e070 con 0x55a5410a6b90 2024-09-18T01:45:25.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.329+0000 7f2bd17fa640 1 --2- 172.21.15.146:0/533487776 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2bbc036af0 0x7f2bbc038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.329+0000 7f2bd17fa640 1 -- 172.21.15.146:0/533487776 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f2cec033070 con 0x55a5410a6b90 2024-09-18T01:45:25.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.329+0000 7f2cf3c2b640 1 --2- 172.21.15.146:0/533487776 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2bbc036af0 0x7f2bbc038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.330+0000 7f2cf3c2b640 1 --2- 172.21.15.146:0/533487776 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2bbc036af0 0x7f2bbc038fb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2ce408d520 tx=0x7f2ce4084000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.330+0000 7f2cf7f37800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.330+0000 7f2cf7f37800 1 --2- 172.21.15.146:0/533487776 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a5410b9cd0 0x55a5410bc190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.330+0000 7f2cf7f37800 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a5410bc8e0 con 0x55a5410b9cd0 2024-09-18T01:45:25.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.330+0000 7f2cebfff640 1 --2- 172.21.15.146:0/533487776 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a5410b9cd0 0x55a5410bc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.330+0000 7f2cebfff640 1 --2- 172.21.15.146:0/533487776 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a5410b9cd0 0x55a5410bc190 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.331+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2cdc00f5f0 con 0x55a5410b9cd0 2024-09-18T01:45:25.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.331+0000 7f2cf7f37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:25.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.331+0000 7f2cf7f37800 20 realm 2024-09-18T01:45:25.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.331+0000 7f2cf7f37800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.331+0000 7f2cf7f37800 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a5410b9120 con 0x55a5410b9cd0 2024-09-18T01:45:25.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.331+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2cdc00f5f0 con 0x55a5410b9cd0 2024-09-18T01:45:25.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.331+0000 7f2cf7f37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:25.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.331+0000 7f2cf7f37800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:25.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.331+0000 7f2cf7f37800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.331+0000 7f2cf7f37800 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a5410bd3d0 con 0x55a5410b9cd0 2024-09-18T01:45:25.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.331+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2cdc00f5f0 con 0x55a5410b9cd0 2024-09-18T01:45:25.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.331+0000 7f2cf7f37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:25.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.331+0000 7f2cf7f37800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.331+0000 7f2cf7f37800 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a5410bdca0 con 0x55a5410b9cd0 2024-09-18T01:45:25.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.331+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2cdc00f5f0 con 0x55a5410b9cd0 2024-09-18T01:45:25.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.332+0000 7f2cf7f37800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:25.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.332+0000 7f2cf7f37800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.332+0000 7f2cf7f37800 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a5410be040 con 0x55a5410b9cd0 2024-09-18T01:45:25.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.332+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2cdc00f5f0 con 0x55a5410b9cd0 2024-09-18T01:45:25.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.332+0000 7f2cf7f37800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:25.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.332+0000 7f2cf7f37800 20 searching for the correct realm 2024-09-18T01:45:25.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.332+0000 7f2cf7f37800 1 --2- 172.21.15.146:0/533487776 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55a5410bff70 0x55a5410c2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.332+0000 7f2cf7f37800 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5410c2a50 con 0x55a5410bff70 2024-09-18T01:45:25.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.332+0000 7f2cf442c640 1 --2- 172.21.15.146:0/533487776 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55a5410bff70 0x55a5410c2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.332+0000 7f2cf442c640 1 --2- 172.21.15.146:0/533487776 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55a5410bff70 0x55a5410c2380 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.332+0000 7f2cf442c640 1 -- 172.21.15.146:0/533487776 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cec03d030 con 0x55a5410bff70 2024-09-18T01:45:25.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.332+0000 7f2cf442c640 1 --2- 172.21.15.146:0/533487776 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f2cec025b50 0x7f2cec04e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.333+0000 7f2cf442c640 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5410c2a50 con 0x7f2cec025b50 2024-09-18T01:45:25.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.333+0000 7f2cf3c2b640 1 --2- 172.21.15.146:0/533487776 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f2cec025b50 0x7f2cec04e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.333+0000 7f2cf3c2b640 1 --2- 172.21.15.146:0/533487776 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f2cec025b50 0x7f2cec04e6c0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.333+0000 7f2cf3c2b640 1 -- 172.21.15.146:0/533487776 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ce4057030 con 0x7f2cec025b50 2024-09-18T01:45:25.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.333+0000 7f2cf3c2b640 1 --2- 172.21.15.146:0/533487776 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f2ce409e040 0x7f2ce40505c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.333+0000 7f2cf3c2b640 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5410c2a50 con 0x7f2ce409e040 2024-09-18T01:45:25.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.333+0000 7f2cebfff640 1 --2- 172.21.15.146:0/533487776 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f2ce409e040 0x7f2ce40505c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.334+0000 7f2cebfff640 1 --2- 172.21.15.146:0/533487776 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f2ce409e040 0x7f2ce40505c0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.334+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cdc00f5f0 con 0x7f2ce409e040 2024-09-18T01:45:25.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.334+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5410c2a50 con 0x55a5410b9cd0 2024-09-18T01:45:25.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.334+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2cdc00f5f0 con 0x55a5410b9cd0 2024-09-18T01:45:25.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.334+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5410c2a50 con 0x55a5410b9cd0 2024-09-18T01:45:25.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.335+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cdc00f5f0 con 0x55a5410b9cd0 2024-09-18T01:45:25.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.335+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5410c2a50 con 0x7f2ce409e040 2024-09-18T01:45:25.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.335+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cdc00f5f0 con 0x7f2ce409e040 2024-09-18T01:45:25.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.335+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5410c2a50 con 0x7f2ce409e040 2024-09-18T01:45:25.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.335+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cdc00f5f0 con 0x7f2ce409e040 2024-09-18T01:45:25.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.335+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5410c2a50 con 0x7f2cec025b50 2024-09-18T01:45:25.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.335+0000 7f2cf3c2b640 1 -- 172.21.15.146:0/533487776 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ce4057030 con 0x7f2cec025b50 2024-09-18T01:45:25.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.335+0000 7f2cf3c2b640 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5410c2a50 con 0x55a5410bff70 2024-09-18T01:45:25.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.335+0000 7f2cf442c640 1 -- 172.21.15.146:0/533487776 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cec03d030 con 0x55a5410bff70 2024-09-18T01:45:25.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.336+0000 7f2cf442c640 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5410c2a50 con 0x55a5410b9cd0 2024-09-18T01:45:25.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.336+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cdc00f5f0 con 0x55a5410b9cd0 2024-09-18T01:45:25.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.336+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5410c2a50 con 0x7f2ce409e040 2024-09-18T01:45:25.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.336+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cdc00f5f0 con 0x7f2ce409e040 2024-09-18T01:45:25.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.336+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5410c2a50 con 0x55a5410b9cd0 2024-09-18T01:45:25.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.336+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cdc00f5f0 con 0x55a5410b9cd0 2024-09-18T01:45:25.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.336+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5410c2a50 con 0x7f2cec025b50 2024-09-18T01:45:25.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.337+0000 7f2cf3c2b640 1 -- 172.21.15.146:0/533487776 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f2ce4057030 con 0x7f2cec025b50 2024-09-18T01:45:25.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.337+0000 7f2cf3c2b640 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5410c2a50 con 0x55a5410bff70 2024-09-18T01:45:25.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.337+0000 7f2cf442c640 1 -- 172.21.15.146:0/533487776 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cec03d030 con 0x55a5410bff70 2024-09-18T01:45:25.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.337+0000 7f2cf442c640 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5410c2a50 con 0x55a5410bff70 2024-09-18T01:45:25.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.337+0000 7f2cf442c640 1 -- 172.21.15.146:0/533487776 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cec03d030 con 0x55a5410bff70 2024-09-18T01:45:25.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.337+0000 7f2cf442c640 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5410c2a50 con 0x7f2ce409e040 2024-09-18T01:45:25.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.337+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cdc00f5f0 con 0x7f2ce409e040 2024-09-18T01:45:25.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.337+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5410c2a50 con 0x55a5410bff70 2024-09-18T01:45:25.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.337+0000 7f2cf442c640 1 -- 172.21.15.146:0/533487776 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cec03d030 con 0x55a5410bff70 2024-09-18T01:45:25.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.337+0000 7f2cf442c640 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5410c2a50 con 0x55a5410bff70 2024-09-18T01:45:25.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.338+0000 7f2cf442c640 1 -- 172.21.15.146:0/533487776 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cec03d030 con 0x55a5410bff70 2024-09-18T01:45:25.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.338+0000 7f2cf442c640 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5410c2a50 con 0x55a5410b9cd0 2024-09-18T01:45:25.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.338+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cdc00f5f0 con 0x55a5410b9cd0 2024-09-18T01:45:25.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.338+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5410c2a50 con 0x55a5410b9cd0 2024-09-18T01:45:25.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.338+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2cdc00f5f0 con 0x55a5410b9cd0 2024-09-18T01:45:25.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.338+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5410c2a50 con 0x7f2ce409e040 2024-09-18T01:45:25.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.338+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cdc00f5f0 con 0x7f2ce409e040 2024-09-18T01:45:25.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.338+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5410c2a50 con 0x55a5410bff70 2024-09-18T01:45:25.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.339+0000 7f2cf442c640 1 -- 172.21.15.146:0/533487776 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cec03d030 con 0x55a5410bff70 2024-09-18T01:45:25.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.339+0000 7f2cf442c640 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5410c2a50 con 0x7f2cec025b50 2024-09-18T01:45:25.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.339+0000 7f2cf3c2b640 1 -- 172.21.15.146:0/533487776 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ce4057030 con 0x7f2cec025b50 2024-09-18T01:45:25.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.339+0000 7f2cf3c2b640 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5410c2a50 con 0x55a5410b9cd0 2024-09-18T01:45:25.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.339+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cdc00f5f0 con 0x55a5410b9cd0 2024-09-18T01:45:25.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.339+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5410c2a50 con 0x7f2ce409e040 2024-09-18T01:45:25.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.339+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cdc03b040 con 0x7f2ce409e040 2024-09-18T01:45:25.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.339+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5410c2a50 con 0x55a5410bff70 2024-09-18T01:45:25.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.340+0000 7f2cf442c640 1 -- 172.21.15.146:0/533487776 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cec03d030 con 0x55a5410bff70 2024-09-18T01:45:25.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.340+0000 7f2cf442c640 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5410c2a50 con 0x7f2ce409e040 2024-09-18T01:45:25.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.340+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cdc03b040 con 0x7f2ce409e040 2024-09-18T01:45:25.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.340+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5410c2a50 con 0x7f2cec025b50 2024-09-18T01:45:25.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.340+0000 7f2cf3c2b640 1 -- 172.21.15.146:0/533487776 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ce4057030 con 0x7f2cec025b50 2024-09-18T01:45:25.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.340+0000 7f2cf3c2b640 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5410c2a50 con 0x55a5410bff70 2024-09-18T01:45:25.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.340+0000 7f2cf442c640 1 -- 172.21.15.146:0/533487776 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cec03d030 con 0x55a5410bff70 2024-09-18T01:45:25.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.340+0000 7f2cf442c640 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5410c2a50 con 0x7f2ce409e040 2024-09-18T01:45:25.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.341+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cdc03b040 con 0x7f2ce409e040 2024-09-18T01:45:25.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.341+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5410c2a50 con 0x55a5410b9cd0 2024-09-18T01:45:25.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.341+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2cdc03b040 con 0x55a5410b9cd0 2024-09-18T01:45:25.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.341+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5410c2a50 con 0x7f2cec025b50 2024-09-18T01:45:25.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.341+0000 7f2cf3c2b640 1 -- 172.21.15.146:0/533487776 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ce4057030 con 0x7f2cec025b50 2024-09-18T01:45:25.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.341+0000 7f2cf7f37800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:25.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.341+0000 7f2cf7f37800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:25.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.341+0000 7f2cf7f37800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:25.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.341+0000 7f2cf7f37800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:25.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.341+0000 7f2cf7f37800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:25.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.341+0000 7f2cf7f37800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:25.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.341+0000 7f2cf7f37800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.341+0000 7f2cf7f37800 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a5410bea10 con 0x55a5410b9cd0 2024-09-18T01:45:25.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.341+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2cdc03b040 con 0x55a5410b9cd0 2024-09-18T01:45:25.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.341+0000 7f2cf7f37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:25.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.341+0000 7f2cf7f37800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.341+0000 7f2cf7f37800 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a5410bf2b0 con 0x55a5410b9cd0 2024-09-18T01:45:25.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.342+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2cdc03b040 con 0x55a5410b9cd0 2024-09-18T01:45:25.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.342+0000 7f2cf7f37800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:25.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.342+0000 7f2cf7f37800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.342+0000 7f2cf7f37800 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a5410bf2b0 con 0x7f2cec025b50 2024-09-18T01:45:25.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.342+0000 7f2cf3c2b640 1 -- 172.21.15.146:0/533487776 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2ce4057030 con 0x7f2cec025b50 2024-09-18T01:45:25.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.342+0000 7f2cf7f37800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:25.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.342+0000 7f2cf7f37800 20 zone default found 2024-09-18T01:45:25.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.342+0000 7f2cf7f37800 4 Realm: () 2024-09-18T01:45:25.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.342+0000 7f2cf7f37800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:25.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.342+0000 7f2cf7f37800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:25.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.342+0000 7f2cf7f37800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:25.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.342+0000 7f2cf7f37800 20 zonegroup default 2024-09-18T01:45:25.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.342+0000 7f2cf7f37800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.342+0000 7f2cf7f37800 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a5410c3380 con 0x7f2ce409e040 2024-09-18T01:45:25.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.342+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2cdc03b040 con 0x7f2ce409e040 2024-09-18T01:45:25.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.342+0000 7f2cf7f37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:25.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.342+0000 7f2cf7f37800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.342+0000 7f2cf7f37800 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a5410c4d60 con 0x55a5410bff70 2024-09-18T01:45:25.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.343+0000 7f2cf442c640 1 -- 172.21.15.146:0/533487776 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2cec03d030 con 0x55a5410bff70 2024-09-18T01:45:25.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.343+0000 7f2cf7f37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:25.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.343+0000 7f2cf7f37800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.343+0000 7f2cf7f37800 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a5410c51e0 con 0x55a5410bff70 2024-09-18T01:45:25.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.343+0000 7f2cf442c640 1 -- 172.21.15.146:0/533487776 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2cec03d030 con 0x55a5410bff70 2024-09-18T01:45:25.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.343+0000 7f2cf7f37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:25.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.343+0000 7f2cf7f37800 20 started sync module instance, tier type = 2024-09-18T01:45:25.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.343+0000 7f2cf7f37800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:25.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.343+0000 7f2cf7f37800 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5410c41f0 con 0x7f2cec025b50 2024-09-18T01:45:25.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.344+0000 7f2cf3c2b640 1 -- 172.21.15.146:0/533487776 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v31'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ce4057030 con 0x7f2cec025b50 2024-09-18T01:45:25.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.344+0000 7f2cf7f37800 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94168249288208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5410c3e50 con 0x7f2cec025b50 2024-09-18T01:45:25.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.344+0000 7f2cf7f37800 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5410c6110 con 0x55a5410b9cd0 2024-09-18T01:45:25.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.345+0000 7f2cf3c2b640 1 -- 172.21.15.146:0/533487776 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94168249288208] v31'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ce4057030 con 0x7f2cec025b50 2024-09-18T01:45:25.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.345+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v31'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cdc03b040 con 0x55a5410b9cd0 2024-09-18T01:45:25.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.345+0000 7f2cf7f37800 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94168249293920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5410c6530 con 0x55a5410b9cd0 2024-09-18T01:45:25.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.345+0000 7f2cf7f37800 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5410c6ef0 con 0x55a5410bff70 2024-09-18T01:45:25.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.346+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94168249293920] v31'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cdc03b040 con 0x55a5410b9cd0 2024-09-18T01:45:25.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.346+0000 7f2cf442c640 1 -- 172.21.15.146:0/533487776 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v31'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cec03d030 con 0x55a5410bff70 2024-09-18T01:45:25.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.346+0000 7f2cf7f37800 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94168249294976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5410c6ef0 con 0x55a5410bff70 2024-09-18T01:45:25.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.346+0000 7f2cf7f37800 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5410c79e0 con 0x7f2cec025b50 2024-09-18T01:45:25.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.348+0000 7f2cf442c640 1 -- 172.21.15.146:0/533487776 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94168249294976] v31'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cec03d030 con 0x55a5410bff70 2024-09-18T01:45:25.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.348+0000 7f2cf3c2b640 1 -- 172.21.15.146:0/533487776 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v31'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ce4057030 con 0x7f2cec025b50 2024-09-18T01:45:25.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.349+0000 7f2cf7f37800 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94168249297472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5410c6e60 con 0x7f2cec025b50 2024-09-18T01:45:25.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.349+0000 7f2cf7f37800 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5410c88a0 con 0x55a5410b9cd0 2024-09-18T01:45:25.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.349+0000 7f2cf3c2b640 1 -- 172.21.15.146:0/533487776 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94168249297472] v31'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ce4057030 con 0x7f2cec025b50 2024-09-18T01:45:25.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.350+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v31'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cdc03b040 con 0x55a5410b9cd0 2024-09-18T01:45:25.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.350+0000 7f2cf7f37800 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94168249304048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5410c8810 con 0x55a5410b9cd0 2024-09-18T01:45:25.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.350+0000 7f2cf7f37800 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5410c9660 con 0x7f2ce409e040 2024-09-18T01:45:25.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.351+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v31'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cdc03b040 con 0x7f2ce409e040 2024-09-18T01:45:25.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.351+0000 7f2cf7f37800 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94168249307456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5410c9660 con 0x7f2ce409e040 2024-09-18T01:45:25.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.351+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94168249304048] v31'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cdc03b040 con 0x55a5410b9cd0 2024-09-18T01:45:25.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.351+0000 7f2cf7f37800 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5410ca3b0 con 0x7f2ce409e040 2024-09-18T01:45:25.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.352+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94168249307456] v31'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cdc03b040 con 0x7f2ce409e040 2024-09-18T01:45:25.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.352+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v31'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cdc03b040 con 0x7f2ce409e040 2024-09-18T01:45:25.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.352+0000 7f2cf7f37800 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94168249309264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5410ca120 con 0x7f2ce409e040 2024-09-18T01:45:25.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.352+0000 7f2cf7f37800 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5410ca9f0 con 0x7f2ce409e040 2024-09-18T01:45:25.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.353+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94168249309264] v31'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cdc03b040 con 0x7f2ce409e040 2024-09-18T01:45:25.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.353+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v31'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cdc03b040 con 0x7f2ce409e040 2024-09-18T01:45:25.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.353+0000 7f2cf7f37800 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94168249310320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5410cabd0 con 0x7f2ce409e040 2024-09-18T01:45:25.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.353+0000 7f2cf7f37800 20 add_watcher() i=0 2024-09-18T01:45:25.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.353+0000 7f2cf7f37800 20 add_watcher() i=1 2024-09-18T01:45:25.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.353+0000 7f2cf7f37800 20 add_watcher() i=2 2024-09-18T01:45:25.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.353+0000 7f2cf7f37800 20 add_watcher() i=3 2024-09-18T01:45:25.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.353+0000 7f2cf7f37800 20 add_watcher() i=4 2024-09-18T01:45:25.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.353+0000 7f2cf7f37800 20 add_watcher() i=5 2024-09-18T01:45:25.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.353+0000 7f2cf7f37800 20 add_watcher() i=6 2024-09-18T01:45:25.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.354+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94168249310320] v31'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cdc03b040 con 0x7f2ce409e040 2024-09-18T01:45:25.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.354+0000 7f2cf7f37800 20 add_watcher() i=7 2024-09-18T01:45:25.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.354+0000 7f2cf7f37800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:25.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.354+0000 7f2cf7f37800 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a5410cdfa0 con 0x55a5410b9cd0 2024-09-18T01:45:25.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.354+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2cdc03b040 con 0x55a5410b9cd0 2024-09-18T01:45:25.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.354+0000 7f2cf7f37800 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94168249313984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5410cb390 con 0x55a5410b9cd0 2024-09-18T01:45:25.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.355+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94168249313984] v31'92 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2cdc03b040 con 0x55a5410b9cd0 2024-09-18T01:45:25.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.355+0000 7f2ba9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:25.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.355+0000 7f2cf7f37800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:25.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.355+0000 7f2cf7f37800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:25.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.355+0000 7f2cf7f37800 5 note: GC not initialized 2024-09-18T01:45:25.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.355+0000 7f2ba8fe1640 20 reqs_thread_entry: start 2024-09-18T01:45:25.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.356+0000 7f2cf7f37800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:25.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.356+0000 7f2cf7f37800 20 Filter name: none 2024-09-18T01:45:25.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.356+0000 7f2b227fc640 20 reqs_thread_entry: start 2024-09-18T01:45:25.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.356+0000 7f2cf7f37800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T01:45:25.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.356+0000 7f2cf7f37800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.356+0000 7f2cf7f37800 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a541101220 con 0x55a5410b9cd0 2024-09-18T01:45:25.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.356+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f2cdc03b040 con 0x55a5410b9cd0 2024-09-18T01:45:25.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.356+0000 7f2cf7f37800 20 rados_obj.operate() r=0 bl.length=556 2024-09-18T01:45:25.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.356+0000 7f2cf7f37800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T01:45:25.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.356+0000 7f2cf7f37800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:45:25.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.356+0000 7f2cf7f37800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:45:25.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.356+0000 7f2cf7f37800 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a541107a10 con 0x55a5410b9cd0 2024-09-18T01:45:25.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.357+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v31'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f2cdc03b040 con 0x55a5410b9cd0 2024-09-18T01:45:25.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.357+0000 7f2cf7f37800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:45:25.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.357+0000 7f2cf7f37800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:45:25.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.357+0000 7f2cf7f37800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-18T01:45:25.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.357+0000 7f2cf7f37800 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94168249562096 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a5411030f0 con 0x55a5410b9cd0 2024-09-18T01:45:25.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.358+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== watch-notify(notify (1) cookie 94168249304048 notify 133143986186 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f2cdc018040 con 0x55a5410b9cd0 2024-09-18T01:45:25.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.358+0000 7f2bd2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986186 cookie 94168249304048 notifier 4425 bl.length()=567 2024-09-18T01:45:25.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.358+0000 7f2bd2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:45:25.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.358+0000 7f2bd2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:45:25.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.358+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(64 notify.4 [notify cookie 94168249562096 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2cdc03b040 con 0x55a5410b9cd0 2024-09-18T01:45:25.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.358+0000 7f2bd2ffd640 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f2bb8003ea0 con 0x55a5410b9cd0 2024-09-18T01:45:25.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.358+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cdc03b040 con 0x55a5410b9cd0 2024-09-18T01:45:25.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.358+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== watch-notify(notify_complete (2) cookie 94168249562096 notify 133143986186 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f2cdc004d50 con 0x55a5410b9cd0 2024-09-18T01:45:25.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.358+0000 7f2cf7f37800 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:66 8.2 8:45671577:users.swift::foo%3afoo2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5411073f0 con 0x7f2cec025b50 2024-09-18T01:45:25.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.359+0000 7f2cf3c2b640 1 -- 172.21.15.146:0/533487776 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(66 foo:foo2 [delete] v31'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ce4057030 con 0x7f2cec025b50 2024-09-18T01:45:25.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.359+0000 7f2cf7f37800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-18T01:45:25.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.359+0000 7f2cf7f37800 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94168249562096 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a541102c40 con 0x7f2cec025b50 2024-09-18T01:45:25.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.359+0000 7f2cf3c2b640 1 -- 172.21.15.146:0/533487776 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== watch-notify(notify (1) cookie 94168249288208 notify 133143986181 ret 0) ==== 201+0+0 (crc 0 0 0) 0x7f2ce4081070 con 0x7f2cec025b50 2024-09-18T01:45:25.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.359+0000 7f2bd27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986181 cookie 94168249288208 notifier 4425 bl.length()=159 2024-09-18T01:45:25.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.359+0000 7f2bd27fc640 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f2b280032c0 con 0x7f2cec025b50 2024-09-18T01:45:25.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.359+0000 7f2cf3c2b640 1 -- 172.21.15.146:0/533487776 <== osd.2 v2:172.21.15.146:6800/3820039304 14 ==== osd_op_reply(67 notify.0 [notify cookie 94168249562096 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2ce4057030 con 0x7f2cec025b50 2024-09-18T01:45:25.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.360+0000 7f2cf3c2b640 1 -- 172.21.15.146:0/533487776 <== osd.2 v2:172.21.15.146:6800/3820039304 15 ==== watch-notify(notify_complete (2) cookie 94168249562096 notify 133143986181 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a54107fc10 con 0x7f2cec025b50 2024-09-18T01:45:25.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.360+0000 7f2cf3c2b640 1 -- 172.21.15.146:0/533487776 <== osd.2 v2:172.21.15.146:6800/3820039304 16 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ce4057030 con 0x7f2cec025b50 2024-09-18T01:45:25.370 INFO:teuthology.orchestra.run.smithi146.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T01:45:23.010714Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:45:23.010705Z","tags":[],"group_ids":[]} 2024-09-18T01:45:25.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.361+0000 7f2ba9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:25.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.361+0000 7f2cf7f37800 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94168249313984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5410fef70 con 0x55a5410b9cd0 2024-09-18T01:45:25.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.362+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 <== osd.1 v2:172.21.15.146:6808/3930274777 28 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94168249313984] v31'93 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2cdc03b040 con 0x55a5410b9cd0 2024-09-18T01:45:25.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.362+0000 7f2cf7f37800 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94168249288208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5410fef70 con 0x7f2cec025b50 2024-09-18T01:45:25.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.363+0000 7f2cf3c2b640 1 -- 172.21.15.146:0/533487776 <== osd.2 v2:172.21.15.146:6800/3820039304 17 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94168249288208] v31'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ce4057030 con 0x7f2cec025b50 2024-09-18T01:45:25.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.363+0000 7f2cf7f37800 20 remove_watcher() i=0 2024-09-18T01:45:25.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.363+0000 7f2cf7f37800 2 removed watcher, disabling cache 2024-09-18T01:45:25.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.363+0000 7f2cf7f37800 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94168249293920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5410fef70 con 0x55a5410b9cd0 2024-09-18T01:45:25.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.364+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 <== osd.1 v2:172.21.15.146:6808/3930274777 29 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94168249293920] v31'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cdc03b040 con 0x55a5410b9cd0 2024-09-18T01:45:25.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.364+0000 7f2cf7f37800 20 remove_watcher() i=1 2024-09-18T01:45:25.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.364+0000 7f2cf7f37800 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94168249294976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5410fef70 con 0x55a5410bff70 2024-09-18T01:45:25.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.365+0000 7f2cf442c640 1 -- 172.21.15.146:0/533487776 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94168249294976] v31'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cec03d030 con 0x55a5410bff70 2024-09-18T01:45:25.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.365+0000 7f2cf7f37800 20 remove_watcher() i=2 2024-09-18T01:45:25.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.365+0000 7f2cf7f37800 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94168249297472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5410fef70 con 0x7f2cec025b50 2024-09-18T01:45:25.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.366+0000 7f2cf3c2b640 1 -- 172.21.15.146:0/533487776 <== osd.2 v2:172.21.15.146:6800/3820039304 18 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94168249297472] v31'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ce4057030 con 0x7f2cec025b50 2024-09-18T01:45:25.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.366+0000 7f2cf7f37800 20 remove_watcher() i=3 2024-09-18T01:45:25.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.366+0000 7f2cf7f37800 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94168249304048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5410fef70 con 0x55a5410b9cd0 2024-09-18T01:45:25.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.367+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 <== osd.1 v2:172.21.15.146:6808/3930274777 30 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94168249304048] v31'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cdc03b040 con 0x55a5410b9cd0 2024-09-18T01:45:25.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.367+0000 7f2cf7f37800 20 remove_watcher() i=4 2024-09-18T01:45:25.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.367+0000 7f2cf7f37800 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94168249307456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5410fef70 con 0x7f2ce409e040 2024-09-18T01:45:25.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.368+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94168249307456] v31'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cdc03b040 con 0x7f2ce409e040 2024-09-18T01:45:25.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.368+0000 7f2cf7f37800 20 remove_watcher() i=5 2024-09-18T01:45:25.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.368+0000 7f2cf7f37800 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94168249309264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5410fef70 con 0x7f2ce409e040 2024-09-18T01:45:25.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.369+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94168249309264] v31'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cdc03b040 con 0x7f2ce409e040 2024-09-18T01:45:25.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.369+0000 7f2cf7f37800 20 remove_watcher() i=6 2024-09-18T01:45:25.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.369+0000 7f2cf7f37800 1 -- 172.21.15.146:0/533487776 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94168249310320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5410fef70 con 0x7f2ce409e040 2024-09-18T01:45:25.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.370+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94168249310320] v31'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cdc03b040 con 0x7f2ce409e040 2024-09-18T01:45:25.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.370+0000 7f2cf7f37800 20 remove_watcher() i=7 2024-09-18T01:45:25.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.370+0000 7f2cf7f37800 1 -- 172.21.15.146:0/533487776 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f2ce409e040 msgr2=0x7f2ce40505c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.370+0000 7f2cf7f37800 1 --2- 172.21.15.146:0/533487776 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f2ce409e040 0x7f2ce40505c0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.370+0000 7f2cf7f37800 1 -- 172.21.15.146:0/533487776 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a5410b9cd0 msgr2=0x55a5410bc190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.370+0000 7f2cf7f37800 1 --2- 172.21.15.146:0/533487776 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a5410b9cd0 0x55a5410bc190 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.370+0000 7f2cf7f37800 1 -- 172.21.15.146:0/533487776 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f2cec025b50 msgr2=0x7f2cec04e6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.370+0000 7f2cf7f37800 1 --2- 172.21.15.146:0/533487776 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f2cec025b50 0x7f2cec04e6c0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.370+0000 7f2cf7f37800 1 -- 172.21.15.146:0/533487776 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55a5410bff70 msgr2=0x55a5410c2380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.370+0000 7f2cf7f37800 1 --2- 172.21.15.146:0/533487776 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55a5410bff70 0x55a5410c2380 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.370+0000 7f2cf7f37800 1 -- 172.21.15.146:0/533487776 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2bbc036af0 msgr2=0x7f2bbc038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.370+0000 7f2cf7f37800 1 --2- 172.21.15.146:0/533487776 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2bbc036af0 0x7f2bbc038fb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2ce408d520 tx=0x7f2ce4084000 comp rx=0 tx=0).stop 2024-09-18T01:45:25.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.370+0000 7f2cebfff640 1 -- 172.21.15.146:0/533487776 reap_dead start 2024-09-18T01:45:25.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.370+0000 7f2cf7f37800 1 -- 172.21.15.146:0/533487776 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a5410a6b90 msgr2=0x55a5410adfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.370+0000 7f2cf7f37800 1 --2- 172.21.15.146:0/533487776 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a5410a6b90 0x55a5410adfd0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2cec04c850 tx=0x7f2cec04c880 comp rx=0 tx=0).stop 2024-09-18T01:45:25.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.370+0000 7f2cf7f37800 1 -- 172.21.15.146:0/533487776 shutdown_connections 2024-09-18T01:45:25.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.370+0000 7f2cf7f37800 1 --2- 172.21.15.146:0/533487776 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a5410a6b90 0x55a5410adfd0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.370+0000 7f2cf7f37800 1 -- 172.21.15.146:0/533487776 >> 172.21.15.146:0/533487776 conn(0x55a5410a2ef0 msgr2=0x55a5410a0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:25.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.370+0000 7f2cf7f37800 1 -- 172.21.15.146:0/533487776 shutdown_connections 2024-09-18T01:45:25.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.370+0000 7f2cf7f37800 1 -- 172.21.15.146:0/533487776 wait complete. 2024-09-18T01:45:25.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.371+0000 7f2cf7f37800 1 -- 172.21.15.146:0/3549219614 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2bcc036b40 msgr2=0x7f2bcc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.371+0000 7f2cf7f37800 1 --2- 172.21.15.146:0/3549219614 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2bcc036b40 0x7f2bcc039000 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x55a541087b50 tx=0x7f2ce408e6d0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.371+0000 7f2cf7f37800 1 -- 172.21.15.146:0/3549219614 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a541099ea0 msgr2=0x55a54109a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.371+0000 7f2cf7f37800 1 --2- 172.21.15.146:0/3549219614 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a541099ea0 0x55a54109a2c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x55a54107ffd0 tx=0x7f2cec0178e0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.371+0000 7f2cf7f37800 1 -- 172.21.15.146:0/3549219614 shutdown_connections 2024-09-18T01:45:25.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.371+0000 7f2cf7f37800 1 --2- 172.21.15.146:0/3549219614 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2bcc036b40 0x7f2bcc039000 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.371+0000 7f2cf7f37800 1 --2- 172.21.15.146:0/3549219614 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a541099ea0 0x55a54109a2c0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.371+0000 7f2cf7f37800 1 -- 172.21.15.146:0/3549219614 >> 172.21.15.146:0/3549219614 conn(0x55a54108ee30 msgr2=0x55a5410919b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:25.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.371+0000 7f2cf7f37800 1 -- 172.21.15.146:0/3549219614 shutdown_connections 2024-09-18T01:45:25.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.371+0000 7f2cf7f37800 1 -- 172.21.15.146:0/3549219614 wait complete. 2024-09-18T01:45:25.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.371+0000 7f2cf7f37800 1 -- 172.21.15.146:0/2647267765 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a540f8bbd0 msgr2=0x55a541086220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.371+0000 7f2cf7f37800 1 --2- 172.21.15.146:0/2647267765 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a540f8bbd0 0x55a541086220 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.371+0000 7f2cf7f37800 1 -- 172.21.15.146:0/2647267765 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55a541089930 msgr2=0x55a54108bd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.371+0000 7f2cf7f37800 1 --2- 172.21.15.146:0/2647267765 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55a541089930 0x55a54108bd20 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.371+0000 7f2cf7f37800 1 -- 172.21.15.146:0/2647267765 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2bdc036b40 msgr2=0x7f2bdc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.371+0000 7f2cf7f37800 1 --2- 172.21.15.146:0/2647267765 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2bdc036b40 0x7f2bdc039000 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc000c00 tx=0x7f2cdc0013b0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.371+0000 7f2cf7f37800 1 -- 172.21.15.146:0/2647267765 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a540efa630 msgr2=0x55a54107f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.371+0000 7f2cf7f37800 1 --2- 172.21.15.146:0/2647267765 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a540efa630 0x55a54107f1b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2ce40460a0 tx=0x7f2ce4003020 comp rx=0 tx=0).stop 2024-09-18T01:45:25.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.371+0000 7f2cf7f37800 1 -- 172.21.15.146:0/2647267765 shutdown_connections 2024-09-18T01:45:25.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.371+0000 7f2cf7f37800 1 --2- 172.21.15.146:0/2647267765 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55a541089930 0x55a54108bd20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.371+0000 7f2cf7f37800 1 --2- 172.21.15.146:0/2647267765 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a540f8bbd0 0x55a541086220 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.371+0000 7f2cf7f37800 1 --2- 172.21.15.146:0/2647267765 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2bdc036b40 0x7f2bdc039000 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.371+0000 7f2cf7f37800 1 --2- 172.21.15.146:0/2647267765 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a540efa630 0x55a54107f1b0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.371+0000 7f2cf7f37800 1 -- 172.21.15.146:0/2647267765 >> 172.21.15.146:0/2647267765 conn(0x55a540f80e00 msgr2=0x55a541071a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:25.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.371+0000 7f2cf7f37800 1 -- 172.21.15.146:0/2647267765 shutdown_connections 2024-09-18T01:45:25.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.371+0000 7f2cf7f37800 1 -- 172.21.15.146:0/2647267765 wait complete. 2024-09-18T01:45:25.383 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T01:45:23.010714Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:45:23.010705Z', 'tags': [], 'group_ids': []} 2024-09-18T01:45:25.384 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-18T01:45:25.384 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-18T01:45:25.384 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-18T01:45:25.428 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:25.428 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:25.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.428+0000 7fb413323800 1 Processor -- start 2024-09-18T01:45:25.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.429+0000 7fb413323800 1 -- start start 2024-09-18T01:45:25.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.429+0000 7fb413323800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x561723937760 0x561723937b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.429+0000 7fb413323800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5617237f6b30 con 0x5617239380a0 2024-09-18T01:45:25.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.429+0000 7fb413323800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x5617237d8360 con 0x561723937760 2024-09-18T01:45:25.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.429+0000 7fb40f055640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x561723937760 0x561723937b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.429+0000 7fb40e854640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x5617239380a0 0x56172393cae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:38886/0 (socket says 172.21.15.146:38886) 2024-09-18T01:45:25.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.429+0000 7fb40e854640 1 -- 172.21.15.146:0/2863185807 learned_addr learned my addr 172.21.15.146:0/2863185807 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:45:25.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.429+0000 7fb40f055640 1 -- 172.21.15.146:0/2863185807 >> v1:172.21.15.129:6789/0 conn(0x5617239380a0 legacy=0x56172393cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.429+0000 7fb40f055640 1 -- 172.21.15.146:0/2863185807 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617237fee00 con 0x561723937760 2024-09-18T01:45:25.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.429+0000 7fb40e053640 1 -- 172.21.15.146:0/2863185807 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3581947945 0 0) 0x5617237f6b30 con 0x5617239380a0 2024-09-18T01:45:25.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.431+0000 7fb40f055640 1 --2- 172.21.15.146:0/2863185807 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561723937760 0x561723937b60 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb40000a470 tx=0x7fb400045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22369b04551c818c server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.431+0000 7fb40e053640 1 -- 172.21.15.146:0/2863185807 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb400053570 con 0x561723937760 2024-09-18T01:45:25.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.431+0000 7fb40e053640 1 -- 172.21.15.146:0/2863185807 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb400058070 con 0x561723937760 2024-09-18T01:45:25.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.431+0000 7fb40e053640 1 -- 172.21.15.146:0/2863185807 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb400053880 con 0x561723937760 2024-09-18T01:45:25.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.432+0000 7fb413323800 1 -- 172.21.15.146:0/2863185807 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561723937760 msgr2=0x561723937b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.432+0000 7fb413323800 1 --2- 172.21.15.146:0/2863185807 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561723937760 0x561723937b60 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb40000a470 tx=0x7fb400045a20 comp rx=0 tx=0).stop 2024-09-18T01:45:25.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.432+0000 7fb413323800 1 -- 172.21.15.146:0/2863185807 shutdown_connections 2024-09-18T01:45:25.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.432+0000 7fb413323800 1 --2- 172.21.15.146:0/2863185807 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561723937760 0x561723937b60 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.432+0000 7fb413323800 1 -- 172.21.15.146:0/2863185807 >> 172.21.15.146:0/2863185807 conn(0x561723932ff0 msgr2=0x561723935410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:25.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.432+0000 7fb413323800 1 -- 172.21.15.146:0/2863185807 shutdown_connections 2024-09-18T01:45:25.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.432+0000 7fb413323800 1 -- 172.21.15.146:0/2863185807 wait complete. 2024-09-18T01:45:25.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.445+0000 7fb413323800 1 Processor -- start 2024-09-18T01:45:25.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.445+0000 7fb413323800 1 -- start start 2024-09-18T01:45:25.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.445+0000 7fb413323800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561723937760 0x561723a26660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.445+0000 7fb413323800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x561723883330 con 0x561723937760 2024-09-18T01:45:25.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.445+0000 7fb40f055640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561723937760 0x561723a26660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.445+0000 7fb40f055640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561723937760 0x561723a26660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60444/0 (socket says 172.21.15.146:60444) 2024-09-18T01:45:25.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.445+0000 7fb40f055640 1 -- 172.21.15.146:0/4002376221 learned_addr learned my addr 172.21.15.146:0/4002376221 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:25.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.446+0000 7fb40f055640 1 -- 172.21.15.146:0/4002376221 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617237d0bc0 con 0x561723937760 2024-09-18T01:45:25.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.446+0000 7fb40f055640 1 --2- 172.21.15.146:0/4002376221 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561723937760 0x561723a26660 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fb400045f50 tx=0x7fb400051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7074fb785eaaa10 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.446+0000 7fb2fd60a640 1 -- 172.21.15.146:0/4002376221 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb400053c20 con 0x561723937760 2024-09-18T01:45:25.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.446+0000 7fb2fd60a640 1 -- 172.21.15.146:0/4002376221 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb400063030 con 0x561723937760 2024-09-18T01:45:25.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.446+0000 7fb2fd60a640 1 -- 172.21.15.146:0/4002376221 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb400053440 con 0x561723937760 2024-09-18T01:45:25.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.447+0000 7fb413323800 1 -- 172.21.15.146:0/4002376221 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561723937760 msgr2=0x561723a26660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.447+0000 7fb413323800 1 --2- 172.21.15.146:0/4002376221 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561723937760 0x561723a26660 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fb400045f50 tx=0x7fb400051000 comp rx=0 tx=0).stop 2024-09-18T01:45:25.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.447+0000 7fb413323800 1 -- 172.21.15.146:0/4002376221 shutdown_connections 2024-09-18T01:45:25.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.447+0000 7fb413323800 1 --2- 172.21.15.146:0/4002376221 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561723937760 0x561723a26660 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.447+0000 7fb413323800 1 -- 172.21.15.146:0/4002376221 >> 172.21.15.146:0/4002376221 conn(0x561723932ff0 msgr2=0x561723a22020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:25.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.447+0000 7fb413323800 1 -- 172.21.15.146:0/4002376221 shutdown_connections 2024-09-18T01:45:25.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.447+0000 7fb413323800 1 -- 172.21.15.146:0/4002376221 wait complete. 2024-09-18T01:45:25.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.447+0000 7fb413323800 1 Processor -- start 2024-09-18T01:45:25.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.447+0000 7fb413323800 1 -- start start 2024-09-18T01:45:25.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.447+0000 7fb413323800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561723937760 0x561723a2dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.447+0000 7fb413323800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x56172393e640 con 0x561723937760 2024-09-18T01:45:25.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.448+0000 7fb40f055640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561723937760 0x561723a2dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.448+0000 7fb40f055640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561723937760 0x561723a2dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60450/0 (socket says 172.21.15.146:60450) 2024-09-18T01:45:25.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.448+0000 7fb40f055640 1 -- 172.21.15.146:0/984387802 learned_addr learned my addr 172.21.15.146:0/984387802 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:25.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.448+0000 7fb40f055640 1 -- 172.21.15.146:0/984387802 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617237e4fe0 con 0x561723937760 2024-09-18T01:45:25.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.448+0000 7fb40f055640 1 --2- 172.21.15.146:0/984387802 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561723937760 0x561723a2dff0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb400045f20 tx=0x7fb400002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.448+0000 7fb2fbe07640 1 -- 172.21.15.146:0/984387802 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb400053570 con 0x561723937760 2024-09-18T01:45:25.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.448+0000 7fb2fbe07640 1 -- 172.21.15.146:0/984387802 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb400053710 con 0x561723937760 2024-09-18T01:45:25.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.448+0000 7fb2fbe07640 1 -- 172.21.15.146:0/984387802 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb400068420 con 0x561723937760 2024-09-18T01:45:25.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.448+0000 7fb413323800 1 -- 172.21.15.146:0/984387802 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561723a2e530 con 0x561723937760 2024-09-18T01:45:25.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.448+0000 7fb413323800 1 -- 172.21.15.146:0/984387802 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561723a2e9d0 con 0x561723937760 2024-09-18T01:45:25.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.449+0000 7fb2fbe07640 1 -- 172.21.15.146:0/984387802 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb400068610 con 0x561723937760 2024-09-18T01:45:25.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.449+0000 7fb2fbe07640 1 --2- 172.21.15.146:0/984387802 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb2f4036b40 0x7fb2f4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.449+0000 7fb2fbe07640 1 -- 172.21.15.146:0/984387802 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fb400070070 con 0x561723937760 2024-09-18T01:45:25.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.449+0000 7fb40e854640 1 --2- 172.21.15.146:0/984387802 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb2f4036b40 0x7fb2f4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.449+0000 7fb413323800 1 --2- 172.21.15.146:0/984387802 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5617239380a0 0x561723a35060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.449+0000 7fb413323800 1 -- 172.21.15.146:0/984387802 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561723a355a0 con 0x5617239380a0 2024-09-18T01:45:25.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.450+0000 7fb40f856640 1 --2- 172.21.15.146:0/984387802 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5617239380a0 0x561723a35060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.450+0000 7fb40e854640 1 --2- 172.21.15.146:0/984387802 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb2f4036b40 0x7fb2f4039000 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8000c00 tx=0x7fb3f80013b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.450+0000 7fb40f856640 1 --2- 172.21.15.146:0/984387802 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5617239380a0 0x561723a35060 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.450+0000 7fb40f856640 1 -- 172.21.15.146:0/984387802 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb40800a4a0 con 0x5617239380a0 2024-09-18T01:45:25.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.450+0000 7fb413323800 1 -- 172.21.15.146:0/984387802 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561723a359d0 con 0x5617239380a0 2024-09-18T01:45:25.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.450+0000 7fb40f856640 1 -- 172.21.15.146:0/984387802 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb40800a4a0 con 0x5617239380a0 2024-09-18T01:45:25.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.450+0000 7fb413323800 1 -- 172.21.15.146:0/984387802 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561723a372d0 con 0x5617239380a0 2024-09-18T01:45:25.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.451+0000 7fb40f856640 1 -- 172.21.15.146:0/984387802 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb40800a4a0 con 0x5617239380a0 2024-09-18T01:45:25.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.451+0000 7fb413323800 1 -- 172.21.15.146:0/984387802 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561723a363b0 con 0x5617239380a0 2024-09-18T01:45:25.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.451+0000 7fb40f856640 1 -- 172.21.15.146:0/984387802 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb40800a4a0 con 0x5617239380a0 2024-09-18T01:45:25.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.451+0000 7fb413323800 1 --2- 172.21.15.146:0/984387802 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x561723a36e50 0x561723a3a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.451+0000 7fb413323800 1 -- 172.21.15.146:0/984387802 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561723a3ae00 con 0x561723a36e50 2024-09-18T01:45:25.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.451+0000 7fb40f055640 1 --2- 172.21.15.146:0/984387802 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x561723a36e50 0x561723a3a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.451+0000 7fb40f055640 1 --2- 172.21.15.146:0/984387802 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x561723a36e50 0x561723a3a690 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.452+0000 7fb40f055640 1 -- 172.21.15.146:0/984387802 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb400051070 con 0x561723a36e50 2024-09-18T01:45:25.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.452+0000 7fb413323800 1 Processor -- start 2024-09-18T01:45:25.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.452+0000 7fb413323800 1 -- start start 2024-09-18T01:45:25.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.452+0000 7fb413323800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561723a48bb0 0x561723a48fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.452+0000 7fb413323800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5617237d2580 con 0x561723a48bb0 2024-09-18T01:45:25.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.453+0000 7fb40f856640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561723a48bb0 0x561723a48fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.453+0000 7fb40f856640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561723a48bb0 0x561723a48fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60454/0 (socket says 172.21.15.146:60454) 2024-09-18T01:45:25.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.453+0000 7fb40f856640 1 -- 172.21.15.146:0/1158492807 learned_addr learned my addr 172.21.15.146:0/1158492807 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:25.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.453+0000 7fb40f856640 1 -- 172.21.15.146:0/1158492807 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561723a49510 con 0x561723a48bb0 2024-09-18T01:45:25.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.453+0000 7fb40f856640 1 --2- 172.21.15.146:0/1158492807 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561723a48bb0 0x561723a48fd0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x561723a2f210 tx=0x7fb4080178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.453+0000 7fb2f9602640 1 -- 172.21.15.146:0/1158492807 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb408013440 con 0x561723a48bb0 2024-09-18T01:45:25.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.453+0000 7fb2f9602640 1 -- 172.21.15.146:0/1158492807 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4080135e0 con 0x561723a48bb0 2024-09-18T01:45:25.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.453+0000 7fb2f9602640 1 -- 172.21.15.146:0/1158492807 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4080138c0 con 0x561723a48bb0 2024-09-18T01:45:25.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.453+0000 7fb413323800 1 -- 172.21.15.146:0/1158492807 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561723a497a0 con 0x561723a48bb0 2024-09-18T01:45:25.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.453+0000 7fb413323800 1 -- 172.21.15.146:0/1158492807 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561723a4c480 con 0x561723a48bb0 2024-09-18T01:45:25.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.454+0000 7fb2f9602640 1 -- 172.21.15.146:0/1158492807 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb408011040 con 0x561723a48bb0 2024-09-18T01:45:25.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.454+0000 7fb2f9602640 1 --2- 172.21.15.146:0/1158492807 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb2e8036b40 0x7fb2e8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.454+0000 7fb2f9602640 1 -- 172.21.15.146:0/1158492807 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fb40801d070 con 0x561723a48bb0 2024-09-18T01:45:25.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.454+0000 7fb40f055640 1 --2- 172.21.15.146:0/1158492807 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb2e8036b40 0x7fb2e8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.454+0000 7fb413323800 1 Processor -- start 2024-09-18T01:45:25.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.454+0000 7fb413323800 1 -- start start 2024-09-18T01:45:25.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.455+0000 7fb40f055640 1 --2- 172.21.15.146:0/1158492807 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb2e8036b40 0x7fb2e8039000 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x561723a36750 tx=0x7fb40008f0e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.455+0000 7fb413323800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561723a55870 0x561723a55c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.455+0000 7fb413323800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x561723a26db0 con 0x561723a55870 2024-09-18T01:45:25.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.455+0000 7fb40f856640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561723a55870 0x561723a55c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.455+0000 7fb40f856640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561723a55870 0x561723a55c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60458/0 (socket says 172.21.15.146:60458) 2024-09-18T01:45:25.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.455+0000 7fb40f856640 1 -- 172.21.15.146:0/4162377625 learned_addr learned my addr 172.21.15.146:0/4162377625 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:25.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.455+0000 7fb40f856640 1 -- 172.21.15.146:0/4162377625 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561723a56240 con 0x561723a55870 2024-09-18T01:45:25.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.455+0000 7fb40f856640 1 --2- 172.21.15.146:0/4162377625 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561723a55870 0x561723a55c70 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb40804c920 tx=0x7fb408001f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6072ac338f45cc90 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.455+0000 7fb2f2ffd640 1 -- 172.21.15.146:0/4162377625 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb408012c90 con 0x561723a55870 2024-09-18T01:45:25.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.455+0000 7fb2f2ffd640 1 -- 172.21.15.146:0/4162377625 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb408012e30 con 0x561723a55870 2024-09-18T01:45:25.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.455+0000 7fb2f2ffd640 1 -- 172.21.15.146:0/4162377625 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb40804e240 con 0x561723a55870 2024-09-18T01:45:25.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.456+0000 7fb413323800 1 -- 172.21.15.146:0/4162377625 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561723a55870 msgr2=0x561723a55c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.456+0000 7fb413323800 1 --2- 172.21.15.146:0/4162377625 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561723a55870 0x561723a55c70 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb40804c920 tx=0x7fb408001f60 comp rx=0 tx=0).stop 2024-09-18T01:45:25.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.456+0000 7fb413323800 1 -- 172.21.15.146:0/4162377625 shutdown_connections 2024-09-18T01:45:25.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.456+0000 7fb413323800 1 --2- 172.21.15.146:0/4162377625 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561723a55870 0x561723a55c70 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.456+0000 7fb413323800 1 -- 172.21.15.146:0/4162377625 >> 172.21.15.146:0/4162377625 conn(0x561723a51c20 msgr2=0x561723a4fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:25.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.456+0000 7fb413323800 1 -- 172.21.15.146:0/4162377625 shutdown_connections 2024-09-18T01:45:25.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.456+0000 7fb413323800 1 -- 172.21.15.146:0/4162377625 wait complete. 2024-09-18T01:45:25.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.456+0000 7fb413323800 1 Processor -- start 2024-09-18T01:45:25.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.456+0000 7fb413323800 1 -- start start 2024-09-18T01:45:25.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.456+0000 7fb413323800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561723a55870 0x561723a5cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.456+0000 7fb413323800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x561723a56810 con 0x561723a55870 2024-09-18T01:45:25.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.457+0000 7fb40f856640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561723a55870 0x561723a5cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.457+0000 7fb40f856640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561723a55870 0x561723a5cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60460/0 (socket says 172.21.15.146:60460) 2024-09-18T01:45:25.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.457+0000 7fb40f856640 1 -- 172.21.15.146:0/362293871 learned_addr learned my addr 172.21.15.146:0/362293871 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:25.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.457+0000 7fb40f856640 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561723a5d1d0 con 0x561723a55870 2024-09-18T01:45:25.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.457+0000 7fb40f856640 1 --2- 172.21.15.146:0/362293871 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561723a55870 0x561723a5cc90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb408044040 tx=0x7fb40804c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.457+0000 7fb2f17fa640 1 -- 172.21.15.146:0/362293871 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb408046040 con 0x561723a55870 2024-09-18T01:45:25.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.457+0000 7fb2f17fa640 1 -- 172.21.15.146:0/362293871 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb408041050 con 0x561723a55870 2024-09-18T01:45:25.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.457+0000 7fb413323800 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561723a5d460 con 0x561723a55870 2024-09-18T01:45:25.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.457+0000 7fb2f17fa640 1 -- 172.21.15.146:0/362293871 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb408013c70 con 0x561723a55870 2024-09-18T01:45:25.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.457+0000 7fb413323800 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561723a60110 con 0x561723a55870 2024-09-18T01:45:25.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.458+0000 7fb2f17fa640 1 -- 172.21.15.146:0/362293871 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb40802aa60 con 0x561723a55870 2024-09-18T01:45:25.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.458+0000 7fb2f17fa640 1 --2- 172.21.15.146:0/362293871 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb2d8036b40 0x7fb2d8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.458+0000 7fb2f17fa640 1 -- 172.21.15.146:0/362293871 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fb408034070 con 0x561723a55870 2024-09-18T01:45:25.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.458+0000 7fb40f055640 1 --2- 172.21.15.146:0/362293871 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb2d8036b40 0x7fb2d8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.458+0000 7fb413323800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.459+0000 7fb413323800 1 --2- 172.21.15.146:0/362293871 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x561723a68920 0x561723a6ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.459+0000 7fb413323800 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561723a6b530 con 0x561723a68920 2024-09-18T01:45:25.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.459+0000 7fb40f055640 1 --2- 172.21.15.146:0/362293871 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb2d8036b40 0x7fb2d8039000 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x561723a3b200 tx=0x7fb40008c000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.459+0000 7fb40e854640 1 --2- 172.21.15.146:0/362293871 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x561723a68920 0x561723a6ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.459+0000 7fb40e854640 1 --2- 172.21.15.146:0/362293871 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x561723a68920 0x561723a6ade0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.459+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb3f800f5f0 con 0x561723a68920 2024-09-18T01:45:25.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.459+0000 7fb413323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:25.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.459+0000 7fb413323800 20 realm 2024-09-18T01:45:25.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.459+0000 7fb413323800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.459+0000 7fb413323800 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561723a67d70 con 0x561723a68920 2024-09-18T01:45:25.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.459+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb3f800f5f0 con 0x561723a68920 2024-09-18T01:45:25.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.459+0000 7fb413323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:25.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.459+0000 7fb413323800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:25.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.459+0000 7fb413323800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.459+0000 7fb413323800 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561723a6c010 con 0x561723a68920 2024-09-18T01:45:25.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.460+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb3f800f5f0 con 0x561723a68920 2024-09-18T01:45:25.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.460+0000 7fb413323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:25.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.460+0000 7fb413323800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.460+0000 7fb413323800 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561723a6c8e0 con 0x561723a68920 2024-09-18T01:45:25.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.460+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb3f800f5f0 con 0x561723a68920 2024-09-18T01:45:25.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.460+0000 7fb413323800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:25.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.460+0000 7fb413323800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.460+0000 7fb413323800 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561723a6cc80 con 0x561723a68920 2024-09-18T01:45:25.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.460+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb3f800f5f0 con 0x561723a68920 2024-09-18T01:45:25.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.460+0000 7fb413323800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:25.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.460+0000 7fb413323800 20 searching for the correct realm 2024-09-18T01:45:25.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.460+0000 7fb413323800 1 --2- 172.21.15.146:0/362293871 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x561723a6eb60 0x561723a70f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.460+0000 7fb413323800 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561723a71640 con 0x561723a6eb60 2024-09-18T01:45:25.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.460+0000 7fb40f856640 1 --2- 172.21.15.146:0/362293871 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x561723a6eb60 0x561723a70f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.461+0000 7fb40f856640 1 --2- 172.21.15.146:0/362293871 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x561723a6eb60 0x561723a70f70 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.461+0000 7fb40f856640 1 -- 172.21.15.146:0/362293871 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb40803e020 con 0x561723a6eb60 2024-09-18T01:45:25.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.461+0000 7fb40f856640 1 --2- 172.21.15.146:0/362293871 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fb408022640 0x7fb4080375a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.461+0000 7fb40f856640 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561723a71640 con 0x7fb408022640 2024-09-18T01:45:25.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.461+0000 7fb40f055640 1 --2- 172.21.15.146:0/362293871 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fb408022640 0x7fb4080375a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.461+0000 7fb40f055640 1 --2- 172.21.15.146:0/362293871 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fb408022640 0x7fb4080375a0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.462+0000 7fb40f055640 1 -- 172.21.15.146:0/362293871 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb40008a040 con 0x7fb408022640 2024-09-18T01:45:25.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.462+0000 7fb40f055640 1 --2- 172.21.15.146:0/362293871 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fb40005f040 0x7fb4000610e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.462+0000 7fb40f055640 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561723a71640 con 0x7fb40005f040 2024-09-18T01:45:25.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.462+0000 7fb40e854640 1 --2- 172.21.15.146:0/362293871 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fb40005f040 0x7fb4000610e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.462+0000 7fb40e854640 1 --2- 172.21.15.146:0/362293871 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fb40005f040 0x7fb4000610e0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.462+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3f800f5f0 con 0x7fb40005f040 2024-09-18T01:45:25.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.462+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561723a71640 con 0x561723a68920 2024-09-18T01:45:25.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.463+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb3f800f5f0 con 0x561723a68920 2024-09-18T01:45:25.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.463+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561723a71640 con 0x561723a68920 2024-09-18T01:45:25.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.463+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3f800f5f0 con 0x561723a68920 2024-09-18T01:45:25.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.463+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561723a71640 con 0x7fb40005f040 2024-09-18T01:45:25.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.463+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3f800f5f0 con 0x7fb40005f040 2024-09-18T01:45:25.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.463+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561723a71640 con 0x7fb40005f040 2024-09-18T01:45:25.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.463+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3f800f5f0 con 0x7fb40005f040 2024-09-18T01:45:25.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.463+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561723a71640 con 0x7fb408022640 2024-09-18T01:45:25.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.463+0000 7fb40f055640 1 -- 172.21.15.146:0/362293871 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb40008a040 con 0x7fb408022640 2024-09-18T01:45:25.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.463+0000 7fb40f055640 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561723a71640 con 0x561723a6eb60 2024-09-18T01:45:25.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.464+0000 7fb40f856640 1 -- 172.21.15.146:0/362293871 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb40803e020 con 0x561723a6eb60 2024-09-18T01:45:25.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.464+0000 7fb40f856640 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561723a71640 con 0x561723a68920 2024-09-18T01:45:25.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.464+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3f800f5f0 con 0x561723a68920 2024-09-18T01:45:25.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.464+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561723a71640 con 0x7fb40005f040 2024-09-18T01:45:25.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.464+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3f800f5f0 con 0x7fb40005f040 2024-09-18T01:45:25.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.464+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561723a71640 con 0x561723a68920 2024-09-18T01:45:25.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.464+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3f800f5f0 con 0x561723a68920 2024-09-18T01:45:25.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.464+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561723a71640 con 0x7fb408022640 2024-09-18T01:45:25.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.465+0000 7fb40f055640 1 -- 172.21.15.146:0/362293871 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fb40008a040 con 0x7fb408022640 2024-09-18T01:45:25.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.465+0000 7fb40f055640 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561723a71640 con 0x561723a6eb60 2024-09-18T01:45:25.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.465+0000 7fb40f856640 1 -- 172.21.15.146:0/362293871 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb40803e020 con 0x561723a6eb60 2024-09-18T01:45:25.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.465+0000 7fb40f856640 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561723a71640 con 0x561723a6eb60 2024-09-18T01:45:25.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.465+0000 7fb40f856640 1 -- 172.21.15.146:0/362293871 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb40803e020 con 0x561723a6eb60 2024-09-18T01:45:25.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.465+0000 7fb40f856640 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561723a71640 con 0x7fb40005f040 2024-09-18T01:45:25.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.465+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3f800f5f0 con 0x7fb40005f040 2024-09-18T01:45:25.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.465+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561723a71640 con 0x561723a6eb60 2024-09-18T01:45:25.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.466+0000 7fb40f856640 1 -- 172.21.15.146:0/362293871 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb40803e020 con 0x561723a6eb60 2024-09-18T01:45:25.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.466+0000 7fb40f856640 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561723a71640 con 0x561723a6eb60 2024-09-18T01:45:25.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.466+0000 7fb40f856640 1 -- 172.21.15.146:0/362293871 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb40803e020 con 0x561723a6eb60 2024-09-18T01:45:25.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.466+0000 7fb40f856640 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561723a71640 con 0x561723a68920 2024-09-18T01:45:25.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.466+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3f800f5f0 con 0x561723a68920 2024-09-18T01:45:25.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.466+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561723a71640 con 0x561723a68920 2024-09-18T01:45:25.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.466+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb3f800f5f0 con 0x561723a68920 2024-09-18T01:45:25.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.466+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561723a71640 con 0x7fb40005f040 2024-09-18T01:45:25.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.466+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3f800f5f0 con 0x7fb40005f040 2024-09-18T01:45:25.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.467+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561723a71640 con 0x561723a6eb60 2024-09-18T01:45:25.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.467+0000 7fb40f856640 1 -- 172.21.15.146:0/362293871 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb40803e020 con 0x561723a6eb60 2024-09-18T01:45:25.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.467+0000 7fb40f856640 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561723a71640 con 0x7fb408022640 2024-09-18T01:45:25.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.467+0000 7fb40f055640 1 -- 172.21.15.146:0/362293871 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb40008a040 con 0x7fb408022640 2024-09-18T01:45:25.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.467+0000 7fb40f055640 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561723a71640 con 0x561723a68920 2024-09-18T01:45:25.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.467+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3f800f5f0 con 0x561723a68920 2024-09-18T01:45:25.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.467+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561723a71640 con 0x7fb40005f040 2024-09-18T01:45:25.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.468+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3f803b040 con 0x7fb40005f040 2024-09-18T01:45:25.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.468+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561723a71640 con 0x561723a6eb60 2024-09-18T01:45:25.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.468+0000 7fb40f856640 1 -- 172.21.15.146:0/362293871 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb40803e020 con 0x561723a6eb60 2024-09-18T01:45:25.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.468+0000 7fb40f856640 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561723a71640 con 0x7fb40005f040 2024-09-18T01:45:25.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.468+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3f803b040 con 0x7fb40005f040 2024-09-18T01:45:25.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.468+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561723a71640 con 0x7fb408022640 2024-09-18T01:45:25.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.468+0000 7fb40f055640 1 -- 172.21.15.146:0/362293871 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb40008a040 con 0x7fb408022640 2024-09-18T01:45:25.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.468+0000 7fb40f055640 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561723a71640 con 0x561723a6eb60 2024-09-18T01:45:25.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.468+0000 7fb40f856640 1 -- 172.21.15.146:0/362293871 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb40803e020 con 0x561723a6eb60 2024-09-18T01:45:25.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.468+0000 7fb40f856640 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561723a71640 con 0x7fb40005f040 2024-09-18T01:45:25.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.469+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3f803b040 con 0x7fb40005f040 2024-09-18T01:45:25.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.469+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561723a71640 con 0x561723a68920 2024-09-18T01:45:25.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.469+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb3f803b040 con 0x561723a68920 2024-09-18T01:45:25.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.469+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561723a71640 con 0x7fb408022640 2024-09-18T01:45:25.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.469+0000 7fb40f055640 1 -- 172.21.15.146:0/362293871 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb40008a040 con 0x7fb408022640 2024-09-18T01:45:25.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.469+0000 7fb413323800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:25.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.469+0000 7fb413323800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:25.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.469+0000 7fb413323800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:25.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.469+0000 7fb413323800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:25.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.469+0000 7fb413323800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:25.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.469+0000 7fb413323800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:25.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.469+0000 7fb413323800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.469+0000 7fb413323800 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561723a6d600 con 0x561723a68920 2024-09-18T01:45:25.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.469+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb3f803b040 con 0x561723a68920 2024-09-18T01:45:25.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.469+0000 7fb413323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:25.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.469+0000 7fb413323800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.469+0000 7fb413323800 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561723a6dea0 con 0x561723a68920 2024-09-18T01:45:25.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.470+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb3f803b040 con 0x561723a68920 2024-09-18T01:45:25.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.470+0000 7fb413323800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:25.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.470+0000 7fb413323800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.470+0000 7fb413323800 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561723a6d240 con 0x7fb408022640 2024-09-18T01:45:25.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.470+0000 7fb40f055640 1 -- 172.21.15.146:0/362293871 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb40008a040 con 0x7fb408022640 2024-09-18T01:45:25.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.470+0000 7fb413323800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:25.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.470+0000 7fb413323800 20 zone default found 2024-09-18T01:45:25.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.470+0000 7fb413323800 4 Realm: () 2024-09-18T01:45:25.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.470+0000 7fb413323800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:25.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.470+0000 7fb413323800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:25.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.470+0000 7fb413323800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:25.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.470+0000 7fb413323800 20 zonegroup default 2024-09-18T01:45:25.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.470+0000 7fb413323800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.470+0000 7fb413323800 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561723a71ac0 con 0x7fb40005f040 2024-09-18T01:45:25.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.470+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb3f803b040 con 0x7fb40005f040 2024-09-18T01:45:25.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.470+0000 7fb413323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:25.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.470+0000 7fb413323800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.470+0000 7fb413323800 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561723a73950 con 0x561723a6eb60 2024-09-18T01:45:25.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.470+0000 7fb40f856640 1 -- 172.21.15.146:0/362293871 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb40803e020 con 0x561723a6eb60 2024-09-18T01:45:25.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.470+0000 7fb413323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:25.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.471+0000 7fb413323800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.471+0000 7fb413323800 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561723a73cf0 con 0x561723a6eb60 2024-09-18T01:45:25.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.471+0000 7fb40f856640 1 -- 172.21.15.146:0/362293871 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb40803e020 con 0x561723a6eb60 2024-09-18T01:45:25.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.471+0000 7fb413323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:25.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.471+0000 7fb413323800 20 started sync module instance, tier type = 2024-09-18T01:45:25.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.471+0000 7fb413323800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:25.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.471+0000 7fb413323800 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561723a72d90 con 0x7fb408022640 2024-09-18T01:45:25.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.472+0000 7fb40f055640 1 -- 172.21.15.146:0/362293871 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v31'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb40008a040 con 0x7fb408022640 2024-09-18T01:45:25.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.472+0000 7fb413323800 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94657382396288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561723a735a0 con 0x7fb408022640 2024-09-18T01:45:25.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.472+0000 7fb413323800 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561723a74a70 con 0x561723a68920 2024-09-18T01:45:25.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.473+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v31'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3f803b040 con 0x561723a68920 2024-09-18T01:45:25.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.473+0000 7fb413323800 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94657382401344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561723a75310 con 0x561723a68920 2024-09-18T01:45:25.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.473+0000 7fb413323800 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561723a75df0 con 0x561723a6eb60 2024-09-18T01:45:25.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.473+0000 7fb40f055640 1 -- 172.21.15.146:0/362293871 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94657382396288] v31'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb40008a040 con 0x7fb408022640 2024-09-18T01:45:25.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.474+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94657382401344] v31'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3f803b040 con 0x561723a68920 2024-09-18T01:45:25.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.474+0000 7fb40f856640 1 -- 172.21.15.146:0/362293871 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v31'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb40803e020 con 0x561723a6eb60 2024-09-18T01:45:25.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.474+0000 7fb413323800 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94657382406400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561723a74e60 con 0x561723a6eb60 2024-09-18T01:45:25.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.474+0000 7fb413323800 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561723a76690 con 0x7fb408022640 2024-09-18T01:45:25.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.475+0000 7fb40f055640 1 -- 172.21.15.146:0/362293871 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v31'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb40008a040 con 0x7fb408022640 2024-09-18T01:45:25.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.475+0000 7fb40f856640 1 -- 172.21.15.146:0/362293871 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94657382406400] v31'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb40803e020 con 0x561723a6eb60 2024-09-18T01:45:25.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.475+0000 7fb413323800 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94657382408672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561723a76ee0 con 0x7fb408022640 2024-09-18T01:45:25.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.475+0000 7fb413323800 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561723a74090 con 0x561723a68920 2024-09-18T01:45:25.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.476+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v31'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3f803b040 con 0x561723a68920 2024-09-18T01:45:25.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.476+0000 7fb413323800 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94657382412000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561723a777b0 con 0x561723a68920 2024-09-18T01:45:25.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.476+0000 7fb413323800 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561723a78170 con 0x7fb40005f040 2024-09-18T01:45:25.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.476+0000 7fb40f055640 1 -- 172.21.15.146:0/362293871 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94657382408672] v31'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb40008a040 con 0x7fb408022640 2024-09-18T01:45:25.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.477+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v31'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3f803b040 con 0x7fb40005f040 2024-09-18T01:45:25.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.477+0000 7fb413323800 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94657382410800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561723a78170 con 0x7fb40005f040 2024-09-18T01:45:25.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.477+0000 7fb413323800 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561723a78b30 con 0x7fb40005f040 2024-09-18T01:45:25.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.477+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94657382412000] v31'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3f803b040 con 0x561723a68920 2024-09-18T01:45:25.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.478+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94657382410800] v31'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3f803b040 con 0x7fb40005f040 2024-09-18T01:45:25.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.479+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v31'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3f803b040 con 0x7fb40005f040 2024-09-18T01:45:25.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.479+0000 7fb413323800 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94657382415552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561723a780e0 con 0x7fb40005f040 2024-09-18T01:45:25.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.479+0000 7fb413323800 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561723a78fe0 con 0x7fb40005f040 2024-09-18T01:45:25.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.480+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94657382415552] v31'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3f803b040 con 0x7fb40005f040 2024-09-18T01:45:25.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.480+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v31'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3f803b040 con 0x7fb40005f040 2024-09-18T01:45:25.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.480+0000 7fb413323800 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94657382418048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561723a78f50 con 0x7fb40005f040 2024-09-18T01:45:25.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.480+0000 7fb413323800 20 add_watcher() i=0 2024-09-18T01:45:25.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.480+0000 7fb413323800 20 add_watcher() i=1 2024-09-18T01:45:25.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.480+0000 7fb413323800 20 add_watcher() i=2 2024-09-18T01:45:25.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.480+0000 7fb413323800 20 add_watcher() i=3 2024-09-18T01:45:25.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.480+0000 7fb413323800 20 add_watcher() i=4 2024-09-18T01:45:25.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.480+0000 7fb413323800 20 add_watcher() i=5 2024-09-18T01:45:25.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.480+0000 7fb413323800 20 add_watcher() i=6 2024-09-18T01:45:25.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.481+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94657382418048] v31'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3f803b040 con 0x7fb40005f040 2024-09-18T01:45:25.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.481+0000 7fb413323800 20 add_watcher() i=7 2024-09-18T01:45:25.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.481+0000 7fb413323800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:25.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.481+0000 7fb413323800 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561723a7c350 con 0x561723a68920 2024-09-18T01:45:25.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.481+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb3f803b040 con 0x561723a68920 2024-09-18T01:45:25.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.481+0000 7fb413323800 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94657382419568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561723a79810 con 0x561723a68920 2024-09-18T01:45:25.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.482+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94657382419568] v31'94 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb3f803b040 con 0x561723a68920 2024-09-18T01:45:25.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.482+0000 7fb2c5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:25.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.482+0000 7fb413323800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:25.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.482+0000 7fb413323800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:25.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.482+0000 7fb413323800 5 note: GC not initialized 2024-09-18T01:45:25.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.483+0000 7fb2c4fe1640 20 reqs_thread_entry: start 2024-09-18T01:45:25.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.483+0000 7fb413323800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:25.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.483+0000 7fb413323800 20 Filter name: none 2024-09-18T01:45:25.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.483+0000 7fb23e7fc640 20 reqs_thread_entry: start 2024-09-18T01:45:25.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.483+0000 7fb413323800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.483+0000 7fb413323800 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561723aaf3a0 con 0x561723a68920 2024-09-18T01:45:25.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.484+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb3f803b040 con 0x561723a68920 2024-09-18T01:45:25.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.484+0000 7fb413323800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:45:25.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.484+0000 7fb413323800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.484+0000 7fb413323800 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561723aafd90 con 0x561723a68920 2024-09-18T01:45:25.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.484+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb3f803b040 con 0x561723a68920 2024-09-18T01:45:25.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.484+0000 7fb413323800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:45:25.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.484+0000 7fb413323800 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561723ab0da0 con 0x7fb408022640 2024-09-18T01:45:25.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.484+0000 7fb40f055640 1 -- 172.21.15.146:0/362293871 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7fb40008a040 con 0x7fb408022640 2024-09-18T01:45:25.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.485+0000 7fb2c5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:25.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.485+0000 7fb413323800 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94657382419568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561723aad170 con 0x561723a68920 2024-09-18T01:45:25.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.486+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94657382419568] v31'95 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb3f803b040 con 0x561723a68920 2024-09-18T01:45:25.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.486+0000 7fb413323800 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94657382396288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561723aad170 con 0x7fb408022640 2024-09-18T01:45:25.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.487+0000 7fb40f055640 1 -- 172.21.15.146:0/362293871 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94657382396288] v31'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb40008a040 con 0x7fb408022640 2024-09-18T01:45:25.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.487+0000 7fb413323800 20 remove_watcher() i=0 2024-09-18T01:45:25.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.487+0000 7fb413323800 2 removed watcher, disabling cache 2024-09-18T01:45:25.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.487+0000 7fb413323800 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94657382401344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561723aad170 con 0x561723a68920 2024-09-18T01:45:25.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.488+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94657382401344] v31'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3f803b040 con 0x561723a68920 2024-09-18T01:45:25.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.488+0000 7fb413323800 20 remove_watcher() i=1 2024-09-18T01:45:25.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.488+0000 7fb413323800 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94657382406400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561723aad170 con 0x561723a6eb60 2024-09-18T01:45:25.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.489+0000 7fb40f856640 1 -- 172.21.15.146:0/362293871 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94657382406400] v31'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb40803e020 con 0x561723a6eb60 2024-09-18T01:45:25.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.489+0000 7fb413323800 20 remove_watcher() i=2 2024-09-18T01:45:25.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.489+0000 7fb413323800 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94657382408672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561723aad170 con 0x7fb408022640 2024-09-18T01:45:25.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.490+0000 7fb40f055640 1 -- 172.21.15.146:0/362293871 <== osd.2 v2:172.21.15.146:6800/3820039304 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94657382408672] v31'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb40008a040 con 0x7fb408022640 2024-09-18T01:45:25.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.490+0000 7fb413323800 20 remove_watcher() i=3 2024-09-18T01:45:25.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.490+0000 7fb413323800 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94657382412000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561723aad170 con 0x561723a68920 2024-09-18T01:45:25.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.491+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94657382412000] v31'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3f803b040 con 0x561723a68920 2024-09-18T01:45:25.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.491+0000 7fb413323800 20 remove_watcher() i=4 2024-09-18T01:45:25.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.491+0000 7fb413323800 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94657382410800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561723aad170 con 0x7fb40005f040 2024-09-18T01:45:25.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.492+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94657382410800] v31'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3f803b040 con 0x7fb40005f040 2024-09-18T01:45:25.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.492+0000 7fb413323800 20 remove_watcher() i=5 2024-09-18T01:45:25.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.492+0000 7fb413323800 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94657382415552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561723aad170 con 0x7fb40005f040 2024-09-18T01:45:25.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.493+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94657382415552] v31'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3f803b040 con 0x7fb40005f040 2024-09-18T01:45:25.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.493+0000 7fb413323800 20 remove_watcher() i=6 2024-09-18T01:45:25.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.493+0000 7fb413323800 1 -- 172.21.15.146:0/362293871 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94657382418048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561723aad170 con 0x7fb40005f040 2024-09-18T01:45:25.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.494+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94657382418048] v31'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3f803b040 con 0x7fb40005f040 2024-09-18T01:45:25.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.494+0000 7fb413323800 20 remove_watcher() i=7 2024-09-18T01:45:25.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.494+0000 7fb413323800 1 -- 172.21.15.146:0/362293871 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fb40005f040 msgr2=0x7fb4000610e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.494+0000 7fb413323800 1 --2- 172.21.15.146:0/362293871 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fb40005f040 0x7fb4000610e0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.494+0000 7fb413323800 1 -- 172.21.15.146:0/362293871 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x561723a68920 msgr2=0x561723a6ade0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.494+0000 7fb413323800 1 --2- 172.21.15.146:0/362293871 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x561723a68920 0x561723a6ade0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.494+0000 7fb413323800 1 -- 172.21.15.146:0/362293871 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fb408022640 msgr2=0x7fb4080375a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.494+0000 7fb413323800 1 --2- 172.21.15.146:0/362293871 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fb408022640 0x7fb4080375a0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.494+0000 7fb413323800 1 -- 172.21.15.146:0/362293871 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x561723a6eb60 msgr2=0x561723a70f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.494+0000 7fb413323800 1 --2- 172.21.15.146:0/362293871 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x561723a6eb60 0x561723a70f70 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.494+0000 7fb413323800 1 -- 172.21.15.146:0/362293871 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb2d8036b40 msgr2=0x7fb2d8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.494+0000 7fb413323800 1 --2- 172.21.15.146:0/362293871 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb2d8036b40 0x7fb2d8039000 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x561723a3b200 tx=0x7fb40008c000 comp rx=0 tx=0).stop 2024-09-18T01:45:25.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.494+0000 7fb413323800 1 -- 172.21.15.146:0/362293871 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561723a55870 msgr2=0x561723a5cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.494+0000 7fb413323800 1 --2- 172.21.15.146:0/362293871 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561723a55870 0x561723a5cc90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb408044040 tx=0x7fb40804c880 comp rx=0 tx=0).stop 2024-09-18T01:45:25.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.494+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 reap_dead start 2024-09-18T01:45:25.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.494+0000 7fb40e854640 1 -- 172.21.15.146:0/362293871 reap_dead start 2024-09-18T01:45:25.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.494+0000 7fb413323800 1 -- 172.21.15.146:0/362293871 shutdown_connections 2024-09-18T01:45:25.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.494+0000 7fb413323800 1 -- 172.21.15.146:0/362293871 >> 172.21.15.146:0/362293871 conn(0x561723a51c20 msgr2=0x561723a56f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:25.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.494+0000 7fb413323800 1 -- 172.21.15.146:0/362293871 shutdown_connections 2024-09-18T01:45:25.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.494+0000 7fb413323800 1 -- 172.21.15.146:0/362293871 wait complete. 2024-09-18T01:45:25.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.494+0000 7fb413323800 1 -- 172.21.15.146:0/1158492807 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb2e8036b40 msgr2=0x7fb2e8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.494+0000 7fb413323800 1 --2- 172.21.15.146:0/1158492807 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb2e8036b40 0x7fb2e8039000 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x561723a36750 tx=0x7fb40008f0e0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.494+0000 7fb413323800 1 -- 172.21.15.146:0/1158492807 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561723a48bb0 msgr2=0x561723a48fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.494+0000 7fb413323800 1 --2- 172.21.15.146:0/1158492807 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561723a48bb0 0x561723a48fd0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x561723a2f210 tx=0x7fb4080178e0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.494+0000 7fb413323800 1 -- 172.21.15.146:0/1158492807 shutdown_connections 2024-09-18T01:45:25.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.494+0000 7fb413323800 1 --2- 172.21.15.146:0/1158492807 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb2e8036b40 0x7fb2e8039000 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.494+0000 7fb413323800 1 --2- 172.21.15.146:0/1158492807 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561723a48bb0 0x561723a48fd0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.494+0000 7fb413323800 1 -- 172.21.15.146:0/1158492807 >> 172.21.15.146:0/1158492807 conn(0x561723a3db40 msgr2=0x561723a406c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:25.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.494+0000 7fb413323800 1 -- 172.21.15.146:0/1158492807 shutdown_connections 2024-09-18T01:45:25.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.495+0000 7fb413323800 1 -- 172.21.15.146:0/1158492807 wait complete. 2024-09-18T01:45:25.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.495+0000 7fb413323800 1 -- 172.21.15.146:0/984387802 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5617239380a0 msgr2=0x561723a35060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.495+0000 7fb413323800 1 --2- 172.21.15.146:0/984387802 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5617239380a0 0x561723a35060 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.495+0000 7fb413323800 1 -- 172.21.15.146:0/984387802 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x561723a36e50 msgr2=0x561723a3a690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.495+0000 7fb413323800 1 --2- 172.21.15.146:0/984387802 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x561723a36e50 0x561723a3a690 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.495+0000 7fb413323800 1 -- 172.21.15.146:0/984387802 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb2f4036b40 msgr2=0x7fb2f4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.495+0000 7fb413323800 1 --2- 172.21.15.146:0/984387802 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb2f4036b40 0x7fb2f4039000 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8000c00 tx=0x7fb3f80013b0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.495+0000 7fb413323800 1 -- 172.21.15.146:0/984387802 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561723937760 msgr2=0x561723a2dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.495+0000 7fb413323800 1 --2- 172.21.15.146:0/984387802 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561723937760 0x561723a2dff0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb400045f20 tx=0x7fb400002fb0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.495+0000 7fb413323800 1 -- 172.21.15.146:0/984387802 shutdown_connections 2024-09-18T01:45:25.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.495+0000 7fb413323800 1 --2- 172.21.15.146:0/984387802 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x561723a36e50 0x561723a3a690 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.495+0000 7fb413323800 1 --2- 172.21.15.146:0/984387802 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5617239380a0 0x561723a35060 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.495+0000 7fb413323800 1 --2- 172.21.15.146:0/984387802 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb2f4036b40 0x7fb2f4039000 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.495+0000 7fb413323800 1 --2- 172.21.15.146:0/984387802 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561723937760 0x561723a2dff0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.495+0000 7fb413323800 1 -- 172.21.15.146:0/984387802 >> 172.21.15.146:0/984387802 conn(0x561723932ff0 msgr2=0x561723a20890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:25.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.495+0000 7fb413323800 1 -- 172.21.15.146:0/984387802 shutdown_connections 2024-09-18T01:45:25.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.495+0000 7fb413323800 1 -- 172.21.15.146:0/984387802 wait complete. 2024-09-18T01:45:25.507 INFO:teuthology.orchestra.run.smithi146.stdout:[] 2024-09-18T01:45:25.507 DEBUG:tasks.util.rgw: json result: [] 2024-09-18T01:45:25.507 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-18T01:45:25.508 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-18T01:45:25.508 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-18T01:45:25.552 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:25.552 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:25.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.552+0000 7fb0ea40f800 1 Processor -- start 2024-09-18T01:45:25.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.552+0000 7fb0ea40f800 1 -- start start 2024-09-18T01:45:25.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.553+0000 7fb0ea40f800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x565417fb0900 0x565417fb2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.553+0000 7fb0ea40f800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x565417e6cb30 con 0x565417fac4c0 2024-09-18T01:45:25.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.553+0000 7fb0ea40f800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x565417e4e360 con 0x565417fb0900 2024-09-18T01:45:25.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.553+0000 7fb0dd33c640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x565417fb0900 0x565417fb2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.553+0000 7fb0dd33c640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x565417fb0900 0x565417fb2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60470/0 (socket says 172.21.15.146:60470) 2024-09-18T01:45:25.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.553+0000 7fb0dd33c640 1 -- 172.21.15.146:0/1319514721 learned_addr learned my addr 172.21.15.146:0/1319514721 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:25.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.553+0000 7fb0e5b3d640 1 --1- 172.21.15.146:0/1319514721 >> v1:172.21.15.129:6789/0 conn(0x565417fac4c0 0x565417fac8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:38888/0 (socket says 172.21.15.146:38888) 2024-09-18T01:45:25.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.553+0000 7fb0dd33c640 1 -- 172.21.15.146:0/1319514721 >> v1:172.21.15.129:6789/0 conn(0x565417fac4c0 legacy=0x565417fac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.553+0000 7fb0dd33c640 1 -- 172.21.15.146:0/1319514721 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x565417e74e00 con 0x565417fb0900 2024-09-18T01:45:25.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.555+0000 7fb0dd33c640 1 --2- 172.21.15.146:0/1319514721 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x565417fb0900 0x565417fb2cf0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb0d000a520 tx=0x7fb0d0045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f86541979de0feb server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.555+0000 7fb0e533c640 1 -- 172.21.15.146:0/1319514721 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0d0055070 con 0x565417fb0900 2024-09-18T01:45:25.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.555+0000 7fb0e533c640 1 -- 172.21.15.146:0/1319514721 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0d00515b0 con 0x565417fb0900 2024-09-18T01:45:25.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.555+0000 7fb0e533c640 1 -- 172.21.15.146:0/1319514721 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0d00518d0 con 0x565417fb0900 2024-09-18T01:45:25.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.555+0000 7fb0ea40f800 1 -- 172.21.15.146:0/1319514721 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x565417fb0900 msgr2=0x565417fb2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.555+0000 7fb0ea40f800 1 --2- 172.21.15.146:0/1319514721 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x565417fb0900 0x565417fb2cf0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb0d000a520 tx=0x7fb0d0045ba0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.555+0000 7fb0ea40f800 1 -- 172.21.15.146:0/1319514721 shutdown_connections 2024-09-18T01:45:25.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.555+0000 7fb0ea40f800 1 --2- 172.21.15.146:0/1319514721 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x565417fb0900 0x565417fb2cf0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.555+0000 7fb0ea40f800 1 -- 172.21.15.146:0/1319514721 >> 172.21.15.146:0/1319514721 conn(0x565417fa7df0 msgr2=0x565417faa210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:25.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.556+0000 7fb0ea40f800 1 -- 172.21.15.146:0/1319514721 shutdown_connections 2024-09-18T01:45:25.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.556+0000 7fb0ea40f800 1 -- 172.21.15.146:0/1319514721 wait complete. 2024-09-18T01:45:25.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.569+0000 7fb0ea40f800 1 Processor -- start 2024-09-18T01:45:25.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.569+0000 7fb0ea40f800 1 -- start start 2024-09-18T01:45:25.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.569+0000 7fb0ea40f800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x565417fac4c0 0x56541809a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.569+0000 7fb0ea40f800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x565417ef9330 con 0x565417fac4c0 2024-09-18T01:45:25.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.570+0000 7fb0e5b3d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x565417fac4c0 0x56541809a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.570+0000 7fb0e5b3d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x565417fac4c0 0x56541809a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60472/0 (socket says 172.21.15.146:60472) 2024-09-18T01:45:25.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.570+0000 7fb0e5b3d640 1 -- 172.21.15.146:0/2842881520 learned_addr learned my addr 172.21.15.146:0/2842881520 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:25.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.570+0000 7fb0e5b3d640 1 -- 172.21.15.146:0/2842881520 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565417e46bc0 con 0x565417fac4c0 2024-09-18T01:45:25.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.570+0000 7fb0e5b3d640 1 --2- 172.21.15.146:0/2842881520 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x565417fac4c0 0x56541809a640 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb0d800d520 tx=0x7fb0d800d9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c050bdf7688fa427 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.570+0000 7fafd3e07640 1 -- 172.21.15.146:0/2842881520 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0d800b900 con 0x565417fac4c0 2024-09-18T01:45:25.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.570+0000 7fafd3e07640 1 -- 172.21.15.146:0/2842881520 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0d800bac0 con 0x565417fac4c0 2024-09-18T01:45:25.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.570+0000 7fafd3e07640 1 -- 172.21.15.146:0/2842881520 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0d800be20 con 0x565417fac4c0 2024-09-18T01:45:25.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.571+0000 7fb0ea40f800 1 -- 172.21.15.146:0/2842881520 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x565417fac4c0 msgr2=0x56541809a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.571+0000 7fb0ea40f800 1 --2- 172.21.15.146:0/2842881520 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x565417fac4c0 0x56541809a640 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb0d800d520 tx=0x7fb0d800d9e0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.571+0000 7fb0ea40f800 1 -- 172.21.15.146:0/2842881520 shutdown_connections 2024-09-18T01:45:25.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.571+0000 7fb0ea40f800 1 --2- 172.21.15.146:0/2842881520 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x565417fac4c0 0x56541809a640 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.571+0000 7fb0ea40f800 1 -- 172.21.15.146:0/2842881520 >> 172.21.15.146:0/2842881520 conn(0x565417fa7df0 msgr2=0x565418096000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:25.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.571+0000 7fb0ea40f800 1 -- 172.21.15.146:0/2842881520 shutdown_connections 2024-09-18T01:45:25.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.571+0000 7fb0ea40f800 1 -- 172.21.15.146:0/2842881520 wait complete. 2024-09-18T01:45:25.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.571+0000 7fb0ea40f800 1 Processor -- start 2024-09-18T01:45:25.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.571+0000 7fb0ea40f800 1 -- start start 2024-09-18T01:45:25.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.571+0000 7fb0ea40f800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x565417fac4c0 0x5654180a20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.571+0000 7fb0ea40f800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x565417fb3530 con 0x565417fac4c0 2024-09-18T01:45:25.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.572+0000 7fb0e5b3d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x565417fac4c0 0x5654180a20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.572+0000 7fb0e5b3d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x565417fac4c0 0x5654180a20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60474/0 (socket says 172.21.15.146:60474) 2024-09-18T01:45:25.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.572+0000 7fb0e5b3d640 1 -- 172.21.15.146:0/3420229665 learned_addr learned my addr 172.21.15.146:0/3420229665 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:25.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.572+0000 7fb0e5b3d640 1 -- 172.21.15.146:0/3420229665 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565417e5afe0 con 0x565417fac4c0 2024-09-18T01:45:25.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.572+0000 7fb0e5b3d640 1 --2- 172.21.15.146:0/3420229665 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x565417fac4c0 0x5654180a20b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x56541809b4a0 tx=0x7fb0d8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.572+0000 7fafd2604640 1 -- 172.21.15.146:0/3420229665 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0d8015aa0 con 0x565417fac4c0 2024-09-18T01:45:25.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.572+0000 7fafd2604640 1 -- 172.21.15.146:0/3420229665 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0d8027070 con 0x565417fac4c0 2024-09-18T01:45:25.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.572+0000 7fafd2604640 1 -- 172.21.15.146:0/3420229665 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0d8015d90 con 0x565417fac4c0 2024-09-18T01:45:25.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.572+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3420229665 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5654180a25f0 con 0x565417fac4c0 2024-09-18T01:45:25.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.572+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3420229665 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654180a2b10 con 0x565417fac4c0 2024-09-18T01:45:25.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.573+0000 7fafd2604640 1 -- 172.21.15.146:0/3420229665 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb0d8022480 con 0x565417fac4c0 2024-09-18T01:45:25.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.573+0000 7fafd2604640 1 --2- 172.21.15.146:0/3420229665 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fafcc036b40 0x7fafcc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.573+0000 7fafd2604640 1 -- 172.21.15.146:0/3420229665 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fb0d804f950 con 0x565417fac4c0 2024-09-18T01:45:25.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.573+0000 7fb0dd33c640 1 --2- 172.21.15.146:0/3420229665 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fafcc036b40 0x7fafcc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.573+0000 7fb0ea40f800 1 --2- 172.21.15.146:0/3420229665 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x565417fb0900 0x5654180a9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.573+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3420229665 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5654180a96a0 con 0x565417fb0900 2024-09-18T01:45:25.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.573+0000 7fb0e633e640 1 --2- 172.21.15.146:0/3420229665 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x565417fb0900 0x5654180a9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.574+0000 7fb0dd33c640 1 --2- 172.21.15.146:0/3420229665 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fafcc036b40 0x7fafcc039000 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb0d0057000 tx=0x7fb0d0052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.574+0000 7fb0e633e640 1 --2- 172.21.15.146:0/3420229665 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x565417fb0900 0x5654180a9120 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.574+0000 7fb0e633e640 1 -- 172.21.15.146:0/3420229665 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb0e000a4a0 con 0x565417fb0900 2024-09-18T01:45:25.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.574+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3420229665 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5654180a66d0 con 0x565417fb0900 2024-09-18T01:45:25.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.574+0000 7fb0e633e640 1 -- 172.21.15.146:0/3420229665 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb0e000a4a0 con 0x565417fb0900 2024-09-18T01:45:25.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.574+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3420229665 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5654180ab4a0 con 0x565417fb0900 2024-09-18T01:45:25.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.575+0000 7fb0e633e640 1 -- 172.21.15.146:0/3420229665 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb0e000a4a0 con 0x565417fb0900 2024-09-18T01:45:25.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.575+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3420229665 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5654180aa5e0 con 0x565417fb0900 2024-09-18T01:45:25.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.575+0000 7fb0e633e640 1 -- 172.21.15.146:0/3420229665 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb0e000a4a0 con 0x565417fb0900 2024-09-18T01:45:25.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.575+0000 7fb0ea40f800 1 --2- 172.21.15.146:0/3420229665 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5654180ab080 0x5654180ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.575+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3420229665 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5654180af070 con 0x5654180ab080 2024-09-18T01:45:25.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.575+0000 7fb0e5b3d640 1 --2- 172.21.15.146:0/3420229665 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5654180ab080 0x5654180ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.575+0000 7fb0e5b3d640 1 --2- 172.21.15.146:0/3420229665 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5654180ab080 0x5654180ae8e0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.576+0000 7fb0e5b3d640 1 -- 172.21.15.146:0/3420229665 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb0d8043040 con 0x5654180ab080 2024-09-18T01:45:25.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.576+0000 7fb0ea40f800 1 Processor -- start 2024-09-18T01:45:25.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.576+0000 7fb0ea40f800 1 -- start start 2024-09-18T01:45:25.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.576+0000 7fb0ea40f800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5654180bce20 0x5654180bd240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.576+0000 7fb0ea40f800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x565417e48580 con 0x5654180bce20 2024-09-18T01:45:25.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.576+0000 7fb0e633e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5654180bce20 0x5654180bd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.576+0000 7fb0e633e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5654180bce20 0x5654180bd240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60488/0 (socket says 172.21.15.146:60488) 2024-09-18T01:45:25.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.576+0000 7fb0e633e640 1 -- 172.21.15.146:0/1962049304 learned_addr learned my addr 172.21.15.146:0/1962049304 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:25.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.577+0000 7fb0e633e640 1 -- 172.21.15.146:0/1962049304 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654180bd780 con 0x5654180bce20 2024-09-18T01:45:25.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.577+0000 7fb0e633e640 1 --2- 172.21.15.146:0/1962049304 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5654180bce20 0x5654180bd240 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x5654180a9a80 tx=0x7fb0e00178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.577+0000 7fafcb7fe640 1 -- 172.21.15.146:0/1962049304 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0e0013440 con 0x5654180bce20 2024-09-18T01:45:25.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.577+0000 7fafcb7fe640 1 -- 172.21.15.146:0/1962049304 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0e00135e0 con 0x5654180bce20 2024-09-18T01:45:25.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.577+0000 7fb0ea40f800 1 -- 172.21.15.146:0/1962049304 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5654180bda10 con 0x5654180bce20 2024-09-18T01:45:25.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.577+0000 7fafcb7fe640 1 -- 172.21.15.146:0/1962049304 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0e00138c0 con 0x5654180bce20 2024-09-18T01:45:25.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.577+0000 7fb0ea40f800 1 -- 172.21.15.146:0/1962049304 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654180c06f0 con 0x5654180bce20 2024-09-18T01:45:25.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.578+0000 7fafcb7fe640 1 -- 172.21.15.146:0/1962049304 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb0e0011040 con 0x5654180bce20 2024-09-18T01:45:25.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.578+0000 7fafcb7fe640 1 --2- 172.21.15.146:0/1962049304 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fafc0036b40 0x7fafc0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.578+0000 7fafcb7fe640 1 -- 172.21.15.146:0/1962049304 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fb0e001d070 con 0x5654180bce20 2024-09-18T01:45:25.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.578+0000 7fb0e5b3d640 1 --2- 172.21.15.146:0/1962049304 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fafc0036b40 0x7fafc0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.578+0000 7fb0ea40f800 1 Processor -- start 2024-09-18T01:45:25.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.578+0000 7fb0ea40f800 1 -- start start 2024-09-18T01:45:25.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.578+0000 7fb0e5b3d640 1 --2- 172.21.15.146:0/1962049304 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fafc0036b40 0x7fafc0039000 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x5654180aa980 tx=0x7fb0d802dfa0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.578+0000 7fb0ea40f800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5654180c9af0 0x5654180c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.578+0000 7fb0ea40f800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x56541809adf0 con 0x5654180c9af0 2024-09-18T01:45:25.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.579+0000 7fb0e633e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5654180c9af0 0x5654180c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.579+0000 7fb0e633e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5654180c9af0 0x5654180c9ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60500/0 (socket says 172.21.15.146:60500) 2024-09-18T01:45:25.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.579+0000 7fb0e633e640 1 -- 172.21.15.146:0/536994 learned_addr learned my addr 172.21.15.146:0/536994 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:25.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.579+0000 7fb0e633e640 1 -- 172.21.15.146:0/536994 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654180ca4c0 con 0x5654180c9af0 2024-09-18T01:45:25.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.579+0000 7fb0e633e640 1 --2- 172.21.15.146:0/536994 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5654180c9af0 0x5654180c9ef0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb0e0012ab0 tx=0x7fb0e0001b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d29e5948e97992a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.579+0000 7fafc97fa640 1 -- 172.21.15.146:0/536994 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0e0045070 con 0x5654180c9af0 2024-09-18T01:45:25.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.579+0000 7fafc97fa640 1 -- 172.21.15.146:0/536994 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0e0015560 con 0x5654180c9af0 2024-09-18T01:45:25.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.579+0000 7fafc97fa640 1 -- 172.21.15.146:0/536994 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0e004e200 con 0x5654180c9af0 2024-09-18T01:45:25.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.580+0000 7fb0ea40f800 1 -- 172.21.15.146:0/536994 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5654180c9af0 msgr2=0x5654180c9ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.580+0000 7fb0ea40f800 1 --2- 172.21.15.146:0/536994 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5654180c9af0 0x5654180c9ef0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb0e0012ab0 tx=0x7fb0e0001b20 comp rx=0 tx=0).stop 2024-09-18T01:45:25.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.580+0000 7fb0ea40f800 1 -- 172.21.15.146:0/536994 shutdown_connections 2024-09-18T01:45:25.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.580+0000 7fb0ea40f800 1 --2- 172.21.15.146:0/536994 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5654180c9af0 0x5654180c9ef0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.580+0000 7fb0ea40f800 1 -- 172.21.15.146:0/536994 >> 172.21.15.146:0/536994 conn(0x5654180c5e50 msgr2=0x5654180c3f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:25.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.580+0000 7fb0ea40f800 1 -- 172.21.15.146:0/536994 shutdown_connections 2024-09-18T01:45:25.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.580+0000 7fb0ea40f800 1 -- 172.21.15.146:0/536994 wait complete. 2024-09-18T01:45:25.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.580+0000 7fb0ea40f800 1 Processor -- start 2024-09-18T01:45:25.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.580+0000 7fb0ea40f800 1 -- start start 2024-09-18T01:45:25.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.580+0000 7fb0ea40f800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5654180c9af0 0x5654180d0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.580+0000 7fb0ea40f800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5654180cab30 con 0x5654180c9af0 2024-09-18T01:45:25.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.580+0000 7fb0e633e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5654180c9af0 0x5654180d0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.580+0000 7fb0e633e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5654180c9af0 0x5654180d0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60510/0 (socket says 172.21.15.146:60510) 2024-09-18T01:45:25.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.580+0000 7fb0e633e640 1 -- 172.21.15.146:0/3653981253 learned_addr learned my addr 172.21.15.146:0/3653981253 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:25.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.581+0000 7fb0e633e640 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654180d14e0 con 0x5654180c9af0 2024-09-18T01:45:25.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.581+0000 7fb0e633e640 1 --2- 172.21.15.146:0/3653981253 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5654180c9af0 0x5654180d0fa0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb0e0012ab0 tx=0x7fb0e004c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.581+0000 7fafb77fe640 1 -- 172.21.15.146:0/3653981253 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0e0045040 con 0x5654180c9af0 2024-09-18T01:45:25.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.581+0000 7fafb77fe640 1 -- 172.21.15.146:0/3653981253 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0e00014f0 con 0x5654180c9af0 2024-09-18T01:45:25.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.581+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5654180d1770 con 0x5654180c9af0 2024-09-18T01:45:25.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.581+0000 7fafb77fe640 1 -- 172.21.15.146:0/3653981253 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0e00017f0 con 0x5654180c9af0 2024-09-18T01:45:25.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.581+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654180d4420 con 0x5654180c9af0 2024-09-18T01:45:25.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.582+0000 7fafb77fe640 1 -- 172.21.15.146:0/3653981253 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb0e0013af0 con 0x5654180c9af0 2024-09-18T01:45:25.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.582+0000 7fafb77fe640 1 --2- 172.21.15.146:0/3653981253 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fafb0036af0 0x7fafb0038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.582+0000 7fafb77fe640 1 -- 172.21.15.146:0/3653981253 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fb0e000e040 con 0x5654180c9af0 2024-09-18T01:45:25.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.582+0000 7fb0e5b3d640 1 --2- 172.21.15.146:0/3653981253 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fafb0036af0 0x7fafb0038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.582+0000 7fb0ea40f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.582+0000 7fb0ea40f800 1 --2- 172.21.15.146:0/3653981253 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5654180dcb20 0x5654180defe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.582+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5654180df730 con 0x5654180dcb20 2024-09-18T01:45:25.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.582+0000 7fb0dd33c640 1 --2- 172.21.15.146:0/3653981253 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5654180dcb20 0x5654180defe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.582+0000 7fb0e5b3d640 1 --2- 172.21.15.146:0/3653981253 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fafb0036af0 0x7fafb0038fb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x5654180af470 tx=0x7fb0d803b000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.583+0000 7fb0dd33c640 1 --2- 172.21.15.146:0/3653981253 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5654180dcb20 0x5654180defe0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.583+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb0d0057030 con 0x5654180dcb20 2024-09-18T01:45:25.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.583+0000 7fb0ea40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:25.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.583+0000 7fb0ea40f800 20 realm 2024-09-18T01:45:25.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.583+0000 7fb0ea40f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.583+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5654180dfb00 con 0x5654180dcb20 2024-09-18T01:45:25.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.583+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb0d0057030 con 0x5654180dcb20 2024-09-18T01:45:25.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.583+0000 7fb0ea40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:25.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.583+0000 7fb0ea40f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:25.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.583+0000 7fb0ea40f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.583+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5654180e03a0 con 0x5654180dcb20 2024-09-18T01:45:25.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.583+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb0d0057030 con 0x5654180dcb20 2024-09-18T01:45:25.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.583+0000 7fb0ea40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:25.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.583+0000 7fb0ea40f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.583+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5654180e0740 con 0x5654180dcb20 2024-09-18T01:45:25.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.584+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb0d0057030 con 0x5654180dcb20 2024-09-18T01:45:25.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.584+0000 7fb0ea40f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:25.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.584+0000 7fb0ea40f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.584+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5654180e0b60 con 0x5654180dcb20 2024-09-18T01:45:25.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.584+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb0d0057030 con 0x5654180dcb20 2024-09-18T01:45:25.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.584+0000 7fb0ea40f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:25.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.584+0000 7fb0ea40f800 20 searching for the correct realm 2024-09-18T01:45:25.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.584+0000 7fb0ea40f800 1 --2- 172.21.15.146:0/3653981253 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5654180e2b50 0x5654180e4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.584+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5654180e5670 con 0x5654180e2b50 2024-09-18T01:45:25.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.584+0000 7fb0e633e640 1 --2- 172.21.15.146:0/3653981253 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5654180e2b50 0x5654180e4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.584+0000 7fb0e633e640 1 --2- 172.21.15.146:0/3653981253 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5654180e2b50 0x5654180e4fa0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.585+0000 7fb0e633e640 1 -- 172.21.15.146:0/3653981253 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0e003c020 con 0x5654180e2b50 2024-09-18T01:45:25.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.585+0000 7fb0e633e640 1 --2- 172.21.15.146:0/3653981253 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fb0e002c450 0x7fb0e00233f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.585+0000 7fb0e633e640 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5654180e5670 con 0x7fb0e002c450 2024-09-18T01:45:25.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.585+0000 7fb0e5b3d640 1 --2- 172.21.15.146:0/3653981253 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fb0e002c450 0x7fb0e00233f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.585+0000 7fb0e5b3d640 1 --2- 172.21.15.146:0/3653981253 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fb0e002c450 0x7fb0e00233f0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.585+0000 7fb0e5b3d640 1 -- 172.21.15.146:0/3653981253 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0d8041040 con 0x7fb0e002c450 2024-09-18T01:45:25.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.585+0000 7fb0e5b3d640 1 --2- 172.21.15.146:0/3653981253 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fb0d80143d0 0x7fb0d8016910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.585+0000 7fb0e5b3d640 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5654180e5670 con 0x7fb0d80143d0 2024-09-18T01:45:25.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.585+0000 7fb0dd33c640 1 --2- 172.21.15.146:0/3653981253 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fb0d80143d0 0x7fb0d8016910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.586+0000 7fb0dd33c640 1 --2- 172.21.15.146:0/3653981253 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fb0d80143d0 0x7fb0d8016910 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.586+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0d0057030 con 0x7fb0d80143d0 2024-09-18T01:45:25.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.586+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5654180e5670 con 0x5654180dcb20 2024-09-18T01:45:25.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.586+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb0d0057030 con 0x5654180dcb20 2024-09-18T01:45:25.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.586+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5654180e5670 con 0x5654180dcb20 2024-09-18T01:45:25.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.586+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0d0057030 con 0x5654180dcb20 2024-09-18T01:45:25.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.586+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5654180e5670 con 0x7fb0d80143d0 2024-09-18T01:45:25.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.587+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0d0057030 con 0x7fb0d80143d0 2024-09-18T01:45:25.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.587+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5654180e5670 con 0x7fb0d80143d0 2024-09-18T01:45:25.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.587+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0d0057030 con 0x7fb0d80143d0 2024-09-18T01:45:25.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.587+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5654180e5670 con 0x7fb0e002c450 2024-09-18T01:45:25.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.587+0000 7fb0e5b3d640 1 -- 172.21.15.146:0/3653981253 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0d8041040 con 0x7fb0e002c450 2024-09-18T01:45:25.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.587+0000 7fb0e5b3d640 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5654180e5670 con 0x5654180e2b50 2024-09-18T01:45:25.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.587+0000 7fb0e633e640 1 -- 172.21.15.146:0/3653981253 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0e003c020 con 0x5654180e2b50 2024-09-18T01:45:25.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.587+0000 7fb0e633e640 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5654180e5670 con 0x5654180dcb20 2024-09-18T01:45:25.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.588+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0d0057030 con 0x5654180dcb20 2024-09-18T01:45:25.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.588+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5654180e5670 con 0x7fb0d80143d0 2024-09-18T01:45:25.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.588+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0d0057030 con 0x7fb0d80143d0 2024-09-18T01:45:25.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.588+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5654180e5670 con 0x5654180dcb20 2024-09-18T01:45:25.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.588+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0d0057030 con 0x5654180dcb20 2024-09-18T01:45:25.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.588+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5654180e5670 con 0x7fb0e002c450 2024-09-18T01:45:25.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.588+0000 7fb0e5b3d640 1 -- 172.21.15.146:0/3653981253 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fb0d8041040 con 0x7fb0e002c450 2024-09-18T01:45:25.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.588+0000 7fb0e5b3d640 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5654180e5670 con 0x5654180e2b50 2024-09-18T01:45:25.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.588+0000 7fb0e633e640 1 -- 172.21.15.146:0/3653981253 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0e003c020 con 0x5654180e2b50 2024-09-18T01:45:25.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.588+0000 7fb0e633e640 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5654180e5670 con 0x5654180e2b50 2024-09-18T01:45:25.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.589+0000 7fb0e633e640 1 -- 172.21.15.146:0/3653981253 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0e003c020 con 0x5654180e2b50 2024-09-18T01:45:25.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.589+0000 7fb0e633e640 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5654180e5670 con 0x7fb0d80143d0 2024-09-18T01:45:25.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.589+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0d0057030 con 0x7fb0d80143d0 2024-09-18T01:45:25.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.589+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5654180e5670 con 0x5654180e2b50 2024-09-18T01:45:25.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.589+0000 7fb0e633e640 1 -- 172.21.15.146:0/3653981253 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0e003c020 con 0x5654180e2b50 2024-09-18T01:45:25.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.589+0000 7fb0e633e640 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5654180e5670 con 0x5654180e2b50 2024-09-18T01:45:25.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.589+0000 7fb0e633e640 1 -- 172.21.15.146:0/3653981253 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0e003c020 con 0x5654180e2b50 2024-09-18T01:45:25.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.589+0000 7fb0e633e640 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5654180e5670 con 0x5654180dcb20 2024-09-18T01:45:25.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.590+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0d0057030 con 0x5654180dcb20 2024-09-18T01:45:25.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.590+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5654180e5670 con 0x5654180dcb20 2024-09-18T01:45:25.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.590+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb0d0057030 con 0x5654180dcb20 2024-09-18T01:45:25.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.590+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5654180e5670 con 0x7fb0d80143d0 2024-09-18T01:45:25.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.590+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0d0057030 con 0x7fb0d80143d0 2024-09-18T01:45:25.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.590+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5654180e5670 con 0x5654180e2b50 2024-09-18T01:45:25.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.590+0000 7fb0e633e640 1 -- 172.21.15.146:0/3653981253 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0e003c020 con 0x5654180e2b50 2024-09-18T01:45:25.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.590+0000 7fb0e633e640 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5654180e5670 con 0x7fb0e002c450 2024-09-18T01:45:25.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.591+0000 7fb0e5b3d640 1 -- 172.21.15.146:0/3653981253 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0d8041040 con 0x7fb0e002c450 2024-09-18T01:45:25.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.591+0000 7fb0e5b3d640 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5654180e5670 con 0x5654180dcb20 2024-09-18T01:45:25.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.591+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0d0057030 con 0x5654180dcb20 2024-09-18T01:45:25.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.591+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5654180e5670 con 0x7fb0d80143d0 2024-09-18T01:45:25.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.591+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0d0057030 con 0x7fb0d80143d0 2024-09-18T01:45:25.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.591+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5654180e5670 con 0x5654180e2b50 2024-09-18T01:45:25.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.591+0000 7fb0e633e640 1 -- 172.21.15.146:0/3653981253 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0e003c020 con 0x5654180e2b50 2024-09-18T01:45:25.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.591+0000 7fb0e633e640 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5654180e5670 con 0x7fb0d80143d0 2024-09-18T01:45:25.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.592+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0d0057030 con 0x7fb0d80143d0 2024-09-18T01:45:25.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.592+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5654180e5670 con 0x7fb0e002c450 2024-09-18T01:45:25.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.592+0000 7fb0e5b3d640 1 -- 172.21.15.146:0/3653981253 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0d8041040 con 0x7fb0e002c450 2024-09-18T01:45:25.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.592+0000 7fb0e5b3d640 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5654180e5670 con 0x5654180e2b50 2024-09-18T01:45:25.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.592+0000 7fb0e633e640 1 -- 172.21.15.146:0/3653981253 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0e003c020 con 0x5654180e2b50 2024-09-18T01:45:25.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.592+0000 7fb0e633e640 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5654180e5670 con 0x7fb0d80143d0 2024-09-18T01:45:25.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.592+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0d0057030 con 0x7fb0d80143d0 2024-09-18T01:45:25.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.592+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5654180e5670 con 0x5654180dcb20 2024-09-18T01:45:25.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.593+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb0d0057030 con 0x5654180dcb20 2024-09-18T01:45:25.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.593+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5654180e5670 con 0x7fb0e002c450 2024-09-18T01:45:25.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.593+0000 7fb0e5b3d640 1 -- 172.21.15.146:0/3653981253 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0d8041040 con 0x7fb0e002c450 2024-09-18T01:45:25.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.593+0000 7fb0ea40f800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:25.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.593+0000 7fb0ea40f800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:25.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.593+0000 7fb0ea40f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:25.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.593+0000 7fb0ea40f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:25.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.593+0000 7fb0ea40f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:25.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.593+0000 7fb0ea40f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:25.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.593+0000 7fb0ea40f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.593+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5654180e15d0 con 0x5654180dcb20 2024-09-18T01:45:25.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.593+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb0d0057030 con 0x5654180dcb20 2024-09-18T01:45:25.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.593+0000 7fb0ea40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:25.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.593+0000 7fb0ea40f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.593+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5654180e1e70 con 0x5654180dcb20 2024-09-18T01:45:25.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.593+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb0d0057030 con 0x5654180dcb20 2024-09-18T01:45:25.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.593+0000 7fb0ea40f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:25.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.593+0000 7fb0ea40f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.593+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5654180e1210 con 0x7fb0e002c450 2024-09-18T01:45:25.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.594+0000 7fb0e5b3d640 1 -- 172.21.15.146:0/3653981253 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb0d8041040 con 0x7fb0e002c450 2024-09-18T01:45:25.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.594+0000 7fb0ea40f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:25.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.594+0000 7fb0ea40f800 20 zone default found 2024-09-18T01:45:25.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.594+0000 7fb0ea40f800 4 Realm: () 2024-09-18T01:45:25.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.594+0000 7fb0ea40f800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:25.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.594+0000 7fb0ea40f800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:25.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.594+0000 7fb0ea40f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:25.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.594+0000 7fb0ea40f800 20 zonegroup default 2024-09-18T01:45:25.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.594+0000 7fb0ea40f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.594+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5654180e5fa0 con 0x7fb0d80143d0 2024-09-18T01:45:25.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.594+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb0d0057030 con 0x7fb0d80143d0 2024-09-18T01:45:25.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.594+0000 7fb0ea40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:25.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.594+0000 7fb0ea40f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.594+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5654180e7b00 con 0x5654180e2b50 2024-09-18T01:45:25.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.594+0000 7fb0e633e640 1 -- 172.21.15.146:0/3653981253 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb0e003c020 con 0x5654180e2b50 2024-09-18T01:45:25.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.594+0000 7fb0ea40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:25.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.594+0000 7fb0ea40f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.594+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5654180e8000 con 0x5654180e2b50 2024-09-18T01:45:25.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.594+0000 7fb0e633e640 1 -- 172.21.15.146:0/3653981253 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb0e003c020 con 0x5654180e2b50 2024-09-18T01:45:25.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.594+0000 7fb0ea40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:25.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.594+0000 7fb0ea40f800 20 started sync module instance, tier type = 2024-09-18T01:45:25.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.594+0000 7fb0ea40f800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:25.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.594+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5654180e6a00 con 0x7fb0e002c450 2024-09-18T01:45:25.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.595+0000 7fb0e5b3d640 1 -- 172.21.15.146:0/3653981253 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v31'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0d8041040 con 0x7fb0e002c450 2024-09-18T01:45:25.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.595+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94919180840432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5654180e8910 con 0x7fb0e002c450 2024-09-18T01:45:25.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.595+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5654180e9160 con 0x5654180dcb20 2024-09-18T01:45:25.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.596+0000 7fb0e5b3d640 1 -- 172.21.15.146:0/3653981253 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94919180840432] v31'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0d8041040 con 0x7fb0e002c450 2024-09-18T01:45:25.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.597+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v31'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0d0057030 con 0x5654180dcb20 2024-09-18T01:45:25.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.597+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94919180846176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5654180e9160 con 0x5654180dcb20 2024-09-18T01:45:25.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.597+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5654180e9c40 con 0x5654180e2b50 2024-09-18T01:45:25.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.598+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94919180846176] v31'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0d0057030 con 0x5654180dcb20 2024-09-18T01:45:25.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.598+0000 7fb0e633e640 1 -- 172.21.15.146:0/3653981253 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v31'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0e003c020 con 0x5654180e2b50 2024-09-18T01:45:25.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.598+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94919180848304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5654180e90d0 con 0x5654180e2b50 2024-09-18T01:45:25.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.598+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5654180eab00 con 0x7fb0e002c450 2024-09-18T01:45:25.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.599+0000 7fb0e633e640 1 -- 172.21.15.146:0/3653981253 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94919180848304] v31'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0e003c020 con 0x5654180e2b50 2024-09-18T01:45:25.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.599+0000 7fb0e5b3d640 1 -- 172.21.15.146:0/3653981253 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v31'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0d8041040 con 0x7fb0e002c450 2024-09-18T01:45:25.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.599+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94919180854864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5654180eaef0 con 0x7fb0e002c450 2024-09-18T01:45:25.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.599+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5654180eb910 con 0x5654180dcb20 2024-09-18T01:45:25.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.600+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v31'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0d0057030 con 0x5654180dcb20 2024-09-18T01:45:25.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.600+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94919180858368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5654180ec1e0 con 0x5654180dcb20 2024-09-18T01:45:25.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.600+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5654180ecc90 con 0x7fb0d80143d0 2024-09-18T01:45:25.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.600+0000 7fb0e5b3d640 1 -- 172.21.15.146:0/3653981253 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94919180854864] v31'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0d8041040 con 0x7fb0e002c450 2024-09-18T01:45:25.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.601+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v31'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0d0057030 con 0x7fb0d80143d0 2024-09-18T01:45:25.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.601+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94919180853296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5654180ecc90 con 0x7fb0d80143d0 2024-09-18T01:45:25.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.601+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5654180ed6a0 con 0x7fb0d80143d0 2024-09-18T01:45:25.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.601+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94919180858368] v31'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0d0057030 con 0x5654180dcb20 2024-09-18T01:45:25.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.602+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94919180853296] v31'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0d0057030 con 0x7fb0d80143d0 2024-09-18T01:45:25.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.602+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v31'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0d0057030 con 0x7fb0d80143d0 2024-09-18T01:45:25.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.602+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94919180860720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5654180ed1f0 con 0x7fb0d80143d0 2024-09-18T01:45:25.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.602+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5654180edbb0 con 0x7fb0d80143d0 2024-09-18T01:45:25.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.603+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(58 notify.7 [create] v31'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0d0057030 con 0x7fb0d80143d0 2024-09-18T01:45:25.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.603+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94919180860720] v31'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0d0057030 con 0x7fb0d80143d0 2024-09-18T01:45:25.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.603+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94919180867328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5654180edfd0 con 0x7fb0d80143d0 2024-09-18T01:45:25.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.603+0000 7fb0ea40f800 20 add_watcher() i=0 2024-09-18T01:45:25.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.603+0000 7fb0ea40f800 20 add_watcher() i=1 2024-09-18T01:45:25.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.603+0000 7fb0ea40f800 20 add_watcher() i=2 2024-09-18T01:45:25.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.603+0000 7fb0ea40f800 20 add_watcher() i=3 2024-09-18T01:45:25.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.603+0000 7fb0ea40f800 20 add_watcher() i=4 2024-09-18T01:45:25.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.603+0000 7fb0ea40f800 20 add_watcher() i=5 2024-09-18T01:45:25.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.603+0000 7fb0ea40f800 20 add_watcher() i=6 2024-09-18T01:45:25.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.604+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94919180867328] v31'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0d0057030 con 0x7fb0d80143d0 2024-09-18T01:45:25.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.604+0000 7fb0ea40f800 20 add_watcher() i=7 2024-09-18T01:45:25.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.604+0000 7fb0ea40f800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:25.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.604+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5654180edfd0 con 0x5654180dcb20 2024-09-18T01:45:25.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.604+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb0d0057030 con 0x5654180dcb20 2024-09-18T01:45:25.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.604+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94919180868384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5654180edfb0 con 0x5654180dcb20 2024-09-18T01:45:25.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.605+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94919180868384] v31'96 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb0d0057030 con 0x5654180dcb20 2024-09-18T01:45:25.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.605+0000 7faf97fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:25.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.605+0000 7fb0ea40f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:25.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.605+0000 7fb0ea40f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:25.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.605+0000 7fb0ea40f800 5 note: GC not initialized 2024-09-18T01:45:25.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.606+0000 7faf96ffd640 20 reqs_thread_entry: start 2024-09-18T01:45:25.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.606+0000 7fb0ea40f800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:25.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.606+0000 7fb0ea40f800 20 Filter name: none 2024-09-18T01:45:25.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.606+0000 7faf94ff9640 20 reqs_thread_entry: start 2024-09-18T01:45:25.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.606+0000 7fb0ea40f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.606+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x565418123ec0 con 0x5654180dcb20 2024-09-18T01:45:25.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.606+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb0d0057030 con 0x5654180dcb20 2024-09-18T01:45:25.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.606+0000 7fb0ea40f800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:45:25.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.606+0000 7fb0ea40f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.606+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5654181248b0 con 0x5654180dcb20 2024-09-18T01:45:25.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.607+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb0d0087210 con 0x5654180dcb20 2024-09-18T01:45:25.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.607+0000 7fb0ea40f800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:45:25.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.607+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5654181258c0 con 0x7fb0e002c450 2024-09-18T01:45:25.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.607+0000 7fb0e5b3d640 1 -- 172.21.15.146:0/3653981253 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7fb0d8041040 con 0x7fb0e002c450 2024-09-18T01:45:25.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.608+0000 7faf97fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:25.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.608+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94919180868384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x565418121cd0 con 0x5654180dcb20 2024-09-18T01:45:25.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.609+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94919180868384] v31'97 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb0d0087210 con 0x5654180dcb20 2024-09-18T01:45:25.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.609+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94919180840432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x565418121cd0 con 0x7fb0e002c450 2024-09-18T01:45:25.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.610+0000 7fb0e5b3d640 1 -- 172.21.15.146:0/3653981253 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94919180840432] v31'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0d8041040 con 0x7fb0e002c450 2024-09-18T01:45:25.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.610+0000 7fb0ea40f800 20 remove_watcher() i=0 2024-09-18T01:45:25.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.610+0000 7fb0ea40f800 2 removed watcher, disabling cache 2024-09-18T01:45:25.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.610+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94919180846176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x565418121cd0 con 0x5654180dcb20 2024-09-18T01:45:25.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.611+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94919180846176] v31'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0d0087210 con 0x5654180dcb20 2024-09-18T01:45:25.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.611+0000 7fb0ea40f800 20 remove_watcher() i=1 2024-09-18T01:45:25.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.611+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94919180848304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x565418121cd0 con 0x5654180e2b50 2024-09-18T01:45:25.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.612+0000 7fb0e633e640 1 -- 172.21.15.146:0/3653981253 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94919180848304] v31'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0e003c020 con 0x5654180e2b50 2024-09-18T01:45:25.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.612+0000 7fb0ea40f800 20 remove_watcher() i=2 2024-09-18T01:45:25.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.612+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94919180854864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x565418121cd0 con 0x7fb0e002c450 2024-09-18T01:45:25.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.612+0000 7fb0e5b3d640 1 -- 172.21.15.146:0/3653981253 <== osd.2 v2:172.21.15.146:6800/3820039304 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94919180854864] v31'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0d8041040 con 0x7fb0e002c450 2024-09-18T01:45:25.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.613+0000 7fb0ea40f800 20 remove_watcher() i=3 2024-09-18T01:45:25.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.613+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94919180858368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x565418121cd0 con 0x5654180dcb20 2024-09-18T01:45:25.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.613+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94919180858368] v31'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0d0087210 con 0x5654180dcb20 2024-09-18T01:45:25.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.613+0000 7fb0ea40f800 20 remove_watcher() i=4 2024-09-18T01:45:25.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.613+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94919180853296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x565418121cd0 con 0x7fb0d80143d0 2024-09-18T01:45:25.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.614+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94919180853296] v31'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0d0087210 con 0x7fb0d80143d0 2024-09-18T01:45:25.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.614+0000 7fb0ea40f800 20 remove_watcher() i=5 2024-09-18T01:45:25.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.614+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94919180860720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x565418121cd0 con 0x7fb0d80143d0 2024-09-18T01:45:25.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.615+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94919180860720] v31'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0d0087210 con 0x7fb0d80143d0 2024-09-18T01:45:25.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.615+0000 7fb0ea40f800 20 remove_watcher() i=6 2024-09-18T01:45:25.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.615+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3653981253 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94919180867328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x565418121cd0 con 0x7fb0d80143d0 2024-09-18T01:45:25.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.616+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94919180867328] v31'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0d0087210 con 0x7fb0d80143d0 2024-09-18T01:45:25.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.616+0000 7fb0ea40f800 20 remove_watcher() i=7 2024-09-18T01:45:25.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.616+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3653981253 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fb0d80143d0 msgr2=0x7fb0d8016910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.616+0000 7fb0ea40f800 1 --2- 172.21.15.146:0/3653981253 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fb0d80143d0 0x7fb0d8016910 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.616+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3653981253 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5654180dcb20 msgr2=0x5654180defe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.616+0000 7fb0ea40f800 1 --2- 172.21.15.146:0/3653981253 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5654180dcb20 0x5654180defe0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.616+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3653981253 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fb0e002c450 msgr2=0x7fb0e00233f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.616+0000 7fb0ea40f800 1 --2- 172.21.15.146:0/3653981253 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fb0e002c450 0x7fb0e00233f0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.616+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3653981253 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5654180e2b50 msgr2=0x5654180e4fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.616+0000 7fb0ea40f800 1 --2- 172.21.15.146:0/3653981253 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5654180e2b50 0x5654180e4fa0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.617+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3653981253 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fafb0036af0 msgr2=0x7fafb0038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.617+0000 7fb0ea40f800 1 --2- 172.21.15.146:0/3653981253 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fafb0036af0 0x7fafb0038fb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x5654180af470 tx=0x7fb0d803b000 comp rx=0 tx=0).stop 2024-09-18T01:45:25.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.617+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3653981253 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5654180c9af0 msgr2=0x5654180d0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.617+0000 7fb0ea40f800 1 --2- 172.21.15.146:0/3653981253 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5654180c9af0 0x5654180d0fa0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb0e0012ab0 tx=0x7fb0e004c840 comp rx=0 tx=0).stop 2024-09-18T01:45:25.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.617+0000 7fb0dd33c640 1 -- 172.21.15.146:0/3653981253 reap_dead start 2024-09-18T01:45:25.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.617+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3653981253 shutdown_connections 2024-09-18T01:45:25.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.617+0000 7fb0ea40f800 1 --2- 172.21.15.146:0/3653981253 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5654180c9af0 0x5654180d0fa0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.617+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3653981253 >> 172.21.15.146:0/3653981253 conn(0x5654180c5e50 msgr2=0x5654180c3f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:25.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.617+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3653981253 shutdown_connections 2024-09-18T01:45:25.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.617+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3653981253 wait complete. 2024-09-18T01:45:25.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.617+0000 7fb0ea40f800 1 -- 172.21.15.146:0/1962049304 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fafc0036b40 msgr2=0x7fafc0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.617+0000 7fb0ea40f800 1 --2- 172.21.15.146:0/1962049304 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fafc0036b40 0x7fafc0039000 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x5654180aa980 tx=0x7fb0d802dfa0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.617+0000 7fb0ea40f800 1 -- 172.21.15.146:0/1962049304 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5654180bce20 msgr2=0x5654180bd240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.617+0000 7fb0ea40f800 1 --2- 172.21.15.146:0/1962049304 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5654180bce20 0x5654180bd240 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x5654180a9a80 tx=0x7fb0e00178e0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.617+0000 7fb0ea40f800 1 -- 172.21.15.146:0/1962049304 shutdown_connections 2024-09-18T01:45:25.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.617+0000 7fb0ea40f800 1 --2- 172.21.15.146:0/1962049304 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fafc0036b40 0x7fafc0039000 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.617+0000 7fb0ea40f800 1 --2- 172.21.15.146:0/1962049304 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5654180bce20 0x5654180bd240 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.617+0000 7fb0ea40f800 1 -- 172.21.15.146:0/1962049304 >> 172.21.15.146:0/1962049304 conn(0x5654180b1db0 msgr2=0x5654180b4930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:25.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.617+0000 7fb0ea40f800 1 -- 172.21.15.146:0/1962049304 shutdown_connections 2024-09-18T01:45:25.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.617+0000 7fb0ea40f800 1 -- 172.21.15.146:0/1962049304 wait complete. 2024-09-18T01:45:25.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.617+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3420229665 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x565417fb0900 msgr2=0x5654180a9120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.617+0000 7fb0ea40f800 1 --2- 172.21.15.146:0/3420229665 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x565417fb0900 0x5654180a9120 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.617+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3420229665 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5654180ab080 msgr2=0x5654180ae8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.617+0000 7fb0ea40f800 1 --2- 172.21.15.146:0/3420229665 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5654180ab080 0x5654180ae8e0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.617+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3420229665 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fafcc036b40 msgr2=0x7fafcc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.618+0000 7fb0ea40f800 1 --2- 172.21.15.146:0/3420229665 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fafcc036b40 0x7fafcc039000 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb0d0057000 tx=0x7fb0d0052000 comp rx=0 tx=0).stop 2024-09-18T01:45:25.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.618+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3420229665 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x565417fac4c0 msgr2=0x5654180a20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.618+0000 7fb0ea40f800 1 --2- 172.21.15.146:0/3420229665 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x565417fac4c0 0x5654180a20b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x56541809b4a0 tx=0x7fb0d8000bc0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.618+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3420229665 shutdown_connections 2024-09-18T01:45:25.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.618+0000 7fb0ea40f800 1 --2- 172.21.15.146:0/3420229665 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5654180ab080 0x5654180ae8e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.618+0000 7fb0ea40f800 1 --2- 172.21.15.146:0/3420229665 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x565417fb0900 0x5654180a9120 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.618+0000 7fb0ea40f800 1 --2- 172.21.15.146:0/3420229665 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fafcc036b40 0x7fafcc039000 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.618+0000 7fb0ea40f800 1 --2- 172.21.15.146:0/3420229665 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x565417fac4c0 0x5654180a20b0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.618+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3420229665 >> 172.21.15.146:0/3420229665 conn(0x565417fa7df0 msgr2=0x5654180948f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:25.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.618+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3420229665 shutdown_connections 2024-09-18T01:45:25.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.618+0000 7fb0ea40f800 1 -- 172.21.15.146:0/3420229665 wait complete. 2024-09-18T01:45:25.632 INFO:teuthology.orchestra.run.smithi146.stdout:[] 2024-09-18T01:45:25.633 DEBUG:tasks.util.rgw: json result: [] 2024-09-18T01:45:25.652 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T01:45:25.652 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-18T01:45:25.652 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-18T01:45:25.652 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-18T01:45:25.696 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:25.696 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:25.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.696+0000 7fab00baf800 1 Processor -- start 2024-09-18T01:45:25.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.696+0000 7fab00baf800 1 -- start start 2024-09-18T01:45:25.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.696+0000 7fab00baf800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55d440514980 0x55d440516d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.696+0000 7fab00baf800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d4403d0b30 con 0x55d440510ac0 2024-09-18T01:45:25.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.696+0000 7fab00baf800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x55d4403b2360 con 0x55d440514980 2024-09-18T01:45:25.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.697+0000 7faaf7fff640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55d440514980 0x55d440516d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.697+0000 7faaf7fff640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55d440514980 0x55d440516d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60522/0 (socket says 172.21.15.146:60522) 2024-09-18T01:45:25.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.697+0000 7faaf7fff640 1 -- 172.21.15.146:0/972123040 learned_addr learned my addr 172.21.15.146:0/972123040 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:25.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.697+0000 7faaf7fff640 1 -- 172.21.15.146:0/972123040 >> v1:172.21.15.129:6789/0 conn(0x55d440510ac0 legacy=0x55d440510ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.697+0000 7faaf7fff640 1 -- 172.21.15.146:0/972123040 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4403d8e00 con 0x55d440514980 2024-09-18T01:45:25.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.699+0000 7faaf7fff640 1 --2- 172.21.15.146:0/972123040 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55d440514980 0x55d440516d70 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7faae800a6b0 tx=0x7faae8047ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c44c7739df3cb3f server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.699+0000 7faafdea2640 1 -- 172.21.15.146:0/972123040 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faae800a200 con 0x55d440514980 2024-09-18T01:45:25.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.699+0000 7faafdea2640 1 -- 172.21.15.146:0/972123040 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faae800a3a0 con 0x55d440514980 2024-09-18T01:45:25.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.699+0000 7faafdea2640 1 -- 172.21.15.146:0/972123040 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faae8008700 con 0x55d440514980 2024-09-18T01:45:25.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.699+0000 7fab00baf800 1 -- 172.21.15.146:0/972123040 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55d440514980 msgr2=0x55d440516d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.699+0000 7fab00baf800 1 --2- 172.21.15.146:0/972123040 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55d440514980 0x55d440516d70 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7faae800a6b0 tx=0x7faae8047ed0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.700+0000 7fab00baf800 1 -- 172.21.15.146:0/972123040 shutdown_connections 2024-09-18T01:45:25.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.700+0000 7fab00baf800 1 --2- 172.21.15.146:0/972123040 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55d440514980 0x55d440516d70 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.700+0000 7fab00baf800 1 -- 172.21.15.146:0/972123040 >> 172.21.15.146:0/972123040 conn(0x55d44050b5c0 msgr2=0x55d44050d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:25.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.700+0000 7fab00baf800 1 -- 172.21.15.146:0/972123040 shutdown_connections 2024-09-18T01:45:25.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.700+0000 7fab00baf800 1 -- 172.21.15.146:0/972123040 wait complete. 2024-09-18T01:45:25.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.713+0000 7fab00baf800 1 Processor -- start 2024-09-18T01:45:25.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.713+0000 7fab00baf800 1 -- start start 2024-09-18T01:45:25.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.713+0000 7fab00baf800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55d440510ac0 0x55d4405fe5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.713+0000 7fab00baf800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55d44045d330 con 0x55d440510ac0 2024-09-18T01:45:25.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.714+0000 7faafe6a3640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55d440510ac0 0x55d4405fe5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.714+0000 7faafe6a3640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55d440510ac0 0x55d4405fe5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60530/0 (socket says 172.21.15.146:60530) 2024-09-18T01:45:25.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.714+0000 7faafe6a3640 1 -- 172.21.15.146:0/2832065446 learned_addr learned my addr 172.21.15.146:0/2832065446 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:25.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.714+0000 7faafe6a3640 1 -- 172.21.15.146:0/2832065446 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4403aabc0 con 0x55d440510ac0 2024-09-18T01:45:25.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.714+0000 7faafe6a3640 1 --2- 172.21.15.146:0/2832065446 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55d440510ac0 0x55d4405fe5d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7faaf0001d00 tx=0x7faaf000b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64fd7f12e9506ca server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.714+0000 7fa9ec608640 1 -- 172.21.15.146:0/2832065446 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faaf000f400 con 0x55d440510ac0 2024-09-18T01:45:25.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.714+0000 7fa9ec608640 1 -- 172.21.15.146:0/2832065446 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faaf0001e50 con 0x55d440510ac0 2024-09-18T01:45:25.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.714+0000 7fa9ec608640 1 -- 172.21.15.146:0/2832065446 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faaf000f600 con 0x55d440510ac0 2024-09-18T01:45:25.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.715+0000 7fab00baf800 1 -- 172.21.15.146:0/2832065446 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55d440510ac0 msgr2=0x55d4405fe5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.715+0000 7fab00baf800 1 --2- 172.21.15.146:0/2832065446 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55d440510ac0 0x55d4405fe5d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7faaf0001d00 tx=0x7faaf000b5b0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.715+0000 7fab00baf800 1 -- 172.21.15.146:0/2832065446 shutdown_connections 2024-09-18T01:45:25.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.715+0000 7fab00baf800 1 --2- 172.21.15.146:0/2832065446 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55d440510ac0 0x55d4405fe5d0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.715+0000 7fab00baf800 1 -- 172.21.15.146:0/2832065446 >> 172.21.15.146:0/2832065446 conn(0x55d44050b5c0 msgr2=0x55d4405f9f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:25.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.715+0000 7fab00baf800 1 -- 172.21.15.146:0/2832065446 shutdown_connections 2024-09-18T01:45:25.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.715+0000 7fab00baf800 1 -- 172.21.15.146:0/2832065446 wait complete. 2024-09-18T01:45:25.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.715+0000 7fab00baf800 1 Processor -- start 2024-09-18T01:45:25.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.715+0000 7fab00baf800 1 -- start start 2024-09-18T01:45:25.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.715+0000 7fab00baf800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55d440510ac0 0x55d440605fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.715+0000 7fab00baf800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55d4405175b0 con 0x55d440510ac0 2024-09-18T01:45:25.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.715+0000 7faafe6a3640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55d440510ac0 0x55d440605fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.716+0000 7faafe6a3640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55d440510ac0 0x55d440605fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60540/0 (socket says 172.21.15.146:60540) 2024-09-18T01:45:25.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.716+0000 7faafe6a3640 1 -- 172.21.15.146:0/1149836866 learned_addr learned my addr 172.21.15.146:0/1149836866 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:25.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.716+0000 7faafe6a3640 1 -- 172.21.15.146:0/1149836866 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4403befe0 con 0x55d440510ac0 2024-09-18T01:45:25.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.716+0000 7faafe6a3640 1 --2- 172.21.15.146:0/1149836866 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55d440510ac0 0x55d440605fe0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7faaf0002000 tx=0x7faaf0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.716+0000 7fa9eae05640 1 -- 172.21.15.146:0/1149836866 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faaf001a5b0 con 0x55d440510ac0 2024-09-18T01:45:25.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.716+0000 7fa9eae05640 1 -- 172.21.15.146:0/1149836866 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faaf001a750 con 0x55d440510ac0 2024-09-18T01:45:25.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.716+0000 7fab00baf800 1 -- 172.21.15.146:0/1149836866 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d440606520 con 0x55d440510ac0 2024-09-18T01:45:25.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.716+0000 7fa9eae05640 1 -- 172.21.15.146:0/1149836866 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faaf001aab0 con 0x55d440510ac0 2024-09-18T01:45:25.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.716+0000 7fab00baf800 1 -- 172.21.15.146:0/1149836866 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d440606aa0 con 0x55d440510ac0 2024-09-18T01:45:25.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.717+0000 7fa9eae05640 1 -- 172.21.15.146:0/1149836866 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7faaf0017070 con 0x55d440510ac0 2024-09-18T01:45:25.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.717+0000 7fa9eae05640 1 --2- 172.21.15.146:0/1149836866 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fa9e4036b40 0x7fa9e4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.717+0000 7fa9eae05640 1 -- 172.21.15.146:0/1149836866 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7faaf0015020 con 0x55d440510ac0 2024-09-18T01:45:25.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.717+0000 7faaf7fff640 1 --2- 172.21.15.146:0/1149836866 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fa9e4036b40 0x7fa9e4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.717+0000 7fab00baf800 1 --2- 172.21.15.146:0/1149836866 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55d440514980 0x55d44060d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.717+0000 7fab00baf800 1 -- 172.21.15.146:0/1149836866 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d44060d5d0 con 0x55d440514980 2024-09-18T01:45:25.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.717+0000 7faafeea4640 1 --2- 172.21.15.146:0/1149836866 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55d440514980 0x55d44060d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.718+0000 7faaf7fff640 1 --2- 172.21.15.146:0/1149836866 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fa9e4036b40 0x7fa9e4039000 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7faae8058000 tx=0x7faae8053000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.718+0000 7faafeea4640 1 --2- 172.21.15.146:0/1149836866 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55d440514980 0x55d44060d050 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.718+0000 7faafeea4640 1 -- 172.21.15.146:0/1149836866 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faaf800a4a0 con 0x55d440514980 2024-09-18T01:45:25.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.718+0000 7fab00baf800 1 -- 172.21.15.146:0/1149836866 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d44060a620 con 0x55d440514980 2024-09-18T01:45:25.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.718+0000 7faafeea4640 1 -- 172.21.15.146:0/1149836866 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faaf800a4a0 con 0x55d440514980 2024-09-18T01:45:25.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.718+0000 7fab00baf800 1 -- 172.21.15.146:0/1149836866 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d44060f3f0 con 0x55d440514980 2024-09-18T01:45:25.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.719+0000 7faafeea4640 1 -- 172.21.15.146:0/1149836866 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7faaf800a4a0 con 0x55d440514980 2024-09-18T01:45:25.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.719+0000 7fab00baf800 1 -- 172.21.15.146:0/1149836866 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d44060e530 con 0x55d440514980 2024-09-18T01:45:25.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.719+0000 7faafeea4640 1 -- 172.21.15.146:0/1149836866 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faaf800a4a0 con 0x55d440514980 2024-09-18T01:45:25.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.719+0000 7fab00baf800 1 --2- 172.21.15.146:0/1149836866 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55d44060f000 0x55d440612840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.719+0000 7fab00baf800 1 -- 172.21.15.146:0/1149836866 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d440612fd0 con 0x55d44060f000 2024-09-18T01:45:25.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.719+0000 7faafe6a3640 1 --2- 172.21.15.146:0/1149836866 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55d44060f000 0x55d440612840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.719+0000 7faafe6a3640 1 --2- 172.21.15.146:0/1149836866 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55d44060f000 0x55d440612840 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.719+0000 7faafe6a3640 1 -- 172.21.15.146:0/1149836866 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7faaf002e070 con 0x55d44060f000 2024-09-18T01:45:25.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.720+0000 7fab00baf800 1 Processor -- start 2024-09-18T01:45:25.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.720+0000 7fab00baf800 1 -- start start 2024-09-18T01:45:25.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.720+0000 7fab00baf800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55d440620d60 0x55d440621180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.720+0000 7fab00baf800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55d4403ac580 con 0x55d440620d60 2024-09-18T01:45:25.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.720+0000 7faafeea4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55d440620d60 0x55d440621180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.720+0000 7faafeea4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55d440620d60 0x55d440621180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60542/0 (socket says 172.21.15.146:60542) 2024-09-18T01:45:25.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.720+0000 7faafeea4640 1 -- 172.21.15.146:0/2205858130 learned_addr learned my addr 172.21.15.146:0/2205858130 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:25.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.720+0000 7faafeea4640 1 -- 172.21.15.146:0/2205858130 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4406216c0 con 0x55d440620d60 2024-09-18T01:45:25.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.721+0000 7faafeea4640 1 --2- 172.21.15.146:0/2205858130 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55d440620d60 0x55d440621180 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x55d44060d9b0 tx=0x7faaf80178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.721+0000 7fa9e3fff640 1 -- 172.21.15.146:0/2205858130 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faaf8013440 con 0x55d440620d60 2024-09-18T01:45:25.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.721+0000 7fa9e3fff640 1 -- 172.21.15.146:0/2205858130 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faaf80135e0 con 0x55d440620d60 2024-09-18T01:45:25.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.721+0000 7fab00baf800 1 -- 172.21.15.146:0/2205858130 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d440621950 con 0x55d440620d60 2024-09-18T01:45:25.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.721+0000 7fa9e3fff640 1 -- 172.21.15.146:0/2205858130 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faaf80138c0 con 0x55d440620d60 2024-09-18T01:45:25.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.721+0000 7fab00baf800 1 -- 172.21.15.146:0/2205858130 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d440624630 con 0x55d440620d60 2024-09-18T01:45:25.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.721+0000 7fa9e3fff640 1 -- 172.21.15.146:0/2205858130 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7faaf8011040 con 0x55d440620d60 2024-09-18T01:45:25.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.722+0000 7fa9e3fff640 1 --2- 172.21.15.146:0/2205858130 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fa9d8036b40 0x7fa9d8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.722+0000 7fa9e3fff640 1 -- 172.21.15.146:0/2205858130 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7faaf801d070 con 0x55d440620d60 2024-09-18T01:45:25.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.722+0000 7faafe6a3640 1 --2- 172.21.15.146:0/2205858130 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fa9d8036b40 0x7fa9d8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.722+0000 7fab00baf800 1 Processor -- start 2024-09-18T01:45:25.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.722+0000 7fab00baf800 1 -- start start 2024-09-18T01:45:25.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.722+0000 7faafe6a3640 1 --2- 172.21.15.146:0/2205858130 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fa9d8036b40 0x7fa9d8039000 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x55d4406133d0 tx=0x7faaf004b060 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.722+0000 7fab00baf800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55d44062da30 0x55d44062de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.722+0000 7fab00baf800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55d4405fed80 con 0x55d44062da30 2024-09-18T01:45:25.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.722+0000 7faafeea4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55d44062da30 0x55d44062de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.722+0000 7faafeea4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55d44062da30 0x55d44062de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60548/0 (socket says 172.21.15.146:60548) 2024-09-18T01:45:25.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.722+0000 7faafeea4640 1 -- 172.21.15.146:0/3272706767 learned_addr learned my addr 172.21.15.146:0/3272706767 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:25.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.723+0000 7faafeea4640 1 -- 172.21.15.146:0/3272706767 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d44062e400 con 0x55d44062da30 2024-09-18T01:45:25.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.723+0000 7faafeea4640 1 --2- 172.21.15.146:0/3272706767 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55d44062da30 0x55d44062de30 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7faaf8001450 tx=0x7faaf804caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9af2aa92f7a91b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.723+0000 7fa9e1ffb640 1 -- 172.21.15.146:0/3272706767 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faaf8045070 con 0x55d44062da30 2024-09-18T01:45:25.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.723+0000 7fa9e1ffb640 1 -- 172.21.15.146:0/3272706767 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faaf8015560 con 0x55d44062da30 2024-09-18T01:45:25.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.723+0000 7fa9e1ffb640 1 -- 172.21.15.146:0/3272706767 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faaf802ad80 con 0x55d44062da30 2024-09-18T01:45:25.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.723+0000 7fab00baf800 1 -- 172.21.15.146:0/3272706767 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55d44062da30 msgr2=0x55d44062de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.723+0000 7fab00baf800 1 --2- 172.21.15.146:0/3272706767 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55d44062da30 0x55d44062de30 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7faaf8001450 tx=0x7faaf804caf0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.723+0000 7fab00baf800 1 -- 172.21.15.146:0/3272706767 shutdown_connections 2024-09-18T01:45:25.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.723+0000 7fab00baf800 1 --2- 172.21.15.146:0/3272706767 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55d44062da30 0x55d44062de30 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.723+0000 7fab00baf800 1 -- 172.21.15.146:0/3272706767 >> 172.21.15.146:0/3272706767 conn(0x55d440629d90 msgr2=0x55d440627e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:25.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.723+0000 7fab00baf800 1 -- 172.21.15.146:0/3272706767 shutdown_connections 2024-09-18T01:45:25.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.723+0000 7fab00baf800 1 -- 172.21.15.146:0/3272706767 wait complete. 2024-09-18T01:45:25.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.724+0000 7fab00baf800 1 Processor -- start 2024-09-18T01:45:25.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.724+0000 7fab00baf800 1 -- start start 2024-09-18T01:45:25.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.724+0000 7fab00baf800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55d44062da30 0x55d440634e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.724+0000 7fab00baf800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55d44062ea70 con 0x55d44062da30 2024-09-18T01:45:25.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.724+0000 7faafeea4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55d44062da30 0x55d440634e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.724+0000 7faafeea4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55d44062da30 0x55d440634e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60560/0 (socket says 172.21.15.146:60560) 2024-09-18T01:45:25.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.724+0000 7faafeea4640 1 -- 172.21.15.146:0/3998796173 learned_addr learned my addr 172.21.15.146:0/3998796173 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:25.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.724+0000 7faafeea4640 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d440635350 con 0x55d44062da30 2024-09-18T01:45:25.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.724+0000 7faafeea4640 1 --2- 172.21.15.146:0/3998796173 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55d44062da30 0x55d440634e10 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7faaf8043040 tx=0x7faaf804c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.725+0000 7fa9cffff640 1 -- 172.21.15.146:0/3998796173 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faaf803a070 con 0x55d44062da30 2024-09-18T01:45:25.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.725+0000 7fa9cffff640 1 -- 172.21.15.146:0/3998796173 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faaf804b380 con 0x55d44062da30 2024-09-18T01:45:25.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.725+0000 7fab00baf800 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d4406355e0 con 0x55d44062da30 2024-09-18T01:45:25.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.725+0000 7fa9cffff640 1 -- 172.21.15.146:0/3998796173 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faaf8045040 con 0x55d44062da30 2024-09-18T01:45:25.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.725+0000 7fab00baf800 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d440638290 con 0x55d44062da30 2024-09-18T01:45:25.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.725+0000 7fa9cffff640 1 -- 172.21.15.146:0/3998796173 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7faaf803d070 con 0x55d44062da30 2024-09-18T01:45:25.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.726+0000 7fa9cffff640 1 --2- 172.21.15.146:0/3998796173 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fa9c8036b40 0x7fa9c8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.726+0000 7fa9cffff640 1 -- 172.21.15.146:0/3998796173 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7faaf800e040 con 0x55d44062da30 2024-09-18T01:45:25.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.726+0000 7faafe6a3640 1 --2- 172.21.15.146:0/3998796173 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fa9c8036b40 0x7fa9c8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.726+0000 7fab00baf800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.726+0000 7fab00baf800 1 --2- 172.21.15.146:0/3998796173 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55d440640af0 0x55d440642fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.726+0000 7fab00baf800 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d440643700 con 0x55d440640af0 2024-09-18T01:45:25.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.726+0000 7faaf7fff640 1 --2- 172.21.15.146:0/3998796173 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55d440640af0 0x55d440642fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.726+0000 7faafe6a3640 1 --2- 172.21.15.146:0/3998796173 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fa9c8036b40 0x7fa9c8039000 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7faaf001beb0 tx=0x7faaf0042000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.726+0000 7faaf7fff640 1 --2- 172.21.15.146:0/3998796173 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55d440640af0 0x55d440642fb0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.727+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faae80088f0 con 0x55d440640af0 2024-09-18T01:45:25.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.727+0000 7fab00baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:25.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.727+0000 7fab00baf800 20 realm 2024-09-18T01:45:25.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.727+0000 7fab00baf800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.727+0000 7fab00baf800 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d440643b30 con 0x55d440640af0 2024-09-18T01:45:25.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.727+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faae80088f0 con 0x55d440640af0 2024-09-18T01:45:25.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.727+0000 7fab00baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:25.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.727+0000 7fab00baf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:25.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.727+0000 7fab00baf800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.727+0000 7fab00baf800 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d440644400 con 0x55d440640af0 2024-09-18T01:45:25.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.727+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faae80088f0 con 0x55d440640af0 2024-09-18T01:45:25.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.727+0000 7fab00baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:25.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.727+0000 7fab00baf800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.727+0000 7fab00baf800 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4406447a0 con 0x55d440640af0 2024-09-18T01:45:25.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.727+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faae80088f0 con 0x55d440640af0 2024-09-18T01:45:25.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.727+0000 7fab00baf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:25.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.727+0000 7fab00baf800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.727+0000 7fab00baf800 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d440644010 con 0x55d440640af0 2024-09-18T01:45:25.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.728+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7faae80088f0 con 0x55d440640af0 2024-09-18T01:45:25.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.728+0000 7fab00baf800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:25.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.728+0000 7fab00baf800 20 searching for the correct realm 2024-09-18T01:45:25.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.728+0000 7fab00baf800 1 --2- 172.21.15.146:0/3998796173 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55d440646c60 0x55d440649070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.728+0000 7fab00baf800 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d440649740 con 0x55d440646c60 2024-09-18T01:45:25.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.728+0000 7faafeea4640 1 --2- 172.21.15.146:0/3998796173 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55d440646c60 0x55d440649070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.728+0000 7faafeea4640 1 --2- 172.21.15.146:0/3998796173 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55d440646c60 0x55d440649070 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.728+0000 7faafeea4640 1 -- 172.21.15.146:0/3998796173 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faaf803c030 con 0x55d440646c60 2024-09-18T01:45:25.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.728+0000 7faafeea4640 1 --2- 172.21.15.146:0/3998796173 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7faaf803f060 0x7faaf800f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.728+0000 7faafeea4640 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d440649740 con 0x7faaf803f060 2024-09-18T01:45:25.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.729+0000 7faafe6a3640 1 --2- 172.21.15.146:0/3998796173 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7faaf803f060 0x7faaf800f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.729+0000 7faafe6a3640 1 --2- 172.21.15.146:0/3998796173 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7faaf803f060 0x7faaf800f2b0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.729+0000 7faafe6a3640 1 -- 172.21.15.146:0/3998796173 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faaf0042070 con 0x7faaf803f060 2024-09-18T01:45:25.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.729+0000 7faafe6a3640 1 --2- 172.21.15.146:0/3998796173 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7faaf004c280 0x7faaf004c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.729+0000 7faafe6a3640 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d440649740 con 0x7faaf004c280 2024-09-18T01:45:25.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.729+0000 7faaf7fff640 1 --2- 172.21.15.146:0/3998796173 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7faaf004c280 0x7faaf004c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.730+0000 7faaf7fff640 1 --2- 172.21.15.146:0/3998796173 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7faaf004c280 0x7faaf004c6c0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.730+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faae80088f0 con 0x7faaf004c280 2024-09-18T01:45:25.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.730+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d440649740 con 0x55d440640af0 2024-09-18T01:45:25.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.730+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7faae80088f0 con 0x55d440640af0 2024-09-18T01:45:25.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.730+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d440649740 con 0x55d440640af0 2024-09-18T01:45:25.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.730+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faae80088f0 con 0x55d440640af0 2024-09-18T01:45:25.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.730+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d440649740 con 0x7faaf004c280 2024-09-18T01:45:25.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.730+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faae80088f0 con 0x7faaf004c280 2024-09-18T01:45:25.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.730+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d440649740 con 0x7faaf004c280 2024-09-18T01:45:25.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.731+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faae80088f0 con 0x7faaf004c280 2024-09-18T01:45:25.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.731+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d440649740 con 0x7faaf803f060 2024-09-18T01:45:25.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.731+0000 7faafe6a3640 1 -- 172.21.15.146:0/3998796173 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faaf0042070 con 0x7faaf803f060 2024-09-18T01:45:25.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.731+0000 7faafe6a3640 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d440649740 con 0x55d440646c60 2024-09-18T01:45:25.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.731+0000 7faafeea4640 1 -- 172.21.15.146:0/3998796173 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faaf803c030 con 0x55d440646c60 2024-09-18T01:45:25.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.731+0000 7faafeea4640 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d440649740 con 0x55d440640af0 2024-09-18T01:45:25.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.731+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faae80088f0 con 0x55d440640af0 2024-09-18T01:45:25.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.731+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d440649740 con 0x7faaf004c280 2024-09-18T01:45:25.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.732+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faae80088f0 con 0x7faaf004c280 2024-09-18T01:45:25.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.732+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d440649740 con 0x55d440640af0 2024-09-18T01:45:25.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.732+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faae80088f0 con 0x55d440640af0 2024-09-18T01:45:25.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.732+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d440649740 con 0x7faaf803f060 2024-09-18T01:45:25.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.732+0000 7faafe6a3640 1 -- 172.21.15.146:0/3998796173 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7faaf0042070 con 0x7faaf803f060 2024-09-18T01:45:25.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.732+0000 7faafe6a3640 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d440649740 con 0x55d440646c60 2024-09-18T01:45:25.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.732+0000 7faafeea4640 1 -- 172.21.15.146:0/3998796173 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faaf803c030 con 0x55d440646c60 2024-09-18T01:45:25.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.732+0000 7faafeea4640 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d440649740 con 0x55d440646c60 2024-09-18T01:45:25.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.733+0000 7faafeea4640 1 -- 172.21.15.146:0/3998796173 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faaf803c030 con 0x55d440646c60 2024-09-18T01:45:25.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.733+0000 7faafeea4640 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d440649740 con 0x7faaf004c280 2024-09-18T01:45:25.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.733+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faae80088f0 con 0x7faaf004c280 2024-09-18T01:45:25.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.733+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d440649740 con 0x55d440646c60 2024-09-18T01:45:25.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.733+0000 7faafeea4640 1 -- 172.21.15.146:0/3998796173 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faaf803c030 con 0x55d440646c60 2024-09-18T01:45:25.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.733+0000 7faafeea4640 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d440649740 con 0x55d440646c60 2024-09-18T01:45:25.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.733+0000 7faafeea4640 1 -- 172.21.15.146:0/3998796173 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faaf803c030 con 0x55d440646c60 2024-09-18T01:45:25.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.733+0000 7faafeea4640 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d440649740 con 0x55d440640af0 2024-09-18T01:45:25.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.734+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faae80088f0 con 0x55d440640af0 2024-09-18T01:45:25.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.734+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d440649740 con 0x55d440640af0 2024-09-18T01:45:25.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.734+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7faae80088f0 con 0x55d440640af0 2024-09-18T01:45:25.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.734+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d440649740 con 0x7faaf004c280 2024-09-18T01:45:25.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.734+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faae80088f0 con 0x7faaf004c280 2024-09-18T01:45:25.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.734+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d440649740 con 0x55d440646c60 2024-09-18T01:45:25.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.734+0000 7faafeea4640 1 -- 172.21.15.146:0/3998796173 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faaf803c030 con 0x55d440646c60 2024-09-18T01:45:25.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.734+0000 7faafeea4640 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d440649740 con 0x7faaf803f060 2024-09-18T01:45:25.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.735+0000 7faafe6a3640 1 -- 172.21.15.146:0/3998796173 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faaf0042070 con 0x7faaf803f060 2024-09-18T01:45:25.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.735+0000 7faafe6a3640 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d440649740 con 0x55d440640af0 2024-09-18T01:45:25.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.735+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faae80088f0 con 0x55d440640af0 2024-09-18T01:45:25.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.735+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d440649740 con 0x7faaf004c280 2024-09-18T01:45:25.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.735+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faae80088f0 con 0x7faaf004c280 2024-09-18T01:45:25.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.735+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d440649740 con 0x55d440646c60 2024-09-18T01:45:25.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.735+0000 7faafeea4640 1 -- 172.21.15.146:0/3998796173 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faaf803c030 con 0x55d440646c60 2024-09-18T01:45:25.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.735+0000 7faafeea4640 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d440649740 con 0x7faaf004c280 2024-09-18T01:45:25.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.736+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faae80088f0 con 0x7faaf004c280 2024-09-18T01:45:25.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.736+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d440649740 con 0x7faaf803f060 2024-09-18T01:45:25.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.736+0000 7faafe6a3640 1 -- 172.21.15.146:0/3998796173 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faaf0042070 con 0x7faaf803f060 2024-09-18T01:45:25.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.736+0000 7faafe6a3640 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d440649740 con 0x55d440646c60 2024-09-18T01:45:25.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.736+0000 7faafeea4640 1 -- 172.21.15.146:0/3998796173 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faaf803c030 con 0x55d440646c60 2024-09-18T01:45:25.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.736+0000 7faafeea4640 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d440649740 con 0x7faaf004c280 2024-09-18T01:45:25.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.736+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faae80088f0 con 0x7faaf004c280 2024-09-18T01:45:25.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.736+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d440649740 con 0x55d440640af0 2024-09-18T01:45:25.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.737+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7faae80088f0 con 0x55d440640af0 2024-09-18T01:45:25.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.737+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d440649740 con 0x7faaf803f060 2024-09-18T01:45:25.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.737+0000 7faafe6a3640 1 -- 172.21.15.146:0/3998796173 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faaf0042070 con 0x7faaf803f060 2024-09-18T01:45:25.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.737+0000 7fab00baf800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:25.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.737+0000 7fab00baf800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:25.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.737+0000 7fab00baf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:25.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.737+0000 7fab00baf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:25.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.737+0000 7fab00baf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:25.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.737+0000 7fab00baf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:25.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.737+0000 7fab00baf800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.737+0000 7fab00baf800 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4406456e0 con 0x55d440640af0 2024-09-18T01:45:25.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.737+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faae80088f0 con 0x55d440640af0 2024-09-18T01:45:25.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.737+0000 7fab00baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:25.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.737+0000 7fab00baf800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.737+0000 7fab00baf800 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4406452f0 con 0x55d440640af0 2024-09-18T01:45:25.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.737+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faae80088f0 con 0x55d440640af0 2024-09-18T01:45:25.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.737+0000 7fab00baf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:25.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.737+0000 7fab00baf800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.737+0000 7fab00baf800 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d440646050 con 0x7faaf803f060 2024-09-18T01:45:25.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.738+0000 7faafe6a3640 1 -- 172.21.15.146:0/3998796173 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7faaf0042070 con 0x7faaf803f060 2024-09-18T01:45:25.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.738+0000 7fab00baf800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:25.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.738+0000 7fab00baf800 20 zone default found 2024-09-18T01:45:25.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.738+0000 7fab00baf800 4 Realm: () 2024-09-18T01:45:25.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.738+0000 7fab00baf800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:25.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.738+0000 7fab00baf800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:25.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.738+0000 7fab00baf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:25.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.738+0000 7fab00baf800 20 zonegroup default 2024-09-18T01:45:25.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.738+0000 7fab00baf800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.738+0000 7fab00baf800 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d44064a070 con 0x7faaf004c280 2024-09-18T01:45:25.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.738+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7faae80088f0 con 0x7faaf004c280 2024-09-18T01:45:25.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.738+0000 7fab00baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:25.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.738+0000 7fab00baf800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.738+0000 7fab00baf800 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d44064bb40 con 0x55d440646c60 2024-09-18T01:45:25.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.738+0000 7faafeea4640 1 -- 172.21.15.146:0/3998796173 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faaf803c030 con 0x55d440646c60 2024-09-18T01:45:25.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.738+0000 7fab00baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:25.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.738+0000 7fab00baf800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.738+0000 7fab00baf800 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d44064bfe0 con 0x55d440646c60 2024-09-18T01:45:25.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.739+0000 7faafeea4640 1 -- 172.21.15.146:0/3998796173 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faaf803c030 con 0x55d440646c60 2024-09-18T01:45:25.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.739+0000 7fab00baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:25.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.739+0000 7fab00baf800 20 started sync module instance, tier type = 2024-09-18T01:45:25.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.739+0000 7fab00baf800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:25.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.739+0000 7fab00baf800 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d44064b670 con 0x7faaf803f060 2024-09-18T01:45:25.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.740+0000 7faafe6a3640 1 -- 172.21.15.146:0/3998796173 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v31'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faaf0042070 con 0x7faaf803f060 2024-09-18T01:45:25.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.740+0000 7fab00baf800 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94370101766896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d44064c440 con 0x7faaf803f060 2024-09-18T01:45:25.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.740+0000 7fab00baf800 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d44064ceb0 con 0x55d440640af0 2024-09-18T01:45:25.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.741+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v31'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faae80088f0 con 0x55d440640af0 2024-09-18T01:45:25.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.741+0000 7fab00baf800 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94370101774752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d44064d780 con 0x55d440640af0 2024-09-18T01:45:25.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.741+0000 7faafe6a3640 1 -- 172.21.15.146:0/3998796173 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94370101766896] v31'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faaf0042070 con 0x7faaf803f060 2024-09-18T01:45:25.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.741+0000 7fab00baf800 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d44064e250 con 0x55d440646c60 2024-09-18T01:45:25.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.742+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94370101774752] v31'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faae80088f0 con 0x55d440640af0 2024-09-18T01:45:25.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.742+0000 7faafeea4640 1 -- 172.21.15.146:0/3998796173 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v31'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faaf803c030 con 0x55d440646c60 2024-09-18T01:45:25.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.742+0000 7fab00baf800 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94370101779776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d44064d780 con 0x55d440646c60 2024-09-18T01:45:25.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.742+0000 7fab00baf800 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d44064eb40 con 0x7faaf803f060 2024-09-18T01:45:25.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.743+0000 7faafeea4640 1 -- 172.21.15.146:0/3998796173 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94370101779776] v31'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faaf803c030 con 0x55d440646c60 2024-09-18T01:45:25.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.743+0000 7faafe6a3640 1 -- 172.21.15.146:0/3998796173 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v31'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faaf0042070 con 0x7faaf803f060 2024-09-18T01:45:25.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.743+0000 7fab00baf800 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94370101777104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d44064d6f0 con 0x7faaf803f060 2024-09-18T01:45:25.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.743+0000 7fab00baf800 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d44064fa00 con 0x55d440640af0 2024-09-18T01:45:25.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.744+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v31'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faae80088f0 con 0x55d440640af0 2024-09-18T01:45:25.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.744+0000 7fab00baf800 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94370101785936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d44064f970 con 0x55d440640af0 2024-09-18T01:45:25.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.744+0000 7fab00baf800 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d440650980 con 0x7faaf004c280 2024-09-18T01:45:25.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.745+0000 7faafe6a3640 1 -- 172.21.15.146:0/3998796173 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94370101777104] v31'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faaf0042070 con 0x7faaf803f060 2024-09-18T01:45:25.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.746+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94370101785936] v31'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faae80088f0 con 0x55d440640af0 2024-09-18T01:45:25.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.746+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v31'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faae80088f0 con 0x7faaf004c280 2024-09-18T01:45:25.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.746+0000 7fab00baf800 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94370101789808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d440650940 con 0x7faaf004c280 2024-09-18T01:45:25.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.746+0000 7fab00baf800 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d44064ff10 con 0x7faaf004c280 2024-09-18T01:45:25.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.747+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(56 notify.6 [create] v31'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faae80088f0 con 0x7faaf004c280 2024-09-18T01:45:25.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.747+0000 7fab00baf800 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94370101791552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d44064ff10 con 0x7faaf004c280 2024-09-18T01:45:25.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.747+0000 7fab00baf800 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d440651d40 con 0x7faaf004c280 2024-09-18T01:45:25.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.747+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94370101789808] v31'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faae80088f0 con 0x7faaf004c280 2024-09-18T01:45:25.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.747+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(58 notify.7 [create] v31'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faae80088f0 con 0x7faaf004c280 2024-09-18T01:45:25.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.747+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94370101791552] v31'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faae80088f0 con 0x7faaf004c280 2024-09-18T01:45:25.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.747+0000 7fab00baf800 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94370101784368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4406512a0 con 0x7faaf004c280 2024-09-18T01:45:25.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.747+0000 7fab00baf800 20 add_watcher() i=0 2024-09-18T01:45:25.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.747+0000 7fab00baf800 20 add_watcher() i=1 2024-09-18T01:45:25.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.747+0000 7fab00baf800 20 add_watcher() i=2 2024-09-18T01:45:25.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.747+0000 7fab00baf800 20 add_watcher() i=3 2024-09-18T01:45:25.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.747+0000 7fab00baf800 20 add_watcher() i=4 2024-09-18T01:45:25.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.747+0000 7fab00baf800 20 add_watcher() i=5 2024-09-18T01:45:25.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.747+0000 7fab00baf800 20 add_watcher() i=6 2024-09-18T01:45:25.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.748+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94370101784368] v31'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faae80088f0 con 0x7faaf004c280 2024-09-18T01:45:25.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.748+0000 7fab00baf800 20 add_watcher() i=7 2024-09-18T01:45:25.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.748+0000 7fab00baf800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:25.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.748+0000 7fab00baf800 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d440654d70 con 0x55d440640af0 2024-09-18T01:45:25.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.749+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7faae80088f0 con 0x55d440640af0 2024-09-18T01:45:25.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.749+0000 7fab00baf800 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94370101794960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d440652160 con 0x55d440640af0 2024-09-18T01:45:25.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.750+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94370101794960] v31'98 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faae80088f0 con 0x55d440640af0 2024-09-18T01:45:25.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.750+0000 7fa9b4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:25.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.750+0000 7fab00baf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:25.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.750+0000 7fab00baf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:25.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.750+0000 7fab00baf800 5 note: GC not initialized 2024-09-18T01:45:25.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.750+0000 7fa92f7fe640 20 reqs_thread_entry: start 2024-09-18T01:45:25.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.750+0000 7fab00baf800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:25.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.750+0000 7fab00baf800 20 Filter name: none 2024-09-18T01:45:25.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.750+0000 7fa92d7fa640 20 reqs_thread_entry: start 2024-09-18T01:45:25.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.750+0000 7fab00baf800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.750+0000 7fab00baf800 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d440687b40 con 0x55d440640af0 2024-09-18T01:45:25.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.751+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7faae80088f0 con 0x55d440640af0 2024-09-18T01:45:25.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.751+0000 7fab00baf800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:45:25.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.751+0000 7fab00baf800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.751+0000 7fab00baf800 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d440688530 con 0x55d440640af0 2024-09-18T01:45:25.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.751+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7faae80088f0 con 0x55d440640af0 2024-09-18T01:45:25.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.751+0000 7fab00baf800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:45:25.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.751+0000 7fab00baf800 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d440689540 con 0x7faaf803f060 2024-09-18T01:45:25.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.751+0000 7faafe6a3640 1 -- 172.21.15.146:0/3998796173 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv2 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7faaf0042070 con 0x7faaf803f060 2024-09-18T01:45:25.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.752+0000 7fa9b4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:25.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.752+0000 7fab00baf800 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94370101794960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d440685950 con 0x55d440640af0 2024-09-18T01:45:25.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.753+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94370101794960] v31'99 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faae80088f0 con 0x55d440640af0 2024-09-18T01:45:25.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.753+0000 7fab00baf800 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94370101766896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d440685950 con 0x7faaf803f060 2024-09-18T01:45:25.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.754+0000 7faafe6a3640 1 -- 172.21.15.146:0/3998796173 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94370101766896] v31'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faaf0042070 con 0x7faaf803f060 2024-09-18T01:45:25.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.754+0000 7fab00baf800 20 remove_watcher() i=0 2024-09-18T01:45:25.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.754+0000 7fab00baf800 2 removed watcher, disabling cache 2024-09-18T01:45:25.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.754+0000 7fab00baf800 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94370101774752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d440685950 con 0x55d440640af0 2024-09-18T01:45:25.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.755+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94370101774752] v31'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faae80088f0 con 0x55d440640af0 2024-09-18T01:45:25.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.755+0000 7fab00baf800 20 remove_watcher() i=1 2024-09-18T01:45:25.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.755+0000 7fab00baf800 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94370101779776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d440685950 con 0x55d440646c60 2024-09-18T01:45:25.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.756+0000 7faafeea4640 1 -- 172.21.15.146:0/3998796173 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94370101779776] v31'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faaf803c030 con 0x55d440646c60 2024-09-18T01:45:25.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.756+0000 7fab00baf800 20 remove_watcher() i=2 2024-09-18T01:45:25.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.756+0000 7fab00baf800 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94370101777104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d440685950 con 0x7faaf803f060 2024-09-18T01:45:25.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.757+0000 7faafe6a3640 1 -- 172.21.15.146:0/3998796173 <== osd.2 v2:172.21.15.146:6800/3820039304 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94370101777104] v31'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faaf0042070 con 0x7faaf803f060 2024-09-18T01:45:25.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.757+0000 7fab00baf800 20 remove_watcher() i=3 2024-09-18T01:45:25.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.757+0000 7fab00baf800 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94370101785936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d440685950 con 0x55d440640af0 2024-09-18T01:45:25.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.758+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94370101785936] v31'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faae8081040 con 0x55d440640af0 2024-09-18T01:45:25.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.758+0000 7fab00baf800 20 remove_watcher() i=4 2024-09-18T01:45:25.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.758+0000 7fab00baf800 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94370101789808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d440685950 con 0x7faaf004c280 2024-09-18T01:45:25.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.759+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94370101789808] v31'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faae8081040 con 0x7faaf004c280 2024-09-18T01:45:25.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.759+0000 7fab00baf800 20 remove_watcher() i=5 2024-09-18T01:45:25.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.759+0000 7fab00baf800 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94370101791552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d440685950 con 0x7faaf004c280 2024-09-18T01:45:25.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.760+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94370101791552] v31'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faae8081040 con 0x7faaf004c280 2024-09-18T01:45:25.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.760+0000 7fab00baf800 20 remove_watcher() i=6 2024-09-18T01:45:25.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.760+0000 7fab00baf800 1 -- 172.21.15.146:0/3998796173 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94370101784368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d440685950 con 0x7faaf004c280 2024-09-18T01:45:25.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.761+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94370101784368] v31'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faae8081040 con 0x7faaf004c280 2024-09-18T01:45:25.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.761+0000 7fab00baf800 20 remove_watcher() i=7 2024-09-18T01:45:25.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.761+0000 7fab00baf800 1 -- 172.21.15.146:0/3998796173 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7faaf004c280 msgr2=0x7faaf004c6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.761+0000 7fab00baf800 1 --2- 172.21.15.146:0/3998796173 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7faaf004c280 0x7faaf004c6c0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.761+0000 7fab00baf800 1 -- 172.21.15.146:0/3998796173 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55d440640af0 msgr2=0x55d440642fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.761+0000 7fab00baf800 1 --2- 172.21.15.146:0/3998796173 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55d440640af0 0x55d440642fb0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.761+0000 7fab00baf800 1 -- 172.21.15.146:0/3998796173 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7faaf803f060 msgr2=0x7faaf800f2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.761+0000 7fab00baf800 1 --2- 172.21.15.146:0/3998796173 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7faaf803f060 0x7faaf800f2b0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.761+0000 7fab00baf800 1 -- 172.21.15.146:0/3998796173 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55d440646c60 msgr2=0x55d440649070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.761+0000 7fab00baf800 1 --2- 172.21.15.146:0/3998796173 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55d440646c60 0x55d440649070 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.762+0000 7fab00baf800 1 -- 172.21.15.146:0/3998796173 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fa9c8036b40 msgr2=0x7fa9c8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.762+0000 7fab00baf800 1 --2- 172.21.15.146:0/3998796173 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fa9c8036b40 0x7fa9c8039000 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7faaf001beb0 tx=0x7faaf0042000 comp rx=0 tx=0).stop 2024-09-18T01:45:25.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.762+0000 7fab00baf800 1 -- 172.21.15.146:0/3998796173 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55d44062da30 msgr2=0x55d440634e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.762+0000 7faaf7fff640 1 -- 172.21.15.146:0/3998796173 reap_dead start 2024-09-18T01:45:25.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.762+0000 7fab00baf800 1 --2- 172.21.15.146:0/3998796173 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55d44062da30 0x55d440634e10 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7faaf8043040 tx=0x7faaf804c880 comp rx=0 tx=0).stop 2024-09-18T01:45:25.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.762+0000 7fab00baf800 1 -- 172.21.15.146:0/3998796173 shutdown_connections 2024-09-18T01:45:25.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.762+0000 7fab00baf800 1 --2- 172.21.15.146:0/3998796173 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55d44062da30 0x55d440634e10 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.762+0000 7fab00baf800 1 -- 172.21.15.146:0/3998796173 >> 172.21.15.146:0/3998796173 conn(0x55d440629d90 msgr2=0x55d440627e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:25.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.762+0000 7fab00baf800 1 -- 172.21.15.146:0/3998796173 shutdown_connections 2024-09-18T01:45:25.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.762+0000 7fab00baf800 1 -- 172.21.15.146:0/3998796173 wait complete. 2024-09-18T01:45:25.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.762+0000 7fab00baf800 1 -- 172.21.15.146:0/2205858130 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fa9d8036b40 msgr2=0x7fa9d8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.762+0000 7fab00baf800 1 --2- 172.21.15.146:0/2205858130 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fa9d8036b40 0x7fa9d8039000 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x55d4406133d0 tx=0x7faaf004b060 comp rx=0 tx=0).stop 2024-09-18T01:45:25.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.762+0000 7fab00baf800 1 -- 172.21.15.146:0/2205858130 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55d440620d60 msgr2=0x55d440621180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.762+0000 7fab00baf800 1 --2- 172.21.15.146:0/2205858130 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55d440620d60 0x55d440621180 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x55d44060d9b0 tx=0x7faaf80178e0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.762+0000 7fab00baf800 1 -- 172.21.15.146:0/2205858130 shutdown_connections 2024-09-18T01:45:25.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.762+0000 7fab00baf800 1 --2- 172.21.15.146:0/2205858130 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fa9d8036b40 0x7fa9d8039000 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.762+0000 7fab00baf800 1 --2- 172.21.15.146:0/2205858130 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55d440620d60 0x55d440621180 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.762+0000 7fab00baf800 1 -- 172.21.15.146:0/2205858130 >> 172.21.15.146:0/2205858130 conn(0x55d440615cf0 msgr2=0x55d440618870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:25.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.762+0000 7fab00baf800 1 -- 172.21.15.146:0/2205858130 shutdown_connections 2024-09-18T01:45:25.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.762+0000 7fab00baf800 1 -- 172.21.15.146:0/2205858130 wait complete. 2024-09-18T01:45:25.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.762+0000 7fab00baf800 1 -- 172.21.15.146:0/1149836866 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55d440514980 msgr2=0x55d44060d050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.762+0000 7fab00baf800 1 --2- 172.21.15.146:0/1149836866 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55d440514980 0x55d44060d050 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.762+0000 7fab00baf800 1 -- 172.21.15.146:0/1149836866 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55d44060f000 msgr2=0x55d440612840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.762+0000 7fab00baf800 1 --2- 172.21.15.146:0/1149836866 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55d44060f000 0x55d440612840 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.762+0000 7fab00baf800 1 -- 172.21.15.146:0/1149836866 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fa9e4036b40 msgr2=0x7fa9e4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.763+0000 7fab00baf800 1 --2- 172.21.15.146:0/1149836866 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fa9e4036b40 0x7fa9e4039000 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7faae8058000 tx=0x7faae8053000 comp rx=0 tx=0).stop 2024-09-18T01:45:25.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.763+0000 7fab00baf800 1 -- 172.21.15.146:0/1149836866 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55d440510ac0 msgr2=0x55d440605fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.763+0000 7fab00baf800 1 --2- 172.21.15.146:0/1149836866 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55d440510ac0 0x55d440605fe0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7faaf0002000 tx=0x7faaf0000bc0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.763+0000 7fab00baf800 1 -- 172.21.15.146:0/1149836866 shutdown_connections 2024-09-18T01:45:25.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.763+0000 7fab00baf800 1 --2- 172.21.15.146:0/1149836866 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55d44060f000 0x55d440612840 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.763+0000 7fab00baf800 1 --2- 172.21.15.146:0/1149836866 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55d440514980 0x55d44060d050 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.763+0000 7fab00baf800 1 --2- 172.21.15.146:0/1149836866 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fa9e4036b40 0x7fa9e4039000 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.763+0000 7fab00baf800 1 --2- 172.21.15.146:0/1149836866 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55d440510ac0 0x55d440605fe0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.763+0000 7fab00baf800 1 -- 172.21.15.146:0/1149836866 >> 172.21.15.146:0/1149836866 conn(0x55d44050b5c0 msgr2=0x55d4405f8860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:25.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.763+0000 7fab00baf800 1 -- 172.21.15.146:0/1149836866 shutdown_connections 2024-09-18T01:45:25.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.763+0000 7fab00baf800 1 -- 172.21.15.146:0/1149836866 wait complete. 2024-09-18T01:45:25.777 INFO:teuthology.orchestra.run.smithi146.stdout:["myfoo"] 2024-09-18T01:45:25.778 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-18T01:45:25.783 INFO:tasks.radosgw_admin:RL: list_buckets foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T01:45:25.784 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-18T01:45:25.784 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-18T01:45:25.784 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-18T01:45:25.826 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:25.827 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:25.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.827+0000 7f6c34432800 1 Processor -- start 2024-09-18T01:45:25.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.827+0000 7f6c34432800 1 -- start start 2024-09-18T01:45:25.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.827+0000 7f6c34432800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55dc73f0fa40 0x55dc73f0fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.827+0000 7f6c34432800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55dc73dd0b30 con 0x55dc73f10380 2024-09-18T01:45:25.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.827+0000 7f6c34432800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x55dc73db2360 con 0x55dc73f0fa40 2024-09-18T01:45:25.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.827+0000 7f6c2f673640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55dc73f0fa40 0x55dc73f0fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.827+0000 7f6c2ee72640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x55dc73f10380 0x55dc73f18ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:38918/0 (socket says 172.21.15.146:38918) 2024-09-18T01:45:25.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.827+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2288147329 learned_addr learned my addr 172.21.15.146:0/2288147329 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:45:25.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.827+0000 7f6c2f673640 1 -- 172.21.15.146:0/2288147329 >> v1:172.21.15.129:6789/0 conn(0x55dc73f10380 legacy=0x55dc73f18ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.827+0000 7f6c2f673640 1 -- 172.21.15.146:0/2288147329 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc73dd8e00 con 0x55dc73f0fa40 2024-09-18T01:45:25.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.827+0000 7f6c2e671640 1 -- 172.21.15.146:0/2288147329 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2058112323 0 0) 0x55dc73dd0b30 con 0x55dc73f10380 2024-09-18T01:45:25.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.829+0000 7f6c2f673640 1 --2- 172.21.15.146:0/2288147329 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55dc73f0fa40 0x55dc73f0fe40 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6c2000a470 tx=0x7f6c20045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d8d71a66c0d7ac8 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.829+0000 7f6c2e671640 1 -- 172.21.15.146:0/2288147329 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c20053570 con 0x55dc73f0fa40 2024-09-18T01:45:25.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.829+0000 7f6c2e671640 1 -- 172.21.15.146:0/2288147329 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c20058070 con 0x55dc73f0fa40 2024-09-18T01:45:25.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.829+0000 7f6c2e671640 1 -- 172.21.15.146:0/2288147329 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c20053880 con 0x55dc73f0fa40 2024-09-18T01:45:25.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.830+0000 7f6c34432800 1 -- 172.21.15.146:0/2288147329 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55dc73f0fa40 msgr2=0x55dc73f0fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.830+0000 7f6c34432800 1 --2- 172.21.15.146:0/2288147329 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55dc73f0fa40 0x55dc73f0fe40 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6c2000a470 tx=0x7f6c20045a20 comp rx=0 tx=0).stop 2024-09-18T01:45:25.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.830+0000 7f6c34432800 1 -- 172.21.15.146:0/2288147329 shutdown_connections 2024-09-18T01:45:25.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.830+0000 7f6c34432800 1 --2- 172.21.15.146:0/2288147329 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55dc73f0fa40 0x55dc73f0fe40 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.830+0000 7f6c34432800 1 -- 172.21.15.146:0/2288147329 >> 172.21.15.146:0/2288147329 conn(0x55dc73f0b5b0 msgr2=0x55dc73f0d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:25.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.830+0000 7f6c34432800 1 -- 172.21.15.146:0/2288147329 shutdown_connections 2024-09-18T01:45:25.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.830+0000 7f6c34432800 1 -- 172.21.15.146:0/2288147329 wait complete. 2024-09-18T01:45:25.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.843+0000 7f6c34432800 1 Processor -- start 2024-09-18T01:45:25.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.843+0000 7f6c34432800 1 -- start start 2024-09-18T01:45:25.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.844+0000 7f6c34432800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55dc73f0fa40 0x55dc74002850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.844+0000 7f6c34432800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55dc73e5d320 con 0x55dc73f0fa40 2024-09-18T01:45:25.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.844+0000 7f6c2f673640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55dc73f0fa40 0x55dc74002850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.844+0000 7f6c2f673640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55dc73f0fa40 0x55dc74002850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60584/0 (socket says 172.21.15.146:60584) 2024-09-18T01:45:25.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.844+0000 7f6c2f673640 1 -- 172.21.15.146:0/1008270298 learned_addr learned my addr 172.21.15.146:0/1008270298 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:25.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.844+0000 7f6c2f673640 1 -- 172.21.15.146:0/1008270298 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc73daabc0 con 0x55dc73f0fa40 2024-09-18T01:45:25.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.844+0000 7f6c2f673640 1 --2- 172.21.15.146:0/1008270298 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55dc73f0fa40 0x55dc74002850 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6c20045f50 tx=0x7f6c20051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adc6f194892391de server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.844+0000 7f6b1d60a640 1 -- 172.21.15.146:0/1008270298 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c20053c20 con 0x55dc73f0fa40 2024-09-18T01:45:25.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.844+0000 7f6b1d60a640 1 -- 172.21.15.146:0/1008270298 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c20063030 con 0x55dc73f0fa40 2024-09-18T01:45:25.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.844+0000 7f6b1d60a640 1 -- 172.21.15.146:0/1008270298 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c20053440 con 0x55dc73f0fa40 2024-09-18T01:45:25.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.845+0000 7f6c34432800 1 -- 172.21.15.146:0/1008270298 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55dc73f0fa40 msgr2=0x55dc74002850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.845+0000 7f6c34432800 1 --2- 172.21.15.146:0/1008270298 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55dc73f0fa40 0x55dc74002850 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6c20045f50 tx=0x7f6c20051000 comp rx=0 tx=0).stop 2024-09-18T01:45:25.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.845+0000 7f6c34432800 1 -- 172.21.15.146:0/1008270298 shutdown_connections 2024-09-18T01:45:25.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.845+0000 7f6c34432800 1 --2- 172.21.15.146:0/1008270298 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55dc73f0fa40 0x55dc74002850 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.845+0000 7f6c34432800 1 -- 172.21.15.146:0/1008270298 >> 172.21.15.146:0/1008270298 conn(0x55dc73f0b5b0 msgr2=0x55dc73ffe210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:25.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.845+0000 7f6c34432800 1 -- 172.21.15.146:0/1008270298 shutdown_connections 2024-09-18T01:45:25.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.845+0000 7f6c34432800 1 -- 172.21.15.146:0/1008270298 wait complete. 2024-09-18T01:45:25.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.845+0000 7f6c34432800 1 Processor -- start 2024-09-18T01:45:25.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.846+0000 7f6c34432800 1 -- start start 2024-09-18T01:45:25.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.846+0000 7f6c34432800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55dc73f0fa40 0x55dc7400a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.846+0000 7f6c34432800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55dc73f1a900 con 0x55dc73f0fa40 2024-09-18T01:45:25.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.846+0000 7f6c2f673640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55dc73f0fa40 0x55dc7400a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.846+0000 7f6c2f673640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55dc73f0fa40 0x55dc7400a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60598/0 (socket says 172.21.15.146:60598) 2024-09-18T01:45:25.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.846+0000 7f6c2f673640 1 -- 172.21.15.146:0/3916836118 learned_addr learned my addr 172.21.15.146:0/3916836118 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:25.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.846+0000 7f6c2f673640 1 -- 172.21.15.146:0/3916836118 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc73dbefe0 con 0x55dc73f0fa40 2024-09-18T01:45:25.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.847+0000 7f6c2f673640 1 --2- 172.21.15.146:0/3916836118 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55dc73f0fa40 0x55dc7400a1d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6c20045f20 tx=0x7f6c20002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.847+0000 7f6b1be07640 1 -- 172.21.15.146:0/3916836118 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c20053570 con 0x55dc73f0fa40 2024-09-18T01:45:25.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.847+0000 7f6b1be07640 1 -- 172.21.15.146:0/3916836118 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c20053710 con 0x55dc73f0fa40 2024-09-18T01:45:25.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.847+0000 7f6b1be07640 1 -- 172.21.15.146:0/3916836118 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c20068420 con 0x55dc73f0fa40 2024-09-18T01:45:25.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.847+0000 7f6c34432800 1 -- 172.21.15.146:0/3916836118 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dc7400a710 con 0x55dc73f0fa40 2024-09-18T01:45:25.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.847+0000 7f6c34432800 1 -- 172.21.15.146:0/3916836118 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc7400abb0 con 0x55dc73f0fa40 2024-09-18T01:45:25.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.847+0000 7f6b1be07640 1 -- 172.21.15.146:0/3916836118 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6c200685c0 con 0x55dc73f0fa40 2024-09-18T01:45:25.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.848+0000 7f6b1be07640 1 --2- 172.21.15.146:0/3916836118 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6b14036b90 0x7f6b14039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.848+0000 7f6b1be07640 1 -- 172.21.15.146:0/3916836118 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f6c20070070 con 0x55dc73f0fa40 2024-09-18T01:45:25.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.848+0000 7f6c2ee72640 1 --2- 172.21.15.146:0/3916836118 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6b14036b90 0x7f6b14039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.848+0000 7f6c34432800 1 --2- 172.21.15.146:0/3916836118 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55dc73f10380 0x55dc74011240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.848+0000 7f6c34432800 1 -- 172.21.15.146:0/3916836118 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc74011780 con 0x55dc73f10380 2024-09-18T01:45:25.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.848+0000 7f6c2fe74640 1 --2- 172.21.15.146:0/3916836118 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55dc73f10380 0x55dc74011240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.848+0000 7f6c2ee72640 1 --2- 172.21.15.146:0/3916836118 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6b14036b90 0x7f6b14039050 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6c24000c00 tx=0x7f6c240013b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.848+0000 7f6c2fe74640 1 --2- 172.21.15.146:0/3916836118 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55dc73f10380 0x55dc74011240 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.849+0000 7f6c2fe74640 1 -- 172.21.15.146:0/3916836118 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c2800a4a0 con 0x55dc73f10380 2024-09-18T01:45:25.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.849+0000 7f6c34432800 1 -- 172.21.15.146:0/3916836118 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc7400e7b0 con 0x55dc73f10380 2024-09-18T01:45:25.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.849+0000 7f6c2fe74640 1 -- 172.21.15.146:0/3916836118 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6c2800a4a0 con 0x55dc73f10380 2024-09-18T01:45:25.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.849+0000 7f6c34432800 1 -- 172.21.15.146:0/3916836118 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc74013540 con 0x55dc73f10380 2024-09-18T01:45:25.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.849+0000 7f6c2fe74640 1 -- 172.21.15.146:0/3916836118 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6c2800a4a0 con 0x55dc73f10380 2024-09-18T01:45:25.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.849+0000 7f6c34432800 1 -- 172.21.15.146:0/3916836118 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc740125c0 con 0x55dc73f10380 2024-09-18T01:45:25.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.849+0000 7f6c2fe74640 1 -- 172.21.15.146:0/3916836118 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6c2800a4a0 con 0x55dc73f10380 2024-09-18T01:45:25.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.849+0000 7f6c34432800 1 --2- 172.21.15.146:0/3916836118 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55dc74013060 0x55dc74016900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.849+0000 7f6c34432800 1 -- 172.21.15.146:0/3916836118 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc74017040 con 0x55dc74013060 2024-09-18T01:45:25.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.850+0000 7f6c2f673640 1 --2- 172.21.15.146:0/3916836118 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55dc74013060 0x55dc74016900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.850+0000 7f6c2f673640 1 --2- 172.21.15.146:0/3916836118 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55dc74013060 0x55dc74016900 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.850+0000 7f6c2f673640 1 -- 172.21.15.146:0/3916836118 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6c20051070 con 0x55dc74013060 2024-09-18T01:45:25.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.850+0000 7f6c34432800 1 Processor -- start 2024-09-18T01:45:25.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.850+0000 7f6c34432800 1 -- start start 2024-09-18T01:45:25.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.851+0000 7f6c34432800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55dc74024df0 0x55dc74025210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.851+0000 7f6c34432800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55dc73dac580 con 0x55dc74024df0 2024-09-18T01:45:25.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.851+0000 7f6c2fe74640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55dc74024df0 0x55dc74025210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.851+0000 7f6c2fe74640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55dc74024df0 0x55dc74025210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60600/0 (socket says 172.21.15.146:60600) 2024-09-18T01:45:25.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.851+0000 7f6c2fe74640 1 -- 172.21.15.146:0/3992750458 learned_addr learned my addr 172.21.15.146:0/3992750458 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:25.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.851+0000 7f6c2fe74640 1 -- 172.21.15.146:0/3992750458 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc74025750 con 0x55dc74024df0 2024-09-18T01:45:25.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.852+0000 7f6c2fe74640 1 --2- 172.21.15.146:0/3992750458 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55dc74024df0 0x55dc74025210 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x55dc7400b3f0 tx=0x7f6c280178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.852+0000 7f6b19602640 1 -- 172.21.15.146:0/3992750458 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c28013440 con 0x55dc74024df0 2024-09-18T01:45:25.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.852+0000 7f6b19602640 1 -- 172.21.15.146:0/3992750458 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c280135e0 con 0x55dc74024df0 2024-09-18T01:45:25.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.852+0000 7f6b19602640 1 -- 172.21.15.146:0/3992750458 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c280138c0 con 0x55dc74024df0 2024-09-18T01:45:25.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.852+0000 7f6c34432800 1 -- 172.21.15.146:0/3992750458 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dc740259e0 con 0x55dc74024df0 2024-09-18T01:45:25.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.852+0000 7f6c34432800 1 -- 172.21.15.146:0/3992750458 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc740286c0 con 0x55dc74024df0 2024-09-18T01:45:25.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.852+0000 7f6b19602640 1 -- 172.21.15.146:0/3992750458 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6c28011040 con 0x55dc74024df0 2024-09-18T01:45:25.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.853+0000 7f6b19602640 1 --2- 172.21.15.146:0/3992750458 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6b08036b40 0x7f6b08039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.853+0000 7f6b19602640 1 -- 172.21.15.146:0/3992750458 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f6c2801d070 con 0x55dc74024df0 2024-09-18T01:45:25.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.853+0000 7f6c2f673640 1 --2- 172.21.15.146:0/3992750458 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6b08036b40 0x7f6b08039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.853+0000 7f6c34432800 1 Processor -- start 2024-09-18T01:45:25.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.853+0000 7f6c2f673640 1 --2- 172.21.15.146:0/3992750458 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6b08036b40 0x7f6b08039000 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x55dc74012960 tx=0x7f6c2005e840 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.853+0000 7f6c34432800 1 -- start start 2024-09-18T01:45:25.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.853+0000 7f6c34432800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55dc74031ac0 0x55dc74031ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.853+0000 7f6c34432800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55dc74002fa0 con 0x55dc74031ac0 2024-09-18T01:45:25.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.853+0000 7f6c2fe74640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55dc74031ac0 0x55dc74031ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.853+0000 7f6c2fe74640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55dc74031ac0 0x55dc74031ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60606/0 (socket says 172.21.15.146:60606) 2024-09-18T01:45:25.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.853+0000 7f6c2fe74640 1 -- 172.21.15.146:0/3758624333 learned_addr learned my addr 172.21.15.146:0/3758624333 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:25.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.854+0000 7f6c2fe74640 1 -- 172.21.15.146:0/3758624333 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc74032490 con 0x55dc74031ac0 2024-09-18T01:45:25.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.854+0000 7f6c2fe74640 1 --2- 172.21.15.146:0/3758624333 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55dc74031ac0 0x55dc74031ec0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6c2804c920 tx=0x7f6c28012830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=247a7df9b9dfbf56 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.854+0000 7f6b12ffd640 1 -- 172.21.15.146:0/3758624333 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c28012c90 con 0x55dc74031ac0 2024-09-18T01:45:25.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.854+0000 7f6b12ffd640 1 -- 172.21.15.146:0/3758624333 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c28012e30 con 0x55dc74031ac0 2024-09-18T01:45:25.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.854+0000 7f6b12ffd640 1 -- 172.21.15.146:0/3758624333 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c280123a0 con 0x55dc74031ac0 2024-09-18T01:45:25.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.854+0000 7f6c34432800 1 -- 172.21.15.146:0/3758624333 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55dc74031ac0 msgr2=0x55dc74031ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.854+0000 7f6c34432800 1 --2- 172.21.15.146:0/3758624333 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55dc74031ac0 0x55dc74031ec0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6c2804c920 tx=0x7f6c28012830 comp rx=0 tx=0).stop 2024-09-18T01:45:25.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.854+0000 7f6c34432800 1 -- 172.21.15.146:0/3758624333 shutdown_connections 2024-09-18T01:45:25.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.854+0000 7f6c34432800 1 --2- 172.21.15.146:0/3758624333 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55dc74031ac0 0x55dc74031ec0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.854+0000 7f6c34432800 1 -- 172.21.15.146:0/3758624333 >> 172.21.15.146:0/3758624333 conn(0x55dc7402de60 msgr2=0x55dc7402bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:25.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.854+0000 7f6c34432800 1 -- 172.21.15.146:0/3758624333 shutdown_connections 2024-09-18T01:45:25.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.854+0000 7f6c34432800 1 -- 172.21.15.146:0/3758624333 wait complete. 2024-09-18T01:45:25.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.855+0000 7f6c34432800 1 Processor -- start 2024-09-18T01:45:25.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.855+0000 7f6c34432800 1 -- start start 2024-09-18T01:45:25.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.855+0000 7f6c34432800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55dc74031ac0 0x55dc74038ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.855+0000 7f6c34432800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55dc74032ab0 con 0x55dc74031ac0 2024-09-18T01:45:25.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.855+0000 7f6c2fe74640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55dc74031ac0 0x55dc74038ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.855+0000 7f6c2fe74640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55dc74031ac0 0x55dc74038ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60618/0 (socket says 172.21.15.146:60618) 2024-09-18T01:45:25.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.855+0000 7f6c2fe74640 1 -- 172.21.15.146:0/2269614714 learned_addr learned my addr 172.21.15.146:0/2269614714 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:25.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.855+0000 7f6c2fe74640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc74039400 con 0x55dc74031ac0 2024-09-18T01:45:25.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.856+0000 7f6c2fe74640 1 --2- 172.21.15.146:0/2269614714 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55dc74031ac0 0x55dc74038ec0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f6c28012980 tx=0x7f6c2804c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.856+0000 7f6b117fa640 1 -- 172.21.15.146:0/2269614714 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c28046040 con 0x55dc74031ac0 2024-09-18T01:45:25.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.856+0000 7f6b117fa640 1 -- 172.21.15.146:0/2269614714 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c28041050 con 0x55dc74031ac0 2024-09-18T01:45:25.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.856+0000 7f6c34432800 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dc74039690 con 0x55dc74031ac0 2024-09-18T01:45:25.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.856+0000 7f6b117fa640 1 -- 172.21.15.146:0/2269614714 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c2804b550 con 0x55dc74031ac0 2024-09-18T01:45:25.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.856+0000 7f6c34432800 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc7403c340 con 0x55dc74031ac0 2024-09-18T01:45:25.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.857+0000 7f6b117fa640 1 -- 172.21.15.146:0/2269614714 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6c28013a60 con 0x55dc74031ac0 2024-09-18T01:45:25.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.857+0000 7f6b117fa640 1 --2- 172.21.15.146:0/2269614714 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6af8036c90 0x7f6af8039150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.857+0000 7f6b117fa640 1 -- 172.21.15.146:0/2269614714 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f6c28034070 con 0x55dc74031ac0 2024-09-18T01:45:25.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.857+0000 7f6c2f673640 1 --2- 172.21.15.146:0/2269614714 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6af8036c90 0x7f6af8039150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.857+0000 7f6c34432800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.857+0000 7f6c34432800 1 --2- 172.21.15.146:0/2269614714 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55dc74044b40 0x55dc74047000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.857+0000 7f6c34432800 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc74047750 con 0x55dc74044b40 2024-09-18T01:45:25.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.857+0000 7f6c2ee72640 1 --2- 172.21.15.146:0/2269614714 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55dc74044b40 0x55dc74047000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.857+0000 7f6c2f673640 1 --2- 172.21.15.146:0/2269614714 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6af8036c90 0x7f6af8039150 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x55dc74017440 tx=0x7f6c2008b000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.858+0000 7f6c2ee72640 1 --2- 172.21.15.146:0/2269614714 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55dc74044b40 0x55dc74047000 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.858+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c2400f5a0 con 0x55dc74044b40 2024-09-18T01:45:25.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.858+0000 7f6c34432800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:25.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.858+0000 7f6c34432800 20 realm 2024-09-18T01:45:25.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.858+0000 7f6c34432800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.858+0000 7f6c34432800 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc74043f90 con 0x55dc74044b40 2024-09-18T01:45:25.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.858+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c2400f5a0 con 0x55dc74044b40 2024-09-18T01:45:25.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.858+0000 7f6c34432800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:25.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.858+0000 7f6c34432800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:25.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.858+0000 7f6c34432800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.858+0000 7f6c34432800 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc74048230 con 0x55dc74044b40 2024-09-18T01:45:25.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.858+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c2400f5a0 con 0x55dc74044b40 2024-09-18T01:45:25.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.858+0000 7f6c34432800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:25.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.858+0000 7f6c34432800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.858+0000 7f6c34432800 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc74048b00 con 0x55dc74044b40 2024-09-18T01:45:25.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.858+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6c2400f5a0 con 0x55dc74044b40 2024-09-18T01:45:25.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.858+0000 7f6c34432800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:25.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.858+0000 7f6c34432800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.858+0000 7f6c34432800 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc74048ea0 con 0x55dc74044b40 2024-09-18T01:45:25.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.859+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6c2400f5a0 con 0x55dc74044b40 2024-09-18T01:45:25.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.859+0000 7f6c34432800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:25.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.859+0000 7f6c34432800 20 searching for the correct realm 2024-09-18T01:45:25.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.859+0000 7f6c34432800 1 --2- 172.21.15.146:0/2269614714 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55dc7404ad80 0x55dc7404d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.859+0000 7f6c34432800 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dc7404d860 con 0x55dc7404ad80 2024-09-18T01:45:25.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.859+0000 7f6c2fe74640 1 --2- 172.21.15.146:0/2269614714 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55dc7404ad80 0x55dc7404d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.859+0000 7f6c2fe74640 1 --2- 172.21.15.146:0/2269614714 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55dc7404ad80 0x55dc7404d190 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.859+0000 7f6c2fe74640 1 -- 172.21.15.146:0/2269614714 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c2803e020 con 0x55dc7404ad80 2024-09-18T01:45:25.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.859+0000 7f6c2fe74640 1 --2- 172.21.15.146:0/2269614714 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f6c28022640 0x7f6c2802c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.859+0000 7f6c2fe74640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dc7404d860 con 0x7f6c28022640 2024-09-18T01:45:25.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.860+0000 7f6c2f673640 1 --2- 172.21.15.146:0/2269614714 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f6c28022640 0x7f6c2802c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.860+0000 7f6c2f673640 1 --2- 172.21.15.146:0/2269614714 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f6c28022640 0x7f6c2802c480 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.860+0000 7f6c2f673640 1 -- 172.21.15.146:0/2269614714 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c200a6040 con 0x7f6c28022640 2024-09-18T01:45:25.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.860+0000 7f6c2f673640 1 --2- 172.21.15.146:0/2269614714 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f6c2005f040 0x7f6c2005c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:25.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.860+0000 7f6c2f673640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dc7404d860 con 0x7f6c2005f040 2024-09-18T01:45:25.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.860+0000 7f6c2ee72640 1 --2- 172.21.15.146:0/2269614714 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f6c2005f040 0x7f6c2005c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:25.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.861+0000 7f6c2ee72640 1 --2- 172.21.15.146:0/2269614714 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f6c2005f040 0x7f6c2005c410 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:25.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.861+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c2400f5a0 con 0x7f6c2005f040 2024-09-18T01:45:25.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.861+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dc7404d860 con 0x55dc74044b40 2024-09-18T01:45:25.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.861+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6c2400f5a0 con 0x55dc74044b40 2024-09-18T01:45:25.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.861+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dc7404d860 con 0x55dc74044b40 2024-09-18T01:45:25.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.861+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c2400f5a0 con 0x55dc74044b40 2024-09-18T01:45:25.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.861+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dc7404d860 con 0x7f6c2005f040 2024-09-18T01:45:25.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.861+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c2400f5a0 con 0x7f6c2005f040 2024-09-18T01:45:25.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.861+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dc7404d860 con 0x7f6c2005f040 2024-09-18T01:45:25.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.862+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c2400f5a0 con 0x7f6c2005f040 2024-09-18T01:45:25.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.862+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dc7404d860 con 0x7f6c28022640 2024-09-18T01:45:25.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.862+0000 7f6c2f673640 1 -- 172.21.15.146:0/2269614714 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c200a6040 con 0x7f6c28022640 2024-09-18T01:45:25.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.862+0000 7f6c2f673640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dc7404d860 con 0x55dc7404ad80 2024-09-18T01:45:25.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.862+0000 7f6c2fe74640 1 -- 172.21.15.146:0/2269614714 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c2803e020 con 0x55dc7404ad80 2024-09-18T01:45:25.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.862+0000 7f6c2fe74640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dc7404d860 con 0x55dc74044b40 2024-09-18T01:45:25.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.862+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c2400f5a0 con 0x55dc74044b40 2024-09-18T01:45:25.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.862+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dc7404d860 con 0x7f6c2005f040 2024-09-18T01:45:25.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.863+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c2400f5a0 con 0x7f6c2005f040 2024-09-18T01:45:25.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.863+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dc7404d860 con 0x55dc74044b40 2024-09-18T01:45:25.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.863+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c2400f5a0 con 0x55dc74044b40 2024-09-18T01:45:25.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.863+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dc7404d860 con 0x7f6c28022640 2024-09-18T01:45:25.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.863+0000 7f6c2f673640 1 -- 172.21.15.146:0/2269614714 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f6c200a6040 con 0x7f6c28022640 2024-09-18T01:45:25.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.863+0000 7f6c2f673640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dc7404d860 con 0x55dc7404ad80 2024-09-18T01:45:25.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.863+0000 7f6c2fe74640 1 -- 172.21.15.146:0/2269614714 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c2803e020 con 0x55dc7404ad80 2024-09-18T01:45:25.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.863+0000 7f6c2fe74640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dc7404d860 con 0x55dc7404ad80 2024-09-18T01:45:25.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.864+0000 7f6c2fe74640 1 -- 172.21.15.146:0/2269614714 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c2803e020 con 0x55dc7404ad80 2024-09-18T01:45:25.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.864+0000 7f6c2fe74640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dc7404d860 con 0x7f6c2005f040 2024-09-18T01:45:25.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.864+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c2400f5a0 con 0x7f6c2005f040 2024-09-18T01:45:25.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.864+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dc7404d860 con 0x55dc7404ad80 2024-09-18T01:45:25.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.864+0000 7f6c2fe74640 1 -- 172.21.15.146:0/2269614714 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c2803e020 con 0x55dc7404ad80 2024-09-18T01:45:25.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.864+0000 7f6c2fe74640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dc7404d860 con 0x55dc7404ad80 2024-09-18T01:45:25.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.864+0000 7f6c2fe74640 1 -- 172.21.15.146:0/2269614714 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c2803e020 con 0x55dc7404ad80 2024-09-18T01:45:25.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.864+0000 7f6c2fe74640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dc7404d860 con 0x55dc74044b40 2024-09-18T01:45:25.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.864+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c2400f5a0 con 0x55dc74044b40 2024-09-18T01:45:25.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.864+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dc7404d860 con 0x55dc74044b40 2024-09-18T01:45:25.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.865+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6c2400f5a0 con 0x55dc74044b40 2024-09-18T01:45:25.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.865+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dc7404d860 con 0x7f6c2005f040 2024-09-18T01:45:25.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.865+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c2400f5a0 con 0x7f6c2005f040 2024-09-18T01:45:25.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.865+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dc7404d860 con 0x55dc7404ad80 2024-09-18T01:45:25.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.865+0000 7f6c2fe74640 1 -- 172.21.15.146:0/2269614714 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c2803e020 con 0x55dc7404ad80 2024-09-18T01:45:25.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.865+0000 7f6c2fe74640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dc7404d860 con 0x7f6c28022640 2024-09-18T01:45:25.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.865+0000 7f6c2f673640 1 -- 172.21.15.146:0/2269614714 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c200a6040 con 0x7f6c28022640 2024-09-18T01:45:25.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.865+0000 7f6c2f673640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dc7404d860 con 0x55dc74044b40 2024-09-18T01:45:25.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.866+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c2400f5a0 con 0x55dc74044b40 2024-09-18T01:45:25.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.866+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dc7404d860 con 0x7f6c2005f040 2024-09-18T01:45:25.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.866+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c2403b040 con 0x7f6c2005f040 2024-09-18T01:45:25.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.866+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dc7404d860 con 0x55dc7404ad80 2024-09-18T01:45:25.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.866+0000 7f6c2fe74640 1 -- 172.21.15.146:0/2269614714 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c2803e020 con 0x55dc7404ad80 2024-09-18T01:45:25.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.866+0000 7f6c2fe74640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dc7404d860 con 0x7f6c2005f040 2024-09-18T01:45:25.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.867+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c2403b040 con 0x7f6c2005f040 2024-09-18T01:45:25.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.867+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dc7404d860 con 0x7f6c28022640 2024-09-18T01:45:25.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.867+0000 7f6c2f673640 1 -- 172.21.15.146:0/2269614714 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c200a6040 con 0x7f6c28022640 2024-09-18T01:45:25.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.867+0000 7f6c2f673640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dc7404d860 con 0x55dc7404ad80 2024-09-18T01:45:25.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.867+0000 7f6c2fe74640 1 -- 172.21.15.146:0/2269614714 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c2803e020 con 0x55dc7404ad80 2024-09-18T01:45:25.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.867+0000 7f6c2fe74640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dc7404d860 con 0x7f6c2005f040 2024-09-18T01:45:25.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.867+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c2403b040 con 0x7f6c2005f040 2024-09-18T01:45:25.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.867+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dc7404d860 con 0x55dc74044b40 2024-09-18T01:45:25.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.868+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6c2403b040 con 0x55dc74044b40 2024-09-18T01:45:25.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.868+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dc7404d860 con 0x7f6c28022640 2024-09-18T01:45:25.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.868+0000 7f6c2f673640 1 -- 172.21.15.146:0/2269614714 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c200a6040 con 0x7f6c28022640 2024-09-18T01:45:25.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.868+0000 7f6c34432800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:25.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.868+0000 7f6c34432800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:25.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.868+0000 7f6c34432800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:25.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.868+0000 7f6c34432800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:25.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.868+0000 7f6c34432800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:25.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.868+0000 7f6c34432800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:25.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.868+0000 7f6c34432800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.868+0000 7f6c34432800 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc74049850 con 0x55dc74044b40 2024-09-18T01:45:25.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.868+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c2403b040 con 0x55dc74044b40 2024-09-18T01:45:25.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.868+0000 7f6c34432800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:25.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.868+0000 7f6c34432800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.868+0000 7f6c34432800 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc7404a0f0 con 0x55dc74044b40 2024-09-18T01:45:25.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.868+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6c2403b040 con 0x55dc74044b40 2024-09-18T01:45:25.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.868+0000 7f6c34432800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:25.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.868+0000 7f6c34432800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.868+0000 7f6c34432800 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc74049490 con 0x7f6c28022640 2024-09-18T01:45:25.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.869+0000 7f6c2f673640 1 -- 172.21.15.146:0/2269614714 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6c200a6040 con 0x7f6c28022640 2024-09-18T01:45:25.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.869+0000 7f6c34432800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:25.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.869+0000 7f6c34432800 20 zone default found 2024-09-18T01:45:25.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.869+0000 7f6c34432800 4 Realm: () 2024-09-18T01:45:25.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.869+0000 7f6c34432800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:25.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.869+0000 7f6c34432800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:25.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.869+0000 7f6c34432800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:25.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.869+0000 7f6c34432800 20 zonegroup default 2024-09-18T01:45:25.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.869+0000 7f6c34432800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.869+0000 7f6c34432800 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc7404dce0 con 0x7f6c2005f040 2024-09-18T01:45:25.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.869+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6c2403b040 con 0x7f6c2005f040 2024-09-18T01:45:25.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.869+0000 7f6c34432800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:25.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.869+0000 7f6c34432800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.869+0000 7f6c34432800 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc7404fb70 con 0x55dc7404ad80 2024-09-18T01:45:25.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.869+0000 7f6c2fe74640 1 -- 172.21.15.146:0/2269614714 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6c2803e020 con 0x55dc7404ad80 2024-09-18T01:45:25.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.869+0000 7f6c34432800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:25.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.869+0000 7f6c34432800 20 rados->read ofs=0 len=0 2024-09-18T01:45:25.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.869+0000 7f6c34432800 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc7404ff10 con 0x55dc7404ad80 2024-09-18T01:45:25.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.870+0000 7f6c2fe74640 1 -- 172.21.15.146:0/2269614714 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6c2803e020 con 0x55dc7404ad80 2024-09-18T01:45:25.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.870+0000 7f6c34432800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:25.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.870+0000 7f6c34432800 20 started sync module instance, tier type = 2024-09-18T01:45:25.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.870+0000 7f6c34432800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:25.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.870+0000 7f6c34432800 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc7404efb0 con 0x7f6c28022640 2024-09-18T01:45:25.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.871+0000 7f6c2f673640 1 -- 172.21.15.146:0/2269614714 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v31'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c200a6040 con 0x7f6c28022640 2024-09-18T01:45:25.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.871+0000 7f6c34432800 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94405327645440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc740502b0 con 0x7f6c28022640 2024-09-18T01:45:25.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.871+0000 7f6c34432800 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc74050c70 con 0x55dc74044b40 2024-09-18T01:45:25.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.872+0000 7f6c2f673640 1 -- 172.21.15.146:0/2269614714 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94405327645440] v31'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c200a6040 con 0x7f6c28022640 2024-09-18T01:45:25.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.872+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v31'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c2403b040 con 0x55dc74044b40 2024-09-18T01:45:25.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.872+0000 7f6c34432800 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94405327652800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc74051090 con 0x55dc74044b40 2024-09-18T01:45:25.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.872+0000 7f6c34432800 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc74051a50 con 0x55dc7404ad80 2024-09-18T01:45:25.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.873+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94405327652800] v31'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c2403b040 con 0x55dc74044b40 2024-09-18T01:45:25.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.873+0000 7f6c2fe74640 1 -- 172.21.15.146:0/2269614714 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v31'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c2803e020 con 0x55dc7404ad80 2024-09-18T01:45:25.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.873+0000 7f6c34432800 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94405327656832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc74051090 con 0x55dc7404ad80 2024-09-18T01:45:25.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.873+0000 7f6c34432800 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc740524f0 con 0x7f6c28022640 2024-09-18T01:45:25.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.874+0000 7f6c2f673640 1 -- 172.21.15.146:0/2269614714 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v31'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c200a6040 con 0x7f6c28022640 2024-09-18T01:45:25.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.874+0000 7f6c34432800 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94405327658976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc740524f0 con 0x7f6c28022640 2024-09-18T01:45:25.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.874+0000 7f6c34432800 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc740534f0 con 0x55dc74044b40 2024-09-18T01:45:25.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.874+0000 7f6c2fe74640 1 -- 172.21.15.146:0/2269614714 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94405327656832] v31'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c2803e020 con 0x55dc7404ad80 2024-09-18T01:45:25.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.877+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v31'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c2403b040 con 0x55dc74044b40 2024-09-18T01:45:25.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.877+0000 7f6c34432800 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94405327663072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc740534b0 con 0x55dc74044b40 2024-09-18T01:45:25.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.877+0000 7f6c34432800 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc74053f70 con 0x7f6c2005f040 2024-09-18T01:45:25.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.877+0000 7f6c2f673640 1 -- 172.21.15.146:0/2269614714 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94405327658976] v31'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c200a6040 con 0x7f6c28022640 2024-09-18T01:45:25.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.878+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94405327663072] v31'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c2403b040 con 0x55dc74044b40 2024-09-18T01:45:25.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.878+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v31'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c2403b040 con 0x7f6c2005f040 2024-09-18T01:45:25.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.878+0000 7f6c34432800 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94405327653856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc74053f70 con 0x7f6c2005f040 2024-09-18T01:45:25.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.878+0000 7f6c34432800 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc740543c0 con 0x7f6c2005f040 2024-09-18T01:45:25.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.879+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94405327653856] v31'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c2403b040 con 0x7f6c2005f040 2024-09-18T01:45:25.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.879+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v31'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c2403b040 con 0x7f6c2005f040 2024-09-18T01:45:25.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.879+0000 7f6c34432800 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94405327661328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc74054380 con 0x7f6c2005f040 2024-09-18T01:45:25.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.879+0000 7f6c34432800 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc74054da0 con 0x7f6c2005f040 2024-09-18T01:45:25.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.880+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(58 notify.7 [create] v31'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c2403b040 con 0x7f6c2005f040 2024-09-18T01:45:25.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.880+0000 7f6c34432800 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94405327669392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc74055210 con 0x7f6c2005f040 2024-09-18T01:45:25.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.880+0000 7f6c34432800 20 add_watcher() i=0 2024-09-18T01:45:25.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.880+0000 7f6c34432800 20 add_watcher() i=1 2024-09-18T01:45:25.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.880+0000 7f6c34432800 20 add_watcher() i=2 2024-09-18T01:45:25.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.880+0000 7f6c34432800 20 add_watcher() i=3 2024-09-18T01:45:25.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.880+0000 7f6c34432800 20 add_watcher() i=4 2024-09-18T01:45:25.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.880+0000 7f6c34432800 20 add_watcher() i=5 2024-09-18T01:45:25.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.880+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94405327661328] v31'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c2403b040 con 0x7f6c2005f040 2024-09-18T01:45:25.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.881+0000 7f6c34432800 20 add_watcher() i=6 2024-09-18T01:45:25.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.881+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94405327669392] v31'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c2403b040 con 0x7f6c2005f040 2024-09-18T01:45:25.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.881+0000 7f6c34432800 20 add_watcher() i=7 2024-09-18T01:45:25.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.881+0000 7f6c34432800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:25.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.881+0000 7f6c34432800 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc74055210 con 0x55dc74044b40 2024-09-18T01:45:25.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.881+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6c2403b040 con 0x55dc74044b40 2024-09-18T01:45:25.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.881+0000 7f6c34432800 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94405327670624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc74055180 con 0x55dc74044b40 2024-09-18T01:45:25.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.882+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94405327670624] v31'100 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6c2403b040 con 0x55dc74044b40 2024-09-18T01:45:25.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.882+0000 7f6ae5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:25.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.882+0000 7f6c34432800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:25.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.882+0000 7f6c34432800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:25.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.882+0000 7f6c34432800 5 note: GC not initialized 2024-09-18T01:45:25.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.882+0000 7f6ae4fe1640 20 reqs_thread_entry: start 2024-09-18T01:45:25.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.883+0000 7f6c34432800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:25.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.883+0000 7f6c34432800 20 Filter name: none 2024-09-18T01:45:25.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.883+0000 7f6a5e7fc640 20 reqs_thread_entry: start 2024-09-18T01:45:25.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.883+0000 7f6c34432800 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dc7408ada0 con 0x55dc7404ad80 2024-09-18T01:45:25.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.883+0000 7f6c2fe74640 1 -- 172.21.15.146:0/2269614714 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(62 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c2803e020 con 0x55dc7404ad80 2024-09-18T01:45:25.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.883+0000 7f6c2fe74640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dc7404ff10 con 0x55dc7404ad80 2024-09-18T01:45:25.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.883+0000 7f6c2fe74640 1 -- 172.21.15.146:0/2269614714 <== osd.3 v2:172.21.15.146:6809/4106661138 15 ==== osd_op_reply(63 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c2803e020 con 0x55dc7404ad80 2024-09-18T01:45:25.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.883+0000 7f6c2fe74640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dc7404ff10 con 0x55dc74044b40 2024-09-18T01:45:25.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.883+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(64 [pgnls start_epoch 31 out=49b] v31'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c2403b040 con 0x55dc74044b40 2024-09-18T01:45:25.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.883+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dc74049850 con 0x55dc74044b40 2024-09-18T01:45:25.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.884+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(65 [pgnls start_epoch 31 out=49b] v31'11 uv11 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c2403b040 con 0x55dc74044b40 2024-09-18T01:45:25.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.884+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dc74049850 con 0x7f6c28022640 2024-09-18T01:45:25.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.884+0000 7f6c2f673640 1 -- 172.21.15.146:0/2269614714 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(66 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c200a6040 con 0x7f6c28022640 2024-09-18T01:45:25.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.884+0000 7f6c2f673640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dc740502b0 con 0x55dc7404ad80 2024-09-18T01:45:25.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.884+0000 7f6c2fe74640 1 -- 172.21.15.146:0/2269614714 <== osd.3 v2:172.21.15.146:6809/4106661138 16 ==== osd_op_reply(67 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c2803e020 con 0x55dc7404ad80 2024-09-18T01:45:25.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.884+0000 7f6c2fe74640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6c2806b040 con 0x55dc74044b40 2024-09-18T01:45:25.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.884+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(68 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c2403b040 con 0x55dc74044b40 2024-09-18T01:45:25.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.884+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6c2806b040 con 0x55dc7404ad80 2024-09-18T01:45:25.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.885+0000 7f6c2fe74640 1 -- 172.21.15.146:0/2269614714 <== osd.3 v2:172.21.15.146:6809/4106661138 17 ==== osd_op_reply(69 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c2803e020 con 0x55dc7404ad80 2024-09-18T01:45:25.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.885+0000 7f6c2fe74640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6c2806b040 con 0x7f6c28022640 2024-09-18T01:45:25.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.885+0000 7f6c2f673640 1 -- 172.21.15.146:0/2269614714 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(70 [pgnls start_epoch 31 out=49b] v31'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c200a6040 con 0x7f6c28022640 2024-09-18T01:45:25.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.885+0000 7f6c2f673640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6c2806b040 con 0x55dc7404ad80 2024-09-18T01:45:25.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.885+0000 7f6c2fe74640 1 -- 172.21.15.146:0/2269614714 <== osd.3 v2:172.21.15.146:6809/4106661138 18 ==== osd_op_reply(71 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c2803e020 con 0x55dc7404ad80 2024-09-18T01:45:25.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.885+0000 7f6c2fe74640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6c2806b040 con 0x55dc74044b40 2024-09-18T01:45:25.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.885+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(72 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c2403b040 con 0x55dc74044b40 2024-09-18T01:45:25.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.885+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6c2806b040 con 0x7f6c2005f040 2024-09-18T01:45:25.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.886+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(73 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c2403b040 con 0x7f6c2005f040 2024-09-18T01:45:25.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.886+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6c2806b040 con 0x7f6c2005f040 2024-09-18T01:45:25.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.886+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(74 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c2403b040 con 0x7f6c2005f040 2024-09-18T01:45:25.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.886+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6c2806b040 con 0x55dc7404ad80 2024-09-18T01:45:25.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.886+0000 7f6c2fe74640 1 -- 172.21.15.146:0/2269614714 <== osd.3 v2:172.21.15.146:6809/4106661138 19 ==== osd_op_reply(75 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c2803e020 con 0x55dc7404ad80 2024-09-18T01:45:25.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.886+0000 7f6c2fe74640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6c2806b040 con 0x7f6c2005f040 2024-09-18T01:45:25.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.887+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(76 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c2403b040 con 0x7f6c2005f040 2024-09-18T01:45:25.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.887+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6c2806b040 con 0x7f6c2005f040 2024-09-18T01:45:25.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.887+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(77 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c2403b040 con 0x7f6c2005f040 2024-09-18T01:45:25.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.887+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6c2806b040 con 0x7f6c2005f040 2024-09-18T01:45:25.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.887+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== osd_op_reply(78 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c2403b040 con 0x7f6c2005f040 2024-09-18T01:45:25.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.887+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6c2806b040 con 0x55dc7404ad80 2024-09-18T01:45:25.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.887+0000 7f6c2fe74640 1 -- 172.21.15.146:0/2269614714 <== osd.3 v2:172.21.15.146:6809/4106661138 20 ==== osd_op_reply(79 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c2803e020 con 0x55dc7404ad80 2024-09-18T01:45:25.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.887+0000 7f6c2fe74640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6c2806b040 con 0x7f6c28022640 2024-09-18T01:45:25.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.887+0000 7f6c2f673640 1 -- 172.21.15.146:0/2269614714 <== osd.2 v2:172.21.15.146:6800/3820039304 14 ==== osd_op_reply(80 [pgnls start_epoch 31 out=70b] v31'2 uv2 ondisk = 1) ==== 144+0+70 (crc 0 0 0) 0x7f6c200a6040 con 0x7f6c28022640 2024-09-18T01:45:25.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.888+0000 7f6c2f673640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6c2806b040 con 0x55dc74044b40 2024-09-18T01:45:25.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.888+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(81 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c2403b040 con 0x55dc74044b40 2024-09-18T01:45:25.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.888+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6c2806b040 con 0x55dc74044b40 2024-09-18T01:45:25.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.888+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== osd_op_reply(82 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c2403b040 con 0x55dc74044b40 2024-09-18T01:45:25.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.888+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6c2806b040 con 0x55dc7404ad80 2024-09-18T01:45:25.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.888+0000 7f6c2fe74640 1 -- 172.21.15.146:0/2269614714 <== osd.3 v2:172.21.15.146:6809/4106661138 21 ==== osd_op_reply(83 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c2803e020 con 0x55dc7404ad80 2024-09-18T01:45:25.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.888+0000 7f6c2fe74640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6c2806b040 con 0x7f6c28022640 2024-09-18T01:45:25.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.888+0000 7f6c2f673640 1 -- 172.21.15.146:0/2269614714 <== osd.2 v2:172.21.15.146:6800/3820039304 15 ==== osd_op_reply(84 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c200a6040 con 0x7f6c28022640 2024-09-18T01:45:25.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.888+0000 7f6c2f673640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6c2806b040 con 0x7f6c2005f040 2024-09-18T01:45:25.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.889+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.0 v2:172.21.15.129:6800/1759265424 22 ==== osd_op_reply(85 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c2403b040 con 0x7f6c2005f040 2024-09-18T01:45:25.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.889+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6c2806b040 con 0x55dc74044b40 2024-09-18T01:45:25.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.889+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.1 v2:172.21.15.146:6808/3930274777 28 ==== osd_op_reply(86 [pgnls start_epoch 31 out=49b] v31'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c2403b040 con 0x55dc74044b40 2024-09-18T01:45:25.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.889+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6c2806b040 con 0x7f6c2005f040 2024-09-18T01:45:25.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.889+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.0 v2:172.21.15.129:6800/1759265424 23 ==== osd_op_reply(87 [pgnls start_epoch 31 out=127b] v31'3 uv3 ondisk = 1) ==== 144+0+127 (crc 0 0 0) 0x7f6c2403b040 con 0x7f6c2005f040 2024-09-18T01:45:25.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.889+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6c2806b040 con 0x55dc7404ad80 2024-09-18T01:45:25.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.890+0000 7f6c2fe74640 1 -- 172.21.15.146:0/2269614714 <== osd.3 v2:172.21.15.146:6809/4106661138 22 ==== osd_op_reply(88 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c2803e020 con 0x55dc7404ad80 2024-09-18T01:45:25.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.890+0000 7f6c2fe74640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6c2806b040 con 0x7f6c28022640 2024-09-18T01:45:25.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.890+0000 7f6c2f673640 1 -- 172.21.15.146:0/2269614714 <== osd.2 v2:172.21.15.146:6800/3820039304 16 ==== osd_op_reply(89 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c200a6040 con 0x7f6c28022640 2024-09-18T01:45:25.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.890+0000 7f6c2f673640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6c2806b040 con 0x7f6c2005f040 2024-09-18T01:45:25.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.890+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.0 v2:172.21.15.129:6800/1759265424 24 ==== osd_op_reply(90 [pgnls start_epoch 31 out=49b] v31'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c2403b040 con 0x7f6c2005f040 2024-09-18T01:45:25.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.890+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6c2806b040 con 0x55dc74044b40 2024-09-18T01:45:25.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.890+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.1 v2:172.21.15.146:6808/3930274777 29 ==== osd_op_reply(91 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c2403b040 con 0x55dc74044b40 2024-09-18T01:45:25.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.890+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6c2806b040 con 0x55dc7404ad80 2024-09-18T01:45:25.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.890+0000 7f6c2fe74640 1 -- 172.21.15.146:0/2269614714 <== osd.3 v2:172.21.15.146:6809/4106661138 23 ==== osd_op_reply(92 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c2803e020 con 0x55dc7404ad80 2024-09-18T01:45:25.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.891+0000 7f6c2fe74640 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6c2806b040 con 0x7f6c28022640 2024-09-18T01:45:25.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.891+0000 7f6c2f673640 1 -- 172.21.15.146:0/2269614714 <== osd.2 v2:172.21.15.146:6800/3820039304 17 ==== osd_op_reply(93 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c200a6040 con 0x7f6c28022640 2024-09-18T01:45:25.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.891+0000 7f6c34432800 20 RGWRados::pool_iterate: got myfoo 2024-09-18T01:45:25.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.891+0000 7f6c34432800 20 RGWRados::pool_iterate: got .bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 2024-09-18T01:45:25.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.892+0000 7f6ae5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:25.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.892+0000 7f6c34432800 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94405327670624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc74049830 con 0x55dc74044b40 2024-09-18T01:45:25.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.893+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.1 v2:172.21.15.146:6808/3930274777 30 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94405327670624] v31'101 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6c2403b040 con 0x55dc74044b40 2024-09-18T01:45:25.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.893+0000 7f6c34432800 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94405327645440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc74089020 con 0x7f6c28022640 2024-09-18T01:45:25.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.893+0000 7f6c2f673640 1 -- 172.21.15.146:0/2269614714 <== osd.2 v2:172.21.15.146:6800/3820039304 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94405327645440] v31'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c200a6040 con 0x7f6c28022640 2024-09-18T01:45:25.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.893+0000 7f6c34432800 20 remove_watcher() i=0 2024-09-18T01:45:25.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.893+0000 7f6c34432800 2 removed watcher, disabling cache 2024-09-18T01:45:25.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.894+0000 7f6c34432800 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94405327652800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc74089020 con 0x55dc74044b40 2024-09-18T01:45:25.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.895+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.1 v2:172.21.15.146:6808/3930274777 31 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94405327652800] v31'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c2403b040 con 0x55dc74044b40 2024-09-18T01:45:25.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.895+0000 7f6c34432800 20 remove_watcher() i=1 2024-09-18T01:45:25.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.895+0000 7f6c34432800 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94405327656832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc74089020 con 0x55dc7404ad80 2024-09-18T01:45:25.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.896+0000 7f6c2fe74640 1 -- 172.21.15.146:0/2269614714 <== osd.3 v2:172.21.15.146:6809/4106661138 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94405327656832] v31'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c2803e020 con 0x55dc7404ad80 2024-09-18T01:45:25.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.896+0000 7f6c34432800 20 remove_watcher() i=2 2024-09-18T01:45:25.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.896+0000 7f6c34432800 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94405327658976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc7404eb00 con 0x7f6c28022640 2024-09-18T01:45:25.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.897+0000 7f6c2f673640 1 -- 172.21.15.146:0/2269614714 <== osd.2 v2:172.21.15.146:6800/3820039304 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94405327658976] v31'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c200a6040 con 0x7f6c28022640 2024-09-18T01:45:25.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.897+0000 7f6c34432800 20 remove_watcher() i=3 2024-09-18T01:45:25.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.897+0000 7f6c34432800 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94405327663072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc740507c0 con 0x55dc74044b40 2024-09-18T01:45:25.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.898+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.1 v2:172.21.15.146:6808/3930274777 32 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94405327663072] v31'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c2403b040 con 0x55dc74044b40 2024-09-18T01:45:25.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.898+0000 7f6c34432800 20 remove_watcher() i=4 2024-09-18T01:45:25.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.898+0000 7f6c34432800 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94405327653856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc74051780 con 0x7f6c2005f040 2024-09-18T01:45:25.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.899+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.0 v2:172.21.15.129:6800/1759265424 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94405327653856] v31'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c2403b040 con 0x7f6c2005f040 2024-09-18T01:45:25.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.899+0000 7f6c34432800 20 remove_watcher() i=5 2024-09-18T01:45:25.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.899+0000 7f6c34432800 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94405327661328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc7404eb00 con 0x7f6c2005f040 2024-09-18T01:45:25.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.900+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.0 v2:172.21.15.129:6800/1759265424 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94405327661328] v31'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c2403b040 con 0x7f6c2005f040 2024-09-18T01:45:25.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.900+0000 7f6c34432800 20 remove_watcher() i=6 2024-09-18T01:45:25.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.900+0000 7f6c34432800 1 -- 172.21.15.146:0/2269614714 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94405327669392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc7404eb00 con 0x7f6c2005f040 2024-09-18T01:45:25.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.901+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 <== osd.0 v2:172.21.15.129:6800/1759265424 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94405327669392] v31'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c2403b040 con 0x7f6c2005f040 2024-09-18T01:45:25.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.901+0000 7f6c34432800 20 remove_watcher() i=7 2024-09-18T01:45:25.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.901+0000 7f6c34432800 1 -- 172.21.15.146:0/2269614714 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f6c2005f040 msgr2=0x7f6c2005c410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.901+0000 7f6c34432800 1 --2- 172.21.15.146:0/2269614714 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f6c2005f040 0x7f6c2005c410 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.901+0000 7f6c34432800 1 -- 172.21.15.146:0/2269614714 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55dc74044b40 msgr2=0x55dc74047000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.901+0000 7f6c34432800 1 --2- 172.21.15.146:0/2269614714 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55dc74044b40 0x55dc74047000 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.901+0000 7f6c34432800 1 -- 172.21.15.146:0/2269614714 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f6c28022640 msgr2=0x7f6c2802c480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.901+0000 7f6c34432800 1 --2- 172.21.15.146:0/2269614714 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f6c28022640 0x7f6c2802c480 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.901+0000 7f6c34432800 1 -- 172.21.15.146:0/2269614714 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55dc7404ad80 msgr2=0x55dc7404d190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.901+0000 7f6c34432800 1 --2- 172.21.15.146:0/2269614714 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55dc7404ad80 0x55dc7404d190 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.901+0000 7f6c34432800 1 -- 172.21.15.146:0/2269614714 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6af8036c90 msgr2=0x7f6af8039150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.901+0000 7f6c34432800 1 --2- 172.21.15.146:0/2269614714 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6af8036c90 0x7f6af8039150 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x55dc74017440 tx=0x7f6c2008b000 comp rx=0 tx=0).stop 2024-09-18T01:45:25.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.901+0000 7f6c34432800 1 -- 172.21.15.146:0/2269614714 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55dc74031ac0 msgr2=0x55dc74038ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.901+0000 7f6c2ee72640 1 -- 172.21.15.146:0/2269614714 reap_dead start 2024-09-18T01:45:25.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.901+0000 7f6c34432800 1 --2- 172.21.15.146:0/2269614714 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55dc74031ac0 0x55dc74038ec0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f6c28012980 tx=0x7f6c2804c880 comp rx=0 tx=0).stop 2024-09-18T01:45:25.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.901+0000 7f6c34432800 1 -- 172.21.15.146:0/2269614714 shutdown_connections 2024-09-18T01:45:25.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.901+0000 7f6c34432800 1 --2- 172.21.15.146:0/2269614714 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55dc74031ac0 0x55dc74038ec0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.901+0000 7f6c34432800 1 -- 172.21.15.146:0/2269614714 >> 172.21.15.146:0/2269614714 conn(0x55dc7402de60 msgr2=0x55dc7402bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:25.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.901+0000 7f6c34432800 1 -- 172.21.15.146:0/2269614714 shutdown_connections 2024-09-18T01:45:25.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.901+0000 7f6c34432800 1 -- 172.21.15.146:0/2269614714 wait complete. 2024-09-18T01:45:25.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.902+0000 7f6c34432800 1 -- 172.21.15.146:0/3992750458 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6b08036b40 msgr2=0x7f6b08039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.902+0000 7f6c34432800 1 --2- 172.21.15.146:0/3992750458 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6b08036b40 0x7f6b08039000 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x55dc74012960 tx=0x7f6c2005e840 comp rx=0 tx=0).stop 2024-09-18T01:45:25.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.902+0000 7f6c34432800 1 -- 172.21.15.146:0/3992750458 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55dc74024df0 msgr2=0x55dc74025210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.902+0000 7f6c34432800 1 --2- 172.21.15.146:0/3992750458 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55dc74024df0 0x55dc74025210 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x55dc7400b3f0 tx=0x7f6c280178e0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.902+0000 7f6c34432800 1 -- 172.21.15.146:0/3992750458 shutdown_connections 2024-09-18T01:45:25.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.902+0000 7f6c34432800 1 --2- 172.21.15.146:0/3992750458 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6b08036b40 0x7f6b08039000 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.902+0000 7f6c34432800 1 --2- 172.21.15.146:0/3992750458 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55dc74024df0 0x55dc74025210 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.902+0000 7f6c34432800 1 -- 172.21.15.146:0/3992750458 >> 172.21.15.146:0/3992750458 conn(0x55dc74019d80 msgr2=0x55dc7401c900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:25.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.902+0000 7f6c34432800 1 -- 172.21.15.146:0/3992750458 shutdown_connections 2024-09-18T01:45:25.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.902+0000 7f6c34432800 1 -- 172.21.15.146:0/3992750458 wait complete. 2024-09-18T01:45:25.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.902+0000 7f6c34432800 1 -- 172.21.15.146:0/3916836118 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55dc73f10380 msgr2=0x55dc74011240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.902+0000 7f6c34432800 1 --2- 172.21.15.146:0/3916836118 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55dc73f10380 0x55dc74011240 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.902+0000 7f6c34432800 1 -- 172.21.15.146:0/3916836118 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55dc74013060 msgr2=0x55dc74016900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.902+0000 7f6c34432800 1 --2- 172.21.15.146:0/3916836118 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55dc74013060 0x55dc74016900 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.902+0000 7f6c34432800 1 -- 172.21.15.146:0/3916836118 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6b14036b90 msgr2=0x7f6b14039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.902+0000 7f6c34432800 1 --2- 172.21.15.146:0/3916836118 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6b14036b90 0x7f6b14039050 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6c24000c00 tx=0x7f6c240013b0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.902+0000 7f6c34432800 1 -- 172.21.15.146:0/3916836118 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55dc73f0fa40 msgr2=0x55dc7400a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:25.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.902+0000 7f6c34432800 1 --2- 172.21.15.146:0/3916836118 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55dc73f0fa40 0x55dc7400a1d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6c20045f20 tx=0x7f6c20002fb0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.902+0000 7f6c34432800 1 -- 172.21.15.146:0/3916836118 shutdown_connections 2024-09-18T01:45:25.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.902+0000 7f6c34432800 1 --2- 172.21.15.146:0/3916836118 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55dc74013060 0x55dc74016900 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.902+0000 7f6c34432800 1 --2- 172.21.15.146:0/3916836118 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55dc73f10380 0x55dc74011240 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.902+0000 7f6c34432800 1 --2- 172.21.15.146:0/3916836118 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6b14036b90 0x7f6b14039050 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.902+0000 7f6c34432800 1 --2- 172.21.15.146:0/3916836118 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55dc73f0fa40 0x55dc7400a1d0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:25.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.902+0000 7f6c34432800 1 -- 172.21.15.146:0/3916836118 >> 172.21.15.146:0/3916836118 conn(0x55dc73f0b5b0 msgr2=0x55dc73ffcae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:25.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.902+0000 7f6c34432800 1 -- 172.21.15.146:0/3916836118 shutdown_connections 2024-09-18T01:45:25.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:25.902+0000 7f6c34432800 1 -- 172.21.15.146:0/3916836118 wait complete. 2024-09-18T01:45:25.917 INFO:teuthology.orchestra.run.smithi146.stdout:["myfoo"] 2024-09-18T01:45:25.917 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-18T01:45:25.927 INFO:tasks.radosgw_admin:RL: create_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T01:45:25.938 INFO:tasks.radosgw_admin:RL: create_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T01:45:25.947 INFO:tasks.radosgw_admin:RL: create_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T01:45:25.993 INFO:tasks.radosgw_admin:RL: create_bucket myfoo5 foo bytes_out=0 bytes_in=237 failed=True 2024-09-18T01:45:26.019 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T01:45:26.047 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T01:45:26.073 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T01:45:26.073 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-18T01:45:26.073 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-18T01:45:26.073 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-18T01:45:26.117 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:26.118 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:26.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.118+0000 7f0829951800 1 Processor -- start 2024-09-18T01:45:26.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.118+0000 7f0829951800 1 -- start start 2024-09-18T01:45:26.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.118+0000 7f0829951800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x559d006544c0 0x559d006548c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.118+0000 7f0829951800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559d00514b30 con 0x559d00654e00 2024-09-18T01:45:26.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.118+0000 7f0829951800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x559d004f6360 con 0x559d006544c0 2024-09-18T01:45:26.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.118+0000 7f0827445640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x559d006544c0 0x559d006548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.118+0000 7f0826c44640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x559d00654e00 0x559d00659980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:38934/0 (socket says 172.21.15.146:38934) 2024-09-18T01:45:26.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.118+0000 7f0827445640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x559d006544c0 0x559d006548c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60624/0 (socket says 172.21.15.146:60624) 2024-09-18T01:45:26.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.118+0000 7f0826c44640 1 -- 172.21.15.146:0/3672646090 learned_addr learned my addr 172.21.15.146:0/3672646090 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:45:26.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.119+0000 7f0827445640 1 -- 172.21.15.146:0/3672646090 >> v1:172.21.15.129:6789/0 conn(0x559d00654e00 legacy=0x559d00659980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.119+0000 7f0827445640 1 -- 172.21.15.146:0/3672646090 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d0051ce00 con 0x559d006544c0 2024-09-18T01:45:26.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.120+0000 7f0827445640 1 --2- 172.21.15.146:0/3672646090 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d006544c0 0x559d006548c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f081800a470 tx=0x7f0818045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=711bf528008a11d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.121+0000 7f0826443640 1 -- 172.21.15.146:0/3672646090 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0818053570 con 0x559d006544c0 2024-09-18T01:45:26.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.121+0000 7f0826443640 1 -- 172.21.15.146:0/3672646090 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0818058070 con 0x559d006544c0 2024-09-18T01:45:26.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.121+0000 7f0826443640 1 -- 172.21.15.146:0/3672646090 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0818053880 con 0x559d006544c0 2024-09-18T01:45:26.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.121+0000 7f0829951800 1 -- 172.21.15.146:0/3672646090 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d006544c0 msgr2=0x559d006548c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.121+0000 7f0829951800 1 --2- 172.21.15.146:0/3672646090 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d006544c0 0x559d006548c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f081800a470 tx=0x7f0818045a20 comp rx=0 tx=0).stop 2024-09-18T01:45:26.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.121+0000 7f0829951800 1 -- 172.21.15.146:0/3672646090 shutdown_connections 2024-09-18T01:45:26.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.121+0000 7f0829951800 1 --2- 172.21.15.146:0/3672646090 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d006544c0 0x559d006548c0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.121+0000 7f0829951800 1 -- 172.21.15.146:0/3672646090 >> 172.21.15.146:0/3672646090 conn(0x559d0064fdf0 msgr2=0x559d00652210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:26.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.121+0000 7f0829951800 1 -- 172.21.15.146:0/3672646090 shutdown_connections 2024-09-18T01:45:26.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.121+0000 7f0829951800 1 -- 172.21.15.146:0/3672646090 wait complete. 2024-09-18T01:45:26.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.135+0000 7f0829951800 1 Processor -- start 2024-09-18T01:45:26.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.135+0000 7f0829951800 1 -- start start 2024-09-18T01:45:26.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.135+0000 7f0829951800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d006544c0 0x559d005c8d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.135+0000 7f0829951800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x559d005a1330 con 0x559d006544c0 2024-09-18T01:45:26.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.135+0000 7f0827445640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d006544c0 0x559d005c8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.135+0000 7f0827445640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d006544c0 0x559d005c8d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60626/0 (socket says 172.21.15.146:60626) 2024-09-18T01:45:26.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.135+0000 7f0827445640 1 -- 172.21.15.146:0/4028599950 learned_addr learned my addr 172.21.15.146:0/4028599950 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:26.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.135+0000 7f0827445640 1 -- 172.21.15.146:0/4028599950 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d004eebc0 con 0x559d006544c0 2024-09-18T01:45:26.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.136+0000 7f0827445640 1 --2- 172.21.15.146:0/4028599950 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d006544c0 0x559d005c8d80 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f0818025c20 tx=0x7f0818051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fb0555484a39c24 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.136+0000 7f071560a640 1 -- 172.21.15.146:0/4028599950 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f081805c580 con 0x559d006544c0 2024-09-18T01:45:26.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.136+0000 7f071560a640 1 -- 172.21.15.146:0/4028599950 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0818063030 con 0x559d006544c0 2024-09-18T01:45:26.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.136+0000 7f071560a640 1 -- 172.21.15.146:0/4028599950 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f081805c850 con 0x559d006544c0 2024-09-18T01:45:26.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.137+0000 7f0829951800 1 -- 172.21.15.146:0/4028599950 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d006544c0 msgr2=0x559d005c8d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.137+0000 7f0829951800 1 --2- 172.21.15.146:0/4028599950 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d006544c0 0x559d005c8d80 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f0818025c20 tx=0x7f0818051000 comp rx=0 tx=0).stop 2024-09-18T01:45:26.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.137+0000 7f0829951800 1 -- 172.21.15.146:0/4028599950 shutdown_connections 2024-09-18T01:45:26.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.137+0000 7f0829951800 1 --2- 172.21.15.146:0/4028599950 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d006544c0 0x559d005c8d80 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.137+0000 7f0829951800 1 -- 172.21.15.146:0/4028599950 >> 172.21.15.146:0/4028599950 conn(0x559d0064fdf0 msgr2=0x559d0073f130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:26.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.137+0000 7f0829951800 1 -- 172.21.15.146:0/4028599950 shutdown_connections 2024-09-18T01:45:26.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.137+0000 7f0829951800 1 -- 172.21.15.146:0/4028599950 wait complete. 2024-09-18T01:45:26.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.137+0000 7f0829951800 1 Processor -- start 2024-09-18T01:45:26.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.137+0000 7f0829951800 1 -- start start 2024-09-18T01:45:26.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.137+0000 7f0829951800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d006544c0 0x559d0074e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.137+0000 7f0829951800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x559d0065b4e0 con 0x559d006544c0 2024-09-18T01:45:26.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.137+0000 7f0827445640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d006544c0 0x559d0074e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.137+0000 7f0827445640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d006544c0 0x559d0074e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60628/0 (socket says 172.21.15.146:60628) 2024-09-18T01:45:26.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.137+0000 7f0827445640 1 -- 172.21.15.146:0/1890998771 learned_addr learned my addr 172.21.15.146:0/1890998771 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:26.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.138+0000 7f0827445640 1 -- 172.21.15.146:0/1890998771 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d00502fe0 con 0x559d006544c0 2024-09-18T01:45:26.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.138+0000 7f0827445640 1 --2- 172.21.15.146:0/1890998771 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d006544c0 0x559d0074e370 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f081800a330 tx=0x7f0818002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.138+0000 7f0713e07640 1 -- 172.21.15.146:0/1890998771 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f081806c030 con 0x559d006544c0 2024-09-18T01:45:26.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.138+0000 7f0713e07640 1 -- 172.21.15.146:0/1890998771 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f081805c580 con 0x559d006544c0 2024-09-18T01:45:26.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.138+0000 7f0829951800 1 -- 172.21.15.146:0/1890998771 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559d0074e8b0 con 0x559d006544c0 2024-09-18T01:45:26.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.138+0000 7f0713e07640 1 -- 172.21.15.146:0/1890998771 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f081805c860 con 0x559d006544c0 2024-09-18T01:45:26.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.138+0000 7f0829951800 1 -- 172.21.15.146:0/1890998771 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d0074ee30 con 0x559d006544c0 2024-09-18T01:45:26.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.139+0000 7f0713e07640 1 -- 172.21.15.146:0/1890998771 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0818053440 con 0x559d006544c0 2024-09-18T01:45:26.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.139+0000 7f0713e07640 1 --2- 172.21.15.146:0/1890998771 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f070c036b40 0x7f070c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.139+0000 7f0713e07640 1 -- 172.21.15.146:0/1890998771 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f0818070020 con 0x559d006544c0 2024-09-18T01:45:26.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.139+0000 7f0826c44640 1 --2- 172.21.15.146:0/1890998771 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f070c036b40 0x7f070c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.139+0000 7f0829951800 1 --2- 172.21.15.146:0/1890998771 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559d00654e00 0x559d007553e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.139+0000 7f0829951800 1 -- 172.21.15.146:0/1890998771 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559d00755920 con 0x559d00654e00 2024-09-18T01:45:26.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.139+0000 7f0827c46640 1 --2- 172.21.15.146:0/1890998771 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559d00654e00 0x559d007553e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.139+0000 7f0826c44640 1 --2- 172.21.15.146:0/1890998771 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f070c036b40 0x7f070c039000 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f081c000f60 tx=0x7f081c0012b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.140+0000 7f0827c46640 1 --2- 172.21.15.146:0/1890998771 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559d00654e00 0x559d007553e0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.140+0000 7f0827c46640 1 -- 172.21.15.146:0/1890998771 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f082000a4a0 con 0x559d00654e00 2024-09-18T01:45:26.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.140+0000 7f0829951800 1 -- 172.21.15.146:0/1890998771 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559d007529b0 con 0x559d00654e00 2024-09-18T01:45:26.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.140+0000 7f0827c46640 1 -- 172.21.15.146:0/1890998771 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f082000a4a0 con 0x559d00654e00 2024-09-18T01:45:26.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.140+0000 7f0829951800 1 -- 172.21.15.146:0/1890998771 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559d00757760 con 0x559d00654e00 2024-09-18T01:45:26.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.140+0000 7f0827c46640 1 -- 172.21.15.146:0/1890998771 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f082000a4a0 con 0x559d00654e00 2024-09-18T01:45:26.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.140+0000 7f0829951800 1 -- 172.21.15.146:0/1890998771 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559d007568a0 con 0x559d00654e00 2024-09-18T01:45:26.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.141+0000 7f0827c46640 1 -- 172.21.15.146:0/1890998771 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f082000a4a0 con 0x559d00654e00 2024-09-18T01:45:26.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.141+0000 7f0829951800 1 --2- 172.21.15.146:0/1890998771 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x559d00757370 0x559d0075abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.141+0000 7f0829951800 1 -- 172.21.15.146:0/1890998771 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559d0075b340 con 0x559d00757370 2024-09-18T01:45:26.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.141+0000 7f0827445640 1 --2- 172.21.15.146:0/1890998771 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x559d00757370 0x559d0075abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.141+0000 7f0827445640 1 --2- 172.21.15.146:0/1890998771 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x559d00757370 0x559d0075abb0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.141+0000 7f0827445640 1 -- 172.21.15.146:0/1890998771 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f081807b070 con 0x559d00757370 2024-09-18T01:45:26.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.142+0000 7f0829951800 1 Processor -- start 2024-09-18T01:45:26.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.142+0000 7f0829951800 1 -- start start 2024-09-18T01:45:26.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.142+0000 7f0829951800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d007690d0 0x559d007694f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.142+0000 7f0829951800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x559d004f0580 con 0x559d007690d0 2024-09-18T01:45:26.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.142+0000 7f0827c46640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d007690d0 0x559d007694f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.142+0000 7f0827c46640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d007690d0 0x559d007694f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60638/0 (socket says 172.21.15.146:60638) 2024-09-18T01:45:26.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.142+0000 7f0827c46640 1 -- 172.21.15.146:0/3884792917 learned_addr learned my addr 172.21.15.146:0/3884792917 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:26.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.142+0000 7f0827c46640 1 -- 172.21.15.146:0/3884792917 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d00769a30 con 0x559d007690d0 2024-09-18T01:45:26.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.143+0000 7f0827c46640 1 --2- 172.21.15.146:0/3884792917 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d007690d0 0x559d007694f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x559d00755d20 tx=0x7f08200178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.143+0000 7f0711602640 1 -- 172.21.15.146:0/3884792917 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0820013440 con 0x559d007690d0 2024-09-18T01:45:26.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.143+0000 7f0711602640 1 -- 172.21.15.146:0/3884792917 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08200135e0 con 0x559d007690d0 2024-09-18T01:45:26.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.143+0000 7f0829951800 1 -- 172.21.15.146:0/3884792917 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559d00769cc0 con 0x559d007690d0 2024-09-18T01:45:26.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.143+0000 7f0711602640 1 -- 172.21.15.146:0/3884792917 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08200138c0 con 0x559d007690d0 2024-09-18T01:45:26.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.143+0000 7f0829951800 1 -- 172.21.15.146:0/3884792917 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d0076c9a0 con 0x559d007690d0 2024-09-18T01:45:26.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.143+0000 7f0711602640 1 -- 172.21.15.146:0/3884792917 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0820011040 con 0x559d007690d0 2024-09-18T01:45:26.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.144+0000 7f0711602640 1 --2- 172.21.15.146:0/3884792917 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0700036b40 0x7f0700039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.144+0000 7f0711602640 1 -- 172.21.15.146:0/3884792917 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f082001d070 con 0x559d007690d0 2024-09-18T01:45:26.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.144+0000 7f0827445640 1 --2- 172.21.15.146:0/3884792917 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0700036b40 0x7f0700039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.144+0000 7f0829951800 1 Processor -- start 2024-09-18T01:45:26.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.144+0000 7f0827445640 1 --2- 172.21.15.146:0/3884792917 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0700036b40 0x7f0700039000 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f081808f1e0 tx=0x7f0818008310 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.144+0000 7f0829951800 1 -- start start 2024-09-18T01:45:26.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.144+0000 7f0829951800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d00775d80 0x559d00776180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.144+0000 7f0829951800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x559d007499a0 con 0x559d00775d80 2024-09-18T01:45:26.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.144+0000 7f0827c46640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d00775d80 0x559d00776180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.144+0000 7f0827c46640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d00775d80 0x559d00776180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60646/0 (socket says 172.21.15.146:60646) 2024-09-18T01:45:26.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.144+0000 7f0827c46640 1 -- 172.21.15.146:0/3109583786 learned_addr learned my addr 172.21.15.146:0/3109583786 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:26.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.145+0000 7f0827c46640 1 -- 172.21.15.146:0/3109583786 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d00776750 con 0x559d00775d80 2024-09-18T01:45:26.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.145+0000 7f0827c46640 1 --2- 172.21.15.146:0/3109583786 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d00775d80 0x559d00776180 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f082004c9f0 tx=0x7f082004cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c4b6a2765236f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.145+0000 7f070affd640 1 -- 172.21.15.146:0/3109583786 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f082004a020 con 0x559d00775d80 2024-09-18T01:45:26.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.145+0000 7f070affd640 1 -- 172.21.15.146:0/3109583786 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0820015560 con 0x559d00775d80 2024-09-18T01:45:26.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.145+0000 7f070affd640 1 -- 172.21.15.146:0/3109583786 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f082002a480 con 0x559d00775d80 2024-09-18T01:45:26.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.145+0000 7f0829951800 1 -- 172.21.15.146:0/3109583786 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d00775d80 msgr2=0x559d00776180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.145+0000 7f0829951800 1 --2- 172.21.15.146:0/3109583786 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d00775d80 0x559d00776180 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f082004c9f0 tx=0x7f082004cca0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.145+0000 7f0829951800 1 -- 172.21.15.146:0/3109583786 shutdown_connections 2024-09-18T01:45:26.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.145+0000 7f0829951800 1 --2- 172.21.15.146:0/3109583786 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d00775d80 0x559d00776180 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.145+0000 7f0829951800 1 -- 172.21.15.146:0/3109583786 >> 172.21.15.146:0/3109583786 conn(0x559d00772120 msgr2=0x559d00770220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:26.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.145+0000 7f0829951800 1 -- 172.21.15.146:0/3109583786 shutdown_connections 2024-09-18T01:45:26.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.145+0000 7f0829951800 1 -- 172.21.15.146:0/3109583786 wait complete. 2024-09-18T01:45:26.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.146+0000 7f0829951800 1 Processor -- start 2024-09-18T01:45:26.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.146+0000 7f0829951800 1 -- start start 2024-09-18T01:45:26.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.146+0000 7f0829951800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d00775d80 0x559d0077d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.146+0000 7f0829951800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x559d00776d70 con 0x559d00775d80 2024-09-18T01:45:26.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.146+0000 7f0827c46640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d00775d80 0x559d0077d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.146+0000 7f0827c46640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d00775d80 0x559d0077d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60658/0 (socket says 172.21.15.146:60658) 2024-09-18T01:45:26.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.146+0000 7f0827c46640 1 -- 172.21.15.146:0/943869202 learned_addr learned my addr 172.21.15.146:0/943869202 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:26.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.146+0000 7f0827c46640 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d0077d760 con 0x559d00775d80 2024-09-18T01:45:26.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.146+0000 7f0827c46640 1 --2- 172.21.15.146:0/943869202 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d00775d80 0x559d0077d220 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f082004c9f0 tx=0x7f082004c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.147+0000 7f07097fa640 1 -- 172.21.15.146:0/943869202 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0820039070 con 0x559d00775d80 2024-09-18T01:45:26.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.147+0000 7f07097fa640 1 -- 172.21.15.146:0/943869202 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f082002a8c0 con 0x559d00775d80 2024-09-18T01:45:26.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.147+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559d0077d9f0 con 0x559d00775d80 2024-09-18T01:45:26.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.147+0000 7f07097fa640 1 -- 172.21.15.146:0/943869202 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0820045040 con 0x559d00775d80 2024-09-18T01:45:26.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.147+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d007806a0 con 0x559d00775d80 2024-09-18T01:45:26.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.147+0000 7f07097fa640 1 -- 172.21.15.146:0/943869202 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f082003c070 con 0x559d00775d80 2024-09-18T01:45:26.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.147+0000 7f07097fa640 1 --2- 172.21.15.146:0/943869202 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f06f0036b40 0x7f06f0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.147+0000 7f07097fa640 1 -- 172.21.15.146:0/943869202 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f082004ce00 con 0x559d00775d80 2024-09-18T01:45:26.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.148+0000 7f0827445640 1 --2- 172.21.15.146:0/943869202 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f06f0036b40 0x7f06f0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.148+0000 7f0829951800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.148+0000 7f0829951800 1 --2- 172.21.15.146:0/943869202 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559d00788e80 0x559d0078b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.148+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559d0078ba90 con 0x559d00788e80 2024-09-18T01:45:26.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.148+0000 7f0826c44640 1 --2- 172.21.15.146:0/943869202 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559d00788e80 0x559d0078b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.148+0000 7f0827445640 1 --2- 172.21.15.146:0/943869202 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f06f0036b40 0x7f06f0039000 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x559d0075b740 tx=0x7f0818087000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.148+0000 7f0826c44640 1 --2- 172.21.15.146:0/943869202 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559d00788e80 0x559d0078b340 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.149+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f081c009050 con 0x559d00788e80 2024-09-18T01:45:26.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.149+0000 7f0829951800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:26.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.149+0000 7f0829951800 20 realm 2024-09-18T01:45:26.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.149+0000 7f0829951800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.149+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559d007882d0 con 0x559d00788e80 2024-09-18T01:45:26.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.149+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f081c009050 con 0x559d00788e80 2024-09-18T01:45:26.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.149+0000 7f0829951800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:26.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.149+0000 7f0829951800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:26.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.149+0000 7f0829951800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.149+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559d0078c570 con 0x559d00788e80 2024-09-18T01:45:26.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.149+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f081c009050 con 0x559d00788e80 2024-09-18T01:45:26.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.149+0000 7f0829951800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:26.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.149+0000 7f0829951800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.149+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559d0078ce40 con 0x559d00788e80 2024-09-18T01:45:26.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.149+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f081c009050 con 0x559d00788e80 2024-09-18T01:45:26.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.149+0000 7f0829951800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:26.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.149+0000 7f0829951800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.149+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559d0078d1e0 con 0x559d00788e80 2024-09-18T01:45:26.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.149+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f081c009050 con 0x559d00788e80 2024-09-18T01:45:26.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.149+0000 7f0829951800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:26.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.149+0000 7f0829951800 20 searching for the correct realm 2024-09-18T01:45:26.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.150+0000 7f0829951800 1 --2- 172.21.15.146:0/943869202 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x559d0078f0c0 0x559d007914b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.150+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559d00791b60 con 0x559d0078f0c0 2024-09-18T01:45:26.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.150+0000 7f0827c46640 1 --2- 172.21.15.146:0/943869202 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x559d0078f0c0 0x559d007914b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.150+0000 7f0827c46640 1 --2- 172.21.15.146:0/943869202 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x559d0078f0c0 0x559d007914b0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.150+0000 7f0827c46640 1 -- 172.21.15.146:0/943869202 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f082003b030 con 0x559d0078f0c0 2024-09-18T01:45:26.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.150+0000 7f0827c46640 1 --2- 172.21.15.146:0/943869202 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f0820037bb0 0x7f08200123a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.150+0000 7f0827c46640 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559d00791b60 con 0x7f0820037bb0 2024-09-18T01:45:26.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.150+0000 7f0827445640 1 --2- 172.21.15.146:0/943869202 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f0820037bb0 0x7f08200123a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.151+0000 7f0827445640 1 --2- 172.21.15.146:0/943869202 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f0820037bb0 0x7f08200123a0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.151+0000 7f0827445640 1 -- 172.21.15.146:0/943869202 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f081807b070 con 0x7f0820037bb0 2024-09-18T01:45:26.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.151+0000 7f0827445640 1 --2- 172.21.15.146:0/943869202 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f081805c070 0x7f0818090300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.151+0000 7f0827445640 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559d00791b60 con 0x7f081805c070 2024-09-18T01:45:26.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.151+0000 7f0826c44640 1 --2- 172.21.15.146:0/943869202 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f081805c070 0x7f0818090300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.151+0000 7f0826c44640 1 --2- 172.21.15.146:0/943869202 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f081805c070 0x7f0818090300 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.152+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f081c009050 con 0x7f081805c070 2024-09-18T01:45:26.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.152+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559d00791b60 con 0x559d00788e80 2024-09-18T01:45:26.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.152+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f081c009050 con 0x559d00788e80 2024-09-18T01:45:26.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.152+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559d00791b60 con 0x559d00788e80 2024-09-18T01:45:26.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.152+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f081c02a040 con 0x559d00788e80 2024-09-18T01:45:26.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.152+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559d00791b60 con 0x7f081805c070 2024-09-18T01:45:26.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.152+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f081c02a040 con 0x7f081805c070 2024-09-18T01:45:26.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.152+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559d00791b60 con 0x7f081805c070 2024-09-18T01:45:26.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.152+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f081c02a040 con 0x7f081805c070 2024-09-18T01:45:26.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.152+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559d00791b60 con 0x7f0820037bb0 2024-09-18T01:45:26.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.153+0000 7f0827445640 1 -- 172.21.15.146:0/943869202 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f081807b070 con 0x7f0820037bb0 2024-09-18T01:45:26.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.153+0000 7f0827445640 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559d00791b60 con 0x559d0078f0c0 2024-09-18T01:45:26.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.153+0000 7f0827c46640 1 -- 172.21.15.146:0/943869202 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f082003b030 con 0x559d0078f0c0 2024-09-18T01:45:26.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.153+0000 7f0827c46640 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559d00791b60 con 0x559d00788e80 2024-09-18T01:45:26.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.153+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f081c02a040 con 0x559d00788e80 2024-09-18T01:45:26.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.153+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559d00791b60 con 0x7f081805c070 2024-09-18T01:45:26.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.153+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f081c02a040 con 0x7f081805c070 2024-09-18T01:45:26.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.153+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559d00791b60 con 0x559d00788e80 2024-09-18T01:45:26.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.154+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f081c02a040 con 0x559d00788e80 2024-09-18T01:45:26.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.154+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559d00791b60 con 0x7f0820037bb0 2024-09-18T01:45:26.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.154+0000 7f0827445640 1 -- 172.21.15.146:0/943869202 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f081807b070 con 0x7f0820037bb0 2024-09-18T01:45:26.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.154+0000 7f0827445640 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559d00791b60 con 0x559d0078f0c0 2024-09-18T01:45:26.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.154+0000 7f0827c46640 1 -- 172.21.15.146:0/943869202 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f082003b030 con 0x559d0078f0c0 2024-09-18T01:45:26.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.154+0000 7f0827c46640 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559d00791b60 con 0x559d0078f0c0 2024-09-18T01:45:26.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.154+0000 7f0827c46640 1 -- 172.21.15.146:0/943869202 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f082003b030 con 0x559d0078f0c0 2024-09-18T01:45:26.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.154+0000 7f0827c46640 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559d00791b60 con 0x7f081805c070 2024-09-18T01:45:26.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.155+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f081c02a040 con 0x7f081805c070 2024-09-18T01:45:26.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.155+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559d00791b60 con 0x559d0078f0c0 2024-09-18T01:45:26.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.155+0000 7f0827c46640 1 -- 172.21.15.146:0/943869202 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f082003b030 con 0x559d0078f0c0 2024-09-18T01:45:26.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.155+0000 7f0827c46640 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559d00791b60 con 0x559d0078f0c0 2024-09-18T01:45:26.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.155+0000 7f0827c46640 1 -- 172.21.15.146:0/943869202 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f082003b030 con 0x559d0078f0c0 2024-09-18T01:45:26.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.155+0000 7f0827c46640 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559d00791b60 con 0x559d00788e80 2024-09-18T01:45:26.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.155+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f081c02a040 con 0x559d00788e80 2024-09-18T01:45:26.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.155+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559d00791b60 con 0x559d00788e80 2024-09-18T01:45:26.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.156+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f081c02a040 con 0x559d00788e80 2024-09-18T01:45:26.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.156+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559d00791b60 con 0x7f081805c070 2024-09-18T01:45:26.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.156+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f081c02a040 con 0x7f081805c070 2024-09-18T01:45:26.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.156+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559d00791b60 con 0x559d0078f0c0 2024-09-18T01:45:26.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.156+0000 7f0827c46640 1 -- 172.21.15.146:0/943869202 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f082003b030 con 0x559d0078f0c0 2024-09-18T01:45:26.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.156+0000 7f0827c46640 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559d00791b60 con 0x7f0820037bb0 2024-09-18T01:45:26.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.156+0000 7f0827445640 1 -- 172.21.15.146:0/943869202 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f081807b070 con 0x7f0820037bb0 2024-09-18T01:45:26.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.156+0000 7f0827445640 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559d00791b60 con 0x559d00788e80 2024-09-18T01:45:26.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.157+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f081c02a040 con 0x559d00788e80 2024-09-18T01:45:26.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.157+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559d00791b60 con 0x7f081805c070 2024-09-18T01:45:26.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.157+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f081c02a040 con 0x7f081805c070 2024-09-18T01:45:26.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.157+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559d00791b60 con 0x559d0078f0c0 2024-09-18T01:45:26.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.157+0000 7f0827c46640 1 -- 172.21.15.146:0/943869202 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f082003b030 con 0x559d0078f0c0 2024-09-18T01:45:26.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.157+0000 7f0827c46640 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559d00791b60 con 0x7f081805c070 2024-09-18T01:45:26.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.157+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f081c02a040 con 0x7f081805c070 2024-09-18T01:45:26.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.157+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559d00791b60 con 0x7f0820037bb0 2024-09-18T01:45:26.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.158+0000 7f0827445640 1 -- 172.21.15.146:0/943869202 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f081807b070 con 0x7f0820037bb0 2024-09-18T01:45:26.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.158+0000 7f0827445640 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559d00791b60 con 0x559d0078f0c0 2024-09-18T01:45:26.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.158+0000 7f0827c46640 1 -- 172.21.15.146:0/943869202 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f082003b030 con 0x559d0078f0c0 2024-09-18T01:45:26.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.158+0000 7f0827c46640 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559d00791b60 con 0x7f081805c070 2024-09-18T01:45:26.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.158+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f081c02a040 con 0x7f081805c070 2024-09-18T01:45:26.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.158+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559d00791b60 con 0x559d00788e80 2024-09-18T01:45:26.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.158+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f081c02a040 con 0x559d00788e80 2024-09-18T01:45:26.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.158+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559d00791b60 con 0x7f0820037bb0 2024-09-18T01:45:26.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.159+0000 7f0827445640 1 -- 172.21.15.146:0/943869202 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08180af040 con 0x7f0820037bb0 2024-09-18T01:45:26.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.159+0000 7f0829951800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:26.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.159+0000 7f0829951800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:26.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.159+0000 7f0829951800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:26.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.159+0000 7f0829951800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:26.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.159+0000 7f0829951800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:26.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.159+0000 7f0829951800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:26.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.159+0000 7f0829951800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.159+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559d0078db90 con 0x559d00788e80 2024-09-18T01:45:26.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.159+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f081c02a040 con 0x559d00788e80 2024-09-18T01:45:26.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.159+0000 7f0829951800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:26.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.159+0000 7f0829951800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.159+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559d0078e430 con 0x559d00788e80 2024-09-18T01:45:26.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.159+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f081c02a040 con 0x559d00788e80 2024-09-18T01:45:26.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.159+0000 7f0829951800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:26.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.159+0000 7f0829951800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.159+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559d0078d7d0 con 0x7f0820037bb0 2024-09-18T01:45:26.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.159+0000 7f0827445640 1 -- 172.21.15.146:0/943869202 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f08180af040 con 0x7f0820037bb0 2024-09-18T01:45:26.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.159+0000 7f0829951800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:26.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.159+0000 7f0829951800 20 zone default found 2024-09-18T01:45:26.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.159+0000 7f0829951800 4 Realm: () 2024-09-18T01:45:26.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.159+0000 7f0829951800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:26.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.159+0000 7f0829951800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:26.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.159+0000 7f0829951800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:26.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.159+0000 7f0829951800 20 zonegroup default 2024-09-18T01:45:26.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.159+0000 7f0829951800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.159+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559d00792470 con 0x7f081805c070 2024-09-18T01:45:26.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.160+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f081c02a040 con 0x7f081805c070 2024-09-18T01:45:26.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.160+0000 7f0829951800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:26.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.160+0000 7f0829951800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.160+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559d00793fd0 con 0x559d0078f0c0 2024-09-18T01:45:26.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.160+0000 7f0827c46640 1 -- 172.21.15.146:0/943869202 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f082003b030 con 0x559d0078f0c0 2024-09-18T01:45:26.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.160+0000 7f0829951800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:26.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.160+0000 7f0829951800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.160+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559d00794480 con 0x559d0078f0c0 2024-09-18T01:45:26.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.160+0000 7f0827c46640 1 -- 172.21.15.146:0/943869202 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f082003b030 con 0x559d0078f0c0 2024-09-18T01:45:26.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.160+0000 7f0829951800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:26.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.160+0000 7f0829951800 20 started sync module instance, tier type = 2024-09-18T01:45:26.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.160+0000 7f0829951800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:26.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.160+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d00792ed0 con 0x7f0820037bb0 2024-09-18T01:45:26.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.161+0000 7f0827445640 1 -- 172.21.15.146:0/943869202 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v31'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08180af040 con 0x7f0820037bb0 2024-09-18T01:45:26.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.161+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94132806169280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d00794d90 con 0x7f0820037bb0 2024-09-18T01:45:26.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.161+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d007955e0 con 0x559d00788e80 2024-09-18T01:45:26.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.162+0000 7f0827445640 1 -- 172.21.15.146:0/943869202 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94132806169280] v31'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08180af040 con 0x7f0820037bb0 2024-09-18T01:45:26.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.162+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v31'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f081c02a040 con 0x559d00788e80 2024-09-18T01:45:26.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.162+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94132806174944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d007955e0 con 0x559d00788e80 2024-09-18T01:45:26.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.162+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d007960e0 con 0x559d0078f0c0 2024-09-18T01:45:26.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.164+0000 7f0827c46640 1 -- 172.21.15.146:0/943869202 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v31'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f082003b030 con 0x559d0078f0c0 2024-09-18T01:45:26.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.164+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94132806179792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d00796980 con 0x559d0078f0c0 2024-09-18T01:45:26.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.164+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d00797430 con 0x7f0820037bb0 2024-09-18T01:45:26.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.164+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94132806174944] v31'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f081c02a040 con 0x559d00788e80 2024-09-18T01:45:26.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.165+0000 7f0827445640 1 -- 172.21.15.146:0/943869202 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v31'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08180af040 con 0x7f0820037bb0 2024-09-18T01:45:26.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.165+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94132806177072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d00797850 con 0x7f0820037bb0 2024-09-18T01:45:26.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.165+0000 7f0827c46640 1 -- 172.21.15.146:0/943869202 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94132806179792] v31'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f082003b030 con 0x559d0078f0c0 2024-09-18T01:45:26.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.165+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d007964d0 con 0x559d00788e80 2024-09-18T01:45:26.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.166+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v31'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f081c02a040 con 0x559d00788e80 2024-09-18T01:45:26.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.166+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94132806188384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d007964d0 con 0x559d00788e80 2024-09-18T01:45:26.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.166+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d00798cd0 con 0x7f081805c070 2024-09-18T01:45:26.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.166+0000 7f0827445640 1 -- 172.21.15.146:0/943869202 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94132806177072] v31'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08180af040 con 0x7f0820037bb0 2024-09-18T01:45:26.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.167+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v31'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f081c02a040 con 0x7f081805c070 2024-09-18T01:45:26.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.167+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94132806191008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d00798c90 con 0x7f081805c070 2024-09-18T01:45:26.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.167+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d007996e0 con 0x7f081805c070 2024-09-18T01:45:26.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.167+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94132806188384] v31'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f081c02a040 con 0x559d00788e80 2024-09-18T01:45:26.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.168+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(56 notify.6 [create] v31'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f081c02a040 con 0x7f081805c070 2024-09-18T01:45:26.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.168+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94132806189440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d007996e0 con 0x7f081805c070 2024-09-18T01:45:26.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.168+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d0079a0e0 con 0x7f081805c070 2024-09-18T01:45:26.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.168+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94132806191008] v31'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f081c02a040 con 0x7f081805c070 2024-09-18T01:45:26.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.170+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94132806189440] v31'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f081c02a040 con 0x7f081805c070 2024-09-18T01:45:26.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.170+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v31'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f081c02a040 con 0x7f081805c070 2024-09-18T01:45:26.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.170+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94132806184768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d00799dd0 con 0x7f081805c070 2024-09-18T01:45:26.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.170+0000 7f0829951800 20 add_watcher() i=0 2024-09-18T01:45:26.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.170+0000 7f0829951800 20 add_watcher() i=1 2024-09-18T01:45:26.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.170+0000 7f0829951800 20 add_watcher() i=2 2024-09-18T01:45:26.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.170+0000 7f0829951800 20 add_watcher() i=3 2024-09-18T01:45:26.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.170+0000 7f0829951800 20 add_watcher() i=4 2024-09-18T01:45:26.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.170+0000 7f0829951800 20 add_watcher() i=5 2024-09-18T01:45:26.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.170+0000 7f0829951800 20 add_watcher() i=6 2024-09-18T01:45:26.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.171+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94132806184768] v31'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f081c02a040 con 0x7f081805c070 2024-09-18T01:45:26.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.171+0000 7f0829951800 20 add_watcher() i=7 2024-09-18T01:45:26.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.171+0000 7f0829951800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:26.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.171+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559d0079d1a0 con 0x559d00788e80 2024-09-18T01:45:26.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.172+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f081c02a040 con 0x559d00788e80 2024-09-18T01:45:26.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.172+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94132806196416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d0079a590 con 0x559d00788e80 2024-09-18T01:45:26.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.173+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94132806196416] v31'102 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f081c02a040 con 0x559d00788e80 2024-09-18T01:45:26.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.173+0000 7f06ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:26.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.173+0000 7f0829951800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:26.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.173+0000 7f0829951800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:26.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.173+0000 7f0829951800 5 note: GC not initialized 2024-09-18T01:45:26.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.173+0000 7f06dcfe1640 20 reqs_thread_entry: start 2024-09-18T01:45:26.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.173+0000 7f0829951800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:26.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.173+0000 7f0829951800 20 Filter name: none 2024-09-18T01:45:26.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.173+0000 7f06567fc640 20 reqs_thread_entry: start 2024-09-18T01:45:26.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.174+0000 7f0829951800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.174+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559d007d0330 con 0x7f0820037bb0 2024-09-18T01:45:26.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.174+0000 7f0827445640 1 -- 172.21.15.146:0/943869202 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f08180af040 con 0x7f0820037bb0 2024-09-18T01:45:26.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.174+0000 7f0829951800 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T01:45:26.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.174+0000 7f0829951800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.174+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:63 8.13 8:ceaa8859:root::.bucket.meta.myfoo%3a8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559d007d0cc0 con 0x7f081805c070 2024-09-18T01:45:26.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.175+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(63 .bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f081c02a040 con 0x7f081805c070 2024-09-18T01:45:26.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.175+0000 7f0829951800 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T01:45:26.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.175+0000 7f0829951800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-18T01:45:26.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.175+0000 7f0829951800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.175+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559d007d0c70 con 0x7f0820037bb0 2024-09-18T01:45:26.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.175+0000 7f0827445640 1 -- 172.21.15.146:0/943869202 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f08180af040 con 0x7f0820037bb0 2024-09-18T01:45:26.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.175+0000 7f0829951800 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T01:45:26.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.175+0000 7f0829951800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.175+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:65 8.13 8:ceaa8859:root::.bucket.meta.myfoo%3a8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559d007d2390 con 0x7f081805c070 2024-09-18T01:45:26.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.175+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(65 .bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f081c02a040 con 0x7f081805c070 2024-09-18T01:45:26.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.175+0000 7f0829951800 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T01:45:26.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.175+0000 7f0829951800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-18T01:45:26.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.175+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:66 4.33 4:cd49ce18:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559d007d3e50 con 0x7f081805c070 2024-09-18T01:45:26.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.175+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:67 4.10 4:083380d8:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559d007d69f0 con 0x559d0078f0c0 2024-09-18T01:45:26.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.176+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:68 4.15 4:a8d62d11:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559d007d9530 con 0x559d0078f0c0 2024-09-18T01:45:26.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.176+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:69 4.36 4:6d8e27f1:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559d007dbee0 con 0x559d00788e80 2024-09-18T01:45:26.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.176+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:70 4.19 4:98d692f3:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559d007de8c0 con 0x559d0078f0c0 2024-09-18T01:45:26.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.176+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:71 4.13 4:cabe8116:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559d007e1310 con 0x7f0820037bb0 2024-09-18T01:45:26.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.176+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:72 4.16 4:6b798858:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559d007e3c00 con 0x559d0078f0c0 2024-09-18T01:45:26.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.176+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:73 4.14 4:2ab8464f:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559d007e60d0 con 0x559d0078f0c0 2024-09-18T01:45:26.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.176+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:74 4.3e 4:7ce77e2d:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559d007e8860 con 0x7f0820037bb0 2024-09-18T01:45:26.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.176+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(66 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f081c02a040 con 0x7f081805c070 2024-09-18T01:45:26.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.176+0000 7f0827c46640 1 -- 172.21.15.146:0/943869202 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(67 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f082003b030 con 0x559d0078f0c0 2024-09-18T01:45:26.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.176+0000 7f0827c46640 1 -- 172.21.15.146:0/943869202 <== osd.3 v2:172.21.15.146:6809/4106661138 15 ==== osd_op_reply(68 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f082003b030 con 0x559d0078f0c0 2024-09-18T01:45:26.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.176+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(69 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f081c02a040 con 0x559d00788e80 2024-09-18T01:45:26.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.176+0000 7f0827c46640 1 -- 172.21.15.146:0/943869202 <== osd.3 v2:172.21.15.146:6809/4106661138 16 ==== osd_op_reply(70 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f082003b030 con 0x559d0078f0c0 2024-09-18T01:45:26.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.176+0000 7f0827445640 1 -- 172.21.15.146:0/943869202 <== osd.2 v2:172.21.15.146:6800/3820039304 14 ==== osd_op_reply(71 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f08180af040 con 0x7f0820037bb0 2024-09-18T01:45:26.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.176+0000 7f0827c46640 1 -- 172.21.15.146:0/943869202 <== osd.3 v2:172.21.15.146:6809/4106661138 17 ==== osd_op_reply(73 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f082003b030 con 0x559d0078f0c0 2024-09-18T01:45:26.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.176+0000 7f0827c46640 1 -- 172.21.15.146:0/943869202 <== osd.3 v2:172.21.15.146:6809/4106661138 18 ==== osd_op_reply(72 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f082003b030 con 0x559d0078f0c0 2024-09-18T01:45:26.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.176+0000 7f0827445640 1 -- 172.21.15.146:0/943869202 <== osd.2 v2:172.21.15.146:6800/3820039304 15 ==== osd_op_reply(74 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f08180af040 con 0x7f0820037bb0 2024-09-18T01:45:26.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.176+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:75 4.2d 4:b678784f:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559d007d8fe0 con 0x7f081805c070 2024-09-18T01:45:26.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.176+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:76 4.10 4:0ad5fa93:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559d007e61e0 con 0x559d0078f0c0 2024-09-18T01:45:26.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.176+0000 7f0827c46640 1 -- 172.21.15.146:0/943869202 <== osd.3 v2:172.21.15.146:6809/4106661138 19 ==== osd_op_reply(76 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.10 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f082003b030 con 0x559d0078f0c0 2024-09-18T01:45:26.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.177+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(75 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f081c02a040 con 0x7f081805c070 2024-09-18T01:45:26.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.177+0000 7f06ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:26.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.177+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94132806196416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d007d8fe0 con 0x559d00788e80 2024-09-18T01:45:26.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.178+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94132806196416] v31'103 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f081c02a040 con 0x559d00788e80 2024-09-18T01:45:26.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.178+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94132806169280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d007cdd30 con 0x7f0820037bb0 2024-09-18T01:45:26.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.179+0000 7f0827445640 1 -- 172.21.15.146:0/943869202 <== osd.2 v2:172.21.15.146:6800/3820039304 16 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94132806169280] v31'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08180af040 con 0x7f0820037bb0 2024-09-18T01:45:26.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.179+0000 7f0829951800 20 remove_watcher() i=0 2024-09-18T01:45:26.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.179+0000 7f0829951800 2 removed watcher, disabling cache 2024-09-18T01:45:26.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.179+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94132806174944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d007cdd30 con 0x559d00788e80 2024-09-18T01:45:26.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.181+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94132806174944] v31'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f081c02a040 con 0x559d00788e80 2024-09-18T01:45:26.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.181+0000 7f0829951800 20 remove_watcher() i=1 2024-09-18T01:45:26.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.181+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94132806179792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d007cdd30 con 0x559d0078f0c0 2024-09-18T01:45:26.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.182+0000 7f0827c46640 1 -- 172.21.15.146:0/943869202 <== osd.3 v2:172.21.15.146:6809/4106661138 20 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94132806179792] v31'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f082003b030 con 0x559d0078f0c0 2024-09-18T01:45:26.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.182+0000 7f0829951800 20 remove_watcher() i=2 2024-09-18T01:45:26.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.182+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94132806177072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d007cdd30 con 0x7f0820037bb0 2024-09-18T01:45:26.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.182+0000 7f0827445640 1 -- 172.21.15.146:0/943869202 <== osd.2 v2:172.21.15.146:6800/3820039304 17 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94132806177072] v31'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08180af040 con 0x7f0820037bb0 2024-09-18T01:45:26.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.182+0000 7f0829951800 20 remove_watcher() i=3 2024-09-18T01:45:26.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.183+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94132806188384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d007cdd30 con 0x559d00788e80 2024-09-18T01:45:26.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.184+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94132806188384] v31'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f081c02a040 con 0x559d00788e80 2024-09-18T01:45:26.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.184+0000 7f0829951800 20 remove_watcher() i=4 2024-09-18T01:45:26.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.184+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94132806191008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d007cdd30 con 0x7f081805c070 2024-09-18T01:45:26.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.185+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94132806191008] v31'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f081c02a040 con 0x7f081805c070 2024-09-18T01:45:26.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.185+0000 7f0829951800 20 remove_watcher() i=5 2024-09-18T01:45:26.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.185+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94132806189440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d007cdd30 con 0x7f081805c070 2024-09-18T01:45:26.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.186+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 <== osd.0 v2:172.21.15.129:6800/1759265424 22 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94132806189440] v31'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f081c02a040 con 0x7f081805c070 2024-09-18T01:45:26.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.186+0000 7f0829951800 20 remove_watcher() i=6 2024-09-18T01:45:26.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.186+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94132806184768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d007cdd30 con 0x7f081805c070 2024-09-18T01:45:26.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.187+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 <== osd.0 v2:172.21.15.129:6800/1759265424 23 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94132806184768] v31'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f081c02a040 con 0x7f081805c070 2024-09-18T01:45:26.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.187+0000 7f0829951800 20 remove_watcher() i=7 2024-09-18T01:45:26.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.187+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f081805c070 msgr2=0x7f0818090300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.187+0000 7f0829951800 1 --2- 172.21.15.146:0/943869202 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f081805c070 0x7f0818090300 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.187+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559d00788e80 msgr2=0x559d0078b340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.187+0000 7f0829951800 1 --2- 172.21.15.146:0/943869202 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559d00788e80 0x559d0078b340 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.187+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f0820037bb0 msgr2=0x7f08200123a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.187+0000 7f0829951800 1 --2- 172.21.15.146:0/943869202 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f0820037bb0 0x7f08200123a0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.187+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x559d0078f0c0 msgr2=0x559d007914b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.187+0000 7f0829951800 1 --2- 172.21.15.146:0/943869202 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x559d0078f0c0 0x559d007914b0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.187+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f06f0036b40 msgr2=0x7f06f0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.187+0000 7f0829951800 1 --2- 172.21.15.146:0/943869202 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f06f0036b40 0x7f06f0039000 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x559d0075b740 tx=0x7f0818087000 comp rx=0 tx=0).stop 2024-09-18T01:45:26.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.187+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d00775d80 msgr2=0x559d0077d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.187+0000 7f0826c44640 1 -- 172.21.15.146:0/943869202 reap_dead start 2024-09-18T01:45:26.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.187+0000 7f0829951800 1 --2- 172.21.15.146:0/943869202 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d00775d80 0x559d0077d220 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f082004c9f0 tx=0x7f082004c980 comp rx=0 tx=0).stop 2024-09-18T01:45:26.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.187+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 shutdown_connections 2024-09-18T01:45:26.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.187+0000 7f0829951800 1 --2- 172.21.15.146:0/943869202 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d00775d80 0x559d0077d220 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.187+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 >> 172.21.15.146:0/943869202 conn(0x559d00772120 msgr2=0x559d007701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:26.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.187+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 shutdown_connections 2024-09-18T01:45:26.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.187+0000 7f0829951800 1 -- 172.21.15.146:0/943869202 wait complete. 2024-09-18T01:45:26.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.188+0000 7f0829951800 1 -- 172.21.15.146:0/3884792917 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0700036b40 msgr2=0x7f0700039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.188+0000 7f0829951800 1 --2- 172.21.15.146:0/3884792917 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0700036b40 0x7f0700039000 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f081808f1e0 tx=0x7f0818008310 comp rx=0 tx=0).stop 2024-09-18T01:45:26.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.188+0000 7f0829951800 1 -- 172.21.15.146:0/3884792917 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d007690d0 msgr2=0x559d007694f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.188+0000 7f0829951800 1 --2- 172.21.15.146:0/3884792917 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d007690d0 0x559d007694f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x559d00755d20 tx=0x7f08200178e0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.188+0000 7f0829951800 1 -- 172.21.15.146:0/3884792917 shutdown_connections 2024-09-18T01:45:26.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.188+0000 7f0829951800 1 --2- 172.21.15.146:0/3884792917 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0700036b40 0x7f0700039000 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.188+0000 7f0829951800 1 --2- 172.21.15.146:0/3884792917 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d007690d0 0x559d007694f0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.188+0000 7f0829951800 1 -- 172.21.15.146:0/3884792917 >> 172.21.15.146:0/3884792917 conn(0x559d0075e060 msgr2=0x559d00760be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:26.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.188+0000 7f0829951800 1 -- 172.21.15.146:0/3884792917 shutdown_connections 2024-09-18T01:45:26.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.188+0000 7f0829951800 1 -- 172.21.15.146:0/3884792917 wait complete. 2024-09-18T01:45:26.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.188+0000 7f0829951800 1 -- 172.21.15.146:0/1890998771 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559d00654e00 msgr2=0x559d007553e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.188+0000 7f0829951800 1 --2- 172.21.15.146:0/1890998771 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559d00654e00 0x559d007553e0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.188+0000 7f0829951800 1 -- 172.21.15.146:0/1890998771 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x559d00757370 msgr2=0x559d0075abb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.188+0000 7f0829951800 1 --2- 172.21.15.146:0/1890998771 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x559d00757370 0x559d0075abb0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.188+0000 7f0829951800 1 -- 172.21.15.146:0/1890998771 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f070c036b40 msgr2=0x7f070c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.188+0000 7f0829951800 1 --2- 172.21.15.146:0/1890998771 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f070c036b40 0x7f070c039000 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f081c000f60 tx=0x7f081c0012b0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.188+0000 7f0829951800 1 -- 172.21.15.146:0/1890998771 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d006544c0 msgr2=0x559d0074e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.188+0000 7f0829951800 1 --2- 172.21.15.146:0/1890998771 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d006544c0 0x559d0074e370 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f081800a330 tx=0x7f0818002fb0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.188+0000 7f0829951800 1 -- 172.21.15.146:0/1890998771 shutdown_connections 2024-09-18T01:45:26.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.188+0000 7f0829951800 1 --2- 172.21.15.146:0/1890998771 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x559d00757370 0x559d0075abb0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.188+0000 7f0829951800 1 --2- 172.21.15.146:0/1890998771 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559d00654e00 0x559d007553e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.188+0000 7f0829951800 1 --2- 172.21.15.146:0/1890998771 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f070c036b40 0x7f070c039000 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.188+0000 7f0829951800 1 --2- 172.21.15.146:0/1890998771 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d006544c0 0x559d0074e370 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.188+0000 7f0829951800 1 -- 172.21.15.146:0/1890998771 >> 172.21.15.146:0/1890998771 conn(0x559d0064fdf0 msgr2=0x559d0073d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:26.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.188+0000 7f0829951800 1 -- 172.21.15.146:0/1890998771 shutdown_connections 2024-09-18T01:45:26.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.188+0000 7f0829951800 1 -- 172.21.15.146:0/1890998771 wait complete. 2024-09-18T01:45:26.205 INFO:teuthology.orchestra.run.smithi146.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"069822df-7f2c-4cd0-aee2-64a07ebf49c5","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1","marker":"8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-18T01:45:25.647023Z","creation_time":"2024-09-18T01:45:25.639613Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-09-18T01:45:26.205 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '069822df-7f2c-4cd0-aee2-64a07ebf49c5', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1', 'marker': '8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-18T01:45:25.647023Z', 'creation_time': '2024-09-18T01:45:25.639613Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-18T01:45:26.205 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-18T01:45:26.205 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-18T01:45:26.205 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-18T01:45:26.249 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:26.250 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:26.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.250+0000 7ff582087800 1 Processor -- start 2024-09-18T01:45:26.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.250+0000 7ff582087800 1 -- start start 2024-09-18T01:45:26.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.250+0000 7ff582087800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x5611d71a1550 0x5611d71a1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.250+0000 7ff582087800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5611d7061b30 con 0x5611d71a1e90 2024-09-18T01:45:26.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.250+0000 7ff582087800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x5611d7043360 con 0x5611d71a1550 2024-09-18T01:45:26.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.250+0000 7ff57fb7b640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x5611d71a1550 0x5611d71a1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.250+0000 7ff57f37a640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x5611d71a1e90 0x5611d71a6a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:38940/0 (socket says 172.21.15.146:38940) 2024-09-18T01:45:26.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.250+0000 7ff57f37a640 1 -- 172.21.15.146:0/3699950559 learned_addr learned my addr 172.21.15.146:0/3699950559 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:45:26.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.250+0000 7ff57fb7b640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x5611d71a1550 0x5611d71a1950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60668/0 (socket says 172.21.15.146:60668) 2024-09-18T01:45:26.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.251+0000 7ff57fb7b640 1 -- 172.21.15.146:0/3699950559 >> v1:172.21.15.129:6789/0 conn(0x5611d71a1e90 legacy=0x5611d71a6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.251+0000 7ff57fb7b640 1 -- 172.21.15.146:0/3699950559 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611d7069e00 con 0x5611d71a1550 2024-09-18T01:45:26.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.252+0000 7ff57fb7b640 1 --2- 172.21.15.146:0/3699950559 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611d71a1550 0x5611d71a1950 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff57000a600 tx=0x7ff570047cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51848a66e32410fd server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.253+0000 7ff57eb79640 1 -- 172.21.15.146:0/3699950559 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff570056070 con 0x5611d71a1550 2024-09-18T01:45:26.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.253+0000 7ff57eb79640 1 -- 172.21.15.146:0/3699950559 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff57000a200 con 0x5611d71a1550 2024-09-18T01:45:26.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.253+0000 7ff57eb79640 1 -- 172.21.15.146:0/3699950559 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff570008590 con 0x5611d71a1550 2024-09-18T01:45:26.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.253+0000 7ff582087800 1 -- 172.21.15.146:0/3699950559 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611d71a1550 msgr2=0x5611d71a1950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.253+0000 7ff582087800 1 --2- 172.21.15.146:0/3699950559 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611d71a1550 0x5611d71a1950 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff57000a600 tx=0x7ff570047cb0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.253+0000 7ff582087800 1 -- 172.21.15.146:0/3699950559 shutdown_connections 2024-09-18T01:45:26.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.253+0000 7ff582087800 1 --2- 172.21.15.146:0/3699950559 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611d71a1550 0x5611d71a1950 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.253+0000 7ff582087800 1 -- 172.21.15.146:0/3699950559 >> 172.21.15.146:0/3699950559 conn(0x5611d719cde0 msgr2=0x5611d719f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:26.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.253+0000 7ff582087800 1 -- 172.21.15.146:0/3699950559 shutdown_connections 2024-09-18T01:45:26.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.253+0000 7ff582087800 1 -- 172.21.15.146:0/3699950559 wait complete. 2024-09-18T01:45:26.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.267+0000 7ff582087800 1 Processor -- start 2024-09-18T01:45:26.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.267+0000 7ff582087800 1 -- start start 2024-09-18T01:45:26.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.267+0000 7ff582087800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611d71a1550 0x5611d728f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.267+0000 7ff582087800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5611d70ee330 con 0x5611d71a1550 2024-09-18T01:45:26.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.267+0000 7ff57fb7b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611d71a1550 0x5611d728f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.267+0000 7ff57fb7b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611d71a1550 0x5611d728f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60682/0 (socket says 172.21.15.146:60682) 2024-09-18T01:45:26.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.267+0000 7ff57fb7b640 1 -- 172.21.15.146:0/2087509446 learned_addr learned my addr 172.21.15.146:0/2087509446 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:26.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.267+0000 7ff57fb7b640 1 -- 172.21.15.146:0/2087509446 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611d703bbc0 con 0x5611d71a1550 2024-09-18T01:45:26.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.268+0000 7ff57fb7b640 1 --2- 172.21.15.146:0/2087509446 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611d71a1550 0x5611d728f690 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff570027ae0 tx=0x7ff570053000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9b8e7d40e17ef19 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.268+0000 7ff46de0b640 1 -- 172.21.15.146:0/2087509446 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff570008780 con 0x5611d71a1550 2024-09-18T01:45:26.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.268+0000 7ff46de0b640 1 -- 172.21.15.146:0/2087509446 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff570008920 con 0x5611d71a1550 2024-09-18T01:45:26.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.268+0000 7ff46de0b640 1 -- 172.21.15.146:0/2087509446 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff570008c00 con 0x5611d71a1550 2024-09-18T01:45:26.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.268+0000 7ff582087800 1 -- 172.21.15.146:0/2087509446 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611d71a1550 msgr2=0x5611d728f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.268+0000 7ff582087800 1 --2- 172.21.15.146:0/2087509446 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611d71a1550 0x5611d728f690 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff570027ae0 tx=0x7ff570053000 comp rx=0 tx=0).stop 2024-09-18T01:45:26.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.268+0000 7ff582087800 1 -- 172.21.15.146:0/2087509446 shutdown_connections 2024-09-18T01:45:26.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.268+0000 7ff582087800 1 --2- 172.21.15.146:0/2087509446 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611d71a1550 0x5611d728f690 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.268+0000 7ff582087800 1 -- 172.21.15.146:0/2087509446 >> 172.21.15.146:0/2087509446 conn(0x5611d719cde0 msgr2=0x5611d728b050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:26.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.268+0000 7ff582087800 1 -- 172.21.15.146:0/2087509446 shutdown_connections 2024-09-18T01:45:26.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.269+0000 7ff582087800 1 -- 172.21.15.146:0/2087509446 wait complete. 2024-09-18T01:45:26.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.269+0000 7ff582087800 1 Processor -- start 2024-09-18T01:45:26.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.269+0000 7ff582087800 1 -- start start 2024-09-18T01:45:26.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.269+0000 7ff582087800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611d71a1550 0x5611d729b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.269+0000 7ff582087800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5611d71a8570 con 0x5611d71a1550 2024-09-18T01:45:26.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.269+0000 7ff57fb7b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611d71a1550 0x5611d729b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.269+0000 7ff57fb7b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611d71a1550 0x5611d729b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60696/0 (socket says 172.21.15.146:60696) 2024-09-18T01:45:26.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.269+0000 7ff57fb7b640 1 -- 172.21.15.146:0/420746780 learned_addr learned my addr 172.21.15.146:0/420746780 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:26.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.270+0000 7ff57fb7b640 1 -- 172.21.15.146:0/420746780 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611d704ffe0 con 0x5611d71a1550 2024-09-18T01:45:26.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.270+0000 7ff57fb7b640 1 --2- 172.21.15.146:0/420746780 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611d71a1550 0x5611d729b2d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff570047cf0 tx=0x7ff570002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.270+0000 7ff467fff640 1 -- 172.21.15.146:0/420746780 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff570008650 con 0x5611d71a1550 2024-09-18T01:45:26.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.270+0000 7ff467fff640 1 -- 172.21.15.146:0/420746780 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff570008ad0 con 0x5611d71a1550 2024-09-18T01:45:26.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.270+0000 7ff582087800 1 -- 172.21.15.146:0/420746780 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5611d729b810 con 0x5611d71a1550 2024-09-18T01:45:26.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.270+0000 7ff467fff640 1 -- 172.21.15.146:0/420746780 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff570051470 con 0x5611d71a1550 2024-09-18T01:45:26.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.270+0000 7ff582087800 1 -- 172.21.15.146:0/420746780 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611d729bd90 con 0x5611d71a1550 2024-09-18T01:45:26.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.271+0000 7ff467fff640 1 -- 172.21.15.146:0/420746780 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff570059070 con 0x5611d71a1550 2024-09-18T01:45:26.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.271+0000 7ff467fff640 1 --2- 172.21.15.146:0/420746780 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff468036b40 0x7ff468039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.271+0000 7ff467fff640 1 -- 172.21.15.146:0/420746780 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7ff570062070 con 0x5611d71a1550 2024-09-18T01:45:26.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.271+0000 7ff57f37a640 1 --2- 172.21.15.146:0/420746780 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff468036b40 0x7ff468039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.271+0000 7ff582087800 1 --2- 172.21.15.146:0/420746780 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5611d71a1e90 0x5611d72a2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.271+0000 7ff582087800 1 -- 172.21.15.146:0/420746780 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5611d72a2910 con 0x5611d71a1e90 2024-09-18T01:45:26.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.271+0000 7ff58037c640 1 --2- 172.21.15.146:0/420746780 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5611d71a1e90 0x5611d72a2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.271+0000 7ff57f37a640 1 --2- 172.21.15.146:0/420746780 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff468036b40 0x7ff468039000 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff574000f60 tx=0x7ff5740012b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.271+0000 7ff58037c640 1 --2- 172.21.15.146:0/420746780 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5611d71a1e90 0x5611d72a2340 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.272+0000 7ff58037c640 1 -- 172.21.15.146:0/420746780 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff57800a4a0 con 0x5611d71a1e90 2024-09-18T01:45:26.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.272+0000 7ff582087800 1 -- 172.21.15.146:0/420746780 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5611d729f910 con 0x5611d71a1e90 2024-09-18T01:45:26.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.272+0000 7ff58037c640 1 -- 172.21.15.146:0/420746780 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff57800a4a0 con 0x5611d71a1e90 2024-09-18T01:45:26.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.272+0000 7ff582087800 1 -- 172.21.15.146:0/420746780 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5611d72a4750 con 0x5611d71a1e90 2024-09-18T01:45:26.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.272+0000 7ff58037c640 1 -- 172.21.15.146:0/420746780 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff57800a4a0 con 0x5611d71a1e90 2024-09-18T01:45:26.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.272+0000 7ff582087800 1 -- 172.21.15.146:0/420746780 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5611d72a37d0 con 0x5611d71a1e90 2024-09-18T01:45:26.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.273+0000 7ff58037c640 1 -- 172.21.15.146:0/420746780 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff57800a4a0 con 0x5611d71a1e90 2024-09-18T01:45:26.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.273+0000 7ff582087800 1 --2- 172.21.15.146:0/420746780 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5611d72a42a0 0x5611d72a7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.273+0000 7ff582087800 1 -- 172.21.15.146:0/420746780 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5611d72a8280 con 0x5611d72a42a0 2024-09-18T01:45:26.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.273+0000 7ff57fb7b640 1 --2- 172.21.15.146:0/420746780 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5611d72a42a0 0x5611d72a7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.273+0000 7ff57fb7b640 1 --2- 172.21.15.146:0/420746780 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5611d72a42a0 0x5611d72a7b10 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.273+0000 7ff57fb7b640 1 -- 172.21.15.146:0/420746780 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff570076020 con 0x5611d72a42a0 2024-09-18T01:45:26.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.273+0000 7ff582087800 1 Processor -- start 2024-09-18T01:45:26.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.274+0000 7ff582087800 1 -- start start 2024-09-18T01:45:26.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.274+0000 7ff582087800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611d72b5fd0 0x5611d72b63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.274+0000 7ff582087800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5611d703d580 con 0x5611d72b5fd0 2024-09-18T01:45:26.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.274+0000 7ff58037c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611d72b5fd0 0x5611d72b63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.274+0000 7ff58037c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611d72b5fd0 0x5611d72b63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60706/0 (socket says 172.21.15.146:60706) 2024-09-18T01:45:26.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.274+0000 7ff58037c640 1 -- 172.21.15.146:0/3942265867 learned_addr learned my addr 172.21.15.146:0/3942265867 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:26.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.274+0000 7ff58037c640 1 -- 172.21.15.146:0/3942265867 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611d72b6930 con 0x5611d72b5fd0 2024-09-18T01:45:26.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.274+0000 7ff58037c640 1 --2- 172.21.15.146:0/3942265867 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611d72b5fd0 0x5611d72b63f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x5611d72a2d10 tx=0x7ff5780178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.274+0000 7ff4657fa640 1 -- 172.21.15.146:0/3942265867 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff578013440 con 0x5611d72b5fd0 2024-09-18T01:45:26.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.274+0000 7ff4657fa640 1 -- 172.21.15.146:0/3942265867 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5780135e0 con 0x5611d72b5fd0 2024-09-18T01:45:26.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.274+0000 7ff582087800 1 -- 172.21.15.146:0/3942265867 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5611d72b6bc0 con 0x5611d72b5fd0 2024-09-18T01:45:26.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.274+0000 7ff4657fa640 1 -- 172.21.15.146:0/3942265867 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5780138c0 con 0x5611d72b5fd0 2024-09-18T01:45:26.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.275+0000 7ff582087800 1 -- 172.21.15.146:0/3942265867 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611d72b98a0 con 0x5611d72b5fd0 2024-09-18T01:45:26.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.275+0000 7ff4657fa640 1 -- 172.21.15.146:0/3942265867 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff578011040 con 0x5611d72b5fd0 2024-09-18T01:45:26.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.275+0000 7ff4657fa640 1 --2- 172.21.15.146:0/3942265867 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff458036b40 0x7ff458039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.275+0000 7ff4657fa640 1 -- 172.21.15.146:0/3942265867 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7ff57801d070 con 0x5611d72b5fd0 2024-09-18T01:45:26.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.275+0000 7ff57fb7b640 1 --2- 172.21.15.146:0/3942265867 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff458036b40 0x7ff458039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.276+0000 7ff582087800 1 Processor -- start 2024-09-18T01:45:26.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.276+0000 7ff582087800 1 -- start start 2024-09-18T01:45:26.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.276+0000 7ff57fb7b640 1 --2- 172.21.15.146:0/3942265867 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff458036b40 0x7ff458039000 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff57008ee50 tx=0x7ff570008ca0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.276+0000 7ff582087800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611d72c2ca0 0x5611d72c30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.276+0000 7ff582087800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5611d728fd80 con 0x5611d72c2ca0 2024-09-18T01:45:26.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.276+0000 7ff58037c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611d72c2ca0 0x5611d72c30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.276+0000 7ff58037c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611d72c2ca0 0x5611d72c30a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60710/0 (socket says 172.21.15.146:60710) 2024-09-18T01:45:26.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.276+0000 7ff58037c640 1 -- 172.21.15.146:0/1811922655 learned_addr learned my addr 172.21.15.146:0/1811922655 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:26.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.276+0000 7ff58037c640 1 -- 172.21.15.146:0/1811922655 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611d72c3670 con 0x5611d72c2ca0 2024-09-18T01:45:26.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.276+0000 7ff58037c640 1 --2- 172.21.15.146:0/1811922655 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611d72c2ca0 0x5611d72c30a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff57804c8f0 tx=0x7ff57804caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=935c20e0bd7706bd server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.277+0000 7ff45effd640 1 -- 172.21.15.146:0/1811922655 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff578045070 con 0x5611d72c2ca0 2024-09-18T01:45:26.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.277+0000 7ff45effd640 1 -- 172.21.15.146:0/1811922655 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff578015560 con 0x5611d72c2ca0 2024-09-18T01:45:26.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.277+0000 7ff45effd640 1 -- 172.21.15.146:0/1811922655 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff57802ad80 con 0x5611d72c2ca0 2024-09-18T01:45:26.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.277+0000 7ff582087800 1 -- 172.21.15.146:0/1811922655 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611d72c2ca0 msgr2=0x5611d72c30a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.277+0000 7ff582087800 1 --2- 172.21.15.146:0/1811922655 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611d72c2ca0 0x5611d72c30a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff57804c8f0 tx=0x7ff57804caf0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.277+0000 7ff582087800 1 -- 172.21.15.146:0/1811922655 shutdown_connections 2024-09-18T01:45:26.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.277+0000 7ff582087800 1 --2- 172.21.15.146:0/1811922655 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611d72c2ca0 0x5611d72c30a0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.277+0000 7ff582087800 1 -- 172.21.15.146:0/1811922655 >> 172.21.15.146:0/1811922655 conn(0x5611d72bf000 msgr2=0x5611d72bd100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:26.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.277+0000 7ff582087800 1 -- 172.21.15.146:0/1811922655 shutdown_connections 2024-09-18T01:45:26.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.277+0000 7ff582087800 1 -- 172.21.15.146:0/1811922655 wait complete. 2024-09-18T01:45:26.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.277+0000 7ff582087800 1 Processor -- start 2024-09-18T01:45:26.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.277+0000 7ff582087800 1 -- start start 2024-09-18T01:45:26.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.278+0000 7ff582087800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611d72c2ca0 0x5611d72ca1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.278+0000 7ff582087800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5611d72c3ce0 con 0x5611d72c2ca0 2024-09-18T01:45:26.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.278+0000 7ff58037c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611d72c2ca0 0x5611d72ca1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.278+0000 7ff58037c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611d72c2ca0 0x5611d72ca1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60718/0 (socket says 172.21.15.146:60718) 2024-09-18T01:45:26.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.278+0000 7ff58037c640 1 -- 172.21.15.146:0/407324392 learned_addr learned my addr 172.21.15.146:0/407324392 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:26.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.278+0000 7ff58037c640 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611d72ca6e0 con 0x5611d72c2ca0 2024-09-18T01:45:26.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.278+0000 7ff58037c640 1 --2- 172.21.15.146:0/407324392 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611d72c2ca0 0x5611d72ca1a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff57804c850 tx=0x7ff57804c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.278+0000 7ff45d7fa640 1 -- 172.21.15.146:0/407324392 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff578045040 con 0x5611d72c2ca0 2024-09-18T01:45:26.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.278+0000 7ff45d7fa640 1 -- 172.21.15.146:0/407324392 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff57804e070 con 0x5611d72c2ca0 2024-09-18T01:45:26.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.278+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5611d72ca970 con 0x5611d72c2ca0 2024-09-18T01:45:26.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.278+0000 7ff45d7fa640 1 -- 172.21.15.146:0/407324392 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff57804e350 con 0x5611d72c2ca0 2024-09-18T01:45:26.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.278+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611d72cd620 con 0x5611d72c2ca0 2024-09-18T01:45:26.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.279+0000 7ff45d7fa640 1 -- 172.21.15.146:0/407324392 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff57803d060 con 0x5611d72c2ca0 2024-09-18T01:45:26.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.279+0000 7ff45d7fa640 1 --2- 172.21.15.146:0/407324392 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff448036b40 0x7ff448039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.279+0000 7ff45d7fa640 1 -- 172.21.15.146:0/407324392 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7ff57800e040 con 0x5611d72c2ca0 2024-09-18T01:45:26.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.279+0000 7ff57fb7b640 1 --2- 172.21.15.146:0/407324392 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff448036b40 0x7ff448039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.280+0000 7ff57fb7b640 1 --2- 172.21.15.146:0/407324392 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff448036b40 0x7ff448039000 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x5611d72a8660 tx=0x7ff570083000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.280+0000 7ff582087800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.280+0000 7ff582087800 1 --2- 172.21.15.146:0/407324392 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5611d72d5e00 0x5611d72d82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.280+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5611d72d8a10 con 0x5611d72d5e00 2024-09-18T01:45:26.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.280+0000 7ff57f37a640 1 --2- 172.21.15.146:0/407324392 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5611d72d5e00 0x5611d72d82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.280+0000 7ff57f37a640 1 --2- 172.21.15.146:0/407324392 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5611d72d5e00 0x5611d72d82c0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.280+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff574009050 con 0x5611d72d5e00 2024-09-18T01:45:26.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.280+0000 7ff582087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:26.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.280+0000 7ff582087800 20 realm 2024-09-18T01:45:26.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.280+0000 7ff582087800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.280+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5611d72d5250 con 0x5611d72d5e00 2024-09-18T01:45:26.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.281+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff574009050 con 0x5611d72d5e00 2024-09-18T01:45:26.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.281+0000 7ff582087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:26.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.281+0000 7ff582087800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:26.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.281+0000 7ff582087800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.281+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5611d72d94f0 con 0x5611d72d5e00 2024-09-18T01:45:26.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.281+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff574009050 con 0x5611d72d5e00 2024-09-18T01:45:26.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.281+0000 7ff582087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:26.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.281+0000 7ff582087800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.281+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5611d72d9dc0 con 0x5611d72d5e00 2024-09-18T01:45:26.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.281+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff574009050 con 0x5611d72d5e00 2024-09-18T01:45:26.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.281+0000 7ff582087800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:26.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.281+0000 7ff582087800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.281+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5611d72da160 con 0x5611d72d5e00 2024-09-18T01:45:26.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.281+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff574009050 con 0x5611d72d5e00 2024-09-18T01:45:26.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.281+0000 7ff582087800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:26.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.281+0000 7ff582087800 20 searching for the correct realm 2024-09-18T01:45:26.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.281+0000 7ff582087800 1 --2- 172.21.15.146:0/407324392 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5611d72dc040 0x5611d72de430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.281+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5611d72deae0 con 0x5611d72dc040 2024-09-18T01:45:26.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.281+0000 7ff58037c640 1 --2- 172.21.15.146:0/407324392 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5611d72dc040 0x5611d72de430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.282+0000 7ff58037c640 1 --2- 172.21.15.146:0/407324392 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5611d72dc040 0x5611d72de430 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.282+0000 7ff58037c640 1 -- 172.21.15.146:0/407324392 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff578029070 con 0x5611d72dc040 2024-09-18T01:45:26.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.282+0000 7ff58037c640 1 --2- 172.21.15.146:0/407324392 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7ff578022420 0x7ff578005070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.282+0000 7ff58037c640 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5611d72deae0 con 0x7ff578022420 2024-09-18T01:45:26.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.282+0000 7ff57fb7b640 1 --2- 172.21.15.146:0/407324392 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7ff578022420 0x7ff578005070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.282+0000 7ff57fb7b640 1 --2- 172.21.15.146:0/407324392 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7ff578022420 0x7ff578005070 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.283+0000 7ff57fb7b640 1 -- 172.21.15.146:0/407324392 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff57009b070 con 0x7ff578022420 2024-09-18T01:45:26.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.283+0000 7ff57fb7b640 1 --2- 172.21.15.146:0/407324392 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7ff57005b070 0x7ff57006f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.283+0000 7ff57fb7b640 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5611d72deae0 con 0x7ff57005b070 2024-09-18T01:45:26.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.283+0000 7ff57f37a640 1 --2- 172.21.15.146:0/407324392 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7ff57005b070 0x7ff57006f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.283+0000 7ff57f37a640 1 --2- 172.21.15.146:0/407324392 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7ff57005b070 0x7ff57006f3e0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.283+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff574009050 con 0x7ff57005b070 2024-09-18T01:45:26.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.283+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5611d72deae0 con 0x5611d72d5e00 2024-09-18T01:45:26.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.284+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff574009050 con 0x5611d72d5e00 2024-09-18T01:45:26.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.284+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5611d72deae0 con 0x5611d72d5e00 2024-09-18T01:45:26.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.284+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff57402a040 con 0x5611d72d5e00 2024-09-18T01:45:26.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.284+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5611d72deae0 con 0x7ff57005b070 2024-09-18T01:45:26.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.284+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff57402a040 con 0x7ff57005b070 2024-09-18T01:45:26.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.284+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5611d72deae0 con 0x7ff57005b070 2024-09-18T01:45:26.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.284+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff57402a040 con 0x7ff57005b070 2024-09-18T01:45:26.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.284+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5611d72deae0 con 0x7ff578022420 2024-09-18T01:45:26.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.284+0000 7ff57fb7b640 1 -- 172.21.15.146:0/407324392 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff57009b070 con 0x7ff578022420 2024-09-18T01:45:26.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.285+0000 7ff57fb7b640 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5611d72deae0 con 0x5611d72dc040 2024-09-18T01:45:26.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.285+0000 7ff58037c640 1 -- 172.21.15.146:0/407324392 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff578029070 con 0x5611d72dc040 2024-09-18T01:45:26.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.285+0000 7ff58037c640 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5611d72deae0 con 0x5611d72d5e00 2024-09-18T01:45:26.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.285+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff57402a040 con 0x5611d72d5e00 2024-09-18T01:45:26.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.285+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5611d72deae0 con 0x7ff57005b070 2024-09-18T01:45:26.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.285+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff57402a040 con 0x7ff57005b070 2024-09-18T01:45:26.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.285+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5611d72deae0 con 0x5611d72d5e00 2024-09-18T01:45:26.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.285+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff57402a040 con 0x5611d72d5e00 2024-09-18T01:45:26.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.285+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5611d72deae0 con 0x7ff578022420 2024-09-18T01:45:26.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.286+0000 7ff57fb7b640 1 -- 172.21.15.146:0/407324392 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7ff57009b070 con 0x7ff578022420 2024-09-18T01:45:26.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.286+0000 7ff57fb7b640 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff5700aa0a0 con 0x5611d72dc040 2024-09-18T01:45:26.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.286+0000 7ff58037c640 1 -- 172.21.15.146:0/407324392 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff578029070 con 0x5611d72dc040 2024-09-18T01:45:26.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.286+0000 7ff58037c640 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff5700aa0a0 con 0x5611d72dc040 2024-09-18T01:45:26.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.286+0000 7ff58037c640 1 -- 172.21.15.146:0/407324392 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff578029070 con 0x5611d72dc040 2024-09-18T01:45:26.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.286+0000 7ff58037c640 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff5700aa0a0 con 0x7ff57005b070 2024-09-18T01:45:26.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.286+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff57402a040 con 0x7ff57005b070 2024-09-18T01:45:26.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.286+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff5700aa0a0 con 0x5611d72dc040 2024-09-18T01:45:26.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.287+0000 7ff58037c640 1 -- 172.21.15.146:0/407324392 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff578029070 con 0x5611d72dc040 2024-09-18T01:45:26.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.287+0000 7ff58037c640 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff5700aa0a0 con 0x5611d72dc040 2024-09-18T01:45:26.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.287+0000 7ff58037c640 1 -- 172.21.15.146:0/407324392 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff578029070 con 0x5611d72dc040 2024-09-18T01:45:26.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.287+0000 7ff58037c640 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff5700aa0a0 con 0x5611d72d5e00 2024-09-18T01:45:26.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.287+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff57402a040 con 0x5611d72d5e00 2024-09-18T01:45:26.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.287+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff5700aa0a0 con 0x5611d72d5e00 2024-09-18T01:45:26.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.287+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff57402a040 con 0x5611d72d5e00 2024-09-18T01:45:26.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.287+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff5700aa0a0 con 0x7ff57005b070 2024-09-18T01:45:26.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.287+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff57402a040 con 0x7ff57005b070 2024-09-18T01:45:26.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.287+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff5700aa0a0 con 0x5611d72dc040 2024-09-18T01:45:26.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.288+0000 7ff58037c640 1 -- 172.21.15.146:0/407324392 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff578029070 con 0x5611d72dc040 2024-09-18T01:45:26.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.288+0000 7ff58037c640 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff5700aa0a0 con 0x7ff578022420 2024-09-18T01:45:26.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.288+0000 7ff57fb7b640 1 -- 172.21.15.146:0/407324392 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff57009b070 con 0x7ff578022420 2024-09-18T01:45:26.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.288+0000 7ff57fb7b640 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff5700aa0a0 con 0x5611d72d5e00 2024-09-18T01:45:26.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.288+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff57402a040 con 0x5611d72d5e00 2024-09-18T01:45:26.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.288+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff5700aa0a0 con 0x7ff57005b070 2024-09-18T01:45:26.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.288+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff57402a040 con 0x7ff57005b070 2024-09-18T01:45:26.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.288+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff5700aa0a0 con 0x5611d72dc040 2024-09-18T01:45:26.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.289+0000 7ff58037c640 1 -- 172.21.15.146:0/407324392 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff578029070 con 0x5611d72dc040 2024-09-18T01:45:26.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.289+0000 7ff58037c640 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff5700aa0a0 con 0x7ff57005b070 2024-09-18T01:45:26.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.289+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff57402a040 con 0x7ff57005b070 2024-09-18T01:45:26.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.289+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff5700aa0a0 con 0x7ff578022420 2024-09-18T01:45:26.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.289+0000 7ff57fb7b640 1 -- 172.21.15.146:0/407324392 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff57009b070 con 0x7ff578022420 2024-09-18T01:45:26.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.289+0000 7ff57fb7b640 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff5700aa0a0 con 0x5611d72dc040 2024-09-18T01:45:26.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.289+0000 7ff58037c640 1 -- 172.21.15.146:0/407324392 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff578029070 con 0x5611d72dc040 2024-09-18T01:45:26.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.289+0000 7ff58037c640 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff5700aa0a0 con 0x7ff57005b070 2024-09-18T01:45:26.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.289+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff57402a040 con 0x7ff57005b070 2024-09-18T01:45:26.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.290+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff5700aa0a0 con 0x5611d72d5e00 2024-09-18T01:45:26.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.290+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff57402a040 con 0x5611d72d5e00 2024-09-18T01:45:26.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.290+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff5700aa0a0 con 0x7ff578022420 2024-09-18T01:45:26.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.290+0000 7ff57fb7b640 1 -- 172.21.15.146:0/407324392 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff57009b070 con 0x7ff578022420 2024-09-18T01:45:26.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.290+0000 7ff582087800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:26.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.290+0000 7ff582087800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:26.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.290+0000 7ff582087800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:26.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.290+0000 7ff582087800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:26.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.290+0000 7ff582087800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:26.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.290+0000 7ff582087800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:26.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.290+0000 7ff582087800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.290+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5611d72daae0 con 0x5611d72d5e00 2024-09-18T01:45:26.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.290+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff57402a040 con 0x5611d72d5e00 2024-09-18T01:45:26.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.290+0000 7ff582087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:26.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.290+0000 7ff582087800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.290+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5611d72db380 con 0x5611d72d5e00 2024-09-18T01:45:26.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.290+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff57402a040 con 0x5611d72d5e00 2024-09-18T01:45:26.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.290+0000 7ff582087800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:26.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.290+0000 7ff582087800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.290+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5611d72da720 con 0x7ff578022420 2024-09-18T01:45:26.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.291+0000 7ff57fb7b640 1 -- 172.21.15.146:0/407324392 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff57009b070 con 0x7ff578022420 2024-09-18T01:45:26.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.291+0000 7ff582087800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:26.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.291+0000 7ff582087800 20 zone default found 2024-09-18T01:45:26.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.291+0000 7ff582087800 4 Realm: () 2024-09-18T01:45:26.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.291+0000 7ff582087800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:26.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.291+0000 7ff582087800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:26.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.291+0000 7ff582087800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:26.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.291+0000 7ff582087800 20 zonegroup default 2024-09-18T01:45:26.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.291+0000 7ff582087800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.291+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5611d72df3f0 con 0x7ff57005b070 2024-09-18T01:45:26.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.291+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff57402a040 con 0x7ff57005b070 2024-09-18T01:45:26.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.291+0000 7ff582087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:26.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.291+0000 7ff582087800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.291+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5611d72e0ec0 con 0x5611d72dc040 2024-09-18T01:45:26.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.291+0000 7ff58037c640 1 -- 172.21.15.146:0/407324392 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff578029070 con 0x5611d72dc040 2024-09-18T01:45:26.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.291+0000 7ff582087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:26.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.291+0000 7ff582087800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.291+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5611d72e13e0 con 0x5611d72dc040 2024-09-18T01:45:26.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.292+0000 7ff58037c640 1 -- 172.21.15.146:0/407324392 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff578029070 con 0x5611d72dc040 2024-09-18T01:45:26.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.292+0000 7ff582087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:26.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.292+0000 7ff582087800 20 started sync module instance, tier type = 2024-09-18T01:45:26.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.292+0000 7ff582087800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:26.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.292+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5611d72e09f0 con 0x7ff578022420 2024-09-18T01:45:26.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.293+0000 7ff57fb7b640 1 -- 172.21.15.146:0/407324392 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v31'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff57009b070 con 0x7ff578022420 2024-09-18T01:45:26.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.293+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94634624548464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5611d72e1880 con 0x7ff578022420 2024-09-18T01:45:26.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.293+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5611d72e2310 con 0x5611d72d5e00 2024-09-18T01:45:26.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.294+0000 7ff57fb7b640 1 -- 172.21.15.146:0/407324392 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94634624548464] v31'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff57009b070 con 0x7ff578022420 2024-09-18T01:45:26.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.294+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v31'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff57402a040 con 0x5611d72d5e00 2024-09-18T01:45:26.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.294+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94634624556512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5611d72e2700 con 0x5611d72d5e00 2024-09-18T01:45:26.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.294+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5611d72e3160 con 0x5611d72dc040 2024-09-18T01:45:26.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.295+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94634624556512] v31'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff57402a040 con 0x5611d72d5e00 2024-09-18T01:45:26.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.295+0000 7ff58037c640 1 -- 172.21.15.146:0/407324392 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v31'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff578029070 con 0x5611d72dc040 2024-09-18T01:45:26.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.295+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94634624549760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5611d72e3550 con 0x5611d72dc040 2024-09-18T01:45:26.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.295+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5611d72e3f90 con 0x7ff578022420 2024-09-18T01:45:26.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.296+0000 7ff58037c640 1 -- 172.21.15.146:0/407324392 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94634624549760] v31'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff578029070 con 0x5611d72dc040 2024-09-18T01:45:26.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.296+0000 7ff57fb7b640 1 -- 172.21.15.146:0/407324392 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v31'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff57009b070 con 0x7ff578022420 2024-09-18T01:45:26.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.296+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94634624563808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5611d72e4380 con 0x7ff578022420 2024-09-18T01:45:26.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.296+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5611d72e4da0 con 0x5611d72d5e00 2024-09-18T01:45:26.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.297+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v31'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff57402a040 con 0x5611d72d5e00 2024-09-18T01:45:26.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.297+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94634624567440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5611d72e4da0 con 0x5611d72d5e00 2024-09-18T01:45:26.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.297+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5611d72e5da0 con 0x7ff57005b070 2024-09-18T01:45:26.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.297+0000 7ff57fb7b640 1 -- 172.21.15.146:0/407324392 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94634624563808] v31'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff57009b070 con 0x7ff578022420 2024-09-18T01:45:26.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.298+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v31'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff57402a040 con 0x7ff57005b070 2024-09-18T01:45:26.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.298+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94634624571536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5611d72e5d60 con 0x7ff57005b070 2024-09-18T01:45:26.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.298+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5611d72e67b0 con 0x7ff57005b070 2024-09-18T01:45:26.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.298+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94634624567440] v31'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff57402a040 con 0x5611d72d5e00 2024-09-18T01:45:26.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.299+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(56 notify.6 [create] v31'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff57402a040 con 0x7ff57005b070 2024-09-18T01:45:26.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.299+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94634624571536] v31'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff57402a040 con 0x7ff57005b070 2024-09-18T01:45:26.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.299+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94634624569664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5611d72e67b0 con 0x7ff57005b070 2024-09-18T01:45:26.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.299+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5611d72e2c40 con 0x7ff57005b070 2024-09-18T01:45:26.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.300+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94634624569664] v31'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff57402a040 con 0x7ff57005b070 2024-09-18T01:45:26.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.300+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v31'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff57402a040 con 0x7ff57005b070 2024-09-18T01:45:26.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.300+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94634624574208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5611d72e6720 con 0x7ff57005b070 2024-09-18T01:45:26.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.300+0000 7ff582087800 20 add_watcher() i=0 2024-09-18T01:45:26.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.300+0000 7ff582087800 20 add_watcher() i=1 2024-09-18T01:45:26.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.300+0000 7ff582087800 20 add_watcher() i=2 2024-09-18T01:45:26.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.300+0000 7ff582087800 20 add_watcher() i=3 2024-09-18T01:45:26.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.300+0000 7ff582087800 20 add_watcher() i=4 2024-09-18T01:45:26.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.300+0000 7ff582087800 20 add_watcher() i=5 2024-09-18T01:45:26.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.300+0000 7ff582087800 20 add_watcher() i=6 2024-09-18T01:45:26.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.301+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94634624574208] v31'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff57402a040 con 0x7ff57005b070 2024-09-18T01:45:26.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.301+0000 7ff582087800 20 add_watcher() i=7 2024-09-18T01:45:26.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.301+0000 7ff582087800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:26.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.301+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5611d72ea1a0 con 0x5611d72d5e00 2024-09-18T01:45:26.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.301+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff57402a040 con 0x5611d72d5e00 2024-09-18T01:45:26.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.301+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94634624576704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5611d72e7590 con 0x5611d72d5e00 2024-09-18T01:45:26.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.302+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94634624576704] v31'104 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff57402a040 con 0x5611d72d5e00 2024-09-18T01:45:26.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.302+0000 7ff435fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:26.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.302+0000 7ff582087800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:26.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.302+0000 7ff582087800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:26.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.303+0000 7ff582087800 5 note: GC not initialized 2024-09-18T01:45:26.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.303+0000 7ff434fe1640 20 reqs_thread_entry: start 2024-09-18T01:45:26.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.303+0000 7ff582087800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:26.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.303+0000 7ff582087800 20 Filter name: none 2024-09-18T01:45:26.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.303+0000 7ff3ae7fc640 20 reqs_thread_entry: start 2024-09-18T01:45:26.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.303+0000 7ff582087800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.303+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5611d731cff0 con 0x5611d72d5e00 2024-09-18T01:45:26.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.303+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ff57402a040 con 0x5611d72d5e00 2024-09-18T01:45:26.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.303+0000 7ff582087800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:45:26.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.303+0000 7ff582087800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.304+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5611d731d9e0 con 0x5611d72d5e00 2024-09-18T01:45:26.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.304+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ff57402a040 con 0x5611d72d5e00 2024-09-18T01:45:26.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.304+0000 7ff582087800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:45:26.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.304+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5611d731e9f0 con 0x7ff578022420 2024-09-18T01:45:26.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.304+0000 7ff57fb7b640 1 -- 172.21.15.146:0/407324392 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7ff57009b070 con 0x7ff578022420 2024-09-18T01:45:26.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.304+0000 7ff582087800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.304+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:65 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5611d731c160 con 0x7ff578022420 2024-09-18T01:45:26.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.305+0000 7ff57fb7b640 1 -- 172.21.15.146:0/407324392 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(65 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7ff57009b070 con 0x7ff578022420 2024-09-18T01:45:26.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.305+0000 7ff582087800 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T01:45:26.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.305+0000 7ff582087800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.305+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:66 8.13 8:ceaa8859:root::.bucket.meta.myfoo%3a8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5611d731e9f0 con 0x7ff57005b070 2024-09-18T01:45:26.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.305+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(66 .bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7ff57402a040 con 0x7ff57005b070 2024-09-18T01:45:26.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.305+0000 7ff582087800 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T01:45:26.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.305+0000 7ff582087800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-18T01:45:26.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.305+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:67 4.33 4:cd49ce18:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5611d731e3f0 con 0x7ff57005b070 2024-09-18T01:45:26.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.305+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:68 4.10 4:083380d8:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5611d7323450 con 0x5611d72dc040 2024-09-18T01:45:26.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.305+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:69 4.15 4:a8d62d11:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5611d731e3f0 con 0x5611d72dc040 2024-09-18T01:45:26.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.305+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:70 4.36 4:6d8e27f1:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5611d73280c0 con 0x5611d72d5e00 2024-09-18T01:45:26.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.305+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:71 4.19 4:98d692f3:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5611d732aeb0 con 0x5611d72dc040 2024-09-18T01:45:26.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.305+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:72 4.13 4:cabe8116:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5611d732d9b0 con 0x7ff578022420 2024-09-18T01:45:26.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.305+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:73 4.16 4:6b798858:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5611d73303e0 con 0x5611d72dc040 2024-09-18T01:45:26.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.305+0000 7ff58037c640 1 -- 172.21.15.146:0/407324392 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(68 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff578029070 con 0x5611d72dc040 2024-09-18T01:45:26.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.306+0000 7ff58037c640 1 -- 172.21.15.146:0/407324392 <== osd.3 v2:172.21.15.146:6809/4106661138 15 ==== osd_op_reply(69 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff578029070 con 0x5611d72dc040 2024-09-18T01:45:26.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.306+0000 7ff58037c640 1 -- 172.21.15.146:0/407324392 <== osd.3 v2:172.21.15.146:6809/4106661138 16 ==== osd_op_reply(71 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff578029070 con 0x5611d72dc040 2024-09-18T01:45:26.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.306+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:74 4.14 4:2ab8464f:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5611d732a880 con 0x5611d72dc040 2024-09-18T01:45:26.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.306+0000 7ff57fb7b640 1 -- 172.21.15.146:0/407324392 <== osd.2 v2:172.21.15.146:6800/3820039304 14 ==== osd_op_reply(72 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff57009b070 con 0x7ff578022420 2024-09-18T01:45:26.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.306+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:75 4.3e 4:7ce77e2d:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5611d732d510 con 0x7ff578022420 2024-09-18T01:45:26.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.306+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:76 4.2d 4:b678784f:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5611d732cd30 con 0x7ff57005b070 2024-09-18T01:45:26.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.306+0000 7ff58037c640 1 -- 172.21.15.146:0/407324392 <== osd.3 v2:172.21.15.146:6809/4106661138 17 ==== osd_op_reply(73 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff578029070 con 0x5611d72dc040 2024-09-18T01:45:26.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.306+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:77 4.10 4:0ad5fa93:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5611d732de70 con 0x5611d72dc040 2024-09-18T01:45:26.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.306+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(67 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff57402a040 con 0x7ff57005b070 2024-09-18T01:45:26.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.306+0000 7ff58037c640 1 -- 172.21.15.146:0/407324392 <== osd.3 v2:172.21.15.146:6809/4106661138 18 ==== osd_op_reply(74 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff578029070 con 0x5611d72dc040 2024-09-18T01:45:26.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.306+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(70 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff57402a040 con 0x5611d72d5e00 2024-09-18T01:45:26.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.306+0000 7ff57fb7b640 1 -- 172.21.15.146:0/407324392 <== osd.2 v2:172.21.15.146:6800/3820039304 15 ==== osd_op_reply(75 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff57009b070 con 0x7ff578022420 2024-09-18T01:45:26.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.306+0000 7ff58037c640 1 -- 172.21.15.146:0/407324392 <== osd.3 v2:172.21.15.146:6809/4106661138 19 ==== osd_op_reply(77 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.10 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff578029070 con 0x5611d72dc040 2024-09-18T01:45:26.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.306+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(76 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff57402a040 con 0x7ff57005b070 2024-09-18T01:45:26.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.307+0000 7ff435fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:26.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.308+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94634624576704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5611d732cd30 con 0x5611d72d5e00 2024-09-18T01:45:26.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.309+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94634624576704] v31'105 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff57402a040 con 0x5611d72d5e00 2024-09-18T01:45:26.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.309+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94634624548464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5611d731ade0 con 0x7ff578022420 2024-09-18T01:45:26.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.310+0000 7ff57fb7b640 1 -- 172.21.15.146:0/407324392 <== osd.2 v2:172.21.15.146:6800/3820039304 16 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94634624548464] v31'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff57009b070 con 0x7ff578022420 2024-09-18T01:45:26.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.310+0000 7ff582087800 20 remove_watcher() i=0 2024-09-18T01:45:26.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.310+0000 7ff582087800 2 removed watcher, disabling cache 2024-09-18T01:45:26.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.310+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94634624556512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5611d731ade0 con 0x5611d72d5e00 2024-09-18T01:45:26.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.311+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94634624556512] v31'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff574047040 con 0x5611d72d5e00 2024-09-18T01:45:26.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.311+0000 7ff582087800 20 remove_watcher() i=1 2024-09-18T01:45:26.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.311+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94634624549760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5611d731ade0 con 0x5611d72dc040 2024-09-18T01:45:26.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.312+0000 7ff58037c640 1 -- 172.21.15.146:0/407324392 <== osd.3 v2:172.21.15.146:6809/4106661138 20 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94634624549760] v31'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff578029070 con 0x5611d72dc040 2024-09-18T01:45:26.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.312+0000 7ff582087800 20 remove_watcher() i=2 2024-09-18T01:45:26.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.312+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94634624563808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5611d731ade0 con 0x7ff578022420 2024-09-18T01:45:26.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.313+0000 7ff57fb7b640 1 -- 172.21.15.146:0/407324392 <== osd.2 v2:172.21.15.146:6800/3820039304 17 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94634624563808] v31'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff57009b070 con 0x7ff578022420 2024-09-18T01:45:26.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.313+0000 7ff582087800 20 remove_watcher() i=3 2024-09-18T01:45:26.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.313+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94634624567440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5611d731ade0 con 0x5611d72d5e00 2024-09-18T01:45:26.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.314+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94634624567440] v31'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff574047040 con 0x5611d72d5e00 2024-09-18T01:45:26.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.314+0000 7ff582087800 20 remove_watcher() i=4 2024-09-18T01:45:26.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.314+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94634624571536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5611d731ade0 con 0x7ff57005b070 2024-09-18T01:45:26.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.315+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94634624571536] v31'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff574047040 con 0x7ff57005b070 2024-09-18T01:45:26.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.315+0000 7ff582087800 20 remove_watcher() i=5 2024-09-18T01:45:26.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.315+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94634624569664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5611d731ade0 con 0x7ff57005b070 2024-09-18T01:45:26.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.315+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94634624569664] v31'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff574047040 con 0x7ff57005b070 2024-09-18T01:45:26.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.316+0000 7ff582087800 20 remove_watcher() i=6 2024-09-18T01:45:26.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.316+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94634624574208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5611d731ade0 con 0x7ff57005b070 2024-09-18T01:45:26.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.318+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 <== osd.0 v2:172.21.15.129:6800/1759265424 22 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94634624574208] v31'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff574047040 con 0x7ff57005b070 2024-09-18T01:45:26.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.318+0000 7ff582087800 20 remove_watcher() i=7 2024-09-18T01:45:26.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.318+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7ff57005b070 msgr2=0x7ff57006f3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.318+0000 7ff582087800 1 --2- 172.21.15.146:0/407324392 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7ff57005b070 0x7ff57006f3e0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.318+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5611d72d5e00 msgr2=0x5611d72d82c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.318+0000 7ff582087800 1 --2- 172.21.15.146:0/407324392 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5611d72d5e00 0x5611d72d82c0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.318+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7ff578022420 msgr2=0x7ff578005070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.318+0000 7ff582087800 1 --2- 172.21.15.146:0/407324392 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7ff578022420 0x7ff578005070 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.318+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5611d72dc040 msgr2=0x5611d72de430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.318+0000 7ff582087800 1 --2- 172.21.15.146:0/407324392 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5611d72dc040 0x5611d72de430 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.318+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff448036b40 msgr2=0x7ff448039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.318+0000 7ff582087800 1 --2- 172.21.15.146:0/407324392 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff448036b40 0x7ff448039000 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x5611d72a8660 tx=0x7ff570083000 comp rx=0 tx=0).stop 2024-09-18T01:45:26.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.318+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611d72c2ca0 msgr2=0x5611d72ca1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.318+0000 7ff57f37a640 1 -- 172.21.15.146:0/407324392 reap_dead start 2024-09-18T01:45:26.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.318+0000 7ff582087800 1 --2- 172.21.15.146:0/407324392 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611d72c2ca0 0x5611d72ca1a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff57804c850 tx=0x7ff57804c880 comp rx=0 tx=0).stop 2024-09-18T01:45:26.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.319+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 shutdown_connections 2024-09-18T01:45:26.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.319+0000 7ff582087800 1 --2- 172.21.15.146:0/407324392 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611d72c2ca0 0x5611d72ca1a0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.319+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 >> 172.21.15.146:0/407324392 conn(0x5611d72bf000 msgr2=0x5611d72bd0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:26.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.319+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 shutdown_connections 2024-09-18T01:45:26.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.319+0000 7ff582087800 1 -- 172.21.15.146:0/407324392 wait complete. 2024-09-18T01:45:26.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.319+0000 7ff582087800 1 -- 172.21.15.146:0/3942265867 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff458036b40 msgr2=0x7ff458039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.319+0000 7ff582087800 1 --2- 172.21.15.146:0/3942265867 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff458036b40 0x7ff458039000 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff57008ee50 tx=0x7ff570008ca0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.319+0000 7ff582087800 1 -- 172.21.15.146:0/3942265867 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611d72b5fd0 msgr2=0x5611d72b63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.319+0000 7ff582087800 1 --2- 172.21.15.146:0/3942265867 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611d72b5fd0 0x5611d72b63f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x5611d72a2d10 tx=0x7ff5780178e0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.319+0000 7ff582087800 1 -- 172.21.15.146:0/3942265867 shutdown_connections 2024-09-18T01:45:26.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.319+0000 7ff582087800 1 --2- 172.21.15.146:0/3942265867 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff458036b40 0x7ff458039000 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.319+0000 7ff582087800 1 --2- 172.21.15.146:0/3942265867 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611d72b5fd0 0x5611d72b63f0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.319+0000 7ff582087800 1 -- 172.21.15.146:0/3942265867 >> 172.21.15.146:0/3942265867 conn(0x5611d72aaf60 msgr2=0x5611d72adae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:26.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.319+0000 7ff582087800 1 -- 172.21.15.146:0/3942265867 shutdown_connections 2024-09-18T01:45:26.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.319+0000 7ff582087800 1 -- 172.21.15.146:0/3942265867 wait complete. 2024-09-18T01:45:26.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.319+0000 7ff582087800 1 -- 172.21.15.146:0/420746780 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5611d71a1e90 msgr2=0x5611d72a2340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.319+0000 7ff582087800 1 --2- 172.21.15.146:0/420746780 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5611d71a1e90 0x5611d72a2340 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.319+0000 7ff582087800 1 -- 172.21.15.146:0/420746780 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5611d72a42a0 msgr2=0x5611d72a7b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.319+0000 7ff582087800 1 --2- 172.21.15.146:0/420746780 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5611d72a42a0 0x5611d72a7b10 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.319+0000 7ff582087800 1 -- 172.21.15.146:0/420746780 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff468036b40 msgr2=0x7ff468039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.319+0000 7ff582087800 1 --2- 172.21.15.146:0/420746780 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff468036b40 0x7ff468039000 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff574000f60 tx=0x7ff5740012b0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.319+0000 7ff582087800 1 -- 172.21.15.146:0/420746780 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611d71a1550 msgr2=0x5611d729b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.319+0000 7ff582087800 1 --2- 172.21.15.146:0/420746780 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611d71a1550 0x5611d729b2d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff570047cf0 tx=0x7ff570002fb0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.319+0000 7ff582087800 1 -- 172.21.15.146:0/420746780 shutdown_connections 2024-09-18T01:45:26.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.319+0000 7ff582087800 1 --2- 172.21.15.146:0/420746780 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5611d72a42a0 0x5611d72a7b10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.319+0000 7ff582087800 1 --2- 172.21.15.146:0/420746780 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5611d71a1e90 0x5611d72a2340 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.319+0000 7ff582087800 1 --2- 172.21.15.146:0/420746780 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff468036b40 0x7ff468039000 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.319+0000 7ff582087800 1 --2- 172.21.15.146:0/420746780 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5611d71a1550 0x5611d729b2d0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.320+0000 7ff582087800 1 -- 172.21.15.146:0/420746780 >> 172.21.15.146:0/420746780 conn(0x5611d719cde0 msgr2=0x5611d72898c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:26.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.320+0000 7ff582087800 1 -- 172.21.15.146:0/420746780 shutdown_connections 2024-09-18T01:45:26.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.320+0000 7ff582087800 1 -- 172.21.15.146:0/420746780 wait complete. 2024-09-18T01:45:26.334 INFO:teuthology.orchestra.run.smithi146.stdout:[{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"069822df-7f2c-4cd0-aee2-64a07ebf49c5","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1","marker":"8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-18T01:45:25.647023Z","creation_time":"2024-09-18T01:45:25.639613Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}}] 2024-09-18T01:45:26.334 DEBUG:tasks.util.rgw: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '069822df-7f2c-4cd0-aee2-64a07ebf49c5', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1', 'marker': '8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-18T01:45:25.647023Z', 'creation_time': '2024-09-18T01:45:25.639613Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-09-18T01:45:26.340 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-18T01:45:26.340 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-18T01:45:26.340 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-18T01:45:26.340 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-18T01:45:26.384 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:26.384 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:26.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.384+0000 7f728ba98800 1 Processor -- start 2024-09-18T01:45:26.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.384+0000 7f728ba98800 1 -- start start 2024-09-18T01:45:26.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.385+0000 7f728ba98800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55ed67e23990 0x55ed67e25d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.385+0000 7f728ba98800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ed67cdfb30 con 0x55ed67e1fbc0 2024-09-18T01:45:26.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.385+0000 7f728ba98800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x55ed67cc1360 con 0x55ed67e23990 2024-09-18T01:45:26.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.385+0000 7f7280d92640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55ed67e23990 0x55ed67e25d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.385+0000 7f7289593640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x55ed67e1fbc0 0x55ed67e1ffc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:38954/0 (socket says 172.21.15.146:38954) 2024-09-18T01:45:26.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.385+0000 7f7289593640 1 -- 172.21.15.146:0/3802944035 learned_addr learned my addr 172.21.15.146:0/3802944035 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:45:26.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.385+0000 7f7280d92640 1 -- 172.21.15.146:0/3802944035 >> v1:172.21.15.129:6789/0 conn(0x55ed67e1fbc0 legacy=0x55ed67e1ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.385+0000 7f7280d92640 1 -- 172.21.15.146:0/3802944035 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed67ce7e00 con 0x55ed67e23990 2024-09-18T01:45:26.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.387+0000 7f7280d92640 1 --2- 172.21.15.146:0/3802944035 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ed67e23990 0x55ed67e25d80 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f727400a470 tx=0x7f7274045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eaba652b3baee1b server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.387+0000 7f7288d92640 1 -- 172.21.15.146:0/3802944035 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7274053570 con 0x55ed67e23990 2024-09-18T01:45:26.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.387+0000 7f7288d92640 1 -- 172.21.15.146:0/3802944035 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7274058070 con 0x55ed67e23990 2024-09-18T01:45:26.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.387+0000 7f7288d92640 1 -- 172.21.15.146:0/3802944035 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7274053880 con 0x55ed67e23990 2024-09-18T01:45:26.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.388+0000 7f728ba98800 1 -- 172.21.15.146:0/3802944035 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ed67e23990 msgr2=0x55ed67e25d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.388+0000 7f728ba98800 1 --2- 172.21.15.146:0/3802944035 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ed67e23990 0x55ed67e25d80 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f727400a470 tx=0x7f7274045a20 comp rx=0 tx=0).stop 2024-09-18T01:45:26.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.388+0000 7f728ba98800 1 -- 172.21.15.146:0/3802944035 shutdown_connections 2024-09-18T01:45:26.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.388+0000 7f728ba98800 1 --2- 172.21.15.146:0/3802944035 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ed67e23990 0x55ed67e25d80 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.388+0000 7f728ba98800 1 -- 172.21.15.146:0/3802944035 >> 172.21.15.146:0/3802944035 conn(0x55ed67e1a5c0 msgr2=0x55ed67e1c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:26.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.388+0000 7f728ba98800 1 -- 172.21.15.146:0/3802944035 shutdown_connections 2024-09-18T01:45:26.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.388+0000 7f728ba98800 1 -- 172.21.15.146:0/3802944035 wait complete. 2024-09-18T01:45:26.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.401+0000 7f728ba98800 1 Processor -- start 2024-09-18T01:45:26.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.401+0000 7f728ba98800 1 -- start start 2024-09-18T01:45:26.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.401+0000 7f728ba98800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ed67e1fbc0 0x55ed67e1f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.401+0000 7f728ba98800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55ed67d6c330 con 0x55ed67e1fbc0 2024-09-18T01:45:26.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.402+0000 7f7289593640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ed67e1fbc0 0x55ed67e1f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.402+0000 7f7289593640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ed67e1fbc0 0x55ed67e1f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60742/0 (socket says 172.21.15.146:60742) 2024-09-18T01:45:26.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.402+0000 7f7289593640 1 -- 172.21.15.146:0/740117525 learned_addr learned my addr 172.21.15.146:0/740117525 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:26.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.402+0000 7f7289593640 1 -- 172.21.15.146:0/740117525 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed67cb9bc0 con 0x55ed67e1fbc0 2024-09-18T01:45:26.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.402+0000 7f7289593640 1 --2- 172.21.15.146:0/740117525 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ed67e1fbc0 0x55ed67e1f350 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f727c001d80 tx=0x7f727c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11970905df47016e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.402+0000 7f7177606640 1 -- 172.21.15.146:0/740117525 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f727c013030 con 0x55ed67e1fbc0 2024-09-18T01:45:26.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.402+0000 7f7177606640 1 -- 172.21.15.146:0/740117525 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f727c00e470 con 0x55ed67e1fbc0 2024-09-18T01:45:26.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.402+0000 7f7177606640 1 -- 172.21.15.146:0/740117525 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f727c00e810 con 0x55ed67e1fbc0 2024-09-18T01:45:26.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.403+0000 7f728ba98800 1 -- 172.21.15.146:0/740117525 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ed67e1fbc0 msgr2=0x55ed67e1f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.403+0000 7f728ba98800 1 --2- 172.21.15.146:0/740117525 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ed67e1fbc0 0x55ed67e1f350 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f727c001d80 tx=0x7f727c001e70 comp rx=0 tx=0).stop 2024-09-18T01:45:26.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.403+0000 7f728ba98800 1 -- 172.21.15.146:0/740117525 shutdown_connections 2024-09-18T01:45:26.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.403+0000 7f728ba98800 1 --2- 172.21.15.146:0/740117525 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ed67e1fbc0 0x55ed67e1f350 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.403+0000 7f728ba98800 1 -- 172.21.15.146:0/740117525 >> 172.21.15.146:0/740117525 conn(0x55ed67e1a5c0 msgr2=0x55ed67f0a100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:26.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.403+0000 7f728ba98800 1 -- 172.21.15.146:0/740117525 shutdown_connections 2024-09-18T01:45:26.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.403+0000 7f728ba98800 1 -- 172.21.15.146:0/740117525 wait complete. 2024-09-18T01:45:26.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.403+0000 7f728ba98800 1 Processor -- start 2024-09-18T01:45:26.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.403+0000 7f728ba98800 1 -- start start 2024-09-18T01:45:26.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.404+0000 7f728ba98800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ed67e1fbc0 0x55ed67f19460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.404+0000 7f728ba98800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55ed67e265c0 con 0x55ed67e1fbc0 2024-09-18T01:45:26.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.404+0000 7f7289593640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ed67e1fbc0 0x55ed67f19460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.404+0000 7f7289593640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ed67e1fbc0 0x55ed67f19460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60748/0 (socket says 172.21.15.146:60748) 2024-09-18T01:45:26.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.404+0000 7f7289593640 1 -- 172.21.15.146:0/2398624081 learned_addr learned my addr 172.21.15.146:0/2398624081 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:26.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.404+0000 7f7289593640 1 -- 172.21.15.146:0/2398624081 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed67ccdfe0 con 0x55ed67e1fbc0 2024-09-18T01:45:26.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.404+0000 7f7289593640 1 --2- 172.21.15.146:0/2398624081 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ed67e1fbc0 0x55ed67f19460 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f727c004000 tx=0x7f727c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.404+0000 7f7175e03640 1 -- 172.21.15.146:0/2398624081 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f727c027070 con 0x55ed67e1fbc0 2024-09-18T01:45:26.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.404+0000 7f7175e03640 1 -- 172.21.15.146:0/2398624081 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f727c019900 con 0x55ed67e1fbc0 2024-09-18T01:45:26.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.404+0000 7f728ba98800 1 -- 172.21.15.146:0/2398624081 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ed67f199a0 con 0x55ed67e1fbc0 2024-09-18T01:45:26.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.404+0000 7f7175e03640 1 -- 172.21.15.146:0/2398624081 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f727c019c60 con 0x55ed67e1fbc0 2024-09-18T01:45:26.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.404+0000 7f728ba98800 1 -- 172.21.15.146:0/2398624081 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed67f19ec0 con 0x55ed67e1fbc0 2024-09-18T01:45:26.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.405+0000 7f7175e03640 1 -- 172.21.15.146:0/2398624081 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f727c02a070 con 0x55ed67e1fbc0 2024-09-18T01:45:26.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.405+0000 7f7175e03640 1 --2- 172.21.15.146:0/2398624081 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7170036b40 0x7f7170039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.405+0000 7f7175e03640 1 -- 172.21.15.146:0/2398624081 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f727c01f070 con 0x55ed67e1fbc0 2024-09-18T01:45:26.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.405+0000 7f7280d92640 1 --2- 172.21.15.146:0/2398624081 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7170036b40 0x7f7170039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.405+0000 7f728ba98800 1 --2- 172.21.15.146:0/2398624081 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55ed67e23990 0x55ed67f204d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.405+0000 7f728ba98800 1 -- 172.21.15.146:0/2398624081 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ed67f20aa0 con 0x55ed67e23990 2024-09-18T01:45:26.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.406+0000 7f7289d94640 1 --2- 172.21.15.146:0/2398624081 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55ed67e23990 0x55ed67f204d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.406+0000 7f7280d92640 1 --2- 172.21.15.146:0/2398624081 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7170036b40 0x7f7170039000 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7274057000 tx=0x7f7274052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.406+0000 7f7289d94640 1 --2- 172.21.15.146:0/2398624081 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55ed67e23990 0x55ed67f204d0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.406+0000 7f7289d94640 1 -- 172.21.15.146:0/2398624081 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f728400a4a0 con 0x55ed67e23990 2024-09-18T01:45:26.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.406+0000 7f728ba98800 1 -- 172.21.15.146:0/2398624081 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ed67f1daa0 con 0x55ed67e23990 2024-09-18T01:45:26.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.406+0000 7f7289d94640 1 -- 172.21.15.146:0/2398624081 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f728400a4a0 con 0x55ed67e23990 2024-09-18T01:45:26.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.406+0000 7f728ba98800 1 -- 172.21.15.146:0/2398624081 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ed67f228a0 con 0x55ed67e23990 2024-09-18T01:45:26.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.407+0000 7f7289d94640 1 -- 172.21.15.146:0/2398624081 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f728400a4a0 con 0x55ed67e23990 2024-09-18T01:45:26.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.407+0000 7f728ba98800 1 -- 172.21.15.146:0/2398624081 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ed67f219e0 con 0x55ed67e23990 2024-09-18T01:45:26.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.407+0000 7f7289d94640 1 -- 172.21.15.146:0/2398624081 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f728400a4a0 con 0x55ed67e23990 2024-09-18T01:45:26.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.407+0000 7f728ba98800 1 --2- 172.21.15.146:0/2398624081 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55ed67f224b0 0x55ed67f25cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.407+0000 7f728ba98800 1 -- 172.21.15.146:0/2398624081 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ed67f26480 con 0x55ed67f224b0 2024-09-18T01:45:26.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.407+0000 7f7289593640 1 --2- 172.21.15.146:0/2398624081 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55ed67f224b0 0x55ed67f25cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.407+0000 7f7289593640 1 --2- 172.21.15.146:0/2398624081 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55ed67f224b0 0x55ed67f25cf0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.408+0000 7f7289593640 1 -- 172.21.15.146:0/2398624081 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f727c029030 con 0x55ed67f224b0 2024-09-18T01:45:26.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.408+0000 7f728ba98800 1 Processor -- start 2024-09-18T01:45:26.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.408+0000 7f728ba98800 1 -- start start 2024-09-18T01:45:26.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.408+0000 7f728ba98800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ed67f34210 0x55ed67f34630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.408+0000 7f728ba98800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55ed67cbb580 con 0x55ed67f34210 2024-09-18T01:45:26.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.409+0000 7f7289d94640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ed67f34210 0x55ed67f34630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.409+0000 7f7289d94640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ed67f34210 0x55ed67f34630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60764/0 (socket says 172.21.15.146:60764) 2024-09-18T01:45:26.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.409+0000 7f7289d94640 1 -- 172.21.15.146:0/461044657 learned_addr learned my addr 172.21.15.146:0/461044657 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:26.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.409+0000 7f7289d94640 1 -- 172.21.15.146:0/461044657 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed67f34b70 con 0x55ed67f34210 2024-09-18T01:45:26.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.409+0000 7f7289d94640 1 --2- 172.21.15.146:0/461044657 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ed67f34210 0x55ed67f34630 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x55ed67f20e60 tx=0x7f72840178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.409+0000 7f716effd640 1 -- 172.21.15.146:0/461044657 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7284013440 con 0x55ed67f34210 2024-09-18T01:45:26.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.409+0000 7f716effd640 1 -- 172.21.15.146:0/461044657 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72840135e0 con 0x55ed67f34210 2024-09-18T01:45:26.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.409+0000 7f728ba98800 1 -- 172.21.15.146:0/461044657 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ed67f34e00 con 0x55ed67f34210 2024-09-18T01:45:26.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.409+0000 7f716effd640 1 -- 172.21.15.146:0/461044657 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72840138c0 con 0x55ed67f34210 2024-09-18T01:45:26.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.409+0000 7f728ba98800 1 -- 172.21.15.146:0/461044657 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed67f37ae0 con 0x55ed67f34210 2024-09-18T01:45:26.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.410+0000 7f716effd640 1 -- 172.21.15.146:0/461044657 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7284011040 con 0x55ed67f34210 2024-09-18T01:45:26.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.410+0000 7f716effd640 1 --2- 172.21.15.146:0/461044657 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7160036b90 0x7f7160039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.410+0000 7f716effd640 1 -- 172.21.15.146:0/461044657 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f728401d070 con 0x55ed67f34210 2024-09-18T01:45:26.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.410+0000 7f7289593640 1 --2- 172.21.15.146:0/461044657 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7160036b90 0x7f7160039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.410+0000 7f728ba98800 1 Processor -- start 2024-09-18T01:45:26.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.411+0000 7f728ba98800 1 -- start start 2024-09-18T01:45:26.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.411+0000 7f7289593640 1 --2- 172.21.15.146:0/461044657 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7160036b90 0x7f7160039050 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f727c00dfd0 tx=0x7f727c02ae80 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.411+0000 7f728ba98800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ed67f40e60 0x55ed67f41260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.411+0000 7f728ba98800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55ed67f14970 con 0x55ed67f40e60 2024-09-18T01:45:26.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.411+0000 7f7289d94640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ed67f40e60 0x55ed67f41260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.411+0000 7f7289d94640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ed67f40e60 0x55ed67f41260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60774/0 (socket says 172.21.15.146:60774) 2024-09-18T01:45:26.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.411+0000 7f7289d94640 1 -- 172.21.15.146:0/1714412828 learned_addr learned my addr 172.21.15.146:0/1714412828 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:26.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.411+0000 7f7289d94640 1 -- 172.21.15.146:0/1714412828 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed67f41830 con 0x55ed67f40e60 2024-09-18T01:45:26.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.411+0000 7f7289d94640 1 --2- 172.21.15.146:0/1714412828 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ed67f40e60 0x55ed67f41260 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f728404c890 tx=0x7f728404c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20cffc19ea2090d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.411+0000 7f716cff9640 1 -- 172.21.15.146:0/1714412828 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7284045070 con 0x55ed67f40e60 2024-09-18T01:45:26.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.411+0000 7f716cff9640 1 -- 172.21.15.146:0/1714412828 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7284012df0 con 0x55ed67f40e60 2024-09-18T01:45:26.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.411+0000 7f716cff9640 1 -- 172.21.15.146:0/1714412828 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7284021b80 con 0x55ed67f40e60 2024-09-18T01:45:26.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.412+0000 7f728ba98800 1 -- 172.21.15.146:0/1714412828 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ed67f40e60 msgr2=0x55ed67f41260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.412+0000 7f728ba98800 1 --2- 172.21.15.146:0/1714412828 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ed67f40e60 0x55ed67f41260 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f728404c890 tx=0x7f728404c9d0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.412+0000 7f728ba98800 1 -- 172.21.15.146:0/1714412828 shutdown_connections 2024-09-18T01:45:26.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.412+0000 7f728ba98800 1 --2- 172.21.15.146:0/1714412828 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ed67f40e60 0x55ed67f41260 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.412+0000 7f728ba98800 1 -- 172.21.15.146:0/1714412828 >> 172.21.15.146:0/1714412828 conn(0x55ed67f3d210 msgr2=0x55ed67f3b310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:26.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.412+0000 7f728ba98800 1 -- 172.21.15.146:0/1714412828 shutdown_connections 2024-09-18T01:45:26.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.412+0000 7f728ba98800 1 -- 172.21.15.146:0/1714412828 wait complete. 2024-09-18T01:45:26.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.412+0000 7f728ba98800 1 Processor -- start 2024-09-18T01:45:26.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.412+0000 7f728ba98800 1 -- start start 2024-09-18T01:45:26.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.412+0000 7f728ba98800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ed67f40e60 0x55ed67f482b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.412+0000 7f728ba98800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55ed67f41e00 con 0x55ed67f40e60 2024-09-18T01:45:26.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.413+0000 7f7289d94640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ed67f40e60 0x55ed67f482b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.413+0000 7f7289d94640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ed67f40e60 0x55ed67f482b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60780/0 (socket says 172.21.15.146:60780) 2024-09-18T01:45:26.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.413+0000 7f7289d94640 1 -- 172.21.15.146:0/3066979838 learned_addr learned my addr 172.21.15.146:0/3066979838 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:26.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.413+0000 7f7289d94640 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed67f487f0 con 0x55ed67f40e60 2024-09-18T01:45:26.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.413+0000 7f7289d94640 1 --2- 172.21.15.146:0/3066979838 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ed67f40e60 0x55ed67f482b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7284043040 tx=0x7f728404c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.413+0000 7f715effd640 1 -- 172.21.15.146:0/3066979838 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f728403a070 con 0x55ed67f40e60 2024-09-18T01:45:26.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.413+0000 7f715effd640 1 -- 172.21.15.146:0/3066979838 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f728404b480 con 0x55ed67f40e60 2024-09-18T01:45:26.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.413+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ed67f48a80 con 0x55ed67f40e60 2024-09-18T01:45:26.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.413+0000 7f715effd640 1 -- 172.21.15.146:0/3066979838 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7284045040 con 0x55ed67f40e60 2024-09-18T01:45:26.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.413+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed67f4b730 con 0x55ed67f40e60 2024-09-18T01:45:26.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.414+0000 7f715effd640 1 -- 172.21.15.146:0/3066979838 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f728403d070 con 0x55ed67f40e60 2024-09-18T01:45:26.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.414+0000 7f715effd640 1 --2- 172.21.15.146:0/3066979838 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7154036b90 0x7f7154039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.414+0000 7f715effd640 1 -- 172.21.15.146:0/3066979838 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f728400e040 con 0x55ed67f40e60 2024-09-18T01:45:26.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.414+0000 7f7289593640 1 --2- 172.21.15.146:0/3066979838 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7154036b90 0x7f7154039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.415+0000 7f728ba98800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.415+0000 7f728ba98800 1 --2- 172.21.15.146:0/3066979838 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55ed67f53f30 0x55ed67f563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.415+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ed67f56b40 con 0x55ed67f53f30 2024-09-18T01:45:26.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.415+0000 7f7280d92640 1 --2- 172.21.15.146:0/3066979838 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55ed67f53f30 0x55ed67f563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.415+0000 7f7289593640 1 --2- 172.21.15.146:0/3066979838 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7154036b90 0x7f7154039050 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f727c016fd0 tx=0x7f727c037000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.415+0000 7f7280d92640 1 --2- 172.21.15.146:0/3066979838 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55ed67f53f30 0x55ed67f563f0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.415+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7274051070 con 0x55ed67f53f30 2024-09-18T01:45:26.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.415+0000 7f728ba98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:26.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.415+0000 7f728ba98800 20 realm 2024-09-18T01:45:26.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.415+0000 7f728ba98800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.415+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ed67f56f70 con 0x55ed67f53f30 2024-09-18T01:45:26.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.416+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7274051070 con 0x55ed67f53f30 2024-09-18T01:45:26.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.416+0000 7f728ba98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:26.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.416+0000 7f728ba98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:26.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.416+0000 7f728ba98800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.416+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ed67f57840 con 0x55ed67f53f30 2024-09-18T01:45:26.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.416+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7274051070 con 0x55ed67f53f30 2024-09-18T01:45:26.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.416+0000 7f728ba98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:26.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.416+0000 7f728ba98800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.416+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ed67f57be0 con 0x55ed67f53f30 2024-09-18T01:45:26.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.416+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7274051070 con 0x55ed67f53f30 2024-09-18T01:45:26.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.416+0000 7f728ba98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:26.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.416+0000 7f728ba98800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.416+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ed67f57450 con 0x55ed67f53f30 2024-09-18T01:45:26.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.416+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7274051070 con 0x55ed67f53f30 2024-09-18T01:45:26.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.416+0000 7f728ba98800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:26.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.416+0000 7f728ba98800 20 searching for the correct realm 2024-09-18T01:45:26.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.416+0000 7f728ba98800 1 --2- 172.21.15.146:0/3066979838 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55ed67f5a0a0 0x55ed67f5c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.416+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ed67f5cb80 con 0x55ed67f5a0a0 2024-09-18T01:45:26.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.416+0000 7f7289d94640 1 --2- 172.21.15.146:0/3066979838 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55ed67f5a0a0 0x55ed67f5c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.417+0000 7f7289d94640 1 --2- 172.21.15.146:0/3066979838 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55ed67f5a0a0 0x55ed67f5c4b0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.417+0000 7f7289d94640 1 -- 172.21.15.146:0/3066979838 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f728403c030 con 0x55ed67f5a0a0 2024-09-18T01:45:26.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.417+0000 7f7289d94640 1 --2- 172.21.15.146:0/3066979838 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f728403f060 0x7f728402b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.417+0000 7f7289d94640 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f7284057040 con 0x7f728403f060 2024-09-18T01:45:26.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.417+0000 7f7289593640 1 --2- 172.21.15.146:0/3066979838 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f728403f060 0x7f728402b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.417+0000 7f7289593640 1 --2- 172.21.15.146:0/3066979838 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f728403f060 0x7f728402b3e0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.418+0000 7f7289593640 1 -- 172.21.15.146:0/3066979838 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f727c029030 con 0x7f728403f060 2024-09-18T01:45:26.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.418+0000 7f7289593640 1 --2- 172.21.15.146:0/3066979838 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f727c02c060 0x7f727c00c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.418+0000 7f7289593640 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f7284057040 con 0x7f727c02c060 2024-09-18T01:45:26.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.418+0000 7f7280d92640 1 --2- 172.21.15.146:0/3066979838 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f727c02c060 0x7f727c00c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.418+0000 7f7280d92640 1 --2- 172.21.15.146:0/3066979838 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f727c02c060 0x7f727c00c590 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.418+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7274051070 con 0x7f727c02c060 2024-09-18T01:45:26.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.418+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f7284057040 con 0x55ed67f53f30 2024-09-18T01:45:26.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.419+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7274051070 con 0x55ed67f53f30 2024-09-18T01:45:26.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.419+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f7284057040 con 0x55ed67f53f30 2024-09-18T01:45:26.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.419+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7274051070 con 0x55ed67f53f30 2024-09-18T01:45:26.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.419+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f7284057040 con 0x7f727c02c060 2024-09-18T01:45:26.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.419+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7274051070 con 0x7f727c02c060 2024-09-18T01:45:26.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.419+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f7284057040 con 0x7f727c02c060 2024-09-18T01:45:26.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.419+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7274051070 con 0x7f727c02c060 2024-09-18T01:45:26.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.419+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f7284057040 con 0x7f728403f060 2024-09-18T01:45:26.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.420+0000 7f7289593640 1 -- 172.21.15.146:0/3066979838 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f727c029030 con 0x7f728403f060 2024-09-18T01:45:26.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.420+0000 7f7289593640 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f7284057040 con 0x55ed67f5a0a0 2024-09-18T01:45:26.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.420+0000 7f7289d94640 1 -- 172.21.15.146:0/3066979838 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f728403c030 con 0x55ed67f5a0a0 2024-09-18T01:45:26.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.420+0000 7f7289d94640 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f7284057040 con 0x55ed67f53f30 2024-09-18T01:45:26.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.420+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7274051070 con 0x55ed67f53f30 2024-09-18T01:45:26.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.420+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f7284057040 con 0x7f727c02c060 2024-09-18T01:45:26.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.420+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7274051070 con 0x7f727c02c060 2024-09-18T01:45:26.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.420+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f7284057040 con 0x55ed67f53f30 2024-09-18T01:45:26.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.421+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7274051070 con 0x55ed67f53f30 2024-09-18T01:45:26.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.421+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f7284057040 con 0x7f728403f060 2024-09-18T01:45:26.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.421+0000 7f7289593640 1 -- 172.21.15.146:0/3066979838 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f727c029030 con 0x7f728403f060 2024-09-18T01:45:26.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.421+0000 7f7289593640 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f7284057040 con 0x55ed67f5a0a0 2024-09-18T01:45:26.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.421+0000 7f7289d94640 1 -- 172.21.15.146:0/3066979838 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f728403c030 con 0x55ed67f5a0a0 2024-09-18T01:45:26.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.421+0000 7f7289d94640 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f7284057040 con 0x55ed67f5a0a0 2024-09-18T01:45:26.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.421+0000 7f7289d94640 1 -- 172.21.15.146:0/3066979838 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f728403c030 con 0x55ed67f5a0a0 2024-09-18T01:45:26.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.421+0000 7f7289d94640 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f7284057040 con 0x7f727c02c060 2024-09-18T01:45:26.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.421+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7274051070 con 0x7f727c02c060 2024-09-18T01:45:26.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.421+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f7284057040 con 0x55ed67f5a0a0 2024-09-18T01:45:26.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.422+0000 7f7289d94640 1 -- 172.21.15.146:0/3066979838 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f728403c030 con 0x55ed67f5a0a0 2024-09-18T01:45:26.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.422+0000 7f7289d94640 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f7284057040 con 0x55ed67f5a0a0 2024-09-18T01:45:26.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.422+0000 7f7289d94640 1 -- 172.21.15.146:0/3066979838 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f728403c030 con 0x55ed67f5a0a0 2024-09-18T01:45:26.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.422+0000 7f7289d94640 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f7284057040 con 0x55ed67f53f30 2024-09-18T01:45:26.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.422+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7274051070 con 0x55ed67f53f30 2024-09-18T01:45:26.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.422+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f7284057040 con 0x55ed67f53f30 2024-09-18T01:45:26.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.422+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7274051070 con 0x55ed67f53f30 2024-09-18T01:45:26.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.422+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f7284057040 con 0x7f727c02c060 2024-09-18T01:45:26.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.423+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7274051070 con 0x7f727c02c060 2024-09-18T01:45:26.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.423+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f7284057040 con 0x55ed67f5a0a0 2024-09-18T01:45:26.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.423+0000 7f7289d94640 1 -- 172.21.15.146:0/3066979838 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f728403c030 con 0x55ed67f5a0a0 2024-09-18T01:45:26.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.423+0000 7f7289d94640 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f7284057040 con 0x7f728403f060 2024-09-18T01:45:26.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.423+0000 7f7289593640 1 -- 172.21.15.146:0/3066979838 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f727c029030 con 0x7f728403f060 2024-09-18T01:45:26.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.423+0000 7f7289593640 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f7284057040 con 0x55ed67f53f30 2024-09-18T01:45:26.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.423+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7274051070 con 0x55ed67f53f30 2024-09-18T01:45:26.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.423+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f7284057040 con 0x7f727c02c060 2024-09-18T01:45:26.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.424+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7274051070 con 0x7f727c02c060 2024-09-18T01:45:26.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.424+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f7284057040 con 0x55ed67f5a0a0 2024-09-18T01:45:26.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.424+0000 7f7289d94640 1 -- 172.21.15.146:0/3066979838 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f728403c030 con 0x55ed67f5a0a0 2024-09-18T01:45:26.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.424+0000 7f7289d94640 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f7284057040 con 0x7f727c02c060 2024-09-18T01:45:26.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.424+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7274051070 con 0x7f727c02c060 2024-09-18T01:45:26.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.424+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f7284057040 con 0x7f728403f060 2024-09-18T01:45:26.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.424+0000 7f7289593640 1 -- 172.21.15.146:0/3066979838 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f727c029030 con 0x7f728403f060 2024-09-18T01:45:26.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.424+0000 7f7289593640 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f7284057040 con 0x55ed67f5a0a0 2024-09-18T01:45:26.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.425+0000 7f7289d94640 1 -- 172.21.15.146:0/3066979838 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f728403c030 con 0x55ed67f5a0a0 2024-09-18T01:45:26.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.425+0000 7f7289d94640 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f7284057040 con 0x7f727c02c060 2024-09-18T01:45:26.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.425+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7274051070 con 0x7f727c02c060 2024-09-18T01:45:26.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.425+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f7284057040 con 0x55ed67f53f30 2024-09-18T01:45:26.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.425+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7274051070 con 0x55ed67f53f30 2024-09-18T01:45:26.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.425+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f7284057040 con 0x7f728403f060 2024-09-18T01:45:26.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.425+0000 7f7289593640 1 -- 172.21.15.146:0/3066979838 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f727c062040 con 0x7f728403f060 2024-09-18T01:45:26.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.425+0000 7f728ba98800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:26.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.425+0000 7f728ba98800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:26.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.425+0000 7f728ba98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:26.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.425+0000 7f728ba98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:26.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.425+0000 7f728ba98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:26.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.425+0000 7f728ba98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:26.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.425+0000 7f728ba98800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.425+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ed67f58af0 con 0x55ed67f53f30 2024-09-18T01:45:26.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.426+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7274051070 con 0x55ed67f53f30 2024-09-18T01:45:26.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.426+0000 7f728ba98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:26.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.426+0000 7f728ba98800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.426+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ed67f59390 con 0x55ed67f53f30 2024-09-18T01:45:26.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.426+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7274051070 con 0x55ed67f53f30 2024-09-18T01:45:26.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.426+0000 7f728ba98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:26.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.426+0000 7f728ba98800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.426+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ed67f58730 con 0x7f728403f060 2024-09-18T01:45:26.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.426+0000 7f7289593640 1 -- 172.21.15.146:0/3066979838 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f727c062040 con 0x7f728403f060 2024-09-18T01:45:26.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.426+0000 7f728ba98800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:26.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.426+0000 7f728ba98800 20 zone default found 2024-09-18T01:45:26.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.426+0000 7f728ba98800 4 Realm: () 2024-09-18T01:45:26.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.426+0000 7f728ba98800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:26.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.426+0000 7f728ba98800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:26.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.426+0000 7f728ba98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:26.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.426+0000 7f728ba98800 20 zonegroup default 2024-09-18T01:45:26.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.426+0000 7f728ba98800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.426+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ed67f5d4b0 con 0x7f727c02c060 2024-09-18T01:45:26.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.426+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7274051070 con 0x7f727c02c060 2024-09-18T01:45:26.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.426+0000 7f728ba98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:26.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.426+0000 7f728ba98800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.426+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ed67f5f010 con 0x55ed67f5a0a0 2024-09-18T01:45:26.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.427+0000 7f7289d94640 1 -- 172.21.15.146:0/3066979838 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f728403c030 con 0x55ed67f5a0a0 2024-09-18T01:45:26.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.427+0000 7f728ba98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:26.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.427+0000 7f728ba98800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.427+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ed67f5f4a0 con 0x55ed67f5a0a0 2024-09-18T01:45:26.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.427+0000 7f7289d94640 1 -- 172.21.15.146:0/3066979838 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f728403c030 con 0x55ed67f5a0a0 2024-09-18T01:45:26.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.427+0000 7f728ba98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:26.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.427+0000 7f728ba98800 20 started sync module instance, tier type = 2024-09-18T01:45:26.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.427+0000 7f728ba98800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:26.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.427+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ed67f5df10 con 0x7f728403f060 2024-09-18T01:45:26.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.428+0000 7f7289593640 1 -- 172.21.15.146:0/3066979838 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v31'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f727c062040 con 0x7f728403f060 2024-09-18T01:45:26.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.428+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94478139775584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ed67f5f900 con 0x7f728403f060 2024-09-18T01:45:26.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.428+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ed67f60150 con 0x55ed67f53f30 2024-09-18T01:45:26.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.429+0000 7f7289593640 1 -- 172.21.15.146:0/3066979838 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94478139775584] v31'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f727c062040 con 0x7f728403f060 2024-09-18T01:45:26.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.429+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v31'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7274051070 con 0x55ed67f53f30 2024-09-18T01:45:26.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.430+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94478139784352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ed67f60570 con 0x55ed67f53f30 2024-09-18T01:45:26.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.430+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ed67f60e00 con 0x55ed67f5a0a0 2024-09-18T01:45:26.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.430+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94478139784352] v31'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7274051070 con 0x55ed67f53f30 2024-09-18T01:45:26.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.431+0000 7f7289d94640 1 -- 172.21.15.146:0/3066979838 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v31'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f728403c030 con 0x55ed67f5a0a0 2024-09-18T01:45:26.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.431+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94478139785408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ed67f60990 con 0x55ed67f5a0a0 2024-09-18T01:45:26.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.431+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ed67f61880 con 0x7f728403f060 2024-09-18T01:45:26.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.432+0000 7f7289d94640 1 -- 172.21.15.146:0/3066979838 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94478139785408] v31'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f728403c030 con 0x55ed67f5a0a0 2024-09-18T01:45:26.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.432+0000 7f7289593640 1 -- 172.21.15.146:0/3066979838 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v31'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f727c062040 con 0x7f728403f060 2024-09-18T01:45:26.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.432+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94478139786464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ed67f60900 con 0x7f728403f060 2024-09-18T01:45:26.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.432+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ed67f62740 con 0x55ed67f53f30 2024-09-18T01:45:26.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.433+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v31'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7274051070 con 0x55ed67f53f30 2024-09-18T01:45:26.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.433+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94478139794064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ed67f62b60 con 0x55ed67f53f30 2024-09-18T01:45:26.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.433+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ed67f63630 con 0x7f727c02c060 2024-09-18T01:45:26.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.433+0000 7f7289593640 1 -- 172.21.15.146:0/3066979838 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94478139786464] v31'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f727c062040 con 0x7f728403f060 2024-09-18T01:45:26.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.434+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v31'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7274051070 con 0x7f727c02c060 2024-09-18T01:45:26.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.434+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94478139797792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ed67f635f0 con 0x7f727c02c060 2024-09-18T01:45:26.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.434+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ed67f64060 con 0x7f727c02c060 2024-09-18T01:45:26.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.434+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94478139794064] v31'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7274051070 con 0x55ed67f53f30 2024-09-18T01:45:26.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.435+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94478139797792] v31'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7274051070 con 0x7f727c02c060 2024-09-18T01:45:26.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.435+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v31'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7274051070 con 0x7f727c02c060 2024-09-18T01:45:26.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.435+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94478139792496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ed67f626b0 con 0x7f727c02c060 2024-09-18T01:45:26.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.435+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ed67f64510 con 0x7f727c02c060 2024-09-18T01:45:26.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.436+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(58 notify.7 [create] v31'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7274051070 con 0x7f727c02c060 2024-09-18T01:45:26.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.436+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94478139792496] v31'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7274051070 con 0x7f727c02c060 2024-09-18T01:45:26.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.436+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94478139801696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ed67f64480 con 0x7f727c02c060 2024-09-18T01:45:26.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.436+0000 7f728ba98800 20 add_watcher() i=0 2024-09-18T01:45:26.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.436+0000 7f728ba98800 20 add_watcher() i=1 2024-09-18T01:45:26.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.436+0000 7f728ba98800 20 add_watcher() i=2 2024-09-18T01:45:26.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.436+0000 7f728ba98800 20 add_watcher() i=3 2024-09-18T01:45:26.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.436+0000 7f728ba98800 20 add_watcher() i=4 2024-09-18T01:45:26.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.436+0000 7f728ba98800 20 add_watcher() i=5 2024-09-18T01:45:26.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.436+0000 7f728ba98800 20 add_watcher() i=6 2024-09-18T01:45:26.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.437+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94478139801696] v31'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7274051070 con 0x7f727c02c060 2024-09-18T01:45:26.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.437+0000 7f728ba98800 20 add_watcher() i=7 2024-09-18T01:45:26.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.437+0000 7f728ba98800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:26.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.437+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ed67f63c80 con 0x55ed67f53f30 2024-09-18T01:45:26.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.437+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7274051070 con 0x55ed67f53f30 2024-09-18T01:45:26.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.437+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94478139803824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ed67f65180 con 0x55ed67f53f30 2024-09-18T01:45:26.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.438+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94478139803824] v31'106 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7274051070 con 0x55ed67f53f30 2024-09-18T01:45:26.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.438+0000 7f713f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:26.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.438+0000 7f728ba98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:26.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.438+0000 7f728ba98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:26.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.438+0000 7f728ba98800 5 note: GC not initialized 2024-09-18T01:45:26.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.438+0000 7f713e7e4640 20 reqs_thread_entry: start 2024-09-18T01:45:26.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.439+0000 7f728ba98800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:26.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.439+0000 7f728ba98800 20 Filter name: none 2024-09-18T01:45:26.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.439+0000 7f70affff640 20 reqs_thread_entry: start 2024-09-18T01:45:26.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.439+0000 7f728ba98800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.439+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ed67f9ac70 con 0x7f728403f060 2024-09-18T01:45:26.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.439+0000 7f7289593640 1 -- 172.21.15.146:0/3066979838 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f727c062040 con 0x7f728403f060 2024-09-18T01:45:26.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.439+0000 7f728ba98800 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T01:45:26.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.439+0000 7f728ba98800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.439+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:63 8.13 8:ceaa8859:root::.bucket.meta.myfoo%3a8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ed67f9b5e0 con 0x7f727c02c060 2024-09-18T01:45:26.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.440+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(63 .bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f7274051070 con 0x7f727c02c060 2024-09-18T01:45:26.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.440+0000 7f728ba98800 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T01:45:26.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.440+0000 7f728ba98800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-18T01:45:26.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.440+0000 7f728ba98800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.440+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ed67f9cc60 con 0x7f728403f060 2024-09-18T01:45:26.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.440+0000 7f7289593640 1 -- 172.21.15.146:0/3066979838 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f727c062040 con 0x7f728403f060 2024-09-18T01:45:26.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.440+0000 7f728ba98800 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T01:45:26.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.440+0000 7f728ba98800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.440+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:65 8.13 8:ceaa8859:root::.bucket.meta.myfoo%3a8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ed67f9cc60 con 0x7f727c02c060 2024-09-18T01:45:26.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.441+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(65 .bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f72740832a0 con 0x7f727c02c060 2024-09-18T01:45:26.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.441+0000 7f728ba98800 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T01:45:26.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.441+0000 7f728ba98800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-18T01:45:26.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.441+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:66 4.33 4:cd49ce18:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ed67f9c5f0 con 0x7f727c02c060 2024-09-18T01:45:26.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.441+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:67 4.10 4:083380d8:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ed67fa1580 con 0x55ed67f5a0a0 2024-09-18T01:45:26.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.441+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:68 4.15 4:a8d62d11:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ed67f9c5f0 con 0x55ed67f5a0a0 2024-09-18T01:45:26.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.441+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:69 4.36 4:6d8e27f1:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ed67fa67e0 con 0x55ed67f53f30 2024-09-18T01:45:26.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.441+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:70 4.19 4:98d692f3:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ed67f9c5f0 con 0x55ed67f5a0a0 2024-09-18T01:45:26.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.441+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:71 4.13 4:cabe8116:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ed67fa67e0 con 0x7f728403f060 2024-09-18T01:45:26.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.441+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:72 4.16 4:6b798858:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ed67fae1b0 con 0x55ed67f5a0a0 2024-09-18T01:45:26.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.441+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:73 4.14 4:2ab8464f:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ed67fb1070 con 0x55ed67f5a0a0 2024-09-18T01:45:26.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.441+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:74 4.3e 4:7ce77e2d:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ed67fb3f30 con 0x7f728403f060 2024-09-18T01:45:26.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.441+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:75 4.2d 4:b678784f:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ed67fb6da0 con 0x7f727c02c060 2024-09-18T01:45:26.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.441+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:76 4.10 4:0ad5fa93:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ed67fb9bd0 con 0x55ed67f5a0a0 2024-09-18T01:45:26.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.441+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(66 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f72740832a0 con 0x7f727c02c060 2024-09-18T01:45:26.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.441+0000 7f7289d94640 1 -- 172.21.15.146:0/3066979838 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(67 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f728403c030 con 0x55ed67f5a0a0 2024-09-18T01:45:26.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.441+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(69 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f72740832a0 con 0x55ed67f53f30 2024-09-18T01:45:26.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.441+0000 7f7289d94640 1 -- 172.21.15.146:0/3066979838 <== osd.3 v2:172.21.15.146:6809/4106661138 15 ==== osd_op_reply(68 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f728403c030 con 0x55ed67f5a0a0 2024-09-18T01:45:26.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.441+0000 7f7289d94640 1 -- 172.21.15.146:0/3066979838 <== osd.3 v2:172.21.15.146:6809/4106661138 16 ==== osd_op_reply(70 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f728403c030 con 0x55ed67f5a0a0 2024-09-18T01:45:26.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.441+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(75 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f72740832a0 con 0x7f727c02c060 2024-09-18T01:45:26.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.441+0000 7f7289593640 1 -- 172.21.15.146:0/3066979838 <== osd.2 v2:172.21.15.146:6800/3820039304 14 ==== osd_op_reply(71 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.5 [call out=124b] v0'0 uv3 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f727c068040 con 0x7f728403f060 2024-09-18T01:45:26.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.441+0000 7f7289d94640 1 -- 172.21.15.146:0/3066979838 <== osd.3 v2:172.21.15.146:6809/4106661138 17 ==== osd_op_reply(72 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f728403c030 con 0x55ed67f5a0a0 2024-09-18T01:45:26.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.441+0000 7f7289593640 1 -- 172.21.15.146:0/3066979838 <== osd.2 v2:172.21.15.146:6800/3820039304 15 ==== osd_op_reply(74 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f727c068040 con 0x7f728403f060 2024-09-18T01:45:26.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.441+0000 7f7289d94640 1 -- 172.21.15.146:0/3066979838 <== osd.3 v2:172.21.15.146:6809/4106661138 18 ==== osd_op_reply(73 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f728403c030 con 0x55ed67f5a0a0 2024-09-18T01:45:26.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.441+0000 7f7289d94640 1 -- 172.21.15.146:0/3066979838 <== osd.3 v2:172.21.15.146:6809/4106661138 19 ==== osd_op_reply(76 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.10 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f728403c030 con 0x55ed67f5a0a0 2024-09-18T01:45:26.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.442+0000 7f713f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:26.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.442+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94478139803824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ed67fb3f30 con 0x55ed67f53f30 2024-09-18T01:45:26.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.443+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94478139803824] v31'107 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f72740832a0 con 0x55ed67f53f30 2024-09-18T01:45:26.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.443+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94478139775584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ed67f9b050 con 0x7f728403f060 2024-09-18T01:45:26.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.444+0000 7f7289593640 1 -- 172.21.15.146:0/3066979838 <== osd.2 v2:172.21.15.146:6800/3820039304 16 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94478139775584] v31'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f727c068040 con 0x7f728403f060 2024-09-18T01:45:26.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.444+0000 7f728ba98800 20 remove_watcher() i=0 2024-09-18T01:45:26.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.444+0000 7f728ba98800 2 removed watcher, disabling cache 2024-09-18T01:45:26.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.444+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94478139784352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ed67fb3f30 con 0x55ed67f53f30 2024-09-18T01:45:26.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.445+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94478139784352] v31'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7274089040 con 0x55ed67f53f30 2024-09-18T01:45:26.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.445+0000 7f728ba98800 20 remove_watcher() i=1 2024-09-18T01:45:26.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.445+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94478139785408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ed67f9b050 con 0x55ed67f5a0a0 2024-09-18T01:45:26.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.446+0000 7f7289d94640 1 -- 172.21.15.146:0/3066979838 <== osd.3 v2:172.21.15.146:6809/4106661138 20 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94478139785408] v31'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f728403c030 con 0x55ed67f5a0a0 2024-09-18T01:45:26.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.446+0000 7f728ba98800 20 remove_watcher() i=2 2024-09-18T01:45:26.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.446+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94478139786464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ed67fb3f30 con 0x7f728403f060 2024-09-18T01:45:26.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.447+0000 7f7289593640 1 -- 172.21.15.146:0/3066979838 <== osd.2 v2:172.21.15.146:6800/3820039304 17 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94478139786464] v31'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f727c068040 con 0x7f728403f060 2024-09-18T01:45:26.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.447+0000 7f728ba98800 20 remove_watcher() i=3 2024-09-18T01:45:26.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.447+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94478139794064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ed67f9b050 con 0x55ed67f53f30 2024-09-18T01:45:26.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.448+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94478139794064] v31'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7274089040 con 0x55ed67f53f30 2024-09-18T01:45:26.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.448+0000 7f728ba98800 20 remove_watcher() i=4 2024-09-18T01:45:26.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.448+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94478139797792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ed67fb3f30 con 0x7f727c02c060 2024-09-18T01:45:26.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.450+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94478139797792] v31'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7274089040 con 0x7f727c02c060 2024-09-18T01:45:26.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.450+0000 7f728ba98800 20 remove_watcher() i=5 2024-09-18T01:45:26.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.450+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94478139792496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ed67f9b050 con 0x7f727c02c060 2024-09-18T01:45:26.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.451+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 <== osd.0 v2:172.21.15.129:6800/1759265424 22 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94478139792496] v31'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7274089040 con 0x7f727c02c060 2024-09-18T01:45:26.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.451+0000 7f728ba98800 20 remove_watcher() i=6 2024-09-18T01:45:26.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.451+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94478139801696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ed67f9b050 con 0x7f727c02c060 2024-09-18T01:45:26.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.451+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 <== osd.0 v2:172.21.15.129:6800/1759265424 23 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94478139801696] v31'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7274089040 con 0x7f727c02c060 2024-09-18T01:45:26.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.451+0000 7f728ba98800 20 remove_watcher() i=7 2024-09-18T01:45:26.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.452+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f727c02c060 msgr2=0x7f727c00c590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.452+0000 7f728ba98800 1 --2- 172.21.15.146:0/3066979838 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f727c02c060 0x7f727c00c590 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.452+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55ed67f53f30 msgr2=0x55ed67f563f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.452+0000 7f728ba98800 1 --2- 172.21.15.146:0/3066979838 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55ed67f53f30 0x55ed67f563f0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.452+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f728403f060 msgr2=0x7f728402b3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.452+0000 7f728ba98800 1 --2- 172.21.15.146:0/3066979838 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f728403f060 0x7f728402b3e0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.452+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55ed67f5a0a0 msgr2=0x55ed67f5c4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.452+0000 7f728ba98800 1 --2- 172.21.15.146:0/3066979838 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55ed67f5a0a0 0x55ed67f5c4b0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.452+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7154036b90 msgr2=0x7f7154039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.452+0000 7f728ba98800 1 --2- 172.21.15.146:0/3066979838 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7154036b90 0x7f7154039050 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f727c016fd0 tx=0x7f727c037000 comp rx=0 tx=0).stop 2024-09-18T01:45:26.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.452+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ed67f40e60 msgr2=0x55ed67f482b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.452+0000 7f7280d92640 1 -- 172.21.15.146:0/3066979838 reap_dead start 2024-09-18T01:45:26.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.452+0000 7f728ba98800 1 --2- 172.21.15.146:0/3066979838 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ed67f40e60 0x55ed67f482b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7284043040 tx=0x7f728404c820 comp rx=0 tx=0).stop 2024-09-18T01:45:26.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.452+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 shutdown_connections 2024-09-18T01:45:26.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.452+0000 7f728ba98800 1 --2- 172.21.15.146:0/3066979838 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ed67f40e60 0x55ed67f482b0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.452+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 >> 172.21.15.146:0/3066979838 conn(0x55ed67f3d210 msgr2=0x55ed67f42570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:26.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.452+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 shutdown_connections 2024-09-18T01:45:26.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.452+0000 7f728ba98800 1 -- 172.21.15.146:0/3066979838 wait complete. 2024-09-18T01:45:26.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.452+0000 7f728ba98800 1 -- 172.21.15.146:0/461044657 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7160036b90 msgr2=0x7f7160039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.452+0000 7f728ba98800 1 --2- 172.21.15.146:0/461044657 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7160036b90 0x7f7160039050 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f727c00dfd0 tx=0x7f727c02ae80 comp rx=0 tx=0).stop 2024-09-18T01:45:26.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.452+0000 7f728ba98800 1 -- 172.21.15.146:0/461044657 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ed67f34210 msgr2=0x55ed67f34630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.452+0000 7f728ba98800 1 --2- 172.21.15.146:0/461044657 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ed67f34210 0x55ed67f34630 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x55ed67f20e60 tx=0x7f72840178e0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.452+0000 7f728ba98800 1 -- 172.21.15.146:0/461044657 shutdown_connections 2024-09-18T01:45:26.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.452+0000 7f728ba98800 1 --2- 172.21.15.146:0/461044657 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7160036b90 0x7f7160039050 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.452+0000 7f728ba98800 1 --2- 172.21.15.146:0/461044657 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ed67f34210 0x55ed67f34630 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.452+0000 7f728ba98800 1 -- 172.21.15.146:0/461044657 >> 172.21.15.146:0/461044657 conn(0x55ed67f291a0 msgr2=0x55ed67f2bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:26.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.452+0000 7f728ba98800 1 -- 172.21.15.146:0/461044657 shutdown_connections 2024-09-18T01:45:26.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.452+0000 7f728ba98800 1 -- 172.21.15.146:0/461044657 wait complete. 2024-09-18T01:45:26.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.453+0000 7f728ba98800 1 -- 172.21.15.146:0/2398624081 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55ed67e23990 msgr2=0x55ed67f204d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.453+0000 7f728ba98800 1 --2- 172.21.15.146:0/2398624081 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55ed67e23990 0x55ed67f204d0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.453+0000 7f728ba98800 1 -- 172.21.15.146:0/2398624081 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55ed67f224b0 msgr2=0x55ed67f25cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.453+0000 7f728ba98800 1 --2- 172.21.15.146:0/2398624081 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55ed67f224b0 0x55ed67f25cf0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.453+0000 7f728ba98800 1 -- 172.21.15.146:0/2398624081 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7170036b40 msgr2=0x7f7170039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.453+0000 7f728ba98800 1 --2- 172.21.15.146:0/2398624081 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7170036b40 0x7f7170039000 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7274057000 tx=0x7f7274052000 comp rx=0 tx=0).stop 2024-09-18T01:45:26.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.453+0000 7f728ba98800 1 -- 172.21.15.146:0/2398624081 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ed67e1fbc0 msgr2=0x55ed67f19460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.453+0000 7f728ba98800 1 --2- 172.21.15.146:0/2398624081 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ed67e1fbc0 0x55ed67f19460 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f727c004000 tx=0x7f727c000bc0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.453+0000 7f728ba98800 1 -- 172.21.15.146:0/2398624081 shutdown_connections 2024-09-18T01:45:26.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.453+0000 7f728ba98800 1 --2- 172.21.15.146:0/2398624081 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55ed67f224b0 0x55ed67f25cf0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.453+0000 7f728ba98800 1 --2- 172.21.15.146:0/2398624081 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55ed67e23990 0x55ed67f204d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.453+0000 7f728ba98800 1 --2- 172.21.15.146:0/2398624081 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7170036b40 0x7f7170039000 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.453+0000 7f728ba98800 1 --2- 172.21.15.146:0/2398624081 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ed67e1fbc0 0x55ed67f19460 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.453+0000 7f728ba98800 1 -- 172.21.15.146:0/2398624081 >> 172.21.15.146:0/2398624081 conn(0x55ed67e1a5c0 msgr2=0x55ed67f089f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:26.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.453+0000 7f728ba98800 1 -- 172.21.15.146:0/2398624081 shutdown_connections 2024-09-18T01:45:26.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.453+0000 7f728ba98800 1 -- 172.21.15.146:0/2398624081 wait complete. 2024-09-18T01:45:26.468 INFO:teuthology.orchestra.run.smithi146.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"069822df-7f2c-4cd0-aee2-64a07ebf49c5","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1","marker":"8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-18T01:45:25.647023Z","creation_time":"2024-09-18T01:45:25.639613Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":3,"size_actual":4096,"size_utilized":3,"size_kb":1,"size_kb_actual":4,"size_kb_utilized":1,"num_objects":1}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-09-18T01:45:26.468 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '069822df-7f2c-4cd0-aee2-64a07ebf49c5', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1', 'marker': '8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-18T01:45:25.647023Z', 'creation_time': '2024-09-18T01:45:25.639613Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-18T01:45:26.468 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-18T01:45:26.468 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-18T01:45:26.469 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user stats --uid foo --sync-stats 2024-09-18T01:45:26.514 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:26.514 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:26.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.514+0000 7f967500f800 1 Processor -- start 2024-09-18T01:45:26.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.514+0000 7f967500f800 1 -- start start 2024-09-18T01:45:26.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.514+0000 7f967500f800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55e5cb730a10 0x55e5cb732e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.514+0000 7f967500f800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e5cb5ebb30 con 0x55e5cb72c710 2024-09-18T01:45:26.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.514+0000 7f967500f800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x55e5cb5cd360 con 0x55e5cb730a10 2024-09-18T01:45:26.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.515+0000 7f9667fff640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55e5cb730a10 0x55e5cb732e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.515+0000 7f96706e7640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x55e5cb72c710 0x55e5cb72cb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:38968/0 (socket says 172.21.15.146:38968) 2024-09-18T01:45:26.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.515+0000 7f9667fff640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55e5cb730a10 0x55e5cb732e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60784/0 (socket says 172.21.15.146:60784) 2024-09-18T01:45:26.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.515+0000 7f96706e7640 1 -- 172.21.15.146:0/460900251 learned_addr learned my addr 172.21.15.146:0/460900251 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:45:26.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.515+0000 7f9667fff640 1 -- 172.21.15.146:0/460900251 >> v1:172.21.15.129:6789/0 conn(0x55e5cb72c710 legacy=0x55e5cb72cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.515+0000 7f9667fff640 1 -- 172.21.15.146:0/460900251 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5cb5f3e00 con 0x55e5cb730a10 2024-09-18T01:45:26.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.517+0000 7f9667fff640 1 --2- 172.21.15.146:0/460900251 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e5cb730a10 0x55e5cb732e00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f965800a470 tx=0x7f9658045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=625449248dcc7f28 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.517+0000 7f966fee6640 1 -- 172.21.15.146:0/460900251 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9658053570 con 0x55e5cb730a10 2024-09-18T01:45:26.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.517+0000 7f966fee6640 1 -- 172.21.15.146:0/460900251 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9658058070 con 0x55e5cb730a10 2024-09-18T01:45:26.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.517+0000 7f966fee6640 1 -- 172.21.15.146:0/460900251 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9658053880 con 0x55e5cb730a10 2024-09-18T01:45:26.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.517+0000 7f967500f800 1 -- 172.21.15.146:0/460900251 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e5cb730a10 msgr2=0x55e5cb732e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.517+0000 7f967500f800 1 --2- 172.21.15.146:0/460900251 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e5cb730a10 0x55e5cb732e00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f965800a470 tx=0x7f9658045a20 comp rx=0 tx=0).stop 2024-09-18T01:45:26.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.517+0000 7f967500f800 1 -- 172.21.15.146:0/460900251 shutdown_connections 2024-09-18T01:45:26.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.517+0000 7f967500f800 1 --2- 172.21.15.146:0/460900251 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e5cb730a10 0x55e5cb732e00 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.517+0000 7f967500f800 1 -- 172.21.15.146:0/460900251 >> 172.21.15.146:0/460900251 conn(0x55e5cb727fe0 msgr2=0x55e5cb72a400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:26.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.517+0000 7f967500f800 1 -- 172.21.15.146:0/460900251 shutdown_connections 2024-09-18T01:45:26.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.517+0000 7f967500f800 1 -- 172.21.15.146:0/460900251 wait complete. 2024-09-18T01:45:26.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.531+0000 7f967500f800 1 Processor -- start 2024-09-18T01:45:26.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.531+0000 7f967500f800 1 -- start start 2024-09-18T01:45:26.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.531+0000 7f967500f800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e5cb72c710 0x55e5cb81b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.531+0000 7f967500f800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55e5cb678360 con 0x55e5cb72c710 2024-09-18T01:45:26.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.531+0000 7f96706e7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e5cb72c710 0x55e5cb81b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.531+0000 7f96706e7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e5cb72c710 0x55e5cb81b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60796/0 (socket says 172.21.15.146:60796) 2024-09-18T01:45:26.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.531+0000 7f96706e7640 1 -- 172.21.15.146:0/1886779306 learned_addr learned my addr 172.21.15.146:0/1886779306 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:26.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.531+0000 7f96706e7640 1 -- 172.21.15.146:0/1886779306 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5cb5c5bc0 con 0x55e5cb72c710 2024-09-18T01:45:26.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.532+0000 7f96706e7640 1 --2- 172.21.15.146:0/1886779306 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e5cb72c710 0x55e5cb81b870 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9660001d80 tx=0x7f9660001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9702e602228d315 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.532+0000 7f955e60c640 1 -- 172.21.15.146:0/1886779306 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9660013030 con 0x55e5cb72c710 2024-09-18T01:45:26.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.532+0000 7f955e60c640 1 -- 172.21.15.146:0/1886779306 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f966000e470 con 0x55e5cb72c710 2024-09-18T01:45:26.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.532+0000 7f955e60c640 1 -- 172.21.15.146:0/1886779306 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f966000e810 con 0x55e5cb72c710 2024-09-18T01:45:26.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.532+0000 7f967500f800 1 -- 172.21.15.146:0/1886779306 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e5cb72c710 msgr2=0x55e5cb81b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.532+0000 7f967500f800 1 --2- 172.21.15.146:0/1886779306 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e5cb72c710 0x55e5cb81b870 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9660001d80 tx=0x7f9660001e70 comp rx=0 tx=0).stop 2024-09-18T01:45:26.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.532+0000 7f967500f800 1 -- 172.21.15.146:0/1886779306 shutdown_connections 2024-09-18T01:45:26.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.532+0000 7f967500f800 1 --2- 172.21.15.146:0/1886779306 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e5cb72c710 0x55e5cb81b870 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.532+0000 7f967500f800 1 -- 172.21.15.146:0/1886779306 >> 172.21.15.146:0/1886779306 conn(0x55e5cb727fe0 msgr2=0x55e5cb817230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:26.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.533+0000 7f967500f800 1 -- 172.21.15.146:0/1886779306 shutdown_connections 2024-09-18T01:45:26.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.533+0000 7f967500f800 1 -- 172.21.15.146:0/1886779306 wait complete. 2024-09-18T01:45:26.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.533+0000 7f967500f800 1 Processor -- start 2024-09-18T01:45:26.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.533+0000 7f967500f800 1 -- start start 2024-09-18T01:45:26.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.533+0000 7f967500f800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e5cb72c710 0x55e5cb823280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.533+0000 7f967500f800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55e5cb733640 con 0x55e5cb72c710 2024-09-18T01:45:26.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.533+0000 7f96706e7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e5cb72c710 0x55e5cb823280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.533+0000 7f96706e7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e5cb72c710 0x55e5cb823280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60798/0 (socket says 172.21.15.146:60798) 2024-09-18T01:45:26.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.533+0000 7f96706e7640 1 -- 172.21.15.146:0/1809419649 learned_addr learned my addr 172.21.15.146:0/1809419649 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:26.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.533+0000 7f96706e7640 1 -- 172.21.15.146:0/1809419649 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5cb5d9fe0 con 0x55e5cb72c710 2024-09-18T01:45:26.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.534+0000 7f96706e7640 1 --2- 172.21.15.146:0/1809419649 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e5cb72c710 0x55e5cb823280 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9660004000 tx=0x7f9660000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.534+0000 7f955ce09640 1 -- 172.21.15.146:0/1809419649 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9660027070 con 0x55e5cb72c710 2024-09-18T01:45:26.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.534+0000 7f955ce09640 1 -- 172.21.15.146:0/1809419649 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9660019900 con 0x55e5cb72c710 2024-09-18T01:45:26.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.534+0000 7f967500f800 1 -- 172.21.15.146:0/1809419649 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e5cb8237c0 con 0x55e5cb72c710 2024-09-18T01:45:26.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.534+0000 7f955ce09640 1 -- 172.21.15.146:0/1809419649 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9660019c60 con 0x55e5cb72c710 2024-09-18T01:45:26.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.534+0000 7f967500f800 1 -- 172.21.15.146:0/1809419649 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5cb823ce0 con 0x55e5cb72c710 2024-09-18T01:45:26.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.535+0000 7f955ce09640 1 -- 172.21.15.146:0/1809419649 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f966002a070 con 0x55e5cb72c710 2024-09-18T01:45:26.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.535+0000 7f955ce09640 1 --2- 172.21.15.146:0/1809419649 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9558036b40 0x7f9558039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.535+0000 7f955ce09640 1 -- 172.21.15.146:0/1809419649 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f966001f070 con 0x55e5cb72c710 2024-09-18T01:45:26.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.535+0000 7f9667fff640 1 --2- 172.21.15.146:0/1809419649 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9558036b40 0x7f9558039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.535+0000 7f967500f800 1 --2- 172.21.15.146:0/1809419649 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55e5cb730a10 0x55e5cb82a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.535+0000 7f967500f800 1 -- 172.21.15.146:0/1809419649 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb82a8c0 con 0x55e5cb730a10 2024-09-18T01:45:26.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.535+0000 7f9670ee8640 1 --2- 172.21.15.146:0/1809419649 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55e5cb730a10 0x55e5cb82a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.535+0000 7f9667fff640 1 --2- 172.21.15.146:0/1809419649 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9558036b40 0x7f9558039000 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9658057000 tx=0x7f9658052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.535+0000 7f9670ee8640 1 --2- 172.21.15.146:0/1809419649 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55e5cb730a10 0x55e5cb82a2f0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.536+0000 7f9670ee8640 1 -- 172.21.15.146:0/1809419649 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f966800a4a0 con 0x55e5cb730a10 2024-09-18T01:45:26.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.536+0000 7f967500f800 1 -- 172.21.15.146:0/1809419649 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb8278a0 con 0x55e5cb730a10 2024-09-18T01:45:26.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.536+0000 7f9670ee8640 1 -- 172.21.15.146:0/1809419649 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f966800a4a0 con 0x55e5cb730a10 2024-09-18T01:45:26.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.536+0000 7f967500f800 1 -- 172.21.15.146:0/1809419649 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb82c6c0 con 0x55e5cb730a10 2024-09-18T01:45:26.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.536+0000 7f9670ee8640 1 -- 172.21.15.146:0/1809419649 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f966800a4a0 con 0x55e5cb730a10 2024-09-18T01:45:26.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.536+0000 7f967500f800 1 -- 172.21.15.146:0/1809419649 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb82b800 con 0x55e5cb730a10 2024-09-18T01:45:26.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.537+0000 7f9670ee8640 1 -- 172.21.15.146:0/1809419649 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f966800a4a0 con 0x55e5cb730a10 2024-09-18T01:45:26.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.537+0000 7f967500f800 1 --2- 172.21.15.146:0/1809419649 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55e5cb82c2a0 0x55e5cb82fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.537+0000 7f967500f800 1 -- 172.21.15.146:0/1809419649 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb830290 con 0x55e5cb82c2a0 2024-09-18T01:45:26.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.537+0000 7f96706e7640 1 --2- 172.21.15.146:0/1809419649 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55e5cb82c2a0 0x55e5cb82fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.537+0000 7f96706e7640 1 --2- 172.21.15.146:0/1809419649 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55e5cb82c2a0 0x55e5cb82fb00 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.537+0000 7f96706e7640 1 -- 172.21.15.146:0/1809419649 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9660029030 con 0x55e5cb82c2a0 2024-09-18T01:45:26.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.538+0000 7f967500f800 1 Processor -- start 2024-09-18T01:45:26.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.538+0000 7f967500f800 1 -- start start 2024-09-18T01:45:26.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.538+0000 7f967500f800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e5cb6a2760 0x55e5cb6a0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.538+0000 7f967500f800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55e5cb5c7580 con 0x55e5cb6a2760 2024-09-18T01:45:26.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.538+0000 7f9670ee8640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e5cb6a2760 0x55e5cb6a0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.538+0000 7f9670ee8640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e5cb6a2760 0x55e5cb6a0db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60810/0 (socket says 172.21.15.146:60810) 2024-09-18T01:45:26.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.538+0000 7f9670ee8640 1 -- 172.21.15.146:0/3343654355 learned_addr learned my addr 172.21.15.146:0/3343654355 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:26.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.538+0000 7f9670ee8640 1 -- 172.21.15.146:0/3343654355 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5cb6a2b80 con 0x55e5cb6a2760 2024-09-18T01:45:26.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.539+0000 7f9670ee8640 1 --2- 172.21.15.146:0/3343654355 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e5cb6a2760 0x55e5cb6a0db0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x55e5cb82aca0 tx=0x7f96680178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.539+0000 7f9555ffb640 1 -- 172.21.15.146:0/3343654355 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9668013440 con 0x55e5cb6a2760 2024-09-18T01:45:26.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.539+0000 7f9555ffb640 1 -- 172.21.15.146:0/3343654355 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96680135e0 con 0x55e5cb6a2760 2024-09-18T01:45:26.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.539+0000 7f967500f800 1 -- 172.21.15.146:0/3343654355 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e5cb6a13b0 con 0x55e5cb6a2760 2024-09-18T01:45:26.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.539+0000 7f9555ffb640 1 -- 172.21.15.146:0/3343654355 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96680138c0 con 0x55e5cb6a2760 2024-09-18T01:45:26.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.539+0000 7f967500f800 1 -- 172.21.15.146:0/3343654355 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5cb6a18b0 con 0x55e5cb6a2760 2024-09-18T01:45:26.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.539+0000 7f9555ffb640 1 -- 172.21.15.146:0/3343654355 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9668011040 con 0x55e5cb6a2760 2024-09-18T01:45:26.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.540+0000 7f9555ffb640 1 --2- 172.21.15.146:0/3343654355 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9548036b40 0x7f9548039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.540+0000 7f9555ffb640 1 -- 172.21.15.146:0/3343654355 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f966801d070 con 0x55e5cb6a2760 2024-09-18T01:45:26.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.540+0000 7f96706e7640 1 --2- 172.21.15.146:0/3343654355 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9548036b40 0x7f9548039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.540+0000 7f967500f800 1 Processor -- start 2024-09-18T01:45:26.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.540+0000 7f967500f800 1 -- start start 2024-09-18T01:45:26.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.540+0000 7f96706e7640 1 --2- 172.21.15.146:0/3343654355 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9548036b40 0x7f9548039000 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x55e5cb82bba0 tx=0x7f966002ae80 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.540+0000 7f967500f800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e5cb84cee0 0x55e5cb84d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.540+0000 7f967500f800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55e5cb81c020 con 0x55e5cb84cee0 2024-09-18T01:45:26.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.540+0000 7f9670ee8640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e5cb84cee0 0x55e5cb84d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.540+0000 7f9670ee8640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e5cb84cee0 0x55e5cb84d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60822/0 (socket says 172.21.15.146:60822) 2024-09-18T01:45:26.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.540+0000 7f9670ee8640 1 -- 172.21.15.146:0/2677581776 learned_addr learned my addr 172.21.15.146:0/2677581776 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:26.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.541+0000 7f9670ee8640 1 -- 172.21.15.146:0/2677581776 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5cb84d8b0 con 0x55e5cb84cee0 2024-09-18T01:45:26.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.541+0000 7f9670ee8640 1 --2- 172.21.15.146:0/2677581776 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e5cb84cee0 0x55e5cb84d2e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f966804c960 tx=0x7f966804cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdfbf71a5a4bd3d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.541+0000 7f954f7fe640 1 -- 172.21.15.146:0/2677581776 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9668040e60 con 0x55e5cb84cee0 2024-09-18T01:45:26.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.541+0000 7f954f7fe640 1 -- 172.21.15.146:0/2677581776 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f966804a030 con 0x55e5cb84cee0 2024-09-18T01:45:26.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.541+0000 7f954f7fe640 1 -- 172.21.15.146:0/2677581776 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f966802a350 con 0x55e5cb84cee0 2024-09-18T01:45:26.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.541+0000 7f967500f800 1 -- 172.21.15.146:0/2677581776 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e5cb84cee0 msgr2=0x55e5cb84d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.541+0000 7f967500f800 1 --2- 172.21.15.146:0/2677581776 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e5cb84cee0 0x55e5cb84d2e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f966804c960 tx=0x7f966804cb60 comp rx=0 tx=0).stop 2024-09-18T01:45:26.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.541+0000 7f967500f800 1 -- 172.21.15.146:0/2677581776 shutdown_connections 2024-09-18T01:45:26.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.541+0000 7f967500f800 1 --2- 172.21.15.146:0/2677581776 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e5cb84cee0 0x55e5cb84d2e0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.541+0000 7f967500f800 1 -- 172.21.15.146:0/2677581776 >> 172.21.15.146:0/2677581776 conn(0x55e5cb849290 msgr2=0x55e5cb847390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:26.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.541+0000 7f967500f800 1 -- 172.21.15.146:0/2677581776 shutdown_connections 2024-09-18T01:45:26.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.541+0000 7f967500f800 1 -- 172.21.15.146:0/2677581776 wait complete. 2024-09-18T01:45:26.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.542+0000 7f967500f800 1 Processor -- start 2024-09-18T01:45:26.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.542+0000 7f967500f800 1 -- start start 2024-09-18T01:45:26.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.542+0000 7f967500f800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e5cb84cee0 0x55e5cb854320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.542+0000 7f967500f800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55e5cb84de80 con 0x55e5cb84cee0 2024-09-18T01:45:26.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.542+0000 7f9670ee8640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e5cb84cee0 0x55e5cb854320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.542+0000 7f9670ee8640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e5cb84cee0 0x55e5cb854320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60824/0 (socket says 172.21.15.146:60824) 2024-09-18T01:45:26.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.542+0000 7f9670ee8640 1 -- 172.21.15.146:0/2628411447 learned_addr learned my addr 172.21.15.146:0/2628411447 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:26.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.542+0000 7f9670ee8640 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5cb854860 con 0x55e5cb84cee0 2024-09-18T01:45:26.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.542+0000 7f9670ee8640 1 --2- 172.21.15.146:0/2628411447 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e5cb84cee0 0x55e5cb854320 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f966804c960 tx=0x7f966804c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.542+0000 7f954dffb640 1 -- 172.21.15.146:0/2628411447 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f966802a8e0 con 0x55e5cb84cee0 2024-09-18T01:45:26.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.542+0000 7f954dffb640 1 -- 172.21.15.146:0/2628411447 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f966804e0d0 con 0x55e5cb84cee0 2024-09-18T01:45:26.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.542+0000 7f954dffb640 1 -- 172.21.15.146:0/2628411447 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f966804e3b0 con 0x55e5cb84cee0 2024-09-18T01:45:26.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.542+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e5cb854af0 con 0x55e5cb84cee0 2024-09-18T01:45:26.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.543+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5cb8577a0 con 0x55e5cb84cee0 2024-09-18T01:45:26.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.543+0000 7f954dffb640 1 -- 172.21.15.146:0/2628411447 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9668013af0 con 0x55e5cb84cee0 2024-09-18T01:45:26.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.543+0000 7f954dffb640 1 --2- 172.21.15.146:0/2628411447 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9540036b90 0x7f9540039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.543+0000 7f954dffb640 1 -- 172.21.15.146:0/2628411447 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f9668032070 con 0x55e5cb84cee0 2024-09-18T01:45:26.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.543+0000 7f96706e7640 1 --2- 172.21.15.146:0/2628411447 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9540036b90 0x7f9540039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.544+0000 7f967500f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.544+0000 7f967500f800 1 --2- 172.21.15.146:0/2628411447 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55e5cb860020 0x55e5cb8624e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.544+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb862c30 con 0x55e5cb860020 2024-09-18T01:45:26.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.544+0000 7f9667fff640 1 --2- 172.21.15.146:0/2628411447 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55e5cb860020 0x55e5cb8624e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.544+0000 7f96706e7640 1 --2- 172.21.15.146:0/2628411447 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9540036b90 0x7f9540039050 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9660017a60 tx=0x7f9660037000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.544+0000 7f9667fff640 1 --2- 172.21.15.146:0/2628411447 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55e5cb860020 0x55e5cb8624e0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.544+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9658051070 con 0x55e5cb860020 2024-09-18T01:45:26.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.544+0000 7f967500f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:26.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.544+0000 7f967500f800 20 realm 2024-09-18T01:45:26.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.544+0000 7f967500f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.544+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb863060 con 0x55e5cb860020 2024-09-18T01:45:26.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.545+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9658051070 con 0x55e5cb860020 2024-09-18T01:45:26.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.545+0000 7f967500f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:26.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.545+0000 7f967500f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:26.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.545+0000 7f967500f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.545+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb863930 con 0x55e5cb860020 2024-09-18T01:45:26.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.545+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9658051070 con 0x55e5cb860020 2024-09-18T01:45:26.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.545+0000 7f967500f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:26.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.545+0000 7f967500f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.545+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb863cd0 con 0x55e5cb860020 2024-09-18T01:45:26.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.545+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9658051070 con 0x55e5cb860020 2024-09-18T01:45:26.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.545+0000 7f967500f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:26.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.545+0000 7f967500f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.545+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb863540 con 0x55e5cb860020 2024-09-18T01:45:26.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.545+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9658051070 con 0x55e5cb860020 2024-09-18T01:45:26.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.545+0000 7f967500f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:26.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.545+0000 7f967500f800 20 searching for the correct realm 2024-09-18T01:45:26.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.545+0000 7f967500f800 1 --2- 172.21.15.146:0/2628411447 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55e5cb866190 0x55e5cb8685a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.545+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb868c70 con 0x55e5cb866190 2024-09-18T01:45:26.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.545+0000 7f9670ee8640 1 --2- 172.21.15.146:0/2628411447 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55e5cb866190 0x55e5cb8685a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.546+0000 7f9670ee8640 1 --2- 172.21.15.146:0/2628411447 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55e5cb866190 0x55e5cb8685a0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.546+0000 7f9670ee8640 1 -- 172.21.15.146:0/2628411447 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f966803c020 con 0x55e5cb866190 2024-09-18T01:45:26.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.546+0000 7f9670ee8640 1 --2- 172.21.15.146:0/2628411447 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f9668014030 0x7f9668001540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.546+0000 7f9670ee8640 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb868c70 con 0x7f9668014030 2024-09-18T01:45:26.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.546+0000 7f96706e7640 1 --2- 172.21.15.146:0/2628411447 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f9668014030 0x7f9668001540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.546+0000 7f96706e7640 1 --2- 172.21.15.146:0/2628411447 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f9668014030 0x7f9668001540 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.547+0000 7f96706e7640 1 -- 172.21.15.146:0/2628411447 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9660029030 con 0x7f9668014030 2024-09-18T01:45:26.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.547+0000 7f96706e7640 1 --2- 172.21.15.146:0/2628411447 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f966002c060 0x7f966000c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.547+0000 7f96706e7640 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb868c70 con 0x7f966002c060 2024-09-18T01:45:26.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.547+0000 7f9667fff640 1 --2- 172.21.15.146:0/2628411447 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f966002c060 0x7f966000c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.547+0000 7f9667fff640 1 --2- 172.21.15.146:0/2628411447 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f966002c060 0x7f966000c590 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.547+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9658051070 con 0x7f966002c060 2024-09-18T01:45:26.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.547+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb868c70 con 0x55e5cb860020 2024-09-18T01:45:26.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.548+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9658051070 con 0x55e5cb860020 2024-09-18T01:45:26.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.548+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb868c70 con 0x55e5cb860020 2024-09-18T01:45:26.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.548+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9658051070 con 0x55e5cb860020 2024-09-18T01:45:26.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.548+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb868c70 con 0x7f966002c060 2024-09-18T01:45:26.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.548+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9658051070 con 0x7f966002c060 2024-09-18T01:45:26.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.548+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb868c70 con 0x7f966002c060 2024-09-18T01:45:26.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.548+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9658051070 con 0x7f966002c060 2024-09-18T01:45:26.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.548+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb868c70 con 0x7f9668014030 2024-09-18T01:45:26.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.549+0000 7f96706e7640 1 -- 172.21.15.146:0/2628411447 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9660029030 con 0x7f9668014030 2024-09-18T01:45:26.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.549+0000 7f96706e7640 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb868c70 con 0x55e5cb866190 2024-09-18T01:45:26.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.549+0000 7f9670ee8640 1 -- 172.21.15.146:0/2628411447 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f966803c020 con 0x55e5cb866190 2024-09-18T01:45:26.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.549+0000 7f9670ee8640 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb868c70 con 0x55e5cb860020 2024-09-18T01:45:26.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.549+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9658051070 con 0x55e5cb860020 2024-09-18T01:45:26.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.549+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb868c70 con 0x7f966002c060 2024-09-18T01:45:26.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.549+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9658051070 con 0x7f966002c060 2024-09-18T01:45:26.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.549+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb868c70 con 0x55e5cb860020 2024-09-18T01:45:26.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.549+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9658051070 con 0x55e5cb860020 2024-09-18T01:45:26.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.549+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb868c70 con 0x7f9668014030 2024-09-18T01:45:26.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.550+0000 7f96706e7640 1 -- 172.21.15.146:0/2628411447 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f9660029030 con 0x7f9668014030 2024-09-18T01:45:26.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.550+0000 7f96706e7640 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb868c70 con 0x55e5cb866190 2024-09-18T01:45:26.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.550+0000 7f9670ee8640 1 -- 172.21.15.146:0/2628411447 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f966803c020 con 0x55e5cb866190 2024-09-18T01:45:26.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.550+0000 7f9670ee8640 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb868c70 con 0x55e5cb866190 2024-09-18T01:45:26.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.550+0000 7f9670ee8640 1 -- 172.21.15.146:0/2628411447 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f966803c020 con 0x55e5cb866190 2024-09-18T01:45:26.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.550+0000 7f9670ee8640 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb868c70 con 0x7f966002c060 2024-09-18T01:45:26.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.550+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9658051070 con 0x7f966002c060 2024-09-18T01:45:26.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.550+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb868c70 con 0x55e5cb866190 2024-09-18T01:45:26.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.551+0000 7f9670ee8640 1 -- 172.21.15.146:0/2628411447 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f966803c020 con 0x55e5cb866190 2024-09-18T01:45:26.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.551+0000 7f9670ee8640 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb868c70 con 0x55e5cb866190 2024-09-18T01:45:26.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.551+0000 7f9670ee8640 1 -- 172.21.15.146:0/2628411447 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f966803c020 con 0x55e5cb866190 2024-09-18T01:45:26.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.551+0000 7f9670ee8640 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb868c70 con 0x55e5cb860020 2024-09-18T01:45:26.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.551+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9658051070 con 0x55e5cb860020 2024-09-18T01:45:26.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.551+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb868c70 con 0x55e5cb860020 2024-09-18T01:45:26.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.551+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9658051070 con 0x55e5cb860020 2024-09-18T01:45:26.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.551+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb868c70 con 0x7f966002c060 2024-09-18T01:45:26.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.552+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9658051070 con 0x7f966002c060 2024-09-18T01:45:26.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.552+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb868c70 con 0x55e5cb866190 2024-09-18T01:45:26.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.552+0000 7f9670ee8640 1 -- 172.21.15.146:0/2628411447 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f966803c020 con 0x55e5cb866190 2024-09-18T01:45:26.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.552+0000 7f9670ee8640 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb868c70 con 0x7f9668014030 2024-09-18T01:45:26.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.552+0000 7f96706e7640 1 -- 172.21.15.146:0/2628411447 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9660029030 con 0x7f9668014030 2024-09-18T01:45:26.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.552+0000 7f96706e7640 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb868c70 con 0x55e5cb860020 2024-09-18T01:45:26.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.552+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9658051070 con 0x55e5cb860020 2024-09-18T01:45:26.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.552+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb868c70 con 0x7f966002c060 2024-09-18T01:45:26.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.553+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9658051070 con 0x7f966002c060 2024-09-18T01:45:26.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.553+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb868c70 con 0x55e5cb866190 2024-09-18T01:45:26.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.553+0000 7f9670ee8640 1 -- 172.21.15.146:0/2628411447 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f966803c020 con 0x55e5cb866190 2024-09-18T01:45:26.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.553+0000 7f9670ee8640 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb868c70 con 0x7f966002c060 2024-09-18T01:45:26.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.553+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9658051070 con 0x7f966002c060 2024-09-18T01:45:26.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.553+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb868c70 con 0x7f9668014030 2024-09-18T01:45:26.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.553+0000 7f96706e7640 1 -- 172.21.15.146:0/2628411447 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9660029030 con 0x7f9668014030 2024-09-18T01:45:26.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.553+0000 7f96706e7640 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb868c70 con 0x55e5cb866190 2024-09-18T01:45:26.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.553+0000 7f9670ee8640 1 -- 172.21.15.146:0/2628411447 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f966803c020 con 0x55e5cb866190 2024-09-18T01:45:26.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.553+0000 7f9670ee8640 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb868c70 con 0x7f966002c060 2024-09-18T01:45:26.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.554+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9658051070 con 0x7f966002c060 2024-09-18T01:45:26.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.554+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb868c70 con 0x55e5cb860020 2024-09-18T01:45:26.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.554+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9658051070 con 0x55e5cb860020 2024-09-18T01:45:26.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.554+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb868c70 con 0x7f9668014030 2024-09-18T01:45:26.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.554+0000 7f96706e7640 1 -- 172.21.15.146:0/2628411447 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9660062040 con 0x7f9668014030 2024-09-18T01:45:26.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.554+0000 7f967500f800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:26.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.554+0000 7f967500f800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:26.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.554+0000 7f967500f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:26.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.554+0000 7f967500f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:26.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.554+0000 7f967500f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:26.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.554+0000 7f967500f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:26.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.554+0000 7f967500f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.554+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb864be0 con 0x55e5cb860020 2024-09-18T01:45:26.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.555+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9658051070 con 0x55e5cb860020 2024-09-18T01:45:26.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.555+0000 7f967500f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:26.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.555+0000 7f967500f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.555+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb865480 con 0x55e5cb860020 2024-09-18T01:45:26.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.555+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9658051070 con 0x55e5cb860020 2024-09-18T01:45:26.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.555+0000 7f967500f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:26.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.555+0000 7f967500f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.555+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb864820 con 0x7f9668014030 2024-09-18T01:45:26.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.555+0000 7f96706e7640 1 -- 172.21.15.146:0/2628411447 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9660062040 con 0x7f9668014030 2024-09-18T01:45:26.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.555+0000 7f967500f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:26.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.555+0000 7f967500f800 20 zone default found 2024-09-18T01:45:26.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.555+0000 7f967500f800 4 Realm: () 2024-09-18T01:45:26.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.555+0000 7f967500f800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:26.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.555+0000 7f967500f800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:26.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.555+0000 7f967500f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:26.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.555+0000 7f967500f800 20 zonegroup default 2024-09-18T01:45:26.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.555+0000 7f967500f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.555+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb8695a0 con 0x7f966002c060 2024-09-18T01:45:26.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.555+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9658051070 con 0x7f966002c060 2024-09-18T01:45:26.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.555+0000 7f967500f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:26.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.555+0000 7f967500f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.555+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb86b100 con 0x55e5cb866190 2024-09-18T01:45:26.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.556+0000 7f9670ee8640 1 -- 172.21.15.146:0/2628411447 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f966803c020 con 0x55e5cb866190 2024-09-18T01:45:26.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.556+0000 7f967500f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:26.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.556+0000 7f967500f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.556+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb86b570 con 0x55e5cb866190 2024-09-18T01:45:26.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.556+0000 7f9670ee8640 1 -- 172.21.15.146:0/2628411447 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f966803c020 con 0x55e5cb866190 2024-09-18T01:45:26.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.556+0000 7f967500f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:26.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.556+0000 7f967500f800 20 started sync module instance, tier type = 2024-09-18T01:45:26.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.556+0000 7f967500f800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:26.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.556+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb86a000 con 0x7f9668014030 2024-09-18T01:45:26.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.557+0000 7f96706e7640 1 -- 172.21.15.146:0/2628411447 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v31'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9660062040 con 0x7f9668014030 2024-09-18T01:45:26.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.557+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94445450470384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb869c60 con 0x7f9668014030 2024-09-18T01:45:26.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.557+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb86c480 con 0x55e5cb860020 2024-09-18T01:45:26.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.558+0000 7f96706e7640 1 -- 172.21.15.146:0/2628411447 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94445450470384] v31'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9660062040 con 0x7f9668014030 2024-09-18T01:45:26.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.558+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v31'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9658051070 con 0x55e5cb860020 2024-09-18T01:45:26.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.558+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94445450477520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb86c3f0 con 0x55e5cb860020 2024-09-18T01:45:26.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.558+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb86d340 con 0x55e5cb866190 2024-09-18T01:45:26.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.559+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94445450477520] v31'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9658051070 con 0x55e5cb860020 2024-09-18T01:45:26.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.559+0000 7f9670ee8640 1 -- 172.21.15.146:0/2628411447 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v31'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f966803c020 con 0x55e5cb866190 2024-09-18T01:45:26.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.559+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94445450479728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb86d340 con 0x55e5cb866190 2024-09-18T01:45:26.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.559+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb86ddd0 con 0x7f9668014030 2024-09-18T01:45:26.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.560+0000 7f9670ee8640 1 -- 172.21.15.146:0/2628411447 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94445450479728] v31'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f966803c020 con 0x55e5cb866190 2024-09-18T01:45:26.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.561+0000 7f96706e7640 1 -- 172.21.15.146:0/2628411447 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v31'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9660062040 con 0x7f9668014030 2024-09-18T01:45:26.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.561+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94445450481296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb86d2b0 con 0x7f9668014030 2024-09-18T01:45:26.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.561+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb86ec90 con 0x55e5cb860020 2024-09-18T01:45:26.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.562+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v31'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9658051070 con 0x55e5cb860020 2024-09-18T01:45:26.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.562+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94445450487776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb86ec00 con 0x55e5cb860020 2024-09-18T01:45:26.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.562+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb86fbc0 con 0x7f966002c060 2024-09-18T01:45:26.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.562+0000 7f96706e7640 1 -- 172.21.15.146:0/2628411447 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94445450481296] v31'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9660062040 con 0x7f9668014030 2024-09-18T01:45:26.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.563+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v31'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9658051070 con 0x7f966002c060 2024-09-18T01:45:26.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.563+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94445450487776] v31'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9658051070 con 0x55e5cb860020 2024-09-18T01:45:26.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.563+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94445450491600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb86fbc0 con 0x7f966002c060 2024-09-18T01:45:26.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.563+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb86f0c0 con 0x7f966002c060 2024-09-18T01:45:26.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.564+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94445450491600] v31'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9658051070 con 0x7f966002c060 2024-09-18T01:45:26.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.564+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v31'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9658051070 con 0x7f966002c060 2024-09-18T01:45:26.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.564+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94445450489984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb870100 con 0x7f966002c060 2024-09-18T01:45:26.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.564+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb870ac0 con 0x7f966002c060 2024-09-18T01:45:26.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.565+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94445450489984] v31'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9658051070 con 0x7f966002c060 2024-09-18T01:45:26.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.565+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v31'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9658051070 con 0x7f966002c060 2024-09-18T01:45:26.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.565+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94445450486208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb870ac0 con 0x7f966002c060 2024-09-18T01:45:26.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.565+0000 7f967500f800 20 add_watcher() i=0 2024-09-18T01:45:26.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.565+0000 7f967500f800 20 add_watcher() i=1 2024-09-18T01:45:26.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.565+0000 7f967500f800 20 add_watcher() i=2 2024-09-18T01:45:26.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.565+0000 7f967500f800 20 add_watcher() i=3 2024-09-18T01:45:26.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.565+0000 7f967500f800 20 add_watcher() i=4 2024-09-18T01:45:26.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.565+0000 7f967500f800 20 add_watcher() i=5 2024-09-18T01:45:26.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.565+0000 7f967500f800 20 add_watcher() i=6 2024-09-18T01:45:26.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.566+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94445450486208] v31'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9658051070 con 0x7f966002c060 2024-09-18T01:45:26.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.566+0000 7f967500f800 20 add_watcher() i=7 2024-09-18T01:45:26.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.566+0000 7f967500f800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:26.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.566+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb873e20 con 0x55e5cb860020 2024-09-18T01:45:26.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.566+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9658051070 con 0x55e5cb860020 2024-09-18T01:45:26.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.566+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94445450495872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb871050 con 0x55e5cb860020 2024-09-18T01:45:26.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.567+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94445450495872] v31'108 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9658051070 con 0x55e5cb860020 2024-09-18T01:45:26.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.567+0000 7f95267e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:26.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.567+0000 7f967500f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:26.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.567+0000 7f967500f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:26.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.567+0000 7f967500f800 5 note: GC not initialized 2024-09-18T01:45:26.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.568+0000 7f95257e2640 20 reqs_thread_entry: start 2024-09-18T01:45:26.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.568+0000 7f967500f800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:26.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.568+0000 7f967500f800 20 Filter name: none 2024-09-18T01:45:26.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.568+0000 7f9496ffd640 20 reqs_thread_entry: start 2024-09-18T01:45:26.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.568+0000 7f967500f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.568+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb8a6d80 con 0x55e5cb860020 2024-09-18T01:45:26.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.568+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f9658051070 con 0x55e5cb860020 2024-09-18T01:45:26.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.568+0000 7f967500f800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:45:26.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.568+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb8a82d0 con 0x7f9668014030 2024-09-18T01:45:26.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.569+0000 7f96706e7640 1 -- 172.21.15.146:0/2628411447 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f9660062040 con 0x7f9668014030 2024-09-18T01:45:26.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.569+0000 7f967500f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.569+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:64 8.13 8:ceaa8859:root::.bucket.meta.myfoo%3a8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb8a82d0 con 0x7f966002c060 2024-09-18T01:45:26.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.569+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(64 .bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f9658051070 con 0x7f966002c060 2024-09-18T01:45:26.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.569+0000 7f967500f800 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T01:45:26.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.569+0000 7f967500f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-18T01:45:26.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.569+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:65 4.33 4:cd49ce18:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb8a9d90 con 0x7f966002c060 2024-09-18T01:45:26.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.569+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:66 4.10 4:083380d8:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb8aca00 con 0x55e5cb866190 2024-09-18T01:45:26.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.569+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:67 4.15 4:a8d62d11:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb8af2f0 con 0x55e5cb866190 2024-09-18T01:45:26.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.569+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:68 4.36 4:6d8e27f1:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb8b1ed0 con 0x55e5cb860020 2024-09-18T01:45:26.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.569+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:69 4.19 4:98d692f3:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb8b4740 con 0x55e5cb866190 2024-09-18T01:45:26.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.569+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:70 4.13 4:cabe8116:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb8b7030 con 0x7f9668014030 2024-09-18T01:45:26.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.569+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:71 4.16 4:6b798858:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb8b9500 con 0x55e5cb866190 2024-09-18T01:45:26.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.569+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:72 4.14 4:2ab8464f:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb8bbb10 con 0x55e5cb866190 2024-09-18T01:45:26.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.569+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:73 4.3e 4:7ce77e2d:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb8be4a0 con 0x7f9668014030 2024-09-18T01:45:26.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.570+0000 7f9670ee8640 1 -- 172.21.15.146:0/2628411447 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(66 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f966803c020 con 0x55e5cb866190 2024-09-18T01:45:26.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.570+0000 7f9670ee8640 1 -- 172.21.15.146:0/2628411447 <== osd.3 v2:172.21.15.146:6809/4106661138 15 ==== osd_op_reply(67 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f966803c020 con 0x55e5cb866190 2024-09-18T01:45:26.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.570+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:74 4.2d 4:b678784f:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb8ace20 con 0x7f966002c060 2024-09-18T01:45:26.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.570+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:75 4.10 4:0ad5fa93:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb8bee10 con 0x55e5cb866190 2024-09-18T01:45:26.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.570+0000 7f9670ee8640 1 -- 172.21.15.146:0/2628411447 <== osd.3 v2:172.21.15.146:6809/4106661138 16 ==== osd_op_reply(71 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f966803c020 con 0x55e5cb866190 2024-09-18T01:45:26.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.570+0000 7f9670ee8640 1 -- 172.21.15.146:0/2628411447 <== osd.3 v2:172.21.15.146:6809/4106661138 17 ==== osd_op_reply(72 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f966803c020 con 0x55e5cb866190 2024-09-18T01:45:26.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.570+0000 7f9670ee8640 1 -- 172.21.15.146:0/2628411447 <== osd.3 v2:172.21.15.146:6809/4106661138 18 ==== osd_op_reply(69 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f966803c020 con 0x55e5cb866190 2024-09-18T01:45:26.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.570+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(65 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9658083060 con 0x7f966002c060 2024-09-18T01:45:26.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.570+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(68 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9658083060 con 0x55e5cb860020 2024-09-18T01:45:26.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.570+0000 7f96706e7640 1 -- 172.21.15.146:0/2628411447 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(70 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.5 [call out=124b] v0'0 uv3 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f9660062040 con 0x7f9668014030 2024-09-18T01:45:26.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.570+0000 7f96706e7640 1 -- 172.21.15.146:0/2628411447 <== osd.2 v2:172.21.15.146:6800/3820039304 14 ==== osd_op_reply(73 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9660062040 con 0x7f9668014030 2024-09-18T01:45:26.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.570+0000 7f9670ee8640 1 -- 172.21.15.146:0/2628411447 <== osd.3 v2:172.21.15.146:6809/4106661138 19 ==== osd_op_reply(75 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.10 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f966803c020 con 0x55e5cb866190 2024-09-18T01:45:26.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.570+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(74 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9658083060 con 0x7f966002c060 2024-09-18T01:45:26.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.570+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:76 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb8ac370 con 0x7f9668014030 2024-09-18T01:45:26.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.571+0000 7f96706e7640 1 -- 172.21.15.146:0/2628411447 <== osd.2 v2:172.21.15.146:6800/3820039304 15 ==== osd_op_reply(76 foo.buckets [call] v31'15 uv15 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f9660062040 con 0x7f9668014030 2024-09-18T01:45:26.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.571+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:77 8.9 8:96d98480:users.uid::foo.buckets:head [call user.complete_stats_sync in=37b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb8ac350 con 0x7f9668014030 2024-09-18T01:45:26.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.572+0000 7f96706e7640 1 -- 172.21.15.146:0/2628411447 <== osd.2 v2:172.21.15.146:6800/3820039304 16 ==== osd_op_reply(77 foo.buckets [call] v31'16 uv16 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f9660062040 con 0x7f9668014030 2024-09-18T01:45:26.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.572+0000 7f967500f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.572+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:78 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb8ac350 con 0x55e5cb860020 2024-09-18T01:45:26.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.573+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(78 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f9658083060 con 0x55e5cb860020 2024-09-18T01:45:26.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.573+0000 7f967500f800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:45:26.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.573+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:79 8.9 8:96d98480:users.uid::foo.buckets:head [call user.get_header in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb8b1980 con 0x7f9668014030 2024-09-18T01:45:26.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.573+0000 7f96706e7640 1 -- 172.21.15.146:0/2628411447 <== osd.2 v2:172.21.15.146:6800/3820039304 17 ==== osd_op_reply(79 foo.buckets [call out=58b] v0'0 uv16 ondisk = 0) ==== 155+0+58 (crc 0 0 0) 0x7f9660062040 con 0x7f9668014030 2024-09-18T01:45:26.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.574+0000 7f95267e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:26.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.574+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:80 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94445450495872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb8a4b90 con 0x55e5cb860020 2024-09-18T01:45:26.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.575+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(80 data_loggenerations_metadata [watch unwatch cookie 94445450495872] v31'109 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9658083060 con 0x55e5cb860020 2024-09-18T01:45:26.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.575+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:81 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94445450470384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb8a4b90 con 0x7f9668014030 2024-09-18T01:45:26.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.575+0000 7f96706e7640 1 -- 172.21.15.146:0/2628411447 <== osd.2 v2:172.21.15.146:6800/3820039304 18 ==== osd_op_reply(81 notify.0 [watch unwatch cookie 94445450470384] v31'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9660062040 con 0x7f9668014030 2024-09-18T01:45:26.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.576+0000 7f967500f800 20 remove_watcher() i=0 2024-09-18T01:45:26.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.576+0000 7f967500f800 2 removed watcher, disabling cache 2024-09-18T01:45:26.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.576+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:82 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94445450477520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb8a4b90 con 0x55e5cb860020 2024-09-18T01:45:26.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.577+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(82 notify.1 [watch unwatch cookie 94445450477520] v31'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9658083060 con 0x55e5cb860020 2024-09-18T01:45:26.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.577+0000 7f967500f800 20 remove_watcher() i=1 2024-09-18T01:45:26.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.577+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:83 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94445450479728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb8a4b90 con 0x55e5cb866190 2024-09-18T01:45:26.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.578+0000 7f9670ee8640 1 -- 172.21.15.146:0/2628411447 <== osd.3 v2:172.21.15.146:6809/4106661138 20 ==== osd_op_reply(83 notify.2 [watch unwatch cookie 94445450479728] v31'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f966803c020 con 0x55e5cb866190 2024-09-18T01:45:26.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.578+0000 7f967500f800 20 remove_watcher() i=2 2024-09-18T01:45:26.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.578+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:84 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94445450481296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb8a4b90 con 0x7f9668014030 2024-09-18T01:45:26.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.579+0000 7f96706e7640 1 -- 172.21.15.146:0/2628411447 <== osd.2 v2:172.21.15.146:6800/3820039304 19 ==== osd_op_reply(84 notify.3 [watch unwatch cookie 94445450481296] v31'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9660062040 con 0x7f9668014030 2024-09-18T01:45:26.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.579+0000 7f967500f800 20 remove_watcher() i=3 2024-09-18T01:45:26.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.579+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:85 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94445450487776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb8a4b90 con 0x55e5cb860020 2024-09-18T01:45:26.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.580+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== osd_op_reply(85 notify.4 [watch unwatch cookie 94445450487776] v31'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9658083060 con 0x55e5cb860020 2024-09-18T01:45:26.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.580+0000 7f967500f800 20 remove_watcher() i=4 2024-09-18T01:45:26.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.580+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:86 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94445450491600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb8a4b90 con 0x7f966002c060 2024-09-18T01:45:26.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.581+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(86 notify.5 [watch unwatch cookie 94445450491600] v31'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9658083060 con 0x7f966002c060 2024-09-18T01:45:26.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.581+0000 7f967500f800 20 remove_watcher() i=5 2024-09-18T01:45:26.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.581+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:87 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94445450489984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb8a4b90 con 0x7f966002c060 2024-09-18T01:45:26.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.581+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== osd_op_reply(87 notify.6 [watch unwatch cookie 94445450489984] v31'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9658083060 con 0x7f966002c060 2024-09-18T01:45:26.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.582+0000 7f967500f800 20 remove_watcher() i=6 2024-09-18T01:45:26.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.582+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:88 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94445450486208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5cb8a4b90 con 0x7f966002c060 2024-09-18T01:45:26.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.582+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 <== osd.0 v2:172.21.15.129:6800/1759265424 22 ==== osd_op_reply(88 notify.7 [watch unwatch cookie 94445450486208] v31'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9658083060 con 0x7f966002c060 2024-09-18T01:45:26.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.582+0000 7f967500f800 20 remove_watcher() i=7 2024-09-18T01:45:26.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.583+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f966002c060 msgr2=0x7f966000c590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.583+0000 7f967500f800 1 --2- 172.21.15.146:0/2628411447 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f966002c060 0x7f966000c590 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.583+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55e5cb860020 msgr2=0x55e5cb8624e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.583+0000 7f967500f800 1 --2- 172.21.15.146:0/2628411447 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55e5cb860020 0x55e5cb8624e0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.583+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f9668014030 msgr2=0x7f9668001540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.583+0000 7f967500f800 1 --2- 172.21.15.146:0/2628411447 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f9668014030 0x7f9668001540 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.583+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55e5cb866190 msgr2=0x55e5cb8685a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.583+0000 7f967500f800 1 --2- 172.21.15.146:0/2628411447 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55e5cb866190 0x55e5cb8685a0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.583+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9540036b90 msgr2=0x7f9540039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.583+0000 7f967500f800 1 --2- 172.21.15.146:0/2628411447 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9540036b90 0x7f9540039050 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9660017a60 tx=0x7f9660037000 comp rx=0 tx=0).stop 2024-09-18T01:45:26.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.583+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e5cb84cee0 msgr2=0x55e5cb854320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.583+0000 7f9667fff640 1 -- 172.21.15.146:0/2628411447 reap_dead start 2024-09-18T01:45:26.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.583+0000 7f967500f800 1 --2- 172.21.15.146:0/2628411447 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e5cb84cee0 0x55e5cb854320 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f966804c960 tx=0x7f966804c8f0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.583+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 shutdown_connections 2024-09-18T01:45:26.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.583+0000 7f967500f800 1 --2- 172.21.15.146:0/2628411447 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e5cb84cee0 0x55e5cb854320 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.583+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 >> 172.21.15.146:0/2628411447 conn(0x55e5cb849290 msgr2=0x55e5cb84e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:26.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.583+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 shutdown_connections 2024-09-18T01:45:26.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.583+0000 7f967500f800 1 -- 172.21.15.146:0/2628411447 wait complete. 2024-09-18T01:45:26.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.583+0000 7f967500f800 1 -- 172.21.15.146:0/3343654355 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9548036b40 msgr2=0x7f9548039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.583+0000 7f967500f800 1 --2- 172.21.15.146:0/3343654355 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9548036b40 0x7f9548039000 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x55e5cb82bba0 tx=0x7f966002ae80 comp rx=0 tx=0).stop 2024-09-18T01:45:26.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.583+0000 7f967500f800 1 -- 172.21.15.146:0/3343654355 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e5cb6a2760 msgr2=0x55e5cb6a0db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.583+0000 7f967500f800 1 --2- 172.21.15.146:0/3343654355 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e5cb6a2760 0x55e5cb6a0db0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x55e5cb82aca0 tx=0x7f96680178e0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.583+0000 7f967500f800 1 -- 172.21.15.146:0/3343654355 shutdown_connections 2024-09-18T01:45:26.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.583+0000 7f967500f800 1 --2- 172.21.15.146:0/3343654355 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9548036b40 0x7f9548039000 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.583+0000 7f967500f800 1 --2- 172.21.15.146:0/3343654355 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e5cb6a2760 0x55e5cb6a0db0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.583+0000 7f967500f800 1 -- 172.21.15.146:0/3343654355 >> 172.21.15.146:0/3343654355 conn(0x55e5cb832fd0 msgr2=0x55e5cb835b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:26.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.583+0000 7f967500f800 1 -- 172.21.15.146:0/3343654355 shutdown_connections 2024-09-18T01:45:26.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.583+0000 7f967500f800 1 -- 172.21.15.146:0/3343654355 wait complete. 2024-09-18T01:45:26.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.584+0000 7f967500f800 1 -- 172.21.15.146:0/1809419649 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55e5cb730a10 msgr2=0x55e5cb82a2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.584+0000 7f967500f800 1 --2- 172.21.15.146:0/1809419649 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55e5cb730a10 0x55e5cb82a2f0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.584+0000 7f967500f800 1 -- 172.21.15.146:0/1809419649 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55e5cb82c2a0 msgr2=0x55e5cb82fb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.584+0000 7f967500f800 1 --2- 172.21.15.146:0/1809419649 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55e5cb82c2a0 0x55e5cb82fb00 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.584+0000 7f967500f800 1 -- 172.21.15.146:0/1809419649 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9558036b40 msgr2=0x7f9558039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.584+0000 7f967500f800 1 --2- 172.21.15.146:0/1809419649 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9558036b40 0x7f9558039000 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9658057000 tx=0x7f9658052000 comp rx=0 tx=0).stop 2024-09-18T01:45:26.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.584+0000 7f967500f800 1 -- 172.21.15.146:0/1809419649 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e5cb72c710 msgr2=0x55e5cb823280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.584+0000 7f967500f800 1 --2- 172.21.15.146:0/1809419649 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e5cb72c710 0x55e5cb823280 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9660004000 tx=0x7f9660000bc0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.584+0000 7f967500f800 1 -- 172.21.15.146:0/1809419649 shutdown_connections 2024-09-18T01:45:26.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.584+0000 7f967500f800 1 --2- 172.21.15.146:0/1809419649 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55e5cb82c2a0 0x55e5cb82fb00 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.584+0000 7f967500f800 1 --2- 172.21.15.146:0/1809419649 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55e5cb730a10 0x55e5cb82a2f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.584+0000 7f967500f800 1 --2- 172.21.15.146:0/1809419649 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9558036b40 0x7f9558039000 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.584+0000 7f967500f800 1 --2- 172.21.15.146:0/1809419649 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e5cb72c710 0x55e5cb823280 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.584+0000 7f967500f800 1 -- 172.21.15.146:0/1809419649 >> 172.21.15.146:0/1809419649 conn(0x55e5cb727fe0 msgr2=0x55e5cb815ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:26.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.584+0000 7f967500f800 1 -- 172.21.15.146:0/1809419649 shutdown_connections 2024-09-18T01:45:26.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.584+0000 7f967500f800 1 -- 172.21.15.146:0/1809419649 wait complete. 2024-09-18T01:45:26.597 INFO:teuthology.orchestra.run.smithi146.stdout:{"stats":{"size":3,"size_actual":4096,"size_kb":1,"size_kb_actual":4,"num_objects":1},"last_stats_sync":"2024-09-18T01:45:26.572237Z","last_stats_update":"2024-09-18T01:45:26.571176Z"} 2024-09-18T01:45:26.597 DEBUG:tasks.util.rgw: json result: {'stats': {'size': 3, 'size_actual': 4096, 'size_kb': 1, 'size_kb_actual': 4, 'num_objects': 1}, 'last_stats_sync': '2024-09-18T01:45:26.572237Z', 'last_stats_update': '2024-09-18T01:45:26.571176Z'} 2024-09-18T01:45:26.604 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T01:45:26.604 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-18T01:45:26.604 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-18T01:45:26.604 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid foo --bucket myfoo 2024-09-18T01:45:26.650 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:26.650 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:26.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.650+0000 7fafd65af800 1 Processor -- start 2024-09-18T01:45:26.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.650+0000 7fafd65af800 1 -- start start 2024-09-18T01:45:26.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.650+0000 7fafd65af800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55ce95399d20 0x55ce9539c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.650+0000 7fafd65af800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ce95252b30 con 0x55ce95307630 2024-09-18T01:45:26.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.650+0000 7fafd65af800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x55ce95234360 con 0x55ce95399d20 2024-09-18T01:45:26.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.651+0000 7fafcbfff640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55ce95399d20 0x55ce9539c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.651+0000 7fafd40a3640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x55ce95307630 0x55ce95398600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:38980/0 (socket says 172.21.15.146:38980) 2024-09-18T01:45:26.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.651+0000 7fafd40a3640 1 -- 172.21.15.146:0/1555793893 learned_addr learned my addr 172.21.15.146:0/1555793893 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:45:26.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.651+0000 7fafcbfff640 1 -- 172.21.15.146:0/1555793893 >> v1:172.21.15.129:6789/0 conn(0x55ce95307630 legacy=0x55ce95398600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.651+0000 7fafcbfff640 1 -- 172.21.15.146:0/1555793893 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce9525ae00 con 0x55ce95399d20 2024-09-18T01:45:26.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.653+0000 7fafcbfff640 1 --2- 172.21.15.146:0/1555793893 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ce95399d20 0x55ce9539c110 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fafbc00a470 tx=0x7fafbc045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2525d29697b28c68 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.653+0000 7fafd38a2640 1 -- 172.21.15.146:0/1555793893 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafbc053570 con 0x55ce95399d20 2024-09-18T01:45:26.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.653+0000 7fafd38a2640 1 -- 172.21.15.146:0/1555793893 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafbc058070 con 0x55ce95399d20 2024-09-18T01:45:26.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.653+0000 7fafd38a2640 1 -- 172.21.15.146:0/1555793893 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafbc053880 con 0x55ce95399d20 2024-09-18T01:45:26.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.654+0000 7fafd65af800 1 -- 172.21.15.146:0/1555793893 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ce95399d20 msgr2=0x55ce9539c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.654+0000 7fafd65af800 1 --2- 172.21.15.146:0/1555793893 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ce95399d20 0x55ce9539c110 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fafbc00a470 tx=0x7fafbc045a20 comp rx=0 tx=0).stop 2024-09-18T01:45:26.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.654+0000 7fafd65af800 1 -- 172.21.15.146:0/1555793893 shutdown_connections 2024-09-18T01:45:26.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.654+0000 7fafd65af800 1 --2- 172.21.15.146:0/1555793893 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ce95399d20 0x55ce9539c110 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.654+0000 7fafd65af800 1 -- 172.21.15.146:0/1555793893 >> 172.21.15.146:0/1555793893 conn(0x55ce9538ddb0 msgr2=0x55ce953901d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:26.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.654+0000 7fafd65af800 1 -- 172.21.15.146:0/1555793893 shutdown_connections 2024-09-18T01:45:26.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.654+0000 7fafd65af800 1 -- 172.21.15.146:0/1555793893 wait complete. 2024-09-18T01:45:26.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.667+0000 7fafd65af800 1 Processor -- start 2024-09-18T01:45:26.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.668+0000 7fafd65af800 1 -- start start 2024-09-18T01:45:26.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.668+0000 7fafd65af800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ce95307630 0x55ce95484a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.668+0000 7fafd65af800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55ce952df360 con 0x55ce95307630 2024-09-18T01:45:26.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.668+0000 7fafd40a3640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ce95307630 0x55ce95484a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.668+0000 7fafd40a3640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ce95307630 0x55ce95484a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60832/0 (socket says 172.21.15.146:60832) 2024-09-18T01:45:26.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.668+0000 7fafd40a3640 1 -- 172.21.15.146:0/2744740530 learned_addr learned my addr 172.21.15.146:0/2744740530 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:26.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.668+0000 7fafd40a3640 1 -- 172.21.15.146:0/2744740530 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce9522cbc0 con 0x55ce95307630 2024-09-18T01:45:26.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.668+0000 7fafd40a3640 1 --2- 172.21.15.146:0/2744740530 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ce95307630 0x55ce95484a90 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fafc4001e10 tx=0x7fafc400b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bca424d686520a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.669+0000 7faec260c640 1 -- 172.21.15.146:0/2744740530 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafc4012020 con 0x55ce95307630 2024-09-18T01:45:26.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.669+0000 7faec260c640 1 -- 172.21.15.146:0/2744740530 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafc400e5a0 con 0x55ce95307630 2024-09-18T01:45:26.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.669+0000 7faec260c640 1 -- 172.21.15.146:0/2744740530 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafc400e8e0 con 0x55ce95307630 2024-09-18T01:45:26.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.669+0000 7fafd65af800 1 -- 172.21.15.146:0/2744740530 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ce95307630 msgr2=0x55ce95484a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.669+0000 7fafd65af800 1 --2- 172.21.15.146:0/2744740530 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ce95307630 0x55ce95484a90 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fafc4001e10 tx=0x7fafc400b780 comp rx=0 tx=0).stop 2024-09-18T01:45:26.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.669+0000 7fafd65af800 1 -- 172.21.15.146:0/2744740530 shutdown_connections 2024-09-18T01:45:26.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.669+0000 7fafd65af800 1 --2- 172.21.15.146:0/2744740530 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ce95307630 0x55ce95484a90 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.669+0000 7fafd65af800 1 -- 172.21.15.146:0/2744740530 >> 172.21.15.146:0/2744740530 conn(0x55ce9538ddb0 msgr2=0x55ce95480450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:26.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.669+0000 7fafd65af800 1 -- 172.21.15.146:0/2744740530 shutdown_connections 2024-09-18T01:45:26.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.669+0000 7fafd65af800 1 -- 172.21.15.146:0/2744740530 wait complete. 2024-09-18T01:45:26.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.670+0000 7fafd65af800 1 Processor -- start 2024-09-18T01:45:26.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.670+0000 7fafd65af800 1 -- start start 2024-09-18T01:45:26.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.670+0000 7fafd65af800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ce95307630 0x55ce9548c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.670+0000 7fafd65af800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55ce9539c920 con 0x55ce95307630 2024-09-18T01:45:26.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.670+0000 7fafd40a3640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ce95307630 0x55ce9548c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.670+0000 7fafd40a3640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ce95307630 0x55ce9548c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60848/0 (socket says 172.21.15.146:60848) 2024-09-18T01:45:26.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.670+0000 7fafd40a3640 1 -- 172.21.15.146:0/1004106854 learned_addr learned my addr 172.21.15.146:0/1004106854 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:26.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.670+0000 7fafd40a3640 1 -- 172.21.15.146:0/1004106854 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce95240fe0 con 0x55ce95307630 2024-09-18T01:45:26.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.671+0000 7fafd40a3640 1 --2- 172.21.15.146:0/1004106854 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ce95307630 0x55ce9548c470 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fafc4001e10 tx=0x7fafc4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.671+0000 7faec0e09640 1 -- 172.21.15.146:0/1004106854 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafc4012030 con 0x55ce95307630 2024-09-18T01:45:26.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.671+0000 7faec0e09640 1 -- 172.21.15.146:0/1004106854 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafc401a7a0 con 0x55ce95307630 2024-09-18T01:45:26.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.671+0000 7fafd65af800 1 -- 172.21.15.146:0/1004106854 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ce9548c9b0 con 0x55ce95307630 2024-09-18T01:45:26.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.671+0000 7faec0e09640 1 -- 172.21.15.146:0/1004106854 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafc401aac0 con 0x55ce95307630 2024-09-18T01:45:26.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.671+0000 7fafd65af800 1 -- 172.21.15.146:0/1004106854 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce9548ced0 con 0x55ce95307630 2024-09-18T01:45:26.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.672+0000 7faec0e09640 1 -- 172.21.15.146:0/1004106854 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fafc4015020 con 0x55ce95307630 2024-09-18T01:45:26.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.672+0000 7faec0e09640 1 --2- 172.21.15.146:0/1004106854 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7faebc036b40 0x7faebc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.672+0000 7faec0e09640 1 -- 172.21.15.146:0/1004106854 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fafc4020030 con 0x55ce95307630 2024-09-18T01:45:26.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.672+0000 7fafcbfff640 1 --2- 172.21.15.146:0/1004106854 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7faebc036b40 0x7faebc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.672+0000 7fafd65af800 1 --2- 172.21.15.146:0/1004106854 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55ce95399d20 0x55ce954934e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.672+0000 7fafd65af800 1 -- 172.21.15.146:0/1004106854 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ce95493a20 con 0x55ce95399d20 2024-09-18T01:45:26.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.672+0000 7fafd48a4640 1 --2- 172.21.15.146:0/1004106854 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55ce95399d20 0x55ce954934e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.672+0000 7fafcbfff640 1 --2- 172.21.15.146:0/1004106854 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7faebc036b40 0x7faebc039000 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fafbc057000 tx=0x7fafbc052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.672+0000 7fafd48a4640 1 --2- 172.21.15.146:0/1004106854 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55ce95399d20 0x55ce954934e0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.673+0000 7fafd48a4640 1 -- 172.21.15.146:0/1004106854 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fafcc00a4a0 con 0x55ce95399d20 2024-09-18T01:45:26.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.673+0000 7fafd65af800 1 -- 172.21.15.146:0/1004106854 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ce95490ab0 con 0x55ce95399d20 2024-09-18T01:45:26.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.673+0000 7fafd48a4640 1 -- 172.21.15.146:0/1004106854 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fafcc00a4a0 con 0x55ce95399d20 2024-09-18T01:45:26.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.673+0000 7fafd65af800 1 -- 172.21.15.146:0/1004106854 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ce95495820 con 0x55ce95399d20 2024-09-18T01:45:26.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.673+0000 7fafd48a4640 1 -- 172.21.15.146:0/1004106854 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fafcc00a4a0 con 0x55ce95399d20 2024-09-18T01:45:26.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.673+0000 7fafd65af800 1 -- 172.21.15.146:0/1004106854 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ce95494a50 con 0x55ce95399d20 2024-09-18T01:45:26.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.674+0000 7fafd48a4640 1 -- 172.21.15.146:0/1004106854 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fafcc00a4a0 con 0x55ce95399d20 2024-09-18T01:45:26.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.674+0000 7fafd65af800 1 --2- 172.21.15.146:0/1004106854 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55ce95496bd0 0x55ce95498fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.674+0000 7fafd65af800 1 -- 172.21.15.146:0/1004106854 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ce95499500 con 0x55ce95496bd0 2024-09-18T01:45:26.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.674+0000 7fafd40a3640 1 --2- 172.21.15.146:0/1004106854 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55ce95496bd0 0x55ce95498fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.674+0000 7fafd40a3640 1 --2- 172.21.15.146:0/1004106854 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55ce95496bd0 0x55ce95498fc0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.674+0000 7fafd40a3640 1 -- 172.21.15.146:0/1004106854 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fafc400dcd0 con 0x55ce95496bd0 2024-09-18T01:45:26.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.675+0000 7fafd65af800 1 Processor -- start 2024-09-18T01:45:26.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.675+0000 7fafd65af800 1 -- start start 2024-09-18T01:45:26.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.675+0000 7fafd65af800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ce954a7180 0x55ce954a75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.675+0000 7fafd65af800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55ce9522e580 con 0x55ce954a7180 2024-09-18T01:45:26.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.675+0000 7fafd48a4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ce954a7180 0x55ce954a75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.675+0000 7fafd48a4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ce954a7180 0x55ce954a75a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60858/0 (socket says 172.21.15.146:60858) 2024-09-18T01:45:26.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.675+0000 7fafd48a4640 1 -- 172.21.15.146:0/2961074941 learned_addr learned my addr 172.21.15.146:0/2961074941 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:26.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.675+0000 7fafd48a4640 1 -- 172.21.15.146:0/2961074941 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce954a7ae0 con 0x55ce954a7180 2024-09-18T01:45:26.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.675+0000 7fafd48a4640 1 --2- 172.21.15.146:0/2961074941 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ce954a7180 0x55ce954a75a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x55ce9548d870 tx=0x7fafcc0178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.676+0000 7faeb9ffb640 1 -- 172.21.15.146:0/2961074941 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafcc013440 con 0x55ce954a7180 2024-09-18T01:45:26.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.676+0000 7faeb9ffb640 1 -- 172.21.15.146:0/2961074941 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafcc0135e0 con 0x55ce954a7180 2024-09-18T01:45:26.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.676+0000 7fafd65af800 1 -- 172.21.15.146:0/2961074941 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ce954a7d70 con 0x55ce954a7180 2024-09-18T01:45:26.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.676+0000 7faeb9ffb640 1 -- 172.21.15.146:0/2961074941 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafcc0138c0 con 0x55ce954a7180 2024-09-18T01:45:26.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.676+0000 7fafd65af800 1 -- 172.21.15.146:0/2961074941 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce954aaa50 con 0x55ce954a7180 2024-09-18T01:45:26.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.677+0000 7faeb9ffb640 1 -- 172.21.15.146:0/2961074941 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fafcc011040 con 0x55ce954a7180 2024-09-18T01:45:26.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.677+0000 7faeb9ffb640 1 --2- 172.21.15.146:0/2961074941 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7faeac036b90 0x7faeac039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.677+0000 7faeb9ffb640 1 -- 172.21.15.146:0/2961074941 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fafcc01d070 con 0x55ce954a7180 2024-09-18T01:45:26.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.677+0000 7fafd40a3640 1 --2- 172.21.15.146:0/2961074941 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7faeac036b90 0x7faeac039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.677+0000 7fafd65af800 1 Processor -- start 2024-09-18T01:45:26.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.677+0000 7fafd40a3640 1 --2- 172.21.15.146:0/2961074941 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7faeac036b90 0x7faeac039050 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fafc4001750 tx=0x7fafc4041040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.677+0000 7fafd65af800 1 -- start start 2024-09-18T01:45:26.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.677+0000 7fafd65af800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ce954b3e00 0x55ce954b4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.677+0000 7fafd65af800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55ce95485240 con 0x55ce954b3e00 2024-09-18T01:45:26.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.677+0000 7fafd48a4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ce954b3e00 0x55ce954b4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.677+0000 7fafd48a4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ce954b3e00 0x55ce954b4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60860/0 (socket says 172.21.15.146:60860) 2024-09-18T01:45:26.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.678+0000 7fafd48a4640 1 -- 172.21.15.146:0/1178338776 learned_addr learned my addr 172.21.15.146:0/1178338776 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:26.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.678+0000 7fafd48a4640 1 -- 172.21.15.146:0/1178338776 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce954b47d0 con 0x55ce954b3e00 2024-09-18T01:45:26.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.678+0000 7fafd48a4640 1 --2- 172.21.15.146:0/1178338776 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ce954b3e00 0x55ce954b4200 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fafcc04c8c0 tx=0x7fafcc001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c52a685db1c099f server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.678+0000 7faeb37fe640 1 -- 172.21.15.146:0/1178338776 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafcc027040 con 0x55ce954b3e00 2024-09-18T01:45:26.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.678+0000 7faeb37fe640 1 -- 172.21.15.146:0/1178338776 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafcc04e0d0 con 0x55ce954b3e00 2024-09-18T01:45:26.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.678+0000 7faeb37fe640 1 -- 172.21.15.146:0/1178338776 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafcc04b250 con 0x55ce954b3e00 2024-09-18T01:45:26.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.678+0000 7fafd65af800 1 -- 172.21.15.146:0/1178338776 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ce954b3e00 msgr2=0x55ce954b4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.678+0000 7fafd65af800 1 --2- 172.21.15.146:0/1178338776 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ce954b3e00 0x55ce954b4200 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fafcc04c8c0 tx=0x7fafcc001940 comp rx=0 tx=0).stop 2024-09-18T01:45:26.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.678+0000 7fafd65af800 1 -- 172.21.15.146:0/1178338776 shutdown_connections 2024-09-18T01:45:26.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.678+0000 7fafd65af800 1 --2- 172.21.15.146:0/1178338776 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ce954b3e00 0x55ce954b4200 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.678+0000 7fafd65af800 1 -- 172.21.15.146:0/1178338776 >> 172.21.15.146:0/1178338776 conn(0x55ce954b01a0 msgr2=0x55ce954ae2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:26.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.678+0000 7fafd65af800 1 -- 172.21.15.146:0/1178338776 shutdown_connections 2024-09-18T01:45:26.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.679+0000 7fafd65af800 1 -- 172.21.15.146:0/1178338776 wait complete. 2024-09-18T01:45:26.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.679+0000 7fafd65af800 1 Processor -- start 2024-09-18T01:45:26.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.679+0000 7fafd65af800 1 -- start start 2024-09-18T01:45:26.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.679+0000 7fafd65af800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ce954b3e00 0x55ce954bb270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.679+0000 7fafd65af800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55ce954b4df0 con 0x55ce954b3e00 2024-09-18T01:45:26.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.679+0000 7fafd48a4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ce954b3e00 0x55ce954bb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.679+0000 7fafd48a4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ce954b3e00 0x55ce954bb270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60866/0 (socket says 172.21.15.146:60866) 2024-09-18T01:45:26.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.679+0000 7fafd48a4640 1 -- 172.21.15.146:0/440543031 learned_addr learned my addr 172.21.15.146:0/440543031 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:26.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.679+0000 7fafd48a4640 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce954bb7b0 con 0x55ce954b3e00 2024-09-18T01:45:26.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.679+0000 7fafd48a4640 1 --2- 172.21.15.146:0/440543031 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ce954b3e00 0x55ce954bb270 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fafcc04b7b0 tx=0x7fafcc04c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.680+0000 7faeb1ffb640 1 -- 172.21.15.146:0/440543031 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafcc027050 con 0x55ce954b3e00 2024-09-18T01:45:26.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.680+0000 7faeb1ffb640 1 -- 172.21.15.146:0/440543031 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafcc02ae30 con 0x55ce954b3e00 2024-09-18T01:45:26.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.680+0000 7faeb1ffb640 1 -- 172.21.15.146:0/440543031 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafcc04e280 con 0x55ce954b3e00 2024-09-18T01:45:26.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.680+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ce954bba40 con 0x55ce954b3e00 2024-09-18T01:45:26.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.680+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce954be6f0 con 0x55ce954b3e00 2024-09-18T01:45:26.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.680+0000 7faeb1ffb640 1 -- 172.21.15.146:0/440543031 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fafcc021a50 con 0x55ce954b3e00 2024-09-18T01:45:26.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.681+0000 7faeb1ffb640 1 --2- 172.21.15.146:0/440543031 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7faea4036b90 0x7faea4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.681+0000 7faeb1ffb640 1 -- 172.21.15.146:0/440543031 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fafcc034030 con 0x55ce954b3e00 2024-09-18T01:45:26.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.681+0000 7fafd40a3640 1 --2- 172.21.15.146:0/440543031 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7faea4036b90 0x7faea4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.681+0000 7fafd40a3640 1 --2- 172.21.15.146:0/440543031 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7faea4036b90 0x7faea4039050 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fafc404b2a0 tx=0x7fafc4035000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.681+0000 7fafd65af800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.681+0000 7fafd65af800 1 --2- 172.21.15.146:0/440543031 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55ce954c6ee0 0x55ce954c93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.681+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ce954c9af0 con 0x55ce954c6ee0 2024-09-18T01:45:26.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.681+0000 7fafcbfff640 1 --2- 172.21.15.146:0/440543031 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55ce954c6ee0 0x55ce954c93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.682+0000 7fafcbfff640 1 --2- 172.21.15.146:0/440543031 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55ce954c6ee0 0x55ce954c93a0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.682+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fafbc051070 con 0x55ce954c6ee0 2024-09-18T01:45:26.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.682+0000 7fafd65af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:26.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.682+0000 7fafd65af800 20 realm 2024-09-18T01:45:26.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.682+0000 7fafd65af800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.682+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ce954c9f20 con 0x55ce954c6ee0 2024-09-18T01:45:26.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.682+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fafbc051070 con 0x55ce954c6ee0 2024-09-18T01:45:26.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.682+0000 7fafd65af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:26.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.682+0000 7fafd65af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:26.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.682+0000 7fafd65af800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.682+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ce954ca7f0 con 0x55ce954c6ee0 2024-09-18T01:45:26.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.682+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fafbc051070 con 0x55ce954c6ee0 2024-09-18T01:45:26.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.682+0000 7fafd65af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:26.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.682+0000 7fafd65af800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.682+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ce954cab90 con 0x55ce954c6ee0 2024-09-18T01:45:26.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.683+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fafbc051070 con 0x55ce954c6ee0 2024-09-18T01:45:26.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.683+0000 7fafd65af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:26.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.683+0000 7fafd65af800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.683+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ce954cb3e0 con 0x55ce954c6ee0 2024-09-18T01:45:26.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.683+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fafbc051070 con 0x55ce954c6ee0 2024-09-18T01:45:26.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.683+0000 7fafd65af800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:26.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.683+0000 7fafd65af800 20 searching for the correct realm 2024-09-18T01:45:26.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.683+0000 7fafd65af800 1 --2- 172.21.15.146:0/440543031 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55ce954cd150 0x55ce954cf540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.683+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce954cfb70 con 0x55ce954cd150 2024-09-18T01:45:26.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.683+0000 7fafd48a4640 1 --2- 172.21.15.146:0/440543031 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55ce954cd150 0x55ce954cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.683+0000 7fafd48a4640 1 --2- 172.21.15.146:0/440543031 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55ce954cd150 0x55ce954cf540 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.684+0000 7fafd48a4640 1 -- 172.21.15.146:0/440543031 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafcc029070 con 0x55ce954cd150 2024-09-18T01:45:26.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.684+0000 7fafd48a4640 1 --2- 172.21.15.146:0/440543031 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fafcc0123a0 0x7fafcc022420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.684+0000 7fafd48a4640 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce954cfb70 con 0x7fafcc0123a0 2024-09-18T01:45:26.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.684+0000 7fafd40a3640 1 --2- 172.21.15.146:0/440543031 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fafcc0123a0 0x7fafcc022420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.684+0000 7fafd40a3640 1 --2- 172.21.15.146:0/440543031 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fafcc0123a0 0x7fafcc022420 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.684+0000 7fafd40a3640 1 -- 172.21.15.146:0/440543031 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc400dcd0 con 0x7fafcc0123a0 2024-09-18T01:45:26.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.684+0000 7fafd40a3640 1 --2- 172.21.15.146:0/440543031 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fafc4017050 0x7fafc402c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.684+0000 7fafd40a3640 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce954cfb70 con 0x7fafc4017050 2024-09-18T01:45:26.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.685+0000 7fafcbfff640 1 --2- 172.21.15.146:0/440543031 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fafc4017050 0x7fafc402c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.685+0000 7fafcbfff640 1 --2- 172.21.15.146:0/440543031 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fafc4017050 0x7fafc402c5b0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.685+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafbc051070 con 0x7fafc4017050 2024-09-18T01:45:26.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.685+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce954cfb70 con 0x55ce954c6ee0 2024-09-18T01:45:26.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.686+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fafbc051070 con 0x55ce954c6ee0 2024-09-18T01:45:26.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.686+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce954cfb70 con 0x55ce954c6ee0 2024-09-18T01:45:26.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.686+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafbc051070 con 0x55ce954c6ee0 2024-09-18T01:45:26.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.686+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce954cfb70 con 0x7fafc4017050 2024-09-18T01:45:26.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.686+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafbc051070 con 0x7fafc4017050 2024-09-18T01:45:26.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.686+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce954cfb70 con 0x7fafc4017050 2024-09-18T01:45:26.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.686+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafbc051070 con 0x7fafc4017050 2024-09-18T01:45:26.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.686+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce954cfb70 con 0x7fafcc0123a0 2024-09-18T01:45:26.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.687+0000 7fafd40a3640 1 -- 172.21.15.146:0/440543031 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc400dcd0 con 0x7fafcc0123a0 2024-09-18T01:45:26.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.687+0000 7fafd40a3640 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce954cfb70 con 0x55ce954cd150 2024-09-18T01:45:26.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.687+0000 7fafd48a4640 1 -- 172.21.15.146:0/440543031 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafcc05d040 con 0x55ce954cd150 2024-09-18T01:45:26.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.687+0000 7fafd48a4640 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce954cfb70 con 0x55ce954c6ee0 2024-09-18T01:45:26.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.687+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafbc051070 con 0x55ce954c6ee0 2024-09-18T01:45:26.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.687+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce954cfb70 con 0x7fafc4017050 2024-09-18T01:45:26.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.687+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafbc051070 con 0x7fafc4017050 2024-09-18T01:45:26.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.687+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce954cfb70 con 0x55ce954c6ee0 2024-09-18T01:45:26.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.688+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafbc051070 con 0x55ce954c6ee0 2024-09-18T01:45:26.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.688+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce954cfb70 con 0x7fafcc0123a0 2024-09-18T01:45:26.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.688+0000 7fafd40a3640 1 -- 172.21.15.146:0/440543031 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fafc400dcd0 con 0x7fafcc0123a0 2024-09-18T01:45:26.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.688+0000 7fafd40a3640 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce954cfb70 con 0x55ce954cd150 2024-09-18T01:45:26.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.688+0000 7fafd48a4640 1 -- 172.21.15.146:0/440543031 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafcc05d040 con 0x55ce954cd150 2024-09-18T01:45:26.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.688+0000 7fafd48a4640 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce954cfb70 con 0x55ce954cd150 2024-09-18T01:45:26.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.688+0000 7fafd48a4640 1 -- 172.21.15.146:0/440543031 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafcc05d040 con 0x55ce954cd150 2024-09-18T01:45:26.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.688+0000 7fafd48a4640 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce954cfb70 con 0x7fafc4017050 2024-09-18T01:45:26.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.689+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafbc051070 con 0x7fafc4017050 2024-09-18T01:45:26.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.689+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce954cfb70 con 0x55ce954cd150 2024-09-18T01:45:26.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.689+0000 7fafd48a4640 1 -- 172.21.15.146:0/440543031 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafcc05d040 con 0x55ce954cd150 2024-09-18T01:45:26.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.689+0000 7fafd48a4640 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce954cfb70 con 0x55ce954cd150 2024-09-18T01:45:26.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.689+0000 7fafd48a4640 1 -- 172.21.15.146:0/440543031 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafcc05d040 con 0x55ce954cd150 2024-09-18T01:45:26.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.689+0000 7fafd48a4640 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce954cfb70 con 0x55ce954c6ee0 2024-09-18T01:45:26.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.689+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafbc051070 con 0x55ce954c6ee0 2024-09-18T01:45:26.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.689+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce954cfb70 con 0x55ce954c6ee0 2024-09-18T01:45:26.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.689+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fafbc051070 con 0x55ce954c6ee0 2024-09-18T01:45:26.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.689+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce954cfb70 con 0x7fafc4017050 2024-09-18T01:45:26.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.690+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafbc051070 con 0x7fafc4017050 2024-09-18T01:45:26.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.690+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce954cfb70 con 0x55ce954cd150 2024-09-18T01:45:26.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.690+0000 7fafd48a4640 1 -- 172.21.15.146:0/440543031 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafcc05d040 con 0x55ce954cd150 2024-09-18T01:45:26.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.690+0000 7fafd48a4640 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce954cfb70 con 0x7fafcc0123a0 2024-09-18T01:45:26.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.690+0000 7fafd40a3640 1 -- 172.21.15.146:0/440543031 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc400dcd0 con 0x7fafcc0123a0 2024-09-18T01:45:26.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.690+0000 7fafd40a3640 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce954cfb70 con 0x55ce954c6ee0 2024-09-18T01:45:26.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.690+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafbc051070 con 0x55ce954c6ee0 2024-09-18T01:45:26.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.690+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce954cfb70 con 0x7fafc4017050 2024-09-18T01:45:26.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.691+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafbc051070 con 0x7fafc4017050 2024-09-18T01:45:26.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.691+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce954cfb70 con 0x55ce954cd150 2024-09-18T01:45:26.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.691+0000 7fafd48a4640 1 -- 172.21.15.146:0/440543031 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafcc05d040 con 0x55ce954cd150 2024-09-18T01:45:26.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.691+0000 7fafd48a4640 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce954cfb70 con 0x7fafc4017050 2024-09-18T01:45:26.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.691+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafbc051070 con 0x7fafc4017050 2024-09-18T01:45:26.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.691+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce954cfb70 con 0x7fafcc0123a0 2024-09-18T01:45:26.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.691+0000 7fafd40a3640 1 -- 172.21.15.146:0/440543031 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc400dcd0 con 0x7fafcc0123a0 2024-09-18T01:45:26.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.691+0000 7fafd40a3640 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce954cfb70 con 0x55ce954cd150 2024-09-18T01:45:26.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.692+0000 7fafd48a4640 1 -- 172.21.15.146:0/440543031 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafcc05d040 con 0x55ce954cd150 2024-09-18T01:45:26.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.692+0000 7fafd48a4640 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce954cfb70 con 0x7fafc4017050 2024-09-18T01:45:26.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.692+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafbc051070 con 0x7fafc4017050 2024-09-18T01:45:26.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.692+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce954cfb70 con 0x55ce954c6ee0 2024-09-18T01:45:26.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.692+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fafbc051070 con 0x55ce954c6ee0 2024-09-18T01:45:26.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.692+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce954cfb70 con 0x7fafcc0123a0 2024-09-18T01:45:26.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.692+0000 7fafd40a3640 1 -- 172.21.15.146:0/440543031 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc4060040 con 0x7fafcc0123a0 2024-09-18T01:45:26.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.692+0000 7fafd65af800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:26.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.692+0000 7fafd65af800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:26.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.692+0000 7fafd65af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:26.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.692+0000 7fafd65af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:26.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.692+0000 7fafd65af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:26.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.692+0000 7fafd65af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:26.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.692+0000 7fafd65af800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.693+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ce954cbd90 con 0x55ce954c6ee0 2024-09-18T01:45:26.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.693+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fafbc051070 con 0x55ce954c6ee0 2024-09-18T01:45:26.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.693+0000 7fafd65af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:26.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.693+0000 7fafd65af800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.693+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ce954cc630 con 0x55ce954c6ee0 2024-09-18T01:45:26.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.693+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fafbc051070 con 0x55ce954c6ee0 2024-09-18T01:45:26.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.693+0000 7fafd65af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:26.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.693+0000 7fafd65af800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.693+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ce954cfff0 con 0x7fafcc0123a0 2024-09-18T01:45:26.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.693+0000 7fafd40a3640 1 -- 172.21.15.146:0/440543031 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fafc4060040 con 0x7fafcc0123a0 2024-09-18T01:45:26.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.693+0000 7fafd65af800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:26.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.693+0000 7fafd65af800 20 zone default found 2024-09-18T01:45:26.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.693+0000 7fafd65af800 4 Realm: () 2024-09-18T01:45:26.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.693+0000 7fafd65af800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:26.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.693+0000 7fafd65af800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:26.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.693+0000 7fafd65af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:26.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.693+0000 7fafd65af800 20 zonegroup default 2024-09-18T01:45:26.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.693+0000 7fafd65af800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.693+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ce954d0840 con 0x7fafc4017050 2024-09-18T01:45:26.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.694+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fafbc051070 con 0x7fafc4017050 2024-09-18T01:45:26.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.694+0000 7fafd65af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:26.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.694+0000 7fafd65af800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.694+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ce954d2220 con 0x55ce954cd150 2024-09-18T01:45:26.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.694+0000 7fafd48a4640 1 -- 172.21.15.146:0/440543031 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fafcc05d040 con 0x55ce954cd150 2024-09-18T01:45:26.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.694+0000 7fafd65af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:26.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.694+0000 7fafd65af800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.694+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ce954d2b00 con 0x55ce954cd150 2024-09-18T01:45:26.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.694+0000 7fafd48a4640 1 -- 172.21.15.146:0/440543031 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fafcc05d040 con 0x55ce954cd150 2024-09-18T01:45:26.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.694+0000 7fafd65af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:26.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.694+0000 7fafd65af800 20 started sync module instance, tier type = 2024-09-18T01:45:26.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.694+0000 7fafd65af800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:26.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.694+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce954d1210 con 0x7fafcc0123a0 2024-09-18T01:45:26.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.695+0000 7fafd40a3640 1 -- 172.21.15.146:0/440543031 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v31'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc4060040 con 0x7fafcc0123a0 2024-09-18T01:45:26.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.695+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94345756478816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce954d2ea0 con 0x7fafcc0123a0 2024-09-18T01:45:26.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.695+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce954d36f0 con 0x55ce954c6ee0 2024-09-18T01:45:26.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.696+0000 7fafd40a3640 1 -- 172.21.15.146:0/440543031 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94345756478816] v31'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc4060040 con 0x7fafcc0123a0 2024-09-18T01:45:26.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.696+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v31'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafbc051070 con 0x55ce954c6ee0 2024-09-18T01:45:26.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.697+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94345756488256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce954d3b10 con 0x55ce954c6ee0 2024-09-18T01:45:26.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.697+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce954d43a0 con 0x55ce954cd150 2024-09-18T01:45:26.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.698+0000 7fafd48a4640 1 -- 172.21.15.146:0/440543031 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v31'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafcc05d040 con 0x55ce954cd150 2024-09-18T01:45:26.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.698+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94345756488256] v31'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafbc051070 con 0x55ce954c6ee0 2024-09-18T01:45:26.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.698+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94345756491024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce954d4c70 con 0x55ce954cd150 2024-09-18T01:45:26.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.698+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce954d3680 con 0x7fafcc0123a0 2024-09-18T01:45:26.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.699+0000 7fafd48a4640 1 -- 172.21.15.146:0/440543031 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94345756491024] v31'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafcc05d040 con 0x55ce954cd150 2024-09-18T01:45:26.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.699+0000 7fafd40a3640 1 -- 172.21.15.146:0/440543031 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v31'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc4060040 con 0x7fafcc0123a0 2024-09-18T01:45:26.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.699+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94345756494240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce954d56e0 con 0x7fafcc0123a0 2024-09-18T01:45:26.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.699+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce954d60a0 con 0x55ce954c6ee0 2024-09-18T01:45:26.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.700+0000 7fafd40a3640 1 -- 172.21.15.146:0/440543031 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94345756494240] v31'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc4060040 con 0x7fafcc0123a0 2024-09-18T01:45:26.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.700+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v31'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafbc051070 con 0x55ce954c6ee0 2024-09-18T01:45:26.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.700+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94345756498928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce954d64c0 con 0x55ce954c6ee0 2024-09-18T01:45:26.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.700+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce954d6e80 con 0x7fafc4017050 2024-09-18T01:45:26.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.701+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94345756498928] v31'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafbc051070 con 0x55ce954c6ee0 2024-09-18T01:45:26.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.701+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v31'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafbc051070 con 0x7fafc4017050 2024-09-18T01:45:26.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.701+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94345756500464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce954d6e80 con 0x7fafc4017050 2024-09-18T01:45:26.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.701+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce954d7840 con 0x7fafc4017050 2024-09-18T01:45:26.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.702+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94345756500464] v31'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafbc051070 con 0x7fafc4017050 2024-09-18T01:45:26.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.702+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v31'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafbc051070 con 0x7fafc4017050 2024-09-18T01:45:26.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.702+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94345756502480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce954d7a20 con 0x7fafc4017050 2024-09-18T01:45:26.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.702+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce954d8270 con 0x7fafc4017050 2024-09-18T01:45:26.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.703+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(58 notify.7 [create] v31'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafbc051070 con 0x7fafc4017050 2024-09-18T01:45:26.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.703+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94345756502480] v31'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafbc051070 con 0x7fafc4017050 2024-09-18T01:45:26.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.703+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94345756507136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce954d7610 con 0x7fafc4017050 2024-09-18T01:45:26.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.703+0000 7fafd65af800 20 add_watcher() i=0 2024-09-18T01:45:26.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.703+0000 7fafd65af800 20 add_watcher() i=1 2024-09-18T01:45:26.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.703+0000 7fafd65af800 20 add_watcher() i=2 2024-09-18T01:45:26.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.703+0000 7fafd65af800 20 add_watcher() i=3 2024-09-18T01:45:26.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.703+0000 7fafd65af800 20 add_watcher() i=4 2024-09-18T01:45:26.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.703+0000 7fafd65af800 20 add_watcher() i=5 2024-09-18T01:45:26.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.703+0000 7fafd65af800 20 add_watcher() i=6 2024-09-18T01:45:26.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.704+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94345756507136] v31'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafbc051070 con 0x7fafc4017050 2024-09-18T01:45:26.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.704+0000 7fafd65af800 20 add_watcher() i=7 2024-09-18T01:45:26.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.704+0000 7fafd65af800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:26.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.704+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ce954db640 con 0x55ce954c6ee0 2024-09-18T01:45:26.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.704+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fafbc051070 con 0x55ce954c6ee0 2024-09-18T01:45:26.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.704+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94345756508192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce954d8b00 con 0x55ce954c6ee0 2024-09-18T01:45:26.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.705+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94345756508192] v31'110 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fafbc051070 con 0x55ce954c6ee0 2024-09-18T01:45:26.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.706+0000 7fae8a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:26.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.706+0000 7fafd65af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:26.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.706+0000 7fafd65af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:26.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.706+0000 7fafd65af800 5 note: GC not initialized 2024-09-18T01:45:26.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.706+0000 7fae897e2640 20 reqs_thread_entry: start 2024-09-18T01:45:26.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.706+0000 7fafd65af800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:26.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.706+0000 7fafd65af800 20 Filter name: none 2024-09-18T01:45:26.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.706+0000 7fadfaffd640 20 reqs_thread_entry: start 2024-09-18T01:45:26.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.706+0000 7fafd65af800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T01:45:26.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.706+0000 7fafd65af800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.706+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ce9550e9f0 con 0x55ce954c6ee0 2024-09-18T01:45:26.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.707+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fafbc051070 con 0x55ce954c6ee0 2024-09-18T01:45:26.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.707+0000 7fafd65af800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:45:26.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.707+0000 7fafd65af800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T01:45:26.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.707+0000 7fafd65af800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:45:26.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.707+0000 7fafd65af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:45:26.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.707+0000 7fafd65af800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-18T01:45:26.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.707+0000 7fafd65af800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.707+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ce95510ad0 con 0x7fafcc0123a0 2024-09-18T01:45:26.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.707+0000 7fafd40a3640 1 -- 172.21.15.146:0/440543031 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fafc4060040 con 0x7fafcc0123a0 2024-09-18T01:45:26.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.707+0000 7fafd65af800 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T01:45:26.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.707+0000 7fafd65af800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-18T01:45:26.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.707+0000 7fafd65af800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T01:45:26.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.707+0000 7fafd65af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 : miss 2024-09-18T01:45:26.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.707+0000 7fafd65af800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.707+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:64 8.13 8:ceaa8859:root::.bucket.meta.myfoo%3a8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ce95512350 con 0x7fafc4017050 2024-09-18T01:45:26.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.708+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(64 .bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fafbc051070 con 0x7fafc4017050 2024-09-18T01:45:26.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.708+0000 7fafd65af800 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T01:45:26.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.708+0000 7fafd65af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 info.flags=0x17 2024-09-18T01:45:26.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.708+0000 7fafd65af800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 to cache LRU end 2024-09-18T01:45:26.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.708+0000 7fafd65af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:45:26.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.708+0000 7fafd65af800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T01:45:26.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.708+0000 7fafd65af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 2024-09-18T01:45:26.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.708+0000 7fafd65af800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-18T01:45:26.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.708+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce95515a50 con 0x7fafcc0123a0 2024-09-18T01:45:26.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.709+0000 7fafd40a3640 1 -- 172.21.15.146:0/440543031 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(65 foo.buckets [call] v31'17 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fafc4060040 con 0x7fafcc0123a0 2024-09-18T01:45:26.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.709+0000 7fafd65af800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-18T01:45:26.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.709+0000 7fafd65af800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.709+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ce95514bc0 con 0x7fafcc0123a0 2024-09-18T01:45:26.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.709+0000 7fafd40a3640 1 -- 172.21.15.146:0/440543031 <== osd.2 v2:172.21.15.146:6800/3820039304 14 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7fafc4060040 con 0x7fafcc0123a0 2024-09-18T01:45:26.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.709+0000 7fafd65af800 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T01:45:26.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.709+0000 7fafd65af800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-18T01:45:26.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.709+0000 7fafd65af800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T01:45:26.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.709+0000 7fafd65af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:45:26.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.709+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce95515830 con 0x7fafcc0123a0 2024-09-18T01:45:26.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.711+0000 7fafd40a3640 1 -- 172.21.15.146:0/440543031 <== osd.2 v2:172.21.15.146:6800/3820039304 15 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v31'18 uv18 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7fafc4060040 con 0x7fafcc0123a0 2024-09-18T01:45:26.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.711+0000 7fafd65af800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-18T01:45:26.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.711+0000 7fafd65af800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T01:45:26.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.711+0000 7fafd65af800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-18T01:45:26.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.711+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94345756760048 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ce955172d0 con 0x7fafc4017050 2024-09-18T01:45:26.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.711+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== watch-notify(notify (1) cookie 94345756502480 notify 133143986178 ret 0) ==== 380+0+0 (crc 0 0 0) 0x55ce95512740 con 0x7fafc4017050 2024-09-18T01:45:26.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.711+0000 7faeb37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986178 cookie 94345756502480 notifier 4488 bl.length()=338 2024-09-18T01:45:26.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.711+0000 7faeb37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-18T01:45:26.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.711+0000 7faeb37fe640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T01:45:26.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.711+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(68 notify.6 [notify cookie 94345756760048 out=8b] v0'0 uv105 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fafbc051070 con 0x7fafc4017050 2024-09-18T01:45:26.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.711+0000 7faeb37fe640 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fae98003ea0 con 0x7fafc4017050 2024-09-18T01:45:26.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.711+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafbc051070 con 0x7fafc4017050 2024-09-18T01:45:26.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.711+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== watch-notify(notify_complete (2) cookie 94345756760048 notify 133143986178 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ce955118c0 con 0x7fafc4017050 2024-09-18T01:45:26.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.712+0000 7fae8a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:26.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.712+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94345756508192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce9550c740 con 0x55ce954c6ee0 2024-09-18T01:45:26.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.713+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94345756508192] v31'111 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fafbc051070 con 0x55ce954c6ee0 2024-09-18T01:45:26.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.713+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94345756478816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce9550c740 con 0x7fafcc0123a0 2024-09-18T01:45:26.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.714+0000 7fafd40a3640 1 -- 172.21.15.146:0/440543031 <== osd.2 v2:172.21.15.146:6800/3820039304 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94345756478816] v31'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc4060040 con 0x7fafcc0123a0 2024-09-18T01:45:26.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.714+0000 7fafd65af800 20 remove_watcher() i=0 2024-09-18T01:45:26.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.714+0000 7fafd65af800 2 removed watcher, disabling cache 2024-09-18T01:45:26.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.714+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94345756488256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce9550c740 con 0x55ce954c6ee0 2024-09-18T01:45:26.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.715+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94345756488256] v31'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafbc051070 con 0x55ce954c6ee0 2024-09-18T01:45:26.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.715+0000 7fafd65af800 20 remove_watcher() i=1 2024-09-18T01:45:26.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.715+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94345756491024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce9550c740 con 0x55ce954cd150 2024-09-18T01:45:26.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.717+0000 7fafd48a4640 1 -- 172.21.15.146:0/440543031 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94345756491024] v31'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafcc05d040 con 0x55ce954cd150 2024-09-18T01:45:26.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.717+0000 7fafd65af800 20 remove_watcher() i=2 2024-09-18T01:45:26.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.717+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94345756494240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce9550c740 con 0x7fafcc0123a0 2024-09-18T01:45:26.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.717+0000 7fafd40a3640 1 -- 172.21.15.146:0/440543031 <== osd.2 v2:172.21.15.146:6800/3820039304 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94345756494240] v31'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc4060040 con 0x7fafcc0123a0 2024-09-18T01:45:26.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.717+0000 7fafd65af800 20 remove_watcher() i=3 2024-09-18T01:45:26.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.718+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94345756498928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce9550c740 con 0x55ce954c6ee0 2024-09-18T01:45:26.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.719+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94345756498928] v31'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafbc051070 con 0x55ce954c6ee0 2024-09-18T01:45:26.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.719+0000 7fafd65af800 20 remove_watcher() i=4 2024-09-18T01:45:26.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.719+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94345756500464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce9550c740 con 0x7fafc4017050 2024-09-18T01:45:26.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.719+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 <== osd.0 v2:172.21.15.129:6800/1759265424 22 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94345756500464] v31'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafbc051070 con 0x7fafc4017050 2024-09-18T01:45:26.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.719+0000 7fafd65af800 20 remove_watcher() i=5 2024-09-18T01:45:26.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.720+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94345756502480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce9550c740 con 0x7fafc4017050 2024-09-18T01:45:26.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.720+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 <== osd.0 v2:172.21.15.129:6800/1759265424 23 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94345756502480] v31'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafbc051070 con 0x7fafc4017050 2024-09-18T01:45:26.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.720+0000 7fafd65af800 20 remove_watcher() i=6 2024-09-18T01:45:26.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.720+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94345756507136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce9550c740 con 0x7fafc4017050 2024-09-18T01:45:26.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.721+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 <== osd.0 v2:172.21.15.129:6800/1759265424 24 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94345756507136] v31'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafbc051070 con 0x7fafc4017050 2024-09-18T01:45:26.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.721+0000 7fafd65af800 20 remove_watcher() i=7 2024-09-18T01:45:26.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.721+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fafc4017050 msgr2=0x7fafc402c5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.721+0000 7fafd65af800 1 --2- 172.21.15.146:0/440543031 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fafc4017050 0x7fafc402c5b0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.721+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55ce954c6ee0 msgr2=0x55ce954c93a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.721+0000 7fafd65af800 1 --2- 172.21.15.146:0/440543031 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55ce954c6ee0 0x55ce954c93a0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.721+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fafcc0123a0 msgr2=0x7fafcc022420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.721+0000 7fafd65af800 1 --2- 172.21.15.146:0/440543031 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fafcc0123a0 0x7fafcc022420 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.721+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55ce954cd150 msgr2=0x55ce954cf540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.721+0000 7fafd65af800 1 --2- 172.21.15.146:0/440543031 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55ce954cd150 0x55ce954cf540 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.722+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7faea4036b90 msgr2=0x7faea4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.722+0000 7fafd65af800 1 --2- 172.21.15.146:0/440543031 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7faea4036b90 0x7faea4039050 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fafc404b2a0 tx=0x7fafc4035000 comp rx=0 tx=0).stop 2024-09-18T01:45:26.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.722+0000 7fafcbfff640 1 -- 172.21.15.146:0/440543031 reap_dead start 2024-09-18T01:45:26.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.722+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ce954b3e00 msgr2=0x55ce954bb270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.722+0000 7fafd65af800 1 --2- 172.21.15.146:0/440543031 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ce954b3e00 0x55ce954bb270 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fafcc04b7b0 tx=0x7fafcc04c820 comp rx=0 tx=0).stop 2024-09-18T01:45:26.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.722+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 shutdown_connections 2024-09-18T01:45:26.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.722+0000 7fafd65af800 1 --2- 172.21.15.146:0/440543031 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ce954b3e00 0x55ce954bb270 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.722+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 >> 172.21.15.146:0/440543031 conn(0x55ce954b01a0 msgr2=0x55ce954ae270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:26.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.722+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 shutdown_connections 2024-09-18T01:45:26.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.722+0000 7fafd65af800 1 -- 172.21.15.146:0/440543031 wait complete. 2024-09-18T01:45:26.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.722+0000 7fafd65af800 1 -- 172.21.15.146:0/2961074941 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7faeac036b90 msgr2=0x7faeac039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.722+0000 7fafd65af800 1 --2- 172.21.15.146:0/2961074941 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7faeac036b90 0x7faeac039050 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fafc4001750 tx=0x7fafc4041040 comp rx=0 tx=0).stop 2024-09-18T01:45:26.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.722+0000 7fafd65af800 1 -- 172.21.15.146:0/2961074941 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ce954a7180 msgr2=0x55ce954a75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.722+0000 7fafd65af800 1 --2- 172.21.15.146:0/2961074941 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ce954a7180 0x55ce954a75a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x55ce9548d870 tx=0x7fafcc0178e0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.722+0000 7fafd65af800 1 -- 172.21.15.146:0/2961074941 shutdown_connections 2024-09-18T01:45:26.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.722+0000 7fafd65af800 1 --2- 172.21.15.146:0/2961074941 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7faeac036b90 0x7faeac039050 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.722+0000 7fafd65af800 1 --2- 172.21.15.146:0/2961074941 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ce954a7180 0x55ce954a75a0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.722+0000 7fafd65af800 1 -- 172.21.15.146:0/2961074941 >> 172.21.15.146:0/2961074941 conn(0x55ce9549c110 msgr2=0x55ce9549ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:26.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.722+0000 7fafd65af800 1 -- 172.21.15.146:0/2961074941 shutdown_connections 2024-09-18T01:45:26.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.722+0000 7fafd65af800 1 -- 172.21.15.146:0/2961074941 wait complete. 2024-09-18T01:45:26.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.722+0000 7fafd65af800 1 -- 172.21.15.146:0/1004106854 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55ce95399d20 msgr2=0x55ce954934e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.722+0000 7fafd65af800 1 --2- 172.21.15.146:0/1004106854 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55ce95399d20 0x55ce954934e0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.722+0000 7fafd65af800 1 -- 172.21.15.146:0/1004106854 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55ce95496bd0 msgr2=0x55ce95498fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.722+0000 7fafd65af800 1 --2- 172.21.15.146:0/1004106854 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55ce95496bd0 0x55ce95498fc0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.723+0000 7fafd65af800 1 -- 172.21.15.146:0/1004106854 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7faebc036b40 msgr2=0x7faebc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.723+0000 7fafd65af800 1 --2- 172.21.15.146:0/1004106854 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7faebc036b40 0x7faebc039000 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fafbc057000 tx=0x7fafbc052000 comp rx=0 tx=0).stop 2024-09-18T01:45:26.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.723+0000 7fafd65af800 1 -- 172.21.15.146:0/1004106854 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ce95307630 msgr2=0x55ce9548c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.723+0000 7fafd65af800 1 --2- 172.21.15.146:0/1004106854 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ce95307630 0x55ce9548c470 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fafc4001e10 tx=0x7fafc4000ed0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.723+0000 7fafd65af800 1 -- 172.21.15.146:0/1004106854 shutdown_connections 2024-09-18T01:45:26.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.723+0000 7fafd65af800 1 --2- 172.21.15.146:0/1004106854 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55ce95496bd0 0x55ce95498fc0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.723+0000 7fafd65af800 1 --2- 172.21.15.146:0/1004106854 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55ce95399d20 0x55ce954934e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.723+0000 7fafd65af800 1 --2- 172.21.15.146:0/1004106854 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7faebc036b40 0x7faebc039000 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.723+0000 7fafd65af800 1 --2- 172.21.15.146:0/1004106854 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ce95307630 0x55ce9548c470 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.723+0000 7fafd65af800 1 -- 172.21.15.146:0/1004106854 >> 172.21.15.146:0/1004106854 conn(0x55ce9538ddb0 msgr2=0x55ce9547ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:26.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.723+0000 7fafd65af800 1 -- 172.21.15.146:0/1004106854 shutdown_connections 2024-09-18T01:45:26.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.723+0000 7fafd65af800 1 -- 172.21.15.146:0/1004106854 wait complete. 2024-09-18T01:45:26.736 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-18T01:45:26.736 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-18T01:45:26.737 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-18T01:45:26.788 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:26.788 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:26.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.788+0000 7f229cc36800 1 Processor -- start 2024-09-18T01:45:26.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.788+0000 7f229cc36800 1 -- start start 2024-09-18T01:45:26.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.789+0000 7f229cc36800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55f7ac15f650 0x55f7ac1ee2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.789+0000 7f229cc36800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f7ac0aab30 con 0x55f7ac1ee7f0 2024-09-18T01:45:26.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.789+0000 7f229cc36800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x55f7ac08c360 con 0x55f7ac15f650 2024-09-18T01:45:26.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.789+0000 7f2297f52640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55f7ac15f650 0x55f7ac1ee2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.789+0000 7f228f751640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x55f7ac1ee7f0 0x55f7ac1f0be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:38988/0 (socket says 172.21.15.146:38988) 2024-09-18T01:45:26.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.789+0000 7f228f751640 1 -- 172.21.15.146:0/769072491 learned_addr learned my addr 172.21.15.146:0/769072491 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:45:26.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.789+0000 7f2297f52640 1 -- 172.21.15.146:0/769072491 >> v1:172.21.15.129:6789/0 conn(0x55f7ac1ee7f0 legacy=0x55f7ac1f0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.789+0000 7f2297f52640 1 -- 172.21.15.146:0/769072491 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7ac0b2e00 con 0x55f7ac15f650 2024-09-18T01:45:26.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.791+0000 7f2297f52640 1 --2- 172.21.15.146:0/769072491 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f7ac15f650 0x55f7ac1ee2b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f228800a470 tx=0x7f2288045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b29fc900e60e61b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.791+0000 7f2297751640 1 -- 172.21.15.146:0/769072491 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2288053570 con 0x55f7ac15f650 2024-09-18T01:45:26.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.791+0000 7f2297751640 1 -- 172.21.15.146:0/769072491 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2288058070 con 0x55f7ac15f650 2024-09-18T01:45:26.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.791+0000 7f2297751640 1 -- 172.21.15.146:0/769072491 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2288053880 con 0x55f7ac15f650 2024-09-18T01:45:26.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.792+0000 7f229cc36800 1 -- 172.21.15.146:0/769072491 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f7ac15f650 msgr2=0x55f7ac1ee2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.792+0000 7f229cc36800 1 --2- 172.21.15.146:0/769072491 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f7ac15f650 0x55f7ac1ee2b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f228800a470 tx=0x7f2288045a20 comp rx=0 tx=0).stop 2024-09-18T01:45:26.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.792+0000 7f229cc36800 1 -- 172.21.15.146:0/769072491 shutdown_connections 2024-09-18T01:45:26.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.792+0000 7f229cc36800 1 --2- 172.21.15.146:0/769072491 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f7ac15f650 0x55f7ac1ee2b0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.792+0000 7f229cc36800 1 -- 172.21.15.146:0/769072491 >> 172.21.15.146:0/769072491 conn(0x55f7ac1e5e20 msgr2=0x55f7ac1e8240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:26.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.792+0000 7f229cc36800 1 -- 172.21.15.146:0/769072491 shutdown_connections 2024-09-18T01:45:26.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.792+0000 7f229cc36800 1 -- 172.21.15.146:0/769072491 wait complete. 2024-09-18T01:45:26.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.805+0000 7f229cc36800 1 Processor -- start 2024-09-18T01:45:26.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.806+0000 7f229cc36800 1 -- start start 2024-09-18T01:45:26.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.806+0000 7f229cc36800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f7ac15f650 0x55f7ac2da980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.806+0000 7f229cc36800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55f7ac137370 con 0x55f7ac15f650 2024-09-18T01:45:26.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.806+0000 7f2297f52640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f7ac15f650 0x55f7ac2da980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.806+0000 7f2297f52640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f7ac15f650 0x55f7ac2da980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60888/0 (socket says 172.21.15.146:60888) 2024-09-18T01:45:26.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.806+0000 7f2297f52640 1 -- 172.21.15.146:0/717755397 learned_addr learned my addr 172.21.15.146:0/717755397 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:26.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.806+0000 7f2297f52640 1 -- 172.21.15.146:0/717755397 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7ac084bc0 con 0x55f7ac15f650 2024-09-18T01:45:26.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.807+0000 7f2297f52640 1 --2- 172.21.15.146:0/717755397 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f7ac15f650 0x55f7ac2da980 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2288025c20 tx=0x7f2288051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=873dd2a9baadf7c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.807+0000 7f2185e0b640 1 -- 172.21.15.146:0/717755397 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f228805c580 con 0x55f7ac15f650 2024-09-18T01:45:26.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.807+0000 7f2185e0b640 1 -- 172.21.15.146:0/717755397 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2288063030 con 0x55f7ac15f650 2024-09-18T01:45:26.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.807+0000 7f2185e0b640 1 -- 172.21.15.146:0/717755397 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f228805c850 con 0x55f7ac15f650 2024-09-18T01:45:26.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.807+0000 7f229cc36800 1 -- 172.21.15.146:0/717755397 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f7ac15f650 msgr2=0x55f7ac2da980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.807+0000 7f229cc36800 1 --2- 172.21.15.146:0/717755397 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f7ac15f650 0x55f7ac2da980 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2288025c20 tx=0x7f2288051000 comp rx=0 tx=0).stop 2024-09-18T01:45:26.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.807+0000 7f229cc36800 1 -- 172.21.15.146:0/717755397 shutdown_connections 2024-09-18T01:45:26.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.807+0000 7f229cc36800 1 --2- 172.21.15.146:0/717755397 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f7ac15f650 0x55f7ac2da980 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.807+0000 7f229cc36800 1 -- 172.21.15.146:0/717755397 >> 172.21.15.146:0/717755397 conn(0x55f7ac1e5e20 msgr2=0x55f7ac2d6340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:26.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.808+0000 7f229cc36800 1 -- 172.21.15.146:0/717755397 shutdown_connections 2024-09-18T01:45:26.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.808+0000 7f229cc36800 1 -- 172.21.15.146:0/717755397 wait complete. 2024-09-18T01:45:26.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.808+0000 7f229cc36800 1 Processor -- start 2024-09-18T01:45:26.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.808+0000 7f229cc36800 1 -- start start 2024-09-18T01:45:26.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.808+0000 7f229cc36800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f7ac15f650 0x55f7ac2e2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.808+0000 7f229cc36800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55f7ac1f26c0 con 0x55f7ac15f650 2024-09-18T01:45:26.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.808+0000 7f2297f52640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f7ac15f650 0x55f7ac2e2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.808+0000 7f2297f52640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f7ac15f650 0x55f7ac2e2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60902/0 (socket says 172.21.15.146:60902) 2024-09-18T01:45:26.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.808+0000 7f2297f52640 1 -- 172.21.15.146:0/1065577829 learned_addr learned my addr 172.21.15.146:0/1065577829 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:26.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.808+0000 7f2297f52640 1 -- 172.21.15.146:0/1065577829 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7ac098fe0 con 0x55f7ac15f650 2024-09-18T01:45:26.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.809+0000 7f2297f52640 1 --2- 172.21.15.146:0/1065577829 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f7ac15f650 0x55f7ac2e2260 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f228800a330 tx=0x7f2288002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.809+0000 7f217ffff640 1 -- 172.21.15.146:0/1065577829 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f228806c030 con 0x55f7ac15f650 2024-09-18T01:45:26.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.809+0000 7f217ffff640 1 -- 172.21.15.146:0/1065577829 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f228805c580 con 0x55f7ac15f650 2024-09-18T01:45:26.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.809+0000 7f229cc36800 1 -- 172.21.15.146:0/1065577829 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f7ac2e27a0 con 0x55f7ac15f650 2024-09-18T01:45:26.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.809+0000 7f217ffff640 1 -- 172.21.15.146:0/1065577829 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f228805c860 con 0x55f7ac15f650 2024-09-18T01:45:26.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.809+0000 7f229cc36800 1 -- 172.21.15.146:0/1065577829 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7ac2e2d20 con 0x55f7ac15f650 2024-09-18T01:45:26.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.810+0000 7f217ffff640 1 -- 172.21.15.146:0/1065577829 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2288053440 con 0x55f7ac15f650 2024-09-18T01:45:26.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.810+0000 7f217ffff640 1 --2- 172.21.15.146:0/1065577829 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2180036b40 0x7f2180039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.810+0000 7f217ffff640 1 -- 172.21.15.146:0/1065577829 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f2288070020 con 0x55f7ac15f650 2024-09-18T01:45:26.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.810+0000 7f228f751640 1 --2- 172.21.15.146:0/1065577829 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2180036b40 0x7f2180039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.810+0000 7f229cc36800 1 --2- 172.21.15.146:0/1065577829 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55f7ac1ee7f0 0x55f7ac2e92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.810+0000 7f229cc36800 1 -- 172.21.15.146:0/1065577829 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac2e9810 con 0x55f7ac1ee7f0 2024-09-18T01:45:26.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.810+0000 7f2298753640 1 --2- 172.21.15.146:0/1065577829 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55f7ac1ee7f0 0x55f7ac2e92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.810+0000 7f228f751640 1 --2- 172.21.15.146:0/1065577829 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2180036b40 0x7f2180039000 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2280000f60 tx=0x7f22800012b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.810+0000 7f2298753640 1 --2- 172.21.15.146:0/1065577829 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55f7ac1ee7f0 0x55f7ac2e92d0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.811+0000 7f2298753640 1 -- 172.21.15.146:0/1065577829 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f229000a4a0 con 0x55f7ac1ee7f0 2024-09-18T01:45:26.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.811+0000 7f229cc36800 1 -- 172.21.15.146:0/1065577829 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac2e68a0 con 0x55f7ac1ee7f0 2024-09-18T01:45:26.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.811+0000 7f2298753640 1 -- 172.21.15.146:0/1065577829 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f229000a4a0 con 0x55f7ac1ee7f0 2024-09-18T01:45:26.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.811+0000 7f229cc36800 1 -- 172.21.15.146:0/1065577829 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac2eb650 con 0x55f7ac1ee7f0 2024-09-18T01:45:26.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.811+0000 7f2298753640 1 -- 172.21.15.146:0/1065577829 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f229000a4a0 con 0x55f7ac1ee7f0 2024-09-18T01:45:26.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.811+0000 7f229cc36800 1 -- 172.21.15.146:0/1065577829 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac2ea790 con 0x55f7ac1ee7f0 2024-09-18T01:45:26.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.812+0000 7f2298753640 1 -- 172.21.15.146:0/1065577829 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f229000a4a0 con 0x55f7ac1ee7f0 2024-09-18T01:45:26.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.812+0000 7f229cc36800 1 --2- 172.21.15.146:0/1065577829 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55f7ac2eb260 0x55f7ac2eeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.812+0000 7f229cc36800 1 -- 172.21.15.146:0/1065577829 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac2ef230 con 0x55f7ac2eb260 2024-09-18T01:45:26.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.812+0000 7f2297f52640 1 --2- 172.21.15.146:0/1065577829 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55f7ac2eb260 0x55f7ac2eeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.812+0000 7f2297f52640 1 --2- 172.21.15.146:0/1065577829 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55f7ac2eb260 0x55f7ac2eeaa0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.812+0000 7f2297f52640 1 -- 172.21.15.146:0/1065577829 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f228807b070 con 0x55f7ac2eb260 2024-09-18T01:45:26.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.813+0000 7f229cc36800 1 Processor -- start 2024-09-18T01:45:26.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.813+0000 7f229cc36800 1 -- start start 2024-09-18T01:45:26.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.813+0000 7f229cc36800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f7ac2fcfc0 0x55f7ac2fd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.813+0000 7f229cc36800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55f7ac086580 con 0x55f7ac2fcfc0 2024-09-18T01:45:26.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.813+0000 7f2298753640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f7ac2fcfc0 0x55f7ac2fd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.813+0000 7f2298753640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f7ac2fcfc0 0x55f7ac2fd3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60908/0 (socket says 172.21.15.146:60908) 2024-09-18T01:45:26.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.813+0000 7f2298753640 1 -- 172.21.15.146:0/583679802 learned_addr learned my addr 172.21.15.146:0/583679802 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:26.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.814+0000 7f2298753640 1 -- 172.21.15.146:0/583679802 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7ac2fd920 con 0x55f7ac2fcfc0 2024-09-18T01:45:26.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.814+0000 7f2298753640 1 --2- 172.21.15.146:0/583679802 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f7ac2fcfc0 0x55f7ac2fd3e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x55f7ac2e9c10 tx=0x7f22900178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.814+0000 7f217d7fa640 1 -- 172.21.15.146:0/583679802 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2290013440 con 0x55f7ac2fcfc0 2024-09-18T01:45:26.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.814+0000 7f217d7fa640 1 -- 172.21.15.146:0/583679802 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22900135e0 con 0x55f7ac2fcfc0 2024-09-18T01:45:26.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.814+0000 7f217d7fa640 1 -- 172.21.15.146:0/583679802 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22900138c0 con 0x55f7ac2fcfc0 2024-09-18T01:45:26.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.814+0000 7f229cc36800 1 -- 172.21.15.146:0/583679802 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f7ac2fdbb0 con 0x55f7ac2fcfc0 2024-09-18T01:45:26.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.814+0000 7f229cc36800 1 -- 172.21.15.146:0/583679802 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7ac300890 con 0x55f7ac2fcfc0 2024-09-18T01:45:26.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.815+0000 7f217d7fa640 1 -- 172.21.15.146:0/583679802 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2290011040 con 0x55f7ac2fcfc0 2024-09-18T01:45:26.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.815+0000 7f217d7fa640 1 --2- 172.21.15.146:0/583679802 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2170036b90 0x7f2170039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.815+0000 7f217d7fa640 1 -- 172.21.15.146:0/583679802 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f229001d070 con 0x55f7ac2fcfc0 2024-09-18T01:45:26.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.815+0000 7f2297f52640 1 --2- 172.21.15.146:0/583679802 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2170036b90 0x7f2170039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.815+0000 7f229cc36800 1 Processor -- start 2024-09-18T01:45:26.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.815+0000 7f2297f52640 1 --2- 172.21.15.146:0/583679802 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2170036b90 0x7f2170039050 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f228800a010 tx=0x7f228808ee50 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.815+0000 7f229cc36800 1 -- start start 2024-09-18T01:45:26.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.815+0000 7f229cc36800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f7ac1eb530 0x55f7ac1eb930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.815+0000 7f229cc36800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55f7ac2db0d0 con 0x55f7ac1eb530 2024-09-18T01:45:26.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.816+0000 7f2298753640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f7ac1eb530 0x55f7ac1eb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.816+0000 7f2298753640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f7ac1eb530 0x55f7ac1eb930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60914/0 (socket says 172.21.15.146:60914) 2024-09-18T01:45:26.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.816+0000 7f2298753640 1 -- 172.21.15.146:0/2347925223 learned_addr learned my addr 172.21.15.146:0/2347925223 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:26.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.816+0000 7f2298753640 1 -- 172.21.15.146:0/2347925223 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7ac1ebf00 con 0x55f7ac1eb530 2024-09-18T01:45:26.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.816+0000 7f2298753640 1 --2- 172.21.15.146:0/2347925223 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f7ac1eb530 0x55f7ac1eb930 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f229004c890 tx=0x7f22900127a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab0bc25ff5e00c64 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.816+0000 7f2176ffd640 1 -- 172.21.15.146:0/2347925223 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2290045070 con 0x55f7ac1eb530 2024-09-18T01:45:26.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.816+0000 7f2176ffd640 1 -- 172.21.15.146:0/2347925223 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f229004e0d0 con 0x55f7ac1eb530 2024-09-18T01:45:26.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.816+0000 7f2176ffd640 1 -- 172.21.15.146:0/2347925223 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2290021a50 con 0x55f7ac1eb530 2024-09-18T01:45:26.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.817+0000 7f229cc36800 1 -- 172.21.15.146:0/2347925223 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f7ac1eb530 msgr2=0x55f7ac1eb930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.817+0000 7f229cc36800 1 --2- 172.21.15.146:0/2347925223 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f7ac1eb530 0x55f7ac1eb930 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f229004c890 tx=0x7f22900127a0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.817+0000 7f229cc36800 1 -- 172.21.15.146:0/2347925223 shutdown_connections 2024-09-18T01:45:26.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.817+0000 7f229cc36800 1 --2- 172.21.15.146:0/2347925223 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f7ac1eb530 0x55f7ac1eb930 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.817+0000 7f229cc36800 1 -- 172.21.15.146:0/2347925223 >> 172.21.15.146:0/2347925223 conn(0x55f7ac305fc0 msgr2=0x55f7ac3040c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:26.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.817+0000 7f229cc36800 1 -- 172.21.15.146:0/2347925223 shutdown_connections 2024-09-18T01:45:26.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.817+0000 7f229cc36800 1 -- 172.21.15.146:0/2347925223 wait complete. 2024-09-18T01:45:26.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.817+0000 7f229cc36800 1 Processor -- start 2024-09-18T01:45:26.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.817+0000 7f229cc36800 1 -- start start 2024-09-18T01:45:26.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.817+0000 7f229cc36800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f7ac1eb530 0x55f7ac3132d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.817+0000 7f229cc36800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55f7ac1ea210 con 0x55f7ac1eb530 2024-09-18T01:45:26.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.817+0000 7f2298753640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f7ac1eb530 0x55f7ac3132d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.817+0000 7f2298753640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f7ac1eb530 0x55f7ac3132d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60924/0 (socket says 172.21.15.146:60924) 2024-09-18T01:45:26.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.817+0000 7f2298753640 1 -- 172.21.15.146:0/2798389588 learned_addr learned my addr 172.21.15.146:0/2798389588 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:26.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.818+0000 7f2298753640 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7ac313810 con 0x55f7ac1eb530 2024-09-18T01:45:26.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.818+0000 7f2298753640 1 --2- 172.21.15.146:0/2798389588 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f7ac1eb530 0x55f7ac3132d0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f22900127e0 tx=0x7f229004c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.818+0000 7f21757fa640 1 -- 172.21.15.146:0/2798389588 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f229003a070 con 0x55f7ac1eb530 2024-09-18T01:45:26.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.818+0000 7f21757fa640 1 -- 172.21.15.146:0/2798389588 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2290001540 con 0x55f7ac1eb530 2024-09-18T01:45:26.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.818+0000 7f21757fa640 1 -- 172.21.15.146:0/2798389588 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2290045040 con 0x55f7ac1eb530 2024-09-18T01:45:26.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.818+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f7ac313aa0 con 0x55f7ac1eb530 2024-09-18T01:45:26.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.818+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7ac316750 con 0x55f7ac1eb530 2024-09-18T01:45:26.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.818+0000 7f21757fa640 1 -- 172.21.15.146:0/2798389588 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f229003d070 con 0x55f7ac1eb530 2024-09-18T01:45:26.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.819+0000 7f21757fa640 1 --2- 172.21.15.146:0/2798389588 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2160036b90 0x7f2160039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.819+0000 7f21757fa640 1 -- 172.21.15.146:0/2798389588 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f2290032070 con 0x55f7ac1eb530 2024-09-18T01:45:26.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.819+0000 7f2297f52640 1 --2- 172.21.15.146:0/2798389588 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2160036b90 0x7f2160039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.819+0000 7f2297f52640 1 --2- 172.21.15.146:0/2798389588 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2160036b90 0x7f2160039050 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2288009750 tx=0x7f2288091000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.819+0000 7f229cc36800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.819+0000 7f229cc36800 1 --2- 172.21.15.146:0/2798389588 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55f7ac31ef40 0x55f7ac321400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.819+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac321b50 con 0x55f7ac31ef40 2024-09-18T01:45:26.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.820+0000 7f228f751640 1 --2- 172.21.15.146:0/2798389588 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55f7ac31ef40 0x55f7ac321400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.820+0000 7f228f751640 1 --2- 172.21.15.146:0/2798389588 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55f7ac31ef40 0x55f7ac321400 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.820+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2280009050 con 0x55f7ac31ef40 2024-09-18T01:45:26.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.820+0000 7f229cc36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:26.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.820+0000 7f229cc36800 20 realm 2024-09-18T01:45:26.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.820+0000 7f229cc36800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.820+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac31e390 con 0x55f7ac31ef40 2024-09-18T01:45:26.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.820+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2280009050 con 0x55f7ac31ef40 2024-09-18T01:45:26.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.820+0000 7f229cc36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:26.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.820+0000 7f229cc36800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:26.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.820+0000 7f229cc36800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.820+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac322640 con 0x55f7ac31ef40 2024-09-18T01:45:26.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.820+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2280009050 con 0x55f7ac31ef40 2024-09-18T01:45:26.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.820+0000 7f229cc36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:26.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.820+0000 7f229cc36800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.821+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac322f10 con 0x55f7ac31ef40 2024-09-18T01:45:26.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.821+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2280009050 con 0x55f7ac31ef40 2024-09-18T01:45:26.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.821+0000 7f229cc36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:26.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.821+0000 7f229cc36800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.821+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac3232b0 con 0x55f7ac31ef40 2024-09-18T01:45:26.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.821+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2280009050 con 0x55f7ac31ef40 2024-09-18T01:45:26.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.821+0000 7f229cc36800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:26.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.821+0000 7f229cc36800 20 searching for the correct realm 2024-09-18T01:45:26.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.821+0000 7f229cc36800 1 --2- 172.21.15.146:0/2798389588 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55f7ac325190 0x55f7ac327580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.821+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac327c30 con 0x55f7ac325190 2024-09-18T01:45:26.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.821+0000 7f2298753640 1 --2- 172.21.15.146:0/2798389588 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55f7ac325190 0x55f7ac327580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.821+0000 7f2298753640 1 --2- 172.21.15.146:0/2798389588 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55f7ac325190 0x55f7ac327580 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.822+0000 7f2298753640 1 -- 172.21.15.146:0/2798389588 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f229003c030 con 0x55f7ac325190 2024-09-18T01:45:26.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.822+0000 7f2298753640 1 --2- 172.21.15.146:0/2798389588 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f229003f060 0x7f229002c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.822+0000 7f2298753640 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac327c30 con 0x7f229003f060 2024-09-18T01:45:26.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.822+0000 7f2297f52640 1 --2- 172.21.15.146:0/2798389588 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f229003f060 0x7f229002c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.822+0000 7f2297f52640 1 --2- 172.21.15.146:0/2798389588 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f229003f060 0x7f229002c7a0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.822+0000 7f2297f52640 1 -- 172.21.15.146:0/2798389588 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f228807b070 con 0x7f229003f060 2024-09-18T01:45:26.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.822+0000 7f2297f52640 1 --2- 172.21.15.146:0/2798389588 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f228805c070 0x7f228805f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.822+0000 7f2297f52640 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac327c30 con 0x7f228805c070 2024-09-18T01:45:26.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.823+0000 7f228f751640 1 --2- 172.21.15.146:0/2798389588 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f228805c070 0x7f228805f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.823+0000 7f228f751640 1 --2- 172.21.15.146:0/2798389588 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f228805c070 0x7f228805f760 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.823+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2280009050 con 0x7f228805c070 2024-09-18T01:45:26.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.823+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac327c30 con 0x55f7ac31ef40 2024-09-18T01:45:26.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.823+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2280009050 con 0x55f7ac31ef40 2024-09-18T01:45:26.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.823+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac327c30 con 0x55f7ac31ef40 2024-09-18T01:45:26.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.824+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f228002a040 con 0x55f7ac31ef40 2024-09-18T01:45:26.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.824+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac327c30 con 0x7f228805c070 2024-09-18T01:45:26.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.824+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f228002a040 con 0x7f228805c070 2024-09-18T01:45:26.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.824+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac327c30 con 0x7f228805c070 2024-09-18T01:45:26.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.824+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f228002a040 con 0x7f228805c070 2024-09-18T01:45:26.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.824+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac327c30 con 0x7f229003f060 2024-09-18T01:45:26.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.824+0000 7f2297f52640 1 -- 172.21.15.146:0/2798389588 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f228807b070 con 0x7f229003f060 2024-09-18T01:45:26.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.824+0000 7f2297f52640 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac327c30 con 0x55f7ac325190 2024-09-18T01:45:26.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.825+0000 7f2298753640 1 -- 172.21.15.146:0/2798389588 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f229003c030 con 0x55f7ac325190 2024-09-18T01:45:26.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.825+0000 7f2298753640 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac327c30 con 0x55f7ac31ef40 2024-09-18T01:45:26.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.825+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f228002a040 con 0x55f7ac31ef40 2024-09-18T01:45:26.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.825+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac327c30 con 0x7f228805c070 2024-09-18T01:45:26.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.825+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f228002a040 con 0x7f228805c070 2024-09-18T01:45:26.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.825+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac327c30 con 0x55f7ac31ef40 2024-09-18T01:45:26.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.825+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f228002a040 con 0x55f7ac31ef40 2024-09-18T01:45:26.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.825+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac327c30 con 0x7f229003f060 2024-09-18T01:45:26.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.826+0000 7f2297f52640 1 -- 172.21.15.146:0/2798389588 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f228807b070 con 0x7f229003f060 2024-09-18T01:45:26.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.826+0000 7f2297f52640 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac327c30 con 0x55f7ac325190 2024-09-18T01:45:26.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.826+0000 7f2298753640 1 -- 172.21.15.146:0/2798389588 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f229003c030 con 0x55f7ac325190 2024-09-18T01:45:26.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.826+0000 7f2298753640 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac327c30 con 0x55f7ac325190 2024-09-18T01:45:26.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.826+0000 7f2298753640 1 -- 172.21.15.146:0/2798389588 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f229003c030 con 0x55f7ac325190 2024-09-18T01:45:26.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.826+0000 7f2298753640 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac327c30 con 0x7f228805c070 2024-09-18T01:45:26.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.827+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f228002a040 con 0x7f228805c070 2024-09-18T01:45:26.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.827+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac327c30 con 0x55f7ac325190 2024-09-18T01:45:26.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.827+0000 7f2298753640 1 -- 172.21.15.146:0/2798389588 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f229003c030 con 0x55f7ac325190 2024-09-18T01:45:26.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.827+0000 7f2298753640 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac327c30 con 0x55f7ac325190 2024-09-18T01:45:26.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.827+0000 7f2298753640 1 -- 172.21.15.146:0/2798389588 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f229003c030 con 0x55f7ac325190 2024-09-18T01:45:26.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.827+0000 7f2298753640 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac327c30 con 0x55f7ac31ef40 2024-09-18T01:45:26.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.827+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f228002a040 con 0x55f7ac31ef40 2024-09-18T01:45:26.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.827+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac327c30 con 0x55f7ac31ef40 2024-09-18T01:45:26.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.827+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f228002a040 con 0x55f7ac31ef40 2024-09-18T01:45:26.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.827+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac327c30 con 0x7f228805c070 2024-09-18T01:45:26.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.828+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f228002a040 con 0x7f228805c070 2024-09-18T01:45:26.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.828+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac327c30 con 0x55f7ac325190 2024-09-18T01:45:26.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.828+0000 7f2298753640 1 -- 172.21.15.146:0/2798389588 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f229003c030 con 0x55f7ac325190 2024-09-18T01:45:26.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.828+0000 7f2298753640 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac327c30 con 0x7f229003f060 2024-09-18T01:45:26.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.828+0000 7f2297f52640 1 -- 172.21.15.146:0/2798389588 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f228807b070 con 0x7f229003f060 2024-09-18T01:45:26.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.828+0000 7f2297f52640 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac327c30 con 0x55f7ac31ef40 2024-09-18T01:45:26.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.828+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f228002a040 con 0x55f7ac31ef40 2024-09-18T01:45:26.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.828+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac327c30 con 0x7f228805c070 2024-09-18T01:45:26.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.829+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f228002a040 con 0x7f228805c070 2024-09-18T01:45:26.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.829+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac327c30 con 0x55f7ac325190 2024-09-18T01:45:26.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.829+0000 7f2298753640 1 -- 172.21.15.146:0/2798389588 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f229003c030 con 0x55f7ac325190 2024-09-18T01:45:26.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.829+0000 7f2298753640 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac327c30 con 0x7f228805c070 2024-09-18T01:45:26.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.829+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f228002a040 con 0x7f228805c070 2024-09-18T01:45:26.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.829+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac327c30 con 0x7f229003f060 2024-09-18T01:45:26.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.829+0000 7f2297f52640 1 -- 172.21.15.146:0/2798389588 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f228807b070 con 0x7f229003f060 2024-09-18T01:45:26.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.829+0000 7f2297f52640 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac327c30 con 0x55f7ac325190 2024-09-18T01:45:26.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.830+0000 7f2298753640 1 -- 172.21.15.146:0/2798389588 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f229003c030 con 0x55f7ac325190 2024-09-18T01:45:26.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.830+0000 7f2298753640 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac327c30 con 0x7f228805c070 2024-09-18T01:45:26.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.830+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f228002a040 con 0x7f228805c070 2024-09-18T01:45:26.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.830+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac327c30 con 0x55f7ac31ef40 2024-09-18T01:45:26.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.830+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f228002a040 con 0x55f7ac31ef40 2024-09-18T01:45:26.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.830+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac327c30 con 0x7f229003f060 2024-09-18T01:45:26.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.830+0000 7f2297f52640 1 -- 172.21.15.146:0/2798389588 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22880b1040 con 0x7f229003f060 2024-09-18T01:45:26.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.830+0000 7f229cc36800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:26.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.830+0000 7f229cc36800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:26.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.830+0000 7f229cc36800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:26.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.830+0000 7f229cc36800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:26.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.830+0000 7f229cc36800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:26.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.830+0000 7f229cc36800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:26.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.830+0000 7f229cc36800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.830+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac323c60 con 0x55f7ac31ef40 2024-09-18T01:45:26.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.831+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f228002a040 con 0x55f7ac31ef40 2024-09-18T01:45:26.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.831+0000 7f229cc36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:26.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.831+0000 7f229cc36800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.831+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac324500 con 0x55f7ac31ef40 2024-09-18T01:45:26.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.831+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f228002a040 con 0x55f7ac31ef40 2024-09-18T01:45:26.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.831+0000 7f229cc36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:26.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.831+0000 7f229cc36800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.831+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac3280b0 con 0x7f229003f060 2024-09-18T01:45:26.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.831+0000 7f2297f52640 1 -- 172.21.15.146:0/2798389588 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f22880b1040 con 0x7f229003f060 2024-09-18T01:45:26.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.831+0000 7f229cc36800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:26.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.831+0000 7f229cc36800 20 zone default found 2024-09-18T01:45:26.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.831+0000 7f229cc36800 4 Realm: () 2024-09-18T01:45:26.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.831+0000 7f229cc36800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:26.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.831+0000 7f229cc36800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:26.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.831+0000 7f229cc36800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:26.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.831+0000 7f229cc36800 20 zonegroup default 2024-09-18T01:45:26.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.831+0000 7f229cc36800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.831+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac328900 con 0x7f228805c070 2024-09-18T01:45:26.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.832+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f228002a040 con 0x7f228805c070 2024-09-18T01:45:26.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.832+0000 7f229cc36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:26.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.832+0000 7f229cc36800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.832+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac32a310 con 0x55f7ac325190 2024-09-18T01:45:26.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.832+0000 7f2298753640 1 -- 172.21.15.146:0/2798389588 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f229003c030 con 0x55f7ac325190 2024-09-18T01:45:26.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.832+0000 7f229cc36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:26.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.832+0000 7f229cc36800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.832+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac32a820 con 0x55f7ac325190 2024-09-18T01:45:26.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.832+0000 7f2298753640 1 -- 172.21.15.146:0/2798389588 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f229003c030 con 0x55f7ac325190 2024-09-18T01:45:26.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.832+0000 7f229cc36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:26.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.832+0000 7f229cc36800 20 started sync module instance, tier type = 2024-09-18T01:45:26.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.832+0000 7f229cc36800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:26.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.832+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac329770 con 0x7f229003f060 2024-09-18T01:45:26.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.833+0000 7f2297f52640 1 -- 172.21.15.146:0/2798389588 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v31'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22880b1040 con 0x7f229003f060 2024-09-18T01:45:26.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.833+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94522234280800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac3293d0 con 0x7f229003f060 2024-09-18T01:45:26.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.833+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac32b750 con 0x55f7ac31ef40 2024-09-18T01:45:26.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.834+0000 7f2297f52640 1 -- 172.21.15.146:0/2798389588 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94522234280800] v31'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22880b1040 con 0x7f229003f060 2024-09-18T01:45:26.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.834+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v31'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f228002a040 con 0x55f7ac31ef40 2024-09-18T01:45:26.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.834+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94522234286752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac32bb70 con 0x55f7ac31ef40 2024-09-18T01:45:26.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.834+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac32c530 con 0x55f7ac325190 2024-09-18T01:45:26.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.835+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94522234286752] v31'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f228002a040 con 0x55f7ac31ef40 2024-09-18T01:45:26.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.835+0000 7f2298753640 1 -- 172.21.15.146:0/2798389588 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v31'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f229003c030 con 0x55f7ac325190 2024-09-18T01:45:26.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.836+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94522234290784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac32bb70 con 0x55f7ac325190 2024-09-18T01:45:26.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.836+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac32cf40 con 0x7f229003f060 2024-09-18T01:45:26.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.836+0000 7f2298753640 1 -- 172.21.15.146:0/2798389588 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94522234290784] v31'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f229003c030 con 0x55f7ac325190 2024-09-18T01:45:26.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.837+0000 7f2297f52640 1 -- 172.21.15.146:0/2798389588 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v31'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22880b1040 con 0x7f229003f060 2024-09-18T01:45:26.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.837+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94522234287808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac32bae0 con 0x7f229003f060 2024-09-18T01:45:26.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.837+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac32de30 con 0x55f7ac31ef40 2024-09-18T01:45:26.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.838+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v31'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f228002a040 con 0x55f7ac31ef40 2024-09-18T01:45:26.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.838+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94522234296704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac32e290 con 0x55f7ac31ef40 2024-09-18T01:45:26.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.838+0000 7f2297f52640 1 -- 172.21.15.146:0/2798389588 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94522234287808] v31'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22880b1040 con 0x7f229003f060 2024-09-18T01:45:26.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.838+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac32ed90 con 0x7f228805c070 2024-09-18T01:45:26.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.839+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94522234296704] v31'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f228002a040 con 0x55f7ac31ef40 2024-09-18T01:45:26.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.839+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v31'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f228002a040 con 0x7f228805c070 2024-09-18T01:45:26.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.839+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94522234295216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac32dda0 con 0x7f228805c070 2024-09-18T01:45:26.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.839+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac32f370 con 0x7f228805c070 2024-09-18T01:45:26.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.840+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94522234295216] v31'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f228002a040 con 0x7f228805c070 2024-09-18T01:45:26.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.840+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v31'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f228002a040 con 0x7f228805c070 2024-09-18T01:45:26.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.840+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94522234300544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac32f370 con 0x7f228805c070 2024-09-18T01:45:26.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.840+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac32fc00 con 0x7f228805c070 2024-09-18T01:45:26.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.841+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94522234300544] v31'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f228002a040 con 0x7f228805c070 2024-09-18T01:45:26.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.841+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v31'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f228002a040 con 0x7f228805c070 2024-09-18T01:45:26.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.841+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94522234302144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac32fde0 con 0x7f228805c070 2024-09-18T01:45:26.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.841+0000 7f229cc36800 20 add_watcher() i=0 2024-09-18T01:45:26.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.841+0000 7f229cc36800 20 add_watcher() i=1 2024-09-18T01:45:26.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.841+0000 7f229cc36800 20 add_watcher() i=2 2024-09-18T01:45:26.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.841+0000 7f229cc36800 20 add_watcher() i=3 2024-09-18T01:45:26.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.841+0000 7f229cc36800 20 add_watcher() i=4 2024-09-18T01:45:26.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.841+0000 7f229cc36800 20 add_watcher() i=5 2024-09-18T01:45:26.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.841+0000 7f229cc36800 20 add_watcher() i=6 2024-09-18T01:45:26.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.842+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94522234302144] v31'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f228002a040 con 0x7f228805c070 2024-09-18T01:45:26.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.842+0000 7f229cc36800 20 add_watcher() i=7 2024-09-18T01:45:26.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.842+0000 7f229cc36800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:26.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.842+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac3331b0 con 0x55f7ac31ef40 2024-09-18T01:45:26.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.842+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f228002a040 con 0x55f7ac31ef40 2024-09-18T01:45:26.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.842+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94522234305744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac3305a0 con 0x55f7ac31ef40 2024-09-18T01:45:26.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.843+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94522234305744] v31'112 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f228002a040 con 0x55f7ac31ef40 2024-09-18T01:45:26.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.843+0000 7f214dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:26.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.843+0000 7f229cc36800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:26.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.843+0000 7f229cc36800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:26.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.843+0000 7f229cc36800 5 note: GC not initialized 2024-09-18T01:45:26.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.843+0000 7f214cfe1640 20 reqs_thread_entry: start 2024-09-18T01:45:26.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.844+0000 7f229cc36800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:26.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.844+0000 7f229cc36800 20 Filter name: none 2024-09-18T01:45:26.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.844+0000 7f20c67fc640 20 reqs_thread_entry: start 2024-09-18T01:45:26.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.844+0000 7f229cc36800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-18T01:45:26.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.844+0000 7f229cc36800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.844+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac3664b0 con 0x7f228805c070 2024-09-18T01:45:26.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.844+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f228002a040 con 0x7f228805c070 2024-09-18T01:45:26.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.844+0000 7f229cc36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:26.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.844+0000 7f229cc36800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-18T01:45:26.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.844+0000 7f229cc36800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-18T01:45:26.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.844+0000 7f229cc36800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-18T01:45:26.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.844+0000 7f229cc36800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.844+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac364af0 con 0x7f228805c070 2024-09-18T01:45:26.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.845+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f228002a040 con 0x7f228805c070 2024-09-18T01:45:26.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.845+0000 7f229cc36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:26.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.845+0000 7f229cc36800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-18T01:45:26.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.845+0000 7f229cc36800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-18T01:45:26.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.845+0000 7f229cc36800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-18T01:45:26.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.845+0000 7f229cc36800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-18T01:45:26.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.845+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac365390 con 0x7f228805c070 2024-09-18T01:45:26.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.846+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v31'5 uv5 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f228002a040 con 0x7f228805c070 2024-09-18T01:45:26.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.846+0000 7f229cc36800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-18T01:45:26.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.846+0000 7f229cc36800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-18T01:45:26.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.846+0000 7f229cc36800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-18T01:45:26.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.846+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94522234523360 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac369f50 con 0x7f228805c070 2024-09-18T01:45:26.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.846+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== watch-notify(notify (1) cookie 94522234295216 notify 133143986179 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55f7ac365730 con 0x7f228805c070 2024-09-18T01:45:26.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.846+0000 7f2176ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986179 cookie 94522234295216 notifier 4495 bl.length()=556 2024-09-18T01:45:26.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.846+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== osd_op_reply(65 notify.5 [notify cookie 94522234523360 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f228002a040 con 0x7f228805c070 2024-09-18T01:45:26.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.846+0000 7f2176ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-18T01:45:26.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.846+0000 7f2176ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-18T01:45:26.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.846+0000 7f2176ffd640 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f215c003ea0 con 0x7f228805c070 2024-09-18T01:45:26.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.846+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 <== osd.0 v2:172.21.15.129:6800/1759265424 22 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f228002a040 con 0x7f228805c070 2024-09-18T01:45:26.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.846+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 <== osd.0 v2:172.21.15.129:6800/1759265424 23 ==== watch-notify(notify_complete (2) cookie 94522234523360 notify 133143986179 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f7ac365f00 con 0x7f228805c070 2024-09-18T01:45:26.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.846+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac367a00 con 0x7f228805c070 2024-09-18T01:45:26.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.847+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 <== osd.0 v2:172.21.15.129:6800/1759265424 24 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v31'4 uv4 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f228002a040 con 0x7f228805c070 2024-09-18T01:45:26.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.847+0000 7f229cc36800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-18T01:45:26.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.847+0000 7f229cc36800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-18T01:45:26.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.847+0000 7f229cc36800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-18T01:45:26.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.847+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94522234523280 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac369ed0 con 0x55f7ac325190 2024-09-18T01:45:26.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.847+0000 7f2298753640 1 -- 172.21.15.146:0/2798389588 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== watch-notify(notify (1) cookie 94522234290784 notify 133143986178 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55f7ac316750 con 0x55f7ac325190 2024-09-18T01:45:26.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.848+0000 7f2176ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986178 cookie 94522234290784 notifier 4495 bl.length()=177 2024-09-18T01:45:26.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.848+0000 7f2298753640 1 -- 172.21.15.146:0/2798389588 <== osd.3 v2:172.21.15.146:6809/4106661138 15 ==== osd_op_reply(68 notify.2 [notify cookie 94522234523280 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f229003c030 con 0x55f7ac325190 2024-09-18T01:45:26.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.848+0000 7f2176ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-18T01:45:26.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.848+0000 7f2176ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-18T01:45:26.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.848+0000 7f2176ffd640 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f215c003ea0 con 0x55f7ac325190 2024-09-18T01:45:26.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.848+0000 7f2298753640 1 -- 172.21.15.146:0/2798389588 <== osd.3 v2:172.21.15.146:6809/4106661138 16 ==== watch-notify(notify_complete (2) cookie 94522234523280 notify 133143986178 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f7ac313aa0 con 0x55f7ac325190 2024-09-18T01:45:26.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.848+0000 7f2298753640 1 -- 172.21.15.146:0/2798389588 <== osd.3 v2:172.21.15.146:6809/4106661138 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f229003c030 con 0x55f7ac325190 2024-09-18T01:45:26.862 INFO:teuthology.orchestra.run.smithi146.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-18T01:45:26.845544Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:45:26.845534Z","tags":[],"group_ids":[]} 2024-09-18T01:45:26.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.849+0000 7f214dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:26.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.849+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94522234305744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac364170 con 0x55f7ac31ef40 2024-09-18T01:45:26.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.850+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94522234305744] v31'113 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f228002a040 con 0x55f7ac31ef40 2024-09-18T01:45:26.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.850+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94522234280800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac364170 con 0x7f229003f060 2024-09-18T01:45:26.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.851+0000 7f2297f52640 1 -- 172.21.15.146:0/2798389588 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94522234280800] v31'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22880b1040 con 0x7f229003f060 2024-09-18T01:45:26.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.851+0000 7f229cc36800 20 remove_watcher() i=0 2024-09-18T01:45:26.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.851+0000 7f229cc36800 2 removed watcher, disabling cache 2024-09-18T01:45:26.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.851+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94522234286752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac364170 con 0x55f7ac31ef40 2024-09-18T01:45:26.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.852+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94522234286752] v31'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f228002a040 con 0x55f7ac31ef40 2024-09-18T01:45:26.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.852+0000 7f229cc36800 20 remove_watcher() i=1 2024-09-18T01:45:26.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.852+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94522234290784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac364170 con 0x55f7ac325190 2024-09-18T01:45:26.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.853+0000 7f2298753640 1 -- 172.21.15.146:0/2798389588 <== osd.3 v2:172.21.15.146:6809/4106661138 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94522234290784] v31'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f229003c030 con 0x55f7ac325190 2024-09-18T01:45:26.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.853+0000 7f229cc36800 20 remove_watcher() i=2 2024-09-18T01:45:26.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.853+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94522234287808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac364170 con 0x7f229003f060 2024-09-18T01:45:26.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.854+0000 7f2297f52640 1 -- 172.21.15.146:0/2798389588 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94522234287808] v31'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22880b1040 con 0x7f229003f060 2024-09-18T01:45:26.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.854+0000 7f229cc36800 20 remove_watcher() i=3 2024-09-18T01:45:26.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.854+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94522234296704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac364170 con 0x55f7ac31ef40 2024-09-18T01:45:26.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.855+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94522234296704] v31'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f228002a040 con 0x55f7ac31ef40 2024-09-18T01:45:26.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.855+0000 7f229cc36800 20 remove_watcher() i=4 2024-09-18T01:45:26.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.855+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94522234295216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac364170 con 0x7f228805c070 2024-09-18T01:45:26.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.856+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 <== osd.0 v2:172.21.15.129:6800/1759265424 25 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94522234295216] v31'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f228002a040 con 0x7f228805c070 2024-09-18T01:45:26.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.856+0000 7f229cc36800 20 remove_watcher() i=5 2024-09-18T01:45:26.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.856+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94522234300544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac364170 con 0x7f228805c070 2024-09-18T01:45:26.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.857+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 <== osd.0 v2:172.21.15.129:6800/1759265424 26 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94522234300544] v31'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f228002a040 con 0x7f228805c070 2024-09-18T01:45:26.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.857+0000 7f229cc36800 20 remove_watcher() i=6 2024-09-18T01:45:26.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.857+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94522234302144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f7ac364170 con 0x7f228805c070 2024-09-18T01:45:26.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.858+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 <== osd.0 v2:172.21.15.129:6800/1759265424 27 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94522234302144] v31'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f228002a040 con 0x7f228805c070 2024-09-18T01:45:26.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.858+0000 7f229cc36800 20 remove_watcher() i=7 2024-09-18T01:45:26.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.858+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f228805c070 msgr2=0x7f228805f760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.858+0000 7f229cc36800 1 --2- 172.21.15.146:0/2798389588 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f228805c070 0x7f228805f760 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.858+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55f7ac31ef40 msgr2=0x55f7ac321400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.858+0000 7f229cc36800 1 --2- 172.21.15.146:0/2798389588 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55f7ac31ef40 0x55f7ac321400 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.858+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f229003f060 msgr2=0x7f229002c7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.858+0000 7f229cc36800 1 --2- 172.21.15.146:0/2798389588 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f229003f060 0x7f229002c7a0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.858+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55f7ac325190 msgr2=0x55f7ac327580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.858+0000 7f229cc36800 1 --2- 172.21.15.146:0/2798389588 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55f7ac325190 0x55f7ac327580 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.858+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2160036b90 msgr2=0x7f2160039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.858+0000 7f229cc36800 1 --2- 172.21.15.146:0/2798389588 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2160036b90 0x7f2160039050 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2288009750 tx=0x7f2288091000 comp rx=0 tx=0).stop 2024-09-18T01:45:26.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.858+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f7ac1eb530 msgr2=0x55f7ac3132d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.858+0000 7f229cc36800 1 --2- 172.21.15.146:0/2798389588 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f7ac1eb530 0x55f7ac3132d0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f22900127e0 tx=0x7f229004c820 comp rx=0 tx=0).stop 2024-09-18T01:45:26.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.858+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 reap_dead start 2024-09-18T01:45:26.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.858+0000 7f228f751640 1 -- 172.21.15.146:0/2798389588 reap_dead start 2024-09-18T01:45:26.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.858+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 shutdown_connections 2024-09-18T01:45:26.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.858+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 >> 172.21.15.146:0/2798389588 conn(0x55f7ac305fc0 msgr2=0x55f7ac304090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:26.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.858+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 shutdown_connections 2024-09-18T01:45:26.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.858+0000 7f229cc36800 1 -- 172.21.15.146:0/2798389588 wait complete. 2024-09-18T01:45:26.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.859+0000 7f229cc36800 1 -- 172.21.15.146:0/583679802 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2170036b90 msgr2=0x7f2170039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.859+0000 7f229cc36800 1 --2- 172.21.15.146:0/583679802 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2170036b90 0x7f2170039050 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f228800a010 tx=0x7f228808ee50 comp rx=0 tx=0).stop 2024-09-18T01:45:26.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.859+0000 7f229cc36800 1 -- 172.21.15.146:0/583679802 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f7ac2fcfc0 msgr2=0x55f7ac2fd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.859+0000 7f229cc36800 1 --2- 172.21.15.146:0/583679802 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f7ac2fcfc0 0x55f7ac2fd3e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x55f7ac2e9c10 tx=0x7f22900178e0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.859+0000 7f229cc36800 1 -- 172.21.15.146:0/583679802 shutdown_connections 2024-09-18T01:45:26.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.859+0000 7f229cc36800 1 --2- 172.21.15.146:0/583679802 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2170036b90 0x7f2170039050 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.859+0000 7f229cc36800 1 --2- 172.21.15.146:0/583679802 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f7ac2fcfc0 0x55f7ac2fd3e0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.859+0000 7f229cc36800 1 -- 172.21.15.146:0/583679802 >> 172.21.15.146:0/583679802 conn(0x55f7ac2f1f50 msgr2=0x55f7ac2f4ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:26.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.859+0000 7f229cc36800 1 -- 172.21.15.146:0/583679802 shutdown_connections 2024-09-18T01:45:26.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.859+0000 7f229cc36800 1 -- 172.21.15.146:0/583679802 wait complete. 2024-09-18T01:45:26.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.859+0000 7f229cc36800 1 -- 172.21.15.146:0/1065577829 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55f7ac1ee7f0 msgr2=0x55f7ac2e92d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.859+0000 7f229cc36800 1 --2- 172.21.15.146:0/1065577829 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55f7ac1ee7f0 0x55f7ac2e92d0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.859+0000 7f229cc36800 1 -- 172.21.15.146:0/1065577829 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55f7ac2eb260 msgr2=0x55f7ac2eeaa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.859+0000 7f229cc36800 1 --2- 172.21.15.146:0/1065577829 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55f7ac2eb260 0x55f7ac2eeaa0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.859+0000 7f229cc36800 1 -- 172.21.15.146:0/1065577829 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2180036b40 msgr2=0x7f2180039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.859+0000 7f229cc36800 1 --2- 172.21.15.146:0/1065577829 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2180036b40 0x7f2180039000 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2280000f60 tx=0x7f22800012b0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.859+0000 7f229cc36800 1 -- 172.21.15.146:0/1065577829 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f7ac15f650 msgr2=0x55f7ac2e2260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.859+0000 7f229cc36800 1 --2- 172.21.15.146:0/1065577829 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f7ac15f650 0x55f7ac2e2260 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f228800a330 tx=0x7f2288002fb0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.859+0000 7f229cc36800 1 -- 172.21.15.146:0/1065577829 shutdown_connections 2024-09-18T01:45:26.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.859+0000 7f229cc36800 1 --2- 172.21.15.146:0/1065577829 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55f7ac2eb260 0x55f7ac2eeaa0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.859+0000 7f229cc36800 1 --2- 172.21.15.146:0/1065577829 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55f7ac1ee7f0 0x55f7ac2e92d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.859+0000 7f229cc36800 1 --2- 172.21.15.146:0/1065577829 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2180036b40 0x7f2180039000 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.859+0000 7f229cc36800 1 --2- 172.21.15.146:0/1065577829 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f7ac15f650 0x55f7ac2e2260 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.859+0000 7f229cc36800 1 -- 172.21.15.146:0/1065577829 >> 172.21.15.146:0/1065577829 conn(0x55f7ac1e5e20 msgr2=0x55f7ac2d4bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:26.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.859+0000 7f229cc36800 1 -- 172.21.15.146:0/1065577829 shutdown_connections 2024-09-18T01:45:26.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.859+0000 7f229cc36800 1 -- 172.21.15.146:0/1065577829 wait complete. 2024-09-18T01:45:26.874 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-18T01:45:26.845544Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:45:26.845534Z', 'tags': [], 'group_ids': []} 2024-09-18T01:45:26.879 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-18T01:45:26.883 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T01:45:26.883 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:myfoo'] 2024-09-18T01:45:26.883 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:myfoo'] 2024-09-18T01:45:26.884 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:myfoo 2024-09-18T01:45:26.926 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:26.926 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:26.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.927+0000 7fab8632c800 1 Processor -- start 2024-09-18T01:45:26.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.927+0000 7fab8632c800 1 -- start start 2024-09-18T01:45:26.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.927+0000 7fab8632c800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x559cd9eab8e0 0x559cd9eadcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.927+0000 7fab8632c800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559cd9d66b30 con 0x559cd9e1ae10 2024-09-18T01:45:26.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.927+0000 7fab8632c800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x559cd9d48360 con 0x559cd9eab8e0 2024-09-18T01:45:26.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.927+0000 7fab7bfff640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x559cd9eab8e0 0x559cd9eadcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.927+0000 7fab820b7640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x559cd9e1ae10 0x559cd9eaa1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:38996/0 (socket says 172.21.15.146:38996) 2024-09-18T01:45:26.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.927+0000 7fab820b7640 1 -- 172.21.15.146:0/2689209875 learned_addr learned my addr 172.21.15.146:0/2689209875 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:45:26.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.927+0000 7fab7bfff640 1 -- 172.21.15.146:0/2689209875 >> v1:172.21.15.129:6789/0 conn(0x559cd9e1ae10 legacy=0x559cd9eaa1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.927+0000 7fab7bfff640 1 -- 172.21.15.146:0/2689209875 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cd9d6ee00 con 0x559cd9eab8e0 2024-09-18T01:45:26.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.929+0000 7fab7bfff640 1 --2- 172.21.15.146:0/2689209875 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559cd9eab8e0 0x559cd9eadcd0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fab6c00a470 tx=0x7fab6c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f72b86c1388dc81b server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.929+0000 7fab818b6640 1 -- 172.21.15.146:0/2689209875 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab6c053570 con 0x559cd9eab8e0 2024-09-18T01:45:26.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.929+0000 7fab818b6640 1 -- 172.21.15.146:0/2689209875 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab6c058070 con 0x559cd9eab8e0 2024-09-18T01:45:26.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.929+0000 7fab818b6640 1 -- 172.21.15.146:0/2689209875 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab6c053880 con 0x559cd9eab8e0 2024-09-18T01:45:26.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.930+0000 7fab8632c800 1 -- 172.21.15.146:0/2689209875 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559cd9eab8e0 msgr2=0x559cd9eadcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.930+0000 7fab8632c800 1 --2- 172.21.15.146:0/2689209875 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559cd9eab8e0 0x559cd9eadcd0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fab6c00a470 tx=0x7fab6c045a20 comp rx=0 tx=0).stop 2024-09-18T01:45:26.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.930+0000 7fab8632c800 1 -- 172.21.15.146:0/2689209875 shutdown_connections 2024-09-18T01:45:26.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.930+0000 7fab8632c800 1 --2- 172.21.15.146:0/2689209875 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559cd9eab8e0 0x559cd9eadcd0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.930+0000 7fab8632c800 1 -- 172.21.15.146:0/2689209875 >> 172.21.15.146:0/2689209875 conn(0x559cd9ea1df0 msgr2=0x559cd9ea4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:26.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.930+0000 7fab8632c800 1 -- 172.21.15.146:0/2689209875 shutdown_connections 2024-09-18T01:45:26.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.930+0000 7fab8632c800 1 -- 172.21.15.146:0/2689209875 wait complete. 2024-09-18T01:45:26.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.944+0000 7fab8632c800 1 Processor -- start 2024-09-18T01:45:26.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.944+0000 7fab8632c800 1 -- start start 2024-09-18T01:45:26.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.944+0000 7fab8632c800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559cd9e1ae10 0x559cd9f96870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.944+0000 7fab8632c800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x559cd9df3330 con 0x559cd9e1ae10 2024-09-18T01:45:26.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.944+0000 7fab820b7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559cd9e1ae10 0x559cd9f96870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.944+0000 7fab820b7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559cd9e1ae10 0x559cd9f96870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60936/0 (socket says 172.21.15.146:60936) 2024-09-18T01:45:26.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.944+0000 7fab820b7640 1 -- 172.21.15.146:0/2849653264 learned_addr learned my addr 172.21.15.146:0/2849653264 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:26.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.944+0000 7fab820b7640 1 -- 172.21.15.146:0/2849653264 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cd9d40bc0 con 0x559cd9e1ae10 2024-09-18T01:45:26.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.945+0000 7fab820b7640 1 --2- 172.21.15.146:0/2849653264 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559cd9e1ae10 0x559cd9f96870 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fab74001e10 tx=0x7fab7400b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fb09a52480597fa server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.945+0000 7faa70608640 1 -- 172.21.15.146:0/2849653264 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab74012020 con 0x559cd9e1ae10 2024-09-18T01:45:26.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.945+0000 7faa70608640 1 -- 172.21.15.146:0/2849653264 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab7400e5a0 con 0x559cd9e1ae10 2024-09-18T01:45:26.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.945+0000 7faa70608640 1 -- 172.21.15.146:0/2849653264 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab7400e8e0 con 0x559cd9e1ae10 2024-09-18T01:45:26.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.945+0000 7fab8632c800 1 -- 172.21.15.146:0/2849653264 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559cd9e1ae10 msgr2=0x559cd9f96870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.945+0000 7fab8632c800 1 --2- 172.21.15.146:0/2849653264 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559cd9e1ae10 0x559cd9f96870 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fab74001e10 tx=0x7fab7400b780 comp rx=0 tx=0).stop 2024-09-18T01:45:26.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.945+0000 7fab8632c800 1 -- 172.21.15.146:0/2849653264 shutdown_connections 2024-09-18T01:45:26.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.945+0000 7fab8632c800 1 --2- 172.21.15.146:0/2849653264 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559cd9e1ae10 0x559cd9f96870 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.945+0000 7fab8632c800 1 -- 172.21.15.146:0/2849653264 >> 172.21.15.146:0/2849653264 conn(0x559cd9ea1df0 msgr2=0x559cd9f92230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:26.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.946+0000 7fab8632c800 1 -- 172.21.15.146:0/2849653264 shutdown_connections 2024-09-18T01:45:26.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.946+0000 7fab8632c800 1 -- 172.21.15.146:0/2849653264 wait complete. 2024-09-18T01:45:26.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.946+0000 7fab8632c800 1 Processor -- start 2024-09-18T01:45:26.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.946+0000 7fab8632c800 1 -- start start 2024-09-18T01:45:26.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.946+0000 7fab8632c800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559cd9e1ae10 0x559cd9f9e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.946+0000 7fab8632c800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x559cd9eae600 con 0x559cd9e1ae10 2024-09-18T01:45:26.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.946+0000 7fab820b7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559cd9e1ae10 0x559cd9f9e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.946+0000 7fab820b7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559cd9e1ae10 0x559cd9f9e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60946/0 (socket says 172.21.15.146:60946) 2024-09-18T01:45:26.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.946+0000 7fab820b7640 1 -- 172.21.15.146:0/761859016 learned_addr learned my addr 172.21.15.146:0/761859016 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:26.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.946+0000 7fab820b7640 1 -- 172.21.15.146:0/761859016 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cd9d54fe0 con 0x559cd9e1ae10 2024-09-18T01:45:26.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.947+0000 7fab820b7640 1 --2- 172.21.15.146:0/761859016 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559cd9e1ae10 0x559cd9f9e240 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fab74001e10 tx=0x7fab74000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.947+0000 7faa6ee05640 1 -- 172.21.15.146:0/761859016 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab74012030 con 0x559cd9e1ae10 2024-09-18T01:45:26.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.947+0000 7faa6ee05640 1 -- 172.21.15.146:0/761859016 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab7401a7a0 con 0x559cd9e1ae10 2024-09-18T01:45:26.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.947+0000 7fab8632c800 1 -- 172.21.15.146:0/761859016 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559cd9f9e780 con 0x559cd9e1ae10 2024-09-18T01:45:26.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.947+0000 7faa6ee05640 1 -- 172.21.15.146:0/761859016 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab7401aac0 con 0x559cd9e1ae10 2024-09-18T01:45:26.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.947+0000 7fab8632c800 1 -- 172.21.15.146:0/761859016 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559cd9f9eca0 con 0x559cd9e1ae10 2024-09-18T01:45:26.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.948+0000 7faa6ee05640 1 -- 172.21.15.146:0/761859016 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fab74015020 con 0x559cd9e1ae10 2024-09-18T01:45:26.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.948+0000 7faa6ee05640 1 --2- 172.21.15.146:0/761859016 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7faa68036b40 0x7faa68039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.948+0000 7faa6ee05640 1 -- 172.21.15.146:0/761859016 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fab74020030 con 0x559cd9e1ae10 2024-09-18T01:45:26.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.948+0000 7fab7bfff640 1 --2- 172.21.15.146:0/761859016 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7faa68036b40 0x7faa68039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.948+0000 7fab8632c800 1 --2- 172.21.15.146:0/761859016 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559cd9eab8e0 0x559cd9fa52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.948+0000 7fab8632c800 1 -- 172.21.15.146:0/761859016 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fa57f0 con 0x559cd9eab8e0 2024-09-18T01:45:26.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.948+0000 7fab828b8640 1 --2- 172.21.15.146:0/761859016 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559cd9eab8e0 0x559cd9fa52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.948+0000 7fab7bfff640 1 --2- 172.21.15.146:0/761859016 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7faa68036b40 0x7faa68039000 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fab6c057000 tx=0x7fab6c052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.948+0000 7fab828b8640 1 --2- 172.21.15.146:0/761859016 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559cd9eab8e0 0x559cd9fa52b0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.949+0000 7fab828b8640 1 -- 172.21.15.146:0/761859016 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab7c00a4a0 con 0x559cd9eab8e0 2024-09-18T01:45:26.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.949+0000 7fab8632c800 1 -- 172.21.15.146:0/761859016 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fa2860 con 0x559cd9eab8e0 2024-09-18T01:45:26.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.949+0000 7fab828b8640 1 -- 172.21.15.146:0/761859016 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fab7c00a4a0 con 0x559cd9eab8e0 2024-09-18T01:45:26.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.949+0000 7fab8632c800 1 -- 172.21.15.146:0/761859016 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fa75f0 con 0x559cd9eab8e0 2024-09-18T01:45:26.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.949+0000 7fab828b8640 1 -- 172.21.15.146:0/761859016 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fab7c00a4a0 con 0x559cd9eab8e0 2024-09-18T01:45:26.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.949+0000 7fab8632c800 1 -- 172.21.15.146:0/761859016 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fa6730 con 0x559cd9eab8e0 2024-09-18T01:45:26.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.949+0000 7fab828b8640 1 -- 172.21.15.146:0/761859016 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fab7c00a4a0 con 0x559cd9eab8e0 2024-09-18T01:45:26.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.950+0000 7fab8632c800 1 --2- 172.21.15.146:0/761859016 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x559cd9fa71d0 0x559cd9faaa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.950+0000 7fab8632c800 1 -- 172.21.15.146:0/761859016 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fab1c0 con 0x559cd9fa71d0 2024-09-18T01:45:26.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.950+0000 7fab820b7640 1 --2- 172.21.15.146:0/761859016 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x559cd9fa71d0 0x559cd9faaa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.950+0000 7fab820b7640 1 --2- 172.21.15.146:0/761859016 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x559cd9fa71d0 0x559cd9faaa30 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.950+0000 7fab820b7640 1 -- 172.21.15.146:0/761859016 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fab7400dcd0 con 0x559cd9fa71d0 2024-09-18T01:45:26.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.950+0000 7fab8632c800 1 Processor -- start 2024-09-18T01:45:26.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.951+0000 7fab8632c800 1 -- start start 2024-09-18T01:45:26.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.951+0000 7fab8632c800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559cd9ea7b70 0x559cd9ea61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.951+0000 7fab8632c800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x559cd9d42580 con 0x559cd9ea7b70 2024-09-18T01:45:26.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.951+0000 7fab828b8640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559cd9ea7b70 0x559cd9ea61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.951+0000 7fab828b8640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559cd9ea7b70 0x559cd9ea61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60962/0 (socket says 172.21.15.146:60962) 2024-09-18T01:45:26.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.951+0000 7fab828b8640 1 -- 172.21.15.146:0/1542406607 learned_addr learned my addr 172.21.15.146:0/1542406607 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:26.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.951+0000 7fab828b8640 1 -- 172.21.15.146:0/1542406607 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cd9ea7f90 con 0x559cd9ea7b70 2024-09-18T01:45:26.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.951+0000 7fab828b8640 1 --2- 172.21.15.146:0/1542406607 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559cd9ea7b70 0x559cd9ea61c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x559cd9fa5bd0 tx=0x7fab7c0178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.951+0000 7faa67fff640 1 -- 172.21.15.146:0/1542406607 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab7c013440 con 0x559cd9ea7b70 2024-09-18T01:45:26.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.951+0000 7faa67fff640 1 -- 172.21.15.146:0/1542406607 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab7c0135e0 con 0x559cd9ea7b70 2024-09-18T01:45:26.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.951+0000 7fab8632c800 1 -- 172.21.15.146:0/1542406607 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559cd9ea67c0 con 0x559cd9ea7b70 2024-09-18T01:45:26.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.951+0000 7faa67fff640 1 -- 172.21.15.146:0/1542406607 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab7c0138c0 con 0x559cd9ea7b70 2024-09-18T01:45:26.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.952+0000 7fab8632c800 1 -- 172.21.15.146:0/1542406607 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559cd9ea6cc0 con 0x559cd9ea7b70 2024-09-18T01:45:26.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.952+0000 7faa67fff640 1 -- 172.21.15.146:0/1542406607 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fab7c011040 con 0x559cd9ea7b70 2024-09-18T01:45:26.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.952+0000 7faa67fff640 1 --2- 172.21.15.146:0/1542406607 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7faa5c036b90 0x7faa5c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.952+0000 7faa67fff640 1 -- 172.21.15.146:0/1542406607 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fab7c01d070 con 0x559cd9ea7b70 2024-09-18T01:45:26.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.952+0000 7fab820b7640 1 --2- 172.21.15.146:0/1542406607 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7faa5c036b90 0x7faa5c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.953+0000 7fab8632c800 1 Processor -- start 2024-09-18T01:45:26.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.953+0000 7fab8632c800 1 -- start start 2024-09-18T01:45:26.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.953+0000 7fab820b7640 1 --2- 172.21.15.146:0/1542406607 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7faa5c036b90 0x7faa5c039050 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x559cd9fa6ad0 tx=0x7fab74041040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.953+0000 7fab8632c800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559cd9fc7dc0 0x559cd9fc81c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.953+0000 7fab8632c800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x559cd9f97020 con 0x559cd9fc7dc0 2024-09-18T01:45:26.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.953+0000 7fab828b8640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559cd9fc7dc0 0x559cd9fc81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.953+0000 7fab828b8640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559cd9fc7dc0 0x559cd9fc81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60976/0 (socket says 172.21.15.146:60976) 2024-09-18T01:45:26.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.953+0000 7fab828b8640 1 -- 172.21.15.146:0/4136750263 learned_addr learned my addr 172.21.15.146:0/4136750263 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:26.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.953+0000 7fab828b8640 1 -- 172.21.15.146:0/4136750263 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cd9fc8790 con 0x559cd9fc7dc0 2024-09-18T01:45:26.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.953+0000 7fab828b8640 1 --2- 172.21.15.146:0/4136750263 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559cd9fc7dc0 0x559cd9fc81c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fab7c04c970 tx=0x7fab7c04cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66e0a83ab308422e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.954+0000 7faa65ffb640 1 -- 172.21.15.146:0/4136750263 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab7c02b3a0 con 0x559cd9fc7dc0 2024-09-18T01:45:26.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.954+0000 7faa65ffb640 1 -- 172.21.15.146:0/4136750263 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab7c041e50 con 0x559cd9fc7dc0 2024-09-18T01:45:26.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.954+0000 7faa65ffb640 1 -- 172.21.15.146:0/4136750263 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab7c021a50 con 0x559cd9fc7dc0 2024-09-18T01:45:26.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.954+0000 7fab8632c800 1 -- 172.21.15.146:0/4136750263 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559cd9fc7dc0 msgr2=0x559cd9fc81c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:26.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.954+0000 7fab8632c800 1 --2- 172.21.15.146:0/4136750263 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559cd9fc7dc0 0x559cd9fc81c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fab7c04c970 tx=0x7fab7c04cbf0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.954+0000 7fab8632c800 1 -- 172.21.15.146:0/4136750263 shutdown_connections 2024-09-18T01:45:26.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.954+0000 7fab8632c800 1 --2- 172.21.15.146:0/4136750263 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559cd9fc7dc0 0x559cd9fc81c0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:26.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.954+0000 7fab8632c800 1 -- 172.21.15.146:0/4136750263 >> 172.21.15.146:0/4136750263 conn(0x559cd9fc4170 msgr2=0x559cd9fc2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:26.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.954+0000 7fab8632c800 1 -- 172.21.15.146:0/4136750263 shutdown_connections 2024-09-18T01:45:26.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.954+0000 7fab8632c800 1 -- 172.21.15.146:0/4136750263 wait complete. 2024-09-18T01:45:26.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.954+0000 7fab8632c800 1 Processor -- start 2024-09-18T01:45:26.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.954+0000 7fab8632c800 1 -- start start 2024-09-18T01:45:26.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.955+0000 7fab8632c800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559cd9fc7dc0 0x559cd9fcf240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.955+0000 7fab8632c800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x559cd9fc8d60 con 0x559cd9fc7dc0 2024-09-18T01:45:26.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.955+0000 7fab828b8640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559cd9fc7dc0 0x559cd9fcf240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.955+0000 7fab828b8640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559cd9fc7dc0 0x559cd9fcf240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:60986/0 (socket says 172.21.15.146:60986) 2024-09-18T01:45:26.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.955+0000 7fab828b8640 1 -- 172.21.15.146:0/530942942 learned_addr learned my addr 172.21.15.146:0/530942942 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:26.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.955+0000 7fab828b8640 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cd9fcf780 con 0x559cd9fc7dc0 2024-09-18T01:45:26.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.955+0000 7fab828b8640 1 --2- 172.21.15.146:0/530942942 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559cd9fc7dc0 0x559cd9fcf240 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fab7c04b860 tx=0x7fab7c04c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.955+0000 7faa53fff640 1 -- 172.21.15.146:0/530942942 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab7c046030 con 0x559cd9fc7dc0 2024-09-18T01:45:26.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.955+0000 7faa53fff640 1 -- 172.21.15.146:0/530942942 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab7c04e0f0 con 0x559cd9fc7dc0 2024-09-18T01:45:26.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.955+0000 7fab8632c800 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559cd9fcfa10 con 0x559cd9fc7dc0 2024-09-18T01:45:26.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.955+0000 7faa53fff640 1 -- 172.21.15.146:0/530942942 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab7c012ab0 con 0x559cd9fc7dc0 2024-09-18T01:45:26.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.955+0000 7fab8632c800 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559cd9fd26c0 con 0x559cd9fc7dc0 2024-09-18T01:45:26.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.956+0000 7faa53fff640 1 -- 172.21.15.146:0/530942942 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fab7c012c50 con 0x559cd9fc7dc0 2024-09-18T01:45:26.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.956+0000 7faa53fff640 1 --2- 172.21.15.146:0/530942942 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7faa4c036b40 0x7faa4c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.956+0000 7faa53fff640 1 -- 172.21.15.146:0/530942942 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fab7c033070 con 0x559cd9fc7dc0 2024-09-18T01:45:26.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.956+0000 7fab820b7640 1 --2- 172.21.15.146:0/530942942 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7faa4c036b40 0x7faa4c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.956+0000 7fab8632c800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.957+0000 7fab8632c800 1 --2- 172.21.15.146:0/530942942 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559cd9fdaf20 0x559cd9fdd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.957+0000 7fab8632c800 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fddb30 con 0x559cd9fdaf20 2024-09-18T01:45:26.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.957+0000 7fab820b7640 1 --2- 172.21.15.146:0/530942942 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7faa4c036b40 0x7faa4c039000 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fab74001750 tx=0x7fab74035000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.957+0000 7fab7bfff640 1 --2- 172.21.15.146:0/530942942 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559cd9fdaf20 0x559cd9fdd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.957+0000 7fab7bfff640 1 --2- 172.21.15.146:0/530942942 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559cd9fdaf20 0x559cd9fdd3e0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.957+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab6c051070 con 0x559cd9fdaf20 2024-09-18T01:45:26.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.957+0000 7fab8632c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:26.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.957+0000 7fab8632c800 20 realm 2024-09-18T01:45:26.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.957+0000 7fab8632c800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.957+0000 7fab8632c800 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fddf60 con 0x559cd9fdaf20 2024-09-18T01:45:26.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.957+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab6c051070 con 0x559cd9fdaf20 2024-09-18T01:45:26.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.957+0000 7fab8632c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:26.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.957+0000 7fab8632c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:26.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.957+0000 7fab8632c800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.957+0000 7fab8632c800 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fde830 con 0x559cd9fdaf20 2024-09-18T01:45:26.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.958+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab6c051070 con 0x559cd9fdaf20 2024-09-18T01:45:26.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.958+0000 7fab8632c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:26.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.958+0000 7fab8632c800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.958+0000 7fab8632c800 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fdebd0 con 0x559cd9fdaf20 2024-09-18T01:45:26.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.958+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fab6c051070 con 0x559cd9fdaf20 2024-09-18T01:45:26.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.958+0000 7fab8632c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:26.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.958+0000 7fab8632c800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.958+0000 7fab8632c800 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fde440 con 0x559cd9fdaf20 2024-09-18T01:45:26.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.958+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fab6c051070 con 0x559cd9fdaf20 2024-09-18T01:45:26.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.958+0000 7fab8632c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:26.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.958+0000 7fab8632c800 20 searching for the correct realm 2024-09-18T01:45:26.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.958+0000 7fab8632c800 1 --2- 172.21.15.146:0/530942942 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x559cd9fe1090 0x559cd9fe34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.958+0000 7fab8632c800 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fe3b70 con 0x559cd9fe1090 2024-09-18T01:45:26.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.958+0000 7fab828b8640 1 --2- 172.21.15.146:0/530942942 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x559cd9fe1090 0x559cd9fe34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.958+0000 7fab828b8640 1 --2- 172.21.15.146:0/530942942 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x559cd9fe1090 0x559cd9fe34a0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.959+0000 7fab828b8640 1 -- 172.21.15.146:0/530942942 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7c03d020 con 0x559cd9fe1090 2024-09-18T01:45:26.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.959+0000 7fab828b8640 1 --2- 172.21.15.146:0/530942942 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fab7c007230 0x7fab7c035580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.959+0000 7fab828b8640 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fe3b70 con 0x7fab7c007230 2024-09-18T01:45:26.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.959+0000 7fab820b7640 1 --2- 172.21.15.146:0/530942942 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fab7c007230 0x7fab7c035580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.959+0000 7fab820b7640 1 --2- 172.21.15.146:0/530942942 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fab7c007230 0x7fab7c035580 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.959+0000 7fab820b7640 1 -- 172.21.15.146:0/530942942 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7400dcd0 con 0x7fab7c007230 2024-09-18T01:45:26.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.959+0000 7fab820b7640 1 --2- 172.21.15.146:0/530942942 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fab74017050 0x7fab7400d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:26.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.959+0000 7fab820b7640 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fe3b70 con 0x7fab74017050 2024-09-18T01:45:26.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.960+0000 7fab7bfff640 1 --2- 172.21.15.146:0/530942942 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fab74017050 0x7fab7400d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:26.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.960+0000 7fab7bfff640 1 --2- 172.21.15.146:0/530942942 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fab74017050 0x7fab7400d3d0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:26.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.960+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6c051070 con 0x7fab74017050 2024-09-18T01:45:26.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.960+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fe3b70 con 0x559cd9fdaf20 2024-09-18T01:45:26.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.960+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fab6c051070 con 0x559cd9fdaf20 2024-09-18T01:45:26.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.960+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fe3b70 con 0x559cd9fdaf20 2024-09-18T01:45:26.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.961+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6c051070 con 0x559cd9fdaf20 2024-09-18T01:45:26.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.961+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fe3b70 con 0x7fab74017050 2024-09-18T01:45:26.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.961+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6c051070 con 0x7fab74017050 2024-09-18T01:45:26.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.961+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fe3b70 con 0x7fab74017050 2024-09-18T01:45:26.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.961+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6c051070 con 0x7fab74017050 2024-09-18T01:45:26.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.961+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fe3b70 con 0x7fab7c007230 2024-09-18T01:45:26.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.962+0000 7fab820b7640 1 -- 172.21.15.146:0/530942942 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7400dcd0 con 0x7fab7c007230 2024-09-18T01:45:26.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.962+0000 7fab820b7640 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fe3b70 con 0x559cd9fe1090 2024-09-18T01:45:26.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.962+0000 7fab828b8640 1 -- 172.21.15.146:0/530942942 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7c03d020 con 0x559cd9fe1090 2024-09-18T01:45:26.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.962+0000 7fab828b8640 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fe3b70 con 0x559cd9fdaf20 2024-09-18T01:45:26.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.962+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6c051070 con 0x559cd9fdaf20 2024-09-18T01:45:26.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.962+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fe3b70 con 0x7fab74017050 2024-09-18T01:45:26.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.962+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6c051070 con 0x7fab74017050 2024-09-18T01:45:26.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.962+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fe3b70 con 0x559cd9fdaf20 2024-09-18T01:45:26.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.962+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6c051070 con 0x559cd9fdaf20 2024-09-18T01:45:26.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.962+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fe3b70 con 0x7fab7c007230 2024-09-18T01:45:26.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.963+0000 7fab820b7640 1 -- 172.21.15.146:0/530942942 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fab7400dcd0 con 0x7fab7c007230 2024-09-18T01:45:26.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.963+0000 7fab820b7640 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fe3b70 con 0x559cd9fe1090 2024-09-18T01:45:26.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.963+0000 7fab828b8640 1 -- 172.21.15.146:0/530942942 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7c03d020 con 0x559cd9fe1090 2024-09-18T01:45:26.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.963+0000 7fab828b8640 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fe3b70 con 0x559cd9fe1090 2024-09-18T01:45:26.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.963+0000 7fab828b8640 1 -- 172.21.15.146:0/530942942 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7c03d020 con 0x559cd9fe1090 2024-09-18T01:45:26.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.963+0000 7fab828b8640 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fe3b70 con 0x7fab74017050 2024-09-18T01:45:26.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.963+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6c051070 con 0x7fab74017050 2024-09-18T01:45:26.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.963+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fe3b70 con 0x559cd9fe1090 2024-09-18T01:45:26.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.964+0000 7fab828b8640 1 -- 172.21.15.146:0/530942942 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7c03d020 con 0x559cd9fe1090 2024-09-18T01:45:26.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.964+0000 7fab828b8640 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fe3b70 con 0x559cd9fe1090 2024-09-18T01:45:26.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.964+0000 7fab828b8640 1 -- 172.21.15.146:0/530942942 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7c03d020 con 0x559cd9fe1090 2024-09-18T01:45:26.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.964+0000 7fab828b8640 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fe3b70 con 0x559cd9fdaf20 2024-09-18T01:45:26.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.964+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6c051070 con 0x559cd9fdaf20 2024-09-18T01:45:26.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.964+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fe3b70 con 0x559cd9fdaf20 2024-09-18T01:45:26.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.964+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fab6c051070 con 0x559cd9fdaf20 2024-09-18T01:45:26.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.964+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fe3b70 con 0x7fab74017050 2024-09-18T01:45:26.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.965+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6c051070 con 0x7fab74017050 2024-09-18T01:45:26.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.965+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fe3b70 con 0x559cd9fe1090 2024-09-18T01:45:26.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.965+0000 7fab828b8640 1 -- 172.21.15.146:0/530942942 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7c03d020 con 0x559cd9fe1090 2024-09-18T01:45:26.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.965+0000 7fab828b8640 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fe3b70 con 0x7fab7c007230 2024-09-18T01:45:26.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.965+0000 7fab820b7640 1 -- 172.21.15.146:0/530942942 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7400dcd0 con 0x7fab7c007230 2024-09-18T01:45:26.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.965+0000 7fab820b7640 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fe3b70 con 0x559cd9fdaf20 2024-09-18T01:45:26.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.966+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6c051070 con 0x559cd9fdaf20 2024-09-18T01:45:26.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.966+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fe3b70 con 0x7fab74017050 2024-09-18T01:45:26.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.966+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6c051070 con 0x7fab74017050 2024-09-18T01:45:26.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.966+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fe3b70 con 0x559cd9fe1090 2024-09-18T01:45:26.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.966+0000 7fab828b8640 1 -- 172.21.15.146:0/530942942 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7c03d020 con 0x559cd9fe1090 2024-09-18T01:45:26.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.966+0000 7fab828b8640 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fe3b70 con 0x7fab74017050 2024-09-18T01:45:26.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.966+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6c051070 con 0x7fab74017050 2024-09-18T01:45:26.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.966+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fe3b70 con 0x7fab7c007230 2024-09-18T01:45:26.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.967+0000 7fab820b7640 1 -- 172.21.15.146:0/530942942 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7400dcd0 con 0x7fab7c007230 2024-09-18T01:45:26.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.967+0000 7fab820b7640 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fe3b70 con 0x559cd9fe1090 2024-09-18T01:45:26.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.967+0000 7fab828b8640 1 -- 172.21.15.146:0/530942942 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7c03d020 con 0x559cd9fe1090 2024-09-18T01:45:26.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.967+0000 7fab828b8640 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fe3b70 con 0x7fab74017050 2024-09-18T01:45:26.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.967+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6c051070 con 0x7fab74017050 2024-09-18T01:45:26.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.967+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fe3b70 con 0x559cd9fdaf20 2024-09-18T01:45:26.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.967+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fab6c051070 con 0x559cd9fdaf20 2024-09-18T01:45:26.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.967+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fe3b70 con 0x7fab7c007230 2024-09-18T01:45:26.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.967+0000 7fab820b7640 1 -- 172.21.15.146:0/530942942 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab74060040 con 0x7fab7c007230 2024-09-18T01:45:26.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.968+0000 7fab8632c800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:26.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.968+0000 7fab8632c800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:26.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.968+0000 7fab8632c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:26.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.968+0000 7fab8632c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:26.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.968+0000 7fab8632c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:26.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.968+0000 7fab8632c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:26.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.968+0000 7fab8632c800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.968+0000 7fab8632c800 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fdfb10 con 0x559cd9fdaf20 2024-09-18T01:45:26.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.968+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab6c051070 con 0x559cd9fdaf20 2024-09-18T01:45:26.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.968+0000 7fab8632c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:26.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.968+0000 7fab8632c800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.968+0000 7fab8632c800 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fe03b0 con 0x559cd9fdaf20 2024-09-18T01:45:26.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.968+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fab6c051070 con 0x559cd9fdaf20 2024-09-18T01:45:26.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.968+0000 7fab8632c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:26.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.968+0000 7fab8632c800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.968+0000 7fab8632c800 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fdf750 con 0x7fab7c007230 2024-09-18T01:45:26.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.968+0000 7fab820b7640 1 -- 172.21.15.146:0/530942942 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fab74060040 con 0x7fab7c007230 2024-09-18T01:45:26.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.968+0000 7fab8632c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:26.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.968+0000 7fab8632c800 20 zone default found 2024-09-18T01:45:26.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.968+0000 7fab8632c800 4 Realm: () 2024-09-18T01:45:26.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.968+0000 7fab8632c800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:26.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.968+0000 7fab8632c800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:26.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.968+0000 7fab8632c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:26.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.968+0000 7fab8632c800 20 zonegroup default 2024-09-18T01:45:26.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.968+0000 7fab8632c800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.968+0000 7fab8632c800 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fe44a0 con 0x7fab74017050 2024-09-18T01:45:26.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.969+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fab6c051070 con 0x7fab74017050 2024-09-18T01:45:26.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.969+0000 7fab8632c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:26.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.969+0000 7fab8632c800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.969+0000 7fab8632c800 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fe6000 con 0x559cd9fe1090 2024-09-18T01:45:26.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.969+0000 7fab828b8640 1 -- 172.21.15.146:0/530942942 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fab7c03d020 con 0x559cd9fe1090 2024-09-18T01:45:26.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.969+0000 7fab8632c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:26.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.969+0000 7fab8632c800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.969+0000 7fab8632c800 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fe6540 con 0x559cd9fe1090 2024-09-18T01:45:26.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.969+0000 7fab828b8640 1 -- 172.21.15.146:0/530942942 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fab7c03d020 con 0x559cd9fe1090 2024-09-18T01:45:26.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.969+0000 7fab8632c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:26.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.969+0000 7fab8632c800 20 started sync module instance, tier type = 2024-09-18T01:45:26.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.969+0000 7fab8632c800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:26.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.969+0000 7fab8632c800 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fe4f00 con 0x7fab7c007230 2024-09-18T01:45:26.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.970+0000 7fab820b7640 1 -- 172.21.15.146:0/530942942 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v31'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab74060040 con 0x7fab7c007230 2024-09-18T01:45:26.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.970+0000 7fab8632c800 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94132160582384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fe6e50 con 0x7fab7c007230 2024-09-18T01:45:26.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.970+0000 7fab8632c800 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fe76a0 con 0x559cd9fdaf20 2024-09-18T01:45:26.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.971+0000 7fab820b7640 1 -- 172.21.15.146:0/530942942 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94132160582384] v31'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab74060040 con 0x7fab7c007230 2024-09-18T01:45:26.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.971+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v31'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6c051070 con 0x559cd9fdaf20 2024-09-18T01:45:26.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.971+0000 7fab8632c800 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94132160588192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fe76a0 con 0x559cd9fdaf20 2024-09-18T01:45:26.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.971+0000 7fab8632c800 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fe8180 con 0x559cd9fe1090 2024-09-18T01:45:26.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.972+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94132160588192] v31'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6c051070 con 0x559cd9fdaf20 2024-09-18T01:45:26.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.973+0000 7fab828b8640 1 -- 172.21.15.146:0/530942942 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v31'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab7c03d020 con 0x559cd9fe1090 2024-09-18T01:45:26.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.973+0000 7fab8632c800 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94132160590320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fe8140 con 0x559cd9fe1090 2024-09-18T01:45:26.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.973+0000 7fab8632c800 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fe8c20 con 0x7fab7c007230 2024-09-18T01:45:26.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.973+0000 7fab820b7640 1 -- 172.21.15.146:0/530942942 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v31'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab74060040 con 0x7fab7c007230 2024-09-18T01:45:26.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.974+0000 7fab8632c800 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94132160595760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fe94c0 con 0x7fab7c007230 2024-09-18T01:45:26.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.974+0000 7fab8632c800 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fe9f80 con 0x559cd9fdaf20 2024-09-18T01:45:26.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.974+0000 7fab828b8640 1 -- 172.21.15.146:0/530942942 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94132160590320] v31'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab7c03d020 con 0x559cd9fe1090 2024-09-18T01:45:26.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.975+0000 7fab820b7640 1 -- 172.21.15.146:0/530942942 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94132160595760] v31'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab74060040 con 0x7fab7c007230 2024-09-18T01:45:26.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.975+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v31'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6c051070 con 0x559cd9fdaf20 2024-09-18T01:45:26.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.975+0000 7fab8632c800 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94132160598032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fe7c90 con 0x559cd9fdaf20 2024-09-18T01:45:26.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.975+0000 7fab8632c800 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fea820 con 0x7fab74017050 2024-09-18T01:45:26.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.976+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v31'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6c051070 con 0x7fab74017050 2024-09-18T01:45:26.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.976+0000 7fab8632c800 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94132160602832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559cd9feac50 con 0x7fab74017050 2024-09-18T01:45:26.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.976+0000 7fab8632c800 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559cd9feb740 con 0x7fab74017050 2024-09-18T01:45:26.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.976+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94132160598032] v31'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6c051070 con 0x559cd9fdaf20 2024-09-18T01:45:26.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.977+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(56 notify.6 [create] v31'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6c051070 con 0x7fab74017050 2024-09-18T01:45:26.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.977+0000 7fab8632c800 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94132160606736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559cd9feb700 con 0x7fab74017050 2024-09-18T01:45:26.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.977+0000 7fab8632c800 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fec100 con 0x7fab74017050 2024-09-18T01:45:26.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.977+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94132160602832] v31'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6c051070 con 0x7fab74017050 2024-09-18T01:45:26.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.978+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94132160606736] v31'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6c051070 con 0x7fab74017050 2024-09-18T01:45:26.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.978+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v31'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6c051070 con 0x7fab74017050 2024-09-18T01:45:26.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.978+0000 7fab8632c800 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94132160600656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559cd9febc10 con 0x7fab74017050 2024-09-18T01:45:26.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.978+0000 7fab8632c800 20 add_watcher() i=0 2024-09-18T01:45:26.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.978+0000 7fab8632c800 20 add_watcher() i=1 2024-09-18T01:45:26.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.978+0000 7fab8632c800 20 add_watcher() i=2 2024-09-18T01:45:26.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.978+0000 7fab8632c800 20 add_watcher() i=3 2024-09-18T01:45:26.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.978+0000 7fab8632c800 20 add_watcher() i=4 2024-09-18T01:45:26.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.978+0000 7fab8632c800 20 add_watcher() i=5 2024-09-18T01:45:26.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.978+0000 7fab8632c800 20 add_watcher() i=6 2024-09-18T01:45:26.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.979+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94132160600656] v31'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6c051070 con 0x7fab74017050 2024-09-18T01:45:26.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.979+0000 7fab8632c800 20 add_watcher() i=7 2024-09-18T01:45:26.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.979+0000 7fab8632c800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:26.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.979+0000 7fab8632c800 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fef0f0 con 0x559cd9fdaf20 2024-09-18T01:45:26.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.979+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fab6c051070 con 0x559cd9fdaf20 2024-09-18T01:45:26.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.979+0000 7fab8632c800 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94132160609296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559cd9fec4e0 con 0x559cd9fdaf20 2024-09-18T01:45:26.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.980+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94132160609296] v31'114 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fab6c051070 con 0x559cd9fdaf20 2024-09-18T01:45:26.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.980+0000 7faa38fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:26.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.980+0000 7fab8632c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:26.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.980+0000 7fab8632c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:26.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.980+0000 7fab8632c800 5 note: GC not initialized 2024-09-18T01:45:26.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.981+0000 7fa9b37fe640 20 reqs_thread_entry: start 2024-09-18T01:45:26.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.981+0000 7fab8632c800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:26.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.981+0000 7fab8632c800 20 Filter name: none 2024-09-18T01:45:26.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.981+0000 7fa9b17fa640 20 reqs_thread_entry: start 2024-09-18T01:45:26.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.981+0000 7fab8632c800 20 rados->read ofs=0 len=0 2024-09-18T01:45:26.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.981+0000 7fab8632c800 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559cda021ed0 con 0x7fab7c007230 2024-09-18T01:45:26.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.981+0000 7fab820b7640 1 -- 172.21.15.146:0/530942942 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(62 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv18 ondisk = 0) ==== 275+0+304 (crc 0 0 0) 0x7fab74060040 con 0x7fab7c007230 2024-09-18T01:45:26.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.981+0000 7fab8632c800 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T01:45:26.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.982+0000 7faa38fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:26.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.982+0000 7fab8632c800 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94132160609296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559cda01fd50 con 0x559cd9fdaf20 2024-09-18T01:45:26.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.983+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94132160609296] v31'115 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fab6c051070 con 0x559cd9fdaf20 2024-09-18T01:45:26.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.983+0000 7fab8632c800 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94132160582384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559cda01fd50 con 0x7fab7c007230 2024-09-18T01:45:26.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.984+0000 7fab820b7640 1 -- 172.21.15.146:0/530942942 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94132160582384] v31'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab74060040 con 0x7fab7c007230 2024-09-18T01:45:26.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.984+0000 7fab8632c800 20 remove_watcher() i=0 2024-09-18T01:45:26.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.984+0000 7fab8632c800 2 removed watcher, disabling cache 2024-09-18T01:45:26.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.984+0000 7fab8632c800 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94132160588192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559cda01fd50 con 0x559cd9fdaf20 2024-09-18T01:45:26.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.986+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94132160588192] v31'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6c051070 con 0x559cd9fdaf20 2024-09-18T01:45:26.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.986+0000 7fab8632c800 20 remove_watcher() i=1 2024-09-18T01:45:26.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.986+0000 7fab8632c800 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94132160590320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559cda01fd50 con 0x559cd9fe1090 2024-09-18T01:45:26.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.987+0000 7fab828b8640 1 -- 172.21.15.146:0/530942942 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94132160590320] v31'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab7c03d020 con 0x559cd9fe1090 2024-09-18T01:45:26.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.987+0000 7fab8632c800 20 remove_watcher() i=2 2024-09-18T01:45:27.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.987+0000 7fab8632c800 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94132160595760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559cda01fd50 con 0x7fab7c007230 2024-09-18T01:45:27.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.988+0000 7fab820b7640 1 -- 172.21.15.146:0/530942942 <== osd.2 v2:172.21.15.146:6800/3820039304 14 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94132160595760] v31'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab74060040 con 0x7fab7c007230 2024-09-18T01:45:27.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.988+0000 7fab8632c800 20 remove_watcher() i=3 2024-09-18T01:45:27.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.988+0000 7fab8632c800 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94132160598032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559cda01fd50 con 0x559cd9fdaf20 2024-09-18T01:45:27.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.988+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94132160598032] v31'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6c051070 con 0x559cd9fdaf20 2024-09-18T01:45:27.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.988+0000 7fab8632c800 20 remove_watcher() i=4 2024-09-18T01:45:27.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.988+0000 7fab8632c800 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94132160602832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559cda01fd50 con 0x7fab74017050 2024-09-18T01:45:27.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.989+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94132160602832] v31'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6c051070 con 0x7fab74017050 2024-09-18T01:45:27.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.989+0000 7fab8632c800 20 remove_watcher() i=5 2024-09-18T01:45:27.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.989+0000 7fab8632c800 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94132160606736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559cda01fd50 con 0x7fab74017050 2024-09-18T01:45:27.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.990+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94132160606736] v31'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6c051070 con 0x7fab74017050 2024-09-18T01:45:27.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.990+0000 7fab8632c800 20 remove_watcher() i=6 2024-09-18T01:45:27.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.990+0000 7fab8632c800 1 -- 172.21.15.146:0/530942942 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94132160600656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559cda01fd50 con 0x7fab74017050 2024-09-18T01:45:27.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.991+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94132160600656] v31'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6c051070 con 0x7fab74017050 2024-09-18T01:45:27.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.991+0000 7fab8632c800 20 remove_watcher() i=7 2024-09-18T01:45:27.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.991+0000 7fab8632c800 1 -- 172.21.15.146:0/530942942 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fab74017050 msgr2=0x7fab7400d3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.991+0000 7fab8632c800 1 --2- 172.21.15.146:0/530942942 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fab74017050 0x7fab7400d3d0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.991+0000 7fab8632c800 1 -- 172.21.15.146:0/530942942 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559cd9fdaf20 msgr2=0x559cd9fdd3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.991+0000 7fab8632c800 1 --2- 172.21.15.146:0/530942942 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559cd9fdaf20 0x559cd9fdd3e0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.991+0000 7fab8632c800 1 -- 172.21.15.146:0/530942942 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fab7c007230 msgr2=0x7fab7c035580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.991+0000 7fab8632c800 1 --2- 172.21.15.146:0/530942942 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fab7c007230 0x7fab7c035580 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.991+0000 7fab8632c800 1 -- 172.21.15.146:0/530942942 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x559cd9fe1090 msgr2=0x559cd9fe34a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.991+0000 7fab8632c800 1 --2- 172.21.15.146:0/530942942 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x559cd9fe1090 0x559cd9fe34a0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.991+0000 7fab8632c800 1 -- 172.21.15.146:0/530942942 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7faa4c036b40 msgr2=0x7faa4c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.991+0000 7fab8632c800 1 --2- 172.21.15.146:0/530942942 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7faa4c036b40 0x7faa4c039000 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fab74001750 tx=0x7fab74035000 comp rx=0 tx=0).stop 2024-09-18T01:45:27.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.991+0000 7fab8632c800 1 -- 172.21.15.146:0/530942942 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559cd9fc7dc0 msgr2=0x559cd9fcf240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.991+0000 7fab8632c800 1 --2- 172.21.15.146:0/530942942 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559cd9fc7dc0 0x559cd9fcf240 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fab7c04b860 tx=0x7fab7c04c8d0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.991+0000 7fab7bfff640 1 -- 172.21.15.146:0/530942942 reap_dead start 2024-09-18T01:45:27.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.991+0000 7fab8632c800 1 -- 172.21.15.146:0/530942942 shutdown_connections 2024-09-18T01:45:27.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.991+0000 7fab8632c800 1 --2- 172.21.15.146:0/530942942 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559cd9fc7dc0 0x559cd9fcf240 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.991+0000 7fab8632c800 1 -- 172.21.15.146:0/530942942 >> 172.21.15.146:0/530942942 conn(0x559cd9fc4170 msgr2=0x559cd9fc94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:27.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.992+0000 7fab8632c800 1 -- 172.21.15.146:0/530942942 shutdown_connections 2024-09-18T01:45:27.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.992+0000 7fab8632c800 1 -- 172.21.15.146:0/530942942 wait complete. 2024-09-18T01:45:27.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.992+0000 7fab8632c800 1 -- 172.21.15.146:0/1542406607 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7faa5c036b90 msgr2=0x7faa5c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.992+0000 7fab8632c800 1 --2- 172.21.15.146:0/1542406607 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7faa5c036b90 0x7faa5c039050 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x559cd9fa6ad0 tx=0x7fab74041040 comp rx=0 tx=0).stop 2024-09-18T01:45:27.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.992+0000 7fab8632c800 1 -- 172.21.15.146:0/1542406607 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559cd9ea7b70 msgr2=0x559cd9ea61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.992+0000 7fab8632c800 1 --2- 172.21.15.146:0/1542406607 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559cd9ea7b70 0x559cd9ea61c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x559cd9fa5bd0 tx=0x7fab7c0178e0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.992+0000 7fab8632c800 1 -- 172.21.15.146:0/1542406607 shutdown_connections 2024-09-18T01:45:27.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.992+0000 7fab8632c800 1 --2- 172.21.15.146:0/1542406607 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7faa5c036b90 0x7faa5c039050 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.992+0000 7fab8632c800 1 --2- 172.21.15.146:0/1542406607 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559cd9ea7b70 0x559cd9ea61c0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.992+0000 7fab8632c800 1 -- 172.21.15.146:0/1542406607 >> 172.21.15.146:0/1542406607 conn(0x559cd9fadf00 msgr2=0x559cd9fb0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:27.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.992+0000 7fab8632c800 1 -- 172.21.15.146:0/1542406607 shutdown_connections 2024-09-18T01:45:27.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.992+0000 7fab8632c800 1 -- 172.21.15.146:0/1542406607 wait complete. 2024-09-18T01:45:27.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.992+0000 7fab8632c800 1 -- 172.21.15.146:0/761859016 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559cd9eab8e0 msgr2=0x559cd9fa52b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.992+0000 7fab8632c800 1 --2- 172.21.15.146:0/761859016 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559cd9eab8e0 0x559cd9fa52b0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.992+0000 7fab8632c800 1 -- 172.21.15.146:0/761859016 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x559cd9fa71d0 msgr2=0x559cd9faaa30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.992+0000 7fab8632c800 1 --2- 172.21.15.146:0/761859016 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x559cd9fa71d0 0x559cd9faaa30 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.992+0000 7fab8632c800 1 -- 172.21.15.146:0/761859016 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7faa68036b40 msgr2=0x7faa68039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.992+0000 7fab8632c800 1 --2- 172.21.15.146:0/761859016 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7faa68036b40 0x7faa68039000 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fab6c057000 tx=0x7fab6c052000 comp rx=0 tx=0).stop 2024-09-18T01:45:27.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.992+0000 7fab8632c800 1 -- 172.21.15.146:0/761859016 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559cd9e1ae10 msgr2=0x559cd9f9e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.992+0000 7fab8632c800 1 --2- 172.21.15.146:0/761859016 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559cd9e1ae10 0x559cd9f9e240 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fab74001e10 tx=0x7fab74000ed0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.992+0000 7fab8632c800 1 -- 172.21.15.146:0/761859016 shutdown_connections 2024-09-18T01:45:27.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.992+0000 7fab8632c800 1 --2- 172.21.15.146:0/761859016 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x559cd9fa71d0 0x559cd9faaa30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.992+0000 7fab8632c800 1 --2- 172.21.15.146:0/761859016 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559cd9eab8e0 0x559cd9fa52b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.992+0000 7fab8632c800 1 --2- 172.21.15.146:0/761859016 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7faa68036b40 0x7faa68039000 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.992+0000 7fab8632c800 1 --2- 172.21.15.146:0/761859016 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559cd9e1ae10 0x559cd9f9e240 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.992+0000 7fab8632c800 1 -- 172.21.15.146:0/761859016 >> 172.21.15.146:0/761859016 conn(0x559cd9ea1df0 msgr2=0x559cd9f90b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:27.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.992+0000 7fab8632c800 1 -- 172.21.15.146:0/761859016 shutdown_connections 2024-09-18T01:45:27.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:26.992+0000 7fab8632c800 1 -- 172.21.15.146:0/761859016 wait complete. 2024-09-18T01:45:27.005 INFO:teuthology.orchestra.run.smithi146.stdout:{"key":"bucket:myfoo","ver":{"tag":"_2TwRu99AI-qvIBlAtlJH4Wd","ver":2},"mtime":"2024-09-18T01:45:26.710290Z","data":{"bucket":{"name":"myfoo","marker":"8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1","bucket_id":"8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1","tenant":"","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"foo","creation_time":"2024-09-18T01:45:25.639613Z","linked":false,"has_bucket_info":false}} 2024-09-18T01:45:27.005 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:myfoo', 'ver': {'tag': '_2TwRu99AI-qvIBlAtlJH4Wd', 'ver': 2}, 'mtime': '2024-09-18T01:45:26.710290Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1', 'bucket_id': '8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1', 'tenant': '', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'foo', 'creation_time': '2024-09-18T01:45:25.639613Z', 'linked': False, 'has_bucket_info': False}} 2024-09-18T01:45:27.005 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1'] 2024-09-18T01:45:27.005 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1'] 2024-09-18T01:45:27.006 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid fud --bucket myfoo --bucket-id 8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 2024-09-18T01:45:27.094 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:27.094 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:27.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.094+0000 7f2993d39800 1 Processor -- start 2024-09-18T01:45:27.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.094+0000 7f2993d39800 1 -- start start 2024-09-18T01:45:27.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.094+0000 7f2993d39800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x5582fa9a09b0 0x5582fa9a2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.094+0000 7f2993d39800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5582fa85cb30 con 0x5582fa99c570 2024-09-18T01:45:27.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.094+0000 7f2993d39800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x5582fa83e360 con 0x5582fa9a09b0 2024-09-18T01:45:27.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.094+0000 7f29871d7640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x5582fa9a09b0 0x5582fa9a2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.094+0000 7f298f9d8640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x5582fa99c570 0x5582fa99c970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:39006/0 (socket says 172.21.15.146:39006) 2024-09-18T01:45:27.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.094+0000 7f298f9d8640 1 -- 172.21.15.146:0/3611674881 learned_addr learned my addr 172.21.15.146:0/3611674881 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:45:27.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.095+0000 7f29871d7640 1 -- 172.21.15.146:0/3611674881 >> v1:172.21.15.129:6789/0 conn(0x5582fa99c570 legacy=0x5582fa99c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.095+0000 7f29871d7640 1 -- 172.21.15.146:0/3611674881 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582fa864e00 con 0x5582fa9a09b0 2024-09-18T01:45:27.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.096+0000 7f29871d7640 1 --2- 172.21.15.146:0/3611674881 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5582fa9a09b0 0x5582fa9a2da0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f297800a470 tx=0x7f2978045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8936a687a105d1f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.097+0000 7f298f1d7640 1 -- 172.21.15.146:0/3611674881 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2978053570 con 0x5582fa9a09b0 2024-09-18T01:45:27.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.097+0000 7f298f1d7640 1 -- 172.21.15.146:0/3611674881 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2978058070 con 0x5582fa9a09b0 2024-09-18T01:45:27.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.097+0000 7f298f1d7640 1 -- 172.21.15.146:0/3611674881 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2978053880 con 0x5582fa9a09b0 2024-09-18T01:45:27.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.097+0000 7f2993d39800 1 -- 172.21.15.146:0/3611674881 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5582fa9a09b0 msgr2=0x5582fa9a2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.097+0000 7f2993d39800 1 --2- 172.21.15.146:0/3611674881 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5582fa9a09b0 0x5582fa9a2da0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f297800a470 tx=0x7f2978045a20 comp rx=0 tx=0).stop 2024-09-18T01:45:27.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.098+0000 7f2993d39800 1 -- 172.21.15.146:0/3611674881 shutdown_connections 2024-09-18T01:45:27.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.098+0000 7f2993d39800 1 --2- 172.21.15.146:0/3611674881 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5582fa9a09b0 0x5582fa9a2da0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.098+0000 7f2993d39800 1 -- 172.21.15.146:0/3611674881 >> 172.21.15.146:0/3611674881 conn(0x5582fa997e00 msgr2=0x5582fa99a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:27.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.098+0000 7f2993d39800 1 -- 172.21.15.146:0/3611674881 shutdown_connections 2024-09-18T01:45:27.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.098+0000 7f2993d39800 1 -- 172.21.15.146:0/3611674881 wait complete. 2024-09-18T01:45:27.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.111+0000 7f2993d39800 1 Processor -- start 2024-09-18T01:45:27.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.111+0000 7f2993d39800 1 -- start start 2024-09-18T01:45:27.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.112+0000 7f2993d39800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5582fa99c570 0x5582faa8b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.112+0000 7f2993d39800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5582fa8e9350 con 0x5582fa99c570 2024-09-18T01:45:27.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.112+0000 7f298f9d8640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5582fa99c570 0x5582faa8b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.112+0000 7f298f9d8640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5582fa99c570 0x5582faa8b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:32780/0 (socket says 172.21.15.146:32780) 2024-09-18T01:45:27.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.112+0000 7f298f9d8640 1 -- 172.21.15.146:0/68779901 learned_addr learned my addr 172.21.15.146:0/68779901 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:27.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.112+0000 7f298f9d8640 1 -- 172.21.15.146:0/68779901 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582fa836bc0 con 0x5582fa99c570 2024-09-18T01:45:27.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.112+0000 7f298f9d8640 1 --2- 172.21.15.146:0/68779901 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5582fa99c570 0x5582faa8b850 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2980001e10 tx=0x7f298000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71b16bda277b77e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.113+0000 7f287de0b640 1 -- 172.21.15.146:0/68779901 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2980012020 con 0x5582fa99c570 2024-09-18T01:45:27.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.113+0000 7f287de0b640 1 -- 172.21.15.146:0/68779901 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f298000e5a0 con 0x5582fa99c570 2024-09-18T01:45:27.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.113+0000 7f287de0b640 1 -- 172.21.15.146:0/68779901 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f298000e8e0 con 0x5582fa99c570 2024-09-18T01:45:27.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.113+0000 7f2993d39800 1 -- 172.21.15.146:0/68779901 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5582fa99c570 msgr2=0x5582faa8b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.113+0000 7f2993d39800 1 --2- 172.21.15.146:0/68779901 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5582fa99c570 0x5582faa8b850 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2980001e10 tx=0x7f298000b780 comp rx=0 tx=0).stop 2024-09-18T01:45:27.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.113+0000 7f2993d39800 1 -- 172.21.15.146:0/68779901 shutdown_connections 2024-09-18T01:45:27.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.113+0000 7f2993d39800 1 --2- 172.21.15.146:0/68779901 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5582fa99c570 0x5582faa8b850 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.113+0000 7f2993d39800 1 -- 172.21.15.146:0/68779901 >> 172.21.15.146:0/68779901 conn(0x5582fa997e00 msgr2=0x5582faa87210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:27.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.113+0000 7f2993d39800 1 -- 172.21.15.146:0/68779901 shutdown_connections 2024-09-18T01:45:27.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.113+0000 7f2993d39800 1 -- 172.21.15.146:0/68779901 wait complete. 2024-09-18T01:45:27.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.114+0000 7f2993d39800 1 Processor -- start 2024-09-18T01:45:27.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.114+0000 7f2993d39800 1 -- start start 2024-09-18T01:45:27.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.114+0000 7f2993d39800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5582fa99c570 0x5582faa93230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.114+0000 7f2993d39800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5582fa9a35e0 con 0x5582fa99c570 2024-09-18T01:45:27.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.114+0000 7f298f9d8640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5582fa99c570 0x5582faa93230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.114+0000 7f298f9d8640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5582fa99c570 0x5582faa93230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:32792/0 (socket says 172.21.15.146:32792) 2024-09-18T01:45:27.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.114+0000 7f298f9d8640 1 -- 172.21.15.146:0/1550516599 learned_addr learned my addr 172.21.15.146:0/1550516599 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:27.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.114+0000 7f298f9d8640 1 -- 172.21.15.146:0/1550516599 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582fa84afe0 con 0x5582fa99c570 2024-09-18T01:45:27.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.115+0000 7f298f9d8640 1 --2- 172.21.15.146:0/1550516599 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5582fa99c570 0x5582faa93230 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f2980001e10 tx=0x7f2980000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.115+0000 7f2877fff640 1 -- 172.21.15.146:0/1550516599 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2980012030 con 0x5582fa99c570 2024-09-18T01:45:27.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.115+0000 7f2877fff640 1 -- 172.21.15.146:0/1550516599 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f298001a7a0 con 0x5582fa99c570 2024-09-18T01:45:27.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.115+0000 7f2877fff640 1 -- 172.21.15.146:0/1550516599 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f298001aac0 con 0x5582fa99c570 2024-09-18T01:45:27.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.115+0000 7f2993d39800 1 -- 172.21.15.146:0/1550516599 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5582faa93770 con 0x5582fa99c570 2024-09-18T01:45:27.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.115+0000 7f2993d39800 1 -- 172.21.15.146:0/1550516599 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582faa93c90 con 0x5582fa99c570 2024-09-18T01:45:27.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.116+0000 7f2877fff640 1 -- 172.21.15.146:0/1550516599 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2980015020 con 0x5582fa99c570 2024-09-18T01:45:27.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.116+0000 7f2877fff640 1 --2- 172.21.15.146:0/1550516599 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2878036b40 0x7f2878039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.116+0000 7f2877fff640 1 -- 172.21.15.146:0/1550516599 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f2980020030 con 0x5582fa99c570 2024-09-18T01:45:27.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.116+0000 7f29871d7640 1 --2- 172.21.15.146:0/1550516599 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2878036b40 0x7f2878039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.116+0000 7f2993d39800 1 --2- 172.21.15.146:0/1550516599 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5582fa9a09b0 0x5582faa9a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.116+0000 7f2993d39800 1 -- 172.21.15.146:0/1550516599 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5582faa9a7e0 con 0x5582fa9a09b0 2024-09-18T01:45:27.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.116+0000 7f29901d9640 1 --2- 172.21.15.146:0/1550516599 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5582fa9a09b0 0x5582faa9a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.116+0000 7f29871d7640 1 --2- 172.21.15.146:0/1550516599 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2878036b40 0x7f2878039000 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2978057000 tx=0x7f2978052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.116+0000 7f29901d9640 1 --2- 172.21.15.146:0/1550516599 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5582fa9a09b0 0x5582faa9a2a0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.117+0000 7f29901d9640 1 -- 172.21.15.146:0/1550516599 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f298800a4a0 con 0x5582fa9a09b0 2024-09-18T01:45:27.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.117+0000 7f2993d39800 1 -- 172.21.15.146:0/1550516599 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5582faa97870 con 0x5582fa9a09b0 2024-09-18T01:45:27.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.117+0000 7f29901d9640 1 -- 172.21.15.146:0/1550516599 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f298800a4a0 con 0x5582fa9a09b0 2024-09-18T01:45:27.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.117+0000 7f2993d39800 1 -- 172.21.15.146:0/1550516599 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5582faa9c5e0 con 0x5582fa9a09b0 2024-09-18T01:45:27.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.117+0000 7f29901d9640 1 -- 172.21.15.146:0/1550516599 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f298800a4a0 con 0x5582fa9a09b0 2024-09-18T01:45:27.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.117+0000 7f2993d39800 1 -- 172.21.15.146:0/1550516599 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5582faa9b810 con 0x5582fa9a09b0 2024-09-18T01:45:27.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.117+0000 7f29901d9640 1 -- 172.21.15.146:0/1550516599 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f298800a4a0 con 0x5582fa9a09b0 2024-09-18T01:45:27.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.117+0000 7f2993d39800 1 --2- 172.21.15.146:0/1550516599 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5582faa9d990 0x5582faa9fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.117+0000 7f2993d39800 1 -- 172.21.15.146:0/1550516599 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5582faaa02c0 con 0x5582faa9d990 2024-09-18T01:45:27.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.118+0000 7f298f9d8640 1 --2- 172.21.15.146:0/1550516599 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5582faa9d990 0x5582faa9fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.118+0000 7f298f9d8640 1 --2- 172.21.15.146:0/1550516599 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5582faa9d990 0x5582faa9fd80 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.118+0000 7f298f9d8640 1 -- 172.21.15.146:0/1550516599 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f298000dcd0 con 0x5582faa9d990 2024-09-18T01:45:27.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.118+0000 7f2993d39800 1 Processor -- start 2024-09-18T01:45:27.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.118+0000 7f2993d39800 1 -- start start 2024-09-18T01:45:27.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.119+0000 7f2993d39800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5582fa911600 0x5582faab1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.119+0000 7f2993d39800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5582fa838580 con 0x5582fa911600 2024-09-18T01:45:27.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.119+0000 7f29901d9640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5582fa911600 0x5582faab1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.119+0000 7f29901d9640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5582fa911600 0x5582faab1d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:32798/0 (socket says 172.21.15.146:32798) 2024-09-18T01:45:27.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.119+0000 7f29901d9640 1 -- 172.21.15.146:0/3961960211 learned_addr learned my addr 172.21.15.146:0/3961960211 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:27.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.119+0000 7f29901d9640 1 -- 172.21.15.146:0/3961960211 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582faab22b0 con 0x5582fa911600 2024-09-18T01:45:27.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.119+0000 7f29901d9640 1 --2- 172.21.15.146:0/3961960211 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5582fa911600 0x5582faab1d70 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x5582faa94630 tx=0x7f29880178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.119+0000 7f28757fa640 1 -- 172.21.15.146:0/3961960211 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2988013440 con 0x5582fa911600 2024-09-18T01:45:27.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.119+0000 7f28757fa640 1 -- 172.21.15.146:0/3961960211 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29880135e0 con 0x5582fa911600 2024-09-18T01:45:27.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.119+0000 7f28757fa640 1 -- 172.21.15.146:0/3961960211 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29880138c0 con 0x5582fa911600 2024-09-18T01:45:27.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.119+0000 7f2993d39800 1 -- 172.21.15.146:0/3961960211 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5582faab2480 con 0x5582fa911600 2024-09-18T01:45:27.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.120+0000 7f2993d39800 1 -- 172.21.15.146:0/3961960211 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582faab2920 con 0x5582fa911600 2024-09-18T01:45:27.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.120+0000 7f28757fa640 1 -- 172.21.15.146:0/3961960211 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2988011040 con 0x5582fa911600 2024-09-18T01:45:27.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.120+0000 7f28757fa640 1 --2- 172.21.15.146:0/3961960211 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2868036b90 0x7f2868039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.120+0000 7f28757fa640 1 -- 172.21.15.146:0/3961960211 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f298801d070 con 0x5582fa911600 2024-09-18T01:45:27.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.120+0000 7f298f9d8640 1 --2- 172.21.15.146:0/3961960211 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2868036b90 0x7f2868039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.121+0000 7f2993d39800 1 Processor -- start 2024-09-18T01:45:27.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.121+0000 7f2993d39800 1 -- start start 2024-09-18T01:45:27.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.121+0000 7f298f9d8640 1 --2- 172.21.15.146:0/3961960211 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2868036b90 0x7f2868039050 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2980001750 tx=0x7f2980041040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.121+0000 7f2993d39800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5582faaaeff0 0x5582faaaf3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.121+0000 7f2993d39800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5582faa8c000 con 0x5582faaaeff0 2024-09-18T01:45:27.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.121+0000 7f29901d9640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5582faaaeff0 0x5582faaaf3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.121+0000 7f29901d9640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5582faaaeff0 0x5582faaaf3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:32812/0 (socket says 172.21.15.146:32812) 2024-09-18T01:45:27.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.121+0000 7f29901d9640 1 -- 172.21.15.146:0/3151044789 learned_addr learned my addr 172.21.15.146:0/3151044789 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:27.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.121+0000 7f29901d9640 1 -- 172.21.15.146:0/3151044789 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582faaaf9c0 con 0x5582faaaeff0 2024-09-18T01:45:27.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.121+0000 7f29901d9640 1 --2- 172.21.15.146:0/3151044789 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5582faaaeff0 0x5582faaaf3f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f298804c8c0 tx=0x7f2988001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3b772c8d2c7d53b server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.122+0000 7f286effd640 1 -- 172.21.15.146:0/3151044789 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2988027040 con 0x5582faaaeff0 2024-09-18T01:45:27.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.122+0000 7f286effd640 1 -- 172.21.15.146:0/3151044789 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2988012cc0 con 0x5582faaaeff0 2024-09-18T01:45:27.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.122+0000 7f286effd640 1 -- 172.21.15.146:0/3151044789 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f298804b250 con 0x5582faaaeff0 2024-09-18T01:45:27.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.122+0000 7f2993d39800 1 -- 172.21.15.146:0/3151044789 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5582faaaeff0 msgr2=0x5582faaaf3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.122+0000 7f2993d39800 1 --2- 172.21.15.146:0/3151044789 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5582faaaeff0 0x5582faaaf3f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f298804c8c0 tx=0x7f2988001940 comp rx=0 tx=0).stop 2024-09-18T01:45:27.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.122+0000 7f2993d39800 1 -- 172.21.15.146:0/3151044789 shutdown_connections 2024-09-18T01:45:27.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.122+0000 7f2993d39800 1 --2- 172.21.15.146:0/3151044789 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5582faaaeff0 0x5582faaaf3f0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.122+0000 7f2993d39800 1 -- 172.21.15.146:0/3151044789 >> 172.21.15.146:0/3151044789 conn(0x5582faab8060 msgr2=0x5582faab6160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:27.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.122+0000 7f2993d39800 1 -- 172.21.15.146:0/3151044789 shutdown_connections 2024-09-18T01:45:27.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.122+0000 7f2993d39800 1 -- 172.21.15.146:0/3151044789 wait complete. 2024-09-18T01:45:27.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.122+0000 7f2993d39800 1 Processor -- start 2024-09-18T01:45:27.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.122+0000 7f2993d39800 1 -- start start 2024-09-18T01:45:27.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.122+0000 7f2993d39800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5582faaaeff0 0x5582faac52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.123+0000 7f2993d39800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5582faaadcd0 con 0x5582faaaeff0 2024-09-18T01:45:27.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.123+0000 7f29901d9640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5582faaaeff0 0x5582faac52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.123+0000 7f29901d9640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5582faaaeff0 0x5582faac52e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:32818/0 (socket says 172.21.15.146:32818) 2024-09-18T01:45:27.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.123+0000 7f29901d9640 1 -- 172.21.15.146:0/3290191595 learned_addr learned my addr 172.21.15.146:0/3290191595 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:27.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.123+0000 7f29901d9640 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582faac5820 con 0x5582faaaeff0 2024-09-18T01:45:27.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.123+0000 7f29901d9640 1 --2- 172.21.15.146:0/3290191595 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5582faaaeff0 0x5582faac52e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f2988001df0 tx=0x7f298804c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.123+0000 7f286d7fa640 1 -- 172.21.15.146:0/3290191595 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2988027070 con 0x5582faaaeff0 2024-09-18T01:45:27.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.123+0000 7f286d7fa640 1 -- 172.21.15.146:0/3290191595 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2988013e30 con 0x5582faaaeff0 2024-09-18T01:45:27.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.123+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5582faac5ab0 con 0x5582faaaeff0 2024-09-18T01:45:27.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.123+0000 7f286d7fa640 1 -- 172.21.15.146:0/3290191595 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f298802aa60 con 0x5582faaaeff0 2024-09-18T01:45:27.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.123+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582faac8760 con 0x5582faaaeff0 2024-09-18T01:45:27.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.124+0000 7f286d7fa640 1 -- 172.21.15.146:0/3290191595 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f298802ac00 con 0x5582faaaeff0 2024-09-18T01:45:27.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.124+0000 7f286d7fa640 1 --2- 172.21.15.146:0/3290191595 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2858036b90 0x7f2858039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.124+0000 7f286d7fa640 1 -- 172.21.15.146:0/3290191595 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f2988033070 con 0x5582faaaeff0 2024-09-18T01:45:27.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.124+0000 7f298f9d8640 1 --2- 172.21.15.146:0/3290191595 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2858036b90 0x7f2858039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.125+0000 7f298f9d8640 1 --2- 172.21.15.146:0/3290191595 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2858036b90 0x7f2858039050 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f298004b2a0 tx=0x7f2980035000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.125+0000 7f2993d39800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.125+0000 7f2993d39800 1 --2- 172.21.15.146:0/3290191595 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5582faad1030 0x5582faad34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.125+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5582faad3c40 con 0x5582faad1030 2024-09-18T01:45:27.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.125+0000 7f29871d7640 1 --2- 172.21.15.146:0/3290191595 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5582faad1030 0x5582faad34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.125+0000 7f29871d7640 1 --2- 172.21.15.146:0/3290191595 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5582faad1030 0x5582faad34f0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.126+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2978051070 con 0x5582faad1030 2024-09-18T01:45:27.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.126+0000 7f2993d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:27.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.126+0000 7f2993d39800 20 realm 2024-09-18T01:45:27.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.126+0000 7f2993d39800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.126+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5582faad4070 con 0x5582faad1030 2024-09-18T01:45:27.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.126+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2978051070 con 0x5582faad1030 2024-09-18T01:45:27.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.126+0000 7f2993d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:27.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.126+0000 7f2993d39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:27.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.126+0000 7f2993d39800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.126+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5582faad4940 con 0x5582faad1030 2024-09-18T01:45:27.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.126+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2978051070 con 0x5582faad1030 2024-09-18T01:45:27.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.126+0000 7f2993d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:27.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.126+0000 7f2993d39800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.126+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5582faad4ce0 con 0x5582faad1030 2024-09-18T01:45:27.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.126+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2978051070 con 0x5582faad1030 2024-09-18T01:45:27.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.126+0000 7f2993d39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:27.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.126+0000 7f2993d39800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.126+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5582faad5530 con 0x5582faad1030 2024-09-18T01:45:27.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.127+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2978051070 con 0x5582faad1030 2024-09-18T01:45:27.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.127+0000 7f2993d39800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:27.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.127+0000 7f2993d39800 20 searching for the correct realm 2024-09-18T01:45:27.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.127+0000 7f2993d39800 1 --2- 172.21.15.146:0/3290191595 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5582faad72a0 0x5582faad9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.127+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5582faad9cc0 con 0x5582faad72a0 2024-09-18T01:45:27.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.127+0000 7f29901d9640 1 --2- 172.21.15.146:0/3290191595 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5582faad72a0 0x5582faad9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.127+0000 7f29901d9640 1 --2- 172.21.15.146:0/3290191595 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5582faad72a0 0x5582faad9690 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.127+0000 7f29901d9640 1 -- 172.21.15.146:0/3290191595 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2988057040 con 0x5582faad72a0 2024-09-18T01:45:27.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.127+0000 7f29901d9640 1 --2- 172.21.15.146:0/3290191595 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f29880123a0 0x7f2988027850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.127+0000 7f29901d9640 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5582faad9cc0 con 0x7f29880123a0 2024-09-18T01:45:27.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.127+0000 7f298f9d8640 1 --2- 172.21.15.146:0/3290191595 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f29880123a0 0x7f2988027850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.128+0000 7f298f9d8640 1 --2- 172.21.15.146:0/3290191595 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f29880123a0 0x7f2988027850 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.128+0000 7f298f9d8640 1 -- 172.21.15.146:0/3290191595 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f298000dcd0 con 0x7f29880123a0 2024-09-18T01:45:27.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.128+0000 7f298f9d8640 1 --2- 172.21.15.146:0/3290191595 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f2980017050 0x7f298002c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.128+0000 7f298f9d8640 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5582faad9cc0 con 0x7f2980017050 2024-09-18T01:45:27.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.128+0000 7f29871d7640 1 --2- 172.21.15.146:0/3290191595 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f2980017050 0x7f298002c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.128+0000 7f29871d7640 1 --2- 172.21.15.146:0/3290191595 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f2980017050 0x7f298002c5b0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.129+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2978051070 con 0x7f2980017050 2024-09-18T01:45:27.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.129+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5582faad9cc0 con 0x5582faad1030 2024-09-18T01:45:27.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.129+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2978051070 con 0x5582faad1030 2024-09-18T01:45:27.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.129+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5582faad9cc0 con 0x5582faad1030 2024-09-18T01:45:27.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.129+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2978051070 con 0x5582faad1030 2024-09-18T01:45:27.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.129+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5582faad9cc0 con 0x7f2980017050 2024-09-18T01:45:27.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.129+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2978051070 con 0x7f2980017050 2024-09-18T01:45:27.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.129+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5582faad9cc0 con 0x7f2980017050 2024-09-18T01:45:27.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.129+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2978051070 con 0x7f2980017050 2024-09-18T01:45:27.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.129+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5582faad9cc0 con 0x7f29880123a0 2024-09-18T01:45:27.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.130+0000 7f298f9d8640 1 -- 172.21.15.146:0/3290191595 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f298000dcd0 con 0x7f29880123a0 2024-09-18T01:45:27.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.130+0000 7f298f9d8640 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5582faad9cc0 con 0x5582faad72a0 2024-09-18T01:45:27.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.130+0000 7f29901d9640 1 -- 172.21.15.146:0/3290191595 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2988057040 con 0x5582faad72a0 2024-09-18T01:45:27.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.130+0000 7f29901d9640 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5582faad9cc0 con 0x5582faad1030 2024-09-18T01:45:27.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.130+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2978051070 con 0x5582faad1030 2024-09-18T01:45:27.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.130+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5582faad9cc0 con 0x7f2980017050 2024-09-18T01:45:27.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.130+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2978051070 con 0x7f2980017050 2024-09-18T01:45:27.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.130+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5582faad9cc0 con 0x5582faad1030 2024-09-18T01:45:27.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.131+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2978051070 con 0x5582faad1030 2024-09-18T01:45:27.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.131+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5582faad9cc0 con 0x7f29880123a0 2024-09-18T01:45:27.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.131+0000 7f298f9d8640 1 -- 172.21.15.146:0/3290191595 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f298000dcd0 con 0x7f29880123a0 2024-09-18T01:45:27.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.131+0000 7f298f9d8640 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5582faad9cc0 con 0x5582faad72a0 2024-09-18T01:45:27.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.131+0000 7f29901d9640 1 -- 172.21.15.146:0/3290191595 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2988057040 con 0x5582faad72a0 2024-09-18T01:45:27.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.131+0000 7f29901d9640 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5582faad9cc0 con 0x5582faad72a0 2024-09-18T01:45:27.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.131+0000 7f29901d9640 1 -- 172.21.15.146:0/3290191595 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2988057040 con 0x5582faad72a0 2024-09-18T01:45:27.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.131+0000 7f29901d9640 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5582faad9cc0 con 0x7f2980017050 2024-09-18T01:45:27.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.132+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2978051070 con 0x7f2980017050 2024-09-18T01:45:27.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.132+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5582faad9cc0 con 0x5582faad72a0 2024-09-18T01:45:27.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.132+0000 7f29901d9640 1 -- 172.21.15.146:0/3290191595 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2988057040 con 0x5582faad72a0 2024-09-18T01:45:27.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.132+0000 7f29901d9640 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5582faad9cc0 con 0x5582faad72a0 2024-09-18T01:45:27.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.132+0000 7f29901d9640 1 -- 172.21.15.146:0/3290191595 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2988057040 con 0x5582faad72a0 2024-09-18T01:45:27.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.132+0000 7f29901d9640 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5582faad9cc0 con 0x5582faad1030 2024-09-18T01:45:27.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.132+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2978051070 con 0x5582faad1030 2024-09-18T01:45:27.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.132+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5582faad9cc0 con 0x5582faad1030 2024-09-18T01:45:27.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.132+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2978051070 con 0x5582faad1030 2024-09-18T01:45:27.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.133+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5582faad9cc0 con 0x7f2980017050 2024-09-18T01:45:27.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.133+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2978051070 con 0x7f2980017050 2024-09-18T01:45:27.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.133+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5582faad9cc0 con 0x5582faad72a0 2024-09-18T01:45:27.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.133+0000 7f29901d9640 1 -- 172.21.15.146:0/3290191595 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2988057040 con 0x5582faad72a0 2024-09-18T01:45:27.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.133+0000 7f29901d9640 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5582faad9cc0 con 0x7f29880123a0 2024-09-18T01:45:27.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.133+0000 7f298f9d8640 1 -- 172.21.15.146:0/3290191595 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f298000dcd0 con 0x7f29880123a0 2024-09-18T01:45:27.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.133+0000 7f298f9d8640 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5582faad9cc0 con 0x5582faad1030 2024-09-18T01:45:27.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.133+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2978051070 con 0x5582faad1030 2024-09-18T01:45:27.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.133+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5582faad9cc0 con 0x7f2980017050 2024-09-18T01:45:27.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.134+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2978051070 con 0x7f2980017050 2024-09-18T01:45:27.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.134+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5582faad9cc0 con 0x5582faad72a0 2024-09-18T01:45:27.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.134+0000 7f29901d9640 1 -- 172.21.15.146:0/3290191595 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2988057040 con 0x5582faad72a0 2024-09-18T01:45:27.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.134+0000 7f29901d9640 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5582faad9cc0 con 0x7f2980017050 2024-09-18T01:45:27.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.134+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2978051070 con 0x7f2980017050 2024-09-18T01:45:27.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.134+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5582faad9cc0 con 0x7f29880123a0 2024-09-18T01:45:27.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.134+0000 7f298f9d8640 1 -- 172.21.15.146:0/3290191595 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f298000dcd0 con 0x7f29880123a0 2024-09-18T01:45:27.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.134+0000 7f298f9d8640 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5582faad9cc0 con 0x5582faad72a0 2024-09-18T01:45:27.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.135+0000 7f29901d9640 1 -- 172.21.15.146:0/3290191595 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2988057040 con 0x5582faad72a0 2024-09-18T01:45:27.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.135+0000 7f29901d9640 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5582faad9cc0 con 0x7f2980017050 2024-09-18T01:45:27.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.135+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2978051070 con 0x7f2980017050 2024-09-18T01:45:27.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.135+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5582faad9cc0 con 0x5582faad1030 2024-09-18T01:45:27.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.135+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2978051070 con 0x5582faad1030 2024-09-18T01:45:27.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.135+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5582faad9cc0 con 0x7f29880123a0 2024-09-18T01:45:27.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.135+0000 7f298f9d8640 1 -- 172.21.15.146:0/3290191595 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2980060040 con 0x7f29880123a0 2024-09-18T01:45:27.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.135+0000 7f2993d39800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:27.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.135+0000 7f2993d39800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:27.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.135+0000 7f2993d39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:27.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.135+0000 7f2993d39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:27.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.135+0000 7f2993d39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:27.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.135+0000 7f2993d39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:27.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.135+0000 7f2993d39800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.135+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5582faad5ee0 con 0x5582faad1030 2024-09-18T01:45:27.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.136+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2978051070 con 0x5582faad1030 2024-09-18T01:45:27.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.136+0000 7f2993d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:27.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.136+0000 7f2993d39800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.136+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5582faad6780 con 0x5582faad1030 2024-09-18T01:45:27.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.136+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2978051070 con 0x5582faad1030 2024-09-18T01:45:27.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.136+0000 7f2993d39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:27.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.136+0000 7f2993d39800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.136+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5582faada140 con 0x7f29880123a0 2024-09-18T01:45:27.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.136+0000 7f298f9d8640 1 -- 172.21.15.146:0/3290191595 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2980060040 con 0x7f29880123a0 2024-09-18T01:45:27.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.136+0000 7f2993d39800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:27.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.136+0000 7f2993d39800 20 zone default found 2024-09-18T01:45:27.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.136+0000 7f2993d39800 4 Realm: () 2024-09-18T01:45:27.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.136+0000 7f2993d39800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:27.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.136+0000 7f2993d39800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:27.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.136+0000 7f2993d39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:27.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.136+0000 7f2993d39800 20 zonegroup default 2024-09-18T01:45:27.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.136+0000 7f2993d39800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.136+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5582faada990 con 0x7f2980017050 2024-09-18T01:45:27.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.136+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2978051070 con 0x7f2980017050 2024-09-18T01:45:27.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.136+0000 7f2993d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:27.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.136+0000 7f2993d39800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.136+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5582faadc370 con 0x5582faad72a0 2024-09-18T01:45:27.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.137+0000 7f29901d9640 1 -- 172.21.15.146:0/3290191595 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2988057040 con 0x5582faad72a0 2024-09-18T01:45:27.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.137+0000 7f2993d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:27.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.137+0000 7f2993d39800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.137+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5582faadc830 con 0x5582faad72a0 2024-09-18T01:45:27.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.137+0000 7f29901d9640 1 -- 172.21.15.146:0/3290191595 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2988057040 con 0x5582faad72a0 2024-09-18T01:45:27.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.137+0000 7f2993d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:27.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.137+0000 7f2993d39800 20 started sync module instance, tier type = 2024-09-18T01:45:27.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.137+0000 7f2993d39800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:27.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.137+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5582faadb800 con 0x7f29880123a0 2024-09-18T01:45:27.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.138+0000 7f298f9d8640 1 -- 172.21.15.146:0/3290191595 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v31'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2980060040 con 0x7f29880123a0 2024-09-18T01:45:27.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.138+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94021039799280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5582faadd140 con 0x7f29880123a0 2024-09-18T01:45:27.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.138+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5582faadd990 con 0x5582faad1030 2024-09-18T01:45:27.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.139+0000 7f298f9d8640 1 -- 172.21.15.146:0/3290191595 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94021039799280] v31'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2980060040 con 0x7f29880123a0 2024-09-18T01:45:27.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.139+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v31'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2978051070 con 0x5582faad1030 2024-09-18T01:45:27.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.139+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94021039803536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5582faadd9d0 con 0x5582faad1030 2024-09-18T01:45:27.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.139+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5582faade490 con 0x5582faad72a0 2024-09-18T01:45:27.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.140+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94021039803536] v31'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2978051070 con 0x5582faad1030 2024-09-18T01:45:27.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.140+0000 7f29901d9640 1 -- 172.21.15.146:0/3290191595 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v31'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2988057040 con 0x5582faad72a0 2024-09-18T01:45:27.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.140+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94021039808352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5582faade450 con 0x5582faad72a0 2024-09-18T01:45:27.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.140+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5582faadef40 con 0x7f29880123a0 2024-09-18T01:45:27.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.141+0000 7f298f9d8640 1 -- 172.21.15.146:0/3290191595 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v31'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2980060040 con 0x7f29880123a0 2024-09-18T01:45:27.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.141+0000 7f29901d9640 1 -- 172.21.15.146:0/3290191595 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94021039808352] v31'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2988057040 con 0x5582faad72a0 2024-09-18T01:45:27.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.141+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94021039805664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5582faadf330 con 0x7f29880123a0 2024-09-18T01:45:27.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.141+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5582faadfd50 con 0x5582faad1030 2024-09-18T01:45:27.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.142+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v31'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2978051070 con 0x5582faad1030 2024-09-18T01:45:27.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.142+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94021039814720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5582faae05f0 con 0x5582faad1030 2024-09-18T01:45:27.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.142+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5582faae10d0 con 0x7f2980017050 2024-09-18T01:45:27.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.142+0000 7f298f9d8640 1 -- 172.21.15.146:0/3290191595 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94021039805664] v31'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2980060040 con 0x7f29880123a0 2024-09-18T01:45:27.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.143+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v31'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2978051070 con 0x7f2980017050 2024-09-18T01:45:27.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.143+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94021039819744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5582faae10d0 con 0x7f2980017050 2024-09-18T01:45:27.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.143+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5582faae1ae0 con 0x7f2980017050 2024-09-18T01:45:27.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.143+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94021039814720] v31'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2978051070 con 0x5582faad1030 2024-09-18T01:45:27.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.144+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94021039819744] v31'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2978051070 con 0x7f2980017050 2024-09-18T01:45:27.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.146+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v31'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2978051070 con 0x7f2980017050 2024-09-18T01:45:27.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.146+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94021039811152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5582faae1630 con 0x7f2980017050 2024-09-18T01:45:27.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.146+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5582faae2380 con 0x7f2980017050 2024-09-18T01:45:27.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.147+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94021039811152] v31'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2978051070 con 0x7f2980017050 2024-09-18T01:45:27.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.147+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v31'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2978051070 con 0x7f2980017050 2024-09-18T01:45:27.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.147+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94021039816944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5582faae1630 con 0x7f2980017050 2024-09-18T01:45:27.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.147+0000 7f2993d39800 20 add_watcher() i=0 2024-09-18T01:45:27.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.147+0000 7f2993d39800 20 add_watcher() i=1 2024-09-18T01:45:27.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.147+0000 7f2993d39800 20 add_watcher() i=2 2024-09-18T01:45:27.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.147+0000 7f2993d39800 20 add_watcher() i=3 2024-09-18T01:45:27.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.147+0000 7f2993d39800 20 add_watcher() i=4 2024-09-18T01:45:27.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.147+0000 7f2993d39800 20 add_watcher() i=5 2024-09-18T01:45:27.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.147+0000 7f2993d39800 20 add_watcher() i=6 2024-09-18T01:45:27.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.148+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94021039816944] v31'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2978051070 con 0x7f2980017050 2024-09-18T01:45:27.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.148+0000 7f2993d39800 20 add_watcher() i=7 2024-09-18T01:45:27.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.148+0000 7f2993d39800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:27.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.148+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5582faae53b0 con 0x5582faad1030 2024-09-18T01:45:27.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.148+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2978051070 con 0x5582faad1030 2024-09-18T01:45:27.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.148+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94021039824592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5582faae2840 con 0x5582faad1030 2024-09-18T01:45:27.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.149+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94021039824592] v31'116 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2978051070 con 0x5582faad1030 2024-09-18T01:45:27.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.149+0000 7f2845fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:27.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.150+0000 7f2993d39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:27.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.150+0000 7f2993d39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:27.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.150+0000 7f2993d39800 5 note: GC not initialized 2024-09-18T01:45:27.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.150+0000 7f2844fe1640 20 reqs_thread_entry: start 2024-09-18T01:45:27.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.150+0000 7f2993d39800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:27.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.150+0000 7f2993d39800 20 Filter name: none 2024-09-18T01:45:27.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.150+0000 7f27be7fc640 20 reqs_thread_entry: start 2024-09-18T01:45:27.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.150+0000 7f2993d39800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-18T01:45:27.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.150+0000 7f2993d39800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.150+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5582fab18740 con 0x7f2980017050 2024-09-18T01:45:27.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.151+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f2978051070 con 0x7f2980017050 2024-09-18T01:45:27.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.151+0000 7f2993d39800 20 rados_obj.operate() r=0 bl.length=380 2024-09-18T01:45:27.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.151+0000 7f2993d39800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-18T01:45:27.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.151+0000 7f2993d39800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-18T01:45:27.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.151+0000 7f2993d39800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:45:27.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.151+0000 7f2993d39800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-18T01:45:27.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.151+0000 7f2993d39800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.151+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5582fab1a820 con 0x7f29880123a0 2024-09-18T01:45:27.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.151+0000 7f298f9d8640 1 -- 172.21.15.146:0/3290191595 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv18 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f2980060040 con 0x7f29880123a0 2024-09-18T01:45:27.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.151+0000 7f2993d39800 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T01:45:27.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.151+0000 7f2993d39800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-18T01:45:27.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.151+0000 7f2993d39800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T01:45:27.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.151+0000 7f2993d39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 : miss 2024-09-18T01:45:27.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.151+0000 7f2993d39800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.151+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:64 8.13 8:ceaa8859:root::.bucket.meta.myfoo%3a8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5582fab1c2c0 con 0x7f2980017050 2024-09-18T01:45:27.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.152+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(64 .bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f2978051070 con 0x7f2980017050 2024-09-18T01:45:27.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.152+0000 7f2993d39800 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T01:45:27.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.152+0000 7f2993d39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 info.flags=0x17 2024-09-18T01:45:27.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.152+0000 7f2993d39800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 to cache LRU end 2024-09-18T01:45:27.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.152+0000 7f2993d39800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:45:27.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.152+0000 7f2993d39800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T01:45:27.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.152+0000 7f2993d39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 2024-09-18T01:45:27.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.152+0000 7f2993d39800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-18T01:45:27.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.152+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5582fab208a0 con 0x7f29880123a0 2024-09-18T01:45:27.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.153+0000 7f298f9d8640 1 -- 172.21.15.146:0/3290191595 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(65 foo.buckets [call] v31'19 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f2980060040 con 0x7f29880123a0 2024-09-18T01:45:27.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.153+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:66 8.13 8:ceaa8859:root::.bucket.meta.myfoo%3a8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5582fab26800 con 0x7f2980017050 2024-09-18T01:45:27.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.154+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(66 .bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v31'5 uv5 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f2978051070 con 0x7f2980017050 2024-09-18T01:45:27.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.154+0000 7f2993d39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 info.flags=0x17 2024-09-18T01:45:27.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.154+0000 7f2993d39800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 to cache LRU end 2024-09-18T01:45:27.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.154+0000 7f2993d39800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T01:45:27.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.154+0000 7f2993d39800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1, ofs0, ns] 2024-09-18T01:45:27.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.154+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94021040061296 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5582fab20cd0 con 0x7f2980017050 2024-09-18T01:45:27.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.154+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== watch-notify(notify (1) cookie 94021039819744 notify 133143986180 ret 0) ==== 794+0+0 (crc 0 0 0) 0x5582fab1c6b0 con 0x7f2980017050 2024-09-18T01:45:27.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.154+0000 7f286effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986180 cookie 94021039819744 notifier 4509 bl.length()=752 2024-09-18T01:45:27.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.154+0000 7f286effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 info.flags=0x17 2024-09-18T01:45:27.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.154+0000 7f286effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 to cache LRU end 2024-09-18T01:45:27.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.154+0000 7f286effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T01:45:27.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.154+0000 7f286effd640 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f2854003ea0 con 0x7f2980017050 2024-09-18T01:45:27.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.154+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== osd_op_reply(67 notify.5 [notify cookie 94021040061296 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2978051070 con 0x7f2980017050 2024-09-18T01:45:27.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.155+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 <== osd.0 v2:172.21.15.129:6800/1759265424 22 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2978051070 con 0x7f2980017050 2024-09-18T01:45:27.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.155+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 <== osd.0 v2:172.21.15.129:6800/1759265424 23 ==== watch-notify(notify_complete (2) cookie 94021040061296 notify 133143986180 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5582fab1b7e0 con 0x7f2980017050 2024-09-18T01:45:27.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.155+0000 7f2993d39800 20 handle_bi_update(): bucket=:myfoo[8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1]): orig_sources= new_sources= 2024-09-18T01:45:27.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.155+0000 7f2993d39800 20 handle_bi_update(): bucket=:myfoo[8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1]): potential sources added=[] removed=[] 2024-09-18T01:45:27.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.155+0000 7f2993d39800 20 handle_bi_update(): bucket=:myfoo[8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1]): orig_dests= new_dests= 2024-09-18T01:45:27.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.155+0000 7f2993d39800 20 handle_bi_update(): bucket=:myfoo[8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1]): potential dests added=[] removed=[] 2024-09-18T01:45:27.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.155+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:69 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5582fab24fc0 con 0x7f2980017050 2024-09-18T01:45:27.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.156+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 <== osd.0 v2:172.21.15.129:6800/1759265424 24 ==== osd_op_reply(69 fud.buckets [call] v31'1 uv1 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f2978051070 con 0x7f2980017050 2024-09-18T01:45:27.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.156+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5582fab25fd0 con 0x7f29880123a0 2024-09-18T01:45:27.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.157+0000 7f298f9d8640 1 -- 172.21.15.146:0/3290191595 <== osd.2 v2:172.21.15.146:6800/3820039304 14 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v31'20 uv20 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f2980060040 con 0x7f29880123a0 2024-09-18T01:45:27.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.157+0000 7f2993d39800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-18T01:45:27.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.157+0000 7f2993d39800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T01:45:27.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.157+0000 7f2993d39800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-18T01:45:27.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.157+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94021040061296 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5582fab25470 con 0x7f2980017050 2024-09-18T01:45:27.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.158+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 <== osd.0 v2:172.21.15.129:6800/1759265424 25 ==== watch-notify(notify (1) cookie 94021039811152 notify 133143986181 ret 0) ==== 356+0+0 (crc 0 0 0) 0x5582fa864e00 con 0x7f2980017050 2024-09-18T01:45:27.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.158+0000 7f286e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986181 cookie 94021039811152 notifier 4509 bl.length()=314 2024-09-18T01:45:27.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.158+0000 7f286e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-18T01:45:27.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.158+0000 7f286e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T01:45:27.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.158+0000 7f286e7fc640 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f27c4003400 con 0x7f2980017050 2024-09-18T01:45:27.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.158+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 <== osd.0 v2:172.21.15.129:6800/1759265424 26 ==== osd_op_reply(71 notify.6 [notify cookie 94021040061296 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2978051070 con 0x7f2980017050 2024-09-18T01:45:27.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.158+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 <== osd.0 v2:172.21.15.129:6800/1759265424 27 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2978051070 con 0x7f2980017050 2024-09-18T01:45:27.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.158+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 <== osd.0 v2:172.21.15.129:6800/1759265424 28 ==== watch-notify(notify_complete (2) cookie 94021040061296 notify 133143986181 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f297806cbc0 con 0x7f2980017050 2024-09-18T01:45:27.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.159+0000 7f2845fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:27.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.159+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94021039824592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5582fab16490 con 0x5582faad1030 2024-09-18T01:45:27.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.160+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94021039824592] v31'117 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2978051070 con 0x5582faad1030 2024-09-18T01:45:27.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.160+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94021039799280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5582fab16490 con 0x7f29880123a0 2024-09-18T01:45:27.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.161+0000 7f298f9d8640 1 -- 172.21.15.146:0/3290191595 <== osd.2 v2:172.21.15.146:6800/3820039304 15 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94021039799280] v31'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2980060040 con 0x7f29880123a0 2024-09-18T01:45:27.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.161+0000 7f2993d39800 20 remove_watcher() i=0 2024-09-18T01:45:27.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.161+0000 7f2993d39800 2 removed watcher, disabling cache 2024-09-18T01:45:27.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.161+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94021039803536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5582fab16490 con 0x5582faad1030 2024-09-18T01:45:27.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.162+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94021039803536] v31'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2978051070 con 0x5582faad1030 2024-09-18T01:45:27.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.162+0000 7f2993d39800 20 remove_watcher() i=1 2024-09-18T01:45:27.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.162+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94021039808352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5582fab16490 con 0x5582faad72a0 2024-09-18T01:45:27.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.163+0000 7f29901d9640 1 -- 172.21.15.146:0/3290191595 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94021039808352] v31'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2988057040 con 0x5582faad72a0 2024-09-18T01:45:27.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.163+0000 7f2993d39800 20 remove_watcher() i=2 2024-09-18T01:45:27.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.163+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94021039805664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5582fab16490 con 0x7f29880123a0 2024-09-18T01:45:27.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.164+0000 7f298f9d8640 1 -- 172.21.15.146:0/3290191595 <== osd.2 v2:172.21.15.146:6800/3820039304 16 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94021039805664] v31'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2980060040 con 0x7f29880123a0 2024-09-18T01:45:27.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.164+0000 7f2993d39800 20 remove_watcher() i=3 2024-09-18T01:45:27.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.164+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94021039814720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5582fab16490 con 0x5582faad1030 2024-09-18T01:45:27.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.165+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94021039814720] v31'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2978051070 con 0x5582faad1030 2024-09-18T01:45:27.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.165+0000 7f2993d39800 20 remove_watcher() i=4 2024-09-18T01:45:27.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.165+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94021039819744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5582fab16490 con 0x7f2980017050 2024-09-18T01:45:27.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.165+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 <== osd.0 v2:172.21.15.129:6800/1759265424 29 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94021039819744] v31'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2978051070 con 0x7f2980017050 2024-09-18T01:45:27.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.165+0000 7f2993d39800 20 remove_watcher() i=5 2024-09-18T01:45:27.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.166+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94021039811152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5582fab16490 con 0x7f2980017050 2024-09-18T01:45:27.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.166+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 <== osd.0 v2:172.21.15.129:6800/1759265424 30 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94021039811152] v31'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2978051070 con 0x7f2980017050 2024-09-18T01:45:27.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.166+0000 7f2993d39800 20 remove_watcher() i=6 2024-09-18T01:45:27.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.166+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94021039816944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5582fab16490 con 0x7f2980017050 2024-09-18T01:45:27.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.167+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 <== osd.0 v2:172.21.15.129:6800/1759265424 31 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94021039816944] v31'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2978051070 con 0x7f2980017050 2024-09-18T01:45:27.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.167+0000 7f2993d39800 20 remove_watcher() i=7 2024-09-18T01:45:27.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.168+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f2980017050 msgr2=0x7f298002c5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.168+0000 7f2993d39800 1 --2- 172.21.15.146:0/3290191595 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f2980017050 0x7f298002c5b0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.168+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5582faad1030 msgr2=0x5582faad34f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.168+0000 7f2993d39800 1 --2- 172.21.15.146:0/3290191595 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5582faad1030 0x5582faad34f0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.168+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f29880123a0 msgr2=0x7f2988027850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.168+0000 7f2993d39800 1 --2- 172.21.15.146:0/3290191595 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f29880123a0 0x7f2988027850 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.168+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5582faad72a0 msgr2=0x5582faad9690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.168+0000 7f2993d39800 1 --2- 172.21.15.146:0/3290191595 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5582faad72a0 0x5582faad9690 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.168+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2858036b90 msgr2=0x7f2858039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.168+0000 7f2993d39800 1 --2- 172.21.15.146:0/3290191595 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2858036b90 0x7f2858039050 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f298004b2a0 tx=0x7f2980035000 comp rx=0 tx=0).stop 2024-09-18T01:45:27.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.168+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5582faaaeff0 msgr2=0x5582faac52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.168+0000 7f29871d7640 1 -- 172.21.15.146:0/3290191595 reap_dead start 2024-09-18T01:45:27.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.168+0000 7f2993d39800 1 --2- 172.21.15.146:0/3290191595 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5582faaaeff0 0x5582faac52e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f2988001df0 tx=0x7f298804c820 comp rx=0 tx=0).stop 2024-09-18T01:45:27.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.168+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 shutdown_connections 2024-09-18T01:45:27.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.168+0000 7f2993d39800 1 --2- 172.21.15.146:0/3290191595 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5582faaaeff0 0x5582faac52e0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.168+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 >> 172.21.15.146:0/3290191595 conn(0x5582faab8060 msgr2=0x5582faab6130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:27.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.168+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 shutdown_connections 2024-09-18T01:45:27.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.168+0000 7f2993d39800 1 -- 172.21.15.146:0/3290191595 wait complete. 2024-09-18T01:45:27.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.168+0000 7f2993d39800 1 -- 172.21.15.146:0/3961960211 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2868036b90 msgr2=0x7f2868039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.168+0000 7f2993d39800 1 --2- 172.21.15.146:0/3961960211 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2868036b90 0x7f2868039050 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2980001750 tx=0x7f2980041040 comp rx=0 tx=0).stop 2024-09-18T01:45:27.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.168+0000 7f2993d39800 1 -- 172.21.15.146:0/3961960211 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5582fa911600 msgr2=0x5582faab1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.168+0000 7f2993d39800 1 --2- 172.21.15.146:0/3961960211 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5582fa911600 0x5582faab1d70 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x5582faa94630 tx=0x7f29880178e0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.168+0000 7f2993d39800 1 -- 172.21.15.146:0/3961960211 shutdown_connections 2024-09-18T01:45:27.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.168+0000 7f2993d39800 1 --2- 172.21.15.146:0/3961960211 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2868036b90 0x7f2868039050 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.168+0000 7f2993d39800 1 --2- 172.21.15.146:0/3961960211 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5582fa911600 0x5582faab1d70 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.168+0000 7f2993d39800 1 -- 172.21.15.146:0/3961960211 >> 172.21.15.146:0/3961960211 conn(0x5582faaa2ed0 msgr2=0x5582faaa5a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:27.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.168+0000 7f2993d39800 1 -- 172.21.15.146:0/3961960211 shutdown_connections 2024-09-18T01:45:27.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.168+0000 7f2993d39800 1 -- 172.21.15.146:0/3961960211 wait complete. 2024-09-18T01:45:27.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.169+0000 7f2993d39800 1 -- 172.21.15.146:0/1550516599 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5582fa9a09b0 msgr2=0x5582faa9a2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.169+0000 7f2993d39800 1 --2- 172.21.15.146:0/1550516599 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5582fa9a09b0 0x5582faa9a2a0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.169+0000 7f2993d39800 1 -- 172.21.15.146:0/1550516599 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5582faa9d990 msgr2=0x5582faa9fd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.169+0000 7f2993d39800 1 --2- 172.21.15.146:0/1550516599 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5582faa9d990 0x5582faa9fd80 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.169+0000 7f2993d39800 1 -- 172.21.15.146:0/1550516599 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2878036b40 msgr2=0x7f2878039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.169+0000 7f2993d39800 1 --2- 172.21.15.146:0/1550516599 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2878036b40 0x7f2878039000 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2978057000 tx=0x7f2978052000 comp rx=0 tx=0).stop 2024-09-18T01:45:27.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.169+0000 7f2993d39800 1 -- 172.21.15.146:0/1550516599 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5582fa99c570 msgr2=0x5582faa93230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.169+0000 7f2993d39800 1 --2- 172.21.15.146:0/1550516599 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5582fa99c570 0x5582faa93230 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f2980001e10 tx=0x7f2980000ed0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.169+0000 7f2993d39800 1 -- 172.21.15.146:0/1550516599 shutdown_connections 2024-09-18T01:45:27.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.169+0000 7f2993d39800 1 --2- 172.21.15.146:0/1550516599 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5582faa9d990 0x5582faa9fd80 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.169+0000 7f2993d39800 1 --2- 172.21.15.146:0/1550516599 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5582fa9a09b0 0x5582faa9a2a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.169+0000 7f2993d39800 1 --2- 172.21.15.146:0/1550516599 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2878036b40 0x7f2878039000 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.169+0000 7f2993d39800 1 --2- 172.21.15.146:0/1550516599 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5582fa99c570 0x5582faa93230 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.169+0000 7f2993d39800 1 -- 172.21.15.146:0/1550516599 >> 172.21.15.146:0/1550516599 conn(0x5582fa997e00 msgr2=0x5582faa85aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:27.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.169+0000 7f2993d39800 1 -- 172.21.15.146:0/1550516599 shutdown_connections 2024-09-18T01:45:27.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.169+0000 7f2993d39800 1 -- 172.21.15.146:0/1550516599 wait complete. 2024-09-18T01:45:27.181 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-18T01:45:27.181 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-18T01:45:27.182 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-18T01:45:27.226 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:27.226 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:27.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.226+0000 7f18ca22f800 1 Processor -- start 2024-09-18T01:45:27.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.226+0000 7f18ca22f800 1 -- start start 2024-09-18T01:45:27.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.226+0000 7f18ca22f800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x5652c741e4a0 0x5652c74b26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.226+0000 7f18ca22f800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5652c7368b30 con 0x5652c741f5b0 2024-09-18T01:45:27.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.226+0000 7f18ca22f800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x5652c734a360 con 0x5652c741e4a0 2024-09-18T01:45:27.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.227+0000 7f18bffff640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x5652c741e4a0 0x5652c74b26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.227+0000 7f18c54ee640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x5652c741f5b0 0x5652c741dd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:39018/0 (socket says 172.21.15.146:39018) 2024-09-18T01:45:27.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.227+0000 7f18c54ee640 1 -- 172.21.15.146:0/3366502373 learned_addr learned my addr 172.21.15.146:0/3366502373 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:45:27.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.227+0000 7f18bffff640 1 -- 172.21.15.146:0/3366502373 >> v1:172.21.15.129:6789/0 conn(0x5652c741f5b0 legacy=0x5652c741dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.227+0000 7f18bffff640 1 -- 172.21.15.146:0/3366502373 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652c7370e00 con 0x5652c741e4a0 2024-09-18T01:45:27.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.229+0000 7f18bffff640 1 --2- 172.21.15.146:0/3366502373 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5652c741e4a0 0x5652c74b26e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f18b000a470 tx=0x7f18b0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=705423f206b8f56b server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.229+0000 7f18c4ced640 1 -- 172.21.15.146:0/3366502373 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18b0053570 con 0x5652c741e4a0 2024-09-18T01:45:27.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.229+0000 7f18c4ced640 1 -- 172.21.15.146:0/3366502373 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18b0058070 con 0x5652c741e4a0 2024-09-18T01:45:27.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.229+0000 7f18c4ced640 1 -- 172.21.15.146:0/3366502373 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18b0053880 con 0x5652c741e4a0 2024-09-18T01:45:27.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.230+0000 7f18ca22f800 1 -- 172.21.15.146:0/3366502373 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5652c741e4a0 msgr2=0x5652c74b26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.230+0000 7f18ca22f800 1 --2- 172.21.15.146:0/3366502373 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5652c741e4a0 0x5652c74b26e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f18b000a470 tx=0x7f18b0045a20 comp rx=0 tx=0).stop 2024-09-18T01:45:27.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.230+0000 7f18ca22f800 1 -- 172.21.15.146:0/3366502373 shutdown_connections 2024-09-18T01:45:27.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.230+0000 7f18ca22f800 1 --2- 172.21.15.146:0/3366502373 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5652c741e4a0 0x5652c74b26e0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.230+0000 7f18ca22f800 1 -- 172.21.15.146:0/3366502373 >> 172.21.15.146:0/3366502373 conn(0x5652c74a4ff0 msgr2=0x5652c74a7410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:27.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.230+0000 7f18ca22f800 1 -- 172.21.15.146:0/3366502373 shutdown_connections 2024-09-18T01:45:27.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.230+0000 7f18ca22f800 1 -- 172.21.15.146:0/3366502373 wait complete. 2024-09-18T01:45:27.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.243+0000 7f18ca22f800 1 Processor -- start 2024-09-18T01:45:27.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.243+0000 7f18ca22f800 1 -- start start 2024-09-18T01:45:27.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.244+0000 7f18ca22f800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5652c741e4a0 0x5652c759aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.244+0000 7f18ca22f800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5652c73f5330 con 0x5652c741e4a0 2024-09-18T01:45:27.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.244+0000 7f18c54ee640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5652c741e4a0 0x5652c759aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.244+0000 7f18c54ee640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5652c741e4a0 0x5652c759aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:32832/0 (socket says 172.21.15.146:32832) 2024-09-18T01:45:27.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.244+0000 7f18c54ee640 1 -- 172.21.15.146:0/1524280221 learned_addr learned my addr 172.21.15.146:0/1524280221 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:27.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.244+0000 7f18c54ee640 1 -- 172.21.15.146:0/1524280221 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652c7342bc0 con 0x5652c741e4a0 2024-09-18T01:45:27.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.244+0000 7f18c54ee640 1 --2- 172.21.15.146:0/1524280221 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5652c741e4a0 0x5652c759aa70 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f18b8001e10 tx=0x7f18b800b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddd930f1c4d77001 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.244+0000 7f17b3606640 1 -- 172.21.15.146:0/1524280221 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18b8012020 con 0x5652c741e4a0 2024-09-18T01:45:27.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.245+0000 7f17b3606640 1 -- 172.21.15.146:0/1524280221 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18b800e5a0 con 0x5652c741e4a0 2024-09-18T01:45:27.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.245+0000 7f17b3606640 1 -- 172.21.15.146:0/1524280221 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18b800e8e0 con 0x5652c741e4a0 2024-09-18T01:45:27.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.245+0000 7f18ca22f800 1 -- 172.21.15.146:0/1524280221 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5652c741e4a0 msgr2=0x5652c759aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.245+0000 7f18ca22f800 1 --2- 172.21.15.146:0/1524280221 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5652c741e4a0 0x5652c759aa70 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f18b8001e10 tx=0x7f18b800b780 comp rx=0 tx=0).stop 2024-09-18T01:45:27.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.245+0000 7f18ca22f800 1 -- 172.21.15.146:0/1524280221 shutdown_connections 2024-09-18T01:45:27.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.245+0000 7f18ca22f800 1 --2- 172.21.15.146:0/1524280221 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5652c741e4a0 0x5652c759aa70 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.245+0000 7f18ca22f800 1 -- 172.21.15.146:0/1524280221 >> 172.21.15.146:0/1524280221 conn(0x5652c74a4ff0 msgr2=0x5652c7596430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:27.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.245+0000 7f18ca22f800 1 -- 172.21.15.146:0/1524280221 shutdown_connections 2024-09-18T01:45:27.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.245+0000 7f18ca22f800 1 -- 172.21.15.146:0/1524280221 wait complete. 2024-09-18T01:45:27.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.246+0000 7f18ca22f800 1 Processor -- start 2024-09-18T01:45:27.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.246+0000 7f18ca22f800 1 -- start start 2024-09-18T01:45:27.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.246+0000 7f18ca22f800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5652c741e4a0 0x5652c75a2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.246+0000 7f18ca22f800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5652c741eb90 con 0x5652c741e4a0 2024-09-18T01:45:27.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.246+0000 7f18c54ee640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5652c741e4a0 0x5652c75a2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.246+0000 7f18c54ee640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5652c741e4a0 0x5652c75a2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:32844/0 (socket says 172.21.15.146:32844) 2024-09-18T01:45:27.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.246+0000 7f18c54ee640 1 -- 172.21.15.146:0/4134849731 learned_addr learned my addr 172.21.15.146:0/4134849731 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:27.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.246+0000 7f18c54ee640 1 -- 172.21.15.146:0/4134849731 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652c7356fe0 con 0x5652c741e4a0 2024-09-18T01:45:27.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.246+0000 7f18c54ee640 1 --2- 172.21.15.146:0/4134849731 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5652c741e4a0 0x5652c75a2480 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f18b800b7c0 tx=0x7f18b8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.246+0000 7f17b1e03640 1 -- 172.21.15.146:0/4134849731 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18b8012030 con 0x5652c741e4a0 2024-09-18T01:45:27.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.247+0000 7f17b1e03640 1 -- 172.21.15.146:0/4134849731 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18b8001470 con 0x5652c741e4a0 2024-09-18T01:45:27.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.247+0000 7f18ca22f800 1 -- 172.21.15.146:0/4134849731 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5652c75a29c0 con 0x5652c741e4a0 2024-09-18T01:45:27.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.247+0000 7f17b1e03640 1 -- 172.21.15.146:0/4134849731 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18b801a8d0 con 0x5652c741e4a0 2024-09-18T01:45:27.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.247+0000 7f18ca22f800 1 -- 172.21.15.146:0/4134849731 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652c75a2ee0 con 0x5652c741e4a0 2024-09-18T01:45:27.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.247+0000 7f17b1e03640 1 -- 172.21.15.146:0/4134849731 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f18b8015020 con 0x5652c741e4a0 2024-09-18T01:45:27.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.248+0000 7f17b1e03640 1 --2- 172.21.15.146:0/4134849731 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f17ac036b90 0x7f17ac039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.248+0000 7f17b1e03640 1 -- 172.21.15.146:0/4134849731 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f18b8020030 con 0x5652c741e4a0 2024-09-18T01:45:27.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.248+0000 7f18bffff640 1 --2- 172.21.15.146:0/4134849731 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f17ac036b90 0x7f17ac039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.248+0000 7f18ca22f800 1 --2- 172.21.15.146:0/4134849731 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5652c741f5b0 0x5652c75a94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.248+0000 7f18ca22f800 1 -- 172.21.15.146:0/4134849731 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5652c75a9a70 con 0x5652c741f5b0 2024-09-18T01:45:27.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.248+0000 7f18c5cef640 1 --2- 172.21.15.146:0/4134849731 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5652c741f5b0 0x5652c75a94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.248+0000 7f18bffff640 1 --2- 172.21.15.146:0/4134849731 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f17ac036b90 0x7f17ac039050 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f18b0057000 tx=0x7f18b0052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.248+0000 7f18c5cef640 1 --2- 172.21.15.146:0/4134849731 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5652c741f5b0 0x5652c75a94f0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.248+0000 7f18c5cef640 1 -- 172.21.15.146:0/4134849731 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f18c000a4a0 con 0x5652c741f5b0 2024-09-18T01:45:27.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.248+0000 7f18ca22f800 1 -- 172.21.15.146:0/4134849731 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5652c75a6aa0 con 0x5652c741f5b0 2024-09-18T01:45:27.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.249+0000 7f18c5cef640 1 -- 172.21.15.146:0/4134849731 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f18c000a4a0 con 0x5652c741f5b0 2024-09-18T01:45:27.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.249+0000 7f18ca22f800 1 -- 172.21.15.146:0/4134849731 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5652c75ab870 con 0x5652c741f5b0 2024-09-18T01:45:27.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.249+0000 7f18c5cef640 1 -- 172.21.15.146:0/4134849731 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f18c000a4a0 con 0x5652c741f5b0 2024-09-18T01:45:27.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.249+0000 7f18ca22f800 1 -- 172.21.15.146:0/4134849731 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5652c75aa9b0 con 0x5652c741f5b0 2024-09-18T01:45:27.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.249+0000 7f18c5cef640 1 -- 172.21.15.146:0/4134849731 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f18c000a4a0 con 0x5652c741f5b0 2024-09-18T01:45:27.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.249+0000 7f18ca22f800 1 --2- 172.21.15.146:0/4134849731 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5652c75ab450 0x5652c75aecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.249+0000 7f18ca22f800 1 -- 172.21.15.146:0/4134849731 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5652c75af440 con 0x5652c75ab450 2024-09-18T01:45:27.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.250+0000 7f18c54ee640 1 --2- 172.21.15.146:0/4134849731 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5652c75ab450 0x5652c75aecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.250+0000 7f18c54ee640 1 --2- 172.21.15.146:0/4134849731 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5652c75ab450 0x5652c75aecb0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.250+0000 7f18c54ee640 1 -- 172.21.15.146:0/4134849731 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f18b8018950 con 0x5652c75ab450 2024-09-18T01:45:27.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.250+0000 7f18ca22f800 1 Processor -- start 2024-09-18T01:45:27.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.250+0000 7f18ca22f800 1 -- start start 2024-09-18T01:45:27.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.250+0000 7f18ca22f800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5652c75bd1f0 0x5652c75bd610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.251+0000 7f18ca22f800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5652c7344580 con 0x5652c75bd1f0 2024-09-18T01:45:27.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.251+0000 7f18c5cef640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5652c75bd1f0 0x5652c75bd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.251+0000 7f18c5cef640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5652c75bd1f0 0x5652c75bd610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:32856/0 (socket says 172.21.15.146:32856) 2024-09-18T01:45:27.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.251+0000 7f18c5cef640 1 -- 172.21.15.146:0/2476129399 learned_addr learned my addr 172.21.15.146:0/2476129399 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:27.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.251+0000 7f18c5cef640 1 -- 172.21.15.146:0/2476129399 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652c75bdb50 con 0x5652c75bd1f0 2024-09-18T01:45:27.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.251+0000 7f18c5cef640 1 --2- 172.21.15.146:0/2476129399 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5652c75bd1f0 0x5652c75bd610 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x5652c75a9e50 tx=0x7f18c00178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.251+0000 7f17aaffd640 1 -- 172.21.15.146:0/2476129399 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18c0013440 con 0x5652c75bd1f0 2024-09-18T01:45:27.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.251+0000 7f17aaffd640 1 -- 172.21.15.146:0/2476129399 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18c00135e0 con 0x5652c75bd1f0 2024-09-18T01:45:27.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.251+0000 7f18ca22f800 1 -- 172.21.15.146:0/2476129399 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5652c75bdde0 con 0x5652c75bd1f0 2024-09-18T01:45:27.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.251+0000 7f17aaffd640 1 -- 172.21.15.146:0/2476129399 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18c00138c0 con 0x5652c75bd1f0 2024-09-18T01:45:27.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.252+0000 7f18ca22f800 1 -- 172.21.15.146:0/2476129399 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652c75c0ac0 con 0x5652c75bd1f0 2024-09-18T01:45:27.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.252+0000 7f17aaffd640 1 -- 172.21.15.146:0/2476129399 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f18c0011040 con 0x5652c75bd1f0 2024-09-18T01:45:27.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.252+0000 7f17aaffd640 1 --2- 172.21.15.146:0/2476129399 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f179c036b40 0x7f179c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.252+0000 7f17aaffd640 1 -- 172.21.15.146:0/2476129399 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f18c001d070 con 0x5652c75bd1f0 2024-09-18T01:45:27.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.252+0000 7f18c54ee640 1 --2- 172.21.15.146:0/2476129399 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f179c036b40 0x7f179c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.253+0000 7f18ca22f800 1 Processor -- start 2024-09-18T01:45:27.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.253+0000 7f18c54ee640 1 --2- 172.21.15.146:0/2476129399 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f179c036b40 0x7f179c039000 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x5652c75aad50 tx=0x7f18b8024ec0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.253+0000 7f18ca22f800 1 -- start start 2024-09-18T01:45:27.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.253+0000 7f18ca22f800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5652c75c9ec0 0x5652c75ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.253+0000 7f18ca22f800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5652c759b220 con 0x5652c75c9ec0 2024-09-18T01:45:27.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.253+0000 7f18c5cef640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5652c75c9ec0 0x5652c75ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.253+0000 7f18c5cef640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5652c75c9ec0 0x5652c75ca2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:32868/0 (socket says 172.21.15.146:32868) 2024-09-18T01:45:27.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.253+0000 7f18c5cef640 1 -- 172.21.15.146:0/131368071 learned_addr learned my addr 172.21.15.146:0/131368071 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:27.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.253+0000 7f18c5cef640 1 -- 172.21.15.146:0/131368071 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652c75ca890 con 0x5652c75c9ec0 2024-09-18T01:45:27.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.254+0000 7f18c5cef640 1 --2- 172.21.15.146:0/131368071 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5652c75c9ec0 0x5652c75ca2c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f18c0001450 tx=0x7f18c004caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72db486c697432ec server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.254+0000 7f17a8ff9640 1 -- 172.21.15.146:0/131368071 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18c0045070 con 0x5652c75c9ec0 2024-09-18T01:45:27.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.254+0000 7f17a8ff9640 1 -- 172.21.15.146:0/131368071 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18c0015560 con 0x5652c75c9ec0 2024-09-18T01:45:27.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.254+0000 7f17a8ff9640 1 -- 172.21.15.146:0/131368071 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18c002ad80 con 0x5652c75c9ec0 2024-09-18T01:45:27.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.254+0000 7f18ca22f800 1 -- 172.21.15.146:0/131368071 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5652c75c9ec0 msgr2=0x5652c75ca2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.254+0000 7f18ca22f800 1 --2- 172.21.15.146:0/131368071 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5652c75c9ec0 0x5652c75ca2c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f18c0001450 tx=0x7f18c004caf0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.254+0000 7f18ca22f800 1 -- 172.21.15.146:0/131368071 shutdown_connections 2024-09-18T01:45:27.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.254+0000 7f18ca22f800 1 --2- 172.21.15.146:0/131368071 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5652c75c9ec0 0x5652c75ca2c0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.254+0000 7f18ca22f800 1 -- 172.21.15.146:0/131368071 >> 172.21.15.146:0/131368071 conn(0x5652c75c6220 msgr2=0x5652c75c4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:27.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.254+0000 7f18ca22f800 1 -- 172.21.15.146:0/131368071 shutdown_connections 2024-09-18T01:45:27.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.254+0000 7f18ca22f800 1 -- 172.21.15.146:0/131368071 wait complete. 2024-09-18T01:45:27.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.254+0000 7f18ca22f800 1 Processor -- start 2024-09-18T01:45:27.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.255+0000 7f18ca22f800 1 -- start start 2024-09-18T01:45:27.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.255+0000 7f18ca22f800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5652c75c9ec0 0x5652c75d1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.255+0000 7f18ca22f800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5652c75caf00 con 0x5652c75c9ec0 2024-09-18T01:45:27.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.255+0000 7f18c5cef640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5652c75c9ec0 0x5652c75d1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.255+0000 7f18c5cef640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5652c75c9ec0 0x5652c75d1300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:32884/0 (socket says 172.21.15.146:32884) 2024-09-18T01:45:27.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.255+0000 7f18c5cef640 1 -- 172.21.15.146:0/3846628155 learned_addr learned my addr 172.21.15.146:0/3846628155 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:27.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.255+0000 7f18c5cef640 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652c75d1840 con 0x5652c75c9ec0 2024-09-18T01:45:27.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.255+0000 7f18c5cef640 1 --2- 172.21.15.146:0/3846628155 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5652c75c9ec0 0x5652c75d1300 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f18c0001450 tx=0x7f18c004c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.255+0000 7f179affd640 1 -- 172.21.15.146:0/3846628155 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18c0045040 con 0x5652c75c9ec0 2024-09-18T01:45:27.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.255+0000 7f179affd640 1 -- 172.21.15.146:0/3846628155 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18c004b250 con 0x5652c75c9ec0 2024-09-18T01:45:27.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.255+0000 7f179affd640 1 -- 172.21.15.146:0/3846628155 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18c00014f0 con 0x5652c75c9ec0 2024-09-18T01:45:27.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.255+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5652c75d1ad0 con 0x5652c75c9ec0 2024-09-18T01:45:27.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.255+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652c75d4780 con 0x5652c75c9ec0 2024-09-18T01:45:27.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.256+0000 7f179affd640 1 -- 172.21.15.146:0/3846628155 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f18c003d060 con 0x5652c75c9ec0 2024-09-18T01:45:27.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.256+0000 7f179affd640 1 --2- 172.21.15.146:0/3846628155 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1790036b90 0x7f1790039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.256+0000 7f179affd640 1 -- 172.21.15.146:0/3846628155 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f18c000e040 con 0x5652c75c9ec0 2024-09-18T01:45:27.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.256+0000 7f18c54ee640 1 --2- 172.21.15.146:0/3846628155 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1790036b90 0x7f1790039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.257+0000 7f18c54ee640 1 --2- 172.21.15.146:0/3846628155 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1790036b90 0x7f1790039050 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f18b8000fd0 tx=0x7f18b8038000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.257+0000 7f18ca22f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.257+0000 7f18ca22f800 1 --2- 172.21.15.146:0/3846628155 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5652c75dd060 0x5652c75df520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.257+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5652c75dfc70 con 0x5652c75dd060 2024-09-18T01:45:27.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.257+0000 7f18bffff640 1 --2- 172.21.15.146:0/3846628155 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5652c75dd060 0x5652c75df520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.257+0000 7f18bffff640 1 --2- 172.21.15.146:0/3846628155 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5652c75dd060 0x5652c75df520 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.258+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f18b0051070 con 0x5652c75dd060 2024-09-18T01:45:27.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.258+0000 7f18ca22f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:27.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.258+0000 7f18ca22f800 20 realm 2024-09-18T01:45:27.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.258+0000 7f18ca22f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.258+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5652c75e00a0 con 0x5652c75dd060 2024-09-18T01:45:27.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.258+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f18b0051070 con 0x5652c75dd060 2024-09-18T01:45:27.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.258+0000 7f18ca22f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:27.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.258+0000 7f18ca22f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:27.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.258+0000 7f18ca22f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.258+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5652c75e0970 con 0x5652c75dd060 2024-09-18T01:45:27.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.258+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f18b0051070 con 0x5652c75dd060 2024-09-18T01:45:27.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.258+0000 7f18ca22f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:27.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.258+0000 7f18ca22f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.258+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5652c75e0d10 con 0x5652c75dd060 2024-09-18T01:45:27.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.258+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f18b0051070 con 0x5652c75dd060 2024-09-18T01:45:27.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.258+0000 7f18ca22f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:27.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.258+0000 7f18ca22f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.258+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5652c75e1560 con 0x5652c75dd060 2024-09-18T01:45:27.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.259+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f18b0051070 con 0x5652c75dd060 2024-09-18T01:45:27.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.259+0000 7f18ca22f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:27.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.259+0000 7f18ca22f800 20 searching for the correct realm 2024-09-18T01:45:27.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.259+0000 7f18ca22f800 1 --2- 172.21.15.146:0/3846628155 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5652c75e32d0 0x5652c75e56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.259+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5652c75e5cf0 con 0x5652c75e32d0 2024-09-18T01:45:27.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.259+0000 7f18c5cef640 1 --2- 172.21.15.146:0/3846628155 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5652c75e32d0 0x5652c75e56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.259+0000 7f18c5cef640 1 --2- 172.21.15.146:0/3846628155 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5652c75e32d0 0x5652c75e56c0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.259+0000 7f18c5cef640 1 -- 172.21.15.146:0/3846628155 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18c0029070 con 0x5652c75e32d0 2024-09-18T01:45:27.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.259+0000 7f18c5cef640 1 --2- 172.21.15.146:0/3846628155 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f18c003f070 0x7f18c0013aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.259+0000 7f18c5cef640 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5652c75e5cf0 con 0x7f18c003f070 2024-09-18T01:45:27.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.260+0000 7f18c54ee640 1 --2- 172.21.15.146:0/3846628155 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f18c003f070 0x7f18c0013aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.260+0000 7f18c54ee640 1 --2- 172.21.15.146:0/3846628155 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f18c003f070 0x7f18c0013aa0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.260+0000 7f18c54ee640 1 -- 172.21.15.146:0/3846628155 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18b8018950 con 0x7f18c003f070 2024-09-18T01:45:27.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.260+0000 7f18c54ee640 1 --2- 172.21.15.146:0/3846628155 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f18b8059040 0x7f18b8040580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.260+0000 7f18c54ee640 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5652c75e5cf0 con 0x7f18b8059040 2024-09-18T01:45:27.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.260+0000 7f18bffff640 1 --2- 172.21.15.146:0/3846628155 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f18b8059040 0x7f18b8040580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.261+0000 7f18bffff640 1 --2- 172.21.15.146:0/3846628155 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f18b8059040 0x7f18b8040580 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.261+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18b0051070 con 0x7f18b8059040 2024-09-18T01:45:27.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.261+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5652c75e5cf0 con 0x5652c75dd060 2024-09-18T01:45:27.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.261+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f18b0051070 con 0x5652c75dd060 2024-09-18T01:45:27.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.261+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5652c75e5cf0 con 0x5652c75dd060 2024-09-18T01:45:27.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.261+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18b0051070 con 0x5652c75dd060 2024-09-18T01:45:27.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.261+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5652c75e5cf0 con 0x7f18b8059040 2024-09-18T01:45:27.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.261+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18b0051070 con 0x7f18b8059040 2024-09-18T01:45:27.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.261+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5652c75e5cf0 con 0x7f18b8059040 2024-09-18T01:45:27.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.262+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18b0051070 con 0x7f18b8059040 2024-09-18T01:45:27.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.262+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5652c75e5cf0 con 0x7f18c003f070 2024-09-18T01:45:27.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.262+0000 7f18c54ee640 1 -- 172.21.15.146:0/3846628155 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18b8018950 con 0x7f18c003f070 2024-09-18T01:45:27.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.262+0000 7f18c54ee640 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5652c75e5cf0 con 0x5652c75e32d0 2024-09-18T01:45:27.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.262+0000 7f18c5cef640 1 -- 172.21.15.146:0/3846628155 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18c0029070 con 0x5652c75e32d0 2024-09-18T01:45:27.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.262+0000 7f18c5cef640 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5652c75e5cf0 con 0x5652c75dd060 2024-09-18T01:45:27.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.262+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18b0051070 con 0x5652c75dd060 2024-09-18T01:45:27.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.262+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5652c75e5cf0 con 0x7f18b8059040 2024-09-18T01:45:27.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.263+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18b0051070 con 0x7f18b8059040 2024-09-18T01:45:27.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.263+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5652c75e5cf0 con 0x5652c75dd060 2024-09-18T01:45:27.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.263+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18b0051070 con 0x5652c75dd060 2024-09-18T01:45:27.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.263+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5652c75e5cf0 con 0x7f18c003f070 2024-09-18T01:45:27.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.263+0000 7f18c54ee640 1 -- 172.21.15.146:0/3846628155 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f18b8018950 con 0x7f18c003f070 2024-09-18T01:45:27.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.263+0000 7f18c54ee640 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5652c75e5cf0 con 0x5652c75e32d0 2024-09-18T01:45:27.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.263+0000 7f18c5cef640 1 -- 172.21.15.146:0/3846628155 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18c0029070 con 0x5652c75e32d0 2024-09-18T01:45:27.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.263+0000 7f18c5cef640 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5652c75e5cf0 con 0x5652c75e32d0 2024-09-18T01:45:27.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.264+0000 7f18c5cef640 1 -- 172.21.15.146:0/3846628155 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18c0029070 con 0x5652c75e32d0 2024-09-18T01:45:27.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.264+0000 7f18c5cef640 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5652c75e5cf0 con 0x7f18b8059040 2024-09-18T01:45:27.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.264+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18b0051070 con 0x7f18b8059040 2024-09-18T01:45:27.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.264+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5652c75e5cf0 con 0x5652c75e32d0 2024-09-18T01:45:27.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.264+0000 7f18c5cef640 1 -- 172.21.15.146:0/3846628155 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18c0029070 con 0x5652c75e32d0 2024-09-18T01:45:27.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.264+0000 7f18c5cef640 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5652c75e5cf0 con 0x5652c75e32d0 2024-09-18T01:45:27.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.264+0000 7f18c5cef640 1 -- 172.21.15.146:0/3846628155 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18c0029070 con 0x5652c75e32d0 2024-09-18T01:45:27.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.264+0000 7f18c5cef640 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5652c75e5cf0 con 0x5652c75dd060 2024-09-18T01:45:27.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.265+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18b0051070 con 0x5652c75dd060 2024-09-18T01:45:27.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.265+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5652c75e5cf0 con 0x5652c75dd060 2024-09-18T01:45:27.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.265+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f18b0051070 con 0x5652c75dd060 2024-09-18T01:45:27.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.265+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5652c75e5cf0 con 0x7f18b8059040 2024-09-18T01:45:27.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.265+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18b0051070 con 0x7f18b8059040 2024-09-18T01:45:27.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.265+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5652c75e5cf0 con 0x5652c75e32d0 2024-09-18T01:45:27.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.265+0000 7f18c5cef640 1 -- 172.21.15.146:0/3846628155 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18c0029070 con 0x5652c75e32d0 2024-09-18T01:45:27.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.265+0000 7f18c5cef640 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5652c75e5cf0 con 0x7f18c003f070 2024-09-18T01:45:27.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.266+0000 7f18c54ee640 1 -- 172.21.15.146:0/3846628155 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18b8018950 con 0x7f18c003f070 2024-09-18T01:45:27.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.266+0000 7f18c54ee640 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5652c75e5cf0 con 0x5652c75dd060 2024-09-18T01:45:27.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.266+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18b0051070 con 0x5652c75dd060 2024-09-18T01:45:27.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.266+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5652c75e5cf0 con 0x7f18b8059040 2024-09-18T01:45:27.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.266+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18b0051070 con 0x7f18b8059040 2024-09-18T01:45:27.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.266+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5652c75e5cf0 con 0x5652c75e32d0 2024-09-18T01:45:27.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.266+0000 7f18c5cef640 1 -- 172.21.15.146:0/3846628155 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18c0029070 con 0x5652c75e32d0 2024-09-18T01:45:27.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.266+0000 7f18c5cef640 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5652c75e5cf0 con 0x7f18b8059040 2024-09-18T01:45:27.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.267+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18b0051070 con 0x7f18b8059040 2024-09-18T01:45:27.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.267+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5652c75e5cf0 con 0x7f18c003f070 2024-09-18T01:45:27.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.267+0000 7f18c54ee640 1 -- 172.21.15.146:0/3846628155 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18b8018950 con 0x7f18c003f070 2024-09-18T01:45:27.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.267+0000 7f18c54ee640 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5652c75e5cf0 con 0x5652c75e32d0 2024-09-18T01:45:27.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.267+0000 7f18c5cef640 1 -- 172.21.15.146:0/3846628155 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18c0029070 con 0x5652c75e32d0 2024-09-18T01:45:27.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.267+0000 7f18c5cef640 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5652c75e5cf0 con 0x7f18b8059040 2024-09-18T01:45:27.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.267+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18b0051070 con 0x7f18b8059040 2024-09-18T01:45:27.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.268+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5652c75e5cf0 con 0x5652c75dd060 2024-09-18T01:45:27.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.268+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f18b0051070 con 0x5652c75dd060 2024-09-18T01:45:27.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.268+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5652c75e5cf0 con 0x7f18c003f070 2024-09-18T01:45:27.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.268+0000 7f18c54ee640 1 -- 172.21.15.146:0/3846628155 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18b8018950 con 0x7f18c003f070 2024-09-18T01:45:27.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.268+0000 7f18ca22f800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:27.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.268+0000 7f18ca22f800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:27.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.268+0000 7f18ca22f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:27.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.268+0000 7f18ca22f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:27.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.268+0000 7f18ca22f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:27.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.268+0000 7f18ca22f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:27.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.268+0000 7f18ca22f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.268+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5652c75e1ee0 con 0x5652c75dd060 2024-09-18T01:45:27.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.268+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f18b0051070 con 0x5652c75dd060 2024-09-18T01:45:27.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.268+0000 7f18ca22f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:27.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.268+0000 7f18ca22f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.268+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5652c75e2780 con 0x5652c75dd060 2024-09-18T01:45:27.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.269+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f18b0051070 con 0x5652c75dd060 2024-09-18T01:45:27.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.269+0000 7f18ca22f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:27.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.269+0000 7f18ca22f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.269+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5652c75e6170 con 0x7f18c003f070 2024-09-18T01:45:27.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.269+0000 7f18c54ee640 1 -- 172.21.15.146:0/3846628155 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f18b8018950 con 0x7f18c003f070 2024-09-18T01:45:27.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.269+0000 7f18ca22f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:27.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.269+0000 7f18ca22f800 20 zone default found 2024-09-18T01:45:27.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.269+0000 7f18ca22f800 4 Realm: () 2024-09-18T01:45:27.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.269+0000 7f18ca22f800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:27.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.269+0000 7f18ca22f800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:27.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.269+0000 7f18ca22f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:27.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.269+0000 7f18ca22f800 20 zonegroup default 2024-09-18T01:45:27.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.269+0000 7f18ca22f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.269+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5652c75e69c0 con 0x7f18b8059040 2024-09-18T01:45:27.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.269+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f18b0051070 con 0x7f18b8059040 2024-09-18T01:45:27.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.269+0000 7f18ca22f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:27.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.269+0000 7f18ca22f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.269+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5652c75e83a0 con 0x5652c75e32d0 2024-09-18T01:45:27.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.270+0000 7f18c5cef640 1 -- 172.21.15.146:0/3846628155 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f18c0029070 con 0x5652c75e32d0 2024-09-18T01:45:27.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.270+0000 7f18ca22f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:27.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.270+0000 7f18ca22f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.270+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5652c75e8890 con 0x5652c75e32d0 2024-09-18T01:45:27.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.270+0000 7f18c5cef640 1 -- 172.21.15.146:0/3846628155 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f18c0029070 con 0x5652c75e32d0 2024-09-18T01:45:27.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.270+0000 7f18ca22f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:27.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.270+0000 7f18ca22f800 20 started sync module instance, tier type = 2024-09-18T01:45:27.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.270+0000 7f18ca22f800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:27.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.270+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75e7830 con 0x7f18c003f070 2024-09-18T01:45:27.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.271+0000 7f18c54ee640 1 -- 172.21.15.146:0/3846628155 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v31'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18b8018950 con 0x7f18c003f070 2024-09-18T01:45:27.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.271+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94913532165152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75e91a0 con 0x7f18c003f070 2024-09-18T01:45:27.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.271+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75e99f0 con 0x5652c75dd060 2024-09-18T01:45:27.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.272+0000 7f18c54ee640 1 -- 172.21.15.146:0/3846628155 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94913532165152] v31'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18b8018950 con 0x7f18c003f070 2024-09-18T01:45:27.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.272+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v31'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18b0051070 con 0x5652c75dd060 2024-09-18T01:45:27.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.272+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94913532169456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75e9600 con 0x5652c75dd060 2024-09-18T01:45:27.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.272+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75ea120 con 0x5652c75e32d0 2024-09-18T01:45:27.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.273+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94913532169456] v31'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18b0051070 con 0x5652c75dd060 2024-09-18T01:45:27.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.273+0000 7f18c5cef640 1 -- 172.21.15.146:0/3846628155 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v31'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18c0029070 con 0x5652c75e32d0 2024-09-18T01:45:27.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.273+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94913532173296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75ea510 con 0x5652c75e32d0 2024-09-18T01:45:27.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.273+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75eaf40 con 0x7f18c003f070 2024-09-18T01:45:27.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.274+0000 7f18c5cef640 1 -- 172.21.15.146:0/3846628155 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94913532173296] v31'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18c0029070 con 0x5652c75e32d0 2024-09-18T01:45:27.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.274+0000 7f18c54ee640 1 -- 172.21.15.146:0/3846628155 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v31'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18b8018950 con 0x7f18c003f070 2024-09-18T01:45:27.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.274+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94913532170512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75eaf00 con 0x7f18c003f070 2024-09-18T01:45:27.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.274+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75eba40 con 0x5652c75dd060 2024-09-18T01:45:27.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.275+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v31'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18b0051070 con 0x5652c75dd060 2024-09-18T01:45:27.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.275+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94913532179792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75eba40 con 0x5652c75dd060 2024-09-18T01:45:27.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.275+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75eca60 con 0x7f18b8059040 2024-09-18T01:45:27.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.276+0000 7f18c54ee640 1 -- 172.21.15.146:0/3846628155 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94913532170512] v31'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18b8018950 con 0x7f18c003f070 2024-09-18T01:45:27.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.276+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v31'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18b0051070 con 0x7f18b8059040 2024-09-18T01:45:27.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.276+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94913532183856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75eca20 con 0x7f18b8059040 2024-09-18T01:45:27.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.276+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75ed470 con 0x7f18b8059040 2024-09-18T01:45:27.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.277+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94913532179792] v31'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18b0051070 con 0x5652c75dd060 2024-09-18T01:45:27.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.277+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94913532183856] v31'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18b0051070 con 0x7f18b8059040 2024-09-18T01:45:27.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.278+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v31'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18b0051070 con 0x7f18b8059040 2024-09-18T01:45:27.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.278+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94913532176976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75ecfc0 con 0x7f18b8059040 2024-09-18T01:45:27.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.278+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75ed8b0 con 0x7f18b8059040 2024-09-18T01:45:27.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.278+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(58 notify.7 [create] v31'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18b0051070 con 0x7f18b8059040 2024-09-18T01:45:27.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.279+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94913532176976] v31'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18b0051070 con 0x7f18b8059040 2024-09-18T01:45:27.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.279+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94913532186560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75edf40 con 0x7f18b8059040 2024-09-18T01:45:27.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.279+0000 7f18ca22f800 20 add_watcher() i=0 2024-09-18T01:45:27.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.279+0000 7f18ca22f800 20 add_watcher() i=1 2024-09-18T01:45:27.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.279+0000 7f18ca22f800 20 add_watcher() i=2 2024-09-18T01:45:27.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.279+0000 7f18ca22f800 20 add_watcher() i=3 2024-09-18T01:45:27.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.279+0000 7f18ca22f800 20 add_watcher() i=4 2024-09-18T01:45:27.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.279+0000 7f18ca22f800 20 add_watcher() i=5 2024-09-18T01:45:27.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.279+0000 7f18ca22f800 20 add_watcher() i=6 2024-09-18T01:45:27.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.279+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94913532186560] v31'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18b0051070 con 0x7f18b8059040 2024-09-18T01:45:27.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.279+0000 7f18ca22f800 20 add_watcher() i=7 2024-09-18T01:45:27.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.279+0000 7f18ca22f800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:27.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.279+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5652c75f0e60 con 0x5652c75dd060 2024-09-18T01:45:27.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.280+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f18b0051070 con 0x5652c75dd060 2024-09-18T01:45:27.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.280+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94913532189056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75ee250 con 0x5652c75dd060 2024-09-18T01:45:27.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.281+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94913532189056] v31'118 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f18b0051070 con 0x5652c75dd060 2024-09-18T01:45:27.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.281+0000 7f177b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:27.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.281+0000 7f18ca22f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:27.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.281+0000 7f18ca22f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:27.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.281+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75f9750 con 0x5652c75dd060 2024-09-18T01:45:27.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.282+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'45 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f18b0051070 con 0x5652c75dd060 2024-09-18T01:45:27.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.283+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75f9da0 con 0x7f18b8059040 2024-09-18T01:45:27.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.284+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f18b0051070 con 0x7f18b8059040 2024-09-18T01:45:27.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.284+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75fa200 con 0x5652c75e32d0 2024-09-18T01:45:27.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.285+0000 7f18c5cef640 1 -- 172.21.15.146:0/3846628155 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f18c0029070 con 0x5652c75e32d0 2024-09-18T01:45:27.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.285+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75fa140 con 0x5652c75dd060 2024-09-18T01:45:27.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.286+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'119 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f18b0051070 con 0x5652c75dd060 2024-09-18T01:45:27.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.286+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75fa730 con 0x7f18c003f070 2024-09-18T01:45:27.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.287+0000 7f18c54ee640 1 -- 172.21.15.146:0/3846628155 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'38 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f18b8018950 con 0x7f18c003f070 2024-09-18T01:45:27.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.287+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75fabe0 con 0x5652c75e32d0 2024-09-18T01:45:27.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.289+0000 7f18c5cef640 1 -- 172.21.15.146:0/3846628155 <== osd.3 v2:172.21.15.146:6809/4106661138 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'35 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f18c0029070 con 0x5652c75e32d0 2024-09-18T01:45:27.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.289+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75fabe0 con 0x5652c75dd060 2024-09-18T01:45:27.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.291+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f18b0051070 con 0x5652c75dd060 2024-09-18T01:45:27.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.291+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75fabe0 con 0x7f18b8059040 2024-09-18T01:45:27.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.292+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'27 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f18b0051070 con 0x7f18b8059040 2024-09-18T01:45:27.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.292+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75fac70 con 0x7f18c003f070 2024-09-18T01:45:27.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.293+0000 7f18c54ee640 1 -- 172.21.15.146:0/3846628155 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f18b8018950 con 0x7f18c003f070 2024-09-18T01:45:27.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.293+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75fb200 con 0x5652c75e32d0 2024-09-18T01:45:27.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.294+0000 7f18c5cef640 1 -- 172.21.15.146:0/3846628155 <== osd.3 v2:172.21.15.146:6809/4106661138 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f18c0029070 con 0x5652c75e32d0 2024-09-18T01:45:27.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.294+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75fb200 con 0x7f18c003f070 2024-09-18T01:45:27.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.294+0000 7f18c54ee640 1 -- 172.21.15.146:0/3846628155 <== osd.2 v2:172.21.15.146:6800/3820039304 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'39 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f18b8018950 con 0x7f18c003f070 2024-09-18T01:45:27.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.295+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75fb200 con 0x7f18b8059040 2024-09-18T01:45:27.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.295+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'16 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f18b0051070 con 0x7f18b8059040 2024-09-18T01:45:27.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.295+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75fb200 con 0x7f18c003f070 2024-09-18T01:45:27.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.296+0000 7f18c54ee640 1 -- 172.21.15.146:0/3846628155 <== osd.2 v2:172.21.15.146:6800/3820039304 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f18b8018950 con 0x7f18c003f070 2024-09-18T01:45:27.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.296+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75fb200 con 0x7f18b8059040 2024-09-18T01:45:27.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.297+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'39 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f18b0051070 con 0x7f18b8059040 2024-09-18T01:45:27.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.298+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75fb200 con 0x5652c75dd060 2024-09-18T01:45:27.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.298+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'120 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f18b0051070 con 0x5652c75dd060 2024-09-18T01:45:27.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.298+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75fb200 con 0x5652c75e32d0 2024-09-18T01:45:27.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.299+0000 7f18c5cef640 1 -- 172.21.15.146:0/3846628155 <== osd.3 v2:172.21.15.146:6809/4106661138 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'32 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f18c0029070 con 0x5652c75e32d0 2024-09-18T01:45:27.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.300+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75fb200 con 0x7f18c003f070 2024-09-18T01:45:27.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.300+0000 7f18c54ee640 1 -- 172.21.15.146:0/3846628155 <== osd.2 v2:172.21.15.146:6800/3820039304 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'40 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f18b8018950 con 0x7f18c003f070 2024-09-18T01:45:27.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.301+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75fb200 con 0x5652c75e32d0 2024-09-18T01:45:27.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.301+0000 7f18c5cef640 1 -- 172.21.15.146:0/3846628155 <== osd.3 v2:172.21.15.146:6809/4106661138 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'27 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f18c0029070 con 0x5652c75e32d0 2024-09-18T01:45:27.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.301+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75fb200 con 0x5652c75dd060 2024-09-18T01:45:27.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.303+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f18b0051070 con 0x5652c75dd060 2024-09-18T01:45:27.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.303+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75fb200 con 0x5652c75dd060 2024-09-18T01:45:27.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.304+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'121 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f18b0051070 con 0x5652c75dd060 2024-09-18T01:45:27.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.304+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75fb200 con 0x5652c75e32d0 2024-09-18T01:45:27.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.305+0000 7f18c5cef640 1 -- 172.21.15.146:0/3846628155 <== osd.3 v2:172.21.15.146:6809/4106661138 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'33 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f18c0029070 con 0x5652c75e32d0 2024-09-18T01:45:27.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.305+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75fb200 con 0x7f18c003f070 2024-09-18T01:45:27.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.306+0000 7f18c54ee640 1 -- 172.21.15.146:0/3846628155 <== osd.2 v2:172.21.15.146:6800/3820039304 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'30 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f18b8018950 con 0x7f18c003f070 2024-09-18T01:45:27.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.306+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75fb200 con 0x5652c75e32d0 2024-09-18T01:45:27.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.307+0000 7f18c5cef640 1 -- 172.21.15.146:0/3846628155 <== osd.3 v2:172.21.15.146:6809/4106661138 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'22 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f18c0029070 con 0x5652c75e32d0 2024-09-18T01:45:27.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.307+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75fb200 con 0x5652c75e32d0 2024-09-18T01:45:27.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.308+0000 7f18c5cef640 1 -- 172.21.15.146:0/3846628155 <== osd.3 v2:172.21.15.146:6809/4106661138 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'32 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f18c0029070 con 0x5652c75e32d0 2024-09-18T01:45:27.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.308+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75fb200 con 0x5652c75e32d0 2024-09-18T01:45:27.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.309+0000 7f18c5cef640 1 -- 172.21.15.146:0/3846628155 <== osd.3 v2:172.21.15.146:6809/4106661138 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f18c0029070 con 0x5652c75e32d0 2024-09-18T01:45:27.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.309+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75fb200 con 0x5652c75e32d0 2024-09-18T01:45:27.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.309+0000 7f18c5cef640 1 -- 172.21.15.146:0/3846628155 <== osd.3 v2:172.21.15.146:6809/4106661138 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'36 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f18c0029070 con 0x5652c75e32d0 2024-09-18T01:45:27.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.309+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75fb200 con 0x7f18b8059040 2024-09-18T01:45:27.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.311+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'23 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f18b0051070 con 0x7f18b8059040 2024-09-18T01:45:27.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.311+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75fb200 con 0x5652c75e32d0 2024-09-18T01:45:27.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.312+0000 7f18c5cef640 1 -- 172.21.15.146:0/3846628155 <== osd.3 v2:172.21.15.146:6809/4106661138 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f18c0029070 con 0x5652c75e32d0 2024-09-18T01:45:27.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.312+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75fb200 con 0x7f18b8059040 2024-09-18T01:45:27.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.313+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.0 v2:172.21.15.129:6800/1759265424 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'28 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f18b0051070 con 0x7f18b8059040 2024-09-18T01:45:27.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.313+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75fb200 con 0x5652c75e32d0 2024-09-18T01:45:27.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.314+0000 7f18c5cef640 1 -- 172.21.15.146:0/3846628155 <== osd.3 v2:172.21.15.146:6809/4106661138 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'34 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f18c0029070 con 0x5652c75e32d0 2024-09-18T01:45:27.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.314+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75fb200 con 0x7f18b8059040 2024-09-18T01:45:27.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.315+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.0 v2:172.21.15.129:6800/1759265424 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'40 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f18b0051070 con 0x7f18b8059040 2024-09-18T01:45:27.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.315+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75fb200 con 0x7f18c003f070 2024-09-18T01:45:27.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.316+0000 7f18c54ee640 1 -- 172.21.15.146:0/3846628155 <== osd.2 v2:172.21.15.146:6800/3820039304 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f18b8018950 con 0x7f18c003f070 2024-09-18T01:45:27.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.316+0000 7f177a7e4640 20 reqs_thread_entry: start 2024-09-18T01:45:27.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.316+0000 7f18ca22f800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:27.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.316+0000 7f18ca22f800 20 Filter name: none 2024-09-18T01:45:27.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.316+0000 7f16ebfff640 20 reqs_thread_entry: start 2024-09-18T01:45:27.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.316+0000 7f18ca22f800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-18T01:45:27.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.316+0000 7f18ca22f800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.316+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5652c76262a0 con 0x7f18b8059040 2024-09-18T01:45:27.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.317+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.0 v2:172.21.15.129:6800/1759265424 24 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f18b0051070 con 0x7f18b8059040 2024-09-18T01:45:27.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.317+0000 7f18ca22f800 20 rados_obj.operate() r=0 bl.length=380 2024-09-18T01:45:27.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.317+0000 7f18ca22f800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-18T01:45:27.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.317+0000 7f18ca22f800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-18T01:45:27.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.317+0000 7f18ca22f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:45:27.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.317+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5652c76288a0 con 0x7f18b8059040 2024-09-18T01:45:27.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.317+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.0 v2:172.21.15.129:6800/1759265424 25 ==== osd_op_reply(95 fud.buckets [call out=183b] v0'0 uv1 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f18b0051070 con 0x7f18b8059040 2024-09-18T01:45:27.319 INFO:teuthology.orchestra.run.smithi146.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-18T01:45:27.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.318+0000 7f177b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:27.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.318+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94913532189056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75f8610 con 0x5652c75dd060 2024-09-18T01:45:27.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.319+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.1 v2:172.21.15.146:6808/3930274777 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94913532189056] v31'122 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f18b0051070 con 0x5652c75dd060 2024-09-18T01:45:27.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.319+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94913532165152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75ed980 con 0x7f18c003f070 2024-09-18T01:45:27.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.320+0000 7f18c54ee640 1 -- 172.21.15.146:0/3846628155 <== osd.2 v2:172.21.15.146:6800/3820039304 19 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94913532165152] v31'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18b8018950 con 0x7f18c003f070 2024-09-18T01:45:27.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.320+0000 7f18ca22f800 20 remove_watcher() i=0 2024-09-18T01:45:27.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.320+0000 7f18ca22f800 2 removed watcher, disabling cache 2024-09-18T01:45:27.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.320+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94913532169456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75ed980 con 0x5652c75dd060 2024-09-18T01:45:27.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.321+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.1 v2:172.21.15.146:6808/3930274777 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94913532169456] v31'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18b0051070 con 0x5652c75dd060 2024-09-18T01:45:27.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.321+0000 7f18ca22f800 20 remove_watcher() i=1 2024-09-18T01:45:27.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.321+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94913532173296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75e8cf0 con 0x5652c75e32d0 2024-09-18T01:45:27.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.322+0000 7f18c5cef640 1 -- 172.21.15.146:0/3846628155 <== osd.3 v2:172.21.15.146:6809/4106661138 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94913532173296] v31'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18c0029070 con 0x5652c75e32d0 2024-09-18T01:45:27.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.322+0000 7f18ca22f800 20 remove_watcher() i=2 2024-09-18T01:45:27.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.322+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94913532170512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75ed980 con 0x7f18c003f070 2024-09-18T01:45:27.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.323+0000 7f18c54ee640 1 -- 172.21.15.146:0/3846628155 <== osd.2 v2:172.21.15.146:6800/3820039304 20 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94913532170512] v31'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18b8018950 con 0x7f18c003f070 2024-09-18T01:45:27.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.323+0000 7f18ca22f800 20 remove_watcher() i=3 2024-09-18T01:45:27.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.323+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94913532179792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75e9bf0 con 0x5652c75dd060 2024-09-18T01:45:27.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.325+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.1 v2:172.21.15.146:6808/3930274777 30 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94913532179792] v31'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18b0051070 con 0x5652c75dd060 2024-09-18T01:45:27.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.325+0000 7f18ca22f800 20 remove_watcher() i=4 2024-09-18T01:45:27.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.325+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94913532183856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75ed980 con 0x7f18b8059040 2024-09-18T01:45:27.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.326+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.0 v2:172.21.15.129:6800/1759265424 26 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94913532183856] v31'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18b0051070 con 0x7f18b8059040 2024-09-18T01:45:27.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.326+0000 7f18ca22f800 20 remove_watcher() i=5 2024-09-18T01:45:27.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.326+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94913532176976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75eb550 con 0x7f18b8059040 2024-09-18T01:45:27.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.327+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.0 v2:172.21.15.129:6800/1759265424 27 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94913532176976] v31'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18b0051070 con 0x7f18b8059040 2024-09-18T01:45:27.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.327+0000 7f18ca22f800 20 remove_watcher() i=6 2024-09-18T01:45:27.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.327+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94913532186560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5652c75e9bf0 con 0x7f18b8059040 2024-09-18T01:45:27.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.328+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 <== osd.0 v2:172.21.15.129:6800/1759265424 28 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94913532186560] v31'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18b0051070 con 0x7f18b8059040 2024-09-18T01:45:27.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.328+0000 7f18ca22f800 20 remove_watcher() i=7 2024-09-18T01:45:27.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.328+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f18b8059040 msgr2=0x7f18b8040580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.328+0000 7f18ca22f800 1 --2- 172.21.15.146:0/3846628155 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f18b8059040 0x7f18b8040580 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.328+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5652c75dd060 msgr2=0x5652c75df520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.328+0000 7f18ca22f800 1 --2- 172.21.15.146:0/3846628155 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5652c75dd060 0x5652c75df520 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.328+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f18c003f070 msgr2=0x7f18c0013aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.328+0000 7f18ca22f800 1 --2- 172.21.15.146:0/3846628155 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f18c003f070 0x7f18c0013aa0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.328+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5652c75e32d0 msgr2=0x5652c75e56c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.328+0000 7f18ca22f800 1 --2- 172.21.15.146:0/3846628155 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5652c75e32d0 0x5652c75e56c0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.328+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1790036b90 msgr2=0x7f1790039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.328+0000 7f18ca22f800 1 --2- 172.21.15.146:0/3846628155 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1790036b90 0x7f1790039050 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f18b8000fd0 tx=0x7f18b8038000 comp rx=0 tx=0).stop 2024-09-18T01:45:27.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.328+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5652c75c9ec0 msgr2=0x5652c75d1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.328+0000 7f18ca22f800 1 --2- 172.21.15.146:0/3846628155 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5652c75c9ec0 0x5652c75d1300 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f18c0001450 tx=0x7f18c004c880 comp rx=0 tx=0).stop 2024-09-18T01:45:27.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.328+0000 7f18bffff640 1 -- 172.21.15.146:0/3846628155 reap_dead start 2024-09-18T01:45:27.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.328+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 shutdown_connections 2024-09-18T01:45:27.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.328+0000 7f18ca22f800 1 --2- 172.21.15.146:0/3846628155 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5652c75c9ec0 0x5652c75d1300 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.328+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 >> 172.21.15.146:0/3846628155 conn(0x5652c75c6220 msgr2=0x5652c75c42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:27.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.328+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 shutdown_connections 2024-09-18T01:45:27.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.328+0000 7f18ca22f800 1 -- 172.21.15.146:0/3846628155 wait complete. 2024-09-18T01:45:27.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.328+0000 7f18ca22f800 1 -- 172.21.15.146:0/2476129399 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f179c036b40 msgr2=0x7f179c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.328+0000 7f18ca22f800 1 --2- 172.21.15.146:0/2476129399 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f179c036b40 0x7f179c039000 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x5652c75aad50 tx=0x7f18b8024ec0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.328+0000 7f18ca22f800 1 -- 172.21.15.146:0/2476129399 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5652c75bd1f0 msgr2=0x5652c75bd610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.328+0000 7f18ca22f800 1 --2- 172.21.15.146:0/2476129399 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5652c75bd1f0 0x5652c75bd610 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x5652c75a9e50 tx=0x7f18c00178e0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.329+0000 7f18ca22f800 1 -- 172.21.15.146:0/2476129399 shutdown_connections 2024-09-18T01:45:27.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.329+0000 7f18ca22f800 1 --2- 172.21.15.146:0/2476129399 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f179c036b40 0x7f179c039000 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.329+0000 7f18ca22f800 1 --2- 172.21.15.146:0/2476129399 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5652c75bd1f0 0x5652c75bd610 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.329+0000 7f18ca22f800 1 -- 172.21.15.146:0/2476129399 >> 172.21.15.146:0/2476129399 conn(0x5652c75b2180 msgr2=0x5652c75b4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:27.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.329+0000 7f18ca22f800 1 -- 172.21.15.146:0/2476129399 shutdown_connections 2024-09-18T01:45:27.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.329+0000 7f18ca22f800 1 -- 172.21.15.146:0/2476129399 wait complete. 2024-09-18T01:45:27.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.329+0000 7f18ca22f800 1 -- 172.21.15.146:0/4134849731 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5652c741f5b0 msgr2=0x5652c75a94f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.329+0000 7f18ca22f800 1 --2- 172.21.15.146:0/4134849731 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5652c741f5b0 0x5652c75a94f0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.329+0000 7f18ca22f800 1 -- 172.21.15.146:0/4134849731 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5652c75ab450 msgr2=0x5652c75aecb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.329+0000 7f18ca22f800 1 --2- 172.21.15.146:0/4134849731 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5652c75ab450 0x5652c75aecb0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.329+0000 7f18ca22f800 1 -- 172.21.15.146:0/4134849731 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f17ac036b90 msgr2=0x7f17ac039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.329+0000 7f18ca22f800 1 --2- 172.21.15.146:0/4134849731 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f17ac036b90 0x7f17ac039050 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f18b0057000 tx=0x7f18b0052000 comp rx=0 tx=0).stop 2024-09-18T01:45:27.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.329+0000 7f18ca22f800 1 -- 172.21.15.146:0/4134849731 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5652c741e4a0 msgr2=0x5652c75a2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.329+0000 7f18ca22f800 1 --2- 172.21.15.146:0/4134849731 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5652c741e4a0 0x5652c75a2480 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f18b800b7c0 tx=0x7f18b8000ed0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.329+0000 7f18ca22f800 1 -- 172.21.15.146:0/4134849731 shutdown_connections 2024-09-18T01:45:27.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.329+0000 7f18ca22f800 1 --2- 172.21.15.146:0/4134849731 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5652c75ab450 0x5652c75aecb0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.329+0000 7f18ca22f800 1 --2- 172.21.15.146:0/4134849731 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5652c741f5b0 0x5652c75a94f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.329+0000 7f18ca22f800 1 --2- 172.21.15.146:0/4134849731 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f17ac036b90 0x7f17ac039050 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.329+0000 7f18ca22f800 1 --2- 172.21.15.146:0/4134849731 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5652c741e4a0 0x5652c75a2480 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.329+0000 7f18ca22f800 1 -- 172.21.15.146:0/4134849731 >> 172.21.15.146:0/4134849731 conn(0x5652c74a4ff0 msgr2=0x5652c7594ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:27.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.329+0000 7f18ca22f800 1 -- 172.21.15.146:0/4134849731 shutdown_connections 2024-09-18T01:45:27.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.329+0000 7f18ca22f800 1 -- 172.21.15.146:0/4134849731 wait complete. 2024-09-18T01:45:27.338 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-18T01:45:27.338 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-18T01:45:27.339 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-18T01:45:27.339 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid fud --bucket myfoo 2024-09-18T01:45:27.385 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:27.385 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:27.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.385+0000 7f1cd9c0e800 1 Processor -- start 2024-09-18T01:45:27.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.385+0000 7f1cd9c0e800 1 -- start start 2024-09-18T01:45:27.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.385+0000 7f1cd9c0e800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x564b081eaa10 0x564b081ece00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.385+0000 7f1cd9c0e800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564b080a5b30 con 0x564b081e6710 2024-09-18T01:45:27.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.385+0000 7f1cd9c0e800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x564b08087360 con 0x564b081eaa10 2024-09-18T01:45:27.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.385+0000 7f1cd4af6640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x564b081eaa10 0x564b081ece00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.385+0000 7f1cd4af6640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x564b081eaa10 0x564b081ece00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:57604/0 (socket says 172.21.15.146:57604) 2024-09-18T01:45:27.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.385+0000 7f1cd52f7640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x564b081e6710 0x564b081e6b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:47300/0 (socket says 172.21.15.146:47300) 2024-09-18T01:45:27.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.385+0000 7f1cd4af6640 1 -- 172.21.15.146:0/4287154456 learned_addr learned my addr 172.21.15.146:0/4287154456 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:27.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.386+0000 7f1cd4af6640 1 -- 172.21.15.146:0/4287154456 >> v1:172.21.15.129:6789/0 conn(0x564b081e6710 legacy=0x564b081e6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.386+0000 7f1cd4af6640 1 -- 172.21.15.146:0/4287154456 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b080ade00 con 0x564b081eaa10 2024-09-18T01:45:27.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.387+0000 7f1cd4af6640 1 --2- 172.21.15.146:0/4287154456 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b081eaa10 0x564b081ece00 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc00a520 tx=0x7f1ccc045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3719aeea91ef4b1a server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.388+0000 7f1cc7fff640 1 -- 172.21.15.146:0/4287154456 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ccc055070 con 0x564b081eaa10 2024-09-18T01:45:27.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.388+0000 7f1cc7fff640 1 -- 172.21.15.146:0/4287154456 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ccc0515b0 con 0x564b081eaa10 2024-09-18T01:45:27.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.388+0000 7f1cc7fff640 1 -- 172.21.15.146:0/4287154456 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ccc0518d0 con 0x564b081eaa10 2024-09-18T01:45:27.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.388+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/4287154456 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b081eaa10 msgr2=0x564b081ece00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.388+0000 7f1cd9c0e800 1 --2- 172.21.15.146:0/4287154456 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b081eaa10 0x564b081ece00 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc00a520 tx=0x7f1ccc045ba0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.388+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/4287154456 shutdown_connections 2024-09-18T01:45:27.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.388+0000 7f1cd9c0e800 1 --2- 172.21.15.146:0/4287154456 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b081eaa10 0x564b081ece00 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.388+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/4287154456 >> 172.21.15.146:0/4287154456 conn(0x564b081e1fe0 msgr2=0x564b081e4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:27.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.388+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/4287154456 shutdown_connections 2024-09-18T01:45:27.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.388+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/4287154456 wait complete. 2024-09-18T01:45:27.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.402+0000 7f1cd9c0e800 1 Processor -- start 2024-09-18T01:45:27.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.402+0000 7f1cd9c0e800 1 -- start start 2024-09-18T01:45:27.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.402+0000 7f1cd9c0e800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b081e6710 0x564b082d5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.402+0000 7f1cd9c0e800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x564b08132360 con 0x564b081e6710 2024-09-18T01:45:27.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.402+0000 7f1cd52f7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b081e6710 0x564b082d5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.402+0000 7f1cd52f7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b081e6710 0x564b082d5870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:57618/0 (socket says 172.21.15.146:57618) 2024-09-18T01:45:27.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.402+0000 7f1cd52f7640 1 -- 172.21.15.146:0/7153518 learned_addr learned my addr 172.21.15.146:0/7153518 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:27.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.403+0000 7f1cd52f7640 1 -- 172.21.15.146:0/7153518 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b0807fbc0 con 0x564b081e6710 2024-09-18T01:45:27.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.403+0000 7f1cd52f7640 1 --2- 172.21.15.146:0/7153518 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b081e6710 0x564b082d5870 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f1cc8001e40 tx=0x7f1cc8001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bae5c6d99b4147 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.403+0000 7f1bc3606640 1 -- 172.21.15.146:0/7153518 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cc800e5c0 con 0x564b081e6710 2024-09-18T01:45:27.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.403+0000 7f1bc3606640 1 -- 172.21.15.146:0/7153518 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cc8006070 con 0x564b081e6710 2024-09-18T01:45:27.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.403+0000 7f1bc3606640 1 -- 172.21.15.146:0/7153518 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cc800e910 con 0x564b081e6710 2024-09-18T01:45:27.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.404+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/7153518 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b081e6710 msgr2=0x564b082d5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.404+0000 7f1cd9c0e800 1 --2- 172.21.15.146:0/7153518 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b081e6710 0x564b082d5870 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f1cc8001e40 tx=0x7f1cc8001e70 comp rx=0 tx=0).stop 2024-09-18T01:45:27.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.404+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/7153518 shutdown_connections 2024-09-18T01:45:27.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.404+0000 7f1cd9c0e800 1 --2- 172.21.15.146:0/7153518 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b081e6710 0x564b082d5870 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.404+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/7153518 >> 172.21.15.146:0/7153518 conn(0x564b081e1fe0 msgr2=0x564b082d1230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:27.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.404+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/7153518 shutdown_connections 2024-09-18T01:45:27.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.404+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/7153518 wait complete. 2024-09-18T01:45:27.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.404+0000 7f1cd9c0e800 1 Processor -- start 2024-09-18T01:45:27.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.404+0000 7f1cd9c0e800 1 -- start start 2024-09-18T01:45:27.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.404+0000 7f1cd9c0e800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b081e6710 0x564b082dd280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.404+0000 7f1cd9c0e800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x564b081ed640 con 0x564b081e6710 2024-09-18T01:45:27.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.404+0000 7f1cd52f7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b081e6710 0x564b082dd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.404+0000 7f1cd52f7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b081e6710 0x564b082dd280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:57626/0 (socket says 172.21.15.146:57626) 2024-09-18T01:45:27.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.404+0000 7f1cd52f7640 1 -- 172.21.15.146:0/1015265997 learned_addr learned my addr 172.21.15.146:0/1015265997 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:27.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.405+0000 7f1cd52f7640 1 -- 172.21.15.146:0/1015265997 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b08093fe0 con 0x564b081e6710 2024-09-18T01:45:27.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.405+0000 7f1cd52f7640 1 --2- 172.21.15.146:0/1015265997 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b081e6710 0x564b082dd280 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f1cc8000f60 tx=0x7f1cc8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.405+0000 7f1bc1e03640 1 -- 172.21.15.146:0/1015265997 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cc800f8d0 con 0x564b081e6710 2024-09-18T01:45:27.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.405+0000 7f1bc1e03640 1 -- 172.21.15.146:0/1015265997 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cc800fa70 con 0x564b081e6710 2024-09-18T01:45:27.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.405+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1015265997 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564b082dd7c0 con 0x564b081e6710 2024-09-18T01:45:27.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.405+0000 7f1bc1e03640 1 -- 172.21.15.146:0/1015265997 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cc800fd90 con 0x564b081e6710 2024-09-18T01:45:27.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.405+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1015265997 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b082ddce0 con 0x564b081e6710 2024-09-18T01:45:27.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.406+0000 7f1bc1e03640 1 -- 172.21.15.146:0/1015265997 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1cc8017070 con 0x564b081e6710 2024-09-18T01:45:27.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.406+0000 7f1bc1e03640 1 --2- 172.21.15.146:0/1015265997 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1bbc036af0 0x7f1bbc038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.406+0000 7f1bc1e03640 1 -- 172.21.15.146:0/1015265997 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f1cc8015020 con 0x564b081e6710 2024-09-18T01:45:27.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.406+0000 7f1cd4af6640 1 --2- 172.21.15.146:0/1015265997 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1bbc036af0 0x7f1bbc038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.406+0000 7f1cd9c0e800 1 --2- 172.21.15.146:0/1015265997 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564b081eaa10 0x564b082e42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.406+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1015265997 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564b082e48c0 con 0x564b081eaa10 2024-09-18T01:45:27.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.406+0000 7f1cd5af8640 1 --2- 172.21.15.146:0/1015265997 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564b081eaa10 0x564b082e42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.406+0000 7f1cd4af6640 1 --2- 172.21.15.146:0/1015265997 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1bbc036af0 0x7f1bbc038fb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc057000 tx=0x7f1ccc052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.407+0000 7f1cd5af8640 1 --2- 172.21.15.146:0/1015265997 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564b081eaa10 0x564b082e42f0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.407+0000 7f1cd5af8640 1 -- 172.21.15.146:0/1015265997 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1cd000a4a0 con 0x564b081eaa10 2024-09-18T01:45:27.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.407+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1015265997 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564b082e18c0 con 0x564b081eaa10 2024-09-18T01:45:27.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.407+0000 7f1cd5af8640 1 -- 172.21.15.146:0/1015265997 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1cd000a4a0 con 0x564b081eaa10 2024-09-18T01:45:27.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.407+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1015265997 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564b082e66b0 con 0x564b081eaa10 2024-09-18T01:45:27.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.407+0000 7f1cd5af8640 1 -- 172.21.15.146:0/1015265997 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1cd000a4a0 con 0x564b081eaa10 2024-09-18T01:45:27.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.408+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1015265997 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564b082e58e0 con 0x564b081eaa10 2024-09-18T01:45:27.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.408+0000 7f1cd5af8640 1 -- 172.21.15.146:0/1015265997 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1cd000a4a0 con 0x564b081eaa10 2024-09-18T01:45:27.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.408+0000 7f1cd9c0e800 1 --2- 172.21.15.146:0/1015265997 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x564b082e7a60 0x564b082e9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.408+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1015265997 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564b082ea390 con 0x564b082e7a60 2024-09-18T01:45:27.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.408+0000 7f1cd52f7640 1 --2- 172.21.15.146:0/1015265997 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x564b082e7a60 0x564b082e9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.408+0000 7f1cd52f7640 1 --2- 172.21.15.146:0/1015265997 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x564b082e7a60 0x564b082e9e50 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.408+0000 7f1cd52f7640 1 -- 172.21.15.146:0/1015265997 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1cc802e070 con 0x564b082e7a60 2024-09-18T01:45:27.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.409+0000 7f1cd9c0e800 1 Processor -- start 2024-09-18T01:45:27.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.409+0000 7f1cd9c0e800 1 -- start start 2024-09-18T01:45:27.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.409+0000 7f1cd9c0e800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b0815c740 0x564b0815ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.409+0000 7f1cd9c0e800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x564b08081580 con 0x564b0815c740 2024-09-18T01:45:27.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.409+0000 7f1cd5af8640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b0815c740 0x564b0815ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.409+0000 7f1cd5af8640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b0815c740 0x564b0815ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:57634/0 (socket says 172.21.15.146:57634) 2024-09-18T01:45:27.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.409+0000 7f1cd5af8640 1 -- 172.21.15.146:0/3242766176 learned_addr learned my addr 172.21.15.146:0/3242766176 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:27.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.409+0000 7f1cd5af8640 1 -- 172.21.15.146:0/3242766176 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b0815cb60 con 0x564b0815c740 2024-09-18T01:45:27.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.410+0000 7f1cd5af8640 1 --2- 172.21.15.146:0/3242766176 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b0815c740 0x564b0815ad90 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x564b082dded0 tx=0x7f1cd00178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.410+0000 7f1bbaffd640 1 -- 172.21.15.146:0/3242766176 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cd0013440 con 0x564b0815c740 2024-09-18T01:45:27.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.410+0000 7f1bbaffd640 1 -- 172.21.15.146:0/3242766176 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cd00135e0 con 0x564b0815c740 2024-09-18T01:45:27.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.410+0000 7f1bbaffd640 1 -- 172.21.15.146:0/3242766176 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cd00138c0 con 0x564b0815c740 2024-09-18T01:45:27.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.410+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/3242766176 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564b0815b330 con 0x564b0815c740 2024-09-18T01:45:27.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.410+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/3242766176 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b0815b830 con 0x564b0815c740 2024-09-18T01:45:27.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.410+0000 7f1bbaffd640 1 -- 172.21.15.146:0/3242766176 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1cd0011040 con 0x564b0815c740 2024-09-18T01:45:27.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.411+0000 7f1bbaffd640 1 --2- 172.21.15.146:0/3242766176 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1bac036b90 0x7f1bac039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.411+0000 7f1bbaffd640 1 -- 172.21.15.146:0/3242766176 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f1cd001d070 con 0x564b0815c740 2024-09-18T01:45:27.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.411+0000 7f1cd52f7640 1 --2- 172.21.15.146:0/3242766176 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1bac036b90 0x7f1bac039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.411+0000 7f1cd9c0e800 1 Processor -- start 2024-09-18T01:45:27.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.411+0000 7f1cd9c0e800 1 -- start start 2024-09-18T01:45:27.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.411+0000 7f1cd52f7640 1 --2- 172.21.15.146:0/3242766176 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1bac036b90 0x7f1bac039050 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1cc801cfd0 tx=0x7f1cc804b760 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.411+0000 7f1cd9c0e800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b08306eb0 0x564b083072b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.411+0000 7f1cd9c0e800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x564b082d6020 con 0x564b08306eb0 2024-09-18T01:45:27.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.411+0000 7f1cd5af8640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b08306eb0 0x564b083072b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.411+0000 7f1cd5af8640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b08306eb0 0x564b083072b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:57638/0 (socket says 172.21.15.146:57638) 2024-09-18T01:45:27.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.411+0000 7f1cd5af8640 1 -- 172.21.15.146:0/2046165074 learned_addr learned my addr 172.21.15.146:0/2046165074 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:27.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.412+0000 7f1cd5af8640 1 -- 172.21.15.146:0/2046165074 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b08307880 con 0x564b08306eb0 2024-09-18T01:45:27.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.412+0000 7f1cd5af8640 1 --2- 172.21.15.146:0/2046165074 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b08306eb0 0x564b083072b0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f1cd004c8c0 tx=0x7f1cd0001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8245f474f4529858 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.412+0000 7f1bb8ff9640 1 -- 172.21.15.146:0/2046165074 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cd0027040 con 0x564b08306eb0 2024-09-18T01:45:27.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.412+0000 7f1bb8ff9640 1 -- 172.21.15.146:0/2046165074 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cd0012cc0 con 0x564b08306eb0 2024-09-18T01:45:27.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.412+0000 7f1bb8ff9640 1 -- 172.21.15.146:0/2046165074 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cd004b250 con 0x564b08306eb0 2024-09-18T01:45:27.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.412+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/2046165074 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b08306eb0 msgr2=0x564b083072b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.412+0000 7f1cd9c0e800 1 --2- 172.21.15.146:0/2046165074 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b08306eb0 0x564b083072b0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f1cd004c8c0 tx=0x7f1cd0001940 comp rx=0 tx=0).stop 2024-09-18T01:45:27.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.412+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/2046165074 shutdown_connections 2024-09-18T01:45:27.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.412+0000 7f1cd9c0e800 1 --2- 172.21.15.146:0/2046165074 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b08306eb0 0x564b083072b0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.412+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/2046165074 >> 172.21.15.146:0/2046165074 conn(0x564b08303210 msgr2=0x564b08301310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:27.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.412+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/2046165074 shutdown_connections 2024-09-18T01:45:27.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.412+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/2046165074 wait complete. 2024-09-18T01:45:27.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.413+0000 7f1cd9c0e800 1 Processor -- start 2024-09-18T01:45:27.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.413+0000 7f1cd9c0e800 1 -- start start 2024-09-18T01:45:27.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.413+0000 7f1cd9c0e800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b08306eb0 0x564b0830e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.413+0000 7f1cd9c0e800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x564b08307f30 con 0x564b08306eb0 2024-09-18T01:45:27.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.413+0000 7f1cd5af8640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b08306eb0 0x564b0830e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.413+0000 7f1cd5af8640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b08306eb0 0x564b0830e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:57654/0 (socket says 172.21.15.146:57654) 2024-09-18T01:45:27.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.413+0000 7f1cd5af8640 1 -- 172.21.15.146:0/1940911163 learned_addr learned my addr 172.21.15.146:0/1940911163 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:27.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.413+0000 7f1cd5af8640 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b0830e8d0 con 0x564b08306eb0 2024-09-18T01:45:27.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.413+0000 7f1cd5af8640 1 --2- 172.21.15.146:0/1940911163 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b08306eb0 0x564b0830e390 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f1cd004b7b0 tx=0x7f1cd004c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.413+0000 7f1baaffd640 1 -- 172.21.15.146:0/1940911163 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cd0027070 con 0x564b08306eb0 2024-09-18T01:45:27.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.413+0000 7f1baaffd640 1 -- 172.21.15.146:0/1940911163 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cd0013e30 con 0x564b08306eb0 2024-09-18T01:45:27.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.413+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564b0830eb60 con 0x564b08306eb0 2024-09-18T01:45:27.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.414+0000 7f1baaffd640 1 -- 172.21.15.146:0/1940911163 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cd002aa60 con 0x564b08306eb0 2024-09-18T01:45:27.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.414+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b08311810 con 0x564b08306eb0 2024-09-18T01:45:27.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.414+0000 7f1baaffd640 1 -- 172.21.15.146:0/1940911163 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1cd002ac00 con 0x564b08306eb0 2024-09-18T01:45:27.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.415+0000 7f1baaffd640 1 --2- 172.21.15.146:0/1940911163 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1ba0036b90 0x7f1ba0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.415+0000 7f1baaffd640 1 -- 172.21.15.146:0/1940911163 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f1cd0033070 con 0x564b08306eb0 2024-09-18T01:45:27.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.415+0000 7f1cd52f7640 1 --2- 172.21.15.146:0/1940911163 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1ba0036b90 0x7f1ba0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.415+0000 7f1cd52f7640 1 --2- 172.21.15.146:0/1940911163 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1ba0036b90 0x7f1ba0039050 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x564b082e6610 tx=0x7f1cc8046000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.415+0000 7f1cd9c0e800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.415+0000 7f1cd9c0e800 1 --2- 172.21.15.146:0/1940911163 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564b0831a0b0 0x564b0831c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.415+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564b0831ccc0 con 0x564b0831a0b0 2024-09-18T01:45:27.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.415+0000 7f1cd4af6640 1 --2- 172.21.15.146:0/1940911163 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564b0831a0b0 0x564b0831c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.416+0000 7f1cd4af6640 1 --2- 172.21.15.146:0/1940911163 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564b0831a0b0 0x564b0831c570 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.416+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ccc057030 con 0x564b0831a0b0 2024-09-18T01:45:27.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.416+0000 7f1cd9c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:27.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.416+0000 7f1cd9c0e800 20 realm 2024-09-18T01:45:27.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.416+0000 7f1cd9c0e800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.416+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564b0831d090 con 0x564b0831a0b0 2024-09-18T01:45:27.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.416+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ccc057030 con 0x564b0831a0b0 2024-09-18T01:45:27.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.416+0000 7f1cd9c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:27.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.416+0000 7f1cd9c0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:27.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.416+0000 7f1cd9c0e800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.416+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564b0831d930 con 0x564b0831a0b0 2024-09-18T01:45:27.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.416+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ccc057030 con 0x564b0831a0b0 2024-09-18T01:45:27.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.416+0000 7f1cd9c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:27.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.416+0000 7f1cd9c0e800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.416+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564b0831dcd0 con 0x564b0831a0b0 2024-09-18T01:45:27.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.417+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1ccc057030 con 0x564b0831a0b0 2024-09-18T01:45:27.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.417+0000 7f1cd9c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:27.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.417+0000 7f1cd9c0e800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.417+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564b0831e520 con 0x564b0831a0b0 2024-09-18T01:45:27.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.417+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1ccc057030 con 0x564b0831a0b0 2024-09-18T01:45:27.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.417+0000 7f1cd9c0e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:27.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.417+0000 7f1cd9c0e800 20 searching for the correct realm 2024-09-18T01:45:27.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.417+0000 7f1cd9c0e800 1 --2- 172.21.15.146:0/1940911163 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x564b08320290 0x564b08322680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.417+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564b08322c90 con 0x564b08320290 2024-09-18T01:45:27.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.417+0000 7f1cd5af8640 1 --2- 172.21.15.146:0/1940911163 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x564b08320290 0x564b08322680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.417+0000 7f1cd5af8640 1 --2- 172.21.15.146:0/1940911163 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x564b08320290 0x564b08322680 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.418+0000 7f1cd5af8640 1 -- 172.21.15.146:0/1940911163 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd0057040 con 0x564b08320290 2024-09-18T01:45:27.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.418+0000 7f1cd5af8640 1 --2- 172.21.15.146:0/1940911163 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f1cd00123a0 0x7f1cd0036580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.418+0000 7f1cd5af8640 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564b08322c90 con 0x7f1cd00123a0 2024-09-18T01:45:27.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.418+0000 7f1cd52f7640 1 --2- 172.21.15.146:0/1940911163 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f1cd00123a0 0x7f1cd0036580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.418+0000 7f1cd52f7640 1 --2- 172.21.15.146:0/1940911163 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f1cd00123a0 0x7f1cd0036580 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.418+0000 7f1cd52f7640 1 -- 172.21.15.146:0/1940911163 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cc802e070 con 0x7f1cd00123a0 2024-09-18T01:45:27.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.418+0000 7f1cd52f7640 1 --2- 172.21.15.146:0/1940911163 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f1cc803d040 0x7f1cc801d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.418+0000 7f1cd52f7640 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564b08322c90 con 0x7f1cc803d040 2024-09-18T01:45:27.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.418+0000 7f1cd4af6640 1 --2- 172.21.15.146:0/1940911163 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f1cc803d040 0x7f1cc801d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.419+0000 7f1cd4af6640 1 --2- 172.21.15.146:0/1940911163 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f1cc803d040 0x7f1cc801d5f0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.419+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ccc057030 con 0x7f1cc803d040 2024-09-18T01:45:27.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.419+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564b08322c90 con 0x564b0831a0b0 2024-09-18T01:45:27.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.419+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1ccc057030 con 0x564b0831a0b0 2024-09-18T01:45:27.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.419+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564b08322c90 con 0x564b0831a0b0 2024-09-18T01:45:27.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.420+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ccc057030 con 0x564b0831a0b0 2024-09-18T01:45:27.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.420+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564b08322c90 con 0x7f1cc803d040 2024-09-18T01:45:27.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.420+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ccc057030 con 0x7f1cc803d040 2024-09-18T01:45:27.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.420+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564b08322c90 con 0x7f1cc803d040 2024-09-18T01:45:27.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.420+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ccc057030 con 0x7f1cc803d040 2024-09-18T01:45:27.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.420+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564b08322c90 con 0x7f1cd00123a0 2024-09-18T01:45:27.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.420+0000 7f1cd52f7640 1 -- 172.21.15.146:0/1940911163 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cc802e070 con 0x7f1cd00123a0 2024-09-18T01:45:27.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.420+0000 7f1cd52f7640 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564b08322c90 con 0x564b08320290 2024-09-18T01:45:27.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.420+0000 7f1cd5af8640 1 -- 172.21.15.146:0/1940911163 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd0057040 con 0x564b08320290 2024-09-18T01:45:27.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.421+0000 7f1cd5af8640 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564b08322c90 con 0x564b0831a0b0 2024-09-18T01:45:27.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.421+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ccc057030 con 0x564b0831a0b0 2024-09-18T01:45:27.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.421+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564b08322c90 con 0x7f1cc803d040 2024-09-18T01:45:27.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.421+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ccc057030 con 0x7f1cc803d040 2024-09-18T01:45:27.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.421+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564b08322c90 con 0x564b0831a0b0 2024-09-18T01:45:27.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.421+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ccc057030 con 0x564b0831a0b0 2024-09-18T01:45:27.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.421+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564b08322c90 con 0x7f1cd00123a0 2024-09-18T01:45:27.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.421+0000 7f1cd52f7640 1 -- 172.21.15.146:0/1940911163 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f1cc802e070 con 0x7f1cd00123a0 2024-09-18T01:45:27.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.421+0000 7f1cd52f7640 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564b08322c90 con 0x564b08320290 2024-09-18T01:45:27.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.422+0000 7f1cd5af8640 1 -- 172.21.15.146:0/1940911163 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd0057040 con 0x564b08320290 2024-09-18T01:45:27.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.422+0000 7f1cd5af8640 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564b08322c90 con 0x564b08320290 2024-09-18T01:45:27.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.422+0000 7f1cd5af8640 1 -- 172.21.15.146:0/1940911163 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd0057040 con 0x564b08320290 2024-09-18T01:45:27.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.422+0000 7f1cd5af8640 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564b08322c90 con 0x7f1cc803d040 2024-09-18T01:45:27.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.422+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ccc057030 con 0x7f1cc803d040 2024-09-18T01:45:27.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.422+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564b08322c90 con 0x564b08320290 2024-09-18T01:45:27.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.422+0000 7f1cd5af8640 1 -- 172.21.15.146:0/1940911163 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd0057040 con 0x564b08320290 2024-09-18T01:45:27.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.422+0000 7f1cd5af8640 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564b08322c90 con 0x564b08320290 2024-09-18T01:45:27.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.423+0000 7f1cd5af8640 1 -- 172.21.15.146:0/1940911163 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd0057040 con 0x564b08320290 2024-09-18T01:45:27.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.423+0000 7f1cd5af8640 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564b08322c90 con 0x564b0831a0b0 2024-09-18T01:45:27.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.423+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ccc057030 con 0x564b0831a0b0 2024-09-18T01:45:27.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.423+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564b08322c90 con 0x564b0831a0b0 2024-09-18T01:45:27.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.423+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1ccc057030 con 0x564b0831a0b0 2024-09-18T01:45:27.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.423+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564b08322c90 con 0x7f1cc803d040 2024-09-18T01:45:27.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.423+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ccc057030 con 0x7f1cc803d040 2024-09-18T01:45:27.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.423+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564b08322c90 con 0x564b08320290 2024-09-18T01:45:27.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.423+0000 7f1cd5af8640 1 -- 172.21.15.146:0/1940911163 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd0057040 con 0x564b08320290 2024-09-18T01:45:27.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.423+0000 7f1cd5af8640 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564b08322c90 con 0x7f1cd00123a0 2024-09-18T01:45:27.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.424+0000 7f1cd52f7640 1 -- 172.21.15.146:0/1940911163 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cc802e070 con 0x7f1cd00123a0 2024-09-18T01:45:27.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.424+0000 7f1cd52f7640 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564b08322c90 con 0x564b0831a0b0 2024-09-18T01:45:27.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.424+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ccc057030 con 0x564b0831a0b0 2024-09-18T01:45:27.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.424+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564b08322c90 con 0x7f1cc803d040 2024-09-18T01:45:27.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.424+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ccc057030 con 0x7f1cc803d040 2024-09-18T01:45:27.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.424+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564b08322c90 con 0x564b08320290 2024-09-18T01:45:27.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.424+0000 7f1cd5af8640 1 -- 172.21.15.146:0/1940911163 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd0057040 con 0x564b08320290 2024-09-18T01:45:27.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.424+0000 7f1cd5af8640 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564b08322c90 con 0x7f1cc803d040 2024-09-18T01:45:27.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.425+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ccc057030 con 0x7f1cc803d040 2024-09-18T01:45:27.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.425+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564b08322c90 con 0x7f1cd00123a0 2024-09-18T01:45:27.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.425+0000 7f1cd52f7640 1 -- 172.21.15.146:0/1940911163 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cc802e070 con 0x7f1cd00123a0 2024-09-18T01:45:27.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.425+0000 7f1cd52f7640 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564b08322c90 con 0x564b08320290 2024-09-18T01:45:27.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.425+0000 7f1cd5af8640 1 -- 172.21.15.146:0/1940911163 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd0057040 con 0x564b08320290 2024-09-18T01:45:27.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.425+0000 7f1cd5af8640 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564b08322c90 con 0x7f1cc803d040 2024-09-18T01:45:27.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.425+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ccc057030 con 0x7f1cc803d040 2024-09-18T01:45:27.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.425+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564b08322c90 con 0x564b0831a0b0 2024-09-18T01:45:27.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.426+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1ccc057030 con 0x564b0831a0b0 2024-09-18T01:45:27.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.426+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564b08322c90 con 0x7f1cd00123a0 2024-09-18T01:45:27.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.426+0000 7f1cd52f7640 1 -- 172.21.15.146:0/1940911163 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cc802e070 con 0x7f1cd00123a0 2024-09-18T01:45:27.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.426+0000 7f1cd9c0e800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:27.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.426+0000 7f1cd9c0e800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:27.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.426+0000 7f1cd9c0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:27.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.426+0000 7f1cd9c0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:27.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.426+0000 7f1cd9c0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:27.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.426+0000 7f1cd9c0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:27.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.426+0000 7f1cd9c0e800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.426+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564b0831eea0 con 0x564b0831a0b0 2024-09-18T01:45:27.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.426+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ccc057030 con 0x564b0831a0b0 2024-09-18T01:45:27.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.426+0000 7f1cd9c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:27.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.426+0000 7f1cd9c0e800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.426+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564b0831f740 con 0x564b0831a0b0 2024-09-18T01:45:27.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.426+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1ccc057030 con 0x564b0831a0b0 2024-09-18T01:45:27.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.426+0000 7f1cd9c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:27.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.426+0000 7f1cd9c0e800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.426+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564b08323110 con 0x7f1cd00123a0 2024-09-18T01:45:27.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.427+0000 7f1cd52f7640 1 -- 172.21.15.146:0/1940911163 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1cc802e070 con 0x7f1cd00123a0 2024-09-18T01:45:27.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.427+0000 7f1cd9c0e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:27.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.427+0000 7f1cd9c0e800 20 zone default found 2024-09-18T01:45:27.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.427+0000 7f1cd9c0e800 4 Realm: () 2024-09-18T01:45:27.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.427+0000 7f1cd9c0e800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:27.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.427+0000 7f1cd9c0e800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:27.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.427+0000 7f1cd9c0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:27.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.427+0000 7f1cd9c0e800 20 zonegroup default 2024-09-18T01:45:27.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.427+0000 7f1cd9c0e800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.427+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564b08323960 con 0x7f1cc803d040 2024-09-18T01:45:27.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.427+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1ccc057030 con 0x7f1cc803d040 2024-09-18T01:45:27.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.427+0000 7f1cd9c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:27.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.427+0000 7f1cd9c0e800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.427+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564b08325340 con 0x564b08320290 2024-09-18T01:45:27.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.427+0000 7f1cd5af8640 1 -- 172.21.15.146:0/1940911163 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1cd0057040 con 0x564b08320290 2024-09-18T01:45:27.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.427+0000 7f1cd9c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:27.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.427+0000 7f1cd9c0e800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.427+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564b08325840 con 0x564b08320290 2024-09-18T01:45:27.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.427+0000 7f1cd5af8640 1 -- 172.21.15.146:0/1940911163 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1cd0057040 con 0x564b08320290 2024-09-18T01:45:27.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.427+0000 7f1cd9c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:27.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.427+0000 7f1cd9c0e800 20 started sync module instance, tier type = 2024-09-18T01:45:27.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.427+0000 7f1cd9c0e800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:27.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.427+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564b083247d0 con 0x7f1cd00123a0 2024-09-18T01:45:27.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.428+0000 7f1cd52f7640 1 -- 172.21.15.146:0/1940911163 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v31'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cc802e070 con 0x7f1cd00123a0 2024-09-18T01:45:27.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.428+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94880260049856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564b08326150 con 0x7f1cd00123a0 2024-09-18T01:45:27.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.428+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564b083269a0 con 0x564b0831a0b0 2024-09-18T01:45:27.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.429+0000 7f1cd52f7640 1 -- 172.21.15.146:0/1940911163 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94880260049856] v31'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cc802e070 con 0x7f1cd00123a0 2024-09-18T01:45:27.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.430+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v31'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ccc057030 con 0x564b0831a0b0 2024-09-18T01:45:27.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.430+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94880260054176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564b083269a0 con 0x564b0831a0b0 2024-09-18T01:45:27.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.430+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564b08327480 con 0x564b08320290 2024-09-18T01:45:27.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.431+0000 7f1cd5af8640 1 -- 172.21.15.146:0/1940911163 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v31'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cd0057040 con 0x564b08320290 2024-09-18T01:45:27.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.431+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94880260059024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564b08327480 con 0x564b08320290 2024-09-18T01:45:27.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.431+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564b08328460 con 0x7f1cd00123a0 2024-09-18T01:45:27.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.431+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94880260054176] v31'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ccc057030 con 0x564b0831a0b0 2024-09-18T01:45:27.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.432+0000 7f1cd5af8640 1 -- 172.21.15.146:0/1940911163 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94880260059024] v31'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cd0057040 con 0x564b08320290 2024-09-18T01:45:27.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.432+0000 7f1cd52f7640 1 -- 172.21.15.146:0/1940911163 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v31'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cc802e070 con 0x7f1cd00123a0 2024-09-18T01:45:27.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.432+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94880260061296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564b083264f0 con 0x7f1cd00123a0 2024-09-18T01:45:27.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.432+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564b08328d40 con 0x564b0831a0b0 2024-09-18T01:45:27.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.433+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v31'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ccc057030 con 0x564b0831a0b0 2024-09-18T01:45:27.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.433+0000 7f1cd52f7640 1 -- 172.21.15.146:0/1940911163 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94880260061296] v31'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cc802e070 con 0x7f1cd00123a0 2024-09-18T01:45:27.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.433+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94880260065360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564b083295e0 con 0x564b0831a0b0 2024-09-18T01:45:27.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.433+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564b08327f90 con 0x7f1cc803d040 2024-09-18T01:45:27.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.434+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v31'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ccc057030 con 0x7f1cc803d040 2024-09-18T01:45:27.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.434+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94880260065360] v31'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ccc057030 con 0x564b0831a0b0 2024-09-18T01:45:27.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.434+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94880260070352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564b08327f90 con 0x7f1cc803d040 2024-09-18T01:45:27.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.434+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564b08329130 con 0x7f1cc803d040 2024-09-18T01:45:27.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.435+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94880260070352] v31'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ccc057030 con 0x7f1cc803d040 2024-09-18T01:45:27.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.435+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v31'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ccc057030 con 0x7f1cc803d040 2024-09-18T01:45:27.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.435+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94880260067632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564b0832a610 con 0x7f1cc803d040 2024-09-18T01:45:27.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.435+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564b0832afd0 con 0x7f1cc803d040 2024-09-18T01:45:27.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.436+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94880260067632] v31'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ccc057030 con 0x7f1cc803d040 2024-09-18T01:45:27.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.436+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v31'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ccc057030 con 0x7f1cc803d040 2024-09-18T01:45:27.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.436+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94880260071408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564b0832afd0 con 0x7f1cc803d040 2024-09-18T01:45:27.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.436+0000 7f1cd9c0e800 20 add_watcher() i=0 2024-09-18T01:45:27.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.436+0000 7f1cd9c0e800 20 add_watcher() i=1 2024-09-18T01:45:27.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.436+0000 7f1cd9c0e800 20 add_watcher() i=2 2024-09-18T01:45:27.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.436+0000 7f1cd9c0e800 20 add_watcher() i=3 2024-09-18T01:45:27.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.436+0000 7f1cd9c0e800 20 add_watcher() i=4 2024-09-18T01:45:27.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.436+0000 7f1cd9c0e800 20 add_watcher() i=5 2024-09-18T01:45:27.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.436+0000 7f1cd9c0e800 20 add_watcher() i=6 2024-09-18T01:45:27.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.437+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94880260071408] v31'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ccc057030 con 0x7f1cc803d040 2024-09-18T01:45:27.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.437+0000 7f1cd9c0e800 20 add_watcher() i=7 2024-09-18T01:45:27.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.437+0000 7f1cd9c0e800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:27.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.437+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564b0832e3d0 con 0x564b0831a0b0 2024-09-18T01:45:27.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.437+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1ccc057030 con 0x564b0831a0b0 2024-09-18T01:45:27.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.437+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94880260074736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564b0832b8f0 con 0x564b0831a0b0 2024-09-18T01:45:27.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.438+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94880260074736] v31'123 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1ccc057030 con 0x564b0831a0b0 2024-09-18T01:45:27.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.438+0000 7f1b8b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:27.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.438+0000 7f1cd9c0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:27.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.438+0000 7f1cd9c0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:27.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.438+0000 7f1cd9c0e800 5 note: GC not initialized 2024-09-18T01:45:27.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.439+0000 7f1b8a7e4640 20 reqs_thread_entry: start 2024-09-18T01:45:27.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.439+0000 7f1cd9c0e800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:27.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.439+0000 7f1cd9c0e800 20 Filter name: none 2024-09-18T01:45:27.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.439+0000 7f1afbfff640 20 reqs_thread_entry: start 2024-09-18T01:45:27.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.439+0000 7f1cd9c0e800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-18T01:45:27.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.439+0000 7f1cd9c0e800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.439+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564b083617a0 con 0x7f1cc803d040 2024-09-18T01:45:27.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.439+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f1ccc057030 con 0x7f1cc803d040 2024-09-18T01:45:27.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.439+0000 7f1cd9c0e800 20 rados_obj.operate() r=0 bl.length=380 2024-09-18T01:45:27.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.439+0000 7f1cd9c0e800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-18T01:45:27.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.439+0000 7f1cd9c0e800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-18T01:45:27.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.439+0000 7f1cd9c0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:45:27.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.439+0000 7f1cd9c0e800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-18T01:45:27.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.439+0000 7f1cd9c0e800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.439+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564b08363880 con 0x7f1cd00123a0 2024-09-18T01:45:27.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.440+0000 7f1cd52f7640 1 -- 172.21.15.146:0/1940911163 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv20 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f1cc802e070 con 0x7f1cd00123a0 2024-09-18T01:45:27.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.440+0000 7f1cd9c0e800 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T01:45:27.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.440+0000 7f1cd9c0e800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-18T01:45:27.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.440+0000 7f1cd9c0e800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T01:45:27.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.440+0000 7f1cd9c0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 : miss 2024-09-18T01:45:27.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.440+0000 7f1cd9c0e800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.440+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:64 8.13 8:ceaa8859:root::.bucket.meta.myfoo%3a8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564b08365320 con 0x7f1cc803d040 2024-09-18T01:45:27.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.441+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(64 .bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f1ccc057030 con 0x7f1cc803d040 2024-09-18T01:45:27.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.441+0000 7f1cd9c0e800 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T01:45:27.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.441+0000 7f1cd9c0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 info.flags=0x17 2024-09-18T01:45:27.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.441+0000 7f1cd9c0e800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 to cache LRU end 2024-09-18T01:45:27.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.441+0000 7f1cd9c0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:45:27.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.441+0000 7f1cd9c0e800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T01:45:27.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.441+0000 7f1cd9c0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 2024-09-18T01:45:27.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.441+0000 7f1cd9c0e800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-18T01:45:27.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.441+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564b08366870 con 0x7f1cc803d040 2024-09-18T01:45:27.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.442+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(65 fud.buckets [call] v31'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f1ccc057030 con 0x7f1cc803d040 2024-09-18T01:45:27.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.442+0000 7f1cd9c0e800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-18T01:45:27.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.442+0000 7f1cd9c0e800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.442+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564b08366c70 con 0x7f1cd00123a0 2024-09-18T01:45:27.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.442+0000 7f1cd52f7640 1 -- 172.21.15.146:0/1940911163 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv20 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f1cc802e070 con 0x7f1cd00123a0 2024-09-18T01:45:27.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.442+0000 7f1cd9c0e800 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T01:45:27.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.442+0000 7f1cd9c0e800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-18T01:45:27.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.442+0000 7f1cd9c0e800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T01:45:27.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.442+0000 7f1cd9c0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:45:27.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.442+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564b0836c860 con 0x7f1cd00123a0 2024-09-18T01:45:27.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.443+0000 7f1cd52f7640 1 -- 172.21.15.146:0/1940911163 <== osd.2 v2:172.21.15.146:6800/3820039304 14 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v31'21 uv21 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f1cc802e070 con 0x7f1cd00123a0 2024-09-18T01:45:27.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.443+0000 7f1cd9c0e800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-18T01:45:27.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.443+0000 7f1cd9c0e800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T01:45:27.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.443+0000 7f1cd9c0e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-18T01:45:27.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.443+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94880260326256 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564b08369db0 con 0x7f1cc803d040 2024-09-18T01:45:27.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.443+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== watch-notify(notify (1) cookie 94880260067632 notify 133143986182 ret 0) ==== 380+0+0 (crc 0 0 0) 0x564b08365710 con 0x7f1cc803d040 2024-09-18T01:45:27.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.444+0000 7f1bb8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986182 cookie 94880260067632 notifier 4523 bl.length()=338 2024-09-18T01:45:27.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.444+0000 7f1bb8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-18T01:45:27.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.444+0000 7f1bb8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T01:45:27.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.444+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== osd_op_reply(68 notify.6 [notify cookie 94880260326256 out=8b] v0'0 uv120 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1ccc087020 con 0x7f1cc803d040 2024-09-18T01:45:27.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.444+0000 7f1bb8ff9640 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f1b98003ea0 con 0x7f1cc803d040 2024-09-18T01:45:27.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.444+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 <== osd.0 v2:172.21.15.129:6800/1759265424 22 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ccc087020 con 0x7f1cc803d040 2024-09-18T01:45:27.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.444+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 <== osd.0 v2:172.21.15.129:6800/1759265424 23 ==== watch-notify(notify_complete (2) cookie 94880260326256 notify 133143986182 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564b08364840 con 0x7f1cc803d040 2024-09-18T01:45:27.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.445+0000 7f1b8b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:27.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.445+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94880260074736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564b0835f510 con 0x564b0831a0b0 2024-09-18T01:45:27.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.446+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94880260074736] v31'124 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1ccc087020 con 0x564b0831a0b0 2024-09-18T01:45:27.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.446+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94880260049856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564b0835f510 con 0x7f1cd00123a0 2024-09-18T01:45:27.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.446+0000 7f1cd52f7640 1 -- 172.21.15.146:0/1940911163 <== osd.2 v2:172.21.15.146:6800/3820039304 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94880260049856] v31'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cc802e070 con 0x7f1cd00123a0 2024-09-18T01:45:27.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.447+0000 7f1cd9c0e800 20 remove_watcher() i=0 2024-09-18T01:45:27.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.447+0000 7f1cd9c0e800 2 removed watcher, disabling cache 2024-09-18T01:45:27.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.447+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94880260054176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564b0835f510 con 0x564b0831a0b0 2024-09-18T01:45:27.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.448+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94880260054176] v31'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ccc087020 con 0x564b0831a0b0 2024-09-18T01:45:27.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.448+0000 7f1cd9c0e800 20 remove_watcher() i=1 2024-09-18T01:45:27.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.448+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94880260059024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564b0835f510 con 0x564b08320290 2024-09-18T01:45:27.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.449+0000 7f1cd5af8640 1 -- 172.21.15.146:0/1940911163 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94880260059024] v31'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cd0057040 con 0x564b08320290 2024-09-18T01:45:27.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.449+0000 7f1cd9c0e800 20 remove_watcher() i=2 2024-09-18T01:45:27.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.449+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94880260061296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564b0835f510 con 0x7f1cd00123a0 2024-09-18T01:45:27.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.450+0000 7f1cd52f7640 1 -- 172.21.15.146:0/1940911163 <== osd.2 v2:172.21.15.146:6800/3820039304 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94880260061296] v31'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cc802e070 con 0x7f1cd00123a0 2024-09-18T01:45:27.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.450+0000 7f1cd9c0e800 20 remove_watcher() i=3 2024-09-18T01:45:27.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.450+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94880260065360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564b0835f510 con 0x564b0831a0b0 2024-09-18T01:45:27.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.451+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94880260065360] v31'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ccc087020 con 0x564b0831a0b0 2024-09-18T01:45:27.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.451+0000 7f1cd9c0e800 20 remove_watcher() i=4 2024-09-18T01:45:27.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.451+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94880260070352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564b0835f510 con 0x7f1cc803d040 2024-09-18T01:45:27.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.452+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 <== osd.0 v2:172.21.15.129:6800/1759265424 24 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94880260070352] v31'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ccc087020 con 0x7f1cc803d040 2024-09-18T01:45:27.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.452+0000 7f1cd9c0e800 20 remove_watcher() i=5 2024-09-18T01:45:27.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.452+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94880260067632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564b0835f510 con 0x7f1cc803d040 2024-09-18T01:45:27.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.453+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 <== osd.0 v2:172.21.15.129:6800/1759265424 25 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94880260067632] v31'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ccc087020 con 0x7f1cc803d040 2024-09-18T01:45:27.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.453+0000 7f1cd9c0e800 20 remove_watcher() i=6 2024-09-18T01:45:27.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.453+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94880260071408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564b0835f510 con 0x7f1cc803d040 2024-09-18T01:45:27.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.454+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 <== osd.0 v2:172.21.15.129:6800/1759265424 26 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94880260071408] v31'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ccc087020 con 0x7f1cc803d040 2024-09-18T01:45:27.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.454+0000 7f1cd9c0e800 20 remove_watcher() i=7 2024-09-18T01:45:27.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.454+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f1cc803d040 msgr2=0x7f1cc801d5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.454+0000 7f1cd9c0e800 1 --2- 172.21.15.146:0/1940911163 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f1cc803d040 0x7f1cc801d5f0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.454+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564b0831a0b0 msgr2=0x564b0831c570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.454+0000 7f1cd9c0e800 1 --2- 172.21.15.146:0/1940911163 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564b0831a0b0 0x564b0831c570 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.454+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f1cd00123a0 msgr2=0x7f1cd0036580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.454+0000 7f1cd9c0e800 1 --2- 172.21.15.146:0/1940911163 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f1cd00123a0 0x7f1cd0036580 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.454+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x564b08320290 msgr2=0x564b08322680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.454+0000 7f1cd9c0e800 1 --2- 172.21.15.146:0/1940911163 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x564b08320290 0x564b08322680 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.454+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1ba0036b90 msgr2=0x7f1ba0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.454+0000 7f1cd9c0e800 1 --2- 172.21.15.146:0/1940911163 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1ba0036b90 0x7f1ba0039050 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x564b082e6610 tx=0x7f1cc8046000 comp rx=0 tx=0).stop 2024-09-18T01:45:27.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.454+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b08306eb0 msgr2=0x564b0830e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.454+0000 7f1cd9c0e800 1 --2- 172.21.15.146:0/1940911163 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b08306eb0 0x564b0830e390 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f1cd004b7b0 tx=0x7f1cd004c820 comp rx=0 tx=0).stop 2024-09-18T01:45:27.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.454+0000 7f1cd4af6640 1 -- 172.21.15.146:0/1940911163 reap_dead start 2024-09-18T01:45:27.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.454+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 shutdown_connections 2024-09-18T01:45:27.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.454+0000 7f1cd9c0e800 1 --2- 172.21.15.146:0/1940911163 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b08306eb0 0x564b0830e390 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.454+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 >> 172.21.15.146:0/1940911163 conn(0x564b08303210 msgr2=0x564b083012e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:27.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.454+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 shutdown_connections 2024-09-18T01:45:27.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.454+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1940911163 wait complete. 2024-09-18T01:45:27.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.455+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/3242766176 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1bac036b90 msgr2=0x7f1bac039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.455+0000 7f1cd9c0e800 1 --2- 172.21.15.146:0/3242766176 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1bac036b90 0x7f1bac039050 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1cc801cfd0 tx=0x7f1cc804b760 comp rx=0 tx=0).stop 2024-09-18T01:45:27.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.455+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/3242766176 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b0815c740 msgr2=0x564b0815ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.455+0000 7f1cd9c0e800 1 --2- 172.21.15.146:0/3242766176 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b0815c740 0x564b0815ad90 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x564b082dded0 tx=0x7f1cd00178e0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.455+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/3242766176 shutdown_connections 2024-09-18T01:45:27.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.455+0000 7f1cd9c0e800 1 --2- 172.21.15.146:0/3242766176 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1bac036b90 0x7f1bac039050 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.455+0000 7f1cd9c0e800 1 --2- 172.21.15.146:0/3242766176 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b0815c740 0x564b0815ad90 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.455+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/3242766176 >> 172.21.15.146:0/3242766176 conn(0x564b082ecf80 msgr2=0x564b082efb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:27.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.455+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/3242766176 shutdown_connections 2024-09-18T01:45:27.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.455+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/3242766176 wait complete. 2024-09-18T01:45:27.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.455+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1015265997 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564b081eaa10 msgr2=0x564b082e42f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.455+0000 7f1cd9c0e800 1 --2- 172.21.15.146:0/1015265997 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564b081eaa10 0x564b082e42f0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.455+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1015265997 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x564b082e7a60 msgr2=0x564b082e9e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.455+0000 7f1cd9c0e800 1 --2- 172.21.15.146:0/1015265997 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x564b082e7a60 0x564b082e9e50 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.455+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1015265997 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1bbc036af0 msgr2=0x7f1bbc038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.455+0000 7f1cd9c0e800 1 --2- 172.21.15.146:0/1015265997 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1bbc036af0 0x7f1bbc038fb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc057000 tx=0x7f1ccc052000 comp rx=0 tx=0).stop 2024-09-18T01:45:27.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.455+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1015265997 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b081e6710 msgr2=0x564b082dd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.455+0000 7f1cd9c0e800 1 --2- 172.21.15.146:0/1015265997 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b081e6710 0x564b082dd280 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f1cc8000f60 tx=0x7f1cc8000bc0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.455+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1015265997 shutdown_connections 2024-09-18T01:45:27.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.455+0000 7f1cd9c0e800 1 --2- 172.21.15.146:0/1015265997 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x564b082e7a60 0x564b082e9e50 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.455+0000 7f1cd9c0e800 1 --2- 172.21.15.146:0/1015265997 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564b081eaa10 0x564b082e42f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.455+0000 7f1cd9c0e800 1 --2- 172.21.15.146:0/1015265997 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1bbc036af0 0x7f1bbc038fb0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.455+0000 7f1cd9c0e800 1 --2- 172.21.15.146:0/1015265997 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b081e6710 0x564b082dd280 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.455+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1015265997 >> 172.21.15.146:0/1015265997 conn(0x564b081e1fe0 msgr2=0x564b082cfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:27.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.455+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1015265997 shutdown_connections 2024-09-18T01:45:27.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.455+0000 7f1cd9c0e800 1 -- 172.21.15.146:0/1015265997 wait complete. 2024-09-18T01:45:27.468 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1'] 2024-09-18T01:45:27.469 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1'] 2024-09-18T01:45:27.469 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid foo --bucket myfoo --bucket-id 8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 2024-09-18T01:45:27.517 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:27.517 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:27.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.517+0000 7f790bf35800 1 Processor -- start 2024-09-18T01:45:27.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.518+0000 7f790bf35800 1 -- start start 2024-09-18T01:45:27.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.518+0000 7f790bf35800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x556de9467570 0x556de9467970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.518+0000 7f790bf35800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556de9327b30 con 0x556de9467eb0 2024-09-18T01:45:27.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.518+0000 7f790bf35800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x556de9309360 con 0x556de9467570 2024-09-18T01:45:27.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.518+0000 7f7907c2b640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x556de9467570 0x556de9467970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.518+0000 7f78fffff640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x556de9467eb0 0x556de946ca30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:47306/0 (socket says 172.21.15.146:47306) 2024-09-18T01:45:27.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.518+0000 7f7907c2b640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x556de9467570 0x556de9467970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:57662/0 (socket says 172.21.15.146:57662) 2024-09-18T01:45:27.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.518+0000 7f78fffff640 1 -- 172.21.15.146:0/3798193097 learned_addr learned my addr 172.21.15.146:0/3798193097 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:45:27.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.518+0000 7f790742a640 1 -- 172.21.15.146:0/3798193097 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 76974417 0 0) 0x556de9327b30 con 0x556de9467eb0 2024-09-18T01:45:27.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.518+0000 7f790742a640 1 -- 172.21.15.146:0/3798193097 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78f4001e10 con 0x556de9467eb0 2024-09-18T01:45:27.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.518+0000 7f7907c2b640 1 -- 172.21.15.146:0/3798193097 >> v1:172.21.15.129:6789/0 conn(0x556de9467eb0 legacy=0x556de946ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.518+0000 7f7907c2b640 1 -- 172.21.15.146:0/3798193097 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556de932fe00 con 0x556de9467570 2024-09-18T01:45:27.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.520+0000 7f7907c2b640 1 --2- 172.21.15.146:0/3798193097 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556de9467570 0x556de9467970 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f78f800a470 tx=0x7f78f8045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c40a65307ccc6b19 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.520+0000 7f790742a640 1 -- 172.21.15.146:0/3798193097 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78f8059070 con 0x556de9467570 2024-09-18T01:45:27.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.520+0000 7f790742a640 1 -- 172.21.15.146:0/3798193097 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78f8054570 con 0x556de9467570 2024-09-18T01:45:27.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.520+0000 7f790742a640 1 -- 172.21.15.146:0/3798193097 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78f8054850 con 0x556de9467570 2024-09-18T01:45:27.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.521+0000 7f790bf35800 1 -- 172.21.15.146:0/3798193097 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556de9467570 msgr2=0x556de9467970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.521+0000 7f790bf35800 1 --2- 172.21.15.146:0/3798193097 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556de9467570 0x556de9467970 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f78f800a470 tx=0x7f78f8045920 comp rx=0 tx=0).stop 2024-09-18T01:45:27.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.521+0000 7f790bf35800 1 -- 172.21.15.146:0/3798193097 shutdown_connections 2024-09-18T01:45:27.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.521+0000 7f790bf35800 1 --2- 172.21.15.146:0/3798193097 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556de9467570 0x556de9467970 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.521+0000 7f790bf35800 1 -- 172.21.15.146:0/3798193097 >> 172.21.15.146:0/3798193097 conn(0x556de9462e00 msgr2=0x556de9465220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:27.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.521+0000 7f790bf35800 1 -- 172.21.15.146:0/3798193097 shutdown_connections 2024-09-18T01:45:27.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.521+0000 7f790bf35800 1 -- 172.21.15.146:0/3798193097 wait complete. 2024-09-18T01:45:27.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.534+0000 7f790bf35800 1 Processor -- start 2024-09-18T01:45:27.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.535+0000 7f790bf35800 1 -- start start 2024-09-18T01:45:27.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.535+0000 7f790bf35800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556de9467570 0x556de9556680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.535+0000 7f790bf35800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x556de93b4350 con 0x556de9467570 2024-09-18T01:45:27.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.535+0000 7f7907c2b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556de9467570 0x556de9556680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.535+0000 7f7907c2b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556de9467570 0x556de9556680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:57674/0 (socket says 172.21.15.146:57674) 2024-09-18T01:45:27.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.535+0000 7f7907c2b640 1 -- 172.21.15.146:0/4269025599 learned_addr learned my addr 172.21.15.146:0/4269025599 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:27.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.535+0000 7f7907c2b640 1 -- 172.21.15.146:0/4269025599 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556de9301bc0 con 0x556de9467570 2024-09-18T01:45:27.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.535+0000 7f7907c2b640 1 --2- 172.21.15.146:0/4269025599 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556de9467570 0x556de9556680 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f78f8025b20 tx=0x7f78f804e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6d092757340355c server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.536+0000 7f77f5e0b640 1 -- 172.21.15.146:0/4269025599 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78f8062070 con 0x556de9467570 2024-09-18T01:45:27.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.536+0000 7f77f5e0b640 1 -- 172.21.15.146:0/4269025599 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78f800a230 con 0x556de9467570 2024-09-18T01:45:27.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.536+0000 7f77f5e0b640 1 -- 172.21.15.146:0/4269025599 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78f8059040 con 0x556de9467570 2024-09-18T01:45:27.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.536+0000 7f790bf35800 1 -- 172.21.15.146:0/4269025599 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556de9467570 msgr2=0x556de9556680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.536+0000 7f790bf35800 1 --2- 172.21.15.146:0/4269025599 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556de9467570 0x556de9556680 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f78f8025b20 tx=0x7f78f804e000 comp rx=0 tx=0).stop 2024-09-18T01:45:27.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.536+0000 7f790bf35800 1 -- 172.21.15.146:0/4269025599 shutdown_connections 2024-09-18T01:45:27.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.536+0000 7f790bf35800 1 --2- 172.21.15.146:0/4269025599 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556de9467570 0x556de9556680 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.536+0000 7f790bf35800 1 -- 172.21.15.146:0/4269025599 >> 172.21.15.146:0/4269025599 conn(0x556de9462e00 msgr2=0x556de9552040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:27.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.536+0000 7f790bf35800 1 -- 172.21.15.146:0/4269025599 shutdown_connections 2024-09-18T01:45:27.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.537+0000 7f790bf35800 1 -- 172.21.15.146:0/4269025599 wait complete. 2024-09-18T01:45:27.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.537+0000 7f790bf35800 1 Processor -- start 2024-09-18T01:45:27.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.537+0000 7f790bf35800 1 -- start start 2024-09-18T01:45:27.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.537+0000 7f790bf35800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556de9467570 0x556de955e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.537+0000 7f790bf35800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x556de946e590 con 0x556de9467570 2024-09-18T01:45:27.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.537+0000 7f7907c2b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556de9467570 0x556de955e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.537+0000 7f7907c2b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556de9467570 0x556de955e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:57688/0 (socket says 172.21.15.146:57688) 2024-09-18T01:45:27.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.537+0000 7f7907c2b640 1 -- 172.21.15.146:0/4084519192 learned_addr learned my addr 172.21.15.146:0/4084519192 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:27.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.538+0000 7f7907c2b640 1 -- 172.21.15.146:0/4084519192 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556de9315fe0 con 0x556de9467570 2024-09-18T01:45:27.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.538+0000 7f7907c2b640 1 --2- 172.21.15.146:0/4084519192 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556de9467570 0x556de955e040 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f78f8045960 tx=0x7f78f8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.538+0000 7f77effff640 1 -- 172.21.15.146:0/4084519192 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78f8062070 con 0x556de9467570 2024-09-18T01:45:27.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.538+0000 7f77effff640 1 -- 172.21.15.146:0/4084519192 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78f8054910 con 0x556de9467570 2024-09-18T01:45:27.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.538+0000 7f790bf35800 1 -- 172.21.15.146:0/4084519192 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556de955e580 con 0x556de9467570 2024-09-18T01:45:27.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.538+0000 7f77effff640 1 -- 172.21.15.146:0/4084519192 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78f8059040 con 0x556de9467570 2024-09-18T01:45:27.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.538+0000 7f790bf35800 1 -- 172.21.15.146:0/4084519192 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556de955eaa0 con 0x556de9467570 2024-09-18T01:45:27.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.539+0000 7f77effff640 1 -- 172.21.15.146:0/4084519192 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f78f8065040 con 0x556de9467570 2024-09-18T01:45:27.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.539+0000 7f77effff640 1 --2- 172.21.15.146:0/4084519192 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f77f0036b40 0x7f77f0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.539+0000 7f77effff640 1 -- 172.21.15.146:0/4084519192 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f78f808fab0 con 0x556de9467570 2024-09-18T01:45:27.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.539+0000 7f78fffff640 1 --2- 172.21.15.146:0/4084519192 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f77f0036b40 0x7f77f0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.539+0000 7f790bf35800 1 --2- 172.21.15.146:0/4084519192 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x556de9467eb0 0x556de95650b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.539+0000 7f790bf35800 1 -- 172.21.15.146:0/4084519192 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556de95655f0 con 0x556de9467eb0 2024-09-18T01:45:27.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.539+0000 7f790842c640 1 --2- 172.21.15.146:0/4084519192 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x556de9467eb0 0x556de95650b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.539+0000 7f78fffff640 1 --2- 172.21.15.146:0/4084519192 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f77f0036b40 0x7f77f0039000 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f78f0000f60 tx=0x7f78f00010a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.540+0000 7f790842c640 1 --2- 172.21.15.146:0/4084519192 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x556de9467eb0 0x556de95650b0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.540+0000 7f790842c640 1 -- 172.21.15.146:0/4084519192 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f790000a4a0 con 0x556de9467eb0 2024-09-18T01:45:27.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.540+0000 7f790bf35800 1 -- 172.21.15.146:0/4084519192 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556de9562660 con 0x556de9467eb0 2024-09-18T01:45:27.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.540+0000 7f790842c640 1 -- 172.21.15.146:0/4084519192 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f790000a4a0 con 0x556de9467eb0 2024-09-18T01:45:27.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.540+0000 7f790bf35800 1 -- 172.21.15.146:0/4084519192 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556de95673f0 con 0x556de9467eb0 2024-09-18T01:45:27.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.540+0000 7f790842c640 1 -- 172.21.15.146:0/4084519192 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f790000a4a0 con 0x556de9467eb0 2024-09-18T01:45:27.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.540+0000 7f790bf35800 1 -- 172.21.15.146:0/4084519192 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556de9566530 con 0x556de9467eb0 2024-09-18T01:45:27.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.541+0000 7f790842c640 1 -- 172.21.15.146:0/4084519192 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f790000a4a0 con 0x556de9467eb0 2024-09-18T01:45:27.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.541+0000 7f790bf35800 1 --2- 172.21.15.146:0/4084519192 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x556de9566fd0 0x556de956a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.541+0000 7f790bf35800 1 -- 172.21.15.146:0/4084519192 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556de956afc0 con 0x556de9566fd0 2024-09-18T01:45:27.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.541+0000 7f7907c2b640 1 --2- 172.21.15.146:0/4084519192 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x556de9566fd0 0x556de956a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.541+0000 7f7907c2b640 1 --2- 172.21.15.146:0/4084519192 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x556de9566fd0 0x556de956a830 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.541+0000 7f7907c2b640 1 -- 172.21.15.146:0/4084519192 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f78f805c040 con 0x556de9566fd0 2024-09-18T01:45:27.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.542+0000 7f790bf35800 1 Processor -- start 2024-09-18T01:45:27.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.542+0000 7f790bf35800 1 -- start start 2024-09-18T01:45:27.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.542+0000 7f790bf35800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556de93dc680 0x556de957cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.542+0000 7f790bf35800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x556de9303580 con 0x556de93dc680 2024-09-18T01:45:27.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.542+0000 7f790842c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556de93dc680 0x556de957cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.542+0000 7f790842c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556de93dc680 0x556de957cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:57698/0 (socket says 172.21.15.146:57698) 2024-09-18T01:45:27.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.542+0000 7f790842c640 1 -- 172.21.15.146:0/81849645 learned_addr learned my addr 172.21.15.146:0/81849645 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:27.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.542+0000 7f790842c640 1 -- 172.21.15.146:0/81849645 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556de957d060 con 0x556de93dc680 2024-09-18T01:45:27.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.543+0000 7f790842c640 1 --2- 172.21.15.146:0/81849645 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556de93dc680 0x556de957cb20 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x556de95659d0 tx=0x7f79000178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.543+0000 7f77ed7fa640 1 -- 172.21.15.146:0/81849645 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7900013440 con 0x556de93dc680 2024-09-18T01:45:27.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.543+0000 7f77ed7fa640 1 -- 172.21.15.146:0/81849645 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79000135e0 con 0x556de93dc680 2024-09-18T01:45:27.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.543+0000 7f790bf35800 1 -- 172.21.15.146:0/81849645 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556de957d230 con 0x556de93dc680 2024-09-18T01:45:27.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.543+0000 7f77ed7fa640 1 -- 172.21.15.146:0/81849645 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79000138c0 con 0x556de93dc680 2024-09-18T01:45:27.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.543+0000 7f790bf35800 1 -- 172.21.15.146:0/81849645 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556de957d730 con 0x556de93dc680 2024-09-18T01:45:27.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.543+0000 7f77ed7fa640 1 -- 172.21.15.146:0/81849645 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7900011040 con 0x556de93dc680 2024-09-18T01:45:27.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.544+0000 7f77ed7fa640 1 --2- 172.21.15.146:0/81849645 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f77e0036b90 0x7f77e0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.544+0000 7f77ed7fa640 1 -- 172.21.15.146:0/81849645 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f790001d070 con 0x556de93dc680 2024-09-18T01:45:27.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.544+0000 7f7907c2b640 1 --2- 172.21.15.146:0/81849645 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f77e0036b90 0x7f77e0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.544+0000 7f790bf35800 1 Processor -- start 2024-09-18T01:45:27.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.544+0000 7f790bf35800 1 -- start start 2024-09-18T01:45:27.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.544+0000 7f7907c2b640 1 --2- 172.21.15.146:0/81849645 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f77e0036b90 0x7f77e0039050 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x556de95668d0 tx=0x7f78f8056ee0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.544+0000 7f790bf35800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556de9579d50 0x556de957a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.544+0000 7f790bf35800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x556de9556d70 con 0x556de9579d50 2024-09-18T01:45:27.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.544+0000 7f790842c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556de9579d50 0x556de957a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.544+0000 7f790842c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556de9579d50 0x556de957a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:57704/0 (socket says 172.21.15.146:57704) 2024-09-18T01:45:27.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.544+0000 7f790842c640 1 -- 172.21.15.146:0/150572002 learned_addr learned my addr 172.21.15.146:0/150572002 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:27.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.545+0000 7f790842c640 1 -- 172.21.15.146:0/150572002 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556de957a720 con 0x556de9579d50 2024-09-18T01:45:27.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.545+0000 7f790842c640 1 --2- 172.21.15.146:0/150572002 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556de9579d50 0x556de957a150 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f790004c860 tx=0x7f790004cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89000b6a9fdd245b server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.545+0000 7f77e6ffd640 1 -- 172.21.15.146:0/150572002 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7900012c90 con 0x556de9579d50 2024-09-18T01:45:27.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.545+0000 7f77e6ffd640 1 -- 172.21.15.146:0/150572002 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7900012e30 con 0x556de9579d50 2024-09-18T01:45:27.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.545+0000 7f77e6ffd640 1 -- 172.21.15.146:0/150572002 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79000124d0 con 0x556de9579d50 2024-09-18T01:45:27.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.545+0000 7f790bf35800 1 -- 172.21.15.146:0/150572002 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556de9579d50 msgr2=0x556de957a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.545+0000 7f790bf35800 1 --2- 172.21.15.146:0/150572002 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556de9579d50 0x556de957a150 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f790004c860 tx=0x7f790004cb10 comp rx=0 tx=0).stop 2024-09-18T01:45:27.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.545+0000 7f790bf35800 1 -- 172.21.15.146:0/150572002 shutdown_connections 2024-09-18T01:45:27.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.545+0000 7f790bf35800 1 --2- 172.21.15.146:0/150572002 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556de9579d50 0x556de957a150 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.545+0000 7f790bf35800 1 -- 172.21.15.146:0/150572002 >> 172.21.15.146:0/150572002 conn(0x556de9582e60 msgr2=0x556de9580f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:27.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.545+0000 7f790bf35800 1 -- 172.21.15.146:0/150572002 shutdown_connections 2024-09-18T01:45:27.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.545+0000 7f790bf35800 1 -- 172.21.15.146:0/150572002 wait complete. 2024-09-18T01:45:27.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.546+0000 7f790bf35800 1 Processor -- start 2024-09-18T01:45:27.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.546+0000 7f790bf35800 1 -- start start 2024-09-18T01:45:27.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.546+0000 7f790bf35800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556de9579d50 0x556de9590160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.546+0000 7f790bf35800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x556de9578a80 con 0x556de9579d50 2024-09-18T01:45:27.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.546+0000 7f790842c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556de9579d50 0x556de9590160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.546+0000 7f790842c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556de9579d50 0x556de9590160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:57720/0 (socket says 172.21.15.146:57720) 2024-09-18T01:45:27.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.546+0000 7f790842c640 1 -- 172.21.15.146:0/1312510941 learned_addr learned my addr 172.21.15.146:0/1312510941 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:27.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.546+0000 7f790842c640 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556de95906a0 con 0x556de9579d50 2024-09-18T01:45:27.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.546+0000 7f790842c640 1 --2- 172.21.15.146:0/1312510941 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556de9579d50 0x556de9590160 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f7900015fd0 tx=0x7f790004c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.546+0000 7f77e57fa640 1 -- 172.21.15.146:0/1312510941 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7900012c90 con 0x556de9579d50 2024-09-18T01:45:27.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.546+0000 7f77e57fa640 1 -- 172.21.15.146:0/1312510941 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7900001520 con 0x556de9579d50 2024-09-18T01:45:27.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.546+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556de9590930 con 0x556de9579d50 2024-09-18T01:45:27.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.546+0000 7f77e57fa640 1 -- 172.21.15.146:0/1312510941 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7900001c30 con 0x556de9579d50 2024-09-18T01:45:27.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.547+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556de95935e0 con 0x556de9579d50 2024-09-18T01:45:27.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.547+0000 7f77e57fa640 1 -- 172.21.15.146:0/1312510941 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7900013b90 con 0x556de9579d50 2024-09-18T01:45:27.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.547+0000 7f77e57fa640 1 --2- 172.21.15.146:0/1312510941 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f77d0036b90 0x7f77d0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.547+0000 7f77e57fa640 1 -- 172.21.15.146:0/1312510941 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f790000e040 con 0x556de9579d50 2024-09-18T01:45:27.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.547+0000 7f7907c2b640 1 --2- 172.21.15.146:0/1312510941 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f77d0036b90 0x7f77d0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.548+0000 7f7907c2b640 1 --2- 172.21.15.146:0/1312510941 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f77d0036b90 0x7f77d0039050 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f78f808dda0 tx=0x7f78f8082000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.548+0000 7f790bf35800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.548+0000 7f790bf35800 1 --2- 172.21.15.146:0/1312510941 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x556de959bdd0 0x556de959e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.548+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556de959e9e0 con 0x556de959bdd0 2024-09-18T01:45:27.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.548+0000 7f78fffff640 1 --2- 172.21.15.146:0/1312510941 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x556de959bdd0 0x556de959e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.548+0000 7f78fffff640 1 --2- 172.21.15.146:0/1312510941 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x556de959bdd0 0x556de959e290 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.549+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f78f0009050 con 0x556de959bdd0 2024-09-18T01:45:27.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.549+0000 7f790bf35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:27.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.549+0000 7f790bf35800 20 realm 2024-09-18T01:45:27.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.549+0000 7f790bf35800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.549+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556de959b220 con 0x556de959bdd0 2024-09-18T01:45:27.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.549+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f78f0009050 con 0x556de959bdd0 2024-09-18T01:45:27.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.549+0000 7f790bf35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:27.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.549+0000 7f790bf35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:27.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.549+0000 7f790bf35800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.549+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556de959f4d0 con 0x556de959bdd0 2024-09-18T01:45:27.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.549+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f78f0009050 con 0x556de959bdd0 2024-09-18T01:45:27.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.549+0000 7f790bf35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:27.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.549+0000 7f790bf35800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.549+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556de959fda0 con 0x556de959bdd0 2024-09-18T01:45:27.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.549+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f78f0009050 con 0x556de959bdd0 2024-09-18T01:45:27.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.549+0000 7f790bf35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:27.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.549+0000 7f790bf35800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.549+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556de95a0140 con 0x556de959bdd0 2024-09-18T01:45:27.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.550+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f78f0009050 con 0x556de959bdd0 2024-09-18T01:45:27.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.550+0000 7f790bf35800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:27.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.550+0000 7f790bf35800 20 searching for the correct realm 2024-09-18T01:45:27.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.550+0000 7f790bf35800 1 --2- 172.21.15.146:0/1312510941 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x556de95a2020 0x556de95a4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.550+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556de95a4b40 con 0x556de95a2020 2024-09-18T01:45:27.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.550+0000 7f790842c640 1 --2- 172.21.15.146:0/1312510941 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x556de95a2020 0x556de95a4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.550+0000 7f790842c640 1 --2- 172.21.15.146:0/1312510941 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x556de95a2020 0x556de95a4470 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.550+0000 7f790842c640 1 -- 172.21.15.146:0/1312510941 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7900035070 con 0x556de95a2020 2024-09-18T01:45:27.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.550+0000 7f790842c640 1 --2- 172.21.15.146:0/1312510941 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f79000300d0 0x7f7900022880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.550+0000 7f790842c640 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556de95a4b40 con 0x7f79000300d0 2024-09-18T01:45:27.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.550+0000 7f7907c2b640 1 --2- 172.21.15.146:0/1312510941 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f79000300d0 0x7f7900022880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.551+0000 7f7907c2b640 1 --2- 172.21.15.146:0/1312510941 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f79000300d0 0x7f7900022880 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.551+0000 7f7907c2b640 1 -- 172.21.15.146:0/1312510941 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78f805c040 con 0x7f79000300d0 2024-09-18T01:45:27.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.551+0000 7f7907c2b640 1 --2- 172.21.15.146:0/1312510941 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f78f80665d0 0x7f78f808f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.551+0000 7f7907c2b640 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556de95a4b40 con 0x7f78f80665d0 2024-09-18T01:45:27.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.551+0000 7f78fffff640 1 --2- 172.21.15.146:0/1312510941 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f78f80665d0 0x7f78f808f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.552+0000 7f78fffff640 1 --2- 172.21.15.146:0/1312510941 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f78f80665d0 0x7f78f808f220 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.552+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78f0009050 con 0x7f78f80665d0 2024-09-18T01:45:27.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.552+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556de95a4b40 con 0x556de959bdd0 2024-09-18T01:45:27.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.552+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f78f0009050 con 0x556de959bdd0 2024-09-18T01:45:27.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.552+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556de95a4b40 con 0x556de959bdd0 2024-09-18T01:45:27.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.552+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78f002a040 con 0x556de959bdd0 2024-09-18T01:45:27.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.552+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556de95a4b40 con 0x7f78f80665d0 2024-09-18T01:45:27.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.553+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78f002a040 con 0x7f78f80665d0 2024-09-18T01:45:27.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.553+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556de95a4b40 con 0x7f78f80665d0 2024-09-18T01:45:27.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.553+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78f002a040 con 0x7f78f80665d0 2024-09-18T01:45:27.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.553+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556de95a4b40 con 0x7f79000300d0 2024-09-18T01:45:27.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.553+0000 7f7907c2b640 1 -- 172.21.15.146:0/1312510941 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78f805c040 con 0x7f79000300d0 2024-09-18T01:45:27.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.553+0000 7f7907c2b640 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556de95a4b40 con 0x556de95a2020 2024-09-18T01:45:27.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.553+0000 7f790842c640 1 -- 172.21.15.146:0/1312510941 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7900035070 con 0x556de95a2020 2024-09-18T01:45:27.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.553+0000 7f790842c640 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556de95a4b40 con 0x556de959bdd0 2024-09-18T01:45:27.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.553+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78f002a040 con 0x556de959bdd0 2024-09-18T01:45:27.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.553+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556de95a4b40 con 0x7f78f80665d0 2024-09-18T01:45:27.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.554+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78f002a040 con 0x7f78f80665d0 2024-09-18T01:45:27.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.554+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556de95a4b40 con 0x556de959bdd0 2024-09-18T01:45:27.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.554+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78f002a040 con 0x556de959bdd0 2024-09-18T01:45:27.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.554+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556de95a4b40 con 0x7f79000300d0 2024-09-18T01:45:27.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.554+0000 7f7907c2b640 1 -- 172.21.15.146:0/1312510941 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f78f805c040 con 0x7f79000300d0 2024-09-18T01:45:27.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.554+0000 7f7907c2b640 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556de95a4b40 con 0x556de95a2020 2024-09-18T01:45:27.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.554+0000 7f790842c640 1 -- 172.21.15.146:0/1312510941 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f790005e040 con 0x556de95a2020 2024-09-18T01:45:27.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.554+0000 7f790842c640 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556de95a4b40 con 0x556de95a2020 2024-09-18T01:45:27.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.555+0000 7f790842c640 1 -- 172.21.15.146:0/1312510941 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f790005e040 con 0x556de95a2020 2024-09-18T01:45:27.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.555+0000 7f790842c640 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556de95a4b40 con 0x7f78f80665d0 2024-09-18T01:45:27.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.555+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78f002a040 con 0x7f78f80665d0 2024-09-18T01:45:27.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.555+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556de95a4b40 con 0x556de95a2020 2024-09-18T01:45:27.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.555+0000 7f790842c640 1 -- 172.21.15.146:0/1312510941 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f790005e040 con 0x556de95a2020 2024-09-18T01:45:27.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.555+0000 7f790842c640 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556de95a4b40 con 0x556de95a2020 2024-09-18T01:45:27.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.555+0000 7f790842c640 1 -- 172.21.15.146:0/1312510941 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f790005e040 con 0x556de95a2020 2024-09-18T01:45:27.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.555+0000 7f790842c640 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556de95a4b40 con 0x556de959bdd0 2024-09-18T01:45:27.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.556+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78f002a040 con 0x556de959bdd0 2024-09-18T01:45:27.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.556+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556de95a4b40 con 0x556de959bdd0 2024-09-18T01:45:27.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.556+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f78f002a040 con 0x556de959bdd0 2024-09-18T01:45:27.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.556+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556de95a4b40 con 0x7f78f80665d0 2024-09-18T01:45:27.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.556+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78f002a040 con 0x7f78f80665d0 2024-09-18T01:45:27.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.556+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556de95a4b40 con 0x556de95a2020 2024-09-18T01:45:27.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.556+0000 7f790842c640 1 -- 172.21.15.146:0/1312510941 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f790005e040 con 0x556de95a2020 2024-09-18T01:45:27.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.556+0000 7f790842c640 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556de95a4b40 con 0x7f79000300d0 2024-09-18T01:45:27.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.557+0000 7f7907c2b640 1 -- 172.21.15.146:0/1312510941 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78f805c040 con 0x7f79000300d0 2024-09-18T01:45:27.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.557+0000 7f7907c2b640 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556de95a4b40 con 0x556de959bdd0 2024-09-18T01:45:27.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.557+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78f002a040 con 0x556de959bdd0 2024-09-18T01:45:27.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.557+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556de95a4b40 con 0x7f78f80665d0 2024-09-18T01:45:27.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.557+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78f002a040 con 0x7f78f80665d0 2024-09-18T01:45:27.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.557+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556de95a4b40 con 0x556de95a2020 2024-09-18T01:45:27.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.557+0000 7f790842c640 1 -- 172.21.15.146:0/1312510941 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f790005e040 con 0x556de95a2020 2024-09-18T01:45:27.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.557+0000 7f790842c640 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556de95a4b40 con 0x7f78f80665d0 2024-09-18T01:45:27.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.558+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78f002a040 con 0x7f78f80665d0 2024-09-18T01:45:27.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.558+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556de95a4b40 con 0x7f79000300d0 2024-09-18T01:45:27.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.558+0000 7f7907c2b640 1 -- 172.21.15.146:0/1312510941 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78f805c040 con 0x7f79000300d0 2024-09-18T01:45:27.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.558+0000 7f7907c2b640 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556de95a4b40 con 0x556de95a2020 2024-09-18T01:45:27.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.558+0000 7f790842c640 1 -- 172.21.15.146:0/1312510941 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f790005e040 con 0x556de95a2020 2024-09-18T01:45:27.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.558+0000 7f790842c640 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556de95a4b40 con 0x7f78f80665d0 2024-09-18T01:45:27.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.558+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78f002a040 con 0x7f78f80665d0 2024-09-18T01:45:27.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.558+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556de95a4b40 con 0x556de959bdd0 2024-09-18T01:45:27.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.559+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f78f002a040 con 0x556de959bdd0 2024-09-18T01:45:27.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.559+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556de95a4b40 con 0x7f79000300d0 2024-09-18T01:45:27.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.559+0000 7f7907c2b640 1 -- 172.21.15.146:0/1312510941 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78f805c040 con 0x7f79000300d0 2024-09-18T01:45:27.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.559+0000 7f790bf35800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:27.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.559+0000 7f790bf35800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:27.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.559+0000 7f790bf35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:27.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.559+0000 7f790bf35800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:27.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.559+0000 7f790bf35800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:27.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.559+0000 7f790bf35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:27.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.559+0000 7f790bf35800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.559+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556de95a0ac0 con 0x556de959bdd0 2024-09-18T01:45:27.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.559+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f78f002a040 con 0x556de959bdd0 2024-09-18T01:45:27.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.559+0000 7f790bf35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:27.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.559+0000 7f790bf35800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.559+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556de95a1360 con 0x556de959bdd0 2024-09-18T01:45:27.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.559+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f78f002a040 con 0x556de959bdd0 2024-09-18T01:45:27.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.559+0000 7f790bf35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:27.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.559+0000 7f790bf35800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.559+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556de95a4fc0 con 0x7f79000300d0 2024-09-18T01:45:27.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.560+0000 7f7907c2b640 1 -- 172.21.15.146:0/1312510941 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f78f805c040 con 0x7f79000300d0 2024-09-18T01:45:27.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.560+0000 7f790bf35800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:27.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.560+0000 7f790bf35800 20 zone default found 2024-09-18T01:45:27.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.560+0000 7f790bf35800 4 Realm: () 2024-09-18T01:45:27.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.560+0000 7f790bf35800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:27.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.560+0000 7f790bf35800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:27.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.560+0000 7f790bf35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:27.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.560+0000 7f790bf35800 20 zonegroup default 2024-09-18T01:45:27.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.560+0000 7f790bf35800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.560+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556de95a5810 con 0x7f78f80665d0 2024-09-18T01:45:27.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.560+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f78f002a040 con 0x7f78f80665d0 2024-09-18T01:45:27.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.560+0000 7f790bf35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:27.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.560+0000 7f790bf35800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.560+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556de95a71f0 con 0x556de95a2020 2024-09-18T01:45:27.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.560+0000 7f790842c640 1 -- 172.21.15.146:0/1312510941 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f790005e040 con 0x556de95a2020 2024-09-18T01:45:27.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.560+0000 7f790bf35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:27.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.560+0000 7f790bf35800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.560+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556de95a76e0 con 0x556de95a2020 2024-09-18T01:45:27.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.561+0000 7f790842c640 1 -- 172.21.15.146:0/1312510941 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f790005e040 con 0x556de95a2020 2024-09-18T01:45:27.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.561+0000 7f790bf35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:27.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.561+0000 7f790bf35800 20 started sync module instance, tier type = 2024-09-18T01:45:27.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.561+0000 7f790bf35800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:27.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.561+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556de95a6680 con 0x7f79000300d0 2024-09-18T01:45:27.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.562+0000 7f7907c2b640 1 -- 172.21.15.146:0/1312510941 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v31'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78f805c040 con 0x7f79000300d0 2024-09-18T01:45:27.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.562+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93930554813040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556de95a7ff0 con 0x7f79000300d0 2024-09-18T01:45:27.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.562+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556de95a8840 con 0x556de959bdd0 2024-09-18T01:45:27.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.563+0000 7f7907c2b640 1 -- 172.21.15.146:0/1312510941 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93930554813040] v31'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78f805c040 con 0x7f79000300d0 2024-09-18T01:45:27.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.563+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v31'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78f002a040 con 0x556de959bdd0 2024-09-18T01:45:27.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.563+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93930554817344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556de95a8840 con 0x556de959bdd0 2024-09-18T01:45:27.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.563+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556de95a9300 con 0x556de95a2020 2024-09-18T01:45:27.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.564+0000 7f790842c640 1 -- 172.21.15.146:0/1312510941 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v31'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f790005e040 con 0x556de95a2020 2024-09-18T01:45:27.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.564+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93930554822096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556de95a9300 con 0x556de95a2020 2024-09-18T01:45:27.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.564+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556de95aa300 con 0x7f79000300d0 2024-09-18T01:45:27.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.564+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93930554817344] v31'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78f002a040 con 0x556de959bdd0 2024-09-18T01:45:27.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.565+0000 7f7907c2b640 1 -- 172.21.15.146:0/1312510941 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v31'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78f805c040 con 0x7f79000300d0 2024-09-18T01:45:27.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.565+0000 7f790842c640 1 -- 172.21.15.146:0/1312510941 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93930554822096] v31'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f790005e040 con 0x556de95a2020 2024-09-18T01:45:27.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.565+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93930554826224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556de95a96f0 con 0x7f79000300d0 2024-09-18T01:45:27.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.565+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556de95aad10 con 0x556de959bdd0 2024-09-18T01:45:27.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.566+0000 7f7907c2b640 1 -- 172.21.15.146:0/1312510941 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93930554826224] v31'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78f805c040 con 0x7f79000300d0 2024-09-18T01:45:27.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.566+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v31'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78f002a040 con 0x556de959bdd0 2024-09-18T01:45:27.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.566+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93930554819472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556de95aad10 con 0x556de959bdd0 2024-09-18T01:45:27.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.566+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556de95ab5e0 con 0x7f78f80665d0 2024-09-18T01:45:27.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.567+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93930554819472] v31'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78f002a040 con 0x556de959bdd0 2024-09-18T01:45:27.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.567+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v31'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78f002a040 con 0x7f78f80665d0 2024-09-18T01:45:27.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.567+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93930554828896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556de95ab130 con 0x7f78f80665d0 2024-09-18T01:45:27.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.567+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556de95abff0 con 0x7f78f80665d0 2024-09-18T01:45:27.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.568+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(56 notify.6 [create] v31'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78f002a040 con 0x7f78f80665d0 2024-09-18T01:45:27.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.568+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93930554833728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556de95ac410 con 0x7f78f80665d0 2024-09-18T01:45:27.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.568+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556de95acef0 con 0x7f78f80665d0 2024-09-18T01:45:27.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.568+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93930554828896] v31'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78f002a040 con 0x7f78f80665d0 2024-09-18T01:45:27.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.569+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(58 notify.7 [create] v31'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78f002a040 con 0x7f78f80665d0 2024-09-18T01:45:27.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.569+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93930554837504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556de95acef0 con 0x7f78f80665d0 2024-09-18T01:45:27.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.569+0000 7f790bf35800 20 add_watcher() i=0 2024-09-18T01:45:27.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.569+0000 7f790bf35800 20 add_watcher() i=1 2024-09-18T01:45:27.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.569+0000 7f790bf35800 20 add_watcher() i=2 2024-09-18T01:45:27.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.569+0000 7f790bf35800 20 add_watcher() i=3 2024-09-18T01:45:27.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.569+0000 7f790bf35800 20 add_watcher() i=4 2024-09-18T01:45:27.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.569+0000 7f790bf35800 20 add_watcher() i=5 2024-09-18T01:45:27.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.569+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93930554833728] v31'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78f002a040 con 0x7f78f80665d0 2024-09-18T01:45:27.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.569+0000 7f790bf35800 20 add_watcher() i=6 2024-09-18T01:45:27.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.570+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93930554837504] v31'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78f002a040 con 0x7f78f80665d0 2024-09-18T01:45:27.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.570+0000 7f790bf35800 20 add_watcher() i=7 2024-09-18T01:45:27.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.570+0000 7f790bf35800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:27.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.570+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556de95abf60 con 0x556de959bdd0 2024-09-18T01:45:27.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.570+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f78f002a040 con 0x556de959bdd0 2024-09-18T01:45:27.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.570+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93930554829952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556de95abf60 con 0x556de959bdd0 2024-09-18T01:45:27.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.571+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93930554829952] v31'125 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f78f002a040 con 0x556de959bdd0 2024-09-18T01:45:27.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.571+0000 7f77bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:27.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.572+0000 7f790bf35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:27.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.572+0000 7f790bf35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:27.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.572+0000 7f790bf35800 5 note: GC not initialized 2024-09-18T01:45:27.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.572+0000 7f77bcfe1640 20 reqs_thread_entry: start 2024-09-18T01:45:27.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.572+0000 7f790bf35800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:27.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.572+0000 7f790bf35800 20 Filter name: none 2024-09-18T01:45:27.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.572+0000 7f77367fc640 20 reqs_thread_entry: start 2024-09-18T01:45:27.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.572+0000 7f790bf35800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T01:45:27.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.572+0000 7f790bf35800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.572+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556de95e3270 con 0x556de959bdd0 2024-09-18T01:45:27.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.572+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f78f002a040 con 0x556de959bdd0 2024-09-18T01:45:27.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.572+0000 7f790bf35800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:45:27.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.572+0000 7f790bf35800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T01:45:27.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.572+0000 7f790bf35800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:45:27.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.572+0000 7f790bf35800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:45:27.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.572+0000 7f790bf35800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-18T01:45:27.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.572+0000 7f790bf35800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.572+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556de95e2dc0 con 0x7f79000300d0 2024-09-18T01:45:27.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.573+0000 7f7907c2b640 1 -- 172.21.15.146:0/1312510941 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv21 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f78f805c040 con 0x7f79000300d0 2024-09-18T01:45:27.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.573+0000 7f790bf35800 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T01:45:27.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.573+0000 7f790bf35800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-18T01:45:27.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.573+0000 7f790bf35800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T01:45:27.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.573+0000 7f790bf35800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 : miss 2024-09-18T01:45:27.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.573+0000 7f790bf35800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.573+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:64 8.13 8:ceaa8859:root::.bucket.meta.myfoo%3a8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556de95e6f30 con 0x7f78f80665d0 2024-09-18T01:45:27.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.573+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(64 .bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f78f002a040 con 0x7f78f80665d0 2024-09-18T01:45:27.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.573+0000 7f790bf35800 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T01:45:27.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.573+0000 7f790bf35800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 info.flags=0x17 2024-09-18T01:45:27.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.573+0000 7f790bf35800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 to cache LRU end 2024-09-18T01:45:27.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.573+0000 7f790bf35800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:45:27.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.573+0000 7f790bf35800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T01:45:27.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.574+0000 7f790bf35800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 2024-09-18T01:45:27.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.574+0000 7f790bf35800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-18T01:45:27.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.574+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556de95eb720 con 0x7f78f80665d0 2024-09-18T01:45:27.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.575+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(65 fud.buckets [call] v31'3 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f78f002a040 con 0x7f78f80665d0 2024-09-18T01:45:27.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.575+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:66 8.13 8:ceaa8859:root::.bucket.meta.myfoo%3a8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556de95f1660 con 0x7f78f80665d0 2024-09-18T01:45:27.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.576+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(66 .bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v31'6 uv6 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f78f002a040 con 0x7f78f80665d0 2024-09-18T01:45:27.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.576+0000 7f790bf35800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 info.flags=0x17 2024-09-18T01:45:27.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.576+0000 7f790bf35800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 to cache LRU end 2024-09-18T01:45:27.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.576+0000 7f790bf35800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T01:45:27.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.576+0000 7f790bf35800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1, ofs0, ns] 2024-09-18T01:45:27.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.576+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 93930555078128 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556de95ebb50 con 0x7f78f80665d0 2024-09-18T01:45:27.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.576+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== watch-notify(notify (1) cookie 93930554828896 notify 133143986183 ret 0) ==== 794+0+0 (crc 0 0 0) 0x556de95e7320 con 0x7f78f80665d0 2024-09-18T01:45:27.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.576+0000 7f77e6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986183 cookie 93930554828896 notifier 4530 bl.length()=752 2024-09-18T01:45:27.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.576+0000 7f77e6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 info.flags=0x17 2024-09-18T01:45:27.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.576+0000 7f77e6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 to cache LRU end 2024-09-18T01:45:27.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.576+0000 7f77e6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T01:45:27.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.576+0000 7f77e6ffd640 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f77cc003ea0 con 0x7f78f80665d0 2024-09-18T01:45:27.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.576+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== osd_op_reply(67 notify.5 [notify cookie 93930555078128 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f78f002a040 con 0x7f78f80665d0 2024-09-18T01:45:27.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.576+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 <== osd.0 v2:172.21.15.129:6800/1759265424 22 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78f002a040 con 0x7f78f80665d0 2024-09-18T01:45:27.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.577+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 <== osd.0 v2:172.21.15.129:6800/1759265424 23 ==== watch-notify(notify_complete (2) cookie 93930555078128 notify 133143986183 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556de95e6540 con 0x7f78f80665d0 2024-09-18T01:45:27.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.577+0000 7f790bf35800 20 handle_bi_update(): bucket=:myfoo[8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1]): orig_sources= new_sources= 2024-09-18T01:45:27.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.577+0000 7f790bf35800 20 handle_bi_update(): bucket=:myfoo[8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1]): potential sources added=[] removed=[] 2024-09-18T01:45:27.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.577+0000 7f790bf35800 20 handle_bi_update(): bucket=:myfoo[8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1]): orig_dests= new_dests= 2024-09-18T01:45:27.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.577+0000 7f790bf35800 20 handle_bi_update(): bucket=:myfoo[8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1]): potential dests added=[] removed=[] 2024-09-18T01:45:27.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.577+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556de95efe40 con 0x7f79000300d0 2024-09-18T01:45:27.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.578+0000 7f7907c2b640 1 -- 172.21.15.146:0/1312510941 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(69 foo.buckets [call] v31'22 uv22 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f78f805c040 con 0x7f79000300d0 2024-09-18T01:45:27.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.578+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556de95f0e50 con 0x7f79000300d0 2024-09-18T01:45:27.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.579+0000 7f7907c2b640 1 -- 172.21.15.146:0/1312510941 <== osd.2 v2:172.21.15.146:6800/3820039304 14 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v31'23 uv23 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f78f805c040 con 0x7f79000300d0 2024-09-18T01:45:27.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.579+0000 7f790bf35800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-18T01:45:27.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.579+0000 7f790bf35800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T01:45:27.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.579+0000 7f790bf35800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-18T01:45:27.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.579+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93930555078096 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556de95f02f0 con 0x7f78f80665d0 2024-09-18T01:45:27.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.579+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 <== osd.0 v2:172.21.15.129:6800/1759265424 24 ==== watch-notify(notify (1) cookie 93930554833728 notify 133143986184 ret 0) ==== 356+0+0 (crc 0 0 0) 0x7f78f4001e10 con 0x7f78f80665d0 2024-09-18T01:45:27.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.579+0000 7f77e67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986184 cookie 93930554833728 notifier 4530 bl.length()=314 2024-09-18T01:45:27.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.579+0000 7f77e67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-18T01:45:27.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.579+0000 7f77e67fc640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T01:45:27.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.579+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 <== osd.0 v2:172.21.15.129:6800/1759265424 25 ==== osd_op_reply(71 notify.6 [notify cookie 93930555078096 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f78f002a040 con 0x7f78f80665d0 2024-09-18T01:45:27.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.579+0000 7f77e67fc640 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f773c003400 con 0x7f78f80665d0 2024-09-18T01:45:27.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.580+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 <== osd.0 v2:172.21.15.129:6800/1759265424 26 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78f002a040 con 0x7f78f80665d0 2024-09-18T01:45:27.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.580+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 <== osd.0 v2:172.21.15.129:6800/1759265424 27 ==== watch-notify(notify_complete (2) cookie 93930555078096 notify 133143986184 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f78f002e9f0 con 0x7f78f80665d0 2024-09-18T01:45:27.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.580+0000 7f77bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:27.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.580+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93930554829952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556de95e0fc0 con 0x556de959bdd0 2024-09-18T01:45:27.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.581+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 93930554829952] v31'126 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f78f002a040 con 0x556de959bdd0 2024-09-18T01:45:27.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.581+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93930554813040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556de95e0fc0 con 0x7f79000300d0 2024-09-18T01:45:27.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.582+0000 7f7907c2b640 1 -- 172.21.15.146:0/1312510941 <== osd.2 v2:172.21.15.146:6800/3820039304 15 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 93930554813040] v31'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78f805c040 con 0x7f79000300d0 2024-09-18T01:45:27.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.582+0000 7f790bf35800 20 remove_watcher() i=0 2024-09-18T01:45:27.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.582+0000 7f790bf35800 2 removed watcher, disabling cache 2024-09-18T01:45:27.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.582+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93930554817344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556de95e0fc0 con 0x556de959bdd0 2024-09-18T01:45:27.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.584+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 93930554817344] v31'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78f002a040 con 0x556de959bdd0 2024-09-18T01:45:27.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.584+0000 7f790bf35800 20 remove_watcher() i=1 2024-09-18T01:45:27.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.584+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93930554822096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556de95e0fc0 con 0x556de95a2020 2024-09-18T01:45:27.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.585+0000 7f790842c640 1 -- 172.21.15.146:0/1312510941 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 93930554822096] v31'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f790005e040 con 0x556de95a2020 2024-09-18T01:45:27.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.585+0000 7f790bf35800 20 remove_watcher() i=2 2024-09-18T01:45:27.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.585+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93930554826224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556de95e0fc0 con 0x7f79000300d0 2024-09-18T01:45:27.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.586+0000 7f7907c2b640 1 -- 172.21.15.146:0/1312510941 <== osd.2 v2:172.21.15.146:6800/3820039304 16 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 93930554826224] v31'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78f805c040 con 0x7f79000300d0 2024-09-18T01:45:27.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.586+0000 7f790bf35800 20 remove_watcher() i=3 2024-09-18T01:45:27.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.586+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93930554819472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556de95e0fc0 con 0x556de959bdd0 2024-09-18T01:45:27.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.587+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 93930554819472] v31'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78f002a040 con 0x556de959bdd0 2024-09-18T01:45:27.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.587+0000 7f790bf35800 20 remove_watcher() i=4 2024-09-18T01:45:27.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.587+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93930554828896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556de95e0fc0 con 0x7f78f80665d0 2024-09-18T01:45:27.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.588+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 <== osd.0 v2:172.21.15.129:6800/1759265424 28 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 93930554828896] v31'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78f002a040 con 0x7f78f80665d0 2024-09-18T01:45:27.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.588+0000 7f790bf35800 20 remove_watcher() i=5 2024-09-18T01:45:27.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.588+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93930554833728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556de95e0fc0 con 0x7f78f80665d0 2024-09-18T01:45:27.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.589+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 <== osd.0 v2:172.21.15.129:6800/1759265424 29 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 93930554833728] v31'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78f002a040 con 0x7f78f80665d0 2024-09-18T01:45:27.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.589+0000 7f790bf35800 20 remove_watcher() i=6 2024-09-18T01:45:27.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.589+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93930554837504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556de95e0fc0 con 0x7f78f80665d0 2024-09-18T01:45:27.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.590+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 <== osd.0 v2:172.21.15.129:6800/1759265424 30 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 93930554837504] v31'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78f002a040 con 0x7f78f80665d0 2024-09-18T01:45:27.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.590+0000 7f790bf35800 20 remove_watcher() i=7 2024-09-18T01:45:27.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.590+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f78f80665d0 msgr2=0x7f78f808f220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.590+0000 7f790bf35800 1 --2- 172.21.15.146:0/1312510941 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f78f80665d0 0x7f78f808f220 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.590+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x556de959bdd0 msgr2=0x556de959e290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.590+0000 7f790bf35800 1 --2- 172.21.15.146:0/1312510941 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x556de959bdd0 0x556de959e290 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.590+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f79000300d0 msgr2=0x7f7900022880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.590+0000 7f790bf35800 1 --2- 172.21.15.146:0/1312510941 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f79000300d0 0x7f7900022880 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.590+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x556de95a2020 msgr2=0x556de95a4470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.590+0000 7f790bf35800 1 --2- 172.21.15.146:0/1312510941 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x556de95a2020 0x556de95a4470 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.590+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f77d0036b90 msgr2=0x7f77d0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.590+0000 7f790bf35800 1 --2- 172.21.15.146:0/1312510941 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f77d0036b90 0x7f77d0039050 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f78f808dda0 tx=0x7f78f8082000 comp rx=0 tx=0).stop 2024-09-18T01:45:27.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.590+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556de9579d50 msgr2=0x556de9590160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.590+0000 7f790bf35800 1 --2- 172.21.15.146:0/1312510941 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556de9579d50 0x556de9590160 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f7900015fd0 tx=0x7f790004c7f0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.590+0000 7f78fffff640 1 -- 172.21.15.146:0/1312510941 reap_dead start 2024-09-18T01:45:27.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.590+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 shutdown_connections 2024-09-18T01:45:27.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.590+0000 7f790bf35800 1 --2- 172.21.15.146:0/1312510941 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556de9579d50 0x556de9590160 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.590+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 >> 172.21.15.146:0/1312510941 conn(0x556de9582e60 msgr2=0x556de9580f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:27.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.590+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 shutdown_connections 2024-09-18T01:45:27.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.590+0000 7f790bf35800 1 -- 172.21.15.146:0/1312510941 wait complete. 2024-09-18T01:45:27.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.590+0000 7f790bf35800 1 -- 172.21.15.146:0/81849645 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f77e0036b90 msgr2=0x7f77e0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.590+0000 7f790bf35800 1 --2- 172.21.15.146:0/81849645 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f77e0036b90 0x7f77e0039050 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x556de95668d0 tx=0x7f78f8056ee0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.590+0000 7f790bf35800 1 -- 172.21.15.146:0/81849645 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556de93dc680 msgr2=0x556de957cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.590+0000 7f790bf35800 1 --2- 172.21.15.146:0/81849645 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556de93dc680 0x556de957cb20 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x556de95659d0 tx=0x7f79000178e0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.590+0000 7f790bf35800 1 -- 172.21.15.146:0/81849645 shutdown_connections 2024-09-18T01:45:27.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.590+0000 7f790bf35800 1 --2- 172.21.15.146:0/81849645 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f77e0036b90 0x7f77e0039050 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.590+0000 7f790bf35800 1 --2- 172.21.15.146:0/81849645 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556de93dc680 0x556de957cb20 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.590+0000 7f790bf35800 1 -- 172.21.15.146:0/81849645 >> 172.21.15.146:0/81849645 conn(0x556de956dd00 msgr2=0x556de9570880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:27.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.590+0000 7f790bf35800 1 -- 172.21.15.146:0/81849645 shutdown_connections 2024-09-18T01:45:27.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.590+0000 7f790bf35800 1 -- 172.21.15.146:0/81849645 wait complete. 2024-09-18T01:45:27.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.591+0000 7f790bf35800 1 -- 172.21.15.146:0/4084519192 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x556de9467eb0 msgr2=0x556de95650b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.591+0000 7f790bf35800 1 --2- 172.21.15.146:0/4084519192 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x556de9467eb0 0x556de95650b0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.591+0000 7f790bf35800 1 -- 172.21.15.146:0/4084519192 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x556de9566fd0 msgr2=0x556de956a830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.591+0000 7f790bf35800 1 --2- 172.21.15.146:0/4084519192 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x556de9566fd0 0x556de956a830 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.591+0000 7f790bf35800 1 -- 172.21.15.146:0/4084519192 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f77f0036b40 msgr2=0x7f77f0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.591+0000 7f790bf35800 1 --2- 172.21.15.146:0/4084519192 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f77f0036b40 0x7f77f0039000 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f78f0000f60 tx=0x7f78f00010a0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.591+0000 7f790bf35800 1 -- 172.21.15.146:0/4084519192 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556de9467570 msgr2=0x556de955e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.591+0000 7f790bf35800 1 --2- 172.21.15.146:0/4084519192 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556de9467570 0x556de955e040 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f78f8045960 tx=0x7f78f8002fb0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.591+0000 7f790bf35800 1 -- 172.21.15.146:0/4084519192 shutdown_connections 2024-09-18T01:45:27.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.591+0000 7f790bf35800 1 --2- 172.21.15.146:0/4084519192 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x556de9566fd0 0x556de956a830 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.591+0000 7f790bf35800 1 --2- 172.21.15.146:0/4084519192 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x556de9467eb0 0x556de95650b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.591+0000 7f790bf35800 1 --2- 172.21.15.146:0/4084519192 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f77f0036b40 0x7f77f0039000 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.591+0000 7f790bf35800 1 --2- 172.21.15.146:0/4084519192 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556de9467570 0x556de955e040 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.591+0000 7f790bf35800 1 -- 172.21.15.146:0/4084519192 >> 172.21.15.146:0/4084519192 conn(0x556de9462e00 msgr2=0x556de95508b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:27.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.591+0000 7f790bf35800 1 -- 172.21.15.146:0/4084519192 shutdown_connections 2024-09-18T01:45:27.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.591+0000 7f790bf35800 1 -- 172.21.15.146:0/4084519192 wait complete. 2024-09-18T01:45:27.601 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-18T01:45:27.601 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-18T01:45:27.601 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-18T01:45:27.645 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:27.645 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:27.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.645+0000 7f8a80717800 1 Processor -- start 2024-09-18T01:45:27.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.645+0000 7f8a80717800 1 -- start start 2024-09-18T01:45:27.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.645+0000 7f8a80717800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x5590a796c900 0x5590a796ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.645+0000 7f8a80717800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5590a7828b30 con 0x5590a79684c0 2024-09-18T01:45:27.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.645+0000 7f8a80717800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x5590a780a360 con 0x5590a796c900 2024-09-18T01:45:27.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.646+0000 7f8a77fff640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x5590a796c900 0x5590a796ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.646+0000 7f8a7e20b640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x5590a79684c0 0x5590a79688c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:47322/0 (socket says 172.21.15.146:47322) 2024-09-18T01:45:27.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.646+0000 7f8a7e20b640 1 -- 172.21.15.146:0/3848538590 learned_addr learned my addr 172.21.15.146:0/3848538590 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:45:27.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.646+0000 7f8a77fff640 1 -- 172.21.15.146:0/3848538590 >> v1:172.21.15.129:6789/0 conn(0x5590a79684c0 legacy=0x5590a79688c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.646+0000 7f8a77fff640 1 -- 172.21.15.146:0/3848538590 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590a7830e00 con 0x5590a796c900 2024-09-18T01:45:27.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.648+0000 7f8a77fff640 1 --2- 172.21.15.146:0/3848538590 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5590a796c900 0x5590a796ecf0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f8a6800a470 tx=0x7f8a68045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24c0e759563992 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.648+0000 7f8a7da0a640 1 -- 172.21.15.146:0/3848538590 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a68053570 con 0x5590a796c900 2024-09-18T01:45:27.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.648+0000 7f8a7da0a640 1 -- 172.21.15.146:0/3848538590 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a68058070 con 0x5590a796c900 2024-09-18T01:45:27.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.648+0000 7f8a7da0a640 1 -- 172.21.15.146:0/3848538590 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a68053880 con 0x5590a796c900 2024-09-18T01:45:27.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.648+0000 7f8a80717800 1 -- 172.21.15.146:0/3848538590 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5590a796c900 msgr2=0x5590a796ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.648+0000 7f8a80717800 1 --2- 172.21.15.146:0/3848538590 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5590a796c900 0x5590a796ecf0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f8a6800a470 tx=0x7f8a68045a20 comp rx=0 tx=0).stop 2024-09-18T01:45:27.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.648+0000 7f8a80717800 1 -- 172.21.15.146:0/3848538590 shutdown_connections 2024-09-18T01:45:27.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.648+0000 7f8a80717800 1 --2- 172.21.15.146:0/3848538590 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5590a796c900 0x5590a796ecf0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.648+0000 7f8a80717800 1 -- 172.21.15.146:0/3848538590 >> 172.21.15.146:0/3848538590 conn(0x5590a7963df0 msgr2=0x5590a7966210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:27.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.649+0000 7f8a80717800 1 -- 172.21.15.146:0/3848538590 shutdown_connections 2024-09-18T01:45:27.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.649+0000 7f8a80717800 1 -- 172.21.15.146:0/3848538590 wait complete. 2024-09-18T01:45:27.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.662+0000 7f8a80717800 1 Processor -- start 2024-09-18T01:45:27.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.662+0000 7f8a80717800 1 -- start start 2024-09-18T01:45:27.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.662+0000 7f8a80717800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5590a79684c0 0x5590a78dcd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.662+0000 7f8a80717800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5590a78b5330 con 0x5590a79684c0 2024-09-18T01:45:27.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.663+0000 7f8a7e20b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5590a79684c0 0x5590a78dcd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.663+0000 7f8a7e20b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5590a79684c0 0x5590a78dcd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:57730/0 (socket says 172.21.15.146:57730) 2024-09-18T01:45:27.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.663+0000 7f8a7e20b640 1 -- 172.21.15.146:0/2169286867 learned_addr learned my addr 172.21.15.146:0/2169286867 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:27.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.663+0000 7f8a7e20b640 1 -- 172.21.15.146:0/2169286867 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590a7802bc0 con 0x5590a79684c0 2024-09-18T01:45:27.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.663+0000 7f8a7e20b640 1 --2- 172.21.15.146:0/2169286867 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5590a79684c0 0x5590a78dcd60 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f8a70001d80 tx=0x7f8a70001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3da29d9407a6954 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.663+0000 7f896c608640 1 -- 172.21.15.146:0/2169286867 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a70013030 con 0x5590a79684c0 2024-09-18T01:45:27.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.663+0000 7f896c608640 1 -- 172.21.15.146:0/2169286867 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a7000e470 con 0x5590a79684c0 2024-09-18T01:45:27.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.663+0000 7f896c608640 1 -- 172.21.15.146:0/2169286867 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a7000e810 con 0x5590a79684c0 2024-09-18T01:45:27.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.664+0000 7f8a80717800 1 -- 172.21.15.146:0/2169286867 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5590a79684c0 msgr2=0x5590a78dcd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.664+0000 7f8a80717800 1 --2- 172.21.15.146:0/2169286867 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5590a79684c0 0x5590a78dcd60 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f8a70001d80 tx=0x7f8a70001e70 comp rx=0 tx=0).stop 2024-09-18T01:45:27.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.664+0000 7f8a80717800 1 -- 172.21.15.146:0/2169286867 shutdown_connections 2024-09-18T01:45:27.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.664+0000 7f8a80717800 1 --2- 172.21.15.146:0/2169286867 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5590a79684c0 0x5590a78dcd60 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.664+0000 7f8a80717800 1 -- 172.21.15.146:0/2169286867 >> 172.21.15.146:0/2169286867 conn(0x5590a7963df0 msgr2=0x5590a7a53110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:27.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.664+0000 7f8a80717800 1 -- 172.21.15.146:0/2169286867 shutdown_connections 2024-09-18T01:45:27.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.664+0000 7f8a80717800 1 -- 172.21.15.146:0/2169286867 wait complete. 2024-09-18T01:45:27.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.665+0000 7f8a80717800 1 Processor -- start 2024-09-18T01:45:27.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.665+0000 7f8a80717800 1 -- start start 2024-09-18T01:45:27.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.665+0000 7f8a80717800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5590a79684c0 0x5590a7a60260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.665+0000 7f8a80717800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5590a796f530 con 0x5590a79684c0 2024-09-18T01:45:27.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.665+0000 7f8a7e20b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5590a79684c0 0x5590a7a60260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.665+0000 7f8a7e20b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5590a79684c0 0x5590a7a60260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:57738/0 (socket says 172.21.15.146:57738) 2024-09-18T01:45:27.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.665+0000 7f8a7e20b640 1 -- 172.21.15.146:0/3353893895 learned_addr learned my addr 172.21.15.146:0/3353893895 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:27.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.665+0000 7f8a7e20b640 1 -- 172.21.15.146:0/3353893895 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590a7816fe0 con 0x5590a79684c0 2024-09-18T01:45:27.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.665+0000 7f8a7e20b640 1 --2- 172.21.15.146:0/3353893895 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5590a79684c0 0x5590a7a60260 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f8a70004000 tx=0x7f8a70000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.665+0000 7f896ae05640 1 -- 172.21.15.146:0/3353893895 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a70027070 con 0x5590a79684c0 2024-09-18T01:45:27.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.665+0000 7f896ae05640 1 -- 172.21.15.146:0/3353893895 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a70019900 con 0x5590a79684c0 2024-09-18T01:45:27.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.666+0000 7f8a80717800 1 -- 172.21.15.146:0/3353893895 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5590a7a607a0 con 0x5590a79684c0 2024-09-18T01:45:27.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.666+0000 7f896ae05640 1 -- 172.21.15.146:0/3353893895 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a70019c60 con 0x5590a79684c0 2024-09-18T01:45:27.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.666+0000 7f8a80717800 1 -- 172.21.15.146:0/3353893895 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590a7a60cc0 con 0x5590a79684c0 2024-09-18T01:45:27.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.666+0000 7f896ae05640 1 -- 172.21.15.146:0/3353893895 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8a7002a070 con 0x5590a79684c0 2024-09-18T01:45:27.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.666+0000 7f896ae05640 1 --2- 172.21.15.146:0/3353893895 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8964036b40 0x7f8964039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.666+0000 7f896ae05640 1 -- 172.21.15.146:0/3353893895 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f8a7001f070 con 0x5590a79684c0 2024-09-18T01:45:27.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.667+0000 7f8a77fff640 1 --2- 172.21.15.146:0/3353893895 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8964036b40 0x7f8964039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.667+0000 7f8a80717800 1 --2- 172.21.15.146:0/3353893895 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5590a796c900 0x5590a7a672d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.667+0000 7f8a80717800 1 -- 172.21.15.146:0/3353893895 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5590a7a67850 con 0x5590a796c900 2024-09-18T01:45:27.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.667+0000 7f8a7ea0c640 1 --2- 172.21.15.146:0/3353893895 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5590a796c900 0x5590a7a672d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.667+0000 7f8a77fff640 1 --2- 172.21.15.146:0/3353893895 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8964036b40 0x7f8964039000 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8a68057000 tx=0x7f8a68052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.667+0000 7f8a7ea0c640 1 --2- 172.21.15.146:0/3353893895 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5590a796c900 0x5590a7a672d0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.667+0000 7f8a7ea0c640 1 -- 172.21.15.146:0/3353893895 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8a7800a4a0 con 0x5590a796c900 2024-09-18T01:45:27.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.667+0000 7f8a80717800 1 -- 172.21.15.146:0/3353893895 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5590a7a648a0 con 0x5590a796c900 2024-09-18T01:45:27.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.668+0000 7f8a7ea0c640 1 -- 172.21.15.146:0/3353893895 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8a7800a4a0 con 0x5590a796c900 2024-09-18T01:45:27.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.668+0000 7f8a80717800 1 -- 172.21.15.146:0/3353893895 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5590a7a69690 con 0x5590a796c900 2024-09-18T01:45:27.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.668+0000 7f8a7ea0c640 1 -- 172.21.15.146:0/3353893895 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8a7800a4a0 con 0x5590a796c900 2024-09-18T01:45:27.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.668+0000 7f8a80717800 1 -- 172.21.15.146:0/3353893895 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5590a7a688c0 con 0x5590a796c900 2024-09-18T01:45:27.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.668+0000 7f8a7ea0c640 1 -- 172.21.15.146:0/3353893895 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8a7800a4a0 con 0x5590a796c900 2024-09-18T01:45:27.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.668+0000 7f8a80717800 1 --2- 172.21.15.146:0/3353893895 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5590a7a6aa40 0x5590a7a6ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.668+0000 7f8a80717800 1 -- 172.21.15.146:0/3353893895 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5590a7a6d370 con 0x5590a7a6aa40 2024-09-18T01:45:27.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.668+0000 7f8a7e20b640 1 --2- 172.21.15.146:0/3353893895 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5590a7a6aa40 0x5590a7a6ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.669+0000 7f8a7e20b640 1 --2- 172.21.15.146:0/3353893895 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5590a7a6aa40 0x5590a7a6ce30 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.669+0000 7f8a7e20b640 1 -- 172.21.15.146:0/3353893895 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8a70029030 con 0x5590a7a6aa40 2024-09-18T01:45:27.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.669+0000 7f8a80717800 1 Processor -- start 2024-09-18T01:45:27.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.669+0000 7f8a80717800 1 -- start start 2024-09-18T01:45:27.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.669+0000 7f8a80717800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5590a7a58f30 0x5590a7a57580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.669+0000 7f8a80717800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5590a7804580 con 0x5590a7a58f30 2024-09-18T01:45:27.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.670+0000 7f8a7ea0c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5590a7a58f30 0x5590a7a57580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.670+0000 7f8a7ea0c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5590a7a58f30 0x5590a7a57580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:57750/0 (socket says 172.21.15.146:57750) 2024-09-18T01:45:27.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.670+0000 7f8a7ea0c640 1 -- 172.21.15.146:0/2090036701 learned_addr learned my addr 172.21.15.146:0/2090036701 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:27.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.670+0000 7f8a7ea0c640 1 -- 172.21.15.146:0/2090036701 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590a7a59350 con 0x5590a7a58f30 2024-09-18T01:45:27.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.670+0000 7f8a7ea0c640 1 --2- 172.21.15.146:0/2090036701 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5590a7a58f30 0x5590a7a57580 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x5590a7a61660 tx=0x7f8a780178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.670+0000 7f8963fff640 1 -- 172.21.15.146:0/2090036701 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a78013440 con 0x5590a7a58f30 2024-09-18T01:45:27.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.670+0000 7f8963fff640 1 -- 172.21.15.146:0/2090036701 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a780135e0 con 0x5590a7a58f30 2024-09-18T01:45:27.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.670+0000 7f8a80717800 1 -- 172.21.15.146:0/2090036701 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5590a7a57b20 con 0x5590a7a58f30 2024-09-18T01:45:27.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.670+0000 7f8963fff640 1 -- 172.21.15.146:0/2090036701 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a780138c0 con 0x5590a7a58f30 2024-09-18T01:45:27.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.670+0000 7f8a80717800 1 -- 172.21.15.146:0/2090036701 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590a7a58020 con 0x5590a7a58f30 2024-09-18T01:45:27.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.671+0000 7f8963fff640 1 -- 172.21.15.146:0/2090036701 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8a78011040 con 0x5590a7a58f30 2024-09-18T01:45:27.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.671+0000 7f8963fff640 1 --2- 172.21.15.146:0/2090036701 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8958036b90 0x7f8958039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.671+0000 7f8963fff640 1 -- 172.21.15.146:0/2090036701 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f8a7801d070 con 0x5590a7a58f30 2024-09-18T01:45:27.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.671+0000 7f8a7e20b640 1 --2- 172.21.15.146:0/2090036701 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8958036b90 0x7f8958039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.672+0000 7f8a80717800 1 Processor -- start 2024-09-18T01:45:27.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.672+0000 7f8a7e20b640 1 --2- 172.21.15.146:0/2090036701 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8958036b90 0x7f8958039050 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8a7000dfd0 tx=0x7f8a7002ae80 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.672+0000 7f8a80717800 1 -- start start 2024-09-18T01:45:27.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.672+0000 7f8a80717800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5590a7a89f40 0x5590a7a8a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.672+0000 7f8a80717800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5590a7a5b750 con 0x5590a7a89f40 2024-09-18T01:45:27.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.672+0000 7f8a7ea0c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5590a7a89f40 0x5590a7a8a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.672+0000 7f8a7ea0c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5590a7a89f40 0x5590a7a8a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:57764/0 (socket says 172.21.15.146:57764) 2024-09-18T01:45:27.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.672+0000 7f8a7ea0c640 1 -- 172.21.15.146:0/3418221368 learned_addr learned my addr 172.21.15.146:0/3418221368 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:27.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.672+0000 7f8a7ea0c640 1 -- 172.21.15.146:0/3418221368 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590a7a8a910 con 0x5590a7a89f40 2024-09-18T01:45:27.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.672+0000 7f8a7ea0c640 1 --2- 172.21.15.146:0/3418221368 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5590a7a89f40 0x5590a7a8a340 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f8a7804c8c0 tx=0x7f8a78001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26b910cc6517e9fc server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.672+0000 7f8961ffb640 1 -- 172.21.15.146:0/3418221368 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a78027040 con 0x5590a7a89f40 2024-09-18T01:45:27.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.672+0000 7f8961ffb640 1 -- 172.21.15.146:0/3418221368 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a78012cc0 con 0x5590a7a89f40 2024-09-18T01:45:27.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.672+0000 7f8961ffb640 1 -- 172.21.15.146:0/3418221368 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a7804b250 con 0x5590a7a89f40 2024-09-18T01:45:27.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.673+0000 7f8a80717800 1 -- 172.21.15.146:0/3418221368 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5590a7a89f40 msgr2=0x5590a7a8a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.673+0000 7f8a80717800 1 --2- 172.21.15.146:0/3418221368 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5590a7a89f40 0x5590a7a8a340 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f8a7804c8c0 tx=0x7f8a78001940 comp rx=0 tx=0).stop 2024-09-18T01:45:27.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.673+0000 7f8a80717800 1 -- 172.21.15.146:0/3418221368 shutdown_connections 2024-09-18T01:45:27.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.673+0000 7f8a80717800 1 --2- 172.21.15.146:0/3418221368 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5590a7a89f40 0x5590a7a8a340 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.673+0000 7f8a80717800 1 -- 172.21.15.146:0/3418221368 >> 172.21.15.146:0/3418221368 conn(0x5590a7a861e0 msgr2=0x5590a7a84330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:27.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.673+0000 7f8a80717800 1 -- 172.21.15.146:0/3418221368 shutdown_connections 2024-09-18T01:45:27.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.673+0000 7f8a80717800 1 -- 172.21.15.146:0/3418221368 wait complete. 2024-09-18T01:45:27.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.673+0000 7f8a80717800 1 Processor -- start 2024-09-18T01:45:27.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.673+0000 7f8a80717800 1 -- start start 2024-09-18T01:45:27.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.673+0000 7f8a80717800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5590a7a89f40 0x5590a7a91270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.674+0000 7f8a80717800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5590a7a8aee0 con 0x5590a7a89f40 2024-09-18T01:45:27.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.674+0000 7f8a7ea0c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5590a7a89f40 0x5590a7a91270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.674+0000 7f8a7ea0c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5590a7a89f40 0x5590a7a91270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:57770/0 (socket says 172.21.15.146:57770) 2024-09-18T01:45:27.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.674+0000 7f8a7ea0c640 1 -- 172.21.15.146:0/1696358968 learned_addr learned my addr 172.21.15.146:0/1696358968 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:27.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.674+0000 7f8a7ea0c640 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590a7a917b0 con 0x5590a7a89f40 2024-09-18T01:45:27.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.674+0000 7f8a7ea0c640 1 --2- 172.21.15.146:0/1696358968 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5590a7a89f40 0x5590a7a91270 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f8a7804b7b0 tx=0x7f8a7804c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.674+0000 7f894ffff640 1 -- 172.21.15.146:0/1696358968 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a78027070 con 0x5590a7a89f40 2024-09-18T01:45:27.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.674+0000 7f894ffff640 1 -- 172.21.15.146:0/1696358968 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a78013e30 con 0x5590a7a89f40 2024-09-18T01:45:27.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.674+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5590a7a91a40 con 0x5590a7a89f40 2024-09-18T01:45:27.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.674+0000 7f894ffff640 1 -- 172.21.15.146:0/1696358968 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a7802aa60 con 0x5590a7a89f40 2024-09-18T01:45:27.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.674+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590a7a946f0 con 0x5590a7a89f40 2024-09-18T01:45:27.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.675+0000 7f894ffff640 1 -- 172.21.15.146:0/1696358968 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8a7802ac00 con 0x5590a7a89f40 2024-09-18T01:45:27.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.675+0000 7f894ffff640 1 --2- 172.21.15.146:0/1696358968 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8948036b90 0x7f8948039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.675+0000 7f894ffff640 1 -- 172.21.15.146:0/1696358968 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f8a78033070 con 0x5590a7a89f40 2024-09-18T01:45:27.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.675+0000 7f8a7e20b640 1 --2- 172.21.15.146:0/1696358968 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8948036b90 0x7f8948039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.676+0000 7f8a7e20b640 1 --2- 172.21.15.146:0/1696358968 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8948036b90 0x7f8948039050 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8a70016fd0 tx=0x7f8a70037000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.676+0000 7f8a80717800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.676+0000 7f8a80717800 1 --2- 172.21.15.146:0/1696358968 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5590a7a9cf90 0x5590a7a9f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.676+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5590a7a9fba0 con 0x5590a7a9cf90 2024-09-18T01:45:27.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.676+0000 7f8a77fff640 1 --2- 172.21.15.146:0/1696358968 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5590a7a9cf90 0x5590a7a9f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.676+0000 7f8a77fff640 1 --2- 172.21.15.146:0/1696358968 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5590a7a9cf90 0x5590a7a9f450 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.676+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8a68051070 con 0x5590a7a9cf90 2024-09-18T01:45:27.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.676+0000 7f8a80717800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:27.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.677+0000 7f8a80717800 20 realm 2024-09-18T01:45:27.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.677+0000 7f8a80717800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.677+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5590a7a9ffd0 con 0x5590a7a9cf90 2024-09-18T01:45:27.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.677+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8a68051070 con 0x5590a7a9cf90 2024-09-18T01:45:27.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.677+0000 7f8a80717800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:27.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.677+0000 7f8a80717800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:27.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.677+0000 7f8a80717800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.677+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aa08a0 con 0x5590a7a9cf90 2024-09-18T01:45:27.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.677+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8a68051070 con 0x5590a7a9cf90 2024-09-18T01:45:27.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.677+0000 7f8a80717800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:27.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.677+0000 7f8a80717800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.677+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aa0c40 con 0x5590a7a9cf90 2024-09-18T01:45:27.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.677+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8a68051070 con 0x5590a7a9cf90 2024-09-18T01:45:27.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.677+0000 7f8a80717800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:27.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.677+0000 7f8a80717800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.677+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aa1490 con 0x5590a7a9cf90 2024-09-18T01:45:27.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.678+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8a68051070 con 0x5590a7a9cf90 2024-09-18T01:45:27.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.678+0000 7f8a80717800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:27.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.678+0000 7f8a80717800 20 searching for the correct realm 2024-09-18T01:45:27.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.678+0000 7f8a80717800 1 --2- 172.21.15.146:0/1696358968 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5590a7aa3200 0x5590a7aa55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.678+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aa5c20 con 0x5590a7aa3200 2024-09-18T01:45:27.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.678+0000 7f8a7ea0c640 1 --2- 172.21.15.146:0/1696358968 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5590a7aa3200 0x5590a7aa55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.678+0000 7f8a7ea0c640 1 --2- 172.21.15.146:0/1696358968 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5590a7aa3200 0x5590a7aa55f0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.678+0000 7f8a7ea0c640 1 -- 172.21.15.146:0/1696358968 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a78057040 con 0x5590a7aa3200 2024-09-18T01:45:27.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.678+0000 7f8a7ea0c640 1 --2- 172.21.15.146:0/1696358968 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f8a780123a0 0x7f8a78036580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.678+0000 7f8a7ea0c640 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aa5c20 con 0x7f8a780123a0 2024-09-18T01:45:27.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.678+0000 7f8a7e20b640 1 --2- 172.21.15.146:0/1696358968 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f8a780123a0 0x7f8a78036580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.679+0000 7f8a7e20b640 1 --2- 172.21.15.146:0/1696358968 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f8a780123a0 0x7f8a78036580 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.679+0000 7f8a7e20b640 1 -- 172.21.15.146:0/1696358968 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a70029030 con 0x7f8a780123a0 2024-09-18T01:45:27.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.679+0000 7f8a7e20b640 1 --2- 172.21.15.146:0/1696358968 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f8a7002c060 0x7f8a7000c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.679+0000 7f8a7e20b640 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aa5c20 con 0x7f8a7002c060 2024-09-18T01:45:27.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.679+0000 7f8a77fff640 1 --2- 172.21.15.146:0/1696358968 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f8a7002c060 0x7f8a7000c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.679+0000 7f8a77fff640 1 --2- 172.21.15.146:0/1696358968 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f8a7002c060 0x7f8a7000c590 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.680+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a68051070 con 0x7f8a7002c060 2024-09-18T01:45:27.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.680+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aa5c20 con 0x5590a7a9cf90 2024-09-18T01:45:27.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.680+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8a68051070 con 0x5590a7a9cf90 2024-09-18T01:45:27.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.680+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aa5c20 con 0x5590a7a9cf90 2024-09-18T01:45:27.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.680+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a68051070 con 0x5590a7a9cf90 2024-09-18T01:45:27.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.680+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aa5c20 con 0x7f8a7002c060 2024-09-18T01:45:27.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.680+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a68051070 con 0x7f8a7002c060 2024-09-18T01:45:27.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.680+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aa5c20 con 0x7f8a7002c060 2024-09-18T01:45:27.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.681+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a68051070 con 0x7f8a7002c060 2024-09-18T01:45:27.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.681+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aa5c20 con 0x7f8a780123a0 2024-09-18T01:45:27.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.681+0000 7f8a7e20b640 1 -- 172.21.15.146:0/1696358968 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a70029030 con 0x7f8a780123a0 2024-09-18T01:45:27.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.681+0000 7f8a7e20b640 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aa5c20 con 0x5590a7aa3200 2024-09-18T01:45:27.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.681+0000 7f8a7ea0c640 1 -- 172.21.15.146:0/1696358968 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a78057040 con 0x5590a7aa3200 2024-09-18T01:45:27.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.681+0000 7f8a7ea0c640 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aa5c20 con 0x5590a7a9cf90 2024-09-18T01:45:27.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.681+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a68051070 con 0x5590a7a9cf90 2024-09-18T01:45:27.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.681+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aa5c20 con 0x7f8a7002c060 2024-09-18T01:45:27.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.681+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a68051070 con 0x7f8a7002c060 2024-09-18T01:45:27.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.681+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aa5c20 con 0x5590a7a9cf90 2024-09-18T01:45:27.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.682+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a68051070 con 0x5590a7a9cf90 2024-09-18T01:45:27.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.682+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aa5c20 con 0x7f8a780123a0 2024-09-18T01:45:27.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.682+0000 7f8a7e20b640 1 -- 172.21.15.146:0/1696358968 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f8a70029030 con 0x7f8a780123a0 2024-09-18T01:45:27.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.682+0000 7f8a7e20b640 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aa5c20 con 0x5590a7aa3200 2024-09-18T01:45:27.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.682+0000 7f8a7ea0c640 1 -- 172.21.15.146:0/1696358968 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a78057040 con 0x5590a7aa3200 2024-09-18T01:45:27.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.682+0000 7f8a7ea0c640 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aa5c20 con 0x5590a7aa3200 2024-09-18T01:45:27.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.682+0000 7f8a7ea0c640 1 -- 172.21.15.146:0/1696358968 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a78057040 con 0x5590a7aa3200 2024-09-18T01:45:27.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.682+0000 7f8a7ea0c640 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aa5c20 con 0x7f8a7002c060 2024-09-18T01:45:27.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.683+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a68051070 con 0x7f8a7002c060 2024-09-18T01:45:27.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.683+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aa5c20 con 0x5590a7aa3200 2024-09-18T01:45:27.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.683+0000 7f8a7ea0c640 1 -- 172.21.15.146:0/1696358968 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a78057040 con 0x5590a7aa3200 2024-09-18T01:45:27.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.683+0000 7f8a7ea0c640 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aa5c20 con 0x5590a7aa3200 2024-09-18T01:45:27.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.683+0000 7f8a7ea0c640 1 -- 172.21.15.146:0/1696358968 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a78057040 con 0x5590a7aa3200 2024-09-18T01:45:27.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.683+0000 7f8a7ea0c640 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aa5c20 con 0x5590a7a9cf90 2024-09-18T01:45:27.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.683+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a68051070 con 0x5590a7a9cf90 2024-09-18T01:45:27.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.683+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aa5c20 con 0x5590a7a9cf90 2024-09-18T01:45:27.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.684+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8a68051070 con 0x5590a7a9cf90 2024-09-18T01:45:27.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.684+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aa5c20 con 0x7f8a7002c060 2024-09-18T01:45:27.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.684+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a68051070 con 0x7f8a7002c060 2024-09-18T01:45:27.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.684+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aa5c20 con 0x5590a7aa3200 2024-09-18T01:45:27.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.684+0000 7f8a7ea0c640 1 -- 172.21.15.146:0/1696358968 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a78057040 con 0x5590a7aa3200 2024-09-18T01:45:27.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.684+0000 7f8a7ea0c640 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aa5c20 con 0x7f8a780123a0 2024-09-18T01:45:27.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.684+0000 7f8a7e20b640 1 -- 172.21.15.146:0/1696358968 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a70029030 con 0x7f8a780123a0 2024-09-18T01:45:27.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.684+0000 7f8a7e20b640 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aa5c20 con 0x5590a7a9cf90 2024-09-18T01:45:27.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.685+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a68051070 con 0x5590a7a9cf90 2024-09-18T01:45:27.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.685+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aa5c20 con 0x7f8a7002c060 2024-09-18T01:45:27.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.685+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a68051070 con 0x7f8a7002c060 2024-09-18T01:45:27.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.685+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aa5c20 con 0x5590a7aa3200 2024-09-18T01:45:27.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.685+0000 7f8a7ea0c640 1 -- 172.21.15.146:0/1696358968 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a78057040 con 0x5590a7aa3200 2024-09-18T01:45:27.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.685+0000 7f8a7ea0c640 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aa5c20 con 0x7f8a7002c060 2024-09-18T01:45:27.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.686+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a68051070 con 0x7f8a7002c060 2024-09-18T01:45:27.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.686+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aa5c20 con 0x7f8a780123a0 2024-09-18T01:45:27.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.686+0000 7f8a7e20b640 1 -- 172.21.15.146:0/1696358968 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a70029030 con 0x7f8a780123a0 2024-09-18T01:45:27.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.686+0000 7f8a7e20b640 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aa5c20 con 0x5590a7aa3200 2024-09-18T01:45:27.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.686+0000 7f8a7ea0c640 1 -- 172.21.15.146:0/1696358968 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a78057040 con 0x5590a7aa3200 2024-09-18T01:45:27.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.686+0000 7f8a7ea0c640 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aa5c20 con 0x7f8a7002c060 2024-09-18T01:45:27.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.686+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a68051070 con 0x7f8a7002c060 2024-09-18T01:45:27.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.686+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aa5c20 con 0x5590a7a9cf90 2024-09-18T01:45:27.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.686+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8a68051070 con 0x5590a7a9cf90 2024-09-18T01:45:27.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.686+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aa5c20 con 0x7f8a780123a0 2024-09-18T01:45:27.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.687+0000 7f8a7e20b640 1 -- 172.21.15.146:0/1696358968 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a70062040 con 0x7f8a780123a0 2024-09-18T01:45:27.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.687+0000 7f8a80717800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:27.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.687+0000 7f8a80717800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:27.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.687+0000 7f8a80717800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:27.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.687+0000 7f8a80717800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:27.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.687+0000 7f8a80717800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:27.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.687+0000 7f8a80717800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:27.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.687+0000 7f8a80717800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.687+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aa1e10 con 0x5590a7a9cf90 2024-09-18T01:45:27.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.687+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8a68051070 con 0x5590a7a9cf90 2024-09-18T01:45:27.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.687+0000 7f8a80717800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:27.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.687+0000 7f8a80717800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.687+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aa26b0 con 0x5590a7a9cf90 2024-09-18T01:45:27.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.687+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8a68051070 con 0x5590a7a9cf90 2024-09-18T01:45:27.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.687+0000 7f8a80717800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:27.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.687+0000 7f8a80717800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.687+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aa60a0 con 0x7f8a780123a0 2024-09-18T01:45:27.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.688+0000 7f8a7e20b640 1 -- 172.21.15.146:0/1696358968 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8a70062040 con 0x7f8a780123a0 2024-09-18T01:45:27.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.688+0000 7f8a80717800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:27.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.688+0000 7f8a80717800 20 zone default found 2024-09-18T01:45:27.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.688+0000 7f8a80717800 4 Realm: () 2024-09-18T01:45:27.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.688+0000 7f8a80717800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:27.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.688+0000 7f8a80717800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:27.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.688+0000 7f8a80717800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:27.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.688+0000 7f8a80717800 20 zonegroup default 2024-09-18T01:45:27.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.688+0000 7f8a80717800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.688+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aa68f0 con 0x7f8a7002c060 2024-09-18T01:45:27.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.688+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8a68051070 con 0x7f8a7002c060 2024-09-18T01:45:27.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.688+0000 7f8a80717800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:27.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.688+0000 7f8a80717800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.688+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aa82d0 con 0x5590a7aa3200 2024-09-18T01:45:27.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.688+0000 7f8a7ea0c640 1 -- 172.21.15.146:0/1696358968 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8a78057040 con 0x5590a7aa3200 2024-09-18T01:45:27.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.688+0000 7f8a80717800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:27.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.688+0000 7f8a80717800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.688+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aa8810 con 0x5590a7aa3200 2024-09-18T01:45:27.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.688+0000 7f8a7ea0c640 1 -- 172.21.15.146:0/1696358968 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8a78057040 con 0x5590a7aa3200 2024-09-18T01:45:27.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.688+0000 7f8a80717800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:27.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.688+0000 7f8a80717800 20 started sync module instance, tier type = 2024-09-18T01:45:27.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.688+0000 7f8a80717800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:27.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.688+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aa7760 con 0x7f8a780123a0 2024-09-18T01:45:27.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.689+0000 7f8a7e20b640 1 -- 172.21.15.146:0/1696358968 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v31'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a70062040 con 0x7f8a780123a0 2024-09-18T01:45:27.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.689+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94079776619344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aa9120 con 0x7f8a780123a0 2024-09-18T01:45:27.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.689+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aa9970 con 0x5590a7a9cf90 2024-09-18T01:45:27.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.690+0000 7f8a7e20b640 1 -- 172.21.15.146:0/1696358968 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94079776619344] v31'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a70062040 con 0x7f8a780123a0 2024-09-18T01:45:27.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.690+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v31'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a68051070 con 0x5590a7a9cf90 2024-09-18T01:45:27.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.690+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94079776623728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aa9970 con 0x5590a7a9cf90 2024-09-18T01:45:27.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.690+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aaa460 con 0x5590a7aa3200 2024-09-18T01:45:27.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.691+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94079776623728] v31'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a68051070 con 0x5590a7a9cf90 2024-09-18T01:45:27.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.692+0000 7f8a7ea0c640 1 -- 172.21.15.146:0/1696358968 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v31'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a78057040 con 0x5590a7aa3200 2024-09-18T01:45:27.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.692+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94079776628528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aa9970 con 0x5590a7aa3200 2024-09-18T01:45:27.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.692+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aaaf10 con 0x7f8a780123a0 2024-09-18T01:45:27.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.693+0000 7f8a7ea0c640 1 -- 172.21.15.146:0/1696358968 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94079776628528] v31'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a78057040 con 0x5590a7aa3200 2024-09-18T01:45:27.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.693+0000 7f8a7e20b640 1 -- 172.21.15.146:0/1696358968 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v31'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a70062040 con 0x7f8a780123a0 2024-09-18T01:45:27.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.693+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94079776625856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aa98e0 con 0x7f8a780123a0 2024-09-18T01:45:27.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.693+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aabdd0 con 0x5590a7a9cf90 2024-09-18T01:45:27.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.695+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v31'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a68051070 con 0x5590a7a9cf90 2024-09-18T01:45:27.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.695+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94079776635168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aabd40 con 0x5590a7a9cf90 2024-09-18T01:45:27.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.695+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aacdc0 con 0x7f8a7002c060 2024-09-18T01:45:27.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.695+0000 7f8a7e20b640 1 -- 172.21.15.146:0/1696358968 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94079776625856] v31'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a70062040 con 0x7f8a780123a0 2024-09-18T01:45:27.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.696+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94079776635168] v31'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a68051070 con 0x5590a7a9cf90 2024-09-18T01:45:27.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.696+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v31'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a68051070 con 0x7f8a7002c060 2024-09-18T01:45:27.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.696+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94079776639120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aacd80 con 0x7f8a7002c060 2024-09-18T01:45:27.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.696+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aad660 con 0x7f8a7002c060 2024-09-18T01:45:27.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.697+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94079776639120] v31'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a68051070 con 0x7f8a7002c060 2024-09-18T01:45:27.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.697+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v31'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a68051070 con 0x7f8a7002c060 2024-09-18T01:45:27.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.697+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94079776633600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aacd80 con 0x7f8a7002c060 2024-09-18T01:45:27.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.697+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aadc80 con 0x7f8a7002c060 2024-09-18T01:45:27.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.698+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94079776633600] v31'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a68051070 con 0x7f8a7002c060 2024-09-18T01:45:27.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.701+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v31'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a68051070 con 0x7f8a7002c060 2024-09-18T01:45:27.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.701+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94079776641456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aadc80 con 0x7f8a7002c060 2024-09-18T01:45:27.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.701+0000 7f8a80717800 20 add_watcher() i=0 2024-09-18T01:45:27.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.701+0000 7f8a80717800 20 add_watcher() i=1 2024-09-18T01:45:27.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.701+0000 7f8a80717800 20 add_watcher() i=2 2024-09-18T01:45:27.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.701+0000 7f8a80717800 20 add_watcher() i=3 2024-09-18T01:45:27.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.701+0000 7f8a80717800 20 add_watcher() i=4 2024-09-18T01:45:27.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.701+0000 7f8a80717800 20 add_watcher() i=5 2024-09-18T01:45:27.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.701+0000 7f8a80717800 20 add_watcher() i=6 2024-09-18T01:45:27.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.702+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94079776641456] v31'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a68051070 con 0x7f8a7002c060 2024-09-18T01:45:27.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.702+0000 7f8a80717800 20 add_watcher() i=7 2024-09-18T01:45:27.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.702+0000 7f8a80717800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:27.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.702+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5590a7ab1000 con 0x5590a7a9cf90 2024-09-18T01:45:27.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.702+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8a68051070 con 0x5590a7a9cf90 2024-09-18T01:45:27.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.702+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94079776643392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aae210 con 0x5590a7a9cf90 2024-09-18T01:45:27.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.703+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94079776643392] v31'127 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8a68051070 con 0x5590a7a9cf90 2024-09-18T01:45:27.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.703+0000 7f8934fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:27.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.704+0000 7f8a80717800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:27.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.704+0000 7f8a80717800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:27.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.704+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7ab9a90 con 0x5590a7a9cf90 2024-09-18T01:45:27.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.705+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'46 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8a68051070 con 0x5590a7a9cf90 2024-09-18T01:45:27.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.705+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aba160 con 0x7f8a7002c060 2024-09-18T01:45:27.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.706+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8a68051070 con 0x7f8a7002c060 2024-09-18T01:45:27.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.706+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aba5a0 con 0x5590a7aa3200 2024-09-18T01:45:27.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.707+0000 7f8a7ea0c640 1 -- 172.21.15.146:0/1696358968 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8a78057040 con 0x5590a7aa3200 2024-09-18T01:45:27.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.707+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aba580 con 0x5590a7a9cf90 2024-09-18T01:45:27.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.708+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'128 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8a68051070 con 0x5590a7a9cf90 2024-09-18T01:45:27.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.708+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7abab10 con 0x7f8a780123a0 2024-09-18T01:45:27.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.709+0000 7f8a7e20b640 1 -- 172.21.15.146:0/1696358968 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'41 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8a70062040 con 0x7f8a780123a0 2024-09-18T01:45:27.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.709+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7abaf70 con 0x5590a7aa3200 2024-09-18T01:45:27.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.710+0000 7f8a7ea0c640 1 -- 172.21.15.146:0/1696358968 <== osd.3 v2:172.21.15.146:6809/4106661138 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'37 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8a78057040 con 0x5590a7aa3200 2024-09-18T01:45:27.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.710+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7abaf70 con 0x5590a7a9cf90 2024-09-18T01:45:27.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.711+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8a68051070 con 0x5590a7a9cf90 2024-09-18T01:45:27.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.711+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7abaf70 con 0x7f8a7002c060 2024-09-18T01:45:27.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.712+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'29 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8a68051070 con 0x7f8a7002c060 2024-09-18T01:45:27.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.712+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7abb000 con 0x7f8a780123a0 2024-09-18T01:45:27.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.713+0000 7f8a7e20b640 1 -- 172.21.15.146:0/1696358968 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8a70062040 con 0x7f8a780123a0 2024-09-18T01:45:27.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.713+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7abb610 con 0x5590a7aa3200 2024-09-18T01:45:27.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.714+0000 7f8a7ea0c640 1 -- 172.21.15.146:0/1696358968 <== osd.3 v2:172.21.15.146:6809/4106661138 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8a78057040 con 0x5590a7aa3200 2024-09-18T01:45:27.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.714+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7abb610 con 0x7f8a780123a0 2024-09-18T01:45:27.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.715+0000 7f8a7e20b640 1 -- 172.21.15.146:0/1696358968 <== osd.2 v2:172.21.15.146:6800/3820039304 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'42 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8a70062040 con 0x7f8a780123a0 2024-09-18T01:45:27.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.715+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7abb610 con 0x7f8a7002c060 2024-09-18T01:45:27.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.716+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'17 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8a68051070 con 0x7f8a7002c060 2024-09-18T01:45:27.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.716+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7abb610 con 0x7f8a780123a0 2024-09-18T01:45:27.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.717+0000 7f8a7e20b640 1 -- 172.21.15.146:0/1696358968 <== osd.2 v2:172.21.15.146:6800/3820039304 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8a70062040 con 0x7f8a780123a0 2024-09-18T01:45:27.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.717+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7abb610 con 0x7f8a7002c060 2024-09-18T01:45:27.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.719+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'41 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8a68051070 con 0x7f8a7002c060 2024-09-18T01:45:27.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.719+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7abb610 con 0x5590a7a9cf90 2024-09-18T01:45:27.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.720+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'129 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8a68051070 con 0x5590a7a9cf90 2024-09-18T01:45:27.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.720+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7abb610 con 0x5590a7aa3200 2024-09-18T01:45:27.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.721+0000 7f8a7ea0c640 1 -- 172.21.15.146:0/1696358968 <== osd.3 v2:172.21.15.146:6809/4106661138 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'35 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8a78057040 con 0x5590a7aa3200 2024-09-18T01:45:27.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.721+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7abb610 con 0x7f8a780123a0 2024-09-18T01:45:27.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.722+0000 7f8a7e20b640 1 -- 172.21.15.146:0/1696358968 <== osd.2 v2:172.21.15.146:6800/3820039304 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'43 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8a70062040 con 0x7f8a780123a0 2024-09-18T01:45:27.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.722+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7abb610 con 0x5590a7aa3200 2024-09-18T01:45:27.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.723+0000 7f8a7ea0c640 1 -- 172.21.15.146:0/1696358968 <== osd.3 v2:172.21.15.146:6809/4106661138 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'28 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8a78057040 con 0x5590a7aa3200 2024-09-18T01:45:27.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.723+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7abb610 con 0x5590a7a9cf90 2024-09-18T01:45:27.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.724+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8a68051070 con 0x5590a7a9cf90 2024-09-18T01:45:27.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.724+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7abb610 con 0x5590a7a9cf90 2024-09-18T01:45:27.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.725+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'130 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8a68051070 con 0x5590a7a9cf90 2024-09-18T01:45:27.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.725+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7abb610 con 0x5590a7aa3200 2024-09-18T01:45:27.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.726+0000 7f8a7ea0c640 1 -- 172.21.15.146:0/1696358968 <== osd.3 v2:172.21.15.146:6809/4106661138 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'36 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8a78057040 con 0x5590a7aa3200 2024-09-18T01:45:27.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.726+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7abb610 con 0x7f8a780123a0 2024-09-18T01:45:27.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.727+0000 7f8a7e20b640 1 -- 172.21.15.146:0/1696358968 <== osd.2 v2:172.21.15.146:6800/3820039304 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'31 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8a70062040 con 0x7f8a780123a0 2024-09-18T01:45:27.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.727+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7abb610 con 0x5590a7aa3200 2024-09-18T01:45:27.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.728+0000 7f8a7ea0c640 1 -- 172.21.15.146:0/1696358968 <== osd.3 v2:172.21.15.146:6809/4106661138 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'23 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8a78057040 con 0x5590a7aa3200 2024-09-18T01:45:27.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.728+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7abb610 con 0x5590a7aa3200 2024-09-18T01:45:27.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.729+0000 7f8a7ea0c640 1 -- 172.21.15.146:0/1696358968 <== osd.3 v2:172.21.15.146:6809/4106661138 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'33 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8a78057040 con 0x5590a7aa3200 2024-09-18T01:45:27.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.729+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7abb610 con 0x5590a7aa3200 2024-09-18T01:45:27.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.730+0000 7f8a7ea0c640 1 -- 172.21.15.146:0/1696358968 <== osd.3 v2:172.21.15.146:6809/4106661138 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8a78057040 con 0x5590a7aa3200 2024-09-18T01:45:27.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.730+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7abb610 con 0x5590a7aa3200 2024-09-18T01:45:27.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.730+0000 7f8a7ea0c640 1 -- 172.21.15.146:0/1696358968 <== osd.3 v2:172.21.15.146:6809/4106661138 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'38 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8a78057040 con 0x5590a7aa3200 2024-09-18T01:45:27.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.730+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7abb610 con 0x7f8a7002c060 2024-09-18T01:45:27.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.731+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'24 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8a68051070 con 0x7f8a7002c060 2024-09-18T01:45:27.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.731+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7abb610 con 0x5590a7aa3200 2024-09-18T01:45:27.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.732+0000 7f8a7ea0c640 1 -- 172.21.15.146:0/1696358968 <== osd.3 v2:172.21.15.146:6809/4106661138 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'27 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8a78057040 con 0x5590a7aa3200 2024-09-18T01:45:27.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.732+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7abb610 con 0x7f8a7002c060 2024-09-18T01:45:27.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.733+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.0 v2:172.21.15.129:6800/1759265424 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'30 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8a68051070 con 0x7f8a7002c060 2024-09-18T01:45:27.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.733+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7abb610 con 0x5590a7aa3200 2024-09-18T01:45:27.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.734+0000 7f8a7ea0c640 1 -- 172.21.15.146:0/1696358968 <== osd.3 v2:172.21.15.146:6809/4106661138 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'37 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8a78057040 con 0x5590a7aa3200 2024-09-18T01:45:27.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.734+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7abb610 con 0x7f8a7002c060 2024-09-18T01:45:27.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.736+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.0 v2:172.21.15.129:6800/1759265424 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'42 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8a68051070 con 0x7f8a7002c060 2024-09-18T01:45:27.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.736+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7abb610 con 0x7f8a780123a0 2024-09-18T01:45:27.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.737+0000 7f8a7e20b640 1 -- 172.21.15.146:0/1696358968 <== osd.2 v2:172.21.15.146:6800/3820039304 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8a70062040 con 0x7f8a780123a0 2024-09-18T01:45:27.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.737+0000 7f88af7fe640 20 reqs_thread_entry: start 2024-09-18T01:45:27.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.737+0000 7f8a80717800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:27.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.737+0000 7f8a80717800 20 Filter name: none 2024-09-18T01:45:27.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.738+0000 7f88ad7fa640 20 reqs_thread_entry: start 2024-09-18T01:45:27.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.738+0000 7f8a80717800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-18T01:45:27.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.738+0000 7f8a80717800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.738+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5590a7ae6510 con 0x7f8a7002c060 2024-09-18T01:45:27.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.738+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.0 v2:172.21.15.129:6800/1759265424 24 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f8a68051070 con 0x7f8a7002c060 2024-09-18T01:45:27.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.738+0000 7f8a80717800 20 rados_obj.operate() r=0 bl.length=380 2024-09-18T01:45:27.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.738+0000 7f8a80717800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-18T01:45:27.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.738+0000 7f8a80717800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-18T01:45:27.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.738+0000 7f8a80717800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:45:27.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.738+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5590a7ae8e40 con 0x7f8a7002c060 2024-09-18T01:45:27.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.738+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.0 v2:172.21.15.129:6800/1759265424 25 ==== osd_op_reply(95 fud.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 155+0+15 (crc 0 0 0) 0x7f8a68051070 con 0x7f8a7002c060 2024-09-18T01:45:27.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.738+0000 7f8a80717800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-18T01:45:27.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.738+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7ae6e20 con 0x7f8a7002c060 2024-09-18T01:45:27.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.739+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.0 v2:172.21.15.129:6800/1759265424 26 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v31'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f8a68051070 con 0x7f8a7002c060 2024-09-18T01:45:27.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.739+0000 7f8a80717800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-18T01:45:27.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.739+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94079776880944 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5590a7ae9430 con 0x5590a7aa3200 2024-09-18T01:45:27.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.739+0000 7f8a7ea0c640 1 -- 172.21.15.146:0/1696358968 <== osd.3 v2:172.21.15.146:6809/4106661138 26 ==== watch-notify(notify (1) cookie 94079776628528 notify 133143986179 ret 0) ==== 212+0+0 (crc 0 0 0) 0x5590a7ab94b0 con 0x5590a7aa3200 2024-09-18T01:45:27.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.740+0000 7f8961ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986179 cookie 94079776628528 notifier 4537 bl.length()=170 2024-09-18T01:45:27.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.740+0000 7f8961ffb640 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f8944003d60 con 0x5590a7aa3200 2024-09-18T01:45:27.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.740+0000 7f8a7ea0c640 1 -- 172.21.15.146:0/1696358968 <== osd.3 v2:172.21.15.146:6809/4106661138 27 ==== osd_op_reply(97 notify.2 [notify cookie 94079776880944 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8a78057040 con 0x5590a7aa3200 2024-09-18T01:45:27.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.740+0000 7f8a7ea0c640 1 -- 172.21.15.146:0/1696358968 <== osd.3 v2:172.21.15.146:6809/4106661138 28 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a78057040 con 0x5590a7aa3200 2024-09-18T01:45:27.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.740+0000 7f8a7ea0c640 1 -- 172.21.15.146:0/1696358968 <== osd.3 v2:172.21.15.146:6809/4106661138 29 ==== watch-notify(notify_complete (2) cookie 94079776880944 notify 133143986179 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f8a78062020 con 0x5590a7aa3200 2024-09-18T01:45:27.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.740+0000 7f8a80717800 10 removing email index: 2024-09-18T01:45:27.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.740+0000 7f8a80717800 10 removing user buckets index 2024-09-18T01:45:27.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.740+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:99 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7ae9330 con 0x7f8a7002c060 2024-09-18T01:45:27.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.741+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.0 v2:172.21.15.129:6800/1759265424 27 ==== osd_op_reply(99 fud.buckets [delete] v31'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f8a68051070 con 0x7f8a7002c060 2024-09-18T01:45:27.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.741+0000 7f8a80717800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-18T01:45:27.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.741+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94079776886400 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5590a7ae8940 con 0x7f8a7002c060 2024-09-18T01:45:27.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.741+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.0 v2:172.21.15.129:6800/1759265424 28 ==== watch-notify(notify (1) cookie 94079776633600 notify 133143986185 ret 0) ==== 202+0+0 (crc 0 0 0) 0x5590a7aba160 con 0x7f8a7002c060 2024-09-18T01:45:27.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.741+0000 7f89617fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986185 cookie 94079776633600 notifier 4537 bl.length()=160 2024-09-18T01:45:27.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.741+0000 7f89617fa640 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f88b40032c0 con 0x7f8a7002c060 2024-09-18T01:45:27.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.741+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.0 v2:172.21.15.129:6800/1759265424 29 ==== osd_op_reply(100 notify.6 [notify cookie 94079776886400 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8a68051070 con 0x7f8a7002c060 2024-09-18T01:45:27.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.741+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.0 v2:172.21.15.129:6800/1759265424 30 ==== osd_op_reply(101 notify.6 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a68051070 con 0x7f8a7002c060 2024-09-18T01:45:27.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.741+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.0 v2:172.21.15.129:6800/1759265424 31 ==== watch-notify(notify_complete (2) cookie 94079776886400 notify 133143986185 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5590a7a946f0 con 0x7f8a7002c060 2024-09-18T01:45:27.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.742+0000 7f8a80717800 10 removing user index: fud 2024-09-18T01:45:27.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.742+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7ae9330 con 0x7f8a7002c060 2024-09-18T01:45:27.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.742+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.0 v2:172.21.15.129:6800/1759265424 32 ==== osd_op_reply(102 fud [call,call,delete] v31'6 uv6 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f8a68051070 con 0x7f8a7002c060 2024-09-18T01:45:27.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.742+0000 7f8a80717800 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-18T01:45:27.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.742+0000 7f8a80717800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-18T01:45:27.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.742+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify cookie 94079776886400 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5590a7ae7930 con 0x7f8a7002c060 2024-09-18T01:45:27.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.743+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.0 v2:172.21.15.129:6800/1759265424 33 ==== watch-notify(notify (1) cookie 94079776639120 notify 133143986186 ret 0) ==== 194+0+0 (crc 0 0 0) 0x5590a7a946f0 con 0x7f8a7002c060 2024-09-18T01:45:27.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.743+0000 7f8961ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986186 cookie 94079776639120 notifier 4537 bl.length()=152 2024-09-18T01:45:27.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.743+0000 7f8961ffb640 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:104 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f8944003d60 con 0x7f8a7002c060 2024-09-18T01:45:27.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.743+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.0 v2:172.21.15.129:6800/1759265424 34 ==== osd_op_reply(103 notify.5 [notify cookie 94079776886400 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8a68051070 con 0x7f8a7002c060 2024-09-18T01:45:27.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.743+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.0 v2:172.21.15.129:6800/1759265424 35 ==== osd_op_reply(104 notify.5 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a68051070 con 0x7f8a7002c060 2024-09-18T01:45:27.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.743+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.0 v2:172.21.15.129:6800/1759265424 36 ==== watch-notify(notify_complete (2) cookie 94079776886400 notify 133143986186 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5590a7ab9c20 con 0x7f8a7002c060 2024-09-18T01:45:27.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.744+0000 7f8934fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:27.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.744+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94079776643392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7ae9330 con 0x5590a7a9cf90 2024-09-18T01:45:27.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.745+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.1 v2:172.21.15.146:6808/3930274777 28 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94079776643392] v31'131 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8a68051070 con 0x5590a7a9cf90 2024-09-18T01:45:27.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.745+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94079776619344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7ae9330 con 0x7f8a780123a0 2024-09-18T01:45:27.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.746+0000 7f8a7e20b640 1 -- 172.21.15.146:0/1696358968 <== osd.2 v2:172.21.15.146:6800/3820039304 19 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94079776619344] v31'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a70062040 con 0x7f8a780123a0 2024-09-18T01:45:27.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.746+0000 7f8a80717800 20 remove_watcher() i=0 2024-09-18T01:45:27.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.746+0000 7f8a80717800 2 removed watcher, disabling cache 2024-09-18T01:45:27.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.746+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94079776623728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7ae9330 con 0x5590a7a9cf90 2024-09-18T01:45:27.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.747+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.1 v2:172.21.15.146:6808/3930274777 29 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94079776623728] v31'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a68051070 con 0x5590a7a9cf90 2024-09-18T01:45:27.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.747+0000 7f8a80717800 20 remove_watcher() i=1 2024-09-18T01:45:27.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.747+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94079776628528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aa7b50 con 0x5590a7aa3200 2024-09-18T01:45:27.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.748+0000 7f8a7ea0c640 1 -- 172.21.15.146:0/1696358968 <== osd.3 v2:172.21.15.146:6809/4106661138 30 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94079776628528] v31'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a78064040 con 0x5590a7aa3200 2024-09-18T01:45:27.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.748+0000 7f8a80717800 20 remove_watcher() i=2 2024-09-18T01:45:27.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.748+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94079776625856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aa7b50 con 0x7f8a780123a0 2024-09-18T01:45:27.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.749+0000 7f8a7e20b640 1 -- 172.21.15.146:0/1696358968 <== osd.2 v2:172.21.15.146:6800/3820039304 20 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94079776625856] v31'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a70062040 con 0x7f8a780123a0 2024-09-18T01:45:27.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.749+0000 7f8a80717800 20 remove_watcher() i=3 2024-09-18T01:45:27.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.749+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94079776635168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aa94c0 con 0x5590a7a9cf90 2024-09-18T01:45:27.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.750+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.1 v2:172.21.15.146:6808/3930274777 30 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94079776635168] v31'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a68051070 con 0x5590a7a9cf90 2024-09-18T01:45:27.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.750+0000 7f8a80717800 20 remove_watcher() i=4 2024-09-18T01:45:27.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.750+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94079776639120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aa7b50 con 0x7f8a7002c060 2024-09-18T01:45:27.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.751+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.0 v2:172.21.15.129:6800/1759265424 37 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94079776639120] v31'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a68051070 con 0x7f8a7002c060 2024-09-18T01:45:27.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.751+0000 7f8a80717800 20 remove_watcher() i=5 2024-09-18T01:45:27.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.751+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94079776633600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aab920 con 0x7f8a7002c060 2024-09-18T01:45:27.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.752+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.0 v2:172.21.15.129:6800/1759265424 38 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94079776633600] v31'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a68051070 con 0x7f8a7002c060 2024-09-18T01:45:27.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.752+0000 7f8a80717800 20 remove_watcher() i=6 2024-09-18T01:45:27.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.752+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94079776641456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5590a7aa94c0 con 0x7f8a7002c060 2024-09-18T01:45:27.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.753+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 <== osd.0 v2:172.21.15.129:6800/1759265424 39 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94079776641456] v31'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a68051070 con 0x7f8a7002c060 2024-09-18T01:45:27.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.753+0000 7f8a80717800 20 remove_watcher() i=7 2024-09-18T01:45:27.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.753+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f8a7002c060 msgr2=0x7f8a7000c590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.753+0000 7f8a80717800 1 --2- 172.21.15.146:0/1696358968 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f8a7002c060 0x7f8a7000c590 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.753+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5590a7a9cf90 msgr2=0x5590a7a9f450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.753+0000 7f8a80717800 1 --2- 172.21.15.146:0/1696358968 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5590a7a9cf90 0x5590a7a9f450 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.753+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f8a780123a0 msgr2=0x7f8a78036580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.753+0000 7f8a80717800 1 --2- 172.21.15.146:0/1696358968 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f8a780123a0 0x7f8a78036580 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.753+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5590a7aa3200 msgr2=0x5590a7aa55f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.753+0000 7f8a80717800 1 --2- 172.21.15.146:0/1696358968 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5590a7aa3200 0x5590a7aa55f0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.753+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8948036b90 msgr2=0x7f8948039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.753+0000 7f8a80717800 1 --2- 172.21.15.146:0/1696358968 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8948036b90 0x7f8948039050 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8a70016fd0 tx=0x7f8a70037000 comp rx=0 tx=0).stop 2024-09-18T01:45:27.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.753+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5590a7a89f40 msgr2=0x5590a7a91270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.753+0000 7f8a77fff640 1 -- 172.21.15.146:0/1696358968 reap_dead start 2024-09-18T01:45:27.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.753+0000 7f8a80717800 1 --2- 172.21.15.146:0/1696358968 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5590a7a89f40 0x5590a7a91270 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f8a7804b7b0 tx=0x7f8a7804c820 comp rx=0 tx=0).stop 2024-09-18T01:45:27.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.753+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 shutdown_connections 2024-09-18T01:45:27.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.753+0000 7f8a80717800 1 --2- 172.21.15.146:0/1696358968 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5590a7a89f40 0x5590a7a91270 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.753+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 >> 172.21.15.146:0/1696358968 conn(0x5590a7a861e0 msgr2=0x5590a7a84300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:27.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.754+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 shutdown_connections 2024-09-18T01:45:27.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.754+0000 7f8a80717800 1 -- 172.21.15.146:0/1696358968 wait complete. 2024-09-18T01:45:27.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.754+0000 7f8a80717800 1 -- 172.21.15.146:0/2090036701 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8958036b90 msgr2=0x7f8958039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.754+0000 7f8a80717800 1 --2- 172.21.15.146:0/2090036701 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8958036b90 0x7f8958039050 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8a7000dfd0 tx=0x7f8a7002ae80 comp rx=0 tx=0).stop 2024-09-18T01:45:27.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.754+0000 7f8a80717800 1 -- 172.21.15.146:0/2090036701 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5590a7a58f30 msgr2=0x5590a7a57580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.754+0000 7f8a80717800 1 --2- 172.21.15.146:0/2090036701 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5590a7a58f30 0x5590a7a57580 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x5590a7a61660 tx=0x7f8a780178e0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.754+0000 7f8a80717800 1 -- 172.21.15.146:0/2090036701 shutdown_connections 2024-09-18T01:45:27.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.754+0000 7f8a80717800 1 --2- 172.21.15.146:0/2090036701 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8958036b90 0x7f8958039050 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.754+0000 7f8a80717800 1 --2- 172.21.15.146:0/2090036701 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5590a7a58f30 0x5590a7a57580 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.754+0000 7f8a80717800 1 -- 172.21.15.146:0/2090036701 >> 172.21.15.146:0/2090036701 conn(0x5590a7a6ff80 msgr2=0x5590a7a72b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:27.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.754+0000 7f8a80717800 1 -- 172.21.15.146:0/2090036701 shutdown_connections 2024-09-18T01:45:27.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.754+0000 7f8a80717800 1 -- 172.21.15.146:0/2090036701 wait complete. 2024-09-18T01:45:27.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.754+0000 7f8a80717800 1 -- 172.21.15.146:0/3353893895 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5590a796c900 msgr2=0x5590a7a672d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.754+0000 7f8a80717800 1 --2- 172.21.15.146:0/3353893895 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5590a796c900 0x5590a7a672d0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.754+0000 7f8a80717800 1 -- 172.21.15.146:0/3353893895 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5590a7a6aa40 msgr2=0x5590a7a6ce30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.754+0000 7f8a80717800 1 --2- 172.21.15.146:0/3353893895 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5590a7a6aa40 0x5590a7a6ce30 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.754+0000 7f8a80717800 1 -- 172.21.15.146:0/3353893895 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8964036b40 msgr2=0x7f8964039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.754+0000 7f8a80717800 1 --2- 172.21.15.146:0/3353893895 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8964036b40 0x7f8964039000 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8a68057000 tx=0x7f8a68052000 comp rx=0 tx=0).stop 2024-09-18T01:45:27.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.754+0000 7f8a80717800 1 -- 172.21.15.146:0/3353893895 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5590a79684c0 msgr2=0x5590a7a60260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.754+0000 7f8a80717800 1 --2- 172.21.15.146:0/3353893895 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5590a79684c0 0x5590a7a60260 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f8a70004000 tx=0x7f8a70000bc0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.754+0000 7f8a80717800 1 -- 172.21.15.146:0/3353893895 shutdown_connections 2024-09-18T01:45:27.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.754+0000 7f8a80717800 1 --2- 172.21.15.146:0/3353893895 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5590a7a6aa40 0x5590a7a6ce30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.754+0000 7f8a80717800 1 --2- 172.21.15.146:0/3353893895 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5590a796c900 0x5590a7a672d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.754+0000 7f8a80717800 1 --2- 172.21.15.146:0/3353893895 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8964036b40 0x7f8964039000 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.754+0000 7f8a80717800 1 --2- 172.21.15.146:0/3353893895 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5590a79684c0 0x5590a7a60260 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.754+0000 7f8a80717800 1 -- 172.21.15.146:0/3353893895 >> 172.21.15.146:0/3353893895 conn(0x5590a7963df0 msgr2=0x5590a7a51a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:27.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.755+0000 7f8a80717800 1 -- 172.21.15.146:0/3353893895 shutdown_connections 2024-09-18T01:45:27.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.755+0000 7f8a80717800 1 -- 172.21.15.146:0/3353893895 wait complete. 2024-09-18T01:45:27.763 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-18T01:45:27.764 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-18T01:45:27.764 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --tenant testx --uid tenanteduser --display-name tenanted-user --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-18T01:45:27.857 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:27.858 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:27.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.858+0000 7fe2d8b29800 1 Processor -- start 2024-09-18T01:45:27.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.858+0000 7fe2d8b29800 1 -- start start 2024-09-18T01:45:27.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.858+0000 7fe2d8b29800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55adcac82640 0x55adcad13650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.858+0000 7fe2d8b29800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55adcabcdb30 con 0x55adcad13b90 2024-09-18T01:45:27.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.858+0000 7fe2d8b29800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x55adcabaf360 con 0x55adcac82640 2024-09-18T01:45:27.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.858+0000 7fe2d4879640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55adcac82640 0x55adcad13650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.858+0000 7fe2d4879640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55adcac82640 0x55adcad13650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:57784/0 (socket says 172.21.15.146:57784) 2024-09-18T01:45:27.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.858+0000 7fe2cffff640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x55adcad13b90 0x55adcad15f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:47328/0 (socket says 172.21.15.146:47328) 2024-09-18T01:45:27.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.858+0000 7fe2d4879640 1 -- 172.21.15.146:0/3220732192 learned_addr learned my addr 172.21.15.146:0/3220732192 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:27.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.859+0000 7fe2d4879640 1 -- 172.21.15.146:0/3220732192 >> v1:172.21.15.129:6789/0 conn(0x55adcad13b90 legacy=0x55adcad15f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.859+0000 7fe2d4879640 1 -- 172.21.15.146:0/3220732192 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adcabd5e00 con 0x55adcac82640 2024-09-18T01:45:27.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.859+0000 7fe2cf7fe640 1 -- 172.21.15.146:0/3220732192 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1687089716 0 0) 0x55adcabcdb30 con 0x55adcad13b90 2024-09-18T01:45:27.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.860+0000 7fe2d4879640 1 --2- 172.21.15.146:0/3220732192 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55adcac82640 0x55adcad13650 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fe2c800a520 tx=0x7fe2c8045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e12de2da925d1bc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.860+0000 7fe2cf7fe640 1 -- 172.21.15.146:0/3220732192 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2c8055070 con 0x55adcac82640 2024-09-18T01:45:27.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.860+0000 7fe2cf7fe640 1 -- 172.21.15.146:0/3220732192 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2c80515b0 con 0x55adcac82640 2024-09-18T01:45:27.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.861+0000 7fe2cf7fe640 1 -- 172.21.15.146:0/3220732192 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2c80518d0 con 0x55adcac82640 2024-09-18T01:45:27.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.861+0000 7fe2d8b29800 1 -- 172.21.15.146:0/3220732192 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55adcac82640 msgr2=0x55adcad13650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.861+0000 7fe2d8b29800 1 --2- 172.21.15.146:0/3220732192 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55adcac82640 0x55adcad13650 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fe2c800a520 tx=0x7fe2c8045ba0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.861+0000 7fe2d8b29800 1 -- 172.21.15.146:0/3220732192 shutdown_connections 2024-09-18T01:45:27.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.861+0000 7fe2d8b29800 1 --2- 172.21.15.146:0/3220732192 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55adcac82640 0x55adcad13650 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.861+0000 7fe2d8b29800 1 -- 172.21.15.146:0/3220732192 >> 172.21.15.146:0/3220732192 conn(0x55adcad08de0 msgr2=0x55adcad0b200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:27.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.861+0000 7fe2d8b29800 1 -- 172.21.15.146:0/3220732192 shutdown_connections 2024-09-18T01:45:27.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.861+0000 7fe2d8b29800 1 -- 172.21.15.146:0/3220732192 wait complete. 2024-09-18T01:45:27.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.875+0000 7fe2d8b29800 1 Processor -- start 2024-09-18T01:45:27.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.875+0000 7fe2d8b29800 1 -- start start 2024-09-18T01:45:27.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.875+0000 7fe2d8b29800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55adcac82640 0x55adcadff910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.875+0000 7fe2d8b29800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55adcac5a450 con 0x55adcac82640 2024-09-18T01:45:27.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.875+0000 7fe2d4879640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55adcac82640 0x55adcadff910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.875+0000 7fe2d4879640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55adcac82640 0x55adcadff910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:57796/0 (socket says 172.21.15.146:57796) 2024-09-18T01:45:27.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.875+0000 7fe2d4879640 1 -- 172.21.15.146:0/705270296 learned_addr learned my addr 172.21.15.146:0/705270296 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:27.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.875+0000 7fe2d4879640 1 -- 172.21.15.146:0/705270296 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adcaba7bc0 con 0x55adcac82640 2024-09-18T01:45:27.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.875+0000 7fe2d4879640 1 --2- 172.21.15.146:0/705270296 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55adcac82640 0x55adcadff910 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8025da0 tx=0x7fe2c8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19a17a9d0a6d6ca server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.876+0000 7fe1c1e13640 1 -- 172.21.15.146:0/705270296 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2c8051ac0 con 0x55adcac82640 2024-09-18T01:45:27.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.876+0000 7fe1c1e13640 1 -- 172.21.15.146:0/705270296 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2c8051c60 con 0x55adcac82640 2024-09-18T01:45:27.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.876+0000 7fe1c1e13640 1 -- 172.21.15.146:0/705270296 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2c8066460 con 0x55adcac82640 2024-09-18T01:45:27.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.876+0000 7fe2d8b29800 1 -- 172.21.15.146:0/705270296 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55adcac82640 msgr2=0x55adcadff910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.876+0000 7fe2d8b29800 1 --2- 172.21.15.146:0/705270296 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55adcac82640 0x55adcadff910 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8025da0 tx=0x7fe2c8051000 comp rx=0 tx=0).stop 2024-09-18T01:45:27.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.876+0000 7fe2d8b29800 1 -- 172.21.15.146:0/705270296 shutdown_connections 2024-09-18T01:45:27.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.876+0000 7fe2d8b29800 1 --2- 172.21.15.146:0/705270296 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55adcac82640 0x55adcadff910 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.876+0000 7fe2d8b29800 1 -- 172.21.15.146:0/705270296 >> 172.21.15.146:0/705270296 conn(0x55adcad08de0 msgr2=0x55adcadfb2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:27.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.876+0000 7fe2d8b29800 1 -- 172.21.15.146:0/705270296 shutdown_connections 2024-09-18T01:45:27.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.876+0000 7fe2d8b29800 1 -- 172.21.15.146:0/705270296 wait complete. 2024-09-18T01:45:27.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.877+0000 7fe2d8b29800 1 Processor -- start 2024-09-18T01:45:27.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.877+0000 7fe2d8b29800 1 -- start start 2024-09-18T01:45:27.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.877+0000 7fe2d8b29800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55adcac82640 0x55adcae07240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.877+0000 7fe2d8b29800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55adcad17940 con 0x55adcac82640 2024-09-18T01:45:27.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.877+0000 7fe2d4879640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55adcac82640 0x55adcae07240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.877+0000 7fe2d4879640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55adcac82640 0x55adcae07240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:57808/0 (socket says 172.21.15.146:57808) 2024-09-18T01:45:27.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.877+0000 7fe2d4879640 1 -- 172.21.15.146:0/2498056888 learned_addr learned my addr 172.21.15.146:0/2498056888 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:27.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.877+0000 7fe2d4879640 1 -- 172.21.15.146:0/2498056888 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adcabbbfe0 con 0x55adcac82640 2024-09-18T01:45:27.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.878+0000 7fe2d4879640 1 --2- 172.21.15.146:0/2498056888 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55adcac82640 0x55adcae07240 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe2c80460a0 tx=0x7fe2c8003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.878+0000 7fe1bbfff640 1 -- 172.21.15.146:0/2498056888 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2c8066650 con 0x55adcac82640 2024-09-18T01:45:27.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.878+0000 7fe1bbfff640 1 -- 172.21.15.146:0/2498056888 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2c80667f0 con 0x55adcac82640 2024-09-18T01:45:27.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.878+0000 7fe2d8b29800 1 -- 172.21.15.146:0/2498056888 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55adcae07780 con 0x55adcac82640 2024-09-18T01:45:27.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.878+0000 7fe1bbfff640 1 -- 172.21.15.146:0/2498056888 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2c8066af0 con 0x55adcac82640 2024-09-18T01:45:27.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.878+0000 7fe2d8b29800 1 -- 172.21.15.146:0/2498056888 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55adcae07ca0 con 0x55adcac82640 2024-09-18T01:45:27.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.879+0000 7fe1bbfff640 1 -- 172.21.15.146:0/2498056888 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe2c8079060 con 0x55adcac82640 2024-09-18T01:45:27.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.879+0000 7fe1bbfff640 1 --2- 172.21.15.146:0/2498056888 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fe1bc036b40 0x7fe1bc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.879+0000 7fe1bbfff640 1 -- 172.21.15.146:0/2498056888 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fe2c8062070 con 0x55adcac82640 2024-09-18T01:45:27.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.879+0000 7fe2cffff640 1 --2- 172.21.15.146:0/2498056888 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fe1bc036b40 0x7fe1bc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.879+0000 7fe2d8b29800 1 --2- 172.21.15.146:0/2498056888 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55adcad13b90 0x55adcae0e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.879+0000 7fe2d8b29800 1 -- 172.21.15.146:0/2498056888 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55adcae0e830 con 0x55adcad13b90 2024-09-18T01:45:27.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.879+0000 7fe2d507a640 1 --2- 172.21.15.146:0/2498056888 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55adcad13b90 0x55adcae0e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.879+0000 7fe2cffff640 1 --2- 172.21.15.146:0/2498056888 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fe1bc036b40 0x7fe1bc039000 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe2c0000c00 tx=0x7fe2c00013b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.879+0000 7fe2d507a640 1 --2- 172.21.15.146:0/2498056888 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55adcad13b90 0x55adcae0e2b0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.880+0000 7fe2d507a640 1 -- 172.21.15.146:0/2498056888 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe2d000a4a0 con 0x55adcad13b90 2024-09-18T01:45:27.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.880+0000 7fe2d8b29800 1 -- 172.21.15.146:0/2498056888 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55adcae0b860 con 0x55adcad13b90 2024-09-18T01:45:27.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.880+0000 7fe2d507a640 1 -- 172.21.15.146:0/2498056888 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe2d000a4a0 con 0x55adcad13b90 2024-09-18T01:45:27.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.880+0000 7fe2d8b29800 1 -- 172.21.15.146:0/2498056888 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55adcae10610 con 0x55adcad13b90 2024-09-18T01:45:27.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.880+0000 7fe2d507a640 1 -- 172.21.15.146:0/2498056888 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe2d000a4a0 con 0x55adcad13b90 2024-09-18T01:45:27.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.880+0000 7fe2d8b29800 1 -- 172.21.15.146:0/2498056888 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55adcae0f750 con 0x55adcad13b90 2024-09-18T01:45:27.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.880+0000 7fe2d507a640 1 -- 172.21.15.146:0/2498056888 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe2d000a4a0 con 0x55adcad13b90 2024-09-18T01:45:27.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.880+0000 7fe2d8b29800 1 --2- 172.21.15.146:0/2498056888 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55adcae101f0 0x55adcae13a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.880+0000 7fe2d8b29800 1 -- 172.21.15.146:0/2498056888 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55adcae141e0 con 0x55adcae101f0 2024-09-18T01:45:27.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.881+0000 7fe2d4879640 1 --2- 172.21.15.146:0/2498056888 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55adcae101f0 0x55adcae13a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.881+0000 7fe2d4879640 1 --2- 172.21.15.146:0/2498056888 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55adcae101f0 0x55adcae13a50 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.881+0000 7fe2d4879640 1 -- 172.21.15.146:0/2498056888 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe2c8057030 con 0x55adcae101f0 2024-09-18T01:45:27.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.881+0000 7fe2d8b29800 1 Processor -- start 2024-09-18T01:45:27.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.882+0000 7fe2d8b29800 1 -- start start 2024-09-18T01:45:27.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.882+0000 7fe2d8b29800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55adcae21f10 0x55adcae22330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.882+0000 7fe2d8b29800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55adcaba9580 con 0x55adcae21f10 2024-09-18T01:45:27.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.882+0000 7fe2d507a640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55adcae21f10 0x55adcae22330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.882+0000 7fe2d507a640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55adcae21f10 0x55adcae22330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:57814/0 (socket says 172.21.15.146:57814) 2024-09-18T01:45:27.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.882+0000 7fe2d507a640 1 -- 172.21.15.146:0/1116474408 learned_addr learned my addr 172.21.15.146:0/1116474408 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:27.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.882+0000 7fe2d507a640 1 -- 172.21.15.146:0/1116474408 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adcae22870 con 0x55adcae21f10 2024-09-18T01:45:27.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.883+0000 7fe2d507a640 1 --2- 172.21.15.146:0/1116474408 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55adcae21f10 0x55adcae22330 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x55adcae0ebf0 tx=0x7fe2d00178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.883+0000 7fe1b97fa640 1 -- 172.21.15.146:0/1116474408 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2d0013440 con 0x55adcae21f10 2024-09-18T01:45:27.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.883+0000 7fe1b97fa640 1 -- 172.21.15.146:0/1116474408 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2d00135e0 con 0x55adcae21f10 2024-09-18T01:45:27.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.883+0000 7fe2d8b29800 1 -- 172.21.15.146:0/1116474408 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55adcae22b00 con 0x55adcae21f10 2024-09-18T01:45:27.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.883+0000 7fe1b97fa640 1 -- 172.21.15.146:0/1116474408 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2d00138c0 con 0x55adcae21f10 2024-09-18T01:45:27.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.883+0000 7fe2d8b29800 1 -- 172.21.15.146:0/1116474408 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55adcae257e0 con 0x55adcae21f10 2024-09-18T01:45:27.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.884+0000 7fe1b97fa640 1 -- 172.21.15.146:0/1116474408 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe2d0011040 con 0x55adcae21f10 2024-09-18T01:45:27.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.884+0000 7fe1b97fa640 1 --2- 172.21.15.146:0/1116474408 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fe1ac036b90 0x7fe1ac039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.884+0000 7fe1b97fa640 1 -- 172.21.15.146:0/1116474408 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fe2d001d070 con 0x55adcae21f10 2024-09-18T01:45:27.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.884+0000 7fe2d4879640 1 --2- 172.21.15.146:0/1116474408 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fe1ac036b90 0x7fe1ac039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.884+0000 7fe2d8b29800 1 Processor -- start 2024-09-18T01:45:27.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.884+0000 7fe2d4879640 1 --2- 172.21.15.146:0/1116474408 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fe1ac036b90 0x7fe1ac039050 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x55adcae0faf0 tx=0x7fe2c808e6c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.884+0000 7fe2d8b29800 1 -- start start 2024-09-18T01:45:27.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.884+0000 7fe2d8b29800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55adcae2eb90 0x55adcae2ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.884+0000 7fe2d8b29800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55adcae00000 con 0x55adcae2eb90 2024-09-18T01:45:27.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.885+0000 7fe2d507a640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55adcae2eb90 0x55adcae2ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.885+0000 7fe2d507a640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55adcae2eb90 0x55adcae2ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:57816/0 (socket says 172.21.15.146:57816) 2024-09-18T01:45:27.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.885+0000 7fe2d507a640 1 -- 172.21.15.146:0/4201508380 learned_addr learned my addr 172.21.15.146:0/4201508380 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:27.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.885+0000 7fe2d507a640 1 -- 172.21.15.146:0/4201508380 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adcae2f560 con 0x55adcae2eb90 2024-09-18T01:45:27.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.885+0000 7fe2d507a640 1 --2- 172.21.15.146:0/4201508380 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55adcae2eb90 0x55adcae2ef90 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe2d004c890 tx=0x7fe2d00127a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21163a2cf0323b99 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.885+0000 7fe1b2ffd640 1 -- 172.21.15.146:0/4201508380 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2d0045070 con 0x55adcae2eb90 2024-09-18T01:45:27.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.885+0000 7fe1b2ffd640 1 -- 172.21.15.146:0/4201508380 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2d004e0d0 con 0x55adcae2eb90 2024-09-18T01:45:27.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.885+0000 7fe1b2ffd640 1 -- 172.21.15.146:0/4201508380 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2d0021a50 con 0x55adcae2eb90 2024-09-18T01:45:27.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.886+0000 7fe2d8b29800 1 -- 172.21.15.146:0/4201508380 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55adcae2eb90 msgr2=0x55adcae2ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.886+0000 7fe2d8b29800 1 --2- 172.21.15.146:0/4201508380 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55adcae2eb90 0x55adcae2ef90 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe2d004c890 tx=0x7fe2d00127a0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.886+0000 7fe2d8b29800 1 -- 172.21.15.146:0/4201508380 shutdown_connections 2024-09-18T01:45:27.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.886+0000 7fe2d8b29800 1 --2- 172.21.15.146:0/4201508380 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55adcae2eb90 0x55adcae2ef90 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.886+0000 7fe2d8b29800 1 -- 172.21.15.146:0/4201508380 >> 172.21.15.146:0/4201508380 conn(0x55adcae2aef0 msgr2=0x55adcae28ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:27.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.886+0000 7fe2d8b29800 1 -- 172.21.15.146:0/4201508380 shutdown_connections 2024-09-18T01:45:27.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.886+0000 7fe2d8b29800 1 -- 172.21.15.146:0/4201508380 wait complete. 2024-09-18T01:45:27.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.886+0000 7fe2d8b29800 1 Processor -- start 2024-09-18T01:45:27.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.886+0000 7fe2d8b29800 1 -- start start 2024-09-18T01:45:27.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.886+0000 7fe2d8b29800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55adcae2eb90 0x55adcae36070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.886+0000 7fe2d8b29800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55adcae2fc10 con 0x55adcae2eb90 2024-09-18T01:45:27.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.886+0000 7fe2d507a640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55adcae2eb90 0x55adcae36070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.886+0000 7fe2d507a640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55adcae2eb90 0x55adcae36070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:57830/0 (socket says 172.21.15.146:57830) 2024-09-18T01:45:27.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.886+0000 7fe2d507a640 1 -- 172.21.15.146:0/183281166 learned_addr learned my addr 172.21.15.146:0/183281166 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:27.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.886+0000 7fe2d507a640 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adcae365b0 con 0x55adcae2eb90 2024-09-18T01:45:27.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.887+0000 7fe2d507a640 1 --2- 172.21.15.146:0/183281166 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55adcae2eb90 0x55adcae36070 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe2d00127e0 tx=0x7fe2d004c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.887+0000 7fe1b17fa640 1 -- 172.21.15.146:0/183281166 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2d003a070 con 0x55adcae2eb90 2024-09-18T01:45:27.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.887+0000 7fe1b17fa640 1 -- 172.21.15.146:0/183281166 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2d0001540 con 0x55adcae2eb90 2024-09-18T01:45:27.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.887+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55adcae36840 con 0x55adcae2eb90 2024-09-18T01:45:27.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.887+0000 7fe1b17fa640 1 -- 172.21.15.146:0/183281166 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2d0045040 con 0x55adcae2eb90 2024-09-18T01:45:27.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.887+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55adcae394f0 con 0x55adcae2eb90 2024-09-18T01:45:27.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.887+0000 7fe1b17fa640 1 -- 172.21.15.146:0/183281166 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe2d003d070 con 0x55adcae2eb90 2024-09-18T01:45:27.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.888+0000 7fe1b17fa640 1 --2- 172.21.15.146:0/183281166 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fe19c036af0 0x7fe19c038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.888+0000 7fe1b17fa640 1 -- 172.21.15.146:0/183281166 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fe2d0032070 con 0x55adcae2eb90 2024-09-18T01:45:27.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.888+0000 7fe2d4879640 1 --2- 172.21.15.146:0/183281166 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fe19c036af0 0x7fe19c038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.888+0000 7fe2d4879640 1 --2- 172.21.15.146:0/183281166 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fe19c036af0 0x7fe19c038fb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe2c808efd0 tx=0x7fe2c808b000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.888+0000 7fe2d8b29800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.888+0000 7fe2d8b29800 1 --2- 172.21.15.146:0/183281166 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55adcae41d40 0x55adcae44200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.888+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55adcae44950 con 0x55adcae41d40 2024-09-18T01:45:27.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.888+0000 7fe2cffff640 1 --2- 172.21.15.146:0/183281166 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55adcae41d40 0x55adcae44200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.889+0000 7fe2cffff640 1 --2- 172.21.15.146:0/183281166 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55adcae41d40 0x55adcae44200 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.889+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe2c000f5f0 con 0x55adcae41d40 2024-09-18T01:45:27.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.889+0000 7fe2d8b29800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:27.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.889+0000 7fe2d8b29800 20 realm 2024-09-18T01:45:27.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.889+0000 7fe2d8b29800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.889+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55adcae41190 con 0x55adcae41d40 2024-09-18T01:45:27.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.889+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe2c000f5f0 con 0x55adcae41d40 2024-09-18T01:45:27.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.889+0000 7fe2d8b29800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:27.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.889+0000 7fe2d8b29800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:27.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.889+0000 7fe2d8b29800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.889+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55adcae45440 con 0x55adcae41d40 2024-09-18T01:45:27.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.889+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe2c000f5f0 con 0x55adcae41d40 2024-09-18T01:45:27.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.889+0000 7fe2d8b29800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:27.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.889+0000 7fe2d8b29800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.889+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55adcae45d10 con 0x55adcae41d40 2024-09-18T01:45:27.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.890+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe2c000f5f0 con 0x55adcae41d40 2024-09-18T01:45:27.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.890+0000 7fe2d8b29800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:27.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.890+0000 7fe2d8b29800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.890+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55adcae460b0 con 0x55adcae41d40 2024-09-18T01:45:27.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.890+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe2c000f5f0 con 0x55adcae41d40 2024-09-18T01:45:27.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.890+0000 7fe2d8b29800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:27.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.890+0000 7fe2d8b29800 20 searching for the correct realm 2024-09-18T01:45:27.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.890+0000 7fe2d8b29800 1 --2- 172.21.15.146:0/183281166 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55adcae47fe0 0x55adcae4a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.890+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55adcae4aac0 con 0x55adcae47fe0 2024-09-18T01:45:27.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.890+0000 7fe2d507a640 1 --2- 172.21.15.146:0/183281166 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55adcae47fe0 0x55adcae4a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.890+0000 7fe2d507a640 1 --2- 172.21.15.146:0/183281166 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55adcae47fe0 0x55adcae4a3f0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.891+0000 7fe2d507a640 1 -- 172.21.15.146:0/183281166 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2d003c030 con 0x55adcae47fe0 2024-09-18T01:45:27.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.891+0000 7fe2d507a640 1 --2- 172.21.15.146:0/183281166 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fe2d003f060 0x7fe2d0023070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.891+0000 7fe2d507a640 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55adcae4aac0 con 0x7fe2d003f060 2024-09-18T01:45:27.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.891+0000 7fe2d4879640 1 --2- 172.21.15.146:0/183281166 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fe2d003f060 0x7fe2d0023070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.891+0000 7fe2d4879640 1 --2- 172.21.15.146:0/183281166 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fe2d003f060 0x7fe2d0023070 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.891+0000 7fe2d4879640 1 -- 172.21.15.146:0/183281166 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2c8057030 con 0x7fe2d003f060 2024-09-18T01:45:27.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.891+0000 7fe2d4879640 1 --2- 172.21.15.146:0/183281166 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fe2c809e040 0x7fe2c805b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.891+0000 7fe2d4879640 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55adcae4aac0 con 0x7fe2c809e040 2024-09-18T01:45:27.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.891+0000 7fe2cffff640 1 --2- 172.21.15.146:0/183281166 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fe2c809e040 0x7fe2c805b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.892+0000 7fe2cffff640 1 --2- 172.21.15.146:0/183281166 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fe2c809e040 0x7fe2c805b030 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.892+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2c000f5f0 con 0x7fe2c809e040 2024-09-18T01:45:27.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.892+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55adcae4aac0 con 0x55adcae41d40 2024-09-18T01:45:27.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.892+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe2c000f5f0 con 0x55adcae41d40 2024-09-18T01:45:27.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.892+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55adcae4aac0 con 0x55adcae41d40 2024-09-18T01:45:27.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.893+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2c000f5f0 con 0x55adcae41d40 2024-09-18T01:45:27.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.893+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55adcae4aac0 con 0x7fe2c809e040 2024-09-18T01:45:27.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.893+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2c000f5f0 con 0x7fe2c809e040 2024-09-18T01:45:27.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.893+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55adcae4aac0 con 0x7fe2c809e040 2024-09-18T01:45:27.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.893+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2c000f5f0 con 0x7fe2c809e040 2024-09-18T01:45:27.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.893+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55adcae4aac0 con 0x7fe2d003f060 2024-09-18T01:45:27.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.893+0000 7fe2d4879640 1 -- 172.21.15.146:0/183281166 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2c8057030 con 0x7fe2d003f060 2024-09-18T01:45:27.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.893+0000 7fe2d4879640 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55adcae4aac0 con 0x55adcae47fe0 2024-09-18T01:45:27.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.893+0000 7fe2d507a640 1 -- 172.21.15.146:0/183281166 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2d003c030 con 0x55adcae47fe0 2024-09-18T01:45:27.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.893+0000 7fe2d507a640 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55adcae4aac0 con 0x55adcae41d40 2024-09-18T01:45:27.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.894+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2c000f5f0 con 0x55adcae41d40 2024-09-18T01:45:27.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.894+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55adcae4aac0 con 0x7fe2c809e040 2024-09-18T01:45:27.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.894+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2c000f5f0 con 0x7fe2c809e040 2024-09-18T01:45:27.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.894+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55adcae4aac0 con 0x55adcae41d40 2024-09-18T01:45:27.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.894+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2c000f5f0 con 0x55adcae41d40 2024-09-18T01:45:27.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.894+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55adcae4aac0 con 0x7fe2d003f060 2024-09-18T01:45:27.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.894+0000 7fe2d4879640 1 -- 172.21.15.146:0/183281166 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fe2c8057030 con 0x7fe2d003f060 2024-09-18T01:45:27.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.894+0000 7fe2d4879640 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55adcae4aac0 con 0x55adcae47fe0 2024-09-18T01:45:27.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.895+0000 7fe2d507a640 1 -- 172.21.15.146:0/183281166 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2d003c030 con 0x55adcae47fe0 2024-09-18T01:45:27.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.895+0000 7fe2d507a640 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55adcae4aac0 con 0x55adcae47fe0 2024-09-18T01:45:27.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.895+0000 7fe2d507a640 1 -- 172.21.15.146:0/183281166 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2d003c030 con 0x55adcae47fe0 2024-09-18T01:45:27.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.895+0000 7fe2d507a640 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55adcae4aac0 con 0x7fe2c809e040 2024-09-18T01:45:27.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.895+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2c000f5f0 con 0x7fe2c809e040 2024-09-18T01:45:27.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.895+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55adcae4aac0 con 0x55adcae47fe0 2024-09-18T01:45:27.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.895+0000 7fe2d507a640 1 -- 172.21.15.146:0/183281166 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2d003c030 con 0x55adcae47fe0 2024-09-18T01:45:27.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.895+0000 7fe2d507a640 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55adcae4aac0 con 0x55adcae47fe0 2024-09-18T01:45:27.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.896+0000 7fe2d507a640 1 -- 172.21.15.146:0/183281166 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2d003c030 con 0x55adcae47fe0 2024-09-18T01:45:27.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.896+0000 7fe2d507a640 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55adcae4aac0 con 0x55adcae41d40 2024-09-18T01:45:27.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.896+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2c000f5f0 con 0x55adcae41d40 2024-09-18T01:45:27.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.896+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55adcae4aac0 con 0x55adcae41d40 2024-09-18T01:45:27.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.896+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe2c000f5f0 con 0x55adcae41d40 2024-09-18T01:45:27.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.896+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55adcae4aac0 con 0x7fe2c809e040 2024-09-18T01:45:27.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.896+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2c000f5f0 con 0x7fe2c809e040 2024-09-18T01:45:27.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.896+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55adcae4aac0 con 0x55adcae47fe0 2024-09-18T01:45:27.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.896+0000 7fe2d507a640 1 -- 172.21.15.146:0/183281166 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2d003c030 con 0x55adcae47fe0 2024-09-18T01:45:27.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.896+0000 7fe2d507a640 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55adcae4aac0 con 0x7fe2d003f060 2024-09-18T01:45:27.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.897+0000 7fe2d4879640 1 -- 172.21.15.146:0/183281166 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2c8057030 con 0x7fe2d003f060 2024-09-18T01:45:27.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.897+0000 7fe2d4879640 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55adcae4aac0 con 0x55adcae41d40 2024-09-18T01:45:27.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.897+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2c000f5f0 con 0x55adcae41d40 2024-09-18T01:45:27.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.897+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55adcae4aac0 con 0x7fe2c809e040 2024-09-18T01:45:27.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.897+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2c003b040 con 0x7fe2c809e040 2024-09-18T01:45:27.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.897+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55adcae4aac0 con 0x55adcae47fe0 2024-09-18T01:45:27.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.897+0000 7fe2d507a640 1 -- 172.21.15.146:0/183281166 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2d003c030 con 0x55adcae47fe0 2024-09-18T01:45:27.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.897+0000 7fe2d507a640 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55adcae4aac0 con 0x7fe2c809e040 2024-09-18T01:45:27.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.898+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2c003b040 con 0x7fe2c809e040 2024-09-18T01:45:27.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.898+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55adcae4aac0 con 0x7fe2d003f060 2024-09-18T01:45:27.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.898+0000 7fe2d4879640 1 -- 172.21.15.146:0/183281166 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2c8057030 con 0x7fe2d003f060 2024-09-18T01:45:27.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.898+0000 7fe2d4879640 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55adcae4aac0 con 0x55adcae47fe0 2024-09-18T01:45:27.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.898+0000 7fe2d507a640 1 -- 172.21.15.146:0/183281166 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2d003c030 con 0x55adcae47fe0 2024-09-18T01:45:27.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.898+0000 7fe2d507a640 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55adcae4aac0 con 0x7fe2c809e040 2024-09-18T01:45:27.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.898+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2c003b040 con 0x7fe2c809e040 2024-09-18T01:45:27.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.898+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55adcae4aac0 con 0x55adcae41d40 2024-09-18T01:45:27.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.898+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe2c003b040 con 0x55adcae41d40 2024-09-18T01:45:27.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.899+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55adcae4aac0 con 0x7fe2d003f060 2024-09-18T01:45:27.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.899+0000 7fe2d4879640 1 -- 172.21.15.146:0/183281166 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2c80ad040 con 0x7fe2d003f060 2024-09-18T01:45:27.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.899+0000 7fe2d8b29800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:27.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.899+0000 7fe2d8b29800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:27.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.899+0000 7fe2d8b29800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:27.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.899+0000 7fe2d8b29800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:27.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.899+0000 7fe2d8b29800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:27.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.899+0000 7fe2d8b29800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:27.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.899+0000 7fe2d8b29800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.899+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55adcae46a80 con 0x55adcae41d40 2024-09-18T01:45:27.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.899+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe2c003b040 con 0x55adcae41d40 2024-09-18T01:45:27.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.899+0000 7fe2d8b29800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:27.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.899+0000 7fe2d8b29800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.899+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55adcae47320 con 0x55adcae41d40 2024-09-18T01:45:27.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.899+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe2c003b040 con 0x55adcae41d40 2024-09-18T01:45:27.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.899+0000 7fe2d8b29800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:27.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.899+0000 7fe2d8b29800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.899+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55adcae47320 con 0x7fe2d003f060 2024-09-18T01:45:27.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.900+0000 7fe2d4879640 1 -- 172.21.15.146:0/183281166 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe2c80ad040 con 0x7fe2d003f060 2024-09-18T01:45:27.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.900+0000 7fe2d8b29800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:27.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.900+0000 7fe2d8b29800 20 zone default found 2024-09-18T01:45:27.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.900+0000 7fe2d8b29800 4 Realm: () 2024-09-18T01:45:27.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.900+0000 7fe2d8b29800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:27.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.900+0000 7fe2d8b29800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:27.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.900+0000 7fe2d8b29800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:27.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.900+0000 7fe2d8b29800 20 zonegroup default 2024-09-18T01:45:27.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.900+0000 7fe2d8b29800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.900+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55adcae4b3f0 con 0x7fe2c809e040 2024-09-18T01:45:27.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.900+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe2c003b040 con 0x7fe2c809e040 2024-09-18T01:45:27.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.900+0000 7fe2d8b29800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:27.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.900+0000 7fe2d8b29800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.900+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55adcae4cdd0 con 0x55adcae47fe0 2024-09-18T01:45:27.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.900+0000 7fe2d507a640 1 -- 172.21.15.146:0/183281166 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe2d003c030 con 0x55adcae47fe0 2024-09-18T01:45:27.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.900+0000 7fe2d8b29800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:27.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.900+0000 7fe2d8b29800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.900+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55adcae4d250 con 0x55adcae47fe0 2024-09-18T01:45:27.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.901+0000 7fe2d507a640 1 -- 172.21.15.146:0/183281166 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe2d003c030 con 0x55adcae47fe0 2024-09-18T01:45:27.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.901+0000 7fe2d8b29800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:27.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.901+0000 7fe2d8b29800 20 started sync module instance, tier type = 2024-09-18T01:45:27.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.901+0000 7fe2d8b29800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:27.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.901+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55adcae4c260 con 0x7fe2d003f060 2024-09-18T01:45:27.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.902+0000 7fe2d4879640 1 -- 172.21.15.146:0/183281166 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v31'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2c80ad040 con 0x7fe2d003f060 2024-09-18T01:45:27.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.902+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94204921693776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55adcae4bec0 con 0x7fe2d003f060 2024-09-18T01:45:27.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.902+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55adcae4e180 con 0x55adcae41d40 2024-09-18T01:45:27.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.903+0000 7fe2d4879640 1 -- 172.21.15.146:0/183281166 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94204921693776] v31'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2c80ad040 con 0x7fe2d003f060 2024-09-18T01:45:27.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.903+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v31'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2c003b040 con 0x55adcae41d40 2024-09-18T01:45:27.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.903+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94204921699536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55adcae4e5a0 con 0x55adcae41d40 2024-09-18T01:45:27.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.903+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55adcae4ef60 con 0x55adcae47fe0 2024-09-18T01:45:27.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.904+0000 7fe2d507a640 1 -- 172.21.15.146:0/183281166 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v31'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2d003c030 con 0x55adcae47fe0 2024-09-18T01:45:27.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.904+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94204921703088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55adcae4f3c0 con 0x55adcae47fe0 2024-09-18T01:45:27.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.904+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55adcae4fee0 con 0x7fe2d003f060 2024-09-18T01:45:27.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.904+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94204921699536] v31'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2c003b040 con 0x55adcae41d40 2024-09-18T01:45:27.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.905+0000 7fe2d507a640 1 -- 172.21.15.146:0/183281166 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94204921703088] v31'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2d003c030 con 0x55adcae47fe0 2024-09-18T01:45:27.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.905+0000 7fe2d4879640 1 -- 172.21.15.146:0/183281166 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v31'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2c80ad040 con 0x7fe2d003f060 2024-09-18T01:45:27.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.905+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94204921706928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55adcae4eed0 con 0x7fe2d003f060 2024-09-18T01:45:27.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.905+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55adcae508f0 con 0x55adcae41d40 2024-09-18T01:45:27.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.906+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v31'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2c003b040 con 0x55adcae41d40 2024-09-18T01:45:27.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.906+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94204921709904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55adcae50fe0 con 0x55adcae41d40 2024-09-18T01:45:27.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.906+0000 7fe2d4879640 1 -- 172.21.15.146:0/183281166 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94204921706928] v31'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2c80ad040 con 0x7fe2d003f060 2024-09-18T01:45:27.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.906+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55adcae51b00 con 0x7fe2c809e040 2024-09-18T01:45:27.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.907+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v31'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2c003b040 con 0x7fe2c809e040 2024-09-18T01:45:27.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.907+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94204921714128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55adcae51ac0 con 0x7fe2c809e040 2024-09-18T01:45:27.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.907+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55adcae52510 con 0x7fe2c809e040 2024-09-18T01:45:27.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.907+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94204921709904] v31'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2c003b040 con 0x55adcae41d40 2024-09-18T01:45:27.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.908+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(56 notify.6 [create] v31'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2c003b040 con 0x7fe2c809e040 2024-09-18T01:45:27.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.908+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94204921711152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55adcae52510 con 0x7fe2c809e040 2024-09-18T01:45:27.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.908+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55adcae52f10 con 0x7fe2c809e040 2024-09-18T01:45:27.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.908+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94204921714128] v31'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2c003b040 con 0x7fe2c809e040 2024-09-18T01:45:27.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.909+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(58 notify.7 [create] v31'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2c003b040 con 0x7fe2c809e040 2024-09-18T01:45:27.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.909+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94204921711152] v31'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2c003b040 con 0x7fe2c809e040 2024-09-18T01:45:27.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.909+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94204921700592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55adcae52a20 con 0x7fe2c809e040 2024-09-18T01:45:27.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.909+0000 7fe2d8b29800 20 add_watcher() i=0 2024-09-18T01:45:27.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.909+0000 7fe2d8b29800 20 add_watcher() i=1 2024-09-18T01:45:27.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.909+0000 7fe2d8b29800 20 add_watcher() i=2 2024-09-18T01:45:27.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.909+0000 7fe2d8b29800 20 add_watcher() i=3 2024-09-18T01:45:27.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.909+0000 7fe2d8b29800 20 add_watcher() i=4 2024-09-18T01:45:27.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.909+0000 7fe2d8b29800 20 add_watcher() i=5 2024-09-18T01:45:27.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.909+0000 7fe2d8b29800 20 add_watcher() i=6 2024-09-18T01:45:27.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.910+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94204921700592] v31'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2c003b040 con 0x7fe2c809e040 2024-09-18T01:45:27.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.910+0000 7fe2d8b29800 20 add_watcher() i=7 2024-09-18T01:45:27.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.910+0000 7fe2d8b29800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:27.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.910+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55adcae55f00 con 0x55adcae41d40 2024-09-18T01:45:27.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.910+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe2c003b040 con 0x55adcae41d40 2024-09-18T01:45:27.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.910+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94204921719328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55adcae532f0 con 0x55adcae41d40 2024-09-18T01:45:27.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.911+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94204921719328] v31'132 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe2c003b040 con 0x55adcae41d40 2024-09-18T01:45:27.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.911+0000 7fe189fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:27.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.912+0000 7fe2d8b29800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:27.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.912+0000 7fe2d8b29800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:27.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.912+0000 7fe2d8b29800 5 note: GC not initialized 2024-09-18T01:45:27.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.912+0000 7fe188fe1640 20 reqs_thread_entry: start 2024-09-18T01:45:27.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.912+0000 7fe2d8b29800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:27.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.912+0000 7fe2d8b29800 20 Filter name: none 2024-09-18T01:45:27.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.912+0000 7fe1027fc640 20 reqs_thread_entry: start 2024-09-18T01:45:27.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.912+0000 7fe2d8b29800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-18T01:45:27.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.912+0000 7fe2d8b29800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.912+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55adcae893c0 con 0x7fe2c809e040 2024-09-18T01:45:27.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.913+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(62 testx$tenanteduser [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 246+0+0 (crc 0 0 0) 0x7fe2c003b040 con 0x7fe2c809e040 2024-09-18T01:45:27.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.913+0000 7fe2d8b29800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:27.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.913+0000 7fe2d8b29800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x0 2024-09-18T01:45:27.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.913+0000 7fe2d8b29800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-18T01:45:27.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.913+0000 7fe2d8b29800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-18T01:45:27.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.913+0000 7fe2d8b29800 20 rados->read ofs=0 len=0 2024-09-18T01:45:27.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.913+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55adcae87950 con 0x7fe2c809e040 2024-09-18T01:45:27.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.913+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fe2c003b040 con 0x7fe2c809e040 2024-09-18T01:45:27.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.913+0000 7fe2d8b29800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:27.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.913+0000 7fe2d8b29800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-18T01:45:27.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.913+0000 7fe2d8b29800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-18T01:45:27.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.913+0000 7fe2d8b29800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-18T01:45:27.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.913+0000 7fe2d8b29800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-18T01:45:27.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.913+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:64 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [delete,create,call version.set in=58b,writefull 0~419 in=419b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55adcae8c0d0 con 0x7fe2c809e040 2024-09-18T01:45:27.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.914+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(64 testx$tenanteduser [delete,create,call,writefull 0~419] v31'8 uv8 ondisk = 0) ==== 288+0+0 (crc 0 0 0) 0x7fe2c003b040 con 0x7fe2c809e040 2024-09-18T01:45:27.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.914+0000 7fe2d8b29800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-18T01:45:27.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.914+0000 7fe2d8b29800 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-18T01:45:27.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.914+0000 7fe2d8b29800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-18T01:45:27.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.914+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:65 7.e 7:7759931f:::notify.3:head [notify cookie 94204921952912 in=622b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55adcae8cc00 con 0x7fe2d003f060 2024-09-18T01:45:27.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.914+0000 7fe2d4879640 1 -- 172.21.15.146:0/183281166 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== watch-notify(notify (1) cookie 94204921706928 notify 133143986194 ret 0) ==== 652+0+0 (crc 0 0 0) 0x7fe2c8081040 con 0x7fe2d003f060 2024-09-18T01:45:27.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.914+0000 7fe1b2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986194 cookie 94204921706928 notifier 4544 bl.length()=610 2024-09-18T01:45:27.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.914+0000 7fe1b2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-18T01:45:27.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.914+0000 7fe1b2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-18T01:45:27.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.914+0000 7fe1b2ffd640 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fe198003ea0 con 0x7fe2d003f060 2024-09-18T01:45:27.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.914+0000 7fe2d4879640 1 -- 172.21.15.146:0/183281166 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(65 notify.3 [notify cookie 94204921952912 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe2c80ad040 con 0x7fe2d003f060 2024-09-18T01:45:27.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.915+0000 7fe2d4879640 1 -- 172.21.15.146:0/183281166 <== osd.2 v2:172.21.15.146:6800/3820039304 14 ==== osd_op_reply(66 notify.3 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2c80ad040 con 0x7fe2d003f060 2024-09-18T01:45:27.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.915+0000 7fe2d4879640 1 -- 172.21.15.146:0/183281166 <== osd.2 v2:172.21.15.146:6800/3820039304 15 ==== watch-notify(notify_complete (2) cookie 94204921952912 notify 133143986194 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55adcae07ca0 con 0x7fe2d003f060 2024-09-18T01:45:27.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.915+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55adcae8ba60 con 0x7fe2c809e040 2024-09-18T01:45:27.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.916+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~22] v31'9 uv9 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fe2c003b040 con 0x7fe2c809e040 2024-09-18T01:45:27.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.916+0000 7fe2d8b29800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-18T01:45:27.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.916+0000 7fe2d8b29800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-18T01:45:27.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.916+0000 7fe2d8b29800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-18T01:45:27.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.916+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94204921952816 in=204b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55adcae8af50 con 0x55adcae47fe0 2024-09-18T01:45:27.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.916+0000 7fe2d507a640 1 -- 172.21.15.146:0/183281166 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== watch-notify(notify (1) cookie 94204921703088 notify 133143986180 ret 0) ==== 234+0+0 (crc 0 0 0) 0x55adcae394f0 con 0x55adcae47fe0 2024-09-18T01:45:27.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.916+0000 7fe1b27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986180 cookie 94204921703088 notifier 4544 bl.length()=192 2024-09-18T01:45:27.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.916+0000 7fe1b27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-18T01:45:27.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.916+0000 7fe1b27fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-18T01:45:27.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.916+0000 7fe1b27fc640 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fe108003400 con 0x55adcae47fe0 2024-09-18T01:45:27.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.917+0000 7fe2d507a640 1 -- 172.21.15.146:0/183281166 <== osd.3 v2:172.21.15.146:6809/4106661138 15 ==== osd_op_reply(68 notify.2 [notify cookie 94204921952816 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe2d003c030 con 0x55adcae47fe0 2024-09-18T01:45:27.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.917+0000 7fe2d507a640 1 -- 172.21.15.146:0/183281166 <== osd.3 v2:172.21.15.146:6809/4106661138 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2d003c030 con 0x55adcae47fe0 2024-09-18T01:45:27.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.917+0000 7fe2d507a640 1 -- 172.21.15.146:0/183281166 <== osd.3 v2:172.21.15.146:6809/4106661138 17 ==== watch-notify(notify_complete (2) cookie 94204921952816 notify 133143986180 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55adcae36840 con 0x55adcae47fe0 2024-09-18T01:45:27.930 INFO:teuthology.orchestra.run.smithi146.stdout:{"user_id":"testx$tenanteduser","display_name":"tenanted-user","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"testx$tenanteduser","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-18T01:45:27.913810Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:45:27.913798Z","tags":[],"group_ids":[]} 2024-09-18T01:45:27.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.918+0000 7fe189fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:27.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.918+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94204921719328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55adcae86ee0 con 0x55adcae41d40 2024-09-18T01:45:27.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.919+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94204921719328] v31'133 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe2c003b040 con 0x55adcae41d40 2024-09-18T01:45:27.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.919+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94204921693776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55adcae86ee0 con 0x7fe2d003f060 2024-09-18T01:45:27.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.920+0000 7fe2d4879640 1 -- 172.21.15.146:0/183281166 <== osd.2 v2:172.21.15.146:6800/3820039304 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94204921693776] v31'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2c80ad040 con 0x7fe2d003f060 2024-09-18T01:45:27.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.920+0000 7fe2d8b29800 20 remove_watcher() i=0 2024-09-18T01:45:27.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.920+0000 7fe2d8b29800 2 removed watcher, disabling cache 2024-09-18T01:45:27.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.920+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94204921699536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55adcae86ee0 con 0x55adcae41d40 2024-09-18T01:45:27.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.921+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94204921699536] v31'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2c003b040 con 0x55adcae41d40 2024-09-18T01:45:27.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.921+0000 7fe2d8b29800 20 remove_watcher() i=1 2024-09-18T01:45:27.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.921+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94204921703088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55adcae86ee0 con 0x55adcae47fe0 2024-09-18T01:45:27.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.922+0000 7fe2d507a640 1 -- 172.21.15.146:0/183281166 <== osd.3 v2:172.21.15.146:6809/4106661138 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94204921703088] v31'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2d003c030 con 0x55adcae47fe0 2024-09-18T01:45:27.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.922+0000 7fe2d8b29800 20 remove_watcher() i=2 2024-09-18T01:45:27.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.922+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94204921706928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55adcae86ee0 con 0x7fe2d003f060 2024-09-18T01:45:27.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.923+0000 7fe2d4879640 1 -- 172.21.15.146:0/183281166 <== osd.2 v2:172.21.15.146:6800/3820039304 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94204921706928] v31'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2c80ad040 con 0x7fe2d003f060 2024-09-18T01:45:27.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.923+0000 7fe2d8b29800 20 remove_watcher() i=3 2024-09-18T01:45:27.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.923+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94204921709904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55adcae86ee0 con 0x55adcae41d40 2024-09-18T01:45:27.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.924+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94204921709904] v31'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2c003b040 con 0x55adcae41d40 2024-09-18T01:45:27.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.924+0000 7fe2d8b29800 20 remove_watcher() i=4 2024-09-18T01:45:27.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.924+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94204921714128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55adcae86ee0 con 0x7fe2c809e040 2024-09-18T01:45:27.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.925+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94204921714128] v31'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2c003b040 con 0x7fe2c809e040 2024-09-18T01:45:27.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.925+0000 7fe2d8b29800 20 remove_watcher() i=5 2024-09-18T01:45:27.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.925+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94204921711152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55adcae86ee0 con 0x7fe2c809e040 2024-09-18T01:45:27.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.926+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 <== osd.0 v2:172.21.15.129:6800/1759265424 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94204921711152] v31'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2c003b040 con 0x7fe2c809e040 2024-09-18T01:45:27.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.926+0000 7fe2d8b29800 20 remove_watcher() i=6 2024-09-18T01:45:27.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.926+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94204921700592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55adcae86ee0 con 0x7fe2c809e040 2024-09-18T01:45:27.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.927+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 <== osd.0 v2:172.21.15.129:6800/1759265424 23 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94204921700592] v31'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2c003b040 con 0x7fe2c809e040 2024-09-18T01:45:27.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.927+0000 7fe2d8b29800 20 remove_watcher() i=7 2024-09-18T01:45:27.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.927+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fe2c809e040 msgr2=0x7fe2c805b030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.927+0000 7fe2d8b29800 1 --2- 172.21.15.146:0/183281166 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fe2c809e040 0x7fe2c805b030 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.927+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55adcae41d40 msgr2=0x55adcae44200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.927+0000 7fe2d8b29800 1 --2- 172.21.15.146:0/183281166 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55adcae41d40 0x55adcae44200 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.927+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fe2d003f060 msgr2=0x7fe2d0023070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.927+0000 7fe2d8b29800 1 --2- 172.21.15.146:0/183281166 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fe2d003f060 0x7fe2d0023070 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.927+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55adcae47fe0 msgr2=0x55adcae4a3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.927+0000 7fe2d8b29800 1 --2- 172.21.15.146:0/183281166 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55adcae47fe0 0x55adcae4a3f0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.927+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fe19c036af0 msgr2=0x7fe19c038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.927+0000 7fe2d8b29800 1 --2- 172.21.15.146:0/183281166 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fe19c036af0 0x7fe19c038fb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe2c808efd0 tx=0x7fe2c808b000 comp rx=0 tx=0).stop 2024-09-18T01:45:27.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.927+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55adcae2eb90 msgr2=0x55adcae36070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.927+0000 7fe2cffff640 1 -- 172.21.15.146:0/183281166 reap_dead start 2024-09-18T01:45:27.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.927+0000 7fe2d8b29800 1 --2- 172.21.15.146:0/183281166 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55adcae2eb90 0x55adcae36070 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe2d00127e0 tx=0x7fe2d004c820 comp rx=0 tx=0).stop 2024-09-18T01:45:27.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.928+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 shutdown_connections 2024-09-18T01:45:27.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.928+0000 7fe2d8b29800 1 --2- 172.21.15.146:0/183281166 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55adcae2eb90 0x55adcae36070 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.928+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 >> 172.21.15.146:0/183281166 conn(0x55adcae2aef0 msgr2=0x55adcae28fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:27.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.928+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 shutdown_connections 2024-09-18T01:45:27.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.928+0000 7fe2d8b29800 1 -- 172.21.15.146:0/183281166 wait complete. 2024-09-18T01:45:27.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.928+0000 7fe2d8b29800 1 -- 172.21.15.146:0/1116474408 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fe1ac036b90 msgr2=0x7fe1ac039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.928+0000 7fe2d8b29800 1 --2- 172.21.15.146:0/1116474408 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fe1ac036b90 0x7fe1ac039050 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x55adcae0faf0 tx=0x7fe2c808e6c0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.928+0000 7fe2d8b29800 1 -- 172.21.15.146:0/1116474408 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55adcae21f10 msgr2=0x55adcae22330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.928+0000 7fe2d8b29800 1 --2- 172.21.15.146:0/1116474408 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55adcae21f10 0x55adcae22330 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x55adcae0ebf0 tx=0x7fe2d00178e0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.928+0000 7fe2d8b29800 1 -- 172.21.15.146:0/1116474408 shutdown_connections 2024-09-18T01:45:27.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.928+0000 7fe2d8b29800 1 --2- 172.21.15.146:0/1116474408 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fe1ac036b90 0x7fe1ac039050 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.928+0000 7fe2d8b29800 1 --2- 172.21.15.146:0/1116474408 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55adcae21f10 0x55adcae22330 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.928+0000 7fe2d8b29800 1 -- 172.21.15.146:0/1116474408 >> 172.21.15.146:0/1116474408 conn(0x55adcae16ea0 msgr2=0x55adcae19a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:27.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.928+0000 7fe2d8b29800 1 -- 172.21.15.146:0/1116474408 shutdown_connections 2024-09-18T01:45:27.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.928+0000 7fe2d8b29800 1 -- 172.21.15.146:0/1116474408 wait complete. 2024-09-18T01:45:27.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.928+0000 7fe2d8b29800 1 -- 172.21.15.146:0/2498056888 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55adcad13b90 msgr2=0x55adcae0e2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.928+0000 7fe2d8b29800 1 --2- 172.21.15.146:0/2498056888 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55adcad13b90 0x55adcae0e2b0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.928+0000 7fe2d8b29800 1 -- 172.21.15.146:0/2498056888 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55adcae101f0 msgr2=0x55adcae13a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.928+0000 7fe2d8b29800 1 --2- 172.21.15.146:0/2498056888 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55adcae101f0 0x55adcae13a50 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.928+0000 7fe2d8b29800 1 -- 172.21.15.146:0/2498056888 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fe1bc036b40 msgr2=0x7fe1bc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.928+0000 7fe2d8b29800 1 --2- 172.21.15.146:0/2498056888 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fe1bc036b40 0x7fe1bc039000 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe2c0000c00 tx=0x7fe2c00013b0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.928+0000 7fe2d8b29800 1 -- 172.21.15.146:0/2498056888 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55adcac82640 msgr2=0x55adcae07240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.928+0000 7fe2d8b29800 1 --2- 172.21.15.146:0/2498056888 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55adcac82640 0x55adcae07240 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe2c80460a0 tx=0x7fe2c8003020 comp rx=0 tx=0).stop 2024-09-18T01:45:27.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.928+0000 7fe2d8b29800 1 -- 172.21.15.146:0/2498056888 shutdown_connections 2024-09-18T01:45:27.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.928+0000 7fe2d8b29800 1 --2- 172.21.15.146:0/2498056888 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55adcae101f0 0x55adcae13a50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.928+0000 7fe2d8b29800 1 --2- 172.21.15.146:0/2498056888 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55adcad13b90 0x55adcae0e2b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.928+0000 7fe2d8b29800 1 --2- 172.21.15.146:0/2498056888 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fe1bc036b40 0x7fe1bc039000 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.928+0000 7fe2d8b29800 1 --2- 172.21.15.146:0/2498056888 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55adcac82640 0x55adcae07240 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.929+0000 7fe2d8b29800 1 -- 172.21.15.146:0/2498056888 >> 172.21.15.146:0/2498056888 conn(0x55adcad08de0 msgr2=0x55adcadf9b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:27.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.929+0000 7fe2d8b29800 1 -- 172.21.15.146:0/2498056888 shutdown_connections 2024-09-18T01:45:27.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.929+0000 7fe2d8b29800 1 -- 172.21.15.146:0/2498056888 wait complete. 2024-09-18T01:45:27.941 DEBUG:tasks.util.rgw: json result: {'user_id': 'testx$tenanteduser', 'display_name': 'tenanted-user', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'testx$tenanteduser', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-18T01:45:27.913810Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:45:27.913798Z', 'tags': [], 'group_ids': []} 2024-09-18T01:45:27.942 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-18T01:45:27.942 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-18T01:45:27.942 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket /myfoo --tenant testx --uid tenanteduser 2024-09-18T01:45:27.990 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:27.990 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:27.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.990+0000 7f0c9f151800 1 Processor -- start 2024-09-18T01:45:27.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.990+0000 7f0c9f151800 1 -- start start 2024-09-18T01:45:27.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.990+0000 7f0c9f151800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x559d54ebba50 0x559d54ebbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:27.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.990+0000 7f0c9f151800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559d54d7cb30 con 0x559d54ebc390 2024-09-18T01:45:27.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.990+0000 7f0c9f151800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x559d54d5e360 con 0x559d54ebba50 2024-09-18T01:45:27.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.990+0000 7f0c9cc45640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x559d54ebba50 0x559d54ebbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:27.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.990+0000 7f0c9cc45640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x559d54ebba50 0x559d54ebbe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:57836/0 (socket says 172.21.15.146:57836) 2024-09-18T01:45:27.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.990+0000 7f0c9c444640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x559d54ebc390 0x559d54ec2b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:47334/0 (socket says 172.21.15.146:47334) 2024-09-18T01:45:27.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.990+0000 7f0c9cc45640 1 -- 172.21.15.146:0/3721652038 learned_addr learned my addr 172.21.15.146:0/3721652038 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:27.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.991+0000 7f0c9cc45640 1 -- 172.21.15.146:0/3721652038 >> v1:172.21.15.129:6789/0 conn(0x559d54ebc390 legacy=0x559d54ec2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.991+0000 7f0c9cc45640 1 -- 172.21.15.146:0/3721652038 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d54d84e00 con 0x559d54ebba50 2024-09-18T01:45:27.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.991+0000 7f0c9bc43640 1 -- 172.21.15.146:0/3721652038 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 526059699 0 0) 0x559d54d7cb30 con 0x559d54ebc390 2024-09-18T01:45:27.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.992+0000 7f0c9cc45640 1 --2- 172.21.15.146:0/3721652038 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d54ebba50 0x559d54ebbe50 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f0c94005fd0 tx=0x7f0c94045cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0e8167e869ee15 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:27.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.992+0000 7f0c9bc43640 1 -- 172.21.15.146:0/3721652038 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c9404e600 con 0x559d54ebba50 2024-09-18T01:45:27.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.992+0000 7f0c9bc43640 1 -- 172.21.15.146:0/3721652038 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c9404e7a0 con 0x559d54ebba50 2024-09-18T01:45:27.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.992+0000 7f0c9bc43640 1 -- 172.21.15.146:0/3721652038 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c9404eaa0 con 0x559d54ebba50 2024-09-18T01:45:27.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.993+0000 7f0c9f151800 1 -- 172.21.15.146:0/3721652038 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d54ebba50 msgr2=0x559d54ebbe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:27.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.993+0000 7f0c9f151800 1 --2- 172.21.15.146:0/3721652038 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d54ebba50 0x559d54ebbe50 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f0c94005fd0 tx=0x7f0c94045cf0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.993+0000 7f0c9f151800 1 -- 172.21.15.146:0/3721652038 shutdown_connections 2024-09-18T01:45:27.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.993+0000 7f0c9f151800 1 --2- 172.21.15.146:0/3721652038 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d54ebba50 0x559d54ebbe50 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:27.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.993+0000 7f0c9f151800 1 -- 172.21.15.146:0/3721652038 >> 172.21.15.146:0/3721652038 conn(0x559d54eb75e0 msgr2=0x559d54eb9a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:27.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.993+0000 7f0c9f151800 1 -- 172.21.15.146:0/3721652038 shutdown_connections 2024-09-18T01:45:27.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:27.993+0000 7f0c9f151800 1 -- 172.21.15.146:0/3721652038 wait complete. 2024-09-18T01:45:28.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.006+0000 7f0c9f151800 1 Processor -- start 2024-09-18T01:45:28.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.006+0000 7f0c9f151800 1 -- start start 2024-09-18T01:45:28.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.007+0000 7f0c9f151800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d54ebba50 0x559d54fac690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.007+0000 7f0c9f151800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x559d54e09350 con 0x559d54ebba50 2024-09-18T01:45:28.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.007+0000 7f0c9cc45640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d54ebba50 0x559d54fac690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.007+0000 7f0c9cc45640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d54ebba50 0x559d54fac690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:57846/0 (socket says 172.21.15.146:57846) 2024-09-18T01:45:28.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.007+0000 7f0c9cc45640 1 -- 172.21.15.146:0/2107872866 learned_addr learned my addr 172.21.15.146:0/2107872866 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:28.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.007+0000 7f0c9cc45640 1 -- 172.21.15.146:0/2107872866 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d54d56bc0 con 0x559d54ebba50 2024-09-18T01:45:28.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.008+0000 7f0c9cc45640 1 --2- 172.21.15.146:0/2107872866 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d54ebba50 0x559d54fac690 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f0c9400a190 tx=0x7f0c94050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e9ee83aeac61596 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.008+0000 7f0b8ae0d640 1 -- 172.21.15.146:0/2107872866 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c94065020 con 0x559d54ebba50 2024-09-18T01:45:28.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.008+0000 7f0b8ae0d640 1 -- 172.21.15.146:0/2107872866 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c9405c040 con 0x559d54ebba50 2024-09-18T01:45:28.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.008+0000 7f0b8ae0d640 1 -- 172.21.15.146:0/2107872866 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c9404ebb0 con 0x559d54ebba50 2024-09-18T01:45:28.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.008+0000 7f0c9f151800 1 -- 172.21.15.146:0/2107872866 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d54ebba50 msgr2=0x559d54fac690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.008+0000 7f0c9f151800 1 --2- 172.21.15.146:0/2107872866 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d54ebba50 0x559d54fac690 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f0c9400a190 tx=0x7f0c94050000 comp rx=0 tx=0).stop 2024-09-18T01:45:28.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.008+0000 7f0c9f151800 1 -- 172.21.15.146:0/2107872866 shutdown_connections 2024-09-18T01:45:28.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.008+0000 7f0c9f151800 1 --2- 172.21.15.146:0/2107872866 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d54ebba50 0x559d54fac690 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.008+0000 7f0c9f151800 1 -- 172.21.15.146:0/2107872866 >> 172.21.15.146:0/2107872866 conn(0x559d54eb75e0 msgr2=0x559d54fa8050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:28.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.008+0000 7f0c9f151800 1 -- 172.21.15.146:0/2107872866 shutdown_connections 2024-09-18T01:45:28.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.008+0000 7f0c9f151800 1 -- 172.21.15.146:0/2107872866 wait complete. 2024-09-18T01:45:28.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.009+0000 7f0c9f151800 1 Processor -- start 2024-09-18T01:45:28.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.009+0000 7f0c9f151800 1 -- start start 2024-09-18T01:45:28.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.009+0000 7f0c9f151800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d54ebba50 0x559d54fb3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.009+0000 7f0c9f151800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x559d54ec4670 con 0x559d54ebba50 2024-09-18T01:45:28.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.009+0000 7f0c9cc45640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d54ebba50 0x559d54fb3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.009+0000 7f0c9cc45640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d54ebba50 0x559d54fb3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:57858/0 (socket says 172.21.15.146:57858) 2024-09-18T01:45:28.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.009+0000 7f0c9cc45640 1 -- 172.21.15.146:0/3229911782 learned_addr learned my addr 172.21.15.146:0/3229911782 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:28.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.009+0000 7f0c9cc45640 1 -- 172.21.15.146:0/3229911782 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d54d6afe0 con 0x559d54ebba50 2024-09-18T01:45:28.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.009+0000 7f0c9cc45640 1 --2- 172.21.15.146:0/3229911782 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d54ebba50 0x559d54fb3f40 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f0c94045d30 tx=0x7f0c94003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.010+0000 7f0b8960a640 1 -- 172.21.15.146:0/3229911782 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c94065030 con 0x559d54ebba50 2024-09-18T01:45:28.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.010+0000 7f0b8960a640 1 -- 172.21.15.146:0/3229911782 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c9404ee50 con 0x559d54ebba50 2024-09-18T01:45:28.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.010+0000 7f0c9f151800 1 -- 172.21.15.146:0/3229911782 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559d54fb4480 con 0x559d54ebba50 2024-09-18T01:45:28.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.010+0000 7f0b8960a640 1 -- 172.21.15.146:0/3229911782 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c9406c5e0 con 0x559d54ebba50 2024-09-18T01:45:28.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.010+0000 7f0c9f151800 1 -- 172.21.15.146:0/3229911782 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d54fb4a00 con 0x559d54ebba50 2024-09-18T01:45:28.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.010+0000 7f0b8960a640 1 -- 172.21.15.146:0/3229911782 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0c9406c7d0 con 0x559d54ebba50 2024-09-18T01:45:28.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.011+0000 7f0b8960a640 1 --2- 172.21.15.146:0/3229911782 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0b84036b40 0x7f0b84039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.011+0000 7f0b8960a640 1 -- 172.21.15.146:0/3229911782 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f0c94090be0 con 0x559d54ebba50 2024-09-18T01:45:28.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.011+0000 7f0c9c444640 1 --2- 172.21.15.146:0/3229911782 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0b84036b40 0x7f0b84039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.011+0000 7f0c9f151800 1 --2- 172.21.15.146:0/3229911782 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559d54ebc390 0x559d54fbafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.011+0000 7f0c9f151800 1 -- 172.21.15.146:0/3229911782 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559d54fbb530 con 0x559d54ebc390 2024-09-18T01:45:28.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.011+0000 7f0c9d446640 1 --2- 172.21.15.146:0/3229911782 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559d54ebc390 0x559d54fbafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.011+0000 7f0c9c444640 1 --2- 172.21.15.146:0/3229911782 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0b84036b40 0x7f0b84039000 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0c84000c00 tx=0x7f0c840013b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.011+0000 7f0c9d446640 1 --2- 172.21.15.146:0/3229911782 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559d54ebc390 0x559d54fbafb0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.011+0000 7f0c9d446640 1 -- 172.21.15.146:0/3229911782 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c8c0083e0 con 0x559d54ebc390 2024-09-18T01:45:28.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.011+0000 7f0c9f151800 1 -- 172.21.15.146:0/3229911782 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559d54fb8540 con 0x559d54ebc390 2024-09-18T01:45:28.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.012+0000 7f0c9d446640 1 -- 172.21.15.146:0/3229911782 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0c8c0083e0 con 0x559d54ebc390 2024-09-18T01:45:28.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.012+0000 7f0c9f151800 1 -- 172.21.15.146:0/3229911782 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559d54fbd310 con 0x559d54ebc390 2024-09-18T01:45:28.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.012+0000 7f0c9d446640 1 -- 172.21.15.146:0/3229911782 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0c8c0083e0 con 0x559d54ebc390 2024-09-18T01:45:28.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.012+0000 7f0c9f151800 1 -- 172.21.15.146:0/3229911782 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559d54fbc480 con 0x559d54ebc390 2024-09-18T01:45:28.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.012+0000 7f0c9d446640 1 -- 172.21.15.146:0/3229911782 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0c8c0083e0 con 0x559d54ebc390 2024-09-18T01:45:28.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.012+0000 7f0c9f151800 1 --2- 172.21.15.146:0/3229911782 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x559d54fbcef0 0x559d54fc0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.012+0000 7f0c9f151800 1 -- 172.21.15.146:0/3229911782 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559d54fc0f00 con 0x559d54fbcef0 2024-09-18T01:45:28.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.012+0000 7f0c9cc45640 1 --2- 172.21.15.146:0/3229911782 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x559d54fbcef0 0x559d54fc0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.013+0000 7f0c9cc45640 1 --2- 172.21.15.146:0/3229911782 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x559d54fbcef0 0x559d54fc0770 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.013+0000 7f0c9cc45640 1 -- 172.21.15.146:0/3229911782 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0c9407b070 con 0x559d54fbcef0 2024-09-18T01:45:28.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.013+0000 7f0c9f151800 1 Processor -- start 2024-09-18T01:45:28.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.013+0000 7f0c9f151800 1 -- start start 2024-09-18T01:45:28.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.013+0000 7f0c9f151800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d54fcec70 0x559d54fcf090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.013+0000 7f0c9f151800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x559d54d58580 con 0x559d54fcec70 2024-09-18T01:45:28.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.014+0000 7f0c9d446640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d54fcec70 0x559d54fcf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.014+0000 7f0c9d446640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d54fcec70 0x559d54fcf090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:57862/0 (socket says 172.21.15.146:57862) 2024-09-18T01:45:28.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.014+0000 7f0c9d446640 1 -- 172.21.15.146:0/3399154908 learned_addr learned my addr 172.21.15.146:0/3399154908 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:28.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.014+0000 7f0c9d446640 1 -- 172.21.15.146:0/3399154908 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d54fcf5d0 con 0x559d54fcec70 2024-09-18T01:45:28.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.014+0000 7f0c9d446640 1 --2- 172.21.15.146:0/3399154908 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d54fcec70 0x559d54fcf090 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x559d54fb4ff0 tx=0x7f0c8c00ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.014+0000 7f0b827fc640 1 -- 172.21.15.146:0/3399154908 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c8c01c070 con 0x559d54fcec70 2024-09-18T01:45:28.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.014+0000 7f0b827fc640 1 -- 172.21.15.146:0/3399154908 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c8c018410 con 0x559d54fcec70 2024-09-18T01:45:28.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.014+0000 7f0b827fc640 1 -- 172.21.15.146:0/3399154908 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c8c018730 con 0x559d54fcec70 2024-09-18T01:45:28.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.014+0000 7f0c9f151800 1 -- 172.21.15.146:0/3399154908 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559d54fcf860 con 0x559d54fcec70 2024-09-18T01:45:28.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.014+0000 7f0c9f151800 1 -- 172.21.15.146:0/3399154908 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d54fd2540 con 0x559d54fcec70 2024-09-18T01:45:28.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.015+0000 7f0b827fc640 1 -- 172.21.15.146:0/3399154908 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0c8c01f070 con 0x559d54fcec70 2024-09-18T01:45:28.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.015+0000 7f0b827fc640 1 --2- 172.21.15.146:0/3399154908 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0b74036b90 0x7f0b74039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.015+0000 7f0b827fc640 1 -- 172.21.15.146:0/3399154908 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f0c8c04e570 con 0x559d54fcec70 2024-09-18T01:45:28.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.015+0000 7f0c9cc45640 1 --2- 172.21.15.146:0/3399154908 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0b74036b90 0x7f0b74039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.016+0000 7f0c9f151800 1 Processor -- start 2024-09-18T01:45:28.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.016+0000 7f0c9cc45640 1 --2- 172.21.15.146:0/3399154908 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0b74036b90 0x7f0b74039050 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0c94060c10 tx=0x7f0c94061420 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.016+0000 7f0c9f151800 1 -- start start 2024-09-18T01:45:28.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.016+0000 7f0c9f151800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d54fdb910 0x559d54fdbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.016+0000 7f0c9f151800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x559d54facd80 con 0x559d54fdb910 2024-09-18T01:45:28.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.016+0000 7f0c9d446640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d54fdb910 0x559d54fdbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.016+0000 7f0c9d446640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d54fdb910 0x559d54fdbd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:57878/0 (socket says 172.21.15.146:57878) 2024-09-18T01:45:28.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.016+0000 7f0c9d446640 1 -- 172.21.15.146:0/774132153 learned_addr learned my addr 172.21.15.146:0/774132153 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:28.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.016+0000 7f0c9d446640 1 -- 172.21.15.146:0/774132153 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d54fdc2e0 con 0x559d54fdb910 2024-09-18T01:45:28.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.017+0000 7f0c9d446640 1 --2- 172.21.15.146:0/774132153 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d54fdb910 0x559d54fdbd10 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c04caf0 tx=0x7f0c8c04cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd6427fa1f6bdf6f server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.017+0000 7f0b73fff640 1 -- 172.21.15.146:0/774132153 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c8c045070 con 0x559d54fdb910 2024-09-18T01:45:28.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.017+0000 7f0b73fff640 1 -- 172.21.15.146:0/774132153 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c8c04a030 con 0x559d54fdb910 2024-09-18T01:45:28.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.017+0000 7f0b73fff640 1 -- 172.21.15.146:0/774132153 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c8c018d80 con 0x559d54fdb910 2024-09-18T01:45:28.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.017+0000 7f0c9f151800 1 -- 172.21.15.146:0/774132153 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d54fdb910 msgr2=0x559d54fdbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.017+0000 7f0c9f151800 1 --2- 172.21.15.146:0/774132153 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d54fdb910 0x559d54fdbd10 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c04caf0 tx=0x7f0c8c04cbe0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.017+0000 7f0c9f151800 1 -- 172.21.15.146:0/774132153 shutdown_connections 2024-09-18T01:45:28.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.017+0000 7f0c9f151800 1 --2- 172.21.15.146:0/774132153 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d54fdb910 0x559d54fdbd10 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.017+0000 7f0c9f151800 1 -- 172.21.15.146:0/774132153 >> 172.21.15.146:0/774132153 conn(0x559d54fd7c70 msgr2=0x559d54fd5d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:28.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.017+0000 7f0c9f151800 1 -- 172.21.15.146:0/774132153 shutdown_connections 2024-09-18T01:45:28.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.017+0000 7f0c9f151800 1 -- 172.21.15.146:0/774132153 wait complete. 2024-09-18T01:45:28.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.017+0000 7f0c9f151800 1 Processor -- start 2024-09-18T01:45:28.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.017+0000 7f0c9f151800 1 -- start start 2024-09-18T01:45:28.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.018+0000 7f0c9f151800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d54fdb910 0x559d54fe2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.018+0000 7f0c9f151800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x559d54fdc990 con 0x559d54fdb910 2024-09-18T01:45:28.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.018+0000 7f0c9d446640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d54fdb910 0x559d54fe2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.018+0000 7f0c9d446640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d54fdb910 0x559d54fe2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:57886/0 (socket says 172.21.15.146:57886) 2024-09-18T01:45:28.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.018+0000 7f0c9d446640 1 -- 172.21.15.146:0/763361351 learned_addr learned my addr 172.21.15.146:0/763361351 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:28.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.018+0000 7f0c9d446640 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d54fe3340 con 0x559d54fdb910 2024-09-18T01:45:28.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.018+0000 7f0c9d446640 1 --2- 172.21.15.146:0/763361351 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d54fdb910 0x559d54fe2e00 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c015010 tx=0x7f0c8c04c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.018+0000 7f0b727fc640 1 -- 172.21.15.146:0/763361351 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c8c045040 con 0x559d54fdb910 2024-09-18T01:45:28.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.018+0000 7f0b727fc640 1 -- 172.21.15.146:0/763361351 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c8c04b170 con 0x559d54fdb910 2024-09-18T01:45:28.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.018+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559d54fe35d0 con 0x559d54fdb910 2024-09-18T01:45:28.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.018+0000 7f0b727fc640 1 -- 172.21.15.146:0/763361351 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c8c04b490 con 0x559d54fdb910 2024-09-18T01:45:28.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.018+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d54fe6280 con 0x559d54fdb910 2024-09-18T01:45:28.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.019+0000 7f0b727fc640 1 -- 172.21.15.146:0/763361351 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0c8c016a40 con 0x559d54fdb910 2024-09-18T01:45:28.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.019+0000 7f0b727fc640 1 --2- 172.21.15.146:0/763361351 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0b68036b90 0x7f0b68039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.019+0000 7f0b727fc640 1 -- 172.21.15.146:0/763361351 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f0c8c040e00 con 0x559d54fdb910 2024-09-18T01:45:28.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.019+0000 7f0c9cc45640 1 --2- 172.21.15.146:0/763361351 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0b68036b90 0x7f0b68039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.020+0000 7f0c9cc45640 1 --2- 172.21.15.146:0/763361351 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0b68036b90 0x7f0b68039050 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x559d54fc1300 tx=0x7f0c94087000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.020+0000 7f0c9f151800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.020+0000 7f0c9f151800 1 --2- 172.21.15.146:0/763361351 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559d54fee8d0 0x559d54ff0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.020+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559d54ff14e0 con 0x559d54fee8d0 2024-09-18T01:45:28.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.020+0000 7f0c9c444640 1 --2- 172.21.15.146:0/763361351 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559d54fee8d0 0x559d54ff0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.020+0000 7f0c9c444640 1 --2- 172.21.15.146:0/763361351 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559d54fee8d0 0x559d54ff0d90 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.021+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c8400f5f0 con 0x559d54fee8d0 2024-09-18T01:45:28.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.021+0000 7f0c9f151800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:28.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.021+0000 7f0c9f151800 20 realm 2024-09-18T01:45:28.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.021+0000 7f0c9f151800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.021+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559d54fedd20 con 0x559d54fee8d0 2024-09-18T01:45:28.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.021+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c8400f5f0 con 0x559d54fee8d0 2024-09-18T01:45:28.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.021+0000 7f0c9f151800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:28.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.021+0000 7f0c9f151800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:28.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.021+0000 7f0c9f151800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.021+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559d54ff1fd0 con 0x559d54fee8d0 2024-09-18T01:45:28.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.021+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c8400f5f0 con 0x559d54fee8d0 2024-09-18T01:45:28.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.021+0000 7f0c9f151800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:28.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.021+0000 7f0c9f151800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.021+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559d54ff28a0 con 0x559d54fee8d0 2024-09-18T01:45:28.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.021+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0c8400f5f0 con 0x559d54fee8d0 2024-09-18T01:45:28.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.021+0000 7f0c9f151800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:28.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.021+0000 7f0c9f151800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.021+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559d54ff2c40 con 0x559d54fee8d0 2024-09-18T01:45:28.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.022+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0c8400f5f0 con 0x559d54fee8d0 2024-09-18T01:45:28.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.022+0000 7f0c9f151800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:28.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.022+0000 7f0c9f151800 20 searching for the correct realm 2024-09-18T01:45:28.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.022+0000 7f0c9f151800 1 --2- 172.21.15.146:0/763361351 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x559d54ff4b70 0x559d54ff6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.022+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559d54ff7650 con 0x559d54ff4b70 2024-09-18T01:45:28.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.022+0000 7f0c9d446640 1 --2- 172.21.15.146:0/763361351 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x559d54ff4b70 0x559d54ff6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.022+0000 7f0c9d446640 1 --2- 172.21.15.146:0/763361351 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x559d54ff4b70 0x559d54ff6f80 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.022+0000 7f0c9d446640 1 -- 172.21.15.146:0/763361351 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8c03b020 con 0x559d54ff4b70 2024-09-18T01:45:28.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.022+0000 7f0c9d446640 1 --2- 172.21.15.146:0/763361351 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f0c8c021070 0x7f0c8c0163a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.022+0000 7f0c9d446640 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559d54ff7650 con 0x7f0c8c021070 2024-09-18T01:45:28.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.022+0000 7f0c9cc45640 1 --2- 172.21.15.146:0/763361351 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f0c8c021070 0x7f0c8c0163a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.023+0000 7f0c9cc45640 1 --2- 172.21.15.146:0/763361351 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f0c8c021070 0x7f0c8c0163a0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.023+0000 7f0c9cc45640 1 -- 172.21.15.146:0/763361351 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c9407b070 con 0x7f0c8c021070 2024-09-18T01:45:28.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.023+0000 7f0c9cc45640 1 --2- 172.21.15.146:0/763361351 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f0c94069380 0x7f0c940903b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.023+0000 7f0c9cc45640 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559d54ff7650 con 0x7f0c94069380 2024-09-18T01:45:28.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.023+0000 7f0c9c444640 1 --2- 172.21.15.146:0/763361351 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f0c94069380 0x7f0c940903b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.023+0000 7f0c9c444640 1 --2- 172.21.15.146:0/763361351 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f0c94069380 0x7f0c940903b0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.024+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8400f5f0 con 0x7f0c94069380 2024-09-18T01:45:28.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.024+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559d54ff7650 con 0x559d54fee8d0 2024-09-18T01:45:28.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.024+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0c8400f5f0 con 0x559d54fee8d0 2024-09-18T01:45:28.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.024+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559d54ff7650 con 0x559d54fee8d0 2024-09-18T01:45:28.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.024+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8400f5f0 con 0x559d54fee8d0 2024-09-18T01:45:28.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.024+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559d54ff7650 con 0x7f0c94069380 2024-09-18T01:45:28.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.024+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8400f5f0 con 0x7f0c94069380 2024-09-18T01:45:28.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.024+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559d54ff7650 con 0x7f0c94069380 2024-09-18T01:45:28.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.025+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8400f5f0 con 0x7f0c94069380 2024-09-18T01:45:28.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.025+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559d54ff7650 con 0x7f0c8c021070 2024-09-18T01:45:28.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.025+0000 7f0c9cc45640 1 -- 172.21.15.146:0/763361351 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c9407b070 con 0x7f0c8c021070 2024-09-18T01:45:28.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.025+0000 7f0c9cc45640 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559d54ff7650 con 0x559d54ff4b70 2024-09-18T01:45:28.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.025+0000 7f0c9d446640 1 -- 172.21.15.146:0/763361351 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8c03b020 con 0x559d54ff4b70 2024-09-18T01:45:28.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.025+0000 7f0c9d446640 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559d54ff7650 con 0x559d54fee8d0 2024-09-18T01:45:28.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.025+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8400f5f0 con 0x559d54fee8d0 2024-09-18T01:45:28.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.025+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559d54ff7650 con 0x7f0c94069380 2024-09-18T01:45:28.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.026+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8400f5f0 con 0x7f0c94069380 2024-09-18T01:45:28.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.026+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559d54ff7650 con 0x559d54fee8d0 2024-09-18T01:45:28.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.026+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8400f5f0 con 0x559d54fee8d0 2024-09-18T01:45:28.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.026+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559d54ff7650 con 0x7f0c8c021070 2024-09-18T01:45:28.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.026+0000 7f0c9cc45640 1 -- 172.21.15.146:0/763361351 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f0c9407b070 con 0x7f0c8c021070 2024-09-18T01:45:28.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.026+0000 7f0c9cc45640 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559d54ff7650 con 0x559d54ff4b70 2024-09-18T01:45:28.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.026+0000 7f0c9d446640 1 -- 172.21.15.146:0/763361351 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8c03b020 con 0x559d54ff4b70 2024-09-18T01:45:28.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.026+0000 7f0c9d446640 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559d54ff7650 con 0x559d54ff4b70 2024-09-18T01:45:28.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.027+0000 7f0c9d446640 1 -- 172.21.15.146:0/763361351 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8c03b020 con 0x559d54ff4b70 2024-09-18T01:45:28.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.027+0000 7f0c9d446640 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f0c8c05b040 con 0x7f0c94069380 2024-09-18T01:45:28.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.027+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8400f5f0 con 0x7f0c94069380 2024-09-18T01:45:28.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.027+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f0c8c05b040 con 0x559d54ff4b70 2024-09-18T01:45:28.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.027+0000 7f0c9d446640 1 -- 172.21.15.146:0/763361351 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8c03b020 con 0x559d54ff4b70 2024-09-18T01:45:28.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.027+0000 7f0c9d446640 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f0c8c05b040 con 0x559d54ff4b70 2024-09-18T01:45:28.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.027+0000 7f0c9d446640 1 -- 172.21.15.146:0/763361351 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8c03b020 con 0x559d54ff4b70 2024-09-18T01:45:28.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.027+0000 7f0c9d446640 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f0c8c05b040 con 0x559d54fee8d0 2024-09-18T01:45:28.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.027+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8400f5f0 con 0x559d54fee8d0 2024-09-18T01:45:28.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.027+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f0c8c05b040 con 0x559d54fee8d0 2024-09-18T01:45:28.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.028+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0c8400f5f0 con 0x559d54fee8d0 2024-09-18T01:45:28.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.028+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f0c8c05b040 con 0x7f0c94069380 2024-09-18T01:45:28.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.028+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8400f5f0 con 0x7f0c94069380 2024-09-18T01:45:28.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.028+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f0c8c05b040 con 0x559d54ff4b70 2024-09-18T01:45:28.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.028+0000 7f0c9d446640 1 -- 172.21.15.146:0/763361351 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8c03b020 con 0x559d54ff4b70 2024-09-18T01:45:28.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.028+0000 7f0c9d446640 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f0c8c05b040 con 0x7f0c8c021070 2024-09-18T01:45:28.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.029+0000 7f0c9cc45640 1 -- 172.21.15.146:0/763361351 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c9407b070 con 0x7f0c8c021070 2024-09-18T01:45:28.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.029+0000 7f0c9cc45640 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f0c8c05b040 con 0x559d54fee8d0 2024-09-18T01:45:28.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.029+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8400f5f0 con 0x559d54fee8d0 2024-09-18T01:45:28.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.029+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f0c8c05b040 con 0x7f0c94069380 2024-09-18T01:45:28.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.029+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8403b040 con 0x7f0c94069380 2024-09-18T01:45:28.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.029+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f0c8c05b040 con 0x559d54ff4b70 2024-09-18T01:45:28.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.029+0000 7f0c9d446640 1 -- 172.21.15.146:0/763361351 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8c03b020 con 0x559d54ff4b70 2024-09-18T01:45:28.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.029+0000 7f0c9d446640 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f0c8c05b040 con 0x7f0c94069380 2024-09-18T01:45:28.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.030+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8403b040 con 0x7f0c94069380 2024-09-18T01:45:28.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.030+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f0c8c05b040 con 0x7f0c8c021070 2024-09-18T01:45:28.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.030+0000 7f0c9cc45640 1 -- 172.21.15.146:0/763361351 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c9407b070 con 0x7f0c8c021070 2024-09-18T01:45:28.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.030+0000 7f0c9cc45640 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f0c8c05b040 con 0x559d54ff4b70 2024-09-18T01:45:28.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.030+0000 7f0c9d446640 1 -- 172.21.15.146:0/763361351 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8c03b020 con 0x559d54ff4b70 2024-09-18T01:45:28.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.030+0000 7f0c9d446640 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f0c8c05b040 con 0x7f0c94069380 2024-09-18T01:45:28.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.030+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8403b040 con 0x7f0c94069380 2024-09-18T01:45:28.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.030+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f0c8c05b040 con 0x559d54fee8d0 2024-09-18T01:45:28.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.030+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0c8403b040 con 0x559d54fee8d0 2024-09-18T01:45:28.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.031+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f0c8c05b040 con 0x7f0c8c021070 2024-09-18T01:45:28.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.031+0000 7f0c9cc45640 1 -- 172.21.15.146:0/763361351 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c940af040 con 0x7f0c8c021070 2024-09-18T01:45:28.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.031+0000 7f0c9f151800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:28.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.031+0000 7f0c9f151800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:28.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.031+0000 7f0c9f151800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:28.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.031+0000 7f0c9f151800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:28.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.031+0000 7f0c9f151800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:28.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.031+0000 7f0c9f151800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:28.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.031+0000 7f0c9f151800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.031+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559d54ff3610 con 0x559d54fee8d0 2024-09-18T01:45:28.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.031+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c8403b040 con 0x559d54fee8d0 2024-09-18T01:45:28.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.031+0000 7f0c9f151800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:28.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.031+0000 7f0c9f151800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.031+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559d54ff3eb0 con 0x559d54fee8d0 2024-09-18T01:45:28.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.031+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0c8403b040 con 0x559d54fee8d0 2024-09-18T01:45:28.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.031+0000 7f0c9f151800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:28.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.031+0000 7f0c9f151800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.031+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559d54ff3eb0 con 0x7f0c8c021070 2024-09-18T01:45:28.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.031+0000 7f0c9cc45640 1 -- 172.21.15.146:0/763361351 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0c940af040 con 0x7f0c8c021070 2024-09-18T01:45:28.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.032+0000 7f0c9f151800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:28.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.032+0000 7f0c9f151800 20 zone default found 2024-09-18T01:45:28.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.032+0000 7f0c9f151800 4 Realm: () 2024-09-18T01:45:28.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.032+0000 7f0c9f151800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:28.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.032+0000 7f0c9f151800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:28.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.032+0000 7f0c9f151800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:28.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.032+0000 7f0c9f151800 20 zonegroup default 2024-09-18T01:45:28.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.032+0000 7f0c9f151800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.032+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559d54ff7f80 con 0x7f0c94069380 2024-09-18T01:45:28.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.032+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0c8403b040 con 0x7f0c94069380 2024-09-18T01:45:28.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.032+0000 7f0c9f151800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:28.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.032+0000 7f0c9f151800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.032+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559d54ff9960 con 0x559d54ff4b70 2024-09-18T01:45:28.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.032+0000 7f0c9d446640 1 -- 172.21.15.146:0/763361351 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0c8c03b020 con 0x559d54ff4b70 2024-09-18T01:45:28.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.032+0000 7f0c9f151800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:28.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.032+0000 7f0c9f151800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.032+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559d54ff9e70 con 0x559d54ff4b70 2024-09-18T01:45:28.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.032+0000 7f0c9d446640 1 -- 172.21.15.146:0/763361351 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0c8c03b020 con 0x559d54ff4b70 2024-09-18T01:45:28.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.032+0000 7f0c9f151800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:28.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.032+0000 7f0c9f151800 20 started sync module instance, tier type = 2024-09-18T01:45:28.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.032+0000 7f0c9f151800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:28.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.032+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d54ff8da0 con 0x7f0c8c021070 2024-09-18T01:45:28.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.033+0000 7f0c9cc45640 1 -- 172.21.15.146:0/763361351 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v31'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c940af040 con 0x7f0c8c021070 2024-09-18T01:45:28.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.033+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94134224259312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d54ffa2d0 con 0x7f0c8c021070 2024-09-18T01:45:28.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.033+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d54ffab20 con 0x559d54fee8d0 2024-09-18T01:45:28.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.034+0000 7f0c9cc45640 1 -- 172.21.15.146:0/763361351 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94134224259312] v31'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c940af040 con 0x7f0c8c021070 2024-09-18T01:45:28.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.035+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v31'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c8403b040 con 0x559d54fee8d0 2024-09-18T01:45:28.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.035+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94134224266864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d54ffaf40 con 0x559d54fee8d0 2024-09-18T01:45:28.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.035+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d54ffb7d0 con 0x559d54ff4b70 2024-09-18T01:45:28.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.036+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94134224266864] v31'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c8403b040 con 0x559d54fee8d0 2024-09-18T01:45:28.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.036+0000 7f0c9d446640 1 -- 172.21.15.146:0/763361351 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v31'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c8c03b020 con 0x559d54ff4b70 2024-09-18T01:45:28.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.036+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94134224267920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d54ffb360 con 0x559d54ff4b70 2024-09-18T01:45:28.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.036+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d54ffc220 con 0x7f0c8c021070 2024-09-18T01:45:28.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.037+0000 7f0c9d446640 1 -- 172.21.15.146:0/763361351 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94134224267920] v31'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c8c03b020 con 0x559d54ff4b70 2024-09-18T01:45:28.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.037+0000 7f0c9cc45640 1 -- 172.21.15.146:0/763361351 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v31'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c940af040 con 0x7f0c8c021070 2024-09-18T01:45:28.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.037+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94134224268976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d54ffb2d0 con 0x7f0c8c021070 2024-09-18T01:45:28.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.037+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d54ffd110 con 0x559d54fee8d0 2024-09-18T01:45:28.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.038+0000 7f0c9cc45640 1 -- 172.21.15.146:0/763361351 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94134224268976] v31'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c940af040 con 0x7f0c8c021070 2024-09-18T01:45:28.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.038+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v31'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c8403b040 con 0x559d54fee8d0 2024-09-18T01:45:28.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.038+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94134224276576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d54ffd530 con 0x559d54fee8d0 2024-09-18T01:45:28.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.038+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d54ffde00 con 0x7f0c94069380 2024-09-18T01:45:28.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.039+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94134224276576] v31'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c8403b040 con 0x559d54fee8d0 2024-09-18T01:45:28.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.039+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v31'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c8403b040 con 0x7f0c94069380 2024-09-18T01:45:28.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.039+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94134224277632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d54ffd950 con 0x7f0c94069380 2024-09-18T01:45:28.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.039+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d54ffe870 con 0x7f0c94069380 2024-09-18T01:45:28.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.040+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94134224277632] v31'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c8403b040 con 0x7f0c94069380 2024-09-18T01:45:28.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.040+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v31'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c8403b040 con 0x7f0c94069380 2024-09-18T01:45:28.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.040+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94134224282464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d54ffea50 con 0x7f0c94069380 2024-09-18T01:45:28.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.040+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d54fff2a0 con 0x7f0c94069380 2024-09-18T01:45:28.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.041+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(58 notify.7 [create] v31'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c8403b040 con 0x7f0c94069380 2024-09-18T01:45:28.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.041+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94134224284720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d54fff640 con 0x7f0c94069380 2024-09-18T01:45:28.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.041+0000 7f0c9f151800 20 add_watcher() i=0 2024-09-18T01:45:28.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.041+0000 7f0c9f151800 20 add_watcher() i=1 2024-09-18T01:45:28.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.041+0000 7f0c9f151800 20 add_watcher() i=2 2024-09-18T01:45:28.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.041+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94134224282464] v31'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c8403b040 con 0x7f0c94069380 2024-09-18T01:45:28.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.041+0000 7f0c9f151800 20 add_watcher() i=3 2024-09-18T01:45:28.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.041+0000 7f0c9f151800 20 add_watcher() i=4 2024-09-18T01:45:28.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.041+0000 7f0c9f151800 20 add_watcher() i=5 2024-09-18T01:45:28.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.041+0000 7f0c9f151800 20 add_watcher() i=6 2024-09-18T01:45:28.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.042+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94134224284720] v31'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c8403b040 con 0x7f0c94069380 2024-09-18T01:45:28.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.042+0000 7f0c9f151800 20 add_watcher() i=7 2024-09-18T01:45:28.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.042+0000 7f0c9f151800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:28.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.042+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559d54ffd4a0 con 0x559d54fee8d0 2024-09-18T01:45:28.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.042+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0c8403b040 con 0x559d54fee8d0 2024-09-18T01:45:28.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.042+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94134224278688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d54fffb50 con 0x559d54fee8d0 2024-09-18T01:45:28.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.043+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94134224278688] v31'134 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0c8403b040 con 0x559d54fee8d0 2024-09-18T01:45:28.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.043+0000 7f0b537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:28.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.043+0000 7f0c9f151800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:28.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.043+0000 7f0c9f151800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:28.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.043+0000 7f0c9f151800 5 note: GC not initialized 2024-09-18T01:45:28.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.043+0000 7f0b527e4640 20 reqs_thread_entry: start 2024-09-18T01:45:28.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.044+0000 7f0c9f151800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:28.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.044+0000 7f0c9f151800 20 Filter name: none 2024-09-18T01:45:28.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.044+0000 7f0b4bfff640 20 reqs_thread_entry: start 2024-09-18T01:45:28.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.044+0000 7f0c9f151800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-18T01:45:28.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.044+0000 7f0c9f151800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.044+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559d55035c20 con 0x7f0c94069380 2024-09-18T01:45:28.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.044+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(62 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7f0c8403b040 con 0x7f0c94069380 2024-09-18T01:45:28.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.044+0000 7f0c9f151800 20 rados_obj.operate() r=0 bl.length=419 2024-09-18T01:45:28.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.044+0000 7f0c9f151800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-18T01:45:28.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.044+0000 7f0c9f151800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-18T01:45:28.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.044+0000 7f0c9f151800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:45:28.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.044+0000 7f0c9f151800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-18T01:45:28.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.044+0000 7f0c9f151800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.044+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559d55035670 con 0x7f0c8c021070 2024-09-18T01:45:28.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.045+0000 7f0c9cc45640 1 -- 172.21.15.146:0/763361351 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv23 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f0c940af040 con 0x7f0c8c021070 2024-09-18T01:45:28.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.045+0000 7f0c9f151800 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T01:45:28.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.045+0000 7f0c9f151800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-18T01:45:28.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.045+0000 7f0c9f151800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T01:45:28.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.045+0000 7f0c9f151800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 : miss 2024-09-18T01:45:28.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.045+0000 7f0c9f151800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.045+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:64 8.13 8:ceaa8859:root::.bucket.meta.myfoo%3a8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559d55039450 con 0x7f0c94069380 2024-09-18T01:45:28.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.045+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(64 .bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv6 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f0c8403b040 con 0x7f0c94069380 2024-09-18T01:45:28.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.045+0000 7f0c9f151800 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T01:45:28.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.045+0000 7f0c9f151800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 info.flags=0x17 2024-09-18T01:45:28.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.045+0000 7f0c9f151800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 to cache LRU end 2024-09-18T01:45:28.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.045+0000 7f0c9f151800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:45:28.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.045+0000 7f0c9f151800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T01:45:28.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.046+0000 7f0c9f151800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 2024-09-18T01:45:28.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.046+0000 7f0c9f151800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : hit (requested=0x13, cached=0x13) 2024-09-18T01:45:28.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.046+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d5503dad0 con 0x7f0c8c021070 2024-09-18T01:45:28.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.047+0000 7f0c9cc45640 1 -- 172.21.15.146:0/763361351 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(65 foo.buckets [call] v31'24 uv24 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f0c940af040 con 0x7f0c8c021070 2024-09-18T01:45:28.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.047+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:66 8.c 8:36be43c9:root::.bucket.meta.testx%3amyfoo%3a8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1:head [create,call version.inc in=38b,writefull 0~412 in=412b,setxattr user.rgw.acl (203) in=215b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d550413e0 con 0x559d54fee8d0 2024-09-18T01:45:28.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.048+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(66 .bucket.meta.testx:myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 [create,call,writefull 0~412,setxattr (203)] v31'1 uv1 ondisk = 0) ==== 338+0+0 (crc 0 0 0) 0x7f0c8403b040 con 0x559d54fee8d0 2024-09-18T01:45:28.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.048+0000 7f0c9f151800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 info.flags=0x7 2024-09-18T01:45:28.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.048+0000 7f0c9f151800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 to cache LRU end 2024-09-18T01:45:28.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.048+0000 7f0c9f151800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-18T01:45:28.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.048+0000 7f0c9f151800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1, ofs0, ns] 2024-09-18T01:45:28.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.048+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify cookie 94134224548368 in=859b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559d55040e70 con 0x559d54fee8d0 2024-09-18T01:45:28.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.048+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== watch-notify(notify (1) cookie 94134224276576 notify 133143986187 ret 0) ==== 889+0+0 (crc 0 0 0) 0x559d55041780 con 0x559d54fee8d0 2024-09-18T01:45:28.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.048+0000 7f0b73fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986187 cookie 94134224276576 notifier 4551 bl.length()=847 2024-09-18T01:45:28.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.048+0000 7f0b73fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 info.flags=0x7 2024-09-18T01:45:28.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.048+0000 7f0b73fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.testx:myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 to cache LRU end 2024-09-18T01:45:28.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.048+0000 7f0b73fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-18T01:45:28.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.048+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(67 notify.4 [notify cookie 94134224548368 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0c8403b040 con 0x559d54fee8d0 2024-09-18T01:45:28.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.048+0000 7f0b73fff640 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f0b60003ea0 con 0x559d54fee8d0 2024-09-18T01:45:28.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.048+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(68 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c8403b040 con 0x559d54fee8d0 2024-09-18T01:45:28.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.048+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== watch-notify(notify_complete (2) cookie 94134224548368 notify 133143986187 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559d5503d5d0 con 0x559d54fee8d0 2024-09-18T01:45:28.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.048+0000 7f0c9f151800 20 handle_bi_update(): bucket=testx:myfoo[8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1]): orig_sources= new_sources= 2024-09-18T01:45:28.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.048+0000 7f0c9f151800 20 handle_bi_update(): bucket=testx:myfoo[8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1]): potential sources added=[] removed=[] 2024-09-18T01:45:28.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.048+0000 7f0c9f151800 20 handle_bi_update(): bucket=testx:myfoo[8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1]): orig_dests= new_dests= 2024-09-18T01:45:28.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.048+0000 7f0c9f151800 20 handle_bi_update(): bucket=testx:myfoo[8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1]): potential dests added=[] removed=[] 2024-09-18T01:45:28.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.048+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:69 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d55040f70 con 0x559d54fee8d0 2024-09-18T01:45:28.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.049+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== osd_op_reply(69 testx$tenanteduser.buckets [call] v31'2 uv2 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f0c8403b040 con 0x559d54fee8d0 2024-09-18T01:45:28.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.049+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:70 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [delete,create,call version.inc in=38b,writefull 0~193 in=193b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d55040f70 con 0x559d54fee8d0 2024-09-18T01:45:28.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.051+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.1 v2:172.21.15.146:6808/3930274777 28 ==== osd_op_reply(70 testx/myfoo [delete,create,call,writefull 0~193] v31'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7f0c8403b040 con 0x559d54fee8d0 2024-09-18T01:45:28.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.051+0000 7f0c9f151800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-18T01:45:28.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.051+0000 7f0c9f151800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-18T01:45:28.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.051+0000 7f0c9f151800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-18T01:45:28.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.051+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify cookie 94134224554688 in=360b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559d55040ee0 con 0x559d54fee8d0 2024-09-18T01:45:28.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.051+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.1 v2:172.21.15.146:6808/3930274777 29 ==== watch-notify(notify (1) cookie 94134224276576 notify 133143986188 ret 0) ==== 390+0+0 (crc 0 0 0) 0x559d55041310 con 0x559d54fee8d0 2024-09-18T01:45:28.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.051+0000 7f0b737fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986188 cookie 94134224276576 notifier 4551 bl.length()=348 2024-09-18T01:45:28.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.051+0000 7f0b737fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-18T01:45:28.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.051+0000 7f0b737fe640 10 rgw watcher librados: moving default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-18T01:45:28.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.051+0000 7f0b737fe640 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f0ac4003400 con 0x559d54fee8d0 2024-09-18T01:45:28.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.051+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.1 v2:172.21.15.146:6808/3930274777 30 ==== osd_op_reply(71 notify.4 [notify cookie 94134224554688 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0c8403b040 con 0x559d54fee8d0 2024-09-18T01:45:28.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.051+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.1 v2:172.21.15.146:6808/3930274777 31 ==== watch-notify(notify_complete (2) cookie 94134224554688 notify 133143986188 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559d55040220 con 0x559d54fee8d0 2024-09-18T01:45:28.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.051+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.1 v2:172.21.15.146:6808/3930274777 32 ==== osd_op_reply(72 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c8403b040 con 0x559d54fee8d0 2024-09-18T01:45:28.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.051+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:73 8.9 8:91b71841:root::myfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d55040f70 con 0x7f0c8c021070 2024-09-18T01:45:28.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.053+0000 7f0c9cc45640 1 -- 172.21.15.146:0/763361351 <== osd.2 v2:172.21.15.146:6800/3820039304 14 ==== osd_op_reply(73 myfoo [call,delete] v31'25 uv25 ondisk = 0) ==== 191+0+0 (crc 0 0 0) 0x7f0c940af040 con 0x7f0c8c021070 2024-09-18T01:45:28.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.053+0000 7f0c9f151800 10 removing default.rgw.meta+root+myfoo from cache 2024-09-18T01:45:28.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.053+0000 7f0c9f151800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-18T01:45:28.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.053+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94134224554688 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559d55040ee0 con 0x7f0c94069380 2024-09-18T01:45:28.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.053+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== watch-notify(notify (1) cookie 94134224282464 notify 133143986187 ret 0) ==== 191+0+0 (crc 0 0 0) 0x559d55040220 con 0x7f0c94069380 2024-09-18T01:45:28.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.053+0000 7f0b73fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986187 cookie 94134224282464 notifier 4551 bl.length()=149 2024-09-18T01:45:28.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.053+0000 7f0b73fff640 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:75 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f0b60003ea0 con 0x7f0c94069380 2024-09-18T01:45:28.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.053+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(74 notify.6 [notify cookie 94134224554688 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0c8403b040 con 0x7f0c94069380 2024-09-18T01:45:28.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.053+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== watch-notify(notify_complete (2) cookie 94134224554688 notify 133143986187 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559d5503d5d0 con 0x7f0c94069380 2024-09-18T01:45:28.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.053+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.0 v2:172.21.15.129:6800/1759265424 22 ==== osd_op_reply(75 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c8403b040 con 0x7f0c94069380 2024-09-18T01:45:28.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.053+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:76 8.13 8:ceaa8859:root::.bucket.meta.myfoo%3a8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d55040f70 con 0x7f0c94069380 2024-09-18T01:45:28.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.054+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.0 v2:172.21.15.129:6800/1759265424 23 ==== osd_op_reply(76 .bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 [call,delete] v31'10 uv10 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f0c8403b040 con 0x7f0c94069380 2024-09-18T01:45:28.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.054+0000 7f0c9f151800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 from cache 2024-09-18T01:45:28.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.054+0000 7f0c9f151800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1, ofs0, ns] 2024-09-18T01:45:28.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.054+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:77 7.3 7:c609908c:::notify.5:head [notify cookie 94134224526032 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559d55040f70 con 0x7f0c94069380 2024-09-18T01:45:28.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.055+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.0 v2:172.21.15.129:6800/1759265424 24 ==== watch-notify(notify (1) cookie 94134224277632 notify 133143986188 ret 0) ==== 248+0+0 (crc 0 0 0) 0x559d5503d5d0 con 0x7f0c94069380 2024-09-18T01:45:28.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.055+0000 7f0b737fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986188 cookie 94134224277632 notifier 4551 bl.length()=206 2024-09-18T01:45:28.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.055+0000 7f0b737fe640 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f0ac40033e0 con 0x7f0c94069380 2024-09-18T01:45:28.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.055+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.0 v2:172.21.15.129:6800/1759265424 25 ==== osd_op_reply(77 notify.5 [notify cookie 94134224526032 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0c8403b040 con 0x7f0c94069380 2024-09-18T01:45:28.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.055+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.0 v2:172.21.15.129:6800/1759265424 26 ==== osd_op_reply(78 notify.5 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c8403b040 con 0x7f0c94069380 2024-09-18T01:45:28.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.055+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.0 v2:172.21.15.129:6800/1759265424 27 ==== watch-notify(notify_complete (2) cookie 94134224526032 notify 133143986188 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559d55039840 con 0x7f0c94069380 2024-09-18T01:45:28.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.056+0000 7f0b537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:28.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.056+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94134224278688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d550337d0 con 0x559d54fee8d0 2024-09-18T01:45:28.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.057+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.1 v2:172.21.15.146:6808/3930274777 33 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94134224278688] v31'135 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0c8403b040 con 0x559d54fee8d0 2024-09-18T01:45:28.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.057+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94134224259312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d550337d0 con 0x7f0c8c021070 2024-09-18T01:45:28.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.058+0000 7f0c9cc45640 1 -- 172.21.15.146:0/763361351 <== osd.2 v2:172.21.15.146:6800/3820039304 15 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94134224259312] v31'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c940af040 con 0x7f0c8c021070 2024-09-18T01:45:28.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.058+0000 7f0c9f151800 20 remove_watcher() i=0 2024-09-18T01:45:28.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.058+0000 7f0c9f151800 2 removed watcher, disabling cache 2024-09-18T01:45:28.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.058+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94134224266864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d550337d0 con 0x559d54fee8d0 2024-09-18T01:45:28.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.059+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.1 v2:172.21.15.146:6808/3930274777 34 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94134224266864] v31'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c8403b040 con 0x559d54fee8d0 2024-09-18T01:45:28.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.059+0000 7f0c9f151800 20 remove_watcher() i=1 2024-09-18T01:45:28.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.059+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94134224267920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d550337d0 con 0x559d54ff4b70 2024-09-18T01:45:28.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.060+0000 7f0c9d446640 1 -- 172.21.15.146:0/763361351 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94134224267920] v31'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c8c03b020 con 0x559d54ff4b70 2024-09-18T01:45:28.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.060+0000 7f0c9f151800 20 remove_watcher() i=2 2024-09-18T01:45:28.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.060+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94134224268976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d550337d0 con 0x7f0c8c021070 2024-09-18T01:45:28.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.061+0000 7f0c9cc45640 1 -- 172.21.15.146:0/763361351 <== osd.2 v2:172.21.15.146:6800/3820039304 16 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94134224268976] v31'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c940af040 con 0x7f0c8c021070 2024-09-18T01:45:28.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.061+0000 7f0c9f151800 20 remove_watcher() i=3 2024-09-18T01:45:28.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.061+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94134224276576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d550337d0 con 0x559d54fee8d0 2024-09-18T01:45:28.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.062+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.1 v2:172.21.15.146:6808/3930274777 35 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94134224276576] v31'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c8403b040 con 0x559d54fee8d0 2024-09-18T01:45:28.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.062+0000 7f0c9f151800 20 remove_watcher() i=4 2024-09-18T01:45:28.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.062+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94134224277632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d550337d0 con 0x7f0c94069380 2024-09-18T01:45:28.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.063+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.0 v2:172.21.15.129:6800/1759265424 28 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94134224277632] v31'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c8403b040 con 0x7f0c94069380 2024-09-18T01:45:28.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.063+0000 7f0c9f151800 20 remove_watcher() i=5 2024-09-18T01:45:28.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.063+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94134224282464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d550337d0 con 0x7f0c94069380 2024-09-18T01:45:28.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.064+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.0 v2:172.21.15.129:6800/1759265424 29 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94134224282464] v31'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c8403b040 con 0x7f0c94069380 2024-09-18T01:45:28.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.064+0000 7f0c9f151800 20 remove_watcher() i=6 2024-09-18T01:45:28.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.064+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94134224284720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559d550337d0 con 0x7f0c94069380 2024-09-18T01:45:28.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.065+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 <== osd.0 v2:172.21.15.129:6800/1759265424 30 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94134224284720] v31'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c8403b040 con 0x7f0c94069380 2024-09-18T01:45:28.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.065+0000 7f0c9f151800 20 remove_watcher() i=7 2024-09-18T01:45:28.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.065+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f0c94069380 msgr2=0x7f0c940903b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.065+0000 7f0c9f151800 1 --2- 172.21.15.146:0/763361351 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f0c94069380 0x7f0c940903b0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.065+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559d54fee8d0 msgr2=0x559d54ff0d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.065+0000 7f0c9f151800 1 --2- 172.21.15.146:0/763361351 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559d54fee8d0 0x559d54ff0d90 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.065+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f0c8c021070 msgr2=0x7f0c8c0163a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.065+0000 7f0c9f151800 1 --2- 172.21.15.146:0/763361351 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f0c8c021070 0x7f0c8c0163a0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.065+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x559d54ff4b70 msgr2=0x559d54ff6f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.065+0000 7f0c9f151800 1 --2- 172.21.15.146:0/763361351 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x559d54ff4b70 0x559d54ff6f80 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.065+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0b68036b90 msgr2=0x7f0b68039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.065+0000 7f0c9f151800 1 --2- 172.21.15.146:0/763361351 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0b68036b90 0x7f0b68039050 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x559d54fc1300 tx=0x7f0c94087000 comp rx=0 tx=0).stop 2024-09-18T01:45:28.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.065+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d54fdb910 msgr2=0x559d54fe2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.065+0000 7f0c9c444640 1 -- 172.21.15.146:0/763361351 reap_dead start 2024-09-18T01:45:28.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.065+0000 7f0c9f151800 1 --2- 172.21.15.146:0/763361351 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d54fdb910 0x559d54fe2e00 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c015010 tx=0x7f0c8c04c890 comp rx=0 tx=0).stop 2024-09-18T01:45:28.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.065+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 shutdown_connections 2024-09-18T01:45:28.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.065+0000 7f0c9f151800 1 --2- 172.21.15.146:0/763361351 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d54fdb910 0x559d54fe2e00 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.065+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 >> 172.21.15.146:0/763361351 conn(0x559d54fd7c70 msgr2=0x559d54fd5d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:28.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.065+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 shutdown_connections 2024-09-18T01:45:28.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.065+0000 7f0c9f151800 1 -- 172.21.15.146:0/763361351 wait complete. 2024-09-18T01:45:28.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.066+0000 7f0c9f151800 1 -- 172.21.15.146:0/3399154908 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0b74036b90 msgr2=0x7f0b74039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.066+0000 7f0c9f151800 1 --2- 172.21.15.146:0/3399154908 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0b74036b90 0x7f0b74039050 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0c94060c10 tx=0x7f0c94061420 comp rx=0 tx=0).stop 2024-09-18T01:45:28.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.066+0000 7f0c9f151800 1 -- 172.21.15.146:0/3399154908 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d54fcec70 msgr2=0x559d54fcf090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.066+0000 7f0c9f151800 1 --2- 172.21.15.146:0/3399154908 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d54fcec70 0x559d54fcf090 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x559d54fb4ff0 tx=0x7f0c8c00ef30 comp rx=0 tx=0).stop 2024-09-18T01:45:28.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.066+0000 7f0c9f151800 1 -- 172.21.15.146:0/3399154908 shutdown_connections 2024-09-18T01:45:28.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.066+0000 7f0c9f151800 1 --2- 172.21.15.146:0/3399154908 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0b74036b90 0x7f0b74039050 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.066+0000 7f0c9f151800 1 --2- 172.21.15.146:0/3399154908 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d54fcec70 0x559d54fcf090 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.066+0000 7f0c9f151800 1 -- 172.21.15.146:0/3399154908 >> 172.21.15.146:0/3399154908 conn(0x559d54fc3c00 msgr2=0x559d54fc6780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:28.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.066+0000 7f0c9f151800 1 -- 172.21.15.146:0/3399154908 shutdown_connections 2024-09-18T01:45:28.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.066+0000 7f0c9f151800 1 -- 172.21.15.146:0/3399154908 wait complete. 2024-09-18T01:45:28.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.066+0000 7f0c9f151800 1 -- 172.21.15.146:0/3229911782 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559d54ebc390 msgr2=0x559d54fbafb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.066+0000 7f0c9f151800 1 --2- 172.21.15.146:0/3229911782 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559d54ebc390 0x559d54fbafb0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.066+0000 7f0c9f151800 1 -- 172.21.15.146:0/3229911782 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x559d54fbcef0 msgr2=0x559d54fc0770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.066+0000 7f0c9f151800 1 --2- 172.21.15.146:0/3229911782 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x559d54fbcef0 0x559d54fc0770 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.066+0000 7f0c9f151800 1 -- 172.21.15.146:0/3229911782 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0b84036b40 msgr2=0x7f0b84039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.066+0000 7f0c9f151800 1 --2- 172.21.15.146:0/3229911782 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0b84036b40 0x7f0b84039000 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0c84000c00 tx=0x7f0c840013b0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.066+0000 7f0c9f151800 1 -- 172.21.15.146:0/3229911782 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d54ebba50 msgr2=0x559d54fb3f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.066+0000 7f0c9f151800 1 --2- 172.21.15.146:0/3229911782 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d54ebba50 0x559d54fb3f40 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f0c94045d30 tx=0x7f0c94003330 comp rx=0 tx=0).stop 2024-09-18T01:45:28.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.066+0000 7f0c9f151800 1 -- 172.21.15.146:0/3229911782 shutdown_connections 2024-09-18T01:45:28.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.066+0000 7f0c9f151800 1 --2- 172.21.15.146:0/3229911782 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x559d54fbcef0 0x559d54fc0770 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.066+0000 7f0c9f151800 1 --2- 172.21.15.146:0/3229911782 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559d54ebc390 0x559d54fbafb0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.066+0000 7f0c9f151800 1 --2- 172.21.15.146:0/3229911782 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0b84036b40 0x7f0b84039000 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.066+0000 7f0c9f151800 1 --2- 172.21.15.146:0/3229911782 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559d54ebba50 0x559d54fb3f40 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.066+0000 7f0c9f151800 1 -- 172.21.15.146:0/3229911782 >> 172.21.15.146:0/3229911782 conn(0x559d54eb75e0 msgr2=0x559d54fa6920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:28.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.066+0000 7f0c9f151800 1 -- 172.21.15.146:0/3229911782 shutdown_connections 2024-09-18T01:45:28.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.066+0000 7f0c9f151800 1 -- 172.21.15.146:0/3229911782 wait complete. 2024-09-18T01:45:28.084 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:testx/myfoo'] 2024-09-18T01:45:28.084 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:testx/myfoo'] 2024-09-18T01:45:28.084 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo 2024-09-18T01:45:28.127 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:28.127 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:28.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.127+0000 7f7136f26800 1 Processor -- start 2024-09-18T01:45:28.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.127+0000 7f7136f26800 1 -- start start 2024-09-18T01:45:28.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.127+0000 7f7136f26800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x560f7bb2b990 0x560f7bb2dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.127+0000 7f7136f26800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560f7b9e7b30 con 0x560f7bb27550 2024-09-18T01:45:28.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.127+0000 7f7136f26800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x560f7b9c9360 con 0x560f7bb2b990 2024-09-18T01:45:28.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.128+0000 7f71323e2640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x560f7bb2b990 0x560f7bb2dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.128+0000 7f7132be3640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x560f7bb27550 0x560f7bb27950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:47346/0 (socket says 172.21.15.146:47346) 2024-09-18T01:45:28.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.128+0000 7f7132be3640 1 -- 172.21.15.146:0/1616568418 learned_addr learned my addr 172.21.15.146:0/1616568418 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:45:28.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.128+0000 7f71323e2640 1 -- 172.21.15.146:0/1616568418 >> v1:172.21.15.129:6789/0 conn(0x560f7bb27550 legacy=0x560f7bb27950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.128+0000 7f71323e2640 1 -- 172.21.15.146:0/1616568418 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f7b9efe00 con 0x560f7bb2b990 2024-09-18T01:45:28.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.130+0000 7f71323e2640 1 --2- 172.21.15.146:0/1616568418 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x560f7bb2b990 0x560f7bb2dd80 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f711c00a470 tx=0x7f711c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87ad82b9020ecb31 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.130+0000 7f7131be1640 1 -- 172.21.15.146:0/1616568418 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f711c053570 con 0x560f7bb2b990 2024-09-18T01:45:28.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.130+0000 7f7131be1640 1 -- 172.21.15.146:0/1616568418 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f711c058070 con 0x560f7bb2b990 2024-09-18T01:45:28.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.130+0000 7f7131be1640 1 -- 172.21.15.146:0/1616568418 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f711c053880 con 0x560f7bb2b990 2024-09-18T01:45:28.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.130+0000 7f7136f26800 1 -- 172.21.15.146:0/1616568418 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x560f7bb2b990 msgr2=0x560f7bb2dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.130+0000 7f7136f26800 1 --2- 172.21.15.146:0/1616568418 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x560f7bb2b990 0x560f7bb2dd80 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f711c00a470 tx=0x7f711c045a20 comp rx=0 tx=0).stop 2024-09-18T01:45:28.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.130+0000 7f7136f26800 1 -- 172.21.15.146:0/1616568418 shutdown_connections 2024-09-18T01:45:28.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.130+0000 7f7136f26800 1 --2- 172.21.15.146:0/1616568418 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x560f7bb2b990 0x560f7bb2dd80 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.130+0000 7f7136f26800 1 -- 172.21.15.146:0/1616568418 >> 172.21.15.146:0/1616568418 conn(0x560f7bb22de0 msgr2=0x560f7bb25200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:28.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.130+0000 7f7136f26800 1 -- 172.21.15.146:0/1616568418 shutdown_connections 2024-09-18T01:45:28.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.130+0000 7f7136f26800 1 -- 172.21.15.146:0/1616568418 wait complete. 2024-09-18T01:45:28.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.144+0000 7f7136f26800 1 Processor -- start 2024-09-18T01:45:28.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.144+0000 7f7136f26800 1 -- start start 2024-09-18T01:45:28.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.144+0000 7f7136f26800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x560f7bb27550 0x560f7bc16800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.144+0000 7f7136f26800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x560f7ba74330 con 0x560f7bb27550 2024-09-18T01:45:28.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.145+0000 7f7132be3640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x560f7bb27550 0x560f7bc16800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.145+0000 7f7132be3640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x560f7bb27550 0x560f7bc16800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:57908/0 (socket says 172.21.15.146:57908) 2024-09-18T01:45:28.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.145+0000 7f7132be3640 1 -- 172.21.15.146:0/4293088933 learned_addr learned my addr 172.21.15.146:0/4293088933 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:28.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.145+0000 7f7132be3640 1 -- 172.21.15.146:0/4293088933 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f7b9c1bc0 con 0x560f7bb27550 2024-09-18T01:45:28.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.145+0000 7f7132be3640 1 --2- 172.21.15.146:0/4293088933 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x560f7bb27550 0x560f7bc16800 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f7124001e10 tx=0x7f712400b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb7fc78b960f1ffd server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.145+0000 7f7020e09640 1 -- 172.21.15.146:0/4293088933 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7124012020 con 0x560f7bb27550 2024-09-18T01:45:28.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.145+0000 7f7020e09640 1 -- 172.21.15.146:0/4293088933 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f712400e5a0 con 0x560f7bb27550 2024-09-18T01:45:28.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.145+0000 7f7020e09640 1 -- 172.21.15.146:0/4293088933 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f712400e8e0 con 0x560f7bb27550 2024-09-18T01:45:28.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.146+0000 7f7136f26800 1 -- 172.21.15.146:0/4293088933 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x560f7bb27550 msgr2=0x560f7bc16800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.146+0000 7f7136f26800 1 --2- 172.21.15.146:0/4293088933 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x560f7bb27550 0x560f7bc16800 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f7124001e10 tx=0x7f712400b780 comp rx=0 tx=0).stop 2024-09-18T01:45:28.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.146+0000 7f7136f26800 1 -- 172.21.15.146:0/4293088933 shutdown_connections 2024-09-18T01:45:28.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.146+0000 7f7136f26800 1 --2- 172.21.15.146:0/4293088933 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x560f7bb27550 0x560f7bc16800 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.146+0000 7f7136f26800 1 -- 172.21.15.146:0/4293088933 >> 172.21.15.146:0/4293088933 conn(0x560f7bb22de0 msgr2=0x560f7bc121c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:28.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.146+0000 7f7136f26800 1 -- 172.21.15.146:0/4293088933 shutdown_connections 2024-09-18T01:45:28.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.146+0000 7f7136f26800 1 -- 172.21.15.146:0/4293088933 wait complete. 2024-09-18T01:45:28.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.146+0000 7f7136f26800 1 Processor -- start 2024-09-18T01:45:28.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.146+0000 7f7136f26800 1 -- start start 2024-09-18T01:45:28.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.147+0000 7f7136f26800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x560f7bb27550 0x560f7bc1e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.147+0000 7f7136f26800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x560f7bb2e5c0 con 0x560f7bb27550 2024-09-18T01:45:28.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.147+0000 7f7132be3640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x560f7bb27550 0x560f7bc1e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.147+0000 7f7132be3640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x560f7bb27550 0x560f7bc1e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:57924/0 (socket says 172.21.15.146:57924) 2024-09-18T01:45:28.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.147+0000 7f7132be3640 1 -- 172.21.15.146:0/431355443 learned_addr learned my addr 172.21.15.146:0/431355443 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:28.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.147+0000 7f7132be3640 1 -- 172.21.15.146:0/431355443 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f7b9d5fe0 con 0x560f7bb27550 2024-09-18T01:45:28.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.147+0000 7f7132be3640 1 --2- 172.21.15.146:0/431355443 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x560f7bb27550 0x560f7bc1e200 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f7124001e10 tx=0x7f7124000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.147+0000 7f701f606640 1 -- 172.21.15.146:0/431355443 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7124012030 con 0x560f7bb27550 2024-09-18T01:45:28.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.147+0000 7f701f606640 1 -- 172.21.15.146:0/431355443 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f712401c320 con 0x560f7bb27550 2024-09-18T01:45:28.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.147+0000 7f7136f26800 1 -- 172.21.15.146:0/431355443 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560f7bc1e740 con 0x560f7bb27550 2024-09-18T01:45:28.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.147+0000 7f701f606640 1 -- 172.21.15.146:0/431355443 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f712401c9b0 con 0x560f7bb27550 2024-09-18T01:45:28.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.147+0000 7f7136f26800 1 -- 172.21.15.146:0/431355443 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f7bc1ec60 con 0x560f7bb27550 2024-09-18T01:45:28.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.148+0000 7f701f606640 1 -- 172.21.15.146:0/431355443 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7124015020 con 0x560f7bb27550 2024-09-18T01:45:28.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.148+0000 7f701f606640 1 --2- 172.21.15.146:0/431355443 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7018036b40 0x7f7018039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.148+0000 7f701f606640 1 -- 172.21.15.146:0/431355443 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f7124022030 con 0x560f7bb27550 2024-09-18T01:45:28.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.148+0000 7f71323e2640 1 --2- 172.21.15.146:0/431355443 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7018036b40 0x7f7018039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.148+0000 7f7136f26800 1 --2- 172.21.15.146:0/431355443 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x560f7bb2b990 0x560f7bc241c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.149+0000 7f7136f26800 1 -- 172.21.15.146:0/431355443 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc24700 con 0x560f7bb2b990 2024-09-18T01:45:28.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.149+0000 7f71333e4640 1 --2- 172.21.15.146:0/431355443 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x560f7bb2b990 0x560f7bc241c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.149+0000 7f71323e2640 1 --2- 172.21.15.146:0/431355443 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7018036b40 0x7f7018039000 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f711c057000 tx=0x7f711c052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.149+0000 7f71333e4640 1 --2- 172.21.15.146:0/431355443 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x560f7bb2b990 0x560f7bc241c0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.149+0000 7f71333e4640 1 -- 172.21.15.146:0/431355443 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f712c00a4a0 con 0x560f7bb2b990 2024-09-18T01:45:28.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.149+0000 7f7136f26800 1 -- 172.21.15.146:0/431355443 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc21750 con 0x560f7bb2b990 2024-09-18T01:45:28.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.149+0000 7f71333e4640 1 -- 172.21.15.146:0/431355443 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f712c00a4a0 con 0x560f7bb2b990 2024-09-18T01:45:28.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.149+0000 7f7136f26800 1 -- 172.21.15.146:0/431355443 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc264c0 con 0x560f7bb2b990 2024-09-18T01:45:28.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.150+0000 7f71333e4640 1 -- 172.21.15.146:0/431355443 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f712c00a4a0 con 0x560f7bb2b990 2024-09-18T01:45:28.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.150+0000 7f7136f26800 1 -- 172.21.15.146:0/431355443 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc25600 con 0x560f7bb2b990 2024-09-18T01:45:28.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.150+0000 7f71333e4640 1 -- 172.21.15.146:0/431355443 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f712c00a4a0 con 0x560f7bb2b990 2024-09-18T01:45:28.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.150+0000 7f7136f26800 1 --2- 172.21.15.146:0/431355443 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x560f7bc260d0 0x560f7bc29900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.150+0000 7f7136f26800 1 -- 172.21.15.146:0/431355443 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc2a090 con 0x560f7bc260d0 2024-09-18T01:45:28.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.150+0000 7f7132be3640 1 --2- 172.21.15.146:0/431355443 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x560f7bc260d0 0x560f7bc29900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.150+0000 7f7132be3640 1 --2- 172.21.15.146:0/431355443 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x560f7bc260d0 0x560f7bc29900 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.151+0000 7f7132be3640 1 -- 172.21.15.146:0/431355443 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f712401cd30 con 0x560f7bc260d0 2024-09-18T01:45:28.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.151+0000 7f7136f26800 1 Processor -- start 2024-09-18T01:45:28.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.151+0000 7f7136f26800 1 -- start start 2024-09-18T01:45:28.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.151+0000 7f7136f26800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x560f7bc37e20 0x560f7bc38240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.151+0000 7f7136f26800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x560f7b9c3580 con 0x560f7bc37e20 2024-09-18T01:45:28.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.151+0000 7f71333e4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x560f7bc37e20 0x560f7bc38240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.151+0000 7f71333e4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x560f7bc37e20 0x560f7bc38240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:57928/0 (socket says 172.21.15.146:57928) 2024-09-18T01:45:28.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.151+0000 7f71333e4640 1 -- 172.21.15.146:0/4198254003 learned_addr learned my addr 172.21.15.146:0/4198254003 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:28.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.152+0000 7f71333e4640 1 -- 172.21.15.146:0/4198254003 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f7bc38780 con 0x560f7bc37e20 2024-09-18T01:45:28.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.152+0000 7f71333e4640 1 --2- 172.21.15.146:0/4198254003 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x560f7bc37e20 0x560f7bc38240 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x560f7bc24aa0 tx=0x7f712c0178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.152+0000 7f701ce01640 1 -- 172.21.15.146:0/4198254003 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f712c013440 con 0x560f7bc37e20 2024-09-18T01:45:28.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.152+0000 7f701ce01640 1 -- 172.21.15.146:0/4198254003 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f712c0135e0 con 0x560f7bc37e20 2024-09-18T01:45:28.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.152+0000 7f7136f26800 1 -- 172.21.15.146:0/4198254003 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560f7bc38a10 con 0x560f7bc37e20 2024-09-18T01:45:28.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.152+0000 7f701ce01640 1 -- 172.21.15.146:0/4198254003 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f712c0138c0 con 0x560f7bc37e20 2024-09-18T01:45:28.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.152+0000 7f7136f26800 1 -- 172.21.15.146:0/4198254003 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f7bc3b6f0 con 0x560f7bc37e20 2024-09-18T01:45:28.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.153+0000 7f701ce01640 1 -- 172.21.15.146:0/4198254003 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f712c011040 con 0x560f7bc37e20 2024-09-18T01:45:28.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.153+0000 7f701ce01640 1 --2- 172.21.15.146:0/4198254003 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f700c036b90 0x7f700c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.153+0000 7f701ce01640 1 -- 172.21.15.146:0/4198254003 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f712c01d070 con 0x560f7bc37e20 2024-09-18T01:45:28.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.153+0000 7f7132be3640 1 --2- 172.21.15.146:0/4198254003 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f700c036b90 0x7f700c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.153+0000 7f7136f26800 1 Processor -- start 2024-09-18T01:45:28.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.153+0000 7f7136f26800 1 -- start start 2024-09-18T01:45:28.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.153+0000 7f7132be3640 1 --2- 172.21.15.146:0/4198254003 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f700c036b90 0x7f700c039050 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7124001620 tx=0x7f712400deb0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.153+0000 7f7136f26800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x560f7bc48eb0 0x560f7bc492b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.154+0000 7f7136f26800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x560f7bc16fb0 con 0x560f7bc48eb0 2024-09-18T01:45:28.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.154+0000 7f71333e4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x560f7bc48eb0 0x560f7bc492b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.154+0000 7f71333e4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x560f7bc48eb0 0x560f7bc492b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:57934/0 (socket says 172.21.15.146:57934) 2024-09-18T01:45:28.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.154+0000 7f71333e4640 1 -- 172.21.15.146:0/1081725824 learned_addr learned my addr 172.21.15.146:0/1081725824 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:28.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.154+0000 7f71333e4640 1 -- 172.21.15.146:0/1081725824 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f7bc49880 con 0x560f7bc48eb0 2024-09-18T01:45:28.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.154+0000 7f71333e4640 1 --2- 172.21.15.146:0/1081725824 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x560f7bc48eb0 0x560f7bc492b0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f712c04c890 tx=0x7f712c0127a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fce40329c7ac526 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.154+0000 7f70167fc640 1 -- 172.21.15.146:0/1081725824 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f712c045070 con 0x560f7bc48eb0 2024-09-18T01:45:28.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.154+0000 7f70167fc640 1 -- 172.21.15.146:0/1081725824 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f712c04e0d0 con 0x560f7bc48eb0 2024-09-18T01:45:28.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.154+0000 7f70167fc640 1 -- 172.21.15.146:0/1081725824 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f712c021a50 con 0x560f7bc48eb0 2024-09-18T01:45:28.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.155+0000 7f7136f26800 1 -- 172.21.15.146:0/1081725824 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x560f7bc48eb0 msgr2=0x560f7bc492b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.155+0000 7f7136f26800 1 --2- 172.21.15.146:0/1081725824 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x560f7bc48eb0 0x560f7bc492b0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f712c04c890 tx=0x7f712c0127a0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.155+0000 7f7136f26800 1 -- 172.21.15.146:0/1081725824 shutdown_connections 2024-09-18T01:45:28.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.155+0000 7f7136f26800 1 --2- 172.21.15.146:0/1081725824 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x560f7bc48eb0 0x560f7bc492b0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.155+0000 7f7136f26800 1 -- 172.21.15.146:0/1081725824 >> 172.21.15.146:0/1081725824 conn(0x560f7bc40e00 msgr2=0x560f7bc3ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:28.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.155+0000 7f7136f26800 1 -- 172.21.15.146:0/1081725824 shutdown_connections 2024-09-18T01:45:28.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.155+0000 7f7136f26800 1 -- 172.21.15.146:0/1081725824 wait complete. 2024-09-18T01:45:28.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.155+0000 7f7136f26800 1 Processor -- start 2024-09-18T01:45:28.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.155+0000 7f7136f26800 1 -- start start 2024-09-18T01:45:28.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.155+0000 7f7136f26800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x560f7bc48eb0 0x560f7bc50390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.155+0000 7f7136f26800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x560f7bc49ef0 con 0x560f7bc48eb0 2024-09-18T01:45:28.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.155+0000 7f71333e4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x560f7bc48eb0 0x560f7bc50390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.155+0000 7f71333e4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x560f7bc48eb0 0x560f7bc50390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:57948/0 (socket says 172.21.15.146:57948) 2024-09-18T01:45:28.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.155+0000 7f71333e4640 1 -- 172.21.15.146:0/4278176543 learned_addr learned my addr 172.21.15.146:0/4278176543 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:28.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.156+0000 7f71333e4640 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f7bc508d0 con 0x560f7bc48eb0 2024-09-18T01:45:28.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.156+0000 7f71333e4640 1 --2- 172.21.15.146:0/4278176543 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x560f7bc48eb0 0x560f7bc50390 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f712c0127e0 tx=0x7f712c04c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.156+0000 7f7014ff9640 1 -- 172.21.15.146:0/4278176543 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f712c03a070 con 0x560f7bc48eb0 2024-09-18T01:45:28.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.156+0000 7f7014ff9640 1 -- 172.21.15.146:0/4278176543 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f712c001540 con 0x560f7bc48eb0 2024-09-18T01:45:28.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.156+0000 7f7014ff9640 1 -- 172.21.15.146:0/4278176543 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f712c045040 con 0x560f7bc48eb0 2024-09-18T01:45:28.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.156+0000 7f7136f26800 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560f7bc50b60 con 0x560f7bc48eb0 2024-09-18T01:45:28.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.156+0000 7f7136f26800 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f7bc53810 con 0x560f7bc48eb0 2024-09-18T01:45:28.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.156+0000 7f7014ff9640 1 -- 172.21.15.146:0/4278176543 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f712c03d070 con 0x560f7bc48eb0 2024-09-18T01:45:28.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.157+0000 7f7014ff9640 1 --2- 172.21.15.146:0/4278176543 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6ffc036af0 0x7f6ffc038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.157+0000 7f7014ff9640 1 -- 172.21.15.146:0/4278176543 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f712c032070 con 0x560f7bc48eb0 2024-09-18T01:45:28.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.157+0000 7f7132be3640 1 --2- 172.21.15.146:0/4278176543 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6ffc036af0 0x7f6ffc038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.157+0000 7f7136f26800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.157+0000 7f7136f26800 1 --2- 172.21.15.146:0/4278176543 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x560f7bc5c010 0x560f7bc5e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.157+0000 7f7136f26800 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc5ec20 con 0x560f7bc5c010 2024-09-18T01:45:28.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.157+0000 7f7132be3640 1 --2- 172.21.15.146:0/4278176543 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6ffc036af0 0x7f6ffc038fb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f712401c8b0 tx=0x7f7124036000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.157+0000 7f71323e2640 1 --2- 172.21.15.146:0/4278176543 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x560f7bc5c010 0x560f7bc5e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.157+0000 7f71323e2640 1 --2- 172.21.15.146:0/4278176543 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x560f7bc5c010 0x560f7bc5e4d0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.158+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f711c051070 con 0x560f7bc5c010 2024-09-18T01:45:28.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.158+0000 7f7136f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:28.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.158+0000 7f7136f26800 20 realm 2024-09-18T01:45:28.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.158+0000 7f7136f26800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.158+0000 7f7136f26800 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc5f050 con 0x560f7bc5c010 2024-09-18T01:45:28.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.158+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f711c051070 con 0x560f7bc5c010 2024-09-18T01:45:28.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.158+0000 7f7136f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:28.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.158+0000 7f7136f26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:28.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.158+0000 7f7136f26800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.158+0000 7f7136f26800 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc5f920 con 0x560f7bc5c010 2024-09-18T01:45:28.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.158+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f711c051070 con 0x560f7bc5c010 2024-09-18T01:45:28.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.158+0000 7f7136f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:28.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.158+0000 7f7136f26800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.158+0000 7f7136f26800 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc5fcc0 con 0x560f7bc5c010 2024-09-18T01:45:28.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.158+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f711c051070 con 0x560f7bc5c010 2024-09-18T01:45:28.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.158+0000 7f7136f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:28.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.158+0000 7f7136f26800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.158+0000 7f7136f26800 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc5f530 con 0x560f7bc5c010 2024-09-18T01:45:28.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.159+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f711c051070 con 0x560f7bc5c010 2024-09-18T01:45:28.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.159+0000 7f7136f26800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:28.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.159+0000 7f7136f26800 20 searching for the correct realm 2024-09-18T01:45:28.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.159+0000 7f7136f26800 1 --2- 172.21.15.146:0/4278176543 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x560f7bc62180 0x560f7bc64590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.159+0000 7f7136f26800 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc64c60 con 0x560f7bc62180 2024-09-18T01:45:28.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.159+0000 7f71333e4640 1 --2- 172.21.15.146:0/4278176543 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x560f7bc62180 0x560f7bc64590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.159+0000 7f71333e4640 1 --2- 172.21.15.146:0/4278176543 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x560f7bc62180 0x560f7bc64590 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.159+0000 7f71333e4640 1 -- 172.21.15.146:0/4278176543 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f712c03c030 con 0x560f7bc62180 2024-09-18T01:45:28.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.159+0000 7f71333e4640 1 --2- 172.21.15.146:0/4278176543 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f712c03f060 0x7f712c023070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.159+0000 7f71333e4640 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc64c60 con 0x7f712c03f060 2024-09-18T01:45:28.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.160+0000 7f7132be3640 1 --2- 172.21.15.146:0/4278176543 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f712c03f060 0x7f712c023070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.160+0000 7f7132be3640 1 --2- 172.21.15.146:0/4278176543 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f712c03f060 0x7f712c023070 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.160+0000 7f7132be3640 1 -- 172.21.15.146:0/4278176543 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f712401cd30 con 0x7f712c03f060 2024-09-18T01:45:28.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.160+0000 7f7132be3640 1 --2- 172.21.15.146:0/4278176543 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f712403a040 0x7f7124046810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.160+0000 7f7132be3640 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc64c60 con 0x7f712403a040 2024-09-18T01:45:28.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.160+0000 7f71323e2640 1 --2- 172.21.15.146:0/4278176543 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f712403a040 0x7f7124046810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.161+0000 7f71323e2640 1 --2- 172.21.15.146:0/4278176543 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f712403a040 0x7f7124046810 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.161+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f711c051070 con 0x7f712403a040 2024-09-18T01:45:28.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.161+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc64c60 con 0x560f7bc5c010 2024-09-18T01:45:28.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.161+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f711c051070 con 0x560f7bc5c010 2024-09-18T01:45:28.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.161+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc64c60 con 0x560f7bc5c010 2024-09-18T01:45:28.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.161+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f711c051070 con 0x560f7bc5c010 2024-09-18T01:45:28.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.161+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc64c60 con 0x7f712403a040 2024-09-18T01:45:28.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.161+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f711c051070 con 0x7f712403a040 2024-09-18T01:45:28.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.162+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc64c60 con 0x7f712403a040 2024-09-18T01:45:28.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.162+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f711c051070 con 0x7f712403a040 2024-09-18T01:45:28.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.162+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc64c60 con 0x7f712c03f060 2024-09-18T01:45:28.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.162+0000 7f7132be3640 1 -- 172.21.15.146:0/4278176543 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f712401cd30 con 0x7f712c03f060 2024-09-18T01:45:28.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.162+0000 7f7132be3640 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc64c60 con 0x560f7bc62180 2024-09-18T01:45:28.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.162+0000 7f71333e4640 1 -- 172.21.15.146:0/4278176543 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f712c03c030 con 0x560f7bc62180 2024-09-18T01:45:28.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.162+0000 7f71333e4640 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc64c60 con 0x560f7bc5c010 2024-09-18T01:45:28.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.162+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f711c051070 con 0x560f7bc5c010 2024-09-18T01:45:28.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.162+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc64c60 con 0x7f712403a040 2024-09-18T01:45:28.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.163+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f711c051070 con 0x7f712403a040 2024-09-18T01:45:28.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.163+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc64c60 con 0x560f7bc5c010 2024-09-18T01:45:28.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.163+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f711c051070 con 0x560f7bc5c010 2024-09-18T01:45:28.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.163+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc64c60 con 0x7f712c03f060 2024-09-18T01:45:28.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.163+0000 7f7132be3640 1 -- 172.21.15.146:0/4278176543 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f712401cd30 con 0x7f712c03f060 2024-09-18T01:45:28.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.163+0000 7f7132be3640 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc64c60 con 0x560f7bc62180 2024-09-18T01:45:28.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.163+0000 7f71333e4640 1 -- 172.21.15.146:0/4278176543 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f712c03c030 con 0x560f7bc62180 2024-09-18T01:45:28.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.163+0000 7f71333e4640 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc64c60 con 0x560f7bc62180 2024-09-18T01:45:28.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.164+0000 7f71333e4640 1 -- 172.21.15.146:0/4278176543 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f712c03c030 con 0x560f7bc62180 2024-09-18T01:45:28.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.164+0000 7f71333e4640 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc64c60 con 0x7f712403a040 2024-09-18T01:45:28.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.164+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f711c051070 con 0x7f712403a040 2024-09-18T01:45:28.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.164+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc64c60 con 0x560f7bc62180 2024-09-18T01:45:28.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.164+0000 7f71333e4640 1 -- 172.21.15.146:0/4278176543 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f712c03c030 con 0x560f7bc62180 2024-09-18T01:45:28.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.164+0000 7f71333e4640 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc64c60 con 0x560f7bc62180 2024-09-18T01:45:28.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.164+0000 7f71333e4640 1 -- 172.21.15.146:0/4278176543 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f712c03c030 con 0x560f7bc62180 2024-09-18T01:45:28.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.164+0000 7f71333e4640 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc64c60 con 0x560f7bc5c010 2024-09-18T01:45:28.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.164+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f711c051070 con 0x560f7bc5c010 2024-09-18T01:45:28.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.164+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc64c60 con 0x560f7bc5c010 2024-09-18T01:45:28.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.165+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f711c051070 con 0x560f7bc5c010 2024-09-18T01:45:28.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.165+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc64c60 con 0x7f712403a040 2024-09-18T01:45:28.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.165+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f711c051070 con 0x7f712403a040 2024-09-18T01:45:28.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.165+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc64c60 con 0x560f7bc62180 2024-09-18T01:45:28.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.165+0000 7f71333e4640 1 -- 172.21.15.146:0/4278176543 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f712c03c030 con 0x560f7bc62180 2024-09-18T01:45:28.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.165+0000 7f71333e4640 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc64c60 con 0x7f712c03f060 2024-09-18T01:45:28.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.165+0000 7f7132be3640 1 -- 172.21.15.146:0/4278176543 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f712401cd30 con 0x7f712c03f060 2024-09-18T01:45:28.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.165+0000 7f7132be3640 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc64c60 con 0x560f7bc5c010 2024-09-18T01:45:28.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.166+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f711c051070 con 0x560f7bc5c010 2024-09-18T01:45:28.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.166+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc64c60 con 0x7f712403a040 2024-09-18T01:45:28.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.166+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f711c051070 con 0x7f712403a040 2024-09-18T01:45:28.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.166+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc64c60 con 0x560f7bc62180 2024-09-18T01:45:28.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.166+0000 7f71333e4640 1 -- 172.21.15.146:0/4278176543 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f712c03c030 con 0x560f7bc62180 2024-09-18T01:45:28.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.166+0000 7f71333e4640 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc64c60 con 0x7f712403a040 2024-09-18T01:45:28.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.166+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f711c051070 con 0x7f712403a040 2024-09-18T01:45:28.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.166+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc64c60 con 0x7f712c03f060 2024-09-18T01:45:28.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.167+0000 7f7132be3640 1 -- 172.21.15.146:0/4278176543 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f712401cd30 con 0x7f712c03f060 2024-09-18T01:45:28.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.167+0000 7f7132be3640 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc64c60 con 0x560f7bc62180 2024-09-18T01:45:28.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.167+0000 7f71333e4640 1 -- 172.21.15.146:0/4278176543 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f712c03c030 con 0x560f7bc62180 2024-09-18T01:45:28.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.167+0000 7f71333e4640 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc64c60 con 0x7f712403a040 2024-09-18T01:45:28.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.167+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f711c051070 con 0x7f712403a040 2024-09-18T01:45:28.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.167+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc64c60 con 0x560f7bc5c010 2024-09-18T01:45:28.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.167+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f711c051070 con 0x560f7bc5c010 2024-09-18T01:45:28.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.167+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc64c60 con 0x7f712c03f060 2024-09-18T01:45:28.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.168+0000 7f7132be3640 1 -- 172.21.15.146:0/4278176543 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7124061040 con 0x7f712c03f060 2024-09-18T01:45:28.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.168+0000 7f7136f26800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:28.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.168+0000 7f7136f26800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:28.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.168+0000 7f7136f26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:28.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.168+0000 7f7136f26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:28.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.168+0000 7f7136f26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:28.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.168+0000 7f7136f26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:28.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.168+0000 7f7136f26800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.168+0000 7f7136f26800 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc60c00 con 0x560f7bc5c010 2024-09-18T01:45:28.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.168+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f711c051070 con 0x560f7bc5c010 2024-09-18T01:45:28.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.168+0000 7f7136f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:28.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.168+0000 7f7136f26800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.168+0000 7f7136f26800 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc614a0 con 0x560f7bc5c010 2024-09-18T01:45:28.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.168+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f711c051070 con 0x560f7bc5c010 2024-09-18T01:45:28.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.168+0000 7f7136f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:28.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.168+0000 7f7136f26800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.168+0000 7f7136f26800 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc60840 con 0x7f712c03f060 2024-09-18T01:45:28.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.168+0000 7f7132be3640 1 -- 172.21.15.146:0/4278176543 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7124061040 con 0x7f712c03f060 2024-09-18T01:45:28.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.168+0000 7f7136f26800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:28.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.168+0000 7f7136f26800 20 zone default found 2024-09-18T01:45:28.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.168+0000 7f7136f26800 4 Realm: () 2024-09-18T01:45:28.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.168+0000 7f7136f26800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:28.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.168+0000 7f7136f26800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:28.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.168+0000 7f7136f26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:28.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.168+0000 7f7136f26800 20 zonegroup default 2024-09-18T01:45:28.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.168+0000 7f7136f26800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.168+0000 7f7136f26800 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc65590 con 0x7f712403a040 2024-09-18T01:45:28.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.169+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f711c051070 con 0x7f712403a040 2024-09-18T01:45:28.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.169+0000 7f7136f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:28.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.169+0000 7f7136f26800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.169+0000 7f7136f26800 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc670f0 con 0x560f7bc62180 2024-09-18T01:45:28.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.169+0000 7f71333e4640 1 -- 172.21.15.146:0/4278176543 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f712c03c030 con 0x560f7bc62180 2024-09-18T01:45:28.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.169+0000 7f7136f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:28.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.169+0000 7f7136f26800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.169+0000 7f7136f26800 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc675d0 con 0x560f7bc62180 2024-09-18T01:45:28.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.169+0000 7f71333e4640 1 -- 172.21.15.146:0/4278176543 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f712c03c030 con 0x560f7bc62180 2024-09-18T01:45:28.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.169+0000 7f7136f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:28.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.169+0000 7f7136f26800 20 started sync module instance, tier type = 2024-09-18T01:45:28.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.169+0000 7f7136f26800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:28.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.169+0000 7f7136f26800 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc65ff0 con 0x7f712c03f060 2024-09-18T01:45:28.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.170+0000 7f7132be3640 1 -- 172.21.15.146:0/4278176543 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v31'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7124061040 con 0x7f712c03f060 2024-09-18T01:45:28.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.170+0000 7f7136f26800 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94624501097488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc67ee0 con 0x7f712c03f060 2024-09-18T01:45:28.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.170+0000 7f7136f26800 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc68730 con 0x560f7bc5c010 2024-09-18T01:45:28.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.171+0000 7f7132be3640 1 -- 172.21.15.146:0/4278176543 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94624501097488] v31'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7124061040 con 0x7f712c03f060 2024-09-18T01:45:28.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.172+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v31'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f711c051070 con 0x560f7bc5c010 2024-09-18T01:45:28.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.172+0000 7f7136f26800 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94624501103152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc68730 con 0x560f7bc5c010 2024-09-18T01:45:28.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.172+0000 7f7136f26800 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc69210 con 0x560f7bc62180 2024-09-18T01:45:28.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.173+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94624501103152] v31'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f711c051070 con 0x560f7bc5c010 2024-09-18T01:45:28.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.173+0000 7f71333e4640 1 -- 172.21.15.146:0/4278176543 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v31'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f712c03c030 con 0x560f7bc62180 2024-09-18T01:45:28.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.173+0000 7f7136f26800 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94624501108000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc68730 con 0x560f7bc62180 2024-09-18T01:45:28.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.173+0000 7f7136f26800 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc69ca0 con 0x7f712c03f060 2024-09-18T01:45:28.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.174+0000 7f71333e4640 1 -- 172.21.15.146:0/4278176543 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94624501108000] v31'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f712c03c030 con 0x560f7bc62180 2024-09-18T01:45:28.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.174+0000 7f7132be3640 1 -- 172.21.15.146:0/4278176543 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v31'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7124061040 con 0x7f712c03f060 2024-09-18T01:45:28.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.174+0000 7f7136f26800 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94624501105280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc686a0 con 0x7f712c03f060 2024-09-18T01:45:28.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.174+0000 7f7136f26800 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc6ab60 con 0x560f7bc5c010 2024-09-18T01:45:28.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.175+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v31'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f711c051070 con 0x560f7bc5c010 2024-09-18T01:45:28.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.175+0000 7f7132be3640 1 -- 172.21.15.146:0/4278176543 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94624501105280] v31'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7124061040 con 0x7f712c03f060 2024-09-18T01:45:28.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.175+0000 7f7136f26800 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94624501115024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc6b400 con 0x560f7bc5c010 2024-09-18T01:45:28.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.175+0000 7f7136f26800 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc6a090 con 0x7f712403a040 2024-09-18T01:45:28.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.176+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94624501115024] v31'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f711c051070 con 0x560f7bc5c010 2024-09-18T01:45:28.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.176+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v31'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f711c051070 con 0x7f712403a040 2024-09-18T01:45:28.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.176+0000 7f7136f26800 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94624501116672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc6b320 con 0x7f712403a040 2024-09-18T01:45:28.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.176+0000 7f7136f26800 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc6c2e0 con 0x7f712403a040 2024-09-18T01:45:28.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.177+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94624501116672] v31'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f711c051070 con 0x7f712403a040 2024-09-18T01:45:28.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.177+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v31'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f711c051070 con 0x7f712403a040 2024-09-18T01:45:28.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.177+0000 7f7136f26800 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94624501119296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc6c210 con 0x7f712403a040 2024-09-18T01:45:28.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.177+0000 7f7136f26800 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc6cc90 con 0x7f712403a040 2024-09-18T01:45:28.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.178+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(58 notify.7 [create] v31'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f711c051070 con 0x7f712403a040 2024-09-18T01:45:28.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.178+0000 7f7136f26800 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94624501122976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc6d140 con 0x7f712403a040 2024-09-18T01:45:28.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.178+0000 7f7136f26800 20 add_watcher() i=0 2024-09-18T01:45:28.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.178+0000 7f7136f26800 20 add_watcher() i=1 2024-09-18T01:45:28.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.178+0000 7f7136f26800 20 add_watcher() i=2 2024-09-18T01:45:28.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.178+0000 7f7136f26800 20 add_watcher() i=3 2024-09-18T01:45:28.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.178+0000 7f7136f26800 20 add_watcher() i=4 2024-09-18T01:45:28.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.178+0000 7f7136f26800 20 add_watcher() i=5 2024-09-18T01:45:28.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.178+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94624501119296] v31'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f711c051070 con 0x7f712403a040 2024-09-18T01:45:28.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.178+0000 7f7136f26800 20 add_watcher() i=6 2024-09-18T01:45:28.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.179+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94624501122976] v31'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f711c051070 con 0x7f712403a040 2024-09-18T01:45:28.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.179+0000 7f7136f26800 20 add_watcher() i=7 2024-09-18T01:45:28.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.179+0000 7f7136f26800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:28.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.179+0000 7f7136f26800 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc6d140 con 0x560f7bc5c010 2024-09-18T01:45:28.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.179+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f711c051070 con 0x560f7bc5c010 2024-09-18T01:45:28.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.179+0000 7f7136f26800 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94624501124240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560f7bc6d0b0 con 0x560f7bc5c010 2024-09-18T01:45:28.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.180+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94624501124240] v31'136 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f711c051070 con 0x560f7bc5c010 2024-09-18T01:45:28.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.180+0000 7f6fe97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:28.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.181+0000 7f7136f26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:28.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.181+0000 7f7136f26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:28.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.181+0000 7f7136f26800 5 note: GC not initialized 2024-09-18T01:45:28.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.181+0000 7f6f63fff640 20 reqs_thread_entry: start 2024-09-18T01:45:28.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.181+0000 7f7136f26800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:28.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.181+0000 7f7136f26800 20 Filter name: none 2024-09-18T01:45:28.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.181+0000 7f6f61ffb640 20 reqs_thread_entry: start 2024-09-18T01:45:28.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.181+0000 7f7136f26800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.181+0000 7f7136f26800 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560f7bca3080 con 0x560f7bc5c010 2024-09-18T01:45:28.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.182+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 testx/myfoo [call out=48b,stat out=16b,read 0~193 out=193b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 281+0+332 (crc 0 0 0) 0x7f711c051070 con 0x560f7bc5c010 2024-09-18T01:45:28.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.182+0000 7f7136f26800 20 rados_obj.operate() r=0 bl.length=193 2024-09-18T01:45:28.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.182+0000 7f6fe97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:28.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.182+0000 7f7136f26800 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94624501124240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560f7bca0f20 con 0x560f7bc5c010 2024-09-18T01:45:28.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.183+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94624501124240] v31'137 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f711c051070 con 0x560f7bc5c010 2024-09-18T01:45:28.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.183+0000 7f7136f26800 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94624501097488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560f7bca0f20 con 0x7f712c03f060 2024-09-18T01:45:28.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.184+0000 7f7132be3640 1 -- 172.21.15.146:0/4278176543 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94624501097488] v31'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7124061040 con 0x7f712c03f060 2024-09-18T01:45:28.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.184+0000 7f7136f26800 20 remove_watcher() i=0 2024-09-18T01:45:28.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.184+0000 7f7136f26800 2 removed watcher, disabling cache 2024-09-18T01:45:28.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.184+0000 7f7136f26800 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94624501103152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560f7bca0f20 con 0x560f7bc5c010 2024-09-18T01:45:28.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.186+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94624501103152] v31'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f711c083040 con 0x560f7bc5c010 2024-09-18T01:45:28.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.186+0000 7f7136f26800 20 remove_watcher() i=1 2024-09-18T01:45:28.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.186+0000 7f7136f26800 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94624501108000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560f7bca0f20 con 0x560f7bc62180 2024-09-18T01:45:28.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.187+0000 7f71333e4640 1 -- 172.21.15.146:0/4278176543 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94624501108000] v31'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f712c03c030 con 0x560f7bc62180 2024-09-18T01:45:28.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.187+0000 7f7136f26800 20 remove_watcher() i=2 2024-09-18T01:45:28.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.187+0000 7f7136f26800 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94624501105280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560f7bca0f20 con 0x7f712c03f060 2024-09-18T01:45:28.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.188+0000 7f7132be3640 1 -- 172.21.15.146:0/4278176543 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94624501105280] v31'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7124061040 con 0x7f712c03f060 2024-09-18T01:45:28.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.188+0000 7f7136f26800 20 remove_watcher() i=3 2024-09-18T01:45:28.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.188+0000 7f7136f26800 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94624501115024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560f7bca0f20 con 0x560f7bc5c010 2024-09-18T01:45:28.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.189+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94624501115024] v31'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f711c083040 con 0x560f7bc5c010 2024-09-18T01:45:28.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.189+0000 7f7136f26800 20 remove_watcher() i=4 2024-09-18T01:45:28.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.189+0000 7f7136f26800 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94624501116672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560f7bca0f20 con 0x7f712403a040 2024-09-18T01:45:28.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.190+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94624501116672] v31'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f711c083040 con 0x7f712403a040 2024-09-18T01:45:28.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.190+0000 7f7136f26800 20 remove_watcher() i=5 2024-09-18T01:45:28.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.190+0000 7f7136f26800 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94624501119296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560f7bca0f20 con 0x7f712403a040 2024-09-18T01:45:28.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.191+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94624501119296] v31'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f711c083040 con 0x7f712403a040 2024-09-18T01:45:28.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.191+0000 7f7136f26800 20 remove_watcher() i=6 2024-09-18T01:45:28.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.191+0000 7f7136f26800 1 -- 172.21.15.146:0/4278176543 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94624501122976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560f7bca0f20 con 0x7f712403a040 2024-09-18T01:45:28.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.192+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94624501122976] v31'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f711c083040 con 0x7f712403a040 2024-09-18T01:45:28.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.192+0000 7f7136f26800 20 remove_watcher() i=7 2024-09-18T01:45:28.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.192+0000 7f7136f26800 1 -- 172.21.15.146:0/4278176543 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f712403a040 msgr2=0x7f7124046810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.192+0000 7f7136f26800 1 --2- 172.21.15.146:0/4278176543 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f712403a040 0x7f7124046810 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.192+0000 7f7136f26800 1 -- 172.21.15.146:0/4278176543 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x560f7bc5c010 msgr2=0x560f7bc5e4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.192+0000 7f7136f26800 1 --2- 172.21.15.146:0/4278176543 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x560f7bc5c010 0x560f7bc5e4d0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.192+0000 7f7136f26800 1 -- 172.21.15.146:0/4278176543 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f712c03f060 msgr2=0x7f712c023070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.192+0000 7f7136f26800 1 --2- 172.21.15.146:0/4278176543 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f712c03f060 0x7f712c023070 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.192+0000 7f7136f26800 1 -- 172.21.15.146:0/4278176543 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x560f7bc62180 msgr2=0x560f7bc64590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.192+0000 7f7136f26800 1 --2- 172.21.15.146:0/4278176543 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x560f7bc62180 0x560f7bc64590 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.192+0000 7f7136f26800 1 -- 172.21.15.146:0/4278176543 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6ffc036af0 msgr2=0x7f6ffc038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.192+0000 7f7136f26800 1 --2- 172.21.15.146:0/4278176543 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6ffc036af0 0x7f6ffc038fb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f712401c8b0 tx=0x7f7124036000 comp rx=0 tx=0).stop 2024-09-18T01:45:28.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.192+0000 7f7136f26800 1 -- 172.21.15.146:0/4278176543 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x560f7bc48eb0 msgr2=0x560f7bc50390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.192+0000 7f7136f26800 1 --2- 172.21.15.146:0/4278176543 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x560f7bc48eb0 0x560f7bc50390 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f712c0127e0 tx=0x7f712c04c820 comp rx=0 tx=0).stop 2024-09-18T01:45:28.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.192+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 reap_dead start 2024-09-18T01:45:28.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.192+0000 7f71323e2640 1 -- 172.21.15.146:0/4278176543 reap_dead start 2024-09-18T01:45:28.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.192+0000 7f7136f26800 1 -- 172.21.15.146:0/4278176543 shutdown_connections 2024-09-18T01:45:28.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.192+0000 7f7136f26800 1 -- 172.21.15.146:0/4278176543 >> 172.21.15.146:0/4278176543 conn(0x560f7bc40e00 msgr2=0x560f7bc3eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:28.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.192+0000 7f7136f26800 1 -- 172.21.15.146:0/4278176543 shutdown_connections 2024-09-18T01:45:28.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.192+0000 7f7136f26800 1 -- 172.21.15.146:0/4278176543 wait complete. 2024-09-18T01:45:28.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.192+0000 7f7136f26800 1 -- 172.21.15.146:0/4198254003 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f700c036b90 msgr2=0x7f700c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.192+0000 7f7136f26800 1 --2- 172.21.15.146:0/4198254003 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f700c036b90 0x7f700c039050 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7124001620 tx=0x7f712400deb0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.192+0000 7f7136f26800 1 -- 172.21.15.146:0/4198254003 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x560f7bc37e20 msgr2=0x560f7bc38240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.192+0000 7f7136f26800 1 --2- 172.21.15.146:0/4198254003 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x560f7bc37e20 0x560f7bc38240 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x560f7bc24aa0 tx=0x7f712c0178e0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.192+0000 7f7136f26800 1 -- 172.21.15.146:0/4198254003 shutdown_connections 2024-09-18T01:45:28.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.192+0000 7f7136f26800 1 --2- 172.21.15.146:0/4198254003 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f700c036b90 0x7f700c039050 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.192+0000 7f7136f26800 1 --2- 172.21.15.146:0/4198254003 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x560f7bc37e20 0x560f7bc38240 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.192+0000 7f7136f26800 1 -- 172.21.15.146:0/4198254003 >> 172.21.15.146:0/4198254003 conn(0x560f7bc2cdb0 msgr2=0x560f7bc2f930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:28.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.192+0000 7f7136f26800 1 -- 172.21.15.146:0/4198254003 shutdown_connections 2024-09-18T01:45:28.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.193+0000 7f7136f26800 1 -- 172.21.15.146:0/4198254003 wait complete. 2024-09-18T01:45:28.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.193+0000 7f7136f26800 1 -- 172.21.15.146:0/431355443 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x560f7bb2b990 msgr2=0x560f7bc241c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.193+0000 7f7136f26800 1 --2- 172.21.15.146:0/431355443 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x560f7bb2b990 0x560f7bc241c0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.193+0000 7f7136f26800 1 -- 172.21.15.146:0/431355443 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x560f7bc260d0 msgr2=0x560f7bc29900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.193+0000 7f7136f26800 1 --2- 172.21.15.146:0/431355443 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x560f7bc260d0 0x560f7bc29900 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.193+0000 7f7136f26800 1 -- 172.21.15.146:0/431355443 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7018036b40 msgr2=0x7f7018039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.193+0000 7f7136f26800 1 --2- 172.21.15.146:0/431355443 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7018036b40 0x7f7018039000 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f711c057000 tx=0x7f711c052000 comp rx=0 tx=0).stop 2024-09-18T01:45:28.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.193+0000 7f7136f26800 1 -- 172.21.15.146:0/431355443 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x560f7bb27550 msgr2=0x560f7bc1e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.193+0000 7f7136f26800 1 --2- 172.21.15.146:0/431355443 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x560f7bb27550 0x560f7bc1e200 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f7124001e10 tx=0x7f7124000ed0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.193+0000 7f7136f26800 1 -- 172.21.15.146:0/431355443 shutdown_connections 2024-09-18T01:45:28.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.193+0000 7f7136f26800 1 --2- 172.21.15.146:0/431355443 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x560f7bc260d0 0x560f7bc29900 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.193+0000 7f7136f26800 1 --2- 172.21.15.146:0/431355443 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x560f7bb2b990 0x560f7bc241c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.193+0000 7f7136f26800 1 --2- 172.21.15.146:0/431355443 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7018036b40 0x7f7018039000 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.193+0000 7f7136f26800 1 --2- 172.21.15.146:0/431355443 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x560f7bb27550 0x560f7bc1e200 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.193+0000 7f7136f26800 1 -- 172.21.15.146:0/431355443 >> 172.21.15.146:0/431355443 conn(0x560f7bb22de0 msgr2=0x560f7bc10a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:28.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.193+0000 7f7136f26800 1 -- 172.21.15.146:0/431355443 shutdown_connections 2024-09-18T01:45:28.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.193+0000 7f7136f26800 1 -- 172.21.15.146:0/431355443 wait complete. 2024-09-18T01:45:28.206 INFO:teuthology.orchestra.run.smithi146.stdout:{"key":"bucket:testx/myfoo","ver":{"tag":"7poboyIqVHhY1Pi+7eg/5eYv","ver":2},"mtime":"2024-09-18T01:45:28.050403Z","data":{"bucket":{"name":"myfoo","marker":"8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1","bucket_id":"8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1","tenant":"testx","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"testx$tenanteduser","creation_time":"2024-09-18T01:45:25.639613Z","linked":true,"has_bucket_info":false}} 2024-09-18T01:45:28.206 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:testx/myfoo', 'ver': {'tag': '7poboyIqVHhY1Pi+7eg/5eYv', 'ver': 2}, 'mtime': '2024-09-18T01:45:28.050403Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1', 'bucket_id': '8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1', 'tenant': 'testx', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'testx$tenanteduser', 'creation_time': '2024-09-18T01:45:25.639613Z', 'linked': True, 'has_bucket_info': False}} 2024-09-18T01:45:28.206 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-18T01:45:28.206 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-18T01:45:28.206 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket testx/myfoo --uid foo 2024-09-18T01:45:28.296 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:28.296 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:28.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.296+0000 7f9c29739800 1 Processor -- start 2024-09-18T01:45:28.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.296+0000 7f9c29739800 1 -- start start 2024-09-18T01:45:28.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.296+0000 7f9c29739800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55a4103fb900 0x55a4103fdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.296+0000 7f9c29739800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a4102b6b30 con 0x55a41036b650 2024-09-18T01:45:28.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.296+0000 7f9c29739800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x55a410298360 con 0x55a4103fb900 2024-09-18T01:45:28.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.296+0000 7f9c24cc4640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55a4103fb900 0x55a4103fdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.297+0000 7f9c254c5640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x55a41036b650 0x55a4103fa1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:47348/0 (socket says 172.21.15.146:47348) 2024-09-18T01:45:28.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.297+0000 7f9c254c5640 1 -- 172.21.15.146:0/2111850708 learned_addr learned my addr 172.21.15.146:0/2111850708 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:45:28.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.297+0000 7f9c24cc4640 1 -- 172.21.15.146:0/2111850708 >> v1:172.21.15.129:6789/0 conn(0x55a41036b650 legacy=0x55a4103fa1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.297+0000 7f9c24cc4640 1 -- 172.21.15.146:0/2111850708 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4102bee00 con 0x55a4103fb900 2024-09-18T01:45:28.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.299+0000 7f9c24cc4640 1 --2- 172.21.15.146:0/2111850708 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a4103fb900 0x55a4103fdcf0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f9c1000a470 tx=0x7f9c10045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc5a7551fc325238 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.299+0000 7f9c1ffff640 1 -- 172.21.15.146:0/2111850708 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c10053570 con 0x55a4103fb900 2024-09-18T01:45:28.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.299+0000 7f9c1ffff640 1 -- 172.21.15.146:0/2111850708 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c10058070 con 0x55a4103fb900 2024-09-18T01:45:28.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.299+0000 7f9c1ffff640 1 -- 172.21.15.146:0/2111850708 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c10053880 con 0x55a4103fb900 2024-09-18T01:45:28.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.300+0000 7f9c29739800 1 -- 172.21.15.146:0/2111850708 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a4103fb900 msgr2=0x55a4103fdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.300+0000 7f9c29739800 1 --2- 172.21.15.146:0/2111850708 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a4103fb900 0x55a4103fdcf0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f9c1000a470 tx=0x7f9c10045a20 comp rx=0 tx=0).stop 2024-09-18T01:45:28.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.300+0000 7f9c29739800 1 -- 172.21.15.146:0/2111850708 shutdown_connections 2024-09-18T01:45:28.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.300+0000 7f9c29739800 1 --2- 172.21.15.146:0/2111850708 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a4103fb900 0x55a4103fdcf0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.300+0000 7f9c29739800 1 -- 172.21.15.146:0/2111850708 >> 172.21.15.146:0/2111850708 conn(0x55a4103f1db0 msgr2=0x55a4103f41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:28.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.300+0000 7f9c29739800 1 -- 172.21.15.146:0/2111850708 shutdown_connections 2024-09-18T01:45:28.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.300+0000 7f9c29739800 1 -- 172.21.15.146:0/2111850708 wait complete. 2024-09-18T01:45:28.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.314+0000 7f9c29739800 1 Processor -- start 2024-09-18T01:45:28.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.314+0000 7f9c29739800 1 -- start start 2024-09-18T01:45:28.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.315+0000 7f9c29739800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a41036b650 0x55a4103f7b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.315+0000 7f9c29739800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55a410343360 con 0x55a41036b650 2024-09-18T01:45:28.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.315+0000 7f9c254c5640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a41036b650 0x55a4103f7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.315+0000 7f9c254c5640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a41036b650 0x55a4103f7b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:57970/0 (socket says 172.21.15.146:57970) 2024-09-18T01:45:28.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.315+0000 7f9c254c5640 1 -- 172.21.15.146:0/670163521 learned_addr learned my addr 172.21.15.146:0/670163521 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:28.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.315+0000 7f9c254c5640 1 -- 172.21.15.146:0/670163521 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a410290bc0 con 0x55a41036b650 2024-09-18T01:45:28.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.315+0000 7f9c254c5640 1 --2- 172.21.15.146:0/670163521 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a41036b650 0x55a4103f7b10 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f9c18001d80 tx=0x7f9c18001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5275d298210f819 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.315+0000 7f9b13606640 1 -- 172.21.15.146:0/670163521 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c18013030 con 0x55a41036b650 2024-09-18T01:45:28.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.316+0000 7f9b13606640 1 -- 172.21.15.146:0/670163521 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c1800e470 con 0x55a41036b650 2024-09-18T01:45:28.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.316+0000 7f9b13606640 1 -- 172.21.15.146:0/670163521 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c1800e810 con 0x55a41036b650 2024-09-18T01:45:28.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.316+0000 7f9c29739800 1 -- 172.21.15.146:0/670163521 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a41036b650 msgr2=0x55a4103f7b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.316+0000 7f9c29739800 1 --2- 172.21.15.146:0/670163521 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a41036b650 0x55a4103f7b10 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f9c18001d80 tx=0x7f9c18001e70 comp rx=0 tx=0).stop 2024-09-18T01:45:28.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.316+0000 7f9c29739800 1 -- 172.21.15.146:0/670163521 shutdown_connections 2024-09-18T01:45:28.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.316+0000 7f9c29739800 1 --2- 172.21.15.146:0/670163521 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a41036b650 0x55a4103f7b10 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.316+0000 7f9c29739800 1 -- 172.21.15.146:0/670163521 >> 172.21.15.146:0/670163521 conn(0x55a4103f1db0 msgr2=0x55a4104e2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:28.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.316+0000 7f9c29739800 1 -- 172.21.15.146:0/670163521 shutdown_connections 2024-09-18T01:45:28.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.316+0000 7f9c29739800 1 -- 172.21.15.146:0/670163521 wait complete. 2024-09-18T01:45:28.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.317+0000 7f9c29739800 1 Processor -- start 2024-09-18T01:45:28.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.317+0000 7f9c29739800 1 -- start start 2024-09-18T01:45:28.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.317+0000 7f9c29739800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a41036b650 0x55a4104f0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.317+0000 7f9c29739800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55a4103fe620 con 0x55a41036b650 2024-09-18T01:45:28.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.317+0000 7f9c254c5640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a41036b650 0x55a4104f0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.317+0000 7f9c254c5640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a41036b650 0x55a4104f0470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:57982/0 (socket says 172.21.15.146:57982) 2024-09-18T01:45:28.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.317+0000 7f9c254c5640 1 -- 172.21.15.146:0/828270986 learned_addr learned my addr 172.21.15.146:0/828270986 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:28.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.317+0000 7f9c254c5640 1 -- 172.21.15.146:0/828270986 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4102a4fe0 con 0x55a41036b650 2024-09-18T01:45:28.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.318+0000 7f9c254c5640 1 --2- 172.21.15.146:0/828270986 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a41036b650 0x55a4104f0470 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f9c18004000 tx=0x7f9c18000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.318+0000 7f9b11e03640 1 -- 172.21.15.146:0/828270986 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c18027070 con 0x55a41036b650 2024-09-18T01:45:28.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.318+0000 7f9b11e03640 1 -- 172.21.15.146:0/828270986 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c18001400 con 0x55a41036b650 2024-09-18T01:45:28.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.318+0000 7f9c29739800 1 -- 172.21.15.146:0/828270986 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a4104f09b0 con 0x55a41036b650 2024-09-18T01:45:28.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.318+0000 7f9b11e03640 1 -- 172.21.15.146:0/828270986 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c18019a70 con 0x55a41036b650 2024-09-18T01:45:28.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.318+0000 7f9c29739800 1 -- 172.21.15.146:0/828270986 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4104f0ed0 con 0x55a41036b650 2024-09-18T01:45:28.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.319+0000 7f9b11e03640 1 -- 172.21.15.146:0/828270986 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9c1802a070 con 0x55a41036b650 2024-09-18T01:45:28.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.319+0000 7f9b11e03640 1 --2- 172.21.15.146:0/828270986 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9b0c036b90 0x7f9b0c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.319+0000 7f9b11e03640 1 -- 172.21.15.146:0/828270986 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f9c1801f070 con 0x55a41036b650 2024-09-18T01:45:28.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.319+0000 7f9c24cc4640 1 --2- 172.21.15.146:0/828270986 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9b0c036b90 0x7f9b0c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.319+0000 7f9c29739800 1 --2- 172.21.15.146:0/828270986 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a4103fb900 0x55a4104f74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.319+0000 7f9c29739800 1 -- 172.21.15.146:0/828270986 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a4104f7a20 con 0x55a4103fb900 2024-09-18T01:45:28.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.319+0000 7f9c25cc6640 1 --2- 172.21.15.146:0/828270986 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a4103fb900 0x55a4104f74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.319+0000 7f9c24cc4640 1 --2- 172.21.15.146:0/828270986 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9b0c036b90 0x7f9b0c039050 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9c10057000 tx=0x7f9c10052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.319+0000 7f9c25cc6640 1 --2- 172.21.15.146:0/828270986 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a4103fb900 0x55a4104f74e0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.320+0000 7f9c25cc6640 1 -- 172.21.15.146:0/828270986 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9c2000a4a0 con 0x55a4103fb900 2024-09-18T01:45:28.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.320+0000 7f9c29739800 1 -- 172.21.15.146:0/828270986 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a4104f4ab0 con 0x55a4103fb900 2024-09-18T01:45:28.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.320+0000 7f9c25cc6640 1 -- 172.21.15.146:0/828270986 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9c2000a4a0 con 0x55a4103fb900 2024-09-18T01:45:28.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.320+0000 7f9c29739800 1 -- 172.21.15.146:0/828270986 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a4104f9860 con 0x55a4103fb900 2024-09-18T01:45:28.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.320+0000 7f9c25cc6640 1 -- 172.21.15.146:0/828270986 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9c2000a4a0 con 0x55a4103fb900 2024-09-18T01:45:28.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.320+0000 7f9c29739800 1 -- 172.21.15.146:0/828270986 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a4104f8a90 con 0x55a4103fb900 2024-09-18T01:45:28.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.320+0000 7f9c25cc6640 1 -- 172.21.15.146:0/828270986 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9c2000a4a0 con 0x55a4103fb900 2024-09-18T01:45:28.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.321+0000 7f9c29739800 1 --2- 172.21.15.146:0/828270986 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55a4104fac10 0x55a4104fd000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.321+0000 7f9c29739800 1 -- 172.21.15.146:0/828270986 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a4104fd540 con 0x55a4104fac10 2024-09-18T01:45:28.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.321+0000 7f9c254c5640 1 --2- 172.21.15.146:0/828270986 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55a4104fac10 0x55a4104fd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.321+0000 7f9c254c5640 1 --2- 172.21.15.146:0/828270986 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55a4104fac10 0x55a4104fd000 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.321+0000 7f9c254c5640 1 -- 172.21.15.146:0/828270986 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9c18029030 con 0x55a4104fac10 2024-09-18T01:45:28.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.321+0000 7f9c29739800 1 Processor -- start 2024-09-18T01:45:28.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.321+0000 7f9c29739800 1 -- start start 2024-09-18T01:45:28.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.322+0000 7f9c29739800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a41050b1c0 0x55a41050b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.322+0000 7f9c29739800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55a410292580 con 0x55a41050b1c0 2024-09-18T01:45:28.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.322+0000 7f9c25cc6640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a41050b1c0 0x55a41050b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.322+0000 7f9c25cc6640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a41050b1c0 0x55a41050b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:57998/0 (socket says 172.21.15.146:57998) 2024-09-18T01:45:28.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.322+0000 7f9c25cc6640 1 -- 172.21.15.146:0/898633155 learned_addr learned my addr 172.21.15.146:0/898633155 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:28.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.322+0000 7f9c25cc6640 1 -- 172.21.15.146:0/898633155 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a41050bb20 con 0x55a41050b1c0 2024-09-18T01:45:28.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.322+0000 7f9c25cc6640 1 --2- 172.21.15.146:0/898633155 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a41050b1c0 0x55a41050b5e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x55a4104f1870 tx=0x7f9c200178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.322+0000 7f9b0affd640 1 -- 172.21.15.146:0/898633155 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c20013440 con 0x55a41050b1c0 2024-09-18T01:45:28.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.322+0000 7f9b0affd640 1 -- 172.21.15.146:0/898633155 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c200135e0 con 0x55a41050b1c0 2024-09-18T01:45:28.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.322+0000 7f9b0affd640 1 -- 172.21.15.146:0/898633155 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c200138c0 con 0x55a41050b1c0 2024-09-18T01:45:28.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.322+0000 7f9c29739800 1 -- 172.21.15.146:0/898633155 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a41050bdb0 con 0x55a41050b1c0 2024-09-18T01:45:28.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.323+0000 7f9c29739800 1 -- 172.21.15.146:0/898633155 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a41050ea90 con 0x55a41050b1c0 2024-09-18T01:45:28.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.323+0000 7f9b0affd640 1 -- 172.21.15.146:0/898633155 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9c20011040 con 0x55a41050b1c0 2024-09-18T01:45:28.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.323+0000 7f9b0affd640 1 --2- 172.21.15.146:0/898633155 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9afc036b90 0x7f9afc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.323+0000 7f9b0affd640 1 -- 172.21.15.146:0/898633155 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f9c2001d070 con 0x55a41050b1c0 2024-09-18T01:45:28.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.323+0000 7f9c254c5640 1 --2- 172.21.15.146:0/898633155 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9afc036b90 0x7f9afc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.324+0000 7f9c29739800 1 Processor -- start 2024-09-18T01:45:28.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.324+0000 7f9c29739800 1 -- start start 2024-09-18T01:45:28.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.324+0000 7f9c254c5640 1 --2- 172.21.15.146:0/898633155 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9afc036b90 0x7f9afc039050 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9c1802c030 tx=0x7f9c1800c3e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.324+0000 7f9c29739800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a410517e10 0x55a4105181f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.324+0000 7f9c29739800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55a4103f61e0 con 0x55a410517e10 2024-09-18T01:45:28.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.324+0000 7f9c25cc6640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a410517e10 0x55a4105181f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.324+0000 7f9c25cc6640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a410517e10 0x55a4105181f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:58008/0 (socket says 172.21.15.146:58008) 2024-09-18T01:45:28.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.324+0000 7f9c25cc6640 1 -- 172.21.15.146:0/659826579 learned_addr learned my addr 172.21.15.146:0/659826579 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:28.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.324+0000 7f9c25cc6640 1 -- 172.21.15.146:0/659826579 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a410518730 con 0x55a410517e10 2024-09-18T01:45:28.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.324+0000 7f9c25cc6640 1 --2- 172.21.15.146:0/659826579 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a410517e10 0x55a4105181f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f9c2004c8c0 tx=0x7f9c20001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b748e6dac9379580 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.325+0000 7f9b08ff9640 1 -- 172.21.15.146:0/659826579 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c20027040 con 0x55a410517e10 2024-09-18T01:45:28.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.325+0000 7f9b08ff9640 1 -- 172.21.15.146:0/659826579 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c20012cc0 con 0x55a410517e10 2024-09-18T01:45:28.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.325+0000 7f9b08ff9640 1 -- 172.21.15.146:0/659826579 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c2004b250 con 0x55a410517e10 2024-09-18T01:45:28.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.325+0000 7f9c29739800 1 -- 172.21.15.146:0/659826579 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a410517e10 msgr2=0x55a4105181f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.325+0000 7f9c29739800 1 --2- 172.21.15.146:0/659826579 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a410517e10 0x55a4105181f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f9c2004c8c0 tx=0x7f9c20001940 comp rx=0 tx=0).stop 2024-09-18T01:45:28.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.325+0000 7f9c29739800 1 -- 172.21.15.146:0/659826579 shutdown_connections 2024-09-18T01:45:28.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.325+0000 7f9c29739800 1 --2- 172.21.15.146:0/659826579 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a410517e10 0x55a4105181f0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.325+0000 7f9c29739800 1 -- 172.21.15.146:0/659826579 >> 172.21.15.146:0/659826579 conn(0x55a4105141c0 msgr2=0x55a4105122c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:28.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.325+0000 7f9c29739800 1 -- 172.21.15.146:0/659826579 shutdown_connections 2024-09-18T01:45:28.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.325+0000 7f9c29739800 1 -- 172.21.15.146:0/659826579 wait complete. 2024-09-18T01:45:28.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.325+0000 7f9c29739800 1 Processor -- start 2024-09-18T01:45:28.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.325+0000 7f9c29739800 1 -- start start 2024-09-18T01:45:28.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.326+0000 7f9c29739800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a410517e10 0x55a41051f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.326+0000 7f9c29739800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55a410518df0 con 0x55a410517e10 2024-09-18T01:45:28.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.326+0000 7f9c25cc6640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a410517e10 0x55a41051f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.326+0000 7f9c25cc6640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a410517e10 0x55a41051f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:58022/0 (socket says 172.21.15.146:58022) 2024-09-18T01:45:28.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.326+0000 7f9c25cc6640 1 -- 172.21.15.146:0/37996824 learned_addr learned my addr 172.21.15.146:0/37996824 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:28.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.326+0000 7f9c25cc6640 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a41051f840 con 0x55a410517e10 2024-09-18T01:45:28.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.326+0000 7f9c25cc6640 1 --2- 172.21.15.146:0/37996824 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a410517e10 0x55a41051f300 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f9c20001df0 tx=0x7f9c2004c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.326+0000 7f9afaffd640 1 -- 172.21.15.146:0/37996824 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c20027070 con 0x55a410517e10 2024-09-18T01:45:28.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.326+0000 7f9afaffd640 1 -- 172.21.15.146:0/37996824 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c2002aa60 con 0x55a410517e10 2024-09-18T01:45:28.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.326+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a41051fad0 con 0x55a410517e10 2024-09-18T01:45:28.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.326+0000 7f9afaffd640 1 -- 172.21.15.146:0/37996824 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c2002ad40 con 0x55a410517e10 2024-09-18T01:45:28.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.326+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a41051feb0 con 0x55a410517e10 2024-09-18T01:45:28.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.327+0000 7f9afaffd640 1 -- 172.21.15.146:0/37996824 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9c20021a50 con 0x55a410517e10 2024-09-18T01:45:28.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.327+0000 7f9afaffd640 1 --2- 172.21.15.146:0/37996824 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9af0036b90 0x7f9af0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.327+0000 7f9afaffd640 1 -- 172.21.15.146:0/37996824 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f9c20033070 con 0x55a410517e10 2024-09-18T01:45:28.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.327+0000 7f9c254c5640 1 --2- 172.21.15.146:0/37996824 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9af0036b90 0x7f9af0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.328+0000 7f9c254c5640 1 --2- 172.21.15.146:0/37996824 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9af0036b90 0x7f9af0039050 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9c1800c520 tx=0x7f9c18040000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.328+0000 7f9c29739800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.328+0000 7f9c29739800 1 --2- 172.21.15.146:0/37996824 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a41052b000 0x55a41052d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.328+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a41052dc10 con 0x55a41052b000 2024-09-18T01:45:28.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.328+0000 7f9c24cc4640 1 --2- 172.21.15.146:0/37996824 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a41052b000 0x55a41052d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.329+0000 7f9c24cc4640 1 --2- 172.21.15.146:0/37996824 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a41052b000 0x55a41052d4c0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.329+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9c10051070 con 0x55a41052b000 2024-09-18T01:45:28.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.329+0000 7f9c29739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:28.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.329+0000 7f9c29739800 20 realm 2024-09-18T01:45:28.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.329+0000 7f9c29739800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.329+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a41052e040 con 0x55a41052b000 2024-09-18T01:45:28.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.329+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9c10051070 con 0x55a41052b000 2024-09-18T01:45:28.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.329+0000 7f9c29739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:28.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.329+0000 7f9c29739800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:28.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.329+0000 7f9c29739800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.329+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a41052e910 con 0x55a41052b000 2024-09-18T01:45:28.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.329+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9c10051070 con 0x55a41052b000 2024-09-18T01:45:28.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.329+0000 7f9c29739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:28.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.329+0000 7f9c29739800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.329+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a41052ecb0 con 0x55a41052b000 2024-09-18T01:45:28.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.329+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9c10051070 con 0x55a41052b000 2024-09-18T01:45:28.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.329+0000 7f9c29739800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:28.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.329+0000 7f9c29739800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.329+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a41052f500 con 0x55a41052b000 2024-09-18T01:45:28.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.330+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9c10051070 con 0x55a41052b000 2024-09-18T01:45:28.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.330+0000 7f9c29739800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:28.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.330+0000 7f9c29739800 20 searching for the correct realm 2024-09-18T01:45:28.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.330+0000 7f9c29739800 1 --2- 172.21.15.146:0/37996824 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55a410531270 0x55a410533660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.330+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a410533c90 con 0x55a410531270 2024-09-18T01:45:28.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.330+0000 7f9c25cc6640 1 --2- 172.21.15.146:0/37996824 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55a410531270 0x55a410533660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.330+0000 7f9c25cc6640 1 --2- 172.21.15.146:0/37996824 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55a410531270 0x55a410533660 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.330+0000 7f9c25cc6640 1 -- 172.21.15.146:0/37996824 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c20057040 con 0x55a410531270 2024-09-18T01:45:28.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.330+0000 7f9c25cc6640 1 --2- 172.21.15.146:0/37996824 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f9c200123a0 0x7f9c20022760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.330+0000 7f9c25cc6640 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a410533c90 con 0x7f9c200123a0 2024-09-18T01:45:28.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.331+0000 7f9c254c5640 1 --2- 172.21.15.146:0/37996824 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f9c200123a0 0x7f9c20022760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.331+0000 7f9c254c5640 1 --2- 172.21.15.146:0/37996824 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f9c200123a0 0x7f9c20022760 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.331+0000 7f9c254c5640 1 -- 172.21.15.146:0/37996824 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c18029030 con 0x7f9c200123a0 2024-09-18T01:45:28.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.331+0000 7f9c254c5640 1 --2- 172.21.15.146:0/37996824 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f9c1802c060 0x7f9c1804c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.331+0000 7f9c254c5640 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a410533c90 con 0x7f9c1802c060 2024-09-18T01:45:28.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.331+0000 7f9c24cc4640 1 --2- 172.21.15.146:0/37996824 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f9c1802c060 0x7f9c1804c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.332+0000 7f9c24cc4640 1 --2- 172.21.15.146:0/37996824 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f9c1802c060 0x7f9c1804c190 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.332+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c10051070 con 0x7f9c1802c060 2024-09-18T01:45:28.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.332+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a410533c90 con 0x55a41052b000 2024-09-18T01:45:28.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.332+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9c10051070 con 0x55a41052b000 2024-09-18T01:45:28.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.332+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a410533c90 con 0x55a41052b000 2024-09-18T01:45:28.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.332+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c10051070 con 0x55a41052b000 2024-09-18T01:45:28.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.332+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a410533c90 con 0x7f9c1802c060 2024-09-18T01:45:28.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.332+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c10051070 con 0x7f9c1802c060 2024-09-18T01:45:28.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.332+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a410533c90 con 0x7f9c1802c060 2024-09-18T01:45:28.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.333+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c10051070 con 0x7f9c1802c060 2024-09-18T01:45:28.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.333+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a410533c90 con 0x7f9c200123a0 2024-09-18T01:45:28.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.333+0000 7f9c254c5640 1 -- 172.21.15.146:0/37996824 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c18029030 con 0x7f9c200123a0 2024-09-18T01:45:28.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.333+0000 7f9c254c5640 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a410533c90 con 0x55a410531270 2024-09-18T01:45:28.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.333+0000 7f9c25cc6640 1 -- 172.21.15.146:0/37996824 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c20057040 con 0x55a410531270 2024-09-18T01:45:28.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.333+0000 7f9c25cc6640 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a410533c90 con 0x55a41052b000 2024-09-18T01:45:28.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.333+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c10051070 con 0x55a41052b000 2024-09-18T01:45:28.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.333+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a410533c90 con 0x7f9c1802c060 2024-09-18T01:45:28.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.334+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c10051070 con 0x7f9c1802c060 2024-09-18T01:45:28.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.334+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a410533c90 con 0x55a41052b000 2024-09-18T01:45:28.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.334+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c10051070 con 0x55a41052b000 2024-09-18T01:45:28.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.334+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a410533c90 con 0x7f9c200123a0 2024-09-18T01:45:28.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.334+0000 7f9c254c5640 1 -- 172.21.15.146:0/37996824 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f9c18029030 con 0x7f9c200123a0 2024-09-18T01:45:28.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.334+0000 7f9c254c5640 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a410533c90 con 0x55a410531270 2024-09-18T01:45:28.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.334+0000 7f9c25cc6640 1 -- 172.21.15.146:0/37996824 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c20057040 con 0x55a410531270 2024-09-18T01:45:28.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.334+0000 7f9c25cc6640 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a410533c90 con 0x55a410531270 2024-09-18T01:45:28.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.335+0000 7f9c25cc6640 1 -- 172.21.15.146:0/37996824 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c20057040 con 0x55a410531270 2024-09-18T01:45:28.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.335+0000 7f9c25cc6640 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a410533c90 con 0x7f9c1802c060 2024-09-18T01:45:28.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.335+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c10051070 con 0x7f9c1802c060 2024-09-18T01:45:28.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.335+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a410533c90 con 0x55a410531270 2024-09-18T01:45:28.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.335+0000 7f9c25cc6640 1 -- 172.21.15.146:0/37996824 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c20057040 con 0x55a410531270 2024-09-18T01:45:28.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.335+0000 7f9c25cc6640 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a410533c90 con 0x55a410531270 2024-09-18T01:45:28.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.335+0000 7f9c25cc6640 1 -- 172.21.15.146:0/37996824 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c20057040 con 0x55a410531270 2024-09-18T01:45:28.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.335+0000 7f9c25cc6640 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a410533c90 con 0x55a41052b000 2024-09-18T01:45:28.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.335+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c10051070 con 0x55a41052b000 2024-09-18T01:45:28.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.335+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a410533c90 con 0x55a41052b000 2024-09-18T01:45:28.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.336+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9c10051070 con 0x55a41052b000 2024-09-18T01:45:28.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.336+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a410533c90 con 0x7f9c1802c060 2024-09-18T01:45:28.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.336+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c10051070 con 0x7f9c1802c060 2024-09-18T01:45:28.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.336+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a410533c90 con 0x55a410531270 2024-09-18T01:45:28.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.336+0000 7f9c25cc6640 1 -- 172.21.15.146:0/37996824 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c20057040 con 0x55a410531270 2024-09-18T01:45:28.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.336+0000 7f9c25cc6640 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a410533c90 con 0x7f9c200123a0 2024-09-18T01:45:28.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.336+0000 7f9c254c5640 1 -- 172.21.15.146:0/37996824 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c18029030 con 0x7f9c200123a0 2024-09-18T01:45:28.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.336+0000 7f9c254c5640 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a410533c90 con 0x55a41052b000 2024-09-18T01:45:28.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.337+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c10051070 con 0x55a41052b000 2024-09-18T01:45:28.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.337+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a410533c90 con 0x7f9c1802c060 2024-09-18T01:45:28.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.337+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c10051070 con 0x7f9c1802c060 2024-09-18T01:45:28.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.337+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a410533c90 con 0x55a410531270 2024-09-18T01:45:28.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.337+0000 7f9c25cc6640 1 -- 172.21.15.146:0/37996824 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c20057040 con 0x55a410531270 2024-09-18T01:45:28.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.337+0000 7f9c25cc6640 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a410533c90 con 0x7f9c1802c060 2024-09-18T01:45:28.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.337+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c10051070 con 0x7f9c1802c060 2024-09-18T01:45:28.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.337+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a410533c90 con 0x7f9c200123a0 2024-09-18T01:45:28.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.338+0000 7f9c254c5640 1 -- 172.21.15.146:0/37996824 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c18029030 con 0x7f9c200123a0 2024-09-18T01:45:28.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.338+0000 7f9c254c5640 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a410533c90 con 0x55a410531270 2024-09-18T01:45:28.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.338+0000 7f9c25cc6640 1 -- 172.21.15.146:0/37996824 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c20057040 con 0x55a410531270 2024-09-18T01:45:28.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.338+0000 7f9c25cc6640 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a410533c90 con 0x7f9c1802c060 2024-09-18T01:45:28.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.338+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c10051070 con 0x7f9c1802c060 2024-09-18T01:45:28.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.338+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a410533c90 con 0x55a41052b000 2024-09-18T01:45:28.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.338+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9c10051070 con 0x55a41052b000 2024-09-18T01:45:28.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.338+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a410533c90 con 0x7f9c200123a0 2024-09-18T01:45:28.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.338+0000 7f9c254c5640 1 -- 172.21.15.146:0/37996824 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c18029030 con 0x7f9c200123a0 2024-09-18T01:45:28.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.338+0000 7f9c29739800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:28.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.338+0000 7f9c29739800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:28.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.338+0000 7f9c29739800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:28.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.338+0000 7f9c29739800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:28.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.338+0000 7f9c29739800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:28.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.338+0000 7f9c29739800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:28.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.339+0000 7f9c29739800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.339+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a41052feb0 con 0x55a41052b000 2024-09-18T01:45:28.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.339+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9c10051070 con 0x55a41052b000 2024-09-18T01:45:28.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.339+0000 7f9c29739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:28.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.339+0000 7f9c29739800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.339+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a410530750 con 0x55a41052b000 2024-09-18T01:45:28.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.339+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9c10051070 con 0x55a41052b000 2024-09-18T01:45:28.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.339+0000 7f9c29739800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:28.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.339+0000 7f9c29739800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.339+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a410534110 con 0x7f9c200123a0 2024-09-18T01:45:28.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.339+0000 7f9c254c5640 1 -- 172.21.15.146:0/37996824 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9c18029030 con 0x7f9c200123a0 2024-09-18T01:45:28.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.339+0000 7f9c29739800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:28.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.339+0000 7f9c29739800 20 zone default found 2024-09-18T01:45:28.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.339+0000 7f9c29739800 4 Realm: () 2024-09-18T01:45:28.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.339+0000 7f9c29739800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:28.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.339+0000 7f9c29739800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:28.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.339+0000 7f9c29739800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:28.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.339+0000 7f9c29739800 20 zonegroup default 2024-09-18T01:45:28.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.339+0000 7f9c29739800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.339+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a410534960 con 0x7f9c1802c060 2024-09-18T01:45:28.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.340+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9c10051070 con 0x7f9c1802c060 2024-09-18T01:45:28.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.340+0000 7f9c29739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:28.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.340+0000 7f9c29739800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.340+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a410536340 con 0x55a410531270 2024-09-18T01:45:28.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.340+0000 7f9c25cc6640 1 -- 172.21.15.146:0/37996824 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9c20057040 con 0x55a410531270 2024-09-18T01:45:28.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.340+0000 7f9c29739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:28.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.340+0000 7f9c29739800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.340+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a410536800 con 0x55a410531270 2024-09-18T01:45:28.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.340+0000 7f9c25cc6640 1 -- 172.21.15.146:0/37996824 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9c20057040 con 0x55a410531270 2024-09-18T01:45:28.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.340+0000 7f9c29739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:28.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.340+0000 7f9c29739800 20 started sync module instance, tier type = 2024-09-18T01:45:28.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.340+0000 7f9c29739800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:28.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.340+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a4105357d0 con 0x7f9c200123a0 2024-09-18T01:45:28.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.341+0000 7f9c254c5640 1 -- 172.21.15.146:0/37996824 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v31'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c18029030 con 0x7f9c200123a0 2024-09-18T01:45:28.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.341+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94163136895936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a410535430 con 0x7f9c200123a0 2024-09-18T01:45:28.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.341+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a410537730 con 0x55a41052b000 2024-09-18T01:45:28.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.342+0000 7f9c254c5640 1 -- 172.21.15.146:0/37996824 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94163136895936] v31'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c18029030 con 0x7f9c200123a0 2024-09-18T01:45:28.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.343+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v31'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c10051070 con 0x55a41052b000 2024-09-18T01:45:28.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.343+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94163136901760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a410537b50 con 0x55a41052b000 2024-09-18T01:45:28.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.343+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a410538510 con 0x55a410531270 2024-09-18T01:45:28.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.344+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94163136901760] v31'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c10051070 con 0x55a41052b000 2024-09-18T01:45:28.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.344+0000 7f9c25cc6640 1 -- 172.21.15.146:0/37996824 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v31'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c20057040 con 0x55a410531270 2024-09-18T01:45:28.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.344+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94163136905792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a410537b50 con 0x55a410531270 2024-09-18T01:45:28.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.344+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a410538db0 con 0x7f9c200123a0 2024-09-18T01:45:28.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.345+0000 7f9c25cc6640 1 -- 172.21.15.146:0/37996824 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94163136905792] v31'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c20057040 con 0x55a410531270 2024-09-18T01:45:28.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.346+0000 7f9c254c5640 1 -- 172.21.15.146:0/37996824 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v31'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c18029030 con 0x7f9c200123a0 2024-09-18T01:45:28.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.346+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94163136902816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a410539600 con 0x7f9c200123a0 2024-09-18T01:45:28.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.346+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a410539e50 con 0x55a41052b000 2024-09-18T01:45:28.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.347+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v31'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c10051070 con 0x55a41052b000 2024-09-18T01:45:28.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.347+0000 7f9c254c5640 1 -- 172.21.15.146:0/37996824 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94163136902816] v31'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c18029030 con 0x7f9c200123a0 2024-09-18T01:45:28.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.347+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94163136911328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a41053a2b0 con 0x55a41052b000 2024-09-18T01:45:28.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.347+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a410539170 con 0x7f9c1802c060 2024-09-18T01:45:28.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.348+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v31'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c10051070 con 0x7f9c1802c060 2024-09-18T01:45:28.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.348+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94163136915616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a41053a2b0 con 0x7f9c1802c060 2024-09-18T01:45:28.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.348+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a41053b790 con 0x7f9c1802c060 2024-09-18T01:45:28.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.348+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94163136911328] v31'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c10051070 con 0x55a41052b000 2024-09-18T01:45:28.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.349+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94163136915616] v31'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c10051070 con 0x7f9c1802c060 2024-09-18T01:45:28.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.349+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v31'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c10051070 con 0x7f9c1802c060 2024-09-18T01:45:28.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.349+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94163136916672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a41053b2e0 con 0x7f9c1802c060 2024-09-18T01:45:28.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.349+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a41053b2e0 con 0x7f9c1802c060 2024-09-18T01:45:28.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.350+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94163136916672] v31'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c10051070 con 0x7f9c1802c060 2024-09-18T01:45:28.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.350+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v31'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c10051070 con 0x7f9c1802c060 2024-09-18T01:45:28.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.350+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94163136912640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a41053bd80 con 0x7f9c1802c060 2024-09-18T01:45:28.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.350+0000 7f9c29739800 20 add_watcher() i=0 2024-09-18T01:45:28.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.350+0000 7f9c29739800 20 add_watcher() i=1 2024-09-18T01:45:28.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.350+0000 7f9c29739800 20 add_watcher() i=2 2024-09-18T01:45:28.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.350+0000 7f9c29739800 20 add_watcher() i=3 2024-09-18T01:45:28.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.350+0000 7f9c29739800 20 add_watcher() i=4 2024-09-18T01:45:28.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.350+0000 7f9c29739800 20 add_watcher() i=5 2024-09-18T01:45:28.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.350+0000 7f9c29739800 20 add_watcher() i=6 2024-09-18T01:45:28.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.351+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94163136912640] v31'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c10051070 con 0x7f9c1802c060 2024-09-18T01:45:28.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.351+0000 7f9c29739800 20 add_watcher() i=7 2024-09-18T01:45:28.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.351+0000 7f9c29739800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:28.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.351+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a41053efb0 con 0x55a41052b000 2024-09-18T01:45:28.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.351+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9c10051070 con 0x55a41052b000 2024-09-18T01:45:28.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.351+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94163136932208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a41053bd80 con 0x55a41052b000 2024-09-18T01:45:28.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.352+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94163136932208] v31'138 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9c10051070 con 0x55a41052b000 2024-09-18T01:45:28.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.352+0000 7f9adbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:28.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.352+0000 7f9c29739800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:28.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.352+0000 7f9c29739800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:28.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.352+0000 7f9c29739800 5 note: GC not initialized 2024-09-18T01:45:28.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.352+0000 7f9adafe5640 20 reqs_thread_entry: start 2024-09-18T01:45:28.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.352+0000 7f9c29739800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:28.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.353+0000 7f9c29739800 20 Filter name: none 2024-09-18T01:45:28.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.353+0000 7f9ad8fe1640 20 reqs_thread_entry: start 2024-09-18T01:45:28.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.353+0000 7f9c29739800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T01:45:28.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.353+0000 7f9c29739800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.353+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a410572400 con 0x55a41052b000 2024-09-18T01:45:28.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.353+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f9c10051070 con 0x55a41052b000 2024-09-18T01:45:28.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.353+0000 7f9c29739800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:45:28.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.353+0000 7f9c29739800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T01:45:28.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.353+0000 7f9c29739800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:45:28.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.353+0000 7f9c29739800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:45:28.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.353+0000 7f9c29739800 10 cache get: name=default.rgw.meta+root+testx/myfoo : miss 2024-09-18T01:45:28.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.353+0000 7f9c29739800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.353+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:63 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a4105744e0 con 0x55a41052b000 2024-09-18T01:45:28.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.353+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(63 testx/myfoo [call out=48b,read 0~193 out=193b] v0'0 uv1 ondisk = 0) ==== 197+0+241 (crc 0 0 0) 0x7f9c10051070 con 0x55a41052b000 2024-09-18T01:45:28.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.353+0000 7f9c29739800 20 rados_obj.operate() r=0 bl.length=193 2024-09-18T01:45:28.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.353+0000 7f9c29739800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x11 2024-09-18T01:45:28.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.353+0000 7f9c29739800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-18T01:45:28.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.353+0000 7f9c29739800 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 : miss 2024-09-18T01:45:28.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.353+0000 7f9c29739800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.353+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:64 8.c 8:36be43c9:root::.bucket.meta.testx%3amyfoo%3a8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a410575d50 con 0x55a41052b000 2024-09-18T01:45:28.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.354+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(64 .bucket.meta.testx:myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 [call out=48b,stat out=16b,read 0~412 out=412b,getxattrs out=298b] v0'0 uv1 ondisk = 0) ==== 338+0+774 (crc 0 0 0) 0x7f9c10051070 con 0x55a41052b000 2024-09-18T01:45:28.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.354+0000 7f9c29739800 20 rados_obj.operate() r=0 bl.length=412 2024-09-18T01:45:28.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.354+0000 7f9c29739800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 info.flags=0x17 2024-09-18T01:45:28.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.354+0000 7f9c29739800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 to cache LRU end 2024-09-18T01:45:28.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.354+0000 7f9c29739800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:45:28.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.354+0000 7f9c29739800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-18T01:45:28.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.354+0000 7f9c29739800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.testx:myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 2024-09-18T01:45:28.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.354+0000 7f9c29739800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-18T01:45:28.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.354+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a41057a390 con 0x55a41052b000 2024-09-18T01:45:28.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.355+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(65 testx$tenanteduser.buckets [call] v31'3 uv3 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f9c10051070 con 0x55a41052b000 2024-09-18T01:45:28.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.355+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:66 8.13 8:ceaa8859:root::.bucket.meta.myfoo%3a8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1:head [create,call version.inc in=38b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a41057dca0 con 0x7f9c1802c060 2024-09-18T01:45:28.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.357+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(66 .bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 [create,call,writefull 0~379,setxattr (123)] v31'11 uv11 ondisk = 0) ==== 332+0+0 (crc 0 0 0) 0x7f9c10051070 con 0x7f9c1802c060 2024-09-18T01:45:28.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.357+0000 7f9c29739800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 info.flags=0x7 2024-09-18T01:45:28.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.357+0000 7f9c29739800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 to cache LRU end 2024-09-18T01:45:28.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.357+0000 7f9c29739800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T01:45:28.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.357+0000 7f9c29739800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1, ofs0, ns] 2024-09-18T01:45:28.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.357+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94163137182272 in=740b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a41057d6a0 con 0x7f9c1802c060 2024-09-18T01:45:28.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.357+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== watch-notify(notify (1) cookie 94163136915616 notify 133143986189 ret 0) ==== 770+0+0 (crc 0 0 0) 0x55a41057e040 con 0x7f9c1802c060 2024-09-18T01:45:28.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.357+0000 7f9b08ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986189 cookie 94163136915616 notifier 4565 bl.length()=728 2024-09-18T01:45:28.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.357+0000 7f9b08ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 info.flags=0x7 2024-09-18T01:45:28.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.357+0000 7f9b08ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 to cache LRU end 2024-09-18T01:45:28.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.357+0000 7f9b08ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T01:45:28.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.357+0000 7f9b08ff9640 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f9ae8003ea0 con 0x7f9c1802c060 2024-09-18T01:45:28.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.357+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(67 notify.5 [notify cookie 94163137182272 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9c10051070 con 0x7f9c1802c060 2024-09-18T01:45:28.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.357+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c10051070 con 0x7f9c1802c060 2024-09-18T01:45:28.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.357+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== watch-notify(notify_complete (2) cookie 94163137182272 notify 133143986189 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a410579e00 con 0x7f9c1802c060 2024-09-18T01:45:28.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.357+0000 7f9c29739800 20 handle_bi_update(): bucket=:myfoo[8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1]): orig_sources= new_sources= 2024-09-18T01:45:28.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.357+0000 7f9c29739800 20 handle_bi_update(): bucket=:myfoo[8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1]): potential sources added=[] removed=[] 2024-09-18T01:45:28.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.357+0000 7f9c29739800 20 handle_bi_update(): bucket=:myfoo[8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1]): orig_dests= new_dests= 2024-09-18T01:45:28.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.357+0000 7f9c29739800 20 handle_bi_update(): bucket=:myfoo[8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1]): potential dests added=[] removed=[] 2024-09-18T01:45:28.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.357+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a41057d720 con 0x7f9c200123a0 2024-09-18T01:45:28.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.358+0000 7f9c254c5640 1 -- 172.21.15.146:0/37996824 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(69 foo.buckets [call] v31'26 uv26 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f9c18029030 con 0x7f9c200123a0 2024-09-18T01:45:28.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.358+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a41057d720 con 0x7f9c200123a0 2024-09-18T01:45:28.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.359+0000 7f9c254c5640 1 -- 172.21.15.146:0/37996824 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v31'27 uv27 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f9c18029030 con 0x7f9c200123a0 2024-09-18T01:45:28.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.359+0000 7f9c29739800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-18T01:45:28.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.359+0000 7f9c29739800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T01:45:28.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.359+0000 7f9c29739800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-18T01:45:28.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.359+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94163137188464 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a41057e2a0 con 0x7f9c1802c060 2024-09-18T01:45:28.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.360+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.0 v2:172.21.15.129:6800/1759265424 22 ==== watch-notify(notify (1) cookie 94163136916672 notify 133143986190 ret 0) ==== 356+0+0 (crc 0 0 0) 0x55a410576140 con 0x7f9c1802c060 2024-09-18T01:45:28.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.360+0000 7f9afbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986190 cookie 94163136916672 notifier 4565 bl.length()=314 2024-09-18T01:45:28.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.360+0000 7f9afbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-18T01:45:28.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.360+0000 7f9afbfff640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T01:45:28.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.360+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.0 v2:172.21.15.129:6800/1759265424 23 ==== osd_op_reply(71 notify.6 [notify cookie 94163137188464 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9c10051070 con 0x7f9c1802c060 2024-09-18T01:45:28.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.360+0000 7f9afbfff640 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f9a4c003400 con 0x7f9c1802c060 2024-09-18T01:45:28.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.360+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.0 v2:172.21.15.129:6800/1759265424 24 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c10051070 con 0x7f9c1802c060 2024-09-18T01:45:28.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.360+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.0 v2:172.21.15.129:6800/1759265424 25 ==== watch-notify(notify_complete (2) cookie 94163137188464 notify 133143986190 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a410575270 con 0x7f9c1802c060 2024-09-18T01:45:28.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.360+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:73 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a41057d720 con 0x55a41052b000 2024-09-18T01:45:28.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.361+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(73 testx/myfoo [call,delete] v31'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7f9c10051070 con 0x55a41052b000 2024-09-18T01:45:28.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.361+0000 7f9c29739800 10 removing default.rgw.meta+root+testx/myfoo from cache 2024-09-18T01:45:28.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.361+0000 7f9c29739800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-18T01:45:28.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.361+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [notify cookie 94163137188464 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a41057db40 con 0x55a41052b000 2024-09-18T01:45:28.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.361+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== watch-notify(notify (1) cookie 94163136911328 notify 133143986189 ret 0) ==== 197+0+0 (crc 0 0 0) 0x55a410575270 con 0x55a41052b000 2024-09-18T01:45:28.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.361+0000 7f9b08ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986189 cookie 94163136911328 notifier 4565 bl.length()=155 2024-09-18T01:45:28.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.361+0000 7f9b08ff9640 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f9ae8003ea0 con 0x55a41052b000 2024-09-18T01:45:28.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.362+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.1 v2:172.21.15.146:6808/3930274777 28 ==== osd_op_reply(74 notify.4 [notify cookie 94163137188464 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9c10051070 con 0x55a41052b000 2024-09-18T01:45:28.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.362+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.1 v2:172.21.15.146:6808/3930274777 29 ==== osd_op_reply(75 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c10051070 con 0x55a41052b000 2024-09-18T01:45:28.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.362+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.1 v2:172.21.15.146:6808/3930274777 30 ==== watch-notify(notify_complete (2) cookie 94163137188464 notify 133143986189 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a4102bee00 con 0x55a41052b000 2024-09-18T01:45:28.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.362+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:76 8.c 8:36be43c9:root::.bucket.meta.testx%3amyfoo%3a8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a41057d720 con 0x55a41052b000 2024-09-18T01:45:28.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.363+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.1 v2:172.21.15.146:6808/3930274777 31 ==== osd_op_reply(76 .bucket.meta.testx:myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 [call,delete] v31'4 uv4 ondisk = 0) ==== 254+0+0 (crc 0 0 0) 0x7f9c10051070 con 0x55a41052b000 2024-09-18T01:45:28.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.363+0000 7f9c29739800 10 removing default.rgw.meta+root+.bucket.meta.testx:myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 from cache 2024-09-18T01:45:28.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.363+0000 7f9c29739800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1, ofs0, ns] 2024-09-18T01:45:28.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.363+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [notify cookie 94163137156608 in=224b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a41057d720 con 0x55a41052b000 2024-09-18T01:45:28.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.363+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.1 v2:172.21.15.146:6808/3930274777 32 ==== watch-notify(notify (1) cookie 94163136911328 notify 133143986190 ret 0) ==== 254+0+0 (crc 0 0 0) 0x55a4102bee00 con 0x55a41052b000 2024-09-18T01:45:28.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.363+0000 7f9afbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986190 cookie 94163136911328 notifier 4565 bl.length()=212 2024-09-18T01:45:28.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.363+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.1 v2:172.21.15.146:6808/3930274777 33 ==== osd_op_reply(77 notify.4 [notify cookie 94163137156608 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9c10051070 con 0x55a41052b000 2024-09-18T01:45:28.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.363+0000 7f9afbfff640 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f9a4c003470 con 0x55a41052b000 2024-09-18T01:45:28.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.364+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.1 v2:172.21.15.146:6808/3930274777 34 ==== watch-notify(notify_complete (2) cookie 94163137156608 notify 133143986190 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f9c1005f8f0 con 0x55a41052b000 2024-09-18T01:45:28.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.364+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.1 v2:172.21.15.146:6808/3930274777 35 ==== osd_op_reply(78 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c10051070 con 0x55a41052b000 2024-09-18T01:45:28.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.364+0000 7f9adbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:28.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.364+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94163136932208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a410570150 con 0x55a41052b000 2024-09-18T01:45:28.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.365+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.1 v2:172.21.15.146:6808/3930274777 36 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94163136932208] v31'139 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9c10051070 con 0x55a41052b000 2024-09-18T01:45:28.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.365+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94163136895936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a410570150 con 0x7f9c200123a0 2024-09-18T01:45:28.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.366+0000 7f9c254c5640 1 -- 172.21.15.146:0/37996824 <== osd.2 v2:172.21.15.146:6800/3820039304 14 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94163136895936] v31'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c18029030 con 0x7f9c200123a0 2024-09-18T01:45:28.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.366+0000 7f9c29739800 20 remove_watcher() i=0 2024-09-18T01:45:28.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.366+0000 7f9c29739800 2 removed watcher, disabling cache 2024-09-18T01:45:28.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.366+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94163136901760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a410570150 con 0x55a41052b000 2024-09-18T01:45:28.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.368+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.1 v2:172.21.15.146:6808/3930274777 37 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94163136901760] v31'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c10051070 con 0x55a41052b000 2024-09-18T01:45:28.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.368+0000 7f9c29739800 20 remove_watcher() i=1 2024-09-18T01:45:28.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.368+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94163136905792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a410570150 con 0x55a410531270 2024-09-18T01:45:28.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.369+0000 7f9c25cc6640 1 -- 172.21.15.146:0/37996824 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94163136905792] v31'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c20057040 con 0x55a410531270 2024-09-18T01:45:28.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.369+0000 7f9c29739800 20 remove_watcher() i=2 2024-09-18T01:45:28.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.369+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94163136902816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a410570150 con 0x7f9c200123a0 2024-09-18T01:45:28.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.370+0000 7f9c254c5640 1 -- 172.21.15.146:0/37996824 <== osd.2 v2:172.21.15.146:6800/3820039304 15 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94163136902816] v31'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c18029030 con 0x7f9c200123a0 2024-09-18T01:45:28.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.370+0000 7f9c29739800 20 remove_watcher() i=3 2024-09-18T01:45:28.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.370+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94163136911328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a410570150 con 0x55a41052b000 2024-09-18T01:45:28.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.371+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.1 v2:172.21.15.146:6808/3930274777 38 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94163136911328] v31'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c10051070 con 0x55a41052b000 2024-09-18T01:45:28.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.371+0000 7f9c29739800 20 remove_watcher() i=4 2024-09-18T01:45:28.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.371+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94163136915616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a410570150 con 0x7f9c1802c060 2024-09-18T01:45:28.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.372+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.0 v2:172.21.15.129:6800/1759265424 26 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94163136915616] v31'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c10051070 con 0x7f9c1802c060 2024-09-18T01:45:28.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.372+0000 7f9c29739800 20 remove_watcher() i=5 2024-09-18T01:45:28.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.372+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94163136916672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a410570150 con 0x7f9c1802c060 2024-09-18T01:45:28.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.373+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.0 v2:172.21.15.129:6800/1759265424 27 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94163136916672] v31'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c10051070 con 0x7f9c1802c060 2024-09-18T01:45:28.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.373+0000 7f9c29739800 20 remove_watcher() i=6 2024-09-18T01:45:28.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.373+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94163136912640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a410570150 con 0x7f9c1802c060 2024-09-18T01:45:28.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.374+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 <== osd.0 v2:172.21.15.129:6800/1759265424 28 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94163136912640] v31'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c10051070 con 0x7f9c1802c060 2024-09-18T01:45:28.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.374+0000 7f9c29739800 20 remove_watcher() i=7 2024-09-18T01:45:28.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.374+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f9c1802c060 msgr2=0x7f9c1804c190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.374+0000 7f9c29739800 1 --2- 172.21.15.146:0/37996824 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f9c1802c060 0x7f9c1804c190 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.374+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a41052b000 msgr2=0x55a41052d4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.374+0000 7f9c29739800 1 --2- 172.21.15.146:0/37996824 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a41052b000 0x55a41052d4c0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.374+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f9c200123a0 msgr2=0x7f9c20022760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.374+0000 7f9c29739800 1 --2- 172.21.15.146:0/37996824 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f9c200123a0 0x7f9c20022760 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.374+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55a410531270 msgr2=0x55a410533660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.374+0000 7f9c29739800 1 --2- 172.21.15.146:0/37996824 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55a410531270 0x55a410533660 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.374+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9af0036b90 msgr2=0x7f9af0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.374+0000 7f9c29739800 1 --2- 172.21.15.146:0/37996824 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9af0036b90 0x7f9af0039050 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9c1800c520 tx=0x7f9c18040000 comp rx=0 tx=0).stop 2024-09-18T01:45:28.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.374+0000 7f9c24cc4640 1 -- 172.21.15.146:0/37996824 reap_dead start 2024-09-18T01:45:28.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.374+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a410517e10 msgr2=0x55a41051f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.374+0000 7f9c29739800 1 --2- 172.21.15.146:0/37996824 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a410517e10 0x55a41051f300 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f9c20001df0 tx=0x7f9c2004c820 comp rx=0 tx=0).stop 2024-09-18T01:45:28.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.374+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 shutdown_connections 2024-09-18T01:45:28.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.374+0000 7f9c29739800 1 --2- 172.21.15.146:0/37996824 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a410517e10 0x55a41051f300 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.374+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 >> 172.21.15.146:0/37996824 conn(0x55a4105141c0 msgr2=0x55a410519550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:28.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.374+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 shutdown_connections 2024-09-18T01:45:28.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.374+0000 7f9c29739800 1 -- 172.21.15.146:0/37996824 wait complete. 2024-09-18T01:45:28.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.375+0000 7f9c29739800 1 -- 172.21.15.146:0/898633155 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9afc036b90 msgr2=0x7f9afc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.375+0000 7f9c29739800 1 --2- 172.21.15.146:0/898633155 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9afc036b90 0x7f9afc039050 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9c1802c030 tx=0x7f9c1800c3e0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.375+0000 7f9c29739800 1 -- 172.21.15.146:0/898633155 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a41050b1c0 msgr2=0x55a41050b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.375+0000 7f9c29739800 1 --2- 172.21.15.146:0/898633155 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a41050b1c0 0x55a41050b5e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x55a4104f1870 tx=0x7f9c200178e0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.375+0000 7f9c29739800 1 -- 172.21.15.146:0/898633155 shutdown_connections 2024-09-18T01:45:28.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.375+0000 7f9c29739800 1 --2- 172.21.15.146:0/898633155 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9afc036b90 0x7f9afc039050 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.375+0000 7f9c29739800 1 --2- 172.21.15.146:0/898633155 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a41050b1c0 0x55a41050b5e0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.375+0000 7f9c29739800 1 -- 172.21.15.146:0/898633155 >> 172.21.15.146:0/898633155 conn(0x55a410500150 msgr2=0x55a410502cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:28.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.375+0000 7f9c29739800 1 -- 172.21.15.146:0/898633155 shutdown_connections 2024-09-18T01:45:28.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.375+0000 7f9c29739800 1 -- 172.21.15.146:0/898633155 wait complete. 2024-09-18T01:45:28.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.375+0000 7f9c29739800 1 -- 172.21.15.146:0/828270986 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a4103fb900 msgr2=0x55a4104f74e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.375+0000 7f9c29739800 1 --2- 172.21.15.146:0/828270986 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a4103fb900 0x55a4104f74e0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.375+0000 7f9c29739800 1 -- 172.21.15.146:0/828270986 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55a4104fac10 msgr2=0x55a4104fd000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.375+0000 7f9c29739800 1 --2- 172.21.15.146:0/828270986 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55a4104fac10 0x55a4104fd000 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.375+0000 7f9c29739800 1 -- 172.21.15.146:0/828270986 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9b0c036b90 msgr2=0x7f9b0c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.375+0000 7f9c29739800 1 --2- 172.21.15.146:0/828270986 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9b0c036b90 0x7f9b0c039050 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9c10057000 tx=0x7f9c10052000 comp rx=0 tx=0).stop 2024-09-18T01:45:28.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.375+0000 7f9c29739800 1 -- 172.21.15.146:0/828270986 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a41036b650 msgr2=0x55a4104f0470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.375+0000 7f9c29739800 1 --2- 172.21.15.146:0/828270986 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a41036b650 0x55a4104f0470 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f9c18004000 tx=0x7f9c18000bc0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.375+0000 7f9c29739800 1 -- 172.21.15.146:0/828270986 shutdown_connections 2024-09-18T01:45:28.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.375+0000 7f9c29739800 1 --2- 172.21.15.146:0/828270986 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55a4104fac10 0x55a4104fd000 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.375+0000 7f9c29739800 1 --2- 172.21.15.146:0/828270986 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a4103fb900 0x55a4104f74e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.375+0000 7f9c29739800 1 --2- 172.21.15.146:0/828270986 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9b0c036b90 0x7f9b0c039050 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.375+0000 7f9c29739800 1 --2- 172.21.15.146:0/828270986 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a41036b650 0x55a4104f0470 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.375+0000 7f9c29739800 1 -- 172.21.15.146:0/828270986 >> 172.21.15.146:0/828270986 conn(0x55a4103f1db0 msgr2=0x55a4104e1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:28.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.375+0000 7f9c29739800 1 -- 172.21.15.146:0/828270986 shutdown_connections 2024-09-18T01:45:28.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.375+0000 7f9c29739800 1 -- 172.21.15.146:0/828270986 wait complete. 2024-09-18T01:45:28.449 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-18T01:45:28.449 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-18T01:45:28.449 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --tenant testx --uid tenanteduser 2024-09-18T01:45:28.496 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:28.496 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:28.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.496+0000 7ff0e4640800 1 Processor -- start 2024-09-18T01:45:28.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.496+0000 7ff0e4640800 1 -- start start 2024-09-18T01:45:28.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.496+0000 7ff0e4640800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x561d32307d20 0x561d3230a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.496+0000 7ff0e4640800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561d321c0b30 con 0x561d32275630 2024-09-18T01:45:28.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.496+0000 7ff0e4640800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x561d321a2360 con 0x561d32307d20 2024-09-18T01:45:28.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.496+0000 7ff0e1933640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x561d32307d20 0x561d3230a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.496+0000 7ff0e2134640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x561d32275630 0x561d32306600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:47364/0 (socket says 172.21.15.146:47364) 2024-09-18T01:45:28.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.496+0000 7ff0e2134640 1 -- 172.21.15.146:0/4150653436 learned_addr learned my addr 172.21.15.146:0/4150653436 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:45:28.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.497+0000 7ff0e1933640 1 -- 172.21.15.146:0/4150653436 >> v1:172.21.15.129:6789/0 conn(0x561d32275630 legacy=0x561d32306600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.497+0000 7ff0e1132640 1 -- 172.21.15.146:0/4150653436 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2849710525 0 0) 0x561d321c0b30 con 0x561d32275630 2024-09-18T01:45:28.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.497+0000 7ff0e1933640 1 -- 172.21.15.146:0/4150653436 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d321c8e00 con 0x561d32307d20 2024-09-18T01:45:28.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.498+0000 7ff0e1933640 1 --2- 172.21.15.146:0/4150653436 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561d32307d20 0x561d3230a110 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7ff0d800a470 tx=0x7ff0d8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0f1e2574cc0a46d server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.499+0000 7ff0e1132640 1 -- 172.21.15.146:0/4150653436 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0d8053570 con 0x561d32307d20 2024-09-18T01:45:28.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.499+0000 7ff0e1132640 1 -- 172.21.15.146:0/4150653436 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0d8058070 con 0x561d32307d20 2024-09-18T01:45:28.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.499+0000 7ff0e1132640 1 -- 172.21.15.146:0/4150653436 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0d8053880 con 0x561d32307d20 2024-09-18T01:45:28.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.499+0000 7ff0e4640800 1 -- 172.21.15.146:0/4150653436 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561d32307d20 msgr2=0x561d3230a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.499+0000 7ff0e4640800 1 --2- 172.21.15.146:0/4150653436 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561d32307d20 0x561d3230a110 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7ff0d800a470 tx=0x7ff0d8045a20 comp rx=0 tx=0).stop 2024-09-18T01:45:28.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.499+0000 7ff0e4640800 1 -- 172.21.15.146:0/4150653436 shutdown_connections 2024-09-18T01:45:28.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.499+0000 7ff0e4640800 1 --2- 172.21.15.146:0/4150653436 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561d32307d20 0x561d3230a110 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.499+0000 7ff0e4640800 1 -- 172.21.15.146:0/4150653436 >> 172.21.15.146:0/4150653436 conn(0x561d322fbdb0 msgr2=0x561d322fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:28.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.499+0000 7ff0e4640800 1 -- 172.21.15.146:0/4150653436 shutdown_connections 2024-09-18T01:45:28.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.499+0000 7ff0e4640800 1 -- 172.21.15.146:0/4150653436 wait complete. 2024-09-18T01:45:28.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.513+0000 7ff0e4640800 1 Processor -- start 2024-09-18T01:45:28.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.513+0000 7ff0e4640800 1 -- start start 2024-09-18T01:45:28.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.513+0000 7ff0e4640800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561d32275630 0x561d323f2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.513+0000 7ff0e4640800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x561d3224d360 con 0x561d32275630 2024-09-18T01:45:28.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.514+0000 7ff0e2134640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561d32275630 0x561d323f2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.514+0000 7ff0e2134640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561d32275630 0x561d323f2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:58038/0 (socket says 172.21.15.146:58038) 2024-09-18T01:45:28.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.514+0000 7ff0e2134640 1 -- 172.21.15.146:0/3305974785 learned_addr learned my addr 172.21.15.146:0/3305974785 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:28.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.514+0000 7ff0e2134640 1 -- 172.21.15.146:0/3305974785 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d3219abc0 con 0x561d32275630 2024-09-18T01:45:28.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.514+0000 7ff0e2134640 1 --2- 172.21.15.146:0/3305974785 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561d32275630 0x561d323f2820 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7ff0d400b240 tx=0x7ff0d400b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4012ad25940185a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.514+0000 7fefd0608640 1 -- 172.21.15.146:0/3305974785 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0d4008070 con 0x561d32275630 2024-09-18T01:45:28.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.514+0000 7fefd0608640 1 -- 172.21.15.146:0/3305974785 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0d400d500 con 0x561d32275630 2024-09-18T01:45:28.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.514+0000 7fefd0608640 1 -- 172.21.15.146:0/3305974785 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0d400d860 con 0x561d32275630 2024-09-18T01:45:28.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.515+0000 7ff0e4640800 1 -- 172.21.15.146:0/3305974785 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561d32275630 msgr2=0x561d323f2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.515+0000 7ff0e4640800 1 --2- 172.21.15.146:0/3305974785 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561d32275630 0x561d323f2820 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7ff0d400b240 tx=0x7ff0d400b700 comp rx=0 tx=0).stop 2024-09-18T01:45:28.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.515+0000 7ff0e4640800 1 -- 172.21.15.146:0/3305974785 shutdown_connections 2024-09-18T01:45:28.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.515+0000 7ff0e4640800 1 --2- 172.21.15.146:0/3305974785 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561d32275630 0x561d323f2820 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.515+0000 7ff0e4640800 1 -- 172.21.15.146:0/3305974785 >> 172.21.15.146:0/3305974785 conn(0x561d322fbdb0 msgr2=0x561d323ee1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:28.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.515+0000 7ff0e4640800 1 -- 172.21.15.146:0/3305974785 shutdown_connections 2024-09-18T01:45:28.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.515+0000 7ff0e4640800 1 -- 172.21.15.146:0/3305974785 wait complete. 2024-09-18T01:45:28.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.515+0000 7ff0e4640800 1 Processor -- start 2024-09-18T01:45:28.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.515+0000 7ff0e4640800 1 -- start start 2024-09-18T01:45:28.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.515+0000 7ff0e4640800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561d32275630 0x561d323fa2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.515+0000 7ff0e4640800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x561d3230a920 con 0x561d32275630 2024-09-18T01:45:28.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.516+0000 7ff0e2134640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561d32275630 0x561d323fa2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.516+0000 7ff0e2134640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561d32275630 0x561d323fa2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:58048/0 (socket says 172.21.15.146:58048) 2024-09-18T01:45:28.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.516+0000 7ff0e2134640 1 -- 172.21.15.146:0/3315152383 learned_addr learned my addr 172.21.15.146:0/3315152383 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:28.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.516+0000 7ff0e2134640 1 -- 172.21.15.146:0/3315152383 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d321aefe0 con 0x561d32275630 2024-09-18T01:45:28.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.516+0000 7ff0e2134640 1 --2- 172.21.15.146:0/3315152383 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561d32275630 0x561d323fa2a0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x561d323f3680 tx=0x7ff0d4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.516+0000 7fefcee05640 1 -- 172.21.15.146:0/3315152383 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0d4019870 con 0x561d32275630 2024-09-18T01:45:28.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.516+0000 7fefcee05640 1 -- 172.21.15.146:0/3315152383 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0d4019a10 con 0x561d32275630 2024-09-18T01:45:28.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.516+0000 7ff0e4640800 1 -- 172.21.15.146:0/3315152383 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561d323fa7e0 con 0x561d32275630 2024-09-18T01:45:28.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.516+0000 7fefcee05640 1 -- 172.21.15.146:0/3315152383 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0d4019d30 con 0x561d32275630 2024-09-18T01:45:28.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.516+0000 7ff0e4640800 1 -- 172.21.15.146:0/3315152383 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d323fad00 con 0x561d32275630 2024-09-18T01:45:28.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.517+0000 7fefcee05640 1 -- 172.21.15.146:0/3315152383 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff0d4017040 con 0x561d32275630 2024-09-18T01:45:28.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.517+0000 7fefcee05640 1 --2- 172.21.15.146:0/3315152383 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fefc8036b90 0x7fefc8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.517+0000 7fefcee05640 1 -- 172.21.15.146:0/3315152383 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7ff0d4015020 con 0x561d32275630 2024-09-18T01:45:28.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.517+0000 7ff0e1933640 1 --2- 172.21.15.146:0/3315152383 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fefc8036b90 0x7fefc8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.517+0000 7ff0e4640800 1 --2- 172.21.15.146:0/3315152383 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x561d32307d20 0x561d32401310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.517+0000 7ff0e4640800 1 -- 172.21.15.146:0/3315152383 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561d32401890 con 0x561d32307d20 2024-09-18T01:45:28.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.517+0000 7ff0e2935640 1 --2- 172.21.15.146:0/3315152383 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x561d32307d20 0x561d32401310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.518+0000 7ff0e1933640 1 --2- 172.21.15.146:0/3315152383 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fefc8036b90 0x7fefc8039050 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8057000 tx=0x7ff0d8052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.518+0000 7ff0e2935640 1 --2- 172.21.15.146:0/3315152383 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x561d32307d20 0x561d32401310 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.518+0000 7ff0e2935640 1 -- 172.21.15.146:0/3315152383 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0dc00a4a0 con 0x561d32307d20 2024-09-18T01:45:28.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.518+0000 7ff0e4640800 1 -- 172.21.15.146:0/3315152383 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561d323fe8c0 con 0x561d32307d20 2024-09-18T01:45:28.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.518+0000 7ff0e2935640 1 -- 172.21.15.146:0/3315152383 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff0dc00a4a0 con 0x561d32307d20 2024-09-18T01:45:28.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.518+0000 7ff0e4640800 1 -- 172.21.15.146:0/3315152383 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561d324036b0 con 0x561d32307d20 2024-09-18T01:45:28.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.519+0000 7ff0e2935640 1 -- 172.21.15.146:0/3315152383 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff0dc00a4a0 con 0x561d32307d20 2024-09-18T01:45:28.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.519+0000 7ff0e4640800 1 -- 172.21.15.146:0/3315152383 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561d324027f0 con 0x561d32307d20 2024-09-18T01:45:28.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.519+0000 7ff0e2935640 1 -- 172.21.15.146:0/3315152383 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff0dc00a4a0 con 0x561d32307d20 2024-09-18T01:45:28.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.519+0000 7ff0e4640800 1 --2- 172.21.15.146:0/3315152383 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x561d32403290 0x561d32406af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.519+0000 7ff0e4640800 1 -- 172.21.15.146:0/3315152383 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561d32407280 con 0x561d32403290 2024-09-18T01:45:28.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.519+0000 7ff0e2134640 1 --2- 172.21.15.146:0/3315152383 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x561d32403290 0x561d32406af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.519+0000 7ff0e2134640 1 --2- 172.21.15.146:0/3315152383 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x561d32403290 0x561d32406af0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.520+0000 7ff0e2134640 1 -- 172.21.15.146:0/3315152383 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff0d402d070 con 0x561d32403290 2024-09-18T01:45:28.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.520+0000 7ff0e4640800 1 Processor -- start 2024-09-18T01:45:28.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.520+0000 7ff0e4640800 1 -- start start 2024-09-18T01:45:28.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.520+0000 7ff0e4640800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561d32415030 0x561d32415450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.520+0000 7ff0e4640800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x561d3219c580 con 0x561d32415030 2024-09-18T01:45:28.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.520+0000 7ff0e2935640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561d32415030 0x561d32415450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.520+0000 7ff0e2935640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561d32415030 0x561d32415450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:58054/0 (socket says 172.21.15.146:58054) 2024-09-18T01:45:28.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.520+0000 7ff0e2935640 1 -- 172.21.15.146:0/2562184096 learned_addr learned my addr 172.21.15.146:0/2562184096 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:28.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.521+0000 7ff0e2935640 1 -- 172.21.15.146:0/2562184096 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d32415990 con 0x561d32415030 2024-09-18T01:45:28.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.521+0000 7ff0e2935640 1 --2- 172.21.15.146:0/2562184096 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561d32415030 0x561d32415450 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x561d32401c90 tx=0x7ff0dc0178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.521+0000 7fefc7fff640 1 -- 172.21.15.146:0/2562184096 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0dc013440 con 0x561d32415030 2024-09-18T01:45:28.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.521+0000 7fefc7fff640 1 -- 172.21.15.146:0/2562184096 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0dc0135e0 con 0x561d32415030 2024-09-18T01:45:28.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.521+0000 7ff0e4640800 1 -- 172.21.15.146:0/2562184096 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561d32415c20 con 0x561d32415030 2024-09-18T01:45:28.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.521+0000 7fefc7fff640 1 -- 172.21.15.146:0/2562184096 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0dc0138c0 con 0x561d32415030 2024-09-18T01:45:28.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.521+0000 7ff0e4640800 1 -- 172.21.15.146:0/2562184096 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d32418900 con 0x561d32415030 2024-09-18T01:45:28.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.522+0000 7fefc7fff640 1 -- 172.21.15.146:0/2562184096 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff0dc011040 con 0x561d32415030 2024-09-18T01:45:28.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.522+0000 7fefc7fff640 1 --2- 172.21.15.146:0/2562184096 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fefbc036b90 0x7fefbc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.522+0000 7fefc7fff640 1 -- 172.21.15.146:0/2562184096 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7ff0dc01d070 con 0x561d32415030 2024-09-18T01:45:28.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.522+0000 7ff0e2134640 1 --2- 172.21.15.146:0/2562184096 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fefbc036b90 0x7fefbc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.522+0000 7ff0e4640800 1 Processor -- start 2024-09-18T01:45:28.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.522+0000 7ff0e4640800 1 -- start start 2024-09-18T01:45:28.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.522+0000 7ff0e2134640 1 --2- 172.21.15.146:0/2562184096 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fefbc036b90 0x7fefbc039050 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x561d32402b90 tx=0x7ff0d404b640 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.522+0000 7ff0e4640800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561d32421c80 0x561d32422080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.522+0000 7ff0e4640800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x561d323f2fd0 con 0x561d32421c80 2024-09-18T01:45:28.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.523+0000 7ff0e2935640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561d32421c80 0x561d32422080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.523+0000 7ff0e2935640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561d32421c80 0x561d32422080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:58064/0 (socket says 172.21.15.146:58064) 2024-09-18T01:45:28.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.523+0000 7ff0e2935640 1 -- 172.21.15.146:0/3871044224 learned_addr learned my addr 172.21.15.146:0/3871044224 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:28.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.523+0000 7ff0e2935640 1 -- 172.21.15.146:0/3871044224 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d32422650 con 0x561d32421c80 2024-09-18T01:45:28.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.523+0000 7ff0e2935640 1 --2- 172.21.15.146:0/3871044224 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561d32421c80 0x561d32422080 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc04c890 tx=0x7ff0dc04c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdb02c4ffb9d957b server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.523+0000 7fefc5ffb640 1 -- 172.21.15.146:0/3871044224 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0dc045070 con 0x561d32421c80 2024-09-18T01:45:28.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.523+0000 7fefc5ffb640 1 -- 172.21.15.146:0/3871044224 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0dc012df0 con 0x561d32421c80 2024-09-18T01:45:28.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.523+0000 7fefc5ffb640 1 -- 172.21.15.146:0/3871044224 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0dc021b80 con 0x561d32421c80 2024-09-18T01:45:28.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.524+0000 7ff0e4640800 1 -- 172.21.15.146:0/3871044224 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561d32421c80 msgr2=0x561d32422080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.524+0000 7ff0e4640800 1 --2- 172.21.15.146:0/3871044224 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561d32421c80 0x561d32422080 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc04c890 tx=0x7ff0dc04c9d0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.524+0000 7ff0e4640800 1 -- 172.21.15.146:0/3871044224 shutdown_connections 2024-09-18T01:45:28.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.524+0000 7ff0e4640800 1 --2- 172.21.15.146:0/3871044224 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561d32421c80 0x561d32422080 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.524+0000 7ff0e4640800 1 -- 172.21.15.146:0/3871044224 >> 172.21.15.146:0/3871044224 conn(0x561d3241dfe0 msgr2=0x561d3241c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:28.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.524+0000 7ff0e4640800 1 -- 172.21.15.146:0/3871044224 shutdown_connections 2024-09-18T01:45:28.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.524+0000 7ff0e4640800 1 -- 172.21.15.146:0/3871044224 wait complete. 2024-09-18T01:45:28.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.524+0000 7ff0e4640800 1 Processor -- start 2024-09-18T01:45:28.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.524+0000 7ff0e4640800 1 -- start start 2024-09-18T01:45:28.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.524+0000 7ff0e4640800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561d32421c80 0x561d32429140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.524+0000 7ff0e4640800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x561d32422cc0 con 0x561d32421c80 2024-09-18T01:45:28.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.524+0000 7ff0e2935640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561d32421c80 0x561d32429140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.524+0000 7ff0e2935640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561d32421c80 0x561d32429140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:58070/0 (socket says 172.21.15.146:58070) 2024-09-18T01:45:28.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.525+0000 7ff0e2935640 1 -- 172.21.15.146:0/2737196285 learned_addr learned my addr 172.21.15.146:0/2737196285 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:28.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.525+0000 7ff0e2935640 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d32429680 con 0x561d32421c80 2024-09-18T01:45:28.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.525+0000 7ff0e2935640 1 --2- 172.21.15.146:0/2737196285 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561d32421c80 0x561d32429140 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc04ca10 tx=0x7ff0dc04c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.525+0000 7fefb3fff640 1 -- 172.21.15.146:0/2737196285 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0dc03a070 con 0x561d32421c80 2024-09-18T01:45:28.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.525+0000 7fefb3fff640 1 -- 172.21.15.146:0/2737196285 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0dc04e2a0 con 0x561d32421c80 2024-09-18T01:45:28.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.525+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561d32429910 con 0x561d32421c80 2024-09-18T01:45:28.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.525+0000 7fefb3fff640 1 -- 172.21.15.146:0/2737196285 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0dc045040 con 0x561d32421c80 2024-09-18T01:45:28.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.525+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d3242c5c0 con 0x561d32421c80 2024-09-18T01:45:28.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.526+0000 7fefb3fff640 1 -- 172.21.15.146:0/2737196285 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff0dc03d070 con 0x561d32421c80 2024-09-18T01:45:28.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.526+0000 7fefb3fff640 1 --2- 172.21.15.146:0/2737196285 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fefac036b90 0x7fefac039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.526+0000 7fefb3fff640 1 -- 172.21.15.146:0/2737196285 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7ff0dc00e040 con 0x561d32421c80 2024-09-18T01:45:28.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.526+0000 7ff0e2134640 1 --2- 172.21.15.146:0/2737196285 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fefac036b90 0x7fefac039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.526+0000 7ff0e2134640 1 --2- 172.21.15.146:0/2737196285 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fefac036b90 0x7fefac039050 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff0d400bc50 tx=0x7ff0d4033000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.527+0000 7ff0e4640800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.527+0000 7ff0e4640800 1 --2- 172.21.15.146:0/2737196285 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x561d32434de0 0x561d324372a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.527+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561d324379f0 con 0x561d32434de0 2024-09-18T01:45:28.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.527+0000 7ff0e1933640 1 --2- 172.21.15.146:0/2737196285 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x561d32434de0 0x561d324372a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.527+0000 7ff0e1933640 1 --2- 172.21.15.146:0/2737196285 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x561d32434de0 0x561d324372a0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.527+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0d8051070 con 0x561d32434de0 2024-09-18T01:45:28.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.527+0000 7ff0e4640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:28.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.527+0000 7ff0e4640800 20 realm 2024-09-18T01:45:28.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.527+0000 7ff0e4640800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.527+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561d32437e20 con 0x561d32434de0 2024-09-18T01:45:28.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.528+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0d8051070 con 0x561d32434de0 2024-09-18T01:45:28.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.528+0000 7ff0e4640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:28.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.528+0000 7ff0e4640800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:28.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.528+0000 7ff0e4640800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.528+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561d324386f0 con 0x561d32434de0 2024-09-18T01:45:28.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.528+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0d8051070 con 0x561d32434de0 2024-09-18T01:45:28.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.528+0000 7ff0e4640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:28.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.528+0000 7ff0e4640800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.528+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561d32438a90 con 0x561d32434de0 2024-09-18T01:45:28.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.528+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff0d8051070 con 0x561d32434de0 2024-09-18T01:45:28.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.528+0000 7ff0e4640800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:28.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.528+0000 7ff0e4640800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.528+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561d324392e0 con 0x561d32434de0 2024-09-18T01:45:28.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.528+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff0d8051070 con 0x561d32434de0 2024-09-18T01:45:28.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.528+0000 7ff0e4640800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:28.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.528+0000 7ff0e4640800 20 searching for the correct realm 2024-09-18T01:45:28.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.528+0000 7ff0e4640800 1 --2- 172.21.15.146:0/2737196285 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x561d3243b050 0x561d3243d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.528+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561d3243da70 con 0x561d3243b050 2024-09-18T01:45:28.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.528+0000 7ff0e2935640 1 --2- 172.21.15.146:0/2737196285 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x561d3243b050 0x561d3243d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.529+0000 7ff0e2935640 1 --2- 172.21.15.146:0/2737196285 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x561d3243b050 0x561d3243d440 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.529+0000 7ff0e2935640 1 -- 172.21.15.146:0/2737196285 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0dc03c030 con 0x561d3243b050 2024-09-18T01:45:28.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.529+0000 7ff0e2935640 1 --2- 172.21.15.146:0/2737196285 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7ff0dc03f060 0x7ff0dc023070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.529+0000 7ff0e2935640 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561d3243da70 con 0x7ff0dc03f060 2024-09-18T01:45:28.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.529+0000 7ff0e2134640 1 --2- 172.21.15.146:0/2737196285 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7ff0dc03f060 0x7ff0dc023070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.529+0000 7ff0e2134640 1 --2- 172.21.15.146:0/2737196285 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7ff0dc03f060 0x7ff0dc023070 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.530+0000 7ff0e2134640 1 -- 172.21.15.146:0/2737196285 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0d402d070 con 0x7ff0dc03f060 2024-09-18T01:45:28.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.530+0000 7ff0e2134640 1 --2- 172.21.15.146:0/2737196285 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7ff0d4018810 0x7ff0d403f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.530+0000 7ff0e2134640 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561d3243da70 con 0x7ff0d4018810 2024-09-18T01:45:28.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.530+0000 7ff0e1933640 1 --2- 172.21.15.146:0/2737196285 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7ff0d4018810 0x7ff0d403f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.530+0000 7ff0e1933640 1 --2- 172.21.15.146:0/2737196285 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7ff0d4018810 0x7ff0d403f1e0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.530+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0d8051070 con 0x7ff0d4018810 2024-09-18T01:45:28.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.530+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561d3243da70 con 0x561d32434de0 2024-09-18T01:45:28.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.531+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff0d8051070 con 0x561d32434de0 2024-09-18T01:45:28.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.531+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561d3243da70 con 0x561d32434de0 2024-09-18T01:45:28.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.531+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0d8051070 con 0x561d32434de0 2024-09-18T01:45:28.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.531+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561d3243da70 con 0x7ff0d4018810 2024-09-18T01:45:28.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.531+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0d8051070 con 0x7ff0d4018810 2024-09-18T01:45:28.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.531+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561d3243da70 con 0x7ff0d4018810 2024-09-18T01:45:28.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.531+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0d8051070 con 0x7ff0d4018810 2024-09-18T01:45:28.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.531+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561d3243da70 con 0x7ff0dc03f060 2024-09-18T01:45:28.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.532+0000 7ff0e2134640 1 -- 172.21.15.146:0/2737196285 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0d402d070 con 0x7ff0dc03f060 2024-09-18T01:45:28.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.532+0000 7ff0e2134640 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561d3243da70 con 0x561d3243b050 2024-09-18T01:45:28.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.532+0000 7ff0e2935640 1 -- 172.21.15.146:0/2737196285 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0dc03c030 con 0x561d3243b050 2024-09-18T01:45:28.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.532+0000 7ff0e2935640 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561d3243da70 con 0x561d32434de0 2024-09-18T01:45:28.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.532+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0d8051070 con 0x561d32434de0 2024-09-18T01:45:28.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.532+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561d3243da70 con 0x7ff0d4018810 2024-09-18T01:45:28.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.532+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0d8051070 con 0x7ff0d4018810 2024-09-18T01:45:28.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.532+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561d3243da70 con 0x561d32434de0 2024-09-18T01:45:28.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.532+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0d8051070 con 0x561d32434de0 2024-09-18T01:45:28.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.532+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561d3243da70 con 0x7ff0dc03f060 2024-09-18T01:45:28.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.533+0000 7ff0e2134640 1 -- 172.21.15.146:0/2737196285 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7ff0d402d070 con 0x7ff0dc03f060 2024-09-18T01:45:28.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.533+0000 7ff0e2134640 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561d3243da70 con 0x561d3243b050 2024-09-18T01:45:28.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.533+0000 7ff0e2935640 1 -- 172.21.15.146:0/2737196285 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0dc03c030 con 0x561d3243b050 2024-09-18T01:45:28.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.533+0000 7ff0e2935640 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561d3243da70 con 0x561d3243b050 2024-09-18T01:45:28.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.533+0000 7ff0e2935640 1 -- 172.21.15.146:0/2737196285 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0dc03c030 con 0x561d3243b050 2024-09-18T01:45:28.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.533+0000 7ff0e2935640 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561d3243da70 con 0x7ff0d4018810 2024-09-18T01:45:28.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.533+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0d8051070 con 0x7ff0d4018810 2024-09-18T01:45:28.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.533+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561d3243da70 con 0x561d3243b050 2024-09-18T01:45:28.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.534+0000 7ff0e2935640 1 -- 172.21.15.146:0/2737196285 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0dc03c030 con 0x561d3243b050 2024-09-18T01:45:28.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.534+0000 7ff0e2935640 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561d3243da70 con 0x561d3243b050 2024-09-18T01:45:28.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.534+0000 7ff0e2935640 1 -- 172.21.15.146:0/2737196285 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0dc03c030 con 0x561d3243b050 2024-09-18T01:45:28.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.534+0000 7ff0e2935640 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561d3243da70 con 0x561d32434de0 2024-09-18T01:45:28.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.534+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0d8051070 con 0x561d32434de0 2024-09-18T01:45:28.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.534+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561d3243da70 con 0x561d32434de0 2024-09-18T01:45:28.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.534+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff0d8051070 con 0x561d32434de0 2024-09-18T01:45:28.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.534+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561d3243da70 con 0x7ff0d4018810 2024-09-18T01:45:28.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.535+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0d8051070 con 0x7ff0d4018810 2024-09-18T01:45:28.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.535+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561d3243da70 con 0x561d3243b050 2024-09-18T01:45:28.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.535+0000 7ff0e2935640 1 -- 172.21.15.146:0/2737196285 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0dc03c030 con 0x561d3243b050 2024-09-18T01:45:28.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.535+0000 7ff0e2935640 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561d3243da70 con 0x7ff0dc03f060 2024-09-18T01:45:28.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.535+0000 7ff0e2134640 1 -- 172.21.15.146:0/2737196285 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0d402d070 con 0x7ff0dc03f060 2024-09-18T01:45:28.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.535+0000 7ff0e2134640 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561d3243da70 con 0x561d32434de0 2024-09-18T01:45:28.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.535+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0d8051070 con 0x561d32434de0 2024-09-18T01:45:28.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.535+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561d3243da70 con 0x7ff0d4018810 2024-09-18T01:45:28.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.535+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0d8051070 con 0x7ff0d4018810 2024-09-18T01:45:28.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.536+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561d3243da70 con 0x561d3243b050 2024-09-18T01:45:28.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.536+0000 7ff0e2935640 1 -- 172.21.15.146:0/2737196285 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0dc03c030 con 0x561d3243b050 2024-09-18T01:45:28.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.536+0000 7ff0e2935640 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561d3243da70 con 0x7ff0d4018810 2024-09-18T01:45:28.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.536+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0d8051070 con 0x7ff0d4018810 2024-09-18T01:45:28.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.536+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561d3243da70 con 0x7ff0dc03f060 2024-09-18T01:45:28.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.536+0000 7ff0e2134640 1 -- 172.21.15.146:0/2737196285 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0d402d070 con 0x7ff0dc03f060 2024-09-18T01:45:28.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.536+0000 7ff0e2134640 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561d3243da70 con 0x561d3243b050 2024-09-18T01:45:28.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.536+0000 7ff0e2935640 1 -- 172.21.15.146:0/2737196285 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0dc03c030 con 0x561d3243b050 2024-09-18T01:45:28.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.536+0000 7ff0e2935640 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561d3243da70 con 0x7ff0d4018810 2024-09-18T01:45:28.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.537+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0d8051070 con 0x7ff0d4018810 2024-09-18T01:45:28.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.537+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561d3243da70 con 0x561d32434de0 2024-09-18T01:45:28.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.537+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff0d8051070 con 0x561d32434de0 2024-09-18T01:45:28.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.537+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561d3243da70 con 0x7ff0dc03f060 2024-09-18T01:45:28.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.537+0000 7ff0e2134640 1 -- 172.21.15.146:0/2737196285 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0d402d070 con 0x7ff0dc03f060 2024-09-18T01:45:28.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.537+0000 7ff0e4640800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:28.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.537+0000 7ff0e4640800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:28.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.537+0000 7ff0e4640800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:28.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.537+0000 7ff0e4640800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:28.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.537+0000 7ff0e4640800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:28.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.537+0000 7ff0e4640800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:28.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.537+0000 7ff0e4640800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.537+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561d32439c60 con 0x561d32434de0 2024-09-18T01:45:28.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.537+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0d8051070 con 0x561d32434de0 2024-09-18T01:45:28.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.537+0000 7ff0e4640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:28.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.537+0000 7ff0e4640800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.537+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561d3243a500 con 0x561d32434de0 2024-09-18T01:45:28.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.538+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff0d8051070 con 0x561d32434de0 2024-09-18T01:45:28.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.538+0000 7ff0e4640800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:28.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.538+0000 7ff0e4640800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.538+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561d3243def0 con 0x7ff0dc03f060 2024-09-18T01:45:28.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.538+0000 7ff0e2134640 1 -- 172.21.15.146:0/2737196285 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff0d402d070 con 0x7ff0dc03f060 2024-09-18T01:45:28.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.538+0000 7ff0e4640800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:28.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.538+0000 7ff0e4640800 20 zone default found 2024-09-18T01:45:28.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.538+0000 7ff0e4640800 4 Realm: () 2024-09-18T01:45:28.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.538+0000 7ff0e4640800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:28.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.538+0000 7ff0e4640800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:28.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.538+0000 7ff0e4640800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:28.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.538+0000 7ff0e4640800 20 zonegroup default 2024-09-18T01:45:28.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.538+0000 7ff0e4640800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.538+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561d3243e740 con 0x7ff0d4018810 2024-09-18T01:45:28.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.538+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff0d8051070 con 0x7ff0d4018810 2024-09-18T01:45:28.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.538+0000 7ff0e4640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:28.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.538+0000 7ff0e4640800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.538+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561d32440120 con 0x561d3243b050 2024-09-18T01:45:28.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.538+0000 7ff0e2935640 1 -- 172.21.15.146:0/2737196285 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff0dc03c030 con 0x561d3243b050 2024-09-18T01:45:28.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.539+0000 7ff0e4640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:28.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.539+0000 7ff0e4640800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.539+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561d324405a0 con 0x561d3243b050 2024-09-18T01:45:28.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.539+0000 7ff0e2935640 1 -- 172.21.15.146:0/2737196285 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff0dc03c030 con 0x561d3243b050 2024-09-18T01:45:28.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.539+0000 7ff0e4640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:28.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.539+0000 7ff0e4640800 20 started sync module instance, tier type = 2024-09-18T01:45:28.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.539+0000 7ff0e4640800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:28.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.539+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d3243f5b0 con 0x7ff0dc03f060 2024-09-18T01:45:28.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.540+0000 7ff0e2134640 1 -- 172.21.15.146:0/2737196285 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v31'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0d402d070 con 0x7ff0dc03f060 2024-09-18T01:45:28.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.540+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94683397355984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d3243f210 con 0x7ff0dc03f060 2024-09-18T01:45:28.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.540+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d324414d0 con 0x561d32434de0 2024-09-18T01:45:28.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.541+0000 7ff0e2134640 1 -- 172.21.15.146:0/2737196285 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94683397355984] v31'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0d402d070 con 0x7ff0dc03f060 2024-09-18T01:45:28.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.541+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v31'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0d8051070 con 0x561d32434de0 2024-09-18T01:45:28.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.541+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94683397361696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d324418f0 con 0x561d32434de0 2024-09-18T01:45:28.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.541+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d324422b0 con 0x561d3243b050 2024-09-18T01:45:28.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.542+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94683397361696] v31'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0d8051070 con 0x561d32434de0 2024-09-18T01:45:28.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.542+0000 7ff0e2935640 1 -- 172.21.15.146:0/2737196285 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v31'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0dc03c030 con 0x561d3243b050 2024-09-18T01:45:28.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.542+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94683397362752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d32441860 con 0x561d3243b050 2024-09-18T01:45:28.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.542+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d324431b0 con 0x7ff0dc03f060 2024-09-18T01:45:28.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.543+0000 7ff0e2134640 1 -- 172.21.15.146:0/2737196285 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v31'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0d402d070 con 0x7ff0dc03f060 2024-09-18T01:45:28.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.543+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94683397369024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d32443a50 con 0x7ff0dc03f060 2024-09-18T01:45:28.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.543+0000 7ff0e2935640 1 -- 172.21.15.146:0/2737196285 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94683397362752] v31'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0dc03c030 con 0x561d3243b050 2024-09-18T01:45:28.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.543+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d32444010 con 0x561d32434de0 2024-09-18T01:45:28.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.544+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v31'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0d8051070 con 0x561d32434de0 2024-09-18T01:45:28.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.544+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94683397367456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d324448b0 con 0x561d32434de0 2024-09-18T01:45:28.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.544+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d32445330 con 0x7ff0d4018810 2024-09-18T01:45:28.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.544+0000 7ff0e2134640 1 -- 172.21.15.146:0/2737196285 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94683397369024] v31'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0d402d070 con 0x7ff0dc03f060 2024-09-18T01:45:28.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.545+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94683397367456] v31'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0d8051070 con 0x561d32434de0 2024-09-18T01:45:28.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.545+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v31'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0d8051070 con 0x7ff0d4018810 2024-09-18T01:45:28.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.545+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94683397377568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d324443b0 con 0x7ff0d4018810 2024-09-18T01:45:28.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.545+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d32445bd0 con 0x7ff0d4018810 2024-09-18T01:45:28.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.548+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(56 notify.6 [create] v31'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0d8051070 con 0x7ff0d4018810 2024-09-18T01:45:28.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.548+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94683397379872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d324443b0 con 0x7ff0d4018810 2024-09-18T01:45:28.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.548+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d324466c0 con 0x7ff0d4018810 2024-09-18T01:45:28.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.548+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94683397377568] v31'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0d8051070 con 0x7ff0d4018810 2024-09-18T01:45:28.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.549+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94683397379872] v31'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0d8051070 con 0x7ff0d4018810 2024-09-18T01:45:28.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.549+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v31'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0d8051070 con 0x7ff0d4018810 2024-09-18T01:45:28.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.549+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94683397382544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d32446680 con 0x7ff0d4018810 2024-09-18T01:45:28.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.549+0000 7ff0e4640800 20 add_watcher() i=0 2024-09-18T01:45:28.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.549+0000 7ff0e4640800 20 add_watcher() i=1 2024-09-18T01:45:28.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.549+0000 7ff0e4640800 20 add_watcher() i=2 2024-09-18T01:45:28.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.549+0000 7ff0e4640800 20 add_watcher() i=3 2024-09-18T01:45:28.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.549+0000 7ff0e4640800 20 add_watcher() i=4 2024-09-18T01:45:28.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.549+0000 7ff0e4640800 20 add_watcher() i=5 2024-09-18T01:45:28.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.549+0000 7ff0e4640800 20 add_watcher() i=6 2024-09-18T01:45:28.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.551+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94683397382544] v31'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0d8051070 con 0x7ff0d4018810 2024-09-18T01:45:28.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.551+0000 7ff0e4640800 20 add_watcher() i=7 2024-09-18T01:45:28.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.551+0000 7ff0e4640800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:28.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.551+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561d32445b40 con 0x561d32434de0 2024-09-18T01:45:28.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.551+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff0d8051070 con 0x561d32434de0 2024-09-18T01:45:28.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.551+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94683397371296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d32445b40 con 0x561d32434de0 2024-09-18T01:45:28.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.552+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94683397371296] v31'140 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff0d8051070 con 0x561d32434de0 2024-09-18T01:45:28.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.552+0000 7fef98fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:28.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.552+0000 7ff0e4640800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:28.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.552+0000 7ff0e4640800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:28.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.552+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d32452040 con 0x561d32434de0 2024-09-18T01:45:28.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.553+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'47 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff0d8051070 con 0x561d32434de0 2024-09-18T01:45:28.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.554+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d32452710 con 0x7ff0d4018810 2024-09-18T01:45:28.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.554+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff0d8051070 con 0x7ff0d4018810 2024-09-18T01:45:28.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.554+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d32452b50 con 0x561d3243b050 2024-09-18T01:45:28.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.555+0000 7ff0e2935640 1 -- 172.21.15.146:0/2737196285 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff0dc03c030 con 0x561d3243b050 2024-09-18T01:45:28.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.555+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d32452af0 con 0x561d32434de0 2024-09-18T01:45:28.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.556+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'141 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff0d8051070 con 0x561d32434de0 2024-09-18T01:45:28.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.556+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d324530c0 con 0x7ff0dc03f060 2024-09-18T01:45:28.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.557+0000 7ff0e2134640 1 -- 172.21.15.146:0/2737196285 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'44 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff0d402d070 con 0x7ff0dc03f060 2024-09-18T01:45:28.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.557+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d32453630 con 0x561d3243b050 2024-09-18T01:45:28.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.558+0000 7ff0e2935640 1 -- 172.21.15.146:0/2737196285 <== osd.3 v2:172.21.15.146:6809/4106661138 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'39 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff0dc03c030 con 0x561d3243b050 2024-09-18T01:45:28.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.558+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d32453630 con 0x561d32434de0 2024-09-18T01:45:28.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.560+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff0d8051070 con 0x561d32434de0 2024-09-18T01:45:28.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.560+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d32453630 con 0x7ff0d4018810 2024-09-18T01:45:28.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.561+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'31 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff0d8051070 con 0x7ff0d4018810 2024-09-18T01:45:28.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.561+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d32453630 con 0x7ff0dc03f060 2024-09-18T01:45:28.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.562+0000 7ff0e2134640 1 -- 172.21.15.146:0/2737196285 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff0d402d070 con 0x7ff0dc03f060 2024-09-18T01:45:28.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.562+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d32453be0 con 0x561d3243b050 2024-09-18T01:45:28.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.563+0000 7ff0e2935640 1 -- 172.21.15.146:0/2737196285 <== osd.3 v2:172.21.15.146:6809/4106661138 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff0dc03c030 con 0x561d3243b050 2024-09-18T01:45:28.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.563+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d32453be0 con 0x7ff0dc03f060 2024-09-18T01:45:28.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.564+0000 7ff0e2134640 1 -- 172.21.15.146:0/2737196285 <== osd.2 v2:172.21.15.146:6800/3820039304 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'45 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0d402d070 con 0x7ff0dc03f060 2024-09-18T01:45:28.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.564+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d32453be0 con 0x7ff0d4018810 2024-09-18T01:45:28.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.565+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'18 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0d8051070 con 0x7ff0d4018810 2024-09-18T01:45:28.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.565+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d32453be0 con 0x7ff0dc03f060 2024-09-18T01:45:28.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.565+0000 7ff0e2134640 1 -- 172.21.15.146:0/2737196285 <== osd.2 v2:172.21.15.146:6800/3820039304 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0d402d070 con 0x7ff0dc03f060 2024-09-18T01:45:28.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.566+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d32453be0 con 0x7ff0d4018810 2024-09-18T01:45:28.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.567+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'43 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0d8051070 con 0x7ff0d4018810 2024-09-18T01:45:28.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.567+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d32453be0 con 0x561d32434de0 2024-09-18T01:45:28.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.567+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'142 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0d8051070 con 0x561d32434de0 2024-09-18T01:45:28.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.568+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d32453be0 con 0x561d3243b050 2024-09-18T01:45:28.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.569+0000 7ff0e2935640 1 -- 172.21.15.146:0/2737196285 <== osd.3 v2:172.21.15.146:6809/4106661138 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'38 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0dc03c030 con 0x561d3243b050 2024-09-18T01:45:28.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.569+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d32453be0 con 0x7ff0dc03f060 2024-09-18T01:45:28.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.570+0000 7ff0e2134640 1 -- 172.21.15.146:0/2737196285 <== osd.2 v2:172.21.15.146:6800/3820039304 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'46 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0d402d070 con 0x7ff0dc03f060 2024-09-18T01:45:28.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.570+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d32453be0 con 0x561d3243b050 2024-09-18T01:45:28.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.570+0000 7ff0e2935640 1 -- 172.21.15.146:0/2737196285 <== osd.3 v2:172.21.15.146:6809/4106661138 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'29 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0dc03c030 con 0x561d3243b050 2024-09-18T01:45:28.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.570+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d32453be0 con 0x561d32434de0 2024-09-18T01:45:28.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.572+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0d8051070 con 0x561d32434de0 2024-09-18T01:45:28.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.572+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d32453be0 con 0x561d32434de0 2024-09-18T01:45:28.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.572+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'143 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0d8051070 con 0x561d32434de0 2024-09-18T01:45:28.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.572+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d32453be0 con 0x561d3243b050 2024-09-18T01:45:28.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.574+0000 7ff0e2935640 1 -- 172.21.15.146:0/2737196285 <== osd.3 v2:172.21.15.146:6809/4106661138 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'39 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0dc03c030 con 0x561d3243b050 2024-09-18T01:45:28.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.574+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d32453be0 con 0x7ff0dc03f060 2024-09-18T01:45:28.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.574+0000 7ff0e2134640 1 -- 172.21.15.146:0/2737196285 <== osd.2 v2:172.21.15.146:6800/3820039304 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'32 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0d402d070 con 0x7ff0dc03f060 2024-09-18T01:45:28.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.575+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d32453be0 con 0x561d3243b050 2024-09-18T01:45:28.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.575+0000 7ff0e2935640 1 -- 172.21.15.146:0/2737196285 <== osd.3 v2:172.21.15.146:6809/4106661138 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'24 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0dc03c030 con 0x561d3243b050 2024-09-18T01:45:28.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.576+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d32453be0 con 0x561d3243b050 2024-09-18T01:45:28.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.576+0000 7ff0e2935640 1 -- 172.21.15.146:0/2737196285 <== osd.3 v2:172.21.15.146:6809/4106661138 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'34 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0dc03c030 con 0x561d3243b050 2024-09-18T01:45:28.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.576+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d32453be0 con 0x561d3243b050 2024-09-18T01:45:28.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.577+0000 7ff0e2935640 1 -- 172.21.15.146:0/2737196285 <== osd.3 v2:172.21.15.146:6809/4106661138 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0dc03c030 con 0x561d3243b050 2024-09-18T01:45:28.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.577+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d32453be0 con 0x561d3243b050 2024-09-18T01:45:28.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.578+0000 7ff0e2935640 1 -- 172.21.15.146:0/2737196285 <== osd.3 v2:172.21.15.146:6809/4106661138 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'40 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0dc03c030 con 0x561d3243b050 2024-09-18T01:45:28.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.578+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d32453be0 con 0x7ff0d4018810 2024-09-18T01:45:28.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.579+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'25 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0d8051070 con 0x7ff0d4018810 2024-09-18T01:45:28.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.579+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d32453be0 con 0x561d3243b050 2024-09-18T01:45:28.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.580+0000 7ff0e2935640 1 -- 172.21.15.146:0/2737196285 <== osd.3 v2:172.21.15.146:6809/4106661138 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'28 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0dc03c030 con 0x561d3243b050 2024-09-18T01:45:28.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.580+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d32453be0 con 0x7ff0d4018810 2024-09-18T01:45:28.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.581+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.0 v2:172.21.15.129:6800/1759265424 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'32 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0d8051070 con 0x7ff0d4018810 2024-09-18T01:45:28.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.581+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d32453be0 con 0x561d3243b050 2024-09-18T01:45:28.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.582+0000 7ff0e2935640 1 -- 172.21.15.146:0/2737196285 <== osd.3 v2:172.21.15.146:6809/4106661138 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'40 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0dc03c030 con 0x561d3243b050 2024-09-18T01:45:28.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.582+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d32453be0 con 0x7ff0d4018810 2024-09-18T01:45:28.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.583+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.0 v2:172.21.15.129:6800/1759265424 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'44 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0d8051070 con 0x7ff0d4018810 2024-09-18T01:45:28.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.583+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d32453be0 con 0x7ff0dc03f060 2024-09-18T01:45:28.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.584+0000 7ff0e2134640 1 -- 172.21.15.146:0/2737196285 <== osd.2 v2:172.21.15.146:6800/3820039304 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0d402d070 con 0x7ff0dc03f060 2024-09-18T01:45:28.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.584+0000 7fef137fe640 20 reqs_thread_entry: start 2024-09-18T01:45:28.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.585+0000 7ff0e4640800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:28.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.585+0000 7ff0e4640800 20 Filter name: none 2024-09-18T01:45:28.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.585+0000 7fef117fa640 20 reqs_thread_entry: start 2024-09-18T01:45:28.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.585+0000 7ff0e4640800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-18T01:45:28.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.585+0000 7ff0e4640800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.585+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:94 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561d3247ec90 con 0x7ff0d4018810 2024-09-18T01:45:28.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.585+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.0 v2:172.21.15.129:6800/1759265424 24 ==== osd_op_reply(94 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7ff0d8051070 con 0x7ff0d4018810 2024-09-18T01:45:28.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.585+0000 7ff0e4640800 20 rados_obj.operate() r=0 bl.length=419 2024-09-18T01:45:28.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.585+0000 7ff0e4640800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-18T01:45:28.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.585+0000 7ff0e4640800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-18T01:45:28.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.585+0000 7ff0e4640800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:45:28.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.585+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:95 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561d3247ebe0 con 0x561d32434de0 2024-09-18T01:45:28.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.586+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.1 v2:172.21.15.146:6808/3930274777 28 ==== osd_op_reply(95 testx$tenanteduser.buckets [call out=15b] v0'0 uv3 ondisk = 0) ==== 170+0+15 (crc 0 0 0) 0x7ff0d8051070 con 0x561d32434de0 2024-09-18T01:45:28.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.586+0000 7ff0e4640800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-18T01:45:28.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.586+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d3247ebe0 con 0x7ff0d4018810 2024-09-18T01:45:28.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.586+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.0 v2:172.21.15.129:6800/1759265424 25 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v31'12 uv12 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7ff0d8051070 con 0x7ff0d4018810 2024-09-18T01:45:28.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.587+0000 7ff0e4640800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-18T01:45:28.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.587+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94683397619728 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561d324818f0 con 0x561d3243b050 2024-09-18T01:45:28.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.587+0000 7ff0e2935640 1 -- 172.21.15.146:0/2737196285 <== osd.3 v2:172.21.15.146:6809/4106661138 26 ==== watch-notify(notify (1) cookie 94683397362752 notify 133143986181 ret 0) ==== 212+0+0 (crc 0 0 0) 0x561d324519f0 con 0x561d3243b050 2024-09-18T01:45:28.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.587+0000 7fefc5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986181 cookie 94683397362752 notifier 4572 bl.length()=170 2024-09-18T01:45:28.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.587+0000 7ff0e2935640 1 -- 172.21.15.146:0/2737196285 <== osd.3 v2:172.21.15.146:6809/4106661138 27 ==== osd_op_reply(97 notify.2 [notify cookie 94683397619728 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff0dc03c030 con 0x561d3243b050 2024-09-18T01:45:28.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.587+0000 7fefc5ffb640 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fefa8003d60 con 0x561d3243b050 2024-09-18T01:45:28.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.587+0000 7ff0e2935640 1 -- 172.21.15.146:0/2737196285 <== osd.3 v2:172.21.15.146:6809/4106661138 28 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0dc03c030 con 0x561d3243b050 2024-09-18T01:45:28.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.587+0000 7ff0e2935640 1 -- 172.21.15.146:0/2737196285 <== osd.3 v2:172.21.15.146:6809/4106661138 29 ==== watch-notify(notify_complete (2) cookie 94683397619728 notify 133143986181 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561d32429910 con 0x561d3243b050 2024-09-18T01:45:28.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.587+0000 7ff0e4640800 10 removing email index: 2024-09-18T01:45:28.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.587+0000 7ff0e4640800 10 removing user buckets index 2024-09-18T01:45:28.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.587+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:99 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d3247f4b0 con 0x561d32434de0 2024-09-18T01:45:28.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.588+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.1 v2:172.21.15.146:6808/3930274777 29 ==== osd_op_reply(99 testx$tenanteduser.buckets [delete] v31'5 uv5 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7ff0d8051070 con 0x561d32434de0 2024-09-18T01:45:28.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.588+0000 7ff0e4640800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser.buckets, ofs0, ns] 2024-09-18T01:45:28.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.588+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [notify cookie 94683397619296 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561d32481740 con 0x561d32434de0 2024-09-18T01:45:28.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.588+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.1 v2:172.21.15.146:6808/3930274777 30 ==== watch-notify(notify (1) cookie 94683397367456 notify 133143986191 ret 0) ==== 217+0+0 (crc 0 0 0) 0x561d32452710 con 0x561d32434de0 2024-09-18T01:45:28.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.588+0000 7fefc57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986191 cookie 94683397367456 notifier 4572 bl.length()=175 2024-09-18T01:45:28.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.588+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.1 v2:172.21.15.146:6808/3930274777 31 ==== osd_op_reply(100 notify.4 [notify cookie 94683397619296 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff0d8051070 con 0x561d32434de0 2024-09-18T01:45:28.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.588+0000 7fefc57fa640 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fef180032c0 con 0x561d32434de0 2024-09-18T01:45:28.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.589+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.1 v2:172.21.15.146:6808/3930274777 32 ==== watch-notify(notify_complete (2) cookie 94683397619296 notify 133143986191 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561d3242c5c0 con 0x561d32434de0 2024-09-18T01:45:28.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.589+0000 7ff0e4640800 10 removing user index: testx$tenanteduser 2024-09-18T01:45:28.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.589+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.1 v2:172.21.15.146:6808/3930274777 33 ==== osd_op_reply(101 notify.4 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0d8051070 con 0x561d32434de0 2024-09-18T01:45:28.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.589+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:102 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d32483510 con 0x7ff0d4018810 2024-09-18T01:45:28.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.590+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.0 v2:172.21.15.129:6800/1759265424 26 ==== osd_op_reply(102 testx$tenanteduser [call,call,delete] v31'13 uv13 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7ff0d8051070 con 0x7ff0d4018810 2024-09-18T01:45:28.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.590+0000 7ff0e4640800 10 removing default.rgw.meta+users.uid+testx$tenanteduser from cache 2024-09-18T01:45:28.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.590+0000 7ff0e4640800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-18T01:45:28.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.590+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:103 7.e 7:7759931f:::notify.3:head [notify cookie 94683397631984 in=179b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561d32480310 con 0x7ff0dc03f060 2024-09-18T01:45:28.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.590+0000 7ff0e2134640 1 -- 172.21.15.146:0/2737196285 <== osd.2 v2:172.21.15.146:6800/3820039304 19 ==== watch-notify(notify (1) cookie 94683397369024 notify 133143986195 ret 0) ==== 209+0+0 (crc 0 0 0) 0x561d32453110 con 0x7ff0dc03f060 2024-09-18T01:45:28.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.590+0000 7fefc57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986195 cookie 94683397369024 notifier 4572 bl.length()=167 2024-09-18T01:45:28.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.590+0000 7fefc57fa640 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fef180032f0 con 0x7ff0dc03f060 2024-09-18T01:45:28.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.590+0000 7ff0e2134640 1 -- 172.21.15.146:0/2737196285 <== osd.2 v2:172.21.15.146:6800/3820039304 20 ==== osd_op_reply(103 notify.3 [notify cookie 94683397631984 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff0d402d070 con 0x7ff0dc03f060 2024-09-18T01:45:28.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.591+0000 7ff0e2134640 1 -- 172.21.15.146:0/2737196285 <== osd.2 v2:172.21.15.146:6800/3820039304 21 ==== watch-notify(notify_complete (2) cookie 94683397631984 notify 133143986195 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561d32453460 con 0x7ff0dc03f060 2024-09-18T01:45:28.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.591+0000 7ff0e2134640 1 -- 172.21.15.146:0/2737196285 <== osd.2 v2:172.21.15.146:6800/3820039304 22 ==== osd_op_reply(104 notify.3 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0d402d070 con 0x7ff0dc03f060 2024-09-18T01:45:28.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.591+0000 7fef98fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:28.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.591+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94683397371296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d32483510 con 0x561d32434de0 2024-09-18T01:45:28.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.592+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.1 v2:172.21.15.146:6808/3930274777 34 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94683397371296] v31'144 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff0d8051070 con 0x561d32434de0 2024-09-18T01:45:28.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.592+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94683397355984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d32483510 con 0x7ff0dc03f060 2024-09-18T01:45:28.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.593+0000 7ff0e2134640 1 -- 172.21.15.146:0/2737196285 <== osd.2 v2:172.21.15.146:6800/3820039304 23 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94683397355984] v31'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0d402d070 con 0x7ff0dc03f060 2024-09-18T01:45:28.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.593+0000 7ff0e4640800 20 remove_watcher() i=0 2024-09-18T01:45:28.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.593+0000 7ff0e4640800 2 removed watcher, disabling cache 2024-09-18T01:45:28.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.593+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94683397361696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d32483510 con 0x561d32434de0 2024-09-18T01:45:28.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.594+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.1 v2:172.21.15.146:6808/3930274777 35 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94683397361696] v31'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0d8051070 con 0x561d32434de0 2024-09-18T01:45:28.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.594+0000 7ff0e4640800 20 remove_watcher() i=1 2024-09-18T01:45:28.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.594+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94683397362752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d32483510 con 0x561d3243b050 2024-09-18T01:45:28.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.595+0000 7ff0e2935640 1 -- 172.21.15.146:0/2737196285 <== osd.3 v2:172.21.15.146:6809/4106661138 30 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94683397362752] v31'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0dc03c030 con 0x561d3243b050 2024-09-18T01:45:28.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.596+0000 7ff0e4640800 20 remove_watcher() i=2 2024-09-18T01:45:28.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.596+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94683397369024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d32483510 con 0x7ff0dc03f060 2024-09-18T01:45:28.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.596+0000 7ff0e2134640 1 -- 172.21.15.146:0/2737196285 <== osd.2 v2:172.21.15.146:6800/3820039304 24 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94683397369024] v31'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0d402d070 con 0x7ff0dc03f060 2024-09-18T01:45:28.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.596+0000 7ff0e4640800 20 remove_watcher() i=3 2024-09-18T01:45:28.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.596+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94683397367456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d32483510 con 0x561d32434de0 2024-09-18T01:45:28.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.597+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.1 v2:172.21.15.146:6808/3930274777 36 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94683397367456] v31'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0d8051070 con 0x561d32434de0 2024-09-18T01:45:28.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.597+0000 7ff0e4640800 20 remove_watcher() i=4 2024-09-18T01:45:28.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.597+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94683397377568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d32483510 con 0x7ff0d4018810 2024-09-18T01:45:28.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.598+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.0 v2:172.21.15.129:6800/1759265424 27 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94683397377568] v31'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0d8051070 con 0x7ff0d4018810 2024-09-18T01:45:28.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.598+0000 7ff0e4640800 20 remove_watcher() i=5 2024-09-18T01:45:28.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.598+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94683397379872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d32483510 con 0x7ff0d4018810 2024-09-18T01:45:28.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.599+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.0 v2:172.21.15.129:6800/1759265424 28 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94683397379872] v31'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0d8051070 con 0x7ff0d4018810 2024-09-18T01:45:28.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.599+0000 7ff0e4640800 20 remove_watcher() i=6 2024-09-18T01:45:28.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.599+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94683397382544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561d32483510 con 0x7ff0d4018810 2024-09-18T01:45:28.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.600+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 <== osd.0 v2:172.21.15.129:6800/1759265424 29 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94683397382544] v31'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0d8051070 con 0x7ff0d4018810 2024-09-18T01:45:28.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.600+0000 7ff0e4640800 20 remove_watcher() i=7 2024-09-18T01:45:28.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.600+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7ff0d4018810 msgr2=0x7ff0d403f1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.600+0000 7ff0e4640800 1 --2- 172.21.15.146:0/2737196285 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7ff0d4018810 0x7ff0d403f1e0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.600+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x561d32434de0 msgr2=0x561d324372a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.600+0000 7ff0e4640800 1 --2- 172.21.15.146:0/2737196285 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x561d32434de0 0x561d324372a0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.600+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7ff0dc03f060 msgr2=0x7ff0dc023070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.600+0000 7ff0e4640800 1 --2- 172.21.15.146:0/2737196285 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7ff0dc03f060 0x7ff0dc023070 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.600+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x561d3243b050 msgr2=0x561d3243d440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.600+0000 7ff0e4640800 1 --2- 172.21.15.146:0/2737196285 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x561d3243b050 0x561d3243d440 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.600+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fefac036b90 msgr2=0x7fefac039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.600+0000 7ff0e4640800 1 --2- 172.21.15.146:0/2737196285 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fefac036b90 0x7fefac039050 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff0d400bc50 tx=0x7ff0d4033000 comp rx=0 tx=0).stop 2024-09-18T01:45:28.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.600+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561d32421c80 msgr2=0x561d32429140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.600+0000 7ff0e1933640 1 -- 172.21.15.146:0/2737196285 reap_dead start 2024-09-18T01:45:28.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.600+0000 7ff0e4640800 1 --2- 172.21.15.146:0/2737196285 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561d32421c80 0x561d32429140 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc04ca10 tx=0x7ff0dc04c820 comp rx=0 tx=0).stop 2024-09-18T01:45:28.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.601+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 shutdown_connections 2024-09-18T01:45:28.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.601+0000 7ff0e4640800 1 --2- 172.21.15.146:0/2737196285 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561d32421c80 0x561d32429140 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.601+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 >> 172.21.15.146:0/2737196285 conn(0x561d3241dfe0 msgr2=0x561d3241c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:28.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.601+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 shutdown_connections 2024-09-18T01:45:28.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.601+0000 7ff0e4640800 1 -- 172.21.15.146:0/2737196285 wait complete. 2024-09-18T01:45:28.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.601+0000 7ff0e4640800 1 -- 172.21.15.146:0/2562184096 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fefbc036b90 msgr2=0x7fefbc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.601+0000 7ff0e4640800 1 --2- 172.21.15.146:0/2562184096 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fefbc036b90 0x7fefbc039050 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x561d32402b90 tx=0x7ff0d404b640 comp rx=0 tx=0).stop 2024-09-18T01:45:28.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.601+0000 7ff0e4640800 1 -- 172.21.15.146:0/2562184096 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561d32415030 msgr2=0x561d32415450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.601+0000 7ff0e4640800 1 --2- 172.21.15.146:0/2562184096 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561d32415030 0x561d32415450 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x561d32401c90 tx=0x7ff0dc0178e0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.601+0000 7ff0e4640800 1 -- 172.21.15.146:0/2562184096 shutdown_connections 2024-09-18T01:45:28.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.601+0000 7ff0e4640800 1 --2- 172.21.15.146:0/2562184096 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fefbc036b90 0x7fefbc039050 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.601+0000 7ff0e4640800 1 --2- 172.21.15.146:0/2562184096 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561d32415030 0x561d32415450 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.601+0000 7ff0e4640800 1 -- 172.21.15.146:0/2562184096 >> 172.21.15.146:0/2562184096 conn(0x561d32409fc0 msgr2=0x561d3240cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:28.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.601+0000 7ff0e4640800 1 -- 172.21.15.146:0/2562184096 shutdown_connections 2024-09-18T01:45:28.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.601+0000 7ff0e4640800 1 -- 172.21.15.146:0/2562184096 wait complete. 2024-09-18T01:45:28.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.601+0000 7ff0e4640800 1 -- 172.21.15.146:0/3315152383 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x561d32307d20 msgr2=0x561d32401310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.601+0000 7ff0e4640800 1 --2- 172.21.15.146:0/3315152383 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x561d32307d20 0x561d32401310 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.601+0000 7ff0e4640800 1 -- 172.21.15.146:0/3315152383 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x561d32403290 msgr2=0x561d32406af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.601+0000 7ff0e4640800 1 --2- 172.21.15.146:0/3315152383 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x561d32403290 0x561d32406af0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.601+0000 7ff0e4640800 1 -- 172.21.15.146:0/3315152383 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fefc8036b90 msgr2=0x7fefc8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.601+0000 7ff0e4640800 1 --2- 172.21.15.146:0/3315152383 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fefc8036b90 0x7fefc8039050 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8057000 tx=0x7ff0d8052000 comp rx=0 tx=0).stop 2024-09-18T01:45:28.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.601+0000 7ff0e4640800 1 -- 172.21.15.146:0/3315152383 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561d32275630 msgr2=0x561d323fa2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.601+0000 7ff0e4640800 1 --2- 172.21.15.146:0/3315152383 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561d32275630 0x561d323fa2a0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x561d323f3680 tx=0x7ff0d4000ed0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.602+0000 7ff0e4640800 1 -- 172.21.15.146:0/3315152383 shutdown_connections 2024-09-18T01:45:28.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.602+0000 7ff0e4640800 1 --2- 172.21.15.146:0/3315152383 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x561d32403290 0x561d32406af0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.602+0000 7ff0e4640800 1 --2- 172.21.15.146:0/3315152383 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x561d32307d20 0x561d32401310 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.602+0000 7ff0e4640800 1 --2- 172.21.15.146:0/3315152383 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fefc8036b90 0x7fefc8039050 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.602+0000 7ff0e4640800 1 --2- 172.21.15.146:0/3315152383 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561d32275630 0x561d323fa2a0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.602+0000 7ff0e4640800 1 -- 172.21.15.146:0/3315152383 >> 172.21.15.146:0/3315152383 conn(0x561d322fbdb0 msgr2=0x561d323ecb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:28.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.602+0000 7ff0e4640800 1 -- 172.21.15.146:0/3315152383 shutdown_connections 2024-09-18T01:45:28.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.602+0000 7ff0e4640800 1 -- 172.21.15.146:0/3315152383 wait complete. 2024-09-18T01:45:28.617 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-18T01:45:28.620 INFO:tasks.radosgw_admin:RL: get_obj myfoo foo bytes_out=0 bytes_in=4 failed=False 2024-09-18T01:45:28.622 INFO:tasks.radosgw_admin:RL: list_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T01:45:28.623 INFO:tasks.util.rgw:rgwadmin: client.0 : ['object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-18T01:45:28.623 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-18T01:45:28.623 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph object rm --bucket myfoo --object four 2024-09-18T01:45:28.669 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:28.669 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:28.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.669+0000 7f2b20128800 1 Processor -- start 2024-09-18T01:45:28.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.669+0000 7f2b20128800 1 -- start start 2024-09-18T01:45:28.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.669+0000 7f2b20128800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x5614b334ba20 0x5614b334de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.669+0000 7f2b20128800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5614b3206b30 con 0x5614b3345940 2024-09-18T01:45:28.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.669+0000 7f2b20128800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x5614b31e8360 con 0x5614b334ba20 2024-09-18T01:45:28.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.670+0000 7f2b1b6b2640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x5614b334ba20 0x5614b334de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.670+0000 7f2b1beb3640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x5614b3345940 0x5614b3345d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:47372/0 (socket says 172.21.15.146:47372) 2024-09-18T01:45:28.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.670+0000 7f2b1beb3640 1 -- 172.21.15.146:0/382619145 learned_addr learned my addr 172.21.15.146:0/382619145 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:45:28.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.670+0000 7f2b1b6b2640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x5614b334ba20 0x5614b334de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:58074/0 (socket says 172.21.15.146:58074) 2024-09-18T01:45:28.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.670+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/382619145 >> v1:172.21.15.129:6789/0 conn(0x5614b3345940 legacy=0x5614b3345d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.670+0000 7f2b1aeb1640 1 -- 172.21.15.146:0/382619145 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4290752727 0 0) 0x5614b3206b30 con 0x5614b3345940 2024-09-18T01:45:28.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.670+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/382619145 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614b320ee00 con 0x5614b334ba20 2024-09-18T01:45:28.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.672+0000 7f2b1b6b2640 1 --2- 172.21.15.146:0/382619145 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5614b334ba20 0x5614b334de10 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f2b0400a470 tx=0x7f2b04045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8538efb925234aac server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.672+0000 7f2b1aeb1640 1 -- 172.21.15.146:0/382619145 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b04053570 con 0x5614b334ba20 2024-09-18T01:45:28.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.672+0000 7f2b1aeb1640 1 -- 172.21.15.146:0/382619145 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b04058070 con 0x5614b334ba20 2024-09-18T01:45:28.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.672+0000 7f2b1aeb1640 1 -- 172.21.15.146:0/382619145 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b04053880 con 0x5614b334ba20 2024-09-18T01:45:28.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.673+0000 7f2b20128800 1 -- 172.21.15.146:0/382619145 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5614b334ba20 msgr2=0x5614b334de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.673+0000 7f2b20128800 1 --2- 172.21.15.146:0/382619145 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5614b334ba20 0x5614b334de10 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f2b0400a470 tx=0x7f2b04045a20 comp rx=0 tx=0).stop 2024-09-18T01:45:28.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.673+0000 7f2b20128800 1 -- 172.21.15.146:0/382619145 shutdown_connections 2024-09-18T01:45:28.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.673+0000 7f2b20128800 1 --2- 172.21.15.146:0/382619145 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5614b334ba20 0x5614b334de10 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.673+0000 7f2b20128800 1 -- 172.21.15.146:0/382619145 >> 172.21.15.146:0/382619145 conn(0x5614b3341550 msgr2=0x5614b3343970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:28.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.673+0000 7f2b20128800 1 -- 172.21.15.146:0/382619145 shutdown_connections 2024-09-18T01:45:28.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.673+0000 7f2b20128800 1 -- 172.21.15.146:0/382619145 wait complete. 2024-09-18T01:45:28.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.686+0000 7f2b20128800 1 Processor -- start 2024-09-18T01:45:28.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.687+0000 7f2b20128800 1 -- start start 2024-09-18T01:45:28.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.687+0000 7f2b20128800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5614b3345940 0x5614b3348300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.687+0000 7f2b20128800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5614b3293360 con 0x5614b3345940 2024-09-18T01:45:28.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.687+0000 7f2b1beb3640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5614b3345940 0x5614b3348300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.687+0000 7f2b1beb3640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5614b3345940 0x5614b3348300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:58088/0 (socket says 172.21.15.146:58088) 2024-09-18T01:45:28.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.687+0000 7f2b1beb3640 1 -- 172.21.15.146:0/1245772048 learned_addr learned my addr 172.21.15.146:0/1245772048 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:28.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.687+0000 7f2b1beb3640 1 -- 172.21.15.146:0/1245772048 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614b31e0bc0 con 0x5614b3345940 2024-09-18T01:45:28.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.688+0000 7f2b1beb3640 1 --2- 172.21.15.146:0/1245772048 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5614b3345940 0x5614b3348300 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c001660 tx=0x7f2b0c001b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a218f88c226a2fee server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.688+0000 7f2a09e0b640 1 -- 172.21.15.146:0/1245772048 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b0c003450 con 0x5614b3345940 2024-09-18T01:45:28.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.688+0000 7f2a09e0b640 1 -- 172.21.15.146:0/1245772048 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b0c003610 con 0x5614b3345940 2024-09-18T01:45:28.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.688+0000 7f2a09e0b640 1 -- 172.21.15.146:0/1245772048 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b0c0039b0 con 0x5614b3345940 2024-09-18T01:45:28.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.688+0000 7f2b20128800 1 -- 172.21.15.146:0/1245772048 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5614b3345940 msgr2=0x5614b3348300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.688+0000 7f2b20128800 1 --2- 172.21.15.146:0/1245772048 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5614b3345940 0x5614b3348300 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c001660 tx=0x7f2b0c001b20 comp rx=0 tx=0).stop 2024-09-18T01:45:28.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.688+0000 7f2b20128800 1 -- 172.21.15.146:0/1245772048 shutdown_connections 2024-09-18T01:45:28.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.688+0000 7f2b20128800 1 --2- 172.21.15.146:0/1245772048 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5614b3345940 0x5614b3348300 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.688+0000 7f2b20128800 1 -- 172.21.15.146:0/1245772048 >> 172.21.15.146:0/1245772048 conn(0x5614b3341550 msgr2=0x5614b3432050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:28.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.689+0000 7f2b20128800 1 -- 172.21.15.146:0/1245772048 shutdown_connections 2024-09-18T01:45:28.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.689+0000 7f2b20128800 1 -- 172.21.15.146:0/1245772048 wait complete. 2024-09-18T01:45:28.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.689+0000 7f2b20128800 1 Processor -- start 2024-09-18T01:45:28.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.689+0000 7f2b20128800 1 -- start start 2024-09-18T01:45:28.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.689+0000 7f2b20128800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5614b3345940 0x5614b3440270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.689+0000 7f2b20128800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5614b334e650 con 0x5614b3345940 2024-09-18T01:45:28.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.689+0000 7f2b1beb3640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5614b3345940 0x5614b3440270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.689+0000 7f2b1beb3640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5614b3345940 0x5614b3440270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:58094/0 (socket says 172.21.15.146:58094) 2024-09-18T01:45:28.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.689+0000 7f2b1beb3640 1 -- 172.21.15.146:0/1846746954 learned_addr learned my addr 172.21.15.146:0/1846746954 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:28.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.690+0000 7f2b1beb3640 1 -- 172.21.15.146:0/1846746954 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614b31f4fe0 con 0x5614b3345940 2024-09-18T01:45:28.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.690+0000 7f2b1beb3640 1 --2- 172.21.15.146:0/1846746954 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5614b3345940 0x5614b3440270 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x5614b3347a00 tx=0x7f2b0c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.690+0000 7f2a03fff640 1 -- 172.21.15.146:0/1846746954 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b0c025070 con 0x5614b3345940 2024-09-18T01:45:28.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.690+0000 7f2a03fff640 1 -- 172.21.15.146:0/1846746954 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b0c019040 con 0x5614b3345940 2024-09-18T01:45:28.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.690+0000 7f2b20128800 1 -- 172.21.15.146:0/1846746954 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5614b34407b0 con 0x5614b3345940 2024-09-18T01:45:28.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.690+0000 7f2a03fff640 1 -- 172.21.15.146:0/1846746954 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b0c013950 con 0x5614b3345940 2024-09-18T01:45:28.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.690+0000 7f2b20128800 1 -- 172.21.15.146:0/1846746954 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614b3440d30 con 0x5614b3345940 2024-09-18T01:45:28.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.691+0000 7f2a03fff640 1 -- 172.21.15.146:0/1846746954 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2b0c010070 con 0x5614b3345940 2024-09-18T01:45:28.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.691+0000 7f2a03fff640 1 --2- 172.21.15.146:0/1846746954 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2a04036b90 0x7f2a04039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.691+0000 7f2a03fff640 1 -- 172.21.15.146:0/1846746954 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f2b0c04c0b0 con 0x5614b3345940 2024-09-18T01:45:28.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.691+0000 7f2b1b6b2640 1 --2- 172.21.15.146:0/1846746954 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2a04036b90 0x7f2a04039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.691+0000 7f2b20128800 1 --2- 172.21.15.146:0/1846746954 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5614b334ba20 0x5614b34472e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.691+0000 7f2b20128800 1 -- 172.21.15.146:0/1846746954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614b3447870 con 0x5614b334ba20 2024-09-18T01:45:28.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.691+0000 7f2b1c6b4640 1 --2- 172.21.15.146:0/1846746954 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5614b334ba20 0x5614b34472e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.691+0000 7f2b1b6b2640 1 --2- 172.21.15.146:0/1846746954 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2a04036b90 0x7f2a04039050 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2b04057000 tx=0x7f2b04052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.692+0000 7f2b1c6b4640 1 --2- 172.21.15.146:0/1846746954 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5614b334ba20 0x5614b34472e0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.692+0000 7f2b1c6b4640 1 -- 172.21.15.146:0/1846746954 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2b140083e0 con 0x5614b334ba20 2024-09-18T01:45:28.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.692+0000 7f2b20128800 1 -- 172.21.15.146:0/1846746954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614b3444890 con 0x5614b334ba20 2024-09-18T01:45:28.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.692+0000 7f2b1c6b4640 1 -- 172.21.15.146:0/1846746954 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2b140083e0 con 0x5614b334ba20 2024-09-18T01:45:28.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.692+0000 7f2b20128800 1 -- 172.21.15.146:0/1846746954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614b3449670 con 0x5614b334ba20 2024-09-18T01:45:28.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.692+0000 7f2b1c6b4640 1 -- 172.21.15.146:0/1846746954 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2b140083e0 con 0x5614b334ba20 2024-09-18T01:45:28.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.692+0000 7f2b20128800 1 -- 172.21.15.146:0/1846746954 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614b34488a0 con 0x5614b334ba20 2024-09-18T01:45:28.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.693+0000 7f2b1c6b4640 1 -- 172.21.15.146:0/1846746954 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2b140083e0 con 0x5614b334ba20 2024-09-18T01:45:28.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.693+0000 7f2b20128800 1 --2- 172.21.15.146:0/1846746954 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5614b344aa20 0x5614b344ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.693+0000 7f2b20128800 1 -- 172.21.15.146:0/1846746954 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614b344d350 con 0x5614b344aa20 2024-09-18T01:45:28.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.693+0000 7f2b1beb3640 1 --2- 172.21.15.146:0/1846746954 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5614b344aa20 0x5614b344ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.693+0000 7f2b1beb3640 1 --2- 172.21.15.146:0/1846746954 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5614b344aa20 0x5614b344ce10 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.693+0000 7f2b1beb3640 1 -- 172.21.15.146:0/1846746954 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2b0c00f030 con 0x5614b344aa20 2024-09-18T01:45:28.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.694+0000 7f2b20128800 1 Processor -- start 2024-09-18T01:45:28.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.694+0000 7f2b20128800 1 -- start start 2024-09-18T01:45:28.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.694+0000 7f2b20128800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5614b345b000 0x5614b345b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.694+0000 7f2b20128800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5614b31e2580 con 0x5614b345b000 2024-09-18T01:45:28.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.694+0000 7f2b1c6b4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5614b345b000 0x5614b345b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.694+0000 7f2b1c6b4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5614b345b000 0x5614b345b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:58106/0 (socket says 172.21.15.146:58106) 2024-09-18T01:45:28.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.694+0000 7f2b1c6b4640 1 -- 172.21.15.146:0/1312953671 learned_addr learned my addr 172.21.15.146:0/1312953671 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:28.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.695+0000 7f2b1c6b4640 1 -- 172.21.15.146:0/1312953671 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614b345b960 con 0x5614b345b000 2024-09-18T01:45:28.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.695+0000 7f2b1c6b4640 1 --2- 172.21.15.146:0/1312953671 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5614b345b000 0x5614b345b420 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x5614b3441320 tx=0x7f2b1400ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.695+0000 7f2a017fa640 1 -- 172.21.15.146:0/1312953671 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b1401c070 con 0x5614b345b000 2024-09-18T01:45:28.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.695+0000 7f2a017fa640 1 -- 172.21.15.146:0/1312953671 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b14018410 con 0x5614b345b000 2024-09-18T01:45:28.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.695+0000 7f2b20128800 1 -- 172.21.15.146:0/1312953671 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5614b345bbf0 con 0x5614b345b000 2024-09-18T01:45:28.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.695+0000 7f2a017fa640 1 -- 172.21.15.146:0/1312953671 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b14018730 con 0x5614b345b000 2024-09-18T01:45:28.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.695+0000 7f2b20128800 1 -- 172.21.15.146:0/1312953671 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614b345e8d0 con 0x5614b345b000 2024-09-18T01:45:28.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.696+0000 7f2a017fa640 1 -- 172.21.15.146:0/1312953671 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2b1401f070 con 0x5614b345b000 2024-09-18T01:45:28.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.696+0000 7f2a017fa640 1 --2- 172.21.15.146:0/1312953671 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f29f4036b40 0x7f29f4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.696+0000 7f2a017fa640 1 -- 172.21.15.146:0/1312953671 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f2b1404e5e0 con 0x5614b345b000 2024-09-18T01:45:28.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.696+0000 7f2b1beb3640 1 --2- 172.21.15.146:0/1312953671 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f29f4036b40 0x7f29f4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.696+0000 7f2b20128800 1 Processor -- start 2024-09-18T01:45:28.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.696+0000 7f2b20128800 1 -- start start 2024-09-18T01:45:28.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.696+0000 7f2b1beb3640 1 --2- 172.21.15.146:0/1312953671 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f29f4036b40 0x7f29f4039000 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c04a500 tx=0x7f2b0c003450 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.697+0000 7f2b20128800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5614b3467d10 0x5614b3468110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.697+0000 7f2b20128800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5614b3346970 con 0x5614b3467d10 2024-09-18T01:45:28.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.697+0000 7f2b1c6b4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5614b3467d10 0x5614b3468110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.697+0000 7f2b1c6b4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5614b3467d10 0x5614b3468110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:58112/0 (socket says 172.21.15.146:58112) 2024-09-18T01:45:28.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.697+0000 7f2b1c6b4640 1 -- 172.21.15.146:0/2869662404 learned_addr learned my addr 172.21.15.146:0/2869662404 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:28.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.697+0000 7f2b1c6b4640 1 -- 172.21.15.146:0/2869662404 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614b34686e0 con 0x5614b3467d10 2024-09-18T01:45:28.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.697+0000 7f2b1c6b4640 1 --2- 172.21.15.146:0/2869662404 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5614b3467d10 0x5614b3468110 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f2b1404c970 tx=0x7f2b14014450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=479401526d76e95e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.697+0000 7f29faffd640 1 -- 172.21.15.146:0/2869662404 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b14045070 con 0x5614b3467d10 2024-09-18T01:45:28.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.697+0000 7f29faffd640 1 -- 172.21.15.146:0/2869662404 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b14017720 con 0x5614b3467d10 2024-09-18T01:45:28.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.697+0000 7f29faffd640 1 -- 172.21.15.146:0/2869662404 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b14029c20 con 0x5614b3467d10 2024-09-18T01:45:28.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.698+0000 7f2b20128800 1 -- 172.21.15.146:0/2869662404 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5614b3467d10 msgr2=0x5614b3468110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.698+0000 7f2b20128800 1 --2- 172.21.15.146:0/2869662404 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5614b3467d10 0x5614b3468110 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f2b1404c970 tx=0x7f2b14014450 comp rx=0 tx=0).stop 2024-09-18T01:45:28.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.698+0000 7f2b20128800 1 -- 172.21.15.146:0/2869662404 shutdown_connections 2024-09-18T01:45:28.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.698+0000 7f2b20128800 1 --2- 172.21.15.146:0/2869662404 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5614b3467d10 0x5614b3468110 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.698+0000 7f2b20128800 1 -- 172.21.15.146:0/2869662404 >> 172.21.15.146:0/2869662404 conn(0x5614b3464070 msgr2=0x5614b3462170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:28.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.698+0000 7f2b20128800 1 -- 172.21.15.146:0/2869662404 shutdown_connections 2024-09-18T01:45:28.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.698+0000 7f2b20128800 1 -- 172.21.15.146:0/2869662404 wait complete. 2024-09-18T01:45:28.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.698+0000 7f2b20128800 1 Processor -- start 2024-09-18T01:45:28.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.698+0000 7f2b20128800 1 -- start start 2024-09-18T01:45:28.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.698+0000 7f2b20128800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5614b3467d10 0x5614b346f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.698+0000 7f2b20128800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5614b3468d50 con 0x5614b3467d10 2024-09-18T01:45:28.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.698+0000 7f2b1c6b4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5614b3467d10 0x5614b346f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.699+0000 7f2b1c6b4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5614b3467d10 0x5614b346f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:58126/0 (socket says 172.21.15.146:58126) 2024-09-18T01:45:28.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.699+0000 7f2b1c6b4640 1 -- 172.21.15.146:0/1786194608 learned_addr learned my addr 172.21.15.146:0/1786194608 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:28.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.699+0000 7f2b1c6b4640 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614b346f6d0 con 0x5614b3467d10 2024-09-18T01:45:28.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.699+0000 7f2b1c6b4640 1 --2- 172.21.15.146:0/1786194608 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5614b3467d10 0x5614b346f190 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f2b1404b840 tx=0x7f2b1404c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.699+0000 7f29f97fa640 1 -- 172.21.15.146:0/1786194608 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b14045040 con 0x5614b3467d10 2024-09-18T01:45:28.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.699+0000 7f29f97fa640 1 -- 172.21.15.146:0/1786194608 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b1404b250 con 0x5614b3467d10 2024-09-18T01:45:28.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.699+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5614b346f960 con 0x5614b3467d10 2024-09-18T01:45:28.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.699+0000 7f29f97fa640 1 -- 172.21.15.146:0/1786194608 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b1404b530 con 0x5614b3467d10 2024-09-18T01:45:28.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.699+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614b3472610 con 0x5614b3467d10 2024-09-18T01:45:28.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.700+0000 7f29f97fa640 1 -- 172.21.15.146:0/1786194608 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2b1403c060 con 0x5614b3467d10 2024-09-18T01:45:28.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.700+0000 7f29f97fa640 1 --2- 172.21.15.146:0/1786194608 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f29e4036b90 0x7f29e4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.700+0000 7f29f97fa640 1 -- 172.21.15.146:0/1786194608 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f2b14036c30 con 0x5614b3467d10 2024-09-18T01:45:28.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.700+0000 7f2b1beb3640 1 --2- 172.21.15.146:0/1786194608 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f29e4036b90 0x7f29e4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.700+0000 7f2b1beb3640 1 --2- 172.21.15.146:0/1786194608 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f29e4036b90 0x7f29e4039050 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c00d010 tx=0x7f2b0c040000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.701+0000 7f2b20128800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.701+0000 7f2b20128800 1 --2- 172.21.15.146:0/1786194608 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5614b347ad30 0x5614b347d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.701+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614b347d940 con 0x5614b347ad30 2024-09-18T01:45:28.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.701+0000 7f2b1b6b2640 1 --2- 172.21.15.146:0/1786194608 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5614b347ad30 0x5614b347d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.701+0000 7f2b1b6b2640 1 --2- 172.21.15.146:0/1786194608 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5614b347ad30 0x5614b347d1f0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.701+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2b04051070 con 0x5614b347ad30 2024-09-18T01:45:28.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.701+0000 7f2b20128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:28.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.701+0000 7f2b20128800 20 realm 2024-09-18T01:45:28.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.701+0000 7f2b20128800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.701+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614b347dd70 con 0x5614b347ad30 2024-09-18T01:45:28.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.702+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2b04051070 con 0x5614b347ad30 2024-09-18T01:45:28.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.702+0000 7f2b20128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:28.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.702+0000 7f2b20128800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:28.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.702+0000 7f2b20128800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.702+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614b347e640 con 0x5614b347ad30 2024-09-18T01:45:28.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.702+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2b04051070 con 0x5614b347ad30 2024-09-18T01:45:28.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.702+0000 7f2b20128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:28.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.702+0000 7f2b20128800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.702+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614b347e9e0 con 0x5614b347ad30 2024-09-18T01:45:28.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.702+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2b04051070 con 0x5614b347ad30 2024-09-18T01:45:28.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.702+0000 7f2b20128800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:28.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.702+0000 7f2b20128800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.702+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614b347f230 con 0x5614b347ad30 2024-09-18T01:45:28.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.702+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2b04051070 con 0x5614b347ad30 2024-09-18T01:45:28.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.702+0000 7f2b20128800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:28.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.702+0000 7f2b20128800 20 searching for the correct realm 2024-09-18T01:45:28.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.702+0000 7f2b20128800 1 --2- 172.21.15.146:0/1786194608 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5614b3480fa0 0x5614b3483390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.702+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5614b34839c0 con 0x5614b3480fa0 2024-09-18T01:45:28.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.702+0000 7f2b1c6b4640 1 --2- 172.21.15.146:0/1786194608 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5614b3480fa0 0x5614b3483390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.703+0000 7f2b1c6b4640 1 --2- 172.21.15.146:0/1786194608 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5614b3480fa0 0x5614b3483390 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.703+0000 7f2b1c6b4640 1 -- 172.21.15.146:0/1786194608 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b14028070 con 0x5614b3480fa0 2024-09-18T01:45:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.703+0000 7f2b1c6b4640 1 --2- 172.21.15.146:0/1786194608 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f2b1403e070 0x7f2b1404f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.703+0000 7f2b1c6b4640 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5614b34839c0 con 0x7f2b1403e070 2024-09-18T01:45:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.703+0000 7f2b1beb3640 1 --2- 172.21.15.146:0/1786194608 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f2b1403e070 0x7f2b1404f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.703+0000 7f2b1beb3640 1 --2- 172.21.15.146:0/1786194608 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f2b1403e070 0x7f2b1404f910 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.704+0000 7f2b1beb3640 1 -- 172.21.15.146:0/1786194608 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b0c03d070 con 0x7f2b1403e070 2024-09-18T01:45:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.704+0000 7f2b1beb3640 1 --2- 172.21.15.146:0/1786194608 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f2b0c04f040 0x7f2b0c0123c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.704+0000 7f2b1beb3640 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5614b34839c0 con 0x7f2b0c04f040 2024-09-18T01:45:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.704+0000 7f2b1b6b2640 1 --2- 172.21.15.146:0/1786194608 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f2b0c04f040 0x7f2b0c0123c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.704+0000 7f2b1b6b2640 1 --2- 172.21.15.146:0/1786194608 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f2b0c04f040 0x7f2b0c0123c0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.704+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b04051070 con 0x7f2b0c04f040 2024-09-18T01:45:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.704+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5614b34839c0 con 0x5614b347ad30 2024-09-18T01:45:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.705+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2b04051070 con 0x5614b347ad30 2024-09-18T01:45:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.705+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5614b34839c0 con 0x5614b347ad30 2024-09-18T01:45:28.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.705+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b04051070 con 0x5614b347ad30 2024-09-18T01:45:28.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.705+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5614b34839c0 con 0x7f2b0c04f040 2024-09-18T01:45:28.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.705+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b04051070 con 0x7f2b0c04f040 2024-09-18T01:45:28.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.705+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5614b34839c0 con 0x7f2b0c04f040 2024-09-18T01:45:28.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.705+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b04051070 con 0x7f2b0c04f040 2024-09-18T01:45:28.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.705+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5614b34839c0 con 0x7f2b1403e070 2024-09-18T01:45:28.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.706+0000 7f2b1beb3640 1 -- 172.21.15.146:0/1786194608 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b0c03d070 con 0x7f2b1403e070 2024-09-18T01:45:28.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.706+0000 7f2b1beb3640 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5614b34839c0 con 0x5614b3480fa0 2024-09-18T01:45:28.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.706+0000 7f2b1c6b4640 1 -- 172.21.15.146:0/1786194608 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b14028070 con 0x5614b3480fa0 2024-09-18T01:45:28.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.706+0000 7f2b1c6b4640 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5614b34839c0 con 0x5614b347ad30 2024-09-18T01:45:28.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.706+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b04051070 con 0x5614b347ad30 2024-09-18T01:45:28.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.706+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5614b34839c0 con 0x7f2b0c04f040 2024-09-18T01:45:28.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.707+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b04051070 con 0x7f2b0c04f040 2024-09-18T01:45:28.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.707+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5614b34839c0 con 0x5614b347ad30 2024-09-18T01:45:28.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.707+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b04051070 con 0x5614b347ad30 2024-09-18T01:45:28.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.707+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5614b34839c0 con 0x7f2b1403e070 2024-09-18T01:45:28.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.707+0000 7f2b1beb3640 1 -- 172.21.15.146:0/1786194608 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f2b0c03d070 con 0x7f2b1403e070 2024-09-18T01:45:28.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.707+0000 7f2b1beb3640 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5614b34839c0 con 0x5614b3480fa0 2024-09-18T01:45:28.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.707+0000 7f2b1c6b4640 1 -- 172.21.15.146:0/1786194608 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b14028070 con 0x5614b3480fa0 2024-09-18T01:45:28.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.707+0000 7f2b1c6b4640 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5614b34839c0 con 0x5614b3480fa0 2024-09-18T01:45:28.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.707+0000 7f2b1c6b4640 1 -- 172.21.15.146:0/1786194608 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b14028070 con 0x5614b3480fa0 2024-09-18T01:45:28.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.707+0000 7f2b1c6b4640 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f2b1405c040 con 0x7f2b0c04f040 2024-09-18T01:45:28.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.708+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b04051070 con 0x7f2b0c04f040 2024-09-18T01:45:28.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.708+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f2b1405c040 con 0x5614b3480fa0 2024-09-18T01:45:28.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.708+0000 7f2b1c6b4640 1 -- 172.21.15.146:0/1786194608 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b14028070 con 0x5614b3480fa0 2024-09-18T01:45:28.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.708+0000 7f2b1c6b4640 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f2b1405c040 con 0x5614b3480fa0 2024-09-18T01:45:28.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.708+0000 7f2b1c6b4640 1 -- 172.21.15.146:0/1786194608 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b14028070 con 0x5614b3480fa0 2024-09-18T01:45:28.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.708+0000 7f2b1c6b4640 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f2b1405c040 con 0x5614b347ad30 2024-09-18T01:45:28.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.708+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b04051070 con 0x5614b347ad30 2024-09-18T01:45:28.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.708+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f2b1405c040 con 0x5614b347ad30 2024-09-18T01:45:28.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.708+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2b04051070 con 0x5614b347ad30 2024-09-18T01:45:28.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.708+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f2b1405c040 con 0x7f2b0c04f040 2024-09-18T01:45:28.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.709+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b04051070 con 0x7f2b0c04f040 2024-09-18T01:45:28.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.709+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f2b1405c040 con 0x5614b3480fa0 2024-09-18T01:45:28.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.709+0000 7f2b1c6b4640 1 -- 172.21.15.146:0/1786194608 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b14028070 con 0x5614b3480fa0 2024-09-18T01:45:28.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.709+0000 7f2b1c6b4640 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f2b1405c040 con 0x7f2b1403e070 2024-09-18T01:45:28.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.709+0000 7f2b1beb3640 1 -- 172.21.15.146:0/1786194608 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b0c03d070 con 0x7f2b1403e070 2024-09-18T01:45:28.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.709+0000 7f2b1beb3640 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f2b1405c040 con 0x5614b347ad30 2024-09-18T01:45:28.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.709+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b04051070 con 0x5614b347ad30 2024-09-18T01:45:28.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.709+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f2b1405c040 con 0x7f2b0c04f040 2024-09-18T01:45:28.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.710+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b04051070 con 0x7f2b0c04f040 2024-09-18T01:45:28.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.710+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f2b1405c040 con 0x5614b3480fa0 2024-09-18T01:45:28.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.710+0000 7f2b1c6b4640 1 -- 172.21.15.146:0/1786194608 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b14028070 con 0x5614b3480fa0 2024-09-18T01:45:28.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.710+0000 7f2b1c6b4640 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f2b1405c040 con 0x7f2b0c04f040 2024-09-18T01:45:28.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.710+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b04051070 con 0x7f2b0c04f040 2024-09-18T01:45:28.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.710+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f2b1405c040 con 0x7f2b1403e070 2024-09-18T01:45:28.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.710+0000 7f2b1beb3640 1 -- 172.21.15.146:0/1786194608 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b0c03d070 con 0x7f2b1403e070 2024-09-18T01:45:28.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.710+0000 7f2b1beb3640 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f2b1405c040 con 0x5614b3480fa0 2024-09-18T01:45:28.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.711+0000 7f2b1c6b4640 1 -- 172.21.15.146:0/1786194608 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b14028070 con 0x5614b3480fa0 2024-09-18T01:45:28.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.711+0000 7f2b1c6b4640 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f2b1405c040 con 0x7f2b0c04f040 2024-09-18T01:45:28.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.711+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b04051070 con 0x7f2b0c04f040 2024-09-18T01:45:28.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.711+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f2b1405c040 con 0x5614b347ad30 2024-09-18T01:45:28.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.711+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2b04051070 con 0x5614b347ad30 2024-09-18T01:45:28.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.711+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f2b1405c040 con 0x7f2b1403e070 2024-09-18T01:45:28.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.712+0000 7f2b1beb3640 1 -- 172.21.15.146:0/1786194608 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b0c03d070 con 0x7f2b1403e070 2024-09-18T01:45:28.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.712+0000 7f2b20128800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:28.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.712+0000 7f2b20128800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:28.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.712+0000 7f2b20128800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:28.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.712+0000 7f2b20128800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:28.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.712+0000 7f2b20128800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:28.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.712+0000 7f2b20128800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:28.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.712+0000 7f2b20128800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.712+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614b347fbb0 con 0x5614b347ad30 2024-09-18T01:45:28.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.712+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2b04051070 con 0x5614b347ad30 2024-09-18T01:45:28.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.712+0000 7f2b20128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:28.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.712+0000 7f2b20128800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.712+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614b3480450 con 0x5614b347ad30 2024-09-18T01:45:28.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.712+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2b04051070 con 0x5614b347ad30 2024-09-18T01:45:28.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.712+0000 7f2b20128800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:28.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.712+0000 7f2b20128800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.712+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614b3483e40 con 0x7f2b1403e070 2024-09-18T01:45:28.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.712+0000 7f2b1beb3640 1 -- 172.21.15.146:0/1786194608 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2b0c03d070 con 0x7f2b1403e070 2024-09-18T01:45:28.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.712+0000 7f2b20128800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:28.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.712+0000 7f2b20128800 20 zone default found 2024-09-18T01:45:28.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.712+0000 7f2b20128800 4 Realm: () 2024-09-18T01:45:28.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.712+0000 7f2b20128800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:28.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.712+0000 7f2b20128800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:28.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.712+0000 7f2b20128800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:28.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.712+0000 7f2b20128800 20 zonegroup default 2024-09-18T01:45:28.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.712+0000 7f2b20128800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.712+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614b3484690 con 0x7f2b0c04f040 2024-09-18T01:45:28.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.713+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2b04051070 con 0x7f2b0c04f040 2024-09-18T01:45:28.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.713+0000 7f2b20128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:28.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.713+0000 7f2b20128800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.713+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614b3486070 con 0x5614b3480fa0 2024-09-18T01:45:28.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.713+0000 7f2b1c6b4640 1 -- 172.21.15.146:0/1786194608 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2b14028070 con 0x5614b3480fa0 2024-09-18T01:45:28.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.713+0000 7f2b20128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:28.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.713+0000 7f2b20128800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.713+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614b34864f0 con 0x5614b3480fa0 2024-09-18T01:45:28.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.713+0000 7f2b1c6b4640 1 -- 172.21.15.146:0/1786194608 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2b14028070 con 0x5614b3480fa0 2024-09-18T01:45:28.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.713+0000 7f2b20128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:28.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.713+0000 7f2b20128800 20 started sync module instance, tier type = 2024-09-18T01:45:28.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.713+0000 7f2b20128800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:28.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.713+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b34854b0 con 0x7f2b1403e070 2024-09-18T01:45:28.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.714+0000 7f2b1beb3640 1 -- 172.21.15.146:0/1786194608 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v31'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b0c03d070 con 0x7f2b1403e070 2024-09-18T01:45:28.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.714+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94646907195392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b3486950 con 0x7f2b1403e070 2024-09-18T01:45:28.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.714+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b34871a0 con 0x5614b347ad30 2024-09-18T01:45:28.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.715+0000 7f2b1beb3640 1 -- 172.21.15.146:0/1786194608 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94646907195392] v31'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b0c03d070 con 0x7f2b1403e070 2024-09-18T01:45:28.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.715+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v31'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b04051070 con 0x5614b347ad30 2024-09-18T01:45:28.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.715+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94646907202800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b34875c0 con 0x5614b347ad30 2024-09-18T01:45:28.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.715+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b3487f80 con 0x5614b3480fa0 2024-09-18T01:45:28.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.716+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94646907202800] v31'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b04051070 con 0x5614b347ad30 2024-09-18T01:45:28.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.717+0000 7f2b1c6b4640 1 -- 172.21.15.146:0/1786194608 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v31'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b14028070 con 0x5614b3480fa0 2024-09-18T01:45:28.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.717+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94646907204336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b3487f80 con 0x5614b3480fa0 2024-09-18T01:45:28.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.717+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b3488940 con 0x7f2b1403e070 2024-09-18T01:45:28.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.718+0000 7f2b1c6b4640 1 -- 172.21.15.146:0/1786194608 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94646907204336] v31'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b14028070 con 0x5614b3480fa0 2024-09-18T01:45:28.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.718+0000 7f2b1beb3640 1 -- 172.21.15.146:0/1786194608 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v31'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b0c03d070 con 0x7f2b1403e070 2024-09-18T01:45:28.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.718+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94646907206352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b3487ef0 con 0x7f2b1403e070 2024-09-18T01:45:28.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.718+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b3489800 con 0x5614b347ad30 2024-09-18T01:45:28.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.719+0000 7f2b1beb3640 1 -- 172.21.15.146:0/1786194608 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94646907206352] v31'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b0c03d070 con 0x7f2b1403e070 2024-09-18T01:45:28.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.719+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v31'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b04051070 con 0x5614b347ad30 2024-09-18T01:45:28.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.719+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94646907211056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b3489800 con 0x5614b347ad30 2024-09-18T01:45:28.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.719+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b348a210 con 0x7f2b0c04f040 2024-09-18T01:45:28.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.720+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v31'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b04051070 con 0x7f2b0c04f040 2024-09-18T01:45:28.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.720+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94646907215200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b348a180 con 0x7f2b0c04f040 2024-09-18T01:45:28.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.720+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b348b150 con 0x7f2b0c04f040 2024-09-18T01:45:28.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.720+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94646907211056] v31'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b04051070 con 0x5614b347ad30 2024-09-18T01:45:28.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.721+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94646907215200] v31'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b04051070 con 0x7f2b0c04f040 2024-09-18T01:45:28.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.721+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v31'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b04051070 con 0x7f2b0c04f040 2024-09-18T01:45:28.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.721+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94646907218976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b348b110 con 0x7f2b0c04f040 2024-09-18T01:45:28.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.721+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b348b9f0 con 0x7f2b0c04f040 2024-09-18T01:45:28.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.722+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94646907218976] v31'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b04051070 con 0x7f2b0c04f040 2024-09-18T01:45:28.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.722+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v31'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b04051070 con 0x7f2b0c04f040 2024-09-18T01:45:28.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.722+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94646907212624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b348b110 con 0x7f2b0c04f040 2024-09-18T01:45:28.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.722+0000 7f2b20128800 20 add_watcher() i=0 2024-09-18T01:45:28.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.722+0000 7f2b20128800 20 add_watcher() i=1 2024-09-18T01:45:28.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.722+0000 7f2b20128800 20 add_watcher() i=2 2024-09-18T01:45:28.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.722+0000 7f2b20128800 20 add_watcher() i=3 2024-09-18T01:45:28.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.722+0000 7f2b20128800 20 add_watcher() i=4 2024-09-18T01:45:28.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.722+0000 7f2b20128800 20 add_watcher() i=5 2024-09-18T01:45:28.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.722+0000 7f2b20128800 20 add_watcher() i=6 2024-09-18T01:45:28.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.723+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94646907212624] v31'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b04051070 con 0x7f2b0c04f040 2024-09-18T01:45:28.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.723+0000 7f2b20128800 20 add_watcher() i=7 2024-09-18T01:45:28.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.723+0000 7f2b20128800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:28.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.723+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614b348e9d0 con 0x5614b347ad30 2024-09-18T01:45:28.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.723+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2b04051070 con 0x5614b347ad30 2024-09-18T01:45:28.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.723+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94646907221200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b348beb0 con 0x5614b347ad30 2024-09-18T01:45:28.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.724+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94646907221200] v31'145 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2b04051070 con 0x5614b347ad30 2024-09-18T01:45:28.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.724+0000 7f29d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:28.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.724+0000 7f2b20128800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:28.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.724+0000 7f2b20128800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:28.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.724+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b3497450 con 0x5614b347ad30 2024-09-18T01:45:28.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.725+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'48 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2b04051070 con 0x5614b347ad30 2024-09-18T01:45:28.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.725+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b3497b00 con 0x7f2b0c04f040 2024-09-18T01:45:28.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.727+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2b04051070 con 0x7f2b0c04f040 2024-09-18T01:45:28.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.727+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b3497f60 con 0x5614b3480fa0 2024-09-18T01:45:28.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.727+0000 7f2b1c6b4640 1 -- 172.21.15.146:0/1786194608 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2b14028070 con 0x5614b3480fa0 2024-09-18T01:45:28.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.727+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b3497f70 con 0x5614b347ad30 2024-09-18T01:45:28.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.729+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'146 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2b04051070 con 0x5614b347ad30 2024-09-18T01:45:28.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.729+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b34984e0 con 0x7f2b1403e070 2024-09-18T01:45:28.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.729+0000 7f2b1beb3640 1 -- 172.21.15.146:0/1786194608 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'47 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2b0c03d070 con 0x7f2b1403e070 2024-09-18T01:45:28.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.729+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b3498a50 con 0x5614b3480fa0 2024-09-18T01:45:28.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.730+0000 7f2b1c6b4640 1 -- 172.21.15.146:0/1786194608 <== osd.3 v2:172.21.15.146:6809/4106661138 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'41 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2b14028070 con 0x5614b3480fa0 2024-09-18T01:45:28.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.730+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b3498a50 con 0x5614b347ad30 2024-09-18T01:45:28.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.731+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2b04051070 con 0x5614b347ad30 2024-09-18T01:45:28.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.732+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b3498a50 con 0x7f2b0c04f040 2024-09-18T01:45:28.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.733+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'33 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2b04051070 con 0x7f2b0c04f040 2024-09-18T01:45:28.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.733+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b3498ae0 con 0x7f2b1403e070 2024-09-18T01:45:28.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.734+0000 7f2b1beb3640 1 -- 172.21.15.146:0/1786194608 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2b0c03d070 con 0x7f2b1403e070 2024-09-18T01:45:28.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.734+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b3499070 con 0x5614b3480fa0 2024-09-18T01:45:28.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.735+0000 7f2b1c6b4640 1 -- 172.21.15.146:0/1786194608 <== osd.3 v2:172.21.15.146:6809/4106661138 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2b14028070 con 0x5614b3480fa0 2024-09-18T01:45:28.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.735+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b3499070 con 0x7f2b1403e070 2024-09-18T01:45:28.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.736+0000 7f2b1beb3640 1 -- 172.21.15.146:0/1786194608 <== osd.2 v2:172.21.15.146:6800/3820039304 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'48 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b0c03d070 con 0x7f2b1403e070 2024-09-18T01:45:28.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.736+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b3499070 con 0x7f2b0c04f040 2024-09-18T01:45:28.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.737+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'19 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b04051070 con 0x7f2b0c04f040 2024-09-18T01:45:28.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.737+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b3499070 con 0x7f2b1403e070 2024-09-18T01:45:28.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.738+0000 7f2b1beb3640 1 -- 172.21.15.146:0/1786194608 <== osd.2 v2:172.21.15.146:6800/3820039304 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b0c03d070 con 0x7f2b1403e070 2024-09-18T01:45:28.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.738+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b3499070 con 0x7f2b0c04f040 2024-09-18T01:45:28.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.739+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'45 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b04051070 con 0x7f2b0c04f040 2024-09-18T01:45:28.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.739+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b3499070 con 0x5614b347ad30 2024-09-18T01:45:28.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.740+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'147 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b04051070 con 0x5614b347ad30 2024-09-18T01:45:28.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.740+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b3499070 con 0x5614b3480fa0 2024-09-18T01:45:28.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.741+0000 7f2b1c6b4640 1 -- 172.21.15.146:0/1786194608 <== osd.3 v2:172.21.15.146:6809/4106661138 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'41 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b14028070 con 0x5614b3480fa0 2024-09-18T01:45:28.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.741+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b3499070 con 0x7f2b1403e070 2024-09-18T01:45:28.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.742+0000 7f2b1beb3640 1 -- 172.21.15.146:0/1786194608 <== osd.2 v2:172.21.15.146:6800/3820039304 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'49 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b0c03d070 con 0x7f2b1403e070 2024-09-18T01:45:28.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.742+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b3499070 con 0x5614b3480fa0 2024-09-18T01:45:28.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.743+0000 7f2b1c6b4640 1 -- 172.21.15.146:0/1786194608 <== osd.3 v2:172.21.15.146:6809/4106661138 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'30 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b14028070 con 0x5614b3480fa0 2024-09-18T01:45:28.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.743+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b3499070 con 0x5614b347ad30 2024-09-18T01:45:28.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.749+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b04051070 con 0x5614b347ad30 2024-09-18T01:45:28.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.749+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b3499070 con 0x5614b347ad30 2024-09-18T01:45:28.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.750+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'148 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b04051070 con 0x5614b347ad30 2024-09-18T01:45:28.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.750+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b3499070 con 0x5614b3480fa0 2024-09-18T01:45:28.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.751+0000 7f2b1c6b4640 1 -- 172.21.15.146:0/1786194608 <== osd.3 v2:172.21.15.146:6809/4106661138 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'42 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b14028070 con 0x5614b3480fa0 2024-09-18T01:45:28.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.751+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b3499070 con 0x7f2b1403e070 2024-09-18T01:45:28.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.752+0000 7f2b1beb3640 1 -- 172.21.15.146:0/1786194608 <== osd.2 v2:172.21.15.146:6800/3820039304 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'33 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b0c03d070 con 0x7f2b1403e070 2024-09-18T01:45:28.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.752+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b3499070 con 0x5614b3480fa0 2024-09-18T01:45:28.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.753+0000 7f2b1c6b4640 1 -- 172.21.15.146:0/1786194608 <== osd.3 v2:172.21.15.146:6809/4106661138 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'25 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b14028070 con 0x5614b3480fa0 2024-09-18T01:45:28.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.753+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b3499070 con 0x5614b3480fa0 2024-09-18T01:45:28.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.754+0000 7f2b1c6b4640 1 -- 172.21.15.146:0/1786194608 <== osd.3 v2:172.21.15.146:6809/4106661138 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'35 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b14028070 con 0x5614b3480fa0 2024-09-18T01:45:28.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.754+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b3499070 con 0x5614b3480fa0 2024-09-18T01:45:28.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.755+0000 7f2b1c6b4640 1 -- 172.21.15.146:0/1786194608 <== osd.3 v2:172.21.15.146:6809/4106661138 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b14028070 con 0x5614b3480fa0 2024-09-18T01:45:28.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.755+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b3499070 con 0x5614b3480fa0 2024-09-18T01:45:28.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.756+0000 7f2b1c6b4640 1 -- 172.21.15.146:0/1786194608 <== osd.3 v2:172.21.15.146:6809/4106661138 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'42 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b14028070 con 0x5614b3480fa0 2024-09-18T01:45:28.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.756+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b3499070 con 0x7f2b0c04f040 2024-09-18T01:45:28.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.757+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'26 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b04051070 con 0x7f2b0c04f040 2024-09-18T01:45:28.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.757+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b3499070 con 0x5614b3480fa0 2024-09-18T01:45:28.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.758+0000 7f2b1c6b4640 1 -- 172.21.15.146:0/1786194608 <== osd.3 v2:172.21.15.146:6809/4106661138 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'29 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b14028070 con 0x5614b3480fa0 2024-09-18T01:45:28.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.758+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b3499070 con 0x7f2b0c04f040 2024-09-18T01:45:28.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.759+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.0 v2:172.21.15.129:6800/1759265424 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'34 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b04051070 con 0x7f2b0c04f040 2024-09-18T01:45:28.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.759+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b3499070 con 0x5614b3480fa0 2024-09-18T01:45:28.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.760+0000 7f2b1c6b4640 1 -- 172.21.15.146:0/1786194608 <== osd.3 v2:172.21.15.146:6809/4106661138 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'43 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b14028070 con 0x5614b3480fa0 2024-09-18T01:45:28.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.760+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b3499070 con 0x7f2b0c04f040 2024-09-18T01:45:28.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.761+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.0 v2:172.21.15.129:6800/1759265424 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'46 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b04051070 con 0x7f2b0c04f040 2024-09-18T01:45:28.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.761+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b3499070 con 0x7f2b1403e070 2024-09-18T01:45:28.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.762+0000 7f2b1beb3640 1 -- 172.21.15.146:0/1786194608 <== osd.2 v2:172.21.15.146:6800/3820039304 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b0c03d070 con 0x7f2b1403e070 2024-09-18T01:45:28.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.762+0000 7f29d0fe1640 20 reqs_thread_entry: start 2024-09-18T01:45:28.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.762+0000 7f2b20128800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:28.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.762+0000 7f2b20128800 20 Filter name: none 2024-09-18T01:45:28.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.763+0000 7f294a7fc640 20 reqs_thread_entry: start 2024-09-18T01:45:28.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.763+0000 7f2b20128800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-18T01:45:28.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.763+0000 7f2b20128800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.763+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614b34c40f0 con 0x7f2b1403e070 2024-09-18T01:45:28.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.763+0000 7f2b1beb3640 1 -- 172.21.15.146:0/1786194608 <== osd.2 v2:172.21.15.146:6800/3820039304 19 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f2b0c03d070 con 0x7f2b1403e070 2024-09-18T01:45:28.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.763+0000 7f2b20128800 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T01:45:28.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.763+0000 7f2b20128800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-18T01:45:28.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.763+0000 7f2b20128800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T01:45:28.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.763+0000 7f2b20128800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 : miss 2024-09-18T01:45:28.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.763+0000 7f2b20128800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.763+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:95 8.13 8:ceaa8859:root::.bucket.meta.myfoo%3a8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614b34c5bb0 con 0x7f2b0c04f040 2024-09-18T01:45:28.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.763+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.0 v2:172.21.15.129:6800/1759265424 24 ==== osd_op_reply(95 .bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv11 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f2b04051070 con 0x7f2b0c04f040 2024-09-18T01:45:28.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.763+0000 7f2b20128800 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T01:45:28.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.764+0000 7f2b20128800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 info.flags=0x17 2024-09-18T01:45:28.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.764+0000 7f2b20128800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 to cache LRU end 2024-09-18T01:45:28.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.764+0000 7f2b20128800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:45:28.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.764+0000 7f2b20128800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T01:45:28.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.764+0000 7f2b20128800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 2024-09-18T01:45:28.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.764+0000 7f2b20128800 20 get_obj_state: octx=0x7f2b04053620 obj=myfoo:four state=0x5614b34c6e98 s->prefetch_data=0 2024-09-18T01:45:28.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.764+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:96 3.5s0 3:a1b4fc55:::8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1_four:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614b34c7cc0 con 0x7f2b1403e070 2024-09-18T01:45:28.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.764+0000 7f2b1beb3640 1 -- 172.21.15.146:0/1786194608 <== osd.2 v2:172.21.15.146:6800/3820039304 20 ==== osd_op_reply(96 8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1_four [getxattrs out=849b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 234+0+865 (crc 0 0 0) 0x7f2b0c03d070 con 0x7f2b1403e070 2024-09-18T01:45:28.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.764+0000 7f2b20128800 10 manifest: total_size = 4 2024-09-18T01:45:28.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.764+0000 7f2b20128800 20 get_obj_state: setting s->obj_tag to 8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.8610770559993442777 2024-09-18T01:45:28.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.764+0000 7f2b20128800 20 get_obj_state: octx=0x7f2b04053620 obj=myfoo:four state=0x5614b34c6e98 s->prefetch_data=0 2024-09-18T01:45:28.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.764+0000 7f2b20128800 20 prepare_atomic_modification: state is not atomic. state=0x5614b34c6e98 2024-09-18T01:45:28.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.764+0000 7f2b20128800 20 bucket index object: :.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.6 2024-09-18T01:45:28.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.764+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:97 4.16 4:6b798858:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b34cc650 con 0x5614b3480fa0 2024-09-18T01:45:28.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.765+0000 7f2b1c6b4640 1 -- 172.21.15.146:0/1786194608 <== osd.3 v2:172.21.15.146:6809/4106661138 26 ==== osd_op_reply(97 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.6 [stat,call,call] v31'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f2b14028070 con 0x5614b3480fa0 2024-09-18T01:45:28.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.765+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:98 3.5s0 3:a1b4fc55:::8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1_four:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b34cc650 con 0x7f2b1403e070 2024-09-18T01:45:28.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.766+0000 7f2b1beb3640 1 -- 172.21.15.146:0/1786194608 <== osd.2 v2:172.21.15.146:6800/3820039304 21 ==== osd_op_reply(98 8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1_four [call] v31'2 uv2 ondisk = 0) ==== 192+0+0 (crc 0 0 0) 0x7f2b0c03d070 con 0x7f2b1403e070 2024-09-18T01:45:28.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.766+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:99 4.16 4:6b798858:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=259b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b34cd0e0 con 0x5614b3480fa0 2024-09-18T01:45:28.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.768+0000 7f2b1c6b4640 1 -- 172.21.15.146:0/1786194608 <== osd.3 v2:172.21.15.146:6809/4106661138 27 ==== osd_op_reply(99 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.6 [stat,call,call] v31'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f2b14028070 con 0x5614b3480fa0 2024-09-18T01:45:28.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.768+0000 7f29faffd640 20 handle_completion(): completion ok for obj=four 2024-09-18T01:45:28.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.768+0000 7f29d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:28.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.768+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94646907221200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b34ccc30 con 0x5614b347ad30 2024-09-18T01:45:28.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.769+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.1 v2:172.21.15.146:6808/3930274777 28 ==== osd_op_reply(100 data_loggenerations_metadata [watch unwatch cookie 94646907221200] v31'149 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2b04051070 con 0x5614b347ad30 2024-09-18T01:45:28.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.769+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94646907195392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b348b4d0 con 0x7f2b1403e070 2024-09-18T01:45:28.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.770+0000 7f2b1beb3640 1 -- 172.21.15.146:0/1786194608 <== osd.2 v2:172.21.15.146:6800/3820039304 22 ==== osd_op_reply(101 notify.0 [watch unwatch cookie 94646907195392] v31'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b0c03d070 con 0x7f2b1403e070 2024-09-18T01:45:28.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.770+0000 7f2b20128800 20 remove_watcher() i=0 2024-09-18T01:45:28.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.770+0000 7f2b20128800 2 removed watcher, disabling cache 2024-09-18T01:45:28.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.770+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:102 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94646907202800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b348b4d0 con 0x5614b347ad30 2024-09-18T01:45:28.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.771+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.1 v2:172.21.15.146:6808/3930274777 29 ==== osd_op_reply(102 notify.1 [watch unwatch cookie 94646907202800] v31'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b04051070 con 0x5614b347ad30 2024-09-18T01:45:28.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.771+0000 7f2b20128800 20 remove_watcher() i=1 2024-09-18T01:45:28.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.771+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:103 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94646907204336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b348b4d0 con 0x5614b3480fa0 2024-09-18T01:45:28.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.772+0000 7f2b1c6b4640 1 -- 172.21.15.146:0/1786194608 <== osd.3 v2:172.21.15.146:6809/4106661138 28 ==== osd_op_reply(103 notify.2 [watch unwatch cookie 94646907204336] v31'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b14028070 con 0x5614b3480fa0 2024-09-18T01:45:28.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.772+0000 7f2b20128800 20 remove_watcher() i=2 2024-09-18T01:45:28.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.772+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94646907206352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b34872f0 con 0x7f2b1403e070 2024-09-18T01:45:28.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.773+0000 7f2b1beb3640 1 -- 172.21.15.146:0/1786194608 <== osd.2 v2:172.21.15.146:6800/3820039304 23 ==== osd_op_reply(104 notify.3 [watch unwatch cookie 94646907206352] v31'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b0c03d070 con 0x7f2b1403e070 2024-09-18T01:45:28.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.773+0000 7f2b20128800 20 remove_watcher() i=3 2024-09-18T01:45:28.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.773+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94646907211056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b348b4d0 con 0x5614b347ad30 2024-09-18T01:45:28.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.774+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.1 v2:172.21.15.146:6808/3930274777 30 ==== osd_op_reply(105 notify.4 [watch unwatch cookie 94646907211056] v31'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b04051070 con 0x5614b347ad30 2024-09-18T01:45:28.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.774+0000 7f2b20128800 20 remove_watcher() i=4 2024-09-18T01:45:28.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.774+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94646907215200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b3487ad0 con 0x7f2b0c04f040 2024-09-18T01:45:28.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.775+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.0 v2:172.21.15.129:6800/1759265424 25 ==== osd_op_reply(106 notify.5 [watch unwatch cookie 94646907215200] v31'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b04051070 con 0x7f2b0c04f040 2024-09-18T01:45:28.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.775+0000 7f2b20128800 20 remove_watcher() i=5 2024-09-18T01:45:28.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.775+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:107 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94646907218976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b3488d30 con 0x7f2b0c04f040 2024-09-18T01:45:28.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.776+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.0 v2:172.21.15.129:6800/1759265424 26 ==== osd_op_reply(107 notify.6 [watch unwatch cookie 94646907218976] v31'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b04051070 con 0x7f2b0c04f040 2024-09-18T01:45:28.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.776+0000 7f2b20128800 20 remove_watcher() i=6 2024-09-18T01:45:28.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.776+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:108 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94646907212624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614b348b4d0 con 0x7f2b0c04f040 2024-09-18T01:45:28.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.777+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 <== osd.0 v2:172.21.15.129:6800/1759265424 27 ==== osd_op_reply(108 notify.7 [watch unwatch cookie 94646907212624] v31'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b04051070 con 0x7f2b0c04f040 2024-09-18T01:45:28.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.777+0000 7f2b20128800 20 remove_watcher() i=7 2024-09-18T01:45:28.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.777+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f2b0c04f040 msgr2=0x7f2b0c0123c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.777+0000 7f2b20128800 1 --2- 172.21.15.146:0/1786194608 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f2b0c04f040 0x7f2b0c0123c0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.777+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5614b347ad30 msgr2=0x5614b347d1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.777+0000 7f2b20128800 1 --2- 172.21.15.146:0/1786194608 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5614b347ad30 0x5614b347d1f0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.777+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f2b1403e070 msgr2=0x7f2b1404f910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.777+0000 7f2b20128800 1 --2- 172.21.15.146:0/1786194608 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f2b1403e070 0x7f2b1404f910 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.777+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5614b3480fa0 msgr2=0x5614b3483390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.777+0000 7f2b20128800 1 --2- 172.21.15.146:0/1786194608 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5614b3480fa0 0x5614b3483390 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.777+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f29e4036b90 msgr2=0x7f29e4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.777+0000 7f2b20128800 1 --2- 172.21.15.146:0/1786194608 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f29e4036b90 0x7f29e4039050 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c00d010 tx=0x7f2b0c040000 comp rx=0 tx=0).stop 2024-09-18T01:45:28.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.777+0000 7f2b1b6b2640 1 -- 172.21.15.146:0/1786194608 reap_dead start 2024-09-18T01:45:28.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.777+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5614b3467d10 msgr2=0x5614b346f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.777+0000 7f2b20128800 1 --2- 172.21.15.146:0/1786194608 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5614b3467d10 0x5614b346f190 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f2b1404b840 tx=0x7f2b1404c900 comp rx=0 tx=0).stop 2024-09-18T01:45:28.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.777+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 shutdown_connections 2024-09-18T01:45:28.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.777+0000 7f2b20128800 1 --2- 172.21.15.146:0/1786194608 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5614b3467d10 0x5614b346f190 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.777+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 >> 172.21.15.146:0/1786194608 conn(0x5614b3464070 msgr2=0x5614b3462140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:28.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.778+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 shutdown_connections 2024-09-18T01:45:28.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.778+0000 7f2b20128800 1 -- 172.21.15.146:0/1786194608 wait complete. 2024-09-18T01:45:28.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.778+0000 7f2b20128800 1 -- 172.21.15.146:0/1312953671 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f29f4036b40 msgr2=0x7f29f4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.778+0000 7f2b20128800 1 --2- 172.21.15.146:0/1312953671 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f29f4036b40 0x7f29f4039000 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c04a500 tx=0x7f2b0c003450 comp rx=0 tx=0).stop 2024-09-18T01:45:28.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.778+0000 7f2b20128800 1 -- 172.21.15.146:0/1312953671 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5614b345b000 msgr2=0x5614b345b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.778+0000 7f2b20128800 1 --2- 172.21.15.146:0/1312953671 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5614b345b000 0x5614b345b420 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x5614b3441320 tx=0x7f2b1400ef30 comp rx=0 tx=0).stop 2024-09-18T01:45:28.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.778+0000 7f2b20128800 1 -- 172.21.15.146:0/1312953671 shutdown_connections 2024-09-18T01:45:28.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.778+0000 7f2b20128800 1 --2- 172.21.15.146:0/1312953671 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f29f4036b40 0x7f29f4039000 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.778+0000 7f2b20128800 1 --2- 172.21.15.146:0/1312953671 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5614b345b000 0x5614b345b420 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.778+0000 7f2b20128800 1 -- 172.21.15.146:0/1312953671 >> 172.21.15.146:0/1312953671 conn(0x5614b344ff90 msgr2=0x5614b3452b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:28.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.778+0000 7f2b20128800 1 -- 172.21.15.146:0/1312953671 shutdown_connections 2024-09-18T01:45:28.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.778+0000 7f2b20128800 1 -- 172.21.15.146:0/1312953671 wait complete. 2024-09-18T01:45:28.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.778+0000 7f2b20128800 1 -- 172.21.15.146:0/1846746954 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5614b334ba20 msgr2=0x5614b34472e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.778+0000 7f2b20128800 1 --2- 172.21.15.146:0/1846746954 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5614b334ba20 0x5614b34472e0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.778+0000 7f2b20128800 1 -- 172.21.15.146:0/1846746954 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5614b344aa20 msgr2=0x5614b344ce10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.778+0000 7f2b20128800 1 --2- 172.21.15.146:0/1846746954 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5614b344aa20 0x5614b344ce10 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.778+0000 7f2b20128800 1 -- 172.21.15.146:0/1846746954 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2a04036b90 msgr2=0x7f2a04039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.778+0000 7f2b20128800 1 --2- 172.21.15.146:0/1846746954 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2a04036b90 0x7f2a04039050 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2b04057000 tx=0x7f2b04052000 comp rx=0 tx=0).stop 2024-09-18T01:45:28.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.778+0000 7f2b20128800 1 -- 172.21.15.146:0/1846746954 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5614b3345940 msgr2=0x5614b3440270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.778+0000 7f2b20128800 1 --2- 172.21.15.146:0/1846746954 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5614b3345940 0x5614b3440270 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x5614b3347a00 tx=0x7f2b0c001250 comp rx=0 tx=0).stop 2024-09-18T01:45:28.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.778+0000 7f2b20128800 1 -- 172.21.15.146:0/1846746954 shutdown_connections 2024-09-18T01:45:28.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.778+0000 7f2b20128800 1 --2- 172.21.15.146:0/1846746954 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5614b344aa20 0x5614b344ce10 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.778+0000 7f2b20128800 1 --2- 172.21.15.146:0/1846746954 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5614b334ba20 0x5614b34472e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.778+0000 7f2b20128800 1 --2- 172.21.15.146:0/1846746954 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2a04036b90 0x7f2a04039050 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.778+0000 7f2b20128800 1 --2- 172.21.15.146:0/1846746954 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5614b3345940 0x5614b3440270 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.778+0000 7f2b20128800 1 -- 172.21.15.146:0/1846746954 >> 172.21.15.146:0/1846746954 conn(0x5614b3341550 msgr2=0x5614b3431c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:28.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.779+0000 7f2b20128800 1 -- 172.21.15.146:0/1846746954 shutdown_connections 2024-09-18T01:45:28.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.779+0000 7f2b20128800 1 -- 172.21.15.146:0/1846746954 wait complete. 2024-09-18T01:45:28.788 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-18T01:45:28.788 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-18T01:45:28.788 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-18T01:45:28.832 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:28.832 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:28.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.832+0000 7fb295c13800 1 Processor -- start 2024-09-18T01:45:28.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.832+0000 7fb295c13800 1 -- start start 2024-09-18T01:45:28.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.832+0000 7fb295c13800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55aa724bdaa0 0x55aa724bdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.832+0000 7fb295c13800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55aa7237db30 con 0x55aa724be410 2024-09-18T01:45:28.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.832+0000 7fb295c13800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x55aa7235f360 con 0x55aa724bdaa0 2024-09-18T01:45:28.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.833+0000 7fb291267640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55aa724bdaa0 0x55aa724bdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.833+0000 7fb291267640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55aa724bdaa0 0x55aa724bdea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:58138/0 (socket says 172.21.15.146:58138) 2024-09-18T01:45:28.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.833+0000 7fb291267640 1 -- 172.21.15.146:0/3461650540 learned_addr learned my addr 172.21.15.146:0/3461650540 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:28.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.833+0000 7fb28bfff640 1 --1- 172.21.15.146:0/3461650540 >> v1:172.21.15.129:6789/0 conn(0x55aa724be410 0x55aa724c29f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:47384/0 (socket says 172.21.15.146:47384) 2024-09-18T01:45:28.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.833+0000 7fb291267640 1 -- 172.21.15.146:0/3461650540 >> v1:172.21.15.129:6789/0 conn(0x55aa724be410 legacy=0x55aa724c29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.833+0000 7fb291267640 1 -- 172.21.15.146:0/3461650540 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa72385e00 con 0x55aa724bdaa0 2024-09-18T01:45:28.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.833+0000 7fb290a66640 1 -- 172.21.15.146:0/3461650540 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3239038954 0 0) 0x55aa7237db30 con 0x55aa724be410 2024-09-18T01:45:28.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.835+0000 7fb291267640 1 --2- 172.21.15.146:0/3461650540 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55aa724bdaa0 0x55aa724bdea0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fb28400a520 tx=0x7fb284045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b721e3d4476461f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.835+0000 7fb290a66640 1 -- 172.21.15.146:0/3461650540 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb284055070 con 0x55aa724bdaa0 2024-09-18T01:45:28.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.835+0000 7fb290a66640 1 -- 172.21.15.146:0/3461650540 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2840515b0 con 0x55aa724bdaa0 2024-09-18T01:45:28.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.835+0000 7fb290a66640 1 -- 172.21.15.146:0/3461650540 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2840518d0 con 0x55aa724bdaa0 2024-09-18T01:45:28.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.835+0000 7fb295c13800 1 -- 172.21.15.146:0/3461650540 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55aa724bdaa0 msgr2=0x55aa724bdea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.835+0000 7fb295c13800 1 --2- 172.21.15.146:0/3461650540 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55aa724bdaa0 0x55aa724bdea0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fb28400a520 tx=0x7fb284045ba0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.835+0000 7fb295c13800 1 -- 172.21.15.146:0/3461650540 shutdown_connections 2024-09-18T01:45:28.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.835+0000 7fb295c13800 1 --2- 172.21.15.146:0/3461650540 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55aa724bdaa0 0x55aa724bdea0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.835+0000 7fb295c13800 1 -- 172.21.15.146:0/3461650540 >> 172.21.15.146:0/3461650540 conn(0x55aa724b85c0 msgr2=0x55aa724ba9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:28.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.835+0000 7fb295c13800 1 -- 172.21.15.146:0/3461650540 shutdown_connections 2024-09-18T01:45:28.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.835+0000 7fb295c13800 1 -- 172.21.15.146:0/3461650540 wait complete. 2024-09-18T01:45:28.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.849+0000 7fb295c13800 1 Processor -- start 2024-09-18T01:45:28.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.849+0000 7fb295c13800 1 -- start start 2024-09-18T01:45:28.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.849+0000 7fb295c13800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55aa724bdaa0 0x55aa725ac500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.849+0000 7fb295c13800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55aa7240a330 con 0x55aa724bdaa0 2024-09-18T01:45:28.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.849+0000 7fb291267640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55aa724bdaa0 0x55aa725ac500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.849+0000 7fb291267640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55aa724bdaa0 0x55aa725ac500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:58146/0 (socket says 172.21.15.146:58146) 2024-09-18T01:45:28.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.849+0000 7fb291267640 1 -- 172.21.15.146:0/674467714 learned_addr learned my addr 172.21.15.146:0/674467714 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:28.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.850+0000 7fb291267640 1 -- 172.21.15.146:0/674467714 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa72357bc0 con 0x55aa724bdaa0 2024-09-18T01:45:28.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.850+0000 7fb291267640 1 --2- 172.21.15.146:0/674467714 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55aa724bdaa0 0x55aa725ac500 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fb284025da0 tx=0x7fb284051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac9fa34d96b89b29 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.850+0000 7fb17f606640 1 -- 172.21.15.146:0/674467714 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb284051ac0 con 0x55aa724bdaa0 2024-09-18T01:45:28.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.850+0000 7fb17f606640 1 -- 172.21.15.146:0/674467714 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb284051c60 con 0x55aa724bdaa0 2024-09-18T01:45:28.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.850+0000 7fb17f606640 1 -- 172.21.15.146:0/674467714 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb284066460 con 0x55aa724bdaa0 2024-09-18T01:45:28.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.851+0000 7fb295c13800 1 -- 172.21.15.146:0/674467714 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55aa724bdaa0 msgr2=0x55aa725ac500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.851+0000 7fb295c13800 1 --2- 172.21.15.146:0/674467714 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55aa724bdaa0 0x55aa725ac500 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fb284025da0 tx=0x7fb284051000 comp rx=0 tx=0).stop 2024-09-18T01:45:28.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.851+0000 7fb295c13800 1 -- 172.21.15.146:0/674467714 shutdown_connections 2024-09-18T01:45:28.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.851+0000 7fb295c13800 1 --2- 172.21.15.146:0/674467714 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55aa724bdaa0 0x55aa725ac500 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.851+0000 7fb295c13800 1 -- 172.21.15.146:0/674467714 >> 172.21.15.146:0/674467714 conn(0x55aa724b85c0 msgr2=0x55aa725a7ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:28.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.851+0000 7fb295c13800 1 -- 172.21.15.146:0/674467714 shutdown_connections 2024-09-18T01:45:28.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.851+0000 7fb295c13800 1 -- 172.21.15.146:0/674467714 wait complete. 2024-09-18T01:45:28.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.851+0000 7fb295c13800 1 Processor -- start 2024-09-18T01:45:28.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.851+0000 7fb295c13800 1 -- start start 2024-09-18T01:45:28.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.851+0000 7fb295c13800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55aa724bdaa0 0x55aa725b3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.851+0000 7fb295c13800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55aa724c4550 con 0x55aa724bdaa0 2024-09-18T01:45:28.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.851+0000 7fb291267640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55aa724bdaa0 0x55aa725b3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.852+0000 7fb291267640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55aa724bdaa0 0x55aa725b3e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:58150/0 (socket says 172.21.15.146:58150) 2024-09-18T01:45:28.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.852+0000 7fb291267640 1 -- 172.21.15.146:0/2271780582 learned_addr learned my addr 172.21.15.146:0/2271780582 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:28.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.852+0000 7fb291267640 1 -- 172.21.15.146:0/2271780582 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa7236bfe0 con 0x55aa724bdaa0 2024-09-18T01:45:28.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.852+0000 7fb291267640 1 --2- 172.21.15.146:0/2271780582 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55aa724bdaa0 0x55aa725b3e80 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fb2840460a0 tx=0x7fb284003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.852+0000 7fb17de03640 1 -- 172.21.15.146:0/2271780582 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb284066650 con 0x55aa724bdaa0 2024-09-18T01:45:28.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.852+0000 7fb17de03640 1 -- 172.21.15.146:0/2271780582 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb284066810 con 0x55aa724bdaa0 2024-09-18T01:45:28.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.852+0000 7fb295c13800 1 -- 172.21.15.146:0/2271780582 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55aa725b43c0 con 0x55aa724bdaa0 2024-09-18T01:45:28.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.852+0000 7fb17de03640 1 -- 172.21.15.146:0/2271780582 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb284066b30 con 0x55aa724bdaa0 2024-09-18T01:45:28.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.852+0000 7fb295c13800 1 -- 172.21.15.146:0/2271780582 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa725b48e0 con 0x55aa724bdaa0 2024-09-18T01:45:28.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.853+0000 7fb17de03640 1 -- 172.21.15.146:0/2271780582 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb284079060 con 0x55aa724bdaa0 2024-09-18T01:45:28.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.853+0000 7fb17de03640 1 --2- 172.21.15.146:0/2271780582 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb178036b90 0x7fb178039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.853+0000 7fb17de03640 1 -- 172.21.15.146:0/2271780582 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fb284062070 con 0x55aa724bdaa0 2024-09-18T01:45:28.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.853+0000 7fb28bfff640 1 --2- 172.21.15.146:0/2271780582 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb178036b90 0x7fb178039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.853+0000 7fb295c13800 1 --2- 172.21.15.146:0/2271780582 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55aa724be410 0x55aa725baef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.853+0000 7fb295c13800 1 -- 172.21.15.146:0/2271780582 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55aa725bb4c0 con 0x55aa724be410 2024-09-18T01:45:28.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.853+0000 7fb291a68640 1 --2- 172.21.15.146:0/2271780582 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55aa724be410 0x55aa725baef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.854+0000 7fb28bfff640 1 --2- 172.21.15.146:0/2271780582 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb178036b90 0x7fb178039050 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb27c000c00 tx=0x7fb27c0013b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.854+0000 7fb291a68640 1 --2- 172.21.15.146:0/2271780582 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55aa724be410 0x55aa725baef0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.854+0000 7fb291a68640 1 -- 172.21.15.146:0/2271780582 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb28c00a4a0 con 0x55aa724be410 2024-09-18T01:45:28.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.854+0000 7fb295c13800 1 -- 172.21.15.146:0/2271780582 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55aa725b8480 con 0x55aa724be410 2024-09-18T01:45:28.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.854+0000 7fb291a68640 1 -- 172.21.15.146:0/2271780582 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb28c00a4a0 con 0x55aa724be410 2024-09-18T01:45:28.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.854+0000 7fb295c13800 1 -- 172.21.15.146:0/2271780582 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55aa725bd2e0 con 0x55aa724be410 2024-09-18T01:45:28.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.855+0000 7fb291a68640 1 -- 172.21.15.146:0/2271780582 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb28c00a4a0 con 0x55aa724be410 2024-09-18T01:45:28.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.855+0000 7fb295c13800 1 -- 172.21.15.146:0/2271780582 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55aa725bc420 con 0x55aa724be410 2024-09-18T01:45:28.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.855+0000 7fb291a68640 1 -- 172.21.15.146:0/2271780582 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb28c00a4a0 con 0x55aa724be410 2024-09-18T01:45:28.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.855+0000 7fb295c13800 1 --2- 172.21.15.146:0/2271780582 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55aa725bcec0 0x55aa725c06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.855+0000 7fb295c13800 1 -- 172.21.15.146:0/2271780582 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55aa725c0e70 con 0x55aa725bcec0 2024-09-18T01:45:28.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.855+0000 7fb291267640 1 --2- 172.21.15.146:0/2271780582 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55aa725bcec0 0x55aa725c06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.855+0000 7fb291267640 1 --2- 172.21.15.146:0/2271780582 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55aa725bcec0 0x55aa725c06e0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.855+0000 7fb291267640 1 -- 172.21.15.146:0/2271780582 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb284057030 con 0x55aa725bcec0 2024-09-18T01:45:28.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.856+0000 7fb295c13800 1 Processor -- start 2024-09-18T01:45:28.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.856+0000 7fb295c13800 1 -- start start 2024-09-18T01:45:28.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.856+0000 7fb295c13800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55aa725cec20 0x55aa725cf040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.856+0000 7fb295c13800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55aa72359580 con 0x55aa725cec20 2024-09-18T01:45:28.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.856+0000 7fb291a68640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55aa725cec20 0x55aa725cf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.856+0000 7fb291a68640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55aa725cec20 0x55aa725cf040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:58162/0 (socket says 172.21.15.146:58162) 2024-09-18T01:45:28.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.856+0000 7fb291a68640 1 -- 172.21.15.146:0/4186260185 learned_addr learned my addr 172.21.15.146:0/4186260185 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:28.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.857+0000 7fb291a68640 1 -- 172.21.15.146:0/4186260185 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa725cf580 con 0x55aa725cec20 2024-09-18T01:45:28.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.857+0000 7fb291a68640 1 --2- 172.21.15.146:0/4186260185 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55aa725cec20 0x55aa725cf040 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x55aa725bb8c0 tx=0x7fb28c0178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.857+0000 7fb176ffd640 1 -- 172.21.15.146:0/4186260185 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb28c013440 con 0x55aa725cec20 2024-09-18T01:45:28.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.857+0000 7fb176ffd640 1 -- 172.21.15.146:0/4186260185 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb28c0135e0 con 0x55aa725cec20 2024-09-18T01:45:28.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.857+0000 7fb295c13800 1 -- 172.21.15.146:0/4186260185 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55aa725cf810 con 0x55aa725cec20 2024-09-18T01:45:28.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.857+0000 7fb176ffd640 1 -- 172.21.15.146:0/4186260185 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb28c0138c0 con 0x55aa725cec20 2024-09-18T01:45:28.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.857+0000 7fb295c13800 1 -- 172.21.15.146:0/4186260185 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa725d24f0 con 0x55aa725cec20 2024-09-18T01:45:28.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.858+0000 7fb176ffd640 1 -- 172.21.15.146:0/4186260185 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb28c011040 con 0x55aa725cec20 2024-09-18T01:45:28.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.858+0000 7fb176ffd640 1 --2- 172.21.15.146:0/4186260185 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb168036b90 0x7fb168039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.858+0000 7fb176ffd640 1 -- 172.21.15.146:0/4186260185 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fb28c01d070 con 0x55aa725cec20 2024-09-18T01:45:28.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.858+0000 7fb291267640 1 --2- 172.21.15.146:0/4186260185 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb168036b90 0x7fb168039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.858+0000 7fb295c13800 1 Processor -- start 2024-09-18T01:45:28.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.858+0000 7fb291267640 1 --2- 172.21.15.146:0/4186260185 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb168036b90 0x7fb168039050 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x55aa725bc7c0 tx=0x7fb28408e5d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.858+0000 7fb295c13800 1 -- start start 2024-09-18T01:45:28.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.858+0000 7fb295c13800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55aa725db8a0 0x55aa725dbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.858+0000 7fb295c13800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55aa725acbf0 con 0x55aa725db8a0 2024-09-18T01:45:28.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.859+0000 7fb291a68640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55aa725db8a0 0x55aa725dbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.859+0000 7fb291a68640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55aa725db8a0 0x55aa725dbca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:58168/0 (socket says 172.21.15.146:58168) 2024-09-18T01:45:28.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.859+0000 7fb291a68640 1 -- 172.21.15.146:0/1264585569 learned_addr learned my addr 172.21.15.146:0/1264585569 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:28.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.859+0000 7fb291a68640 1 -- 172.21.15.146:0/1264585569 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa725dc270 con 0x55aa725db8a0 2024-09-18T01:45:28.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.859+0000 7fb291a68640 1 --2- 172.21.15.146:0/1264585569 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55aa725db8a0 0x55aa725dbca0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fb28c04c860 tx=0x7fb28c012770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ec593b19fb23fad server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.859+0000 7fb174ff9640 1 -- 172.21.15.146:0/1264585569 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb28c012c90 con 0x55aa725db8a0 2024-09-18T01:45:28.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.859+0000 7fb174ff9640 1 -- 172.21.15.146:0/1264585569 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb28c012e30 con 0x55aa725db8a0 2024-09-18T01:45:28.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.859+0000 7fb174ff9640 1 -- 172.21.15.146:0/1264585569 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb28c0124d0 con 0x55aa725db8a0 2024-09-18T01:45:28.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.860+0000 7fb295c13800 1 -- 172.21.15.146:0/1264585569 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55aa725db8a0 msgr2=0x55aa725dbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.860+0000 7fb295c13800 1 --2- 172.21.15.146:0/1264585569 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55aa725db8a0 0x55aa725dbca0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fb28c04c860 tx=0x7fb28c012770 comp rx=0 tx=0).stop 2024-09-18T01:45:28.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.860+0000 7fb295c13800 1 -- 172.21.15.146:0/1264585569 shutdown_connections 2024-09-18T01:45:28.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.860+0000 7fb295c13800 1 --2- 172.21.15.146:0/1264585569 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55aa725db8a0 0x55aa725dbca0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.860+0000 7fb295c13800 1 -- 172.21.15.146:0/1264585569 >> 172.21.15.146:0/1264585569 conn(0x55aa725d7c00 msgr2=0x55aa725d5d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:28.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.860+0000 7fb295c13800 1 -- 172.21.15.146:0/1264585569 shutdown_connections 2024-09-18T01:45:28.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.860+0000 7fb295c13800 1 -- 172.21.15.146:0/1264585569 wait complete. 2024-09-18T01:45:28.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.860+0000 7fb295c13800 1 Processor -- start 2024-09-18T01:45:28.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.860+0000 7fb295c13800 1 -- start start 2024-09-18T01:45:28.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.860+0000 7fb295c13800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55aa725db8a0 0x55aa725e1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.860+0000 7fb295c13800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55aa725dc8e0 con 0x55aa725db8a0 2024-09-18T01:45:28.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.860+0000 7fb291a68640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55aa725db8a0 0x55aa725e1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.860+0000 7fb291a68640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55aa725db8a0 0x55aa725e1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:58184/0 (socket says 172.21.15.146:58184) 2024-09-18T01:45:28.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.860+0000 7fb291a68640 1 -- 172.21.15.146:0/1709877550 learned_addr learned my addr 172.21.15.146:0/1709877550 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:28.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.861+0000 7fb291a68640 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa725e2120 con 0x55aa725db8a0 2024-09-18T01:45:28.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.861+0000 7fb291a68640 1 --2- 172.21.15.146:0/1709877550 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55aa725db8a0 0x55aa725e1be0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fb28c0127b0 tx=0x7fb28c04c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.861+0000 7fb166ffd640 1 -- 172.21.15.146:0/1709877550 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb28c04a070 con 0x55aa725db8a0 2024-09-18T01:45:28.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.861+0000 7fb166ffd640 1 -- 172.21.15.146:0/1709877550 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb28c04b130 con 0x55aa725db8a0 2024-09-18T01:45:28.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.861+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55aa725e23b0 con 0x55aa725db8a0 2024-09-18T01:45:28.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.861+0000 7fb166ffd640 1 -- 172.21.15.146:0/1709877550 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb28c04b450 con 0x55aa725db8a0 2024-09-18T01:45:28.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.861+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa725e5060 con 0x55aa725db8a0 2024-09-18T01:45:28.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.862+0000 7fb166ffd640 1 -- 172.21.15.146:0/1709877550 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb28c013c70 con 0x55aa725db8a0 2024-09-18T01:45:28.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.862+0000 7fb166ffd640 1 --2- 172.21.15.146:0/1709877550 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb15c036b40 0x7fb15c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.862+0000 7fb166ffd640 1 -- 172.21.15.146:0/1709877550 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fb28c034030 con 0x55aa725db8a0 2024-09-18T01:45:28.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.862+0000 7fb291267640 1 --2- 172.21.15.146:0/1709877550 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb15c036b40 0x7fb15c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.862+0000 7fb295c13800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.862+0000 7fb295c13800 1 --2- 172.21.15.146:0/1709877550 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55aa725ed860 0x55aa725efd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.862+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55aa725f0470 con 0x55aa725ed860 2024-09-18T01:45:28.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.862+0000 7fb28bfff640 1 --2- 172.21.15.146:0/1709877550 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55aa725ed860 0x55aa725efd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.862+0000 7fb291267640 1 --2- 172.21.15.146:0/1709877550 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb15c036b40 0x7fb15c039000 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb284070000 tx=0x7fb28408a000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.863+0000 7fb28bfff640 1 --2- 172.21.15.146:0/1709877550 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55aa725ed860 0x55aa725efd20 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.863+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb27c00f5f0 con 0x55aa725ed860 2024-09-18T01:45:28.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.863+0000 7fb295c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:28.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.863+0000 7fb295c13800 20 realm 2024-09-18T01:45:28.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.863+0000 7fb295c13800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.863+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55aa725eccb0 con 0x55aa725ed860 2024-09-18T01:45:28.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.863+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb27c00f5f0 con 0x55aa725ed860 2024-09-18T01:45:28.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.863+0000 7fb295c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:28.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.863+0000 7fb295c13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:28.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.863+0000 7fb295c13800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.863+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55aa725f0f50 con 0x55aa725ed860 2024-09-18T01:45:28.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.863+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb27c00f5f0 con 0x55aa725ed860 2024-09-18T01:45:28.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.863+0000 7fb295c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:28.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.863+0000 7fb295c13800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.863+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55aa725f1820 con 0x55aa725ed860 2024-09-18T01:45:28.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.864+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb27c00f5f0 con 0x55aa725ed860 2024-09-18T01:45:28.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.864+0000 7fb295c13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:28.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.864+0000 7fb295c13800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.864+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55aa725f1bc0 con 0x55aa725ed860 2024-09-18T01:45:28.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.864+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb27c00f5f0 con 0x55aa725ed860 2024-09-18T01:45:28.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.864+0000 7fb295c13800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:28.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.864+0000 7fb295c13800 20 searching for the correct realm 2024-09-18T01:45:28.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.864+0000 7fb295c13800 1 --2- 172.21.15.146:0/1709877550 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55aa725f3aa0 0x55aa725f5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.864+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55aa725f6580 con 0x55aa725f3aa0 2024-09-18T01:45:28.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.864+0000 7fb291a68640 1 --2- 172.21.15.146:0/1709877550 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55aa725f3aa0 0x55aa725f5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.864+0000 7fb291a68640 1 --2- 172.21.15.146:0/1709877550 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55aa725f3aa0 0x55aa725f5eb0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.864+0000 7fb291a68640 1 -- 172.21.15.146:0/1709877550 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb28c029070 con 0x55aa725f3aa0 2024-09-18T01:45:28.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.864+0000 7fb291a68640 1 --2- 172.21.15.146:0/1709877550 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fb28c059040 0x7fb28c007050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.864+0000 7fb291a68640 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55aa725f6580 con 0x7fb28c059040 2024-09-18T01:45:28.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.865+0000 7fb291267640 1 --2- 172.21.15.146:0/1709877550 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fb28c059040 0x7fb28c007050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.865+0000 7fb291267640 1 --2- 172.21.15.146:0/1709877550 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fb28c059040 0x7fb28c007050 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.865+0000 7fb291267640 1 -- 172.21.15.146:0/1709877550 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb284057030 con 0x7fb28c059040 2024-09-18T01:45:28.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.865+0000 7fb291267640 1 --2- 172.21.15.146:0/1709877550 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fb28409f040 0x7fb284050860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.865+0000 7fb291267640 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55aa725f6580 con 0x7fb28409f040 2024-09-18T01:45:28.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.865+0000 7fb28bfff640 1 --2- 172.21.15.146:0/1709877550 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fb28409f040 0x7fb284050860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.866+0000 7fb28bfff640 1 --2- 172.21.15.146:0/1709877550 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fb28409f040 0x7fb284050860 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.866+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb27c00f5f0 con 0x7fb28409f040 2024-09-18T01:45:28.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.866+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55aa725f6580 con 0x55aa725ed860 2024-09-18T01:45:28.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.866+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb27c00f5f0 con 0x55aa725ed860 2024-09-18T01:45:28.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.866+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55aa725f6580 con 0x55aa725ed860 2024-09-18T01:45:28.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.866+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb27c00f5f0 con 0x55aa725ed860 2024-09-18T01:45:28.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.866+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55aa725f6580 con 0x7fb28409f040 2024-09-18T01:45:28.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.867+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb27c00f5f0 con 0x7fb28409f040 2024-09-18T01:45:28.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.867+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55aa725f6580 con 0x7fb28409f040 2024-09-18T01:45:28.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.867+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb27c00f5f0 con 0x7fb28409f040 2024-09-18T01:45:28.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.867+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55aa725f6580 con 0x7fb28c059040 2024-09-18T01:45:28.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.867+0000 7fb291267640 1 -- 172.21.15.146:0/1709877550 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb284057030 con 0x7fb28c059040 2024-09-18T01:45:28.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.867+0000 7fb291267640 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55aa725f6580 con 0x55aa725f3aa0 2024-09-18T01:45:28.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.867+0000 7fb291a68640 1 -- 172.21.15.146:0/1709877550 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb28c029070 con 0x55aa725f3aa0 2024-09-18T01:45:28.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.867+0000 7fb291a68640 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55aa725f6580 con 0x55aa725ed860 2024-09-18T01:45:28.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.867+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb27c00f5f0 con 0x55aa725ed860 2024-09-18T01:45:28.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.867+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55aa725f6580 con 0x7fb28409f040 2024-09-18T01:45:28.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.868+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb27c00f5f0 con 0x7fb28409f040 2024-09-18T01:45:28.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.868+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55aa725f6580 con 0x55aa725ed860 2024-09-18T01:45:28.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.868+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb27c00f5f0 con 0x55aa725ed860 2024-09-18T01:45:28.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.868+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55aa725f6580 con 0x7fb28c059040 2024-09-18T01:45:28.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.868+0000 7fb291267640 1 -- 172.21.15.146:0/1709877550 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fb284057030 con 0x7fb28c059040 2024-09-18T01:45:28.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.868+0000 7fb291267640 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55aa725f6580 con 0x55aa725f3aa0 2024-09-18T01:45:28.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.868+0000 7fb291a68640 1 -- 172.21.15.146:0/1709877550 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb28c029070 con 0x55aa725f3aa0 2024-09-18T01:45:28.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.868+0000 7fb291a68640 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55aa725f6580 con 0x55aa725f3aa0 2024-09-18T01:45:28.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.869+0000 7fb291a68640 1 -- 172.21.15.146:0/1709877550 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb28c029070 con 0x55aa725f3aa0 2024-09-18T01:45:28.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.869+0000 7fb291a68640 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55aa725f6580 con 0x7fb28409f040 2024-09-18T01:45:28.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.869+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb27c00f5f0 con 0x7fb28409f040 2024-09-18T01:45:28.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.869+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55aa725f6580 con 0x55aa725f3aa0 2024-09-18T01:45:28.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.869+0000 7fb291a68640 1 -- 172.21.15.146:0/1709877550 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb28c029070 con 0x55aa725f3aa0 2024-09-18T01:45:28.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.869+0000 7fb291a68640 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55aa725f6580 con 0x55aa725f3aa0 2024-09-18T01:45:28.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.870+0000 7fb291a68640 1 -- 172.21.15.146:0/1709877550 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb28c029070 con 0x55aa725f3aa0 2024-09-18T01:45:28.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.870+0000 7fb291a68640 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55aa725f6580 con 0x55aa725ed860 2024-09-18T01:45:28.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.870+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb27c00f5f0 con 0x55aa725ed860 2024-09-18T01:45:28.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.870+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55aa725f6580 con 0x55aa725ed860 2024-09-18T01:45:28.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.870+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb27c00f5f0 con 0x55aa725ed860 2024-09-18T01:45:28.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.870+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55aa725f6580 con 0x7fb28409f040 2024-09-18T01:45:28.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.870+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb27c00f5f0 con 0x7fb28409f040 2024-09-18T01:45:28.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.870+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55aa725f6580 con 0x55aa725f3aa0 2024-09-18T01:45:28.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.870+0000 7fb291a68640 1 -- 172.21.15.146:0/1709877550 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb28c029070 con 0x55aa725f3aa0 2024-09-18T01:45:28.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.870+0000 7fb291a68640 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55aa725f6580 con 0x7fb28c059040 2024-09-18T01:45:28.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.871+0000 7fb291267640 1 -- 172.21.15.146:0/1709877550 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb284057030 con 0x7fb28c059040 2024-09-18T01:45:28.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.871+0000 7fb291267640 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55aa725f6580 con 0x55aa725ed860 2024-09-18T01:45:28.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.871+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb27c00f5f0 con 0x55aa725ed860 2024-09-18T01:45:28.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.871+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55aa725f6580 con 0x7fb28409f040 2024-09-18T01:45:28.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.871+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb27c03b040 con 0x7fb28409f040 2024-09-18T01:45:28.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.871+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55aa725f6580 con 0x55aa725f3aa0 2024-09-18T01:45:28.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.871+0000 7fb291a68640 1 -- 172.21.15.146:0/1709877550 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb28c029070 con 0x55aa725f3aa0 2024-09-18T01:45:28.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.872+0000 7fb291a68640 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55aa725f6580 con 0x7fb28409f040 2024-09-18T01:45:28.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.872+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb27c03b040 con 0x7fb28409f040 2024-09-18T01:45:28.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.872+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55aa725f6580 con 0x7fb28c059040 2024-09-18T01:45:28.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.872+0000 7fb291267640 1 -- 172.21.15.146:0/1709877550 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb284057030 con 0x7fb28c059040 2024-09-18T01:45:28.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.872+0000 7fb291267640 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55aa725f6580 con 0x55aa725f3aa0 2024-09-18T01:45:28.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.872+0000 7fb291a68640 1 -- 172.21.15.146:0/1709877550 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb28c029070 con 0x55aa725f3aa0 2024-09-18T01:45:28.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.872+0000 7fb291a68640 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55aa725f6580 con 0x7fb28409f040 2024-09-18T01:45:28.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.872+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb27c03b040 con 0x7fb28409f040 2024-09-18T01:45:28.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.872+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55aa725f6580 con 0x55aa725ed860 2024-09-18T01:45:28.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.873+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb27c03b040 con 0x55aa725ed860 2024-09-18T01:45:28.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.873+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55aa725f6580 con 0x7fb28c059040 2024-09-18T01:45:28.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.873+0000 7fb291267640 1 -- 172.21.15.146:0/1709877550 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb284057030 con 0x7fb28c059040 2024-09-18T01:45:28.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.873+0000 7fb295c13800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:28.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.873+0000 7fb295c13800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:28.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.873+0000 7fb295c13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:28.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.873+0000 7fb295c13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:28.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.873+0000 7fb295c13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:28.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.873+0000 7fb295c13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:28.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.873+0000 7fb295c13800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.873+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55aa725f2570 con 0x55aa725ed860 2024-09-18T01:45:28.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.873+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb27c03b040 con 0x55aa725ed860 2024-09-18T01:45:28.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.873+0000 7fb295c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:28.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.873+0000 7fb295c13800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.873+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55aa725f2e10 con 0x55aa725ed860 2024-09-18T01:45:28.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.873+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb27c03b040 con 0x55aa725ed860 2024-09-18T01:45:28.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.873+0000 7fb295c13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:28.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.873+0000 7fb295c13800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.873+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55aa725f21b0 con 0x7fb28c059040 2024-09-18T01:45:28.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.874+0000 7fb291267640 1 -- 172.21.15.146:0/1709877550 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb284057030 con 0x7fb28c059040 2024-09-18T01:45:28.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.874+0000 7fb295c13800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:28.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.874+0000 7fb295c13800 20 zone default found 2024-09-18T01:45:28.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.874+0000 7fb295c13800 4 Realm: () 2024-09-18T01:45:28.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.874+0000 7fb295c13800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:28.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.874+0000 7fb295c13800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:28.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.874+0000 7fb295c13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:28.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.874+0000 7fb295c13800 20 zonegroup default 2024-09-18T01:45:28.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.874+0000 7fb295c13800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.874+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55aa725f6a00 con 0x7fb28409f040 2024-09-18T01:45:28.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.874+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb27c03b040 con 0x7fb28409f040 2024-09-18T01:45:28.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.874+0000 7fb295c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:28.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.874+0000 7fb295c13800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.874+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55aa725f8890 con 0x55aa725f3aa0 2024-09-18T01:45:28.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.874+0000 7fb291a68640 1 -- 172.21.15.146:0/1709877550 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb28c029070 con 0x55aa725f3aa0 2024-09-18T01:45:28.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.874+0000 7fb295c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:28.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.874+0000 7fb295c13800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.874+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55aa725f8c30 con 0x55aa725f3aa0 2024-09-18T01:45:28.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.875+0000 7fb291a68640 1 -- 172.21.15.146:0/1709877550 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb28c029070 con 0x55aa725f3aa0 2024-09-18T01:45:28.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.875+0000 7fb295c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:28.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.875+0000 7fb295c13800 20 started sync module instance, tier type = 2024-09-18T01:45:28.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.875+0000 7fb295c13800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:28.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.875+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55aa725f7d20 con 0x7fb28c059040 2024-09-18T01:45:28.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.876+0000 7fb291267640 1 -- 172.21.15.146:0/1709877550 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v31'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb284057030 con 0x7fb28c059040 2024-09-18T01:45:28.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.876+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94190551662912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55aa725f94d0 con 0x7fb28c059040 2024-09-18T01:45:28.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.876+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55aa725f9d20 con 0x55aa725ed860 2024-09-18T01:45:28.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.877+0000 7fb291267640 1 -- 172.21.15.146:0/1709877550 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94190551662912] v31'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb284057030 con 0x7fb28c059040 2024-09-18T01:45:28.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.877+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v31'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb27c03b040 con 0x55aa725ed860 2024-09-18T01:45:28.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.877+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94190551666720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55aa725f9d20 con 0x55aa725ed860 2024-09-18T01:45:28.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.877+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55aa725fa840 con 0x55aa725f3aa0 2024-09-18T01:45:28.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.878+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94190551666720] v31'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb27c03b040 con 0x55aa725ed860 2024-09-18T01:45:28.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.878+0000 7fb291a68640 1 -- 172.21.15.146:0/1709877550 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v31'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb28c029070 con 0x55aa725f3aa0 2024-09-18T01:45:28.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.878+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94190551668848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55aa725f9c90 con 0x55aa725f3aa0 2024-09-18T01:45:28.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.878+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55aa725fb700 con 0x7fb28c059040 2024-09-18T01:45:28.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.879+0000 7fb291267640 1 -- 172.21.15.146:0/1709877550 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v31'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb284057030 con 0x7fb28c059040 2024-09-18T01:45:28.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.879+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94190551675472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55aa725fbf50 con 0x7fb28c059040 2024-09-18T01:45:28.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.879+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55aa725fca20 con 0x55aa725ed860 2024-09-18T01:45:28.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.879+0000 7fb291a68640 1 -- 172.21.15.146:0/1709877550 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94190551668848] v31'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb28c029070 con 0x55aa725f3aa0 2024-09-18T01:45:28.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.880+0000 7fb291267640 1 -- 172.21.15.146:0/1709877550 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94190551675472] v31'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb284057030 con 0x7fb28c059040 2024-09-18T01:45:28.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.880+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v31'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb27c03b040 con 0x55aa725ed860 2024-09-18T01:45:28.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.880+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94190551677600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55aa725fac30 con 0x55aa725ed860 2024-09-18T01:45:28.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.880+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55aa725fd330 con 0x7fb28409f040 2024-09-18T01:45:28.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.881+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94190551677600] v31'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb27c03b040 con 0x55aa725ed860 2024-09-18T01:45:28.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.882+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v31'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb27c03b040 con 0x7fb28409f040 2024-09-18T01:45:28.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.882+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94190551680272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55aa725fd2a0 con 0x7fb28409f040 2024-09-18T01:45:28.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.882+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55aa725fdd40 con 0x7fb28409f040 2024-09-18T01:45:28.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.882+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94190551680272] v31'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb27c03b040 con 0x7fb28409f040 2024-09-18T01:45:28.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.883+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v31'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb27c03b040 con 0x7fb28409f040 2024-09-18T01:45:28.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.883+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94190551682816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55aa725fdd40 con 0x7fb28409f040 2024-09-18T01:45:28.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.883+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55aa725fe700 con 0x7fb28409f040 2024-09-18T01:45:28.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.884+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94190551682816] v31'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb27c03b040 con 0x7fb28409f040 2024-09-18T01:45:28.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.885+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v31'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb27c03b040 con 0x7fb28409f040 2024-09-18T01:45:28.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.885+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94190551685264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55aa725fe8e0 con 0x7fb28409f040 2024-09-18T01:45:28.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.885+0000 7fb295c13800 20 add_watcher() i=0 2024-09-18T01:45:28.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.885+0000 7fb295c13800 20 add_watcher() i=1 2024-09-18T01:45:28.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.885+0000 7fb295c13800 20 add_watcher() i=2 2024-09-18T01:45:28.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.885+0000 7fb295c13800 20 add_watcher() i=3 2024-09-18T01:45:28.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.885+0000 7fb295c13800 20 add_watcher() i=4 2024-09-18T01:45:28.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.885+0000 7fb295c13800 20 add_watcher() i=5 2024-09-18T01:45:28.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.885+0000 7fb295c13800 20 add_watcher() i=6 2024-09-18T01:45:28.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.886+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94190551685264] v31'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb27c03b040 con 0x7fb28409f040 2024-09-18T01:45:28.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.886+0000 7fb295c13800 20 add_watcher() i=7 2024-09-18T01:45:28.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.886+0000 7fb295c13800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:28.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.886+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55aa72601a50 con 0x55aa725ed860 2024-09-18T01:45:28.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.886+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb27c03b040 con 0x55aa725ed860 2024-09-18T01:45:28.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.887+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94190551700416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55aa725fe7d0 con 0x55aa725ed860 2024-09-18T01:45:28.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.887+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94190551700416] v31'150 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb27c03b040 con 0x55aa725ed860 2024-09-18T01:45:28.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.888+0000 7fb1477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:28.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.888+0000 7fb295c13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:28.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.888+0000 7fb295c13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:28.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.888+0000 7fb295c13800 5 note: GC not initialized 2024-09-18T01:45:28.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.888+0000 7fb1467e4640 20 reqs_thread_entry: start 2024-09-18T01:45:28.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.888+0000 7fb295c13800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:28.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.888+0000 7fb295c13800 20 Filter name: none 2024-09-18T01:45:28.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.888+0000 7fb0b7fff640 20 reqs_thread_entry: start 2024-09-18T01:45:28.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.888+0000 7fb295c13800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.888+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55aa72634e60 con 0x7fb28c059040 2024-09-18T01:45:28.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.889+0000 7fb291267640 1 -- 172.21.15.146:0/1709877550 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fb284057030 con 0x7fb28c059040 2024-09-18T01:45:28.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.889+0000 7fb295c13800 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T01:45:28.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.889+0000 7fb295c13800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.889+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:63 8.13 8:ceaa8859:root::.bucket.meta.myfoo%3a8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55aa726357d0 con 0x7fb28409f040 2024-09-18T01:45:28.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.889+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(63 .bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv11 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fb27c03b040 con 0x7fb28409f040 2024-09-18T01:45:28.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.889+0000 7fb295c13800 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T01:45:28.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.889+0000 7fb295c13800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-18T01:45:28.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.889+0000 7fb295c13800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.889+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55aa72636e80 con 0x7fb28c059040 2024-09-18T01:45:28.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.889+0000 7fb291267640 1 -- 172.21.15.146:0/1709877550 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fb284057030 con 0x7fb28c059040 2024-09-18T01:45:28.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.889+0000 7fb295c13800 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T01:45:28.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.889+0000 7fb295c13800 20 rados->read ofs=0 len=0 2024-09-18T01:45:28.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.889+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:65 8.13 8:ceaa8859:root::.bucket.meta.myfoo%3a8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55aa72636e80 con 0x7fb28409f040 2024-09-18T01:45:28.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.890+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(65 .bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv11 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fb27c03b040 con 0x7fb28409f040 2024-09-18T01:45:28.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.890+0000 7fb295c13800 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T01:45:28.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.890+0000 7fb295c13800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-18T01:45:28.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.890+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:66 4.33 4:cd49ce18:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55aa72636820 con 0x7fb28409f040 2024-09-18T01:45:28.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.890+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:67 4.10 4:083380d8:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55aa7263b410 con 0x55aa725f3aa0 2024-09-18T01:45:28.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.890+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:68 4.15 4:a8d62d11:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55aa7263dd00 con 0x55aa725f3aa0 2024-09-18T01:45:28.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.890+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:69 4.36 4:6d8e27f1:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55aa72640570 con 0x55aa725ed860 2024-09-18T01:45:28.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.890+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:70 4.19 4:98d692f3:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55aa72642f20 con 0x55aa725f3aa0 2024-09-18T01:45:28.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.890+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:71 4.13 4:cabe8116:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55aa72645910 con 0x7fb28c059040 2024-09-18T01:45:28.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.890+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:72 4.16 4:6b798858:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55aa72645910 con 0x55aa725f3aa0 2024-09-18T01:45:28.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.890+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:73 4.14 4:2ab8464f:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55aa7264ad40 con 0x55aa725f3aa0 2024-09-18T01:45:28.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.890+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:74 4.3e 4:7ce77e2d:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55aa7264dbd0 con 0x7fb28c059040 2024-09-18T01:45:28.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.890+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:75 4.2d 4:b678784f:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55aa72645910 con 0x7fb28409f040 2024-09-18T01:45:28.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.890+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:76 4.10 4:0ad5fa93:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55aa72652ff0 con 0x55aa725f3aa0 2024-09-18T01:45:28.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.890+0000 7fb291267640 1 -- 172.21.15.146:0/1709877550 <== osd.2 v2:172.21.15.146:6800/3820039304 14 ==== osd_op_reply(71 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.5 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fb284057030 con 0x7fb28c059040 2024-09-18T01:45:28.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.890+0000 7fb291a68640 1 -- 172.21.15.146:0/1709877550 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(67 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb28c029070 con 0x55aa725f3aa0 2024-09-18T01:45:28.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.891+0000 7fb291a68640 1 -- 172.21.15.146:0/1709877550 <== osd.3 v2:172.21.15.146:6809/4106661138 15 ==== osd_op_reply(68 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb28c029070 con 0x55aa725f3aa0 2024-09-18T01:45:28.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.891+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(66 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb27c03b040 con 0x7fb28409f040 2024-09-18T01:45:28.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.891+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(69 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb27c03b040 con 0x55aa725ed860 2024-09-18T01:45:28.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.891+0000 7fb291a68640 1 -- 172.21.15.146:0/1709877550 <== osd.3 v2:172.21.15.146:6809/4106661138 16 ==== osd_op_reply(70 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb28c029070 con 0x55aa725f3aa0 2024-09-18T01:45:28.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.891+0000 7fb291267640 1 -- 172.21.15.146:0/1709877550 <== osd.2 v2:172.21.15.146:6800/3820039304 15 ==== osd_op_reply(74 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.8 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fb284057030 con 0x7fb28c059040 2024-09-18T01:45:28.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.891+0000 7fb291a68640 1 -- 172.21.15.146:0/1709877550 <== osd.3 v2:172.21.15.146:6809/4106661138 17 ==== osd_op_reply(72 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.6 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fb28c029070 con 0x55aa725f3aa0 2024-09-18T01:45:28.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.891+0000 7fb291a68640 1 -- 172.21.15.146:0/1709877550 <== osd.3 v2:172.21.15.146:6809/4106661138 18 ==== osd_op_reply(73 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb28c029070 con 0x55aa725f3aa0 2024-09-18T01:45:28.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.891+0000 7fb291a68640 1 -- 172.21.15.146:0/1709877550 <== osd.3 v2:172.21.15.146:6809/4106661138 19 ==== osd_op_reply(76 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.10 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb28c029070 con 0x55aa725f3aa0 2024-09-18T01:45:28.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.891+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(75 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb27c03b040 con 0x7fb28409f040 2024-09-18T01:45:28.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.892+0000 7fb1477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:28.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.892+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94190551700416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55aa72652ff0 con 0x55aa725ed860 2024-09-18T01:45:28.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.893+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94190551700416] v31'151 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb27c03b040 con 0x55aa725ed860 2024-09-18T01:45:28.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.893+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94190551662912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55aa726328a0 con 0x7fb28c059040 2024-09-18T01:45:28.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.894+0000 7fb291267640 1 -- 172.21.15.146:0/1709877550 <== osd.2 v2:172.21.15.146:6800/3820039304 16 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94190551662912] v31'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb284057030 con 0x7fb28c059040 2024-09-18T01:45:28.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.894+0000 7fb295c13800 20 remove_watcher() i=0 2024-09-18T01:45:28.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.894+0000 7fb295c13800 2 removed watcher, disabling cache 2024-09-18T01:45:28.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.894+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94190551666720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55aa726328a0 con 0x55aa725ed860 2024-09-18T01:45:28.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.895+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94190551666720] v31'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb27c03b040 con 0x55aa725ed860 2024-09-18T01:45:28.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.895+0000 7fb295c13800 20 remove_watcher() i=1 2024-09-18T01:45:28.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.895+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94190551668848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55aa726328a0 con 0x55aa725f3aa0 2024-09-18T01:45:28.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.896+0000 7fb291a68640 1 -- 172.21.15.146:0/1709877550 <== osd.3 v2:172.21.15.146:6809/4106661138 20 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94190551668848] v31'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb28c029070 con 0x55aa725f3aa0 2024-09-18T01:45:28.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.896+0000 7fb295c13800 20 remove_watcher() i=2 2024-09-18T01:45:28.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.896+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94190551675472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55aa726328a0 con 0x7fb28c059040 2024-09-18T01:45:28.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.897+0000 7fb291267640 1 -- 172.21.15.146:0/1709877550 <== osd.2 v2:172.21.15.146:6800/3820039304 17 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94190551675472] v31'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb284057030 con 0x7fb28c059040 2024-09-18T01:45:28.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.897+0000 7fb295c13800 20 remove_watcher() i=3 2024-09-18T01:45:28.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.897+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94190551677600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55aa726328a0 con 0x55aa725ed860 2024-09-18T01:45:28.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.898+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94190551677600] v31'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb27c03b040 con 0x55aa725ed860 2024-09-18T01:45:28.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.898+0000 7fb295c13800 20 remove_watcher() i=4 2024-09-18T01:45:28.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.898+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94190551680272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55aa726328a0 con 0x7fb28409f040 2024-09-18T01:45:28.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.899+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94190551680272] v31'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb27c03b040 con 0x7fb28409f040 2024-09-18T01:45:28.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.899+0000 7fb295c13800 20 remove_watcher() i=5 2024-09-18T01:45:28.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.899+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94190551682816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55aa726328a0 con 0x7fb28409f040 2024-09-18T01:45:28.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.900+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 <== osd.0 v2:172.21.15.129:6800/1759265424 22 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94190551682816] v31'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb27c03b040 con 0x7fb28409f040 2024-09-18T01:45:28.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.900+0000 7fb295c13800 20 remove_watcher() i=6 2024-09-18T01:45:28.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.900+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94190551685264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55aa726328a0 con 0x7fb28409f040 2024-09-18T01:45:28.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.901+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 <== osd.0 v2:172.21.15.129:6800/1759265424 23 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94190551685264] v31'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb27c03b040 con 0x7fb28409f040 2024-09-18T01:45:28.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.901+0000 7fb295c13800 20 remove_watcher() i=7 2024-09-18T01:45:28.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.901+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fb28409f040 msgr2=0x7fb284050860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.901+0000 7fb295c13800 1 --2- 172.21.15.146:0/1709877550 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fb28409f040 0x7fb284050860 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.901+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55aa725ed860 msgr2=0x55aa725efd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.901+0000 7fb295c13800 1 --2- 172.21.15.146:0/1709877550 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55aa725ed860 0x55aa725efd20 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.901+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fb28c059040 msgr2=0x7fb28c007050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.901+0000 7fb295c13800 1 --2- 172.21.15.146:0/1709877550 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fb28c059040 0x7fb28c007050 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.901+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55aa725f3aa0 msgr2=0x55aa725f5eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.901+0000 7fb295c13800 1 --2- 172.21.15.146:0/1709877550 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55aa725f3aa0 0x55aa725f5eb0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.901+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb15c036b40 msgr2=0x7fb15c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.901+0000 7fb295c13800 1 --2- 172.21.15.146:0/1709877550 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb15c036b40 0x7fb15c039000 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb284070000 tx=0x7fb28408a000 comp rx=0 tx=0).stop 2024-09-18T01:45:28.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.901+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55aa725db8a0 msgr2=0x55aa725e1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.901+0000 7fb28bfff640 1 -- 172.21.15.146:0/1709877550 reap_dead start 2024-09-18T01:45:28.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.901+0000 7fb295c13800 1 --2- 172.21.15.146:0/1709877550 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55aa725db8a0 0x55aa725e1be0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fb28c0127b0 tx=0x7fb28c04c7f0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.901+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 shutdown_connections 2024-09-18T01:45:28.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.901+0000 7fb295c13800 1 --2- 172.21.15.146:0/1709877550 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55aa725db8a0 0x55aa725e1be0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.901+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 >> 172.21.15.146:0/1709877550 conn(0x55aa725d7c00 msgr2=0x55aa725d5cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:28.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.901+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 shutdown_connections 2024-09-18T01:45:28.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.901+0000 7fb295c13800 1 -- 172.21.15.146:0/1709877550 wait complete. 2024-09-18T01:45:28.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.902+0000 7fb295c13800 1 -- 172.21.15.146:0/4186260185 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb168036b90 msgr2=0x7fb168039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.902+0000 7fb295c13800 1 --2- 172.21.15.146:0/4186260185 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb168036b90 0x7fb168039050 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x55aa725bc7c0 tx=0x7fb28408e5d0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.902+0000 7fb295c13800 1 -- 172.21.15.146:0/4186260185 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55aa725cec20 msgr2=0x55aa725cf040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.902+0000 7fb295c13800 1 --2- 172.21.15.146:0/4186260185 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55aa725cec20 0x55aa725cf040 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x55aa725bb8c0 tx=0x7fb28c0178e0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.902+0000 7fb295c13800 1 -- 172.21.15.146:0/4186260185 shutdown_connections 2024-09-18T01:45:28.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.902+0000 7fb295c13800 1 --2- 172.21.15.146:0/4186260185 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb168036b90 0x7fb168039050 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.902+0000 7fb295c13800 1 --2- 172.21.15.146:0/4186260185 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55aa725cec20 0x55aa725cf040 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.902+0000 7fb295c13800 1 -- 172.21.15.146:0/4186260185 >> 172.21.15.146:0/4186260185 conn(0x55aa725c3bb0 msgr2=0x55aa725c6730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:28.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.902+0000 7fb295c13800 1 -- 172.21.15.146:0/4186260185 shutdown_connections 2024-09-18T01:45:28.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.902+0000 7fb295c13800 1 -- 172.21.15.146:0/4186260185 wait complete. 2024-09-18T01:45:28.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.902+0000 7fb295c13800 1 -- 172.21.15.146:0/2271780582 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55aa724be410 msgr2=0x55aa725baef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.902+0000 7fb295c13800 1 --2- 172.21.15.146:0/2271780582 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55aa724be410 0x55aa725baef0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.902+0000 7fb295c13800 1 -- 172.21.15.146:0/2271780582 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55aa725bcec0 msgr2=0x55aa725c06e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.902+0000 7fb295c13800 1 --2- 172.21.15.146:0/2271780582 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55aa725bcec0 0x55aa725c06e0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.902+0000 7fb295c13800 1 -- 172.21.15.146:0/2271780582 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb178036b90 msgr2=0x7fb178039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.902+0000 7fb295c13800 1 --2- 172.21.15.146:0/2271780582 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb178036b90 0x7fb178039050 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb27c000c00 tx=0x7fb27c0013b0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.902+0000 7fb295c13800 1 -- 172.21.15.146:0/2271780582 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55aa724bdaa0 msgr2=0x55aa725b3e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.902+0000 7fb295c13800 1 --2- 172.21.15.146:0/2271780582 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55aa724bdaa0 0x55aa725b3e80 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fb2840460a0 tx=0x7fb284003020 comp rx=0 tx=0).stop 2024-09-18T01:45:28.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.902+0000 7fb295c13800 1 -- 172.21.15.146:0/2271780582 shutdown_connections 2024-09-18T01:45:28.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.902+0000 7fb295c13800 1 --2- 172.21.15.146:0/2271780582 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55aa725bcec0 0x55aa725c06e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.902+0000 7fb295c13800 1 --2- 172.21.15.146:0/2271780582 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55aa724be410 0x55aa725baef0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.902+0000 7fb295c13800 1 --2- 172.21.15.146:0/2271780582 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb178036b90 0x7fb178039050 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.902+0000 7fb295c13800 1 --2- 172.21.15.146:0/2271780582 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55aa724bdaa0 0x55aa725b3e80 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.902+0000 7fb295c13800 1 -- 172.21.15.146:0/2271780582 >> 172.21.15.146:0/2271780582 conn(0x55aa724b85c0 msgr2=0x55aa725a6790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:28.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.902+0000 7fb295c13800 1 -- 172.21.15.146:0/2271780582 shutdown_connections 2024-09-18T01:45:28.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.902+0000 7fb295c13800 1 -- 172.21.15.146:0/2271780582 wait complete. 2024-09-18T01:45:28.915 INFO:teuthology.orchestra.run.smithi146.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"069822df-7f2c-4cd0-aee2-64a07ebf49c5","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1","marker":"8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-18T01:45:28.356074Z","creation_time":"2024-09-18T01:45:25.639613Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":0,"size_actual":0,"size_utilized":0,"size_kb":0,"size_kb_actual":0,"size_kb_utilized":0,"num_objects":0}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-09-18T01:45:28.915 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '069822df-7f2c-4cd0-aee2-64a07ebf49c5', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1', 'marker': '8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-18T01:45:28.356074Z', 'creation_time': '2024-09-18T01:45:25.639613Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-18T01:45:28.915 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'list'] 2024-09-18T01:45:28.915 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'list'] 2024-09-18T01:45:28.916 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log list 2024-09-18T01:45:28.958 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:28.958 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:28.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.958+0000 7f8d7e126800 1 Processor -- start 2024-09-18T01:45:28.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.958+0000 7f8d7e126800 1 -- start start 2024-09-18T01:45:28.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.958+0000 7f8d7e126800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55896dd46a50 0x55896dd48e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.958+0000 7f8d7e126800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55896dc01b30 con 0x55896dd42750 2024-09-18T01:45:28.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.958+0000 7f8d7e126800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x55896dbe3360 con 0x55896dd46a50 2024-09-18T01:45:28.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.958+0000 7f8d73fff640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55896dd46a50 0x55896dd48e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.958+0000 7f8d79d13640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x55896dd42750 0x55896dd42b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:47400/0 (socket says 172.21.15.146:47400) 2024-09-18T01:45:28.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.958+0000 7f8d79d13640 1 -- 172.21.15.146:0/2315110764 learned_addr learned my addr 172.21.15.146:0/2315110764 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:45:28.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.958+0000 7f8d73fff640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55896dd46a50 0x55896dd48e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:58198/0 (socket says 172.21.15.146:58198) 2024-09-18T01:45:28.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.959+0000 7f8d73fff640 1 -- 172.21.15.146:0/2315110764 >> v1:172.21.15.129:6789/0 conn(0x55896dd42750 legacy=0x55896dd42b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.959+0000 7f8d79512640 1 -- 172.21.15.146:0/2315110764 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3452901690 0 0) 0x55896dc01b30 con 0x55896dd42750 2024-09-18T01:45:28.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.959+0000 7f8d73fff640 1 -- 172.21.15.146:0/2315110764 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55896dc09e00 con 0x55896dd46a50 2024-09-18T01:45:28.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.960+0000 7f8d73fff640 1 --2- 172.21.15.146:0/2315110764 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55896dd46a50 0x55896dd48e40 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f8d6400a470 tx=0x7f8d64045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3c63a31c716dbfd server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.960+0000 7f8d79512640 1 -- 172.21.15.146:0/2315110764 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d64053570 con 0x55896dd46a50 2024-09-18T01:45:28.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.961+0000 7f8d79512640 1 -- 172.21.15.146:0/2315110764 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d64058070 con 0x55896dd46a50 2024-09-18T01:45:28.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.961+0000 7f8d79512640 1 -- 172.21.15.146:0/2315110764 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d64053880 con 0x55896dd46a50 2024-09-18T01:45:28.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.961+0000 7f8d7e126800 1 -- 172.21.15.146:0/2315110764 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55896dd46a50 msgr2=0x55896dd48e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.961+0000 7f8d7e126800 1 --2- 172.21.15.146:0/2315110764 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55896dd46a50 0x55896dd48e40 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f8d6400a470 tx=0x7f8d64045a20 comp rx=0 tx=0).stop 2024-09-18T01:45:28.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.961+0000 7f8d7e126800 1 -- 172.21.15.146:0/2315110764 shutdown_connections 2024-09-18T01:45:28.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.961+0000 7f8d7e126800 1 --2- 172.21.15.146:0/2315110764 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55896dd46a50 0x55896dd48e40 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.961+0000 7f8d7e126800 1 -- 172.21.15.146:0/2315110764 >> 172.21.15.146:0/2315110764 conn(0x55896dd3dfe0 msgr2=0x55896dd40400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:28.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.961+0000 7f8d7e126800 1 -- 172.21.15.146:0/2315110764 shutdown_connections 2024-09-18T01:45:28.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.961+0000 7f8d7e126800 1 -- 172.21.15.146:0/2315110764 wait complete. 2024-09-18T01:45:28.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.975+0000 7f8d7e126800 1 Processor -- start 2024-09-18T01:45:28.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.975+0000 7f8d7e126800 1 -- start start 2024-09-18T01:45:28.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.975+0000 7f8d7e126800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55896dd42750 0x55896de31630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.975+0000 7f8d7e126800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55896dc8e320 con 0x55896dd42750 2024-09-18T01:45:28.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.975+0000 7f8d79d13640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55896dd42750 0x55896de31630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.975+0000 7f8d79d13640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55896dd42750 0x55896de31630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:58210/0 (socket says 172.21.15.146:58210) 2024-09-18T01:45:28.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.975+0000 7f8d79d13640 1 -- 172.21.15.146:0/2562713162 learned_addr learned my addr 172.21.15.146:0/2562713162 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:28.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.976+0000 7f8d79d13640 1 -- 172.21.15.146:0/2562713162 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55896dbdbbc0 con 0x55896dd42750 2024-09-18T01:45:28.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.976+0000 7f8d79d13640 1 --2- 172.21.15.146:0/2562713162 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55896dd42750 0x55896de31630 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c00b240 tx=0x7f8d6c00b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64d4e2b0158b468c server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.976+0000 7f8c67e07640 1 -- 172.21.15.146:0/2562713162 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d6c008070 con 0x55896dd42750 2024-09-18T01:45:28.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.976+0000 7f8c67e07640 1 -- 172.21.15.146:0/2562713162 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d6c00d500 con 0x55896dd42750 2024-09-18T01:45:28.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.976+0000 7f8c67e07640 1 -- 172.21.15.146:0/2562713162 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d6c00d860 con 0x55896dd42750 2024-09-18T01:45:28.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.977+0000 7f8d7e126800 1 -- 172.21.15.146:0/2562713162 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55896dd42750 msgr2=0x55896de31630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:28.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.977+0000 7f8d7e126800 1 --2- 172.21.15.146:0/2562713162 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55896dd42750 0x55896de31630 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c00b240 tx=0x7f8d6c00b700 comp rx=0 tx=0).stop 2024-09-18T01:45:28.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.977+0000 7f8d7e126800 1 -- 172.21.15.146:0/2562713162 shutdown_connections 2024-09-18T01:45:28.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.977+0000 7f8d7e126800 1 --2- 172.21.15.146:0/2562713162 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55896dd42750 0x55896de31630 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:28.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.977+0000 7f8d7e126800 1 -- 172.21.15.146:0/2562713162 >> 172.21.15.146:0/2562713162 conn(0x55896dd3dfe0 msgr2=0x55896de2cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:28.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.977+0000 7f8d7e126800 1 -- 172.21.15.146:0/2562713162 shutdown_connections 2024-09-18T01:45:28.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.977+0000 7f8d7e126800 1 -- 172.21.15.146:0/2562713162 wait complete. 2024-09-18T01:45:28.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.977+0000 7f8d7e126800 1 Processor -- start 2024-09-18T01:45:28.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.977+0000 7f8d7e126800 1 -- start start 2024-09-18T01:45:28.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.977+0000 7f8d7e126800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55896dd42750 0x55896dcb86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.977+0000 7f8d7e126800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55896dd49680 con 0x55896dd42750 2024-09-18T01:45:28.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.977+0000 7f8d79d13640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55896dd42750 0x55896dcb86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.977+0000 7f8d79d13640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55896dd42750 0x55896dcb86b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:58222/0 (socket says 172.21.15.146:58222) 2024-09-18T01:45:28.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.977+0000 7f8d79d13640 1 -- 172.21.15.146:0/4198871140 learned_addr learned my addr 172.21.15.146:0/4198871140 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:28.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.978+0000 7f8d79d13640 1 -- 172.21.15.146:0/4198871140 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55896dbeffe0 con 0x55896dd42750 2024-09-18T01:45:28.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.978+0000 7f8d79d13640 1 --2- 172.21.15.146:0/4198871140 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55896dd42750 0x55896dcb86b0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c000f60 tx=0x7f8d6c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.978+0000 7f8c66604640 1 -- 172.21.15.146:0/4198871140 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d6c019870 con 0x55896dd42750 2024-09-18T01:45:28.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.978+0000 7f8c66604640 1 -- 172.21.15.146:0/4198871140 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d6c019a10 con 0x55896dd42750 2024-09-18T01:45:28.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.978+0000 7f8d7e126800 1 -- 172.21.15.146:0/4198871140 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55896dcb6da0 con 0x55896dd42750 2024-09-18T01:45:28.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.978+0000 7f8c66604640 1 -- 172.21.15.146:0/4198871140 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d6c019d10 con 0x55896dd42750 2024-09-18T01:45:28.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.978+0000 7f8d7e126800 1 -- 172.21.15.146:0/4198871140 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55896dcb72c0 con 0x55896dd42750 2024-09-18T01:45:28.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.979+0000 7f8c66604640 1 -- 172.21.15.146:0/4198871140 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8d6c017040 con 0x55896dd42750 2024-09-18T01:45:28.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.979+0000 7f8c66604640 1 --2- 172.21.15.146:0/4198871140 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8c60036b90 0x7f8c60039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.979+0000 7f8c66604640 1 -- 172.21.15.146:0/4198871140 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f8d6c015020 con 0x55896dd42750 2024-09-18T01:45:28.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.979+0000 7f8d73fff640 1 --2- 172.21.15.146:0/4198871140 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8c60036b90 0x7f8c60039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.979+0000 7f8d7e126800 1 --2- 172.21.15.146:0/4198871140 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55896dd46a50 0x55896de424e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.979+0000 7f8d7e126800 1 -- 172.21.15.146:0/4198871140 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55896de42a20 con 0x55896dd46a50 2024-09-18T01:45:28.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.979+0000 7f8d7a514640 1 --2- 172.21.15.146:0/4198871140 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55896dd46a50 0x55896de424e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.980+0000 7f8d73fff640 1 --2- 172.21.15.146:0/4198871140 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8c60036b90 0x7f8c60039050 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8d64057000 tx=0x7f8d64052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.980+0000 7f8d7a514640 1 --2- 172.21.15.146:0/4198871140 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55896dd46a50 0x55896de424e0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.980+0000 7f8d7a514640 1 -- 172.21.15.146:0/4198871140 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8d7400a4a0 con 0x55896dd46a50 2024-09-18T01:45:28.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.980+0000 7f8d7e126800 1 -- 172.21.15.146:0/4198871140 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55896dcb7620 con 0x55896dd46a50 2024-09-18T01:45:28.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.980+0000 7f8d7a514640 1 -- 172.21.15.146:0/4198871140 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8d7400a4a0 con 0x55896dd46a50 2024-09-18T01:45:28.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.980+0000 7f8d7e126800 1 -- 172.21.15.146:0/4198871140 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55896de447b0 con 0x55896dd46a50 2024-09-18T01:45:28.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.981+0000 7f8d7a514640 1 -- 172.21.15.146:0/4198871140 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8d7400a4a0 con 0x55896dd46a50 2024-09-18T01:45:28.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.981+0000 7f8d7e126800 1 -- 172.21.15.146:0/4198871140 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55896de43a70 con 0x55896dd46a50 2024-09-18T01:45:28.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.981+0000 7f8d7a514640 1 -- 172.21.15.146:0/4198871140 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8d7400a4a0 con 0x55896dd46a50 2024-09-18T01:45:28.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.981+0000 7f8d7e126800 1 --2- 172.21.15.146:0/4198871140 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55896de45b60 0x55896de47f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.981+0000 7f8d7e126800 1 -- 172.21.15.146:0/4198871140 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55896de484d0 con 0x55896de45b60 2024-09-18T01:45:28.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.981+0000 7f8d79d13640 1 --2- 172.21.15.146:0/4198871140 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55896de45b60 0x55896de47f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.981+0000 7f8d79d13640 1 --2- 172.21.15.146:0/4198871140 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55896de45b60 0x55896de47f50 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.982+0000 7f8d79d13640 1 -- 172.21.15.146:0/4198871140 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8d6c02d070 con 0x55896de45b60 2024-09-18T01:45:28.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.982+0000 7f8d7e126800 1 Processor -- start 2024-09-18T01:45:28.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.982+0000 7f8d7e126800 1 -- start start 2024-09-18T01:45:28.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.982+0000 7f8d7e126800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55896de56280 0x55896de566a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.982+0000 7f8d7e126800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55896dcb7c90 con 0x55896de56280 2024-09-18T01:45:28.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.982+0000 7f8d7a514640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55896de56280 0x55896de566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.982+0000 7f8d7a514640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55896de56280 0x55896de566a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:58226/0 (socket says 172.21.15.146:58226) 2024-09-18T01:45:28.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.982+0000 7f8d7a514640 1 -- 172.21.15.146:0/1670989173 learned_addr learned my addr 172.21.15.146:0/1670989173 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:28.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.982+0000 7f8d7a514640 1 -- 172.21.15.146:0/1670989173 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55896de56be0 con 0x55896de56280 2024-09-18T01:45:28.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.983+0000 7f8d7a514640 1 --2- 172.21.15.146:0/1670989173 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55896de56280 0x55896de566a0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x55896dcb7c30 tx=0x7f8d740178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.983+0000 7f8c5f7fe640 1 -- 172.21.15.146:0/1670989173 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d74013570 con 0x55896de56280 2024-09-18T01:45:28.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.983+0000 7f8c5f7fe640 1 -- 172.21.15.146:0/1670989173 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d74013750 con 0x55896de56280 2024-09-18T01:45:28.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.983+0000 7f8d7e126800 1 -- 172.21.15.146:0/1670989173 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55896de56e70 con 0x55896de56280 2024-09-18T01:45:28.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.983+0000 7f8c5f7fe640 1 -- 172.21.15.146:0/1670989173 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d74013a70 con 0x55896de56280 2024-09-18T01:45:28.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.983+0000 7f8d7e126800 1 -- 172.21.15.146:0/1670989173 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55896de59b50 con 0x55896de56280 2024-09-18T01:45:28.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.984+0000 7f8c5f7fe640 1 -- 172.21.15.146:0/1670989173 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8d74011040 con 0x55896de56280 2024-09-18T01:45:28.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.984+0000 7f8c5f7fe640 1 --2- 172.21.15.146:0/1670989173 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8c54036b40 0x7f8c54039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.984+0000 7f8c5f7fe640 1 -- 172.21.15.146:0/1670989173 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f8d7401d070 con 0x55896de56280 2024-09-18T01:45:28.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.984+0000 7f8d79d13640 1 --2- 172.21.15.146:0/1670989173 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8c54036b40 0x7f8c54039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:28.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.984+0000 7f8d7e126800 1 Processor -- start 2024-09-18T01:45:28.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.984+0000 7f8d7e126800 1 -- start start 2024-09-18T01:45:28.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.984+0000 7f8d79d13640 1 --2- 172.21.15.146:0/1670989173 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8c54036b40 0x7f8c54039000 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x55896dcb7540 tx=0x7f8d6c0015f0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:28.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.984+0000 7f8d7e126800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55896de62f70 0x55896de63370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:28.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.984+0000 7f8d7e126800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55896dcb8bf0 con 0x55896de62f70 2024-09-18T01:45:29.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.984+0000 7f8d7a514640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55896de62f70 0x55896de63370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:29.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.984+0000 7f8d7a514640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55896de62f70 0x55896de63370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:58240/0 (socket says 172.21.15.146:58240) 2024-09-18T01:45:29.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.985+0000 7f8d7a514640 1 -- 172.21.15.146:0/1869604874 learned_addr learned my addr 172.21.15.146:0/1869604874 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:29.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.985+0000 7f8d7a514640 1 -- 172.21.15.146:0/1869604874 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55896de63940 con 0x55896de62f70 2024-09-18T01:45:29.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.985+0000 7f8d7a514640 1 --2- 172.21.15.146:0/1869604874 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55896de62f70 0x55896de63370 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f8d7404c8c0 tx=0x7f8d74012ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76cc7c71facc110e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:29.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.985+0000 7f8c5d7fa640 1 -- 172.21.15.146:0/1869604874 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d74045070 con 0x55896de62f70 2024-09-18T01:45:29.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.985+0000 7f8c5d7fa640 1 -- 172.21.15.146:0/1869604874 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d74015950 con 0x55896de62f70 2024-09-18T01:45:29.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.985+0000 7f8c5d7fa640 1 -- 172.21.15.146:0/1869604874 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d74015430 con 0x55896de62f70 2024-09-18T01:45:29.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.985+0000 7f8d7e126800 1 -- 172.21.15.146:0/1869604874 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55896de62f70 msgr2=0x55896de63370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:29.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.985+0000 7f8d7e126800 1 --2- 172.21.15.146:0/1869604874 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55896de62f70 0x55896de63370 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f8d7404c8c0 tx=0x7f8d74012ef0 comp rx=0 tx=0).stop 2024-09-18T01:45:29.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.985+0000 7f8d7e126800 1 -- 172.21.15.146:0/1869604874 shutdown_connections 2024-09-18T01:45:29.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.985+0000 7f8d7e126800 1 --2- 172.21.15.146:0/1869604874 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55896de62f70 0x55896de63370 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:29.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.985+0000 7f8d7e126800 1 -- 172.21.15.146:0/1869604874 >> 172.21.15.146:0/1869604874 conn(0x55896de5f2d0 msgr2=0x55896de5d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:29.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.985+0000 7f8d7e126800 1 -- 172.21.15.146:0/1869604874 shutdown_connections 2024-09-18T01:45:29.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.986+0000 7f8d7e126800 1 -- 172.21.15.146:0/1869604874 wait complete. 2024-09-18T01:45:29.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.986+0000 7f8d7e126800 1 Processor -- start 2024-09-18T01:45:29.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.986+0000 7f8d7e126800 1 -- start start 2024-09-18T01:45:29.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.986+0000 7f8d7e126800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55896de62f70 0x55896de6a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:29.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.986+0000 7f8d7e126800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55896de31de0 con 0x55896de62f70 2024-09-18T01:45:29.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.986+0000 7f8d7a514640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55896de62f70 0x55896de6a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:29.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.986+0000 7f8d7a514640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55896de62f70 0x55896de6a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:58252/0 (socket says 172.21.15.146:58252) 2024-09-18T01:45:29.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.986+0000 7f8d7a514640 1 -- 172.21.15.146:0/3473984288 learned_addr learned my addr 172.21.15.146:0/3473984288 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:29.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.986+0000 7f8d7a514640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55896de6a690 con 0x55896de62f70 2024-09-18T01:45:29.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.987+0000 7f8d7a514640 1 --2- 172.21.15.146:0/3473984288 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55896de62f70 0x55896de6a150 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f8d7404b760 tx=0x7f8d7404c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:29.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.987+0000 7f8c4b7fe640 1 -- 172.21.15.146:0/3473984288 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d74045050 con 0x55896de62f70 2024-09-18T01:45:29.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.987+0000 7f8c4b7fe640 1 -- 172.21.15.146:0/3473984288 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d74046040 con 0x55896de62f70 2024-09-18T01:45:29.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.987+0000 7f8d7e126800 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55896de6a920 con 0x55896de62f70 2024-09-18T01:45:29.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.987+0000 7f8c4b7fe640 1 -- 172.21.15.146:0/3473984288 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d74001520 con 0x55896de62f70 2024-09-18T01:45:29.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.987+0000 7f8d7e126800 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55896de6d5d0 con 0x55896de62f70 2024-09-18T01:45:29.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.987+0000 7f8c4b7fe640 1 -- 172.21.15.146:0/3473984288 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8d7402aa30 con 0x55896de62f70 2024-09-18T01:45:29.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.988+0000 7f8c4b7fe640 1 --2- 172.21.15.146:0/3473984288 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8c44036b90 0x7f8c44039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:29.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.988+0000 7f8c4b7fe640 1 -- 172.21.15.146:0/3473984288 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f8d7400e040 con 0x55896de62f70 2024-09-18T01:45:29.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.988+0000 7f8d79d13640 1 --2- 172.21.15.146:0/3473984288 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8c44036b90 0x7f8c44039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:29.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.988+0000 7f8d7e126800 20 rados->read ofs=0 len=0 2024-09-18T01:45:29.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.988+0000 7f8d7e126800 1 --2- 172.21.15.146:0/3473984288 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55896de75d90 0x55896de78250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:29.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.988+0000 7f8d79d13640 1 --2- 172.21.15.146:0/3473984288 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8c44036b90 0x7f8c44039050 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c00e500 tx=0x7f8d6c032040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:29.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.988+0000 7f8d7e126800 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55896de789a0 con 0x55896de75d90 2024-09-18T01:45:29.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.988+0000 7f8d73fff640 1 --2- 172.21.15.146:0/3473984288 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55896de75d90 0x55896de78250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:29.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.988+0000 7f8d73fff640 1 --2- 172.21.15.146:0/3473984288 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55896de75d90 0x55896de78250 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:29.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.989+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8d64051070 con 0x55896de75d90 2024-09-18T01:45:29.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.989+0000 7f8d7e126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:29.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.989+0000 7f8d7e126800 20 realm 2024-09-18T01:45:29.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.989+0000 7f8d7e126800 20 rados->read ofs=0 len=0 2024-09-18T01:45:29.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.989+0000 7f8d7e126800 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55896de78dd0 con 0x55896de75d90 2024-09-18T01:45:29.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.989+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8d64051070 con 0x55896de75d90 2024-09-18T01:45:29.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.989+0000 7f8d7e126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:29.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.989+0000 7f8d7e126800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:29.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.989+0000 7f8d7e126800 20 rados->read ofs=0 len=0 2024-09-18T01:45:29.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.989+0000 7f8d7e126800 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55896de796a0 con 0x55896de75d90 2024-09-18T01:45:29.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.989+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8d64051070 con 0x55896de75d90 2024-09-18T01:45:29.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.989+0000 7f8d7e126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:29.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.989+0000 7f8d7e126800 20 rados->read ofs=0 len=0 2024-09-18T01:45:29.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.989+0000 7f8d7e126800 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55896de79a40 con 0x55896de75d90 2024-09-18T01:45:29.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.989+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8d64051070 con 0x55896de75d90 2024-09-18T01:45:29.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.989+0000 7f8d7e126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:29.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.989+0000 7f8d7e126800 20 rados->read ofs=0 len=0 2024-09-18T01:45:29.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.989+0000 7f8d7e126800 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55896de792b0 con 0x55896de75d90 2024-09-18T01:45:29.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.990+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8d64051070 con 0x55896de75d90 2024-09-18T01:45:29.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.990+0000 7f8d7e126800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:29.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.990+0000 7f8d7e126800 20 searching for the correct realm 2024-09-18T01:45:29.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.990+0000 7f8d7e126800 1 --2- 172.21.15.146:0/3473984288 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55896de7bf00 0x55896de7e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:29.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.990+0000 7f8d7e126800 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de7e9e0 con 0x55896de7bf00 2024-09-18T01:45:29.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.990+0000 7f8d7a514640 1 --2- 172.21.15.146:0/3473984288 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55896de7bf00 0x55896de7e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:29.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.990+0000 7f8d7a514640 1 --2- 172.21.15.146:0/3473984288 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55896de7bf00 0x55896de7e310 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:29.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.990+0000 7f8d7a514640 1 -- 172.21.15.146:0/3473984288 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d7403b020 con 0x55896de7bf00 2024-09-18T01:45:29.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.990+0000 7f8d7a514640 1 --2- 172.21.15.146:0/3473984288 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f8d7402b610 0x7f8d74022640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:29.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.990+0000 7f8d7a514640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de7e9e0 con 0x7f8d7402b610 2024-09-18T01:45:29.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.990+0000 7f8d79d13640 1 --2- 172.21.15.146:0/3473984288 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f8d7402b610 0x7f8d74022640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:29.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.991+0000 7f8d79d13640 1 --2- 172.21.15.146:0/3473984288 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f8d7402b610 0x7f8d74022640 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:29.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.991+0000 7f8d79d13640 1 -- 172.21.15.146:0/3473984288 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d6c044d70 con 0x7f8d7402b610 2024-09-18T01:45:29.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.991+0000 7f8d79d13640 1 --2- 172.21.15.146:0/3473984288 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f8d6c018ab0 0x7f8d6c00f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:29.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.991+0000 7f8d79d13640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de7e9e0 con 0x7f8d6c018ab0 2024-09-18T01:45:29.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.991+0000 7f8d73fff640 1 --2- 172.21.15.146:0/3473984288 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f8d6c018ab0 0x7f8d6c00f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:29.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.992+0000 7f8d73fff640 1 --2- 172.21.15.146:0/3473984288 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f8d6c018ab0 0x7f8d6c00f470 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:29.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.992+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d64051070 con 0x7f8d6c018ab0 2024-09-18T01:45:29.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.992+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de7e9e0 con 0x55896de75d90 2024-09-18T01:45:29.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.992+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8d64051070 con 0x55896de75d90 2024-09-18T01:45:29.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.992+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de7e9e0 con 0x55896de75d90 2024-09-18T01:45:29.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.992+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d64051070 con 0x55896de75d90 2024-09-18T01:45:29.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.992+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de7e9e0 con 0x7f8d6c018ab0 2024-09-18T01:45:29.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.993+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d64051070 con 0x7f8d6c018ab0 2024-09-18T01:45:29.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.993+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de7e9e0 con 0x7f8d6c018ab0 2024-09-18T01:45:29.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.993+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d64051070 con 0x7f8d6c018ab0 2024-09-18T01:45:29.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.993+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de7e9e0 con 0x7f8d7402b610 2024-09-18T01:45:29.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.993+0000 7f8d79d13640 1 -- 172.21.15.146:0/3473984288 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d6c044d70 con 0x7f8d7402b610 2024-09-18T01:45:29.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.993+0000 7f8d79d13640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de7e9e0 con 0x55896de7bf00 2024-09-18T01:45:29.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.993+0000 7f8d7a514640 1 -- 172.21.15.146:0/3473984288 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d7403b020 con 0x55896de7bf00 2024-09-18T01:45:29.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.993+0000 7f8d7a514640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de7e9e0 con 0x55896de75d90 2024-09-18T01:45:29.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.993+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d64051070 con 0x55896de75d90 2024-09-18T01:45:29.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.994+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de7e9e0 con 0x7f8d6c018ab0 2024-09-18T01:45:29.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.994+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d64051070 con 0x7f8d6c018ab0 2024-09-18T01:45:29.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.994+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de7e9e0 con 0x55896de75d90 2024-09-18T01:45:29.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.994+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d64051070 con 0x55896de75d90 2024-09-18T01:45:29.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.994+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de7e9e0 con 0x7f8d7402b610 2024-09-18T01:45:29.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.994+0000 7f8d79d13640 1 -- 172.21.15.146:0/3473984288 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f8d6c044d70 con 0x7f8d7402b610 2024-09-18T01:45:29.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.994+0000 7f8d79d13640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de7e9e0 con 0x55896de7bf00 2024-09-18T01:45:29.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.994+0000 7f8d7a514640 1 -- 172.21.15.146:0/3473984288 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d7403b020 con 0x55896de7bf00 2024-09-18T01:45:29.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.994+0000 7f8d7a514640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de7e9e0 con 0x55896de7bf00 2024-09-18T01:45:29.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.995+0000 7f8d7a514640 1 -- 172.21.15.146:0/3473984288 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d7403b020 con 0x55896de7bf00 2024-09-18T01:45:29.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.995+0000 7f8d7a514640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de7e9e0 con 0x7f8d6c018ab0 2024-09-18T01:45:29.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.995+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d64051070 con 0x7f8d6c018ab0 2024-09-18T01:45:29.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.995+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de7e9e0 con 0x55896de7bf00 2024-09-18T01:45:29.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.995+0000 7f8d7a514640 1 -- 172.21.15.146:0/3473984288 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d7403b020 con 0x55896de7bf00 2024-09-18T01:45:29.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.995+0000 7f8d7a514640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de7e9e0 con 0x55896de7bf00 2024-09-18T01:45:29.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.995+0000 7f8d7a514640 1 -- 172.21.15.146:0/3473984288 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d7403b020 con 0x55896de7bf00 2024-09-18T01:45:29.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.995+0000 7f8d7a514640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de7e9e0 con 0x55896de75d90 2024-09-18T01:45:29.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.996+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d64051070 con 0x55896de75d90 2024-09-18T01:45:29.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.996+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de7e9e0 con 0x55896de75d90 2024-09-18T01:45:29.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.996+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8d64051070 con 0x55896de75d90 2024-09-18T01:45:29.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.996+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de7e9e0 con 0x7f8d6c018ab0 2024-09-18T01:45:29.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.996+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d64051070 con 0x7f8d6c018ab0 2024-09-18T01:45:29.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.996+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de7e9e0 con 0x55896de7bf00 2024-09-18T01:45:29.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.997+0000 7f8d7a514640 1 -- 172.21.15.146:0/3473984288 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d7403b020 con 0x55896de7bf00 2024-09-18T01:45:29.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.997+0000 7f8d7a514640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de7e9e0 con 0x7f8d7402b610 2024-09-18T01:45:29.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.997+0000 7f8d79d13640 1 -- 172.21.15.146:0/3473984288 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d6c044d70 con 0x7f8d7402b610 2024-09-18T01:45:29.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.997+0000 7f8d79d13640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de7e9e0 con 0x55896de75d90 2024-09-18T01:45:29.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.997+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d64051070 con 0x55896de75d90 2024-09-18T01:45:29.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.997+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de7e9e0 con 0x7f8d6c018ab0 2024-09-18T01:45:29.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.997+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d64051070 con 0x7f8d6c018ab0 2024-09-18T01:45:29.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.997+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de7e9e0 con 0x55896de7bf00 2024-09-18T01:45:29.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.997+0000 7f8d7a514640 1 -- 172.21.15.146:0/3473984288 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d7403b020 con 0x55896de7bf00 2024-09-18T01:45:29.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.997+0000 7f8d7a514640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de7e9e0 con 0x7f8d6c018ab0 2024-09-18T01:45:29.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.998+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d64051070 con 0x7f8d6c018ab0 2024-09-18T01:45:29.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.998+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de7e9e0 con 0x7f8d7402b610 2024-09-18T01:45:29.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.998+0000 7f8d79d13640 1 -- 172.21.15.146:0/3473984288 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d6c044d70 con 0x7f8d7402b610 2024-09-18T01:45:29.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.998+0000 7f8d79d13640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de7e9e0 con 0x55896de7bf00 2024-09-18T01:45:29.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.998+0000 7f8d7a514640 1 -- 172.21.15.146:0/3473984288 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d7403b020 con 0x55896de7bf00 2024-09-18T01:45:29.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.998+0000 7f8d7a514640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de7e9e0 con 0x7f8d6c018ab0 2024-09-18T01:45:29.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.998+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d64051070 con 0x7f8d6c018ab0 2024-09-18T01:45:29.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.998+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de7e9e0 con 0x55896de75d90 2024-09-18T01:45:29.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.999+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8d64051070 con 0x55896de75d90 2024-09-18T01:45:29.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.999+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de7e9e0 con 0x7f8d7402b610 2024-09-18T01:45:29.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.999+0000 7f8d79d13640 1 -- 172.21.15.146:0/3473984288 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d6c044d70 con 0x7f8d7402b610 2024-09-18T01:45:29.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.999+0000 7f8d7e126800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:29.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.999+0000 7f8d7e126800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:29.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.999+0000 7f8d7e126800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:29.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.999+0000 7f8d7e126800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:29.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.999+0000 7f8d7e126800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:29.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.999+0000 7f8d7e126800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:29.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.999+0000 7f8d7e126800 20 rados->read ofs=0 len=0 2024-09-18T01:45:29.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.999+0000 7f8d7e126800 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55896de7a950 con 0x55896de75d90 2024-09-18T01:45:29.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.999+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8d64051070 con 0x55896de75d90 2024-09-18T01:45:29.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.999+0000 7f8d7e126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:29.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.999+0000 7f8d7e126800 20 rados->read ofs=0 len=0 2024-09-18T01:45:29.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:28.999+0000 7f8d7e126800 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55896de7b1f0 con 0x55896de75d90 2024-09-18T01:45:29.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.000+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8d64051070 con 0x55896de75d90 2024-09-18T01:45:29.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.000+0000 7f8d7e126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:29.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.000+0000 7f8d7e126800 20 rados->read ofs=0 len=0 2024-09-18T01:45:29.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.000+0000 7f8d7e126800 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55896de7a590 con 0x7f8d7402b610 2024-09-18T01:45:29.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.000+0000 7f8d79d13640 1 -- 172.21.15.146:0/3473984288 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8d6c044d70 con 0x7f8d7402b610 2024-09-18T01:45:29.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.000+0000 7f8d7e126800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:29.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.000+0000 7f8d7e126800 20 zone default found 2024-09-18T01:45:29.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.000+0000 7f8d7e126800 4 Realm: () 2024-09-18T01:45:29.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.000+0000 7f8d7e126800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:29.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.000+0000 7f8d7e126800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:29.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.000+0000 7f8d7e126800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:29.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.000+0000 7f8d7e126800 20 zonegroup default 2024-09-18T01:45:29.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.000+0000 7f8d7e126800 20 rados->read ofs=0 len=0 2024-09-18T01:45:29.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.000+0000 7f8d7e126800 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55896de7f310 con 0x7f8d6c018ab0 2024-09-18T01:45:29.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.000+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8d64051070 con 0x7f8d6c018ab0 2024-09-18T01:45:29.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.000+0000 7f8d7e126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:29.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.000+0000 7f8d7e126800 20 rados->read ofs=0 len=0 2024-09-18T01:45:29.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.000+0000 7f8d7e126800 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55896de80e70 con 0x55896de7bf00 2024-09-18T01:45:29.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.000+0000 7f8d7a514640 1 -- 172.21.15.146:0/3473984288 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8d7403b020 con 0x55896de7bf00 2024-09-18T01:45:29.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.000+0000 7f8d7e126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:29.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.000+0000 7f8d7e126800 20 rados->read ofs=0 len=0 2024-09-18T01:45:29.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.000+0000 7f8d7e126800 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55896de812e0 con 0x55896de7bf00 2024-09-18T01:45:29.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.001+0000 7f8d7a514640 1 -- 172.21.15.146:0/3473984288 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8d7403b020 con 0x55896de7bf00 2024-09-18T01:45:29.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.001+0000 7f8d7e126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:29.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.001+0000 7f8d7e126800 20 started sync module instance, tier type = 2024-09-18T01:45:29.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.001+0000 7f8d7e126800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:29.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.001+0000 7f8d7e126800 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55896de7fd70 con 0x7f8d7402b610 2024-09-18T01:45:29.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.002+0000 7f8d79d13640 1 -- 172.21.15.146:0/3473984288 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v31'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d6c044d70 con 0x7f8d7402b610 2024-09-18T01:45:29.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.002+0000 7f8d7e126800 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94048742801760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55896de7f9d0 con 0x7f8d7402b610 2024-09-18T01:45:29.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.002+0000 7f8d7e126800 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55896de821f0 con 0x55896de75d90 2024-09-18T01:45:29.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.003+0000 7f8d79d13640 1 -- 172.21.15.146:0/3473984288 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94048742801760] v31'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d6c044d70 con 0x7f8d7402b610 2024-09-18T01:45:29.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.003+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v31'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d64051070 con 0x55896de75d90 2024-09-18T01:45:29.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.003+0000 7f8d7e126800 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94048742808896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55896de82160 con 0x55896de75d90 2024-09-18T01:45:29.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.003+0000 7f8d7e126800 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55896de830b0 con 0x55896de7bf00 2024-09-18T01:45:29.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.004+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94048742808896] v31'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d64051070 con 0x55896de75d90 2024-09-18T01:45:29.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.004+0000 7f8d7a514640 1 -- 172.21.15.146:0/3473984288 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v31'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d7403b020 con 0x55896de7bf00 2024-09-18T01:45:29.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.004+0000 7f8d7e126800 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94048742811104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55896de830b0 con 0x55896de7bf00 2024-09-18T01:45:29.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.004+0000 7f8d7e126800 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55896de83b70 con 0x7f8d7402b610 2024-09-18T01:45:29.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.005+0000 7f8d79d13640 1 -- 172.21.15.146:0/3473984288 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v31'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d6c044d70 con 0x7f8d7402b610 2024-09-18T01:45:29.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.005+0000 7f8d7e126800 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94048742815296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55896de84410 con 0x7f8d7402b610 2024-09-18T01:45:29.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.005+0000 7f8d7e126800 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55896de84ef0 con 0x55896de75d90 2024-09-18T01:45:29.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.006+0000 7f8d7a514640 1 -- 172.21.15.146:0/3473984288 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94048742811104] v31'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d7403b020 con 0x55896de7bf00 2024-09-18T01:45:29.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.006+0000 7f8d79d13640 1 -- 172.21.15.146:0/3473984288 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94048742815296] v31'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d6c044d70 con 0x7f8d7402b610 2024-09-18T01:45:29.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.007+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v31'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d64051070 con 0x55896de75d90 2024-09-18T01:45:29.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.007+0000 7f8d7e126800 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94048742817632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55896de84a00 con 0x55896de75d90 2024-09-18T01:45:29.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.007+0000 7f8d7e126800 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55896de857c0 con 0x7f8d6c018ab0 2024-09-18T01:45:29.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.008+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94048742817632] v31'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d64051070 con 0x55896de75d90 2024-09-18T01:45:29.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.008+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v31'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d64051070 con 0x7f8d6c018ab0 2024-09-18T01:45:29.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.009+0000 7f8d7e126800 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94048742812672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55896de85770 con 0x7f8d6c018ab0 2024-09-18T01:45:29.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.009+0000 7f8d7e126800 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55896de86130 con 0x7f8d6c018ab0 2024-09-18T01:45:29.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.009+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94048742812672] v31'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d64051070 con 0x7f8d6c018ab0 2024-09-18T01:45:29.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.010+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v31'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d64051070 con 0x7f8d6c018ab0 2024-09-18T01:45:29.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.010+0000 7f8d7e126800 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94048742822592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55896de86310 con 0x7f8d6c018ab0 2024-09-18T01:45:29.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.010+0000 7f8d7e126800 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55896de86b60 con 0x7f8d6c018ab0 2024-09-18T01:45:29.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.010+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(58 notify.7 [create] v31'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d64051070 con 0x7f8d6c018ab0 2024-09-18T01:45:29.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.010+0000 7f8d7e126800 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94048742827248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55896de86f40 con 0x7f8d6c018ab0 2024-09-18T01:45:29.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.010+0000 7f8d7e126800 20 add_watcher() i=0 2024-09-18T01:45:29.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.010+0000 7f8d7e126800 20 add_watcher() i=1 2024-09-18T01:45:29.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.010+0000 7f8d7e126800 20 add_watcher() i=2 2024-09-18T01:45:29.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.010+0000 7f8d7e126800 20 add_watcher() i=3 2024-09-18T01:45:29.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.010+0000 7f8d7e126800 20 add_watcher() i=4 2024-09-18T01:45:29.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.010+0000 7f8d7e126800 20 add_watcher() i=5 2024-09-18T01:45:29.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.011+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94048742822592] v31'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d64051070 con 0x7f8d6c018ab0 2024-09-18T01:45:29.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.011+0000 7f8d7e126800 20 add_watcher() i=6 2024-09-18T01:45:29.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.011+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94048742827248] v31'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d64051070 con 0x7f8d6c018ab0 2024-09-18T01:45:29.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.011+0000 7f8d7e126800 20 add_watcher() i=7 2024-09-18T01:45:29.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.011+0000 7f8d7e126800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:29.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.011+0000 7f8d7e126800 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55896de85e60 con 0x55896de75d90 2024-09-18T01:45:29.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.012+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8d64051070 con 0x55896de75d90 2024-09-18T01:45:29.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.012+0000 7f8d7e126800 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94048742828496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55896de85e60 con 0x55896de75d90 2024-09-18T01:45:29.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.013+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94048742828496] v31'152 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8d64051070 con 0x55896de75d90 2024-09-18T01:45:29.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.013+0000 7f8c2b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:29.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.013+0000 7f8d7e126800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:29.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.013+0000 7f8d7e126800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:29.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.013+0000 7f8d7e126800 5 note: GC not initialized 2024-09-18T01:45:29.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.013+0000 7f8c2a7fc640 20 reqs_thread_entry: start 2024-09-18T01:45:29.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.013+0000 7f8d7e126800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:29.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.013+0000 7f8d7e126800 20 Filter name: none 2024-09-18T01:45:29.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.013+0000 7f8b9bfff640 20 reqs_thread_entry: start 2024-09-18T01:45:29.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.013+0000 7f8d7e126800 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:62 6.0 6:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896debc720 con 0x7f8d6c018ab0 2024-09-18T01:45:29.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.014+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(62 [pgnls start_epoch 31 out=254b] v31'46 uv30 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f8d64051070 con 0x7f8d6c018ab0 2024-09-18T01:45:29.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.014+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:63 6.10 6:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de7b1f0 con 0x7f8d6c018ab0 2024-09-18T01:45:29.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.014+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(63 [pgnls start_epoch 31 out=131b] v31'4 uv4 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f8d64087040 con 0x7f8d6c018ab0 2024-09-18T01:45:29.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.014+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:64 6.8 6:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de7b1f0 con 0x55896de7bf00 2024-09-18T01:45:29.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.015+0000 7f8d7a514640 1 -- 172.21.15.146:0/3473984288 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(64 [pgnls start_epoch 31 out=295b] v31'35 uv27 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f8d7403b020 con 0x55896de7bf00 2024-09-18T01:45:29.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.015+0000 7f8d7a514640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:65 6.18 6:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de812e0 con 0x7f8d6c018ab0 2024-09-18T01:45:29.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.015+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(65 [pgnls start_epoch 31 out=172b] v31'23 uv15 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f8d64087040 con 0x7f8d6c018ab0 2024-09-18T01:45:29.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.015+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:66 6.4 6:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de812e0 con 0x55896de75d90 2024-09-18T01:45:29.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.015+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(66 [pgnls start_epoch 31 out=335b] v31'152 uv29 ondisk = 1) ==== 144+0+335 (crc 0 0 0) 0x7f8d64087040 con 0x55896de75d90 2024-09-18T01:45:29.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.015+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:67 6.14 6:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de812e0 con 0x7f8d7402b610 2024-09-18T01:45:29.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.016+0000 7f8d79d13640 1 -- 172.21.15.146:0/3473984288 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(67 [pgnls start_epoch 31 out=213b] v31'23 uv23 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f8d6c044d70 con 0x7f8d7402b610 2024-09-18T01:45:29.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.016+0000 7f8d79d13640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:68 6.c 6:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de84410 con 0x55896de7bf00 2024-09-18T01:45:29.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.016+0000 7f8d7a514640 1 -- 172.21.15.146:0/3473984288 <== osd.3 v2:172.21.15.146:6809/4106661138 15 ==== osd_op_reply(68 [pgnls start_epoch 31 out=254b] v31'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f8d7403b020 con 0x55896de7bf00 2024-09-18T01:45:29.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.016+0000 7f8d7a514640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:69 6.1c 6:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de84410 con 0x55896de7bf00 2024-09-18T01:45:29.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.016+0000 7f8d7a514640 1 -- 172.21.15.146:0/3473984288 <== osd.3 v2:172.21.15.146:6809/4106661138 16 ==== osd_op_reply(69 [pgnls start_epoch 31 out=295b] v31'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f8d7403b020 con 0x55896de7bf00 2024-09-18T01:45:29.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.016+0000 7f8d7a514640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:70 6.2 6:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de84410 con 0x55896de7bf00 2024-09-18T01:45:29.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.016+0000 7f8d7a514640 1 -- 172.21.15.146:0/3473984288 <== osd.3 v2:172.21.15.146:6809/4106661138 17 ==== osd_op_reply(70 [pgnls start_epoch 31 out=213b] v31'16 uv16 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f8d7403b020 con 0x55896de7bf00 2024-09-18T01:45:29.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.016+0000 7f8d7a514640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:71 6.12 6:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de84410 con 0x7f8d7402b610 2024-09-18T01:45:29.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.017+0000 7f8d79d13640 1 -- 172.21.15.146:0/3473984288 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(71 [pgnls start_epoch 31 out=172b] v31'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f8d6c044d70 con 0x7f8d7402b610 2024-09-18T01:45:29.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.017+0000 7f8d79d13640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:72 6.a 6:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de84410 con 0x7f8d7402b610 2024-09-18T01:45:29.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.017+0000 7f8d79d13640 1 -- 172.21.15.146:0/3473984288 <== osd.2 v2:172.21.15.146:6800/3820039304 14 ==== osd_op_reply(72 [pgnls start_epoch 31 out=336b] v31'33 uv25 ondisk = 1) ==== 144+0+336 (crc 0 0 0) 0x7f8d6c044d70 con 0x7f8d7402b610 2024-09-18T01:45:29.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.017+0000 7f8d79d13640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:73 6.1a 6:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de84410 con 0x55896de7bf00 2024-09-18T01:45:29.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.017+0000 7f8d7a514640 1 -- 172.21.15.146:0/3473984288 <== osd.3 v2:172.21.15.146:6809/4106661138 18 ==== osd_op_reply(73 [pgnls start_epoch 31 out=131b] v31'29 uv21 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f8d7403b020 con 0x55896de7bf00 2024-09-18T01:45:29.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.017+0000 7f8d7a514640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:74 6.6 6:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de84410 con 0x55896de7bf00 2024-09-18T01:45:29.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.018+0000 7f8d7a514640 1 -- 172.21.15.146:0/3473984288 <== osd.3 v2:172.21.15.146:6809/4106661138 19 ==== osd_op_reply(74 [pgnls start_epoch 31 out=254b] v31'12 uv12 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f8d7403b020 con 0x55896de7bf00 2024-09-18T01:45:29.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.018+0000 7f8d7a514640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:75 6.16 6:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de84410 con 0x55896de7bf00 2024-09-18T01:45:29.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.018+0000 7f8d7a514640 1 -- 172.21.15.146:0/3473984288 <== osd.3 v2:172.21.15.146:6809/4106661138 20 ==== osd_op_reply(75 [pgnls start_epoch 31 out=90b] v31'30 uv21 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f8d7403b020 con 0x55896de7bf00 2024-09-18T01:45:29.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.018+0000 7f8d7a514640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:76 6.e 6:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de84410 con 0x55896de75d90 2024-09-18T01:45:29.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.018+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(76 [pgnls start_epoch 31 out=213b] v31'25 uv17 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f8d64087040 con 0x55896de75d90 2024-09-18T01:45:29.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.018+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:77 6.1e 6:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de84410 con 0x55896de7bf00 2024-09-18T01:45:29.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.018+0000 7f8d7a514640 1 -- 172.21.15.146:0/3473984288 <== osd.3 v2:172.21.15.146:6809/4106661138 21 ==== osd_op_reply(77 [pgnls start_epoch 31 out=254b] v31'16 uv16 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f8d7403b020 con 0x55896de7bf00 2024-09-18T01:45:29.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.018+0000 7f8d7a514640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:78 6.1 6:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de84410 con 0x55896de75d90 2024-09-18T01:45:29.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.019+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(78 [pgnls start_epoch 31 out=254b] v31'20 uv20 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f8d64087040 con 0x55896de75d90 2024-09-18T01:45:29.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.019+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:79 6.11 6:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de84410 con 0x55896de7bf00 2024-09-18T01:45:29.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.019+0000 7f8d7a514640 1 -- 172.21.15.146:0/3473984288 <== osd.3 v2:172.21.15.146:6809/4106661138 22 ==== osd_op_reply(79 [pgnls start_epoch 31 out=213b] v31'25 uv17 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f8d7403b020 con 0x55896de7bf00 2024-09-18T01:45:29.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.019+0000 7f8d7a514640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:80 6.9 6:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de84410 con 0x55896de7bf00 2024-09-18T01:45:29.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.019+0000 7f8d7a514640 1 -- 172.21.15.146:0/3473984288 <== osd.3 v2:172.21.15.146:6809/4106661138 23 ==== osd_op_reply(80 [pgnls start_epoch 31 out=172b] v31'42 uv26 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f8d7403b020 con 0x55896de7bf00 2024-09-18T01:45:29.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.019+0000 7f8d7a514640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:81 6.19 6:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de84410 con 0x55896de75d90 2024-09-18T01:45:29.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.020+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(81 [pgnls start_epoch 31 out=295b] v31'48 uv39 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f8d64087040 con 0x55896de75d90 2024-09-18T01:45:29.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.020+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:82 6.5 6:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de84410 con 0x7f8d7402b610 2024-09-18T01:45:29.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.020+0000 7f8d79d13640 1 -- 172.21.15.146:0/3473984288 <== osd.2 v2:172.21.15.146:6800/3820039304 15 ==== osd_op_reply(82 [pgnls start_epoch 31 out=276b] v31'15 uv15 ondisk = 1) ==== 144+0+276 (crc 0 0 0) 0x7f8d6c044d70 con 0x7f8d7402b610 2024-09-18T01:45:29.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.020+0000 7f8d79d13640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:83 6.15 6:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de84410 con 0x7f8d7402b610 2024-09-18T01:45:29.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.020+0000 7f8d79d13640 1 -- 172.21.15.146:0/3473984288 <== osd.2 v2:172.21.15.146:6800/3820039304 16 ==== osd_op_reply(83 [pgnls start_epoch 31 out=172b] v31'23 uv15 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f8d6c044d70 con 0x7f8d7402b610 2024-09-18T01:45:29.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.020+0000 7f8d79d13640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:84 6.d 6:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de84410 con 0x55896de75d90 2024-09-18T01:45:29.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.020+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(84 [pgnls start_epoch 31 out=295b] v31'25 uv17 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f8d64087040 con 0x55896de75d90 2024-09-18T01:45:29.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.020+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:85 6.1d 6:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de84410 con 0x7f8d6c018ab0 2024-09-18T01:45:29.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.021+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(85 [pgnls start_epoch 31 out=172b] v31'34 uv18 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f8d64087040 con 0x7f8d6c018ab0 2024-09-18T01:45:29.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.021+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:86 6.3 6:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de84410 con 0x7f8d7402b610 2024-09-18T01:45:29.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.021+0000 7f8d79d13640 1 -- 172.21.15.146:0/3473984288 <== osd.2 v2:172.21.15.146:6800/3820039304 17 ==== osd_op_reply(86 [pgnls start_epoch 31 out=213b] v31'49 uv25 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f8d6c044d70 con 0x7f8d7402b610 2024-09-18T01:45:29.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.021+0000 7f8d79d13640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:87 6.13 6:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de84410 con 0x7f8d6c018ab0 2024-09-18T01:45:29.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.022+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== osd_op_reply(87 [pgnls start_epoch 31 out=172b] v31'19 uv11 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f8d64087040 con 0x7f8d6c018ab0 2024-09-18T01:45:29.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.022+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:88 6.b 6:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de84410 con 0x55896de7bf00 2024-09-18T01:45:29.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.022+0000 7f8d7a514640 1 -- 172.21.15.146:0/3473984288 <== osd.3 v2:172.21.15.146:6809/4106661138 24 ==== osd_op_reply(88 [pgnls start_epoch 31 out=172b] v31'23 uv15 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f8d7403b020 con 0x55896de7bf00 2024-09-18T01:45:29.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.022+0000 7f8d7a514640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:89 6.1b 6:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de84410 con 0x55896de7bf00 2024-09-18T01:45:29.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.022+0000 7f8d7a514640 1 -- 172.21.15.146:0/3473984288 <== osd.3 v2:172.21.15.146:6809/4106661138 25 ==== osd_op_reply(89 [pgnls start_epoch 31 out=90b] v31'19 uv11 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f8d7403b020 con 0x55896de7bf00 2024-09-18T01:45:29.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.022+0000 7f8d7a514640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:90 6.7 6:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de84410 con 0x55896de7bf00 2024-09-18T01:45:29.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.022+0000 7f8d7a514640 1 -- 172.21.15.146:0/3473984288 <== osd.3 v2:172.21.15.146:6809/4106661138 26 ==== osd_op_reply(90 [pgnls start_epoch 31 out=90b] v31'43 uv19 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f8d7403b020 con 0x55896de7bf00 2024-09-18T01:45:29.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.022+0000 7f8d7a514640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:91 6.17 6:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55896de84410 con 0x55896de75d90 2024-09-18T01:45:29.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.023+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== osd_op_reply(91 [pgnls start_epoch 31 out=131b] v31'12 uv12 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f8d64087040 con 0x55896de75d90 2024-09-18T01:45:29.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.023+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:92 6.f 6:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8d6408ec60 con 0x7f8d7402b610 2024-09-18T01:45:29.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.023+0000 7f8d79d13640 1 -- 172.21.15.146:0/3473984288 <== osd.2 v2:172.21.15.146:6800/3820039304 18 ==== osd_op_reply(92 [pgnls start_epoch 31 out=295b] v31'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f8d6c044d70 con 0x7f8d7402b610 2024-09-18T01:45:29.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.023+0000 7f8d79d13640 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:93 6.1f 6:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8d6408ec60 con 0x7f8d6c018ab0 2024-09-18T01:45:29.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.023+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 <== osd.0 v2:172.21.15.129:6800/1759265424 22 ==== osd_op_reply(93 [pgnls start_epoch 31 out=213b] v31'26 uv17 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f8d64087040 con 0x7f8d6c018ab0 2024-09-18T01:45:29.034 INFO:teuthology.orchestra.run.smithi146.stdout:["obj_delete_at_hint.0000000078","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","obj_delete_at_hint.0000000040","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_loggenerations_metadata","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","obj_delete_at_hint.0000000027","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","obj_delete_at_hint.0000000067","obj_delete_at_hint.0000000086","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2024-09-18T01:45:29.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.025+0000 7f8c2b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:29.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.025+0000 7f8d7e126800 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94048742828496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55896de7b1f0 con 0x55896de75d90 2024-09-18T01:45:29.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.026+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 <== osd.1 v2:172.21.15.146:6808/3930274777 28 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94048742828496] v31'153 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8d64087040 con 0x55896de75d90 2024-09-18T01:45:29.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.026+0000 7f8d7e126800 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94048742801760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55896de7b1f0 con 0x7f8d7402b610 2024-09-18T01:45:29.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.027+0000 7f8d79d13640 1 -- 172.21.15.146:0/3473984288 <== osd.2 v2:172.21.15.146:6800/3820039304 19 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94048742801760] v31'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d6c044d70 con 0x7f8d7402b610 2024-09-18T01:45:29.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.027+0000 7f8d7e126800 20 remove_watcher() i=0 2024-09-18T01:45:29.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.027+0000 7f8d7e126800 2 removed watcher, disabling cache 2024-09-18T01:45:29.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.027+0000 7f8d7e126800 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94048742808896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55896debc6e0 con 0x55896de75d90 2024-09-18T01:45:29.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.028+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 <== osd.1 v2:172.21.15.146:6808/3930274777 29 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94048742808896] v31'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d64087040 con 0x55896de75d90 2024-09-18T01:45:29.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.028+0000 7f8d7e126800 20 remove_watcher() i=1 2024-09-18T01:45:29.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.028+0000 7f8d7e126800 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94048742811104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55896debc6e0 con 0x55896de7bf00 2024-09-18T01:45:29.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.029+0000 7f8d7a514640 1 -- 172.21.15.146:0/3473984288 <== osd.3 v2:172.21.15.146:6809/4106661138 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94048742811104] v31'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d7403b020 con 0x55896de7bf00 2024-09-18T01:45:29.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.029+0000 7f8d7e126800 20 remove_watcher() i=2 2024-09-18T01:45:29.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.029+0000 7f8d7e126800 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94048742815296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55896debab70 con 0x7f8d7402b610 2024-09-18T01:45:29.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.030+0000 7f8d79d13640 1 -- 172.21.15.146:0/3473984288 <== osd.2 v2:172.21.15.146:6800/3820039304 20 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94048742815296] v31'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d6c044d70 con 0x7f8d7402b610 2024-09-18T01:45:29.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.030+0000 7f8d7e126800 20 remove_watcher() i=3 2024-09-18T01:45:29.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.030+0000 7f8d7e126800 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94048742817632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55896debab70 con 0x55896de75d90 2024-09-18T01:45:29.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.031+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 <== osd.1 v2:172.21.15.146:6808/3930274777 30 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94048742817632] v31'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d64087040 con 0x55896de75d90 2024-09-18T01:45:29.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.031+0000 7f8d7e126800 20 remove_watcher() i=4 2024-09-18T01:45:29.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.031+0000 7f8d7e126800 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94048742812672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55896debab70 con 0x7f8d6c018ab0 2024-09-18T01:45:29.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.032+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 <== osd.0 v2:172.21.15.129:6800/1759265424 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94048742812672] v31'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d64087040 con 0x7f8d6c018ab0 2024-09-18T01:45:29.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.032+0000 7f8d7e126800 20 remove_watcher() i=5 2024-09-18T01:45:29.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.032+0000 7f8d7e126800 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94048742822592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55896debab70 con 0x7f8d6c018ab0 2024-09-18T01:45:29.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.033+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 <== osd.0 v2:172.21.15.129:6800/1759265424 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94048742822592] v31'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d64087040 con 0x7f8d6c018ab0 2024-09-18T01:45:29.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.033+0000 7f8d7e126800 20 remove_watcher() i=6 2024-09-18T01:45:29.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.033+0000 7f8d7e126800 1 -- 172.21.15.146:0/3473984288 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94048742827248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55896debab70 con 0x7f8d6c018ab0 2024-09-18T01:45:29.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.034+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 <== osd.0 v2:172.21.15.129:6800/1759265424 25 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94048742827248] v31'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d64087040 con 0x7f8d6c018ab0 2024-09-18T01:45:29.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.034+0000 7f8d7e126800 20 remove_watcher() i=7 2024-09-18T01:45:29.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.034+0000 7f8d7e126800 1 -- 172.21.15.146:0/3473984288 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f8d6c018ab0 msgr2=0x7f8d6c00f470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:29.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.034+0000 7f8d7e126800 1 --2- 172.21.15.146:0/3473984288 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f8d6c018ab0 0x7f8d6c00f470 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:29.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.034+0000 7f8d7e126800 1 -- 172.21.15.146:0/3473984288 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55896de75d90 msgr2=0x55896de78250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:29.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.034+0000 7f8d7e126800 1 --2- 172.21.15.146:0/3473984288 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55896de75d90 0x55896de78250 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:29.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.034+0000 7f8d7e126800 1 -- 172.21.15.146:0/3473984288 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f8d7402b610 msgr2=0x7f8d74022640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:29.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.034+0000 7f8d7e126800 1 --2- 172.21.15.146:0/3473984288 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f8d7402b610 0x7f8d74022640 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:29.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.034+0000 7f8d7e126800 1 -- 172.21.15.146:0/3473984288 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55896de7bf00 msgr2=0x55896de7e310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:29.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.034+0000 7f8d7e126800 1 --2- 172.21.15.146:0/3473984288 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55896de7bf00 0x55896de7e310 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:29.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.035+0000 7f8d7e126800 1 -- 172.21.15.146:0/3473984288 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8c44036b90 msgr2=0x7f8c44039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:29.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.035+0000 7f8d7e126800 1 --2- 172.21.15.146:0/3473984288 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8c44036b90 0x7f8c44039050 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c00e500 tx=0x7f8d6c032040 comp rx=0 tx=0).stop 2024-09-18T01:45:29.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.035+0000 7f8d7e126800 1 -- 172.21.15.146:0/3473984288 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55896de62f70 msgr2=0x55896de6a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:29.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.035+0000 7f8d7e126800 1 --2- 172.21.15.146:0/3473984288 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55896de62f70 0x55896de6a150 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f8d7404b760 tx=0x7f8d7404c820 comp rx=0 tx=0).stop 2024-09-18T01:45:29.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.035+0000 7f8d73fff640 1 -- 172.21.15.146:0/3473984288 reap_dead start 2024-09-18T01:45:29.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.035+0000 7f8d7e126800 1 -- 172.21.15.146:0/3473984288 shutdown_connections 2024-09-18T01:45:29.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.035+0000 7f8d7e126800 1 --2- 172.21.15.146:0/3473984288 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55896de62f70 0x55896de6a150 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:29.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.035+0000 7f8d7e126800 1 -- 172.21.15.146:0/3473984288 >> 172.21.15.146:0/3473984288 conn(0x55896de5f2d0 msgr2=0x55896de5d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:29.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.035+0000 7f8d7e126800 1 -- 172.21.15.146:0/3473984288 shutdown_connections 2024-09-18T01:45:29.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.035+0000 7f8d7e126800 1 -- 172.21.15.146:0/3473984288 wait complete. 2024-09-18T01:45:29.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.035+0000 7f8d7e126800 1 -- 172.21.15.146:0/1670989173 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8c54036b40 msgr2=0x7f8c54039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:29.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.035+0000 7f8d7e126800 1 --2- 172.21.15.146:0/1670989173 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8c54036b40 0x7f8c54039000 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x55896dcb7540 tx=0x7f8d6c0015f0 comp rx=0 tx=0).stop 2024-09-18T01:45:29.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.035+0000 7f8d7e126800 1 -- 172.21.15.146:0/1670989173 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55896de56280 msgr2=0x55896de566a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:29.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.035+0000 7f8d7e126800 1 --2- 172.21.15.146:0/1670989173 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55896de56280 0x55896de566a0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x55896dcb7c30 tx=0x7f8d740178e0 comp rx=0 tx=0).stop 2024-09-18T01:45:29.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.035+0000 7f8d7e126800 1 -- 172.21.15.146:0/1670989173 shutdown_connections 2024-09-18T01:45:29.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.035+0000 7f8d7e126800 1 --2- 172.21.15.146:0/1670989173 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8c54036b40 0x7f8c54039000 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:29.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.035+0000 7f8d7e126800 1 --2- 172.21.15.146:0/1670989173 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55896de56280 0x55896de566a0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:29.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.035+0000 7f8d7e126800 1 -- 172.21.15.146:0/1670989173 >> 172.21.15.146:0/1670989173 conn(0x55896de4b210 msgr2=0x55896de4dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:29.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.035+0000 7f8d7e126800 1 -- 172.21.15.146:0/1670989173 shutdown_connections 2024-09-18T01:45:29.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.035+0000 7f8d7e126800 1 -- 172.21.15.146:0/1670989173 wait complete. 2024-09-18T01:45:29.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.036+0000 7f8d7e126800 1 -- 172.21.15.146:0/4198871140 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55896dd46a50 msgr2=0x55896de424e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:29.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.036+0000 7f8d7e126800 1 --2- 172.21.15.146:0/4198871140 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55896dd46a50 0x55896de424e0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:29.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.036+0000 7f8d7e126800 1 -- 172.21.15.146:0/4198871140 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55896de45b60 msgr2=0x55896de47f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:29.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.036+0000 7f8d7e126800 1 --2- 172.21.15.146:0/4198871140 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55896de45b60 0x55896de47f50 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:29.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.036+0000 7f8d7e126800 1 -- 172.21.15.146:0/4198871140 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8c60036b90 msgr2=0x7f8c60039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:29.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.036+0000 7f8d7e126800 1 --2- 172.21.15.146:0/4198871140 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8c60036b90 0x7f8c60039050 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8d64057000 tx=0x7f8d64052000 comp rx=0 tx=0).stop 2024-09-18T01:45:29.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.036+0000 7f8d7e126800 1 -- 172.21.15.146:0/4198871140 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55896dd42750 msgr2=0x55896dcb86b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:29.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.036+0000 7f8d7e126800 1 --2- 172.21.15.146:0/4198871140 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55896dd42750 0x55896dcb86b0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c000f60 tx=0x7f8d6c000ed0 comp rx=0 tx=0).stop 2024-09-18T01:45:29.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.036+0000 7f8d7e126800 1 -- 172.21.15.146:0/4198871140 shutdown_connections 2024-09-18T01:45:29.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.036+0000 7f8d7e126800 1 --2- 172.21.15.146:0/4198871140 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55896de45b60 0x55896de47f50 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:29.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.036+0000 7f8d7e126800 1 --2- 172.21.15.146:0/4198871140 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55896dd46a50 0x55896de424e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:29.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.036+0000 7f8d7e126800 1 --2- 172.21.15.146:0/4198871140 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8c60036b90 0x7f8c60039050 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:29.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.036+0000 7f8d7e126800 1 --2- 172.21.15.146:0/4198871140 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55896dd42750 0x55896dcb86b0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:29.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.036+0000 7f8d7e126800 1 -- 172.21.15.146:0/4198871140 >> 172.21.15.146:0/4198871140 conn(0x55896dd3dfe0 msgr2=0x55896de2b860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:29.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.036+0000 7f8d7e126800 1 -- 172.21.15.146:0/4198871140 shutdown_connections 2024-09-18T01:45:29.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.036+0000 7f8d7e126800 1 -- 172.21.15.146:0/4198871140 wait complete. 2024-09-18T01:45:29.045 DEBUG:tasks.util.rgw: json result: ['obj_delete_at_hint.0000000078', 'obj_delete_at_hint.0000000070', 'obj_delete_at_hint.0000000104', 'obj_delete_at_hint.0000000026', 'obj_delete_at_hint.0000000028', 'obj_delete_at_hint.0000000040', 'obj_delete_at_hint.0000000015', 'obj_delete_at_hint.0000000069', 'obj_delete_at_hint.0000000095', 'obj_delete_at_hint.0000000003', 'obj_delete_at_hint.0000000047', 'obj_delete_at_hint.0000000035', 'obj_delete_at_hint.0000000037', 'obj_delete_at_hint.0000000024', 'obj_delete_at_hint.0000000000', 'obj_delete_at_hint.0000000031', 'data_loggenerations_metadata', 'obj_delete_at_hint.0000000076', 'obj_delete_at_hint.0000000113', 'obj_delete_at_hint.0000000005', 'obj_delete_at_hint.0000000011', 'obj_delete_at_hint.0000000058', 'obj_delete_at_hint.0000000052', 'obj_delete_at_hint.0000000088', 'obj_delete_at_hint.0000000080', 'obj_delete_at_hint.0000000090', 'obj_delete_at_hint.0000000110', 'obj_delete_at_hint.0000000096', 'obj_delete_at_hint.0000000087', 'obj_delete_at_hint.0000000008', 'obj_delete_at_hint.0000000006', 'obj_delete_at_hint.0000000029', 'obj_delete_at_hint.0000000089', 'obj_delete_at_hint.0000000022', 'obj_delete_at_hint.0000000016', 'obj_delete_at_hint.0000000041', 'obj_delete_at_hint.0000000018', 'obj_delete_at_hint.0000000092', 'obj_delete_at_hint.0000000014', 'obj_delete_at_hint.0000000112', 'obj_delete_at_hint.0000000007', 'obj_delete_at_hint.0000000021', 'obj_delete_at_hint.0000000064', 'obj_delete_at_hint.0000000071', 'obj_delete_at_hint.0000000074', 'obj_delete_at_hint.0000000081', 'obj_delete_at_hint.0000000009', 'obj_delete_at_hint.0000000121', 'obj_delete_at_hint.0000000125', 'obj_delete_at_hint.0000000082', 'obj_delete_at_hint.0000000105', 'obj_delete_at_hint.0000000059', 'obj_delete_at_hint.0000000077', 'obj_delete_at_hint.0000000032', 'obj_delete_at_hint.0000000053', 'obj_delete_at_hint.0000000091', 'obj_delete_at_hint.0000000065', 'obj_delete_at_hint.0000000083', 'obj_delete_at_hint.0000000010', 'obj_delete_at_hint.0000000045', 'obj_delete_at_hint.0000000002', 'obj_delete_at_hint.0000000116', 'obj_delete_at_hint.0000000034', 'obj_delete_at_hint.0000000101', 'obj_delete_at_hint.0000000079', 'obj_delete_at_hint.0000000049', 'obj_delete_at_hint.0000000117', 'obj_delete_at_hint.0000000044', 'obj_delete_at_hint.0000000066', 'obj_delete_at_hint.0000000068', 'obj_delete_at_hint.0000000085', 'obj_delete_at_hint.0000000073', 'obj_delete_at_hint.0000000038', 'obj_delete_at_hint.0000000118', 'obj_delete_at_hint.0000000036', 'obj_delete_at_hint.0000000103', 'obj_delete_at_hint.0000000119', 'obj_delete_at_hint.0000000098', 'obj_delete_at_hint.0000000027', 'obj_delete_at_hint.0000000019', 'obj_delete_at_hint.0000000039', 'obj_delete_at_hint.0000000100', 'obj_delete_at_hint.0000000093', 'obj_delete_at_hint.0000000004', 'obj_delete_at_hint.0000000063', 'obj_delete_at_hint.0000000122', 'obj_delete_at_hint.0000000057', 'obj_delete_at_hint.0000000054', 'obj_delete_at_hint.0000000114', 'data_log.0', 'obj_delete_at_hint.0000000012', 'obj_delete_at_hint.0000000084', 'obj_delete_at_hint.0000000043', 'obj_delete_at_hint.0000000111', 'obj_delete_at_hint.0000000048', 'obj_delete_at_hint.0000000020', 'obj_delete_at_hint.0000000099', 'obj_delete_at_hint.0000000056', 'obj_delete_at_hint.0000000072', 'obj_delete_at_hint.0000000062', 'obj_delete_at_hint.0000000115', 'obj_delete_at_hint.0000000033', 'obj_delete_at_hint.0000000025', 'obj_delete_at_hint.0000000123', 'obj_delete_at_hint.0000000108', 'obj_delete_at_hint.0000000094', 'obj_delete_at_hint.0000000060', 'obj_delete_at_hint.0000000109', 'obj_delete_at_hint.0000000013', 'obj_delete_at_hint.0000000051', 'obj_delete_at_hint.0000000106', 'obj_delete_at_hint.0000000017', 'obj_delete_at_hint.0000000023', 'obj_delete_at_hint.0000000107', 'obj_delete_at_hint.0000000046', 'obj_delete_at_hint.0000000067', 'obj_delete_at_hint.0000000086', 'obj_delete_at_hint.0000000050', 'obj_delete_at_hint.0000000102', 'obj_delete_at_hint.0000000124', 'obj_delete_at_hint.0000000001', 'obj_delete_at_hint.0000000126', 'obj_delete_at_hint.0000000055', 'obj_delete_at_hint.0000000061', 'obj_delete_at_hint.0000000097', 'obj_delete_at_hint.0000000042', 'obj_delete_at_hint.0000000075', 'obj_delete_at_hint.0000000120', 'obj_delete_at_hint.0000000030'] 2024-09-18T01:45:29.046 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-18T01:45:29.046 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-18T01:45:29.046 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-18T01:45:29.130 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:29.130 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:29.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.130+0000 7f68242b5800 1 Processor -- start 2024-09-18T01:45:29.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.130+0000 7f68242b5800 1 -- start start 2024-09-18T01:45:29.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.130+0000 7f68242b5800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55baa650d9d0 0x55baa650fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:29.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.130+0000 7f68242b5800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55baa63c8b30 con 0x55baa647d5d0 2024-09-18T01:45:29.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.130+0000 7f68242b5800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x55baa63aa360 con 0x55baa650d9d0 2024-09-18T01:45:29.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.130+0000 7f681bfff640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55baa650d9d0 0x55baa650fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:29.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.130+0000 7f6821da9640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x55baa647d5d0 0x55baa650c2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:47408/0 (socket says 172.21.15.146:47408) 2024-09-18T01:45:29.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.130+0000 7f6821da9640 1 -- 172.21.15.146:0/4138443804 learned_addr learned my addr 172.21.15.146:0/4138443804 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:45:29.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.131+0000 7f681bfff640 1 -- 172.21.15.146:0/4138443804 >> v1:172.21.15.129:6789/0 conn(0x55baa647d5d0 legacy=0x55baa650c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:29.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.131+0000 7f68215a8640 1 -- 172.21.15.146:0/4138443804 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1683134797 0 0) 0x55baa63c8b30 con 0x55baa647d5d0 2024-09-18T01:45:29.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.131+0000 7f681bfff640 1 -- 172.21.15.146:0/4138443804 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55baa63d0e00 con 0x55baa650d9d0 2024-09-18T01:45:29.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.133+0000 7f681bfff640 1 --2- 172.21.15.146:0/4138443804 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55baa650d9d0 0x55baa650fdc0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f680c00a470 tx=0x7f680c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fda9928d19069bbc server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:29.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.133+0000 7f68215a8640 1 -- 172.21.15.146:0/4138443804 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f680c053570 con 0x55baa650d9d0 2024-09-18T01:45:29.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.133+0000 7f68215a8640 1 -- 172.21.15.146:0/4138443804 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f680c058070 con 0x55baa650d9d0 2024-09-18T01:45:29.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.133+0000 7f68215a8640 1 -- 172.21.15.146:0/4138443804 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f680c053880 con 0x55baa650d9d0 2024-09-18T01:45:29.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.133+0000 7f68242b5800 1 -- 172.21.15.146:0/4138443804 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55baa650d9d0 msgr2=0x55baa650fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:29.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.133+0000 7f68242b5800 1 --2- 172.21.15.146:0/4138443804 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55baa650d9d0 0x55baa650fdc0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f680c00a470 tx=0x7f680c045a20 comp rx=0 tx=0).stop 2024-09-18T01:45:29.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.133+0000 7f68242b5800 1 -- 172.21.15.146:0/4138443804 shutdown_connections 2024-09-18T01:45:29.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.133+0000 7f68242b5800 1 --2- 172.21.15.146:0/4138443804 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55baa650d9d0 0x55baa650fdc0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:29.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.133+0000 7f68242b5800 1 -- 172.21.15.146:0/4138443804 >> 172.21.15.146:0/4138443804 conn(0x55baa6503de0 msgr2=0x55baa6506200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:29.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.133+0000 7f68242b5800 1 -- 172.21.15.146:0/4138443804 shutdown_connections 2024-09-18T01:45:29.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.133+0000 7f68242b5800 1 -- 172.21.15.146:0/4138443804 wait complete. 2024-09-18T01:45:29.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.147+0000 7f68242b5800 1 Processor -- start 2024-09-18T01:45:29.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.147+0000 7f68242b5800 1 -- start start 2024-09-18T01:45:29.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.147+0000 7f68242b5800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55baa647d5d0 0x55baa6509be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:29.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.147+0000 7f68242b5800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55baa6455330 con 0x55baa647d5d0 2024-09-18T01:45:29.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.147+0000 7f6821da9640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55baa647d5d0 0x55baa6509be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:29.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.147+0000 7f6821da9640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55baa647d5d0 0x55baa6509be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:58270/0 (socket says 172.21.15.146:58270) 2024-09-18T01:45:29.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.147+0000 7f6821da9640 1 -- 172.21.15.146:0/3386698176 learned_addr learned my addr 172.21.15.146:0/3386698176 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:29.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.148+0000 7f6821da9640 1 -- 172.21.15.146:0/3386698176 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55baa63a2bc0 con 0x55baa647d5d0 2024-09-18T01:45:29.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.148+0000 7f6821da9640 1 --2- 172.21.15.146:0/3386698176 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55baa647d5d0 0x55baa6509be0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f681400b240 tx=0x7f681400b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d38b18b153f2b75 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:29.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.148+0000 7f670fe07640 1 -- 172.21.15.146:0/3386698176 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6814008070 con 0x55baa647d5d0 2024-09-18T01:45:29.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.148+0000 7f670fe07640 1 -- 172.21.15.146:0/3386698176 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f681400d500 con 0x55baa647d5d0 2024-09-18T01:45:29.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.148+0000 7f670fe07640 1 -- 172.21.15.146:0/3386698176 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f681400d860 con 0x55baa647d5d0 2024-09-18T01:45:29.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.149+0000 7f68242b5800 1 -- 172.21.15.146:0/3386698176 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55baa647d5d0 msgr2=0x55baa6509be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:29.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.149+0000 7f68242b5800 1 --2- 172.21.15.146:0/3386698176 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55baa647d5d0 0x55baa6509be0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f681400b240 tx=0x7f681400b700 comp rx=0 tx=0).stop 2024-09-18T01:45:29.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.149+0000 7f68242b5800 1 -- 172.21.15.146:0/3386698176 shutdown_connections 2024-09-18T01:45:29.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.149+0000 7f68242b5800 1 --2- 172.21.15.146:0/3386698176 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55baa647d5d0 0x55baa6509be0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:29.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.149+0000 7f68242b5800 1 -- 172.21.15.146:0/3386698176 >> 172.21.15.146:0/3386698176 conn(0x55baa6503de0 msgr2=0x55baa65f3fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:29.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.149+0000 7f68242b5800 1 -- 172.21.15.146:0/3386698176 shutdown_connections 2024-09-18T01:45:29.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.149+0000 7f68242b5800 1 -- 172.21.15.146:0/3386698176 wait complete. 2024-09-18T01:45:29.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.149+0000 7f68242b5800 1 Processor -- start 2024-09-18T01:45:29.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.149+0000 7f68242b5800 1 -- start start 2024-09-18T01:45:29.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.149+0000 7f68242b5800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55baa647d5d0 0x55baa66022b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:29.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.149+0000 7f68242b5800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55baa6510690 con 0x55baa647d5d0 2024-09-18T01:45:29.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.149+0000 7f6821da9640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55baa647d5d0 0x55baa66022b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:29.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.150+0000 7f6821da9640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55baa647d5d0 0x55baa66022b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:58284/0 (socket says 172.21.15.146:58284) 2024-09-18T01:45:29.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.150+0000 7f6821da9640 1 -- 172.21.15.146:0/4123553901 learned_addr learned my addr 172.21.15.146:0/4123553901 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:29.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.150+0000 7f6821da9640 1 -- 172.21.15.146:0/4123553901 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55baa63b6fe0 con 0x55baa647d5d0 2024-09-18T01:45:29.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.150+0000 7f6821da9640 1 --2- 172.21.15.146:0/4123553901 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55baa647d5d0 0x55baa66022b0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x55baa65092e0 tx=0x7f6814000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:29.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.150+0000 7f670e604640 1 -- 172.21.15.146:0/4123553901 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6814019870 con 0x55baa647d5d0 2024-09-18T01:45:29.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.150+0000 7f670e604640 1 -- 172.21.15.146:0/4123553901 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6814019a10 con 0x55baa647d5d0 2024-09-18T01:45:29.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.150+0000 7f68242b5800 1 -- 172.21.15.146:0/4123553901 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55baa66027f0 con 0x55baa647d5d0 2024-09-18T01:45:29.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.150+0000 7f670e604640 1 -- 172.21.15.146:0/4123553901 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6814019d30 con 0x55baa647d5d0 2024-09-18T01:45:29.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.150+0000 7f68242b5800 1 -- 172.21.15.146:0/4123553901 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55baa6602d10 con 0x55baa647d5d0 2024-09-18T01:45:29.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.151+0000 7f670e604640 1 -- 172.21.15.146:0/4123553901 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6814017040 con 0x55baa647d5d0 2024-09-18T01:45:29.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.151+0000 7f670e604640 1 --2- 172.21.15.146:0/4123553901 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6708036b90 0x7f6708039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:29.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.151+0000 7f670e604640 1 -- 172.21.15.146:0/4123553901 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f6814015020 con 0x55baa647d5d0 2024-09-18T01:45:29.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.151+0000 7f681bfff640 1 --2- 172.21.15.146:0/4123553901 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6708036b90 0x7f6708039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:29.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.151+0000 7f68242b5800 1 --2- 172.21.15.146:0/4123553901 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55baa650d9d0 0x55baa6609320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:29.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.151+0000 7f68242b5800 1 -- 172.21.15.146:0/4123553901 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55baa66098a0 con 0x55baa650d9d0 2024-09-18T01:45:29.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.152+0000 7f68225aa640 1 --2- 172.21.15.146:0/4123553901 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55baa650d9d0 0x55baa6609320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:29.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.152+0000 7f681bfff640 1 --2- 172.21.15.146:0/4123553901 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6708036b90 0x7f6708039050 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f680c057000 tx=0x7f680c052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:29.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.152+0000 7f68225aa640 1 --2- 172.21.15.146:0/4123553901 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55baa650d9d0 0x55baa6609320 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:29.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.152+0000 7f68225aa640 1 -- 172.21.15.146:0/4123553901 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f681c00a4a0 con 0x55baa650d9d0 2024-09-18T01:45:29.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.152+0000 7f68242b5800 1 -- 172.21.15.146:0/4123553901 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55baa66068f0 con 0x55baa650d9d0 2024-09-18T01:45:29.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.152+0000 7f68225aa640 1 -- 172.21.15.146:0/4123553901 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f681c00a4a0 con 0x55baa650d9d0 2024-09-18T01:45:29.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.152+0000 7f68242b5800 1 -- 172.21.15.146:0/4123553901 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55baa660b6c0 con 0x55baa650d9d0 2024-09-18T01:45:29.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.153+0000 7f68225aa640 1 -- 172.21.15.146:0/4123553901 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f681c00a4a0 con 0x55baa650d9d0 2024-09-18T01:45:29.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.153+0000 7f68242b5800 1 -- 172.21.15.146:0/4123553901 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55baa660a8f0 con 0x55baa650d9d0 2024-09-18T01:45:29.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.153+0000 7f68225aa640 1 -- 172.21.15.146:0/4123553901 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f681c00a4a0 con 0x55baa650d9d0 2024-09-18T01:45:29.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.153+0000 7f68242b5800 1 --2- 172.21.15.146:0/4123553901 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55baa660ca70 0x55baa660ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:29.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.153+0000 7f68242b5800 1 -- 172.21.15.146:0/4123553901 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55baa660f3a0 con 0x55baa660ca70 2024-09-18T01:45:29.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.153+0000 7f6821da9640 1 --2- 172.21.15.146:0/4123553901 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55baa660ca70 0x55baa660ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:29.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.153+0000 7f6821da9640 1 --2- 172.21.15.146:0/4123553901 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55baa660ca70 0x55baa660ee60 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:29.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.154+0000 7f6821da9640 1 -- 172.21.15.146:0/4123553901 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f681402d070 con 0x55baa660ca70 2024-09-18T01:45:29.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.154+0000 7f68242b5800 1 Processor -- start 2024-09-18T01:45:29.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.154+0000 7f68242b5800 1 -- start start 2024-09-18T01:45:29.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.154+0000 7f68242b5800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55baa661d020 0x55baa661d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:29.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.154+0000 7f68242b5800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55baa63a4580 con 0x55baa661d020 2024-09-18T01:45:29.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.154+0000 7f68225aa640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55baa661d020 0x55baa661d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:29.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.155+0000 7f68225aa640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55baa661d020 0x55baa661d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:58288/0 (socket says 172.21.15.146:58288) 2024-09-18T01:45:29.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.155+0000 7f68225aa640 1 -- 172.21.15.146:0/3526238164 learned_addr learned my addr 172.21.15.146:0/3526238164 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:29.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.155+0000 7f68225aa640 1 -- 172.21.15.146:0/3526238164 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55baa661d980 con 0x55baa661d020 2024-09-18T01:45:29.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.155+0000 7f68225aa640 1 --2- 172.21.15.146:0/3526238164 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55baa661d020 0x55baa661d440 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x55baa66036b0 tx=0x7f681c0178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:29.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.155+0000 7f67077fe640 1 -- 172.21.15.146:0/3526238164 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f681c013440 con 0x55baa661d020 2024-09-18T01:45:29.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.155+0000 7f67077fe640 1 -- 172.21.15.146:0/3526238164 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f681c0135e0 con 0x55baa661d020 2024-09-18T01:45:29.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.155+0000 7f68242b5800 1 -- 172.21.15.146:0/3526238164 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55baa661dc10 con 0x55baa661d020 2024-09-18T01:45:29.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.155+0000 7f67077fe640 1 -- 172.21.15.146:0/3526238164 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f681c0138c0 con 0x55baa661d020 2024-09-18T01:45:29.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.155+0000 7f68242b5800 1 -- 172.21.15.146:0/3526238164 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55baa66208f0 con 0x55baa661d020 2024-09-18T01:45:29.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.156+0000 7f67077fe640 1 -- 172.21.15.146:0/3526238164 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f681c011040 con 0x55baa661d020 2024-09-18T01:45:29.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.156+0000 7f67077fe640 1 --2- 172.21.15.146:0/3526238164 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f66fc036b90 0x7f66fc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:29.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.156+0000 7f67077fe640 1 -- 172.21.15.146:0/3526238164 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f681c01d070 con 0x55baa661d020 2024-09-18T01:45:29.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.156+0000 7f6821da9640 1 --2- 172.21.15.146:0/3526238164 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f66fc036b90 0x7f66fc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:29.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.156+0000 7f68242b5800 1 Processor -- start 2024-09-18T01:45:29.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.156+0000 7f6821da9640 1 --2- 172.21.15.146:0/3526238164 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f66fc036b90 0x7f66fc039050 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6814001630 tx=0x7f681404b640 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:29.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.156+0000 7f68242b5800 1 -- start start 2024-09-18T01:45:29.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.157+0000 7f68242b5800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55baa6629cc0 0x55baa662a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:29.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.157+0000 7f68242b5800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55baa65082b0 con 0x55baa6629cc0 2024-09-18T01:45:29.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.157+0000 7f68225aa640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55baa6629cc0 0x55baa662a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:29.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.157+0000 7f68225aa640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55baa6629cc0 0x55baa662a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:58304/0 (socket says 172.21.15.146:58304) 2024-09-18T01:45:29.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.157+0000 7f68225aa640 1 -- 172.21.15.146:0/1147683497 learned_addr learned my addr 172.21.15.146:0/1147683497 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:29.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.157+0000 7f68225aa640 1 -- 172.21.15.146:0/1147683497 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55baa662a690 con 0x55baa6629cc0 2024-09-18T01:45:29.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.157+0000 7f68225aa640 1 --2- 172.21.15.146:0/1147683497 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55baa6629cc0 0x55baa662a0c0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f681c04c8c0 tx=0x7f681c001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58bc25026d545bd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:29.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.157+0000 7f67057fa640 1 -- 172.21.15.146:0/1147683497 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f681c027040 con 0x55baa6629cc0 2024-09-18T01:45:29.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.157+0000 7f67057fa640 1 -- 172.21.15.146:0/1147683497 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f681c012cc0 con 0x55baa6629cc0 2024-09-18T01:45:29.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.157+0000 7f67057fa640 1 -- 172.21.15.146:0/1147683497 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f681c04b250 con 0x55baa6629cc0 2024-09-18T01:45:29.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.158+0000 7f68242b5800 1 -- 172.21.15.146:0/1147683497 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55baa6629cc0 msgr2=0x55baa662a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:29.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.158+0000 7f68242b5800 1 --2- 172.21.15.146:0/1147683497 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55baa6629cc0 0x55baa662a0c0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f681c04c8c0 tx=0x7f681c001940 comp rx=0 tx=0).stop 2024-09-18T01:45:29.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.158+0000 7f68242b5800 1 -- 172.21.15.146:0/1147683497 shutdown_connections 2024-09-18T01:45:29.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.158+0000 7f68242b5800 1 --2- 172.21.15.146:0/1147683497 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55baa6629cc0 0x55baa662a0c0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:29.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.158+0000 7f68242b5800 1 -- 172.21.15.146:0/1147683497 >> 172.21.15.146:0/1147683497 conn(0x55baa6626020 msgr2=0x55baa6624120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:29.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.158+0000 7f68242b5800 1 -- 172.21.15.146:0/1147683497 shutdown_connections 2024-09-18T01:45:29.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.158+0000 7f68242b5800 1 -- 172.21.15.146:0/1147683497 wait complete. 2024-09-18T01:45:29.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.158+0000 7f68242b5800 1 Processor -- start 2024-09-18T01:45:29.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.158+0000 7f68242b5800 1 -- start start 2024-09-18T01:45:29.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.158+0000 7f68242b5800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55baa6629cc0 0x55baa6631130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:29.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.158+0000 7f68242b5800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55baa662ad00 con 0x55baa6629cc0 2024-09-18T01:45:29.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.158+0000 7f68225aa640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55baa6629cc0 0x55baa6631130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:29.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.159+0000 7f68225aa640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55baa6629cc0 0x55baa6631130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:58310/0 (socket says 172.21.15.146:58310) 2024-09-18T01:45:29.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.159+0000 7f68225aa640 1 -- 172.21.15.146:0/3759343737 learned_addr learned my addr 172.21.15.146:0/3759343737 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:29.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.159+0000 7f68225aa640 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55baa6631670 con 0x55baa6629cc0 2024-09-18T01:45:29.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.159+0000 7f68225aa640 1 --2- 172.21.15.146:0/3759343737 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55baa6629cc0 0x55baa6631130 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f681c04b7b0 tx=0x7f681c04c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:29.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.159+0000 7f66f37fe640 1 -- 172.21.15.146:0/3759343737 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f681c027070 con 0x55baa6629cc0 2024-09-18T01:45:29.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.159+0000 7f66f37fe640 1 -- 172.21.15.146:0/3759343737 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f681c013e30 con 0x55baa6629cc0 2024-09-18T01:45:29.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.159+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55baa6631900 con 0x55baa6629cc0 2024-09-18T01:45:29.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.159+0000 7f66f37fe640 1 -- 172.21.15.146:0/3759343737 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f681c02aa60 con 0x55baa6629cc0 2024-09-18T01:45:29.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.159+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55baa66345b0 con 0x55baa6629cc0 2024-09-18T01:45:29.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.160+0000 7f66f37fe640 1 -- 172.21.15.146:0/3759343737 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f681c02ac00 con 0x55baa6629cc0 2024-09-18T01:45:29.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.160+0000 7f66f37fe640 1 --2- 172.21.15.146:0/3759343737 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f66ec036b90 0x7f66ec039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:29.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.160+0000 7f66f37fe640 1 -- 172.21.15.146:0/3759343737 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f681c033070 con 0x55baa6629cc0 2024-09-18T01:45:29.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.160+0000 7f6821da9640 1 --2- 172.21.15.146:0/3759343737 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f66ec036b90 0x7f66ec039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:29.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.160+0000 7f6821da9640 1 --2- 172.21.15.146:0/3759343737 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f66ec036b90 0x7f66ec039050 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f681400bc50 tx=0x7f6814033000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:29.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.161+0000 7f68242b5800 20 rados->read ofs=0 len=0 2024-09-18T01:45:29.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.161+0000 7f68242b5800 1 --2- 172.21.15.146:0/3759343737 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55baa663cdf0 0x55baa663f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:29.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.161+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55baa663fa00 con 0x55baa663cdf0 2024-09-18T01:45:29.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.161+0000 7f681bfff640 1 --2- 172.21.15.146:0/3759343737 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55baa663cdf0 0x55baa663f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:29.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.161+0000 7f681bfff640 1 --2- 172.21.15.146:0/3759343737 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55baa663cdf0 0x55baa663f2b0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:29.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.161+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f680c051070 con 0x55baa663cdf0 2024-09-18T01:45:29.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.161+0000 7f68242b5800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:29.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.161+0000 7f68242b5800 20 realm 2024-09-18T01:45:29.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.161+0000 7f68242b5800 20 rados->read ofs=0 len=0 2024-09-18T01:45:29.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.161+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55baa663fe30 con 0x55baa663cdf0 2024-09-18T01:45:29.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.162+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f680c051070 con 0x55baa663cdf0 2024-09-18T01:45:29.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.162+0000 7f68242b5800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:29.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.162+0000 7f68242b5800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:29.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.162+0000 7f68242b5800 20 rados->read ofs=0 len=0 2024-09-18T01:45:29.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.162+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55baa6640700 con 0x55baa663cdf0 2024-09-18T01:45:29.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.162+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f680c051070 con 0x55baa663cdf0 2024-09-18T01:45:29.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.162+0000 7f68242b5800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:29.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.162+0000 7f68242b5800 20 rados->read ofs=0 len=0 2024-09-18T01:45:29.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.162+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55baa6640aa0 con 0x55baa663cdf0 2024-09-18T01:45:29.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.162+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f680c051070 con 0x55baa663cdf0 2024-09-18T01:45:29.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.162+0000 7f68242b5800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:29.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.162+0000 7f68242b5800 20 rados->read ofs=0 len=0 2024-09-18T01:45:29.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.162+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55baa66412f0 con 0x55baa663cdf0 2024-09-18T01:45:29.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.163+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f680c051070 con 0x55baa663cdf0 2024-09-18T01:45:29.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.163+0000 7f68242b5800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:29.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.163+0000 7f68242b5800 20 searching for the correct realm 2024-09-18T01:45:29.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.163+0000 7f68242b5800 1 --2- 172.21.15.146:0/3759343737 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55baa6643060 0x55baa6645450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:29.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.163+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55baa6645a80 con 0x55baa6643060 2024-09-18T01:45:29.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.163+0000 7f68225aa640 1 --2- 172.21.15.146:0/3759343737 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55baa6643060 0x55baa6645450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:29.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.163+0000 7f68225aa640 1 --2- 172.21.15.146:0/3759343737 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55baa6643060 0x55baa6645450 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:29.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.163+0000 7f68225aa640 1 -- 172.21.15.146:0/3759343737 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f681c057040 con 0x55baa6643060 2024-09-18T01:45:29.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.163+0000 7f68225aa640 1 --2- 172.21.15.146:0/3759343737 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f681c0123a0 0x7f681c036580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:29.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.163+0000 7f68225aa640 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55baa6645a80 con 0x7f681c0123a0 2024-09-18T01:45:29.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.163+0000 7f6821da9640 1 --2- 172.21.15.146:0/3759343737 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f681c0123a0 0x7f681c036580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:29.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.164+0000 7f6821da9640 1 --2- 172.21.15.146:0/3759343737 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f681c0123a0 0x7f681c036580 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:29.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.164+0000 7f6821da9640 1 -- 172.21.15.146:0/3759343737 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f681402d070 con 0x7f681c0123a0 2024-09-18T01:45:29.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.164+0000 7f6821da9640 1 --2- 172.21.15.146:0/3759343737 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f6814018810 0x7f681403f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:29.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.164+0000 7f6821da9640 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55baa6645a80 con 0x7f6814018810 2024-09-18T01:45:29.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.164+0000 7f681bfff640 1 --2- 172.21.15.146:0/3759343737 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f6814018810 0x7f681403f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:29.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.164+0000 7f681bfff640 1 --2- 172.21.15.146:0/3759343737 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f6814018810 0x7f681403f1e0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:29.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.165+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f680c051070 con 0x7f6814018810 2024-09-18T01:45:29.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.165+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55baa6645a80 con 0x55baa663cdf0 2024-09-18T01:45:29.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.165+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f680c051070 con 0x55baa663cdf0 2024-09-18T01:45:29.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.165+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55baa6645a80 con 0x55baa663cdf0 2024-09-18T01:45:29.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.165+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f680c051070 con 0x55baa663cdf0 2024-09-18T01:45:29.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.165+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55baa6645a80 con 0x7f6814018810 2024-09-18T01:45:29.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.165+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f680c051070 con 0x7f6814018810 2024-09-18T01:45:29.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.165+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55baa6645a80 con 0x7f6814018810 2024-09-18T01:45:29.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.166+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f680c051070 con 0x7f6814018810 2024-09-18T01:45:29.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.166+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55baa6645a80 con 0x7f681c0123a0 2024-09-18T01:45:29.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.166+0000 7f6821da9640 1 -- 172.21.15.146:0/3759343737 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f681402d070 con 0x7f681c0123a0 2024-09-18T01:45:29.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.166+0000 7f6821da9640 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55baa6645a80 con 0x55baa6643060 2024-09-18T01:45:29.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.166+0000 7f68225aa640 1 -- 172.21.15.146:0/3759343737 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f681c057040 con 0x55baa6643060 2024-09-18T01:45:29.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.166+0000 7f68225aa640 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55baa6645a80 con 0x55baa663cdf0 2024-09-18T01:45:29.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.166+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f680c051070 con 0x55baa663cdf0 2024-09-18T01:45:29.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.166+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55baa6645a80 con 0x7f6814018810 2024-09-18T01:45:29.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.167+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f680c051070 con 0x7f6814018810 2024-09-18T01:45:29.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.167+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55baa6645a80 con 0x55baa663cdf0 2024-09-18T01:45:29.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.167+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f680c051070 con 0x55baa663cdf0 2024-09-18T01:45:29.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.167+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55baa6645a80 con 0x7f681c0123a0 2024-09-18T01:45:29.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.167+0000 7f6821da9640 1 -- 172.21.15.146:0/3759343737 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f681402d070 con 0x7f681c0123a0 2024-09-18T01:45:29.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.167+0000 7f6821da9640 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55baa6645a80 con 0x55baa6643060 2024-09-18T01:45:29.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.167+0000 7f68225aa640 1 -- 172.21.15.146:0/3759343737 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f681c057040 con 0x55baa6643060 2024-09-18T01:45:29.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.167+0000 7f68225aa640 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55baa6645a80 con 0x55baa6643060 2024-09-18T01:45:29.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.168+0000 7f68225aa640 1 -- 172.21.15.146:0/3759343737 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f681c057040 con 0x55baa6643060 2024-09-18T01:45:29.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.168+0000 7f68225aa640 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55baa6645a80 con 0x7f6814018810 2024-09-18T01:45:29.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.168+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f680c051070 con 0x7f6814018810 2024-09-18T01:45:29.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.168+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55baa6645a80 con 0x55baa6643060 2024-09-18T01:45:29.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.168+0000 7f68225aa640 1 -- 172.21.15.146:0/3759343737 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f681c057040 con 0x55baa6643060 2024-09-18T01:45:29.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.168+0000 7f68225aa640 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55baa6645a80 con 0x55baa6643060 2024-09-18T01:45:29.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.168+0000 7f68225aa640 1 -- 172.21.15.146:0/3759343737 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f681c057040 con 0x55baa6643060 2024-09-18T01:45:29.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.168+0000 7f68225aa640 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55baa6645a80 con 0x55baa663cdf0 2024-09-18T01:45:29.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.168+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f680c051070 con 0x55baa663cdf0 2024-09-18T01:45:29.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.168+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55baa6645a80 con 0x55baa663cdf0 2024-09-18T01:45:29.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.169+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f680c051070 con 0x55baa663cdf0 2024-09-18T01:45:29.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.169+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55baa6645a80 con 0x7f6814018810 2024-09-18T01:45:29.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.169+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f680c051070 con 0x7f6814018810 2024-09-18T01:45:29.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.169+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55baa6645a80 con 0x55baa6643060 2024-09-18T01:45:29.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.169+0000 7f68225aa640 1 -- 172.21.15.146:0/3759343737 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f681c057040 con 0x55baa6643060 2024-09-18T01:45:29.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.169+0000 7f68225aa640 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55baa6645a80 con 0x7f681c0123a0 2024-09-18T01:45:29.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.169+0000 7f6821da9640 1 -- 172.21.15.146:0/3759343737 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f681402d070 con 0x7f681c0123a0 2024-09-18T01:45:29.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.169+0000 7f6821da9640 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55baa6645a80 con 0x55baa663cdf0 2024-09-18T01:45:29.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.170+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f680c051070 con 0x55baa663cdf0 2024-09-18T01:45:29.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.170+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55baa6645a80 con 0x7f6814018810 2024-09-18T01:45:29.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.170+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f680c051070 con 0x7f6814018810 2024-09-18T01:45:29.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.170+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55baa6645a80 con 0x55baa6643060 2024-09-18T01:45:29.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.170+0000 7f68225aa640 1 -- 172.21.15.146:0/3759343737 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f681c057040 con 0x55baa6643060 2024-09-18T01:45:29.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.170+0000 7f68225aa640 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55baa6645a80 con 0x7f6814018810 2024-09-18T01:45:29.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.170+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f680c051070 con 0x7f6814018810 2024-09-18T01:45:29.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.170+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55baa6645a80 con 0x7f681c0123a0 2024-09-18T01:45:29.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.171+0000 7f6821da9640 1 -- 172.21.15.146:0/3759343737 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f681402d070 con 0x7f681c0123a0 2024-09-18T01:45:29.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.171+0000 7f6821da9640 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55baa6645a80 con 0x55baa6643060 2024-09-18T01:45:29.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.171+0000 7f68225aa640 1 -- 172.21.15.146:0/3759343737 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f681c057040 con 0x55baa6643060 2024-09-18T01:45:29.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.171+0000 7f68225aa640 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55baa6645a80 con 0x7f6814018810 2024-09-18T01:45:29.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.171+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f680c051070 con 0x7f6814018810 2024-09-18T01:45:29.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.171+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55baa6645a80 con 0x55baa663cdf0 2024-09-18T01:45:29.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.171+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f680c051070 con 0x55baa663cdf0 2024-09-18T01:45:29.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.171+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55baa6645a80 con 0x7f681c0123a0 2024-09-18T01:45:29.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.172+0000 7f6821da9640 1 -- 172.21.15.146:0/3759343737 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f681402d070 con 0x7f681c0123a0 2024-09-18T01:45:29.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.172+0000 7f68242b5800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:29.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.172+0000 7f68242b5800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:29.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.172+0000 7f68242b5800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:29.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.172+0000 7f68242b5800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:29.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.172+0000 7f68242b5800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:29.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.172+0000 7f68242b5800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:29.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.172+0000 7f68242b5800 20 rados->read ofs=0 len=0 2024-09-18T01:45:29.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.172+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55baa6641c70 con 0x55baa663cdf0 2024-09-18T01:45:29.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.172+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f680c051070 con 0x55baa663cdf0 2024-09-18T01:45:29.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.172+0000 7f68242b5800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:29.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.172+0000 7f68242b5800 20 rados->read ofs=0 len=0 2024-09-18T01:45:29.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.172+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55baa6642510 con 0x55baa663cdf0 2024-09-18T01:45:29.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.172+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f680c051070 con 0x55baa663cdf0 2024-09-18T01:45:29.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.172+0000 7f68242b5800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:29.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.172+0000 7f68242b5800 20 rados->read ofs=0 len=0 2024-09-18T01:45:29.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.172+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55baa6645f00 con 0x7f681c0123a0 2024-09-18T01:45:29.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.172+0000 7f6821da9640 1 -- 172.21.15.146:0/3759343737 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f681402d070 con 0x7f681c0123a0 2024-09-18T01:45:29.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.172+0000 7f68242b5800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:29.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.172+0000 7f68242b5800 20 zone default found 2024-09-18T01:45:29.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.172+0000 7f68242b5800 4 Realm: () 2024-09-18T01:45:29.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.172+0000 7f68242b5800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:29.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.172+0000 7f68242b5800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:29.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.172+0000 7f68242b5800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:29.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.172+0000 7f68242b5800 20 zonegroup default 2024-09-18T01:45:29.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.172+0000 7f68242b5800 20 rados->read ofs=0 len=0 2024-09-18T01:45:29.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.172+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55baa6646750 con 0x7f6814018810 2024-09-18T01:45:29.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.173+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f680c051070 con 0x7f6814018810 2024-09-18T01:45:29.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.173+0000 7f68242b5800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:29.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.173+0000 7f68242b5800 20 rados->read ofs=0 len=0 2024-09-18T01:45:29.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.173+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55baa6648130 con 0x55baa6643060 2024-09-18T01:45:29.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.173+0000 7f68225aa640 1 -- 172.21.15.146:0/3759343737 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f681c057040 con 0x55baa6643060 2024-09-18T01:45:29.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.173+0000 7f68242b5800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:29.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.173+0000 7f68242b5800 20 rados->read ofs=0 len=0 2024-09-18T01:45:29.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.173+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55baa6648620 con 0x55baa6643060 2024-09-18T01:45:29.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.173+0000 7f68225aa640 1 -- 172.21.15.146:0/3759343737 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f681c057040 con 0x55baa6643060 2024-09-18T01:45:29.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.173+0000 7f68242b5800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:29.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.173+0000 7f68242b5800 20 started sync module instance, tier type = 2024-09-18T01:45:29.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.173+0000 7f68242b5800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:29.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.173+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55baa66475c0 con 0x7f681c0123a0 2024-09-18T01:45:29.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.174+0000 7f6821da9640 1 -- 172.21.15.146:0/3759343737 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v31'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f681402d070 con 0x7f681c0123a0 2024-09-18T01:45:29.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.174+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94260143880624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55baa6647220 con 0x7f681c0123a0 2024-09-18T01:45:29.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.174+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55baa6649550 con 0x55baa663cdf0 2024-09-18T01:45:29.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.175+0000 7f6821da9640 1 -- 172.21.15.146:0/3759343737 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94260143880624] v31'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f681402d070 con 0x7f681c0123a0 2024-09-18T01:45:29.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.176+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v31'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f680c051070 con 0x55baa663cdf0 2024-09-18T01:45:29.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.176+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94260143886496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55baa6649970 con 0x55baa663cdf0 2024-09-18T01:45:29.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.176+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55baa664a330 con 0x55baa6643060 2024-09-18T01:45:29.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.177+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94260143886496] v31'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f680c051070 con 0x55baa663cdf0 2024-09-18T01:45:29.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.177+0000 7f68225aa640 1 -- 172.21.15.146:0/3759343737 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v31'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f681c057040 con 0x55baa6643060 2024-09-18T01:45:29.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.177+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94260143888032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55baa664a330 con 0x55baa6643060 2024-09-18T01:45:29.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.177+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55baa664ad80 con 0x7f681c0123a0 2024-09-18T01:45:29.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.178+0000 7f68225aa640 1 -- 172.21.15.146:0/3759343737 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94260143888032] v31'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f681c057040 con 0x55baa6643060 2024-09-18T01:45:29.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.178+0000 7f6821da9640 1 -- 172.21.15.146:0/3759343737 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v31'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f681402d070 con 0x7f681c0123a0 2024-09-18T01:45:29.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.178+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94260143890048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55baa664a2a0 con 0x7f681c0123a0 2024-09-18T01:45:29.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.178+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55baa664bc40 con 0x55baa663cdf0 2024-09-18T01:45:29.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.179+0000 7f6821da9640 1 -- 172.21.15.146:0/3759343737 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94260143890048] v31'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f681402d070 con 0x7f681c0123a0 2024-09-18T01:45:29.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.179+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v31'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f680c051070 con 0x55baa663cdf0 2024-09-18T01:45:29.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.179+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94260143896464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55baa664bbb0 con 0x55baa663cdf0 2024-09-18T01:45:29.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.179+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55baa664cb00 con 0x7f6814018810 2024-09-18T01:45:29.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.180+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v31'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f680c051070 con 0x7f6814018810 2024-09-18T01:45:29.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.180+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94260143896464] v31'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f680c051070 con 0x55baa663cdf0 2024-09-18T01:45:29.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.180+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94260143900240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55baa664cf20 con 0x7f6814018810 2024-09-18T01:45:29.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.180+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55baa664c070 con 0x7f6814018810 2024-09-18T01:45:29.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.181+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94260143900240] v31'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f680c051070 con 0x7f6814018810 2024-09-18T01:45:29.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.181+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v31'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f680c051070 con 0x7f6814018810 2024-09-18T01:45:29.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.181+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94260143901296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55baa664ce90 con 0x7f6814018810 2024-09-18T01:45:29.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.181+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55baa664de30 con 0x7f6814018810 2024-09-18T01:45:29.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.182+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(58 notify.7 [create] v31'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f680c051070 con 0x7f6814018810 2024-09-18T01:45:29.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.182+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94260143905120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55baa664e2e0 con 0x7f6814018810 2024-09-18T01:45:29.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.182+0000 7f68242b5800 20 add_watcher() i=0 2024-09-18T01:45:29.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.182+0000 7f68242b5800 20 add_watcher() i=1 2024-09-18T01:45:29.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.182+0000 7f68242b5800 20 add_watcher() i=2 2024-09-18T01:45:29.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.182+0000 7f68242b5800 20 add_watcher() i=3 2024-09-18T01:45:29.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.182+0000 7f68242b5800 20 add_watcher() i=4 2024-09-18T01:45:29.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.182+0000 7f68242b5800 20 add_watcher() i=5 2024-09-18T01:45:29.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.182+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94260143901296] v31'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f680c051070 con 0x7f6814018810 2024-09-18T01:45:29.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.182+0000 7f68242b5800 20 add_watcher() i=6 2024-09-18T01:45:29.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.183+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94260143905120] v31'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f680c051070 con 0x7f6814018810 2024-09-18T01:45:29.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.183+0000 7f68242b5800 20 add_watcher() i=7 2024-09-18T01:45:29.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.183+0000 7f68242b5800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:29.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.183+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55baa664e2e0 con 0x55baa663cdf0 2024-09-18T01:45:29.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.183+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f680c051070 con 0x55baa663cdf0 2024-09-18T01:45:29.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.184+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94260143906352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55baa664e250 con 0x55baa663cdf0 2024-09-18T01:45:29.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.185+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94260143906352] v31'154 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f680c051070 con 0x55baa663cdf0 2024-09-18T01:45:29.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.185+0000 7f66d37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:29.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.185+0000 7f68242b5800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:29.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.185+0000 7f68242b5800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:29.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.185+0000 7f68242b5800 5 note: GC not initialized 2024-09-18T01:45:29.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.185+0000 7f66d27fc640 20 reqs_thread_entry: start 2024-09-18T01:45:29.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.185+0000 7f68242b5800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:29.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.185+0000 7f68242b5800 20 Filter name: none 2024-09-18T01:45:29.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.185+0000 7f6643fff640 20 reqs_thread_entry: start 2024-09-18T01:45:29.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.185+0000 7f68242b5800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T01:45:29.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.185+0000 7f68242b5800 20 rados->read ofs=0 len=0 2024-09-18T01:45:29.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.185+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55baa6684610 con 0x55baa663cdf0 2024-09-18T01:45:29.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.186+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f680c051070 con 0x55baa663cdf0 2024-09-18T01:45:29.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.186+0000 7f68242b5800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:45:29.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.186+0000 7f68242b5800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T01:45:29.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.186+0000 7f68242b5800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:45:29.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.186+0000 7f68242b5800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:45:29.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.186+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55baa66840f0 con 0x7f681c0123a0 2024-09-18T01:45:29.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.186+0000 7f6821da9640 1 -- 172.21.15.146:0/3759343737 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f681402d070 con 0x7f681c0123a0 2024-09-18T01:45:29.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.186+0000 7f68242b5800 20 disabling bucket name=myfoo 2024-09-18T01:45:29.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.186+0000 7f68242b5800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-18T01:45:29.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.186+0000 7f68242b5800 20 rados->read ofs=0 len=0 2024-09-18T01:45:29.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.186+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55baa6685080 con 0x7f681c0123a0 2024-09-18T01:45:29.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.186+0000 7f6821da9640 1 -- 172.21.15.146:0/3759343737 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7f681402d070 con 0x7f681c0123a0 2024-09-18T01:45:29.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.186+0000 7f68242b5800 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T01:45:29.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.186+0000 7f68242b5800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-18T01:45:29.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.186+0000 7f68242b5800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T01:45:29.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.186+0000 7f68242b5800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 : miss 2024-09-18T01:45:29.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.186+0000 7f68242b5800 20 rados->read ofs=0 len=0 2024-09-18T01:45:29.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.186+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:65 8.13 8:ceaa8859:root::.bucket.meta.myfoo%3a8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55baa6686960 con 0x7f6814018810 2024-09-18T01:45:29.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.187+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(65 .bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv11 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f680c051070 con 0x7f6814018810 2024-09-18T01:45:29.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.187+0000 7f68242b5800 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T01:45:29.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.187+0000 7f68242b5800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 info.flags=0x17 2024-09-18T01:45:29.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.187+0000 7f68242b5800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 to cache LRU end 2024-09-18T01:45:29.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.187+0000 7f68242b5800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:45:29.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.187+0000 7f68242b5800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T01:45:29.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.187+0000 7f68242b5800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 2024-09-18T01:45:29.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.187+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:66 8.13 8:ceaa8859:root::.bucket.meta.myfoo%3a8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55baa668f500 con 0x7f6814018810 2024-09-18T01:45:29.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.188+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(66 .bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v31'14 uv14 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f680c051070 con 0x7f6814018810 2024-09-18T01:45:29.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.188+0000 7f68242b5800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 info.flags=0x17 2024-09-18T01:45:29.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.188+0000 7f68242b5800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 to cache LRU end 2024-09-18T01:45:29.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.188+0000 7f68242b5800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T01:45:29.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.188+0000 7f68242b5800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1, ofs0, ns] 2024-09-18T01:45:29.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.188+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94260144150112 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55baa6689f30 con 0x7f6814018810 2024-09-18T01:45:29.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.188+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== watch-notify(notify (1) cookie 94260143900240 notify 133143986191 ret 0) ==== 794+0+0 (crc 0 0 0) 0x55baa6686d50 con 0x7f6814018810 2024-09-18T01:45:29.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.188+0000 7f67057fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986191 cookie 94260143900240 notifier 4600 bl.length()=752 2024-09-18T01:45:29.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.188+0000 7f67057fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 info.flags=0x17 2024-09-18T01:45:29.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.188+0000 7f67057fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 to cache LRU end 2024-09-18T01:45:29.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.188+0000 7f67057fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T01:45:29.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.188+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(67 notify.5 [notify cookie 94260144150112 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f680c087040 con 0x7f6814018810 2024-09-18T01:45:29.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.188+0000 7f67057fa640 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f66e4003ea0 con 0x7f6814018810 2024-09-18T01:45:29.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.188+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f680c087040 con 0x7f6814018810 2024-09-18T01:45:29.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.189+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 <== osd.0 v2:172.21.15.129:6800/1759265424 22 ==== watch-notify(notify_complete (2) cookie 94260144150112 notify 133143986191 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55baa6684d80 con 0x7f6814018810 2024-09-18T01:45:29.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.189+0000 7f68242b5800 20 handle_bi_update(): bucket=:myfoo[8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1]): orig_sources= new_sources= 2024-09-18T01:45:29.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.189+0000 7f68242b5800 20 handle_bi_update(): bucket=:myfoo[8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1]): potential sources added=[] removed=[] 2024-09-18T01:45:29.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.189+0000 7f68242b5800 20 handle_bi_update(): bucket=:myfoo[8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1]): orig_dests= new_dests= 2024-09-18T01:45:29.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.189+0000 7f68242b5800 20 handle_bi_update(): bucket=:myfoo[8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1]): potential dests added=[] removed=[] 2024-09-18T01:45:29.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.189+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55baa668a5f0 con 0x55baa663cdf0 2024-09-18T01:45:29.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.190+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v31'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f680c087040 con 0x55baa663cdf0 2024-09-18T01:45:29.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.190+0000 7f68242b5800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:45:29.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.190+0000 7f68242b5800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:45:29.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.190+0000 7f68242b5800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-18T01:45:29.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.190+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94260144122896 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55baa668c0b0 con 0x55baa663cdf0 2024-09-18T01:45:29.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.190+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== watch-notify(notify (1) cookie 94260143896464 notify 133143986192 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55baa6684d80 con 0x55baa663cdf0 2024-09-18T01:45:29.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.190+0000 7f67057fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986192 cookie 94260143896464 notifier 4600 bl.length()=567 2024-09-18T01:45:29.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.190+0000 7f67057fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:45:29.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.190+0000 7f67057fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:45:29.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.190+0000 7f67057fa640 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f66e4003ea0 con 0x55baa663cdf0 2024-09-18T01:45:29.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.190+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(70 notify.4 [notify cookie 94260144122896 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f680c087040 con 0x55baa663cdf0 2024-09-18T01:45:29.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.190+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f680c087040 con 0x55baa663cdf0 2024-09-18T01:45:29.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.190+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== watch-notify(notify_complete (2) cookie 94260144122896 notify 133143986192 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55baa63d0e00 con 0x55baa663cdf0 2024-09-18T01:45:29.205 INFO:teuthology.orchestra.run.smithi146.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T01:45:23.010714Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:45:23.010705Z","tags":[],"group_ids":[]} 2024-09-18T01:45:29.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.191+0000 7f66d37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:29.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.191+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94260143906352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55baa6682360 con 0x55baa663cdf0 2024-09-18T01:45:29.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.192+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 <== osd.1 v2:172.21.15.146:6808/3930274777 28 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94260143906352] v31'155 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f680c087040 con 0x55baa663cdf0 2024-09-18T01:45:29.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.192+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94260143880624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55baa6682360 con 0x7f681c0123a0 2024-09-18T01:45:29.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.193+0000 7f6821da9640 1 -- 172.21.15.146:0/3759343737 <== osd.2 v2:172.21.15.146:6800/3820039304 14 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94260143880624] v31'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f681402d070 con 0x7f681c0123a0 2024-09-18T01:45:29.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.193+0000 7f68242b5800 20 remove_watcher() i=0 2024-09-18T01:45:29.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.193+0000 7f68242b5800 2 removed watcher, disabling cache 2024-09-18T01:45:29.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.193+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94260143886496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55baa6682360 con 0x55baa663cdf0 2024-09-18T01:45:29.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.195+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 <== osd.1 v2:172.21.15.146:6808/3930274777 29 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94260143886496] v31'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f680c087040 con 0x55baa663cdf0 2024-09-18T01:45:29.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.195+0000 7f68242b5800 20 remove_watcher() i=1 2024-09-18T01:45:29.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.195+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94260143888032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55baa6682360 con 0x55baa6643060 2024-09-18T01:45:29.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.196+0000 7f68225aa640 1 -- 172.21.15.146:0/3759343737 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94260143888032] v31'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f681c057040 con 0x55baa6643060 2024-09-18T01:45:29.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.196+0000 7f68242b5800 20 remove_watcher() i=2 2024-09-18T01:45:29.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.196+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94260143890048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55baa6682360 con 0x7f681c0123a0 2024-09-18T01:45:29.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.197+0000 7f6821da9640 1 -- 172.21.15.146:0/3759343737 <== osd.2 v2:172.21.15.146:6800/3820039304 15 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94260143890048] v31'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f681402d070 con 0x7f681c0123a0 2024-09-18T01:45:29.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.197+0000 7f68242b5800 20 remove_watcher() i=3 2024-09-18T01:45:29.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.197+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94260143896464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55baa6682360 con 0x55baa663cdf0 2024-09-18T01:45:29.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.198+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 <== osd.1 v2:172.21.15.146:6808/3930274777 30 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94260143896464] v31'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f680c087040 con 0x55baa663cdf0 2024-09-18T01:45:29.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.198+0000 7f68242b5800 20 remove_watcher() i=4 2024-09-18T01:45:29.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.198+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94260143900240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55baa6682360 con 0x7f6814018810 2024-09-18T01:45:29.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.199+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 <== osd.0 v2:172.21.15.129:6800/1759265424 23 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94260143900240] v31'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f680c087040 con 0x7f6814018810 2024-09-18T01:45:29.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.199+0000 7f68242b5800 20 remove_watcher() i=5 2024-09-18T01:45:29.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.199+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94260143901296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55baa6682360 con 0x7f6814018810 2024-09-18T01:45:29.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.200+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 <== osd.0 v2:172.21.15.129:6800/1759265424 24 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94260143901296] v31'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f680c087040 con 0x7f6814018810 2024-09-18T01:45:29.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.200+0000 7f68242b5800 20 remove_watcher() i=6 2024-09-18T01:45:29.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.200+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94260143905120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55baa6682360 con 0x7f6814018810 2024-09-18T01:45:29.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.201+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 <== osd.0 v2:172.21.15.129:6800/1759265424 25 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94260143905120] v31'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f680c087040 con 0x7f6814018810 2024-09-18T01:45:29.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.201+0000 7f68242b5800 20 remove_watcher() i=7 2024-09-18T01:45:29.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.201+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f6814018810 msgr2=0x7f681403f1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:29.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.201+0000 7f68242b5800 1 --2- 172.21.15.146:0/3759343737 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f6814018810 0x7f681403f1e0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:29.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.201+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55baa663cdf0 msgr2=0x55baa663f2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:29.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.201+0000 7f68242b5800 1 --2- 172.21.15.146:0/3759343737 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55baa663cdf0 0x55baa663f2b0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:29.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.201+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f681c0123a0 msgr2=0x7f681c036580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:29.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.201+0000 7f68242b5800 1 --2- 172.21.15.146:0/3759343737 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f681c0123a0 0x7f681c036580 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:29.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.201+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55baa6643060 msgr2=0x55baa6645450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:29.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.201+0000 7f68242b5800 1 --2- 172.21.15.146:0/3759343737 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55baa6643060 0x55baa6645450 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:29.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.201+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f66ec036b90 msgr2=0x7f66ec039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:29.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.201+0000 7f68242b5800 1 --2- 172.21.15.146:0/3759343737 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f66ec036b90 0x7f66ec039050 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f681400bc50 tx=0x7f6814033000 comp rx=0 tx=0).stop 2024-09-18T01:45:29.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.201+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55baa6629cc0 msgr2=0x55baa6631130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:29.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.201+0000 7f68242b5800 1 --2- 172.21.15.146:0/3759343737 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55baa6629cc0 0x55baa6631130 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f681c04b7b0 tx=0x7f681c04c820 comp rx=0 tx=0).stop 2024-09-18T01:45:29.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.201+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 reap_dead start 2024-09-18T01:45:29.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.201+0000 7f681bfff640 1 -- 172.21.15.146:0/3759343737 reap_dead start 2024-09-18T01:45:29.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.201+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 shutdown_connections 2024-09-18T01:45:29.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.201+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 >> 172.21.15.146:0/3759343737 conn(0x55baa6626020 msgr2=0x55baa66240f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:29.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.201+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 shutdown_connections 2024-09-18T01:45:29.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.201+0000 7f68242b5800 1 -- 172.21.15.146:0/3759343737 wait complete. 2024-09-18T01:45:29.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.202+0000 7f68242b5800 1 -- 172.21.15.146:0/3526238164 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f66fc036b90 msgr2=0x7f66fc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:29.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.202+0000 7f68242b5800 1 --2- 172.21.15.146:0/3526238164 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f66fc036b90 0x7f66fc039050 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6814001630 tx=0x7f681404b640 comp rx=0 tx=0).stop 2024-09-18T01:45:29.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.202+0000 7f68242b5800 1 -- 172.21.15.146:0/3526238164 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55baa661d020 msgr2=0x55baa661d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:29.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.202+0000 7f68242b5800 1 --2- 172.21.15.146:0/3526238164 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55baa661d020 0x55baa661d440 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x55baa66036b0 tx=0x7f681c0178e0 comp rx=0 tx=0).stop 2024-09-18T01:45:29.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.202+0000 7f68242b5800 1 -- 172.21.15.146:0/3526238164 shutdown_connections 2024-09-18T01:45:29.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.202+0000 7f68242b5800 1 --2- 172.21.15.146:0/3526238164 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f66fc036b90 0x7f66fc039050 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:29.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.202+0000 7f68242b5800 1 --2- 172.21.15.146:0/3526238164 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55baa661d020 0x55baa661d440 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:29.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.202+0000 7f68242b5800 1 -- 172.21.15.146:0/3526238164 >> 172.21.15.146:0/3526238164 conn(0x55baa6611fb0 msgr2=0x55baa6614b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:29.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.202+0000 7f68242b5800 1 -- 172.21.15.146:0/3526238164 shutdown_connections 2024-09-18T01:45:29.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.202+0000 7f68242b5800 1 -- 172.21.15.146:0/3526238164 wait complete. 2024-09-18T01:45:29.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.202+0000 7f68242b5800 1 -- 172.21.15.146:0/4123553901 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55baa650d9d0 msgr2=0x55baa6609320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:29.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.202+0000 7f68242b5800 1 --2- 172.21.15.146:0/4123553901 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55baa650d9d0 0x55baa6609320 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:29.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.202+0000 7f68242b5800 1 -- 172.21.15.146:0/4123553901 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55baa660ca70 msgr2=0x55baa660ee60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:29.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.202+0000 7f68242b5800 1 --2- 172.21.15.146:0/4123553901 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55baa660ca70 0x55baa660ee60 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:29.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.202+0000 7f68242b5800 1 -- 172.21.15.146:0/4123553901 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6708036b90 msgr2=0x7f6708039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:29.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.202+0000 7f68242b5800 1 --2- 172.21.15.146:0/4123553901 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6708036b90 0x7f6708039050 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f680c057000 tx=0x7f680c052000 comp rx=0 tx=0).stop 2024-09-18T01:45:29.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.202+0000 7f68242b5800 1 -- 172.21.15.146:0/4123553901 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55baa647d5d0 msgr2=0x55baa66022b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:29.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.202+0000 7f68242b5800 1 --2- 172.21.15.146:0/4123553901 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55baa647d5d0 0x55baa66022b0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x55baa65092e0 tx=0x7f6814000ed0 comp rx=0 tx=0).stop 2024-09-18T01:45:29.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.202+0000 7f68242b5800 1 -- 172.21.15.146:0/4123553901 shutdown_connections 2024-09-18T01:45:29.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.202+0000 7f68242b5800 1 --2- 172.21.15.146:0/4123553901 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55baa660ca70 0x55baa660ee60 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:29.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.202+0000 7f68242b5800 1 --2- 172.21.15.146:0/4123553901 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55baa650d9d0 0x55baa6609320 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:29.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.202+0000 7f68242b5800 1 --2- 172.21.15.146:0/4123553901 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6708036b90 0x7f6708039050 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:29.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.202+0000 7f68242b5800 1 --2- 172.21.15.146:0/4123553901 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55baa647d5d0 0x55baa66022b0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:29.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.202+0000 7f68242b5800 1 -- 172.21.15.146:0/4123553901 >> 172.21.15.146:0/4123553901 conn(0x55baa6503de0 msgr2=0x55baa65f3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:29.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.202+0000 7f68242b5800 1 -- 172.21.15.146:0/4123553901 shutdown_connections 2024-09-18T01:45:29.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.202+0000 7f68242b5800 1 -- 172.21.15.146:0/4123553901 wait complete. 2024-09-18T01:45:29.216 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T01:45:23.010714Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:45:23.010705Z', 'tags': [], 'group_ids': []} 2024-09-18T01:45:29.218 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-18T01:45:29.219 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-18T01:45:29.219 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-18T01:45:29.263 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:29.263 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:29.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.263+0000 7f55d9b28800 1 Processor -- start 2024-09-18T01:45:29.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.263+0000 7f55d9b28800 1 -- start start 2024-09-18T01:45:29.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.263+0000 7f55d9b28800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x563d8cd90970 0x563d8cd92d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:29.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.263+0000 7f55d9b28800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563d8cc4bb30 con 0x563d8cd00630 2024-09-18T01:45:29.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.263+0000 7f55d9b28800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x563d8cc2d360 con 0x563d8cd90970 2024-09-18T01:45:29.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.263+0000 7f55d50b2640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x563d8cd90970 0x563d8cd92d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:29.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.263+0000 7f55d58b3640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x563d8cd00630 0x563d8cd8f250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:47414/0 (socket says 172.21.15.146:47414) 2024-09-18T01:45:29.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.264+0000 7f55d58b3640 1 -- 172.21.15.146:0/1582862646 learned_addr learned my addr 172.21.15.146:0/1582862646 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:45:29.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.264+0000 7f55d50b2640 1 -- 172.21.15.146:0/1582862646 >> v1:172.21.15.129:6789/0 conn(0x563d8cd00630 legacy=0x563d8cd8f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:29.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.264+0000 7f55d48b1640 1 -- 172.21.15.146:0/1582862646 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3364079880 0 0) 0x563d8cc4bb30 con 0x563d8cd00630 2024-09-18T01:45:29.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.264+0000 7f55d50b2640 1 -- 172.21.15.146:0/1582862646 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d8cc53e00 con 0x563d8cd90970 2024-09-18T01:45:29.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.266+0000 7f55d50b2640 1 --2- 172.21.15.146:0/1582862646 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8cd90970 0x563d8cd92d60 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f55c000a470 tx=0x7f55c0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71850cc866020825 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:29.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.266+0000 7f55d48b1640 1 -- 172.21.15.146:0/1582862646 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55c0053570 con 0x563d8cd90970 2024-09-18T01:45:29.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.266+0000 7f55d48b1640 1 -- 172.21.15.146:0/1582862646 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55c0058070 con 0x563d8cd90970 2024-09-18T01:45:29.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.266+0000 7f55d48b1640 1 -- 172.21.15.146:0/1582862646 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55c0053880 con 0x563d8cd90970 2024-09-18T01:45:29.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.266+0000 7f55d9b28800 1 -- 172.21.15.146:0/1582862646 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8cd90970 msgr2=0x563d8cd92d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:29.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.266+0000 7f55d9b28800 1 --2- 172.21.15.146:0/1582862646 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8cd90970 0x563d8cd92d60 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f55c000a470 tx=0x7f55c0045a20 comp rx=0 tx=0).stop 2024-09-18T01:45:29.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.266+0000 7f55d9b28800 1 -- 172.21.15.146:0/1582862646 shutdown_connections 2024-09-18T01:45:29.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.266+0000 7f55d9b28800 1 --2- 172.21.15.146:0/1582862646 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8cd90970 0x563d8cd92d60 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:29.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.266+0000 7f55d9b28800 1 -- 172.21.15.146:0/1582862646 >> 172.21.15.146:0/1582862646 conn(0x563d8cd86de0 msgr2=0x563d8cd89200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:29.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.266+0000 7f55d9b28800 1 -- 172.21.15.146:0/1582862646 shutdown_connections 2024-09-18T01:45:29.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.266+0000 7f55d9b28800 1 -- 172.21.15.146:0/1582862646 wait complete. 2024-09-18T01:45:29.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.280+0000 7f55d9b28800 1 Processor -- start 2024-09-18T01:45:29.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.280+0000 7f55d9b28800 1 -- start start 2024-09-18T01:45:29.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.280+0000 7f55d9b28800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8cd00630 0x563d8ce7b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:29.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.280+0000 7f55d9b28800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x563d8ccd8330 con 0x563d8cd00630 2024-09-18T01:45:29.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.281+0000 7f55d58b3640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8cd00630 0x563d8ce7b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:29.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.281+0000 7f55d58b3640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8cd00630 0x563d8ce7b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:58336/0 (socket says 172.21.15.146:58336) 2024-09-18T01:45:29.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.281+0000 7f55d58b3640 1 -- 172.21.15.146:0/100506296 learned_addr learned my addr 172.21.15.146:0/100506296 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:29.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.281+0000 7f55d58b3640 1 -- 172.21.15.146:0/100506296 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d8cc25bc0 con 0x563d8cd00630 2024-09-18T01:45:29.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.281+0000 7f55d58b3640 1 --2- 172.21.15.146:0/100506296 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8cd00630 0x563d8ce7b630 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f55c800b240 tx=0x7f55c800b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7b6d45c4987d3f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:29.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.281+0000 7f54c3e07640 1 -- 172.21.15.146:0/100506296 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55c8008070 con 0x563d8cd00630 2024-09-18T01:45:29.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.281+0000 7f54c3e07640 1 -- 172.21.15.146:0/100506296 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55c800d500 con 0x563d8cd00630 2024-09-18T01:45:29.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.281+0000 7f54c3e07640 1 -- 172.21.15.146:0/100506296 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55c800d860 con 0x563d8cd00630 2024-09-18T01:45:29.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.282+0000 7f55d9b28800 1 -- 172.21.15.146:0/100506296 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8cd00630 msgr2=0x563d8ce7b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:29.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.282+0000 7f55d9b28800 1 --2- 172.21.15.146:0/100506296 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8cd00630 0x563d8ce7b630 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f55c800b240 tx=0x7f55c800b700 comp rx=0 tx=0).stop 2024-09-18T01:45:29.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.282+0000 7f55d9b28800 1 -- 172.21.15.146:0/100506296 shutdown_connections 2024-09-18T01:45:29.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.282+0000 7f55d9b28800 1 --2- 172.21.15.146:0/100506296 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8cd00630 0x563d8ce7b630 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:29.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.282+0000 7f55d9b28800 1 -- 172.21.15.146:0/100506296 >> 172.21.15.146:0/100506296 conn(0x563d8cd86de0 msgr2=0x563d8ce76ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:29.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.282+0000 7f55d9b28800 1 -- 172.21.15.146:0/100506296 shutdown_connections 2024-09-18T01:45:29.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.282+0000 7f55d9b28800 1 -- 172.21.15.146:0/100506296 wait complete. 2024-09-18T01:45:29.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.282+0000 7f55d9b28800 1 Processor -- start 2024-09-18T01:45:29.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.282+0000 7f55d9b28800 1 -- start start 2024-09-18T01:45:29.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.282+0000 7f55d9b28800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8cd00630 0x563d8ce830b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:29.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.282+0000 7f55d9b28800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x563d8cd93690 con 0x563d8cd00630 2024-09-18T01:45:29.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.283+0000 7f55d58b3640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8cd00630 0x563d8ce830b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:29.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.283+0000 7f55d58b3640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8cd00630 0x563d8ce830b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:58340/0 (socket says 172.21.15.146:58340) 2024-09-18T01:45:29.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.283+0000 7f55d58b3640 1 -- 172.21.15.146:0/1418410235 learned_addr learned my addr 172.21.15.146:0/1418410235 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:29.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.283+0000 7f55d58b3640 1 -- 172.21.15.146:0/1418410235 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d8cc39fe0 con 0x563d8cd00630 2024-09-18T01:45:29.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.283+0000 7f55d58b3640 1 --2- 172.21.15.146:0/1418410235 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8cd00630 0x563d8ce830b0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x563d8ce7c490 tx=0x7f55c8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:29.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.283+0000 7f54c2604640 1 -- 172.21.15.146:0/1418410235 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55c8019870 con 0x563d8cd00630 2024-09-18T01:45:29.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.283+0000 7f54c2604640 1 -- 172.21.15.146:0/1418410235 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55c8019a10 con 0x563d8cd00630 2024-09-18T01:45:29.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.283+0000 7f55d9b28800 1 -- 172.21.15.146:0/1418410235 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563d8ce835f0 con 0x563d8cd00630 2024-09-18T01:45:29.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.283+0000 7f54c2604640 1 -- 172.21.15.146:0/1418410235 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55c8019d30 con 0x563d8cd00630 2024-09-18T01:45:29.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.283+0000 7f55d9b28800 1 -- 172.21.15.146:0/1418410235 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d8ce83b10 con 0x563d8cd00630 2024-09-18T01:45:29.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.284+0000 7f54c2604640 1 -- 172.21.15.146:0/1418410235 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f55c8017040 con 0x563d8cd00630 2024-09-18T01:45:29.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.284+0000 7f54c2604640 1 --2- 172.21.15.146:0/1418410235 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f54bc036b90 0x7f54bc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:29.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.284+0000 7f54c2604640 1 -- 172.21.15.146:0/1418410235 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f55c8015020 con 0x563d8cd00630 2024-09-18T01:45:29.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.284+0000 7f55d50b2640 1 --2- 172.21.15.146:0/1418410235 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f54bc036b90 0x7f54bc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:29.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.284+0000 7f55d9b28800 1 --2- 172.21.15.146:0/1418410235 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x563d8cd90970 0x563d8ce8a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:29.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.285+0000 7f55d9b28800 1 -- 172.21.15.146:0/1418410235 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563d8ce8a6a0 con 0x563d8cd90970 2024-09-18T01:45:29.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.285+0000 7f55d60b4640 1 --2- 172.21.15.146:0/1418410235 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x563d8cd90970 0x563d8ce8a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:29.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.285+0000 7f55d50b2640 1 --2- 172.21.15.146:0/1418410235 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f54bc036b90 0x7f54bc039050 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f55c0057000 tx=0x7f55c0052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:29.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.285+0000 7f55d60b4640 1 --2- 172.21.15.146:0/1418410235 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x563d8cd90970 0x563d8ce8a120 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:29.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.285+0000 7f55d60b4640 1 -- 172.21.15.146:0/1418410235 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55d000a4a0 con 0x563d8cd90970 2024-09-18T01:45:29.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.285+0000 7f55d9b28800 1 -- 172.21.15.146:0/1418410235 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563d8ce876f0 con 0x563d8cd90970 2024-09-18T01:45:29.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.285+0000 7f55d60b4640 1 -- 172.21.15.146:0/1418410235 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f55d000a4a0 con 0x563d8cd90970 2024-09-18T01:45:29.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.286+0000 7f55d9b28800 1 -- 172.21.15.146:0/1418410235 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563d8ce8c4c0 con 0x563d8cd90970 2024-09-18T01:45:29.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.286+0000 7f55d60b4640 1 -- 172.21.15.146:0/1418410235 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f55d000a4a0 con 0x563d8cd90970 2024-09-18T01:45:29.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.286+0000 7f55d9b28800 1 -- 172.21.15.146:0/1418410235 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563d8ce8b6f0 con 0x563d8cd90970 2024-09-18T01:45:29.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.286+0000 7f55d60b4640 1 -- 172.21.15.146:0/1418410235 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f55d000a4a0 con 0x563d8cd90970 2024-09-18T01:45:29.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.286+0000 7f55d9b28800 1 --2- 172.21.15.146:0/1418410235 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x563d8ce8d870 0x563d8ce8fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:29.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.286+0000 7f55d9b28800 1 -- 172.21.15.146:0/1418410235 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563d8ce901a0 con 0x563d8ce8d870 2024-09-18T01:45:29.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.286+0000 7f55d58b3640 1 --2- 172.21.15.146:0/1418410235 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x563d8ce8d870 0x563d8ce8fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:29.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.286+0000 7f55d58b3640 1 --2- 172.21.15.146:0/1418410235 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x563d8ce8d870 0x563d8ce8fc60 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:29.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.287+0000 7f55d58b3640 1 -- 172.21.15.146:0/1418410235 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f55c802d070 con 0x563d8ce8d870 2024-09-18T01:45:29.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.287+0000 7f55d9b28800 1 Processor -- start 2024-09-18T01:45:29.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.287+0000 7f55d9b28800 1 -- start start 2024-09-18T01:45:29.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.287+0000 7f55d9b28800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8cd8cc20 0x563d8cd8b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:29.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.287+0000 7f55d9b28800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x563d8cc27580 con 0x563d8cd8cc20 2024-09-18T01:45:29.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.287+0000 7f55d60b4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8cd8cc20 0x563d8cd8b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:29.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.288+0000 7f55d60b4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8cd8cc20 0x563d8cd8b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:58356/0 (socket says 172.21.15.146:58356) 2024-09-18T01:45:29.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.288+0000 7f55d60b4640 1 -- 172.21.15.146:0/762553898 learned_addr learned my addr 172.21.15.146:0/762553898 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:29.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.288+0000 7f55d60b4640 1 -- 172.21.15.146:0/762553898 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d8cd8d040 con 0x563d8cd8cc20 2024-09-18T01:45:29.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.288+0000 7f55d60b4640 1 --2- 172.21.15.146:0/762553898 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8cd8cc20 0x563d8cd8b270 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x563d8ce844b0 tx=0x7f55d00178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:29.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.288+0000 7f54bb7fe640 1 -- 172.21.15.146:0/762553898 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55d0013440 con 0x563d8cd8cc20 2024-09-18T01:45:29.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.288+0000 7f54bb7fe640 1 -- 172.21.15.146:0/762553898 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55d00135e0 con 0x563d8cd8cc20 2024-09-18T01:45:29.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.288+0000 7f55d9b28800 1 -- 172.21.15.146:0/762553898 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563d8cd8b870 con 0x563d8cd8cc20 2024-09-18T01:45:29.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.288+0000 7f54bb7fe640 1 -- 172.21.15.146:0/762553898 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55d00138c0 con 0x563d8cd8cc20 2024-09-18T01:45:29.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.288+0000 7f55d9b28800 1 -- 172.21.15.146:0/762553898 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d8cd8bd70 con 0x563d8cd8cc20 2024-09-18T01:45:29.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.289+0000 7f54bb7fe640 1 -- 172.21.15.146:0/762553898 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f55d0011040 con 0x563d8cd8cc20 2024-09-18T01:45:29.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.289+0000 7f54bb7fe640 1 --2- 172.21.15.146:0/762553898 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f54b0036b90 0x7f54b0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:29.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.289+0000 7f54bb7fe640 1 -- 172.21.15.146:0/762553898 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f55d001d070 con 0x563d8cd8cc20 2024-09-18T01:45:29.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.289+0000 7f55d58b3640 1 --2- 172.21.15.146:0/762553898 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f54b0036b90 0x7f54b0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:29.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.289+0000 7f55d9b28800 1 Processor -- start 2024-09-18T01:45:29.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.289+0000 7f55d9b28800 1 -- start start 2024-09-18T01:45:29.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.289+0000 7f55d58b3640 1 --2- 172.21.15.146:0/762553898 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f54b0036b90 0x7f54b0039050 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f55c8001630 tx=0x7f55c804b640 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:29.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.289+0000 7f55d9b28800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8ceaccd0 0x563d8cead0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:29.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.290+0000 7f55d9b28800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x563d8ce7bde0 con 0x563d8ceaccd0 2024-09-18T01:45:29.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.290+0000 7f55d60b4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8ceaccd0 0x563d8cead0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:29.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.290+0000 7f55d60b4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8ceaccd0 0x563d8cead0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:58368/0 (socket says 172.21.15.146:58368) 2024-09-18T01:45:29.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.290+0000 7f55d60b4640 1 -- 172.21.15.146:0/2963916500 learned_addr learned my addr 172.21.15.146:0/2963916500 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:29.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.290+0000 7f55d60b4640 1 -- 172.21.15.146:0/2963916500 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d8cead6a0 con 0x563d8ceaccd0 2024-09-18T01:45:29.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.290+0000 7f55d60b4640 1 --2- 172.21.15.146:0/2963916500 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8ceaccd0 0x563d8cead0d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f55d004c8c0 tx=0x7f55d0001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a71a96b868d2b36e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:29.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.290+0000 7f54b97fa640 1 -- 172.21.15.146:0/2963916500 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55d0027040 con 0x563d8ceaccd0 2024-09-18T01:45:29.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.290+0000 7f54b97fa640 1 -- 172.21.15.146:0/2963916500 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55d0012cc0 con 0x563d8ceaccd0 2024-09-18T01:45:29.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.290+0000 7f54b97fa640 1 -- 172.21.15.146:0/2963916500 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55d004b250 con 0x563d8ceaccd0 2024-09-18T01:45:29.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.291+0000 7f55d9b28800 1 -- 172.21.15.146:0/2963916500 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8ceaccd0 msgr2=0x563d8cead0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:29.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.291+0000 7f55d9b28800 1 --2- 172.21.15.146:0/2963916500 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8ceaccd0 0x563d8cead0d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f55d004c8c0 tx=0x7f55d0001940 comp rx=0 tx=0).stop 2024-09-18T01:45:29.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.291+0000 7f55d9b28800 1 -- 172.21.15.146:0/2963916500 shutdown_connections 2024-09-18T01:45:29.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.291+0000 7f55d9b28800 1 --2- 172.21.15.146:0/2963916500 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8ceaccd0 0x563d8cead0d0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:29.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.291+0000 7f55d9b28800 1 -- 172.21.15.146:0/2963916500 >> 172.21.15.146:0/2963916500 conn(0x563d8cea9030 msgr2=0x563d8cea7130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:29.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.291+0000 7f55d9b28800 1 -- 172.21.15.146:0/2963916500 shutdown_connections 2024-09-18T01:45:29.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.291+0000 7f55d9b28800 1 -- 172.21.15.146:0/2963916500 wait complete. 2024-09-18T01:45:29.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.291+0000 7f55d9b28800 1 Processor -- start 2024-09-18T01:45:29.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.291+0000 7f55d9b28800 1 -- start start 2024-09-18T01:45:29.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.291+0000 7f55d9b28800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8ceaccd0 0x563d8ceb41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:29.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.291+0000 7f55d9b28800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x563d8ceadd10 con 0x563d8ceaccd0 2024-09-18T01:45:29.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.291+0000 7f55d60b4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8ceaccd0 0x563d8ceb41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:29.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.291+0000 7f55d60b4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8ceaccd0 0x563d8ceb41a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:58384/0 (socket says 172.21.15.146:58384) 2024-09-18T01:45:29.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.291+0000 7f55d60b4640 1 -- 172.21.15.146:0/1236216875 learned_addr learned my addr 172.21.15.146:0/1236216875 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:29.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.292+0000 7f55d60b4640 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d8ceb46e0 con 0x563d8ceaccd0 2024-09-18T01:45:29.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.292+0000 7f55d60b4640 1 --2- 172.21.15.146:0/1236216875 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8ceaccd0 0x563d8ceb41a0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f55d004b7b0 tx=0x7f55d004c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:29.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.292+0000 7f54a77fe640 1 -- 172.21.15.146:0/1236216875 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55d0027070 con 0x563d8ceaccd0 2024-09-18T01:45:29.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.292+0000 7f54a77fe640 1 -- 172.21.15.146:0/1236216875 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55d0013e30 con 0x563d8ceaccd0 2024-09-18T01:45:29.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.292+0000 7f54a77fe640 1 -- 172.21.15.146:0/1236216875 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55d002aa60 con 0x563d8ceaccd0 2024-09-18T01:45:29.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.292+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563d8ceb4970 con 0x563d8ceaccd0 2024-09-18T01:45:29.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.292+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d8ceb7620 con 0x563d8ceaccd0 2024-09-18T01:45:29.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.293+0000 7f54a77fe640 1 -- 172.21.15.146:0/1236216875 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f55d002ac00 con 0x563d8ceaccd0 2024-09-18T01:45:29.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.293+0000 7f54a77fe640 1 --2- 172.21.15.146:0/1236216875 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f54a0036b90 0x7f54a0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:29.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.293+0000 7f54a77fe640 1 -- 172.21.15.146:0/1236216875 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f55d0033070 con 0x563d8ceaccd0 2024-09-18T01:45:29.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.293+0000 7f55d58b3640 1 --2- 172.21.15.146:0/1236216875 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f54a0036b90 0x7f54a0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:29.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.293+0000 7f55d58b3640 1 --2- 172.21.15.146:0/1236216875 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f54a0036b90 0x7f54a0039050 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f55c800bc50 tx=0x7f55c8033000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:29.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.293+0000 7f55d9b28800 20 rados->read ofs=0 len=0 2024-09-18T01:45:29.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.293+0000 7f55d9b28800 1 --2- 172.21.15.146:0/1236216875 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x563d8cebfe50 0x563d8cec2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:29.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.293+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563d8cec2a60 con 0x563d8cebfe50 2024-09-18T01:45:29.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.294+0000 7f55d50b2640 1 --2- 172.21.15.146:0/1236216875 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x563d8cebfe50 0x563d8cec2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:29.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.294+0000 7f55d50b2640 1 --2- 172.21.15.146:0/1236216875 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x563d8cebfe50 0x563d8cec2310 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:29.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.294+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55c0051070 con 0x563d8cebfe50 2024-09-18T01:45:29.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.294+0000 7f55d9b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:29.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.294+0000 7f55d9b28800 20 realm 2024-09-18T01:45:29.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.294+0000 7f55d9b28800 20 rados->read ofs=0 len=0 2024-09-18T01:45:29.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.294+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563d8cec2e90 con 0x563d8cebfe50 2024-09-18T01:45:29.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.294+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55c0051070 con 0x563d8cebfe50 2024-09-18T01:45:29.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.294+0000 7f55d9b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:29.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.294+0000 7f55d9b28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:29.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.294+0000 7f55d9b28800 20 rados->read ofs=0 len=0 2024-09-18T01:45:29.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.294+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563d8cec3760 con 0x563d8cebfe50 2024-09-18T01:45:29.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.295+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55c0051070 con 0x563d8cebfe50 2024-09-18T01:45:29.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.295+0000 7f55d9b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:29.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.295+0000 7f55d9b28800 20 rados->read ofs=0 len=0 2024-09-18T01:45:29.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.295+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563d8cec3b00 con 0x563d8cebfe50 2024-09-18T01:45:29.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.295+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f55c0051070 con 0x563d8cebfe50 2024-09-18T01:45:29.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.295+0000 7f55d9b28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:29.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.295+0000 7f55d9b28800 20 rados->read ofs=0 len=0 2024-09-18T01:45:29.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.295+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563d8cec4350 con 0x563d8cebfe50 2024-09-18T01:45:29.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.295+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f55c0051070 con 0x563d8cebfe50 2024-09-18T01:45:29.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.295+0000 7f55d9b28800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:29.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.295+0000 7f55d9b28800 20 searching for the correct realm 2024-09-18T01:45:29.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.295+0000 7f55d9b28800 1 --2- 172.21.15.146:0/1236216875 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x563d8cec60c0 0x563d8cec84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:29.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.295+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563d8cec8ae0 con 0x563d8cec60c0 2024-09-18T01:45:29.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.295+0000 7f55d60b4640 1 --2- 172.21.15.146:0/1236216875 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x563d8cec60c0 0x563d8cec84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:29.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.296+0000 7f55d60b4640 1 --2- 172.21.15.146:0/1236216875 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x563d8cec60c0 0x563d8cec84b0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:29.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.296+0000 7f55d60b4640 1 -- 172.21.15.146:0/1236216875 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55d0057040 con 0x563d8cec60c0 2024-09-18T01:45:29.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.296+0000 7f55d60b4640 1 --2- 172.21.15.146:0/1236216875 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f55d00123a0 0x7f55d0036580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:29.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.296+0000 7f55d60b4640 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563d8cec8ae0 con 0x7f55d00123a0 2024-09-18T01:45:29.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.296+0000 7f55d58b3640 1 --2- 172.21.15.146:0/1236216875 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f55d00123a0 0x7f55d0036580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:29.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.296+0000 7f55d58b3640 1 --2- 172.21.15.146:0/1236216875 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f55d00123a0 0x7f55d0036580 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:29.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.297+0000 7f55d58b3640 1 -- 172.21.15.146:0/1236216875 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55c802d070 con 0x7f55d00123a0 2024-09-18T01:45:29.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.297+0000 7f55d58b3640 1 --2- 172.21.15.146:0/1236216875 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f55c8018810 0x7f55c803f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:29.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.297+0000 7f55d58b3640 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563d8cec8ae0 con 0x7f55c8018810 2024-09-18T01:45:29.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.297+0000 7f55d50b2640 1 --2- 172.21.15.146:0/1236216875 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f55c8018810 0x7f55c803f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:29.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.297+0000 7f55d50b2640 1 --2- 172.21.15.146:0/1236216875 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f55c8018810 0x7f55c803f1e0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:29.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.297+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55c0051070 con 0x7f55c8018810 2024-09-18T01:45:29.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.297+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563d8cec8ae0 con 0x563d8cebfe50 2024-09-18T01:45:29.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.298+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f55c0051070 con 0x563d8cebfe50 2024-09-18T01:45:29.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.298+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563d8cec8ae0 con 0x563d8cebfe50 2024-09-18T01:45:29.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.298+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55c0051070 con 0x563d8cebfe50 2024-09-18T01:45:29.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.298+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563d8cec8ae0 con 0x7f55c8018810 2024-09-18T01:45:29.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.298+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55c0051070 con 0x7f55c8018810 2024-09-18T01:45:29.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.298+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563d8cec8ae0 con 0x7f55c8018810 2024-09-18T01:45:29.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.298+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55c0051070 con 0x7f55c8018810 2024-09-18T01:45:29.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.298+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563d8cec8ae0 con 0x7f55d00123a0 2024-09-18T01:45:29.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.299+0000 7f55d58b3640 1 -- 172.21.15.146:0/1236216875 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55c802d070 con 0x7f55d00123a0 2024-09-18T01:45:29.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.299+0000 7f55d58b3640 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563d8cec8ae0 con 0x563d8cec60c0 2024-09-18T01:45:29.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.299+0000 7f55d60b4640 1 -- 172.21.15.146:0/1236216875 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55d0057040 con 0x563d8cec60c0 2024-09-18T01:45:29.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.299+0000 7f55d60b4640 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563d8cec8ae0 con 0x563d8cebfe50 2024-09-18T01:45:29.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.299+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55c0051070 con 0x563d8cebfe50 2024-09-18T01:45:29.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.299+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563d8cec8ae0 con 0x7f55c8018810 2024-09-18T01:45:29.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.299+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55c0051070 con 0x7f55c8018810 2024-09-18T01:45:29.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.299+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563d8cec8ae0 con 0x563d8cebfe50 2024-09-18T01:45:29.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.299+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55c0051070 con 0x563d8cebfe50 2024-09-18T01:45:29.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.299+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563d8cec8ae0 con 0x7f55d00123a0 2024-09-18T01:45:29.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.300+0000 7f55d58b3640 1 -- 172.21.15.146:0/1236216875 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f55c802d070 con 0x7f55d00123a0 2024-09-18T01:45:29.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.300+0000 7f55d58b3640 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f55c805a0a0 con 0x563d8cec60c0 2024-09-18T01:45:29.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.300+0000 7f55d60b4640 1 -- 172.21.15.146:0/1236216875 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55d0057040 con 0x563d8cec60c0 2024-09-18T01:45:29.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.300+0000 7f55d60b4640 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f55c805a0a0 con 0x563d8cec60c0 2024-09-18T01:45:29.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.300+0000 7f55d60b4640 1 -- 172.21.15.146:0/1236216875 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55d0057040 con 0x563d8cec60c0 2024-09-18T01:45:29.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.300+0000 7f55d60b4640 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f55c805a0a0 con 0x7f55c8018810 2024-09-18T01:45:29.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.300+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55c0051070 con 0x7f55c8018810 2024-09-18T01:45:29.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.300+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f55c805a0a0 con 0x563d8cec60c0 2024-09-18T01:45:29.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.301+0000 7f55d60b4640 1 -- 172.21.15.146:0/1236216875 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55d0057040 con 0x563d8cec60c0 2024-09-18T01:45:29.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.301+0000 7f55d60b4640 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f55c805a0a0 con 0x563d8cec60c0 2024-09-18T01:45:29.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.301+0000 7f55d60b4640 1 -- 172.21.15.146:0/1236216875 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55d0057040 con 0x563d8cec60c0 2024-09-18T01:45:29.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.301+0000 7f55d60b4640 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f55c805a0a0 con 0x563d8cebfe50 2024-09-18T01:45:29.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.301+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55c0051070 con 0x563d8cebfe50 2024-09-18T01:45:29.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.301+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f55c805a0a0 con 0x563d8cebfe50 2024-09-18T01:45:29.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.301+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f55c0051070 con 0x563d8cebfe50 2024-09-18T01:45:29.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.301+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f55c805a0a0 con 0x7f55c8018810 2024-09-18T01:45:29.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.301+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55c0051070 con 0x7f55c8018810 2024-09-18T01:45:29.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.302+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f55c805a0a0 con 0x563d8cec60c0 2024-09-18T01:45:29.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.302+0000 7f55d60b4640 1 -- 172.21.15.146:0/1236216875 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55d0057040 con 0x563d8cec60c0 2024-09-18T01:45:29.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.302+0000 7f55d60b4640 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f55c805a0a0 con 0x7f55d00123a0 2024-09-18T01:45:29.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.302+0000 7f55d58b3640 1 -- 172.21.15.146:0/1236216875 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55c802d070 con 0x7f55d00123a0 2024-09-18T01:45:29.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.302+0000 7f55d58b3640 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f55c805a0a0 con 0x563d8cebfe50 2024-09-18T01:45:29.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.302+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55c0051070 con 0x563d8cebfe50 2024-09-18T01:45:29.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.302+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f55c805a0a0 con 0x7f55c8018810 2024-09-18T01:45:29.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.302+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55c0051070 con 0x7f55c8018810 2024-09-18T01:45:29.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.302+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f55c805a0a0 con 0x563d8cec60c0 2024-09-18T01:45:29.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.303+0000 7f55d60b4640 1 -- 172.21.15.146:0/1236216875 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55d0057040 con 0x563d8cec60c0 2024-09-18T01:45:29.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.303+0000 7f55d60b4640 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f55c805a0a0 con 0x7f55c8018810 2024-09-18T01:45:29.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.303+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55c0051070 con 0x7f55c8018810 2024-09-18T01:45:29.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.303+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f55c805a0a0 con 0x7f55d00123a0 2024-09-18T01:45:29.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.303+0000 7f55d58b3640 1 -- 172.21.15.146:0/1236216875 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55c802d070 con 0x7f55d00123a0 2024-09-18T01:45:29.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.303+0000 7f55d58b3640 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f55c805a0a0 con 0x563d8cec60c0 2024-09-18T01:45:29.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.303+0000 7f55d60b4640 1 -- 172.21.15.146:0/1236216875 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55d0057040 con 0x563d8cec60c0 2024-09-18T01:45:29.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.303+0000 7f55d60b4640 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f55c805a0a0 con 0x7f55c8018810 2024-09-18T01:45:29.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.304+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55c0051070 con 0x7f55c8018810 2024-09-18T01:45:29.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.304+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f55c805a0a0 con 0x563d8cebfe50 2024-09-18T01:45:29.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.304+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f55c0051070 con 0x563d8cebfe50 2024-09-18T01:45:29.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.304+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f55c805a0a0 con 0x7f55d00123a0 2024-09-18T01:45:29.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.304+0000 7f55d58b3640 1 -- 172.21.15.146:0/1236216875 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55c802d070 con 0x7f55d00123a0 2024-09-18T01:45:29.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.304+0000 7f55d9b28800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:29.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.304+0000 7f55d9b28800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:29.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.304+0000 7f55d9b28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:29.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.304+0000 7f55d9b28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:29.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.304+0000 7f55d9b28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:29.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.304+0000 7f55d9b28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:29.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.304+0000 7f55d9b28800 20 rados->read ofs=0 len=0 2024-09-18T01:45:29.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.304+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563d8cec4d00 con 0x563d8cebfe50 2024-09-18T01:45:29.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.304+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55c0051070 con 0x563d8cebfe50 2024-09-18T01:45:29.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.304+0000 7f55d9b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:29.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.304+0000 7f55d9b28800 20 rados->read ofs=0 len=0 2024-09-18T01:45:29.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.304+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563d8cec55a0 con 0x563d8cebfe50 2024-09-18T01:45:29.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.304+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f55c0051070 con 0x563d8cebfe50 2024-09-18T01:45:29.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.305+0000 7f55d9b28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:29.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.305+0000 7f55d9b28800 20 rados->read ofs=0 len=0 2024-09-18T01:45:29.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.305+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563d8cec8f60 con 0x7f55d00123a0 2024-09-18T01:45:29.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.305+0000 7f55d58b3640 1 -- 172.21.15.146:0/1236216875 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f55c802d070 con 0x7f55d00123a0 2024-09-18T01:45:29.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.305+0000 7f55d9b28800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:29.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.305+0000 7f55d9b28800 20 zone default found 2024-09-18T01:45:29.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.305+0000 7f55d9b28800 4 Realm: () 2024-09-18T01:45:29.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.305+0000 7f55d9b28800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:29.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.305+0000 7f55d9b28800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:29.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.305+0000 7f55d9b28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:29.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.305+0000 7f55d9b28800 20 zonegroup default 2024-09-18T01:45:29.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.305+0000 7f55d9b28800 20 rados->read ofs=0 len=0 2024-09-18T01:45:29.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.305+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563d8cec97b0 con 0x7f55c8018810 2024-09-18T01:45:29.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.305+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f55c0051070 con 0x7f55c8018810 2024-09-18T01:45:29.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.305+0000 7f55d9b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:29.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.305+0000 7f55d9b28800 20 rados->read ofs=0 len=0 2024-09-18T01:45:29.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.305+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563d8cecb190 con 0x563d8cec60c0 2024-09-18T01:45:29.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.305+0000 7f55d60b4640 1 -- 172.21.15.146:0/1236216875 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f55d0057040 con 0x563d8cec60c0 2024-09-18T01:45:29.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.305+0000 7f55d9b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:29.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.305+0000 7f55d9b28800 20 rados->read ofs=0 len=0 2024-09-18T01:45:29.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.305+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563d8cecb6a0 con 0x563d8cec60c0 2024-09-18T01:45:29.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.306+0000 7f55d60b4640 1 -- 172.21.15.146:0/1236216875 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f55d0057040 con 0x563d8cec60c0 2024-09-18T01:45:29.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.306+0000 7f55d9b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:29.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.306+0000 7f55d9b28800 20 started sync module instance, tier type = 2024-09-18T01:45:29.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.306+0000 7f55d9b28800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:29.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.306+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d8ceca620 con 0x7f55d00123a0 2024-09-18T01:45:29.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.307+0000 7f55d58b3640 1 -- 172.21.15.146:0/1236216875 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v31'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55c802d070 con 0x7f55d00123a0 2024-09-18T01:45:29.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.307+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94822357314064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d8ceca280 con 0x7f55d00123a0 2024-09-18T01:45:29.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.307+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d8cecc4e0 con 0x563d8cebfe50 2024-09-18T01:45:29.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.308+0000 7f55d58b3640 1 -- 172.21.15.146:0/1236216875 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94822357314064] v31'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55c802d070 con 0x7f55d00123a0 2024-09-18T01:45:29.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.308+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v31'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55c0051070 con 0x563d8cebfe50 2024-09-18T01:45:29.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.308+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94822357318400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d8cecc8d0 con 0x563d8cebfe50 2024-09-18T01:45:29.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.308+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d8cecd330 con 0x563d8cec60c0 2024-09-18T01:45:29.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.309+0000 7f55d60b4640 1 -- 172.21.15.146:0/1236216875 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v31'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55d0057040 con 0x563d8cec60c0 2024-09-18T01:45:29.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.309+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94822357323232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d8cecd330 con 0x563d8cec60c0 2024-09-18T01:45:29.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.309+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d8cece330 con 0x7f55d00123a0 2024-09-18T01:45:29.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.309+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94822357318400] v31'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55c0051070 con 0x563d8cebfe50 2024-09-18T01:45:29.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.310+0000 7f55d60b4640 1 -- 172.21.15.146:0/1236216875 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94822357323232] v31'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55d0057040 con 0x563d8cec60c0 2024-09-18T01:45:29.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.310+0000 7f55d58b3640 1 -- 172.21.15.146:0/1236216875 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v31'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55c802d070 con 0x7f55d00123a0 2024-09-18T01:45:29.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.310+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94822357327392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d8cecd720 con 0x7f55d00123a0 2024-09-18T01:45:29.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.310+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d8ceced40 con 0x563d8cebfe50 2024-09-18T01:45:29.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.311+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v31'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55c0051070 con 0x563d8cebfe50 2024-09-18T01:45:29.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.311+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94822357330064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d8cecf160 con 0x563d8cebfe50 2024-09-18T01:45:29.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.311+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d8cecfb90 con 0x7f55c8018810 2024-09-18T01:45:29.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.311+0000 7f55d58b3640 1 -- 172.21.15.146:0/1236216875 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94822357327392] v31'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55c802d070 con 0x7f55d00123a0 2024-09-18T01:45:29.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.312+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v31'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55c0051070 con 0x7f55c8018810 2024-09-18T01:45:29.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.312+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94822357330064] v31'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55c0051070 con 0x563d8cebfe50 2024-09-18T01:45:29.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.312+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94822357319456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d8cecfb50 con 0x7f55c8018810 2024-09-18T01:45:29.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.312+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d8cececb0 con 0x7f55c8018810 2024-09-18T01:45:29.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.313+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94822357319456] v31'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55c0051070 con 0x7f55c8018810 2024-09-18T01:45:29.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.314+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v31'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55c0051070 con 0x7f55c8018810 2024-09-18T01:45:29.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.314+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94822357333664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d8cecfac0 con 0x7f55c8018810 2024-09-18T01:45:29.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.314+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d8ced0a80 con 0x7f55c8018810 2024-09-18T01:45:29.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.314+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94822357333664] v31'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55c0051070 con 0x7f55c8018810 2024-09-18T01:45:29.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.314+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v31'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55c0051070 con 0x7f55c8018810 2024-09-18T01:45:29.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.315+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94822357336352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d8ced09f0 con 0x7f55c8018810 2024-09-18T01:45:29.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.315+0000 7f55d9b28800 20 add_watcher() i=0 2024-09-18T01:45:29.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.315+0000 7f55d9b28800 20 add_watcher() i=1 2024-09-18T01:45:29.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.315+0000 7f55d9b28800 20 add_watcher() i=2 2024-09-18T01:45:29.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.315+0000 7f55d9b28800 20 add_watcher() i=3 2024-09-18T01:45:29.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.315+0000 7f55d9b28800 20 add_watcher() i=4 2024-09-18T01:45:29.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.315+0000 7f55d9b28800 20 add_watcher() i=5 2024-09-18T01:45:29.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.315+0000 7f55d9b28800 20 add_watcher() i=6 2024-09-18T01:45:29.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.315+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94822357336352] v31'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55c0051070 con 0x7f55c8018810 2024-09-18T01:45:29.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.315+0000 7f55d9b28800 20 add_watcher() i=7 2024-09-18T01:45:29.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.315+0000 7f55d9b28800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:29.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.315+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563d8ced3ea0 con 0x563d8cebfe50 2024-09-18T01:45:29.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.316+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f55c0051070 con 0x563d8cebfe50 2024-09-18T01:45:29.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.316+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94822357337872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d8ced1340 con 0x563d8cebfe50 2024-09-18T01:45:29.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.317+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94822357337872] v31'156 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f55c0051070 con 0x563d8cebfe50 2024-09-18T01:45:29.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.317+0000 7f547f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:29.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.317+0000 7f55d9b28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:29.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.317+0000 7f55d9b28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:29.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.317+0000 7f55d9b28800 5 note: GC not initialized 2024-09-18T01:45:29.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.317+0000 7f547e7fc640 20 reqs_thread_entry: start 2024-09-18T01:45:29.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.317+0000 7f55d9b28800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:29.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.317+0000 7f55d9b28800 20 Filter name: none 2024-09-18T01:45:29.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.317+0000 7f53f7fff640 20 reqs_thread_entry: start 2024-09-18T01:45:29.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.318+0000 7f55d9b28800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T01:45:29.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.318+0000 7f55d9b28800 20 rados->read ofs=0 len=0 2024-09-18T01:45:29.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.318+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563d8cf071c0 con 0x563d8cebfe50 2024-09-18T01:45:29.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.318+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f55c0051070 con 0x563d8cebfe50 2024-09-18T01:45:29.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.318+0000 7f55d9b28800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:45:29.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.318+0000 7f55d9b28800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T01:45:29.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.318+0000 7f55d9b28800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:45:29.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.318+0000 7f55d9b28800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:45:29.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.318+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563d8cf09c50 con 0x7f55d00123a0 2024-09-18T01:45:29.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.318+0000 7f55d58b3640 1 -- 172.21.15.146:0/1236216875 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f55c802d070 con 0x7f55d00123a0 2024-09-18T01:45:29.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.318+0000 7f55d9b28800 20 enabling bucket name=myfoo 2024-09-18T01:45:29.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.318+0000 7f55d9b28800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-18T01:45:29.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.318+0000 7f55d9b28800 20 rados->read ofs=0 len=0 2024-09-18T01:45:29.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.318+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563d8cf07c30 con 0x7f55d00123a0 2024-09-18T01:45:29.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.319+0000 7f55d58b3640 1 -- 172.21.15.146:0/1236216875 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7f55c802d070 con 0x7f55d00123a0 2024-09-18T01:45:29.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.319+0000 7f55d9b28800 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T01:45:29.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.319+0000 7f55d9b28800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-18T01:45:29.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.319+0000 7f55d9b28800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T01:45:29.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.319+0000 7f55d9b28800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 : miss 2024-09-18T01:45:29.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.319+0000 7f55d9b28800 20 rados->read ofs=0 len=0 2024-09-18T01:45:29.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.319+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:65 8.13 8:ceaa8859:root::.bucket.meta.myfoo%3a8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563d8cf0a5a0 con 0x7f55c8018810 2024-09-18T01:45:29.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.319+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(65 .bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv14 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f55c00872a0 con 0x7f55c8018810 2024-09-18T01:45:29.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.319+0000 7f55d9b28800 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T01:45:29.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.319+0000 7f55d9b28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 info.flags=0x17 2024-09-18T01:45:29.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.319+0000 7f55d9b28800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 to cache LRU end 2024-09-18T01:45:29.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.319+0000 7f55d9b28800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:45:29.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.319+0000 7f55d9b28800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T01:45:29.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.319+0000 7f55d9b28800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 2024-09-18T01:45:29.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.319+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:66 8.13 8:ceaa8859:root::.bucket.meta.myfoo%3a8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d8cf12180 con 0x7f55c8018810 2024-09-18T01:45:29.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.321+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(66 .bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v31'15 uv15 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f55c00872a0 con 0x7f55c8018810 2024-09-18T01:45:29.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.321+0000 7f55d9b28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 info.flags=0x17 2024-09-18T01:45:29.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.321+0000 7f55d9b28800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 to cache LRU end 2024-09-18T01:45:29.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.321+0000 7f55d9b28800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T01:45:29.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.321+0000 7f55d9b28800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1, ofs0, ns] 2024-09-18T01:45:29.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.321+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94822357576800 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563d8cf0d830 con 0x7f55c8018810 2024-09-18T01:45:29.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.321+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== watch-notify(notify (1) cookie 94822357319456 notify 133143986192 ret 0) ==== 794+0+0 (crc 0 0 0) 0x563d8cf0a990 con 0x7f55c8018810 2024-09-18T01:45:29.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.321+0000 7f54b97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986192 cookie 94822357319456 notifier 4607 bl.length()=752 2024-09-18T01:45:29.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.321+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(67 notify.5 [notify cookie 94822357576800 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f55c00872a0 con 0x7f55c8018810 2024-09-18T01:45:29.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.321+0000 7f54b97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 info.flags=0x17 2024-09-18T01:45:29.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.321+0000 7f54b97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1 to cache LRU end 2024-09-18T01:45:29.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.321+0000 7f54b97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T01:45:29.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.321+0000 7f54b97fa640 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f5498003ea0 con 0x7f55c8018810 2024-09-18T01:45:29.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.321+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55c00872a0 con 0x7f55c8018810 2024-09-18T01:45:29.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.321+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 <== osd.0 v2:172.21.15.129:6800/1759265424 22 ==== watch-notify(notify_complete (2) cookie 94822357576800 notify 133143986192 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563d8cf09ab0 con 0x7f55c8018810 2024-09-18T01:45:29.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.321+0000 7f55d9b28800 20 handle_bi_update(): bucket=:myfoo[8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1]): orig_sources= new_sources= 2024-09-18T01:45:29.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.321+0000 7f55d9b28800 20 handle_bi_update(): bucket=:myfoo[8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1]): potential sources added=[] removed=[] 2024-09-18T01:45:29.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.321+0000 7f55d9b28800 20 handle_bi_update(): bucket=:myfoo[8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1]): orig_dests= new_dests= 2024-09-18T01:45:29.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.321+0000 7f55d9b28800 20 handle_bi_update(): bucket=:myfoo[8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1]): potential dests added=[] removed=[] 2024-09-18T01:45:29.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.321+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d8cf0ac40 con 0x563d8cebfe50 2024-09-18T01:45:29.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.322+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v31'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f55c00872a0 con 0x563d8cebfe50 2024-09-18T01:45:29.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.322+0000 7f55d9b28800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:45:29.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.322+0000 7f55d9b28800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:45:29.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.322+0000 7f55d9b28800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-18T01:45:29.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.322+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94822357576768 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563d8cf0c750 con 0x563d8cebfe50 2024-09-18T01:45:29.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.323+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== watch-notify(notify (1) cookie 94822357330064 notify 133143986193 ret 0) ==== 609+0+0 (crc 0 0 0) 0x563d8cf09ab0 con 0x563d8cebfe50 2024-09-18T01:45:29.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.323+0000 7f54b97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986193 cookie 94822357330064 notifier 4607 bl.length()=567 2024-09-18T01:45:29.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.323+0000 7f54b97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:45:29.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.323+0000 7f54b97fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:45:29.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.323+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(70 notify.4 [notify cookie 94822357576768 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f55c00872a0 con 0x563d8cebfe50 2024-09-18T01:45:29.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.323+0000 7f54b97fa640 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f5498003ea0 con 0x563d8cebfe50 2024-09-18T01:45:29.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.323+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55c00872a0 con 0x563d8cebfe50 2024-09-18T01:45:29.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.323+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== watch-notify(notify_complete (2) cookie 94822357576768 notify 133143986193 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563d8cc53e00 con 0x563d8cebfe50 2024-09-18T01:45:29.339 INFO:teuthology.orchestra.run.smithi146.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T01:45:23.010714Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:45:23.010705Z","tags":[],"group_ids":[]} 2024-09-18T01:45:29.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.324+0000 7f547f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:29.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.324+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94822357337872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d8cf05f70 con 0x563d8cebfe50 2024-09-18T01:45:29.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.325+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 <== osd.1 v2:172.21.15.146:6808/3930274777 28 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94822357337872] v31'157 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f55c00872a0 con 0x563d8cebfe50 2024-09-18T01:45:29.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.325+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94822357314064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d8ced06e0 con 0x7f55d00123a0 2024-09-18T01:45:29.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.326+0000 7f55d58b3640 1 -- 172.21.15.146:0/1236216875 <== osd.2 v2:172.21.15.146:6800/3820039304 14 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94822357314064] v31'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55c802d070 con 0x7f55d00123a0 2024-09-18T01:45:29.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.326+0000 7f55d9b28800 20 remove_watcher() i=0 2024-09-18T01:45:29.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.326+0000 7f55d9b28800 2 removed watcher, disabling cache 2024-09-18T01:45:29.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.326+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94822357318400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d8cecaa10 con 0x563d8cebfe50 2024-09-18T01:45:29.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.327+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 <== osd.1 v2:172.21.15.146:6808/3930274777 29 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94822357318400] v31'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55c00872a0 con 0x563d8cebfe50 2024-09-18T01:45:29.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.327+0000 7f55d9b28800 20 remove_watcher() i=1 2024-09-18T01:45:29.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.327+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94822357323232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d8cecaa10 con 0x563d8cec60c0 2024-09-18T01:45:29.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.328+0000 7f55d60b4640 1 -- 172.21.15.146:0/1236216875 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94822357323232] v31'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55d0057040 con 0x563d8cec60c0 2024-09-18T01:45:29.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.328+0000 7f55d9b28800 20 remove_watcher() i=2 2024-09-18T01:45:29.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.328+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94822357327392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d8cecaa10 con 0x7f55d00123a0 2024-09-18T01:45:29.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.329+0000 7f55d58b3640 1 -- 172.21.15.146:0/1236216875 <== osd.2 v2:172.21.15.146:6800/3820039304 15 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94822357327392] v31'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55c802d070 con 0x7f55d00123a0 2024-09-18T01:45:29.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.329+0000 7f55d9b28800 20 remove_watcher() i=3 2024-09-18T01:45:29.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.329+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94822357330064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d8cecde20 con 0x563d8cebfe50 2024-09-18T01:45:29.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.330+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 <== osd.1 v2:172.21.15.146:6808/3930274777 30 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94822357330064] v31'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55c00872a0 con 0x563d8cebfe50 2024-09-18T01:45:29.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.330+0000 7f55d9b28800 20 remove_watcher() i=4 2024-09-18T01:45:29.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.330+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94822357319456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d8cece890 con 0x7f55c8018810 2024-09-18T01:45:29.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.331+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 <== osd.0 v2:172.21.15.129:6800/1759265424 23 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94822357319456] v31'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55c00872a0 con 0x7f55c8018810 2024-09-18T01:45:29.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.331+0000 7f55d9b28800 20 remove_watcher() i=5 2024-09-18T01:45:29.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.331+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94822357333664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d8cece890 con 0x7f55c8018810 2024-09-18T01:45:29.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.332+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 <== osd.0 v2:172.21.15.129:6800/1759265424 24 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94822357333664] v31'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55c00872a0 con 0x7f55c8018810 2024-09-18T01:45:29.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.332+0000 7f55d9b28800 20 remove_watcher() i=6 2024-09-18T01:45:29.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.332+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94822357336352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d8cecbfb0 con 0x7f55c8018810 2024-09-18T01:45:29.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.333+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 <== osd.0 v2:172.21.15.129:6800/1759265424 25 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94822357336352] v31'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55c00872a0 con 0x7f55c8018810 2024-09-18T01:45:29.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.333+0000 7f55d9b28800 20 remove_watcher() i=7 2024-09-18T01:45:29.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.333+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f55c8018810 msgr2=0x7f55c803f1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:29.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.333+0000 7f55d9b28800 1 --2- 172.21.15.146:0/1236216875 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f55c8018810 0x7f55c803f1e0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:29.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.333+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x563d8cebfe50 msgr2=0x563d8cec2310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:29.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.333+0000 7f55d9b28800 1 --2- 172.21.15.146:0/1236216875 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x563d8cebfe50 0x563d8cec2310 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:29.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.333+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f55d00123a0 msgr2=0x7f55d0036580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:29.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.333+0000 7f55d9b28800 1 --2- 172.21.15.146:0/1236216875 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f55d00123a0 0x7f55d0036580 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:29.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.333+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x563d8cec60c0 msgr2=0x563d8cec84b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:29.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.333+0000 7f55d9b28800 1 --2- 172.21.15.146:0/1236216875 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x563d8cec60c0 0x563d8cec84b0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:29.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.334+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f54a0036b90 msgr2=0x7f54a0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:29.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.334+0000 7f55d9b28800 1 --2- 172.21.15.146:0/1236216875 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f54a0036b90 0x7f54a0039050 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f55c800bc50 tx=0x7f55c8033000 comp rx=0 tx=0).stop 2024-09-18T01:45:29.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.334+0000 7f55d50b2640 1 -- 172.21.15.146:0/1236216875 reap_dead start 2024-09-18T01:45:29.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.334+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8ceaccd0 msgr2=0x563d8ceb41a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:29.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.334+0000 7f55d9b28800 1 --2- 172.21.15.146:0/1236216875 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8ceaccd0 0x563d8ceb41a0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f55d004b7b0 tx=0x7f55d004c820 comp rx=0 tx=0).stop 2024-09-18T01:45:29.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.334+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 shutdown_connections 2024-09-18T01:45:29.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.334+0000 7f55d9b28800 1 --2- 172.21.15.146:0/1236216875 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8ceaccd0 0x563d8ceb41a0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:29.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.334+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 >> 172.21.15.146:0/1236216875 conn(0x563d8cea9030 msgr2=0x563d8cea7100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:29.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.334+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 shutdown_connections 2024-09-18T01:45:29.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.334+0000 7f55d9b28800 1 -- 172.21.15.146:0/1236216875 wait complete. 2024-09-18T01:45:29.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.334+0000 7f55d9b28800 1 -- 172.21.15.146:0/762553898 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f54b0036b90 msgr2=0x7f54b0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:29.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.334+0000 7f55d9b28800 1 --2- 172.21.15.146:0/762553898 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f54b0036b90 0x7f54b0039050 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f55c8001630 tx=0x7f55c804b640 comp rx=0 tx=0).stop 2024-09-18T01:45:29.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.334+0000 7f55d9b28800 1 -- 172.21.15.146:0/762553898 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8cd8cc20 msgr2=0x563d8cd8b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:29.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.334+0000 7f55d9b28800 1 --2- 172.21.15.146:0/762553898 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8cd8cc20 0x563d8cd8b270 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x563d8ce844b0 tx=0x7f55d00178e0 comp rx=0 tx=0).stop 2024-09-18T01:45:29.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.334+0000 7f55d9b28800 1 -- 172.21.15.146:0/762553898 shutdown_connections 2024-09-18T01:45:29.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.334+0000 7f55d9b28800 1 --2- 172.21.15.146:0/762553898 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f54b0036b90 0x7f54b0039050 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:29.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.334+0000 7f55d9b28800 1 --2- 172.21.15.146:0/762553898 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8cd8cc20 0x563d8cd8b270 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:29.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.334+0000 7f55d9b28800 1 -- 172.21.15.146:0/762553898 >> 172.21.15.146:0/762553898 conn(0x563d8ce92db0 msgr2=0x563d8ce95930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:29.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.334+0000 7f55d9b28800 1 -- 172.21.15.146:0/762553898 shutdown_connections 2024-09-18T01:45:29.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.334+0000 7f55d9b28800 1 -- 172.21.15.146:0/762553898 wait complete. 2024-09-18T01:45:29.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.334+0000 7f55d9b28800 1 -- 172.21.15.146:0/1418410235 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x563d8cd90970 msgr2=0x563d8ce8a120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:29.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.334+0000 7f55d9b28800 1 --2- 172.21.15.146:0/1418410235 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x563d8cd90970 0x563d8ce8a120 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:29.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.335+0000 7f55d9b28800 1 -- 172.21.15.146:0/1418410235 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x563d8ce8d870 msgr2=0x563d8ce8fc60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:29.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.335+0000 7f55d9b28800 1 --2- 172.21.15.146:0/1418410235 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x563d8ce8d870 0x563d8ce8fc60 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:29.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.335+0000 7f55d9b28800 1 -- 172.21.15.146:0/1418410235 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f54bc036b90 msgr2=0x7f54bc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:29.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.335+0000 7f55d9b28800 1 --2- 172.21.15.146:0/1418410235 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f54bc036b90 0x7f54bc039050 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f55c0057000 tx=0x7f55c0052000 comp rx=0 tx=0).stop 2024-09-18T01:45:29.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.335+0000 7f55d9b28800 1 -- 172.21.15.146:0/1418410235 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8cd00630 msgr2=0x563d8ce830b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:29.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.335+0000 7f55d9b28800 1 --2- 172.21.15.146:0/1418410235 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8cd00630 0x563d8ce830b0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x563d8ce7c490 tx=0x7f55c8000ed0 comp rx=0 tx=0).stop 2024-09-18T01:45:29.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.335+0000 7f55d9b28800 1 -- 172.21.15.146:0/1418410235 shutdown_connections 2024-09-18T01:45:29.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.335+0000 7f55d9b28800 1 --2- 172.21.15.146:0/1418410235 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x563d8ce8d870 0x563d8ce8fc60 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:29.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.335+0000 7f55d9b28800 1 --2- 172.21.15.146:0/1418410235 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x563d8cd90970 0x563d8ce8a120 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:29.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.335+0000 7f55d9b28800 1 --2- 172.21.15.146:0/1418410235 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f54bc036b90 0x7f54bc039050 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:29.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.335+0000 7f55d9b28800 1 --2- 172.21.15.146:0/1418410235 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8cd00630 0x563d8ce830b0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:29.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.335+0000 7f55d9b28800 1 -- 172.21.15.146:0/1418410235 >> 172.21.15.146:0/1418410235 conn(0x563d8cd86de0 msgr2=0x563d8ce75880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:29.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.335+0000 7f55d9b28800 1 -- 172.21.15.146:0/1418410235 shutdown_connections 2024-09-18T01:45:29.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:29.335+0000 7f55d9b28800 1 -- 172.21.15.146:0/1418410235 wait complete. 2024-09-18T01:45:29.351 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T01:45:23.010714Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:45:23.010705Z', 'tags': [], 'group_ids': []} 2024-09-18T01:45:29.358 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-18T01:45:29.594 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=30000000 bytes_in=0 failed=False 2024-09-18T01:45:29.601 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T01:45:44.601 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-18T01:45:44.602 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-18T01:45:44.602 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-18T01:45:44.652 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:44.653 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:44.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.652+0000 7fee68e87800 1 Processor -- start 2024-09-18T01:45:44.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.652+0000 7fee68e87800 1 -- start start 2024-09-18T01:45:44.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.652+0000 7fee68e87800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55f454941900 0x55f454943cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:44.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.652+0000 7fee68e87800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f4547fcb30 con 0x55f4548b0df0 2024-09-18T01:45:44.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.652+0000 7fee68e87800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x55f4547de360 con 0x55f454941900 2024-09-18T01:45:44.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.652+0000 7fee6617a640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55f454941900 0x55f454943cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:44.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.652+0000 7fee6617a640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55f454941900 0x55f454943cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38084/0 (socket says 172.21.15.146:38084) 2024-09-18T01:45:44.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.652+0000 7fee6617a640 1 -- 172.21.15.146:0/3206490379 learned_addr learned my addr 172.21.15.146:0/3206490379 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:44.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.652+0000 7fee6697b640 1 --1- 172.21.15.146:0/3206490379 >> v1:172.21.15.129:6789/0 conn(0x55f4548b0df0 0x55f4549401e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:45838/0 (socket says 172.21.15.146:45838) 2024-09-18T01:45:44.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.653+0000 7fee6617a640 1 -- 172.21.15.146:0/3206490379 >> v1:172.21.15.129:6789/0 conn(0x55f4548b0df0 legacy=0x55f4549401e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:44.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.653+0000 7fee6617a640 1 -- 172.21.15.146:0/3206490379 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f454804e00 con 0x55f454941900 2024-09-18T01:45:44.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.654+0000 7fee6617a640 1 --2- 172.21.15.146:0/3206490379 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f454941900 0x55f454943cf0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fee5c00a520 tx=0x7fee5c045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7441d8df4d07e27 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:44.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.655+0000 7fee65979640 1 -- 172.21.15.146:0/3206490379 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee5c055070 con 0x55f454941900 2024-09-18T01:45:44.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.655+0000 7fee65979640 1 -- 172.21.15.146:0/3206490379 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee5c0515b0 con 0x55f454941900 2024-09-18T01:45:44.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.655+0000 7fee65979640 1 -- 172.21.15.146:0/3206490379 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee5c0518d0 con 0x55f454941900 2024-09-18T01:45:44.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.655+0000 7fee68e87800 1 -- 172.21.15.146:0/3206490379 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f454941900 msgr2=0x55f454943cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:44.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.655+0000 7fee68e87800 1 --2- 172.21.15.146:0/3206490379 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f454941900 0x55f454943cf0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fee5c00a520 tx=0x7fee5c045ba0 comp rx=0 tx=0).stop 2024-09-18T01:45:44.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.655+0000 7fee68e87800 1 -- 172.21.15.146:0/3206490379 shutdown_connections 2024-09-18T01:45:44.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.655+0000 7fee68e87800 1 --2- 172.21.15.146:0/3206490379 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f454941900 0x55f454943cf0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:44.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.655+0000 7fee68e87800 1 -- 172.21.15.146:0/3206490379 >> 172.21.15.146:0/3206490379 conn(0x55f454937df0 msgr2=0x55f45493a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:44.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.655+0000 7fee68e87800 1 -- 172.21.15.146:0/3206490379 shutdown_connections 2024-09-18T01:45:44.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.655+0000 7fee68e87800 1 -- 172.21.15.146:0/3206490379 wait complete. 2024-09-18T01:45:44.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.671+0000 7fee68e87800 1 Processor -- start 2024-09-18T01:45:44.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.671+0000 7fee68e87800 1 -- start start 2024-09-18T01:45:44.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.671+0000 7fee68e87800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f4548b0df0 0x55f454a2c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:44.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.671+0000 7fee68e87800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55f454889330 con 0x55f4548b0df0 2024-09-18T01:45:44.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.672+0000 7fee6697b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f4548b0df0 0x55f454a2c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:44.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.672+0000 7fee6697b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f4548b0df0 0x55f454a2c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38086/0 (socket says 172.21.15.146:38086) 2024-09-18T01:45:44.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.672+0000 7fee6697b640 1 -- 172.21.15.146:0/1969560165 learned_addr learned my addr 172.21.15.146:0/1969560165 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:44.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.672+0000 7fee6697b640 1 -- 172.21.15.146:0/1969560165 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4547d6bc0 con 0x55f4548b0df0 2024-09-18T01:45:44.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.672+0000 7fee6697b640 1 --2- 172.21.15.146:0/1969560165 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f4548b0df0 0x55f454a2c850 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fee5800b230 tx=0x7fee5800b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e15e7fff80d477aa server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:44.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.672+0000 7fed54e09640 1 -- 172.21.15.146:0/1969560165 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee5800e5c0 con 0x55f4548b0df0 2024-09-18T01:45:44.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.672+0000 7fed54e09640 1 -- 172.21.15.146:0/1969560165 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee58006070 con 0x55f4548b0df0 2024-09-18T01:45:44.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.672+0000 7fed54e09640 1 -- 172.21.15.146:0/1969560165 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee5800e890 con 0x55f4548b0df0 2024-09-18T01:45:44.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.673+0000 7fee68e87800 1 -- 172.21.15.146:0/1969560165 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f4548b0df0 msgr2=0x55f454a2c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:44.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.673+0000 7fee68e87800 1 --2- 172.21.15.146:0/1969560165 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f4548b0df0 0x55f454a2c850 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fee5800b230 tx=0x7fee5800b6f0 comp rx=0 tx=0).stop 2024-09-18T01:45:44.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.673+0000 7fee68e87800 1 -- 172.21.15.146:0/1969560165 shutdown_connections 2024-09-18T01:45:44.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.673+0000 7fee68e87800 1 --2- 172.21.15.146:0/1969560165 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f4548b0df0 0x55f454a2c850 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:44.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.673+0000 7fee68e87800 1 -- 172.21.15.146:0/1969560165 >> 172.21.15.146:0/1969560165 conn(0x55f454937df0 msgr2=0x55f454a28210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:44.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.673+0000 7fee68e87800 1 -- 172.21.15.146:0/1969560165 shutdown_connections 2024-09-18T01:45:44.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.673+0000 7fee68e87800 1 -- 172.21.15.146:0/1969560165 wait complete. 2024-09-18T01:45:44.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.674+0000 7fee68e87800 1 Processor -- start 2024-09-18T01:45:44.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.674+0000 7fee68e87800 1 -- start start 2024-09-18T01:45:44.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.674+0000 7fee68e87800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f4548b0df0 0x55f454a34250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:44.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.674+0000 7fee68e87800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55f4549445f0 con 0x55f4548b0df0 2024-09-18T01:45:44.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.674+0000 7fee6697b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f4548b0df0 0x55f454a34250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:44.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.674+0000 7fee6697b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f4548b0df0 0x55f454a34250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38100/0 (socket says 172.21.15.146:38100) 2024-09-18T01:45:44.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.674+0000 7fee6697b640 1 -- 172.21.15.146:0/1028329620 learned_addr learned my addr 172.21.15.146:0/1028329620 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:44.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.674+0000 7fee6697b640 1 -- 172.21.15.146:0/1028329620 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4547eafe0 con 0x55f4548b0df0 2024-09-18T01:45:44.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.674+0000 7fee6697b640 1 --2- 172.21.15.146:0/1028329620 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f4548b0df0 0x55f454a34250 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fee58000fd0 tx=0x7fee58000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:44.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.675+0000 7fed53606640 1 -- 172.21.15.146:0/1028329620 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee5800f8d0 con 0x55f4548b0df0 2024-09-18T01:45:44.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.675+0000 7fed53606640 1 -- 172.21.15.146:0/1028329620 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee5800fa90 con 0x55f4548b0df0 2024-09-18T01:45:44.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.675+0000 7fee68e87800 1 -- 172.21.15.146:0/1028329620 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f454a34790 con 0x55f4548b0df0 2024-09-18T01:45:44.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.675+0000 7fed53606640 1 -- 172.21.15.146:0/1028329620 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee5800fdb0 con 0x55f4548b0df0 2024-09-18T01:45:44.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.675+0000 7fee68e87800 1 -- 172.21.15.146:0/1028329620 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f454a34cb0 con 0x55f4548b0df0 2024-09-18T01:45:44.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.676+0000 7fed53606640 1 -- 172.21.15.146:0/1028329620 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fee58017070 con 0x55f4548b0df0 2024-09-18T01:45:44.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.676+0000 7fed53606640 1 --2- 172.21.15.146:0/1028329620 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fed4c036b40 0x7fed4c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:44.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.676+0000 7fed53606640 1 -- 172.21.15.146:0/1028329620 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7fee58015020 con 0x55f4548b0df0 2024-09-18T01:45:44.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.676+0000 7fee6617a640 1 --2- 172.21.15.146:0/1028329620 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fed4c036b40 0x7fed4c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:44.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.676+0000 7fee68e87800 1 --2- 172.21.15.146:0/1028329620 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55f454941900 0x55f454a3b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:44.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.676+0000 7fee68e87800 1 -- 172.21.15.146:0/1028329620 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454a3b840 con 0x55f454941900 2024-09-18T01:45:44.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.676+0000 7fee6717c640 1 --2- 172.21.15.146:0/1028329620 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55f454941900 0x55f454a3b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:44.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.676+0000 7fee6617a640 1 --2- 172.21.15.146:0/1028329620 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fed4c036b40 0x7fed4c039000 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fee5c057000 tx=0x7fee5c052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:44.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.677+0000 7fee6717c640 1 --2- 172.21.15.146:0/1028329620 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55f454941900 0x55f454a3b2c0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:44.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.677+0000 7fee6717c640 1 -- 172.21.15.146:0/1028329620 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fee6000a4a0 con 0x55f454941900 2024-09-18T01:45:44.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.677+0000 7fee68e87800 1 -- 172.21.15.146:0/1028329620 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454a38890 con 0x55f454941900 2024-09-18T01:45:44.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.677+0000 7fee6717c640 1 -- 172.21.15.146:0/1028329620 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fee6000a4a0 con 0x55f454941900 2024-09-18T01:45:44.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.677+0000 7fee68e87800 1 -- 172.21.15.146:0/1028329620 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454a3d660 con 0x55f454941900 2024-09-18T01:45:44.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.677+0000 7fee6717c640 1 -- 172.21.15.146:0/1028329620 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fee6000a4a0 con 0x55f454941900 2024-09-18T01:45:44.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.678+0000 7fee68e87800 1 -- 172.21.15.146:0/1028329620 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454a3c7a0 con 0x55f454941900 2024-09-18T01:45:44.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.678+0000 7fee6717c640 1 -- 172.21.15.146:0/1028329620 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fee6000a4a0 con 0x55f454941900 2024-09-18T01:45:44.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.678+0000 7fee68e87800 1 --2- 172.21.15.146:0/1028329620 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55f454a3d270 0x55f454a40ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:44.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.678+0000 7fee68e87800 1 -- 172.21.15.146:0/1028329620 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454a41240 con 0x55f454a3d270 2024-09-18T01:45:44.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.678+0000 7fee6697b640 1 --2- 172.21.15.146:0/1028329620 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55f454a3d270 0x55f454a40ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:44.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.678+0000 7fee6697b640 1 --2- 172.21.15.146:0/1028329620 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55f454a3d270 0x55f454a40ab0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:44.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.679+0000 7fee6697b640 1 -- 172.21.15.146:0/1028329620 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fee5802e070 con 0x55f454a3d270 2024-09-18T01:45:44.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.679+0000 7fee68e87800 1 Processor -- start 2024-09-18T01:45:44.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.679+0000 7fee68e87800 1 -- start start 2024-09-18T01:45:44.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.679+0000 7fee68e87800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f454a4efd0 0x55f454a4f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:44.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.679+0000 7fee68e87800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55f4547d8580 con 0x55f454a4efd0 2024-09-18T01:45:44.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.679+0000 7fee6717c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f454a4efd0 0x55f454a4f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:44.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.679+0000 7fee6717c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f454a4efd0 0x55f454a4f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38104/0 (socket says 172.21.15.146:38104) 2024-09-18T01:45:44.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.679+0000 7fee6717c640 1 -- 172.21.15.146:0/2334724397 learned_addr learned my addr 172.21.15.146:0/2334724397 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:44.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.680+0000 7fee6717c640 1 -- 172.21.15.146:0/2334724397 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f454a4f930 con 0x55f454a4efd0 2024-09-18T01:45:44.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.680+0000 7fee6717c640 1 --2- 172.21.15.146:0/2334724397 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f454a4efd0 0x55f454a4f3f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x55f454a3bc20 tx=0x7fee600178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:44.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.680+0000 7fed50e01640 1 -- 172.21.15.146:0/2334724397 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee60013440 con 0x55f454a4efd0 2024-09-18T01:45:44.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.680+0000 7fed50e01640 1 -- 172.21.15.146:0/2334724397 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee600135e0 con 0x55f454a4efd0 2024-09-18T01:45:44.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.680+0000 7fee68e87800 1 -- 172.21.15.146:0/2334724397 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f454a4fbc0 con 0x55f454a4efd0 2024-09-18T01:45:44.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.680+0000 7fed50e01640 1 -- 172.21.15.146:0/2334724397 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee600138c0 con 0x55f454a4efd0 2024-09-18T01:45:44.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.680+0000 7fee68e87800 1 -- 172.21.15.146:0/2334724397 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f454a528a0 con 0x55f454a4efd0 2024-09-18T01:45:44.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.681+0000 7fed50e01640 1 -- 172.21.15.146:0/2334724397 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fee60011040 con 0x55f454a4efd0 2024-09-18T01:45:44.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.681+0000 7fed50e01640 1 --2- 172.21.15.146:0/2334724397 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fed40036b40 0x7fed40039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:44.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.681+0000 7fed50e01640 1 -- 172.21.15.146:0/2334724397 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7fee6001d070 con 0x55f454a4efd0 2024-09-18T01:45:44.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.681+0000 7fee6697b640 1 --2- 172.21.15.146:0/2334724397 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fed40036b40 0x7fed40039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:44.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.682+0000 7fee68e87800 1 Processor -- start 2024-09-18T01:45:44.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.682+0000 7fee68e87800 1 -- start start 2024-09-18T01:45:44.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.682+0000 7fee6697b640 1 --2- 172.21.15.146:0/2334724397 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fed40036b40 0x7fed40039000 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fee5800ff70 tx=0x7fee580173c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:44.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.682+0000 7fee68e87800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f454a5bca0 0x55f454a5c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:44.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.682+0000 7fee68e87800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55f454a2d000 con 0x55f454a5bca0 2024-09-18T01:45:44.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.682+0000 7fee6717c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f454a5bca0 0x55f454a5c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:44.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.682+0000 7fee6717c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f454a5bca0 0x55f454a5c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38110/0 (socket says 172.21.15.146:38110) 2024-09-18T01:45:44.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.682+0000 7fee6717c640 1 -- 172.21.15.146:0/3550467278 learned_addr learned my addr 172.21.15.146:0/3550467278 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:44.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.682+0000 7fee6717c640 1 -- 172.21.15.146:0/3550467278 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f454a5c670 con 0x55f454a5bca0 2024-09-18T01:45:44.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.683+0000 7fee6717c640 1 --2- 172.21.15.146:0/3550467278 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f454a5bca0 0x55f454a5c0a0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fee6004c9f0 tx=0x7fee6004cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fd3a085de525137 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:44.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.683+0000 7fed4a7fc640 1 -- 172.21.15.146:0/3550467278 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee6004a020 con 0x55f454a5bca0 2024-09-18T01:45:44.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.683+0000 7fed4a7fc640 1 -- 172.21.15.146:0/3550467278 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee60015560 con 0x55f454a5bca0 2024-09-18T01:45:44.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.683+0000 7fed4a7fc640 1 -- 172.21.15.146:0/3550467278 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee6002a480 con 0x55f454a5bca0 2024-09-18T01:45:44.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.683+0000 7fee68e87800 1 -- 172.21.15.146:0/3550467278 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f454a5bca0 msgr2=0x55f454a5c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:44.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.683+0000 7fee68e87800 1 --2- 172.21.15.146:0/3550467278 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f454a5bca0 0x55f454a5c0a0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fee6004c9f0 tx=0x7fee6004cca0 comp rx=0 tx=0).stop 2024-09-18T01:45:44.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.683+0000 7fee68e87800 1 -- 172.21.15.146:0/3550467278 shutdown_connections 2024-09-18T01:45:44.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.683+0000 7fee68e87800 1 --2- 172.21.15.146:0/3550467278 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f454a5bca0 0x55f454a5c0a0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:44.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.683+0000 7fee68e87800 1 -- 172.21.15.146:0/3550467278 >> 172.21.15.146:0/3550467278 conn(0x55f454a58000 msgr2=0x55f454a56100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:44.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.683+0000 7fee68e87800 1 -- 172.21.15.146:0/3550467278 shutdown_connections 2024-09-18T01:45:44.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.683+0000 7fee68e87800 1 -- 172.21.15.146:0/3550467278 wait complete. 2024-09-18T01:45:44.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.684+0000 7fee68e87800 1 Processor -- start 2024-09-18T01:45:44.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.684+0000 7fee68e87800 1 -- start start 2024-09-18T01:45:44.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.684+0000 7fee68e87800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f454a5bca0 0x55f454a63150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:44.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.684+0000 7fee68e87800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55f454a5cce0 con 0x55f454a5bca0 2024-09-18T01:45:44.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.684+0000 7fee6717c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f454a5bca0 0x55f454a63150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:44.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.684+0000 7fee6717c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f454a5bca0 0x55f454a63150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38124/0 (socket says 172.21.15.146:38124) 2024-09-18T01:45:44.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.684+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 learned_addr learned my addr 172.21.15.146:0/433862089 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:44.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.684+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f454a63690 con 0x55f454a5bca0 2024-09-18T01:45:44.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.685+0000 7fee6717c640 1 --2- 172.21.15.146:0/433862089 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f454a5bca0 0x55f454a63150 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fee60040210 tx=0x7fee6004c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:44.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.685+0000 7fed48ff9640 1 -- 172.21.15.146:0/433862089 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee60013af0 con 0x55f454a5bca0 2024-09-18T01:45:44.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.685+0000 7fed48ff9640 1 -- 172.21.15.146:0/433862089 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee60046040 con 0x55f454a5bca0 2024-09-18T01:45:44.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.685+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f454a63920 con 0x55f454a5bca0 2024-09-18T01:45:44.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.685+0000 7fed48ff9640 1 -- 172.21.15.146:0/433862089 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee60013dc0 con 0x55f454a5bca0 2024-09-18T01:45:44.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.685+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f454a665d0 con 0x55f454a5bca0 2024-09-18T01:45:44.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.686+0000 7fed48ff9640 1 -- 172.21.15.146:0/433862089 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fee6002b3a0 con 0x55f454a5bca0 2024-09-18T01:45:44.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.686+0000 7fed48ff9640 1 --2- 172.21.15.146:0/433862089 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fed30036b90 0x7fed30039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:44.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.686+0000 7fed48ff9640 1 -- 172.21.15.146:0/433862089 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7fee6004ce00 con 0x55f454a5bca0 2024-09-18T01:45:44.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.686+0000 7fee6697b640 1 --2- 172.21.15.146:0/433862089 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fed30036b90 0x7fed30039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:44.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.686+0000 7fee68e87800 20 rados->read ofs=0 len=0 2024-09-18T01:45:44.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.686+0000 7fee68e87800 1 --2- 172.21.15.146:0/433862089 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55f454a6ed00 0x55f454a711c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:44.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.686+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454a71910 con 0x55f454a6ed00 2024-09-18T01:45:44.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.686+0000 7fee6617a640 1 --2- 172.21.15.146:0/433862089 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55f454a6ed00 0x55f454a711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:44.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.686+0000 7fee6697b640 1 --2- 172.21.15.146:0/433862089 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fed30036b90 0x7fed30039050 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fee580197b0 tx=0x7fee58044000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:44.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.687+0000 7fee6617a640 1 --2- 172.21.15.146:0/433862089 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55f454a6ed00 0x55f454a711c0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:44.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.687+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fee5c057030 con 0x55f454a6ed00 2024-09-18T01:45:44.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.687+0000 7fee68e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:44.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.687+0000 7fee68e87800 20 realm 2024-09-18T01:45:44.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.687+0000 7fee68e87800 20 rados->read ofs=0 len=0 2024-09-18T01:45:44.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.687+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454a71d40 con 0x55f454a6ed00 2024-09-18T01:45:44.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.687+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fee5c057030 con 0x55f454a6ed00 2024-09-18T01:45:44.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.687+0000 7fee68e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:44.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.687+0000 7fee68e87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:44.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.687+0000 7fee68e87800 20 rados->read ofs=0 len=0 2024-09-18T01:45:44.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.687+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454a72610 con 0x55f454a6ed00 2024-09-18T01:45:44.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.688+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fee5c057030 con 0x55f454a6ed00 2024-09-18T01:45:44.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.688+0000 7fee68e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:44.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.688+0000 7fee68e87800 20 rados->read ofs=0 len=0 2024-09-18T01:45:44.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.688+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454a729b0 con 0x55f454a6ed00 2024-09-18T01:45:44.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.688+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fee5c057030 con 0x55f454a6ed00 2024-09-18T01:45:44.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.688+0000 7fee68e87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:44.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.688+0000 7fee68e87800 20 rados->read ofs=0 len=0 2024-09-18T01:45:44.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.688+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454a72220 con 0x55f454a6ed00 2024-09-18T01:45:44.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.688+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fee5c057030 con 0x55f454a6ed00 2024-09-18T01:45:44.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.688+0000 7fee68e87800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:44.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.688+0000 7fee68e87800 20 searching for the correct realm 2024-09-18T01:45:44.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.688+0000 7fee68e87800 1 --2- 172.21.15.146:0/433862089 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55f454a74e70 0x55f454a77280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:44.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.688+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f454a77950 con 0x55f454a74e70 2024-09-18T01:45:44.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.688+0000 7fee6717c640 1 --2- 172.21.15.146:0/433862089 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55f454a74e70 0x55f454a77280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:44.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.689+0000 7fee6717c640 1 --2- 172.21.15.146:0/433862089 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55f454a74e70 0x55f454a77280 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:44.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.689+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.689+0000 7fee6717c640 1 --2- 172.21.15.146:0/433862089 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fee60038ba0 0x7fee60001a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:44.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.689+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f454a77950 con 0x7fee60038ba0 2024-09-18T01:45:44.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.689+0000 7fee6697b640 1 --2- 172.21.15.146:0/433862089 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fee60038ba0 0x7fee60001a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:44.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.690+0000 7fee6697b640 1 --2- 172.21.15.146:0/433862089 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fee60038ba0 0x7fee60001a20 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:44.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.690+0000 7fee6697b640 1 -- 172.21.15.146:0/433862089 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee5802e070 con 0x7fee60038ba0 2024-09-18T01:45:44.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.690+0000 7fee6697b640 1 --2- 172.21.15.146:0/433862089 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fee5800f070 0x7fee5801c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:44.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.690+0000 7fee6697b640 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f454a77950 con 0x7fee5800f070 2024-09-18T01:45:44.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.690+0000 7fee6617a640 1 --2- 172.21.15.146:0/433862089 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fee5800f070 0x7fee5801c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:44.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.690+0000 7fee6617a640 1 --2- 172.21.15.146:0/433862089 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fee5800f070 0x7fee5801c620 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:44.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.691+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee5c057030 con 0x7fee5800f070 2024-09-18T01:45:44.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.691+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f454a77950 con 0x55f454a6ed00 2024-09-18T01:45:44.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.691+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fee5c057030 con 0x55f454a6ed00 2024-09-18T01:45:44.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.691+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f454a77950 con 0x55f454a6ed00 2024-09-18T01:45:44.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.691+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee5c057030 con 0x55f454a6ed00 2024-09-18T01:45:44.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.691+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f454a77950 con 0x7fee5800f070 2024-09-18T01:45:44.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.692+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee5c057030 con 0x7fee5800f070 2024-09-18T01:45:44.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.692+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f454a77950 con 0x7fee5800f070 2024-09-18T01:45:44.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.692+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee5c057030 con 0x7fee5800f070 2024-09-18T01:45:44.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.692+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f454a77950 con 0x7fee60038ba0 2024-09-18T01:45:44.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.692+0000 7fee6697b640 1 -- 172.21.15.146:0/433862089 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee5802e070 con 0x7fee60038ba0 2024-09-18T01:45:44.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.692+0000 7fee6697b640 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f454a77950 con 0x55f454a74e70 2024-09-18T01:45:44.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.693+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.693+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f454a77950 con 0x55f454a6ed00 2024-09-18T01:45:44.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.693+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee5c057030 con 0x55f454a6ed00 2024-09-18T01:45:44.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.693+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f454a77950 con 0x7fee5800f070 2024-09-18T01:45:44.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.693+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee5c057030 con 0x7fee5800f070 2024-09-18T01:45:44.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.693+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f454a77950 con 0x55f454a6ed00 2024-09-18T01:45:44.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.693+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee5c057030 con 0x55f454a6ed00 2024-09-18T01:45:44.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.694+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f454a77950 con 0x7fee60038ba0 2024-09-18T01:45:44.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.694+0000 7fee6697b640 1 -- 172.21.15.146:0/433862089 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fee5802e070 con 0x7fee60038ba0 2024-09-18T01:45:44.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.694+0000 7fee6697b640 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f454a77950 con 0x55f454a74e70 2024-09-18T01:45:44.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.694+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.694+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f454a77950 con 0x55f454a74e70 2024-09-18T01:45:44.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.694+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.694+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f454a77950 con 0x7fee5800f070 2024-09-18T01:45:44.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.695+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee5c057030 con 0x7fee5800f070 2024-09-18T01:45:44.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.695+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f454a77950 con 0x55f454a74e70 2024-09-18T01:45:44.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.695+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.695+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f454a77950 con 0x55f454a74e70 2024-09-18T01:45:44.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.695+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.695+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f454a77950 con 0x55f454a6ed00 2024-09-18T01:45:44.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.695+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee5c057030 con 0x55f454a6ed00 2024-09-18T01:45:44.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.695+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f454a77950 con 0x55f454a6ed00 2024-09-18T01:45:44.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.696+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fee5c057030 con 0x55f454a6ed00 2024-09-18T01:45:44.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.696+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f454a77950 con 0x7fee5800f070 2024-09-18T01:45:44.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.696+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee5c057030 con 0x7fee5800f070 2024-09-18T01:45:44.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.696+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f454a77950 con 0x55f454a74e70 2024-09-18T01:45:44.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.696+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.696+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f454a77950 con 0x7fee60038ba0 2024-09-18T01:45:44.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.696+0000 7fee6697b640 1 -- 172.21.15.146:0/433862089 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee5802e070 con 0x7fee60038ba0 2024-09-18T01:45:44.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.696+0000 7fee6697b640 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f454a77950 con 0x55f454a6ed00 2024-09-18T01:45:44.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.697+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee5c057030 con 0x55f454a6ed00 2024-09-18T01:45:44.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.697+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f454a77950 con 0x7fee5800f070 2024-09-18T01:45:44.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.697+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee5c057030 con 0x7fee5800f070 2024-09-18T01:45:44.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.697+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f454a77950 con 0x55f454a74e70 2024-09-18T01:45:44.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.697+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.697+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f454a77950 con 0x7fee5800f070 2024-09-18T01:45:44.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.698+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee5c057030 con 0x7fee5800f070 2024-09-18T01:45:44.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.698+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f454a77950 con 0x7fee60038ba0 2024-09-18T01:45:44.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.698+0000 7fee6697b640 1 -- 172.21.15.146:0/433862089 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee5802e070 con 0x7fee60038ba0 2024-09-18T01:45:44.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.698+0000 7fee6697b640 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f454a77950 con 0x55f454a74e70 2024-09-18T01:45:44.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.698+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.698+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f454a77950 con 0x7fee5800f070 2024-09-18T01:45:44.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.699+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee5c057030 con 0x7fee5800f070 2024-09-18T01:45:44.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.699+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f454a77950 con 0x55f454a6ed00 2024-09-18T01:45:44.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.699+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fee5c057030 con 0x55f454a6ed00 2024-09-18T01:45:44.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.699+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f454a77950 con 0x7fee60038ba0 2024-09-18T01:45:44.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.699+0000 7fee6697b640 1 -- 172.21.15.146:0/433862089 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee5802e070 con 0x7fee60038ba0 2024-09-18T01:45:44.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.699+0000 7fee68e87800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:44.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.699+0000 7fee68e87800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:44.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.699+0000 7fee68e87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:44.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.699+0000 7fee68e87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:44.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.699+0000 7fee68e87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:44.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.699+0000 7fee68e87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:44.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.699+0000 7fee68e87800 20 rados->read ofs=0 len=0 2024-09-18T01:45:44.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.699+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454a738c0 con 0x55f454a6ed00 2024-09-18T01:45:44.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.699+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fee5c057030 con 0x55f454a6ed00 2024-09-18T01:45:44.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.699+0000 7fee68e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:44.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.699+0000 7fee68e87800 20 rados->read ofs=0 len=0 2024-09-18T01:45:44.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.699+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454a74160 con 0x55f454a6ed00 2024-09-18T01:45:44.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.700+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fee5c057030 con 0x55f454a6ed00 2024-09-18T01:45:44.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.700+0000 7fee68e87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:44.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.700+0000 7fee68e87800 20 rados->read ofs=0 len=0 2024-09-18T01:45:44.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.700+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454a73500 con 0x7fee60038ba0 2024-09-18T01:45:44.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.700+0000 7fee6697b640 1 -- 172.21.15.146:0/433862089 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fee5802e070 con 0x7fee60038ba0 2024-09-18T01:45:44.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.700+0000 7fee68e87800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:44.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.700+0000 7fee68e87800 20 zone default found 2024-09-18T01:45:44.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.700+0000 7fee68e87800 4 Realm: () 2024-09-18T01:45:44.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.700+0000 7fee68e87800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:44.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.700+0000 7fee68e87800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:44.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.700+0000 7fee68e87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:44.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.700+0000 7fee68e87800 20 zonegroup default 2024-09-18T01:45:44.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.700+0000 7fee68e87800 20 rados->read ofs=0 len=0 2024-09-18T01:45:44.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.700+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454a78280 con 0x7fee5800f070 2024-09-18T01:45:44.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.700+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fee5c057030 con 0x7fee5800f070 2024-09-18T01:45:44.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.700+0000 7fee68e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:44.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.700+0000 7fee68e87800 20 rados->read ofs=0 len=0 2024-09-18T01:45:44.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.700+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454a79de0 con 0x55f454a74e70 2024-09-18T01:45:44.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.701+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.701+0000 7fee68e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:44.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.701+0000 7fee68e87800 20 rados->read ofs=0 len=0 2024-09-18T01:45:44.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.701+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454a7a230 con 0x55f454a74e70 2024-09-18T01:45:44.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.701+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.701+0000 7fee68e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:44.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.701+0000 7fee68e87800 20 started sync module instance, tier type = 2024-09-18T01:45:44.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.701+0000 7fee68e87800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:44.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.701+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454a78ce0 con 0x7fee60038ba0 2024-09-18T01:45:44.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.702+0000 7fee6697b640 1 -- 172.21.15.146:0/433862089 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v33'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee5802e070 con 0x7fee60038ba0 2024-09-18T01:45:44.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.702+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94507880648912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454a7ab20 con 0x7fee60038ba0 2024-09-18T01:45:44.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.702+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454a7b370 con 0x55f454a6ed00 2024-09-18T01:45:44.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.703+0000 7fee6697b640 1 -- 172.21.15.146:0/433862089 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94507880648912] v33'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee5802e070 con 0x7fee60038ba0 2024-09-18T01:45:44.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.703+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v33'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee5c057030 con 0x55f454a6ed00 2024-09-18T01:45:44.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.703+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94507880656576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454a7b790 con 0x55f454a6ed00 2024-09-18T01:45:44.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.704+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454a7bfe0 con 0x55f454a74e70 2024-09-18T01:45:44.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.705+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94507880656576] v33'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee5c057030 con 0x55f454a6ed00 2024-09-18T01:45:44.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.705+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v33'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.705+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94507880658112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454a7c3d0 con 0x55f454a74e70 2024-09-18T01:45:44.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.705+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454a7cdd0 con 0x7fee60038ba0 2024-09-18T01:45:44.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.706+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94507880658112] v33'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.707+0000 7fee6697b640 1 -- 172.21.15.146:0/433862089 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v33'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee5802e070 con 0x7fee60038ba0 2024-09-18T01:45:44.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.707+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94507880659232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454a7d1c0 con 0x7fee60038ba0 2024-09-18T01:45:44.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.707+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454a7dc00 con 0x55f454a6ed00 2024-09-18T01:45:44.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.709+0000 7fee6697b640 1 -- 172.21.15.146:0/433862089 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94507880659232] v33'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee5802e070 con 0x7fee60038ba0 2024-09-18T01:45:44.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.709+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v33'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee5c057030 con 0x55f454a6ed00 2024-09-18T01:45:44.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.709+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94507880666832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454a7dff0 con 0x55f454a6ed00 2024-09-18T01:45:44.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.709+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454a7e9f0 con 0x7fee5800f070 2024-09-18T01:45:44.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.711+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94507880666832] v33'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee5c057030 con 0x55f454a6ed00 2024-09-18T01:45:44.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.711+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v33'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee5c057030 con 0x7fee5800f070 2024-09-18T01:45:44.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.711+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94507880663264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454a7e9b0 con 0x7fee5800f070 2024-09-18T01:45:44.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.711+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454a7f400 con 0x7fee5800f070 2024-09-18T01:45:44.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.712+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94507880663264] v33'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee5c057030 con 0x7fee5800f070 2024-09-18T01:45:44.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.712+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v33'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee5c057030 con 0x7fee5800f070 2024-09-18T01:45:44.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.713+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94507880670944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454a7f400 con 0x7fee5800f070 2024-09-18T01:45:44.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.713+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454a7fdc0 con 0x7fee5800f070 2024-09-18T01:45:44.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.714+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(58 notify.7 [create] v33'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee5c057030 con 0x7fee5800f070 2024-09-18T01:45:44.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.714+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94507880670944] v33'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee5c057030 con 0x7fee5800f070 2024-09-18T01:45:44.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.714+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94507880675600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454a7fd30 con 0x7fee5800f070 2024-09-18T01:45:44.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.714+0000 7fee68e87800 20 add_watcher() i=0 2024-09-18T01:45:44.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.714+0000 7fee68e87800 20 add_watcher() i=1 2024-09-18T01:45:44.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.714+0000 7fee68e87800 20 add_watcher() i=2 2024-09-18T01:45:44.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.714+0000 7fee68e87800 20 add_watcher() i=3 2024-09-18T01:45:44.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.714+0000 7fee68e87800 20 add_watcher() i=4 2024-09-18T01:45:44.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.714+0000 7fee68e87800 20 add_watcher() i=5 2024-09-18T01:45:44.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.714+0000 7fee68e87800 20 add_watcher() i=6 2024-09-18T01:45:44.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.716+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94507880675600] v33'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee5c057030 con 0x7fee5800f070 2024-09-18T01:45:44.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.716+0000 7fee68e87800 20 add_watcher() i=7 2024-09-18T01:45:44.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.716+0000 7fee68e87800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:44.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.716+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454a83220 con 0x55f454a6ed00 2024-09-18T01:45:44.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.716+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fee5c057030 con 0x55f454a6ed00 2024-09-18T01:45:44.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.716+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94507880673104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454a80740 con 0x55f454a6ed00 2024-09-18T01:45:44.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.717+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94507880673104] v33'158 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fee5c057030 con 0x55f454a6ed00 2024-09-18T01:45:44.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.717+0000 7fed1d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:44.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.718+0000 7fee68e87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:44.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.718+0000 7fee68e87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:44.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.718+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454a8b930 con 0x55f454a6ed00 2024-09-18T01:45:44.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.719+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'49 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee5c057030 con 0x55f454a6ed00 2024-09-18T01:45:44.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.719+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454a8bea0 con 0x7fee5800f070 2024-09-18T01:45:44.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.721+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee5c057030 con 0x7fee5800f070 2024-09-18T01:45:44.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.721+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454a8c2e0 con 0x55f454a74e70 2024-09-18T01:45:44.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.722+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.722+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454a8c180 con 0x55f454a6ed00 2024-09-18T01:45:44.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.723+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'159 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee5c057030 con 0x55f454a6ed00 2024-09-18T01:45:44.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.723+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454a8c8b0 con 0x7fee60038ba0 2024-09-18T01:45:44.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.724+0000 7fee6697b640 1 -- 172.21.15.146:0/433862089 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'50 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee5802e070 con 0x7fee60038ba0 2024-09-18T01:45:44.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.724+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454a8cdb0 con 0x55f454a74e70 2024-09-18T01:45:44.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.725+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'44 uv43 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.725+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454a8cdb0 con 0x55f454a6ed00 2024-09-18T01:45:44.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.726+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee5c057030 con 0x55f454a6ed00 2024-09-18T01:45:44.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.726+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454a8ceb0 con 0x7fee5800f070 2024-09-18T01:45:44.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.727+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'35 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee5c057030 con 0x7fee5800f070 2024-09-18T01:45:44.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.727+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454a8ceb0 con 0x7fee60038ba0 2024-09-18T01:45:44.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.728+0000 7fee6697b640 1 -- 172.21.15.146:0/433862089 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee5802e070 con 0x7fee60038ba0 2024-09-18T01:45:44.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.728+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454a8d340 con 0x55f454a74e70 2024-09-18T01:45:44.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.729+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.729+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454a8d340 con 0x7fee60038ba0 2024-09-18T01:45:44.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.731+0000 7fee6697b640 1 -- 172.21.15.146:0/433862089 <== osd.2 v2:172.21.15.146:6800/3820039304 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'51 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee5802e070 con 0x7fee60038ba0 2024-09-18T01:45:44.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.731+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454a8d340 con 0x7fee5800f070 2024-09-18T01:45:44.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.732+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'20 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee5c057030 con 0x7fee5800f070 2024-09-18T01:45:44.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.732+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454a8d340 con 0x7fee60038ba0 2024-09-18T01:45:44.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.733+0000 7fee6697b640 1 -- 172.21.15.146:0/433862089 <== osd.2 v2:172.21.15.146:6800/3820039304 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'24 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee5802e070 con 0x7fee60038ba0 2024-09-18T01:45:44.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.733+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454a8d340 con 0x7fee5800f070 2024-09-18T01:45:44.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.735+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'47 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee5c057030 con 0x7fee5800f070 2024-09-18T01:45:44.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.735+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454a8d340 con 0x55f454a6ed00 2024-09-18T01:45:44.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.736+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'160 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee5c057030 con 0x55f454a6ed00 2024-09-18T01:45:44.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.736+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454a8d340 con 0x55f454a74e70 2024-09-18T01:45:44.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.737+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'44 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.737+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454a8d340 con 0x7fee60038ba0 2024-09-18T01:45:44.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.738+0000 7fee6697b640 1 -- 172.21.15.146:0/433862089 <== osd.2 v2:172.21.15.146:6800/3820039304 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'52 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee5802e070 con 0x7fee60038ba0 2024-09-18T01:45:44.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.738+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454a8d340 con 0x55f454a74e70 2024-09-18T01:45:44.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.739+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'31 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.739+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454a8d340 con 0x55f454a6ed00 2024-09-18T01:45:44.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.740+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee5c057030 con 0x55f454a6ed00 2024-09-18T01:45:44.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.740+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454a8d340 con 0x55f454a6ed00 2024-09-18T01:45:44.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.741+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'161 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee5c057030 con 0x55f454a6ed00 2024-09-18T01:45:44.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.741+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454a8d340 con 0x55f454a74e70 2024-09-18T01:45:44.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.742+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'45 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.742+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454a8d340 con 0x7fee60038ba0 2024-09-18T01:45:44.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.743+0000 7fee6697b640 1 -- 172.21.15.146:0/433862089 <== osd.2 v2:172.21.15.146:6800/3820039304 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'34 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee5802e070 con 0x7fee60038ba0 2024-09-18T01:45:44.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.743+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454a8d340 con 0x55f454a74e70 2024-09-18T01:45:44.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.744+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'26 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.744+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454a8d340 con 0x55f454a74e70 2024-09-18T01:45:44.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.745+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'36 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.746+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454a8d340 con 0x55f454a74e70 2024-09-18T01:45:44.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.747+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.747+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454a8d340 con 0x55f454a74e70 2024-09-18T01:45:44.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.748+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'45 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.748+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454a8d340 con 0x7fee5800f070 2024-09-18T01:45:44.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.749+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'27 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee5c057030 con 0x7fee5800f070 2024-09-18T01:45:44.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.749+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454a8d340 con 0x55f454a74e70 2024-09-18T01:45:44.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.750+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'30 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.750+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454a8d340 con 0x7fee5800f070 2024-09-18T01:45:44.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.751+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.0 v2:172.21.15.129:6800/1759265424 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'36 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee5c057030 con 0x7fee5800f070 2024-09-18T01:45:44.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.751+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454a8d340 con 0x55f454a74e70 2024-09-18T01:45:44.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.753+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'46 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.753+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454a8d340 con 0x7fee5800f070 2024-09-18T01:45:44.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.754+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.0 v2:172.21.15.129:6800/1759265424 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'48 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee5c057030 con 0x7fee5800f070 2024-09-18T01:45:44.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.754+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454a8d340 con 0x7fee60038ba0 2024-09-18T01:45:44.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.755+0000 7fee6697b640 1 -- 172.21.15.146:0/433862089 <== osd.2 v2:172.21.15.146:6800/3820039304 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee5802e070 con 0x7fee60038ba0 2024-09-18T01:45:44.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.755+0000 7fec97fff640 20 reqs_thread_entry: start 2024-09-18T01:45:44.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.755+0000 7fee68e87800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:44.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.755+0000 7fee68e87800 20 Filter name: none 2024-09-18T01:45:44.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.755+0000 7fec95ffb640 20 reqs_thread_entry: start 2024-09-18T01:45:44.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.755+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454a87c20 con 0x55f454a6ed00 2024-09-18T01:45:44.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.756+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.1 v2:172.21.15.146:6808/3930274777 28 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fee5c057030 con 0x55f454a6ed00 2024-09-18T01:45:44.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.756+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454a87be0 con 0x55f454a6ed00 2024-09-18T01:45:44.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.756+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.1 v2:172.21.15.146:6808/3930274777 29 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv7 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fee5c057030 con 0x55f454a6ed00 2024-09-18T01:45:44.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.756+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454a87be0 con 0x55f454a6ed00 2024-09-18T01:45:44.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.756+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.1 v2:172.21.15.146:6808/3930274777 30 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fee5c057030 con 0x55f454a6ed00 2024-09-18T01:45:44.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.756+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454a87be0 con 0x7fee5800f070 2024-09-18T01:45:44.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.756+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.0 v2:172.21.15.129:6800/1759265424 24 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fee5c087040 con 0x7fee5800f070 2024-09-18T01:45:44.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.756+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454a87be0 con 0x7fee5800f070 2024-09-18T01:45:44.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.757+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.0 v2:172.21.15.129:6800/1759265424 25 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fee5c087040 con 0x7fee5800f070 2024-09-18T01:45:44.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.757+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454a87be0 con 0x7fee5800f070 2024-09-18T01:45:44.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.757+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.0 v2:172.21.15.129:6800/1759265424 26 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fee5c087040 con 0x7fee5800f070 2024-09-18T01:45:44.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.757+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454a87be0 con 0x55f454a74e70 2024-09-18T01:45:44.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.757+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 26 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.758+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454a87be0 con 0x55f454a74e70 2024-09-18T01:45:44.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.758+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 27 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.758+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454a87be0 con 0x55f454a74e70 2024-09-18T01:45:44.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.758+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 28 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.758+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454a87be0 con 0x55f454a6ed00 2024-09-18T01:45:44.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.758+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.1 v2:172.21.15.146:6808/3930274777 31 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fee5c087040 con 0x55f454a6ed00 2024-09-18T01:45:44.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.758+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454a87be0 con 0x55f454a6ed00 2024-09-18T01:45:44.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.758+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.1 v2:172.21.15.146:6808/3930274777 32 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv9 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fee5c087040 con 0x55f454a6ed00 2024-09-18T01:45:44.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.759+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454a87be0 con 0x55f454a6ed00 2024-09-18T01:45:44.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.759+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.1 v2:172.21.15.146:6808/3930274777 33 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fee5c087040 con 0x55f454a6ed00 2024-09-18T01:45:44.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.759+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454a87be0 con 0x7fee60038ba0 2024-09-18T01:45:44.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.759+0000 7fee6697b640 1 -- 172.21.15.146:0/433862089 <== osd.2 v2:172.21.15.146:6800/3820039304 19 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fee5802e070 con 0x7fee60038ba0 2024-09-18T01:45:44.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.759+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454a87be0 con 0x7fee60038ba0 2024-09-18T01:45:44.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.759+0000 7fee6697b640 1 -- 172.21.15.146:0/433862089 <== osd.2 v2:172.21.15.146:6800/3820039304 20 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv7 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fee5802e070 con 0x7fee60038ba0 2024-09-18T01:45:44.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.759+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454a87be0 con 0x7fee60038ba0 2024-09-18T01:45:44.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.760+0000 7fee6697b640 1 -- 172.21.15.146:0/433862089 <== osd.2 v2:172.21.15.146:6800/3820039304 21 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fee5802e070 con 0x7fee60038ba0 2024-09-18T01:45:44.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.760+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454a87be0 con 0x55f454a74e70 2024-09-18T01:45:44.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.760+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv43 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.760+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454a87be0 con 0x55f454a74e70 2024-09-18T01:45:44.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.760+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 30 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv43 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.760+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454a87be0 con 0x55f454a74e70 2024-09-18T01:45:44.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.760+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 31 ==== osd_op_reply(111 gc.5 [call out=1702b] v0'0 uv43 ondisk = 0) ==== 148+0+1702 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.760+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab96b0 con 0x55f454a6ed00 2024-09-18T01:45:44.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.760+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.1 v2:172.21.15.146:6808/3930274777 34 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fee5c087040 con 0x55f454a6ed00 2024-09-18T01:45:44.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.761+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab86a0 con 0x55f454a6ed00 2024-09-18T01:45:44.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.761+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.1 v2:172.21.15.146:6808/3930274777 35 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fee5c087040 con 0x55f454a6ed00 2024-09-18T01:45:44.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.761+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab96b0 con 0x55f454a6ed00 2024-09-18T01:45:44.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.761+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.1 v2:172.21.15.146:6808/3930274777 36 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fee5c087040 con 0x55f454a6ed00 2024-09-18T01:45:44.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.761+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab96b0 con 0x7fee5800f070 2024-09-18T01:45:44.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.762+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.0 v2:172.21.15.129:6800/1759265424 27 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv8 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fee5c087040 con 0x7fee5800f070 2024-09-18T01:45:44.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.762+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab86a0 con 0x7fee5800f070 2024-09-18T01:45:44.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.762+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.0 v2:172.21.15.129:6800/1759265424 28 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv8 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fee5c087040 con 0x7fee5800f070 2024-09-18T01:45:44.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.762+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab96b0 con 0x7fee5800f070 2024-09-18T01:45:44.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.762+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.0 v2:172.21.15.129:6800/1759265424 29 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv8 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fee5c087040 con 0x7fee5800f070 2024-09-18T01:45:44.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.762+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab96b0 con 0x7fee60038ba0 2024-09-18T01:45:44.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.763+0000 7fee6697b640 1 -- 172.21.15.146:0/433862089 <== osd.2 v2:172.21.15.146:6800/3820039304 22 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fee5802e070 con 0x7fee60038ba0 2024-09-18T01:45:44.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.763+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab86a0 con 0x7fee60038ba0 2024-09-18T01:45:44.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.763+0000 7fee6697b640 1 -- 172.21.15.146:0/433862089 <== osd.2 v2:172.21.15.146:6800/3820039304 23 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fee5802e070 con 0x7fee60038ba0 2024-09-18T01:45:44.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.763+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab96b0 con 0x7fee60038ba0 2024-09-18T01:45:44.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.763+0000 7fee6697b640 1 -- 172.21.15.146:0/433862089 <== osd.2 v2:172.21.15.146:6800/3820039304 24 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fee5802e070 con 0x7fee60038ba0 2024-09-18T01:45:44.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.763+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab96b0 con 0x55f454a74e70 2024-09-18T01:45:44.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.763+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 32 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.763+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab86a0 con 0x55f454a74e70 2024-09-18T01:45:44.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.764+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 33 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.764+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab96b0 con 0x55f454a74e70 2024-09-18T01:45:44.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.764+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 34 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.764+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab96b0 con 0x7fee60038ba0 2024-09-18T01:45:44.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.764+0000 7fee6697b640 1 -- 172.21.15.146:0/433862089 <== osd.2 v2:172.21.15.146:6800/3820039304 25 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee5802e070 con 0x7fee60038ba0 2024-09-18T01:45:44.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.764+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab86a0 con 0x7fee60038ba0 2024-09-18T01:45:44.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.764+0000 7fee6697b640 1 -- 172.21.15.146:0/433862089 <== osd.2 v2:172.21.15.146:6800/3820039304 26 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv15 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fee5802e070 con 0x7fee60038ba0 2024-09-18T01:45:44.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.764+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab96b0 con 0x7fee60038ba0 2024-09-18T01:45:44.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.765+0000 7fee6697b640 1 -- 172.21.15.146:0/433862089 <== osd.2 v2:172.21.15.146:6800/3820039304 27 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee5802e070 con 0x7fee60038ba0 2024-09-18T01:45:44.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.765+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab96b0 con 0x7fee5800f070 2024-09-18T01:45:44.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.765+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.0 v2:172.21.15.129:6800/1759265424 30 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee5c087040 con 0x7fee5800f070 2024-09-18T01:45:44.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.765+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab86a0 con 0x7fee5800f070 2024-09-18T01:45:44.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.765+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.0 v2:172.21.15.129:6800/1759265424 31 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv6 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fee5c087040 con 0x7fee5800f070 2024-09-18T01:45:44.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.766+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab96b0 con 0x7fee5800f070 2024-09-18T01:45:44.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.766+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.0 v2:172.21.15.129:6800/1759265424 32 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee5c087040 con 0x7fee5800f070 2024-09-18T01:45:44.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.766+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab96b0 con 0x7fee60038ba0 2024-09-18T01:45:44.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.766+0000 7fee6697b640 1 -- 172.21.15.146:0/433862089 <== osd.2 v2:172.21.15.146:6800/3820039304 28 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee5802e070 con 0x7fee60038ba0 2024-09-18T01:45:44.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.766+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab86a0 con 0x7fee60038ba0 2024-09-18T01:45:44.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.766+0000 7fee6697b640 1 -- 172.21.15.146:0/433862089 <== osd.2 v2:172.21.15.146:6800/3820039304 29 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fee5802e070 con 0x7fee60038ba0 2024-09-18T01:45:44.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.766+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab96b0 con 0x7fee60038ba0 2024-09-18T01:45:44.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.766+0000 7fee6697b640 1 -- 172.21.15.146:0/433862089 <== osd.2 v2:172.21.15.146:6800/3820039304 30 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee5802e070 con 0x7fee60038ba0 2024-09-18T01:45:44.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.766+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab96b0 con 0x7fee5800f070 2024-09-18T01:45:44.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.767+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.0 v2:172.21.15.129:6800/1759265424 33 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv14 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee5c087040 con 0x7fee5800f070 2024-09-18T01:45:44.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.767+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab86a0 con 0x7fee5800f070 2024-09-18T01:45:44.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.767+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.0 v2:172.21.15.129:6800/1759265424 34 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv14 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fee5c087040 con 0x7fee5800f070 2024-09-18T01:45:44.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.767+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab96b0 con 0x7fee5800f070 2024-09-18T01:45:44.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.768+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.0 v2:172.21.15.129:6800/1759265424 35 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv14 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee5c087040 con 0x7fee5800f070 2024-09-18T01:45:44.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.768+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab96b0 con 0x55f454a6ed00 2024-09-18T01:45:44.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.768+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.1 v2:172.21.15.146:6808/3930274777 37 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee5c087040 con 0x55f454a6ed00 2024-09-18T01:45:44.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.768+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab86a0 con 0x55f454a6ed00 2024-09-18T01:45:44.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.768+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.1 v2:172.21.15.146:6808/3930274777 38 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv15 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fee5c087040 con 0x55f454a6ed00 2024-09-18T01:45:44.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.768+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab96b0 con 0x55f454a6ed00 2024-09-18T01:45:44.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.768+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.1 v2:172.21.15.146:6808/3930274777 39 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee5c087040 con 0x55f454a6ed00 2024-09-18T01:45:44.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.768+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab96b0 con 0x55f454a74e70 2024-09-18T01:45:44.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.769+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 35 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.769+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab86a0 con 0x55f454a74e70 2024-09-18T01:45:44.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.769+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 36 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.769+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab96b0 con 0x55f454a74e70 2024-09-18T01:45:44.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.769+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 37 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.769+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab96b0 con 0x7fee60038ba0 2024-09-18T01:45:44.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.769+0000 7fee6697b640 1 -- 172.21.15.146:0/433862089 <== osd.2 v2:172.21.15.146:6800/3820039304 31 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee5802e070 con 0x7fee60038ba0 2024-09-18T01:45:44.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.769+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab86a0 con 0x7fee60038ba0 2024-09-18T01:45:44.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.770+0000 7fee6697b640 1 -- 172.21.15.146:0/433862089 <== osd.2 v2:172.21.15.146:6800/3820039304 32 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv17 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fee5802e070 con 0x7fee60038ba0 2024-09-18T01:45:44.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.770+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab96b0 con 0x7fee60038ba0 2024-09-18T01:45:44.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.770+0000 7fee6697b640 1 -- 172.21.15.146:0/433862089 <== osd.2 v2:172.21.15.146:6800/3820039304 33 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee5802e070 con 0x7fee60038ba0 2024-09-18T01:45:44.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.770+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab96b0 con 0x55f454a74e70 2024-09-18T01:45:44.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.770+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 38 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.770+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab86a0 con 0x55f454a74e70 2024-09-18T01:45:44.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.770+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 39 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.770+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab96b0 con 0x55f454a74e70 2024-09-18T01:45:44.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.771+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 40 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.771+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab96b0 con 0x55f454a6ed00 2024-09-18T01:45:44.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.771+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.1 v2:172.21.15.146:6808/3930274777 40 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee5c087040 con 0x55f454a6ed00 2024-09-18T01:45:44.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.771+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab86a0 con 0x55f454a6ed00 2024-09-18T01:45:44.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.771+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.1 v2:172.21.15.146:6808/3930274777 41 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fee5c087040 con 0x55f454a6ed00 2024-09-18T01:45:44.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.771+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab96b0 con 0x55f454a6ed00 2024-09-18T01:45:44.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.771+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.1 v2:172.21.15.146:6808/3930274777 42 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee5c087040 con 0x55f454a6ed00 2024-09-18T01:45:44.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.771+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab96b0 con 0x55f454a6ed00 2024-09-18T01:45:44.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.772+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.1 v2:172.21.15.146:6808/3930274777 43 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv19 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee5c087040 con 0x55f454a6ed00 2024-09-18T01:45:44.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.772+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab86a0 con 0x55f454a6ed00 2024-09-18T01:45:44.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.772+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.1 v2:172.21.15.146:6808/3930274777 44 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv19 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fee5c087040 con 0x55f454a6ed00 2024-09-18T01:45:44.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.772+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab96b0 con 0x55f454a6ed00 2024-09-18T01:45:44.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.772+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.1 v2:172.21.15.146:6808/3930274777 45 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv19 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee5c087040 con 0x55f454a6ed00 2024-09-18T01:45:44.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.772+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab96b0 con 0x55f454a74e70 2024-09-18T01:45:44.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.772+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 41 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.772+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab86a0 con 0x55f454a74e70 2024-09-18T01:45:44.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.773+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 42 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv15 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.773+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab96b0 con 0x55f454a74e70 2024-09-18T01:45:44.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.773+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 43 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.773+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab96b0 con 0x7fee60038ba0 2024-09-18T01:45:44.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.773+0000 7fee6697b640 1 -- 172.21.15.146:0/433862089 <== osd.2 v2:172.21.15.146:6800/3820039304 34 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee5802e070 con 0x7fee60038ba0 2024-09-18T01:45:44.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.773+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab86a0 con 0x7fee60038ba0 2024-09-18T01:45:44.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.773+0000 7fee6697b640 1 -- 172.21.15.146:0/433862089 <== osd.2 v2:172.21.15.146:6800/3820039304 35 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fee5802e070 con 0x7fee60038ba0 2024-09-18T01:45:44.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.773+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab96b0 con 0x7fee60038ba0 2024-09-18T01:45:44.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.774+0000 7fee6697b640 1 -- 172.21.15.146:0/433862089 <== osd.2 v2:172.21.15.146:6800/3820039304 36 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee5802e070 con 0x7fee60038ba0 2024-09-18T01:45:44.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.774+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab96b0 con 0x55f454a74e70 2024-09-18T01:45:44.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.774+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 44 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.774+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab86a0 con 0x55f454a74e70 2024-09-18T01:45:44.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.774+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 45 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.774+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab96b0 con 0x55f454a74e70 2024-09-18T01:45:44.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.774+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 46 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.774+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab96b0 con 0x55f454a74e70 2024-09-18T01:45:44.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.775+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 47 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.775+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab86a0 con 0x55f454a74e70 2024-09-18T01:45:44.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.775+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 48 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv15 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.775+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab96b0 con 0x55f454a74e70 2024-09-18T01:45:44.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.775+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 49 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.775+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab96b0 con 0x55f454a74e70 2024-09-18T01:45:44.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.775+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 50 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.775+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab86a0 con 0x55f454a74e70 2024-09-18T01:45:44.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.775+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 51 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.775+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab96b0 con 0x55f454a74e70 2024-09-18T01:45:44.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.776+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 52 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.776+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab96b0 con 0x55f454a74e70 2024-09-18T01:45:44.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.776+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 53 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.776+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab86a0 con 0x55f454a74e70 2024-09-18T01:45:44.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.776+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 54 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.776+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab96b0 con 0x55f454a74e70 2024-09-18T01:45:44.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.776+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 55 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.776+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab96b0 con 0x7fee5800f070 2024-09-18T01:45:44.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.777+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.0 v2:172.21.15.129:6800/1759265424 36 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee5c087040 con 0x7fee5800f070 2024-09-18T01:45:44.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.777+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab86a0 con 0x7fee5800f070 2024-09-18T01:45:44.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.777+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.0 v2:172.21.15.129:6800/1759265424 37 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fee5c087040 con 0x7fee5800f070 2024-09-18T01:45:44.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.777+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab96b0 con 0x7fee5800f070 2024-09-18T01:45:44.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.777+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.0 v2:172.21.15.129:6800/1759265424 38 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee5c087040 con 0x7fee5800f070 2024-09-18T01:45:44.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.777+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab96b0 con 0x55f454a74e70 2024-09-18T01:45:44.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.778+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 56 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.778+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab86a0 con 0x55f454a74e70 2024-09-18T01:45:44.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.778+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 57 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.778+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab96b0 con 0x55f454a74e70 2024-09-18T01:45:44.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.778+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 58 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.778+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab96b0 con 0x7fee5800f070 2024-09-18T01:45:44.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.778+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.0 v2:172.21.15.129:6800/1759265424 39 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee5c087040 con 0x7fee5800f070 2024-09-18T01:45:44.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.778+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab86a0 con 0x7fee5800f070 2024-09-18T01:45:44.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.779+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.0 v2:172.21.15.129:6800/1759265424 40 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fee5c087040 con 0x7fee5800f070 2024-09-18T01:45:44.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.779+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab96b0 con 0x7fee5800f070 2024-09-18T01:45:44.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.779+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.0 v2:172.21.15.129:6800/1759265424 41 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee5c087040 con 0x7fee5800f070 2024-09-18T01:45:44.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.779+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab96b0 con 0x55f454a74e70 2024-09-18T01:45:44.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.779+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 59 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.779+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab86a0 con 0x55f454a74e70 2024-09-18T01:45:44.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.780+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 60 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.780+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab96b0 con 0x55f454a74e70 2024-09-18T01:45:44.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.780+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 61 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.780+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab96b0 con 0x7fee5800f070 2024-09-18T01:45:44.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.780+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.0 v2:172.21.15.129:6800/1759265424 42 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee5c087040 con 0x7fee5800f070 2024-09-18T01:45:44.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.780+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab86a0 con 0x7fee5800f070 2024-09-18T01:45:44.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.781+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.0 v2:172.21.15.129:6800/1759265424 43 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fee5c087040 con 0x7fee5800f070 2024-09-18T01:45:44.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.781+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab96b0 con 0x7fee5800f070 2024-09-18T01:45:44.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.781+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.0 v2:172.21.15.129:6800/1759265424 44 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee5c087040 con 0x7fee5800f070 2024-09-18T01:45:44.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.781+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab96b0 con 0x7fee60038ba0 2024-09-18T01:45:44.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.781+0000 7fee6697b640 1 -- 172.21.15.146:0/433862089 <== osd.2 v2:172.21.15.146:6800/3820039304 37 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee5802e070 con 0x7fee60038ba0 2024-09-18T01:45:44.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.781+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab86a0 con 0x7fee60038ba0 2024-09-18T01:45:44.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.781+0000 7fee6697b640 1 -- 172.21.15.146:0/433862089 <== osd.2 v2:172.21.15.146:6800/3820039304 38 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fee5802e070 con 0x7fee60038ba0 2024-09-18T01:45:44.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.781+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab96b0 con 0x7fee60038ba0 2024-09-18T01:45:44.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.782+0000 7fee6697b640 1 -- 172.21.15.146:0/433862089 <== osd.2 v2:172.21.15.146:6800/3820039304 39 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fee5802e070 con 0x7fee60038ba0 2024-09-18T01:45:44.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.782+0000 7fed1d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:44.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.782+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94507880673104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454a872e0 con 0x55f454a6ed00 2024-09-18T01:45:44.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.784+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.1 v2:172.21.15.146:6808/3930274777 46 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94507880673104] v33'162 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fee5c087040 con 0x55f454a6ed00 2024-09-18T01:45:44.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.784+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94507880648912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab6e20 con 0x7fee60038ba0 2024-09-18T01:45:44.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.784+0000 7fee6697b640 1 -- 172.21.15.146:0/433862089 <== osd.2 v2:172.21.15.146:6800/3820039304 40 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94507880648912] v33'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee5802e070 con 0x7fee60038ba0 2024-09-18T01:45:44.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.785+0000 7fee68e87800 20 remove_watcher() i=0 2024-09-18T01:45:44.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.785+0000 7fee68e87800 2 removed watcher, disabling cache 2024-09-18T01:45:44.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.785+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94507880656576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab6e20 con 0x55f454a6ed00 2024-09-18T01:45:44.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.786+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.1 v2:172.21.15.146:6808/3930274777 47 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94507880656576] v33'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee5c087040 con 0x55f454a6ed00 2024-09-18T01:45:44.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.786+0000 7fee68e87800 20 remove_watcher() i=1 2024-09-18T01:45:44.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.786+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94507880658112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab6e20 con 0x55f454a74e70 2024-09-18T01:45:44.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.787+0000 7fee6717c640 1 -- 172.21.15.146:0/433862089 <== osd.3 v2:172.21.15.146:6809/4106661138 62 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94507880658112] v33'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee6003c020 con 0x55f454a74e70 2024-09-18T01:45:44.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.787+0000 7fee68e87800 20 remove_watcher() i=2 2024-09-18T01:45:44.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.787+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94507880659232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab6e20 con 0x7fee60038ba0 2024-09-18T01:45:44.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.788+0000 7fee6697b640 1 -- 172.21.15.146:0/433862089 <== osd.2 v2:172.21.15.146:6800/3820039304 41 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94507880659232] v33'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee5802e070 con 0x7fee60038ba0 2024-09-18T01:45:44.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.788+0000 7fee68e87800 20 remove_watcher() i=3 2024-09-18T01:45:44.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.788+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94507880666832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab6e20 con 0x55f454a6ed00 2024-09-18T01:45:44.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.789+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.1 v2:172.21.15.146:6808/3930274777 48 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94507880666832] v33'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee5c087040 con 0x55f454a6ed00 2024-09-18T01:45:44.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.789+0000 7fee68e87800 20 remove_watcher() i=4 2024-09-18T01:45:44.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.789+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94507880663264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab6e20 con 0x7fee5800f070 2024-09-18T01:45:44.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.790+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.0 v2:172.21.15.129:6800/1759265424 45 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94507880663264] v33'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee5c087040 con 0x7fee5800f070 2024-09-18T01:45:44.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.790+0000 7fee68e87800 20 remove_watcher() i=5 2024-09-18T01:45:44.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.790+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94507880670944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab6e20 con 0x7fee5800f070 2024-09-18T01:45:44.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.792+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.0 v2:172.21.15.129:6800/1759265424 46 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94507880670944] v33'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee5c087040 con 0x7fee5800f070 2024-09-18T01:45:44.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.792+0000 7fee68e87800 20 remove_watcher() i=6 2024-09-18T01:45:44.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.792+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94507880675600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f454ab6e20 con 0x7fee5800f070 2024-09-18T01:45:44.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.793+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 <== osd.0 v2:172.21.15.129:6800/1759265424 47 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94507880675600] v33'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee5c087040 con 0x7fee5800f070 2024-09-18T01:45:44.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.793+0000 7fee68e87800 20 remove_watcher() i=7 2024-09-18T01:45:44.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.793+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fee5800f070 msgr2=0x7fee5801c620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:44.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.793+0000 7fee68e87800 1 --2- 172.21.15.146:0/433862089 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fee5800f070 0x7fee5801c620 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:44.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.793+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55f454a6ed00 msgr2=0x55f454a711c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:44.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.793+0000 7fee68e87800 1 --2- 172.21.15.146:0/433862089 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55f454a6ed00 0x55f454a711c0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:44.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.793+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fee60038ba0 msgr2=0x7fee60001a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:44.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.793+0000 7fee68e87800 1 --2- 172.21.15.146:0/433862089 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fee60038ba0 0x7fee60001a20 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:44.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.793+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55f454a74e70 msgr2=0x55f454a77280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:44.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.793+0000 7fee68e87800 1 --2- 172.21.15.146:0/433862089 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55f454a74e70 0x55f454a77280 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:44.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.793+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fed30036b90 msgr2=0x7fed30039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:44.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.793+0000 7fee68e87800 1 --2- 172.21.15.146:0/433862089 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fed30036b90 0x7fed30039050 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fee580197b0 tx=0x7fee58044000 comp rx=0 tx=0).stop 2024-09-18T01:45:44.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.793+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f454a5bca0 msgr2=0x55f454a63150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:44.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.793+0000 7fee6617a640 1 -- 172.21.15.146:0/433862089 reap_dead start 2024-09-18T01:45:44.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.793+0000 7fee68e87800 1 --2- 172.21.15.146:0/433862089 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f454a5bca0 0x55f454a63150 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fee60040210 tx=0x7fee6004c980 comp rx=0 tx=0).stop 2024-09-18T01:45:44.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.793+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 shutdown_connections 2024-09-18T01:45:44.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.793+0000 7fee68e87800 1 --2- 172.21.15.146:0/433862089 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f454a5bca0 0x55f454a63150 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:44.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.793+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 >> 172.21.15.146:0/433862089 conn(0x55f454a58000 msgr2=0x55f454a560d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:44.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.793+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 shutdown_connections 2024-09-18T01:45:44.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.793+0000 7fee68e87800 1 -- 172.21.15.146:0/433862089 wait complete. 2024-09-18T01:45:44.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.793+0000 7fee68e87800 1 -- 172.21.15.146:0/2334724397 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fed40036b40 msgr2=0x7fed40039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:44.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.793+0000 7fee68e87800 1 --2- 172.21.15.146:0/2334724397 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fed40036b40 0x7fed40039000 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fee5800ff70 tx=0x7fee580173c0 comp rx=0 tx=0).stop 2024-09-18T01:45:44.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.793+0000 7fee68e87800 1 -- 172.21.15.146:0/2334724397 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f454a4efd0 msgr2=0x55f454a4f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:44.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.793+0000 7fee68e87800 1 --2- 172.21.15.146:0/2334724397 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f454a4efd0 0x55f454a4f3f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x55f454a3bc20 tx=0x7fee600178e0 comp rx=0 tx=0).stop 2024-09-18T01:45:44.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.793+0000 7fee68e87800 1 -- 172.21.15.146:0/2334724397 shutdown_connections 2024-09-18T01:45:44.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.793+0000 7fee68e87800 1 --2- 172.21.15.146:0/2334724397 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fed40036b40 0x7fed40039000 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:44.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.793+0000 7fee68e87800 1 --2- 172.21.15.146:0/2334724397 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f454a4efd0 0x55f454a4f3f0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:44.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.793+0000 7fee68e87800 1 -- 172.21.15.146:0/2334724397 >> 172.21.15.146:0/2334724397 conn(0x55f454a43f60 msgr2=0x55f454a46ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:44.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.793+0000 7fee68e87800 1 -- 172.21.15.146:0/2334724397 shutdown_connections 2024-09-18T01:45:44.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.793+0000 7fee68e87800 1 -- 172.21.15.146:0/2334724397 wait complete. 2024-09-18T01:45:44.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.794+0000 7fee68e87800 1 -- 172.21.15.146:0/1028329620 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55f454941900 msgr2=0x55f454a3b2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:44.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.794+0000 7fee68e87800 1 --2- 172.21.15.146:0/1028329620 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55f454941900 0x55f454a3b2c0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:44.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.794+0000 7fee68e87800 1 -- 172.21.15.146:0/1028329620 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55f454a3d270 msgr2=0x55f454a40ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:44.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.794+0000 7fee68e87800 1 --2- 172.21.15.146:0/1028329620 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55f454a3d270 0x55f454a40ab0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:44.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.794+0000 7fee68e87800 1 -- 172.21.15.146:0/1028329620 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fed4c036b40 msgr2=0x7fed4c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:44.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.794+0000 7fee68e87800 1 --2- 172.21.15.146:0/1028329620 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fed4c036b40 0x7fed4c039000 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fee5c057000 tx=0x7fee5c052000 comp rx=0 tx=0).stop 2024-09-18T01:45:44.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.794+0000 7fee68e87800 1 -- 172.21.15.146:0/1028329620 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f4548b0df0 msgr2=0x55f454a34250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:44.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.794+0000 7fee68e87800 1 --2- 172.21.15.146:0/1028329620 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f4548b0df0 0x55f454a34250 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fee58000fd0 tx=0x7fee58000ed0 comp rx=0 tx=0).stop 2024-09-18T01:45:44.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.794+0000 7fee68e87800 1 -- 172.21.15.146:0/1028329620 shutdown_connections 2024-09-18T01:45:44.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.794+0000 7fee68e87800 1 --2- 172.21.15.146:0/1028329620 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55f454a3d270 0x55f454a40ab0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:44.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.794+0000 7fee68e87800 1 --2- 172.21.15.146:0/1028329620 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55f454941900 0x55f454a3b2c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:44.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.794+0000 7fee68e87800 1 --2- 172.21.15.146:0/1028329620 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fed4c036b40 0x7fed4c039000 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:44.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.794+0000 7fee68e87800 1 --2- 172.21.15.146:0/1028329620 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f4548b0df0 0x55f454a34250 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:44.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.794+0000 7fee68e87800 1 -- 172.21.15.146:0/1028329620 >> 172.21.15.146:0/1028329620 conn(0x55f454937df0 msgr2=0x55f454a26b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:44.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.794+0000 7fee68e87800 1 -- 172.21.15.146:0/1028329620 shutdown_connections 2024-09-18T01:45:44.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.794+0000 7fee68e87800 1 -- 172.21.15.146:0/1028329620 wait complete. 2024-09-18T01:45:44.804 INFO:teuthology.orchestra.run.smithi146.stdout:[{"tag":"8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10614682544297223998\u0000","time":"2024-09-18T01:45:44.599808+0000","objs":[{"pool":"default.rgw.buckets.data","oid":"8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1__shadow_.J5arEY1IywBeWgso2YYmpd_nTjk1v6i_1","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1__shadow_.J5arEY1IywBeWgso2YYmpd_nTjk1v6i_2","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1__shadow_.J5arEY1IywBeWgso2YYmpd_nTjk1v6i_3","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1__shadow_.J5arEY1IywBeWgso2YYmpd_nTjk1v6i_4","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1__shadow_.J5arEY1IywBeWgso2YYmpd_nTjk1v6i_5","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1__shadow_.J5arEY1IywBeWgso2YYmpd_nTjk1v6i_6","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1__shadow_.J5arEY1IywBeWgso2YYmpd_nTjk1v6i_7","key":"","instance":""}]}] 2024-09-18T01:45:44.804 DEBUG:tasks.util.rgw: json result: [{'tag': '8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10614682544297223998\x00', 'time': '2024-09-18T01:45:44.599808+0000', 'objs': [{'pool': 'default.rgw.buckets.data', 'oid': '8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1__shadow_.J5arEY1IywBeWgso2YYmpd_nTjk1v6i_1', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1__shadow_.J5arEY1IywBeWgso2YYmpd_nTjk1v6i_2', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1__shadow_.J5arEY1IywBeWgso2YYmpd_nTjk1v6i_3', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1__shadow_.J5arEY1IywBeWgso2YYmpd_nTjk1v6i_4', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1__shadow_.J5arEY1IywBeWgso2YYmpd_nTjk1v6i_5', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1__shadow_.J5arEY1IywBeWgso2YYmpd_nTjk1v6i_6', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1__shadow_.J5arEY1IywBeWgso2YYmpd_nTjk1v6i_7', 'key': '', 'instance': ''}]}] 2024-09-18T01:45:44.804 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process'] 2024-09-18T01:45:44.804 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process'] 2024-09-18T01:45:44.804 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process 2024-09-18T01:45:44.847 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:44.847 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:44.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.846+0000 7fcf92e40800 1 Processor -- start 2024-09-18T01:45:44.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.846+0000 7fcf92e40800 1 -- start start 2024-09-18T01:45:44.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.846+0000 7fcf92e40800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x56159f5c6da0 0x56159f5c9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:44.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.846+0000 7fcf92e40800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56159f47fb30 con 0x56159f5345e0 2024-09-18T01:45:44.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.846+0000 7fcf92e40800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x56159f461360 con 0x56159f5c6da0 2024-09-18T01:45:44.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.847+0000 7fcf8813a640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x56159f5c6da0 0x56159f5c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:44.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.847+0000 7fcf8813a640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x56159f5c6da0 0x56159f5c9190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38136/0 (socket says 172.21.15.146:38136) 2024-09-18T01:45:44.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.847+0000 7fcf9093b640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x56159f5345e0 0x56159f5c5680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:45840/0 (socket says 172.21.15.146:45840) 2024-09-18T01:45:44.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.847+0000 7fcf8813a640 1 -- 172.21.15.146:0/3030330169 learned_addr learned my addr 172.21.15.146:0/3030330169 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:44.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.847+0000 7fcf8813a640 1 -- 172.21.15.146:0/3030330169 >> v1:172.21.15.129:6789/0 conn(0x56159f5345e0 legacy=0x56159f5c5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:44.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.847+0000 7fcf8bfff640 1 -- 172.21.15.146:0/3030330169 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1136005162 0 0) 0x56159f47fb30 con 0x56159f5345e0 2024-09-18T01:45:44.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.847+0000 7fcf8813a640 1 -- 172.21.15.146:0/3030330169 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56159f487e00 con 0x56159f5c6da0 2024-09-18T01:45:44.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.849+0000 7fcf8813a640 1 --2- 172.21.15.146:0/3030330169 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56159f5c6da0 0x56159f5c9190 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fcf7800a520 tx=0x7fcf78045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8934aeb19eda9a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:44.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.849+0000 7fcf8bfff640 1 -- 172.21.15.146:0/3030330169 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf78055070 con 0x56159f5c6da0 2024-09-18T01:45:44.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.849+0000 7fcf8bfff640 1 -- 172.21.15.146:0/3030330169 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf780515b0 con 0x56159f5c6da0 2024-09-18T01:45:44.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.849+0000 7fcf8bfff640 1 -- 172.21.15.146:0/3030330169 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf780518d0 con 0x56159f5c6da0 2024-09-18T01:45:44.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.849+0000 7fcf92e40800 1 -- 172.21.15.146:0/3030330169 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56159f5c6da0 msgr2=0x56159f5c9190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:44.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.849+0000 7fcf92e40800 1 --2- 172.21.15.146:0/3030330169 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56159f5c6da0 0x56159f5c9190 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fcf7800a520 tx=0x7fcf78045ba0 comp rx=0 tx=0).stop 2024-09-18T01:45:44.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.849+0000 7fcf92e40800 1 -- 172.21.15.146:0/3030330169 shutdown_connections 2024-09-18T01:45:44.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.849+0000 7fcf92e40800 1 --2- 172.21.15.146:0/3030330169 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56159f5c6da0 0x56159f5c9190 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:44.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.849+0000 7fcf92e40800 1 -- 172.21.15.146:0/3030330169 >> 172.21.15.146:0/3030330169 conn(0x56159f5badd0 msgr2=0x56159f5bd1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:44.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.849+0000 7fcf92e40800 1 -- 172.21.15.146:0/3030330169 shutdown_connections 2024-09-18T01:45:44.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.849+0000 7fcf92e40800 1 -- 172.21.15.146:0/3030330169 wait complete. 2024-09-18T01:45:44.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.863+0000 7fcf92e40800 1 Processor -- start 2024-09-18T01:45:44.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.863+0000 7fcf92e40800 1 -- start start 2024-09-18T01:45:44.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.863+0000 7fcf92e40800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56159f5345e0 0x56159f6b1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:44.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.863+0000 7fcf92e40800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x56159f50c320 con 0x56159f5345e0 2024-09-18T01:45:44.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.864+0000 7fcf9093b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56159f5345e0 0x56159f6b1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:44.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.864+0000 7fcf9093b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56159f5345e0 0x56159f6b1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38148/0 (socket says 172.21.15.146:38148) 2024-09-18T01:45:44.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.864+0000 7fcf9093b640 1 -- 172.21.15.146:0/415245699 learned_addr learned my addr 172.21.15.146:0/415245699 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:44.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.864+0000 7fcf9093b640 1 -- 172.21.15.146:0/415245699 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56159f459bc0 con 0x56159f5345e0 2024-09-18T01:45:44.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.864+0000 7fcf9093b640 1 --2- 172.21.15.146:0/415245699 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56159f5345e0 0x56159f6b1810 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fcf8000b240 tx=0x7fcf8000b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa7cbe9dbd9dc6bf server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:44.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.864+0000 7fce7ee0d640 1 -- 172.21.15.146:0/415245699 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf80008070 con 0x56159f5345e0 2024-09-18T01:45:44.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.864+0000 7fce7ee0d640 1 -- 172.21.15.146:0/415245699 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf8000d500 con 0x56159f5345e0 2024-09-18T01:45:44.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.864+0000 7fce7ee0d640 1 -- 172.21.15.146:0/415245699 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf8000d860 con 0x56159f5345e0 2024-09-18T01:45:44.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.865+0000 7fcf92e40800 1 -- 172.21.15.146:0/415245699 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56159f5345e0 msgr2=0x56159f6b1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:44.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.865+0000 7fcf92e40800 1 --2- 172.21.15.146:0/415245699 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56159f5345e0 0x56159f6b1810 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fcf8000b240 tx=0x7fcf8000b700 comp rx=0 tx=0).stop 2024-09-18T01:45:44.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.865+0000 7fcf92e40800 1 -- 172.21.15.146:0/415245699 shutdown_connections 2024-09-18T01:45:44.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.865+0000 7fcf92e40800 1 --2- 172.21.15.146:0/415245699 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56159f5345e0 0x56159f6b1810 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:44.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.865+0000 7fcf92e40800 1 -- 172.21.15.146:0/415245699 >> 172.21.15.146:0/415245699 conn(0x56159f5badd0 msgr2=0x56159f6ad1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:44.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.865+0000 7fcf92e40800 1 -- 172.21.15.146:0/415245699 shutdown_connections 2024-09-18T01:45:44.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.865+0000 7fcf92e40800 1 -- 172.21.15.146:0/415245699 wait complete. 2024-09-18T01:45:44.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.865+0000 7fcf92e40800 1 Processor -- start 2024-09-18T01:45:44.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.865+0000 7fcf92e40800 1 -- start start 2024-09-18T01:45:44.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.865+0000 7fcf92e40800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56159f5c6da0 0x56159f6b94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:44.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.865+0000 7fcf92e40800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x56159f5c9970 con 0x56159f5c6da0 2024-09-18T01:45:44.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.866+0000 7fcf9093b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56159f5c6da0 0x56159f6b94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:44.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.866+0000 7fcf9093b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56159f5c6da0 0x56159f6b94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38160/0 (socket says 172.21.15.146:38160) 2024-09-18T01:45:44.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.866+0000 7fcf9093b640 1 -- 172.21.15.146:0/3947033475 learned_addr learned my addr 172.21.15.146:0/3947033475 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:44.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.866+0000 7fcf9093b640 1 -- 172.21.15.146:0/3947033475 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56159f46dfe0 con 0x56159f5c6da0 2024-09-18T01:45:44.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.866+0000 7fcf9093b640 1 --2- 172.21.15.146:0/3947033475 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56159f5c6da0 0x56159f6b94c0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x56159f6b2670 tx=0x7fcf80000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:44.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.866+0000 7fce7d60a640 1 -- 172.21.15.146:0/3947033475 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf800197b0 con 0x56159f5c6da0 2024-09-18T01:45:44.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.866+0000 7fce7d60a640 1 -- 172.21.15.146:0/3947033475 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf80019950 con 0x56159f5c6da0 2024-09-18T01:45:44.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.866+0000 7fce7d60a640 1 -- 172.21.15.146:0/3947033475 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf80019c30 con 0x56159f5c6da0 2024-09-18T01:45:44.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.866+0000 7fcf92e40800 1 -- 172.21.15.146:0/3947033475 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56159f6b9a00 con 0x56159f5c6da0 2024-09-18T01:45:44.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.866+0000 7fcf92e40800 1 -- 172.21.15.146:0/3947033475 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56159f6b9f20 con 0x56159f5c6da0 2024-09-18T01:45:44.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.867+0000 7fce7d60a640 1 -- 172.21.15.146:0/3947033475 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fcf80017040 con 0x56159f5c6da0 2024-09-18T01:45:44.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.867+0000 7fce7d60a640 1 --2- 172.21.15.146:0/3947033475 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fce78036b40 0x7fce78039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:44.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.867+0000 7fce7d60a640 1 -- 172.21.15.146:0/3947033475 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7fcf80015020 con 0x56159f5c6da0 2024-09-18T01:45:44.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.867+0000 7fcf8813a640 1 --2- 172.21.15.146:0/3947033475 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fce78036b40 0x7fce78039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:44.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.867+0000 7fcf92e40800 1 --2- 172.21.15.146:0/3947033475 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56159f6be520 0x56159f6c0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:44.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.868+0000 7fcf92e40800 1 -- 172.21.15.146:0/3947033475 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f6c0e50 con 0x56159f6be520 2024-09-18T01:45:44.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.868+0000 7fcf9113c640 1 --2- 172.21.15.146:0/3947033475 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56159f6be520 0x56159f6c0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:44.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.868+0000 7fcf8813a640 1 --2- 172.21.15.146:0/3947033475 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fce78036b40 0x7fce78039000 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fcf78057000 tx=0x7fcf78052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:44.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.868+0000 7fcf9113c640 1 --2- 172.21.15.146:0/3947033475 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56159f6be520 0x56159f6c0910 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:44.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.868+0000 7fcf9113c640 1 -- 172.21.15.146:0/3947033475 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcf8c00a4a0 con 0x56159f6be520 2024-09-18T01:45:44.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.868+0000 7fcf92e40800 1 -- 172.21.15.146:0/3947033475 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f6bdb00 con 0x56159f6be520 2024-09-18T01:45:44.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.869+0000 7fcf9113c640 1 -- 172.21.15.146:0/3947033475 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcf8c00a4a0 con 0x56159f6be520 2024-09-18T01:45:44.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.869+0000 7fcf92e40800 1 -- 172.21.15.146:0/3947033475 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f6c2c70 con 0x56159f6be520 2024-09-18T01:45:44.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.869+0000 7fcf9113c640 1 -- 172.21.15.146:0/3947033475 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcf8c00a4a0 con 0x56159f6be520 2024-09-18T01:45:44.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.869+0000 7fcf92e40800 1 -- 172.21.15.146:0/3947033475 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f6c1db0 con 0x56159f6be520 2024-09-18T01:45:44.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.869+0000 7fcf9113c640 1 -- 172.21.15.146:0/3947033475 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcf8c00a4a0 con 0x56159f6be520 2024-09-18T01:45:44.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.869+0000 7fcf92e40800 1 --2- 172.21.15.146:0/3947033475 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x56159f6c2880 0x56159f6c6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:44.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.869+0000 7fcf92e40800 1 -- 172.21.15.146:0/3947033475 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f6c6890 con 0x56159f6c2880 2024-09-18T01:45:44.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.869+0000 7fcf9093b640 1 --2- 172.21.15.146:0/3947033475 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x56159f6c2880 0x56159f6c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:44.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.869+0000 7fcf9093b640 1 --2- 172.21.15.146:0/3947033475 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x56159f6c2880 0x56159f6c6100 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:44.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.870+0000 7fcf9093b640 1 -- 172.21.15.146:0/3947033475 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcf8002d070 con 0x56159f6c2880 2024-09-18T01:45:44.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.870+0000 7fcf92e40800 1 Processor -- start 2024-09-18T01:45:44.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.870+0000 7fcf92e40800 1 -- start start 2024-09-18T01:45:44.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.870+0000 7fcf92e40800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56159f6d4600 0x56159f6d4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:44.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.870+0000 7fcf92e40800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x56159f45b580 con 0x56159f6d4600 2024-09-18T01:45:44.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.871+0000 7fcf9113c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56159f6d4600 0x56159f6d4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:44.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.871+0000 7fcf9113c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56159f6d4600 0x56159f6d4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38174/0 (socket says 172.21.15.146:38174) 2024-09-18T01:45:44.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.871+0000 7fcf9113c640 1 -- 172.21.15.146:0/120038837 learned_addr learned my addr 172.21.15.146:0/120038837 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:44.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.871+0000 7fcf9113c640 1 -- 172.21.15.146:0/120038837 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56159f6d4f60 con 0x56159f6d4600 2024-09-18T01:45:44.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.871+0000 7fcf9113c640 1 --2- 172.21.15.146:0/120038837 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56159f6d4600 0x56159f6d4a20 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x56159f6c1230 tx=0x7fcf8c0178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:44.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.871+0000 7fce767fc640 1 -- 172.21.15.146:0/120038837 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf8c013440 con 0x56159f6d4600 2024-09-18T01:45:44.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.871+0000 7fce767fc640 1 -- 172.21.15.146:0/120038837 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf8c0135e0 con 0x56159f6d4600 2024-09-18T01:45:44.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.871+0000 7fcf92e40800 1 -- 172.21.15.146:0/120038837 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56159f6d51f0 con 0x56159f6d4600 2024-09-18T01:45:44.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.871+0000 7fce767fc640 1 -- 172.21.15.146:0/120038837 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf8c0138c0 con 0x56159f6d4600 2024-09-18T01:45:44.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.871+0000 7fcf92e40800 1 -- 172.21.15.146:0/120038837 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56159f6d7ed0 con 0x56159f6d4600 2024-09-18T01:45:44.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.872+0000 7fce767fc640 1 -- 172.21.15.146:0/120038837 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fcf8c011040 con 0x56159f6d4600 2024-09-18T01:45:44.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.872+0000 7fce767fc640 1 --2- 172.21.15.146:0/120038837 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fce68036b40 0x7fce68039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:44.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.872+0000 7fce767fc640 1 -- 172.21.15.146:0/120038837 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7fcf8c01d070 con 0x56159f6d4600 2024-09-18T01:45:44.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.872+0000 7fcf9093b640 1 --2- 172.21.15.146:0/120038837 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fce68036b40 0x7fce68039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:44.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.873+0000 7fcf92e40800 1 Processor -- start 2024-09-18T01:45:44.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.873+0000 7fcf92e40800 1 -- start start 2024-09-18T01:45:44.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.873+0000 7fcf9093b640 1 --2- 172.21.15.146:0/120038837 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fce68036b40 0x7fce68039000 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fcf8001af90 tx=0x7fcf8000fe50 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:44.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.873+0000 7fcf92e40800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56159f6e1280 0x56159f6e1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:44.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.873+0000 7fcf92e40800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x56159f6b1fc0 con 0x56159f6e1280 2024-09-18T01:45:44.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.873+0000 7fcf9113c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56159f6e1280 0x56159f6e1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:44.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.873+0000 7fcf9113c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56159f6e1280 0x56159f6e1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38178/0 (socket says 172.21.15.146:38178) 2024-09-18T01:45:44.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.873+0000 7fcf9113c640 1 -- 172.21.15.146:0/707113685 learned_addr learned my addr 172.21.15.146:0/707113685 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:44.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.873+0000 7fcf9113c640 1 -- 172.21.15.146:0/707113685 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56159f6e1c50 con 0x56159f6e1280 2024-09-18T01:45:44.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.873+0000 7fcf9113c640 1 --2- 172.21.15.146:0/707113685 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56159f6e1280 0x56159f6e1680 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c04c890 tx=0x7fcf8c04c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac87c2bd57e80171 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:44.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.874+0000 7fce67fff640 1 -- 172.21.15.146:0/707113685 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf8c045070 con 0x56159f6e1280 2024-09-18T01:45:44.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.874+0000 7fce67fff640 1 -- 172.21.15.146:0/707113685 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf8c012df0 con 0x56159f6e1280 2024-09-18T01:45:44.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.874+0000 7fce67fff640 1 -- 172.21.15.146:0/707113685 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf8c021b80 con 0x56159f6e1280 2024-09-18T01:45:44.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.874+0000 7fcf92e40800 1 -- 172.21.15.146:0/707113685 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56159f6e1280 msgr2=0x56159f6e1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:44.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.874+0000 7fcf92e40800 1 --2- 172.21.15.146:0/707113685 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56159f6e1280 0x56159f6e1680 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c04c890 tx=0x7fcf8c04c9d0 comp rx=0 tx=0).stop 2024-09-18T01:45:44.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.874+0000 7fcf92e40800 1 -- 172.21.15.146:0/707113685 shutdown_connections 2024-09-18T01:45:44.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.874+0000 7fcf92e40800 1 --2- 172.21.15.146:0/707113685 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56159f6e1280 0x56159f6e1680 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:44.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.874+0000 7fcf92e40800 1 -- 172.21.15.146:0/707113685 >> 172.21.15.146:0/707113685 conn(0x56159f6dd5e0 msgr2=0x56159f6db6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:44.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.874+0000 7fcf92e40800 1 -- 172.21.15.146:0/707113685 shutdown_connections 2024-09-18T01:45:44.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.874+0000 7fcf92e40800 1 -- 172.21.15.146:0/707113685 wait complete. 2024-09-18T01:45:44.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.874+0000 7fcf92e40800 1 Processor -- start 2024-09-18T01:45:44.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.874+0000 7fcf92e40800 1 -- start start 2024-09-18T01:45:44.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.875+0000 7fcf92e40800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56159f6e1280 0x56159f6e8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:44.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.875+0000 7fcf92e40800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x56159f6e22c0 con 0x56159f6e1280 2024-09-18T01:45:44.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.875+0000 7fcf9113c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56159f6e1280 0x56159f6e8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:44.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.875+0000 7fcf9113c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56159f6e1280 0x56159f6e8710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38194/0 (socket says 172.21.15.146:38194) 2024-09-18T01:45:44.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.875+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 learned_addr learned my addr 172.21.15.146:0/1500841341 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:44.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.875+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56159f6e8c50 con 0x56159f6e1280 2024-09-18T01:45:44.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.875+0000 7fcf9113c640 1 --2- 172.21.15.146:0/1500841341 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56159f6e1280 0x56159f6e8710 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c043040 tx=0x7fcf8c04c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:44.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.875+0000 7fce667fc640 1 -- 172.21.15.146:0/1500841341 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf8c03a070 con 0x56159f6e1280 2024-09-18T01:45:44.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.875+0000 7fce667fc640 1 -- 172.21.15.146:0/1500841341 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf8c001540 con 0x56159f6e1280 2024-09-18T01:45:44.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.875+0000 7fce667fc640 1 -- 172.21.15.146:0/1500841341 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf8c045040 con 0x56159f6e1280 2024-09-18T01:45:44.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.875+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56159f6e8ee0 con 0x56159f6e1280 2024-09-18T01:45:44.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.875+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56159f6ebb90 con 0x56159f6e1280 2024-09-18T01:45:44.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.876+0000 7fce667fc640 1 -- 172.21.15.146:0/1500841341 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fcf8c03d070 con 0x56159f6e1280 2024-09-18T01:45:44.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.876+0000 7fce667fc640 1 --2- 172.21.15.146:0/1500841341 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fce5c036b90 0x7fce5c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:44.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.876+0000 7fce667fc640 1 -- 172.21.15.146:0/1500841341 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7fcf8c00e040 con 0x56159f6e1280 2024-09-18T01:45:44.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.876+0000 7fcf9093b640 1 --2- 172.21.15.146:0/1500841341 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fce5c036b90 0x7fce5c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:44.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.877+0000 7fcf9093b640 1 --2- 172.21.15.146:0/1500841341 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fce5c036b90 0x7fce5c039050 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fcf8004d210 tx=0x7fcf80032000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:44.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.877+0000 7fcf92e40800 20 rados->read ofs=0 len=0 2024-09-18T01:45:44.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.877+0000 7fcf92e40800 1 --2- 172.21.15.146:0/1500841341 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56159f6f4370 0x56159f6f6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:44.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.877+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f6f6f80 con 0x56159f6f4370 2024-09-18T01:45:44.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.877+0000 7fcf8813a640 1 --2- 172.21.15.146:0/1500841341 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56159f6f4370 0x56159f6f6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:44.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.877+0000 7fcf8813a640 1 --2- 172.21.15.146:0/1500841341 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56159f6f4370 0x56159f6f6830 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:44.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.878+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcf78057030 con 0x56159f6f4370 2024-09-18T01:45:44.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.878+0000 7fcf92e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:44.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.878+0000 7fcf92e40800 20 realm 2024-09-18T01:45:44.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.878+0000 7fcf92e40800 20 rados->read ofs=0 len=0 2024-09-18T01:45:44.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.878+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f6f73b0 con 0x56159f6f4370 2024-09-18T01:45:44.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.878+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcf78057030 con 0x56159f6f4370 2024-09-18T01:45:44.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.878+0000 7fcf92e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:44.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.878+0000 7fcf92e40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:44.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.878+0000 7fcf92e40800 20 rados->read ofs=0 len=0 2024-09-18T01:45:44.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.878+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f6f7c80 con 0x56159f6f4370 2024-09-18T01:45:44.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.878+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcf78057030 con 0x56159f6f4370 2024-09-18T01:45:44.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.878+0000 7fcf92e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:44.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.878+0000 7fcf92e40800 20 rados->read ofs=0 len=0 2024-09-18T01:45:44.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.878+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f6f8020 con 0x56159f6f4370 2024-09-18T01:45:44.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.878+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcf78057030 con 0x56159f6f4370 2024-09-18T01:45:44.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.878+0000 7fcf92e40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:44.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.878+0000 7fcf92e40800 20 rados->read ofs=0 len=0 2024-09-18T01:45:44.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.878+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f6f8870 con 0x56159f6f4370 2024-09-18T01:45:44.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.879+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcf78057030 con 0x56159f6f4370 2024-09-18T01:45:44.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.879+0000 7fcf92e40800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:44.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.879+0000 7fcf92e40800 20 searching for the correct realm 2024-09-18T01:45:44.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.879+0000 7fcf92e40800 1 --2- 172.21.15.146:0/1500841341 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x56159f6fa5e0 0x56159f6fc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:44.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.879+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56159f6fd000 con 0x56159f6fa5e0 2024-09-18T01:45:44.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.879+0000 7fcf9113c640 1 --2- 172.21.15.146:0/1500841341 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x56159f6fa5e0 0x56159f6fc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:44.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.879+0000 7fcf9113c640 1 --2- 172.21.15.146:0/1500841341 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x56159f6fa5e0 0x56159f6fc9d0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:44.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.879+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:44.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.879+0000 7fcf9113c640 1 --2- 172.21.15.146:0/1500841341 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fcf8c03f060 0x7fcf8c0233f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:44.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.879+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56159f6fd000 con 0x7fcf8c03f060 2024-09-18T01:45:44.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.879+0000 7fcf9093b640 1 --2- 172.21.15.146:0/1500841341 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fcf8c03f060 0x7fcf8c0233f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:44.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.880+0000 7fcf9093b640 1 --2- 172.21.15.146:0/1500841341 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fcf8c03f060 0x7fcf8c0233f0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:44.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.880+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:44.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.880+0000 7fcf9093b640 1 --2- 172.21.15.146:0/1500841341 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fcf80048040 0x7fcf8003f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:44.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.880+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56159f6fd000 con 0x7fcf80048040 2024-09-18T01:45:44.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.880+0000 7fcf8813a640 1 --2- 172.21.15.146:0/1500841341 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fcf80048040 0x7fcf8003f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:44.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.881+0000 7fcf8813a640 1 --2- 172.21.15.146:0/1500841341 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fcf80048040 0x7fcf8003f160 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:44.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.881+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf78057030 con 0x7fcf80048040 2024-09-18T01:45:44.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.881+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56159f6fd000 con 0x56159f6f4370 2024-09-18T01:45:44.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.881+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcf78057030 con 0x56159f6f4370 2024-09-18T01:45:44.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.881+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56159f6fd000 con 0x56159f6f4370 2024-09-18T01:45:44.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.881+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf78057030 con 0x56159f6f4370 2024-09-18T01:45:44.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.881+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56159f6fd000 con 0x7fcf80048040 2024-09-18T01:45:44.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.882+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf78057030 con 0x7fcf80048040 2024-09-18T01:45:44.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.882+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56159f6fd000 con 0x7fcf80048040 2024-09-18T01:45:44.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.882+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf78057030 con 0x7fcf80048040 2024-09-18T01:45:44.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.882+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56159f6fd000 con 0x7fcf8c03f060 2024-09-18T01:45:44.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.882+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:44.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.882+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56159f6fd000 con 0x56159f6fa5e0 2024-09-18T01:45:44.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.882+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:44.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.882+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56159f6fd000 con 0x56159f6f4370 2024-09-18T01:45:44.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.883+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf78057030 con 0x56159f6f4370 2024-09-18T01:45:44.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.883+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56159f6fd000 con 0x7fcf80048040 2024-09-18T01:45:44.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.883+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf78057030 con 0x7fcf80048040 2024-09-18T01:45:44.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.883+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56159f6fd000 con 0x56159f6f4370 2024-09-18T01:45:44.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.883+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf78057030 con 0x56159f6f4370 2024-09-18T01:45:44.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.883+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56159f6fd000 con 0x7fcf8c03f060 2024-09-18T01:45:44.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.883+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:44.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.883+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56159f6fd000 con 0x56159f6fa5e0 2024-09-18T01:45:44.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.883+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:44.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.884+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56159f6fd000 con 0x56159f6fa5e0 2024-09-18T01:45:44.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.884+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:44.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.884+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56159f6fd000 con 0x7fcf80048040 2024-09-18T01:45:44.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.884+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf78057030 con 0x7fcf80048040 2024-09-18T01:45:44.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.884+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56159f6fd000 con 0x56159f6fa5e0 2024-09-18T01:45:44.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.884+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:44.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.884+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56159f6fd000 con 0x56159f6fa5e0 2024-09-18T01:45:44.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.884+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:44.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.884+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56159f6fd000 con 0x56159f6f4370 2024-09-18T01:45:44.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.885+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf78057030 con 0x56159f6f4370 2024-09-18T01:45:44.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.885+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56159f6fd000 con 0x56159f6f4370 2024-09-18T01:45:44.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.885+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fcf78057030 con 0x56159f6f4370 2024-09-18T01:45:44.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.885+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56159f6fd000 con 0x7fcf80048040 2024-09-18T01:45:44.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.885+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf78057030 con 0x7fcf80048040 2024-09-18T01:45:44.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.885+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56159f6fd000 con 0x56159f6fa5e0 2024-09-18T01:45:44.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.885+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:44.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.885+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56159f6fd000 con 0x7fcf8c03f060 2024-09-18T01:45:44.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.886+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:44.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.886+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56159f6fd000 con 0x56159f6f4370 2024-09-18T01:45:44.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.886+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf78057030 con 0x56159f6f4370 2024-09-18T01:45:44.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.886+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56159f6fd000 con 0x7fcf80048040 2024-09-18T01:45:44.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.886+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf78057030 con 0x7fcf80048040 2024-09-18T01:45:44.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.886+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56159f6fd000 con 0x56159f6fa5e0 2024-09-18T01:45:44.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.886+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:44.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.886+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56159f6fd000 con 0x7fcf80048040 2024-09-18T01:45:44.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.887+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf78057030 con 0x7fcf80048040 2024-09-18T01:45:44.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.887+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56159f6fd000 con 0x7fcf8c03f060 2024-09-18T01:45:44.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.887+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:44.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.887+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56159f6fd000 con 0x56159f6fa5e0 2024-09-18T01:45:44.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.887+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:44.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.887+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56159f6fd000 con 0x7fcf80048040 2024-09-18T01:45:44.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.887+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf78057030 con 0x7fcf80048040 2024-09-18T01:45:44.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.887+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56159f6fd000 con 0x56159f6f4370 2024-09-18T01:45:44.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.888+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcf78057030 con 0x56159f6f4370 2024-09-18T01:45:44.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.888+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56159f6fd000 con 0x7fcf8c03f060 2024-09-18T01:45:44.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.888+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:44.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.888+0000 7fcf92e40800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:44.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.888+0000 7fcf92e40800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:44.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.888+0000 7fcf92e40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:44.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.888+0000 7fcf92e40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:44.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.888+0000 7fcf92e40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:44.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.888+0000 7fcf92e40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:44.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.888+0000 7fcf92e40800 20 rados->read ofs=0 len=0 2024-09-18T01:45:44.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.888+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f6f9220 con 0x56159f6f4370 2024-09-18T01:45:44.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.888+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcf78057030 con 0x56159f6f4370 2024-09-18T01:45:44.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.888+0000 7fcf92e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:44.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.888+0000 7fcf92e40800 20 rados->read ofs=0 len=0 2024-09-18T01:45:44.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.888+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f6f9ac0 con 0x56159f6f4370 2024-09-18T01:45:44.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.888+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcf78057030 con 0x56159f6f4370 2024-09-18T01:45:44.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.888+0000 7fcf92e40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:44.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.888+0000 7fcf92e40800 20 rados->read ofs=0 len=0 2024-09-18T01:45:44.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.888+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f6fd480 con 0x7fcf8c03f060 2024-09-18T01:45:44.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.889+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:44.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.889+0000 7fcf92e40800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:44.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.889+0000 7fcf92e40800 20 zone default found 2024-09-18T01:45:44.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.889+0000 7fcf92e40800 4 Realm: () 2024-09-18T01:45:44.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.889+0000 7fcf92e40800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:44.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.889+0000 7fcf92e40800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:44.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.889+0000 7fcf92e40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:44.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.889+0000 7fcf92e40800 20 zonegroup default 2024-09-18T01:45:44.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.889+0000 7fcf92e40800 20 rados->read ofs=0 len=0 2024-09-18T01:45:44.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.889+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f6fdcd0 con 0x7fcf80048040 2024-09-18T01:45:44.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.889+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcf78057030 con 0x7fcf80048040 2024-09-18T01:45:44.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.889+0000 7fcf92e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:44.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.889+0000 7fcf92e40800 20 rados->read ofs=0 len=0 2024-09-18T01:45:44.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.889+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f6ff6b0 con 0x56159f6fa5e0 2024-09-18T01:45:44.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.889+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:44.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.889+0000 7fcf92e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:44.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.889+0000 7fcf92e40800 20 rados->read ofs=0 len=0 2024-09-18T01:45:44.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.889+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f6ffb70 con 0x56159f6fa5e0 2024-09-18T01:45:44.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.890+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:44.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.890+0000 7fcf92e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:44.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.890+0000 7fcf92e40800 20 started sync module instance, tier type = 2024-09-18T01:45:44.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.890+0000 7fcf92e40800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:44.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.890+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f6feb40 con 0x7fcf8c03f060 2024-09-18T01:45:44.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.891+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v33'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:44.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.891+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94650869215024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f6fe7a0 con 0x7fcf8c03f060 2024-09-18T01:45:44.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.891+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f700aa0 con 0x56159f6f4370 2024-09-18T01:45:44.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.892+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94650869215024] v33'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:44.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.892+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v33'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf78057030 con 0x56159f6f4370 2024-09-18T01:45:44.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.892+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94650869220848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f700ec0 con 0x56159f6f4370 2024-09-18T01:45:44.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.892+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f701880 con 0x56159f6fa5e0 2024-09-18T01:45:44.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.893+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94650869220848] v33'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf78057030 con 0x56159f6f4370 2024-09-18T01:45:44.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.893+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v33'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:44.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.893+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94650869222384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f701880 con 0x56159f6fa5e0 2024-09-18T01:45:44.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.893+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f702280 con 0x7fcf8c03f060 2024-09-18T01:45:44.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.894+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v33'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:44.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.894+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94650869226896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f702b20 con 0x7fcf8c03f060 2024-09-18T01:45:44.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.894+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f703600 con 0x56159f6f4370 2024-09-18T01:45:44.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.894+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94650869222384] v33'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:44.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.896+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v33'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf78057030 con 0x56159f6f4370 2024-09-18T01:45:44.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.896+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94650869224400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f703a20 con 0x56159f6f4370 2024-09-18T01:45:44.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.896+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f704440 con 0x7fcf80048040 2024-09-18T01:45:44.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.896+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94650869226896] v33'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:44.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.897+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v33'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf78057030 con 0x7fcf80048040 2024-09-18T01:45:44.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.897+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94650869224400] v33'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf78057030 con 0x56159f6f4370 2024-09-18T01:45:44.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.897+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94650869235504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f704400 con 0x7fcf80048040 2024-09-18T01:45:44.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.897+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f704910 con 0x7fcf80048040 2024-09-18T01:45:44.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.898+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94650869235504] v33'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf78057030 con 0x7fcf80048040 2024-09-18T01:45:44.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.898+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v33'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf78057030 con 0x7fcf80048040 2024-09-18T01:45:44.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.898+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94650869231888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f704910 con 0x7fcf80048040 2024-09-18T01:45:44.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.898+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f704910 con 0x7fcf80048040 2024-09-18T01:45:44.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.899+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(58 notify.7 [create] v33'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf78057030 con 0x7fcf80048040 2024-09-18T01:45:44.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.899+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94650869231888] v33'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf78057030 con 0x7fcf80048040 2024-09-18T01:45:44.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.899+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94650869239328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f705240 con 0x7fcf80048040 2024-09-18T01:45:44.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.899+0000 7fcf92e40800 20 add_watcher() i=0 2024-09-18T01:45:44.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.899+0000 7fcf92e40800 20 add_watcher() i=1 2024-09-18T01:45:44.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.899+0000 7fcf92e40800 20 add_watcher() i=2 2024-09-18T01:45:44.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.899+0000 7fcf92e40800 20 add_watcher() i=3 2024-09-18T01:45:44.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.899+0000 7fcf92e40800 20 add_watcher() i=4 2024-09-18T01:45:44.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.899+0000 7fcf92e40800 20 add_watcher() i=5 2024-09-18T01:45:44.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.899+0000 7fcf92e40800 20 add_watcher() i=6 2024-09-18T01:45:44.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.900+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94650869239328] v33'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf78057030 con 0x7fcf80048040 2024-09-18T01:45:44.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.900+0000 7fcf92e40800 20 add_watcher() i=7 2024-09-18T01:45:44.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.900+0000 7fcf92e40800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:44.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.900+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f7086d0 con 0x56159f6f4370 2024-09-18T01:45:44.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.900+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcf78057030 con 0x56159f6f4370 2024-09-18T01:45:44.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.900+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94650869229168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f705bf0 con 0x56159f6f4370 2024-09-18T01:45:44.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.901+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94650869229168] v33'163 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcf78057030 con 0x56159f6f4370 2024-09-18T01:45:44.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.901+0000 7fce46fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:44.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.901+0000 7fcf92e40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:44.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.901+0000 7fcf92e40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:44.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.901+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f708460 con 0x56159f6f4370 2024-09-18T01:45:44.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.902+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'50 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcf78057030 con 0x56159f6f4370 2024-09-18T01:45:44.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.902+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f7117c0 con 0x7fcf80048040 2024-09-18T01:45:44.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.904+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcf78057030 con 0x7fcf80048040 2024-09-18T01:45:44.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.904+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f711c00 con 0x56159f6fa5e0 2024-09-18T01:45:44.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.904+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:44.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.905+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f711b80 con 0x56159f6f4370 2024-09-18T01:45:44.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.905+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'164 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcf78057030 con 0x56159f6f4370 2024-09-18T01:45:44.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.906+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f712110 con 0x7fcf8c03f060 2024-09-18T01:45:44.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.907+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'53 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:44.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.907+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f7125c0 con 0x56159f6fa5e0 2024-09-18T01:45:44.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.908+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'46 uv43 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:44.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.908+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f7125c0 con 0x56159f6f4370 2024-09-18T01:45:44.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.909+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'27 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcf78057030 con 0x56159f6f4370 2024-09-18T01:45:44.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.909+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f7125c0 con 0x7fcf80048040 2024-09-18T01:45:44.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.910+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'37 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcf78057030 con 0x7fcf80048040 2024-09-18T01:45:44.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.910+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f712650 con 0x7fcf8c03f060 2024-09-18T01:45:44.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.911+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:44.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.911+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f712b00 con 0x56159f6fa5e0 2024-09-18T01:45:44.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.912+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:44.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.912+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f712b00 con 0x7fcf8c03f060 2024-09-18T01:45:44.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.913+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'54 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:44.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.913+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f712b00 con 0x7fcf80048040 2024-09-18T01:45:44.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.914+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'21 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf78057030 con 0x7fcf80048040 2024-09-18T01:45:44.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.914+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f712b00 con 0x7fcf8c03f060 2024-09-18T01:45:44.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.915+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'25 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:44.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.915+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f712b00 con 0x7fcf80048040 2024-09-18T01:45:44.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.916+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'49 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf78057030 con 0x7fcf80048040 2024-09-18T01:45:44.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.916+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f712b00 con 0x56159f6f4370 2024-09-18T01:45:44.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.917+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'165 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf78057030 con 0x56159f6f4370 2024-09-18T01:45:44.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.917+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f712b00 con 0x56159f6fa5e0 2024-09-18T01:45:44.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.918+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'47 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:44.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.918+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f712b00 con 0x7fcf8c03f060 2024-09-18T01:45:44.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.919+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'55 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:44.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.919+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f712b00 con 0x56159f6fa5e0 2024-09-18T01:45:44.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.920+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'32 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:44.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.920+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f712b00 con 0x56159f6f4370 2024-09-18T01:45:44.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.921+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'27 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf78057030 con 0x56159f6f4370 2024-09-18T01:45:44.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.922+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f712b00 con 0x56159f6f4370 2024-09-18T01:45:44.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.922+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'166 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf78057030 con 0x56159f6f4370 2024-09-18T01:45:44.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.922+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f712b00 con 0x56159f6fa5e0 2024-09-18T01:45:44.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.924+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'48 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:44.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.924+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f712b00 con 0x7fcf8c03f060 2024-09-18T01:45:44.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.925+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'35 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:44.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.925+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f712b00 con 0x56159f6fa5e0 2024-09-18T01:45:44.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.926+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'27 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:44.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.926+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f712b00 con 0x56159f6fa5e0 2024-09-18T01:45:44.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.926+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'37 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:44.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.926+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f712b00 con 0x56159f6fa5e0 2024-09-18T01:45:44.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.927+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:44.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.927+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f712b00 con 0x56159f6fa5e0 2024-09-18T01:45:44.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.928+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'47 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:44.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.928+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f712b00 con 0x7fcf80048040 2024-09-18T01:45:44.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.930+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'28 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf78057030 con 0x7fcf80048040 2024-09-18T01:45:44.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.930+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f712b00 con 0x56159f6fa5e0 2024-09-18T01:45:44.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.930+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'31 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:44.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.930+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f712b00 con 0x7fcf80048040 2024-09-18T01:45:44.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.932+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'38 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf78057030 con 0x7fcf80048040 2024-09-18T01:45:44.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.932+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f712b00 con 0x56159f6fa5e0 2024-09-18T01:45:44.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.933+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'49 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:44.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.933+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f712b00 con 0x7fcf80048040 2024-09-18T01:45:44.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.934+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'50 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf78057030 con 0x7fcf80048040 2024-09-18T01:45:44.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.934+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f712b00 con 0x7fcf8c03f060 2024-09-18T01:45:44.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.935+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:44.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.935+0000 7fce45fe3640 20 reqs_thread_entry: start 2024-09-18T01:45:44.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.935+0000 7fcf92e40800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:44.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.935+0000 7fcf92e40800 20 Filter name: none 2024-09-18T01:45:44.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.935+0000 7fcdb77fe640 20 reqs_thread_entry: start 2024-09-18T01:45:44.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.935+0000 7fcf92e40800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=1 2024-09-18T01:45:44.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.935+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f73ebf0 con 0x56159f6f4370 2024-09-18T01:45:44.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.936+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 28 ==== osd_op_reply(94 gc.0 [call] v33'51 uv51 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fcf78057030 con 0x56159f6f4370 2024-09-18T01:45:44.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.936+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f73ebf0 con 0x56159f6f4370 2024-09-18T01:45:44.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.937+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 29 ==== osd_op_reply(95 gc.0 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fcf78057030 con 0x56159f6f4370 2024-09-18T01:45:44.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.937+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:44.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.937+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f73dbe0 con 0x56159f6f4370 2024-09-18T01:45:44.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.937+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 30 ==== osd_op_reply(96 gc.0 [call out=24b] v0'0 uv51 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fcf78057030 con 0x56159f6f4370 2024-09-18T01:45:44.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.937+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:97 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f73ebf0 con 0x56159f6f4370 2024-09-18T01:45:44.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.937+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 31 ==== osd_op_reply(97 gc.0 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fcf78057030 con 0x56159f6f4370 2024-09-18T01:45:44.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.937+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:45:44.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.937+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:98 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f73ebf0 con 0x56159f6f4370 2024-09-18T01:45:44.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.937+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 32 ==== osd_op_reply(98 gc.0 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fcf78081040 con 0x56159f6f4370 2024-09-18T01:45:44.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.937+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:44.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.937+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:99 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f73ebf0 con 0x56159f6f4370 2024-09-18T01:45:44.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.939+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 33 ==== osd_op_reply(99 gc.0 [call] v33'52 uv52 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fcf78081040 con 0x56159f6f4370 2024-09-18T01:45:44.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.939+0000 7fcf92e40800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=1 2024-09-18T01:45:44.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.939+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:100 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f73ebf0 con 0x7fcf80048040 2024-09-18T01:45:44.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.940+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 24 ==== osd_op_reply(100 gc.1 [call] v33'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fcf78081040 con 0x7fcf80048040 2024-09-18T01:45:44.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.940+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:101 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f73ebf0 con 0x7fcf80048040 2024-09-18T01:45:44.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.940+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 25 ==== osd_op_reply(101 gc.1 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fcf78081040 con 0x7fcf80048040 2024-09-18T01:45:44.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.940+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:44.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.940+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:102 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f73dbe0 con 0x7fcf80048040 2024-09-18T01:45:44.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.941+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 26 ==== osd_op_reply(102 gc.1 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fcf78081040 con 0x7fcf80048040 2024-09-18T01:45:44.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.941+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:103 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f73dbe0 con 0x7fcf80048040 2024-09-18T01:45:44.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.941+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 27 ==== osd_op_reply(103 gc.1 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fcf78081040 con 0x7fcf80048040 2024-09-18T01:45:44.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.941+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:45:44.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.941+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:104 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f73dbe0 con 0x7fcf80048040 2024-09-18T01:45:44.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.941+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 28 ==== osd_op_reply(104 gc.1 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fcf78081040 con 0x7fcf80048040 2024-09-18T01:45:44.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.941+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:44.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.941+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:105 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f73ebf0 con 0x7fcf80048040 2024-09-18T01:45:44.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.942+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 29 ==== osd_op_reply(105 gc.1 [call] v33'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fcf78081040 con 0x7fcf80048040 2024-09-18T01:45:44.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.942+0000 7fcf92e40800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=1 2024-09-18T01:45:44.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.942+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:106 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f73ebf0 con 0x56159f6fa5e0 2024-09-18T01:45:44.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.943+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 26 ==== osd_op_reply(106 gc.2 [call] v33'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:44.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.943+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:107 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f73ebf0 con 0x56159f6fa5e0 2024-09-18T01:45:44.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.944+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 27 ==== osd_op_reply(107 gc.2 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:44.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.944+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:44.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.944+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:108 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f73dbe0 con 0x56159f6fa5e0 2024-09-18T01:45:44.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.944+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 28 ==== osd_op_reply(108 gc.2 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:44.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.944+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:109 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f73ebf0 con 0x56159f6fa5e0 2024-09-18T01:45:44.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.944+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 29 ==== osd_op_reply(109 gc.2 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:44.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.944+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:45:44.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.944+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:110 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f73ebf0 con 0x56159f6fa5e0 2024-09-18T01:45:44.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.944+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 30 ==== osd_op_reply(110 gc.2 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:44.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.944+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:44.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.944+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:111 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f73ebf0 con 0x56159f6fa5e0 2024-09-18T01:45:44.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.945+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 31 ==== osd_op_reply(111 gc.2 [call] v33'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:44.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.945+0000 7fcf92e40800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=1 2024-09-18T01:45:44.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.945+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:112 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f73ebf0 con 0x56159f6f4370 2024-09-18T01:45:44.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.946+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 34 ==== osd_op_reply(112 gc.3 [call] v33'167 uv167 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fcf78081040 con 0x56159f6f4370 2024-09-18T01:45:44.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.946+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:113 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f73ebf0 con 0x56159f6f4370 2024-09-18T01:45:44.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.946+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 35 ==== osd_op_reply(113 gc.3 [call out=15b] v0'0 uv167 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fcf78081040 con 0x56159f6f4370 2024-09-18T01:45:44.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.946+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:44.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.946+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:114 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f73dbe0 con 0x56159f6f4370 2024-09-18T01:45:44.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.947+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 36 ==== osd_op_reply(114 gc.3 [call out=24b] v0'0 uv167 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fcf78081040 con 0x56159f6f4370 2024-09-18T01:45:44.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.947+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:115 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f73dbe0 con 0x56159f6f4370 2024-09-18T01:45:44.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.947+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 37 ==== osd_op_reply(115 gc.3 [call out=15b] v0'0 uv167 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fcf78081040 con 0x56159f6f4370 2024-09-18T01:45:44.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.947+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:45:44.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.947+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:116 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f73dbe0 con 0x56159f6f4370 2024-09-18T01:45:44.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.947+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 38 ==== osd_op_reply(116 gc.3 [call out=15b] v0'0 uv167 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fcf78081040 con 0x56159f6f4370 2024-09-18T01:45:44.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.947+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:44.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.947+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:117 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f73ebf0 con 0x56159f6f4370 2024-09-18T01:45:44.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.948+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 39 ==== osd_op_reply(117 gc.3 [call] v33'168 uv168 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fcf78081040 con 0x56159f6f4370 2024-09-18T01:45:44.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.948+0000 7fcf92e40800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=1 2024-09-18T01:45:44.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.948+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:118 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f73ebf0 con 0x7fcf8c03f060 2024-09-18T01:45:44.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.949+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 19 ==== osd_op_reply(118 gc.4 [call] v33'56 uv56 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:44.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.949+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:119 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f73ebf0 con 0x7fcf8c03f060 2024-09-18T01:45:44.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.949+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 20 ==== osd_op_reply(119 gc.4 [call out=15b] v0'0 uv56 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:44.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.949+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:44.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.949+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:120 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f73dbe0 con 0x7fcf8c03f060 2024-09-18T01:45:44.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.949+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 21 ==== osd_op_reply(120 gc.4 [call out=24b] v0'0 uv56 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:44.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.950+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:121 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f73ebf0 con 0x7fcf8c03f060 2024-09-18T01:45:44.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.950+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 22 ==== osd_op_reply(121 gc.4 [call out=15b] v0'0 uv56 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:44.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.950+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:45:44.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.950+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:122 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f73ebf0 con 0x7fcf8c03f060 2024-09-18T01:45:44.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.950+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 23 ==== osd_op_reply(122 gc.4 [call out=15b] v0'0 uv56 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:44.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.950+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:44.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.950+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:123 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f73ebf0 con 0x7fcf8c03f060 2024-09-18T01:45:44.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.951+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 24 ==== osd_op_reply(123 gc.4 [call] v33'57 uv57 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:44.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.951+0000 7fcf92e40800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=1 2024-09-18T01:45:44.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.951+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:124 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f73ebf0 con 0x56159f6fa5e0 2024-09-18T01:45:44.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.952+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 32 ==== osd_op_reply(124 gc.5 [call] v33'48 uv48 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:44.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.952+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:125 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f73ebf0 con 0x56159f6fa5e0 2024-09-18T01:45:44.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.952+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 33 ==== osd_op_reply(125 gc.5 [call out=15b] v0'0 uv48 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:44.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.952+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:44.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.952+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:126 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f73dbe0 con 0x56159f6fa5e0 2024-09-18T01:45:44.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.952+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 34 ==== osd_op_reply(126 gc.5 [call out=24b] v0'0 uv48 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:44.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.952+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:127 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f73ebf0 con 0x56159f6fa5e0 2024-09-18T01:45:44.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.953+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 35 ==== osd_op_reply(127 gc.5 [call out=15b] v0'0 uv48 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:44.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.953+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:45:44.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.953+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:128 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f73ebf0 con 0x56159f6fa5e0 2024-09-18T01:45:44.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.953+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 36 ==== osd_op_reply(128 gc.5 [call out=1702b] v0'0 uv48 ondisk = 0) ==== 148+0+1702 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:44.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.953+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-18T01:45:44.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.953+0000 7fcf92e40800 20 garbage collection: RGWGC::process iterating over entry tag='8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10614682544297223998', time=2024-09-18T01:45:44.599808+0000, chain.objs.size()=7 2024-09-18T01:45:44.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.953+0000 7fcf92e40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1__shadow_.J5arEY1IywBeWgso2YYmpd_nTjk1v6i_1 2024-09-18T01:45:44.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.953+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:129 3.23s0 3:c5e5e5c5:::8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1__shadow_.J5arEY1IywBeWgso2YYmpd_nTjk1v6i_1:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f73cf20 con 0x7fcf80048040 2024-09-18T01:45:44.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.953+0000 7fcf92e40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1__shadow_.J5arEY1IywBeWgso2YYmpd_nTjk1v6i_2 2024-09-18T01:45:44.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.953+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:130 3.1fs0 3:f820dc54:::8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1__shadow_.J5arEY1IywBeWgso2YYmpd_nTjk1v6i_2:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f742100 con 0x56159f6f4370 2024-09-18T01:45:44.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.953+0000 7fcf92e40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1__shadow_.J5arEY1IywBeWgso2YYmpd_nTjk1v6i_3 2024-09-18T01:45:44.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.953+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:131 3.12s0 3:4ad49ba6:::8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1__shadow_.J5arEY1IywBeWgso2YYmpd_nTjk1v6i_3:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f744b50 con 0x7fcf8c03f060 2024-09-18T01:45:44.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.953+0000 7fcf92e40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1__shadow_.J5arEY1IywBeWgso2YYmpd_nTjk1v6i_4 2024-09-18T01:45:44.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.953+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:132 3.2s0 3:4284bc59:::8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1__shadow_.J5arEY1IywBeWgso2YYmpd_nTjk1v6i_4:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f747460 con 0x56159f6fa5e0 2024-09-18T01:45:44.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.953+0000 7fcf92e40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1__shadow_.J5arEY1IywBeWgso2YYmpd_nTjk1v6i_5 2024-09-18T01:45:44.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.953+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:133 3.39s0 3:9d7f614d:::8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1__shadow_.J5arEY1IywBeWgso2YYmpd_nTjk1v6i_5:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f749d50 con 0x56159f6fa5e0 2024-09-18T01:45:44.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.953+0000 7fcf92e40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1__shadow_.J5arEY1IywBeWgso2YYmpd_nTjk1v6i_6 2024-09-18T01:45:44.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.953+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:134 3.1ds0 3:b8daf47e:::8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1__shadow_.J5arEY1IywBeWgso2YYmpd_nTjk1v6i_6:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f74c5c0 con 0x56159f6fa5e0 2024-09-18T01:45:44.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.953+0000 7fcf92e40800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1__shadow_.J5arEY1IywBeWgso2YYmpd_nTjk1v6i_7 2024-09-18T01:45:44.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.953+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:135 3.14s0 3:2991174d:::8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1__shadow_.J5arEY1IywBeWgso2YYmpd_nTjk1v6i_7:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f749d50 con 0x56159f6fa5e0 2024-09-18T01:45:44.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.955+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 30 ==== osd_op_reply(129 8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1__shadow_.J5arEY1IywBeWgso2YYmpd_nTjk1v6i_1 [call] v33'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fcf78081040 con 0x7fcf80048040 2024-09-18T01:45:44.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.955+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 40 ==== osd_op_reply(130 8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1__shadow_.J5arEY1IywBeWgso2YYmpd_nTjk1v6i_2 [call] v33'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fcf78081040 con 0x56159f6f4370 2024-09-18T01:45:44.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.956+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 37 ==== osd_op_reply(132 8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1__shadow_.J5arEY1IywBeWgso2YYmpd_nTjk1v6i_4 [call] v33'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:44.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.957+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 38 ==== osd_op_reply(133 8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1__shadow_.J5arEY1IywBeWgso2YYmpd_nTjk1v6i_5 [call] v33'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:44.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.957+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 25 ==== osd_op_reply(131 8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1__shadow_.J5arEY1IywBeWgso2YYmpd_nTjk1v6i_3 [call] v33'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:44.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.958+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 39 ==== osd_op_reply(134 8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1__shadow_.J5arEY1IywBeWgso2YYmpd_nTjk1v6i_6 [call] v33'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:44.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.958+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 40 ==== osd_op_reply(135 8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1__shadow_.J5arEY1IywBeWgso2YYmpd_nTjk1v6i_7 [call] v33'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:44.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.958+0000 7fcf92e40800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-18T01:45:44.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.958+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:136 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f73c910 con 0x56159f6fa5e0 2024-09-18T01:45:44.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.960+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 41 ==== osd_op_reply(136 gc.5 [call] v33'49 uv49 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:44.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.960+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:137 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f73c910 con 0x56159f6fa5e0 2024-09-18T01:45:44.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.961+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 42 ==== osd_op_reply(137 gc.5 [call] v33'50 uv50 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:44.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.961+0000 7fcf92e40800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=1 2024-09-18T01:45:44.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.961+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:138 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f73c910 con 0x56159f6f4370 2024-09-18T01:45:44.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.962+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 41 ==== osd_op_reply(138 gc.6 [call] v33'28 uv28 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fcf78081040 con 0x56159f6f4370 2024-09-18T01:45:44.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.962+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:139 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f73c8c0 con 0x56159f6f4370 2024-09-18T01:45:44.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.962+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 42 ==== osd_op_reply(139 gc.6 [call out=15b] v0'0 uv28 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fcf78081040 con 0x56159f6f4370 2024-09-18T01:45:44.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.962+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:44.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.962+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:140 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f73c8c0 con 0x56159f6f4370 2024-09-18T01:45:44.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.962+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 43 ==== osd_op_reply(140 gc.6 [call out=24b] v0'0 uv28 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fcf78081040 con 0x56159f6f4370 2024-09-18T01:45:44.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.962+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:141 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f73c8c0 con 0x56159f6f4370 2024-09-18T01:45:44.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.962+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 44 ==== osd_op_reply(141 gc.6 [call out=15b] v0'0 uv28 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fcf78081040 con 0x56159f6f4370 2024-09-18T01:45:44.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.962+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:45:44.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.962+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:142 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f73c8c0 con 0x56159f6f4370 2024-09-18T01:45:44.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.963+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 45 ==== osd_op_reply(142 gc.6 [call out=15b] v0'0 uv28 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fcf78081040 con 0x56159f6f4370 2024-09-18T01:45:44.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.963+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:44.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.963+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:143 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f73c8c0 con 0x56159f6f4370 2024-09-18T01:45:44.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.964+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 46 ==== osd_op_reply(143 gc.6 [call] v33'29 uv29 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fcf78081040 con 0x56159f6f4370 2024-09-18T01:45:44.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.964+0000 7fcf92e40800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=1 2024-09-18T01:45:44.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.964+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:144 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f73c8c0 con 0x7fcf80048040 2024-09-18T01:45:44.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.965+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 31 ==== osd_op_reply(144 gc.7 [call] v33'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fcf78081040 con 0x7fcf80048040 2024-09-18T01:45:44.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.965+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:145 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f73c8c0 con 0x7fcf80048040 2024-09-18T01:45:44.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.965+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 32 ==== osd_op_reply(145 gc.7 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fcf78081040 con 0x7fcf80048040 2024-09-18T01:45:44.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.965+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:44.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.965+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:146 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f73c8c0 con 0x7fcf80048040 2024-09-18T01:45:44.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.965+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 33 ==== osd_op_reply(146 gc.7 [call out=24b] v0'0 uv39 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fcf78081040 con 0x7fcf80048040 2024-09-18T01:45:44.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.965+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:147 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f73c8c0 con 0x7fcf80048040 2024-09-18T01:45:44.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.965+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 34 ==== osd_op_reply(147 gc.7 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fcf78081040 con 0x7fcf80048040 2024-09-18T01:45:44.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.965+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:45:44.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.965+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:148 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f73c8c0 con 0x7fcf80048040 2024-09-18T01:45:44.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.966+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 35 ==== osd_op_reply(148 gc.7 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fcf78081040 con 0x7fcf80048040 2024-09-18T01:45:44.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.966+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:44.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.966+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:149 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f73c8c0 con 0x7fcf80048040 2024-09-18T01:45:44.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.967+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 36 ==== osd_op_reply(149 gc.7 [call] v33'40 uv40 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fcf78081040 con 0x7fcf80048040 2024-09-18T01:45:44.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.967+0000 7fcf92e40800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=1 2024-09-18T01:45:44.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.967+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:150 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f73c8c0 con 0x7fcf8c03f060 2024-09-18T01:45:44.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.968+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 26 ==== osd_op_reply(150 gc.8 [call] v33'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:44.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.968+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:151 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f73c8c0 con 0x7fcf8c03f060 2024-09-18T01:45:44.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.968+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 27 ==== osd_op_reply(151 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:44.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.968+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:44.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.968+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:152 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f73c8c0 con 0x7fcf8c03f060 2024-09-18T01:45:44.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.969+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 28 ==== osd_op_reply(152 gc.8 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:44.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.969+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:153 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f73c8c0 con 0x7fcf8c03f060 2024-09-18T01:45:44.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.969+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 29 ==== osd_op_reply(153 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:44.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.969+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:45:44.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.969+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:154 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f73c8c0 con 0x7fcf8c03f060 2024-09-18T01:45:44.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.969+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 30 ==== osd_op_reply(154 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:44.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.969+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:44.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.969+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:155 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f73c8c0 con 0x7fcf8c03f060 2024-09-18T01:45:44.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.970+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 31 ==== osd_op_reply(155 gc.8 [call] v33'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:44.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.970+0000 7fcf92e40800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=1 2024-09-18T01:45:44.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.970+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:156 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f73c8c0 con 0x56159f6fa5e0 2024-09-18T01:45:44.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.971+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 43 ==== osd_op_reply(156 gc.9 [call] v33'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:44.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.971+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:157 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f73c8c0 con 0x56159f6fa5e0 2024-09-18T01:45:44.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.972+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 44 ==== osd_op_reply(157 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:44.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.972+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:44.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.972+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:158 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f73c8c0 con 0x56159f6fa5e0 2024-09-18T01:45:44.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.972+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 45 ==== osd_op_reply(158 gc.9 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:44.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.972+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:159 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746d70 con 0x56159f6fa5e0 2024-09-18T01:45:44.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.972+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 46 ==== osd_op_reply(159 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:44.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.972+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:45:44.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.972+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:160 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f744530 con 0x56159f6fa5e0 2024-09-18T01:45:44.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.972+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 47 ==== osd_op_reply(160 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:44.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.972+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:44.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.972+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:161 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f744530 con 0x56159f6fa5e0 2024-09-18T01:45:44.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.973+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 48 ==== osd_op_reply(161 gc.9 [call] v33'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:44.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.973+0000 7fcf92e40800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=1 2024-09-18T01:45:44.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.973+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:162 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f744530 con 0x7fcf8c03f060 2024-09-18T01:45:44.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.974+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 32 ==== osd_op_reply(162 gc.10 [call] v33'58 uv58 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:44.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.974+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:163 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f744530 con 0x7fcf8c03f060 2024-09-18T01:45:44.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.974+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 33 ==== osd_op_reply(163 gc.10 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:44.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.974+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:44.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.974+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:164 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f743520 con 0x7fcf8c03f060 2024-09-18T01:45:44.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.975+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 34 ==== osd_op_reply(164 gc.10 [call out=24b] v0'0 uv58 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:44.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.975+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:165 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f744530 con 0x7fcf8c03f060 2024-09-18T01:45:44.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.975+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 35 ==== osd_op_reply(165 gc.10 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:44.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.975+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:45:44.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.975+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:166 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f744530 con 0x7fcf8c03f060 2024-09-18T01:45:44.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.975+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 36 ==== osd_op_reply(166 gc.10 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:44.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.975+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:44.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.975+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:167 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f744530 con 0x7fcf8c03f060 2024-09-18T01:45:44.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.976+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 37 ==== osd_op_reply(167 gc.10 [call] v33'59 uv59 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:44.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.976+0000 7fcf92e40800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=1 2024-09-18T01:45:44.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.976+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:168 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f744530 con 0x7fcf80048040 2024-09-18T01:45:44.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.978+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 37 ==== osd_op_reply(168 gc.11 [call] v33'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fcf78081040 con 0x7fcf80048040 2024-09-18T01:45:44.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.978+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:169 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x7fcf80048040 2024-09-18T01:45:44.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.978+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 38 ==== osd_op_reply(169 gc.11 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf78081040 con 0x7fcf80048040 2024-09-18T01:45:44.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.978+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:44.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.978+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:170 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f745ca0 con 0x7fcf80048040 2024-09-18T01:45:44.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.978+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 39 ==== osd_op_reply(170 gc.11 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fcf78081040 con 0x7fcf80048040 2024-09-18T01:45:44.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.978+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:171 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x7fcf80048040 2024-09-18T01:45:44.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.978+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 40 ==== osd_op_reply(171 gc.11 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf78081040 con 0x7fcf80048040 2024-09-18T01:45:44.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.978+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:45:44.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.978+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:172 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x7fcf80048040 2024-09-18T01:45:44.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.979+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 41 ==== osd_op_reply(172 gc.11 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf78081040 con 0x7fcf80048040 2024-09-18T01:45:44.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.979+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:44.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.979+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:173 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x7fcf80048040 2024-09-18T01:45:44.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.980+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 42 ==== osd_op_reply(173 gc.11 [call] v33'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fcf78081040 con 0x7fcf80048040 2024-09-18T01:45:44.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.980+0000 7fcf92e40800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=1 2024-09-18T01:45:44.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.980+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:174 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x7fcf8c03f060 2024-09-18T01:45:44.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.981+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 38 ==== osd_op_reply(174 gc.12 [call] v33'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:44.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.981+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:175 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x7fcf8c03f060 2024-09-18T01:45:44.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.981+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 39 ==== osd_op_reply(175 gc.12 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:44.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.981+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:44.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.981+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:176 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f745ca0 con 0x7fcf8c03f060 2024-09-18T01:45:44.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.981+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 40 ==== osd_op_reply(176 gc.12 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:44.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.981+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:177 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x7fcf8c03f060 2024-09-18T01:45:44.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.981+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 41 ==== osd_op_reply(177 gc.12 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:44.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.981+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:45:44.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.981+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:178 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x7fcf8c03f060 2024-09-18T01:45:44.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.982+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 42 ==== osd_op_reply(178 gc.12 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:44.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.982+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:44.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.982+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:179 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x7fcf8c03f060 2024-09-18T01:45:44.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.982+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 43 ==== osd_op_reply(179 gc.12 [call] v33'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:44.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.983+0000 7fcf92e40800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=1 2024-09-18T01:45:44.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.983+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:180 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x7fcf80048040 2024-09-18T01:45:44.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.984+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 43 ==== osd_op_reply(180 gc.13 [call] v33'51 uv51 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fcf78081040 con 0x7fcf80048040 2024-09-18T01:45:44.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.984+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:181 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x7fcf80048040 2024-09-18T01:45:44.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.984+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 44 ==== osd_op_reply(181 gc.13 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf78081040 con 0x7fcf80048040 2024-09-18T01:45:44.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.984+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:44.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.984+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:182 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f745ca0 con 0x7fcf80048040 2024-09-18T01:45:44.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.984+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 45 ==== osd_op_reply(182 gc.13 [call out=24b] v0'0 uv51 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fcf78081040 con 0x7fcf80048040 2024-09-18T01:45:44.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.984+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:183 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x7fcf80048040 2024-09-18T01:45:44.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.984+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 46 ==== osd_op_reply(183 gc.13 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf78081040 con 0x7fcf80048040 2024-09-18T01:45:44.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.984+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:45:44.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.984+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:184 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x7fcf80048040 2024-09-18T01:45:44.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.985+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 47 ==== osd_op_reply(184 gc.13 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf78081040 con 0x7fcf80048040 2024-09-18T01:45:44.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.985+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:44.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.985+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:185 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x7fcf80048040 2024-09-18T01:45:44.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.986+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 48 ==== osd_op_reply(185 gc.13 [call] v33'52 uv52 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fcf78081040 con 0x7fcf80048040 2024-09-18T01:45:44.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.986+0000 7fcf92e40800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=1 2024-09-18T01:45:44.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.986+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:186 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6f4370 2024-09-18T01:45:44.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.987+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 47 ==== osd_op_reply(186 gc.14 [call] v33'169 uv169 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fcf78081040 con 0x56159f6f4370 2024-09-18T01:45:44.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.987+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:187 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6f4370 2024-09-18T01:45:44.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.987+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 48 ==== osd_op_reply(187 gc.14 [call out=15b] v0'0 uv169 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf78081040 con 0x56159f6f4370 2024-09-18T01:45:44.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.987+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:44.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.987+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:188 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f745ca0 con 0x56159f6f4370 2024-09-18T01:45:44.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.987+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 49 ==== osd_op_reply(188 gc.14 [call out=24b] v0'0 uv169 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fcf78081040 con 0x56159f6f4370 2024-09-18T01:45:44.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.987+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:189 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6f4370 2024-09-18T01:45:44.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.988+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 50 ==== osd_op_reply(189 gc.14 [call out=15b] v0'0 uv169 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf78081040 con 0x56159f6f4370 2024-09-18T01:45:44.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.988+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:45:44.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.988+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:190 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6f4370 2024-09-18T01:45:44.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.988+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 51 ==== osd_op_reply(190 gc.14 [call out=15b] v0'0 uv169 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf78081040 con 0x56159f6f4370 2024-09-18T01:45:44.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.988+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:44.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.988+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:191 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6f4370 2024-09-18T01:45:44.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.989+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 52 ==== osd_op_reply(191 gc.14 [call] v33'170 uv170 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fcf78081040 con 0x56159f6f4370 2024-09-18T01:45:44.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.989+0000 7fcf92e40800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=1 2024-09-18T01:45:44.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.989+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:192 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6fa5e0 2024-09-18T01:45:44.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.990+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 49 ==== osd_op_reply(192 gc.15 [call] v33'50 uv50 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:44.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.990+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:193 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6fa5e0 2024-09-18T01:45:44.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.990+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 50 ==== osd_op_reply(193 gc.15 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:44.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.990+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:44.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.990+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:194 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f745ca0 con 0x56159f6fa5e0 2024-09-18T01:45:44.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.991+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 51 ==== osd_op_reply(194 gc.15 [call out=24b] v0'0 uv50 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:44.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.991+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:195 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6fa5e0 2024-09-18T01:45:44.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.991+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 52 ==== osd_op_reply(195 gc.15 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:44.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.991+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:45:44.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.991+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:196 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6fa5e0 2024-09-18T01:45:44.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.991+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 53 ==== osd_op_reply(196 gc.15 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:44.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.991+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:44.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.991+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:197 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6fa5e0 2024-09-18T01:45:44.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.992+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 54 ==== osd_op_reply(197 gc.15 [call] v33'51 uv51 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:44.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.992+0000 7fcf92e40800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=1 2024-09-18T01:45:44.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.992+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:198 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x7fcf8c03f060 2024-09-18T01:45:44.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.993+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 44 ==== osd_op_reply(198 gc.16 [call] v33'60 uv60 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:44.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.993+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:199 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x7fcf8c03f060 2024-09-18T01:45:44.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.994+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 45 ==== osd_op_reply(199 gc.16 [call out=15b] v0'0 uv60 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:44.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.994+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:44.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.994+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:200 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f745ca0 con 0x7fcf8c03f060 2024-09-18T01:45:44.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.994+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 46 ==== osd_op_reply(200 gc.16 [call out=24b] v0'0 uv60 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:44.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.994+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:201 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f745ca0 con 0x7fcf8c03f060 2024-09-18T01:45:44.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.994+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 47 ==== osd_op_reply(201 gc.16 [call out=15b] v0'0 uv60 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:44.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.994+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:45:44.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.994+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:202 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f745ca0 con 0x7fcf8c03f060 2024-09-18T01:45:44.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.994+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 48 ==== osd_op_reply(202 gc.16 [call out=15b] v0'0 uv60 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:44.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.994+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:44.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.994+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:203 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x7fcf8c03f060 2024-09-18T01:45:44.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.995+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 49 ==== osd_op_reply(203 gc.16 [call] v33'61 uv61 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:44.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.995+0000 7fcf92e40800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=1 2024-09-18T01:45:45.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.995+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:204 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6fa5e0 2024-09-18T01:45:45.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.996+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 55 ==== osd_op_reply(204 gc.17 [call] v33'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:45.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.996+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:205 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6fa5e0 2024-09-18T01:45:45.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.996+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 56 ==== osd_op_reply(205 gc.17 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:45.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.996+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:45.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.996+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:206 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f745ca0 con 0x56159f6fa5e0 2024-09-18T01:45:45.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.997+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 57 ==== osd_op_reply(206 gc.17 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:45.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.997+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:207 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6fa5e0 2024-09-18T01:45:45.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.997+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 58 ==== osd_op_reply(207 gc.17 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:45.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.997+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:45:45.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.997+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:208 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6fa5e0 2024-09-18T01:45:45.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.997+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 59 ==== osd_op_reply(208 gc.17 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:45.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.997+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:45.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.997+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:209 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6fa5e0 2024-09-18T01:45:45.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.998+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 60 ==== osd_op_reply(209 gc.17 [call] v33'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:45.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.998+0000 7fcf92e40800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=1 2024-09-18T01:45:45.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.998+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:210 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6f4370 2024-09-18T01:45:45.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.999+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 53 ==== osd_op_reply(210 gc.18 [call] v33'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fcf78081040 con 0x56159f6f4370 2024-09-18T01:45:45.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:44.999+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:211 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6f4370 2024-09-18T01:45:45.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.000+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 54 ==== osd_op_reply(211 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf78081040 con 0x56159f6f4370 2024-09-18T01:45:45.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.000+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:45.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.000+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:212 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f745ca0 con 0x56159f6f4370 2024-09-18T01:45:45.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.000+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 55 ==== osd_op_reply(212 gc.18 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fcf78081040 con 0x56159f6f4370 2024-09-18T01:45:45.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.000+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:213 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6f4370 2024-09-18T01:45:45.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.000+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 56 ==== osd_op_reply(213 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf78081040 con 0x56159f6f4370 2024-09-18T01:45:45.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.000+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:45:45.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.000+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:214 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6f4370 2024-09-18T01:45:45.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.000+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 57 ==== osd_op_reply(214 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf78081040 con 0x56159f6f4370 2024-09-18T01:45:45.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.000+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:45.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.000+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:215 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6f4370 2024-09-18T01:45:45.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.001+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 58 ==== osd_op_reply(215 gc.18 [call] v33'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fcf78081040 con 0x56159f6f4370 2024-09-18T01:45:45.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.001+0000 7fcf92e40800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=1 2024-09-18T01:45:45.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.001+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:216 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6f4370 2024-09-18T01:45:45.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.002+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 59 ==== osd_op_reply(216 gc.19 [call] v33'171 uv171 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fcf78081040 con 0x56159f6f4370 2024-09-18T01:45:45.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.002+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:217 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6f4370 2024-09-18T01:45:45.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.003+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 60 ==== osd_op_reply(217 gc.19 [call out=15b] v0'0 uv171 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf78081040 con 0x56159f6f4370 2024-09-18T01:45:45.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.003+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:45.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.003+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:218 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f745ca0 con 0x56159f6f4370 2024-09-18T01:45:45.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.003+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 61 ==== osd_op_reply(218 gc.19 [call out=24b] v0'0 uv171 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fcf78081040 con 0x56159f6f4370 2024-09-18T01:45:45.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.003+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:219 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6f4370 2024-09-18T01:45:45.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.003+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 62 ==== osd_op_reply(219 gc.19 [call out=15b] v0'0 uv171 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf78081040 con 0x56159f6f4370 2024-09-18T01:45:45.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.003+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:45:45.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.003+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:220 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6f4370 2024-09-18T01:45:45.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.003+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 63 ==== osd_op_reply(220 gc.19 [call out=15b] v0'0 uv171 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf78081040 con 0x56159f6f4370 2024-09-18T01:45:45.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.003+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:45.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.004+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:221 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6f4370 2024-09-18T01:45:45.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.004+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 64 ==== osd_op_reply(221 gc.19 [call] v33'172 uv172 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fcf78081040 con 0x56159f6f4370 2024-09-18T01:45:45.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.004+0000 7fcf92e40800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=1 2024-09-18T01:45:45.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.004+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:222 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6fa5e0 2024-09-18T01:45:45.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.006+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 61 ==== osd_op_reply(222 gc.20 [call] v33'52 uv52 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:45.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.006+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:223 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6fa5e0 2024-09-18T01:45:45.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.006+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 62 ==== osd_op_reply(223 gc.20 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:45.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.006+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:45.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.006+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:224 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f745ca0 con 0x56159f6fa5e0 2024-09-18T01:45:45.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.006+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 63 ==== osd_op_reply(224 gc.20 [call out=24b] v0'0 uv52 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:45.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.006+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:225 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6fa5e0 2024-09-18T01:45:45.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.006+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 64 ==== osd_op_reply(225 gc.20 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:45.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.006+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:45:45.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.006+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:226 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6fa5e0 2024-09-18T01:45:45.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.007+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 65 ==== osd_op_reply(226 gc.20 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:45.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.007+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:45.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.007+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:227 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6fa5e0 2024-09-18T01:45:45.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.008+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 66 ==== osd_op_reply(227 gc.20 [call] v33'53 uv53 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:45.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.008+0000 7fcf92e40800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=1 2024-09-18T01:45:45.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.008+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:228 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x7fcf8c03f060 2024-09-18T01:45:45.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.009+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 50 ==== osd_op_reply(228 gc.21 [call] v33'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:45.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.009+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:229 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x7fcf8c03f060 2024-09-18T01:45:45.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.009+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 51 ==== osd_op_reply(229 gc.21 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:45.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.009+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:45.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.009+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:230 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f745ca0 con 0x7fcf8c03f060 2024-09-18T01:45:45.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.009+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 52 ==== osd_op_reply(230 gc.21 [call out=24b] v0'0 uv36 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:45.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.009+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:231 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x7fcf8c03f060 2024-09-18T01:45:45.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.010+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 53 ==== osd_op_reply(231 gc.21 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:45.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.010+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:45:45.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.010+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:232 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x7fcf8c03f060 2024-09-18T01:45:45.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.010+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 54 ==== osd_op_reply(232 gc.21 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:45.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.010+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:45.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.010+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:233 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x7fcf8c03f060 2024-09-18T01:45:45.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.011+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 55 ==== osd_op_reply(233 gc.21 [call] v33'37 uv37 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:45.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.011+0000 7fcf92e40800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=1 2024-09-18T01:45:45.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.011+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:234 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6fa5e0 2024-09-18T01:45:45.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.012+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 67 ==== osd_op_reply(234 gc.22 [call] v33'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:45.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.012+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:235 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6fa5e0 2024-09-18T01:45:45.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.012+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 68 ==== osd_op_reply(235 gc.22 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:45.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.012+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:45.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.012+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:236 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f745ca0 con 0x56159f6fa5e0 2024-09-18T01:45:45.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.012+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 69 ==== osd_op_reply(236 gc.22 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:45.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.012+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:237 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6fa5e0 2024-09-18T01:45:45.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.012+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 70 ==== osd_op_reply(237 gc.22 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:45.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.012+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:45:45.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.012+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:238 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6fa5e0 2024-09-18T01:45:45.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.013+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 71 ==== osd_op_reply(238 gc.22 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:45.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.013+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:45.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.013+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:239 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6fa5e0 2024-09-18T01:45:45.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.014+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 72 ==== osd_op_reply(239 gc.22 [call] v33'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:45.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.014+0000 7fcf92e40800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=1 2024-09-18T01:45:45.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.014+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:240 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6fa5e0 2024-09-18T01:45:45.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.015+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 73 ==== osd_op_reply(240 gc.23 [call] v33'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:45.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.015+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:241 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6fa5e0 2024-09-18T01:45:45.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.015+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 74 ==== osd_op_reply(241 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:45.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.015+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:45.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.015+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:242 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f745ca0 con 0x56159f6fa5e0 2024-09-18T01:45:45.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.015+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 75 ==== osd_op_reply(242 gc.23 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:45.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.015+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:243 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6fa5e0 2024-09-18T01:45:45.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.015+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 76 ==== osd_op_reply(243 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:45.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.015+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:45:45.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.015+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:244 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6fa5e0 2024-09-18T01:45:45.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.016+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 77 ==== osd_op_reply(244 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:45.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.016+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:45.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.016+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:245 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6fa5e0 2024-09-18T01:45:45.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.016+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 78 ==== osd_op_reply(245 gc.23 [call] v33'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:45.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.016+0000 7fcf92e40800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=1 2024-09-18T01:45:45.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.016+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:246 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6fa5e0 2024-09-18T01:45:45.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.017+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 79 ==== osd_op_reply(246 gc.24 [call] v33'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:45.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.017+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:247 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6fa5e0 2024-09-18T01:45:45.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.018+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 80 ==== osd_op_reply(247 gc.24 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:45.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.018+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:45.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.018+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:248 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f745ca0 con 0x56159f6fa5e0 2024-09-18T01:45:45.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.018+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 81 ==== osd_op_reply(248 gc.24 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:45.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.018+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:249 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6fa5e0 2024-09-18T01:45:45.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.018+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 82 ==== osd_op_reply(249 gc.24 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:45.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.018+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:45:45.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.018+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:250 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6fa5e0 2024-09-18T01:45:45.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.018+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 83 ==== osd_op_reply(250 gc.24 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:45.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.018+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:45.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.018+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:251 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6fa5e0 2024-09-18T01:45:45.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.019+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 84 ==== osd_op_reply(251 gc.24 [call] v33'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:45.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.019+0000 7fcf92e40800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=1 2024-09-18T01:45:45.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.019+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:252 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6fa5e0 2024-09-18T01:45:45.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.020+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 85 ==== osd_op_reply(252 gc.25 [call] v33'51 uv51 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:45.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.020+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:253 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6fa5e0 2024-09-18T01:45:45.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.020+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 86 ==== osd_op_reply(253 gc.25 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:45.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.020+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:45.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.020+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:254 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f745ca0 con 0x56159f6fa5e0 2024-09-18T01:45:45.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.021+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 87 ==== osd_op_reply(254 gc.25 [call out=24b] v0'0 uv51 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:45.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.021+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:255 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6fa5e0 2024-09-18T01:45:45.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.021+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 88 ==== osd_op_reply(255 gc.25 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:45.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.021+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:45:45.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.021+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:256 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6fa5e0 2024-09-18T01:45:45.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.021+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 89 ==== osd_op_reply(256 gc.25 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:45.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.021+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:45.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.021+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:257 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6fa5e0 2024-09-18T01:45:45.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.022+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 90 ==== osd_op_reply(257 gc.25 [call] v33'52 uv52 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:45.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.022+0000 7fcf92e40800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=1 2024-09-18T01:45:45.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.022+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:258 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x7fcf80048040 2024-09-18T01:45:45.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.024+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 49 ==== osd_op_reply(258 gc.26 [call] v33'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fcf78081040 con 0x7fcf80048040 2024-09-18T01:45:45.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.024+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:259 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x7fcf80048040 2024-09-18T01:45:45.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.024+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 50 ==== osd_op_reply(259 gc.26 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf78081040 con 0x7fcf80048040 2024-09-18T01:45:45.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.024+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:45.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.024+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:260 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f745ca0 con 0x7fcf80048040 2024-09-18T01:45:45.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.024+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 51 ==== osd_op_reply(260 gc.26 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fcf78081040 con 0x7fcf80048040 2024-09-18T01:45:45.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.024+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:261 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x7fcf80048040 2024-09-18T01:45:45.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.024+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 52 ==== osd_op_reply(261 gc.26 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf78081040 con 0x7fcf80048040 2024-09-18T01:45:45.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.024+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:45:45.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.024+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:262 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x7fcf80048040 2024-09-18T01:45:45.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.025+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 53 ==== osd_op_reply(262 gc.26 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf78081040 con 0x7fcf80048040 2024-09-18T01:45:45.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.025+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:45.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.025+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:263 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x7fcf80048040 2024-09-18T01:45:45.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.026+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 54 ==== osd_op_reply(263 gc.26 [call] v33'30 uv30 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fcf78081040 con 0x7fcf80048040 2024-09-18T01:45:45.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.026+0000 7fcf92e40800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=1 2024-09-18T01:45:45.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.026+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:264 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6fa5e0 2024-09-18T01:45:45.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.026+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 91 ==== osd_op_reply(264 gc.27 [call] v33'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:45.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.027+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:265 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6fa5e0 2024-09-18T01:45:45.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.027+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 92 ==== osd_op_reply(265 gc.27 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:45.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.027+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:45.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.027+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:266 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f745ca0 con 0x56159f6fa5e0 2024-09-18T01:45:45.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.027+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 93 ==== osd_op_reply(266 gc.27 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:45.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.027+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:267 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6fa5e0 2024-09-18T01:45:45.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.027+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 94 ==== osd_op_reply(267 gc.27 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:45.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.027+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:45:45.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.027+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:268 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6fa5e0 2024-09-18T01:45:45.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.027+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 95 ==== osd_op_reply(268 gc.27 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:45.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.027+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:45.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.027+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:269 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6fa5e0 2024-09-18T01:45:45.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.028+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 96 ==== osd_op_reply(269 gc.27 [call] v33'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:45.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.028+0000 7fcf92e40800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=1 2024-09-18T01:45:45.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.028+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:270 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x7fcf80048040 2024-09-18T01:45:45.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.029+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 55 ==== osd_op_reply(270 gc.28 [call] v33'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fcf78081040 con 0x7fcf80048040 2024-09-18T01:45:45.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.029+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:271 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x7fcf80048040 2024-09-18T01:45:45.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.030+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 56 ==== osd_op_reply(271 gc.28 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf78081040 con 0x7fcf80048040 2024-09-18T01:45:45.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.030+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:45.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.030+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:272 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f745ca0 con 0x7fcf80048040 2024-09-18T01:45:45.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.030+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 57 ==== osd_op_reply(272 gc.28 [call out=24b] v0'0 uv41 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fcf78081040 con 0x7fcf80048040 2024-09-18T01:45:45.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.030+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:273 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x7fcf80048040 2024-09-18T01:45:45.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.030+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 58 ==== osd_op_reply(273 gc.28 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf78081040 con 0x7fcf80048040 2024-09-18T01:45:45.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.030+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:45:45.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.030+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:274 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x7fcf80048040 2024-09-18T01:45:45.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.030+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 59 ==== osd_op_reply(274 gc.28 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf78081040 con 0x7fcf80048040 2024-09-18T01:45:45.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.030+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:45.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.030+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:275 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x7fcf80048040 2024-09-18T01:45:45.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.032+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 60 ==== osd_op_reply(275 gc.28 [call] v33'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fcf78081040 con 0x7fcf80048040 2024-09-18T01:45:45.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.032+0000 7fcf92e40800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=1 2024-09-18T01:45:45.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.032+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:276 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6fa5e0 2024-09-18T01:45:45.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.032+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 97 ==== osd_op_reply(276 gc.29 [call] v33'54 uv54 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:45.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.032+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:277 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6fa5e0 2024-09-18T01:45:45.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.033+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 98 ==== osd_op_reply(277 gc.29 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:45.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.033+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:45.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.033+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:278 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f745ca0 con 0x56159f6fa5e0 2024-09-18T01:45:45.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.033+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 99 ==== osd_op_reply(278 gc.29 [call out=24b] v0'0 uv54 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:45.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.033+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:279 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6fa5e0 2024-09-18T01:45:45.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.033+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 100 ==== osd_op_reply(279 gc.29 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:45.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.033+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:45:45.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.033+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:280 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6fa5e0 2024-09-18T01:45:45.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.033+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 101 ==== osd_op_reply(280 gc.29 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:45.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.033+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:45.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.033+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:281 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x56159f6fa5e0 2024-09-18T01:45:45.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.034+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 102 ==== osd_op_reply(281 gc.29 [call] v33'55 uv55 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:45.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.034+0000 7fcf92e40800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=1 2024-09-18T01:45:45.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.034+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:282 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x7fcf80048040 2024-09-18T01:45:45.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.035+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 61 ==== osd_op_reply(282 gc.30 [call] v33'53 uv53 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fcf78081040 con 0x7fcf80048040 2024-09-18T01:45:45.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.035+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:283 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x7fcf80048040 2024-09-18T01:45:45.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.036+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 62 ==== osd_op_reply(283 gc.30 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf78081040 con 0x7fcf80048040 2024-09-18T01:45:45.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.036+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:45.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.036+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:284 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f745ca0 con 0x7fcf80048040 2024-09-18T01:45:45.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.036+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 63 ==== osd_op_reply(284 gc.30 [call out=24b] v0'0 uv53 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fcf78081040 con 0x7fcf80048040 2024-09-18T01:45:45.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.036+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:285 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x7fcf80048040 2024-09-18T01:45:45.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.036+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 64 ==== osd_op_reply(285 gc.30 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf78081040 con 0x7fcf80048040 2024-09-18T01:45:45.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.036+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:45:45.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.036+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:286 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x7fcf80048040 2024-09-18T01:45:45.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.036+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 65 ==== osd_op_reply(286 gc.30 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf78081040 con 0x7fcf80048040 2024-09-18T01:45:45.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.036+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:45.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.036+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:287 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x7fcf80048040 2024-09-18T01:45:45.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.037+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 66 ==== osd_op_reply(287 gc.30 [call] v33'54 uv54 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fcf78081040 con 0x7fcf80048040 2024-09-18T01:45:45.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.037+0000 7fcf92e40800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=1 2024-09-18T01:45:45.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.037+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:288 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x7fcf8c03f060 2024-09-18T01:45:45.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.038+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 56 ==== osd_op_reply(288 gc.31 [call] v33'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:45.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.038+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:289 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x7fcf8c03f060 2024-09-18T01:45:45.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.038+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 57 ==== osd_op_reply(289 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:45.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.039+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:45.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.039+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:290 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f745ca0 con 0x7fcf8c03f060 2024-09-18T01:45:45.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.039+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 58 ==== osd_op_reply(290 gc.31 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:45.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.039+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:291 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x7fcf8c03f060 2024-09-18T01:45:45.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.039+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 59 ==== osd_op_reply(291 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:45.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.039+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:45:45.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.039+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:292 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x7fcf8c03f060 2024-09-18T01:45:45.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.039+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 60 ==== osd_op_reply(292 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:45.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.039+0000 7fcf92e40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:45:45.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.039+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:293 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f746cb0 con 0x7fcf8c03f060 2024-09-18T01:45:45.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.041+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 61 ==== osd_op_reply(293 gc.31 [call] v33'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:45.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.041+0000 7fce46fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:45.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.041+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94650869229168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f711050 con 0x56159f6f4370 2024-09-18T01:45:45.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.042+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 65 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94650869229168] v33'173 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcf78081040 con 0x56159f6f4370 2024-09-18T01:45:45.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.042+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94650869215024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f702670 con 0x7fcf8c03f060 2024-09-18T01:45:45.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.043+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 62 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94650869215024] v33'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:45.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.043+0000 7fcf92e40800 20 remove_watcher() i=0 2024-09-18T01:45:45.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.043+0000 7fcf92e40800 2 removed watcher, disabling cache 2024-09-18T01:45:45.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.043+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94650869220848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f6fef30 con 0x56159f6f4370 2024-09-18T01:45:45.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.045+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 66 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94650869220848] v33'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf78081040 con 0x56159f6f4370 2024-09-18T01:45:45.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.045+0000 7fcf92e40800 20 remove_watcher() i=1 2024-09-18T01:45:45.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.045+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94650869222384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f6fef30 con 0x56159f6fa5e0 2024-09-18T01:45:45.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.046+0000 7fcf9113c640 1 -- 172.21.15.146:0/1500841341 <== osd.3 v2:172.21.15.146:6809/4106661138 103 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94650869222384] v33'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf8c03c030 con 0x56159f6fa5e0 2024-09-18T01:45:45.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.046+0000 7fcf92e40800 20 remove_watcher() i=2 2024-09-18T01:45:45.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.046+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94650869226896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f700bf0 con 0x7fcf8c03f060 2024-09-18T01:45:45.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.047+0000 7fcf9093b640 1 -- 172.21.15.146:0/1500841341 <== osd.2 v2:172.21.15.146:6800/3820039304 63 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94650869226896] v33'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf8002d070 con 0x7fcf8c03f060 2024-09-18T01:45:45.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.047+0000 7fcf92e40800 20 remove_watcher() i=3 2024-09-18T01:45:45.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.047+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94650869224400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f6fef30 con 0x56159f6f4370 2024-09-18T01:45:45.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.048+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.1 v2:172.21.15.146:6808/3930274777 67 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94650869224400] v33'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf78081040 con 0x56159f6f4370 2024-09-18T01:45:45.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.048+0000 7fcf92e40800 20 remove_watcher() i=4 2024-09-18T01:45:45.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.048+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94650869235504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f7013d0 con 0x7fcf80048040 2024-09-18T01:45:45.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.049+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 67 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94650869235504] v33'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf78081040 con 0x7fcf80048040 2024-09-18T01:45:45.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.049+0000 7fcf92e40800 20 remove_watcher() i=5 2024-09-18T01:45:45.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.049+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94650869231888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f6fef30 con 0x7fcf80048040 2024-09-18T01:45:45.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.050+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 68 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94650869231888] v33'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf78081040 con 0x7fcf80048040 2024-09-18T01:45:45.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.050+0000 7fcf92e40800 20 remove_watcher() i=6 2024-09-18T01:45:45.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.050+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94650869239328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56159f7013d0 con 0x7fcf80048040 2024-09-18T01:45:45.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.051+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 <== osd.0 v2:172.21.15.129:6800/1759265424 69 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94650869239328] v33'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf78081040 con 0x7fcf80048040 2024-09-18T01:45:45.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.051+0000 7fcf92e40800 20 remove_watcher() i=7 2024-09-18T01:45:45.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.051+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fcf80048040 msgr2=0x7fcf8003f160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.051+0000 7fcf92e40800 1 --2- 172.21.15.146:0/1500841341 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fcf80048040 0x7fcf8003f160 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.051+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56159f6f4370 msgr2=0x56159f6f6830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.051+0000 7fcf92e40800 1 --2- 172.21.15.146:0/1500841341 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56159f6f4370 0x56159f6f6830 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.051+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fcf8c03f060 msgr2=0x7fcf8c0233f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.051+0000 7fcf92e40800 1 --2- 172.21.15.146:0/1500841341 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fcf8c03f060 0x7fcf8c0233f0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.051+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x56159f6fa5e0 msgr2=0x56159f6fc9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.051+0000 7fcf92e40800 1 --2- 172.21.15.146:0/1500841341 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x56159f6fa5e0 0x56159f6fc9d0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.051+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fce5c036b90 msgr2=0x7fce5c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.051+0000 7fcf92e40800 1 --2- 172.21.15.146:0/1500841341 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fce5c036b90 0x7fce5c039050 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fcf8004d210 tx=0x7fcf80032000 comp rx=0 tx=0).stop 2024-09-18T01:45:45.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.051+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56159f6e1280 msgr2=0x56159f6e8710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.051+0000 7fcf92e40800 1 --2- 172.21.15.146:0/1500841341 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56159f6e1280 0x56159f6e8710 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c043040 tx=0x7fcf8c04c820 comp rx=0 tx=0).stop 2024-09-18T01:45:45.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.051+0000 7fcf8813a640 1 -- 172.21.15.146:0/1500841341 reap_dead start 2024-09-18T01:45:45.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.051+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 shutdown_connections 2024-09-18T01:45:45.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.051+0000 7fcf92e40800 1 --2- 172.21.15.146:0/1500841341 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56159f6e1280 0x56159f6e8710 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.051+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 >> 172.21.15.146:0/1500841341 conn(0x56159f6dd5e0 msgr2=0x56159f6db6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:45.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.051+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 shutdown_connections 2024-09-18T01:45:45.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.051+0000 7fcf92e40800 1 -- 172.21.15.146:0/1500841341 wait complete. 2024-09-18T01:45:45.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.052+0000 7fcf92e40800 1 -- 172.21.15.146:0/120038837 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fce68036b40 msgr2=0x7fce68039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.052+0000 7fcf92e40800 1 --2- 172.21.15.146:0/120038837 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fce68036b40 0x7fce68039000 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fcf8001af90 tx=0x7fcf8000fe50 comp rx=0 tx=0).stop 2024-09-18T01:45:45.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.052+0000 7fcf92e40800 1 -- 172.21.15.146:0/120038837 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56159f6d4600 msgr2=0x56159f6d4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.052+0000 7fcf92e40800 1 --2- 172.21.15.146:0/120038837 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56159f6d4600 0x56159f6d4a20 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x56159f6c1230 tx=0x7fcf8c0178e0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.052+0000 7fcf92e40800 1 -- 172.21.15.146:0/120038837 shutdown_connections 2024-09-18T01:45:45.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.052+0000 7fcf92e40800 1 --2- 172.21.15.146:0/120038837 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fce68036b40 0x7fce68039000 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.052+0000 7fcf92e40800 1 --2- 172.21.15.146:0/120038837 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56159f6d4600 0x56159f6d4a20 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.052+0000 7fcf92e40800 1 -- 172.21.15.146:0/120038837 >> 172.21.15.146:0/120038837 conn(0x56159f6c9590 msgr2=0x56159f6cc110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:45.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.052+0000 7fcf92e40800 1 -- 172.21.15.146:0/120038837 shutdown_connections 2024-09-18T01:45:45.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.052+0000 7fcf92e40800 1 -- 172.21.15.146:0/120038837 wait complete. 2024-09-18T01:45:45.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.052+0000 7fcf92e40800 1 -- 172.21.15.146:0/3947033475 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56159f6be520 msgr2=0x56159f6c0910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.052+0000 7fcf92e40800 1 --2- 172.21.15.146:0/3947033475 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56159f6be520 0x56159f6c0910 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.052+0000 7fcf92e40800 1 -- 172.21.15.146:0/3947033475 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x56159f6c2880 msgr2=0x56159f6c6100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.052+0000 7fcf92e40800 1 --2- 172.21.15.146:0/3947033475 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x56159f6c2880 0x56159f6c6100 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.052+0000 7fcf92e40800 1 -- 172.21.15.146:0/3947033475 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fce78036b40 msgr2=0x7fce78039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.052+0000 7fcf92e40800 1 --2- 172.21.15.146:0/3947033475 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fce78036b40 0x7fce78039000 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fcf78057000 tx=0x7fcf78052000 comp rx=0 tx=0).stop 2024-09-18T01:45:45.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.052+0000 7fcf92e40800 1 -- 172.21.15.146:0/3947033475 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56159f5c6da0 msgr2=0x56159f6b94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.052+0000 7fcf92e40800 1 --2- 172.21.15.146:0/3947033475 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56159f5c6da0 0x56159f6b94c0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x56159f6b2670 tx=0x7fcf80000ed0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.052+0000 7fcf92e40800 1 -- 172.21.15.146:0/3947033475 shutdown_connections 2024-09-18T01:45:45.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.052+0000 7fcf92e40800 1 --2- 172.21.15.146:0/3947033475 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x56159f6c2880 0x56159f6c6100 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.052+0000 7fcf92e40800 1 --2- 172.21.15.146:0/3947033475 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56159f6be520 0x56159f6c0910 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.052+0000 7fcf92e40800 1 --2- 172.21.15.146:0/3947033475 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fce78036b40 0x7fce78039000 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.052+0000 7fcf92e40800 1 --2- 172.21.15.146:0/3947033475 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56159f5c6da0 0x56159f6b94c0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.052+0000 7fcf92e40800 1 -- 172.21.15.146:0/3947033475 >> 172.21.15.146:0/3947033475 conn(0x56159f5badd0 msgr2=0x56159f6aba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:45.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.052+0000 7fcf92e40800 1 -- 172.21.15.146:0/3947033475 shutdown_connections 2024-09-18T01:45:45.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.052+0000 7fcf92e40800 1 -- 172.21.15.146:0/3947033475 wait complete. 2024-09-18T01:45:45.062 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-18T01:45:45.063 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-18T01:45:45.063 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-18T01:45:45.145 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:45.145 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:45.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.144+0000 7f1048926800 1 Processor -- start 2024-09-18T01:45:45.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.145+0000 7f1048926800 1 -- start start 2024-09-18T01:45:45.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.145+0000 7f1048926800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55db0c992a50 0x55db0c992e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.145+0000 7f1048926800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55db0c853b30 con 0x55db0c993390 2024-09-18T01:45:45.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.145+0000 7f1048926800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x55db0c835360 con 0x55db0c992a50 2024-09-18T01:45:45.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.145+0000 7f10445e3640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55db0c992a50 0x55db0c992e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.145+0000 7f103bfff640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x55db0c993390 0x55db0c99bef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:45846/0 (socket says 172.21.15.146:45846) 2024-09-18T01:45:45.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.145+0000 7f10445e3640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55db0c992a50 0x55db0c992e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38200/0 (socket says 172.21.15.146:38200) 2024-09-18T01:45:45.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.145+0000 7f103bfff640 1 -- 172.21.15.146:0/1184868643 learned_addr learned my addr 172.21.15.146:0/1184868643 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:45:45.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.145+0000 7f10445e3640 1 -- 172.21.15.146:0/1184868643 >> v1:172.21.15.129:6789/0 conn(0x55db0c993390 legacy=0x55db0c99bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.145+0000 7f10445e3640 1 -- 172.21.15.146:0/1184868643 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db0c85be00 con 0x55db0c992a50 2024-09-18T01:45:45.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.147+0000 7f10445e3640 1 --2- 172.21.15.146:0/1184868643 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db0c992a50 0x55db0c992e50 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f103400a470 tx=0x7f1034045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef34a0ea13920924 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.147+0000 7f1043de2640 1 -- 172.21.15.146:0/1184868643 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1034053570 con 0x55db0c992a50 2024-09-18T01:45:45.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.147+0000 7f1043de2640 1 -- 172.21.15.146:0/1184868643 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1034058070 con 0x55db0c992a50 2024-09-18T01:45:45.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.147+0000 7f1043de2640 1 -- 172.21.15.146:0/1184868643 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1034053880 con 0x55db0c992a50 2024-09-18T01:45:45.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.148+0000 7f1048926800 1 -- 172.21.15.146:0/1184868643 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db0c992a50 msgr2=0x55db0c992e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.148+0000 7f1048926800 1 --2- 172.21.15.146:0/1184868643 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db0c992a50 0x55db0c992e50 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f103400a470 tx=0x7f1034045a20 comp rx=0 tx=0).stop 2024-09-18T01:45:45.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.148+0000 7f1048926800 1 -- 172.21.15.146:0/1184868643 shutdown_connections 2024-09-18T01:45:45.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.148+0000 7f1048926800 1 --2- 172.21.15.146:0/1184868643 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db0c992a50 0x55db0c992e50 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.148+0000 7f1048926800 1 -- 172.21.15.146:0/1184868643 >> 172.21.15.146:0/1184868643 conn(0x55db0c98e5c0 msgr2=0x55db0c9909e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:45.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.148+0000 7f1048926800 1 -- 172.21.15.146:0/1184868643 shutdown_connections 2024-09-18T01:45:45.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.148+0000 7f1048926800 1 -- 172.21.15.146:0/1184868643 wait complete. 2024-09-18T01:45:45.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.162+0000 7f1048926800 1 Processor -- start 2024-09-18T01:45:45.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.162+0000 7f1048926800 1 -- start start 2024-09-18T01:45:45.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.162+0000 7f1048926800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db0c992a50 0x55db0ca85a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.162+0000 7f1048926800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55db0c8e0330 con 0x55db0c992a50 2024-09-18T01:45:45.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.162+0000 7f10445e3640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db0c992a50 0x55db0ca85a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.162+0000 7f10445e3640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db0c992a50 0x55db0ca85a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38208/0 (socket says 172.21.15.146:38208) 2024-09-18T01:45:45.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.162+0000 7f10445e3640 1 -- 172.21.15.146:0/2375425044 learned_addr learned my addr 172.21.15.146:0/2375425044 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:45.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.162+0000 7f10445e3640 1 -- 172.21.15.146:0/2375425044 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db0c82dbc0 con 0x55db0c992a50 2024-09-18T01:45:45.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.163+0000 7f10445e3640 1 --2- 172.21.15.146:0/2375425044 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db0c992a50 0x55db0ca85a70 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f1034025c20 tx=0x7f1034051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d80fc13c848e2c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.163+0000 7f0f3260c640 1 -- 172.21.15.146:0/2375425044 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f103405c580 con 0x55db0c992a50 2024-09-18T01:45:45.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.163+0000 7f0f3260c640 1 -- 172.21.15.146:0/2375425044 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1034063030 con 0x55db0c992a50 2024-09-18T01:45:45.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.163+0000 7f0f3260c640 1 -- 172.21.15.146:0/2375425044 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f103405c850 con 0x55db0c992a50 2024-09-18T01:45:45.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.164+0000 7f1048926800 1 -- 172.21.15.146:0/2375425044 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db0c992a50 msgr2=0x55db0ca85a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.164+0000 7f1048926800 1 --2- 172.21.15.146:0/2375425044 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db0c992a50 0x55db0ca85a70 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f1034025c20 tx=0x7f1034051000 comp rx=0 tx=0).stop 2024-09-18T01:45:45.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.164+0000 7f1048926800 1 -- 172.21.15.146:0/2375425044 shutdown_connections 2024-09-18T01:45:45.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.164+0000 7f1048926800 1 --2- 172.21.15.146:0/2375425044 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db0c992a50 0x55db0ca85a70 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.164+0000 7f1048926800 1 -- 172.21.15.146:0/2375425044 >> 172.21.15.146:0/2375425044 conn(0x55db0c98e5c0 msgr2=0x55db0ca81430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:45.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.164+0000 7f1048926800 1 -- 172.21.15.146:0/2375425044 shutdown_connections 2024-09-18T01:45:45.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.164+0000 7f1048926800 1 -- 172.21.15.146:0/2375425044 wait complete. 2024-09-18T01:45:45.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.164+0000 7f1048926800 1 Processor -- start 2024-09-18T01:45:45.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.164+0000 7f1048926800 1 -- start start 2024-09-18T01:45:45.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.164+0000 7f1048926800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db0c992a50 0x55db0ca8d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.164+0000 7f1048926800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55db0c99d910 con 0x55db0c992a50 2024-09-18T01:45:45.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.164+0000 7f10445e3640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db0c992a50 0x55db0ca8d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.164+0000 7f10445e3640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db0c992a50 0x55db0ca8d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38212/0 (socket says 172.21.15.146:38212) 2024-09-18T01:45:45.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.164+0000 7f10445e3640 1 -- 172.21.15.146:0/2804669582 learned_addr learned my addr 172.21.15.146:0/2804669582 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:45.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.164+0000 7f10445e3640 1 -- 172.21.15.146:0/2804669582 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db0c841fe0 con 0x55db0c992a50 2024-09-18T01:45:45.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.165+0000 7f10445e3640 1 --2- 172.21.15.146:0/2804669582 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db0c992a50 0x55db0ca8d3b0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f103400a330 tx=0x7f1034002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.165+0000 7f0f30e09640 1 -- 172.21.15.146:0/2804669582 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f103406c030 con 0x55db0c992a50 2024-09-18T01:45:45.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.165+0000 7f0f30e09640 1 -- 172.21.15.146:0/2804669582 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f103405c580 con 0x55db0c992a50 2024-09-18T01:45:45.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.165+0000 7f0f30e09640 1 -- 172.21.15.146:0/2804669582 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f103405c880 con 0x55db0c992a50 2024-09-18T01:45:45.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.165+0000 7f1048926800 1 -- 172.21.15.146:0/2804669582 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55db0ca8d8f0 con 0x55db0c992a50 2024-09-18T01:45:45.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.165+0000 7f1048926800 1 -- 172.21.15.146:0/2804669582 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db0ca8de70 con 0x55db0c992a50 2024-09-18T01:45:45.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.166+0000 7f0f30e09640 1 -- 172.21.15.146:0/2804669582 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1034053440 con 0x55db0c992a50 2024-09-18T01:45:45.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.166+0000 7f0f30e09640 1 --2- 172.21.15.146:0/2804669582 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0f2c036ce0 0x7f0f2c0391a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.166+0000 7f0f30e09640 1 -- 172.21.15.146:0/2804669582 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f1034070020 con 0x55db0c992a50 2024-09-18T01:45:45.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.166+0000 7f103bfff640 1 --2- 172.21.15.146:0/2804669582 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0f2c036ce0 0x7f0f2c0391a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.166+0000 7f1048926800 1 --2- 172.21.15.146:0/2804669582 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55db0c993390 0x55db0ca94420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.166+0000 7f1048926800 1 -- 172.21.15.146:0/2804669582 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0ca94960 con 0x55db0c993390 2024-09-18T01:45:45.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.166+0000 7f1044de4640 1 --2- 172.21.15.146:0/2804669582 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55db0c993390 0x55db0ca94420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.166+0000 7f103bfff640 1 --2- 172.21.15.146:0/2804669582 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0f2c036ce0 0x7f0f2c0391a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f102c000f60 tx=0x7f102c0012b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.166+0000 7f1044de4640 1 --2- 172.21.15.146:0/2804669582 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55db0c993390 0x55db0ca94420 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.167+0000 7f1044de4640 1 -- 172.21.15.146:0/2804669582 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f103c00a4a0 con 0x55db0c993390 2024-09-18T01:45:45.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.167+0000 7f1048926800 1 -- 172.21.15.146:0/2804669582 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0ca919f0 con 0x55db0c993390 2024-09-18T01:45:45.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.167+0000 7f1044de4640 1 -- 172.21.15.146:0/2804669582 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f103c00a4a0 con 0x55db0c993390 2024-09-18T01:45:45.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.167+0000 7f1048926800 1 -- 172.21.15.146:0/2804669582 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0ca967a0 con 0x55db0c993390 2024-09-18T01:45:45.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.167+0000 7f1044de4640 1 -- 172.21.15.146:0/2804669582 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f103c00a4a0 con 0x55db0c993390 2024-09-18T01:45:45.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.167+0000 7f1048926800 1 -- 172.21.15.146:0/2804669582 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0ca958e0 con 0x55db0c993390 2024-09-18T01:45:45.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.168+0000 7f1044de4640 1 -- 172.21.15.146:0/2804669582 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f103c00a4a0 con 0x55db0c993390 2024-09-18T01:45:45.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.168+0000 7f1048926800 1 --2- 172.21.15.146:0/2804669582 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55db0ca963b0 0x55db0ca99bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.168+0000 7f1048926800 1 -- 172.21.15.146:0/2804669582 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0ca9a380 con 0x55db0ca963b0 2024-09-18T01:45:45.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.168+0000 7f10445e3640 1 --2- 172.21.15.146:0/2804669582 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55db0ca963b0 0x55db0ca99bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.168+0000 7f10445e3640 1 --2- 172.21.15.146:0/2804669582 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55db0ca963b0 0x55db0ca99bf0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.168+0000 7f10445e3640 1 -- 172.21.15.146:0/2804669582 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f103407b070 con 0x55db0ca963b0 2024-09-18T01:45:45.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.169+0000 7f1048926800 1 Processor -- start 2024-09-18T01:45:45.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.169+0000 7f1048926800 1 -- start start 2024-09-18T01:45:45.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.169+0000 7f1048926800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db0caa8090 0x55db0caa84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.169+0000 7f1048926800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55db0c82f580 con 0x55db0caa8090 2024-09-18T01:45:45.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.169+0000 7f1044de4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db0caa8090 0x55db0caa84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.169+0000 7f1044de4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db0caa8090 0x55db0caa84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38226/0 (socket says 172.21.15.146:38226) 2024-09-18T01:45:45.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.169+0000 7f1044de4640 1 -- 172.21.15.146:0/3430266024 learned_addr learned my addr 172.21.15.146:0/3430266024 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:45.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.169+0000 7f1044de4640 1 -- 172.21.15.146:0/3430266024 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db0caa89f0 con 0x55db0caa8090 2024-09-18T01:45:45.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.170+0000 7f1044de4640 1 --2- 172.21.15.146:0/3430266024 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db0caa8090 0x55db0caa84b0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x55db0ca94d60 tx=0x7f103c0178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.170+0000 7f0f29ffb640 1 -- 172.21.15.146:0/3430266024 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f103c013440 con 0x55db0caa8090 2024-09-18T01:45:45.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.170+0000 7f0f29ffb640 1 -- 172.21.15.146:0/3430266024 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f103c0135e0 con 0x55db0caa8090 2024-09-18T01:45:45.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.170+0000 7f1048926800 1 -- 172.21.15.146:0/3430266024 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55db0caa8c80 con 0x55db0caa8090 2024-09-18T01:45:45.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.170+0000 7f0f29ffb640 1 -- 172.21.15.146:0/3430266024 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f103c0138c0 con 0x55db0caa8090 2024-09-18T01:45:45.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.170+0000 7f1048926800 1 -- 172.21.15.146:0/3430266024 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db0caab960 con 0x55db0caa8090 2024-09-18T01:45:45.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.171+0000 7f0f29ffb640 1 -- 172.21.15.146:0/3430266024 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f103c011040 con 0x55db0caa8090 2024-09-18T01:45:45.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.171+0000 7f0f29ffb640 1 --2- 172.21.15.146:0/3430266024 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0f1c036b90 0x7f0f1c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.171+0000 7f0f29ffb640 1 -- 172.21.15.146:0/3430266024 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f103c01d070 con 0x55db0caa8090 2024-09-18T01:45:45.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.171+0000 7f10445e3640 1 --2- 172.21.15.146:0/3430266024 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0f1c036b90 0x7f0f1c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.171+0000 7f1048926800 1 Processor -- start 2024-09-18T01:45:45.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.171+0000 7f10445e3640 1 --2- 172.21.15.146:0/3430266024 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0f1c036b90 0x7f0f1c039050 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1034008370 tx=0x7f1034067a10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.171+0000 7f1048926800 1 -- start start 2024-09-18T01:45:45.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.171+0000 7f1048926800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db0cab4cf0 0x55db0cab50f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.171+0000 7f1048926800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55db0ca861c0 con 0x55db0cab4cf0 2024-09-18T01:45:45.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.172+0000 7f1044de4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db0cab4cf0 0x55db0cab50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.172+0000 7f1044de4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db0cab4cf0 0x55db0cab50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38230/0 (socket says 172.21.15.146:38230) 2024-09-18T01:45:45.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.172+0000 7f1044de4640 1 -- 172.21.15.146:0/2554454190 learned_addr learned my addr 172.21.15.146:0/2554454190 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:45.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.172+0000 7f1044de4640 1 -- 172.21.15.146:0/2554454190 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db0cab56c0 con 0x55db0cab4cf0 2024-09-18T01:45:45.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.172+0000 7f1044de4640 1 --2- 172.21.15.146:0/2554454190 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db0cab4cf0 0x55db0cab50f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f103c04c860 tx=0x7f103c04cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54eac7ccb01d05f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.172+0000 7f0f237fe640 1 -- 172.21.15.146:0/2554454190 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f103c012c90 con 0x55db0cab4cf0 2024-09-18T01:45:45.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.172+0000 7f0f237fe640 1 -- 172.21.15.146:0/2554454190 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f103c012e30 con 0x55db0cab4cf0 2024-09-18T01:45:45.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.172+0000 7f0f237fe640 1 -- 172.21.15.146:0/2554454190 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f103c0124d0 con 0x55db0cab4cf0 2024-09-18T01:45:45.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.172+0000 7f1048926800 1 -- 172.21.15.146:0/2554454190 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db0cab4cf0 msgr2=0x55db0cab50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.172+0000 7f1048926800 1 --2- 172.21.15.146:0/2554454190 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db0cab4cf0 0x55db0cab50f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f103c04c860 tx=0x7f103c04cb10 comp rx=0 tx=0).stop 2024-09-18T01:45:45.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.173+0000 7f1048926800 1 -- 172.21.15.146:0/2554454190 shutdown_connections 2024-09-18T01:45:45.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.173+0000 7f1048926800 1 --2- 172.21.15.146:0/2554454190 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db0cab4cf0 0x55db0cab50f0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.173+0000 7f1048926800 1 -- 172.21.15.146:0/2554454190 >> 172.21.15.146:0/2554454190 conn(0x55db0cab1090 msgr2=0x55db0caaf190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:45.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.173+0000 7f1048926800 1 -- 172.21.15.146:0/2554454190 shutdown_connections 2024-09-18T01:45:45.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.173+0000 7f1048926800 1 -- 172.21.15.146:0/2554454190 wait complete. 2024-09-18T01:45:45.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.173+0000 7f1048926800 1 Processor -- start 2024-09-18T01:45:45.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.173+0000 7f1048926800 1 -- start start 2024-09-18T01:45:45.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.173+0000 7f1048926800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db0cab4cf0 0x55db0cabc190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.173+0000 7f1048926800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55db0cab5ce0 con 0x55db0cab4cf0 2024-09-18T01:45:45.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.173+0000 7f1044de4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db0cab4cf0 0x55db0cabc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.173+0000 7f1044de4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db0cab4cf0 0x55db0cabc190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38238/0 (socket says 172.21.15.146:38238) 2024-09-18T01:45:45.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.173+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 learned_addr learned my addr 172.21.15.146:0/2148743496 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:45.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.173+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db0cabc6d0 con 0x55db0cab4cf0 2024-09-18T01:45:45.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.174+0000 7f1044de4640 1 --2- 172.21.15.146:0/2148743496 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db0cab4cf0 0x55db0cabc190 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f103c015fd0 tx=0x7f103c04c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.174+0000 7f0f21ffb640 1 -- 172.21.15.146:0/2148743496 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f103c012c90 con 0x55db0cab4cf0 2024-09-18T01:45:45.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.174+0000 7f0f21ffb640 1 -- 172.21.15.146:0/2148743496 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f103c001520 con 0x55db0cab4cf0 2024-09-18T01:45:45.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.174+0000 7f0f21ffb640 1 -- 172.21.15.146:0/2148743496 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f103c001c30 con 0x55db0cab4cf0 2024-09-18T01:45:45.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.174+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55db0cabc960 con 0x55db0cab4cf0 2024-09-18T01:45:45.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.174+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db0cabf610 con 0x55db0cab4cf0 2024-09-18T01:45:45.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.174+0000 7f0f21ffb640 1 -- 172.21.15.146:0/2148743496 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f103c013b90 con 0x55db0cab4cf0 2024-09-18T01:45:45.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.175+0000 7f0f21ffb640 1 --2- 172.21.15.146:0/2148743496 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0f14036b90 0x7f0f14039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.175+0000 7f0f21ffb640 1 -- 172.21.15.146:0/2148743496 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f103c00e040 con 0x55db0cab4cf0 2024-09-18T01:45:45.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.175+0000 7f10445e3640 1 --2- 172.21.15.146:0/2148743496 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0f14036b90 0x7f0f14039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.175+0000 7f1048926800 20 rados->read ofs=0 len=0 2024-09-18T01:45:45.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.175+0000 7f1048926800 1 --2- 172.21.15.146:0/2148743496 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55db0cac7e00 0x55db0caca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.175+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0caca9c0 con 0x55db0cac7e00 2024-09-18T01:45:45.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.175+0000 7f103bfff640 1 --2- 172.21.15.146:0/2148743496 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55db0cac7e00 0x55db0caca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.175+0000 7f10445e3640 1 --2- 172.21.15.146:0/2148743496 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0f14036b90 0x7f0f14039050 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1034045ed0 tx=0x7f1034083000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.176+0000 7f103bfff640 1 --2- 172.21.15.146:0/2148743496 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55db0cac7e00 0x55db0caca2c0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.176+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f102c009050 con 0x55db0cac7e00 2024-09-18T01:45:45.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.176+0000 7f1048926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:45.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.176+0000 7f1048926800 20 realm 2024-09-18T01:45:45.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.176+0000 7f1048926800 20 rados->read ofs=0 len=0 2024-09-18T01:45:45.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.176+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cac72a0 con 0x55db0cac7e00 2024-09-18T01:45:45.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.176+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f102c009050 con 0x55db0cac7e00 2024-09-18T01:45:45.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.176+0000 7f1048926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:45.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.176+0000 7f1048926800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:45.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.176+0000 7f1048926800 20 rados->read ofs=0 len=0 2024-09-18T01:45:45.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.176+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cacb4a0 con 0x55db0cac7e00 2024-09-18T01:45:45.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.176+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f102c009050 con 0x55db0cac7e00 2024-09-18T01:45:45.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.176+0000 7f1048926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:45.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.176+0000 7f1048926800 20 rados->read ofs=0 len=0 2024-09-18T01:45:45.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.176+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cacbd70 con 0x55db0cac7e00 2024-09-18T01:45:45.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.176+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f102c009050 con 0x55db0cac7e00 2024-09-18T01:45:45.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.176+0000 7f1048926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:45.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.176+0000 7f1048926800 20 rados->read ofs=0 len=0 2024-09-18T01:45:45.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.176+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cacc110 con 0x55db0cac7e00 2024-09-18T01:45:45.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.177+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f102c009050 con 0x55db0cac7e00 2024-09-18T01:45:45.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.177+0000 7f1048926800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:45.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.177+0000 7f1048926800 20 searching for the correct realm 2024-09-18T01:45:45.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.177+0000 7f1048926800 1 --2- 172.21.15.146:0/2148743496 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55db0cacdff0 0x55db0cad03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.177+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad0a90 con 0x55db0cacdff0 2024-09-18T01:45:45.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.177+0000 7f1044de4640 1 --2- 172.21.15.146:0/2148743496 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55db0cacdff0 0x55db0cad03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.177+0000 7f1044de4640 1 --2- 172.21.15.146:0/2148743496 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55db0cacdff0 0x55db0cad03e0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.177+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f103c035070 con 0x55db0cacdff0 2024-09-18T01:45:45.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.177+0000 7f1044de4640 1 --2- 172.21.15.146:0/2148743496 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f103c022420 0x7f103c02aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.177+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad0a90 con 0x7f103c022420 2024-09-18T01:45:45.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.178+0000 7f10445e3640 1 --2- 172.21.15.146:0/2148743496 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f103c022420 0x7f103c02aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.178+0000 7f10445e3640 1 --2- 172.21.15.146:0/2148743496 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f103c022420 0x7f103c02aa60 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.178+0000 7f10445e3640 1 -- 172.21.15.146:0/2148743496 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1034099070 con 0x7f103c022420 2024-09-18T01:45:45.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.178+0000 7f10445e3640 1 --2- 172.21.15.146:0/2148743496 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f103405c070 0x7f1034090300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.178+0000 7f10445e3640 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad0a90 con 0x7f103405c070 2024-09-18T01:45:45.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.178+0000 7f103bfff640 1 --2- 172.21.15.146:0/2148743496 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f103405c070 0x7f1034090300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.179+0000 7f103bfff640 1 --2- 172.21.15.146:0/2148743496 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f103405c070 0x7f1034090300 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.179+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f102c009050 con 0x7f103405c070 2024-09-18T01:45:45.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.179+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad0a90 con 0x55db0cac7e00 2024-09-18T01:45:45.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.179+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f102c009050 con 0x55db0cac7e00 2024-09-18T01:45:45.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.179+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad0a90 con 0x55db0cac7e00 2024-09-18T01:45:45.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.179+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f102c009050 con 0x55db0cac7e00 2024-09-18T01:45:45.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.179+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad0a90 con 0x7f103405c070 2024-09-18T01:45:45.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.179+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f102c009050 con 0x7f103405c070 2024-09-18T01:45:45.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.180+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad0a90 con 0x7f103405c070 2024-09-18T01:45:45.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.180+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f102c009050 con 0x7f103405c070 2024-09-18T01:45:45.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.180+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad0a90 con 0x7f103c022420 2024-09-18T01:45:45.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.180+0000 7f10445e3640 1 -- 172.21.15.146:0/2148743496 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1034099070 con 0x7f103c022420 2024-09-18T01:45:45.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.180+0000 7f10445e3640 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad0a90 con 0x55db0cacdff0 2024-09-18T01:45:45.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.180+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.180+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad0a90 con 0x55db0cac7e00 2024-09-18T01:45:45.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.180+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f102c009050 con 0x55db0cac7e00 2024-09-18T01:45:45.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.180+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad0a90 con 0x7f103405c070 2024-09-18T01:45:45.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.181+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f102c009050 con 0x7f103405c070 2024-09-18T01:45:45.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.181+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad0a90 con 0x55db0cac7e00 2024-09-18T01:45:45.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.181+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f102c009050 con 0x55db0cac7e00 2024-09-18T01:45:45.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.181+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad0a90 con 0x7f103c022420 2024-09-18T01:45:45.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.181+0000 7f10445e3640 1 -- 172.21.15.146:0/2148743496 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f1034099070 con 0x7f103c022420 2024-09-18T01:45:45.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.181+0000 7f10445e3640 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad0a90 con 0x55db0cacdff0 2024-09-18T01:45:45.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.181+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.181+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad0a90 con 0x55db0cacdff0 2024-09-18T01:45:45.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.182+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.182+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad0a90 con 0x7f103405c070 2024-09-18T01:45:45.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.182+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f102c009050 con 0x7f103405c070 2024-09-18T01:45:45.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.182+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad0a90 con 0x55db0cacdff0 2024-09-18T01:45:45.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.182+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.182+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad0a90 con 0x55db0cacdff0 2024-09-18T01:45:45.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.182+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.182+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad0a90 con 0x55db0cac7e00 2024-09-18T01:45:45.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.182+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f102c009050 con 0x55db0cac7e00 2024-09-18T01:45:45.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.182+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad0a90 con 0x55db0cac7e00 2024-09-18T01:45:45.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.183+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f102c009050 con 0x55db0cac7e00 2024-09-18T01:45:45.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.183+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad0a90 con 0x7f103405c070 2024-09-18T01:45:45.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.183+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f102c009050 con 0x7f103405c070 2024-09-18T01:45:45.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.183+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad0a90 con 0x55db0cacdff0 2024-09-18T01:45:45.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.183+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.183+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad0a90 con 0x7f103c022420 2024-09-18T01:45:45.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.184+0000 7f10445e3640 1 -- 172.21.15.146:0/2148743496 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1034099070 con 0x7f103c022420 2024-09-18T01:45:45.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.184+0000 7f10445e3640 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad0a90 con 0x55db0cac7e00 2024-09-18T01:45:45.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.184+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f102c009050 con 0x55db0cac7e00 2024-09-18T01:45:45.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.184+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad0a90 con 0x7f103405c070 2024-09-18T01:45:45.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.184+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f102c009050 con 0x7f103405c070 2024-09-18T01:45:45.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.184+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad0a90 con 0x55db0cacdff0 2024-09-18T01:45:45.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.184+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.184+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad0a90 con 0x7f103405c070 2024-09-18T01:45:45.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.185+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f102c009050 con 0x7f103405c070 2024-09-18T01:45:45.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.185+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad0a90 con 0x7f103c022420 2024-09-18T01:45:45.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.185+0000 7f10445e3640 1 -- 172.21.15.146:0/2148743496 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1034099070 con 0x7f103c022420 2024-09-18T01:45:45.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.185+0000 7f10445e3640 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad0a90 con 0x55db0cacdff0 2024-09-18T01:45:45.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.185+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.185+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad0a90 con 0x7f103405c070 2024-09-18T01:45:45.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.185+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f102c009050 con 0x7f103405c070 2024-09-18T01:45:45.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.185+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad0a90 con 0x55db0cac7e00 2024-09-18T01:45:45.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.186+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f102c009050 con 0x55db0cac7e00 2024-09-18T01:45:45.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.186+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad0a90 con 0x7f103c022420 2024-09-18T01:45:45.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.186+0000 7f10445e3640 1 -- 172.21.15.146:0/2148743496 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1034099070 con 0x7f103c022420 2024-09-18T01:45:45.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.186+0000 7f1048926800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:45.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.186+0000 7f1048926800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:45.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.186+0000 7f1048926800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:45.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.186+0000 7f1048926800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:45.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.186+0000 7f1048926800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:45.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.186+0000 7f1048926800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:45.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.186+0000 7f1048926800 20 rados->read ofs=0 len=0 2024-09-18T01:45:45.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.186+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0caccac0 con 0x55db0cac7e00 2024-09-18T01:45:45.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.186+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f102c009050 con 0x55db0cac7e00 2024-09-18T01:45:45.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.186+0000 7f1048926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:45.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.186+0000 7f1048926800 20 rados->read ofs=0 len=0 2024-09-18T01:45:45.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.186+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cacd360 con 0x55db0cac7e00 2024-09-18T01:45:45.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.186+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f102c009050 con 0x55db0cac7e00 2024-09-18T01:45:45.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.186+0000 7f1048926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:45.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.186+0000 7f1048926800 20 rados->read ofs=0 len=0 2024-09-18T01:45:45.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.186+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cacc700 con 0x7f103c022420 2024-09-18T01:45:45.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.187+0000 7f10445e3640 1 -- 172.21.15.146:0/2148743496 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1034099070 con 0x7f103c022420 2024-09-18T01:45:45.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.187+0000 7f1048926800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:45.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.187+0000 7f1048926800 20 zone default found 2024-09-18T01:45:45.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.187+0000 7f1048926800 4 Realm: () 2024-09-18T01:45:45.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.187+0000 7f1048926800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:45.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.187+0000 7f1048926800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:45.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.187+0000 7f1048926800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:45.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.187+0000 7f1048926800 20 zonegroup default 2024-09-18T01:45:45.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.187+0000 7f1048926800 20 rados->read ofs=0 len=0 2024-09-18T01:45:45.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.187+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad13c0 con 0x7f103405c070 2024-09-18T01:45:45.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.187+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f102c009050 con 0x7f103405c070 2024-09-18T01:45:45.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.187+0000 7f1048926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:45.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.187+0000 7f1048926800 20 rados->read ofs=0 len=0 2024-09-18T01:45:45.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.187+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad2f20 con 0x55db0cacdff0 2024-09-18T01:45:45.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.187+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.187+0000 7f1048926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:45.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.187+0000 7f1048926800 20 rados->read ofs=0 len=0 2024-09-18T01:45:45.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.187+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad3440 con 0x55db0cacdff0 2024-09-18T01:45:45.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.187+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.187+0000 7f1048926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:45.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.188+0000 7f1048926800 20 started sync module instance, tier type = 2024-09-18T01:45:45.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.188+0000 7f1048926800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:45.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.188+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad1e20 con 0x7f103c022420 2024-09-18T01:45:45.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.189+0000 7f10445e3640 1 -- 172.21.15.146:0/2148743496 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v33'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1034099070 con 0x7f103c022420 2024-09-18T01:45:45.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.189+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94399298871824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad3d50 con 0x7f103c022420 2024-09-18T01:45:45.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.189+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad45a0 con 0x55db0cac7e00 2024-09-18T01:45:45.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.190+0000 7f10445e3640 1 -- 172.21.15.146:0/2148743496 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94399298871824] v33'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1034099070 con 0x7f103c022420 2024-09-18T01:45:45.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.190+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v33'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f102c009050 con 0x55db0cac7e00 2024-09-18T01:45:45.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.190+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94399298877600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad45a0 con 0x55db0cac7e00 2024-09-18T01:45:45.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.190+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad5040 con 0x55db0cacdff0 2024-09-18T01:45:45.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.191+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94399298877600] v33'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f102c009050 con 0x55db0cac7e00 2024-09-18T01:45:45.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.191+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v33'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.191+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94399298882352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad5000 con 0x55db0cacdff0 2024-09-18T01:45:45.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.191+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad5ac0 con 0x7f103c022420 2024-09-18T01:45:45.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.192+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94399298882352] v33'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.192+0000 7f10445e3640 1 -- 172.21.15.146:0/2148743496 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v33'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1034099070 con 0x7f103c022420 2024-09-18T01:45:45.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.193+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94399298885104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad5ee0 con 0x7f103c022420 2024-09-18T01:45:45.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.193+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad68e0 con 0x55db0cac7e00 2024-09-18T01:45:45.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.194+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v33'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f102c009050 con 0x55db0cac7e00 2024-09-18T01:45:45.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.194+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94399298888688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad68b0 con 0x55db0cac7e00 2024-09-18T01:45:45.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.194+0000 7f10445e3640 1 -- 172.21.15.146:0/2148743496 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94399298885104] v33'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1034099070 con 0x7f103c022420 2024-09-18T01:45:45.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.194+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad40f0 con 0x7f103405c070 2024-09-18T01:45:45.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.195+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v33'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f102c009050 con 0x7f103405c070 2024-09-18T01:45:45.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.195+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94399298892704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad7890 con 0x7f103405c070 2024-09-18T01:45:45.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.195+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad8250 con 0x7f103405c070 2024-09-18T01:45:45.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.195+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94399298888688] v33'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f102c009050 con 0x55db0cac7e00 2024-09-18T01:45:45.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.196+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94399298892704] v33'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f102c009050 con 0x7f103405c070 2024-09-18T01:45:45.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.196+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v33'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f102c009050 con 0x7f103405c070 2024-09-18T01:45:45.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.196+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94399298891008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad7da0 con 0x7f103405c070 2024-09-18T01:45:45.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.196+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad8760 con 0x7f103405c070 2024-09-18T01:45:45.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.197+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94399298891008] v33'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f102c009050 con 0x7f103405c070 2024-09-18T01:45:45.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.197+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v33'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f102c009050 con 0x7f103405c070 2024-09-18T01:45:45.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.197+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94399298879728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad8760 con 0x7f103405c070 2024-09-18T01:45:45.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.197+0000 7f1048926800 20 add_watcher() i=0 2024-09-18T01:45:45.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.197+0000 7f1048926800 20 add_watcher() i=1 2024-09-18T01:45:45.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.197+0000 7f1048926800 20 add_watcher() i=2 2024-09-18T01:45:45.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.197+0000 7f1048926800 20 add_watcher() i=3 2024-09-18T01:45:45.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.197+0000 7f1048926800 20 add_watcher() i=4 2024-09-18T01:45:45.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.197+0000 7f1048926800 20 add_watcher() i=5 2024-09-18T01:45:45.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.197+0000 7f1048926800 20 add_watcher() i=6 2024-09-18T01:45:45.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.198+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94399298879728] v33'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f102c009050 con 0x7f103405c070 2024-09-18T01:45:45.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.198+0000 7f1048926800 20 add_watcher() i=7 2024-09-18T01:45:45.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.198+0000 7f1048926800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:45.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.198+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cadbb60 con 0x55db0cac7e00 2024-09-18T01:45:45.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.198+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f102c009050 con 0x55db0cac7e00 2024-09-18T01:45:45.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.198+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94399298897024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad9020 con 0x55db0cac7e00 2024-09-18T01:45:45.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.199+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94399298897024] v33'174 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f102c009050 con 0x55db0cac7e00 2024-09-18T01:45:45.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.199+0000 7f0efafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:45.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.199+0000 7f1048926800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:45.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.199+0000 7f1048926800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:45.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.200+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cadb710 con 0x55db0cac7e00 2024-09-18T01:45:45.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.201+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'53 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f102c009050 con 0x55db0cac7e00 2024-09-18T01:45:45.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.201+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cadb680 con 0x7f103405c070 2024-09-18T01:45:45.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.202+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f102c009050 con 0x7f103405c070 2024-09-18T01:45:45.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.202+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae4d60 con 0x55db0cacdff0 2024-09-18T01:45:45.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.203+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.203+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae5180 con 0x55db0cac7e00 2024-09-18T01:45:45.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.204+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'175 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f102c009050 con 0x55db0cac7e00 2024-09-18T01:45:45.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.204+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae5160 con 0x7f103c022420 2024-09-18T01:45:45.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.205+0000 7f10445e3640 1 -- 172.21.15.146:0/2148743496 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'62 uv57 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1034099070 con 0x7f103c022420 2024-09-18T01:45:45.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.205+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae56f0 con 0x55db0cacdff0 2024-09-18T01:45:45.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.206+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'53 uv50 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.206+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae56f0 con 0x55db0cac7e00 2024-09-18T01:45:45.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.207+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f102c009050 con 0x55db0cac7e00 2024-09-18T01:45:45.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.207+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cadb600 con 0x7f103405c070 2024-09-18T01:45:45.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.209+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'43 uv40 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f102c009050 con 0x7f103405c070 2024-09-18T01:45:45.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.209+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cadb600 con 0x7f103c022420 2024-09-18T01:45:45.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.210+0000 7f10445e3640 1 -- 172.21.15.146:0/2148743496 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1034099070 con 0x7f103c022420 2024-09-18T01:45:45.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.210+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae5cf0 con 0x55db0cacdff0 2024-09-18T01:45:45.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.211+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.211+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae5cf0 con 0x7f103c022420 2024-09-18T01:45:45.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.212+0000 7f10445e3640 1 -- 172.21.15.146:0/2148743496 <== osd.2 v2:172.21.15.146:6800/3820039304 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'63 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1034099070 con 0x7f103c022420 2024-09-18T01:45:45.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.212+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae5cf0 con 0x7f103405c070 2024-09-18T01:45:45.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.213+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f102c009050 con 0x7f103405c070 2024-09-18T01:45:45.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.213+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae5cf0 con 0x7f103c022420 2024-09-18T01:45:45.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.214+0000 7f10445e3640 1 -- 172.21.15.146:0/2148743496 <== osd.2 v2:172.21.15.146:6800/3820039304 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1034099070 con 0x7f103c022420 2024-09-18T01:45:45.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.214+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae5cf0 con 0x7f103405c070 2024-09-18T01:45:45.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.215+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'55 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f102c009050 con 0x7f103405c070 2024-09-18T01:45:45.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.215+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae5cf0 con 0x55db0cac7e00 2024-09-18T01:45:45.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.216+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'176 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f102c009050 con 0x55db0cac7e00 2024-09-18T01:45:45.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.216+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae5cf0 con 0x55db0cacdff0 2024-09-18T01:45:45.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.217+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'56 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.217+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae5cf0 con 0x7f103c022420 2024-09-18T01:45:45.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.218+0000 7f10445e3640 1 -- 172.21.15.146:0/2148743496 <== osd.2 v2:172.21.15.146:6800/3820039304 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'64 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1034099070 con 0x7f103c022420 2024-09-18T01:45:45.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.218+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae5cf0 con 0x55db0cacdff0 2024-09-18T01:45:45.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.219+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'35 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.219+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae5cf0 con 0x55db0cac7e00 2024-09-18T01:45:45.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.221+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f102c009050 con 0x55db0cac7e00 2024-09-18T01:45:45.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.221+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae5cf0 con 0x55db0cac7e00 2024-09-18T01:45:45.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.222+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'177 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f102c009050 con 0x55db0cac7e00 2024-09-18T01:45:45.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.222+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae5cf0 con 0x55db0cacdff0 2024-09-18T01:45:45.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.223+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'57 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.223+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae5cf0 con 0x7f103c022420 2024-09-18T01:45:45.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.224+0000 7f10445e3640 1 -- 172.21.15.146:0/2148743496 <== osd.2 v2:172.21.15.146:6800/3820039304 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'38 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1034099070 con 0x7f103c022420 2024-09-18T01:45:45.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.224+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae5cf0 con 0x55db0cacdff0 2024-09-18T01:45:45.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.225+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.225+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae5cf0 con 0x55db0cacdff0 2024-09-18T01:45:45.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.226+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'40 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.226+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae5cf0 con 0x55db0cacdff0 2024-09-18T01:45:45.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.226+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.226+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae5cf0 con 0x55db0cacdff0 2024-09-18T01:45:45.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.227+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'54 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.227+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae5cf0 con 0x7f103405c070 2024-09-18T01:45:45.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.229+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'31 uv30 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f102c009050 con 0x7f103405c070 2024-09-18T01:45:45.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.229+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae5cf0 con 0x55db0cacdff0 2024-09-18T01:45:45.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.230+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'34 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.230+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae5cf0 con 0x7f103405c070 2024-09-18T01:45:45.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.231+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.0 v2:172.21.15.129:6800/1759265424 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'44 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f102c009050 con 0x7f103405c070 2024-09-18T01:45:45.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.231+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae5cf0 con 0x55db0cacdff0 2024-09-18T01:45:45.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.232+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'58 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.232+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae5cf0 con 0x7f103405c070 2024-09-18T01:45:45.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.233+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.0 v2:172.21.15.129:6800/1759265424 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'56 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f102c009050 con 0x7f103405c070 2024-09-18T01:45:45.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.233+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae5cf0 con 0x7f103c022420 2024-09-18T01:45:45.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.234+0000 7f10445e3640 1 -- 172.21.15.146:0/2148743496 <== osd.2 v2:172.21.15.146:6800/3820039304 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1034099070 con 0x7f103c022420 2024-09-18T01:45:45.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.235+0000 7f0ef9fe3640 20 reqs_thread_entry: start 2024-09-18T01:45:45.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.235+0000 7f1048926800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:45.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.235+0000 7f1048926800 20 Filter name: none 2024-09-18T01:45:45.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.235+0000 7f0ef2ffd640 20 reqs_thread_entry: start 2024-09-18T01:45:45.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.235+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x55db0cac7e00 2024-09-18T01:45:45.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.235+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.1 v2:172.21.15.146:6808/3930274777 28 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv52 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f102c009050 con 0x55db0cac7e00 2024-09-18T01:45:45.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.235+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x55db0cac7e00 2024-09-18T01:45:45.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.236+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.1 v2:172.21.15.146:6808/3930274777 29 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv52 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f102c009050 con 0x55db0cac7e00 2024-09-18T01:45:45.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.236+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x55db0cac7e00 2024-09-18T01:45:45.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.236+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.1 v2:172.21.15.146:6808/3930274777 30 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv52 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f102c009050 con 0x55db0cac7e00 2024-09-18T01:45:45.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.236+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x7f103405c070 2024-09-18T01:45:45.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.236+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.0 v2:172.21.15.129:6800/1759265424 24 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f102c009050 con 0x7f103405c070 2024-09-18T01:45:45.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.236+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x7f103405c070 2024-09-18T01:45:45.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.237+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.0 v2:172.21.15.129:6800/1759265424 25 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f102c009050 con 0x7f103405c070 2024-09-18T01:45:45.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.237+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x7f103405c070 2024-09-18T01:45:45.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.237+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.0 v2:172.21.15.129:6800/1759265424 26 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f102c009050 con 0x7f103405c070 2024-09-18T01:45:45.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.237+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x55db0cacdff0 2024-09-18T01:45:45.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.237+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 26 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.237+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x55db0cacdff0 2024-09-18T01:45:45.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.237+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 27 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.238+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x55db0cacdff0 2024-09-18T01:45:45.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.238+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 28 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.238+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x55db0cac7e00 2024-09-18T01:45:45.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.238+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.1 v2:172.21.15.146:6808/3930274777 31 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv168 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f102c009050 con 0x55db0cac7e00 2024-09-18T01:45:45.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.238+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x55db0cac7e00 2024-09-18T01:45:45.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.238+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.1 v2:172.21.15.146:6808/3930274777 32 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv168 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f102c009050 con 0x55db0cac7e00 2024-09-18T01:45:45.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.238+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x55db0cac7e00 2024-09-18T01:45:45.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.239+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.1 v2:172.21.15.146:6808/3930274777 33 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv168 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f102c009050 con 0x55db0cac7e00 2024-09-18T01:45:45.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.239+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x7f103c022420 2024-09-18T01:45:45.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.239+0000 7f10445e3640 1 -- 172.21.15.146:0/2148743496 <== osd.2 v2:172.21.15.146:6800/3820039304 19 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv57 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1034099070 con 0x7f103c022420 2024-09-18T01:45:45.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.239+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x7f103c022420 2024-09-18T01:45:45.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.239+0000 7f10445e3640 1 -- 172.21.15.146:0/2148743496 <== osd.2 v2:172.21.15.146:6800/3820039304 20 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv57 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f1034099070 con 0x7f103c022420 2024-09-18T01:45:45.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.239+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x7f103c022420 2024-09-18T01:45:45.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.239+0000 7f10445e3640 1 -- 172.21.15.146:0/2148743496 <== osd.2 v2:172.21.15.146:6800/3820039304 21 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv57 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1034099070 con 0x7f103c022420 2024-09-18T01:45:45.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.239+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x55db0cacdff0 2024-09-18T01:45:45.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.240+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.240+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x55db0cacdff0 2024-09-18T01:45:45.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.240+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 30 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv50 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.240+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x55db0cacdff0 2024-09-18T01:45:45.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.240+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 31 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.240+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x55db0cac7e00 2024-09-18T01:45:45.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.240+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.1 v2:172.21.15.146:6808/3930274777 34 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv29 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f102c009050 con 0x55db0cac7e00 2024-09-18T01:45:45.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.240+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x55db0cac7e00 2024-09-18T01:45:45.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.241+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.1 v2:172.21.15.146:6808/3930274777 35 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv29 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f102c009050 con 0x55db0cac7e00 2024-09-18T01:45:45.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.241+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x55db0cac7e00 2024-09-18T01:45:45.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.241+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.1 v2:172.21.15.146:6808/3930274777 36 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv29 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f102c009050 con 0x55db0cac7e00 2024-09-18T01:45:45.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.241+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x7f103405c070 2024-09-18T01:45:45.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.241+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.0 v2:172.21.15.129:6800/1759265424 27 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv40 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f102c009050 con 0x7f103405c070 2024-09-18T01:45:45.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.241+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x7f103405c070 2024-09-18T01:45:45.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.241+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.0 v2:172.21.15.129:6800/1759265424 28 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv40 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f102c009050 con 0x7f103405c070 2024-09-18T01:45:45.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.241+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x7f103405c070 2024-09-18T01:45:45.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.242+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.0 v2:172.21.15.129:6800/1759265424 29 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv40 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f102c009050 con 0x7f103405c070 2024-09-18T01:45:45.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.242+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x7f103c022420 2024-09-18T01:45:45.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.242+0000 7f10445e3640 1 -- 172.21.15.146:0/2148743496 <== osd.2 v2:172.21.15.146:6800/3820039304 22 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1034099070 con 0x7f103c022420 2024-09-18T01:45:45.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.242+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x7f103c022420 2024-09-18T01:45:45.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.242+0000 7f10445e3640 1 -- 172.21.15.146:0/2148743496 <== osd.2 v2:172.21.15.146:6800/3820039304 23 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f1034099070 con 0x7f103c022420 2024-09-18T01:45:45.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.242+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x7f103c022420 2024-09-18T01:45:45.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.242+0000 7f10445e3640 1 -- 172.21.15.146:0/2148743496 <== osd.2 v2:172.21.15.146:6800/3820039304 24 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1034099070 con 0x7f103c022420 2024-09-18T01:45:45.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.242+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x55db0cacdff0 2024-09-18T01:45:45.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.243+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 32 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.243+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x55db0cacdff0 2024-09-18T01:45:45.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.243+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 33 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.243+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x55db0cacdff0 2024-09-18T01:45:45.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.243+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 34 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.243+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x7f103c022420 2024-09-18T01:45:45.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.243+0000 7f10445e3640 1 -- 172.21.15.146:0/2148743496 <== osd.2 v2:172.21.15.146:6800/3820039304 25 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1034099070 con 0x7f103c022420 2024-09-18T01:45:45.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.243+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x7f103c022420 2024-09-18T01:45:45.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.244+0000 7f10445e3640 1 -- 172.21.15.146:0/2148743496 <== osd.2 v2:172.21.15.146:6800/3820039304 26 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv59 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1034099070 con 0x7f103c022420 2024-09-18T01:45:45.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.244+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x7f103c022420 2024-09-18T01:45:45.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.244+0000 7f10445e3640 1 -- 172.21.15.146:0/2148743496 <== osd.2 v2:172.21.15.146:6800/3820039304 27 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1034099070 con 0x7f103c022420 2024-09-18T01:45:45.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.244+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x7f103405c070 2024-09-18T01:45:45.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.244+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.0 v2:172.21.15.129:6800/1759265424 30 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f102c009050 con 0x7f103405c070 2024-09-18T01:45:45.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.244+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x7f103405c070 2024-09-18T01:45:45.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.245+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.0 v2:172.21.15.129:6800/1759265424 31 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f102c009050 con 0x7f103405c070 2024-09-18T01:45:45.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.245+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x7f103405c070 2024-09-18T01:45:45.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.245+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.0 v2:172.21.15.129:6800/1759265424 32 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f102c009050 con 0x7f103405c070 2024-09-18T01:45:45.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.245+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x7f103c022420 2024-09-18T01:45:45.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.245+0000 7f10445e3640 1 -- 172.21.15.146:0/2148743496 <== osd.2 v2:172.21.15.146:6800/3820039304 28 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1034099070 con 0x7f103c022420 2024-09-18T01:45:45.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.245+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x7f103c022420 2024-09-18T01:45:45.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.245+0000 7f10445e3640 1 -- 172.21.15.146:0/2148743496 <== osd.2 v2:172.21.15.146:6800/3820039304 29 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1034099070 con 0x7f103c022420 2024-09-18T01:45:45.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.245+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x7f103c022420 2024-09-18T01:45:45.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.246+0000 7f10445e3640 1 -- 172.21.15.146:0/2148743496 <== osd.2 v2:172.21.15.146:6800/3820039304 30 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1034099070 con 0x7f103c022420 2024-09-18T01:45:45.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.246+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x7f103405c070 2024-09-18T01:45:45.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.246+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.0 v2:172.21.15.129:6800/1759265424 33 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f102c009050 con 0x7f103405c070 2024-09-18T01:45:45.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.246+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x7f103405c070 2024-09-18T01:45:45.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.246+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.0 v2:172.21.15.129:6800/1759265424 34 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv52 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f102c009050 con 0x7f103405c070 2024-09-18T01:45:45.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.246+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x7f103405c070 2024-09-18T01:45:45.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.247+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.0 v2:172.21.15.129:6800/1759265424 35 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f102c009050 con 0x7f103405c070 2024-09-18T01:45:45.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.247+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x55db0cac7e00 2024-09-18T01:45:45.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.247+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.1 v2:172.21.15.146:6808/3930274777 37 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv170 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f102c009050 con 0x55db0cac7e00 2024-09-18T01:45:45.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.247+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x55db0cac7e00 2024-09-18T01:45:45.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.247+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.1 v2:172.21.15.146:6808/3930274777 38 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv170 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f102c009050 con 0x55db0cac7e00 2024-09-18T01:45:45.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.247+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x55db0cac7e00 2024-09-18T01:45:45.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.247+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.1 v2:172.21.15.146:6808/3930274777 39 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv170 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f102c009050 con 0x55db0cac7e00 2024-09-18T01:45:45.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.247+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x55db0cacdff0 2024-09-18T01:45:45.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.248+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 35 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.248+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x55db0cacdff0 2024-09-18T01:45:45.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.248+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 36 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv51 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.248+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x55db0cacdff0 2024-09-18T01:45:45.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.248+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 37 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.248+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x7f103c022420 2024-09-18T01:45:45.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.248+0000 7f10445e3640 1 -- 172.21.15.146:0/2148743496 <== osd.2 v2:172.21.15.146:6800/3820039304 31 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv61 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1034099070 con 0x7f103c022420 2024-09-18T01:45:45.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.248+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x7f103c022420 2024-09-18T01:45:45.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.249+0000 7f10445e3640 1 -- 172.21.15.146:0/2148743496 <== osd.2 v2:172.21.15.146:6800/3820039304 32 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv61 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1034099070 con 0x7f103c022420 2024-09-18T01:45:45.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.249+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x7f103c022420 2024-09-18T01:45:45.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.249+0000 7f10445e3640 1 -- 172.21.15.146:0/2148743496 <== osd.2 v2:172.21.15.146:6800/3820039304 33 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv61 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1034099070 con 0x7f103c022420 2024-09-18T01:45:45.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.249+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x55db0cacdff0 2024-09-18T01:45:45.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.249+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 38 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.249+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x55db0cacdff0 2024-09-18T01:45:45.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.249+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 39 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.249+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x55db0cacdff0 2024-09-18T01:45:45.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.250+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 40 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.250+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x55db0cac7e00 2024-09-18T01:45:45.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.250+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.1 v2:172.21.15.146:6808/3930274777 40 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f102c009050 con 0x55db0cac7e00 2024-09-18T01:45:45.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.250+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x55db0cac7e00 2024-09-18T01:45:45.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.250+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.1 v2:172.21.15.146:6808/3930274777 41 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f102c009050 con 0x55db0cac7e00 2024-09-18T01:45:45.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.250+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x55db0cac7e00 2024-09-18T01:45:45.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.250+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.1 v2:172.21.15.146:6808/3930274777 42 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f102c009050 con 0x55db0cac7e00 2024-09-18T01:45:45.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.250+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x55db0cac7e00 2024-09-18T01:45:45.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.251+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.1 v2:172.21.15.146:6808/3930274777 43 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv172 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f102c009050 con 0x55db0cac7e00 2024-09-18T01:45:45.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.251+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x55db0cac7e00 2024-09-18T01:45:45.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.251+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.1 v2:172.21.15.146:6808/3930274777 44 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv172 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f102c009050 con 0x55db0cac7e00 2024-09-18T01:45:45.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.251+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x55db0cac7e00 2024-09-18T01:45:45.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.251+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.1 v2:172.21.15.146:6808/3930274777 45 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv172 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f102c009050 con 0x55db0cac7e00 2024-09-18T01:45:45.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.251+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x55db0cacdff0 2024-09-18T01:45:45.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.251+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 41 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.251+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x55db0cacdff0 2024-09-18T01:45:45.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.252+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 42 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv53 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.252+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x55db0cacdff0 2024-09-18T01:45:45.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.252+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 43 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.252+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x7f103c022420 2024-09-18T01:45:45.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.252+0000 7f10445e3640 1 -- 172.21.15.146:0/2148743496 <== osd.2 v2:172.21.15.146:6800/3820039304 34 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv37 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1034099070 con 0x7f103c022420 2024-09-18T01:45:45.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.252+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x7f103c022420 2024-09-18T01:45:45.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.252+0000 7f10445e3640 1 -- 172.21.15.146:0/2148743496 <== osd.2 v2:172.21.15.146:6800/3820039304 35 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv37 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1034099070 con 0x7f103c022420 2024-09-18T01:45:45.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.252+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x7f103c022420 2024-09-18T01:45:45.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.253+0000 7f10445e3640 1 -- 172.21.15.146:0/2148743496 <== osd.2 v2:172.21.15.146:6800/3820039304 36 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv37 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1034099070 con 0x7f103c022420 2024-09-18T01:45:45.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.253+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x55db0cacdff0 2024-09-18T01:45:45.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.253+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 44 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.253+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x55db0cacdff0 2024-09-18T01:45:45.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.253+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 45 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.253+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x55db0cacdff0 2024-09-18T01:45:45.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.253+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 46 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.253+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x55db0cacdff0 2024-09-18T01:45:45.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.254+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 47 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.254+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x55db0cacdff0 2024-09-18T01:45:45.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.254+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 48 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.254+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x55db0cacdff0 2024-09-18T01:45:45.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.254+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 49 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.254+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x55db0cacdff0 2024-09-18T01:45:45.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.254+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 50 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.254+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x55db0cacdff0 2024-09-18T01:45:45.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.255+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 51 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.255+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x55db0cacdff0 2024-09-18T01:45:45.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.255+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 52 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.255+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x55db0cacdff0 2024-09-18T01:45:45.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.255+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 53 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.255+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x55db0cacdff0 2024-09-18T01:45:45.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.255+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 54 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv52 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.255+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x55db0cacdff0 2024-09-18T01:45:45.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.255+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 55 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.255+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x7f103405c070 2024-09-18T01:45:45.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.256+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.0 v2:172.21.15.129:6800/1759265424 36 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f102c009050 con 0x7f103405c070 2024-09-18T01:45:45.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.256+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x7f103405c070 2024-09-18T01:45:45.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.256+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.0 v2:172.21.15.129:6800/1759265424 37 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv30 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f102c009050 con 0x7f103405c070 2024-09-18T01:45:45.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.256+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x7f103405c070 2024-09-18T01:45:45.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.256+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.0 v2:172.21.15.129:6800/1759265424 38 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f102c009050 con 0x7f103405c070 2024-09-18T01:45:45.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.256+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x55db0cacdff0 2024-09-18T01:45:45.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.257+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 56 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.257+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x55db0cacdff0 2024-09-18T01:45:45.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.257+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 57 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.257+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x55db0cacdff0 2024-09-18T01:45:45.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.257+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 58 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.257+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x7f103405c070 2024-09-18T01:45:45.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.258+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.0 v2:172.21.15.129:6800/1759265424 39 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f102c009050 con 0x7f103405c070 2024-09-18T01:45:45.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.258+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x7f103405c070 2024-09-18T01:45:45.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.258+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.0 v2:172.21.15.129:6800/1759265424 40 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f102c009050 con 0x7f103405c070 2024-09-18T01:45:45.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.258+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x7f103405c070 2024-09-18T01:45:45.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.258+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.0 v2:172.21.15.129:6800/1759265424 41 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f102c009050 con 0x7f103405c070 2024-09-18T01:45:45.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.258+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x55db0cacdff0 2024-09-18T01:45:45.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.258+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 59 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.258+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x55db0cacdff0 2024-09-18T01:45:45.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.259+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 60 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv55 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.259+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x55db0cacdff0 2024-09-18T01:45:45.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.259+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 61 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.259+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x7f103405c070 2024-09-18T01:45:45.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.259+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.0 v2:172.21.15.129:6800/1759265424 42 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f102c009050 con 0x7f103405c070 2024-09-18T01:45:45.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.259+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x7f103405c070 2024-09-18T01:45:45.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.259+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.0 v2:172.21.15.129:6800/1759265424 43 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv54 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f102c009050 con 0x7f103405c070 2024-09-18T01:45:45.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.259+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x7f103405c070 2024-09-18T01:45:45.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.260+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.0 v2:172.21.15.129:6800/1759265424 44 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f102c009050 con 0x7f103405c070 2024-09-18T01:45:45.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.260+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x7f103c022420 2024-09-18T01:45:45.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.260+0000 7f10445e3640 1 -- 172.21.15.146:0/2148743496 <== osd.2 v2:172.21.15.146:6800/3820039304 37 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1034099070 con 0x7f103c022420 2024-09-18T01:45:45.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.260+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x7f103c022420 2024-09-18T01:45:45.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.260+0000 7f10445e3640 1 -- 172.21.15.146:0/2148743496 <== osd.2 v2:172.21.15.146:6800/3820039304 38 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1034099070 con 0x7f103c022420 2024-09-18T01:45:45.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.260+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae47b0 con 0x7f103c022420 2024-09-18T01:45:45.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.260+0000 7f10445e3640 1 -- 172.21.15.146:0/2148743496 <== osd.2 v2:172.21.15.146:6800/3820039304 39 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1034099070 con 0x7f103c022420 2024-09-18T01:45:45.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.261+0000 7f0efafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:45.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.261+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94399298897024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cae4750 con 0x55db0cac7e00 2024-09-18T01:45:45.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.262+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.1 v2:172.21.15.146:6808/3930274777 46 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94399298897024] v33'178 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f102c009050 con 0x55db0cac7e00 2024-09-18T01:45:45.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.262+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94399298871824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad8450 con 0x7f103c022420 2024-09-18T01:45:45.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.263+0000 7f10445e3640 1 -- 172.21.15.146:0/2148743496 <== osd.2 v2:172.21.15.146:6800/3820039304 40 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94399298871824] v33'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1034099070 con 0x7f103c022420 2024-09-18T01:45:45.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.263+0000 7f1048926800 20 remove_watcher() i=0 2024-09-18T01:45:45.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.263+0000 7f1048926800 2 removed watcher, disabling cache 2024-09-18T01:45:45.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.263+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94399298877600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad2210 con 0x55db0cac7e00 2024-09-18T01:45:45.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.265+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.1 v2:172.21.15.146:6808/3930274777 47 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94399298877600] v33'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f102c009050 con 0x55db0cac7e00 2024-09-18T01:45:45.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.265+0000 7f1048926800 20 remove_watcher() i=1 2024-09-18T01:45:45.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.265+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94399298882352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad2210 con 0x55db0cacdff0 2024-09-18T01:45:45.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.266+0000 7f1044de4640 1 -- 172.21.15.146:0/2148743496 <== osd.3 v2:172.21.15.146:6809/4106661138 62 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94399298882352] v33'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f103c05e040 con 0x55db0cacdff0 2024-09-18T01:45:45.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.266+0000 7f1048926800 20 remove_watcher() i=2 2024-09-18T01:45:45.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.266+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94399298885104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad2210 con 0x7f103c022420 2024-09-18T01:45:45.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.267+0000 7f10445e3640 1 -- 172.21.15.146:0/2148743496 <== osd.2 v2:172.21.15.146:6800/3820039304 41 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94399298885104] v33'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1034099070 con 0x7f103c022420 2024-09-18T01:45:45.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.267+0000 7f1048926800 20 remove_watcher() i=3 2024-09-18T01:45:45.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.267+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94399298888688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad55f0 con 0x55db0cac7e00 2024-09-18T01:45:45.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.268+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.1 v2:172.21.15.146:6808/3930274777 48 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94399298888688] v33'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f102c009050 con 0x55db0cac7e00 2024-09-18T01:45:45.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.268+0000 7f1048926800 20 remove_watcher() i=4 2024-09-18T01:45:45.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.268+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94399298892704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad2210 con 0x7f103405c070 2024-09-18T01:45:45.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.269+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.0 v2:172.21.15.129:6800/1759265424 45 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94399298892704] v33'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f102c009050 con 0x7f103405c070 2024-09-18T01:45:45.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.269+0000 7f1048926800 20 remove_watcher() i=5 2024-09-18T01:45:45.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.269+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94399298891008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad63f0 con 0x7f103405c070 2024-09-18T01:45:45.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.270+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.0 v2:172.21.15.129:6800/1759265424 46 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94399298891008] v33'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f102c009050 con 0x7f103405c070 2024-09-18T01:45:45.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.270+0000 7f1048926800 20 remove_watcher() i=6 2024-09-18T01:45:45.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.270+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94399298879728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55db0cad73a0 con 0x7f103405c070 2024-09-18T01:45:45.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.271+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 <== osd.0 v2:172.21.15.129:6800/1759265424 47 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94399298879728] v33'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f102c009050 con 0x7f103405c070 2024-09-18T01:45:45.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.271+0000 7f1048926800 20 remove_watcher() i=7 2024-09-18T01:45:45.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.271+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f103405c070 msgr2=0x7f1034090300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.271+0000 7f1048926800 1 --2- 172.21.15.146:0/2148743496 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f103405c070 0x7f1034090300 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.271+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55db0cac7e00 msgr2=0x55db0caca2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.271+0000 7f1048926800 1 --2- 172.21.15.146:0/2148743496 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55db0cac7e00 0x55db0caca2c0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.271+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f103c022420 msgr2=0x7f103c02aa60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.271+0000 7f1048926800 1 --2- 172.21.15.146:0/2148743496 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f103c022420 0x7f103c02aa60 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.271+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55db0cacdff0 msgr2=0x55db0cad03e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.271+0000 7f1048926800 1 --2- 172.21.15.146:0/2148743496 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55db0cacdff0 0x55db0cad03e0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.271+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0f14036b90 msgr2=0x7f0f14039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.271+0000 7f1048926800 1 --2- 172.21.15.146:0/2148743496 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0f14036b90 0x7f0f14039050 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1034045ed0 tx=0x7f1034083000 comp rx=0 tx=0).stop 2024-09-18T01:45:45.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.271+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db0cab4cf0 msgr2=0x55db0cabc190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.271+0000 7f1048926800 1 --2- 172.21.15.146:0/2148743496 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db0cab4cf0 0x55db0cabc190 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f103c015fd0 tx=0x7f103c04c7f0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.271+0000 7f103bfff640 1 -- 172.21.15.146:0/2148743496 reap_dead start 2024-09-18T01:45:45.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.271+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 shutdown_connections 2024-09-18T01:45:45.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.271+0000 7f1048926800 1 --2- 172.21.15.146:0/2148743496 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db0cab4cf0 0x55db0cabc190 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.271+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 >> 172.21.15.146:0/2148743496 conn(0x55db0cab1090 msgr2=0x55db0caaf160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:45.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.272+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 shutdown_connections 2024-09-18T01:45:45.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.272+0000 7f1048926800 1 -- 172.21.15.146:0/2148743496 wait complete. 2024-09-18T01:45:45.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.272+0000 7f1048926800 1 -- 172.21.15.146:0/3430266024 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0f1c036b90 msgr2=0x7f0f1c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.272+0000 7f1048926800 1 --2- 172.21.15.146:0/3430266024 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0f1c036b90 0x7f0f1c039050 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1034008370 tx=0x7f1034067a10 comp rx=0 tx=0).stop 2024-09-18T01:45:45.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.272+0000 7f1048926800 1 -- 172.21.15.146:0/3430266024 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db0caa8090 msgr2=0x55db0caa84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.272+0000 7f1048926800 1 --2- 172.21.15.146:0/3430266024 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db0caa8090 0x55db0caa84b0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x55db0ca94d60 tx=0x7f103c0178e0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.272+0000 7f1048926800 1 -- 172.21.15.146:0/3430266024 shutdown_connections 2024-09-18T01:45:45.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.272+0000 7f1048926800 1 --2- 172.21.15.146:0/3430266024 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0f1c036b90 0x7f0f1c039050 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.272+0000 7f1048926800 1 --2- 172.21.15.146:0/3430266024 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db0caa8090 0x55db0caa84b0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.272+0000 7f1048926800 1 -- 172.21.15.146:0/3430266024 >> 172.21.15.146:0/3430266024 conn(0x55db0ca9d020 msgr2=0x55db0ca9fba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:45.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.272+0000 7f1048926800 1 -- 172.21.15.146:0/3430266024 shutdown_connections 2024-09-18T01:45:45.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.272+0000 7f1048926800 1 -- 172.21.15.146:0/3430266024 wait complete. 2024-09-18T01:45:45.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.272+0000 7f1048926800 1 -- 172.21.15.146:0/2804669582 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55db0c993390 msgr2=0x55db0ca94420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.272+0000 7f1048926800 1 --2- 172.21.15.146:0/2804669582 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55db0c993390 0x55db0ca94420 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.272+0000 7f1048926800 1 -- 172.21.15.146:0/2804669582 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55db0ca963b0 msgr2=0x55db0ca99bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.272+0000 7f1048926800 1 --2- 172.21.15.146:0/2804669582 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55db0ca963b0 0x55db0ca99bf0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.272+0000 7f1048926800 1 -- 172.21.15.146:0/2804669582 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0f2c036ce0 msgr2=0x7f0f2c0391a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.272+0000 7f1048926800 1 --2- 172.21.15.146:0/2804669582 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0f2c036ce0 0x7f0f2c0391a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f102c000f60 tx=0x7f102c0012b0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.272+0000 7f1048926800 1 -- 172.21.15.146:0/2804669582 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db0c992a50 msgr2=0x55db0ca8d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.272+0000 7f1048926800 1 --2- 172.21.15.146:0/2804669582 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db0c992a50 0x55db0ca8d3b0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f103400a330 tx=0x7f1034002fb0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.272+0000 7f1048926800 1 -- 172.21.15.146:0/2804669582 shutdown_connections 2024-09-18T01:45:45.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.272+0000 7f1048926800 1 --2- 172.21.15.146:0/2804669582 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55db0ca963b0 0x55db0ca99bf0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.272+0000 7f1048926800 1 --2- 172.21.15.146:0/2804669582 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55db0c993390 0x55db0ca94420 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.272+0000 7f1048926800 1 --2- 172.21.15.146:0/2804669582 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0f2c036ce0 0x7f0f2c0391a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.272+0000 7f1048926800 1 --2- 172.21.15.146:0/2804669582 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55db0c992a50 0x55db0ca8d3b0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.272+0000 7f1048926800 1 -- 172.21.15.146:0/2804669582 >> 172.21.15.146:0/2804669582 conn(0x55db0c98e5c0 msgr2=0x55db0ca7fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:45.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.272+0000 7f1048926800 1 -- 172.21.15.146:0/2804669582 shutdown_connections 2024-09-18T01:45:45.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.273+0000 7f1048926800 1 -- 172.21.15.146:0/2804669582 wait complete. 2024-09-18T01:45:45.282 INFO:teuthology.orchestra.run.smithi146.stdout:[] 2024-09-18T01:45:45.282 DEBUG:tasks.util.rgw: json result: [] 2024-09-18T01:45:45.282 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-18T01:45:45.283 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-18T01:45:45.283 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-18T01:45:45.367 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:45.367 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:45.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.366+0000 7f2c65b22800 1 Processor -- start 2024-09-18T01:45:45.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.366+0000 7f2c65b22800 1 -- start start 2024-09-18T01:45:45.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.366+0000 7f2c65b22800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x564b1e4ac960 0x564b1e4aed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.366+0000 7f2c65b22800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564b1e368b30 con 0x564b1e4a8aa0 2024-09-18T01:45:45.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.366+0000 7f2c65b22800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x564b1e34a360 con 0x564b1e4ac960 2024-09-18T01:45:45.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.366+0000 7f2c5bfff640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x564b1e4ac960 0x564b1e4aed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.367+0000 7f2c5bfff640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x564b1e4ac960 0x564b1e4aed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38246/0 (socket says 172.21.15.146:38246) 2024-09-18T01:45:45.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.367+0000 7f2c5bfff640 1 -- 172.21.15.146:0/2740870813 learned_addr learned my addr 172.21.15.146:0/2740870813 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:45.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.367+0000 7f2c5bfff640 1 -- 172.21.15.146:0/2740870813 >> v1:172.21.15.129:6789/0 conn(0x564b1e4a8aa0 legacy=0x564b1e4a8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.367+0000 7f2c5bfff640 1 -- 172.21.15.146:0/2740870813 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b1e370e00 con 0x564b1e4ac960 2024-09-18T01:45:45.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.369+0000 7f2c5bfff640 1 --2- 172.21.15.146:0/2740870813 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b1e4ac960 0x564b1e4aed50 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c00a520 tx=0x7f2c4c045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f74126944f96f42f server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.369+0000 7f2c61015640 1 -- 172.21.15.146:0/2740870813 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c4c055070 con 0x564b1e4ac960 2024-09-18T01:45:45.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.369+0000 7f2c61015640 1 -- 172.21.15.146:0/2740870813 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c4c0515b0 con 0x564b1e4ac960 2024-09-18T01:45:45.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.369+0000 7f2c61015640 1 -- 172.21.15.146:0/2740870813 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c4c0518d0 con 0x564b1e4ac960 2024-09-18T01:45:45.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.369+0000 7f2c65b22800 1 -- 172.21.15.146:0/2740870813 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b1e4ac960 msgr2=0x564b1e4aed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.369+0000 7f2c65b22800 1 --2- 172.21.15.146:0/2740870813 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b1e4ac960 0x564b1e4aed50 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c00a520 tx=0x7f2c4c045ba0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.369+0000 7f2c65b22800 1 -- 172.21.15.146:0/2740870813 shutdown_connections 2024-09-18T01:45:45.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.369+0000 7f2c65b22800 1 --2- 172.21.15.146:0/2740870813 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b1e4ac960 0x564b1e4aed50 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.369+0000 7f2c65b22800 1 -- 172.21.15.146:0/2740870813 >> 172.21.15.146:0/2740870813 conn(0x564b1e4a35c0 msgr2=0x564b1e4a59e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:45.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.369+0000 7f2c65b22800 1 -- 172.21.15.146:0/2740870813 shutdown_connections 2024-09-18T01:45:45.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.369+0000 7f2c65b22800 1 -- 172.21.15.146:0/2740870813 wait complete. 2024-09-18T01:45:45.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.383+0000 7f2c65b22800 1 Processor -- start 2024-09-18T01:45:45.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.383+0000 7f2c65b22800 1 -- start start 2024-09-18T01:45:45.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.383+0000 7f2c65b22800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b1e4a8aa0 0x564b1e597760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.383+0000 7f2c65b22800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x564b1e3f5330 con 0x564b1e4a8aa0 2024-09-18T01:45:45.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.383+0000 7f2c61816640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b1e4a8aa0 0x564b1e597760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.383+0000 7f2c61816640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b1e4a8aa0 0x564b1e597760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38262/0 (socket says 172.21.15.146:38262) 2024-09-18T01:45:45.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.383+0000 7f2c61816640 1 -- 172.21.15.146:0/468571770 learned_addr learned my addr 172.21.15.146:0/468571770 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:45.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.384+0000 7f2c61816640 1 -- 172.21.15.146:0/468571770 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b1e342bc0 con 0x564b1e4a8aa0 2024-09-18T01:45:45.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.384+0000 7f2c61816640 1 --2- 172.21.15.146:0/468571770 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b1e4a8aa0 0x564b1e597760 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f2c54001e60 tx=0x7f2c5400d880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61e6ecca77ed7d0e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.384+0000 7f2b4fe07640 1 -- 172.21.15.146:0/468571770 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c5400b770 con 0x564b1e4a8aa0 2024-09-18T01:45:45.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.384+0000 7f2b4fe07640 1 -- 172.21.15.146:0/468571770 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c5400b930 con 0x564b1e4a8aa0 2024-09-18T01:45:45.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.384+0000 7f2b4fe07640 1 -- 172.21.15.146:0/468571770 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c5400bc50 con 0x564b1e4a8aa0 2024-09-18T01:45:45.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.385+0000 7f2c65b22800 1 -- 172.21.15.146:0/468571770 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b1e4a8aa0 msgr2=0x564b1e597760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.385+0000 7f2c65b22800 1 --2- 172.21.15.146:0/468571770 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b1e4a8aa0 0x564b1e597760 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f2c54001e60 tx=0x7f2c5400d880 comp rx=0 tx=0).stop 2024-09-18T01:45:45.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.385+0000 7f2c65b22800 1 -- 172.21.15.146:0/468571770 shutdown_connections 2024-09-18T01:45:45.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.385+0000 7f2c65b22800 1 --2- 172.21.15.146:0/468571770 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b1e4a8aa0 0x564b1e597760 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.385+0000 7f2c65b22800 1 -- 172.21.15.146:0/468571770 >> 172.21.15.146:0/468571770 conn(0x564b1e4a35c0 msgr2=0x564b1e593120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:45.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.385+0000 7f2c65b22800 1 -- 172.21.15.146:0/468571770 shutdown_connections 2024-09-18T01:45:45.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.385+0000 7f2c65b22800 1 -- 172.21.15.146:0/468571770 wait complete. 2024-09-18T01:45:45.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.385+0000 7f2c65b22800 1 Processor -- start 2024-09-18T01:45:45.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.385+0000 7f2c65b22800 1 -- start start 2024-09-18T01:45:45.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.385+0000 7f2c65b22800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b1e4a8aa0 0x564b1e5a24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.385+0000 7f2c65b22800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x564b1e4af590 con 0x564b1e4a8aa0 2024-09-18T01:45:45.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.385+0000 7f2c61816640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b1e4a8aa0 0x564b1e5a24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.385+0000 7f2c61816640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b1e4a8aa0 0x564b1e5a24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38270/0 (socket says 172.21.15.146:38270) 2024-09-18T01:45:45.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.385+0000 7f2c61816640 1 -- 172.21.15.146:0/3717587036 learned_addr learned my addr 172.21.15.146:0/3717587036 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:45.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.386+0000 7f2c61816640 1 -- 172.21.15.146:0/3717587036 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b1e356fe0 con 0x564b1e4a8aa0 2024-09-18T01:45:45.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.386+0000 7f2c61816640 1 --2- 172.21.15.146:0/3717587036 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b1e4a8aa0 0x564b1e5a24a0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f2c54000fb0 tx=0x7f2c54000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.386+0000 7f2b4e604640 1 -- 172.21.15.146:0/3717587036 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c54016690 con 0x564b1e4a8aa0 2024-09-18T01:45:45.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.386+0000 7f2b4e604640 1 -- 172.21.15.146:0/3717587036 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c54016830 con 0x564b1e4a8aa0 2024-09-18T01:45:45.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.386+0000 7f2b4e604640 1 -- 172.21.15.146:0/3717587036 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c54016b50 con 0x564b1e4a8aa0 2024-09-18T01:45:45.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.386+0000 7f2c65b22800 1 -- 172.21.15.146:0/3717587036 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564b1e5a29e0 con 0x564b1e4a8aa0 2024-09-18T01:45:45.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.386+0000 7f2c65b22800 1 -- 172.21.15.146:0/3717587036 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b1e5a2ea0 con 0x564b1e4a8aa0 2024-09-18T01:45:45.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.387+0000 7f2b4e604640 1 -- 172.21.15.146:0/3717587036 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2c54028060 con 0x564b1e4a8aa0 2024-09-18T01:45:45.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.387+0000 7f2b4e604640 1 --2- 172.21.15.146:0/3717587036 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2b48036b90 0x7f2b48039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.387+0000 7f2b4e604640 1 -- 172.21.15.146:0/3717587036 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f2c5404ba80 con 0x564b1e4a8aa0 2024-09-18T01:45:45.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.387+0000 7f2c5bfff640 1 --2- 172.21.15.146:0/3717587036 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2b48036b90 0x7f2b48039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.387+0000 7f2c65b22800 1 --2- 172.21.15.146:0/3717587036 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564b1e4ac960 0x564b1e5a9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.387+0000 7f2c65b22800 1 -- 172.21.15.146:0/3717587036 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5a9a90 con 0x564b1e4ac960 2024-09-18T01:45:45.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.387+0000 7f2c62017640 1 --2- 172.21.15.146:0/3717587036 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564b1e4ac960 0x564b1e5a9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.388+0000 7f2c5bfff640 1 --2- 172.21.15.146:0/3717587036 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2b48036b90 0x7f2b48039050 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c057000 tx=0x7f2c4c052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.388+0000 7f2c62017640 1 --2- 172.21.15.146:0/3717587036 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564b1e4ac960 0x564b1e5a9510 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.388+0000 7f2c62017640 1 -- 172.21.15.146:0/3717587036 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2c5c00a4a0 con 0x564b1e4ac960 2024-09-18T01:45:45.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.388+0000 7f2c65b22800 1 -- 172.21.15.146:0/3717587036 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5a6ae0 con 0x564b1e4ac960 2024-09-18T01:45:45.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.388+0000 7f2c62017640 1 -- 172.21.15.146:0/3717587036 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2c5c00a4a0 con 0x564b1e4ac960 2024-09-18T01:45:45.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.388+0000 7f2c65b22800 1 -- 172.21.15.146:0/3717587036 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5ab8d0 con 0x564b1e4ac960 2024-09-18T01:45:45.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.389+0000 7f2c62017640 1 -- 172.21.15.146:0/3717587036 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2c5c00a4a0 con 0x564b1e4ac960 2024-09-18T01:45:45.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.389+0000 7f2c65b22800 1 -- 172.21.15.146:0/3717587036 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5aab00 con 0x564b1e4ac960 2024-09-18T01:45:45.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.389+0000 7f2c62017640 1 -- 172.21.15.146:0/3717587036 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2c5c00a4a0 con 0x564b1e4ac960 2024-09-18T01:45:45.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.389+0000 7f2c65b22800 1 --2- 172.21.15.146:0/3717587036 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x564b1e5acc80 0x564b1e5af070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.389+0000 7f2c65b22800 1 -- 172.21.15.146:0/3717587036 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5af5b0 con 0x564b1e5acc80 2024-09-18T01:45:45.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.389+0000 7f2c61816640 1 --2- 172.21.15.146:0/3717587036 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x564b1e5acc80 0x564b1e5af070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.389+0000 7f2c61816640 1 --2- 172.21.15.146:0/3717587036 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x564b1e5acc80 0x564b1e5af070 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.390+0000 7f2c61816640 1 -- 172.21.15.146:0/3717587036 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2c540293b0 con 0x564b1e5acc80 2024-09-18T01:45:45.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.390+0000 7f2c65b22800 1 Processor -- start 2024-09-18T01:45:45.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.390+0000 7f2c65b22800 1 -- start start 2024-09-18T01:45:45.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.390+0000 7f2c65b22800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b1e5bd210 0x564b1e5bd630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.390+0000 7f2c65b22800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x564b1e344580 con 0x564b1e5bd210 2024-09-18T01:45:45.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.390+0000 7f2c62017640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b1e5bd210 0x564b1e5bd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.390+0000 7f2c62017640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b1e5bd210 0x564b1e5bd630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38280/0 (socket says 172.21.15.146:38280) 2024-09-18T01:45:45.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.390+0000 7f2c62017640 1 -- 172.21.15.146:0/123683731 learned_addr learned my addr 172.21.15.146:0/123683731 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:45.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.391+0000 7f2c62017640 1 -- 172.21.15.146:0/123683731 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b1e5bdb70 con 0x564b1e5bd210 2024-09-18T01:45:45.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.391+0000 7f2c62017640 1 --2- 172.21.15.146:0/123683731 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b1e5bd210 0x564b1e5bd630 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x564b1e5a38a0 tx=0x7f2c5c0178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.391+0000 7f2b477fe640 1 -- 172.21.15.146:0/123683731 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c5c013440 con 0x564b1e5bd210 2024-09-18T01:45:45.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.391+0000 7f2b477fe640 1 -- 172.21.15.146:0/123683731 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c5c0135e0 con 0x564b1e5bd210 2024-09-18T01:45:45.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.391+0000 7f2c65b22800 1 -- 172.21.15.146:0/123683731 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564b1e5bde00 con 0x564b1e5bd210 2024-09-18T01:45:45.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.391+0000 7f2b477fe640 1 -- 172.21.15.146:0/123683731 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c5c0138c0 con 0x564b1e5bd210 2024-09-18T01:45:45.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.391+0000 7f2c65b22800 1 -- 172.21.15.146:0/123683731 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b1e5c0ae0 con 0x564b1e5bd210 2024-09-18T01:45:45.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.392+0000 7f2b477fe640 1 -- 172.21.15.146:0/123683731 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2c5c011040 con 0x564b1e5bd210 2024-09-18T01:45:45.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.392+0000 7f2b477fe640 1 --2- 172.21.15.146:0/123683731 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2b3c036b90 0x7f2b3c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.392+0000 7f2b477fe640 1 -- 172.21.15.146:0/123683731 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f2c5c01d070 con 0x564b1e5bd210 2024-09-18T01:45:45.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.392+0000 7f2c61816640 1 --2- 172.21.15.146:0/123683731 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2b3c036b90 0x7f2b3c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.392+0000 7f2c65b22800 1 Processor -- start 2024-09-18T01:45:45.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.392+0000 7f2c65b22800 1 -- start start 2024-09-18T01:45:45.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.392+0000 7f2c61816640 1 --2- 172.21.15.146:0/123683731 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2b3c036b90 0x7f2b3c039050 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2c54049ea0 tx=0x7f2c54049d70 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.393+0000 7f2c65b22800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b1e5c9eb0 0x564b1e5ca2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.393+0000 7f2c65b22800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x564b1e597f10 con 0x564b1e5c9eb0 2024-09-18T01:45:45.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.393+0000 7f2c62017640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b1e5c9eb0 0x564b1e5ca2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.393+0000 7f2c62017640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b1e5c9eb0 0x564b1e5ca2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38282/0 (socket says 172.21.15.146:38282) 2024-09-18T01:45:45.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.393+0000 7f2c62017640 1 -- 172.21.15.146:0/1831769066 learned_addr learned my addr 172.21.15.146:0/1831769066 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:45.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.393+0000 7f2c62017640 1 -- 172.21.15.146:0/1831769066 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b1e5ca880 con 0x564b1e5c9eb0 2024-09-18T01:45:45.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.393+0000 7f2c62017640 1 --2- 172.21.15.146:0/1831769066 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b1e5c9eb0 0x564b1e5ca2b0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c04c8c0 tx=0x7f2c5c001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=996e30e4bce1ba1f server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.393+0000 7f2b457fa640 1 -- 172.21.15.146:0/1831769066 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c5c027040 con 0x564b1e5c9eb0 2024-09-18T01:45:45.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.393+0000 7f2b457fa640 1 -- 172.21.15.146:0/1831769066 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c5c012cc0 con 0x564b1e5c9eb0 2024-09-18T01:45:45.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.393+0000 7f2b457fa640 1 -- 172.21.15.146:0/1831769066 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c5c04b250 con 0x564b1e5c9eb0 2024-09-18T01:45:45.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.394+0000 7f2c65b22800 1 -- 172.21.15.146:0/1831769066 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b1e5c9eb0 msgr2=0x564b1e5ca2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.394+0000 7f2c65b22800 1 --2- 172.21.15.146:0/1831769066 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b1e5c9eb0 0x564b1e5ca2b0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c04c8c0 tx=0x7f2c5c001940 comp rx=0 tx=0).stop 2024-09-18T01:45:45.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.394+0000 7f2c65b22800 1 -- 172.21.15.146:0/1831769066 shutdown_connections 2024-09-18T01:45:45.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.394+0000 7f2c65b22800 1 --2- 172.21.15.146:0/1831769066 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b1e5c9eb0 0x564b1e5ca2b0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.394+0000 7f2c65b22800 1 -- 172.21.15.146:0/1831769066 >> 172.21.15.146:0/1831769066 conn(0x564b1e5c6210 msgr2=0x564b1e5c4310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:45.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.394+0000 7f2c65b22800 1 -- 172.21.15.146:0/1831769066 shutdown_connections 2024-09-18T01:45:45.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.394+0000 7f2c65b22800 1 -- 172.21.15.146:0/1831769066 wait complete. 2024-09-18T01:45:45.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.394+0000 7f2c65b22800 1 Processor -- start 2024-09-18T01:45:45.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.394+0000 7f2c65b22800 1 -- start start 2024-09-18T01:45:45.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.394+0000 7f2c65b22800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b1e5c9eb0 0x564b1e5d1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.394+0000 7f2c65b22800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x564b1e5caf30 con 0x564b1e5c9eb0 2024-09-18T01:45:45.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.395+0000 7f2c62017640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b1e5c9eb0 0x564b1e5d1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.395+0000 7f2c62017640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b1e5c9eb0 0x564b1e5d1390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38284/0 (socket says 172.21.15.146:38284) 2024-09-18T01:45:45.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.395+0000 7f2c62017640 1 -- 172.21.15.146:0/3700867178 learned_addr learned my addr 172.21.15.146:0/3700867178 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:45.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.395+0000 7f2c62017640 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b1e5d18d0 con 0x564b1e5c9eb0 2024-09-18T01:45:45.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.395+0000 7f2c62017640 1 --2- 172.21.15.146:0/3700867178 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b1e5c9eb0 0x564b1e5d1390 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c04b7b0 tx=0x7f2c5c04c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.395+0000 7f2b337fe640 1 -- 172.21.15.146:0/3700867178 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c5c027070 con 0x564b1e5c9eb0 2024-09-18T01:45:45.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.395+0000 7f2b337fe640 1 -- 172.21.15.146:0/3700867178 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c5c001610 con 0x564b1e5c9eb0 2024-09-18T01:45:45.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.395+0000 7f2b337fe640 1 -- 172.21.15.146:0/3700867178 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c5c02aa60 con 0x564b1e5c9eb0 2024-09-18T01:45:45.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.395+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564b1e5d1b60 con 0x564b1e5c9eb0 2024-09-18T01:45:45.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.395+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b1e5d4810 con 0x564b1e5c9eb0 2024-09-18T01:45:45.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.396+0000 7f2b337fe640 1 -- 172.21.15.146:0/3700867178 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2c5c02ac00 con 0x564b1e5c9eb0 2024-09-18T01:45:45.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.396+0000 7f2b337fe640 1 --2- 172.21.15.146:0/3700867178 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2b2c036b90 0x7f2b2c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.396+0000 7f2b337fe640 1 -- 172.21.15.146:0/3700867178 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f2c5c033070 con 0x564b1e5c9eb0 2024-09-18T01:45:45.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.396+0000 7f2c61816640 1 --2- 172.21.15.146:0/3700867178 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2b2c036b90 0x7f2b2c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.397+0000 7f2c61816640 1 --2- 172.21.15.146:0/3700867178 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2b2c036b90 0x7f2b2c039050 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2c54001eb0 tx=0x7f2c54042000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.397+0000 7f2c65b22800 20 rados->read ofs=0 len=0 2024-09-18T01:45:45.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.397+0000 7f2c65b22800 1 --2- 172.21.15.146:0/3700867178 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564b1e5dd0b0 0x564b1e5df570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.397+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5dfcc0 con 0x564b1e5dd0b0 2024-09-18T01:45:45.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.397+0000 7f2c5bfff640 1 --2- 172.21.15.146:0/3700867178 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564b1e5dd0b0 0x564b1e5df570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.397+0000 7f2c5bfff640 1 --2- 172.21.15.146:0/3700867178 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564b1e5dd0b0 0x564b1e5df570 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.398+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2c4c057030 con 0x564b1e5dd0b0 2024-09-18T01:45:45.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.398+0000 7f2c65b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:45.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.398+0000 7f2c65b22800 20 realm 2024-09-18T01:45:45.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.398+0000 7f2c65b22800 20 rados->read ofs=0 len=0 2024-09-18T01:45:45.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.398+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5e00f0 con 0x564b1e5dd0b0 2024-09-18T01:45:45.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.398+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2c4c057030 con 0x564b1e5dd0b0 2024-09-18T01:45:45.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.398+0000 7f2c65b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:45.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.398+0000 7f2c65b22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:45.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.398+0000 7f2c65b22800 20 rados->read ofs=0 len=0 2024-09-18T01:45:45.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.398+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5e09c0 con 0x564b1e5dd0b0 2024-09-18T01:45:45.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.398+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2c4c057030 con 0x564b1e5dd0b0 2024-09-18T01:45:45.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.398+0000 7f2c65b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:45.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.398+0000 7f2c65b22800 20 rados->read ofs=0 len=0 2024-09-18T01:45:45.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.398+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5e0d60 con 0x564b1e5dd0b0 2024-09-18T01:45:45.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.398+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2c4c057030 con 0x564b1e5dd0b0 2024-09-18T01:45:45.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.398+0000 7f2c65b22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:45.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.398+0000 7f2c65b22800 20 rados->read ofs=0 len=0 2024-09-18T01:45:45.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.398+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5e15b0 con 0x564b1e5dd0b0 2024-09-18T01:45:45.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.399+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2c4c057030 con 0x564b1e5dd0b0 2024-09-18T01:45:45.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.399+0000 7f2c65b22800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:45.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.399+0000 7f2c65b22800 20 searching for the correct realm 2024-09-18T01:45:45.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.399+0000 7f2c65b22800 1 --2- 172.21.15.146:0/3700867178 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x564b1e5e3320 0x564b1e5e5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.399+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5e5d40 con 0x564b1e5e3320 2024-09-18T01:45:45.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.399+0000 7f2c62017640 1 --2- 172.21.15.146:0/3700867178 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x564b1e5e3320 0x564b1e5e5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.399+0000 7f2c62017640 1 --2- 172.21.15.146:0/3700867178 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x564b1e5e3320 0x564b1e5e5710 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.399+0000 7f2c62017640 1 -- 172.21.15.146:0/3700867178 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c5c057040 con 0x564b1e5e3320 2024-09-18T01:45:45.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.399+0000 7f2c62017640 1 --2- 172.21.15.146:0/3700867178 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f2c5c0123a0 0x7f2c5c036580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.399+0000 7f2c62017640 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5e5d40 con 0x7f2c5c0123a0 2024-09-18T01:45:45.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.399+0000 7f2c61816640 1 --2- 172.21.15.146:0/3700867178 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f2c5c0123a0 0x7f2c5c036580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.400+0000 7f2c61816640 1 --2- 172.21.15.146:0/3700867178 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f2c5c0123a0 0x7f2c5c036580 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.400+0000 7f2c61816640 1 -- 172.21.15.146:0/3700867178 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c54046050 con 0x7f2c5c0123a0 2024-09-18T01:45:45.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.400+0000 7f2c61816640 1 --2- 172.21.15.146:0/3700867178 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f2c5402a070 0x7f2c5404b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.400+0000 7f2c61816640 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5e5d40 con 0x7f2c5402a070 2024-09-18T01:45:45.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.400+0000 7f2c5bfff640 1 --2- 172.21.15.146:0/3700867178 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f2c5402a070 0x7f2c5404b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.400+0000 7f2c5bfff640 1 --2- 172.21.15.146:0/3700867178 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f2c5402a070 0x7f2c5404b0b0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.401+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c4c057030 con 0x7f2c5402a070 2024-09-18T01:45:45.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.401+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5e5d40 con 0x564b1e5dd0b0 2024-09-18T01:45:45.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.401+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2c4c057030 con 0x564b1e5dd0b0 2024-09-18T01:45:45.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.401+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5e5d40 con 0x564b1e5dd0b0 2024-09-18T01:45:45.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.401+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c4c057030 con 0x564b1e5dd0b0 2024-09-18T01:45:45.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.401+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5e5d40 con 0x7f2c5402a070 2024-09-18T01:45:45.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.402+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c4c057030 con 0x7f2c5402a070 2024-09-18T01:45:45.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.402+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5e5d40 con 0x7f2c5402a070 2024-09-18T01:45:45.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.402+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c4c057030 con 0x7f2c5402a070 2024-09-18T01:45:45.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.402+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5e5d40 con 0x7f2c5c0123a0 2024-09-18T01:45:45.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.402+0000 7f2c61816640 1 -- 172.21.15.146:0/3700867178 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c54046050 con 0x7f2c5c0123a0 2024-09-18T01:45:45.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.402+0000 7f2c61816640 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5e5d40 con 0x564b1e5e3320 2024-09-18T01:45:45.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.402+0000 7f2c62017640 1 -- 172.21.15.146:0/3700867178 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c5c057040 con 0x564b1e5e3320 2024-09-18T01:45:45.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.402+0000 7f2c62017640 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5e5d40 con 0x564b1e5dd0b0 2024-09-18T01:45:45.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.402+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c4c057030 con 0x564b1e5dd0b0 2024-09-18T01:45:45.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.402+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5e5d40 con 0x7f2c5402a070 2024-09-18T01:45:45.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.403+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c4c057030 con 0x7f2c5402a070 2024-09-18T01:45:45.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.403+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5e5d40 con 0x564b1e5dd0b0 2024-09-18T01:45:45.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.403+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c4c057030 con 0x564b1e5dd0b0 2024-09-18T01:45:45.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.403+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5e5d40 con 0x7f2c5c0123a0 2024-09-18T01:45:45.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.403+0000 7f2c61816640 1 -- 172.21.15.146:0/3700867178 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f2c54046050 con 0x7f2c5c0123a0 2024-09-18T01:45:45.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.403+0000 7f2c61816640 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f2c540580a0 con 0x564b1e5e3320 2024-09-18T01:45:45.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.403+0000 7f2c62017640 1 -- 172.21.15.146:0/3700867178 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c5c057040 con 0x564b1e5e3320 2024-09-18T01:45:45.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.403+0000 7f2c62017640 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f2c540580a0 con 0x564b1e5e3320 2024-09-18T01:45:45.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.404+0000 7f2c62017640 1 -- 172.21.15.146:0/3700867178 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c5c057040 con 0x564b1e5e3320 2024-09-18T01:45:45.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.404+0000 7f2c62017640 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f2c540580a0 con 0x7f2c5402a070 2024-09-18T01:45:45.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.404+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c4c057030 con 0x7f2c5402a070 2024-09-18T01:45:45.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.404+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f2c540580a0 con 0x564b1e5e3320 2024-09-18T01:45:45.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.404+0000 7f2c62017640 1 -- 172.21.15.146:0/3700867178 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c5c057040 con 0x564b1e5e3320 2024-09-18T01:45:45.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.404+0000 7f2c62017640 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f2c540580a0 con 0x564b1e5e3320 2024-09-18T01:45:45.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.404+0000 7f2c62017640 1 -- 172.21.15.146:0/3700867178 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c5c057040 con 0x564b1e5e3320 2024-09-18T01:45:45.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.404+0000 7f2c62017640 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f2c540580a0 con 0x564b1e5dd0b0 2024-09-18T01:45:45.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.405+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c4c057030 con 0x564b1e5dd0b0 2024-09-18T01:45:45.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.405+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f2c540580a0 con 0x564b1e5dd0b0 2024-09-18T01:45:45.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.405+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2c4c057030 con 0x564b1e5dd0b0 2024-09-18T01:45:45.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.405+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f2c540580a0 con 0x7f2c5402a070 2024-09-18T01:45:45.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.405+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c4c057030 con 0x7f2c5402a070 2024-09-18T01:45:45.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.405+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f2c540580a0 con 0x564b1e5e3320 2024-09-18T01:45:45.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.405+0000 7f2c62017640 1 -- 172.21.15.146:0/3700867178 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c5c057040 con 0x564b1e5e3320 2024-09-18T01:45:45.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.405+0000 7f2c62017640 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f2c540580a0 con 0x7f2c5c0123a0 2024-09-18T01:45:45.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.406+0000 7f2c61816640 1 -- 172.21.15.146:0/3700867178 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c54046050 con 0x7f2c5c0123a0 2024-09-18T01:45:45.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.406+0000 7f2c61816640 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f2c540580a0 con 0x564b1e5dd0b0 2024-09-18T01:45:45.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.406+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c4c057030 con 0x564b1e5dd0b0 2024-09-18T01:45:45.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.406+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f2c540580a0 con 0x7f2c5402a070 2024-09-18T01:45:45.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.406+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c4c057030 con 0x7f2c5402a070 2024-09-18T01:45:45.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.406+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f2c540580a0 con 0x564b1e5e3320 2024-09-18T01:45:45.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.406+0000 7f2c62017640 1 -- 172.21.15.146:0/3700867178 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c5c057040 con 0x564b1e5e3320 2024-09-18T01:45:45.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.406+0000 7f2c62017640 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f2c540580a0 con 0x7f2c5402a070 2024-09-18T01:45:45.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.407+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c4c057030 con 0x7f2c5402a070 2024-09-18T01:45:45.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.407+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f2c540580a0 con 0x7f2c5c0123a0 2024-09-18T01:45:45.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.407+0000 7f2c61816640 1 -- 172.21.15.146:0/3700867178 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c54046050 con 0x7f2c5c0123a0 2024-09-18T01:45:45.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.407+0000 7f2c61816640 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f2c540580a0 con 0x564b1e5e3320 2024-09-18T01:45:45.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.407+0000 7f2c62017640 1 -- 172.21.15.146:0/3700867178 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c5c057040 con 0x564b1e5e3320 2024-09-18T01:45:45.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.407+0000 7f2c62017640 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f2c540580a0 con 0x7f2c5402a070 2024-09-18T01:45:45.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.407+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c4c057030 con 0x7f2c5402a070 2024-09-18T01:45:45.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.407+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f2c540580a0 con 0x564b1e5dd0b0 2024-09-18T01:45:45.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.407+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2c4c057030 con 0x564b1e5dd0b0 2024-09-18T01:45:45.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.407+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f2c540580a0 con 0x7f2c5c0123a0 2024-09-18T01:45:45.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.408+0000 7f2c61816640 1 -- 172.21.15.146:0/3700867178 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c54046050 con 0x7f2c5c0123a0 2024-09-18T01:45:45.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.408+0000 7f2c65b22800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:45.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.408+0000 7f2c65b22800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:45.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.408+0000 7f2c65b22800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:45.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.408+0000 7f2c65b22800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:45.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.408+0000 7f2c65b22800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:45.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.408+0000 7f2c65b22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:45.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.408+0000 7f2c65b22800 20 rados->read ofs=0 len=0 2024-09-18T01:45:45.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.408+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5e1f30 con 0x564b1e5dd0b0 2024-09-18T01:45:45.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.408+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2c4c057030 con 0x564b1e5dd0b0 2024-09-18T01:45:45.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.408+0000 7f2c65b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:45.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.408+0000 7f2c65b22800 20 rados->read ofs=0 len=0 2024-09-18T01:45:45.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.408+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5e27d0 con 0x564b1e5dd0b0 2024-09-18T01:45:45.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.408+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2c4c057030 con 0x564b1e5dd0b0 2024-09-18T01:45:45.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.408+0000 7f2c65b22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:45.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.408+0000 7f2c65b22800 20 rados->read ofs=0 len=0 2024-09-18T01:45:45.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.408+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5e61c0 con 0x7f2c5c0123a0 2024-09-18T01:45:45.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.408+0000 7f2c61816640 1 -- 172.21.15.146:0/3700867178 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2c54046050 con 0x7f2c5c0123a0 2024-09-18T01:45:45.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.408+0000 7f2c65b22800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:45.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.408+0000 7f2c65b22800 20 zone default found 2024-09-18T01:45:45.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.408+0000 7f2c65b22800 4 Realm: () 2024-09-18T01:45:45.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.408+0000 7f2c65b22800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:45.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.408+0000 7f2c65b22800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:45.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.408+0000 7f2c65b22800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:45.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.408+0000 7f2c65b22800 20 zonegroup default 2024-09-18T01:45:45.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.408+0000 7f2c65b22800 20 rados->read ofs=0 len=0 2024-09-18T01:45:45.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.409+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5e6a10 con 0x7f2c5402a070 2024-09-18T01:45:45.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.409+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2c4c057030 con 0x7f2c5402a070 2024-09-18T01:45:45.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.409+0000 7f2c65b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:45.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.409+0000 7f2c65b22800 20 rados->read ofs=0 len=0 2024-09-18T01:45:45.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.409+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5e83f0 con 0x564b1e5e3320 2024-09-18T01:45:45.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.409+0000 7f2c62017640 1 -- 172.21.15.146:0/3700867178 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2c5c057040 con 0x564b1e5e3320 2024-09-18T01:45:45.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.409+0000 7f2c65b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:45.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.409+0000 7f2c65b22800 20 rados->read ofs=0 len=0 2024-09-18T01:45:45.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.409+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5e8910 con 0x564b1e5e3320 2024-09-18T01:45:45.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.409+0000 7f2c62017640 1 -- 172.21.15.146:0/3700867178 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2c5c057040 con 0x564b1e5e3320 2024-09-18T01:45:45.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.409+0000 7f2c65b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:45.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.409+0000 7f2c65b22800 20 started sync module instance, tier type = 2024-09-18T01:45:45.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.409+0000 7f2c65b22800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:45.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.409+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5e7830 con 0x7f2c5c0123a0 2024-09-18T01:45:45.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.410+0000 7f2c61816640 1 -- 172.21.15.146:0/3700867178 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v33'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c54046050 con 0x7f2c5c0123a0 2024-09-18T01:45:45.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.410+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94880632044624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5e7830 con 0x7f2c5c0123a0 2024-09-18T01:45:45.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.410+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5e9220 con 0x564b1e5dd0b0 2024-09-18T01:45:45.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.411+0000 7f2c61816640 1 -- 172.21.15.146:0/3700867178 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94880632044624] v33'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c54046050 con 0x7f2c5c0123a0 2024-09-18T01:45:45.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.412+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v33'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c4c057030 con 0x564b1e5dd0b0 2024-09-18T01:45:45.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.412+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94880632042640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5e9220 con 0x564b1e5dd0b0 2024-09-18T01:45:45.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.412+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5e9ab0 con 0x564b1e5e3320 2024-09-18T01:45:45.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.413+0000 7f2c62017640 1 -- 172.21.15.146:0/3700867178 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v33'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c5c057040 con 0x564b1e5e3320 2024-09-18T01:45:45.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.413+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94880632050208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5e96c0 con 0x564b1e5e3320 2024-09-18T01:45:45.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.413+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5eaab0 con 0x7f2c5c0123a0 2024-09-18T01:45:45.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.413+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94880632042640] v33'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c4c057030 con 0x564b1e5dd0b0 2024-09-18T01:45:45.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.414+0000 7f2c62017640 1 -- 172.21.15.146:0/3700867178 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94880632050208] v33'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c5c057040 con 0x564b1e5e3320 2024-09-18T01:45:45.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.414+0000 7f2c61816640 1 -- 172.21.15.146:0/3700867178 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v33'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c54046050 con 0x7f2c5c0123a0 2024-09-18T01:45:45.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.414+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94880632053456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5eaa70 con 0x7f2c5c0123a0 2024-09-18T01:45:45.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.414+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5eb350 con 0x564b1e5dd0b0 2024-09-18T01:45:45.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.415+0000 7f2c61816640 1 -- 172.21.15.146:0/3700867178 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94880632053456] v33'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c54046050 con 0x7f2c5c0123a0 2024-09-18T01:45:45.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.415+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v33'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c4c057030 con 0x564b1e5dd0b0 2024-09-18T01:45:45.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.415+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94880632055200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5eaa70 con 0x564b1e5dd0b0 2024-09-18T01:45:45.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.415+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5eba20 con 0x7f2c5402a070 2024-09-18T01:45:45.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.416+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94880632055200] v33'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c4c057030 con 0x564b1e5dd0b0 2024-09-18T01:45:45.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.416+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v33'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c4c057030 con 0x7f2c5402a070 2024-09-18T01:45:45.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.416+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94880632059120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5eb9e0 con 0x7f2c5402a070 2024-09-18T01:45:45.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.417+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5ec430 con 0x7f2c5402a070 2024-09-18T01:45:45.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.417+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94880632059120] v33'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c4c057030 con 0x7f2c5402a070 2024-09-18T01:45:45.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.418+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v33'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c4c057030 con 0x7f2c5402a070 2024-09-18T01:45:45.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.418+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94880632057504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5ec430 con 0x7f2c5402a070 2024-09-18T01:45:45.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.418+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5ecdf0 con 0x7f2c5402a070 2024-09-18T01:45:45.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.420+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94880632057504] v33'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c4c057030 con 0x7f2c5402a070 2024-09-18T01:45:45.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.420+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v33'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c4c057030 con 0x7f2c5402a070 2024-09-18T01:45:45.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.420+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94880632061824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5ecdf0 con 0x7f2c5402a070 2024-09-18T01:45:45.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.420+0000 7f2c65b22800 20 add_watcher() i=0 2024-09-18T01:45:45.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.420+0000 7f2c65b22800 20 add_watcher() i=1 2024-09-18T01:45:45.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.420+0000 7f2c65b22800 20 add_watcher() i=2 2024-09-18T01:45:45.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.420+0000 7f2c65b22800 20 add_watcher() i=3 2024-09-18T01:45:45.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.420+0000 7f2c65b22800 20 add_watcher() i=4 2024-09-18T01:45:45.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.420+0000 7f2c65b22800 20 add_watcher() i=5 2024-09-18T01:45:45.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.420+0000 7f2c65b22800 20 add_watcher() i=6 2024-09-18T01:45:45.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.421+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94880632061824] v33'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c4c057030 con 0x7f2c5402a070 2024-09-18T01:45:45.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.421+0000 7f2c65b22800 20 add_watcher() i=7 2024-09-18T01:45:45.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.421+0000 7f2c65b22800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:45.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.421+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5f0220 con 0x564b1e5dd0b0 2024-09-18T01:45:45.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.421+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2c4c057030 con 0x564b1e5dd0b0 2024-09-18T01:45:45.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.421+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94880632064784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5ed6e0 con 0x564b1e5dd0b0 2024-09-18T01:45:45.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.422+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94880632064784] v33'179 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2c4c057030 con 0x564b1e5dd0b0 2024-09-18T01:45:45.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.423+0000 7f2b137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:45.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.423+0000 7f2c65b22800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:45.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.423+0000 7f2c65b22800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:45.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.423+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5f0020 con 0x564b1e5dd0b0 2024-09-18T01:45:45.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.424+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'54 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2c4c057030 con 0x564b1e5dd0b0 2024-09-18T01:45:45.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.424+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5f9330 con 0x7f2c5402a070 2024-09-18T01:45:45.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.426+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2c4c057030 con 0x7f2c5402a070 2024-09-18T01:45:45.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.427+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5f9750 con 0x564b1e5e3320 2024-09-18T01:45:45.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.428+0000 7f2c62017640 1 -- 172.21.15.146:0/3700867178 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2c5c057040 con 0x564b1e5e3320 2024-09-18T01:45:45.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.428+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5f9710 con 0x564b1e5dd0b0 2024-09-18T01:45:45.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.429+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'180 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2c4c057030 con 0x564b1e5dd0b0 2024-09-18T01:45:45.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.429+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5f9ca0 con 0x7f2c5c0123a0 2024-09-18T01:45:45.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.430+0000 7f2c61816640 1 -- 172.21.15.146:0/3700867178 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'65 uv57 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2c54046050 con 0x7f2c5c0123a0 2024-09-18T01:45:45.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.430+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5fa0e0 con 0x564b1e5e3320 2024-09-18T01:45:45.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.431+0000 7f2c62017640 1 -- 172.21.15.146:0/3700867178 <== osd.3 v2:172.21.15.146:6809/4106661138 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'55 uv50 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2c5c057040 con 0x564b1e5e3320 2024-09-18T01:45:45.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.431+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5fa0e0 con 0x564b1e5dd0b0 2024-09-18T01:45:45.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.432+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2c4c057030 con 0x564b1e5dd0b0 2024-09-18T01:45:45.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.432+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5fa170 con 0x7f2c5402a070 2024-09-18T01:45:45.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.433+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'45 uv40 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2c4c057030 con 0x7f2c5402a070 2024-09-18T01:45:45.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.433+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5fa170 con 0x7f2c5c0123a0 2024-09-18T01:45:45.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.434+0000 7f2c61816640 1 -- 172.21.15.146:0/3700867178 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2c54046050 con 0x7f2c5c0123a0 2024-09-18T01:45:45.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.434+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5fa760 con 0x564b1e5e3320 2024-09-18T01:45:45.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.435+0000 7f2c62017640 1 -- 172.21.15.146:0/3700867178 <== osd.3 v2:172.21.15.146:6809/4106661138 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2c5c057040 con 0x564b1e5e3320 2024-09-18T01:45:45.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.435+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5fa760 con 0x7f2c5c0123a0 2024-09-18T01:45:45.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.435+0000 7f2c61816640 1 -- 172.21.15.146:0/3700867178 <== osd.2 v2:172.21.15.146:6800/3820039304 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'66 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2c54046050 con 0x7f2c5c0123a0 2024-09-18T01:45:45.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.436+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5fa760 con 0x7f2c5402a070 2024-09-18T01:45:45.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.437+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2c4c057030 con 0x7f2c5402a070 2024-09-18T01:45:45.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.437+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5fa760 con 0x7f2c5c0123a0 2024-09-18T01:45:45.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.437+0000 7f2c61816640 1 -- 172.21.15.146:0/3700867178 <== osd.2 v2:172.21.15.146:6800/3820039304 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2c54046050 con 0x7f2c5c0123a0 2024-09-18T01:45:45.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.438+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5fa760 con 0x7f2c5402a070 2024-09-18T01:45:45.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.439+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'57 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2c4c057030 con 0x7f2c5402a070 2024-09-18T01:45:45.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.439+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5fa760 con 0x564b1e5dd0b0 2024-09-18T01:45:45.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.440+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'181 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2c4c057030 con 0x564b1e5dd0b0 2024-09-18T01:45:45.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.440+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5fa760 con 0x564b1e5e3320 2024-09-18T01:45:45.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.441+0000 7f2c62017640 1 -- 172.21.15.146:0/3700867178 <== osd.3 v2:172.21.15.146:6809/4106661138 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'59 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2c5c057040 con 0x564b1e5e3320 2024-09-18T01:45:45.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.441+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5ef9a0 con 0x7f2c5c0123a0 2024-09-18T01:45:45.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.442+0000 7f2c61816640 1 -- 172.21.15.146:0/3700867178 <== osd.2 v2:172.21.15.146:6800/3820039304 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'67 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2c54046050 con 0x7f2c5c0123a0 2024-09-18T01:45:45.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.442+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5ef9a0 con 0x564b1e5e3320 2024-09-18T01:45:45.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.443+0000 7f2c62017640 1 -- 172.21.15.146:0/3700867178 <== osd.3 v2:172.21.15.146:6809/4106661138 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'36 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2c5c057040 con 0x564b1e5e3320 2024-09-18T01:45:45.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.443+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5ef9a0 con 0x564b1e5dd0b0 2024-09-18T01:45:45.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.444+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2c4c057030 con 0x564b1e5dd0b0 2024-09-18T01:45:45.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.444+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5ef9a0 con 0x564b1e5dd0b0 2024-09-18T01:45:45.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.445+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'182 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2c4c057030 con 0x564b1e5dd0b0 2024-09-18T01:45:45.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.445+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5ef9a0 con 0x564b1e5e3320 2024-09-18T01:45:45.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.446+0000 7f2c62017640 1 -- 172.21.15.146:0/3700867178 <== osd.3 v2:172.21.15.146:6809/4106661138 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'60 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2c5c057040 con 0x564b1e5e3320 2024-09-18T01:45:45.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.446+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5ef9a0 con 0x7f2c5c0123a0 2024-09-18T01:45:45.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.447+0000 7f2c61816640 1 -- 172.21.15.146:0/3700867178 <== osd.2 v2:172.21.15.146:6800/3820039304 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'39 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2c54046050 con 0x7f2c5c0123a0 2024-09-18T01:45:45.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.447+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5ef9a0 con 0x564b1e5e3320 2024-09-18T01:45:45.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.447+0000 7f2c62017640 1 -- 172.21.15.146:0/3700867178 <== osd.3 v2:172.21.15.146:6809/4106661138 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2c5c057040 con 0x564b1e5e3320 2024-09-18T01:45:45.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.448+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5ef9a0 con 0x564b1e5e3320 2024-09-18T01:45:45.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.448+0000 7f2c62017640 1 -- 172.21.15.146:0/3700867178 <== osd.3 v2:172.21.15.146:6809/4106661138 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'41 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2c5c057040 con 0x564b1e5e3320 2024-09-18T01:45:45.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.448+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5fa170 con 0x564b1e5e3320 2024-09-18T01:45:45.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.449+0000 7f2c62017640 1 -- 172.21.15.146:0/3700867178 <== osd.3 v2:172.21.15.146:6809/4106661138 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2c5c057040 con 0x564b1e5e3320 2024-09-18T01:45:45.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.449+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5fa170 con 0x564b1e5e3320 2024-09-18T01:45:45.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.450+0000 7f2c62017640 1 -- 172.21.15.146:0/3700867178 <== osd.3 v2:172.21.15.146:6809/4106661138 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'56 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2c5c057040 con 0x564b1e5e3320 2024-09-18T01:45:45.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.450+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5fa760 con 0x7f2c5402a070 2024-09-18T01:45:45.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.451+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'32 uv30 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2c4c057030 con 0x7f2c5402a070 2024-09-18T01:45:45.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.451+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5fa760 con 0x564b1e5e3320 2024-09-18T01:45:45.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.452+0000 7f2c62017640 1 -- 172.21.15.146:0/3700867178 <== osd.3 v2:172.21.15.146:6809/4106661138 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'35 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2c5c057040 con 0x564b1e5e3320 2024-09-18T01:45:45.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.452+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5fa170 con 0x7f2c5402a070 2024-09-18T01:45:45.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.454+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.0 v2:172.21.15.129:6800/1759265424 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'46 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2c4c057030 con 0x7f2c5402a070 2024-09-18T01:45:45.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.454+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5fa170 con 0x564b1e5e3320 2024-09-18T01:45:45.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.455+0000 7f2c62017640 1 -- 172.21.15.146:0/3700867178 <== osd.3 v2:172.21.15.146:6809/4106661138 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'61 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2c5c057040 con 0x564b1e5e3320 2024-09-18T01:45:45.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.455+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5fa170 con 0x7f2c5402a070 2024-09-18T01:45:45.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.455+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.0 v2:172.21.15.129:6800/1759265424 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'58 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2c4c057030 con 0x7f2c5402a070 2024-09-18T01:45:45.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.455+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5fa170 con 0x7f2c5c0123a0 2024-09-18T01:45:45.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.456+0000 7f2c61816640 1 -- 172.21.15.146:0/3700867178 <== osd.2 v2:172.21.15.146:6800/3820039304 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2c54046050 con 0x7f2c5c0123a0 2024-09-18T01:45:45.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.457+0000 7f2b127fc640 20 reqs_thread_entry: start 2024-09-18T01:45:45.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.457+0000 7f2c65b22800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:45.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.457+0000 7f2c65b22800 20 Filter name: none 2024-09-18T01:45:45.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.457+0000 7f2a83fff640 20 reqs_thread_entry: start 2024-09-18T01:45:45.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.457+0000 7f2c65b22800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T01:45:45.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.457+0000 7f2c65b22800 20 rados->read ofs=0 len=0 2024-09-18T01:45:45.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.457+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564b1e6255a0 con 0x564b1e5dd0b0 2024-09-18T01:45:45.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.457+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.1 v2:172.21.15.146:6808/3930274777 28 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f2c4c057030 con 0x564b1e5dd0b0 2024-09-18T01:45:45.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.457+0000 7f2c65b22800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:45:45.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.457+0000 7f2c65b22800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T01:45:45.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.457+0000 7f2c65b22800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:45:45.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.457+0000 7f2c65b22800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:45:45.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.458+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564b1e625540 con 0x7f2c5c0123a0 2024-09-18T01:45:45.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.458+0000 7f2c61816640 1 -- 172.21.15.146:0/3700867178 <== osd.2 v2:172.21.15.146:6800/3820039304 19 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f2c54046050 con 0x7f2c5c0123a0 2024-09-18T01:45:45.460 INFO:teuthology.orchestra.run.smithi146.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-18T01:45:45.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.459+0000 7f2b137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:45.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.459+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94880632064784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5d94e0 con 0x564b1e5dd0b0 2024-09-18T01:45:45.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.460+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.1 v2:172.21.15.146:6808/3930274777 29 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94880632064784] v33'183 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2c4c057030 con 0x564b1e5dd0b0 2024-09-18T01:45:45.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.460+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94880632044624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5ecae0 con 0x7f2c5c0123a0 2024-09-18T01:45:45.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.461+0000 7f2c61816640 1 -- 172.21.15.146:0/3700867178 <== osd.2 v2:172.21.15.146:6800/3820039304 20 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94880632044624] v33'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c54046050 con 0x7f2c5c0123a0 2024-09-18T01:45:45.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.461+0000 7f2c65b22800 20 remove_watcher() i=0 2024-09-18T01:45:45.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.461+0000 7f2c65b22800 2 removed watcher, disabling cache 2024-09-18T01:45:45.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.461+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94880632042640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5e7c50 con 0x564b1e5dd0b0 2024-09-18T01:45:45.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.462+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.1 v2:172.21.15.146:6808/3930274777 30 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94880632042640] v33'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c4c057030 con 0x564b1e5dd0b0 2024-09-18T01:45:45.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.462+0000 7f2c65b22800 20 remove_watcher() i=1 2024-09-18T01:45:45.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.462+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94880632050208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5e7c50 con 0x564b1e5e3320 2024-09-18T01:45:45.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.463+0000 7f2c62017640 1 -- 172.21.15.146:0/3700867178 <== osd.3 v2:172.21.15.146:6809/4106661138 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94880632050208] v33'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c5c057040 con 0x564b1e5e3320 2024-09-18T01:45:45.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.463+0000 7f2c65b22800 20 remove_watcher() i=2 2024-09-18T01:45:45.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.463+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94880632053456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5e9220 con 0x7f2c5c0123a0 2024-09-18T01:45:45.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.464+0000 7f2c61816640 1 -- 172.21.15.146:0/3700867178 <== osd.2 v2:172.21.15.146:6800/3820039304 21 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94880632053456] v33'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c54046050 con 0x7f2c5c0123a0 2024-09-18T01:45:45.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.464+0000 7f2c65b22800 20 remove_watcher() i=3 2024-09-18T01:45:45.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.464+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94880632055200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5e7c50 con 0x564b1e5dd0b0 2024-09-18T01:45:45.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.465+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.1 v2:172.21.15.146:6808/3930274777 31 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94880632055200] v33'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c4c057030 con 0x564b1e5dd0b0 2024-09-18T01:45:45.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.465+0000 7f2c65b22800 20 remove_watcher() i=4 2024-09-18T01:45:45.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.465+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94880632059120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5e9220 con 0x7f2c5402a070 2024-09-18T01:45:45.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.466+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.0 v2:172.21.15.129:6800/1759265424 24 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94880632059120] v33'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c4c057030 con 0x7f2c5402a070 2024-09-18T01:45:45.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.466+0000 7f2c65b22800 20 remove_watcher() i=5 2024-09-18T01:45:45.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.466+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94880632057504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5ea5a0 con 0x7f2c5402a070 2024-09-18T01:45:45.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.467+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.0 v2:172.21.15.129:6800/1759265424 25 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94880632057504] v33'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c4c057030 con 0x7f2c5402a070 2024-09-18T01:45:45.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.467+0000 7f2c65b22800 20 remove_watcher() i=6 2024-09-18T01:45:45.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.467+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94880632061824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564b1e5e7c50 con 0x7f2c5402a070 2024-09-18T01:45:45.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.468+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 <== osd.0 v2:172.21.15.129:6800/1759265424 26 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94880632061824] v33'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c4c057030 con 0x7f2c5402a070 2024-09-18T01:45:45.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.468+0000 7f2c65b22800 20 remove_watcher() i=7 2024-09-18T01:45:45.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.468+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f2c5402a070 msgr2=0x7f2c5404b0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.468+0000 7f2c65b22800 1 --2- 172.21.15.146:0/3700867178 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f2c5402a070 0x7f2c5404b0b0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.468+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564b1e5dd0b0 msgr2=0x564b1e5df570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.468+0000 7f2c65b22800 1 --2- 172.21.15.146:0/3700867178 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564b1e5dd0b0 0x564b1e5df570 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.468+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f2c5c0123a0 msgr2=0x7f2c5c036580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.468+0000 7f2c65b22800 1 --2- 172.21.15.146:0/3700867178 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f2c5c0123a0 0x7f2c5c036580 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.468+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x564b1e5e3320 msgr2=0x564b1e5e5710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.468+0000 7f2c65b22800 1 --2- 172.21.15.146:0/3700867178 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x564b1e5e3320 0x564b1e5e5710 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.468+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2b2c036b90 msgr2=0x7f2b2c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.468+0000 7f2c65b22800 1 --2- 172.21.15.146:0/3700867178 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2b2c036b90 0x7f2b2c039050 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2c54001eb0 tx=0x7f2c54042000 comp rx=0 tx=0).stop 2024-09-18T01:45:45.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.468+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b1e5c9eb0 msgr2=0x564b1e5d1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.468+0000 7f2c5bfff640 1 -- 172.21.15.146:0/3700867178 reap_dead start 2024-09-18T01:45:45.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.468+0000 7f2c65b22800 1 --2- 172.21.15.146:0/3700867178 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b1e5c9eb0 0x564b1e5d1390 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c04b7b0 tx=0x7f2c5c04c820 comp rx=0 tx=0).stop 2024-09-18T01:45:45.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.468+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 shutdown_connections 2024-09-18T01:45:45.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.468+0000 7f2c65b22800 1 --2- 172.21.15.146:0/3700867178 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b1e5c9eb0 0x564b1e5d1390 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.468+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 >> 172.21.15.146:0/3700867178 conn(0x564b1e5c6210 msgr2=0x564b1e5c42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:45.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.469+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 shutdown_connections 2024-09-18T01:45:45.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.469+0000 7f2c65b22800 1 -- 172.21.15.146:0/3700867178 wait complete. 2024-09-18T01:45:45.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.469+0000 7f2c65b22800 1 -- 172.21.15.146:0/123683731 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2b3c036b90 msgr2=0x7f2b3c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.469+0000 7f2c65b22800 1 --2- 172.21.15.146:0/123683731 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2b3c036b90 0x7f2b3c039050 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2c54049ea0 tx=0x7f2c54049d70 comp rx=0 tx=0).stop 2024-09-18T01:45:45.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.469+0000 7f2c65b22800 1 -- 172.21.15.146:0/123683731 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b1e5bd210 msgr2=0x564b1e5bd630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.469+0000 7f2c65b22800 1 --2- 172.21.15.146:0/123683731 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b1e5bd210 0x564b1e5bd630 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x564b1e5a38a0 tx=0x7f2c5c0178e0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.469+0000 7f2c65b22800 1 -- 172.21.15.146:0/123683731 shutdown_connections 2024-09-18T01:45:45.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.469+0000 7f2c65b22800 1 --2- 172.21.15.146:0/123683731 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2b3c036b90 0x7f2b3c039050 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.469+0000 7f2c65b22800 1 --2- 172.21.15.146:0/123683731 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b1e5bd210 0x564b1e5bd630 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.469+0000 7f2c65b22800 1 -- 172.21.15.146:0/123683731 >> 172.21.15.146:0/123683731 conn(0x564b1e5b21a0 msgr2=0x564b1e5b4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:45.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.469+0000 7f2c65b22800 1 -- 172.21.15.146:0/123683731 shutdown_connections 2024-09-18T01:45:45.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.469+0000 7f2c65b22800 1 -- 172.21.15.146:0/123683731 wait complete. 2024-09-18T01:45:45.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.469+0000 7f2c65b22800 1 -- 172.21.15.146:0/3717587036 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564b1e4ac960 msgr2=0x564b1e5a9510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.469+0000 7f2c65b22800 1 --2- 172.21.15.146:0/3717587036 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564b1e4ac960 0x564b1e5a9510 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.469+0000 7f2c65b22800 1 -- 172.21.15.146:0/3717587036 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x564b1e5acc80 msgr2=0x564b1e5af070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.469+0000 7f2c65b22800 1 --2- 172.21.15.146:0/3717587036 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x564b1e5acc80 0x564b1e5af070 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.469+0000 7f2c65b22800 1 -- 172.21.15.146:0/3717587036 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2b48036b90 msgr2=0x7f2b48039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.469+0000 7f2c65b22800 1 --2- 172.21.15.146:0/3717587036 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2b48036b90 0x7f2b48039050 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c057000 tx=0x7f2c4c052000 comp rx=0 tx=0).stop 2024-09-18T01:45:45.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.469+0000 7f2c65b22800 1 -- 172.21.15.146:0/3717587036 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b1e4a8aa0 msgr2=0x564b1e5a24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.469+0000 7f2c65b22800 1 --2- 172.21.15.146:0/3717587036 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b1e4a8aa0 0x564b1e5a24a0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f2c54000fb0 tx=0x7f2c54000bc0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.469+0000 7f2c65b22800 1 -- 172.21.15.146:0/3717587036 shutdown_connections 2024-09-18T01:45:45.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.469+0000 7f2c65b22800 1 --2- 172.21.15.146:0/3717587036 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x564b1e5acc80 0x564b1e5af070 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.469+0000 7f2c65b22800 1 --2- 172.21.15.146:0/3717587036 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564b1e4ac960 0x564b1e5a9510 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.469+0000 7f2c65b22800 1 --2- 172.21.15.146:0/3717587036 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2b48036b90 0x7f2b48039050 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.469+0000 7f2c65b22800 1 --2- 172.21.15.146:0/3717587036 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564b1e4a8aa0 0x564b1e5a24a0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.469+0000 7f2c65b22800 1 -- 172.21.15.146:0/3717587036 >> 172.21.15.146:0/3717587036 conn(0x564b1e4a35c0 msgr2=0x564b1e591a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:45.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.470+0000 7f2c65b22800 1 -- 172.21.15.146:0/3717587036 shutdown_connections 2024-09-18T01:45:45.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.470+0000 7f2c65b22800 1 -- 172.21.15.146:0/3717587036 wait complete. 2024-09-18T01:45:45.479 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-18T01:45:45.488 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=236 failed=True 2024-09-18T01:45:45.492 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T01:45:45.523 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T01:45:45.533 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T01:45:45.581 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-18T01:45:45.586 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T01:45:45.586 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-18T01:45:45.586 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-18T01:45:45.586 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-18T01:45:45.631 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:45.631 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:45.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.630+0000 7f871be30800 1 Processor -- start 2024-09-18T01:45:45.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.631+0000 7f871be30800 1 -- start start 2024-09-18T01:45:45.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.631+0000 7f871be30800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x56054a4b2d40 0x56054a4b5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.631+0000 7f871be30800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56054a36bb30 con 0x56054a420610 2024-09-18T01:45:45.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.631+0000 7f871be30800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x56054a34d360 con 0x56054a4b2d40 2024-09-18T01:45:45.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.631+0000 7f870e94a640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x56054a4b2d40 0x56054a4b5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.631+0000 7f870e94a640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x56054a4b2d40 0x56054a4b5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38286/0 (socket says 172.21.15.146:38286) 2024-09-18T01:45:45.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.631+0000 7f871714b640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x56054a420610 0x56054a4b1620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:45864/0 (socket says 172.21.15.146:45864) 2024-09-18T01:45:45.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.631+0000 7f870e94a640 1 -- 172.21.15.146:0/3401564977 learned_addr learned my addr 172.21.15.146:0/3401564977 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:45.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.631+0000 7f870e94a640 1 -- 172.21.15.146:0/3401564977 >> v1:172.21.15.129:6789/0 conn(0x56054a420610 legacy=0x56054a4b1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.631+0000 7f870e94a640 1 -- 172.21.15.146:0/3401564977 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56054a373e00 con 0x56054a4b2d40 2024-09-18T01:45:45.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.631+0000 7f871694a640 1 -- 172.21.15.146:0/3401564977 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 403151278 0 0) 0x56054a36bb30 con 0x56054a420610 2024-09-18T01:45:45.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.633+0000 7f870e94a640 1 --2- 172.21.15.146:0/3401564977 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56054a4b2d40 0x56054a4b5130 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f870000a520 tx=0x7f8700045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c3708b7515eca23 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.633+0000 7f871694a640 1 -- 172.21.15.146:0/3401564977 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8700055070 con 0x56054a4b2d40 2024-09-18T01:45:45.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.633+0000 7f871694a640 1 -- 172.21.15.146:0/3401564977 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87000515b0 con 0x56054a4b2d40 2024-09-18T01:45:45.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.633+0000 7f871694a640 1 -- 172.21.15.146:0/3401564977 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87000518d0 con 0x56054a4b2d40 2024-09-18T01:45:45.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.634+0000 7f871be30800 1 -- 172.21.15.146:0/3401564977 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56054a4b2d40 msgr2=0x56054a4b5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.634+0000 7f871be30800 1 --2- 172.21.15.146:0/3401564977 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56054a4b2d40 0x56054a4b5130 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f870000a520 tx=0x7f8700045ba0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.634+0000 7f871be30800 1 -- 172.21.15.146:0/3401564977 shutdown_connections 2024-09-18T01:45:45.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.634+0000 7f871be30800 1 --2- 172.21.15.146:0/3401564977 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56054a4b2d40 0x56054a4b5130 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.634+0000 7f871be30800 1 -- 172.21.15.146:0/3401564977 >> 172.21.15.146:0/3401564977 conn(0x56054a4a6db0 msgr2=0x56054a4a91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:45.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.634+0000 7f871be30800 1 -- 172.21.15.146:0/3401564977 shutdown_connections 2024-09-18T01:45:45.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.634+0000 7f871be30800 1 -- 172.21.15.146:0/3401564977 wait complete. 2024-09-18T01:45:45.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.647+0000 7f871be30800 1 Processor -- start 2024-09-18T01:45:45.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.647+0000 7f871be30800 1 -- start start 2024-09-18T01:45:45.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.647+0000 7f871be30800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56054a420610 0x56054a59d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.647+0000 7f871be30800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x56054a3f8360 con 0x56054a420610 2024-09-18T01:45:45.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.648+0000 7f871714b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56054a420610 0x56054a59d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.648+0000 7f871714b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56054a420610 0x56054a59d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38294/0 (socket says 172.21.15.146:38294) 2024-09-18T01:45:45.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.648+0000 7f871714b640 1 -- 172.21.15.146:0/2366027147 learned_addr learned my addr 172.21.15.146:0/2366027147 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:45.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.648+0000 7f871714b640 1 -- 172.21.15.146:0/2366027147 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56054a345bc0 con 0x56054a420610 2024-09-18T01:45:45.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.648+0000 7f871714b640 1 --2- 172.21.15.146:0/2366027147 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56054a420610 0x56054a59d870 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f870800b240 tx=0x7f870800b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b47084d2bc812445 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.648+0000 7f860560a640 1 -- 172.21.15.146:0/2366027147 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8708008070 con 0x56054a420610 2024-09-18T01:45:45.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.648+0000 7f860560a640 1 -- 172.21.15.146:0/2366027147 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f870800d500 con 0x56054a420610 2024-09-18T01:45:45.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.648+0000 7f860560a640 1 -- 172.21.15.146:0/2366027147 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f870800d860 con 0x56054a420610 2024-09-18T01:45:45.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.649+0000 7f871be30800 1 -- 172.21.15.146:0/2366027147 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56054a420610 msgr2=0x56054a59d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.649+0000 7f871be30800 1 --2- 172.21.15.146:0/2366027147 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56054a420610 0x56054a59d870 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f870800b240 tx=0x7f870800b700 comp rx=0 tx=0).stop 2024-09-18T01:45:45.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.649+0000 7f871be30800 1 -- 172.21.15.146:0/2366027147 shutdown_connections 2024-09-18T01:45:45.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.649+0000 7f871be30800 1 --2- 172.21.15.146:0/2366027147 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56054a420610 0x56054a59d870 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.649+0000 7f871be30800 1 -- 172.21.15.146:0/2366027147 >> 172.21.15.146:0/2366027147 conn(0x56054a4a6db0 msgr2=0x56054a599230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:45.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.649+0000 7f871be30800 1 -- 172.21.15.146:0/2366027147 shutdown_connections 2024-09-18T01:45:45.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.649+0000 7f871be30800 1 -- 172.21.15.146:0/2366027147 wait complete. 2024-09-18T01:45:45.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.649+0000 7f871be30800 1 Processor -- start 2024-09-18T01:45:45.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.649+0000 7f871be30800 1 -- start start 2024-09-18T01:45:45.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.650+0000 7f871be30800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56054a420610 0x56054a5a52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.650+0000 7f871be30800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x56054a4b5910 con 0x56054a420610 2024-09-18T01:45:45.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.650+0000 7f871714b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56054a420610 0x56054a5a52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.650+0000 7f871714b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56054a420610 0x56054a5a52f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38298/0 (socket says 172.21.15.146:38298) 2024-09-18T01:45:45.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.650+0000 7f871714b640 1 -- 172.21.15.146:0/1187092411 learned_addr learned my addr 172.21.15.146:0/1187092411 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:45.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.650+0000 7f871714b640 1 -- 172.21.15.146:0/1187092411 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56054a359fe0 con 0x56054a420610 2024-09-18T01:45:45.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.650+0000 7f871714b640 1 --2- 172.21.15.146:0/1187092411 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56054a420610 0x56054a5a52f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x56054a59e6d0 tx=0x7f8708000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.650+0000 7f8603e07640 1 -- 172.21.15.146:0/1187092411 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8708019870 con 0x56054a420610 2024-09-18T01:45:45.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.650+0000 7f8603e07640 1 -- 172.21.15.146:0/1187092411 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8708019a10 con 0x56054a420610 2024-09-18T01:45:45.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.650+0000 7f871be30800 1 -- 172.21.15.146:0/1187092411 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56054a5a5830 con 0x56054a420610 2024-09-18T01:45:45.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.650+0000 7f8603e07640 1 -- 172.21.15.146:0/1187092411 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8708019d30 con 0x56054a420610 2024-09-18T01:45:45.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.650+0000 7f871be30800 1 -- 172.21.15.146:0/1187092411 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56054a5a5d50 con 0x56054a420610 2024-09-18T01:45:45.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.651+0000 7f8603e07640 1 -- 172.21.15.146:0/1187092411 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8708017040 con 0x56054a420610 2024-09-18T01:45:45.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.651+0000 7f8603e07640 1 --2- 172.21.15.146:0/1187092411 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f85fc036b40 0x7f85fc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.651+0000 7f8603e07640 1 -- 172.21.15.146:0/1187092411 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f8708015020 con 0x56054a420610 2024-09-18T01:45:45.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.651+0000 7f870e94a640 1 --2- 172.21.15.146:0/1187092411 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f85fc036b40 0x7f85fc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.652+0000 7f871be30800 1 --2- 172.21.15.146:0/1187092411 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56054a4b2d40 0x56054a5ac360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.652+0000 7f871be30800 1 -- 172.21.15.146:0/1187092411 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56054a5ac8a0 con 0x56054a4b2d40 2024-09-18T01:45:45.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.652+0000 7f871794c640 1 --2- 172.21.15.146:0/1187092411 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56054a4b2d40 0x56054a5ac360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.652+0000 7f870e94a640 1 --2- 172.21.15.146:0/1187092411 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f85fc036b40 0x7f85fc039000 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8700057000 tx=0x7f8700052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.652+0000 7f871794c640 1 --2- 172.21.15.146:0/1187092411 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56054a4b2d40 0x56054a5ac360 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.652+0000 7f871794c640 1 -- 172.21.15.146:0/1187092411 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f871000a4a0 con 0x56054a4b2d40 2024-09-18T01:45:45.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.652+0000 7f871be30800 1 -- 172.21.15.146:0/1187092411 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56054a5a9930 con 0x56054a4b2d40 2024-09-18T01:45:45.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.653+0000 7f871794c640 1 -- 172.21.15.146:0/1187092411 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f871000a4a0 con 0x56054a4b2d40 2024-09-18T01:45:45.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.653+0000 7f871be30800 1 -- 172.21.15.146:0/1187092411 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56054a5ae6a0 con 0x56054a4b2d40 2024-09-18T01:45:45.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.653+0000 7f871794c640 1 -- 172.21.15.146:0/1187092411 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f871000a4a0 con 0x56054a4b2d40 2024-09-18T01:45:45.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.653+0000 7f871be30800 1 -- 172.21.15.146:0/1187092411 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56054a5ad7e0 con 0x56054a4b2d40 2024-09-18T01:45:45.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.653+0000 7f871794c640 1 -- 172.21.15.146:0/1187092411 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f871000a4a0 con 0x56054a4b2d40 2024-09-18T01:45:45.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.653+0000 7f871be30800 1 --2- 172.21.15.146:0/1187092411 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x56054a5ae2b0 0x56054a5b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.653+0000 7f871be30800 1 -- 172.21.15.146:0/1187092411 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56054a5b2280 con 0x56054a5ae2b0 2024-09-18T01:45:45.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.653+0000 7f871714b640 1 --2- 172.21.15.146:0/1187092411 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x56054a5ae2b0 0x56054a5b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.653+0000 7f871714b640 1 --2- 172.21.15.146:0/1187092411 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x56054a5ae2b0 0x56054a5b1af0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.654+0000 7f871714b640 1 -- 172.21.15.146:0/1187092411 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f870802d070 con 0x56054a5ae2b0 2024-09-18T01:45:45.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.654+0000 7f871be30800 1 Processor -- start 2024-09-18T01:45:45.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.654+0000 7f871be30800 1 -- start start 2024-09-18T01:45:45.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.654+0000 7f871be30800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56054a5c0010 0x56054a5c0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.654+0000 7f871be30800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x56054a347580 con 0x56054a5c0010 2024-09-18T01:45:45.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.655+0000 7f871794c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56054a5c0010 0x56054a5c0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.655+0000 7f871794c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56054a5c0010 0x56054a5c0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38306/0 (socket says 172.21.15.146:38306) 2024-09-18T01:45:45.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.655+0000 7f871794c640 1 -- 172.21.15.146:0/381657594 learned_addr learned my addr 172.21.15.146:0/381657594 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:45.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.655+0000 7f871794c640 1 -- 172.21.15.146:0/381657594 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56054a5c0970 con 0x56054a5c0010 2024-09-18T01:45:45.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.655+0000 7f871794c640 1 --2- 172.21.15.146:0/381657594 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56054a5c0010 0x56054a5c0430 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x56054a5acc60 tx=0x7f87100178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.655+0000 7f8601602640 1 -- 172.21.15.146:0/381657594 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8710013440 con 0x56054a5c0010 2024-09-18T01:45:45.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.655+0000 7f8601602640 1 -- 172.21.15.146:0/381657594 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87100135e0 con 0x56054a5c0010 2024-09-18T01:45:45.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.655+0000 7f8601602640 1 -- 172.21.15.146:0/381657594 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87100138c0 con 0x56054a5c0010 2024-09-18T01:45:45.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.655+0000 7f871be30800 1 -- 172.21.15.146:0/381657594 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56054a5c0c00 con 0x56054a5c0010 2024-09-18T01:45:45.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.655+0000 7f871be30800 1 -- 172.21.15.146:0/381657594 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56054a5c38e0 con 0x56054a5c0010 2024-09-18T01:45:45.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.656+0000 7f8601602640 1 -- 172.21.15.146:0/381657594 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8710011040 con 0x56054a5c0010 2024-09-18T01:45:45.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.656+0000 7f8601602640 1 --2- 172.21.15.146:0/381657594 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f85f0036b90 0x7f85f0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.656+0000 7f8601602640 1 -- 172.21.15.146:0/381657594 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f871001d070 con 0x56054a5c0010 2024-09-18T01:45:45.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.656+0000 7f871714b640 1 --2- 172.21.15.146:0/381657594 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f85f0036b90 0x7f85f0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.656+0000 7f871be30800 1 Processor -- start 2024-09-18T01:45:45.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.656+0000 7f871be30800 1 -- start start 2024-09-18T01:45:45.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.656+0000 7f871714b640 1 --2- 172.21.15.146:0/381657594 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f85f0036b90 0x7f85f0039050 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f870800ffd0 tx=0x7f870804b670 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.657+0000 7f871be30800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56054a5ccc40 0x56054a5cd040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.657+0000 7f871be30800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x56054a59e020 con 0x56054a5ccc40 2024-09-18T01:45:45.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.657+0000 7f871794c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56054a5ccc40 0x56054a5cd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.657+0000 7f871794c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56054a5ccc40 0x56054a5cd040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38318/0 (socket says 172.21.15.146:38318) 2024-09-18T01:45:45.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.657+0000 7f871794c640 1 -- 172.21.15.146:0/4232459709 learned_addr learned my addr 172.21.15.146:0/4232459709 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:45.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.657+0000 7f871794c640 1 -- 172.21.15.146:0/4232459709 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56054a5cd580 con 0x56054a5ccc40 2024-09-18T01:45:45.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.657+0000 7f871794c640 1 --2- 172.21.15.146:0/4232459709 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56054a5ccc40 0x56054a5cd040 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f871004c890 tx=0x7f871004c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6916dc311373b6a server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.657+0000 7f85faffd640 1 -- 172.21.15.146:0/4232459709 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8710045070 con 0x56054a5ccc40 2024-09-18T01:45:45.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.657+0000 7f85faffd640 1 -- 172.21.15.146:0/4232459709 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8710012df0 con 0x56054a5ccc40 2024-09-18T01:45:45.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.657+0000 7f85faffd640 1 -- 172.21.15.146:0/4232459709 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8710021b80 con 0x56054a5ccc40 2024-09-18T01:45:45.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.658+0000 7f871be30800 1 -- 172.21.15.146:0/4232459709 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56054a5ccc40 msgr2=0x56054a5cd040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.658+0000 7f871be30800 1 --2- 172.21.15.146:0/4232459709 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56054a5ccc40 0x56054a5cd040 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f871004c890 tx=0x7f871004c9d0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.658+0000 7f871be30800 1 -- 172.21.15.146:0/4232459709 shutdown_connections 2024-09-18T01:45:45.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.658+0000 7f871be30800 1 --2- 172.21.15.146:0/4232459709 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56054a5ccc40 0x56054a5cd040 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.658+0000 7f871be30800 1 -- 172.21.15.146:0/4232459709 >> 172.21.15.146:0/4232459709 conn(0x56054a5c8ff0 msgr2=0x56054a5c70f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:45.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.658+0000 7f871be30800 1 -- 172.21.15.146:0/4232459709 shutdown_connections 2024-09-18T01:45:45.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.658+0000 7f871be30800 1 -- 172.21.15.146:0/4232459709 wait complete. 2024-09-18T01:45:45.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.658+0000 7f871be30800 1 Processor -- start 2024-09-18T01:45:45.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.658+0000 7f871be30800 1 -- start start 2024-09-18T01:45:45.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.658+0000 7f871be30800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56054a5ccc40 0x56054a5d4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.658+0000 7f871be30800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x56054a5cdc20 con 0x56054a5ccc40 2024-09-18T01:45:45.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.659+0000 7f871794c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56054a5ccc40 0x56054a5d4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.659+0000 7f871794c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56054a5ccc40 0x56054a5d4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38328/0 (socket says 172.21.15.146:38328) 2024-09-18T01:45:45.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.659+0000 7f871794c640 1 -- 172.21.15.146:0/3929091087 learned_addr learned my addr 172.21.15.146:0/3929091087 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:45.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.659+0000 7f871794c640 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56054a5d4680 con 0x56054a5ccc40 2024-09-18T01:45:45.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.659+0000 7f871794c640 1 --2- 172.21.15.146:0/3929091087 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56054a5ccc40 0x56054a5d4140 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f871004ca10 tx=0x7f871004c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.659+0000 7f85f97fa640 1 -- 172.21.15.146:0/3929091087 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f871003a070 con 0x56054a5ccc40 2024-09-18T01:45:45.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.659+0000 7f85f97fa640 1 -- 172.21.15.146:0/3929091087 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8710001540 con 0x56054a5ccc40 2024-09-18T01:45:45.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.659+0000 7f85f97fa640 1 -- 172.21.15.146:0/3929091087 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8710045040 con 0x56054a5ccc40 2024-09-18T01:45:45.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.659+0000 7f871be30800 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56054a5d4910 con 0x56054a5ccc40 2024-09-18T01:45:45.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.659+0000 7f871be30800 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56054a5d75c0 con 0x56054a5ccc40 2024-09-18T01:45:45.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.660+0000 7f85f97fa640 1 -- 172.21.15.146:0/3929091087 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f871003d070 con 0x56054a5ccc40 2024-09-18T01:45:45.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.660+0000 7f85f97fa640 1 --2- 172.21.15.146:0/3929091087 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f85e0036b90 0x7f85e0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.660+0000 7f85f97fa640 1 -- 172.21.15.146:0/3929091087 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f871000e040 con 0x56054a5ccc40 2024-09-18T01:45:45.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.660+0000 7f871714b640 1 --2- 172.21.15.146:0/3929091087 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f85e0036b90 0x7f85e0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.661+0000 7f871714b640 1 --2- 172.21.15.146:0/3929091087 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f85e0036b90 0x7f85e0039050 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f870804b7a0 tx=0x7f8708033000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.661+0000 7f871be30800 20 rados->read ofs=0 len=0 2024-09-18T01:45:45.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.661+0000 7f871be30800 1 --2- 172.21.15.146:0/3929091087 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56054a5dfde0 0x56054a5e22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.661+0000 7f871be30800 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56054a5e29f0 con 0x56054a5dfde0 2024-09-18T01:45:45.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.661+0000 7f870e94a640 1 --2- 172.21.15.146:0/3929091087 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56054a5dfde0 0x56054a5e22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.661+0000 7f870e94a640 1 --2- 172.21.15.146:0/3929091087 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56054a5dfde0 0x56054a5e22a0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.662+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8700057030 con 0x56054a5dfde0 2024-09-18T01:45:45.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.662+0000 7f871be30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:45.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.662+0000 7f871be30800 20 realm 2024-09-18T01:45:45.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.662+0000 7f871be30800 20 rados->read ofs=0 len=0 2024-09-18T01:45:45.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.662+0000 7f871be30800 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56054a5e2e20 con 0x56054a5dfde0 2024-09-18T01:45:45.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.662+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8700057030 con 0x56054a5dfde0 2024-09-18T01:45:45.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.662+0000 7f871be30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:45.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.662+0000 7f871be30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:45.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.662+0000 7f871be30800 20 rados->read ofs=0 len=0 2024-09-18T01:45:45.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.662+0000 7f871be30800 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56054a5e36f0 con 0x56054a5dfde0 2024-09-18T01:45:45.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.662+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8700057030 con 0x56054a5dfde0 2024-09-18T01:45:45.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.662+0000 7f871be30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:45.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.662+0000 7f871be30800 20 rados->read ofs=0 len=0 2024-09-18T01:45:45.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.662+0000 7f871be30800 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56054a5e3a90 con 0x56054a5dfde0 2024-09-18T01:45:45.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.662+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8700057030 con 0x56054a5dfde0 2024-09-18T01:45:45.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.662+0000 7f871be30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:45.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.662+0000 7f871be30800 20 rados->read ofs=0 len=0 2024-09-18T01:45:45.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.662+0000 7f871be30800 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56054a5e42e0 con 0x56054a5dfde0 2024-09-18T01:45:45.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.663+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8700057030 con 0x56054a5dfde0 2024-09-18T01:45:45.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.663+0000 7f871be30800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:45.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.663+0000 7f871be30800 20 searching for the correct realm 2024-09-18T01:45:45.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.663+0000 7f871be30800 1 --2- 172.21.15.146:0/3929091087 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x56054a5e6050 0x56054a5e8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.663+0000 7f871be30800 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56054a5e8a70 con 0x56054a5e6050 2024-09-18T01:45:45.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.663+0000 7f871794c640 1 --2- 172.21.15.146:0/3929091087 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x56054a5e6050 0x56054a5e8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.663+0000 7f871794c640 1 --2- 172.21.15.146:0/3929091087 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x56054a5e6050 0x56054a5e8440 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.663+0000 7f871794c640 1 -- 172.21.15.146:0/3929091087 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f871003c030 con 0x56054a5e6050 2024-09-18T01:45:45.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.663+0000 7f871794c640 1 --2- 172.21.15.146:0/3929091087 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f871003f060 0x7f8710013a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.663+0000 7f871794c640 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56054a5e8a70 con 0x7f871003f060 2024-09-18T01:45:45.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.663+0000 7f871714b640 1 --2- 172.21.15.146:0/3929091087 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f871003f060 0x7f8710013a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.664+0000 7f871714b640 1 --2- 172.21.15.146:0/3929091087 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f871003f060 0x7f8710013a60 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.664+0000 7f871714b640 1 -- 172.21.15.146:0/3929091087 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8708044d70 con 0x7f871003f060 2024-09-18T01:45:45.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.664+0000 7f871714b640 1 --2- 172.21.15.146:0/3929091087 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f87080187f0 0x7f870801c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.664+0000 7f871714b640 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56054a5e8a70 con 0x7f87080187f0 2024-09-18T01:45:45.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.664+0000 7f870e94a640 1 --2- 172.21.15.146:0/3929091087 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f87080187f0 0x7f870801c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.664+0000 7f870e94a640 1 --2- 172.21.15.146:0/3929091087 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f87080187f0 0x7f870801c610 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.665+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8700057030 con 0x7f87080187f0 2024-09-18T01:45:45.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.665+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56054a5e8a70 con 0x56054a5dfde0 2024-09-18T01:45:45.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.665+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8700057030 con 0x56054a5dfde0 2024-09-18T01:45:45.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.665+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56054a5e8a70 con 0x56054a5dfde0 2024-09-18T01:45:45.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.665+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8700057030 con 0x56054a5dfde0 2024-09-18T01:45:45.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.665+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56054a5e8a70 con 0x7f87080187f0 2024-09-18T01:45:45.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.665+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8700057030 con 0x7f87080187f0 2024-09-18T01:45:45.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.665+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56054a5e8a70 con 0x7f87080187f0 2024-09-18T01:45:45.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.666+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8700057030 con 0x7f87080187f0 2024-09-18T01:45:45.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.666+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56054a5e8a70 con 0x7f871003f060 2024-09-18T01:45:45.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.666+0000 7f871714b640 1 -- 172.21.15.146:0/3929091087 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8708044d70 con 0x7f871003f060 2024-09-18T01:45:45.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.666+0000 7f871714b640 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56054a5e8a70 con 0x56054a5e6050 2024-09-18T01:45:45.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.666+0000 7f871794c640 1 -- 172.21.15.146:0/3929091087 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f871003c030 con 0x56054a5e6050 2024-09-18T01:45:45.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.666+0000 7f871794c640 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56054a5e8a70 con 0x56054a5dfde0 2024-09-18T01:45:45.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.666+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8700057030 con 0x56054a5dfde0 2024-09-18T01:45:45.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.666+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56054a5e8a70 con 0x7f87080187f0 2024-09-18T01:45:45.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.667+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8700057030 con 0x7f87080187f0 2024-09-18T01:45:45.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.667+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56054a5e8a70 con 0x56054a5dfde0 2024-09-18T01:45:45.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.667+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8700057030 con 0x56054a5dfde0 2024-09-18T01:45:45.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.667+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56054a5e8a70 con 0x7f871003f060 2024-09-18T01:45:45.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.667+0000 7f871714b640 1 -- 172.21.15.146:0/3929091087 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f8708044d70 con 0x7f871003f060 2024-09-18T01:45:45.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.667+0000 7f871714b640 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f870805a0a0 con 0x56054a5e6050 2024-09-18T01:45:45.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.667+0000 7f871794c640 1 -- 172.21.15.146:0/3929091087 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f871003c030 con 0x56054a5e6050 2024-09-18T01:45:45.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.668+0000 7f871794c640 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f870805a0a0 con 0x56054a5e6050 2024-09-18T01:45:45.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.668+0000 7f871794c640 1 -- 172.21.15.146:0/3929091087 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f871003c030 con 0x56054a5e6050 2024-09-18T01:45:45.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.668+0000 7f871794c640 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f870805a0a0 con 0x7f87080187f0 2024-09-18T01:45:45.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.668+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8700057030 con 0x7f87080187f0 2024-09-18T01:45:45.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.668+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f870805a0a0 con 0x56054a5e6050 2024-09-18T01:45:45.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.668+0000 7f871794c640 1 -- 172.21.15.146:0/3929091087 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f871003c030 con 0x56054a5e6050 2024-09-18T01:45:45.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.668+0000 7f871794c640 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f870805a0a0 con 0x56054a5e6050 2024-09-18T01:45:45.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.668+0000 7f871794c640 1 -- 172.21.15.146:0/3929091087 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f871003c030 con 0x56054a5e6050 2024-09-18T01:45:45.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.668+0000 7f871794c640 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f870805a0a0 con 0x56054a5dfde0 2024-09-18T01:45:45.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.669+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8700057030 con 0x56054a5dfde0 2024-09-18T01:45:45.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.669+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f870805a0a0 con 0x56054a5dfde0 2024-09-18T01:45:45.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.669+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8700057030 con 0x56054a5dfde0 2024-09-18T01:45:45.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.669+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f870805a0a0 con 0x7f87080187f0 2024-09-18T01:45:45.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.669+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8700057030 con 0x7f87080187f0 2024-09-18T01:45:45.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.669+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f870805a0a0 con 0x56054a5e6050 2024-09-18T01:45:45.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.669+0000 7f871794c640 1 -- 172.21.15.146:0/3929091087 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f871003c030 con 0x56054a5e6050 2024-09-18T01:45:45.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.669+0000 7f871794c640 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f870805a0a0 con 0x7f871003f060 2024-09-18T01:45:45.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.670+0000 7f871714b640 1 -- 172.21.15.146:0/3929091087 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8708044d70 con 0x7f871003f060 2024-09-18T01:45:45.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.670+0000 7f871714b640 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f870805a0a0 con 0x56054a5dfde0 2024-09-18T01:45:45.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.670+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8700057030 con 0x56054a5dfde0 2024-09-18T01:45:45.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.670+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f870805a0a0 con 0x7f87080187f0 2024-09-18T01:45:45.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.670+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8700057030 con 0x7f87080187f0 2024-09-18T01:45:45.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.670+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f870805a0a0 con 0x56054a5e6050 2024-09-18T01:45:45.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.670+0000 7f871794c640 1 -- 172.21.15.146:0/3929091087 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f871003c030 con 0x56054a5e6050 2024-09-18T01:45:45.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.670+0000 7f871794c640 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f870805a0a0 con 0x7f87080187f0 2024-09-18T01:45:45.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.671+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8700057030 con 0x7f87080187f0 2024-09-18T01:45:45.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.671+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f870805a0a0 con 0x7f871003f060 2024-09-18T01:45:45.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.671+0000 7f871714b640 1 -- 172.21.15.146:0/3929091087 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8708044d70 con 0x7f871003f060 2024-09-18T01:45:45.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.671+0000 7f871714b640 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f870805a0a0 con 0x56054a5e6050 2024-09-18T01:45:45.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.671+0000 7f871794c640 1 -- 172.21.15.146:0/3929091087 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f871003c030 con 0x56054a5e6050 2024-09-18T01:45:45.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.671+0000 7f871794c640 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f870805a0a0 con 0x7f87080187f0 2024-09-18T01:45:45.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.671+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8700057030 con 0x7f87080187f0 2024-09-18T01:45:45.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.671+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f870805a0a0 con 0x56054a5dfde0 2024-09-18T01:45:45.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.672+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8700057030 con 0x56054a5dfde0 2024-09-18T01:45:45.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.672+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f870805a0a0 con 0x7f871003f060 2024-09-18T01:45:45.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.672+0000 7f871714b640 1 -- 172.21.15.146:0/3929091087 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8708044d70 con 0x7f871003f060 2024-09-18T01:45:45.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.672+0000 7f871be30800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:45.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.672+0000 7f871be30800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:45.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.672+0000 7f871be30800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:45.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.672+0000 7f871be30800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:45.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.672+0000 7f871be30800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:45.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.672+0000 7f871be30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:45.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.672+0000 7f871be30800 20 rados->read ofs=0 len=0 2024-09-18T01:45:45.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.672+0000 7f871be30800 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56054a5e4c30 con 0x56054a5dfde0 2024-09-18T01:45:45.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.672+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8700057030 con 0x56054a5dfde0 2024-09-18T01:45:45.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.672+0000 7f871be30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:45.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.672+0000 7f871be30800 20 rados->read ofs=0 len=0 2024-09-18T01:45:45.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.672+0000 7f871be30800 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56054a5e54d0 con 0x56054a5dfde0 2024-09-18T01:45:45.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.672+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8700057030 con 0x56054a5dfde0 2024-09-18T01:45:45.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.672+0000 7f871be30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:45.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.672+0000 7f871be30800 20 rados->read ofs=0 len=0 2024-09-18T01:45:45.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.672+0000 7f871be30800 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56054a5e8ef0 con 0x7f871003f060 2024-09-18T01:45:45.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.673+0000 7f871714b640 1 -- 172.21.15.146:0/3929091087 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8708044d70 con 0x7f871003f060 2024-09-18T01:45:45.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.673+0000 7f871be30800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:45.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.673+0000 7f871be30800 20 zone default found 2024-09-18T01:45:45.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.673+0000 7f871be30800 4 Realm: () 2024-09-18T01:45:45.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.673+0000 7f871be30800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:45.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.673+0000 7f871be30800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:45.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.673+0000 7f871be30800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:45.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.673+0000 7f871be30800 20 zonegroup default 2024-09-18T01:45:45.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.673+0000 7f871be30800 20 rados->read ofs=0 len=0 2024-09-18T01:45:45.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.673+0000 7f871be30800 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56054a5e9740 con 0x7f87080187f0 2024-09-18T01:45:45.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.673+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8700057030 con 0x7f87080187f0 2024-09-18T01:45:45.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.673+0000 7f871be30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:45.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.673+0000 7f871be30800 20 rados->read ofs=0 len=0 2024-09-18T01:45:45.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.673+0000 7f871be30800 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56054a5eb120 con 0x56054a5e6050 2024-09-18T01:45:45.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.673+0000 7f871794c640 1 -- 172.21.15.146:0/3929091087 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f871003c030 con 0x56054a5e6050 2024-09-18T01:45:45.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.673+0000 7f871be30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:45.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.673+0000 7f871be30800 20 rados->read ofs=0 len=0 2024-09-18T01:45:45.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.673+0000 7f871be30800 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56054a5eb5a0 con 0x56054a5e6050 2024-09-18T01:45:45.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.674+0000 7f871794c640 1 -- 172.21.15.146:0/3929091087 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f871003c030 con 0x56054a5e6050 2024-09-18T01:45:45.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.674+0000 7f871be30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:45.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.674+0000 7f871be30800 20 started sync module instance, tier type = 2024-09-18T01:45:45.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.674+0000 7f871be30800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:45.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.674+0000 7f871be30800 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56054a5ea5b0 con 0x7f871003f060 2024-09-18T01:45:45.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.675+0000 7f871714b640 1 -- 172.21.15.146:0/3929091087 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v33'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8708044d70 con 0x7f871003f060 2024-09-18T01:45:45.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.675+0000 7f871be30800 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94580722543008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56054a5ea210 con 0x7f871003f060 2024-09-18T01:45:45.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.675+0000 7f871be30800 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56054a5ec4d0 con 0x56054a5dfde0 2024-09-18T01:45:45.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.676+0000 7f871714b640 1 -- 172.21.15.146:0/3929091087 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94580722543008] v33'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8708044d70 con 0x7f871003f060 2024-09-18T01:45:45.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.676+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v33'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8700057030 con 0x56054a5dfde0 2024-09-18T01:45:45.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.676+0000 7f871be30800 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94580722548768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56054a5ec8f0 con 0x56054a5dfde0 2024-09-18T01:45:45.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.676+0000 7f871be30800 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56054a5ed2b0 con 0x56054a5e6050 2024-09-18T01:45:45.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.677+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94580722548768] v33'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8700057030 con 0x56054a5dfde0 2024-09-18T01:45:45.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.677+0000 7f871794c640 1 -- 172.21.15.146:0/3929091087 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v33'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f871003c030 con 0x56054a5e6050 2024-09-18T01:45:45.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.677+0000 7f871be30800 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94580722549824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56054a5ec860 con 0x56054a5e6050 2024-09-18T01:45:45.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.677+0000 7f871be30800 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56054a5ee170 con 0x7f871003f060 2024-09-18T01:45:45.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.678+0000 7f871714b640 1 -- 172.21.15.146:0/3929091087 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v33'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8708044d70 con 0x7f871003f060 2024-09-18T01:45:45.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.678+0000 7f871be30800 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94580722556096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56054a5eea10 con 0x7f871003f060 2024-09-18T01:45:45.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.678+0000 7f871794c640 1 -- 172.21.15.146:0/3929091087 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94580722549824] v33'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f871003c030 con 0x56054a5e6050 2024-09-18T01:45:45.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.678+0000 7f871be30800 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56054a5ef4e0 con 0x56054a5dfde0 2024-09-18T01:45:45.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.679+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v33'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8700057030 con 0x56054a5dfde0 2024-09-18T01:45:45.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.679+0000 7f871714b640 1 -- 172.21.15.146:0/3929091087 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94580722556096] v33'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8708044d70 con 0x7f871003f060 2024-09-18T01:45:45.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.679+0000 7f871be30800 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94580722560976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56054a5ef4a0 con 0x56054a5dfde0 2024-09-18T01:45:45.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.679+0000 7f871be30800 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56054a5ee560 con 0x7f87080187f0 2024-09-18T01:45:45.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.680+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v33'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8700057030 con 0x7f87080187f0 2024-09-18T01:45:45.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.680+0000 7f871be30800 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94580722562208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56054a5effd0 con 0x7f87080187f0 2024-09-18T01:45:45.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.680+0000 7f871be30800 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56054a5f0990 con 0x7f87080187f0 2024-09-18T01:45:45.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.680+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94580722560976] v33'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8700057030 con 0x56054a5dfde0 2024-09-18T01:45:45.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.681+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94580722562208] v33'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8700057030 con 0x7f87080187f0 2024-09-18T01:45:45.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.681+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v33'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8700057030 con 0x7f87080187f0 2024-09-18T01:45:45.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.681+0000 7f871be30800 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94580722563872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56054a5eff40 con 0x7f87080187f0 2024-09-18T01:45:45.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.682+0000 7f871be30800 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56054a5f0e40 con 0x7f87080187f0 2024-09-18T01:45:45.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.682+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(58 notify.7 [create] v33'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8700057030 con 0x7f87080187f0 2024-09-18T01:45:45.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.682+0000 7f871be30800 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94580722567568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56054a5f1260 con 0x7f87080187f0 2024-09-18T01:45:45.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.682+0000 7f871be30800 20 add_watcher() i=0 2024-09-18T01:45:45.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.682+0000 7f871be30800 20 add_watcher() i=1 2024-09-18T01:45:45.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.682+0000 7f871be30800 20 add_watcher() i=2 2024-09-18T01:45:45.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.682+0000 7f871be30800 20 add_watcher() i=3 2024-09-18T01:45:45.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.682+0000 7f871be30800 20 add_watcher() i=4 2024-09-18T01:45:45.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.682+0000 7f871be30800 20 add_watcher() i=5 2024-09-18T01:45:45.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.682+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94580722563872] v33'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8700057030 con 0x7f87080187f0 2024-09-18T01:45:45.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.683+0000 7f871be30800 20 add_watcher() i=6 2024-09-18T01:45:45.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.683+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94580722567568] v33'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8700057030 con 0x7f87080187f0 2024-09-18T01:45:45.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.683+0000 7f871be30800 20 add_watcher() i=7 2024-09-18T01:45:45.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.683+0000 7f871be30800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:45.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.683+0000 7f871be30800 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56054a5f04e0 con 0x56054a5dfde0 2024-09-18T01:45:45.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.684+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8700057030 con 0x56054a5dfde0 2024-09-18T01:45:45.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.684+0000 7f871be30800 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94580722568624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56054a5f04e0 con 0x56054a5dfde0 2024-09-18T01:45:45.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.684+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94580722568624] v33'184 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8700057030 con 0x56054a5dfde0 2024-09-18T01:45:45.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.685+0000 7f85cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:45.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.685+0000 7f871be30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:45.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.685+0000 7f871be30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:45.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.685+0000 7f871be30800 5 note: GC not initialized 2024-09-18T01:45:45.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.685+0000 7f85ccfe1640 20 reqs_thread_entry: start 2024-09-18T01:45:45.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.685+0000 7f871be30800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:45.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.685+0000 7f871be30800 20 Filter name: none 2024-09-18T01:45:45.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.685+0000 7f85467fc640 20 reqs_thread_entry: start 2024-09-18T01:45:45.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.685+0000 7f871be30800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-18T01:45:45.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.685+0000 7f871be30800 20 rados->read ofs=0 len=0 2024-09-18T01:45:45.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.685+0000 7f871be30800 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56054a627a40 con 0x7f871003f060 2024-09-18T01:45:45.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.686+0000 7f871714b640 1 -- 172.21.15.146:0/3929091087 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f8708044d70 con 0x7f871003f060 2024-09-18T01:45:45.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.686+0000 7f871be30800 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T01:45:45.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.686+0000 7f871be30800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-18T01:45:45.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.686+0000 7f871be30800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T01:45:45.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.686+0000 7f871be30800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5 : miss 2024-09-18T01:45:45.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.686+0000 7f871be30800 20 rados->read ofs=0 len=0 2024-09-18T01:45:45.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.686+0000 7f871be30800 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:63 8.12 8:4ee8b646:root::.bucket.meta.myfoo%3a8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56054a629660 con 0x56054a5e6050 2024-09-18T01:45:45.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.686+0000 7f871794c640 1 -- 172.21.15.146:0/3929091087 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(63 .bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f871003c030 con 0x56054a5e6050 2024-09-18T01:45:45.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.686+0000 7f871be30800 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T01:45:45.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.686+0000 7f871be30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5 info.flags=0x17 2024-09-18T01:45:45.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.686+0000 7f871be30800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5 to cache LRU end 2024-09-18T01:45:45.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.686+0000 7f871be30800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:45:45.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.686+0000 7f871be30800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T01:45:45.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.686+0000 7f871be30800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5 2024-09-18T01:45:45.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.686+0000 7f871be30800 20 get_obj_state: octx=0x7f8700051d00 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x56054a62b828 s->prefetch_data=0 2024-09-18T01:45:45.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.686+0000 7f871be30800 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:64 3.18s0 3:1960fedc:::8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56054a62c9e0 con 0x56054a5e6050 2024-09-18T01:45:45.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.687+0000 7f871794c640 1 -- 172.21.15.146:0/3929091087 <== osd.3 v2:172.21.15.146:6809/4106661138 15 ==== osd_op_reply(64 8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=848b,stat out=16b] v0'0 uv4 ondisk = 0) ==== 262+0+864 (crc 0 0 0) 0x7f871003c030 con 0x56054a5e6050 2024-09-18T01:45:45.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.687+0000 7f871be30800 10 manifest: total_size = 5 2024-09-18T01:45:45.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.687+0000 7f871be30800 20 get_obj_state: setting s->obj_tag to _Gbpr5sHDXj7MjjspbMOrCV9yRtOZGl4 2024-09-18T01:45:45.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.688+0000 7f85cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:45.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.688+0000 7f871be30800 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94580722568624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56054a62c9e0 con 0x56054a5dfde0 2024-09-18T01:45:45.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.689+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94580722568624] v33'185 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8700057030 con 0x56054a5dfde0 2024-09-18T01:45:45.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.689+0000 7f871be30800 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94580722543008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56054a62c9e0 con 0x7f871003f060 2024-09-18T01:45:45.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.690+0000 7f871714b640 1 -- 172.21.15.146:0/3929091087 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94580722543008] v33'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8708044d70 con 0x7f871003f060 2024-09-18T01:45:45.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.690+0000 7f871be30800 20 remove_watcher() i=0 2024-09-18T01:45:45.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.690+0000 7f871be30800 2 removed watcher, disabling cache 2024-09-18T01:45:45.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.690+0000 7f871be30800 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94580722548768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56054a62c9e0 con 0x56054a5dfde0 2024-09-18T01:45:45.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.691+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94580722548768] v33'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8700057030 con 0x56054a5dfde0 2024-09-18T01:45:45.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.691+0000 7f871be30800 20 remove_watcher() i=1 2024-09-18T01:45:45.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.691+0000 7f871be30800 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94580722549824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56054a62c9e0 con 0x56054a5e6050 2024-09-18T01:45:45.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.692+0000 7f871794c640 1 -- 172.21.15.146:0/3929091087 <== osd.3 v2:172.21.15.146:6809/4106661138 16 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94580722549824] v33'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f871003c030 con 0x56054a5e6050 2024-09-18T01:45:45.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.692+0000 7f871be30800 20 remove_watcher() i=2 2024-09-18T01:45:45.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.692+0000 7f871be30800 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94580722556096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56054a62c9e0 con 0x7f871003f060 2024-09-18T01:45:45.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.693+0000 7f871714b640 1 -- 172.21.15.146:0/3929091087 <== osd.2 v2:172.21.15.146:6800/3820039304 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94580722556096] v33'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8708044d70 con 0x7f871003f060 2024-09-18T01:45:45.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.693+0000 7f871be30800 20 remove_watcher() i=3 2024-09-18T01:45:45.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.693+0000 7f871be30800 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94580722560976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56054a62c9e0 con 0x56054a5dfde0 2024-09-18T01:45:45.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.694+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94580722560976] v33'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8700057030 con 0x56054a5dfde0 2024-09-18T01:45:45.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.694+0000 7f871be30800 20 remove_watcher() i=4 2024-09-18T01:45:45.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.694+0000 7f871be30800 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94580722562208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56054a62c9e0 con 0x7f87080187f0 2024-09-18T01:45:45.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.695+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94580722562208] v33'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8700057030 con 0x7f87080187f0 2024-09-18T01:45:45.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.695+0000 7f871be30800 20 remove_watcher() i=5 2024-09-18T01:45:45.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.695+0000 7f871be30800 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94580722563872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56054a62c9e0 con 0x7f87080187f0 2024-09-18T01:45:45.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.696+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94580722563872] v33'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8700057030 con 0x7f87080187f0 2024-09-18T01:45:45.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.696+0000 7f871be30800 20 remove_watcher() i=6 2024-09-18T01:45:45.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.696+0000 7f871be30800 1 -- 172.21.15.146:0/3929091087 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94580722567568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56054a62c9e0 con 0x7f87080187f0 2024-09-18T01:45:45.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.697+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94580722567568] v33'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8700057030 con 0x7f87080187f0 2024-09-18T01:45:45.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.697+0000 7f871be30800 20 remove_watcher() i=7 2024-09-18T01:45:45.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.697+0000 7f871be30800 1 -- 172.21.15.146:0/3929091087 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f87080187f0 msgr2=0x7f870801c610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.697+0000 7f871be30800 1 --2- 172.21.15.146:0/3929091087 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f87080187f0 0x7f870801c610 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.697+0000 7f871be30800 1 -- 172.21.15.146:0/3929091087 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56054a5dfde0 msgr2=0x56054a5e22a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.697+0000 7f871be30800 1 --2- 172.21.15.146:0/3929091087 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56054a5dfde0 0x56054a5e22a0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.697+0000 7f871be30800 1 -- 172.21.15.146:0/3929091087 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f871003f060 msgr2=0x7f8710013a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.697+0000 7f871be30800 1 --2- 172.21.15.146:0/3929091087 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f871003f060 0x7f8710013a60 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.697+0000 7f871be30800 1 -- 172.21.15.146:0/3929091087 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x56054a5e6050 msgr2=0x56054a5e8440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.697+0000 7f871be30800 1 --2- 172.21.15.146:0/3929091087 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x56054a5e6050 0x56054a5e8440 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.697+0000 7f871be30800 1 -- 172.21.15.146:0/3929091087 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f85e0036b90 msgr2=0x7f85e0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.697+0000 7f871be30800 1 --2- 172.21.15.146:0/3929091087 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f85e0036b90 0x7f85e0039050 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f870804b7a0 tx=0x7f8708033000 comp rx=0 tx=0).stop 2024-09-18T01:45:45.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.697+0000 7f871be30800 1 -- 172.21.15.146:0/3929091087 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56054a5ccc40 msgr2=0x56054a5d4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.697+0000 7f871be30800 1 --2- 172.21.15.146:0/3929091087 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56054a5ccc40 0x56054a5d4140 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f871004ca10 tx=0x7f871004c820 comp rx=0 tx=0).stop 2024-09-18T01:45:45.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.697+0000 7f870e94a640 1 -- 172.21.15.146:0/3929091087 reap_dead start 2024-09-18T01:45:45.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.697+0000 7f871be30800 1 -- 172.21.15.146:0/3929091087 shutdown_connections 2024-09-18T01:45:45.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.697+0000 7f871be30800 1 --2- 172.21.15.146:0/3929091087 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56054a5ccc40 0x56054a5d4140 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.697+0000 7f871be30800 1 -- 172.21.15.146:0/3929091087 >> 172.21.15.146:0/3929091087 conn(0x56054a5c8ff0 msgr2=0x56054a5c70c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:45.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.697+0000 7f871be30800 1 -- 172.21.15.146:0/3929091087 shutdown_connections 2024-09-18T01:45:45.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.697+0000 7f871be30800 1 -- 172.21.15.146:0/3929091087 wait complete. 2024-09-18T01:45:45.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.697+0000 7f871be30800 1 -- 172.21.15.146:0/381657594 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f85f0036b90 msgr2=0x7f85f0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.697+0000 7f871be30800 1 --2- 172.21.15.146:0/381657594 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f85f0036b90 0x7f85f0039050 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f870800ffd0 tx=0x7f870804b670 comp rx=0 tx=0).stop 2024-09-18T01:45:45.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.697+0000 7f871be30800 1 -- 172.21.15.146:0/381657594 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56054a5c0010 msgr2=0x56054a5c0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.697+0000 7f871be30800 1 --2- 172.21.15.146:0/381657594 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56054a5c0010 0x56054a5c0430 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x56054a5acc60 tx=0x7f87100178e0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.698+0000 7f871be30800 1 -- 172.21.15.146:0/381657594 shutdown_connections 2024-09-18T01:45:45.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.698+0000 7f871be30800 1 --2- 172.21.15.146:0/381657594 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f85f0036b90 0x7f85f0039050 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.698+0000 7f871be30800 1 --2- 172.21.15.146:0/381657594 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56054a5c0010 0x56054a5c0430 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.698+0000 7f871be30800 1 -- 172.21.15.146:0/381657594 >> 172.21.15.146:0/381657594 conn(0x56054a5b4fa0 msgr2=0x56054a5b7b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:45.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.698+0000 7f871be30800 1 -- 172.21.15.146:0/381657594 shutdown_connections 2024-09-18T01:45:45.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.698+0000 7f871be30800 1 -- 172.21.15.146:0/381657594 wait complete. 2024-09-18T01:45:45.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.698+0000 7f871be30800 1 -- 172.21.15.146:0/1187092411 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56054a4b2d40 msgr2=0x56054a5ac360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.698+0000 7f871be30800 1 --2- 172.21.15.146:0/1187092411 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56054a4b2d40 0x56054a5ac360 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.698+0000 7f871be30800 1 -- 172.21.15.146:0/1187092411 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x56054a5ae2b0 msgr2=0x56054a5b1af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.698+0000 7f871be30800 1 --2- 172.21.15.146:0/1187092411 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x56054a5ae2b0 0x56054a5b1af0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.698+0000 7f871be30800 1 -- 172.21.15.146:0/1187092411 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f85fc036b40 msgr2=0x7f85fc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.698+0000 7f871be30800 1 --2- 172.21.15.146:0/1187092411 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f85fc036b40 0x7f85fc039000 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8700057000 tx=0x7f8700052000 comp rx=0 tx=0).stop 2024-09-18T01:45:45.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.698+0000 7f871be30800 1 -- 172.21.15.146:0/1187092411 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56054a420610 msgr2=0x56054a5a52f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.698+0000 7f871be30800 1 --2- 172.21.15.146:0/1187092411 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56054a420610 0x56054a5a52f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x56054a59e6d0 tx=0x7f8708000ed0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.698+0000 7f871be30800 1 -- 172.21.15.146:0/1187092411 shutdown_connections 2024-09-18T01:45:45.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.698+0000 7f871be30800 1 --2- 172.21.15.146:0/1187092411 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x56054a5ae2b0 0x56054a5b1af0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.698+0000 7f871be30800 1 --2- 172.21.15.146:0/1187092411 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56054a4b2d40 0x56054a5ac360 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.698+0000 7f871be30800 1 --2- 172.21.15.146:0/1187092411 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f85fc036b40 0x7f85fc039000 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.698+0000 7f871be30800 1 --2- 172.21.15.146:0/1187092411 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56054a420610 0x56054a5a52f0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.698+0000 7f871be30800 1 -- 172.21.15.146:0/1187092411 >> 172.21.15.146:0/1187092411 conn(0x56054a4a6db0 msgr2=0x56054a597b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:45.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.698+0000 7f871be30800 1 -- 172.21.15.146:0/1187092411 shutdown_connections 2024-09-18T01:45:45.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.698+0000 7f871be30800 1 -- 172.21.15.146:0/1187092411 wait complete. 2024-09-18T01:45:45.710 INFO:teuthology.orchestra.run.smithi146.stdout:fooFoofooFooFULL_CONTROL 2024-09-18T01:45:45.710 DEBUG:tasks.util.rgw: raw result: fooFoofooFooFULL_CONTROL 2024-09-18T01:45:45.712 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=417 failed=False 2024-09-18T01:45:45.718 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T01:45:45.718 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-18T01:45:45.718 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-18T01:45:45.719 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-18T01:45:45.763 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:45.764 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:45.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.763+0000 7f6b67613800 1 Processor -- start 2024-09-18T01:45:45.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.763+0000 7f6b67613800 1 -- start start 2024-09-18T01:45:45.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.763+0000 7f6b67613800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55fbfd1be900 0x55fbfd1c0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.763+0000 7f6b67613800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fbfd079b30 con 0x55fbfd12e650 2024-09-18T01:45:45.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.763+0000 7f6b67613800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x55fbfd05b360 con 0x55fbfd1be900 2024-09-18T01:45:45.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.763+0000 7f6b62466640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55fbfd1be900 0x55fbfd1c0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.763+0000 7f6b62c67640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x55fbfd12e650 0x55fbfd1bd1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:45878/0 (socket says 172.21.15.146:45878) 2024-09-18T01:45:45.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.763+0000 7f6b62c67640 1 -- 172.21.15.146:0/1529891675 learned_addr learned my addr 172.21.15.146:0/1529891675 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:45:45.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.763+0000 7f6b61c65640 1 -- 172.21.15.146:0/1529891675 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1739578568 0 0) 0x55fbfd079b30 con 0x55fbfd12e650 2024-09-18T01:45:45.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.763+0000 7f6b61c65640 1 -- 172.21.15.146:0/1529891675 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b4c001e10 con 0x55fbfd12e650 2024-09-18T01:45:45.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.764+0000 7f6b62466640 1 -- 172.21.15.146:0/1529891675 >> v1:172.21.15.129:6789/0 conn(0x55fbfd12e650 legacy=0x55fbfd1bd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.764+0000 7f6b62466640 1 -- 172.21.15.146:0/1529891675 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbfd081e00 con 0x55fbfd1be900 2024-09-18T01:45:45.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.765+0000 7f6b62466640 1 --2- 172.21.15.146:0/1529891675 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fbfd1be900 0x55fbfd1c0cf0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f6b5800a470 tx=0x7f6b58045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21c9ac70f78a0ff9 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.765+0000 7f6b61c65640 1 -- 172.21.15.146:0/1529891675 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b58059070 con 0x55fbfd1be900 2024-09-18T01:45:45.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.765+0000 7f6b61c65640 1 -- 172.21.15.146:0/1529891675 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b58054570 con 0x55fbfd1be900 2024-09-18T01:45:45.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.765+0000 7f6b61c65640 1 -- 172.21.15.146:0/1529891675 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b58054870 con 0x55fbfd1be900 2024-09-18T01:45:45.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.766+0000 7f6b67613800 1 -- 172.21.15.146:0/1529891675 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fbfd1be900 msgr2=0x55fbfd1c0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.766+0000 7f6b67613800 1 --2- 172.21.15.146:0/1529891675 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fbfd1be900 0x55fbfd1c0cf0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f6b5800a470 tx=0x7f6b58045920 comp rx=0 tx=0).stop 2024-09-18T01:45:45.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.766+0000 7f6b67613800 1 -- 172.21.15.146:0/1529891675 shutdown_connections 2024-09-18T01:45:45.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.766+0000 7f6b67613800 1 --2- 172.21.15.146:0/1529891675 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fbfd1be900 0x55fbfd1c0cf0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.766+0000 7f6b67613800 1 -- 172.21.15.146:0/1529891675 >> 172.21.15.146:0/1529891675 conn(0x55fbfd1b4db0 msgr2=0x55fbfd1b71d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:45.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.766+0000 7f6b67613800 1 -- 172.21.15.146:0/1529891675 shutdown_connections 2024-09-18T01:45:45.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.766+0000 7f6b67613800 1 -- 172.21.15.146:0/1529891675 wait complete. 2024-09-18T01:45:45.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.780+0000 7f6b67613800 1 Processor -- start 2024-09-18T01:45:45.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.780+0000 7f6b67613800 1 -- start start 2024-09-18T01:45:45.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.780+0000 7f6b67613800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fbfd12e650 0x55fbfd1bab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.780+0000 7f6b67613800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55fbfd106360 con 0x55fbfd12e650 2024-09-18T01:45:45.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.780+0000 7f6b62c67640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fbfd12e650 0x55fbfd1bab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.780+0000 7f6b62c67640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fbfd12e650 0x55fbfd1bab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38356/0 (socket says 172.21.15.146:38356) 2024-09-18T01:45:45.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.780+0000 7f6b62c67640 1 -- 172.21.15.146:0/1551850728 learned_addr learned my addr 172.21.15.146:0/1551850728 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:45.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.781+0000 7f6b62c67640 1 -- 172.21.15.146:0/1551850728 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbfd053bc0 con 0x55fbfd12e650 2024-09-18T01:45:45.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.781+0000 7f6b62c67640 1 --2- 172.21.15.146:0/1551850728 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fbfd12e650 0x55fbfd1bab10 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f6b54001680 tx=0x7f6b54001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d5bf5d4eb636b1d server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.781+0000 7f6a50e09640 1 -- 172.21.15.146:0/1551850728 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b54016070 con 0x55fbfd12e650 2024-09-18T01:45:45.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.781+0000 7f6a50e09640 1 -- 172.21.15.146:0/1551850728 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b54004520 con 0x55fbfd12e650 2024-09-18T01:45:45.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.781+0000 7f6a50e09640 1 -- 172.21.15.146:0/1551850728 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b54004880 con 0x55fbfd12e650 2024-09-18T01:45:45.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.782+0000 7f6b67613800 1 -- 172.21.15.146:0/1551850728 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fbfd12e650 msgr2=0x55fbfd1bab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.782+0000 7f6b67613800 1 --2- 172.21.15.146:0/1551850728 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fbfd12e650 0x55fbfd1bab10 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f6b54001680 tx=0x7f6b54001b40 comp rx=0 tx=0).stop 2024-09-18T01:45:45.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.782+0000 7f6b67613800 1 -- 172.21.15.146:0/1551850728 shutdown_connections 2024-09-18T01:45:45.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.782+0000 7f6b67613800 1 --2- 172.21.15.146:0/1551850728 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fbfd12e650 0x55fbfd1bab10 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.782+0000 7f6b67613800 1 -- 172.21.15.146:0/1551850728 >> 172.21.15.146:0/1551850728 conn(0x55fbfd1b4db0 msgr2=0x55fbfd2a50c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:45.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.782+0000 7f6b67613800 1 -- 172.21.15.146:0/1551850728 shutdown_connections 2024-09-18T01:45:45.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.782+0000 7f6b67613800 1 -- 172.21.15.146:0/1551850728 wait complete. 2024-09-18T01:45:45.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.782+0000 7f6b67613800 1 Processor -- start 2024-09-18T01:45:45.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.782+0000 7f6b67613800 1 -- start start 2024-09-18T01:45:45.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.782+0000 7f6b67613800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fbfd12e650 0x55fbfd2b3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.782+0000 7f6b67613800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55fbfd1c1620 con 0x55fbfd12e650 2024-09-18T01:45:45.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.782+0000 7f6b62c67640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fbfd12e650 0x55fbfd2b3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.782+0000 7f6b62c67640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fbfd12e650 0x55fbfd2b3320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38372/0 (socket says 172.21.15.146:38372) 2024-09-18T01:45:45.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.782+0000 7f6b62c67640 1 -- 172.21.15.146:0/1708119101 learned_addr learned my addr 172.21.15.146:0/1708119101 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:45.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.783+0000 7f6b62c67640 1 -- 172.21.15.146:0/1708119101 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbfd067fe0 con 0x55fbfd12e650 2024-09-18T01:45:45.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.783+0000 7f6b62c67640 1 --2- 172.21.15.146:0/1708119101 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fbfd12e650 0x55fbfd2b3320 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f6b54014040 tx=0x7f6b54001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.783+0000 7f6a4f606640 1 -- 172.21.15.146:0/1708119101 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b54021020 con 0x55fbfd12e650 2024-09-18T01:45:45.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.783+0000 7f6a4f606640 1 -- 172.21.15.146:0/1708119101 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b54011530 con 0x55fbfd12e650 2024-09-18T01:45:45.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.783+0000 7f6a4f606640 1 -- 172.21.15.146:0/1708119101 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b54016040 con 0x55fbfd12e650 2024-09-18T01:45:45.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.783+0000 7f6b67613800 1 -- 172.21.15.146:0/1708119101 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fbfd2b3860 con 0x55fbfd12e650 2024-09-18T01:45:45.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.783+0000 7f6b67613800 1 -- 172.21.15.146:0/1708119101 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbfd2b3d20 con 0x55fbfd12e650 2024-09-18T01:45:45.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.784+0000 7f6a4f606640 1 -- 172.21.15.146:0/1708119101 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6b54024020 con 0x55fbfd12e650 2024-09-18T01:45:45.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.784+0000 7f6a4f606640 1 --2- 172.21.15.146:0/1708119101 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6a48036b90 0x7f6a48039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.784+0000 7f6a4f606640 1 -- 172.21.15.146:0/1708119101 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f6b5404c0e0 con 0x55fbfd12e650 2024-09-18T01:45:45.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.784+0000 7f6b62466640 1 --2- 172.21.15.146:0/1708119101 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6a48036b90 0x7f6a48039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.784+0000 7f6b67613800 1 --2- 172.21.15.146:0/1708119101 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55fbfd1be900 0x55fbfd2ba2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.784+0000 7f6b67613800 1 -- 172.21.15.146:0/1708119101 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2ba8b0 con 0x55fbfd1be900 2024-09-18T01:45:45.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.784+0000 7f6b63468640 1 --2- 172.21.15.146:0/1708119101 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55fbfd1be900 0x55fbfd2ba2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.784+0000 7f6b62466640 1 --2- 172.21.15.146:0/1708119101 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6a48036b90 0x7f6a48039050 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55fbfd12dd90 tx=0x7f6b58050000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.785+0000 7f6b63468640 1 --2- 172.21.15.146:0/1708119101 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55fbfd1be900 0x55fbfd2ba2c0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.785+0000 7f6b63468640 1 -- 172.21.15.146:0/1708119101 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6b5c0083e0 con 0x55fbfd1be900 2024-09-18T01:45:45.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.785+0000 7f6b67613800 1 -- 172.21.15.146:0/1708119101 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2b78b0 con 0x55fbfd1be900 2024-09-18T01:45:45.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.785+0000 7f6b63468640 1 -- 172.21.15.146:0/1708119101 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6b5c0083e0 con 0x55fbfd1be900 2024-09-18T01:45:45.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.785+0000 7f6b67613800 1 -- 172.21.15.146:0/1708119101 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2bc330 con 0x55fbfd1be900 2024-09-18T01:45:45.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.786+0000 7f6b63468640 1 -- 172.21.15.146:0/1708119101 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6b5c0083e0 con 0x55fbfd1be900 2024-09-18T01:45:45.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.786+0000 7f6b67613800 1 -- 172.21.15.146:0/1708119101 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2bb190 con 0x55fbfd1be900 2024-09-18T01:45:45.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.786+0000 7f6b63468640 1 -- 172.21.15.146:0/1708119101 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6b5c0083e0 con 0x55fbfd1be900 2024-09-18T01:45:45.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.786+0000 7f6b67613800 1 --2- 172.21.15.146:0/1708119101 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55fbfd2bd7e0 0x55fbfd2bfbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.786+0000 7f6b67613800 1 -- 172.21.15.146:0/1708119101 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2c01e0 con 0x55fbfd2bd7e0 2024-09-18T01:45:45.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.786+0000 7f6b62c67640 1 --2- 172.21.15.146:0/1708119101 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55fbfd2bd7e0 0x55fbfd2bfbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.786+0000 7f6b62c67640 1 --2- 172.21.15.146:0/1708119101 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55fbfd2bd7e0 0x55fbfd2bfbd0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.787+0000 7f6b62c67640 1 -- 172.21.15.146:0/1708119101 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6b5400f070 con 0x55fbfd2bd7e0 2024-09-18T01:45:45.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.787+0000 7f6b67613800 1 Processor -- start 2024-09-18T01:45:45.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.787+0000 7f6b67613800 1 -- start start 2024-09-18T01:45:45.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.787+0000 7f6b67613800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fbfd2cdf90 0x55fbfd2ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.787+0000 7f6b67613800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55fbfd055580 con 0x55fbfd2cdf90 2024-09-18T01:45:45.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.787+0000 7f6b63468640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fbfd2cdf90 0x55fbfd2ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.787+0000 7f6b63468640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fbfd2cdf90 0x55fbfd2ce3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38376/0 (socket says 172.21.15.146:38376) 2024-09-18T01:45:45.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.787+0000 7f6b63468640 1 -- 172.21.15.146:0/841340156 learned_addr learned my addr 172.21.15.146:0/841340156 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:45.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.788+0000 7f6b63468640 1 -- 172.21.15.146:0/841340156 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbfd2ce8f0 con 0x55fbfd2cdf90 2024-09-18T01:45:45.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.788+0000 7f6b63468640 1 --2- 172.21.15.146:0/841340156 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fbfd2cdf90 0x55fbfd2ce3b0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x55fbfd2b4720 tx=0x7f6b5c00ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.788+0000 7f6a4ce01640 1 -- 172.21.15.146:0/841340156 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b5c00adb0 con 0x55fbfd2cdf90 2024-09-18T01:45:45.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.788+0000 7f6a4ce01640 1 -- 172.21.15.146:0/841340156 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b5c01e020 con 0x55fbfd2cdf90 2024-09-18T01:45:45.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.788+0000 7f6b67613800 1 -- 172.21.15.146:0/841340156 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fbfd2ceb80 con 0x55fbfd2cdf90 2024-09-18T01:45:45.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.788+0000 7f6a4ce01640 1 -- 172.21.15.146:0/841340156 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b5c019550 con 0x55fbfd2cdf90 2024-09-18T01:45:45.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.788+0000 7f6b67613800 1 -- 172.21.15.146:0/841340156 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbfd2d1860 con 0x55fbfd2cdf90 2024-09-18T01:45:45.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.789+0000 7f6a4ce01640 1 -- 172.21.15.146:0/841340156 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6b5c016040 con 0x55fbfd2cdf90 2024-09-18T01:45:45.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.789+0000 7f6a4ce01640 1 --2- 172.21.15.146:0/841340156 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6a3c036b90 0x7f6a3c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.789+0000 7f6a4ce01640 1 -- 172.21.15.146:0/841340156 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f6b5c01f030 con 0x55fbfd2cdf90 2024-09-18T01:45:45.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.789+0000 7f6b62c67640 1 --2- 172.21.15.146:0/841340156 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6a3c036b90 0x7f6a3c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.789+0000 7f6b67613800 1 Processor -- start 2024-09-18T01:45:45.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.789+0000 7f6b67613800 1 -- start start 2024-09-18T01:45:45.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.789+0000 7f6b62c67640 1 --2- 172.21.15.146:0/841340156 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6a3c036b90 0x7f6a3c039050 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x55fbfd2bbd30 tx=0x7f6b5404a310 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.790+0000 7f6b67613800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fbfd2dac90 0x55fbfd2db090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.790+0000 7f6b67613800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55fbfd1b91e0 con 0x55fbfd2dac90 2024-09-18T01:45:45.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.790+0000 7f6b63468640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fbfd2dac90 0x55fbfd2db090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.790+0000 7f6b63468640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fbfd2dac90 0x55fbfd2db090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38384/0 (socket says 172.21.15.146:38384) 2024-09-18T01:45:45.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.790+0000 7f6b63468640 1 -- 172.21.15.146:0/1824398214 learned_addr learned my addr 172.21.15.146:0/1824398214 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:45.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.790+0000 7f6b63468640 1 -- 172.21.15.146:0/1824398214 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbfd2db660 con 0x55fbfd2dac90 2024-09-18T01:45:45.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.790+0000 7f6b63468640 1 --2- 172.21.15.146:0/1824398214 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fbfd2dac90 0x55fbfd2db090 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c04cbe0 tx=0x7f6b5c04ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6633b99c82f06dd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.790+0000 7f6a467fc640 1 -- 172.21.15.146:0/1824398214 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b5c01d040 con 0x55fbfd2dac90 2024-09-18T01:45:45.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.790+0000 7f6a467fc640 1 -- 172.21.15.146:0/1824398214 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b5c0173b0 con 0x55fbfd2dac90 2024-09-18T01:45:45.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.790+0000 7f6a467fc640 1 -- 172.21.15.146:0/1824398214 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b5c017580 con 0x55fbfd2dac90 2024-09-18T01:45:45.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.791+0000 7f6b67613800 1 -- 172.21.15.146:0/1824398214 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fbfd2dac90 msgr2=0x55fbfd2db090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.791+0000 7f6b67613800 1 --2- 172.21.15.146:0/1824398214 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fbfd2dac90 0x55fbfd2db090 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c04cbe0 tx=0x7f6b5c04ce80 comp rx=0 tx=0).stop 2024-09-18T01:45:45.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.791+0000 7f6b67613800 1 -- 172.21.15.146:0/1824398214 shutdown_connections 2024-09-18T01:45:45.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.791+0000 7f6b67613800 1 --2- 172.21.15.146:0/1824398214 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fbfd2dac90 0x55fbfd2db090 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.791+0000 7f6b67613800 1 -- 172.21.15.146:0/1824398214 >> 172.21.15.146:0/1824398214 conn(0x55fbfd2d6ff0 msgr2=0x55fbfd2d50f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:45.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.791+0000 7f6b67613800 1 -- 172.21.15.146:0/1824398214 shutdown_connections 2024-09-18T01:45:45.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.791+0000 7f6b67613800 1 -- 172.21.15.146:0/1824398214 wait complete. 2024-09-18T01:45:45.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.791+0000 7f6b67613800 1 Processor -- start 2024-09-18T01:45:45.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.791+0000 7f6b67613800 1 -- start start 2024-09-18T01:45:45.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.791+0000 7f6b67613800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fbfd2dac90 0x55fbfd2e20d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.791+0000 7f6b67613800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55fbfd2dbcd0 con 0x55fbfd2dac90 2024-09-18T01:45:45.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.791+0000 7f6b63468640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fbfd2dac90 0x55fbfd2e20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.791+0000 7f6b63468640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fbfd2dac90 0x55fbfd2e20d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38390/0 (socket says 172.21.15.146:38390) 2024-09-18T01:45:45.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.791+0000 7f6b63468640 1 -- 172.21.15.146:0/26362355 learned_addr learned my addr 172.21.15.146:0/26362355 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:45.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.792+0000 7f6b63468640 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbfd2e2610 con 0x55fbfd2dac90 2024-09-18T01:45:45.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.792+0000 7f6b63468640 1 --2- 172.21.15.146:0/26362355 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fbfd2dac90 0x55fbfd2e20d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c03dfd0 tx=0x7f6b5c04cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.792+0000 7f6a44ff9640 1 -- 172.21.15.146:0/26362355 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b5c030070 con 0x55fbfd2dac90 2024-09-18T01:45:45.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.792+0000 7f6a44ff9640 1 -- 172.21.15.146:0/26362355 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b5c017560 con 0x55fbfd2dac90 2024-09-18T01:45:45.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.792+0000 7f6b67613800 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fbfd2e28a0 con 0x55fbfd2dac90 2024-09-18T01:45:45.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.792+0000 7f6a44ff9640 1 -- 172.21.15.146:0/26362355 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b5c01d040 con 0x55fbfd2dac90 2024-09-18T01:45:45.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.792+0000 7f6b67613800 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbfd2e28a0 con 0x55fbfd2dac90 2024-09-18T01:45:45.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.793+0000 7f6a44ff9640 1 -- 172.21.15.146:0/26362355 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6b5c033070 con 0x55fbfd2dac90 2024-09-18T01:45:45.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.793+0000 7f6a44ff9640 1 --2- 172.21.15.146:0/26362355 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6a2c036b40 0x7f6a2c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.793+0000 7f6a44ff9640 1 -- 172.21.15.146:0/26362355 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f6b5c036d60 con 0x55fbfd2dac90 2024-09-18T01:45:45.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.793+0000 7f6b62c67640 1 --2- 172.21.15.146:0/26362355 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6a2c036b40 0x7f6a2c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.793+0000 7f6b62c67640 1 --2- 172.21.15.146:0/26362355 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6a2c036b40 0x7f6a2c039000 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6b54002090 tx=0x7f6b54033000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.794+0000 7f6b67613800 20 rados->read ofs=0 len=0 2024-09-18T01:45:45.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.794+0000 7f6b67613800 1 --2- 172.21.15.146:0/26362355 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55fbfd2ed9f0 0x55fbfd2efeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.794+0000 7f6b67613800 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2f0600 con 0x55fbfd2ed9f0 2024-09-18T01:45:45.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.794+0000 7f6b62466640 1 --2- 172.21.15.146:0/26362355 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55fbfd2ed9f0 0x55fbfd2efeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.794+0000 7f6b62466640 1 --2- 172.21.15.146:0/26362355 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55fbfd2ed9f0 0x55fbfd2efeb0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.794+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6b5805c040 con 0x55fbfd2ed9f0 2024-09-18T01:45:45.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.794+0000 7f6b67613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:45.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.794+0000 7f6b67613800 20 realm 2024-09-18T01:45:45.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.794+0000 7f6b67613800 20 rados->read ofs=0 len=0 2024-09-18T01:45:45.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.794+0000 7f6b67613800 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2f0a30 con 0x55fbfd2ed9f0 2024-09-18T01:45:45.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.795+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6b5805c040 con 0x55fbfd2ed9f0 2024-09-18T01:45:45.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.795+0000 7f6b67613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:45.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.795+0000 7f6b67613800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:45.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.795+0000 7f6b67613800 20 rados->read ofs=0 len=0 2024-09-18T01:45:45.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.795+0000 7f6b67613800 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2f1300 con 0x55fbfd2ed9f0 2024-09-18T01:45:45.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.795+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6b5805c040 con 0x55fbfd2ed9f0 2024-09-18T01:45:45.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.795+0000 7f6b67613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:45.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.795+0000 7f6b67613800 20 rados->read ofs=0 len=0 2024-09-18T01:45:45.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.795+0000 7f6b67613800 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2f16a0 con 0x55fbfd2ed9f0 2024-09-18T01:45:45.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.795+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6b5805c040 con 0x55fbfd2ed9f0 2024-09-18T01:45:45.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.795+0000 7f6b67613800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:45.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.795+0000 7f6b67613800 20 rados->read ofs=0 len=0 2024-09-18T01:45:45.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.795+0000 7f6b67613800 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2f1ef0 con 0x55fbfd2ed9f0 2024-09-18T01:45:45.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.795+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6b5805c040 con 0x55fbfd2ed9f0 2024-09-18T01:45:45.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.795+0000 7f6b67613800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:45.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.795+0000 7f6b67613800 20 searching for the correct realm 2024-09-18T01:45:45.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.796+0000 7f6b67613800 1 --2- 172.21.15.146:0/26362355 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55fbfd2f3c60 0x55fbfd2f6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.796+0000 7f6b67613800 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2f6680 con 0x55fbfd2f3c60 2024-09-18T01:45:45.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.796+0000 7f6b63468640 1 --2- 172.21.15.146:0/26362355 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55fbfd2f3c60 0x55fbfd2f6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.796+0000 7f6b63468640 1 --2- 172.21.15.146:0/26362355 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55fbfd2f3c60 0x55fbfd2f6050 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.796+0000 7f6b63468640 1 -- 172.21.15.146:0/26362355 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b5c057040 con 0x55fbfd2f3c60 2024-09-18T01:45:45.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.796+0000 7f6b63468640 1 --2- 172.21.15.146:0/26362355 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f6b5c035070 0x7f6b5c04e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.796+0000 7f6b63468640 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2f6680 con 0x7f6b5c035070 2024-09-18T01:45:45.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.796+0000 7f6b62c67640 1 --2- 172.21.15.146:0/26362355 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f6b5c035070 0x7f6b5c04e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.797+0000 7f6b62c67640 1 --2- 172.21.15.146:0/26362355 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f6b5c035070 0x7f6b5c04e970 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.797+0000 7f6b62c67640 1 -- 172.21.15.146:0/26362355 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b5400f070 con 0x7f6b5c035070 2024-09-18T01:45:45.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.797+0000 7f6b62c67640 1 --2- 172.21.15.146:0/26362355 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f6b5403c040 0x7f6b5402d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:45.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.797+0000 7f6b62c67640 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2f6680 con 0x7f6b5403c040 2024-09-18T01:45:45.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.797+0000 7f6b62466640 1 --2- 172.21.15.146:0/26362355 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f6b5403c040 0x7f6b5402d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:45.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.797+0000 7f6b62466640 1 --2- 172.21.15.146:0/26362355 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f6b5403c040 0x7f6b5402d300 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:45.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.798+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b5805c040 con 0x7f6b5403c040 2024-09-18T01:45:45.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.798+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2f6680 con 0x55fbfd2ed9f0 2024-09-18T01:45:45.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.798+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6b5805c040 con 0x55fbfd2ed9f0 2024-09-18T01:45:45.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.798+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2f6680 con 0x55fbfd2ed9f0 2024-09-18T01:45:45.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.798+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b5805c040 con 0x55fbfd2ed9f0 2024-09-18T01:45:45.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.798+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2f6680 con 0x7f6b5403c040 2024-09-18T01:45:45.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.799+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b5805c040 con 0x7f6b5403c040 2024-09-18T01:45:45.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.799+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2f6680 con 0x7f6b5403c040 2024-09-18T01:45:45.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.799+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b5805c040 con 0x7f6b5403c040 2024-09-18T01:45:45.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.799+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2f6680 con 0x7f6b5c035070 2024-09-18T01:45:45.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.799+0000 7f6b62c67640 1 -- 172.21.15.146:0/26362355 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b5400f070 con 0x7f6b5c035070 2024-09-18T01:45:45.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.799+0000 7f6b62c67640 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2f6680 con 0x55fbfd2f3c60 2024-09-18T01:45:45.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.799+0000 7f6b63468640 1 -- 172.21.15.146:0/26362355 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b5c057040 con 0x55fbfd2f3c60 2024-09-18T01:45:45.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.799+0000 7f6b63468640 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2f6680 con 0x55fbfd2ed9f0 2024-09-18T01:45:45.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.800+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b5805c040 con 0x55fbfd2ed9f0 2024-09-18T01:45:45.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.800+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2f6680 con 0x7f6b5403c040 2024-09-18T01:45:45.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.800+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b5805c040 con 0x7f6b5403c040 2024-09-18T01:45:45.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.800+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2f6680 con 0x55fbfd2ed9f0 2024-09-18T01:45:45.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.800+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b5805c040 con 0x55fbfd2ed9f0 2024-09-18T01:45:45.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.800+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2f6680 con 0x7f6b5c035070 2024-09-18T01:45:45.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.800+0000 7f6b62c67640 1 -- 172.21.15.146:0/26362355 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f6b5400f070 con 0x7f6b5c035070 2024-09-18T01:45:45.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.800+0000 7f6b62c67640 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2f6680 con 0x55fbfd2f3c60 2024-09-18T01:45:45.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.801+0000 7f6b63468640 1 -- 172.21.15.146:0/26362355 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b5c057040 con 0x55fbfd2f3c60 2024-09-18T01:45:45.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.801+0000 7f6b63468640 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2f6680 con 0x55fbfd2f3c60 2024-09-18T01:45:45.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.801+0000 7f6b63468640 1 -- 172.21.15.146:0/26362355 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b5c057040 con 0x55fbfd2f3c60 2024-09-18T01:45:45.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.801+0000 7f6b63468640 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2f6680 con 0x7f6b5403c040 2024-09-18T01:45:45.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.801+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b5805c040 con 0x7f6b5403c040 2024-09-18T01:45:45.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.801+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2f6680 con 0x55fbfd2f3c60 2024-09-18T01:45:45.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.801+0000 7f6b63468640 1 -- 172.21.15.146:0/26362355 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b5c057040 con 0x55fbfd2f3c60 2024-09-18T01:45:45.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.801+0000 7f6b63468640 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2f6680 con 0x55fbfd2f3c60 2024-09-18T01:45:45.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.802+0000 7f6b63468640 1 -- 172.21.15.146:0/26362355 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b5c057040 con 0x55fbfd2f3c60 2024-09-18T01:45:45.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.802+0000 7f6b63468640 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2f6680 con 0x55fbfd2ed9f0 2024-09-18T01:45:45.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.802+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b5805c040 con 0x55fbfd2ed9f0 2024-09-18T01:45:45.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.802+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2f6680 con 0x55fbfd2ed9f0 2024-09-18T01:45:45.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.802+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6b5805c040 con 0x55fbfd2ed9f0 2024-09-18T01:45:45.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.802+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2f6680 con 0x7f6b5403c040 2024-09-18T01:45:45.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.802+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b5805c040 con 0x7f6b5403c040 2024-09-18T01:45:45.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.802+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2f6680 con 0x55fbfd2f3c60 2024-09-18T01:45:45.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.803+0000 7f6b63468640 1 -- 172.21.15.146:0/26362355 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b5c057040 con 0x55fbfd2f3c60 2024-09-18T01:45:45.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.803+0000 7f6b63468640 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2f6680 con 0x7f6b5c035070 2024-09-18T01:45:45.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.803+0000 7f6b62c67640 1 -- 172.21.15.146:0/26362355 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b5400f070 con 0x7f6b5c035070 2024-09-18T01:45:45.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.803+0000 7f6b62c67640 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2f6680 con 0x55fbfd2ed9f0 2024-09-18T01:45:45.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.803+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b5805c040 con 0x55fbfd2ed9f0 2024-09-18T01:45:45.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.803+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2f6680 con 0x7f6b5403c040 2024-09-18T01:45:45.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.803+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b5805c040 con 0x7f6b5403c040 2024-09-18T01:45:45.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.803+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2f6680 con 0x55fbfd2f3c60 2024-09-18T01:45:45.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.803+0000 7f6b63468640 1 -- 172.21.15.146:0/26362355 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b5c057040 con 0x55fbfd2f3c60 2024-09-18T01:45:45.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.804+0000 7f6b63468640 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2f6680 con 0x7f6b5403c040 2024-09-18T01:45:45.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.804+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b5805c040 con 0x7f6b5403c040 2024-09-18T01:45:45.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.804+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2f6680 con 0x7f6b5c035070 2024-09-18T01:45:45.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.804+0000 7f6b62c67640 1 -- 172.21.15.146:0/26362355 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b5400f070 con 0x7f6b5c035070 2024-09-18T01:45:45.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.804+0000 7f6b62c67640 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2f6680 con 0x55fbfd2f3c60 2024-09-18T01:45:45.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.804+0000 7f6b63468640 1 -- 172.21.15.146:0/26362355 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b5c057040 con 0x55fbfd2f3c60 2024-09-18T01:45:45.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.804+0000 7f6b63468640 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2f6680 con 0x7f6b5403c040 2024-09-18T01:45:45.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.805+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b5805c040 con 0x7f6b5403c040 2024-09-18T01:45:45.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.805+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2f6680 con 0x55fbfd2ed9f0 2024-09-18T01:45:45.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.805+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6b5805c040 con 0x55fbfd2ed9f0 2024-09-18T01:45:45.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.805+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2f6680 con 0x7f6b5c035070 2024-09-18T01:45:45.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.805+0000 7f6b62c67640 1 -- 172.21.15.146:0/26362355 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b54061040 con 0x7f6b5c035070 2024-09-18T01:45:45.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.805+0000 7f6b67613800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:45.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.805+0000 7f6b67613800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:45.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.805+0000 7f6b67613800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:45.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.805+0000 7f6b67613800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:45.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.805+0000 7f6b67613800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:45.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.805+0000 7f6b67613800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:45.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.805+0000 7f6b67613800 20 rados->read ofs=0 len=0 2024-09-18T01:45:45.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.805+0000 7f6b67613800 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2f28a0 con 0x55fbfd2ed9f0 2024-09-18T01:45:45.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.805+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6b5805c040 con 0x55fbfd2ed9f0 2024-09-18T01:45:45.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.805+0000 7f6b67613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:45.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.805+0000 7f6b67613800 20 rados->read ofs=0 len=0 2024-09-18T01:45:45.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.805+0000 7f6b67613800 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2f3140 con 0x55fbfd2ed9f0 2024-09-18T01:45:45.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.806+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6b5805c040 con 0x55fbfd2ed9f0 2024-09-18T01:45:45.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.806+0000 7f6b67613800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:45.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.806+0000 7f6b67613800 20 rados->read ofs=0 len=0 2024-09-18T01:45:45.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.806+0000 7f6b67613800 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2f24e0 con 0x7f6b5c035070 2024-09-18T01:45:45.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.806+0000 7f6b62c67640 1 -- 172.21.15.146:0/26362355 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6b54061040 con 0x7f6b5c035070 2024-09-18T01:45:45.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.806+0000 7f6b67613800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:45.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.806+0000 7f6b67613800 20 zone default found 2024-09-18T01:45:45.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.806+0000 7f6b67613800 4 Realm: () 2024-09-18T01:45:45.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.806+0000 7f6b67613800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:45.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.806+0000 7f6b67613800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:45.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.806+0000 7f6b67613800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:45.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.806+0000 7f6b67613800 20 zonegroup default 2024-09-18T01:45:45.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.806+0000 7f6b67613800 20 rados->read ofs=0 len=0 2024-09-18T01:45:45.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.806+0000 7f6b67613800 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2f3140 con 0x7f6b5403c040 2024-09-18T01:45:45.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.806+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6b5805c040 con 0x7f6b5403c040 2024-09-18T01:45:45.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.806+0000 7f6b67613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:45.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.806+0000 7f6b67613800 20 rados->read ofs=0 len=0 2024-09-18T01:45:45.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.806+0000 7f6b67613800 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2f8a10 con 0x55fbfd2f3c60 2024-09-18T01:45:45.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.807+0000 7f6b63468640 1 -- 172.21.15.146:0/26362355 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6b5c057040 con 0x55fbfd2f3c60 2024-09-18T01:45:45.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.807+0000 7f6b67613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:45.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.807+0000 7f6b67613800 20 rados->read ofs=0 len=0 2024-09-18T01:45:45.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.807+0000 7f6b67613800 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2f8e00 con 0x55fbfd2f3c60 2024-09-18T01:45:45.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.807+0000 7f6b63468640 1 -- 172.21.15.146:0/26362355 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6b5c057040 con 0x55fbfd2f3c60 2024-09-18T01:45:45.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.807+0000 7f6b67613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:45.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.807+0000 7f6b67613800 20 started sync module instance, tier type = 2024-09-18T01:45:45.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.807+0000 7f6b67613800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:45.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.807+0000 7f6b67613800 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2f7eb0 con 0x7f6b5c035070 2024-09-18T01:45:45.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.808+0000 7f6b62c67640 1 -- 172.21.15.146:0/26362355 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v33'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b54061040 con 0x7f6b5c035070 2024-09-18T01:45:45.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.808+0000 7f6b67613800 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94540772901536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2f9710 con 0x7f6b5c035070 2024-09-18T01:45:45.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.808+0000 7f6b67613800 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2f9f60 con 0x55fbfd2ed9f0 2024-09-18T01:45:45.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.809+0000 7f6b62c67640 1 -- 172.21.15.146:0/26362355 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94540772901536] v33'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b54061040 con 0x7f6b5c035070 2024-09-18T01:45:45.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.809+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v33'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b5805c040 con 0x55fbfd2ed9f0 2024-09-18T01:45:45.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.809+0000 7f6b67613800 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94540772905568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2f9f60 con 0x55fbfd2ed9f0 2024-09-18T01:45:45.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.809+0000 7f6b67613800 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2faa80 con 0x55fbfd2f3c60 2024-09-18T01:45:45.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.810+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94540772905568] v33'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b5805c040 con 0x55fbfd2ed9f0 2024-09-18T01:45:45.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.811+0000 7f6b63468640 1 -- 172.21.15.146:0/26362355 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v33'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b5c057040 con 0x55fbfd2f3c60 2024-09-18T01:45:45.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.811+0000 7f6b67613800 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94540772910416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2f9f60 con 0x55fbfd2f3c60 2024-09-18T01:45:45.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.811+0000 7f6b67613800 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2fb510 con 0x7f6b5c035070 2024-09-18T01:45:45.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.812+0000 7f6b63468640 1 -- 172.21.15.146:0/26362355 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94540772910416] v33'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b5c057040 con 0x55fbfd2f3c60 2024-09-18T01:45:45.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.812+0000 7f6b62c67640 1 -- 172.21.15.146:0/26362355 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v33'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b54061040 con 0x7f6b5c035070 2024-09-18T01:45:45.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.812+0000 7f6b67613800 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94540772907696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2f9ed0 con 0x7f6b5c035070 2024-09-18T01:45:45.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.812+0000 7f6b67613800 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2fc3d0 con 0x55fbfd2ed9f0 2024-09-18T01:45:45.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.813+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v33'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b5805c040 con 0x55fbfd2ed9f0 2024-09-18T01:45:45.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.813+0000 7f6b67613800 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94540772917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2fcbb0 con 0x55fbfd2ed9f0 2024-09-18T01:45:45.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.813+0000 7f6b67613800 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2fd6d0 con 0x7f6b5403c040 2024-09-18T01:45:45.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.813+0000 7f6b62c67640 1 -- 172.21.15.146:0/26362355 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94540772907696] v33'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b54061040 con 0x7f6b5c035070 2024-09-18T01:45:45.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.814+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v33'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b5805c040 con 0x7f6b5403c040 2024-09-18T01:45:45.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.814+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94540772917504] v33'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b5805c040 con 0x55fbfd2ed9f0 2024-09-18T01:45:45.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.814+0000 7f6b67613800 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94540772921760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2fd690 con 0x7f6b5403c040 2024-09-18T01:45:45.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.814+0000 7f6b67613800 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2fc660 con 0x7f6b5403c040 2024-09-18T01:45:45.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.815+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94540772921760] v33'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b5805c040 con 0x7f6b5403c040 2024-09-18T01:45:45.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.816+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v33'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b5805c040 con 0x7f6b5403c040 2024-09-18T01:45:45.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.816+0000 7f6b67613800 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94540772918880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2fdc30 con 0x7f6b5403c040 2024-09-18T01:45:45.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.816+0000 7f6b67613800 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2fe5f0 con 0x7f6b5403c040 2024-09-18T01:45:45.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.817+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94540772918880] v33'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b5805c040 con 0x7f6b5403c040 2024-09-18T01:45:45.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.817+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v33'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b5805c040 con 0x7f6b5403c040 2024-09-18T01:45:45.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.818+0000 7f6b67613800 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94540772915456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2fe5f0 con 0x7f6b5403c040 2024-09-18T01:45:45.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.818+0000 7f6b67613800 20 add_watcher() i=0 2024-09-18T01:45:45.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.818+0000 7f6b67613800 20 add_watcher() i=1 2024-09-18T01:45:45.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.818+0000 7f6b67613800 20 add_watcher() i=2 2024-09-18T01:45:45.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.818+0000 7f6b67613800 20 add_watcher() i=3 2024-09-18T01:45:45.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.818+0000 7f6b67613800 20 add_watcher() i=4 2024-09-18T01:45:45.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.818+0000 7f6b67613800 20 add_watcher() i=5 2024-09-18T01:45:45.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.818+0000 7f6b67613800 20 add_watcher() i=6 2024-09-18T01:45:45.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.818+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94540772915456] v33'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b5805c040 con 0x7f6b5403c040 2024-09-18T01:45:45.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.818+0000 7f6b67613800 20 add_watcher() i=7 2024-09-18T01:45:45.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.818+0000 7f6b67613800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:45.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.818+0000 7f6b67613800 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd3018b0 con 0x55fbfd2ed9f0 2024-09-18T01:45:45.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.819+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6b5805c040 con 0x55fbfd2ed9f0 2024-09-18T01:45:45.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.819+0000 7f6b67613800 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94540772926128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd2feb80 con 0x55fbfd2ed9f0 2024-09-18T01:45:45.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.820+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94540772926128] v33'186 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6b58083040 con 0x55fbfd2ed9f0 2024-09-18T01:45:45.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.820+0000 7f6a197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:45.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.820+0000 7f6b67613800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:45.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.820+0000 7f6b67613800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:45.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.820+0000 7f6b67613800 5 note: GC not initialized 2024-09-18T01:45:45.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.820+0000 7f6993fff640 20 reqs_thread_entry: start 2024-09-18T01:45:45.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.820+0000 7f6b67613800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:45.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.820+0000 7f6b67613800 20 Filter name: none 2024-09-18T01:45:45.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.820+0000 7f6991ffb640 20 reqs_thread_entry: start 2024-09-18T01:45:45.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.821+0000 7f6b67613800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-18T01:45:45.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.821+0000 7f6b67613800 20 rados->read ofs=0 len=0 2024-09-18T01:45:45.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.821+0000 7f6b67613800 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd3351e0 con 0x7f6b5c035070 2024-09-18T01:45:45.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.821+0000 7f6b62c67640 1 -- 172.21.15.146:0/26362355 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f6b54061040 con 0x7f6b5c035070 2024-09-18T01:45:45.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.821+0000 7f6b67613800 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T01:45:45.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.821+0000 7f6b67613800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-18T01:45:45.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.821+0000 7f6b67613800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T01:45:45.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.821+0000 7f6b67613800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5 : miss 2024-09-18T01:45:45.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.821+0000 7f6b67613800 20 rados->read ofs=0 len=0 2024-09-18T01:45:45.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.821+0000 7f6b67613800 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:63 8.12 8:4ee8b646:root::.bucket.meta.myfoo%3a8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd336e00 con 0x55fbfd2f3c60 2024-09-18T01:45:45.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.821+0000 7f6b63468640 1 -- 172.21.15.146:0/26362355 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(63 .bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f6b5c057040 con 0x55fbfd2f3c60 2024-09-18T01:45:45.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.821+0000 7f6b67613800 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T01:45:45.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.821+0000 7f6b67613800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5 info.flags=0x17 2024-09-18T01:45:45.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.821+0000 7f6b67613800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5 to cache LRU end 2024-09-18T01:45:45.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.821+0000 7f6b67613800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:45:45.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.821+0000 7f6b67613800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T01:45:45.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.821+0000 7f6b67613800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5 2024-09-18T01:45:45.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.821+0000 7f6b67613800 20 get_obj_state: octx=0x7f6b5800a040 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55fbfd3390f8 s->prefetch_data=0 2024-09-18T01:45:45.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.821+0000 7f6b67613800 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:64 3.18s0 3:1960fedc:::8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd33a2b0 con 0x55fbfd2f3c60 2024-09-18T01:45:45.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.822+0000 7f6b63468640 1 -- 172.21.15.146:0/26362355 <== osd.3 v2:172.21.15.146:6809/4106661138 15 ==== osd_op_reply(64 8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=910b,stat out=16b] v0'0 uv5 ondisk = 0) ==== 262+0+926 (crc 0 0 0) 0x7f6b5c057040 con 0x55fbfd2f3c60 2024-09-18T01:45:45.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.822+0000 7f6b67613800 10 manifest: total_size = 5 2024-09-18T01:45:45.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.822+0000 7f6b67613800 20 get_obj_state: setting s->obj_tag to _hNLHNGj28OOYAVOojjG8fixWycvZP-W 2024-09-18T01:45:45.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.822+0000 7f6a197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:45.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.822+0000 7f6b67613800 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94540772926128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd33a2b0 con 0x55fbfd2ed9f0 2024-09-18T01:45:45.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.823+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94540772926128] v33'187 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6b58083040 con 0x55fbfd2ed9f0 2024-09-18T01:45:45.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.823+0000 7f6b67613800 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94540772901536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd33a2b0 con 0x7f6b5c035070 2024-09-18T01:45:45.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.824+0000 7f6b62c67640 1 -- 172.21.15.146:0/26362355 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94540772901536] v33'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b54061040 con 0x7f6b5c035070 2024-09-18T01:45:45.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.824+0000 7f6b67613800 20 remove_watcher() i=0 2024-09-18T01:45:45.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.825+0000 7f6b67613800 2 removed watcher, disabling cache 2024-09-18T01:45:45.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.825+0000 7f6b67613800 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94540772905568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd33a2b0 con 0x55fbfd2ed9f0 2024-09-18T01:45:45.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.825+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94540772905568] v33'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b58083040 con 0x55fbfd2ed9f0 2024-09-18T01:45:45.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.825+0000 7f6b67613800 20 remove_watcher() i=1 2024-09-18T01:45:45.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.826+0000 7f6b67613800 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94540772910416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd33a2b0 con 0x55fbfd2f3c60 2024-09-18T01:45:45.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.826+0000 7f6b63468640 1 -- 172.21.15.146:0/26362355 <== osd.3 v2:172.21.15.146:6809/4106661138 16 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94540772910416] v33'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b5c057040 con 0x55fbfd2f3c60 2024-09-18T01:45:45.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.826+0000 7f6b67613800 20 remove_watcher() i=2 2024-09-18T01:45:45.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.826+0000 7f6b67613800 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94540772907696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd33a2b0 con 0x7f6b5c035070 2024-09-18T01:45:45.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.827+0000 7f6b62c67640 1 -- 172.21.15.146:0/26362355 <== osd.2 v2:172.21.15.146:6800/3820039304 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94540772907696] v33'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b54061040 con 0x7f6b5c035070 2024-09-18T01:45:45.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.827+0000 7f6b67613800 20 remove_watcher() i=3 2024-09-18T01:45:45.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.827+0000 7f6b67613800 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94540772917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd33a2b0 con 0x55fbfd2ed9f0 2024-09-18T01:45:45.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.828+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94540772917504] v33'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b58083040 con 0x55fbfd2ed9f0 2024-09-18T01:45:45.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.828+0000 7f6b67613800 20 remove_watcher() i=4 2024-09-18T01:45:45.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.829+0000 7f6b67613800 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94540772921760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd33a2b0 con 0x7f6b5403c040 2024-09-18T01:45:45.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.829+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94540772921760] v33'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b58083040 con 0x7f6b5403c040 2024-09-18T01:45:45.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.829+0000 7f6b67613800 20 remove_watcher() i=5 2024-09-18T01:45:45.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.830+0000 7f6b67613800 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94540772918880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd33a2b0 con 0x7f6b5403c040 2024-09-18T01:45:45.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.831+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94540772918880] v33'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b58083040 con 0x7f6b5403c040 2024-09-18T01:45:45.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.831+0000 7f6b67613800 20 remove_watcher() i=6 2024-09-18T01:45:45.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.831+0000 7f6b67613800 1 -- 172.21.15.146:0/26362355 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94540772915456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fbfd33a2b0 con 0x7f6b5403c040 2024-09-18T01:45:45.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.832+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94540772915456] v33'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b58083040 con 0x7f6b5403c040 2024-09-18T01:45:45.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.832+0000 7f6b67613800 20 remove_watcher() i=7 2024-09-18T01:45:45.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.832+0000 7f6b67613800 1 -- 172.21.15.146:0/26362355 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f6b5403c040 msgr2=0x7f6b5402d300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.832+0000 7f6b67613800 1 --2- 172.21.15.146:0/26362355 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f6b5403c040 0x7f6b5402d300 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.832+0000 7f6b67613800 1 -- 172.21.15.146:0/26362355 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55fbfd2ed9f0 msgr2=0x55fbfd2efeb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.832+0000 7f6b67613800 1 --2- 172.21.15.146:0/26362355 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55fbfd2ed9f0 0x55fbfd2efeb0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.832+0000 7f6b67613800 1 -- 172.21.15.146:0/26362355 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f6b5c035070 msgr2=0x7f6b5c04e970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.832+0000 7f6b67613800 1 --2- 172.21.15.146:0/26362355 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f6b5c035070 0x7f6b5c04e970 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.832+0000 7f6b67613800 1 -- 172.21.15.146:0/26362355 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55fbfd2f3c60 msgr2=0x55fbfd2f6050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.832+0000 7f6b67613800 1 --2- 172.21.15.146:0/26362355 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55fbfd2f3c60 0x55fbfd2f6050 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.832+0000 7f6b67613800 1 -- 172.21.15.146:0/26362355 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6a2c036b40 msgr2=0x7f6a2c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.832+0000 7f6b67613800 1 --2- 172.21.15.146:0/26362355 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6a2c036b40 0x7f6a2c039000 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6b54002090 tx=0x7f6b54033000 comp rx=0 tx=0).stop 2024-09-18T01:45:45.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.832+0000 7f6b67613800 1 -- 172.21.15.146:0/26362355 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fbfd2dac90 msgr2=0x55fbfd2e20d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.832+0000 7f6b67613800 1 --2- 172.21.15.146:0/26362355 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fbfd2dac90 0x55fbfd2e20d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c03dfd0 tx=0x7f6b5c04cb40 comp rx=0 tx=0).stop 2024-09-18T01:45:45.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.832+0000 7f6b62466640 1 -- 172.21.15.146:0/26362355 reap_dead start 2024-09-18T01:45:45.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.832+0000 7f6b67613800 1 -- 172.21.15.146:0/26362355 shutdown_connections 2024-09-18T01:45:45.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.832+0000 7f6b67613800 1 -- 172.21.15.146:0/26362355 >> 172.21.15.146:0/26362355 conn(0x55fbfd2d6ff0 msgr2=0x55fbfd2d50c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:45.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.832+0000 7f6b67613800 1 -- 172.21.15.146:0/26362355 shutdown_connections 2024-09-18T01:45:45.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.832+0000 7f6b67613800 1 -- 172.21.15.146:0/26362355 wait complete. 2024-09-18T01:45:45.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.832+0000 7f6b67613800 1 -- 172.21.15.146:0/841340156 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6a3c036b90 msgr2=0x7f6a3c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.832+0000 7f6b67613800 1 --2- 172.21.15.146:0/841340156 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6a3c036b90 0x7f6a3c039050 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x55fbfd2bbd30 tx=0x7f6b5404a310 comp rx=0 tx=0).stop 2024-09-18T01:45:45.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.832+0000 7f6b67613800 1 -- 172.21.15.146:0/841340156 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fbfd2cdf90 msgr2=0x55fbfd2ce3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.832+0000 7f6b67613800 1 --2- 172.21.15.146:0/841340156 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fbfd2cdf90 0x55fbfd2ce3b0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x55fbfd2b4720 tx=0x7f6b5c00ef30 comp rx=0 tx=0).stop 2024-09-18T01:45:45.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.833+0000 7f6b67613800 1 -- 172.21.15.146:0/841340156 shutdown_connections 2024-09-18T01:45:45.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.833+0000 7f6b67613800 1 --2- 172.21.15.146:0/841340156 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6a3c036b90 0x7f6a3c039050 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.833+0000 7f6b67613800 1 --2- 172.21.15.146:0/841340156 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fbfd2cdf90 0x55fbfd2ce3b0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.833+0000 7f6b67613800 1 -- 172.21.15.146:0/841340156 >> 172.21.15.146:0/841340156 conn(0x55fbfd2c2f20 msgr2=0x55fbfd2c5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:45.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.833+0000 7f6b67613800 1 -- 172.21.15.146:0/841340156 shutdown_connections 2024-09-18T01:45:45.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.833+0000 7f6b67613800 1 -- 172.21.15.146:0/841340156 wait complete. 2024-09-18T01:45:45.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.833+0000 7f6b67613800 1 -- 172.21.15.146:0/1708119101 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55fbfd1be900 msgr2=0x55fbfd2ba2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.833+0000 7f6b67613800 1 --2- 172.21.15.146:0/1708119101 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55fbfd1be900 0x55fbfd2ba2c0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.833+0000 7f6b67613800 1 -- 172.21.15.146:0/1708119101 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55fbfd2bd7e0 msgr2=0x55fbfd2bfbd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.833+0000 7f6b67613800 1 --2- 172.21.15.146:0/1708119101 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55fbfd2bd7e0 0x55fbfd2bfbd0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.833+0000 7f6b67613800 1 -- 172.21.15.146:0/1708119101 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6a48036b90 msgr2=0x7f6a48039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.833+0000 7f6b67613800 1 --2- 172.21.15.146:0/1708119101 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6a48036b90 0x7f6a48039050 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55fbfd12dd90 tx=0x7f6b58050000 comp rx=0 tx=0).stop 2024-09-18T01:45:45.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.833+0000 7f6b67613800 1 -- 172.21.15.146:0/1708119101 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fbfd12e650 msgr2=0x55fbfd2b3320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:45.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.833+0000 7f6b67613800 1 --2- 172.21.15.146:0/1708119101 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fbfd12e650 0x55fbfd2b3320 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f6b54014040 tx=0x7f6b54001250 comp rx=0 tx=0).stop 2024-09-18T01:45:45.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.833+0000 7f6b67613800 1 -- 172.21.15.146:0/1708119101 shutdown_connections 2024-09-18T01:45:45.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.833+0000 7f6b67613800 1 --2- 172.21.15.146:0/1708119101 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55fbfd2bd7e0 0x55fbfd2bfbd0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.833+0000 7f6b67613800 1 --2- 172.21.15.146:0/1708119101 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55fbfd1be900 0x55fbfd2ba2c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.833+0000 7f6b67613800 1 --2- 172.21.15.146:0/1708119101 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6a48036b90 0x7f6a48039050 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.833+0000 7f6b67613800 1 --2- 172.21.15.146:0/1708119101 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55fbfd12e650 0x55fbfd2b3320 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:45.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.833+0000 7f6b67613800 1 -- 172.21.15.146:0/1708119101 >> 172.21.15.146:0/1708119101 conn(0x55fbfd1b4db0 msgr2=0x55fbfd2a4c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:45.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.833+0000 7f6b67613800 1 -- 172.21.15.146:0/1708119101 shutdown_connections 2024-09-18T01:45:45.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:45.833+0000 7f6b67613800 1 -- 172.21.15.146:0/1708119101 wait complete. 2024-09-18T01:45:45.843 INFO:teuthology.orchestra.run.smithi146.stdout:fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-18T01:45:45.844 DEBUG:tasks.util.rgw: raw result: fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-18T01:45:45.848 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=609 failed=False 2024-09-18T01:45:45.863 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T01:45:45.957 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-18T01:45:45.957 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-18T01:45:45.958 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-18T01:45:45.958 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-18T01:45:45.958 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-18T01:45:45.959 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-18T01:45:45.959 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket rm --bucket myfoo --purge-objects 2024-09-18T01:45:46.004 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:46.005 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:46.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.003+0000 7f767f80e800 1 Processor -- start 2024-09-18T01:45:46.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.003+0000 7f767f80e800 1 -- start start 2024-09-18T01:45:46.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.004+0000 7f767f80e800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x5599cd337630 0x5599cd3c8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.004+0000 7f767f80e800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5599cd282b30 con 0x5599cd3c8b40 2024-09-18T01:45:46.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.004+0000 7f767f80e800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x5599cd264360 con 0x5599cd337630 2024-09-18T01:45:46.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.004+0000 7f767af1a640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x5599cd337630 0x5599cd3c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.004+0000 7f767af1a640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x5599cd337630 0x5599cd3c8600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38396/0 (socket says 172.21.15.146:38396) 2024-09-18T01:45:46.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.004+0000 7f767af1a640 1 -- 172.21.15.146:0/499621217 learned_addr learned my addr 172.21.15.146:0/499621217 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:46.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.004+0000 7f7673fff640 1 --1- 172.21.15.146:0/499621217 >> v1:172.21.15.129:6789/0 conn(0x5599cd3c8b40 0x5599cd3caf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:45890/0 (socket says 172.21.15.146:45890) 2024-09-18T01:45:46.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.004+0000 7f767af1a640 1 -- 172.21.15.146:0/499621217 >> v1:172.21.15.129:6789/0 conn(0x5599cd3c8b40 legacy=0x5599cd3caf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.004+0000 7f767af1a640 1 -- 172.21.15.146:0/499621217 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599cd28ae00 con 0x5599cd337630 2024-09-18T01:45:46.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.006+0000 7f767af1a640 1 --2- 172.21.15.146:0/499621217 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5599cd337630 0x5599cd3c8600 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f766c00a520 tx=0x7f766c045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43d8987f72a69f8c server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.006+0000 7f767a719640 1 -- 172.21.15.146:0/499621217 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f766c055070 con 0x5599cd337630 2024-09-18T01:45:46.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.006+0000 7f767a719640 1 -- 172.21.15.146:0/499621217 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f766c0515b0 con 0x5599cd337630 2024-09-18T01:45:46.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.006+0000 7f767a719640 1 -- 172.21.15.146:0/499621217 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f766c0518d0 con 0x5599cd337630 2024-09-18T01:45:46.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.007+0000 7f767f80e800 1 -- 172.21.15.146:0/499621217 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5599cd337630 msgr2=0x5599cd3c8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.007+0000 7f767f80e800 1 --2- 172.21.15.146:0/499621217 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5599cd337630 0x5599cd3c8600 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f766c00a520 tx=0x7f766c045ba0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.007+0000 7f767f80e800 1 -- 172.21.15.146:0/499621217 shutdown_connections 2024-09-18T01:45:46.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.007+0000 7f767f80e800 1 --2- 172.21.15.146:0/499621217 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5599cd337630 0x5599cd3c8600 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.007+0000 7f767f80e800 1 -- 172.21.15.146:0/499621217 >> 172.21.15.146:0/499621217 conn(0x5599cd3bddb0 msgr2=0x5599cd3c01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:46.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.007+0000 7f767f80e800 1 -- 172.21.15.146:0/499621217 shutdown_connections 2024-09-18T01:45:46.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.007+0000 7f767f80e800 1 -- 172.21.15.146:0/499621217 wait complete. 2024-09-18T01:45:46.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.020+0000 7f767f80e800 1 Processor -- start 2024-09-18T01:45:46.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.020+0000 7f767f80e800 1 -- start start 2024-09-18T01:45:46.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.020+0000 7f767f80e800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5599cd337630 0x5599cd4b4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.020+0000 7f767f80e800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5599cd30f360 con 0x5599cd337630 2024-09-18T01:45:46.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.020+0000 7f767af1a640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5599cd337630 0x5599cd4b4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.021+0000 7f767af1a640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5599cd337630 0x5599cd4b4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38398/0 (socket says 172.21.15.146:38398) 2024-09-18T01:45:46.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.021+0000 7f767af1a640 1 -- 172.21.15.146:0/242939847 learned_addr learned my addr 172.21.15.146:0/242939847 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:46.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.021+0000 7f767af1a640 1 -- 172.21.15.146:0/242939847 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599cd25cbc0 con 0x5599cd337630 2024-09-18T01:45:46.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.021+0000 7f767af1a640 1 --2- 172.21.15.146:0/242939847 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5599cd337630 0x5599cd4b4a70 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f766c025da0 tx=0x7f766c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ef96fa4d83c7897 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.021+0000 7f7568e09640 1 -- 172.21.15.146:0/242939847 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f766c051950 con 0x5599cd337630 2024-09-18T01:45:46.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.021+0000 7f7568e09640 1 -- 172.21.15.146:0/242939847 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f766c051af0 con 0x5599cd337630 2024-09-18T01:45:46.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.021+0000 7f7568e09640 1 -- 172.21.15.146:0/242939847 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f766c051dd0 con 0x5599cd337630 2024-09-18T01:45:46.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.022+0000 7f767f80e800 1 -- 172.21.15.146:0/242939847 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5599cd337630 msgr2=0x5599cd4b4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.022+0000 7f767f80e800 1 --2- 172.21.15.146:0/242939847 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5599cd337630 0x5599cd4b4a70 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f766c025da0 tx=0x7f766c051000 comp rx=0 tx=0).stop 2024-09-18T01:45:46.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.022+0000 7f767f80e800 1 -- 172.21.15.146:0/242939847 shutdown_connections 2024-09-18T01:45:46.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.022+0000 7f767f80e800 1 --2- 172.21.15.146:0/242939847 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5599cd337630 0x5599cd4b4a70 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.022+0000 7f767f80e800 1 -- 172.21.15.146:0/242939847 >> 172.21.15.146:0/242939847 conn(0x5599cd3bddb0 msgr2=0x5599cd4b0430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:46.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.022+0000 7f767f80e800 1 -- 172.21.15.146:0/242939847 shutdown_connections 2024-09-18T01:45:46.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.022+0000 7f767f80e800 1 -- 172.21.15.146:0/242939847 wait complete. 2024-09-18T01:45:46.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.022+0000 7f767f80e800 1 Processor -- start 2024-09-18T01:45:46.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.022+0000 7f767f80e800 1 -- start start 2024-09-18T01:45:46.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.022+0000 7f767f80e800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5599cd337630 0x5599cd4bc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.022+0000 7f767f80e800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5599cd3cc920 con 0x5599cd337630 2024-09-18T01:45:46.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.023+0000 7f767af1a640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5599cd337630 0x5599cd4bc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.023+0000 7f767af1a640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5599cd337630 0x5599cd4bc3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38408/0 (socket says 172.21.15.146:38408) 2024-09-18T01:45:46.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.023+0000 7f767af1a640 1 -- 172.21.15.146:0/3935940556 learned_addr learned my addr 172.21.15.146:0/3935940556 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:46.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.023+0000 7f767af1a640 1 -- 172.21.15.146:0/3935940556 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599cd270fe0 con 0x5599cd337630 2024-09-18T01:45:46.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.023+0000 7f767af1a640 1 --2- 172.21.15.146:0/3935940556 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5599cd337630 0x5599cd4bc3a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f766c067040 tx=0x7f766c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.023+0000 7f7567606640 1 -- 172.21.15.146:0/3935940556 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f766c073070 con 0x5599cd337630 2024-09-18T01:45:46.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.023+0000 7f7567606640 1 -- 172.21.15.146:0/3935940556 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f766c05a450 con 0x5599cd337630 2024-09-18T01:45:46.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.023+0000 7f767f80e800 1 -- 172.21.15.146:0/3935940556 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5599cd4bc8e0 con 0x5599cd337630 2024-09-18T01:45:46.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.023+0000 7f7567606640 1 -- 172.21.15.146:0/3935940556 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f766c05a730 con 0x5599cd337630 2024-09-18T01:45:46.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.023+0000 7f767f80e800 1 -- 172.21.15.146:0/3935940556 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599cd4bce60 con 0x5599cd337630 2024-09-18T01:45:46.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.024+0000 7f7567606640 1 -- 172.21.15.146:0/3935940556 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f766c076070 con 0x5599cd337630 2024-09-18T01:45:46.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.024+0000 7f7567606640 1 --2- 172.21.15.146:0/3935940556 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7560036b90 0x7f7560039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.024+0000 7f7567606640 1 -- 172.21.15.146:0/3935940556 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f766c062070 con 0x5599cd337630 2024-09-18T01:45:46.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.024+0000 7f7673fff640 1 --2- 172.21.15.146:0/3935940556 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7560036b90 0x7f7560039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.024+0000 7f767f80e800 1 --2- 172.21.15.146:0/3935940556 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5599cd3c8b40 0x5599cd4c3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.024+0000 7f767f80e800 1 -- 172.21.15.146:0/3935940556 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd4c3990 con 0x5599cd3c8b40 2024-09-18T01:45:46.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.024+0000 7f767b71b640 1 --2- 172.21.15.146:0/3935940556 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5599cd3c8b40 0x5599cd4c3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.025+0000 7f7673fff640 1 --2- 172.21.15.146:0/3935940556 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7560036b90 0x7f7560039050 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7664000f60 tx=0x7f7664001370 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.025+0000 7f767b71b640 1 --2- 172.21.15.146:0/3935940556 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5599cd3c8b40 0x5599cd4c3410 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.025+0000 7f767b71b640 1 -- 172.21.15.146:0/3935940556 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f767400a4a0 con 0x5599cd3c8b40 2024-09-18T01:45:46.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.025+0000 7f767f80e800 1 -- 172.21.15.146:0/3935940556 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd4c09e0 con 0x5599cd3c8b40 2024-09-18T01:45:46.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.025+0000 7f767b71b640 1 -- 172.21.15.146:0/3935940556 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f767400a4a0 con 0x5599cd3c8b40 2024-09-18T01:45:46.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.025+0000 7f767f80e800 1 -- 172.21.15.146:0/3935940556 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd4c57b0 con 0x5599cd3c8b40 2024-09-18T01:45:46.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.026+0000 7f767b71b640 1 -- 172.21.15.146:0/3935940556 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f767400a4a0 con 0x5599cd3c8b40 2024-09-18T01:45:46.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.026+0000 7f767f80e800 1 -- 172.21.15.146:0/3935940556 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd4c49e0 con 0x5599cd3c8b40 2024-09-18T01:45:46.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.026+0000 7f767b71b640 1 -- 172.21.15.146:0/3935940556 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f767400a4a0 con 0x5599cd3c8b40 2024-09-18T01:45:46.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.026+0000 7f767f80e800 1 --2- 172.21.15.146:0/3935940556 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5599cd4c6b60 0x5599cd4c8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.026+0000 7f767f80e800 1 -- 172.21.15.146:0/3935940556 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd4c9490 con 0x5599cd4c6b60 2024-09-18T01:45:46.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.026+0000 7f767af1a640 1 --2- 172.21.15.146:0/3935940556 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5599cd4c6b60 0x5599cd4c8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.026+0000 7f767af1a640 1 --2- 172.21.15.146:0/3935940556 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5599cd4c6b60 0x5599cd4c8f50 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.027+0000 7f767af1a640 1 -- 172.21.15.146:0/3935940556 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f766c075030 con 0x5599cd4c6b60 2024-09-18T01:45:46.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.027+0000 7f767f80e800 1 Processor -- start 2024-09-18T01:45:46.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.027+0000 7f767f80e800 1 -- start start 2024-09-18T01:45:46.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.027+0000 7f767f80e800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5599cd4d7090 0x5599cd4d74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.027+0000 7f767f80e800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5599cd25e580 con 0x5599cd4d7090 2024-09-18T01:45:46.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.027+0000 7f767b71b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5599cd4d7090 0x5599cd4d74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.028+0000 7f767b71b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5599cd4d7090 0x5599cd4d74b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38424/0 (socket says 172.21.15.146:38424) 2024-09-18T01:45:46.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.028+0000 7f767b71b640 1 -- 172.21.15.146:0/4106065284 learned_addr learned my addr 172.21.15.146:0/4106065284 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:46.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.028+0000 7f767b71b640 1 -- 172.21.15.146:0/4106065284 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599cd4d79f0 con 0x5599cd4d7090 2024-09-18T01:45:46.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.028+0000 7f767b71b640 1 --2- 172.21.15.146:0/4106065284 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5599cd4d7090 0x5599cd4d74b0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x5599cd4bd7a0 tx=0x7f76740178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.028+0000 7f7564e01640 1 -- 172.21.15.146:0/4106065284 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7674013440 con 0x5599cd4d7090 2024-09-18T01:45:46.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.028+0000 7f7564e01640 1 -- 172.21.15.146:0/4106065284 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76740135e0 con 0x5599cd4d7090 2024-09-18T01:45:46.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.028+0000 7f767f80e800 1 -- 172.21.15.146:0/4106065284 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5599cd4d7c80 con 0x5599cd4d7090 2024-09-18T01:45:46.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.028+0000 7f7564e01640 1 -- 172.21.15.146:0/4106065284 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76740138c0 con 0x5599cd4d7090 2024-09-18T01:45:46.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.028+0000 7f767f80e800 1 -- 172.21.15.146:0/4106065284 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599cd4da960 con 0x5599cd4d7090 2024-09-18T01:45:46.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.029+0000 7f7564e01640 1 -- 172.21.15.146:0/4106065284 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7674011040 con 0x5599cd4d7090 2024-09-18T01:45:46.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.029+0000 7f7564e01640 1 --2- 172.21.15.146:0/4106065284 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7554036b90 0x7f7554039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.029+0000 7f7564e01640 1 -- 172.21.15.146:0/4106065284 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f767401d070 con 0x5599cd4d7090 2024-09-18T01:45:46.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.029+0000 7f767af1a640 1 --2- 172.21.15.146:0/4106065284 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7554036b90 0x7f7554039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.029+0000 7f767f80e800 1 Processor -- start 2024-09-18T01:45:46.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.030+0000 7f767f80e800 1 -- start start 2024-09-18T01:45:46.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.030+0000 7f767af1a640 1 --2- 172.21.15.146:0/4106065284 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7554036b90 0x7f7554039050 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f766c064520 tx=0x7f766c08f550 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.030+0000 7f767f80e800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5599cd4e3d00 0x5599cd4e4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.030+0000 7f767f80e800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5599cd4b5160 con 0x5599cd4e3d00 2024-09-18T01:45:46.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.030+0000 7f767b71b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5599cd4e3d00 0x5599cd4e4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.030+0000 7f767b71b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5599cd4e3d00 0x5599cd4e4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38440/0 (socket says 172.21.15.146:38440) 2024-09-18T01:45:46.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.030+0000 7f767b71b640 1 -- 172.21.15.146:0/3712046050 learned_addr learned my addr 172.21.15.146:0/3712046050 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:46.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.030+0000 7f767b71b640 1 -- 172.21.15.146:0/3712046050 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599cd4e46d0 con 0x5599cd4e3d00 2024-09-18T01:45:46.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.030+0000 7f767b71b640 1 --2- 172.21.15.146:0/3712046050 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5599cd4e3d00 0x5599cd4e4100 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f767404c8c0 tx=0x7f7674001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0c36b82b8843170 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.030+0000 7f755e7fc640 1 -- 172.21.15.146:0/3712046050 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7674027040 con 0x5599cd4e3d00 2024-09-18T01:45:46.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.030+0000 7f755e7fc640 1 -- 172.21.15.146:0/3712046050 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7674012cc0 con 0x5599cd4e3d00 2024-09-18T01:45:46.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.030+0000 7f755e7fc640 1 -- 172.21.15.146:0/3712046050 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f767404b250 con 0x5599cd4e3d00 2024-09-18T01:45:46.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.031+0000 7f767f80e800 1 -- 172.21.15.146:0/3712046050 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5599cd4e3d00 msgr2=0x5599cd4e4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.031+0000 7f767f80e800 1 --2- 172.21.15.146:0/3712046050 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5599cd4e3d00 0x5599cd4e4100 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f767404c8c0 tx=0x7f7674001940 comp rx=0 tx=0).stop 2024-09-18T01:45:46.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.031+0000 7f767f80e800 1 -- 172.21.15.146:0/3712046050 shutdown_connections 2024-09-18T01:45:46.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.031+0000 7f767f80e800 1 --2- 172.21.15.146:0/3712046050 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5599cd4e3d00 0x5599cd4e4100 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.031+0000 7f767f80e800 1 -- 172.21.15.146:0/3712046050 >> 172.21.15.146:0/3712046050 conn(0x5599cd4e00b0 msgr2=0x5599cd4de1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:46.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.031+0000 7f767f80e800 1 -- 172.21.15.146:0/3712046050 shutdown_connections 2024-09-18T01:45:46.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.031+0000 7f767f80e800 1 -- 172.21.15.146:0/3712046050 wait complete. 2024-09-18T01:45:46.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.031+0000 7f767f80e800 1 Processor -- start 2024-09-18T01:45:46.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.031+0000 7f767f80e800 1 -- start start 2024-09-18T01:45:46.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.031+0000 7f767f80e800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5599cd4e3d00 0x5599cd4eb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.031+0000 7f767f80e800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5599cd4e4ca0 con 0x5599cd4e3d00 2024-09-18T01:45:46.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.032+0000 7f767b71b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5599cd4e3d00 0x5599cd4eb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.032+0000 7f767b71b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5599cd4e3d00 0x5599cd4eb1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38452/0 (socket says 172.21.15.146:38452) 2024-09-18T01:45:46.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.032+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 learned_addr learned my addr 172.21.15.146:0/74251215 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:46.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.032+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599cd4eb730 con 0x5599cd4e3d00 2024-09-18T01:45:46.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.032+0000 7f767b71b640 1 --2- 172.21.15.146:0/74251215 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5599cd4e3d00 0x5599cd4eb1f0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f767404b7b0 tx=0x7f767404c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.032+0000 7f755cff9640 1 -- 172.21.15.146:0/74251215 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7674027070 con 0x5599cd4e3d00 2024-09-18T01:45:46.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.032+0000 7f755cff9640 1 -- 172.21.15.146:0/74251215 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7674001610 con 0x5599cd4e3d00 2024-09-18T01:45:46.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.032+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5599cd4eb9c0 con 0x5599cd4e3d00 2024-09-18T01:45:46.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.032+0000 7f755cff9640 1 -- 172.21.15.146:0/74251215 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f767402aa60 con 0x5599cd4e3d00 2024-09-18T01:45:46.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.032+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599cd4ee670 con 0x5599cd4e3d00 2024-09-18T01:45:46.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.033+0000 7f755cff9640 1 -- 172.21.15.146:0/74251215 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f767402ac00 con 0x5599cd4e3d00 2024-09-18T01:45:46.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.033+0000 7f755cff9640 1 --2- 172.21.15.146:0/74251215 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7544036b90 0x7f7544039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.033+0000 7f755cff9640 1 -- 172.21.15.146:0/74251215 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f7674033070 con 0x5599cd4e3d00 2024-09-18T01:45:46.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.033+0000 7f767af1a640 1 --2- 172.21.15.146:0/74251215 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7544036b90 0x7f7544039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.033+0000 7f767af1a640 1 --2- 172.21.15.146:0/74251215 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7544036b90 0x7f7544039050 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f766c005a60 tx=0x7f766c08c000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.034+0000 7f767f80e800 20 rados->read ofs=0 len=0 2024-09-18T01:45:46.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.034+0000 7f767f80e800 1 --2- 172.21.15.146:0/74251215 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5599cd4f6e40 0x5599cd4f9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.034+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd4f9a50 con 0x5599cd4f6e40 2024-09-18T01:45:46.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.034+0000 7f7673fff640 1 --2- 172.21.15.146:0/74251215 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5599cd4f6e40 0x5599cd4f9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.034+0000 7f7673fff640 1 --2- 172.21.15.146:0/74251215 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5599cd4f6e40 0x5599cd4f9300 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.034+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f766400f610 con 0x5599cd4f6e40 2024-09-18T01:45:46.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.034+0000 7f767f80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:46.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.034+0000 7f767f80e800 20 realm 2024-09-18T01:45:46.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.034+0000 7f767f80e800 20 rados->read ofs=0 len=0 2024-09-18T01:45:46.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.034+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd4f6290 con 0x5599cd4f6e40 2024-09-18T01:45:46.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.035+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f766400f610 con 0x5599cd4f6e40 2024-09-18T01:45:46.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.035+0000 7f767f80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:46.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.035+0000 7f767f80e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:46.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.035+0000 7f767f80e800 20 rados->read ofs=0 len=0 2024-09-18T01:45:46.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.035+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd4fa540 con 0x5599cd4f6e40 2024-09-18T01:45:46.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.035+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f766400f610 con 0x5599cd4f6e40 2024-09-18T01:45:46.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.035+0000 7f767f80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:46.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.035+0000 7f767f80e800 20 rados->read ofs=0 len=0 2024-09-18T01:45:46.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.035+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd4fae10 con 0x5599cd4f6e40 2024-09-18T01:45:46.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.035+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f766400f610 con 0x5599cd4f6e40 2024-09-18T01:45:46.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.035+0000 7f767f80e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:46.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.035+0000 7f767f80e800 20 rados->read ofs=0 len=0 2024-09-18T01:45:46.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.035+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd4fb1b0 con 0x5599cd4f6e40 2024-09-18T01:45:46.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.035+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f766400f610 con 0x5599cd4f6e40 2024-09-18T01:45:46.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.035+0000 7f767f80e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:46.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.035+0000 7f767f80e800 20 searching for the correct realm 2024-09-18T01:45:46.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.036+0000 7f767f80e800 1 --2- 172.21.15.146:0/74251215 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5599cd4fd090 0x5599cd4ff4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.036+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599cd4ffb90 con 0x5599cd4fd090 2024-09-18T01:45:46.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.036+0000 7f767b71b640 1 --2- 172.21.15.146:0/74251215 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5599cd4fd090 0x5599cd4ff4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.036+0000 7f767b71b640 1 --2- 172.21.15.146:0/74251215 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5599cd4fd090 0x5599cd4ff4c0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.036+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.036+0000 7f767b71b640 1 --2- 172.21.15.146:0/74251215 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f76740123a0 0x7f7674036580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.036+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599cd4ffb90 con 0x7f76740123a0 2024-09-18T01:45:46.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.036+0000 7f767af1a640 1 --2- 172.21.15.146:0/74251215 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f76740123a0 0x7f7674036580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.036+0000 7f767af1a640 1 --2- 172.21.15.146:0/74251215 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f76740123a0 0x7f7674036580 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.037+0000 7f767af1a640 1 -- 172.21.15.146:0/74251215 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f766c075030 con 0x7f76740123a0 2024-09-18T01:45:46.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.037+0000 7f767af1a640 1 --2- 172.21.15.146:0/74251215 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f766c0a0070 0x7f766c04f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.037+0000 7f767af1a640 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599cd4ffb90 con 0x7f766c0a0070 2024-09-18T01:45:46.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.037+0000 7f7673fff640 1 --2- 172.21.15.146:0/74251215 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f766c0a0070 0x7f766c04f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.037+0000 7f7673fff640 1 --2- 172.21.15.146:0/74251215 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f766c0a0070 0x7f766c04f360 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.037+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f766400f610 con 0x7f766c0a0070 2024-09-18T01:45:46.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.038+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599cd4ffb90 con 0x5599cd4f6e40 2024-09-18T01:45:46.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.038+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f766400f610 con 0x5599cd4f6e40 2024-09-18T01:45:46.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.038+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599cd4ffb90 con 0x5599cd4f6e40 2024-09-18T01:45:46.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.038+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f766400f610 con 0x5599cd4f6e40 2024-09-18T01:45:46.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.038+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599cd4ffb90 con 0x7f766c0a0070 2024-09-18T01:45:46.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.038+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f766400f610 con 0x7f766c0a0070 2024-09-18T01:45:46.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.038+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599cd4ffb90 con 0x7f766c0a0070 2024-09-18T01:45:46.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.038+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f766400f610 con 0x7f766c0a0070 2024-09-18T01:45:46.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.038+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599cd4ffb90 con 0x7f76740123a0 2024-09-18T01:45:46.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.039+0000 7f767af1a640 1 -- 172.21.15.146:0/74251215 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f766c075030 con 0x7f76740123a0 2024-09-18T01:45:46.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.039+0000 7f767af1a640 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599cd4ffb90 con 0x5599cd4fd090 2024-09-18T01:45:46.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.039+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.039+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599cd4ffb90 con 0x5599cd4f6e40 2024-09-18T01:45:46.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.039+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f766400f610 con 0x5599cd4f6e40 2024-09-18T01:45:46.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.039+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599cd4ffb90 con 0x7f766c0a0070 2024-09-18T01:45:46.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.039+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f766400f610 con 0x7f766c0a0070 2024-09-18T01:45:46.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.039+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599cd4ffb90 con 0x5599cd4f6e40 2024-09-18T01:45:46.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.040+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f766400f610 con 0x5599cd4f6e40 2024-09-18T01:45:46.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.040+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599cd4ffb90 con 0x7f76740123a0 2024-09-18T01:45:46.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.040+0000 7f767af1a640 1 -- 172.21.15.146:0/74251215 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f766c0af040 con 0x7f76740123a0 2024-09-18T01:45:46.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.040+0000 7f767af1a640 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599cd4ffb90 con 0x5599cd4fd090 2024-09-18T01:45:46.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.040+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.040+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599cd4ffb90 con 0x5599cd4fd090 2024-09-18T01:45:46.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.040+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.040+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599cd4ffb90 con 0x7f766c0a0070 2024-09-18T01:45:46.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.041+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f766400f610 con 0x7f766c0a0070 2024-09-18T01:45:46.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.041+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599cd4ffb90 con 0x5599cd4fd090 2024-09-18T01:45:46.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.041+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.041+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599cd4ffb90 con 0x5599cd4fd090 2024-09-18T01:45:46.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.041+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.041+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599cd4ffb90 con 0x5599cd4f6e40 2024-09-18T01:45:46.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.041+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f766400f610 con 0x5599cd4f6e40 2024-09-18T01:45:46.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.041+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599cd4ffb90 con 0x5599cd4f6e40 2024-09-18T01:45:46.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.041+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f766400f610 con 0x5599cd4f6e40 2024-09-18T01:45:46.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.042+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599cd4ffb90 con 0x7f766c0a0070 2024-09-18T01:45:46.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.042+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f766400f610 con 0x7f766c0a0070 2024-09-18T01:45:46.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.042+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599cd4ffb90 con 0x5599cd4fd090 2024-09-18T01:45:46.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.042+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.042+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599cd4ffb90 con 0x7f76740123a0 2024-09-18T01:45:46.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.042+0000 7f767af1a640 1 -- 172.21.15.146:0/74251215 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f766c0af040 con 0x7f76740123a0 2024-09-18T01:45:46.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.042+0000 7f767af1a640 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599cd4ffb90 con 0x5599cd4f6e40 2024-09-18T01:45:46.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.043+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f766400f610 con 0x5599cd4f6e40 2024-09-18T01:45:46.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.043+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599cd4ffb90 con 0x7f766c0a0070 2024-09-18T01:45:46.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.043+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f766400f610 con 0x7f766c0a0070 2024-09-18T01:45:46.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.043+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599cd4ffb90 con 0x5599cd4fd090 2024-09-18T01:45:46.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.043+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.043+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599cd4ffb90 con 0x7f766c0a0070 2024-09-18T01:45:46.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.043+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f766400f610 con 0x7f766c0a0070 2024-09-18T01:45:46.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.043+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599cd4ffb90 con 0x7f76740123a0 2024-09-18T01:45:46.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.044+0000 7f767af1a640 1 -- 172.21.15.146:0/74251215 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f766c0af040 con 0x7f76740123a0 2024-09-18T01:45:46.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.044+0000 7f767af1a640 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599cd4ffb90 con 0x5599cd4fd090 2024-09-18T01:45:46.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.044+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.044+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599cd4ffb90 con 0x7f766c0a0070 2024-09-18T01:45:46.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.044+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f766400f610 con 0x7f766c0a0070 2024-09-18T01:45:46.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.044+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599cd4ffb90 con 0x5599cd4f6e40 2024-09-18T01:45:46.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.044+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f766400f610 con 0x5599cd4f6e40 2024-09-18T01:45:46.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.044+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599cd4ffb90 con 0x7f76740123a0 2024-09-18T01:45:46.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.045+0000 7f767af1a640 1 -- 172.21.15.146:0/74251215 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f766c0af040 con 0x7f76740123a0 2024-09-18T01:45:46.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.045+0000 7f767f80e800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:46.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.045+0000 7f767f80e800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:46.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.045+0000 7f767f80e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:46.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.045+0000 7f767f80e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:46.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.045+0000 7f767f80e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:46.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.045+0000 7f767f80e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:46.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.045+0000 7f767f80e800 20 rados->read ofs=0 len=0 2024-09-18T01:45:46.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.045+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd4fbb30 con 0x5599cd4f6e40 2024-09-18T01:45:46.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.045+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f766400f610 con 0x5599cd4f6e40 2024-09-18T01:45:46.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.045+0000 7f767f80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:46.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.045+0000 7f767f80e800 20 rados->read ofs=0 len=0 2024-09-18T01:45:46.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.045+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd4fc3d0 con 0x5599cd4f6e40 2024-09-18T01:45:46.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.045+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f766400f610 con 0x5599cd4f6e40 2024-09-18T01:45:46.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.045+0000 7f767f80e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:46.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.045+0000 7f767f80e800 20 rados->read ofs=0 len=0 2024-09-18T01:45:46.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.045+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd500010 con 0x7f76740123a0 2024-09-18T01:45:46.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.045+0000 7f767af1a640 1 -- 172.21.15.146:0/74251215 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f766c0af040 con 0x7f76740123a0 2024-09-18T01:45:46.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.045+0000 7f767f80e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:46.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.045+0000 7f767f80e800 20 zone default found 2024-09-18T01:45:46.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.045+0000 7f767f80e800 4 Realm: () 2024-09-18T01:45:46.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.045+0000 7f767f80e800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:46.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.045+0000 7f767f80e800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:46.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.045+0000 7f767f80e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:46.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.045+0000 7f767f80e800 20 zonegroup default 2024-09-18T01:45:46.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.045+0000 7f767f80e800 20 rados->read ofs=0 len=0 2024-09-18T01:45:46.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.046+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd500860 con 0x7f766c0a0070 2024-09-18T01:45:46.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.046+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f766400f610 con 0x7f766c0a0070 2024-09-18T01:45:46.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.046+0000 7f767f80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:46.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.046+0000 7f767f80e800 20 rados->read ofs=0 len=0 2024-09-18T01:45:46.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.046+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd502240 con 0x5599cd4fd090 2024-09-18T01:45:46.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.046+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.046+0000 7f767f80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:46.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.046+0000 7f767f80e800 20 rados->read ofs=0 len=0 2024-09-18T01:45:46.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.046+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd5026e0 con 0x5599cd4fd090 2024-09-18T01:45:46.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.046+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.046+0000 7f767f80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:46.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.046+0000 7f767f80e800 20 started sync module instance, tier type = 2024-09-18T01:45:46.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.046+0000 7f767f80e800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:46.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.046+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd5016d0 con 0x7f76740123a0 2024-09-18T01:45:46.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.047+0000 7f767af1a640 1 -- 172.21.15.146:0/74251215 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v33'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f766c0af040 con 0x7f76740123a0 2024-09-18T01:45:46.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.048+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94119062936256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd501330 con 0x7f76740123a0 2024-09-18T01:45:46.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.048+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd503520 con 0x5599cd4f6e40 2024-09-18T01:45:46.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.049+0000 7f767af1a640 1 -- 172.21.15.146:0/74251215 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94119062936256] v33'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f766c0af040 con 0x7f76740123a0 2024-09-18T01:45:46.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.049+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v33'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f766400f610 con 0x5599cd4f6e40 2024-09-18T01:45:46.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.049+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94119062940480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd503940 con 0x5599cd4f6e40 2024-09-18T01:45:46.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.049+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd504380 con 0x5599cd4fd090 2024-09-18T01:45:46.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.050+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v33'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.050+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94119062945360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd504380 con 0x5599cd4fd090 2024-09-18T01:45:46.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.050+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd505380 con 0x7f76740123a0 2024-09-18T01:45:46.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.050+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94119062940480] v33'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f766400f610 con 0x5599cd4f6e40 2024-09-18T01:45:46.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.051+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94119062945360] v33'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.051+0000 7f767af1a640 1 -- 172.21.15.146:0/74251215 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v33'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f766c0af040 con 0x7f76740123a0 2024-09-18T01:45:46.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.051+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94119062949488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd504770 con 0x7f76740123a0 2024-09-18T01:45:46.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.051+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd505d90 con 0x5599cd4f6e40 2024-09-18T01:45:46.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.052+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v33'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f766400f610 con 0x5599cd4f6e40 2024-09-18T01:45:46.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.052+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94119062952432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd5064c0 con 0x5599cd4f6e40 2024-09-18T01:45:46.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.052+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd506fe0 con 0x7f766c0a0070 2024-09-18T01:45:46.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.052+0000 7f767af1a640 1 -- 172.21.15.146:0/74251215 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94119062949488] v33'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f766c0af040 con 0x7f76740123a0 2024-09-18T01:45:46.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.053+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v33'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f766400f610 con 0x7f766c0a0070 2024-09-18T01:45:46.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.053+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94119062952432] v33'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f766400f610 con 0x5599cd4f6e40 2024-09-18T01:45:46.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.053+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94119062956720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd506fa0 con 0x7f766c0a0070 2024-09-18T01:45:46.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.053+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd507540 con 0x7f766c0a0070 2024-09-18T01:45:46.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.054+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94119062956720] v33'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f766400f610 con 0x7f766c0a0070 2024-09-18T01:45:46.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.054+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v33'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f766400f610 con 0x7f766c0a0070 2024-09-18T01:45:46.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.054+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94119062941536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd507540 con 0x7f766c0a0070 2024-09-18T01:45:46.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.054+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd507f00 con 0x7f766c0a0070 2024-09-18T01:45:46.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.055+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94119062941536] v33'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f766400f610 con 0x7f766c0a0070 2024-09-18T01:45:46.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.055+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v33'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f766400f610 con 0x7f766c0a0070 2024-09-18T01:45:46.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.055+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94119062953744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd507f00 con 0x7f766c0a0070 2024-09-18T01:45:46.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.055+0000 7f767f80e800 20 add_watcher() i=0 2024-09-18T01:45:46.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.055+0000 7f767f80e800 20 add_watcher() i=1 2024-09-18T01:45:46.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.055+0000 7f767f80e800 20 add_watcher() i=2 2024-09-18T01:45:46.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.055+0000 7f767f80e800 20 add_watcher() i=3 2024-09-18T01:45:46.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.055+0000 7f767f80e800 20 add_watcher() i=4 2024-09-18T01:45:46.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.055+0000 7f767f80e800 20 add_watcher() i=5 2024-09-18T01:45:46.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.055+0000 7f767f80e800 20 add_watcher() i=6 2024-09-18T01:45:46.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.056+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94119062953744] v33'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f766400f610 con 0x7f766c0a0070 2024-09-18T01:45:46.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.056+0000 7f767f80e800 20 add_watcher() i=7 2024-09-18T01:45:46.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.056+0000 7f767f80e800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:46.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.056+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd50b1e0 con 0x5599cd4f6e40 2024-09-18T01:45:46.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.056+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f766400f610 con 0x5599cd4f6e40 2024-09-18T01:45:46.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.056+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94119062961088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd508490 con 0x5599cd4f6e40 2024-09-18T01:45:46.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.057+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94119062961088] v33'188 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f766400f610 con 0x5599cd4f6e40 2024-09-18T01:45:46.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.057+0000 7f75317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:46.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.058+0000 7f767f80e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:46.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.058+0000 7f767f80e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:46.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.058+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd50aaf0 con 0x5599cd4f6e40 2024-09-18T01:45:46.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.059+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'55 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f766400f610 con 0x5599cd4f6e40 2024-09-18T01:45:46.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.059+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd5143c0 con 0x7f766c0a0070 2024-09-18T01:45:46.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.060+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f766400f610 con 0x7f766c0a0070 2024-09-18T01:45:46.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.060+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd514930 con 0x5599cd4fd090 2024-09-18T01:45:46.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.061+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.061+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd514930 con 0x5599cd4f6e40 2024-09-18T01:45:46.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.062+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'189 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f766400f610 con 0x5599cd4f6e40 2024-09-18T01:45:46.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.062+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd514840 con 0x7f76740123a0 2024-09-18T01:45:46.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.063+0000 7f767af1a640 1 -- 172.21.15.146:0/74251215 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'68 uv57 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f766c0af040 con 0x7f76740123a0 2024-09-18T01:45:46.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.063+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd514dd0 con 0x5599cd4fd090 2024-09-18T01:45:46.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.064+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'57 uv50 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.064+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd514dd0 con 0x5599cd4f6e40 2024-09-18T01:45:46.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.065+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f766400f610 con 0x5599cd4f6e40 2024-09-18T01:45:46.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.065+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd514e60 con 0x7f766c0a0070 2024-09-18T01:45:46.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.066+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'47 uv40 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f766400f610 con 0x7f766c0a0070 2024-09-18T01:45:46.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.066+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd514e60 con 0x7f76740123a0 2024-09-18T01:45:46.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.067+0000 7f767af1a640 1 -- 172.21.15.146:0/74251215 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f766c0af040 con 0x7f76740123a0 2024-09-18T01:45:46.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.067+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd515310 con 0x5599cd4fd090 2024-09-18T01:45:46.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.068+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.068+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd515310 con 0x7f76740123a0 2024-09-18T01:45:46.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.069+0000 7f767af1a640 1 -- 172.21.15.146:0/74251215 <== osd.2 v2:172.21.15.146:6800/3820039304 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'69 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f766c0af040 con 0x7f76740123a0 2024-09-18T01:45:46.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.069+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd515310 con 0x7f766c0a0070 2024-09-18T01:45:46.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.070+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f766400f610 con 0x7f766c0a0070 2024-09-18T01:45:46.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.070+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd515310 con 0x7f76740123a0 2024-09-18T01:45:46.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.071+0000 7f767af1a640 1 -- 172.21.15.146:0/74251215 <== osd.2 v2:172.21.15.146:6800/3820039304 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f766c0af040 con 0x7f76740123a0 2024-09-18T01:45:46.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.071+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd515310 con 0x7f766c0a0070 2024-09-18T01:45:46.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.072+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'59 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f766400f610 con 0x7f766c0a0070 2024-09-18T01:45:46.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.072+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd515310 con 0x5599cd4f6e40 2024-09-18T01:45:46.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.073+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'190 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f766400f610 con 0x5599cd4f6e40 2024-09-18T01:45:46.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.073+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd515310 con 0x5599cd4fd090 2024-09-18T01:45:46.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.074+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'62 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.074+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd515310 con 0x7f76740123a0 2024-09-18T01:45:46.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.075+0000 7f767af1a640 1 -- 172.21.15.146:0/74251215 <== osd.2 v2:172.21.15.146:6800/3820039304 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'70 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f766c0af040 con 0x7f76740123a0 2024-09-18T01:45:46.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.075+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd5153a0 con 0x5599cd4fd090 2024-09-18T01:45:46.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.076+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'37 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.076+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd5153a0 con 0x5599cd4f6e40 2024-09-18T01:45:46.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.077+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f766400f610 con 0x5599cd4f6e40 2024-09-18T01:45:46.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.077+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd5153a0 con 0x5599cd4f6e40 2024-09-18T01:45:46.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.078+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'191 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f766400f610 con 0x5599cd4f6e40 2024-09-18T01:45:46.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.078+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd5153d0 con 0x5599cd4fd090 2024-09-18T01:45:46.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.079+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'63 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.079+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd5153d0 con 0x7f76740123a0 2024-09-18T01:45:46.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.080+0000 7f767af1a640 1 -- 172.21.15.146:0/74251215 <== osd.2 v2:172.21.15.146:6800/3820039304 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'40 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f766c0af040 con 0x7f76740123a0 2024-09-18T01:45:46.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.080+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd5153a0 con 0x5599cd4fd090 2024-09-18T01:45:46.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.081+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.081+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd5153a0 con 0x5599cd4fd090 2024-09-18T01:45:46.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.082+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'42 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.082+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd5153a0 con 0x5599cd4fd090 2024-09-18T01:45:46.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.083+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.083+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd5153a0 con 0x5599cd4fd090 2024-09-18T01:45:46.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.084+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'58 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.084+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd5153a0 con 0x7f766c0a0070 2024-09-18T01:45:46.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.085+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'33 uv30 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f766400f610 con 0x7f766c0a0070 2024-09-18T01:45:46.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.085+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd5153a0 con 0x5599cd4fd090 2024-09-18T01:45:46.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.086+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'36 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.086+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd5153a0 con 0x7f766c0a0070 2024-09-18T01:45:46.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.087+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.0 v2:172.21.15.129:6800/1759265424 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'48 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f766400f610 con 0x7f766c0a0070 2024-09-18T01:45:46.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.087+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd5153a0 con 0x5599cd4fd090 2024-09-18T01:45:46.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.089+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'64 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.089+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd5153a0 con 0x7f766c0a0070 2024-09-18T01:45:46.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.090+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.0 v2:172.21.15.129:6800/1759265424 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'60 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f766400f610 con 0x7f766c0a0070 2024-09-18T01:45:46.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.090+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd5153a0 con 0x7f76740123a0 2024-09-18T01:45:46.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.091+0000 7f767af1a640 1 -- 172.21.15.146:0/74251215 <== osd.2 v2:172.21.15.146:6800/3820039304 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f766c0af040 con 0x7f76740123a0 2024-09-18T01:45:46.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.091+0000 7f74abfff640 20 reqs_thread_entry: start 2024-09-18T01:45:46.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.091+0000 7f767f80e800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:46.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.091+0000 7f767f80e800 20 Filter name: none 2024-09-18T01:45:46.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.092+0000 7f74a9ffb640 20 reqs_thread_entry: start 2024-09-18T01:45:46.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.092+0000 7f767f80e800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-18T01:45:46.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.092+0000 7f767f80e800 20 rados->read ofs=0 len=0 2024-09-18T01:45:46.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.092+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd5403a0 con 0x7f76740123a0 2024-09-18T01:45:46.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.092+0000 7f767af1a640 1 -- 172.21.15.146:0/74251215 <== osd.2 v2:172.21.15.146:6800/3820039304 19 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f766c0af040 con 0x7f76740123a0 2024-09-18T01:45:46.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.092+0000 7f767f80e800 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T01:45:46.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.092+0000 7f767f80e800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-18T01:45:46.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.092+0000 7f767f80e800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T01:45:46.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.092+0000 7f767f80e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5 : miss 2024-09-18T01:45:46.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.092+0000 7f767f80e800 20 rados->read ofs=0 len=0 2024-09-18T01:45:46.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.092+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:95 8.12 8:4ee8b646:root::.bucket.meta.myfoo%3a8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd541dc0 con 0x5599cd4fd090 2024-09-18T01:45:46.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.092+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 26 ==== osd_op_reply(95 .bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.092+0000 7f767f80e800 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T01:45:46.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.092+0000 7f767f80e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5 info.flags=0x17 2024-09-18T01:45:46.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.092+0000 7f767f80e800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5 to cache LRU end 2024-09-18T01:45:46.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.092+0000 7f767f80e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:45:46.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.092+0000 7f767f80e800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T01:45:46.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.092+0000 7f767f80e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5 2024-09-18T01:45:46.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.092+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:96 4.29 4:9436b7e0:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd5bf4a0 con 0x5599cd4fd090 2024-09-18T01:45:46.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.093+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 27 ==== osd_op_reply(96 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.093+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:97 4.11 4:8ab7c471:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd5bf4e0 con 0x7f766c0a0070 2024-09-18T01:45:46.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.093+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.0 v2:172.21.15.129:6800/1759265424 24 ==== osd_op_reply(97 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f766400f610 con 0x7f766c0a0070 2024-09-18T01:45:46.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.093+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:98 4.3c 4:3d0839d9:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd5bf4e0 con 0x5599cd4f6e40 2024-09-18T01:45:46.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.094+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.1 v2:172.21.15.146:6808/3930274777 28 ==== osd_op_reply(98 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.2 [call out=426b] v0'0 uv7 ondisk = 0) ==== 194+0+426 (crc 0 0 0) 0x7f766400f610 con 0x5599cd4f6e40 2024-09-18T01:45:46.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.094+0000 7f767f80e800 10 cls_bucket_list_unordered: got 9c8454ddf7aa50116496bac348d7550d 2024-09-18T01:45:46.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.094+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:99 4.31 4:8e2998ee:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd5bf4e0 con 0x5599cd4f6e40 2024-09-18T01:45:46.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.094+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.1 v2:172.21.15.146:6808/3930274777 29 ==== osd_op_reply(99 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f766400f610 con 0x5599cd4f6e40 2024-09-18T01:45:46.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.094+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:100 4.11 4:8b7e14c8:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd5bfab0 con 0x7f766c0a0070 2024-09-18T01:45:46.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.094+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.0 v2:172.21.15.129:6800/1759265424 25 ==== osd_op_reply(100 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.4 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f766400f610 con 0x7f766c0a0070 2024-09-18T01:45:46.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.094+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:101 4.18 4:1a93d74b:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd5bfab0 con 0x7f76740123a0 2024-09-18T01:45:46.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.095+0000 7f767af1a640 1 -- 172.21.15.146:0/74251215 <== osd.2 v2:172.21.15.146:6800/3820039304 20 ==== osd_op_reply(101 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f766c0af040 con 0x7f76740123a0 2024-09-18T01:45:46.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.095+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:102 4.21 4:86bf4593:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd5bfab0 con 0x7f766c0a0070 2024-09-18T01:45:46.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.095+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.0 v2:172.21.15.129:6800/1759265424 26 ==== osd_op_reply(102 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.6 [call out=424b] v0'0 uv7 ondisk = 0) ==== 194+0+424 (crc 0 0 0) 0x7f766400f610 con 0x7f766c0a0070 2024-09-18T01:45:46.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.095+0000 7f767f80e800 10 cls_bucket_list_unordered: got b1b9a972ccd8c962a473909b97007eb4 2024-09-18T01:45:46.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.095+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:103 4.10 4:0b1052bf:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd5bfa90 con 0x5599cd4fd090 2024-09-18T01:45:46.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.095+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 28 ==== osd_op_reply(103 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.7 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.095+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:104 4.19 4:9928806e:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd5bfa90 con 0x5599cd4fd090 2024-09-18T01:45:46.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.096+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 29 ==== osd_op_reply(104 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.8 [call out=425b] v0'0 uv9 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.096+0000 7f767f80e800 10 cls_bucket_list_unordered: got c785e1ed2950e3e36b1e2ca01f299a54 2024-09-18T01:45:46.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.096+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:105 4.2b 4:d7c70802:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd5bfa90 con 0x5599cd4f6e40 2024-09-18T01:45:46.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.096+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.1 v2:172.21.15.146:6808/3930274777 30 ==== osd_op_reply(105 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f766400f610 con 0x5599cd4f6e40 2024-09-18T01:45:46.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.096+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:106 4.3a 4:5cdac1fe:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd5bfa90 con 0x5599cd4fd090 2024-09-18T01:45:46.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.096+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 30 ==== osd_op_reply(106 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.10 [call out=698b] v0'0 uv11 ondisk = 0) ==== 195+0+698 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.096+0000 7f767f80e800 10 cls_bucket_list_unordered: got 24d27c169c2c881eb09a065116f2aa5c 2024-09-18T01:45:46.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.096+0000 7f767f80e800 10 cls_bucket_list_unordered: got bb3aec0fdcdbc2974890f805c585d432 2024-09-18T01:45:46.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.097+0000 7f767f80e800 20 get_obj_state: octx=0x7f766400f590 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x5599cd542648 s->prefetch_data=0 2024-09-18T01:45:46.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.097+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:107 3.10s0 3:0a0ad429:::8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5_9c8454ddf7aa50116496bac348d7550d:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd5bd020 con 0x5599cd4f6e40 2024-09-18T01:45:46.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.097+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.1 v2:172.21.15.146:6808/3930274777 31 ==== osd_op_reply(107 8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5_9c8454ddf7aa50116496bac348d7550d [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7f766400f610 con 0x5599cd4f6e40 2024-09-18T01:45:46.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.097+0000 7f767f80e800 10 manifest: total_size = 6 2024-09-18T01:45:46.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.097+0000 7f767f80e800 20 get_obj_state: setting s->obj_tag to 8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10555674518991285994 2024-09-18T01:45:46.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.097+0000 7f767f80e800 20 get_obj_state: octx=0x7f766400f590 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x5599cd542648 s->prefetch_data=0 2024-09-18T01:45:46.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.097+0000 7f767f80e800 20 prepare_atomic_modification: state is not atomic. state=0x5599cd542648 2024-09-18T01:45:46.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.097+0000 7f767f80e800 20 bucket index object: :.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.2 2024-09-18T01:45:46.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.097+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:108 4.3c 4:3d0839d9:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd5474b0 con 0x5599cd4f6e40 2024-09-18T01:45:46.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.098+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.1 v2:172.21.15.146:6808/3930274777 32 ==== osd_op_reply(108 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.2 [stat,call,call] v33'8 uv8 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f766400f610 con 0x5599cd4f6e40 2024-09-18T01:45:46.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.098+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:109 3.10s0 3:0a0ad429:::8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5_9c8454ddf7aa50116496bac348d7550d:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd545490 con 0x5599cd4f6e40 2024-09-18T01:45:46.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.100+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.1 v2:172.21.15.146:6808/3930274777 33 ==== osd_op_reply(109 8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5_9c8454ddf7aa50116496bac348d7550d [call] v33'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f766400f610 con 0x5599cd4f6e40 2024-09-18T01:45:46.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.100+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:110 4.3c 4:3d0839d9:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd547450 con 0x5599cd4f6e40 2024-09-18T01:45:46.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.100+0000 7f767f80e800 20 get_obj_state: octx=0x7f766400f590 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x5599cd542648 s->prefetch_data=0 2024-09-18T01:45:46.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.100+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:111 3.2fs0 3:f443ddc2:::8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5_b1b9a972ccd8c962a473909b97007eb4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd547450 con 0x5599cd4fd090 2024-09-18T01:45:46.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.100+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 31 ==== osd_op_reply(111 8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5_b1b9a972ccd8c962a473909b97007eb4 [getxattrs out=875b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+891 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.100+0000 7f767f80e800 10 manifest: total_size = 3 2024-09-18T01:45:46.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.100+0000 7f767f80e800 20 get_obj_state: setting s->obj_tag to 8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.990790928988510623 2024-09-18T01:45:46.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.100+0000 7f767f80e800 20 get_obj_state: octx=0x7f766400f590 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x5599cd542648 s->prefetch_data=0 2024-09-18T01:45:46.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.100+0000 7f767f80e800 20 prepare_atomic_modification: state is not atomic. state=0x5599cd542648 2024-09-18T01:45:46.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.100+0000 7f767f80e800 20 bucket index object: :.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.6 2024-09-18T01:45:46.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.100+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:112 4.21 4:86bf4593:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd54c580 con 0x7f766c0a0070 2024-09-18T01:45:46.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.101+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.1 v2:172.21.15.146:6808/3930274777 34 ==== osd_op_reply(110 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.2 [stat,call,call] v33'9 uv9 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f766400f610 con 0x5599cd4f6e40 2024-09-18T01:45:46.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.101+0000 7f755e7fc640 20 handle_completion(): completion ok for obj=9c8454ddf7aa50116496bac348d7550d 2024-09-18T01:45:46.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.102+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.0 v2:172.21.15.129:6800/1759265424 27 ==== osd_op_reply(112 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.6 [stat,call,call] v33'8 uv8 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f766400f610 con 0x7f766c0a0070 2024-09-18T01:45:46.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.102+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:113 3.2fs0 3:f443ddc2:::8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5_b1b9a972ccd8c962a473909b97007eb4:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd54c580 con 0x5599cd4fd090 2024-09-18T01:45:46.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.105+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 32 ==== osd_op_reply(113 8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5_b1b9a972ccd8c962a473909b97007eb4 [call] v33'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.105+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:114 4.21 4:86bf4593:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd548010 con 0x7f766c0a0070 2024-09-18T01:45:46.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.105+0000 7f767f80e800 20 get_obj_state: octx=0x7f766400f590 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x5599cd542648 s->prefetch_data=0 2024-09-18T01:45:46.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.105+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:115 3.33s0 3:cffddc3b:::8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5_c785e1ed2950e3e36b1e2ca01f299a54:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd5bd3b0 con 0x7f766c0a0070 2024-09-18T01:45:46.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.106+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.0 v2:172.21.15.129:6800/1759265424 28 ==== osd_op_reply(115 8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5_c785e1ed2950e3e36b1e2ca01f299a54 [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f766400f610 con 0x7f766c0a0070 2024-09-18T01:45:46.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.106+0000 7f767f80e800 10 manifest: total_size = 4 2024-09-18T01:45:46.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.106+0000 7f767f80e800 20 get_obj_state: setting s->obj_tag to 8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.1236233929105513270 2024-09-18T01:45:46.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.106+0000 7f767f80e800 20 get_obj_state: octx=0x7f766400f590 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x5599cd542648 s->prefetch_data=0 2024-09-18T01:45:46.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.106+0000 7f767f80e800 20 prepare_atomic_modification: state is not atomic. state=0x5599cd542648 2024-09-18T01:45:46.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.106+0000 7f767f80e800 20 bucket index object: :.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.8 2024-09-18T01:45:46.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.106+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:116 4.19 4:9928806e:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd54bc20 con 0x5599cd4fd090 2024-09-18T01:45:46.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.106+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.0 v2:172.21.15.129:6800/1759265424 29 ==== osd_op_reply(114 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.6 [stat,call,call] v33'9 uv9 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f766400f610 con 0x7f766c0a0070 2024-09-18T01:45:46.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.106+0000 7f755dffb640 20 handle_completion(): completion ok for obj=b1b9a972ccd8c962a473909b97007eb4 2024-09-18T01:45:46.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.108+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 33 ==== osd_op_reply(116 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.8 [stat,call,call] v33'10 uv10 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.108+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:117 3.33s0 3:cffddc3b:::8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd54a760 con 0x7f766c0a0070 2024-09-18T01:45:46.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.109+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.0 v2:172.21.15.129:6800/1759265424 30 ==== osd_op_reply(117 8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5_c785e1ed2950e3e36b1e2ca01f299a54 [call] v33'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f766400f610 con 0x7f766c0a0070 2024-09-18T01:45:46.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.109+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:118 4.19 4:9928806e:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd54a760 con 0x5599cd4fd090 2024-09-18T01:45:46.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.109+0000 7f767f80e800 20 get_obj_state: octx=0x7f766400f590 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x5599cd542648 s->prefetch_data=0 2024-09-18T01:45:46.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.109+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:119 3.14s0 3:2a8eeccc:::8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5_24d27c169c2c881eb09a065116f2aa5c:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd54a760 con 0x5599cd4fd090 2024-09-18T01:45:46.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.109+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 34 ==== osd_op_reply(119 8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5_24d27c169c2c881eb09a065116f2aa5c [getxattrs out=879b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.109+0000 7f767f80e800 10 manifest: total_size = 5 2024-09-18T01:45:46.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.109+0000 7f767f80e800 20 get_obj_state: setting s->obj_tag to 8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.16613154357579751115 2024-09-18T01:45:46.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.109+0000 7f767f80e800 20 get_obj_state: octx=0x7f766400f590 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x5599cd542648 s->prefetch_data=0 2024-09-18T01:45:46.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.109+0000 7f767f80e800 20 prepare_atomic_modification: state is not atomic. state=0x5599cd542648 2024-09-18T01:45:46.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.109+0000 7f767f80e800 20 bucket index object: :.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.10 2024-09-18T01:45:46.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.110+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:120 4.3a 4:5cdac1fe:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd54a760 con 0x5599cd4fd090 2024-09-18T01:45:46.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.110+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 35 ==== osd_op_reply(118 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.8 [stat,call,call] v33'11 uv11 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.110+0000 7f755e7fc640 20 handle_completion(): completion ok for obj=c785e1ed2950e3e36b1e2ca01f299a54 2024-09-18T01:45:46.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.111+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 36 ==== osd_op_reply(120 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.10 [stat,call,call] v33'12 uv12 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.111+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:121 3.14s0 3:2a8eeccc:::8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5_24d27c169c2c881eb09a065116f2aa5c:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd549750 con 0x5599cd4fd090 2024-09-18T01:45:46.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.112+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 37 ==== osd_op_reply(121 8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5_24d27c169c2c881eb09a065116f2aa5c [call] v33'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.112+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:122 4.3a 4:5cdac1fe:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd54a760 con 0x5599cd4fd090 2024-09-18T01:45:46.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.112+0000 7f767f80e800 20 get_obj_state: octx=0x7f766400f590 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x5599cd542648 s->prefetch_data=0 2024-09-18T01:45:46.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.112+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:123 3.18s0 3:1960fedc:::8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd54a760 con 0x5599cd4fd090 2024-09-18T01:45:46.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.112+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 38 ==== osd_op_reply(123 8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=910b,stat out=16b] v0'0 uv5 ondisk = 0) ==== 262+0+926 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.112+0000 7f767f80e800 10 manifest: total_size = 5 2024-09-18T01:45:46.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.112+0000 7f767f80e800 20 get_obj_state: setting s->obj_tag to _hNLHNGj28OOYAVOojjG8fixWycvZP-W 2024-09-18T01:45:46.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.112+0000 7f767f80e800 20 get_obj_state: octx=0x7f766400f590 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x5599cd542648 s->prefetch_data=0 2024-09-18T01:45:46.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.112+0000 7f767f80e800 20 prepare_atomic_modification: state is not atomic. state=0x5599cd542648 2024-09-18T01:45:46.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.112+0000 7f767f80e800 20 bucket index object: :.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.10 2024-09-18T01:45:46.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.112+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:124 4.3a 4:5cdac1fe:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd54a760 con 0x5599cd4fd090 2024-09-18T01:45:46.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.113+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 39 ==== osd_op_reply(122 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.10 [stat,call,call] v33'13 uv13 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.113+0000 7f755dffb640 20 handle_completion(): completion ok for obj=24d27c169c2c881eb09a065116f2aa5c 2024-09-18T01:45:46.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.113+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 40 ==== osd_op_reply(124 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.10 [stat,call,call] v33'14 uv14 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.113+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:125 3.18s0 3:1960fedc:::8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5_bb3aec0fdcdbc2974890f805c585d432:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd54a760 con 0x5599cd4fd090 2024-09-18T01:45:46.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.115+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 41 ==== osd_op_reply(125 8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5_bb3aec0fdcdbc2974890f805c585d432 [call] v33'6 uv6 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.115+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:126 4.3a 4:5cdac1fe:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd54b770 con 0x5599cd4fd090 2024-09-18T01:45:46.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.115+0000 7f767f80e800 20 list_objects_ordered: starting attempt 1 2024-09-18T01:45:46.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.115+0000 7f767f80e800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-18T01:45:46.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.115+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:127 4.29 4:9436b7e0:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd54b770 con 0x5599cd4fd090 2024-09-18T01:45:46.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.115+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:128 4.11 4:8ab7c471:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd542460 con 0x7f766c0a0070 2024-09-18T01:45:46.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.115+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:129 4.3c 4:3d0839d9:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd542460 con 0x5599cd4f6e40 2024-09-18T01:45:46.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.115+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:130 4.31 4:8e2998ee:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd552fb0 con 0x5599cd4f6e40 2024-09-18T01:45:46.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.115+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:131 4.11 4:8b7e14c8:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd555910 con 0x7f766c0a0070 2024-09-18T01:45:46.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.115+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:132 4.18 4:1a93d74b:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd555910 con 0x7f76740123a0 2024-09-18T01:45:46.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.115+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:133 4.21 4:86bf4593:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd55aa00 con 0x7f766c0a0070 2024-09-18T01:45:46.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.115+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:134 4.10 4:0b1052bf:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd55d500 con 0x5599cd4fd090 2024-09-18T01:45:46.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.115+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:135 4.19 4:9928806e:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd560000 con 0x5599cd4fd090 2024-09-18T01:45:46.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.115+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.0 v2:172.21.15.129:6800/1759265424 31 ==== osd_op_reply(128 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f766400f610 con 0x7f766c0a0070 2024-09-18T01:45:46.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.115+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:136 4.2b 4:d7c70802:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd560000 con 0x5599cd4f6e40 2024-09-18T01:45:46.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.115+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:137 4.3a 4:5cdac1fe:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd562ad0 con 0x5599cd4fd090 2024-09-18T01:45:46.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.116+0000 7f767af1a640 1 -- 172.21.15.146:0/74251215 <== osd.2 v2:172.21.15.146:6800/3820039304 21 ==== osd_op_reply(132 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f766c0af040 con 0x7f76740123a0 2024-09-18T01:45:46.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.116+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 42 ==== osd_op_reply(127 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.116+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.0 v2:172.21.15.129:6800/1759265424 32 ==== osd_op_reply(133 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.6 [call out=124b] v0'0 uv9 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f766400f610 con 0x7f766c0a0070 2024-09-18T01:45:46.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.116+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 43 ==== osd_op_reply(134 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.7 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.116+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.0 v2:172.21.15.129:6800/1759265424 33 ==== osd_op_reply(131 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.4 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f766400f610 con 0x7f766c0a0070 2024-09-18T01:45:46.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.116+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.1 v2:172.21.15.146:6808/3930274777 35 ==== osd_op_reply(129 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.2 [call out=124b] v0'0 uv9 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f766400f610 con 0x5599cd4f6e40 2024-09-18T01:45:46.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.116+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.1 v2:172.21.15.146:6808/3930274777 36 ==== osd_op_reply(130 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f766400f610 con 0x5599cd4f6e40 2024-09-18T01:45:46.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.116+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 44 ==== osd_op_reply(135 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.8 [call out=124b] v0'0 uv11 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.116+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.1 v2:172.21.15.146:6808/3930274777 37 ==== osd_op_reply(136 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f766400f610 con 0x5599cd4f6e40 2024-09-18T01:45:46.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.116+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 45 ==== osd_op_reply(126 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.10 [stat,call,call] v33'15 uv15 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.116+0000 7f755e7fc640 20 handle_completion(): completion ok for obj=bb3aec0fdcdbc2974890f805c585d432 2024-09-18T01:45:46.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.117+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 46 ==== osd_op_reply(137 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.10 [call out=124b] v0'0 uv15 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.117+0000 7f767f80e800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-18T01:45:46.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.117+0000 7f767f80e800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-18T01:45:46.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.117+0000 7f767f80e800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-18T01:45:46.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.117+0000 7f767f80e800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-18T01:45:46.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.117+0000 7f767f80e800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5])"; uploads.size()=0; is_truncated=0 2024-09-18T01:45:46.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.117+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:138 4.29 4:9436b7e0:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd562b30 con 0x5599cd4fd090 2024-09-18T01:45:46.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.117+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:139 4.11 4:8ab7c471:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd547ec0 con 0x7f766c0a0070 2024-09-18T01:45:46.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.117+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:140 4.3c 4:3d0839d9:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd555460 con 0x5599cd4f6e40 2024-09-18T01:45:46.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.117+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:141 4.31 4:8e2998ee:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd562b30 con 0x5599cd4f6e40 2024-09-18T01:45:46.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.117+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:142 4.11 4:8b7e14c8:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd547ec0 con 0x7f766c0a0070 2024-09-18T01:45:46.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.117+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:143 4.18 4:1a93d74b:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd555860 con 0x7f76740123a0 2024-09-18T01:45:46.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.117+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:144 4.21 4:86bf4593:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd555460 con 0x7f766c0a0070 2024-09-18T01:45:46.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.117+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:145 4.10 4:0b1052bf:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd562b30 con 0x5599cd4fd090 2024-09-18T01:45:46.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.117+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:146 4.19 4:9928806e:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd547ec0 con 0x5599cd4fd090 2024-09-18T01:45:46.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.117+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:147 4.2b 4:d7c70802:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd54eee0 con 0x5599cd4f6e40 2024-09-18T01:45:46.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.117+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:148 4.3a 4:5cdac1fe:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd551900 con 0x5599cd4fd090 2024-09-18T01:45:46.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.117+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.0 v2:172.21.15.129:6800/1759265424 34 ==== osd_op_reply(139 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f766400f610 con 0x7f766c0a0070 2024-09-18T01:45:46.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.117+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.1 v2:172.21.15.146:6808/3930274777 38 ==== osd_op_reply(140 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.2 [call out=124b] v0'0 uv9 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f766400f610 con 0x5599cd4f6e40 2024-09-18T01:45:46.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.117+0000 7f767af1a640 1 -- 172.21.15.146:0/74251215 <== osd.2 v2:172.21.15.146:6800/3820039304 22 ==== osd_op_reply(143 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f766c0af040 con 0x7f76740123a0 2024-09-18T01:45:46.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.117+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.1 v2:172.21.15.146:6808/3930274777 39 ==== osd_op_reply(141 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f766400f610 con 0x5599cd4f6e40 2024-09-18T01:45:46.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.117+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.0 v2:172.21.15.129:6800/1759265424 35 ==== osd_op_reply(144 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.6 [call out=124b] v0'0 uv9 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f766400f610 con 0x7f766c0a0070 2024-09-18T01:45:46.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.117+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.0 v2:172.21.15.129:6800/1759265424 36 ==== osd_op_reply(142 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.4 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f766400f610 con 0x7f766c0a0070 2024-09-18T01:45:46.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.117+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.1 v2:172.21.15.146:6808/3930274777 40 ==== osd_op_reply(147 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f766400f610 con 0x5599cd4f6e40 2024-09-18T01:45:46.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.117+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 47 ==== osd_op_reply(138 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.117+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 48 ==== osd_op_reply(145 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.7 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.117+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 49 ==== osd_op_reply(146 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.8 [call out=124b] v0'0 uv11 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.118+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 50 ==== osd_op_reply(148 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.10 [call out=124b] v0'0 uv15 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.118+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:149 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd547ec0 con 0x7f76740123a0 2024-09-18T01:45:46.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.119+0000 7f767af1a640 1 -- 172.21.15.146:0/74251215 <== osd.2 v2:172.21.15.146:6800/3820039304 23 ==== osd_op_reply(149 foo.buckets [call] v33'37 uv37 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f766c0af040 con 0x7f76740123a0 2024-09-18T01:45:46.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.119+0000 7f767f80e800 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x11) 2024-09-18T01:45:46.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.119+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:150 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd547ec0 con 0x7f76740123a0 2024-09-18T01:45:46.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.120+0000 7f767af1a640 1 -- 172.21.15.146:0/74251215 <== osd.2 v2:172.21.15.146:6800/3820039304 24 ==== osd_op_reply(150 myfoo [call,call,delete] v33'38 uv38 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7f766c0af040 con 0x7f76740123a0 2024-09-18T01:45:46.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.120+0000 7f767f80e800 10 removing default.rgw.meta+root+myfoo from cache 2024-09-18T01:45:46.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.120+0000 7f767f80e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-18T01:45:46.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.120+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:151 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94119063333584 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd547ec0 con 0x7f766c0a0070 2024-09-18T01:45:46.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.120+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.0 v2:172.21.15.129:6800/1759265424 37 ==== watch-notify(notify (1) cookie 94119062941536 notify 141733920791 ret 0) ==== 191+0+0 (crc 0 0 0) 0x5599cd5143c0 con 0x7f766c0a0070 2024-09-18T01:45:46.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.120+0000 7f755dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920791 cookie 94119062941536 notifier 4656 bl.length()=149 2024-09-18T01:45:46.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.120+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.0 v2:172.21.15.129:6800/1759265424 38 ==== osd_op_reply(151 notify.6 [notify cookie 94119063333584 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f766400f610 con 0x7f766c0a0070 2024-09-18T01:45:46.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.120+0000 7f755dffb640 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:152 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f74b00032c0 con 0x7f766c0a0070 2024-09-18T01:45:46.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.120+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.0 v2:172.21.15.129:6800/1759265424 39 ==== osd_op_reply(152 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f766400f610 con 0x7f766c0a0070 2024-09-18T01:45:46.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.120+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.0 v2:172.21.15.129:6800/1759265424 40 ==== watch-notify(notify_complete (2) cookie 94119063333584 notify 141733920791 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5599cd50aab0 con 0x7f766c0a0070 2024-09-18T01:45:46.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.120+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:153 8.12 8:4ee8b646:root::.bucket.meta.myfoo%3a8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd547ec0 con 0x5599cd4fd090 2024-09-18T01:45:46.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.121+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 51 ==== osd_op_reply(153 .bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5 [call,call,delete] v33'2 uv2 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.121+0000 7f767f80e800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5 from cache 2024-09-18T01:45:46.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.121+0000 7f767f80e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5, ofs0, ns] 2024-09-18T01:45:46.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.121+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:154 7.3 7:c609908c:::notify.5:head [notify cookie 94119063333584 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd547ec0 con 0x7f766c0a0070 2024-09-18T01:45:46.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.122+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.0 v2:172.21.15.129:6800/1759265424 41 ==== watch-notify(notify (1) cookie 94119062956720 notify 141733920792 ret 0) ==== 248+0+0 (crc 0 0 0) 0x5599cd50aab0 con 0x7f766c0a0070 2024-09-18T01:45:46.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.122+0000 7f755e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920792 cookie 94119062956720 notifier 4656 bl.length()=206 2024-09-18T01:45:46.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.122+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.0 v2:172.21.15.129:6800/1759265424 42 ==== osd_op_reply(154 notify.5 [notify cookie 94119063333584 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f766400f610 con 0x7f766c0a0070 2024-09-18T01:45:46.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.122+0000 7f755e7fc640 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:155 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f7540003d60 con 0x7f766c0a0070 2024-09-18T01:45:46.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.122+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.0 v2:172.21.15.129:6800/1759265424 43 ==== osd_op_reply(155 notify.5 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f766400f610 con 0x7f766c0a0070 2024-09-18T01:45:46.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.122+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.0 v2:172.21.15.129:6800/1759265424 44 ==== watch-notify(notify_complete (2) cookie 94119063333584 notify 141733920792 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5599cd50ae90 con 0x7f766c0a0070 2024-09-18T01:45:46.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.122+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:156 4.29 4:9436b7e0:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd547ec0 con 0x5599cd4fd090 2024-09-18T01:45:46.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.122+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:157 4.11 4:8ab7c471:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd562ad0 con 0x7f766c0a0070 2024-09-18T01:45:46.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.122+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:158 4.3c 4:3d0839d9:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd552780 con 0x5599cd4f6e40 2024-09-18T01:45:46.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.122+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:159 4.31 4:8e2998ee:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd547ec0 con 0x5599cd4f6e40 2024-09-18T01:45:46.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.122+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:160 4.11 4:8b7e14c8:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd562ad0 con 0x7f766c0a0070 2024-09-18T01:45:46.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.122+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:161 4.18 4:1a93d74b:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd5401e0 con 0x7f76740123a0 2024-09-18T01:45:46.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.122+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:162 4.21 4:86bf4593:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd5405c0 con 0x7f766c0a0070 2024-09-18T01:45:46.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.122+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:163 4.10 4:0b1052bf:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd547ec0 con 0x5599cd4fd090 2024-09-18T01:45:46.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.122+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:164 4.19 4:9928806e:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd562ad0 con 0x5599cd4fd090 2024-09-18T01:45:46.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.122+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:165 4.2b 4:d7c70802:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd5405c0 con 0x5599cd4f6e40 2024-09-18T01:45:46.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.122+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:166 4.3a 4:5cdac1fe:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd5405c0 con 0x5599cd4fd090 2024-09-18T01:45:46.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.124+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.1 v2:172.21.15.146:6808/3930274777 41 ==== osd_op_reply(158 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.2 [delete] v33'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f766400f610 con 0x5599cd4f6e40 2024-09-18T01:45:46.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.124+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.0 v2:172.21.15.129:6800/1759265424 45 ==== osd_op_reply(157 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.1 [delete] v33'3 uv3 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f766400f610 con 0x7f766c0a0070 2024-09-18T01:45:46.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.124+0000 7f767af1a640 1 -- 172.21.15.146:0/74251215 <== osd.2 v2:172.21.15.146:6800/3820039304 25 ==== osd_op_reply(161 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.5 [delete] v33'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f766c0af040 con 0x7f76740123a0 2024-09-18T01:45:46.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.124+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.1 v2:172.21.15.146:6808/3930274777 42 ==== osd_op_reply(159 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.3 [delete] v33'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f766400f610 con 0x5599cd4f6e40 2024-09-18T01:45:46.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.124+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.0 v2:172.21.15.129:6800/1759265424 46 ==== osd_op_reply(162 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.6 [delete] v33'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f766400f610 con 0x7f766c0a0070 2024-09-18T01:45:46.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.124+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 52 ==== osd_op_reply(156 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.0 [delete] v33'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.126+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 53 ==== osd_op_reply(164 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.8 [delete] v33'12 uv12 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.126+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.0 v2:172.21.15.129:6800/1759265424 47 ==== osd_op_reply(160 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.4 [delete] v33'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f766400f610 con 0x7f766c0a0070 2024-09-18T01:45:46.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.126+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 54 ==== osd_op_reply(166 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.10 [delete] v33'16 uv16 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.126+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 55 ==== osd_op_reply(163 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.7 [delete] v33'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.126+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.1 v2:172.21.15.146:6808/3930274777 43 ==== osd_op_reply(165 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5.9 [delete] v33'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f766400f610 con 0x5599cd4f6e40 2024-09-18T01:45:46.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.126+0000 7f767f80e800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5 : miss 2024-09-18T01:45:46.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.126+0000 7f767f80e800 20 rados->read ofs=0 len=0 2024-09-18T01:45:46.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.126+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:167 6.7 6:e692f554:::pubsub..bucket.myfoo%2f8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599cd547ec0 con 0x5599cd4fd090 2024-09-18T01:45:46.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.127+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 56 ==== osd_op_reply(167 pubsub..bucket.myfoo/8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.127+0000 7f767f80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:46.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.127+0000 7f767f80e800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5 info.flags=0x0 2024-09-18T01:45:46.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.127+0000 7f767f80e800 10 adding default.rgw.log++pubsub..bucket.myfoo/8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5 to cache LRU end 2024-09-18T01:45:46.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.127+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:168 6.7 6:e692f554:::pubsub..bucket.myfoo%2f8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd547ec0 con 0x5599cd4fd090 2024-09-18T01:45:46.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.129+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 57 ==== osd_op_reply(168 pubsub..bucket.myfoo/8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.5 [delete] v33'65 uv55 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.129+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:169 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd547ec0 con 0x7f76740123a0 2024-09-18T01:45:46.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.130+0000 7f767af1a640 1 -- 172.21.15.146:0/74251215 <== osd.2 v2:172.21.15.146:6800/3820039304 26 ==== osd_op_reply(169 foo.buckets [call] v33'39 uv39 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f766c0af040 con 0x7f76740123a0 2024-09-18T01:45:46.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.131+0000 7f75317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:46.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.131+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:170 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94119062961088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd547ec0 con 0x5599cd4f6e40 2024-09-18T01:45:46.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.132+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.1 v2:172.21.15.146:6808/3930274777 44 ==== osd_op_reply(170 data_loggenerations_metadata [watch unwatch cookie 94119062961088] v33'192 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f766400f610 con 0x5599cd4f6e40 2024-09-18T01:45:46.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.132+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:171 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94119062936256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd547ec0 con 0x7f76740123a0 2024-09-18T01:45:46.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.133+0000 7f767af1a640 1 -- 172.21.15.146:0/74251215 <== osd.2 v2:172.21.15.146:6800/3820039304 27 ==== osd_op_reply(171 notify.0 [watch unwatch cookie 94119062936256] v33'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f766c0af040 con 0x7f76740123a0 2024-09-18T01:45:46.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.133+0000 7f767f80e800 20 remove_watcher() i=0 2024-09-18T01:45:46.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.133+0000 7f767f80e800 2 removed watcher, disabling cache 2024-09-18T01:45:46.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.133+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:172 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94119062940480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd501ac0 con 0x5599cd4f6e40 2024-09-18T01:45:46.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.134+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.1 v2:172.21.15.146:6808/3930274777 45 ==== osd_op_reply(172 notify.1 [watch unwatch cookie 94119062940480] v33'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f766400f610 con 0x5599cd4f6e40 2024-09-18T01:45:46.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.134+0000 7f767f80e800 20 remove_watcher() i=1 2024-09-18T01:45:46.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.134+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:173 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94119062945360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd547ec0 con 0x5599cd4fd090 2024-09-18T01:45:46.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.135+0000 7f767b71b640 1 -- 172.21.15.146:0/74251215 <== osd.3 v2:172.21.15.146:6809/4106661138 58 ==== osd_op_reply(173 notify.2 [watch unwatch cookie 94119062945360] v33'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7674057040 con 0x5599cd4fd090 2024-09-18T01:45:46.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.135+0000 7f767f80e800 20 remove_watcher() i=2 2024-09-18T01:45:46.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.135+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:174 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94119062949488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd502b40 con 0x7f76740123a0 2024-09-18T01:45:46.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.136+0000 7f767af1a640 1 -- 172.21.15.146:0/74251215 <== osd.2 v2:172.21.15.146:6800/3820039304 28 ==== osd_op_reply(174 notify.3 [watch unwatch cookie 94119062949488] v33'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f766c0af040 con 0x7f76740123a0 2024-09-18T01:45:46.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.136+0000 7f767f80e800 20 remove_watcher() i=3 2024-09-18T01:45:46.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.136+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:175 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94119062952432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd501ac0 con 0x5599cd4f6e40 2024-09-18T01:45:46.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.137+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.1 v2:172.21.15.146:6808/3930274777 46 ==== osd_op_reply(175 notify.4 [watch unwatch cookie 94119062952432] v33'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f766400f610 con 0x5599cd4f6e40 2024-09-18T01:45:46.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.137+0000 7f767f80e800 20 remove_watcher() i=4 2024-09-18T01:45:46.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.137+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:176 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94119062956720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd547ec0 con 0x7f766c0a0070 2024-09-18T01:45:46.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.138+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.0 v2:172.21.15.129:6800/1759265424 48 ==== osd_op_reply(176 notify.5 [watch unwatch cookie 94119062956720] v33'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f766400f610 con 0x7f766c0a0070 2024-09-18T01:45:46.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.138+0000 7f767f80e800 20 remove_watcher() i=5 2024-09-18T01:45:46.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.138+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:177 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94119062941536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd502b40 con 0x7f766c0a0070 2024-09-18T01:45:46.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.139+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.0 v2:172.21.15.129:6800/1759265424 49 ==== osd_op_reply(177 notify.6 [watch unwatch cookie 94119062941536] v33'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f766400f610 con 0x7f766c0a0070 2024-09-18T01:45:46.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.139+0000 7f767f80e800 20 remove_watcher() i=6 2024-09-18T01:45:46.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.139+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:178 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94119062953744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599cd501ac0 con 0x7f766c0a0070 2024-09-18T01:45:46.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.140+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 <== osd.0 v2:172.21.15.129:6800/1759265424 50 ==== osd_op_reply(178 notify.7 [watch unwatch cookie 94119062953744] v33'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f766400f610 con 0x7f766c0a0070 2024-09-18T01:45:46.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.140+0000 7f767f80e800 20 remove_watcher() i=7 2024-09-18T01:45:46.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.140+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f766c0a0070 msgr2=0x7f766c04f360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.140+0000 7f767f80e800 1 --2- 172.21.15.146:0/74251215 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f766c0a0070 0x7f766c04f360 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.140+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5599cd4f6e40 msgr2=0x5599cd4f9300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.140+0000 7f767f80e800 1 --2- 172.21.15.146:0/74251215 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5599cd4f6e40 0x5599cd4f9300 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.140+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f76740123a0 msgr2=0x7f7674036580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.140+0000 7f767f80e800 1 --2- 172.21.15.146:0/74251215 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f76740123a0 0x7f7674036580 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.140+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5599cd4fd090 msgr2=0x5599cd4ff4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.140+0000 7f767f80e800 1 --2- 172.21.15.146:0/74251215 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5599cd4fd090 0x5599cd4ff4c0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.140+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7544036b90 msgr2=0x7f7544039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.140+0000 7f767f80e800 1 --2- 172.21.15.146:0/74251215 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7544036b90 0x7f7544039050 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f766c005a60 tx=0x7f766c08c000 comp rx=0 tx=0).stop 2024-09-18T01:45:46.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.140+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5599cd4e3d00 msgr2=0x5599cd4eb1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.140+0000 7f767f80e800 1 --2- 172.21.15.146:0/74251215 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5599cd4e3d00 0x5599cd4eb1f0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f767404b7b0 tx=0x7f767404c820 comp rx=0 tx=0).stop 2024-09-18T01:45:46.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.140+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 reap_dead start 2024-09-18T01:45:46.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.140+0000 7f7673fff640 1 -- 172.21.15.146:0/74251215 reap_dead start 2024-09-18T01:45:46.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.140+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 shutdown_connections 2024-09-18T01:45:46.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.140+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 >> 172.21.15.146:0/74251215 conn(0x5599cd4e00b0 msgr2=0x5599cd4e5410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:46.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.140+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 shutdown_connections 2024-09-18T01:45:46.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.140+0000 7f767f80e800 1 -- 172.21.15.146:0/74251215 wait complete. 2024-09-18T01:45:46.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.140+0000 7f767f80e800 1 -- 172.21.15.146:0/4106065284 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7554036b90 msgr2=0x7f7554039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.140+0000 7f767f80e800 1 --2- 172.21.15.146:0/4106065284 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7554036b90 0x7f7554039050 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f766c064520 tx=0x7f766c08f550 comp rx=0 tx=0).stop 2024-09-18T01:45:46.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.140+0000 7f767f80e800 1 -- 172.21.15.146:0/4106065284 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5599cd4d7090 msgr2=0x5599cd4d74b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.140+0000 7f767f80e800 1 --2- 172.21.15.146:0/4106065284 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5599cd4d7090 0x5599cd4d74b0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x5599cd4bd7a0 tx=0x7f76740178e0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.140+0000 7f767f80e800 1 -- 172.21.15.146:0/4106065284 shutdown_connections 2024-09-18T01:45:46.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.140+0000 7f767f80e800 1 --2- 172.21.15.146:0/4106065284 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7554036b90 0x7f7554039050 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.141+0000 7f767f80e800 1 --2- 172.21.15.146:0/4106065284 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5599cd4d7090 0x5599cd4d74b0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.141+0000 7f767f80e800 1 -- 172.21.15.146:0/4106065284 >> 172.21.15.146:0/4106065284 conn(0x5599cd4cc020 msgr2=0x5599cd4ceba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:46.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.141+0000 7f767f80e800 1 -- 172.21.15.146:0/4106065284 shutdown_connections 2024-09-18T01:45:46.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.141+0000 7f767f80e800 1 -- 172.21.15.146:0/4106065284 wait complete. 2024-09-18T01:45:46.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.141+0000 7f767f80e800 1 -- 172.21.15.146:0/3935940556 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5599cd3c8b40 msgr2=0x5599cd4c3410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.141+0000 7f767f80e800 1 --2- 172.21.15.146:0/3935940556 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5599cd3c8b40 0x5599cd4c3410 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.141+0000 7f767f80e800 1 -- 172.21.15.146:0/3935940556 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5599cd4c6b60 msgr2=0x5599cd4c8f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.141+0000 7f767f80e800 1 --2- 172.21.15.146:0/3935940556 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5599cd4c6b60 0x5599cd4c8f50 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.141+0000 7f767f80e800 1 -- 172.21.15.146:0/3935940556 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7560036b90 msgr2=0x7f7560039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.141+0000 7f767f80e800 1 --2- 172.21.15.146:0/3935940556 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7560036b90 0x7f7560039050 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7664000f60 tx=0x7f7664001370 comp rx=0 tx=0).stop 2024-09-18T01:45:46.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.141+0000 7f767f80e800 1 -- 172.21.15.146:0/3935940556 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5599cd337630 msgr2=0x5599cd4bc3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.141+0000 7f767f80e800 1 --2- 172.21.15.146:0/3935940556 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5599cd337630 0x5599cd4bc3a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f766c067040 tx=0x7f766c002fb0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.141+0000 7f767f80e800 1 -- 172.21.15.146:0/3935940556 shutdown_connections 2024-09-18T01:45:46.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.141+0000 7f767f80e800 1 --2- 172.21.15.146:0/3935940556 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5599cd4c6b60 0x5599cd4c8f50 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.141+0000 7f767f80e800 1 --2- 172.21.15.146:0/3935940556 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5599cd3c8b40 0x5599cd4c3410 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.141+0000 7f767f80e800 1 --2- 172.21.15.146:0/3935940556 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7560036b90 0x7f7560039050 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.141+0000 7f767f80e800 1 --2- 172.21.15.146:0/3935940556 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5599cd337630 0x5599cd4bc3a0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.141+0000 7f767f80e800 1 -- 172.21.15.146:0/3935940556 >> 172.21.15.146:0/3935940556 conn(0x5599cd3bddb0 msgr2=0x5599cd4aecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:46.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.141+0000 7f767f80e800 1 -- 172.21.15.146:0/3935940556 shutdown_connections 2024-09-18T01:45:46.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.141+0000 7f767f80e800 1 -- 172.21.15.146:0/3935940556 wait complete. 2024-09-18T01:45:46.152 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-18T01:45:46.152 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-18T01:45:46.152 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid foo --caps user=read 2024-09-18T01:45:46.198 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:46.198 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:46.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.197+0000 7fa016d26800 1 Processor -- start 2024-09-18T01:45:46.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.197+0000 7fa016d26800 1 -- start start 2024-09-18T01:45:46.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.198+0000 7fa016d26800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x56207e390a10 0x56207e392e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.198+0000 7fa016d26800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56207e24bb30 con 0x56207e38c710 2024-09-18T01:45:46.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.198+0000 7fa016d26800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x56207e22d360 con 0x56207e390a10 2024-09-18T01:45:46.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.198+0000 7fa00a1e2640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x56207e390a10 0x56207e392e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.198+0000 7fa0129e3640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x56207e38c710 0x56207e38cb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:45902/0 (socket says 172.21.15.146:45902) 2024-09-18T01:45:46.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.198+0000 7fa0129e3640 1 -- 172.21.15.146:0/3664135994 learned_addr learned my addr 172.21.15.146:0/3664135994 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:45:46.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.198+0000 7fa00a1e2640 1 -- 172.21.15.146:0/3664135994 >> v1:172.21.15.129:6789/0 conn(0x56207e38c710 legacy=0x56207e38cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.198+0000 7fa0121e2640 1 -- 172.21.15.146:0/3664135994 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3883252390 0 0) 0x56207e24bb30 con 0x56207e38c710 2024-09-18T01:45:46.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.198+0000 7fa00a1e2640 1 -- 172.21.15.146:0/3664135994 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56207e253e00 con 0x56207e390a10 2024-09-18T01:45:46.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.200+0000 7fa00a1e2640 1 --2- 172.21.15.146:0/3664135994 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56207e390a10 0x56207e392e00 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc00a470 tx=0x7f9ffc045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d976609e6faec7c server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.200+0000 7fa0121e2640 1 -- 172.21.15.146:0/3664135994 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ffc053570 con 0x56207e390a10 2024-09-18T01:45:46.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.200+0000 7fa0121e2640 1 -- 172.21.15.146:0/3664135994 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ffc058070 con 0x56207e390a10 2024-09-18T01:45:46.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.200+0000 7fa0121e2640 1 -- 172.21.15.146:0/3664135994 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ffc053880 con 0x56207e390a10 2024-09-18T01:45:46.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.201+0000 7fa016d26800 1 -- 172.21.15.146:0/3664135994 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56207e390a10 msgr2=0x56207e392e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.201+0000 7fa016d26800 1 --2- 172.21.15.146:0/3664135994 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56207e390a10 0x56207e392e00 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc00a470 tx=0x7f9ffc045a20 comp rx=0 tx=0).stop 2024-09-18T01:45:46.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.201+0000 7fa016d26800 1 -- 172.21.15.146:0/3664135994 shutdown_connections 2024-09-18T01:45:46.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.201+0000 7fa016d26800 1 --2- 172.21.15.146:0/3664135994 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56207e390a10 0x56207e392e00 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.201+0000 7fa016d26800 1 -- 172.21.15.146:0/3664135994 >> 172.21.15.146:0/3664135994 conn(0x56207e387fe0 msgr2=0x56207e38a400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:46.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.201+0000 7fa016d26800 1 -- 172.21.15.146:0/3664135994 shutdown_connections 2024-09-18T01:45:46.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.201+0000 7fa016d26800 1 -- 172.21.15.146:0/3664135994 wait complete. 2024-09-18T01:45:46.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.214+0000 7fa016d26800 1 Processor -- start 2024-09-18T01:45:46.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.214+0000 7fa016d26800 1 -- start start 2024-09-18T01:45:46.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.214+0000 7fa016d26800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56207e38c710 0x56207e47b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.214+0000 7fa016d26800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x56207e2d8360 con 0x56207e38c710 2024-09-18T01:45:46.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.215+0000 7fa0129e3640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56207e38c710 0x56207e47b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.215+0000 7fa0129e3640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56207e38c710 0x56207e47b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38476/0 (socket says 172.21.15.146:38476) 2024-09-18T01:45:46.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.215+0000 7fa0129e3640 1 -- 172.21.15.146:0/1673225640 learned_addr learned my addr 172.21.15.146:0/1673225640 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:46.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.215+0000 7fa0129e3640 1 -- 172.21.15.146:0/1673225640 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56207e225bc0 con 0x56207e38c710 2024-09-18T01:45:46.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.215+0000 7fa0129e3640 1 --2- 172.21.15.146:0/1673225640 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56207e38c710 0x56207e47b630 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fa00400b240 tx=0x7fa00400b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73a4de45cb67d11a server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.215+0000 7f9f00e09640 1 -- 172.21.15.146:0/1673225640 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa004008070 con 0x56207e38c710 2024-09-18T01:45:46.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.215+0000 7f9f00e09640 1 -- 172.21.15.146:0/1673225640 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa00400d500 con 0x56207e38c710 2024-09-18T01:45:46.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.215+0000 7f9f00e09640 1 -- 172.21.15.146:0/1673225640 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa00400d860 con 0x56207e38c710 2024-09-18T01:45:46.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.216+0000 7fa016d26800 1 -- 172.21.15.146:0/1673225640 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56207e38c710 msgr2=0x56207e47b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.216+0000 7fa016d26800 1 --2- 172.21.15.146:0/1673225640 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56207e38c710 0x56207e47b630 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fa00400b240 tx=0x7fa00400b700 comp rx=0 tx=0).stop 2024-09-18T01:45:46.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.216+0000 7fa016d26800 1 -- 172.21.15.146:0/1673225640 shutdown_connections 2024-09-18T01:45:46.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.216+0000 7fa016d26800 1 --2- 172.21.15.146:0/1673225640 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56207e38c710 0x56207e47b630 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.216+0000 7fa016d26800 1 -- 172.21.15.146:0/1673225640 >> 172.21.15.146:0/1673225640 conn(0x56207e387fe0 msgr2=0x56207e476ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:46.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.216+0000 7fa016d26800 1 -- 172.21.15.146:0/1673225640 shutdown_connections 2024-09-18T01:45:46.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.216+0000 7fa016d26800 1 -- 172.21.15.146:0/1673225640 wait complete. 2024-09-18T01:45:46.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.216+0000 7fa016d26800 1 Processor -- start 2024-09-18T01:45:46.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.216+0000 7fa016d26800 1 -- start start 2024-09-18T01:45:46.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.216+0000 7fa016d26800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56207e38c710 0x56207e4830c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.217+0000 7fa016d26800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x56207e393640 con 0x56207e38c710 2024-09-18T01:45:46.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.217+0000 7fa0129e3640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56207e38c710 0x56207e4830c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.217+0000 7fa0129e3640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56207e38c710 0x56207e4830c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38484/0 (socket says 172.21.15.146:38484) 2024-09-18T01:45:46.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.217+0000 7fa0129e3640 1 -- 172.21.15.146:0/2277703041 learned_addr learned my addr 172.21.15.146:0/2277703041 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:46.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.217+0000 7fa0129e3640 1 -- 172.21.15.146:0/2277703041 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56207e239fe0 con 0x56207e38c710 2024-09-18T01:45:46.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.217+0000 7fa0129e3640 1 --2- 172.21.15.146:0/2277703041 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56207e38c710 0x56207e4830c0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x56207e47c490 tx=0x7fa004000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.217+0000 7f9eff606640 1 -- 172.21.15.146:0/2277703041 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa004019870 con 0x56207e38c710 2024-09-18T01:45:46.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.217+0000 7f9eff606640 1 -- 172.21.15.146:0/2277703041 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa004019a10 con 0x56207e38c710 2024-09-18T01:45:46.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.217+0000 7f9eff606640 1 -- 172.21.15.146:0/2277703041 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa004019d30 con 0x56207e38c710 2024-09-18T01:45:46.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.217+0000 7fa016d26800 1 -- 172.21.15.146:0/2277703041 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56207e483600 con 0x56207e38c710 2024-09-18T01:45:46.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.217+0000 7fa016d26800 1 -- 172.21.15.146:0/2277703041 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56207e483b20 con 0x56207e38c710 2024-09-18T01:45:46.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.218+0000 7f9eff606640 1 -- 172.21.15.146:0/2277703041 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa004017040 con 0x56207e38c710 2024-09-18T01:45:46.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.218+0000 7f9eff606640 1 --2- 172.21.15.146:0/2277703041 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9ef8036b90 0x7f9ef8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.218+0000 7f9eff606640 1 -- 172.21.15.146:0/2277703041 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7fa004015020 con 0x56207e38c710 2024-09-18T01:45:46.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.218+0000 7fa00a1e2640 1 --2- 172.21.15.146:0/2277703041 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9ef8036b90 0x7f9ef8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.218+0000 7fa016d26800 1 --2- 172.21.15.146:0/2277703041 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56207e390a10 0x56207e48a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.219+0000 7fa016d26800 1 -- 172.21.15.146:0/2277703041 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56207e48a6b0 con 0x56207e390a10 2024-09-18T01:45:46.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.219+0000 7fa0131e4640 1 --2- 172.21.15.146:0/2277703041 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56207e390a10 0x56207e48a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.219+0000 7fa00a1e2640 1 --2- 172.21.15.146:0/2277703041 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9ef8036b90 0x7f9ef8039050 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc057000 tx=0x7f9ffc052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.219+0000 7fa0131e4640 1 --2- 172.21.15.146:0/2277703041 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56207e390a10 0x56207e48a130 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.219+0000 7fa0131e4640 1 -- 172.21.15.146:0/2277703041 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa00c00a4a0 con 0x56207e390a10 2024-09-18T01:45:46.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.219+0000 7fa016d26800 1 -- 172.21.15.146:0/2277703041 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56207e487700 con 0x56207e390a10 2024-09-18T01:45:46.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.219+0000 7fa0131e4640 1 -- 172.21.15.146:0/2277703041 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa00c00a4a0 con 0x56207e390a10 2024-09-18T01:45:46.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.219+0000 7fa016d26800 1 -- 172.21.15.146:0/2277703041 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56207e48c4d0 con 0x56207e390a10 2024-09-18T01:45:46.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.220+0000 7fa0131e4640 1 -- 172.21.15.146:0/2277703041 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa00c00a4a0 con 0x56207e390a10 2024-09-18T01:45:46.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.220+0000 7fa016d26800 1 -- 172.21.15.146:0/2277703041 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56207e48b610 con 0x56207e390a10 2024-09-18T01:45:46.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.220+0000 7fa0131e4640 1 -- 172.21.15.146:0/2277703041 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa00c00a4a0 con 0x56207e390a10 2024-09-18T01:45:46.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.220+0000 7fa016d26800 1 --2- 172.21.15.146:0/2277703041 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x56207e48c0e0 0x56207e48f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.220+0000 7fa016d26800 1 -- 172.21.15.146:0/2277703041 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56207e4900b0 con 0x56207e48c0e0 2024-09-18T01:45:46.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.220+0000 7fa0129e3640 1 --2- 172.21.15.146:0/2277703041 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x56207e48c0e0 0x56207e48f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.220+0000 7fa0129e3640 1 --2- 172.21.15.146:0/2277703041 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x56207e48c0e0 0x56207e48f920 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.221+0000 7fa0129e3640 1 -- 172.21.15.146:0/2277703041 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa00402d070 con 0x56207e48c0e0 2024-09-18T01:45:46.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.221+0000 7fa016d26800 1 Processor -- start 2024-09-18T01:45:46.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.221+0000 7fa016d26800 1 -- start start 2024-09-18T01:45:46.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.221+0000 7fa016d26800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56207e49de40 0x56207e49e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.221+0000 7fa016d26800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x56207e227580 con 0x56207e49de40 2024-09-18T01:45:46.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.221+0000 7fa0131e4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56207e49de40 0x56207e49e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.222+0000 7fa0131e4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56207e49de40 0x56207e49e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38494/0 (socket says 172.21.15.146:38494) 2024-09-18T01:45:46.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.222+0000 7fa0131e4640 1 -- 172.21.15.146:0/3443186721 learned_addr learned my addr 172.21.15.146:0/3443186721 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:46.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.222+0000 7fa0131e4640 1 -- 172.21.15.146:0/3443186721 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56207e49e7a0 con 0x56207e49de40 2024-09-18T01:45:46.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.222+0000 7fa0131e4640 1 --2- 172.21.15.146:0/3443186721 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56207e49de40 0x56207e49e260 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x56207e48aa90 tx=0x7fa00c0178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.222+0000 7f9efce01640 1 -- 172.21.15.146:0/3443186721 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa00c013440 con 0x56207e49de40 2024-09-18T01:45:46.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.222+0000 7f9efce01640 1 -- 172.21.15.146:0/3443186721 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa00c0135e0 con 0x56207e49de40 2024-09-18T01:45:46.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.222+0000 7f9efce01640 1 -- 172.21.15.146:0/3443186721 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa00c0138c0 con 0x56207e49de40 2024-09-18T01:45:46.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.222+0000 7fa016d26800 1 -- 172.21.15.146:0/3443186721 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56207e49ea30 con 0x56207e49de40 2024-09-18T01:45:46.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.222+0000 7fa016d26800 1 -- 172.21.15.146:0/3443186721 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56207e4a1710 con 0x56207e49de40 2024-09-18T01:45:46.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.223+0000 7f9efce01640 1 -- 172.21.15.146:0/3443186721 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa00c011040 con 0x56207e49de40 2024-09-18T01:45:46.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.223+0000 7f9efce01640 1 --2- 172.21.15.146:0/3443186721 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9eec036b90 0x7f9eec039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.223+0000 7f9efce01640 1 -- 172.21.15.146:0/3443186721 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7fa00c01d070 con 0x56207e49de40 2024-09-18T01:45:46.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.223+0000 7fa0129e3640 1 --2- 172.21.15.146:0/3443186721 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9eec036b90 0x7f9eec039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.223+0000 7fa016d26800 1 Processor -- start 2024-09-18T01:45:46.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.223+0000 7fa0129e3640 1 --2- 172.21.15.146:0/3443186721 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9eec036b90 0x7f9eec039050 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa004001630 tx=0x7fa00404b640 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.223+0000 7fa016d26800 1 -- start start 2024-09-18T01:45:46.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.224+0000 7fa016d26800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56207e301fe0 0x56207e3023e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.224+0000 7fa016d26800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x56207e47bde0 con 0x56207e301fe0 2024-09-18T01:45:46.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.224+0000 7fa0131e4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56207e301fe0 0x56207e3023e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.224+0000 7fa0131e4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56207e301fe0 0x56207e3023e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38502/0 (socket says 172.21.15.146:38502) 2024-09-18T01:45:46.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.224+0000 7fa0131e4640 1 -- 172.21.15.146:0/2684197598 learned_addr learned my addr 172.21.15.146:0/2684197598 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:46.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.224+0000 7fa0131e4640 1 -- 172.21.15.146:0/2684197598 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56207e3029b0 con 0x56207e301fe0 2024-09-18T01:45:46.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.224+0000 7fa0131e4640 1 --2- 172.21.15.146:0/2684197598 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56207e301fe0 0x56207e3023e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fa00c04c970 tx=0x7fa00c04cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9259ea6b50f5273d server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.224+0000 7f9ef67fc640 1 -- 172.21.15.146:0/2684197598 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa00c02b3a0 con 0x56207e301fe0 2024-09-18T01:45:46.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.224+0000 7f9ef67fc640 1 -- 172.21.15.146:0/2684197598 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa00c041e50 con 0x56207e301fe0 2024-09-18T01:45:46.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.224+0000 7f9ef67fc640 1 -- 172.21.15.146:0/2684197598 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa00c021a50 con 0x56207e301fe0 2024-09-18T01:45:46.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.225+0000 7fa016d26800 1 -- 172.21.15.146:0/2684197598 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56207e301fe0 msgr2=0x56207e3023e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.225+0000 7fa016d26800 1 --2- 172.21.15.146:0/2684197598 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56207e301fe0 0x56207e3023e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fa00c04c970 tx=0x7fa00c04cbf0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.225+0000 7fa016d26800 1 -- 172.21.15.146:0/2684197598 shutdown_connections 2024-09-18T01:45:46.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.225+0000 7fa016d26800 1 --2- 172.21.15.146:0/2684197598 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56207e301fe0 0x56207e3023e0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.225+0000 7fa016d26800 1 -- 172.21.15.146:0/2684197598 >> 172.21.15.146:0/2684197598 conn(0x56207e4a6e20 msgr2=0x56207e4a4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:46.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.225+0000 7fa016d26800 1 -- 172.21.15.146:0/2684197598 shutdown_connections 2024-09-18T01:45:46.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.225+0000 7fa016d26800 1 -- 172.21.15.146:0/2684197598 wait complete. 2024-09-18T01:45:46.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.225+0000 7fa016d26800 1 Processor -- start 2024-09-18T01:45:46.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.225+0000 7fa016d26800 1 -- start start 2024-09-18T01:45:46.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.225+0000 7fa016d26800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56207e301fe0 0x56207e4b4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.225+0000 7fa016d26800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x56207e300d10 con 0x56207e301fe0 2024-09-18T01:45:46.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.225+0000 7fa0131e4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56207e301fe0 0x56207e4b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.225+0000 7fa0131e4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56207e301fe0 0x56207e4b4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38516/0 (socket says 172.21.15.146:38516) 2024-09-18T01:45:46.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.225+0000 7fa0131e4640 1 -- 172.21.15.146:0/2777662226 learned_addr learned my addr 172.21.15.146:0/2777662226 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:46.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.226+0000 7fa0131e4640 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56207e4b4680 con 0x56207e301fe0 2024-09-18T01:45:46.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.226+0000 7fa0131e4640 1 --2- 172.21.15.146:0/2777662226 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56207e301fe0 0x56207e4b4140 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fa00c044040 tx=0x7fa00c04c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.226+0000 7f9ef4ff9640 1 -- 172.21.15.146:0/2777662226 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa00c046040 con 0x56207e301fe0 2024-09-18T01:45:46.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.226+0000 7f9ef4ff9640 1 -- 172.21.15.146:0/2777662226 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa00c012ab0 con 0x56207e301fe0 2024-09-18T01:45:46.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.226+0000 7fa016d26800 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56207e4b4910 con 0x56207e301fe0 2024-09-18T01:45:46.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.226+0000 7f9ef4ff9640 1 -- 172.21.15.146:0/2777662226 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa00c012dd0 con 0x56207e301fe0 2024-09-18T01:45:46.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.226+0000 7fa016d26800 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56207e4b75c0 con 0x56207e301fe0 2024-09-18T01:45:46.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.227+0000 7f9ef4ff9640 1 -- 172.21.15.146:0/2777662226 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa00c04e0d0 con 0x56207e301fe0 2024-09-18T01:45:46.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.227+0000 7f9ef4ff9640 1 --2- 172.21.15.146:0/2777662226 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9edc036af0 0x7f9edc038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.227+0000 7f9ef4ff9640 1 -- 172.21.15.146:0/2777662226 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7fa00c034070 con 0x56207e301fe0 2024-09-18T01:45:46.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.227+0000 7fa0129e3640 1 --2- 172.21.15.146:0/2777662226 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9edc036af0 0x7f9edc038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.228+0000 7fa0129e3640 1 --2- 172.21.15.146:0/2777662226 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9edc036af0 0x7f9edc038fb0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa00400bc50 tx=0x7fa004033000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.228+0000 7fa016d26800 20 rados->read ofs=0 len=0 2024-09-18T01:45:46.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.228+0000 7fa016d26800 1 --2- 172.21.15.146:0/2777662226 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56207e4bfe40 0x56207e4c2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.228+0000 7fa016d26800 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56207e4c2a50 con 0x56207e4bfe40 2024-09-18T01:45:46.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.228+0000 7fa00a1e2640 1 --2- 172.21.15.146:0/2777662226 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56207e4bfe40 0x56207e4c2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.228+0000 7fa00a1e2640 1 --2- 172.21.15.146:0/2777662226 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56207e4bfe40 0x56207e4c2300 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.228+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ffc051070 con 0x56207e4bfe40 2024-09-18T01:45:46.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.229+0000 7fa016d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:46.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.229+0000 7fa016d26800 20 realm 2024-09-18T01:45:46.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.229+0000 7fa016d26800 20 rados->read ofs=0 len=0 2024-09-18T01:45:46.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.229+0000 7fa016d26800 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56207e4c2e80 con 0x56207e4bfe40 2024-09-18T01:45:46.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.229+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ffc051070 con 0x56207e4bfe40 2024-09-18T01:45:46.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.229+0000 7fa016d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:46.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.229+0000 7fa016d26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:46.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.229+0000 7fa016d26800 20 rados->read ofs=0 len=0 2024-09-18T01:45:46.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.229+0000 7fa016d26800 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56207e4c3750 con 0x56207e4bfe40 2024-09-18T01:45:46.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.229+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ffc051070 con 0x56207e4bfe40 2024-09-18T01:45:46.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.229+0000 7fa016d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:46.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.229+0000 7fa016d26800 20 rados->read ofs=0 len=0 2024-09-18T01:45:46.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.229+0000 7fa016d26800 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56207e4c3af0 con 0x56207e4bfe40 2024-09-18T01:45:46.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.229+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9ffc051070 con 0x56207e4bfe40 2024-09-18T01:45:46.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.229+0000 7fa016d26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:46.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.229+0000 7fa016d26800 20 rados->read ofs=0 len=0 2024-09-18T01:45:46.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.229+0000 7fa016d26800 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56207e4c4340 con 0x56207e4bfe40 2024-09-18T01:45:46.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.229+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9ffc051070 con 0x56207e4bfe40 2024-09-18T01:45:46.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.229+0000 7fa016d26800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:46.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.229+0000 7fa016d26800 20 searching for the correct realm 2024-09-18T01:45:46.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.230+0000 7fa016d26800 1 --2- 172.21.15.146:0/2777662226 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x56207e4c60b0 0x56207e4c84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.230+0000 7fa016d26800 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56207e4c8ad0 con 0x56207e4c60b0 2024-09-18T01:45:46.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.230+0000 7fa0131e4640 1 --2- 172.21.15.146:0/2777662226 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x56207e4c60b0 0x56207e4c84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.230+0000 7fa0131e4640 1 --2- 172.21.15.146:0/2777662226 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x56207e4c60b0 0x56207e4c84a0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.230+0000 7fa0131e4640 1 -- 172.21.15.146:0/2777662226 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa00c056040 con 0x56207e4c60b0 2024-09-18T01:45:46.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.230+0000 7fa0131e4640 1 --2- 172.21.15.146:0/2777662226 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fa00c03f0d0 0x7fa00c027790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.230+0000 7fa0131e4640 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56207e4c8ad0 con 0x7fa00c03f0d0 2024-09-18T01:45:46.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.230+0000 7fa0129e3640 1 --2- 172.21.15.146:0/2777662226 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fa00c03f0d0 0x7fa00c027790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.231+0000 7fa0129e3640 1 --2- 172.21.15.146:0/2777662226 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fa00c03f0d0 0x7fa00c027790 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.231+0000 7fa0129e3640 1 -- 172.21.15.146:0/2777662226 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa00402d070 con 0x7fa00c03f0d0 2024-09-18T01:45:46.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.231+0000 7fa0129e3640 1 --2- 172.21.15.146:0/2777662226 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fa004018810 0x7fa00403f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.231+0000 7fa0129e3640 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56207e4c8ad0 con 0x7fa004018810 2024-09-18T01:45:46.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.231+0000 7fa00a1e2640 1 --2- 172.21.15.146:0/2777662226 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fa004018810 0x7fa00403f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.231+0000 7fa00a1e2640 1 --2- 172.21.15.146:0/2777662226 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fa004018810 0x7fa00403f1e0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.232+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ffc051070 con 0x7fa004018810 2024-09-18T01:45:46.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.232+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56207e4c8ad0 con 0x56207e4bfe40 2024-09-18T01:45:46.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.232+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9ffc051070 con 0x56207e4bfe40 2024-09-18T01:45:46.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.232+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56207e4c8ad0 con 0x56207e4bfe40 2024-09-18T01:45:46.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.232+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ffc051070 con 0x56207e4bfe40 2024-09-18T01:45:46.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.232+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56207e4c8ad0 con 0x7fa004018810 2024-09-18T01:45:46.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.232+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ffc051070 con 0x7fa004018810 2024-09-18T01:45:46.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.233+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56207e4c8ad0 con 0x7fa004018810 2024-09-18T01:45:46.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.233+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ffc051070 con 0x7fa004018810 2024-09-18T01:45:46.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.233+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56207e4c8ad0 con 0x7fa00c03f0d0 2024-09-18T01:45:46.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.233+0000 7fa0129e3640 1 -- 172.21.15.146:0/2777662226 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa00402d070 con 0x7fa00c03f0d0 2024-09-18T01:45:46.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.233+0000 7fa0129e3640 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56207e4c8ad0 con 0x56207e4c60b0 2024-09-18T01:45:46.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.233+0000 7fa0131e4640 1 -- 172.21.15.146:0/2777662226 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa00c056040 con 0x56207e4c60b0 2024-09-18T01:45:46.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.233+0000 7fa0131e4640 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56207e4c8ad0 con 0x56207e4bfe40 2024-09-18T01:45:46.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.233+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ffc051070 con 0x56207e4bfe40 2024-09-18T01:45:46.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.233+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56207e4c8ad0 con 0x7fa004018810 2024-09-18T01:45:46.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.234+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ffc051070 con 0x7fa004018810 2024-09-18T01:45:46.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.234+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56207e4c8ad0 con 0x56207e4bfe40 2024-09-18T01:45:46.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.234+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ffc051070 con 0x56207e4bfe40 2024-09-18T01:45:46.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.234+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56207e4c8ad0 con 0x7fa00c03f0d0 2024-09-18T01:45:46.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.234+0000 7fa0129e3640 1 -- 172.21.15.146:0/2777662226 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fa00402d070 con 0x7fa00c03f0d0 2024-09-18T01:45:46.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.234+0000 7fa0129e3640 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fa00405a0a0 con 0x56207e4c60b0 2024-09-18T01:45:46.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.235+0000 7fa0131e4640 1 -- 172.21.15.146:0/2777662226 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa00c056040 con 0x56207e4c60b0 2024-09-18T01:45:46.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.235+0000 7fa0131e4640 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fa00405a0a0 con 0x56207e4c60b0 2024-09-18T01:45:46.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.235+0000 7fa0131e4640 1 -- 172.21.15.146:0/2777662226 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa00c056040 con 0x56207e4c60b0 2024-09-18T01:45:46.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.235+0000 7fa0131e4640 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fa00405a0a0 con 0x7fa004018810 2024-09-18T01:45:46.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.235+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ffc051070 con 0x7fa004018810 2024-09-18T01:45:46.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.235+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fa00405a0a0 con 0x56207e4c60b0 2024-09-18T01:45:46.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.236+0000 7fa0131e4640 1 -- 172.21.15.146:0/2777662226 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa00c056040 con 0x56207e4c60b0 2024-09-18T01:45:46.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.236+0000 7fa0131e4640 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fa00405a0a0 con 0x56207e4c60b0 2024-09-18T01:45:46.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.236+0000 7fa0131e4640 1 -- 172.21.15.146:0/2777662226 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa00c056040 con 0x56207e4c60b0 2024-09-18T01:45:46.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.236+0000 7fa0131e4640 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fa00405a0a0 con 0x56207e4bfe40 2024-09-18T01:45:46.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.236+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ffc051070 con 0x56207e4bfe40 2024-09-18T01:45:46.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.236+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fa00405a0a0 con 0x56207e4bfe40 2024-09-18T01:45:46.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.236+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9ffc051070 con 0x56207e4bfe40 2024-09-18T01:45:46.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.236+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fa00405a0a0 con 0x7fa004018810 2024-09-18T01:45:46.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.236+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ffc051070 con 0x7fa004018810 2024-09-18T01:45:46.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.236+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fa00405a0a0 con 0x56207e4c60b0 2024-09-18T01:45:46.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.237+0000 7fa0131e4640 1 -- 172.21.15.146:0/2777662226 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa00c056040 con 0x56207e4c60b0 2024-09-18T01:45:46.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.237+0000 7fa0131e4640 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fa00405a0a0 con 0x7fa00c03f0d0 2024-09-18T01:45:46.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.237+0000 7fa0129e3640 1 -- 172.21.15.146:0/2777662226 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa00402d070 con 0x7fa00c03f0d0 2024-09-18T01:45:46.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.237+0000 7fa0129e3640 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fa00405a0a0 con 0x56207e4bfe40 2024-09-18T01:45:46.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.237+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ffc051070 con 0x56207e4bfe40 2024-09-18T01:45:46.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.237+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fa00405a0a0 con 0x7fa004018810 2024-09-18T01:45:46.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.238+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ffc051070 con 0x7fa004018810 2024-09-18T01:45:46.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.238+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fa00405a0a0 con 0x56207e4c60b0 2024-09-18T01:45:46.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.238+0000 7fa0131e4640 1 -- 172.21.15.146:0/2777662226 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa00c056040 con 0x56207e4c60b0 2024-09-18T01:45:46.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.238+0000 7fa0131e4640 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fa00405a0a0 con 0x7fa004018810 2024-09-18T01:45:46.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.238+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ffc051070 con 0x7fa004018810 2024-09-18T01:45:46.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.238+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fa00405a0a0 con 0x7fa00c03f0d0 2024-09-18T01:45:46.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.238+0000 7fa0129e3640 1 -- 172.21.15.146:0/2777662226 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa00402d070 con 0x7fa00c03f0d0 2024-09-18T01:45:46.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.238+0000 7fa0129e3640 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fa00405a0a0 con 0x56207e4c60b0 2024-09-18T01:45:46.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.239+0000 7fa0131e4640 1 -- 172.21.15.146:0/2777662226 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa00c056040 con 0x56207e4c60b0 2024-09-18T01:45:46.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.239+0000 7fa0131e4640 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fa00405a0a0 con 0x7fa004018810 2024-09-18T01:45:46.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.239+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ffc051070 con 0x7fa004018810 2024-09-18T01:45:46.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.239+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fa00405a0a0 con 0x56207e4bfe40 2024-09-18T01:45:46.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.239+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9ffc051070 con 0x56207e4bfe40 2024-09-18T01:45:46.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.239+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fa00405a0a0 con 0x7fa00c03f0d0 2024-09-18T01:45:46.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.239+0000 7fa0129e3640 1 -- 172.21.15.146:0/2777662226 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa00402d070 con 0x7fa00c03f0d0 2024-09-18T01:45:46.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.240+0000 7fa016d26800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:46.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.240+0000 7fa016d26800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:46.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.240+0000 7fa016d26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:46.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.240+0000 7fa016d26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:46.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.240+0000 7fa016d26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:46.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.240+0000 7fa016d26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:46.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.240+0000 7fa016d26800 20 rados->read ofs=0 len=0 2024-09-18T01:45:46.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.240+0000 7fa016d26800 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56207e4c4cc0 con 0x56207e4bfe40 2024-09-18T01:45:46.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.240+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ffc051070 con 0x56207e4bfe40 2024-09-18T01:45:46.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.240+0000 7fa016d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:46.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.240+0000 7fa016d26800 20 rados->read ofs=0 len=0 2024-09-18T01:45:46.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.240+0000 7fa016d26800 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56207e4c5560 con 0x56207e4bfe40 2024-09-18T01:45:46.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.240+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9ffc051070 con 0x56207e4bfe40 2024-09-18T01:45:46.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.240+0000 7fa016d26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:46.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.240+0000 7fa016d26800 20 rados->read ofs=0 len=0 2024-09-18T01:45:46.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.240+0000 7fa016d26800 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56207e4c8f50 con 0x7fa00c03f0d0 2024-09-18T01:45:46.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.240+0000 7fa0129e3640 1 -- 172.21.15.146:0/2777662226 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa00402d070 con 0x7fa00c03f0d0 2024-09-18T01:45:46.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.240+0000 7fa016d26800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:46.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.240+0000 7fa016d26800 20 zone default found 2024-09-18T01:45:46.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.240+0000 7fa016d26800 4 Realm: () 2024-09-18T01:45:46.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.240+0000 7fa016d26800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:46.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.240+0000 7fa016d26800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:46.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.240+0000 7fa016d26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:46.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.240+0000 7fa016d26800 20 zonegroup default 2024-09-18T01:45:46.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.240+0000 7fa016d26800 20 rados->read ofs=0 len=0 2024-09-18T01:45:46.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.240+0000 7fa016d26800 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56207e4c97a0 con 0x7fa004018810 2024-09-18T01:45:46.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.241+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9ffc051070 con 0x7fa004018810 2024-09-18T01:45:46.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.241+0000 7fa016d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:46.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.241+0000 7fa016d26800 20 rados->read ofs=0 len=0 2024-09-18T01:45:46.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.241+0000 7fa016d26800 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56207e4cb180 con 0x56207e4c60b0 2024-09-18T01:45:46.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.241+0000 7fa0131e4640 1 -- 172.21.15.146:0/2777662226 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa00c056040 con 0x56207e4c60b0 2024-09-18T01:45:46.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.241+0000 7fa016d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:46.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.241+0000 7fa016d26800 20 rados->read ofs=0 len=0 2024-09-18T01:45:46.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.241+0000 7fa016d26800 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56207e4cba40 con 0x56207e4c60b0 2024-09-18T01:45:46.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.241+0000 7fa0131e4640 1 -- 172.21.15.146:0/2777662226 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa00c056040 con 0x56207e4c60b0 2024-09-18T01:45:46.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.241+0000 7fa016d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:46.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.241+0000 7fa016d26800 20 started sync module instance, tier type = 2024-09-18T01:45:46.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.241+0000 7fa016d26800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:46.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.241+0000 7fa016d26800 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56207e4ca170 con 0x7fa00c03f0d0 2024-09-18T01:45:46.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.242+0000 7fa0129e3640 1 -- 172.21.15.146:0/2777662226 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v33'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa00402d070 con 0x7fa00c03f0d0 2024-09-18T01:45:46.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.242+0000 7fa016d26800 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94697557892288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56207e4cbde0 con 0x7fa00c03f0d0 2024-09-18T01:45:46.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.242+0000 7fa016d26800 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56207e4cc630 con 0x56207e4bfe40 2024-09-18T01:45:46.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.243+0000 7fa0129e3640 1 -- 172.21.15.146:0/2777662226 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94697557892288] v33'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa00402d070 con 0x7fa00c03f0d0 2024-09-18T01:45:46.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.244+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v33'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ffc051070 con 0x56207e4bfe40 2024-09-18T01:45:46.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.244+0000 7fa016d26800 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94697557901696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56207e4cca50 con 0x56207e4bfe40 2024-09-18T01:45:46.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.244+0000 7fa016d26800 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56207e4cd410 con 0x56207e4c60b0 2024-09-18T01:45:46.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.245+0000 7fa0131e4640 1 -- 172.21.15.146:0/2777662226 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v33'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa00c056040 con 0x56207e4c60b0 2024-09-18T01:45:46.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.245+0000 7fa016d26800 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94697557905248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56207e4cd830 con 0x56207e4c60b0 2024-09-18T01:45:46.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.245+0000 7fa016d26800 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56207e4ce350 con 0x7fa00c03f0d0 2024-09-18T01:45:46.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.245+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94697557901696] v33'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ffc051070 con 0x56207e4bfe40 2024-09-18T01:45:46.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.246+0000 7fa0131e4640 1 -- 172.21.15.146:0/2777662226 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94697557905248] v33'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa00c056040 con 0x56207e4c60b0 2024-09-18T01:45:46.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.246+0000 7fa0129e3640 1 -- 172.21.15.146:0/2777662226 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v33'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa00402d070 con 0x7fa00c03f0d0 2024-09-18T01:45:46.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.246+0000 7fa016d26800 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94697557902752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56207e4cd830 con 0x7fa00c03f0d0 2024-09-18T01:45:46.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.246+0000 7fa016d26800 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56207e4cebf0 con 0x56207e4bfe40 2024-09-18T01:45:46.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.247+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v33'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ffc051070 con 0x56207e4bfe40 2024-09-18T01:45:46.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.247+0000 7fa016d26800 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94697557911360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56207e4cebc0 con 0x56207e4bfe40 2024-09-18T01:45:46.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.247+0000 7fa016d26800 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56207e4cfbe0 con 0x7fa004018810 2024-09-18T01:45:46.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.247+0000 7fa0129e3640 1 -- 172.21.15.146:0/2777662226 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94697557902752] v33'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa00402d070 con 0x7fa00c03f0d0 2024-09-18T01:45:46.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.248+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94697557911360] v33'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ffc051070 con 0x56207e4bfe40 2024-09-18T01:45:46.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.248+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v33'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ffc051070 con 0x7fa004018810 2024-09-18T01:45:46.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.248+0000 7fa016d26800 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94697557915312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56207e4ceda0 con 0x7fa004018810 2024-09-18T01:45:46.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.248+0000 7fa016d26800 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56207e4d0480 con 0x7fa004018810 2024-09-18T01:45:46.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.249+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94697557915312] v33'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ffc051070 con 0x7fa004018810 2024-09-18T01:45:46.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.249+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v33'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ffc051070 con 0x7fa004018810 2024-09-18T01:45:46.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.249+0000 7fa016d26800 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94697557906304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56207e4ceda0 con 0x7fa004018810 2024-09-18T01:45:46.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.249+0000 7fa016d26800 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56207e4d0aa0 con 0x7fa004018810 2024-09-18T01:45:46.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.250+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(58 notify.7 [create] v33'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ffc051070 con 0x7fa004018810 2024-09-18T01:45:46.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.250+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94697557906304] v33'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ffc051070 con 0x7fa004018810 2024-09-18T01:45:46.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.250+0000 7fa016d26800 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94697557919216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56207e4d0ec0 con 0x7fa004018810 2024-09-18T01:45:46.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.250+0000 7fa016d26800 20 add_watcher() i=0 2024-09-18T01:45:46.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.250+0000 7fa016d26800 20 add_watcher() i=1 2024-09-18T01:45:46.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.250+0000 7fa016d26800 20 add_watcher() i=2 2024-09-18T01:45:46.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.250+0000 7fa016d26800 20 add_watcher() i=3 2024-09-18T01:45:46.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.250+0000 7fa016d26800 20 add_watcher() i=4 2024-09-18T01:45:46.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.250+0000 7fa016d26800 20 add_watcher() i=5 2024-09-18T01:45:46.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.250+0000 7fa016d26800 20 add_watcher() i=6 2024-09-18T01:45:46.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.251+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94697557919216] v33'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ffc051070 con 0x7fa004018810 2024-09-18T01:45:46.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.251+0000 7fa016d26800 20 add_watcher() i=7 2024-09-18T01:45:46.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.251+0000 7fa016d26800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:46.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.251+0000 7fa016d26800 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56207e4d0ec0 con 0x56207e4bfe40 2024-09-18T01:45:46.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.251+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9ffc051070 con 0x56207e4bfe40 2024-09-18T01:45:46.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.251+0000 7fa016d26800 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94697557920272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56207e4d0e60 con 0x56207e4bfe40 2024-09-18T01:45:46.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.252+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94697557920272] v33'193 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9ffc051070 con 0x56207e4bfe40 2024-09-18T01:45:46.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.253+0000 7f9ec97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:46.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.253+0000 7fa016d26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:46.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.253+0000 7fa016d26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:46.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.253+0000 7fa016d26800 5 note: GC not initialized 2024-09-18T01:45:46.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.253+0000 7f9e43fff640 20 reqs_thread_entry: start 2024-09-18T01:45:46.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.253+0000 7fa016d26800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:46.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.253+0000 7fa016d26800 20 Filter name: none 2024-09-18T01:45:46.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.253+0000 7f9e41ffb640 20 reqs_thread_entry: start 2024-09-18T01:45:46.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.253+0000 7fa016d26800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T01:45:46.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.253+0000 7fa016d26800 20 rados->read ofs=0 len=0 2024-09-18T01:45:46.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.253+0000 7fa016d26800 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56207e507150 con 0x56207e4bfe40 2024-09-18T01:45:46.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.254+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f9ffc087040 con 0x56207e4bfe40 2024-09-18T01:45:46.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.254+0000 7fa016d26800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:45:46.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.254+0000 7fa016d26800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T01:45:46.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.254+0000 7fa016d26800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:45:46.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.254+0000 7fa016d26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:45:46.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.254+0000 7fa016d26800 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~403 in=403b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56207e50d410 con 0x56207e4bfe40 2024-09-18T01:45:46.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.255+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~403] v33'14 uv14 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f9ffc087040 con 0x56207e4bfe40 2024-09-18T01:45:46.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.255+0000 7fa016d26800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:45:46.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.255+0000 7fa016d26800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:45:46.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.255+0000 7fa016d26800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-18T01:45:46.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.255+0000 7fa016d26800 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94697558166992 in=591b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56207e50beb0 con 0x56207e4bfe40 2024-09-18T01:45:46.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.255+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== watch-notify(notify (1) cookie 94697557911360 notify 141733920786 ret 0) ==== 621+0+0 (crc 0 0 0) 0x56207e253e00 con 0x56207e4bfe40 2024-09-18T01:45:46.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.255+0000 7f9ef67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920786 cookie 94697557911360 notifier 4663 bl.length()=579 2024-09-18T01:45:46.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.255+0000 7f9ef67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:45:46.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.255+0000 7f9ef67fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:45:46.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.255+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(64 notify.4 [notify cookie 94697558166992 out=8b] v0'0 uv180 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9ffc087040 con 0x56207e4bfe40 2024-09-18T01:45:46.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.255+0000 7f9ef67fc640 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f9ed8003ea0 con 0x56207e4bfe40 2024-09-18T01:45:46.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.255+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ffc087040 con 0x56207e4bfe40 2024-09-18T01:45:46.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.255+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== watch-notify(notify_complete (2) cookie 94697558166992 notify 141733920786 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f9ffc072910 con 0x56207e4bfe40 2024-09-18T01:45:46.267 INFO:teuthology.orchestra.run.smithi146.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T01:45:23.010714Z"}],"swift_keys":[],"caps":[{"type":"user","perm":"read"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:45:23.010705Z","tags":[],"group_ids":[]} 2024-09-18T01:45:46.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.256+0000 7f9ec97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:46.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.256+0000 7fa016d26800 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94697557920272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56207e504ec0 con 0x56207e4bfe40 2024-09-18T01:45:46.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.257+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 <== osd.1 v2:172.21.15.146:6808/3930274777 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94697557920272] v33'194 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9ffc087040 con 0x56207e4bfe40 2024-09-18T01:45:46.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.257+0000 7fa016d26800 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94697557892288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56207e504ec0 con 0x7fa00c03f0d0 2024-09-18T01:45:46.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.258+0000 7fa0129e3640 1 -- 172.21.15.146:0/2777662226 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94697557892288] v33'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa00402d070 con 0x7fa00c03f0d0 2024-09-18T01:45:46.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.258+0000 7fa016d26800 20 remove_watcher() i=0 2024-09-18T01:45:46.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.258+0000 7fa016d26800 2 removed watcher, disabling cache 2024-09-18T01:45:46.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.258+0000 7fa016d26800 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94697557901696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56207e504ec0 con 0x56207e4bfe40 2024-09-18T01:45:46.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.260+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 <== osd.1 v2:172.21.15.146:6808/3930274777 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94697557901696] v33'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ffc087040 con 0x56207e4bfe40 2024-09-18T01:45:46.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.260+0000 7fa016d26800 20 remove_watcher() i=1 2024-09-18T01:45:46.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.260+0000 7fa016d26800 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94697557905248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56207e504ec0 con 0x56207e4c60b0 2024-09-18T01:45:46.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.261+0000 7fa0131e4640 1 -- 172.21.15.146:0/2777662226 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94697557905248] v33'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa00c056040 con 0x56207e4c60b0 2024-09-18T01:45:46.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.261+0000 7fa016d26800 20 remove_watcher() i=2 2024-09-18T01:45:46.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.261+0000 7fa016d26800 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94697557902752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56207e504ec0 con 0x7fa00c03f0d0 2024-09-18T01:45:46.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.261+0000 7fa0129e3640 1 -- 172.21.15.146:0/2777662226 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94697557902752] v33'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa00402d070 con 0x7fa00c03f0d0 2024-09-18T01:45:46.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.262+0000 7fa016d26800 20 remove_watcher() i=3 2024-09-18T01:45:46.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.262+0000 7fa016d26800 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94697557911360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56207e504ec0 con 0x56207e4bfe40 2024-09-18T01:45:46.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.263+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 <== osd.1 v2:172.21.15.146:6808/3930274777 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94697557911360] v33'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ffc087040 con 0x56207e4bfe40 2024-09-18T01:45:46.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.263+0000 7fa016d26800 20 remove_watcher() i=4 2024-09-18T01:45:46.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.263+0000 7fa016d26800 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94697557915312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56207e504ec0 con 0x7fa004018810 2024-09-18T01:45:46.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.264+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94697557915312] v33'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ffc087040 con 0x7fa004018810 2024-09-18T01:45:46.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.264+0000 7fa016d26800 20 remove_watcher() i=5 2024-09-18T01:45:46.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.264+0000 7fa016d26800 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94697557906304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56207e504ec0 con 0x7fa004018810 2024-09-18T01:45:46.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.264+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94697557906304] v33'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ffc087040 con 0x7fa004018810 2024-09-18T01:45:46.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.264+0000 7fa016d26800 20 remove_watcher() i=6 2024-09-18T01:45:46.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.264+0000 7fa016d26800 1 -- 172.21.15.146:0/2777662226 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94697557919216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56207e504ec0 con 0x7fa004018810 2024-09-18T01:45:46.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.265+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94697557919216] v33'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ffc087040 con 0x7fa004018810 2024-09-18T01:45:46.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.265+0000 7fa016d26800 20 remove_watcher() i=7 2024-09-18T01:45:46.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.266+0000 7fa016d26800 1 -- 172.21.15.146:0/2777662226 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fa004018810 msgr2=0x7fa00403f1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.266+0000 7fa016d26800 1 --2- 172.21.15.146:0/2777662226 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fa004018810 0x7fa00403f1e0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.266+0000 7fa016d26800 1 -- 172.21.15.146:0/2777662226 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56207e4bfe40 msgr2=0x56207e4c2300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.266+0000 7fa016d26800 1 --2- 172.21.15.146:0/2777662226 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56207e4bfe40 0x56207e4c2300 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.266+0000 7fa016d26800 1 -- 172.21.15.146:0/2777662226 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fa00c03f0d0 msgr2=0x7fa00c027790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.266+0000 7fa016d26800 1 --2- 172.21.15.146:0/2777662226 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fa00c03f0d0 0x7fa00c027790 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.266+0000 7fa016d26800 1 -- 172.21.15.146:0/2777662226 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x56207e4c60b0 msgr2=0x56207e4c84a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.266+0000 7fa016d26800 1 --2- 172.21.15.146:0/2777662226 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x56207e4c60b0 0x56207e4c84a0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.266+0000 7fa016d26800 1 -- 172.21.15.146:0/2777662226 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9edc036af0 msgr2=0x7f9edc038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.266+0000 7fa016d26800 1 --2- 172.21.15.146:0/2777662226 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9edc036af0 0x7f9edc038fb0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa00400bc50 tx=0x7fa004033000 comp rx=0 tx=0).stop 2024-09-18T01:45:46.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.266+0000 7fa016d26800 1 -- 172.21.15.146:0/2777662226 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56207e301fe0 msgr2=0x56207e4b4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.266+0000 7fa016d26800 1 --2- 172.21.15.146:0/2777662226 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56207e301fe0 0x56207e4b4140 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fa00c044040 tx=0x7fa00c04c8d0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.266+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 reap_dead start 2024-09-18T01:45:46.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.266+0000 7fa00a1e2640 1 -- 172.21.15.146:0/2777662226 reap_dead start 2024-09-18T01:45:46.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.266+0000 7fa016d26800 1 -- 172.21.15.146:0/2777662226 shutdown_connections 2024-09-18T01:45:46.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.266+0000 7fa016d26800 1 -- 172.21.15.146:0/2777662226 >> 172.21.15.146:0/2777662226 conn(0x56207e4a6e20 msgr2=0x56207e4a4ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:46.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.266+0000 7fa016d26800 1 -- 172.21.15.146:0/2777662226 shutdown_connections 2024-09-18T01:45:46.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.266+0000 7fa016d26800 1 -- 172.21.15.146:0/2777662226 wait complete. 2024-09-18T01:45:46.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.266+0000 7fa016d26800 1 -- 172.21.15.146:0/3443186721 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9eec036b90 msgr2=0x7f9eec039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.266+0000 7fa016d26800 1 --2- 172.21.15.146:0/3443186721 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9eec036b90 0x7f9eec039050 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa004001630 tx=0x7fa00404b640 comp rx=0 tx=0).stop 2024-09-18T01:45:46.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.266+0000 7fa016d26800 1 -- 172.21.15.146:0/3443186721 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56207e49de40 msgr2=0x56207e49e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.266+0000 7fa016d26800 1 --2- 172.21.15.146:0/3443186721 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56207e49de40 0x56207e49e260 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x56207e48aa90 tx=0x7fa00c0178e0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.266+0000 7fa016d26800 1 -- 172.21.15.146:0/3443186721 shutdown_connections 2024-09-18T01:45:46.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.266+0000 7fa016d26800 1 --2- 172.21.15.146:0/3443186721 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9eec036b90 0x7f9eec039050 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.266+0000 7fa016d26800 1 --2- 172.21.15.146:0/3443186721 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56207e49de40 0x56207e49e260 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.266+0000 7fa016d26800 1 -- 172.21.15.146:0/3443186721 >> 172.21.15.146:0/3443186721 conn(0x56207e492dd0 msgr2=0x56207e495950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:46.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.266+0000 7fa016d26800 1 -- 172.21.15.146:0/3443186721 shutdown_connections 2024-09-18T01:45:46.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.266+0000 7fa016d26800 1 -- 172.21.15.146:0/3443186721 wait complete. 2024-09-18T01:45:46.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.267+0000 7fa016d26800 1 -- 172.21.15.146:0/2277703041 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56207e390a10 msgr2=0x56207e48a130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.267+0000 7fa016d26800 1 --2- 172.21.15.146:0/2277703041 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56207e390a10 0x56207e48a130 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.267+0000 7fa016d26800 1 -- 172.21.15.146:0/2277703041 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x56207e48c0e0 msgr2=0x56207e48f920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.267+0000 7fa016d26800 1 --2- 172.21.15.146:0/2277703041 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x56207e48c0e0 0x56207e48f920 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.267+0000 7fa016d26800 1 -- 172.21.15.146:0/2277703041 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9ef8036b90 msgr2=0x7f9ef8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.267+0000 7fa016d26800 1 --2- 172.21.15.146:0/2277703041 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9ef8036b90 0x7f9ef8039050 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc057000 tx=0x7f9ffc052000 comp rx=0 tx=0).stop 2024-09-18T01:45:46.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.267+0000 7fa016d26800 1 -- 172.21.15.146:0/2277703041 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56207e38c710 msgr2=0x56207e4830c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.267+0000 7fa016d26800 1 --2- 172.21.15.146:0/2277703041 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56207e38c710 0x56207e4830c0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x56207e47c490 tx=0x7fa004000ed0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.267+0000 7fa016d26800 1 -- 172.21.15.146:0/2277703041 shutdown_connections 2024-09-18T01:45:46.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.267+0000 7fa016d26800 1 --2- 172.21.15.146:0/2277703041 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x56207e48c0e0 0x56207e48f920 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.267+0000 7fa016d26800 1 --2- 172.21.15.146:0/2277703041 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56207e390a10 0x56207e48a130 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.267+0000 7fa016d26800 1 --2- 172.21.15.146:0/2277703041 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9ef8036b90 0x7f9ef8039050 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.267+0000 7fa016d26800 1 --2- 172.21.15.146:0/2277703041 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56207e38c710 0x56207e4830c0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.267+0000 7fa016d26800 1 -- 172.21.15.146:0/2277703041 >> 172.21.15.146:0/2277703041 conn(0x56207e387fe0 msgr2=0x56207e475900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:46.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.267+0000 7fa016d26800 1 -- 172.21.15.146:0/2277703041 shutdown_connections 2024-09-18T01:45:46.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.267+0000 7fa016d26800 1 -- 172.21.15.146:0/2277703041 wait complete. 2024-09-18T01:45:46.278 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T01:45:23.010714Z'}], 'swift_keys': [], 'caps': [{'type': 'user', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:45:23.010705Z', 'tags': [], 'group_ids': []} 2024-09-18T01:45:46.278 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-18T01:45:46.279 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-18T01:45:46.279 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid foo --caps user=read 2024-09-18T01:45:46.328 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:46.328 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:46.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.327+0000 7f1b43f08800 1 Processor -- start 2024-09-18T01:45:46.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.327+0000 7f1b43f08800 1 -- start start 2024-09-18T01:45:46.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.327+0000 7f1b43f08800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55e4c2203930 0x55e4c2205d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.327+0000 7f1b43f08800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e4c20bfb30 con 0x55e4c21ffa70 2024-09-18T01:45:46.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.327+0000 7f1b43f08800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x55e4c20a1360 con 0x55e4c2203930 2024-09-18T01:45:46.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.327+0000 7f1b3bfff640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55e4c2203930 0x55e4c2205d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.327+0000 7f1b3bfff640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55e4c2203930 0x55e4c2205d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38518/0 (socket says 172.21.15.146:38518) 2024-09-18T01:45:46.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.327+0000 7f1b419fc640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x55e4c21ffa70 0x55e4c21ffe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:45906/0 (socket says 172.21.15.146:45906) 2024-09-18T01:45:46.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.327+0000 7f1b3bfff640 1 -- 172.21.15.146:0/411502622 learned_addr learned my addr 172.21.15.146:0/411502622 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:46.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.328+0000 7f1b3bfff640 1 -- 172.21.15.146:0/411502622 >> v1:172.21.15.129:6789/0 conn(0x55e4c21ffa70 legacy=0x55e4c21ffe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.328+0000 7f1b411fb640 1 -- 172.21.15.146:0/411502622 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3758418657 0 0) 0x55e4c20bfb30 con 0x55e4c21ffa70 2024-09-18T01:45:46.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.328+0000 7f1b3bfff640 1 -- 172.21.15.146:0/411502622 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4c20c7e00 con 0x55e4c2203930 2024-09-18T01:45:46.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.329+0000 7f1b3bfff640 1 --2- 172.21.15.146:0/411502622 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e4c2203930 0x55e4c2205d20 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c00a520 tx=0x7f1b2c045c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40c0cf7ae1e8f1ed server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.329+0000 7f1b411fb640 1 -- 172.21.15.146:0/411502622 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b2c058530 con 0x55e4c2203930 2024-09-18T01:45:46.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.329+0000 7f1b411fb640 1 -- 172.21.15.146:0/411502622 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b2c0586d0 con 0x55e4c2203930 2024-09-18T01:45:46.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.329+0000 7f1b411fb640 1 -- 172.21.15.146:0/411502622 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b2c0589f0 con 0x55e4c2203930 2024-09-18T01:45:46.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.330+0000 7f1b43f08800 1 -- 172.21.15.146:0/411502622 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e4c2203930 msgr2=0x55e4c2205d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.330+0000 7f1b43f08800 1 --2- 172.21.15.146:0/411502622 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e4c2203930 0x55e4c2205d20 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c00a520 tx=0x7f1b2c045c40 comp rx=0 tx=0).stop 2024-09-18T01:45:46.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.330+0000 7f1b43f08800 1 -- 172.21.15.146:0/411502622 shutdown_connections 2024-09-18T01:45:46.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.330+0000 7f1b43f08800 1 --2- 172.21.15.146:0/411502622 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e4c2203930 0x55e4c2205d20 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.330+0000 7f1b43f08800 1 -- 172.21.15.146:0/411502622 >> 172.21.15.146:0/411502622 conn(0x55e4c21fa550 msgr2=0x55e4c21fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:46.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.330+0000 7f1b43f08800 1 -- 172.21.15.146:0/411502622 shutdown_connections 2024-09-18T01:45:46.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.330+0000 7f1b43f08800 1 -- 172.21.15.146:0/411502622 wait complete. 2024-09-18T01:45:46.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.344+0000 7f1b43f08800 1 Processor -- start 2024-09-18T01:45:46.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.344+0000 7f1b43f08800 1 -- start start 2024-09-18T01:45:46.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.344+0000 7f1b43f08800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e4c21ffa70 0x55e4c22ef650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.344+0000 7f1b43f08800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55e4c214c360 con 0x55e4c21ffa70 2024-09-18T01:45:46.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.344+0000 7f1b419fc640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e4c21ffa70 0x55e4c22ef650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.344+0000 7f1b419fc640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e4c21ffa70 0x55e4c22ef650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38526/0 (socket says 172.21.15.146:38526) 2024-09-18T01:45:46.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.344+0000 7f1b419fc640 1 -- 172.21.15.146:0/1681762644 learned_addr learned my addr 172.21.15.146:0/1681762644 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:46.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.344+0000 7f1b419fc640 1 -- 172.21.15.146:0/1681762644 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4c2099bc0 con 0x55e4c21ffa70 2024-09-18T01:45:46.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.345+0000 7f1b419fc640 1 --2- 172.21.15.146:0/1681762644 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e4c21ffa70 0x55e4c22ef650 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f1b3400b240 tx=0x7f1b3400b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87e501ddf8297b1c server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.345+0000 7f1a2fe07640 1 -- 172.21.15.146:0/1681762644 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b34008070 con 0x55e4c21ffa70 2024-09-18T01:45:46.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.345+0000 7f1a2fe07640 1 -- 172.21.15.146:0/1681762644 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b3400d500 con 0x55e4c21ffa70 2024-09-18T01:45:46.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.345+0000 7f1a2fe07640 1 -- 172.21.15.146:0/1681762644 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b3400d860 con 0x55e4c21ffa70 2024-09-18T01:45:46.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.345+0000 7f1b43f08800 1 -- 172.21.15.146:0/1681762644 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e4c21ffa70 msgr2=0x55e4c22ef650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.345+0000 7f1b43f08800 1 --2- 172.21.15.146:0/1681762644 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e4c21ffa70 0x55e4c22ef650 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f1b3400b240 tx=0x7f1b3400b700 comp rx=0 tx=0).stop 2024-09-18T01:45:46.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.345+0000 7f1b43f08800 1 -- 172.21.15.146:0/1681762644 shutdown_connections 2024-09-18T01:45:46.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.345+0000 7f1b43f08800 1 --2- 172.21.15.146:0/1681762644 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e4c21ffa70 0x55e4c22ef650 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.346+0000 7f1b43f08800 1 -- 172.21.15.146:0/1681762644 >> 172.21.15.146:0/1681762644 conn(0x55e4c21fa550 msgr2=0x55e4c22edb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:46.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.346+0000 7f1b43f08800 1 -- 172.21.15.146:0/1681762644 shutdown_connections 2024-09-18T01:45:46.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.346+0000 7f1b43f08800 1 -- 172.21.15.146:0/1681762644 wait complete. 2024-09-18T01:45:46.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.346+0000 7f1b43f08800 1 Processor -- start 2024-09-18T01:45:46.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.346+0000 7f1b43f08800 1 -- start start 2024-09-18T01:45:46.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.346+0000 7f1b43f08800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e4c21ffa70 0x55e4c22eb430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.346+0000 7f1b43f08800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55e4c22065c0 con 0x55e4c21ffa70 2024-09-18T01:45:46.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.346+0000 7f1b419fc640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e4c21ffa70 0x55e4c22eb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.346+0000 7f1b419fc640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e4c21ffa70 0x55e4c22eb430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38542/0 (socket says 172.21.15.146:38542) 2024-09-18T01:45:46.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.346+0000 7f1b419fc640 1 -- 172.21.15.146:0/2546816203 learned_addr learned my addr 172.21.15.146:0/2546816203 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:46.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.346+0000 7f1b419fc640 1 -- 172.21.15.146:0/2546816203 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4c20adfe0 con 0x55e4c21ffa70 2024-09-18T01:45:46.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.347+0000 7f1b419fc640 1 --2- 172.21.15.146:0/2546816203 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e4c21ffa70 0x55e4c22eb430 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x55e4c22f04b0 tx=0x7f1b34000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.347+0000 7f1a2e604640 1 -- 172.21.15.146:0/2546816203 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b34019870 con 0x55e4c21ffa70 2024-09-18T01:45:46.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.347+0000 7f1a2e604640 1 -- 172.21.15.146:0/2546816203 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b34019a10 con 0x55e4c21ffa70 2024-09-18T01:45:46.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.347+0000 7f1b43f08800 1 -- 172.21.15.146:0/2546816203 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e4c22e9b20 con 0x55e4c21ffa70 2024-09-18T01:45:46.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.347+0000 7f1a2e604640 1 -- 172.21.15.146:0/2546816203 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b34019d30 con 0x55e4c21ffa70 2024-09-18T01:45:46.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.347+0000 7f1b43f08800 1 -- 172.21.15.146:0/2546816203 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4c22ea040 con 0x55e4c21ffa70 2024-09-18T01:45:46.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.348+0000 7f1a2e604640 1 -- 172.21.15.146:0/2546816203 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1b34017040 con 0x55e4c21ffa70 2024-09-18T01:45:46.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.348+0000 7f1a2e604640 1 --2- 172.21.15.146:0/2546816203 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1a28036b90 0x7f1a28039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.348+0000 7f1a2e604640 1 -- 172.21.15.146:0/2546816203 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f1b34015020 con 0x55e4c21ffa70 2024-09-18T01:45:46.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.348+0000 7f1b3bfff640 1 --2- 172.21.15.146:0/2546816203 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1a28036b90 0x7f1a28039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.348+0000 7f1b43f08800 1 --2- 172.21.15.146:0/2546816203 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55e4c2203930 0x55e4c2300490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.348+0000 7f1b43f08800 1 -- 172.21.15.146:0/2546816203 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e4c23009d0 con 0x55e4c2203930 2024-09-18T01:45:46.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.348+0000 7f1b421fd640 1 --2- 172.21.15.146:0/2546816203 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55e4c2203930 0x55e4c2300490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.348+0000 7f1b3bfff640 1 --2- 172.21.15.146:0/2546816203 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1a28036b90 0x7f1a28039050 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c057000 tx=0x7f1b2c052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.348+0000 7f1b421fd640 1 --2- 172.21.15.146:0/2546816203 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55e4c2203930 0x55e4c2300490 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.349+0000 7f1b421fd640 1 -- 172.21.15.146:0/2546816203 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1b3c00a4a0 con 0x55e4c2203930 2024-09-18T01:45:46.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.349+0000 7f1b43f08800 1 -- 172.21.15.146:0/2546816203 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e4c2301220 con 0x55e4c2203930 2024-09-18T01:45:46.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.349+0000 7f1b421fd640 1 -- 172.21.15.146:0/2546816203 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1b3c00a4a0 con 0x55e4c2203930 2024-09-18T01:45:46.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.349+0000 7f1b43f08800 1 -- 172.21.15.146:0/2546816203 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e4c23025d0 con 0x55e4c2203930 2024-09-18T01:45:46.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.349+0000 7f1b421fd640 1 -- 172.21.15.146:0/2546816203 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1b3c00a4a0 con 0x55e4c2203930 2024-09-18T01:45:46.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.349+0000 7f1b43f08800 1 -- 172.21.15.146:0/2546816203 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e4c2301a70 con 0x55e4c2203930 2024-09-18T01:45:46.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.349+0000 7f1b421fd640 1 -- 172.21.15.146:0/2546816203 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1b3c00a4a0 con 0x55e4c2203930 2024-09-18T01:45:46.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.350+0000 7f1b43f08800 1 --2- 172.21.15.146:0/2546816203 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55e4c23039a0 0x55e4c2305d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.350+0000 7f1b43f08800 1 -- 172.21.15.146:0/2546816203 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e4c2306430 con 0x55e4c23039a0 2024-09-18T01:45:46.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.350+0000 7f1b419fc640 1 --2- 172.21.15.146:0/2546816203 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55e4c23039a0 0x55e4c2305d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.350+0000 7f1b419fc640 1 --2- 172.21.15.146:0/2546816203 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55e4c23039a0 0x55e4c2305d90 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.350+0000 7f1b419fc640 1 -- 172.21.15.146:0/2546816203 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1b3402d070 con 0x55e4c23039a0 2024-09-18T01:45:46.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.350+0000 7f1b43f08800 1 Processor -- start 2024-09-18T01:45:46.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.351+0000 7f1b43f08800 1 -- start start 2024-09-18T01:45:46.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.351+0000 7f1b43f08800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e4c23141c0 0x55e4c23145e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.351+0000 7f1b43f08800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55e4c22eb970 con 0x55e4c23141c0 2024-09-18T01:45:46.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.351+0000 7f1b421fd640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e4c23141c0 0x55e4c23145e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.351+0000 7f1b421fd640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e4c23141c0 0x55e4c23145e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38552/0 (socket says 172.21.15.146:38552) 2024-09-18T01:45:46.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.351+0000 7f1b421fd640 1 -- 172.21.15.146:0/3424170360 learned_addr learned my addr 172.21.15.146:0/3424170360 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:46.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.351+0000 7f1b421fd640 1 -- 172.21.15.146:0/3424170360 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4c2314b20 con 0x55e4c23141c0 2024-09-18T01:45:46.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.351+0000 7f1b421fd640 1 --2- 172.21.15.146:0/3424170360 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e4c23141c0 0x55e4c23145e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x55e4c22eaaa0 tx=0x7f1b3c0178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.351+0000 7f1a277fe640 1 -- 172.21.15.146:0/3424170360 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b3c013440 con 0x55e4c23141c0 2024-09-18T01:45:46.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.351+0000 7f1a277fe640 1 -- 172.21.15.146:0/3424170360 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b3c0135e0 con 0x55e4c23141c0 2024-09-18T01:45:46.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.351+0000 7f1b43f08800 1 -- 172.21.15.146:0/3424170360 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e4c2314db0 con 0x55e4c23141c0 2024-09-18T01:45:46.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.351+0000 7f1a277fe640 1 -- 172.21.15.146:0/3424170360 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b3c0138c0 con 0x55e4c23141c0 2024-09-18T01:45:46.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.352+0000 7f1b43f08800 1 -- 172.21.15.146:0/3424170360 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4c2317a90 con 0x55e4c23141c0 2024-09-18T01:45:46.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.352+0000 7f1a277fe640 1 -- 172.21.15.146:0/3424170360 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1b3c011040 con 0x55e4c23141c0 2024-09-18T01:45:46.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.352+0000 7f1a277fe640 1 --2- 172.21.15.146:0/3424170360 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1a1c036b90 0x7f1a1c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.352+0000 7f1a277fe640 1 -- 172.21.15.146:0/3424170360 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f1b3c01d070 con 0x55e4c23141c0 2024-09-18T01:45:46.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.352+0000 7f1b419fc640 1 --2- 172.21.15.146:0/3424170360 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1a1c036b90 0x7f1a1c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.353+0000 7f1b43f08800 1 Processor -- start 2024-09-18T01:45:46.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.353+0000 7f1b43f08800 1 -- start start 2024-09-18T01:45:46.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.353+0000 7f1b419fc640 1 --2- 172.21.15.146:0/3424170360 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1a1c036b90 0x7f1a1c039050 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x55e4c2301e10 tx=0x7f1b3404b640 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.353+0000 7f1b43f08800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e4c2320e40 0x55e4c2321240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.353+0000 7f1b43f08800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55e4c209b580 con 0x55e4c2320e40 2024-09-18T01:45:46.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.353+0000 7f1b421fd640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e4c2320e40 0x55e4c2321240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.353+0000 7f1b421fd640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e4c2320e40 0x55e4c2321240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38558/0 (socket says 172.21.15.146:38558) 2024-09-18T01:45:46.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.353+0000 7f1b421fd640 1 -- 172.21.15.146:0/3831976447 learned_addr learned my addr 172.21.15.146:0/3831976447 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:46.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.353+0000 7f1b421fd640 1 -- 172.21.15.146:0/3831976447 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4c2321810 con 0x55e4c2320e40 2024-09-18T01:45:46.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.353+0000 7f1b421fd640 1 --2- 172.21.15.146:0/3831976447 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e4c2320e40 0x55e4c2321240 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c04c860 tx=0x7f1b3c04cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27a7f15167092209 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.354+0000 7f1a257fa640 1 -- 172.21.15.146:0/3831976447 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b3c012c90 con 0x55e4c2320e40 2024-09-18T01:45:46.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.354+0000 7f1a257fa640 1 -- 172.21.15.146:0/3831976447 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b3c012e30 con 0x55e4c2320e40 2024-09-18T01:45:46.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.354+0000 7f1a257fa640 1 -- 172.21.15.146:0/3831976447 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b3c0124d0 con 0x55e4c2320e40 2024-09-18T01:45:46.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.354+0000 7f1b43f08800 1 -- 172.21.15.146:0/3831976447 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e4c2320e40 msgr2=0x55e4c2321240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.354+0000 7f1b43f08800 1 --2- 172.21.15.146:0/3831976447 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e4c2320e40 0x55e4c2321240 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c04c860 tx=0x7f1b3c04cb10 comp rx=0 tx=0).stop 2024-09-18T01:45:46.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.354+0000 7f1b43f08800 1 -- 172.21.15.146:0/3831976447 shutdown_connections 2024-09-18T01:45:46.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.354+0000 7f1b43f08800 1 --2- 172.21.15.146:0/3831976447 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e4c2320e40 0x55e4c2321240 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.354+0000 7f1b43f08800 1 -- 172.21.15.146:0/3831976447 >> 172.21.15.146:0/3831976447 conn(0x55e4c231d1a0 msgr2=0x55e4c231b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:46.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.354+0000 7f1b43f08800 1 -- 172.21.15.146:0/3831976447 shutdown_connections 2024-09-18T01:45:46.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.354+0000 7f1b43f08800 1 -- 172.21.15.146:0/3831976447 wait complete. 2024-09-18T01:45:46.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.354+0000 7f1b43f08800 1 Processor -- start 2024-09-18T01:45:46.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.354+0000 7f1b43f08800 1 -- start start 2024-09-18T01:45:46.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.355+0000 7f1b43f08800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e4c2320e40 0x55e4c2328190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.355+0000 7f1b43f08800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55e4c2321d00 con 0x55e4c2320e40 2024-09-18T01:45:46.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.355+0000 7f1b421fd640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e4c2320e40 0x55e4c2328190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.355+0000 7f1b421fd640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e4c2320e40 0x55e4c2328190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38572/0 (socket says 172.21.15.146:38572) 2024-09-18T01:45:46.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.355+0000 7f1b421fd640 1 -- 172.21.15.146:0/1266964706 learned_addr learned my addr 172.21.15.146:0/1266964706 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:46.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.355+0000 7f1b421fd640 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4c23286d0 con 0x55e4c2320e40 2024-09-18T01:45:46.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.355+0000 7f1b421fd640 1 --2- 172.21.15.146:0/1266964706 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e4c2320e40 0x55e4c2328190 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c015fd0 tx=0x7f1b3c04c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.355+0000 7f1a137fe640 1 -- 172.21.15.146:0/1266964706 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b3c012c90 con 0x55e4c2320e40 2024-09-18T01:45:46.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.355+0000 7f1a137fe640 1 -- 172.21.15.146:0/1266964706 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b3c001520 con 0x55e4c2320e40 2024-09-18T01:45:46.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.355+0000 7f1a137fe640 1 -- 172.21.15.146:0/1266964706 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b3c001c30 con 0x55e4c2320e40 2024-09-18T01:45:46.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.355+0000 7f1b43f08800 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e4c2328960 con 0x55e4c2320e40 2024-09-18T01:45:46.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.355+0000 7f1b43f08800 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4c232b610 con 0x55e4c2320e40 2024-09-18T01:45:46.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.356+0000 7f1a137fe640 1 -- 172.21.15.146:0/1266964706 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1b3c013b90 con 0x55e4c2320e40 2024-09-18T01:45:46.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.356+0000 7f1a137fe640 1 --2- 172.21.15.146:0/1266964706 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1a0c036b40 0x7f1a0c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.356+0000 7f1a137fe640 1 -- 172.21.15.146:0/1266964706 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f1b3c00e040 con 0x55e4c2320e40 2024-09-18T01:45:46.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.356+0000 7f1b419fc640 1 --2- 172.21.15.146:0/1266964706 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1a0c036b40 0x7f1a0c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.357+0000 7f1b419fc640 1 --2- 172.21.15.146:0/1266964706 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1a0c036b40 0x7f1a0c039000 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1b3400e6d0 tx=0x7f1b34033000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.357+0000 7f1b43f08800 20 rados->read ofs=0 len=0 2024-09-18T01:45:46.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.357+0000 7f1b43f08800 1 --2- 172.21.15.146:0/1266964706 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55e4c2333df0 0x55e4c23362b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.357+0000 7f1b43f08800 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e4c2336a00 con 0x55e4c2333df0 2024-09-18T01:45:46.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.357+0000 7f1b3bfff640 1 --2- 172.21.15.146:0/1266964706 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55e4c2333df0 0x55e4c23362b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.358+0000 7f1b3bfff640 1 --2- 172.21.15.146:0/1266964706 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55e4c2333df0 0x55e4c23362b0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.358+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1b2c059af0 con 0x55e4c2333df0 2024-09-18T01:45:46.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.358+0000 7f1b43f08800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:46.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.358+0000 7f1b43f08800 20 realm 2024-09-18T01:45:46.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.358+0000 7f1b43f08800 20 rados->read ofs=0 len=0 2024-09-18T01:45:46.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.358+0000 7f1b43f08800 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e4c2336e30 con 0x55e4c2333df0 2024-09-18T01:45:46.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.358+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1b2c059af0 con 0x55e4c2333df0 2024-09-18T01:45:46.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.358+0000 7f1b43f08800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:46.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.358+0000 7f1b43f08800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:46.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.358+0000 7f1b43f08800 20 rados->read ofs=0 len=0 2024-09-18T01:45:46.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.358+0000 7f1b43f08800 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e4c2337700 con 0x55e4c2333df0 2024-09-18T01:45:46.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.358+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1b2c059af0 con 0x55e4c2333df0 2024-09-18T01:45:46.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.358+0000 7f1b43f08800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:46.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.358+0000 7f1b43f08800 20 rados->read ofs=0 len=0 2024-09-18T01:45:46.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.358+0000 7f1b43f08800 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e4c2337aa0 con 0x55e4c2333df0 2024-09-18T01:45:46.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.358+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1b2c059af0 con 0x55e4c2333df0 2024-09-18T01:45:46.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.358+0000 7f1b43f08800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:46.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.359+0000 7f1b43f08800 20 rados->read ofs=0 len=0 2024-09-18T01:45:46.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.359+0000 7f1b43f08800 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e4c23382f0 con 0x55e4c2333df0 2024-09-18T01:45:46.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.359+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1b2c059af0 con 0x55e4c2333df0 2024-09-18T01:45:46.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.359+0000 7f1b43f08800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:46.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.359+0000 7f1b43f08800 20 searching for the correct realm 2024-09-18T01:45:46.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.359+0000 7f1b43f08800 1 --2- 172.21.15.146:0/1266964706 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55e4c233a060 0x55e4c233c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.359+0000 7f1b43f08800 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e4c233ca80 con 0x55e4c233a060 2024-09-18T01:45:46.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.359+0000 7f1b421fd640 1 --2- 172.21.15.146:0/1266964706 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55e4c233a060 0x55e4c233c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.359+0000 7f1b421fd640 1 --2- 172.21.15.146:0/1266964706 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55e4c233a060 0x55e4c233c450 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.359+0000 7f1b421fd640 1 -- 172.21.15.146:0/1266964706 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b3c035070 con 0x55e4c233a060 2024-09-18T01:45:46.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.359+0000 7f1b421fd640 1 --2- 172.21.15.146:0/1266964706 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f1b3c022420 0x7f1b3c02aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.359+0000 7f1b421fd640 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e4c233ca80 con 0x7f1b3c022420 2024-09-18T01:45:46.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.360+0000 7f1b419fc640 1 --2- 172.21.15.146:0/1266964706 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f1b3c022420 0x7f1b3c02aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.360+0000 7f1b419fc640 1 --2- 172.21.15.146:0/1266964706 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f1b3c022420 0x7f1b3c02aa60 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.360+0000 7f1b419fc640 1 -- 172.21.15.146:0/1266964706 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b3402d070 con 0x7f1b3c022420 2024-09-18T01:45:46.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.360+0000 7f1b419fc640 1 --2- 172.21.15.146:0/1266964706 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f1b34018810 0x7f1b3403f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.360+0000 7f1b419fc640 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e4c233ca80 con 0x7f1b34018810 2024-09-18T01:45:46.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.360+0000 7f1b3bfff640 1 --2- 172.21.15.146:0/1266964706 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f1b34018810 0x7f1b3403f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.361+0000 7f1b3bfff640 1 --2- 172.21.15.146:0/1266964706 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f1b34018810 0x7f1b3403f1e0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.361+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b2c059af0 con 0x7f1b34018810 2024-09-18T01:45:46.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.361+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e4c233ca80 con 0x55e4c2333df0 2024-09-18T01:45:46.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.361+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1b2c059af0 con 0x55e4c2333df0 2024-09-18T01:45:46.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.361+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e4c233ca80 con 0x55e4c2333df0 2024-09-18T01:45:46.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.361+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b2c059af0 con 0x55e4c2333df0 2024-09-18T01:45:46.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.361+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e4c233ca80 con 0x7f1b34018810 2024-09-18T01:45:46.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.361+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b2c059af0 con 0x7f1b34018810 2024-09-18T01:45:46.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.361+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e4c233ca80 con 0x7f1b34018810 2024-09-18T01:45:46.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.362+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b2c059af0 con 0x7f1b34018810 2024-09-18T01:45:46.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.362+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e4c233ca80 con 0x7f1b3c022420 2024-09-18T01:45:46.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.362+0000 7f1b419fc640 1 -- 172.21.15.146:0/1266964706 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b3402d070 con 0x7f1b3c022420 2024-09-18T01:45:46.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.362+0000 7f1b419fc640 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e4c233ca80 con 0x55e4c233a060 2024-09-18T01:45:46.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.362+0000 7f1b421fd640 1 -- 172.21.15.146:0/1266964706 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b3c035070 con 0x55e4c233a060 2024-09-18T01:45:46.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.362+0000 7f1b421fd640 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e4c233ca80 con 0x55e4c2333df0 2024-09-18T01:45:46.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.362+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b2c059af0 con 0x55e4c2333df0 2024-09-18T01:45:46.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.362+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e4c233ca80 con 0x7f1b34018810 2024-09-18T01:45:46.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.363+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b2c059af0 con 0x7f1b34018810 2024-09-18T01:45:46.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.363+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e4c233ca80 con 0x55e4c2333df0 2024-09-18T01:45:46.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.363+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b2c059af0 con 0x55e4c2333df0 2024-09-18T01:45:46.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.363+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e4c233ca80 con 0x7f1b3c022420 2024-09-18T01:45:46.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.363+0000 7f1b419fc640 1 -- 172.21.15.146:0/1266964706 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f1b3402d070 con 0x7f1b3c022420 2024-09-18T01:45:46.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.363+0000 7f1b419fc640 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f1b3405a0a0 con 0x55e4c233a060 2024-09-18T01:45:46.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.363+0000 7f1b421fd640 1 -- 172.21.15.146:0/1266964706 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b3c05e040 con 0x55e4c233a060 2024-09-18T01:45:46.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.363+0000 7f1b421fd640 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f1b3405a0a0 con 0x55e4c233a060 2024-09-18T01:45:46.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.364+0000 7f1b421fd640 1 -- 172.21.15.146:0/1266964706 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b3c05e040 con 0x55e4c233a060 2024-09-18T01:45:46.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.364+0000 7f1b421fd640 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f1b3405a0a0 con 0x7f1b34018810 2024-09-18T01:45:46.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.364+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b2c059af0 con 0x7f1b34018810 2024-09-18T01:45:46.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.364+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f1b3405a0a0 con 0x55e4c233a060 2024-09-18T01:45:46.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.364+0000 7f1b421fd640 1 -- 172.21.15.146:0/1266964706 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b3c05e040 con 0x55e4c233a060 2024-09-18T01:45:46.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.364+0000 7f1b421fd640 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f1b3405a0a0 con 0x55e4c233a060 2024-09-18T01:45:46.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.364+0000 7f1b421fd640 1 -- 172.21.15.146:0/1266964706 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b3c05e040 con 0x55e4c233a060 2024-09-18T01:45:46.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.364+0000 7f1b421fd640 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f1b3405a0a0 con 0x55e4c2333df0 2024-09-18T01:45:46.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.365+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b2c059af0 con 0x55e4c2333df0 2024-09-18T01:45:46.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.365+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f1b3405a0a0 con 0x55e4c2333df0 2024-09-18T01:45:46.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.365+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1b2c059af0 con 0x55e4c2333df0 2024-09-18T01:45:46.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.365+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f1b3405a0a0 con 0x7f1b34018810 2024-09-18T01:45:46.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.365+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b2c059af0 con 0x7f1b34018810 2024-09-18T01:45:46.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.365+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f1b3405a0a0 con 0x55e4c233a060 2024-09-18T01:45:46.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.365+0000 7f1b421fd640 1 -- 172.21.15.146:0/1266964706 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b3c05e040 con 0x55e4c233a060 2024-09-18T01:45:46.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.365+0000 7f1b421fd640 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f1b3405a0a0 con 0x7f1b3c022420 2024-09-18T01:45:46.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.366+0000 7f1b419fc640 1 -- 172.21.15.146:0/1266964706 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b3402d070 con 0x7f1b3c022420 2024-09-18T01:45:46.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.366+0000 7f1b419fc640 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f1b3405a0a0 con 0x55e4c2333df0 2024-09-18T01:45:46.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.366+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b2c059af0 con 0x55e4c2333df0 2024-09-18T01:45:46.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.366+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f1b3405a0a0 con 0x7f1b34018810 2024-09-18T01:45:46.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.366+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b2c059af0 con 0x7f1b34018810 2024-09-18T01:45:46.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.366+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f1b3405a0a0 con 0x55e4c233a060 2024-09-18T01:45:46.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.366+0000 7f1b421fd640 1 -- 172.21.15.146:0/1266964706 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b3c05e040 con 0x55e4c233a060 2024-09-18T01:45:46.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.366+0000 7f1b421fd640 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f1b3405a0a0 con 0x7f1b34018810 2024-09-18T01:45:46.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.367+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b2c059af0 con 0x7f1b34018810 2024-09-18T01:45:46.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.367+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f1b3405a0a0 con 0x7f1b3c022420 2024-09-18T01:45:46.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.367+0000 7f1b419fc640 1 -- 172.21.15.146:0/1266964706 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b3402d070 con 0x7f1b3c022420 2024-09-18T01:45:46.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.367+0000 7f1b419fc640 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f1b3405a0a0 con 0x55e4c233a060 2024-09-18T01:45:46.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.367+0000 7f1b421fd640 1 -- 172.21.15.146:0/1266964706 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b3c05e040 con 0x55e4c233a060 2024-09-18T01:45:46.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.367+0000 7f1b421fd640 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f1b3405a0a0 con 0x7f1b34018810 2024-09-18T01:45:46.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.367+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b2c059af0 con 0x7f1b34018810 2024-09-18T01:45:46.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.367+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f1b3405a0a0 con 0x55e4c2333df0 2024-09-18T01:45:46.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.367+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1b2c059af0 con 0x55e4c2333df0 2024-09-18T01:45:46.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.367+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f1b3405a0a0 con 0x7f1b3c022420 2024-09-18T01:45:46.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.368+0000 7f1b419fc640 1 -- 172.21.15.146:0/1266964706 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b3402d070 con 0x7f1b3c022420 2024-09-18T01:45:46.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.368+0000 7f1b43f08800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:46.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.368+0000 7f1b43f08800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:46.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.368+0000 7f1b43f08800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:46.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.368+0000 7f1b43f08800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:46.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.368+0000 7f1b43f08800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:46.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.368+0000 7f1b43f08800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:46.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.368+0000 7f1b43f08800 20 rados->read ofs=0 len=0 2024-09-18T01:45:46.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.368+0000 7f1b43f08800 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e4c2338ca0 con 0x55e4c2333df0 2024-09-18T01:45:46.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.368+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1b2c059af0 con 0x55e4c2333df0 2024-09-18T01:45:46.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.368+0000 7f1b43f08800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:46.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.368+0000 7f1b43f08800 20 rados->read ofs=0 len=0 2024-09-18T01:45:46.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.368+0000 7f1b43f08800 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e4c2339540 con 0x55e4c2333df0 2024-09-18T01:45:46.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.368+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1b2c059af0 con 0x55e4c2333df0 2024-09-18T01:45:46.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.368+0000 7f1b43f08800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:46.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.368+0000 7f1b43f08800 20 rados->read ofs=0 len=0 2024-09-18T01:45:46.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.368+0000 7f1b43f08800 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e4c233cf00 con 0x7f1b3c022420 2024-09-18T01:45:46.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.368+0000 7f1b419fc640 1 -- 172.21.15.146:0/1266964706 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1b3402d070 con 0x7f1b3c022420 2024-09-18T01:45:46.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.368+0000 7f1b43f08800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:46.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.369+0000 7f1b43f08800 20 zone default found 2024-09-18T01:45:46.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.369+0000 7f1b43f08800 4 Realm: () 2024-09-18T01:45:46.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.369+0000 7f1b43f08800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:46.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.369+0000 7f1b43f08800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:46.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.369+0000 7f1b43f08800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:46.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.369+0000 7f1b43f08800 20 zonegroup default 2024-09-18T01:45:46.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.369+0000 7f1b43f08800 20 rados->read ofs=0 len=0 2024-09-18T01:45:46.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.369+0000 7f1b43f08800 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e4c233d750 con 0x7f1b34018810 2024-09-18T01:45:46.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.369+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1b2c059af0 con 0x7f1b34018810 2024-09-18T01:45:46.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.369+0000 7f1b43f08800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:46.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.369+0000 7f1b43f08800 20 rados->read ofs=0 len=0 2024-09-18T01:45:46.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.369+0000 7f1b43f08800 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e4c233f130 con 0x55e4c233a060 2024-09-18T01:45:46.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.369+0000 7f1b421fd640 1 -- 172.21.15.146:0/1266964706 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1b3c05e040 con 0x55e4c233a060 2024-09-18T01:45:46.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.369+0000 7f1b43f08800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:46.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.369+0000 7f1b43f08800 20 rados->read ofs=0 len=0 2024-09-18T01:45:46.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.369+0000 7f1b43f08800 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e4c233f5d0 con 0x55e4c233a060 2024-09-18T01:45:46.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.369+0000 7f1b421fd640 1 -- 172.21.15.146:0/1266964706 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1b3c05e040 con 0x55e4c233a060 2024-09-18T01:45:46.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.369+0000 7f1b43f08800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:46.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.369+0000 7f1b43f08800 20 started sync module instance, tier type = 2024-09-18T01:45:46.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.369+0000 7f1b43f08800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:46.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.369+0000 7f1b43f08800 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e4c233e5c0 con 0x7f1b3c022420 2024-09-18T01:45:46.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.370+0000 7f1b419fc640 1 -- 172.21.15.146:0/1266964706 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v33'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b3402d070 con 0x7f1b3c022420 2024-09-18T01:45:46.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.370+0000 7f1b43f08800 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94440999086512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e4c233fee0 con 0x7f1b3c022420 2024-09-18T01:45:46.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.370+0000 7f1b43f08800 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e4c2340730 con 0x55e4c2333df0 2024-09-18T01:45:46.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.371+0000 7f1b419fc640 1 -- 172.21.15.146:0/1266964706 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94440999086512] v33'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b3402d070 con 0x7f1b3c022420 2024-09-18T01:45:46.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.372+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v33'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b2c059af0 con 0x55e4c2333df0 2024-09-18T01:45:46.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.372+0000 7f1b43f08800 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94440999090736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e4c2340770 con 0x55e4c2333df0 2024-09-18T01:45:46.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.372+0000 7f1b43f08800 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e4c2341260 con 0x55e4c233a060 2024-09-18T01:45:46.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.373+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94440999090736] v33'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b2c059af0 con 0x55e4c2333df0 2024-09-18T01:45:46.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.373+0000 7f1b421fd640 1 -- 172.21.15.146:0/1266964706 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v33'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b3c05e040 con 0x55e4c233a060 2024-09-18T01:45:46.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.373+0000 7f1b43f08800 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94440999095600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e4c2341220 con 0x55e4c233a060 2024-09-18T01:45:46.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.373+0000 7f1b43f08800 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e4c2341cf0 con 0x7f1b3c022420 2024-09-18T01:45:46.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.374+0000 7f1b419fc640 1 -- 172.21.15.146:0/1266964706 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v33'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b3402d070 con 0x7f1b3c022420 2024-09-18T01:45:46.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.374+0000 7f1b43f08800 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94440999098400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e4c23425c0 con 0x7f1b3c022420 2024-09-18T01:45:46.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.374+0000 7f1b43f08800 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e4c2343060 con 0x55e4c2333df0 2024-09-18T01:45:46.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.374+0000 7f1b421fd640 1 -- 172.21.15.146:0/1266964706 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94440999095600] v33'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b3c05e040 con 0x55e4c233a060 2024-09-18T01:45:46.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.375+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v33'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b2c059af0 con 0x55e4c2333df0 2024-09-18T01:45:46.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.375+0000 7f1b419fc640 1 -- 172.21.15.146:0/1266964706 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94440999098400] v33'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b3402d070 con 0x7f1b3c022420 2024-09-18T01:45:46.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.375+0000 7f1b43f08800 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94440999103312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e4c2343060 con 0x55e4c2333df0 2024-09-18T01:45:46.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.375+0000 7f1b43f08800 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e4c2343930 con 0x7f1b34018810 2024-09-18T01:45:46.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.376+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94440999103312] v33'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b2c059af0 con 0x55e4c2333df0 2024-09-18T01:45:46.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.376+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v33'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b2c059af0 con 0x7f1b34018810 2024-09-18T01:45:46.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.376+0000 7f1b43f08800 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94440999100688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e4c2343060 con 0x7f1b34018810 2024-09-18T01:45:46.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.376+0000 7f1b43f08800 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e4c2344030 con 0x7f1b34018810 2024-09-18T01:45:46.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.377+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94440999100688] v33'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b2c059af0 con 0x7f1b34018810 2024-09-18T01:45:46.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.377+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v33'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b2c059af0 con 0x7f1b34018810 2024-09-18T01:45:46.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.377+0000 7f1b43f08800 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94440999107328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e4c2343ff0 con 0x7f1b34018810 2024-09-18T01:45:46.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.377+0000 7f1b43f08800 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e4c2344a40 con 0x7f1b34018810 2024-09-18T01:45:46.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.378+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94440999107328] v33'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b2c059af0 con 0x7f1b34018810 2024-09-18T01:45:46.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.378+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v33'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b2c059af0 con 0x7f1b34018810 2024-09-18T01:45:46.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.378+0000 7f1b43f08800 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94440999105584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e4c2344a40 con 0x7f1b34018810 2024-09-18T01:45:46.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.378+0000 7f1b43f08800 20 add_watcher() i=0 2024-09-18T01:45:46.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.378+0000 7f1b43f08800 20 add_watcher() i=1 2024-09-18T01:45:46.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.378+0000 7f1b43f08800 20 add_watcher() i=2 2024-09-18T01:45:46.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.378+0000 7f1b43f08800 20 add_watcher() i=3 2024-09-18T01:45:46.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.378+0000 7f1b43f08800 20 add_watcher() i=4 2024-09-18T01:45:46.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.378+0000 7f1b43f08800 20 add_watcher() i=5 2024-09-18T01:45:46.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.378+0000 7f1b43f08800 20 add_watcher() i=6 2024-09-18T01:45:46.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.379+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94440999105584] v33'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b2c059af0 con 0x7f1b34018810 2024-09-18T01:45:46.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.379+0000 7f1b43f08800 20 add_watcher() i=7 2024-09-18T01:45:46.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.379+0000 7f1b43f08800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:46.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.379+0000 7f1b43f08800 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e4c2347e40 con 0x55e4c2333df0 2024-09-18T01:45:46.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.380+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1b2c059af0 con 0x55e4c2333df0 2024-09-18T01:45:46.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.380+0000 7f1b43f08800 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94440999110496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e4c2345360 con 0x55e4c2333df0 2024-09-18T01:45:46.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.381+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94440999110496] v33'195 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1b2c059af0 con 0x55e4c2333df0 2024-09-18T01:45:46.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.381+0000 7f19f37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:46.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.381+0000 7f1b43f08800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:46.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.381+0000 7f1b43f08800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:46.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.381+0000 7f1b43f08800 5 note: GC not initialized 2024-09-18T01:45:46.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.381+0000 7f19f27fc640 20 reqs_thread_entry: start 2024-09-18T01:45:46.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.381+0000 7f1b43f08800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:46.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.381+0000 7f1b43f08800 20 Filter name: none 2024-09-18T01:45:46.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.381+0000 7f1963fff640 20 reqs_thread_entry: start 2024-09-18T01:45:46.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.381+0000 7f1b43f08800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T01:45:46.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.381+0000 7f1b43f08800 20 rados->read ofs=0 len=0 2024-09-18T01:45:46.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.381+0000 7f1b43f08800 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e4c237b1b0 con 0x55e4c2333df0 2024-09-18T01:45:46.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.382+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 foo [call out=48b,read 0~403 out=403b,getxattrs out=75b] v0'0 uv14 ondisk = 0) ==== 231+0+526 (crc 0 0 0) 0x7f1b2c059af0 con 0x55e4c2333df0 2024-09-18T01:45:46.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.382+0000 7f1b43f08800 20 rados_obj.operate() r=0 bl.length=403 2024-09-18T01:45:46.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.382+0000 7f1b43f08800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T01:45:46.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.382+0000 7f1b43f08800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:45:46.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.382+0000 7f1b43f08800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:45:46.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.382+0000 7f1b43f08800 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e4c2381450 con 0x55e4c2333df0 2024-09-18T01:45:46.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.383+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v33'15 uv15 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f1b2c059af0 con 0x55e4c2333df0 2024-09-18T01:45:46.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.383+0000 7f1b43f08800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:45:46.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.383+0000 7f1b43f08800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:45:46.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.383+0000 7f1b43f08800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-18T01:45:46.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.383+0000 7f1b43f08800 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94440999357968 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e4c237cc30 con 0x55e4c2333df0 2024-09-18T01:45:46.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.383+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== watch-notify(notify (1) cookie 94440999103312 notify 141733920787 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f1b2c074040 con 0x55e4c2333df0 2024-09-18T01:45:46.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.383+0000 7f1a257fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920787 cookie 94440999103312 notifier 4670 bl.length()=567 2024-09-18T01:45:46.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.383+0000 7f1a257fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-18T01:45:46.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.383+0000 7f1a257fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:45:46.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.383+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(64 notify.4 [notify cookie 94440999357968 out=8b] v0'0 uv183 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1b2c059af0 con 0x55e4c2333df0 2024-09-18T01:45:46.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.383+0000 7f1a257fa640 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f1a04003ea0 con 0x55e4c2333df0 2024-09-18T01:45:46.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.384+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b2c059af0 con 0x55e4c2333df0 2024-09-18T01:45:46.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.384+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== watch-notify(notify_complete (2) cookie 94440999357968 notify 141733920787 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e4c20c7e00 con 0x55e4c2333df0 2024-09-18T01:45:46.399 INFO:teuthology.orchestra.run.smithi146.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-18T01:45:23.010714Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:45:23.010705Z","tags":[],"group_ids":[]} 2024-09-18T01:45:46.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.385+0000 7f19f37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:46.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.385+0000 7f1b43f08800 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94440999110496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e4c2378f60 con 0x55e4c2333df0 2024-09-18T01:45:46.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.386+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 <== osd.1 v2:172.21.15.146:6808/3930274777 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94440999110496] v33'196 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1b2c059af0 con 0x55e4c2333df0 2024-09-18T01:45:46.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.386+0000 7f1b43f08800 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94440999086512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e4c2378f60 con 0x7f1b3c022420 2024-09-18T01:45:46.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.387+0000 7f1b419fc640 1 -- 172.21.15.146:0/1266964706 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94440999086512] v33'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b3402d070 con 0x7f1b3c022420 2024-09-18T01:45:46.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.387+0000 7f1b43f08800 20 remove_watcher() i=0 2024-09-18T01:45:46.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.387+0000 7f1b43f08800 2 removed watcher, disabling cache 2024-09-18T01:45:46.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.387+0000 7f1b43f08800 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94440999090736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e4c2378f60 con 0x55e4c2333df0 2024-09-18T01:45:46.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.388+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 <== osd.1 v2:172.21.15.146:6808/3930274777 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94440999090736] v33'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b2c059af0 con 0x55e4c2333df0 2024-09-18T01:45:46.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.388+0000 7f1b43f08800 20 remove_watcher() i=1 2024-09-18T01:45:46.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.388+0000 7f1b43f08800 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94440999095600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e4c2378f60 con 0x55e4c233a060 2024-09-18T01:45:46.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.389+0000 7f1b421fd640 1 -- 172.21.15.146:0/1266964706 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94440999095600] v33'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b3c05e040 con 0x55e4c233a060 2024-09-18T01:45:46.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.389+0000 7f1b43f08800 20 remove_watcher() i=2 2024-09-18T01:45:46.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.389+0000 7f1b43f08800 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94440999098400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e4c2378f60 con 0x7f1b3c022420 2024-09-18T01:45:46.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.390+0000 7f1b419fc640 1 -- 172.21.15.146:0/1266964706 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94440999098400] v33'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b3402d070 con 0x7f1b3c022420 2024-09-18T01:45:46.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.390+0000 7f1b43f08800 20 remove_watcher() i=3 2024-09-18T01:45:46.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.390+0000 7f1b43f08800 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94440999103312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e4c2378f60 con 0x55e4c2333df0 2024-09-18T01:45:46.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.391+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 <== osd.1 v2:172.21.15.146:6808/3930274777 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94440999103312] v33'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b2c059af0 con 0x55e4c2333df0 2024-09-18T01:45:46.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.391+0000 7f1b43f08800 20 remove_watcher() i=4 2024-09-18T01:45:46.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.391+0000 7f1b43f08800 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94440999100688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e4c2378f60 con 0x7f1b34018810 2024-09-18T01:45:46.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.392+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94440999100688] v33'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b2c059af0 con 0x7f1b34018810 2024-09-18T01:45:46.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.392+0000 7f1b43f08800 20 remove_watcher() i=5 2024-09-18T01:45:46.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.392+0000 7f1b43f08800 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94440999107328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e4c2378f60 con 0x7f1b34018810 2024-09-18T01:45:46.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.393+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94440999107328] v33'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b2c059af0 con 0x7f1b34018810 2024-09-18T01:45:46.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.393+0000 7f1b43f08800 20 remove_watcher() i=6 2024-09-18T01:45:46.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.393+0000 7f1b43f08800 1 -- 172.21.15.146:0/1266964706 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94440999105584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e4c2378f60 con 0x7f1b34018810 2024-09-18T01:45:46.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.394+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94440999105584] v33'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b2c059af0 con 0x7f1b34018810 2024-09-18T01:45:46.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.394+0000 7f1b43f08800 20 remove_watcher() i=7 2024-09-18T01:45:46.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.394+0000 7f1b43f08800 1 -- 172.21.15.146:0/1266964706 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f1b34018810 msgr2=0x7f1b3403f1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.394+0000 7f1b43f08800 1 --2- 172.21.15.146:0/1266964706 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f1b34018810 0x7f1b3403f1e0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.394+0000 7f1b43f08800 1 -- 172.21.15.146:0/1266964706 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55e4c2333df0 msgr2=0x55e4c23362b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.394+0000 7f1b43f08800 1 --2- 172.21.15.146:0/1266964706 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55e4c2333df0 0x55e4c23362b0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.394+0000 7f1b43f08800 1 -- 172.21.15.146:0/1266964706 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f1b3c022420 msgr2=0x7f1b3c02aa60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.394+0000 7f1b43f08800 1 --2- 172.21.15.146:0/1266964706 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f1b3c022420 0x7f1b3c02aa60 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.394+0000 7f1b43f08800 1 -- 172.21.15.146:0/1266964706 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55e4c233a060 msgr2=0x55e4c233c450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.394+0000 7f1b43f08800 1 --2- 172.21.15.146:0/1266964706 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55e4c233a060 0x55e4c233c450 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.394+0000 7f1b43f08800 1 -- 172.21.15.146:0/1266964706 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1a0c036b40 msgr2=0x7f1a0c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.394+0000 7f1b43f08800 1 --2- 172.21.15.146:0/1266964706 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1a0c036b40 0x7f1a0c039000 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1b3400e6d0 tx=0x7f1b34033000 comp rx=0 tx=0).stop 2024-09-18T01:45:46.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.394+0000 7f1b43f08800 1 -- 172.21.15.146:0/1266964706 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e4c2320e40 msgr2=0x55e4c2328190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.394+0000 7f1b3bfff640 1 -- 172.21.15.146:0/1266964706 reap_dead start 2024-09-18T01:45:46.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.394+0000 7f1b43f08800 1 --2- 172.21.15.146:0/1266964706 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e4c2320e40 0x55e4c2328190 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c015fd0 tx=0x7f1b3c04c7f0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.394+0000 7f1b43f08800 1 -- 172.21.15.146:0/1266964706 shutdown_connections 2024-09-18T01:45:46.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.394+0000 7f1b43f08800 1 --2- 172.21.15.146:0/1266964706 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e4c2320e40 0x55e4c2328190 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.394+0000 7f1b43f08800 1 -- 172.21.15.146:0/1266964706 >> 172.21.15.146:0/1266964706 conn(0x55e4c231d1a0 msgr2=0x55e4c231b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:46.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.394+0000 7f1b43f08800 1 -- 172.21.15.146:0/1266964706 shutdown_connections 2024-09-18T01:45:46.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.394+0000 7f1b43f08800 1 -- 172.21.15.146:0/1266964706 wait complete. 2024-09-18T01:45:46.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.395+0000 7f1b43f08800 1 -- 172.21.15.146:0/3424170360 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1a1c036b90 msgr2=0x7f1a1c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.395+0000 7f1b43f08800 1 --2- 172.21.15.146:0/3424170360 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1a1c036b90 0x7f1a1c039050 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x55e4c2301e10 tx=0x7f1b3404b640 comp rx=0 tx=0).stop 2024-09-18T01:45:46.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.395+0000 7f1b43f08800 1 -- 172.21.15.146:0/3424170360 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e4c23141c0 msgr2=0x55e4c23145e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.395+0000 7f1b43f08800 1 --2- 172.21.15.146:0/3424170360 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e4c23141c0 0x55e4c23145e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x55e4c22eaaa0 tx=0x7f1b3c0178e0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.395+0000 7f1b43f08800 1 -- 172.21.15.146:0/3424170360 shutdown_connections 2024-09-18T01:45:46.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.395+0000 7f1b43f08800 1 --2- 172.21.15.146:0/3424170360 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1a1c036b90 0x7f1a1c039050 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.395+0000 7f1b43f08800 1 --2- 172.21.15.146:0/3424170360 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e4c23141c0 0x55e4c23145e0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.395+0000 7f1b43f08800 1 -- 172.21.15.146:0/3424170360 >> 172.21.15.146:0/3424170360 conn(0x55e4c2309150 msgr2=0x55e4c230bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:46.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.395+0000 7f1b43f08800 1 -- 172.21.15.146:0/3424170360 shutdown_connections 2024-09-18T01:45:46.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.395+0000 7f1b43f08800 1 -- 172.21.15.146:0/3424170360 wait complete. 2024-09-18T01:45:46.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.395+0000 7f1b43f08800 1 -- 172.21.15.146:0/2546816203 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55e4c2203930 msgr2=0x55e4c2300490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.395+0000 7f1b43f08800 1 --2- 172.21.15.146:0/2546816203 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55e4c2203930 0x55e4c2300490 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.395+0000 7f1b43f08800 1 -- 172.21.15.146:0/2546816203 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55e4c23039a0 msgr2=0x55e4c2305d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.395+0000 7f1b43f08800 1 --2- 172.21.15.146:0/2546816203 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55e4c23039a0 0x55e4c2305d90 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.395+0000 7f1b43f08800 1 -- 172.21.15.146:0/2546816203 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1a28036b90 msgr2=0x7f1a28039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.395+0000 7f1b43f08800 1 --2- 172.21.15.146:0/2546816203 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1a28036b90 0x7f1a28039050 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c057000 tx=0x7f1b2c052000 comp rx=0 tx=0).stop 2024-09-18T01:45:46.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.395+0000 7f1b43f08800 1 -- 172.21.15.146:0/2546816203 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e4c21ffa70 msgr2=0x55e4c22eb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.395+0000 7f1b43f08800 1 --2- 172.21.15.146:0/2546816203 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e4c21ffa70 0x55e4c22eb430 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x55e4c22f04b0 tx=0x7f1b34000ed0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.395+0000 7f1b43f08800 1 -- 172.21.15.146:0/2546816203 shutdown_connections 2024-09-18T01:45:46.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.395+0000 7f1b43f08800 1 --2- 172.21.15.146:0/2546816203 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55e4c23039a0 0x55e4c2305d90 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.395+0000 7f1b43f08800 1 --2- 172.21.15.146:0/2546816203 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55e4c2203930 0x55e4c2300490 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.395+0000 7f1b43f08800 1 --2- 172.21.15.146:0/2546816203 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1a28036b90 0x7f1a28039050 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.395+0000 7f1b43f08800 1 --2- 172.21.15.146:0/2546816203 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55e4c21ffa70 0x55e4c22eb430 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.395+0000 7f1b43f08800 1 -- 172.21.15.146:0/2546816203 >> 172.21.15.146:0/2546816203 conn(0x55e4c21fa550 msgr2=0x55e4c22edb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:46.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.395+0000 7f1b43f08800 1 -- 172.21.15.146:0/2546816203 shutdown_connections 2024-09-18T01:45:46.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.395+0000 7f1b43f08800 1 -- 172.21.15.146:0/2546816203 wait complete. 2024-09-18T01:45:46.410 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-18T01:45:23.010714Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:45:23.010705Z', 'tags': [], 'group_ids': []} 2024-09-18T01:45:46.422 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T01:45:46.422 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-18T01:45:46.423 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-18T01:45:46.423 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-18T01:45:46.467 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:45:46.467 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:45:46.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.466+0000 7f2dd3f3e800 1 Processor -- start 2024-09-18T01:45:46.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.466+0000 7f2dd3f3e800 1 -- start start 2024-09-18T01:45:46.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.466+0000 7f2dd3f3e800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x56187b37e8f0 0x56187b380d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.466+0000 7f2dd3f3e800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56187b239b30 con 0x56187b2ee6b0 2024-09-18T01:45:46.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.466+0000 7f2dd3f3e800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x56187b21b360 con 0x56187b37e8f0 2024-09-18T01:45:46.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.467+0000 7f2dc7433640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x56187b37e8f0 0x56187b380d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.467+0000 7f2dcfc34640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x56187b2ee6b0 0x56187b37d1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:45908/0 (socket says 172.21.15.146:45908) 2024-09-18T01:45:46.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.467+0000 7f2dcfc34640 1 -- 172.21.15.146:0/4045470522 learned_addr learned my addr 172.21.15.146:0/4045470522 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:45:46.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.467+0000 7f2dc7433640 1 -- 172.21.15.146:0/4045470522 >> v1:172.21.15.129:6789/0 conn(0x56187b2ee6b0 legacy=0x56187b37d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.467+0000 7f2dcf433640 1 -- 172.21.15.146:0/4045470522 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1928287645 0 0) 0x56187b239b30 con 0x56187b2ee6b0 2024-09-18T01:45:46.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.467+0000 7f2dc7433640 1 -- 172.21.15.146:0/4045470522 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56187b241e00 con 0x56187b37e8f0 2024-09-18T01:45:46.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.469+0000 7f2dc7433640 1 --2- 172.21.15.146:0/4045470522 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56187b37e8f0 0x56187b380d00 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f2db800a470 tx=0x7f2db8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=def7bfed3ad7785a server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.469+0000 7f2dcf433640 1 -- 172.21.15.146:0/4045470522 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2db8053570 con 0x56187b37e8f0 2024-09-18T01:45:46.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.469+0000 7f2dcf433640 1 -- 172.21.15.146:0/4045470522 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2db8058070 con 0x56187b37e8f0 2024-09-18T01:45:46.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.469+0000 7f2dcf433640 1 -- 172.21.15.146:0/4045470522 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2db8053880 con 0x56187b37e8f0 2024-09-18T01:45:46.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.469+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/4045470522 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56187b37e8f0 msgr2=0x56187b380d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.469+0000 7f2dd3f3e800 1 --2- 172.21.15.146:0/4045470522 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56187b37e8f0 0x56187b380d00 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f2db800a470 tx=0x7f2db8045a20 comp rx=0 tx=0).stop 2024-09-18T01:45:46.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.469+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/4045470522 shutdown_connections 2024-09-18T01:45:46.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.469+0000 7f2dd3f3e800 1 --2- 172.21.15.146:0/4045470522 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56187b37e8f0 0x56187b380d00 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.469+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/4045470522 >> 172.21.15.146:0/4045470522 conn(0x56187b374de0 msgr2=0x56187b377200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:46.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.469+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/4045470522 shutdown_connections 2024-09-18T01:45:46.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.469+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/4045470522 wait complete. 2024-09-18T01:45:46.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.483+0000 7f2dd3f3e800 1 Processor -- start 2024-09-18T01:45:46.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.483+0000 7f2dd3f3e800 1 -- start start 2024-09-18T01:45:46.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.483+0000 7f2dd3f3e800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56187b2ee6b0 0x56187b37ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.483+0000 7f2dd3f3e800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x56187b2c6330 con 0x56187b2ee6b0 2024-09-18T01:45:46.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.484+0000 7f2dcfc34640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56187b2ee6b0 0x56187b37ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.484+0000 7f2dcfc34640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56187b2ee6b0 0x56187b37ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38596/0 (socket says 172.21.15.146:38596) 2024-09-18T01:45:46.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.484+0000 7f2dcfc34640 1 -- 172.21.15.146:0/346768535 learned_addr learned my addr 172.21.15.146:0/346768535 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:46.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.484+0000 7f2dcfc34640 1 -- 172.21.15.146:0/346768535 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56187b213bc0 con 0x56187b2ee6b0 2024-09-18T01:45:46.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.484+0000 7f2dcfc34640 1 --2- 172.21.15.146:0/346768535 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56187b2ee6b0 0x56187b37ab00 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f2dc000b240 tx=0x7f2dc000b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcbc8a4589445760 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.484+0000 7f2cbde0b640 1 -- 172.21.15.146:0/346768535 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2dc0008070 con 0x56187b2ee6b0 2024-09-18T01:45:46.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.484+0000 7f2cbde0b640 1 -- 172.21.15.146:0/346768535 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dc000d500 con 0x56187b2ee6b0 2024-09-18T01:45:46.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.484+0000 7f2cbde0b640 1 -- 172.21.15.146:0/346768535 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2dc000d860 con 0x56187b2ee6b0 2024-09-18T01:45:46.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.485+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/346768535 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56187b2ee6b0 msgr2=0x56187b37ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.485+0000 7f2dd3f3e800 1 --2- 172.21.15.146:0/346768535 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56187b2ee6b0 0x56187b37ab00 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f2dc000b240 tx=0x7f2dc000b700 comp rx=0 tx=0).stop 2024-09-18T01:45:46.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.485+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/346768535 shutdown_connections 2024-09-18T01:45:46.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.485+0000 7f2dd3f3e800 1 --2- 172.21.15.146:0/346768535 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56187b2ee6b0 0x56187b37ab00 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.485+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/346768535 >> 172.21.15.146:0/346768535 conn(0x56187b374de0 msgr2=0x56187b465010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:46.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.485+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/346768535 shutdown_connections 2024-09-18T01:45:46.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.485+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/346768535 wait complete. 2024-09-18T01:45:46.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.485+0000 7f2dd3f3e800 1 Processor -- start 2024-09-18T01:45:46.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.485+0000 7f2dd3f3e800 1 -- start start 2024-09-18T01:45:46.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.485+0000 7f2dd3f3e800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56187b2ee6b0 0x56187b4732e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.486+0000 7f2dd3f3e800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x56187b381680 con 0x56187b2ee6b0 2024-09-18T01:45:46.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.486+0000 7f2dcfc34640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56187b2ee6b0 0x56187b4732e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.486+0000 7f2dcfc34640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56187b2ee6b0 0x56187b4732e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38612/0 (socket says 172.21.15.146:38612) 2024-09-18T01:45:46.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.486+0000 7f2dcfc34640 1 -- 172.21.15.146:0/2275734454 learned_addr learned my addr 172.21.15.146:0/2275734454 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:46.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.486+0000 7f2dcfc34640 1 -- 172.21.15.146:0/2275734454 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56187b227fe0 con 0x56187b2ee6b0 2024-09-18T01:45:46.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.486+0000 7f2dcfc34640 1 --2- 172.21.15.146:0/2275734454 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56187b2ee6b0 0x56187b4732e0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x56187b37a200 tx=0x7f2dc0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.486+0000 7f2cb7fff640 1 -- 172.21.15.146:0/2275734454 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2dc0019870 con 0x56187b2ee6b0 2024-09-18T01:45:46.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.486+0000 7f2cb7fff640 1 -- 172.21.15.146:0/2275734454 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dc0019a10 con 0x56187b2ee6b0 2024-09-18T01:45:46.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.486+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/2275734454 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56187b473820 con 0x56187b2ee6b0 2024-09-18T01:45:46.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.486+0000 7f2cb7fff640 1 -- 172.21.15.146:0/2275734454 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2dc0019d30 con 0x56187b2ee6b0 2024-09-18T01:45:46.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.486+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/2275734454 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56187b473d40 con 0x56187b2ee6b0 2024-09-18T01:45:46.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.487+0000 7f2cb7fff640 1 -- 172.21.15.146:0/2275734454 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2dc0017040 con 0x56187b2ee6b0 2024-09-18T01:45:46.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.487+0000 7f2cb7fff640 1 --2- 172.21.15.146:0/2275734454 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2cb8036b90 0x7f2cb8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.487+0000 7f2cb7fff640 1 -- 172.21.15.146:0/2275734454 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f2dc0015020 con 0x56187b2ee6b0 2024-09-18T01:45:46.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.487+0000 7f2dc7433640 1 --2- 172.21.15.146:0/2275734454 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2cb8036b90 0x7f2cb8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.487+0000 7f2dd3f3e800 1 --2- 172.21.15.146:0/2275734454 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56187b37e8f0 0x56187b47a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.487+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/2275734454 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56187b47a8d0 con 0x56187b37e8f0 2024-09-18T01:45:46.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.488+0000 7f2dd0435640 1 --2- 172.21.15.146:0/2275734454 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56187b37e8f0 0x56187b47a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.488+0000 7f2dc7433640 1 --2- 172.21.15.146:0/2275734454 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2cb8036b90 0x7f2cb8039050 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2db8057000 tx=0x7f2db8052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.488+0000 7f2dd0435640 1 --2- 172.21.15.146:0/2275734454 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56187b37e8f0 0x56187b47a350 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.488+0000 7f2dd0435640 1 -- 172.21.15.146:0/2275734454 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2dc800a4a0 con 0x56187b37e8f0 2024-09-18T01:45:46.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.488+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/2275734454 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56187b477920 con 0x56187b37e8f0 2024-09-18T01:45:46.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.488+0000 7f2dd0435640 1 -- 172.21.15.146:0/2275734454 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2dc800a4a0 con 0x56187b37e8f0 2024-09-18T01:45:46.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.488+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/2275734454 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56187b47c6f0 con 0x56187b37e8f0 2024-09-18T01:45:46.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.489+0000 7f2dd0435640 1 -- 172.21.15.146:0/2275734454 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2dc800a4a0 con 0x56187b37e8f0 2024-09-18T01:45:46.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.489+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/2275734454 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56187b47b830 con 0x56187b37e8f0 2024-09-18T01:45:46.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.489+0000 7f2dd0435640 1 -- 172.21.15.146:0/2275734454 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2dc800a4a0 con 0x56187b37e8f0 2024-09-18T01:45:46.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.489+0000 7f2dd3f3e800 1 --2- 172.21.15.146:0/2275734454 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x56187b47c300 0x56187b47fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.489+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/2275734454 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56187b4802d0 con 0x56187b47c300 2024-09-18T01:45:46.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.489+0000 7f2dcfc34640 1 --2- 172.21.15.146:0/2275734454 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x56187b47c300 0x56187b47fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.489+0000 7f2dcfc34640 1 --2- 172.21.15.146:0/2275734454 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x56187b47c300 0x56187b47fb40 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.490+0000 7f2dcfc34640 1 -- 172.21.15.146:0/2275734454 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2dc002d070 con 0x56187b47c300 2024-09-18T01:45:46.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.490+0000 7f2dd3f3e800 1 Processor -- start 2024-09-18T01:45:46.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.490+0000 7f2dd3f3e800 1 -- start start 2024-09-18T01:45:46.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.490+0000 7f2dd3f3e800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56187b48e060 0x56187b48e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.490+0000 7f2dd3f3e800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x56187b215580 con 0x56187b48e060 2024-09-18T01:45:46.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.490+0000 7f2dd0435640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56187b48e060 0x56187b48e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.490+0000 7f2dd0435640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56187b48e060 0x56187b48e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38614/0 (socket says 172.21.15.146:38614) 2024-09-18T01:45:46.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.490+0000 7f2dd0435640 1 -- 172.21.15.146:0/2315399816 learned_addr learned my addr 172.21.15.146:0/2315399816 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:46.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.490+0000 7f2dd0435640 1 -- 172.21.15.146:0/2315399816 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56187b48e9c0 con 0x56187b48e060 2024-09-18T01:45:46.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.491+0000 7f2dd0435640 1 --2- 172.21.15.146:0/2315399816 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56187b48e060 0x56187b48e480 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x56187b47acb0 tx=0x7f2dc80178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.491+0000 7f2cb57fa640 1 -- 172.21.15.146:0/2315399816 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2dc8013440 con 0x56187b48e060 2024-09-18T01:45:46.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.491+0000 7f2cb57fa640 1 -- 172.21.15.146:0/2315399816 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dc80135e0 con 0x56187b48e060 2024-09-18T01:45:46.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.491+0000 7f2cb57fa640 1 -- 172.21.15.146:0/2315399816 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2dc80138c0 con 0x56187b48e060 2024-09-18T01:45:46.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.491+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/2315399816 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56187b48ec50 con 0x56187b48e060 2024-09-18T01:45:46.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.491+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/2315399816 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56187b491930 con 0x56187b48e060 2024-09-18T01:45:46.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.492+0000 7f2cb57fa640 1 -- 172.21.15.146:0/2315399816 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2dc8011040 con 0x56187b48e060 2024-09-18T01:45:46.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.492+0000 7f2cb57fa640 1 --2- 172.21.15.146:0/2315399816 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2ca8036b90 0x7f2ca8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.492+0000 7f2cb57fa640 1 -- 172.21.15.146:0/2315399816 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f2dc801d070 con 0x56187b48e060 2024-09-18T01:45:46.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.492+0000 7f2dcfc34640 1 --2- 172.21.15.146:0/2315399816 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2ca8036b90 0x7f2ca8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.492+0000 7f2dd3f3e800 1 Processor -- start 2024-09-18T01:45:46.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.492+0000 7f2dcfc34640 1 --2- 172.21.15.146:0/2315399816 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2ca8036b90 0x7f2ca8039050 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0001630 tx=0x7f2dc004b640 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.492+0000 7f2dd3f3e800 1 -- start start 2024-09-18T01:45:46.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.492+0000 7f2dd3f3e800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56187b49ace0 0x56187b49b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.492+0000 7f2dd3f3e800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x56187b3791d0 con 0x56187b49ace0 2024-09-18T01:45:46.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.492+0000 7f2dd0435640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56187b49ace0 0x56187b49b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.492+0000 7f2dd0435640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56187b49ace0 0x56187b49b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38620/0 (socket says 172.21.15.146:38620) 2024-09-18T01:45:46.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.493+0000 7f2dd0435640 1 -- 172.21.15.146:0/3628739262 learned_addr learned my addr 172.21.15.146:0/3628739262 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:46.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.493+0000 7f2dd0435640 1 -- 172.21.15.146:0/3628739262 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56187b49b6b0 con 0x56187b49ace0 2024-09-18T01:45:46.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.493+0000 7f2dd0435640 1 --2- 172.21.15.146:0/3628739262 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56187b49ace0 0x56187b49b0e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f2dc804c890 tx=0x7f2dc80127a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6e0acbf355b6b2b server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.493+0000 7f2caeffd640 1 -- 172.21.15.146:0/3628739262 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2dc8045070 con 0x56187b49ace0 2024-09-18T01:45:46.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.493+0000 7f2caeffd640 1 -- 172.21.15.146:0/3628739262 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dc804e0d0 con 0x56187b49ace0 2024-09-18T01:45:46.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.493+0000 7f2caeffd640 1 -- 172.21.15.146:0/3628739262 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2dc8021a50 con 0x56187b49ace0 2024-09-18T01:45:46.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.493+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/3628739262 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56187b49ace0 msgr2=0x56187b49b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.493+0000 7f2dd3f3e800 1 --2- 172.21.15.146:0/3628739262 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56187b49ace0 0x56187b49b0e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f2dc804c890 tx=0x7f2dc80127a0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.493+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/3628739262 shutdown_connections 2024-09-18T01:45:46.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.493+0000 7f2dd3f3e800 1 --2- 172.21.15.146:0/3628739262 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56187b49ace0 0x56187b49b0e0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.493+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/3628739262 >> 172.21.15.146:0/3628739262 conn(0x56187b497040 msgr2=0x56187b495140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:46.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.493+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/3628739262 shutdown_connections 2024-09-18T01:45:46.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.493+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/3628739262 wait complete. 2024-09-18T01:45:46.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.494+0000 7f2dd3f3e800 1 Processor -- start 2024-09-18T01:45:46.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.494+0000 7f2dd3f3e800 1 -- start start 2024-09-18T01:45:46.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.494+0000 7f2dd3f3e800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56187b49ace0 0x56187b4a2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.494+0000 7f2dd3f3e800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x56187b49bd20 con 0x56187b49ace0 2024-09-18T01:45:46.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.494+0000 7f2dd0435640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56187b49ace0 0x56187b4a2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.494+0000 7f2dd0435640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56187b49ace0 0x56187b4a2150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:38624/0 (socket says 172.21.15.146:38624) 2024-09-18T01:45:46.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.494+0000 7f2dd0435640 1 -- 172.21.15.146:0/435629532 learned_addr learned my addr 172.21.15.146:0/435629532 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:45:46.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.494+0000 7f2dd0435640 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56187b4a2690 con 0x56187b49ace0 2024-09-18T01:45:46.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.494+0000 7f2dd0435640 1 --2- 172.21.15.146:0/435629532 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56187b49ace0 0x56187b4a2150 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f2dc80127e0 tx=0x7f2dc804c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.495+0000 7f2cad7fa640 1 -- 172.21.15.146:0/435629532 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2dc803a070 con 0x56187b49ace0 2024-09-18T01:45:46.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.495+0000 7f2cad7fa640 1 -- 172.21.15.146:0/435629532 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dc8013a60 con 0x56187b49ace0 2024-09-18T01:45:46.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.495+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56187b4a2920 con 0x56187b49ace0 2024-09-18T01:45:46.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.495+0000 7f2cad7fa640 1 -- 172.21.15.146:0/435629532 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2dc8045040 con 0x56187b49ace0 2024-09-18T01:45:46.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.495+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56187b4a55d0 con 0x56187b49ace0 2024-09-18T01:45:46.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.495+0000 7f2cad7fa640 1 -- 172.21.15.146:0/435629532 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2dc803d070 con 0x56187b49ace0 2024-09-18T01:45:46.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.496+0000 7f2cad7fa640 1 --2- 172.21.15.146:0/435629532 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2c98036b40 0x7f2c98039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.496+0000 7f2cad7fa640 1 -- 172.21.15.146:0/435629532 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f2dc8032070 con 0x56187b49ace0 2024-09-18T01:45:46.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.496+0000 7f2dcfc34640 1 --2- 172.21.15.146:0/435629532 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2c98036b40 0x7f2c98039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.496+0000 7f2dcfc34640 1 --2- 172.21.15.146:0/435629532 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2c98036b40 0x7f2c98039000 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2dc000bc50 tx=0x7f2dc0033000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.496+0000 7f2dd3f3e800 20 rados->read ofs=0 len=0 2024-09-18T01:45:46.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.496+0000 7f2dd3f3e800 1 --2- 172.21.15.146:0/435629532 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56187b4addb0 0x56187b4b0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.496+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56187b4b09c0 con 0x56187b4addb0 2024-09-18T01:45:46.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.497+0000 7f2dc7433640 1 --2- 172.21.15.146:0/435629532 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56187b4addb0 0x56187b4b0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.497+0000 7f2dc7433640 1 --2- 172.21.15.146:0/435629532 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56187b4addb0 0x56187b4b0270 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.497+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2db8051070 con 0x56187b4addb0 2024-09-18T01:45:46.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.497+0000 7f2dd3f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:46.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.497+0000 7f2dd3f3e800 20 realm 2024-09-18T01:45:46.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.497+0000 7f2dd3f3e800 20 rados->read ofs=0 len=0 2024-09-18T01:45:46.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.497+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56187b4b0df0 con 0x56187b4addb0 2024-09-18T01:45:46.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.497+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2db8051070 con 0x56187b4addb0 2024-09-18T01:45:46.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.497+0000 7f2dd3f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:46.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.497+0000 7f2dd3f3e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:45:46.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.497+0000 7f2dd3f3e800 20 rados->read ofs=0 len=0 2024-09-18T01:45:46.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.497+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56187b4b16c0 con 0x56187b4addb0 2024-09-18T01:45:46.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.498+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2db8051070 con 0x56187b4addb0 2024-09-18T01:45:46.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.498+0000 7f2dd3f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:46.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.498+0000 7f2dd3f3e800 20 rados->read ofs=0 len=0 2024-09-18T01:45:46.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.498+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56187b4b1a60 con 0x56187b4addb0 2024-09-18T01:45:46.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.498+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2db8051070 con 0x56187b4addb0 2024-09-18T01:45:46.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.498+0000 7f2dd3f3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:46.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.498+0000 7f2dd3f3e800 20 rados->read ofs=0 len=0 2024-09-18T01:45:46.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.498+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56187b4b22b0 con 0x56187b4addb0 2024-09-18T01:45:46.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.498+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2db8051070 con 0x56187b4addb0 2024-09-18T01:45:46.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.498+0000 7f2dd3f3e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:45:46.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.498+0000 7f2dd3f3e800 20 searching for the correct realm 2024-09-18T01:45:46.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.498+0000 7f2dd3f3e800 1 --2- 172.21.15.146:0/435629532 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x56187b4b4020 0x56187b4b6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.498+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56187b4b6a40 con 0x56187b4b4020 2024-09-18T01:45:46.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.498+0000 7f2dd0435640 1 --2- 172.21.15.146:0/435629532 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x56187b4b4020 0x56187b4b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.499+0000 7f2dd0435640 1 --2- 172.21.15.146:0/435629532 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x56187b4b4020 0x56187b4b6410 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.499+0000 7f2dd0435640 1 -- 172.21.15.146:0/435629532 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dc803c030 con 0x56187b4b4020 2024-09-18T01:45:46.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.499+0000 7f2dd0435640 1 --2- 172.21.15.146:0/435629532 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f2dc803f060 0x7f2dc8022a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.499+0000 7f2dd0435640 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56187b4b6a40 con 0x7f2dc803f060 2024-09-18T01:45:46.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.499+0000 7f2dcfc34640 1 --2- 172.21.15.146:0/435629532 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f2dc803f060 0x7f2dc8022a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.499+0000 7f2dcfc34640 1 --2- 172.21.15.146:0/435629532 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f2dc803f060 0x7f2dc8022a90 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.499+0000 7f2dcfc34640 1 -- 172.21.15.146:0/435629532 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dc002d070 con 0x7f2dc803f060 2024-09-18T01:45:46.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.499+0000 7f2dcfc34640 1 --2- 172.21.15.146:0/435629532 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f2dc0018810 0x7f2dc003f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:45:46.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.499+0000 7f2dcfc34640 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56187b4b6a40 con 0x7f2dc0018810 2024-09-18T01:45:46.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.500+0000 7f2dc7433640 1 --2- 172.21.15.146:0/435629532 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f2dc0018810 0x7f2dc003f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:45:46.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.500+0000 7f2dc7433640 1 --2- 172.21.15.146:0/435629532 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f2dc0018810 0x7f2dc003f1e0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:45:46.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.500+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2db8051070 con 0x7f2dc0018810 2024-09-18T01:45:46.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.500+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56187b4b6a40 con 0x56187b4addb0 2024-09-18T01:45:46.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.500+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2db8051070 con 0x56187b4addb0 2024-09-18T01:45:46.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.500+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56187b4b6a40 con 0x56187b4addb0 2024-09-18T01:45:46.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.501+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2db8051070 con 0x56187b4addb0 2024-09-18T01:45:46.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.501+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56187b4b6a40 con 0x7f2dc0018810 2024-09-18T01:45:46.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.501+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2db8051070 con 0x7f2dc0018810 2024-09-18T01:45:46.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.501+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56187b4b6a40 con 0x7f2dc0018810 2024-09-18T01:45:46.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.501+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2db8051070 con 0x7f2dc0018810 2024-09-18T01:45:46.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.501+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56187b4b6a40 con 0x7f2dc803f060 2024-09-18T01:45:46.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.501+0000 7f2dcfc34640 1 -- 172.21.15.146:0/435629532 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dc002d070 con 0x7f2dc803f060 2024-09-18T01:45:46.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.501+0000 7f2dcfc34640 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56187b4b6a40 con 0x56187b4b4020 2024-09-18T01:45:46.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.502+0000 7f2dd0435640 1 -- 172.21.15.146:0/435629532 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dc803c030 con 0x56187b4b4020 2024-09-18T01:45:46.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.502+0000 7f2dd0435640 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56187b4b6a40 con 0x56187b4addb0 2024-09-18T01:45:46.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.502+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2db8051070 con 0x56187b4addb0 2024-09-18T01:45:46.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.502+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56187b4b6a40 con 0x7f2dc0018810 2024-09-18T01:45:46.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.502+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2db8051070 con 0x7f2dc0018810 2024-09-18T01:45:46.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.502+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56187b4b6a40 con 0x56187b4addb0 2024-09-18T01:45:46.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.502+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2db8051070 con 0x56187b4addb0 2024-09-18T01:45:46.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.502+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56187b4b6a40 con 0x7f2dc803f060 2024-09-18T01:45:46.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.502+0000 7f2dcfc34640 1 -- 172.21.15.146:0/435629532 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f2dc002d070 con 0x7f2dc803f060 2024-09-18T01:45:46.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.503+0000 7f2dcfc34640 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f2dc005a0a0 con 0x56187b4b4020 2024-09-18T01:45:46.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.503+0000 7f2dd0435640 1 -- 172.21.15.146:0/435629532 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dc803c030 con 0x56187b4b4020 2024-09-18T01:45:46.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.503+0000 7f2dd0435640 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f2dc005a0a0 con 0x56187b4b4020 2024-09-18T01:45:46.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.503+0000 7f2dd0435640 1 -- 172.21.15.146:0/435629532 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dc803c030 con 0x56187b4b4020 2024-09-18T01:45:46.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.503+0000 7f2dd0435640 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f2dc005a0a0 con 0x7f2dc0018810 2024-09-18T01:45:46.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.503+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2db8051070 con 0x7f2dc0018810 2024-09-18T01:45:46.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.503+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f2dc005a0a0 con 0x56187b4b4020 2024-09-18T01:45:46.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.503+0000 7f2dd0435640 1 -- 172.21.15.146:0/435629532 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dc803c030 con 0x56187b4b4020 2024-09-18T01:45:46.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.503+0000 7f2dd0435640 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f2dc005a0a0 con 0x56187b4b4020 2024-09-18T01:45:46.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.504+0000 7f2dd0435640 1 -- 172.21.15.146:0/435629532 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dc803c030 con 0x56187b4b4020 2024-09-18T01:45:46.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.504+0000 7f2dd0435640 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f2dc005a0a0 con 0x56187b4addb0 2024-09-18T01:45:46.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.504+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2db8051070 con 0x56187b4addb0 2024-09-18T01:45:46.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.504+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f2dc005a0a0 con 0x56187b4addb0 2024-09-18T01:45:46.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.504+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2db8051070 con 0x56187b4addb0 2024-09-18T01:45:46.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.504+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f2dc005a0a0 con 0x7f2dc0018810 2024-09-18T01:45:46.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.504+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2db8051070 con 0x7f2dc0018810 2024-09-18T01:45:46.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.504+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f2dc005a0a0 con 0x56187b4b4020 2024-09-18T01:45:46.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.505+0000 7f2dd0435640 1 -- 172.21.15.146:0/435629532 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dc803c030 con 0x56187b4b4020 2024-09-18T01:45:46.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.505+0000 7f2dd0435640 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f2dc005a0a0 con 0x7f2dc803f060 2024-09-18T01:45:46.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.505+0000 7f2dcfc34640 1 -- 172.21.15.146:0/435629532 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dc002d070 con 0x7f2dc803f060 2024-09-18T01:45:46.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.505+0000 7f2dcfc34640 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f2dc005a0a0 con 0x56187b4addb0 2024-09-18T01:45:46.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.505+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2db8051070 con 0x56187b4addb0 2024-09-18T01:45:46.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.505+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f2dc005a0a0 con 0x7f2dc0018810 2024-09-18T01:45:46.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.505+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2db8051070 con 0x7f2dc0018810 2024-09-18T01:45:46.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.505+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f2dc005a0a0 con 0x56187b4b4020 2024-09-18T01:45:46.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.506+0000 7f2dd0435640 1 -- 172.21.15.146:0/435629532 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dc803c030 con 0x56187b4b4020 2024-09-18T01:45:46.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.506+0000 7f2dd0435640 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f2dc005a0a0 con 0x7f2dc0018810 2024-09-18T01:45:46.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.506+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2db8051070 con 0x7f2dc0018810 2024-09-18T01:45:46.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.506+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f2dc005a0a0 con 0x7f2dc803f060 2024-09-18T01:45:46.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.506+0000 7f2dcfc34640 1 -- 172.21.15.146:0/435629532 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dc002d070 con 0x7f2dc803f060 2024-09-18T01:45:46.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.506+0000 7f2dcfc34640 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f2dc005a0a0 con 0x56187b4b4020 2024-09-18T01:45:46.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.506+0000 7f2dd0435640 1 -- 172.21.15.146:0/435629532 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dc803c030 con 0x56187b4b4020 2024-09-18T01:45:46.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.506+0000 7f2dd0435640 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f2dc005a0a0 con 0x7f2dc0018810 2024-09-18T01:45:46.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.507+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2db8051070 con 0x7f2dc0018810 2024-09-18T01:45:46.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.507+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f2dc005a0a0 con 0x56187b4addb0 2024-09-18T01:45:46.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.507+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2db8051070 con 0x56187b4addb0 2024-09-18T01:45:46.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.507+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f2dc005a0a0 con 0x7f2dc803f060 2024-09-18T01:45:46.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.507+0000 7f2dcfc34640 1 -- 172.21.15.146:0/435629532 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dc002d070 con 0x7f2dc803f060 2024-09-18T01:45:46.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.507+0000 7f2dd3f3e800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:45:46.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.507+0000 7f2dd3f3e800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:45:46.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.507+0000 7f2dd3f3e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:45:46.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.507+0000 7f2dd3f3e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:45:46.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.507+0000 7f2dd3f3e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:45:46.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.507+0000 7f2dd3f3e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:45:46.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.507+0000 7f2dd3f3e800 20 rados->read ofs=0 len=0 2024-09-18T01:45:46.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.507+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56187b4b2c30 con 0x56187b4addb0 2024-09-18T01:45:46.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.507+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2db8051070 con 0x56187b4addb0 2024-09-18T01:45:46.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.507+0000 7f2dd3f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:46.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.507+0000 7f2dd3f3e800 20 rados->read ofs=0 len=0 2024-09-18T01:45:46.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.507+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56187b4b34d0 con 0x56187b4addb0 2024-09-18T01:45:46.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.507+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2db8051070 con 0x56187b4addb0 2024-09-18T01:45:46.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.507+0000 7f2dd3f3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:45:46.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.507+0000 7f2dd3f3e800 20 rados->read ofs=0 len=0 2024-09-18T01:45:46.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.507+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56187b4b6ec0 con 0x7f2dc803f060 2024-09-18T01:45:46.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.508+0000 7f2dcfc34640 1 -- 172.21.15.146:0/435629532 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2dc002d070 con 0x7f2dc803f060 2024-09-18T01:45:46.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.508+0000 7f2dd3f3e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:45:46.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.508+0000 7f2dd3f3e800 20 zone default found 2024-09-18T01:45:46.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.508+0000 7f2dd3f3e800 4 Realm: () 2024-09-18T01:45:46.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.508+0000 7f2dd3f3e800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:45:46.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.508+0000 7f2dd3f3e800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:45:46.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.508+0000 7f2dd3f3e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:45:46.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.508+0000 7f2dd3f3e800 20 zonegroup default 2024-09-18T01:45:46.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.508+0000 7f2dd3f3e800 20 rados->read ofs=0 len=0 2024-09-18T01:45:46.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.508+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56187b4b7710 con 0x7f2dc0018810 2024-09-18T01:45:46.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.508+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2db8051070 con 0x7f2dc0018810 2024-09-18T01:45:46.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.508+0000 7f2dd3f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:46.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.508+0000 7f2dd3f3e800 20 rados->read ofs=0 len=0 2024-09-18T01:45:46.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.508+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56187b4b90f0 con 0x56187b4b4020 2024-09-18T01:45:46.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.508+0000 7f2dd0435640 1 -- 172.21.15.146:0/435629532 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2dc803c030 con 0x56187b4b4020 2024-09-18T01:45:46.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.508+0000 7f2dd3f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:46.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.508+0000 7f2dd3f3e800 20 rados->read ofs=0 len=0 2024-09-18T01:45:46.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.508+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56187b4b9590 con 0x56187b4b4020 2024-09-18T01:45:46.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.509+0000 7f2dd0435640 1 -- 172.21.15.146:0/435629532 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2dc803c030 con 0x56187b4b4020 2024-09-18T01:45:46.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.509+0000 7f2dd3f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:45:46.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.509+0000 7f2dd3f3e800 20 started sync module instance, tier type = 2024-09-18T01:45:46.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.509+0000 7f2dd3f3e800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:45:46.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.509+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4b8580 con 0x7f2dc803f060 2024-09-18T01:45:46.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.510+0000 7f2dcfc34640 1 -- 172.21.15.146:0/435629532 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v33'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dc002d070 con 0x7f2dc803f060 2024-09-18T01:45:46.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.510+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94663147751792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4b81e0 con 0x7f2dc803f060 2024-09-18T01:45:46.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.510+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4ba4c0 con 0x56187b4addb0 2024-09-18T01:45:46.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.511+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v33'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2db8051070 con 0x56187b4addb0 2024-09-18T01:45:46.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.511+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94663147758064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4baca0 con 0x56187b4addb0 2024-09-18T01:45:46.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.511+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4bb7c0 con 0x56187b4b4020 2024-09-18T01:45:46.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.512+0000 7f2dcfc34640 1 -- 172.21.15.146:0/435629532 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94663147751792] v33'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dc002d070 con 0x7f2dc803f060 2024-09-18T01:45:46.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.512+0000 7f2dd0435640 1 -- 172.21.15.146:0/435629532 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v33'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dc803c030 con 0x56187b4b4020 2024-09-18T01:45:46.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.512+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94663147762320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4bb780 con 0x56187b4b4020 2024-09-18T01:45:46.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.512+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4bc240 con 0x7f2dc803f060 2024-09-18T01:45:46.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.512+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94663147758064] v33'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2db8051070 con 0x56187b4addb0 2024-09-18T01:45:46.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.513+0000 7f2dcfc34640 1 -- 172.21.15.146:0/435629532 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v33'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dc002d070 con 0x7f2dc803f060 2024-09-18T01:45:46.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.513+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94663147765072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4bc630 con 0x7f2dc803f060 2024-09-18T01:45:46.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.513+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4bd090 con 0x56187b4addb0 2024-09-18T01:45:46.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.514+0000 7f2dd0435640 1 -- 172.21.15.146:0/435629532 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94663147762320] v33'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dc803c030 con 0x56187b4b4020 2024-09-18T01:45:46.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.514+0000 7f2dcfc34640 1 -- 172.21.15.146:0/435629532 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94663147765072] v33'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dc002d070 con 0x7f2dc803f060 2024-09-18T01:45:46.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.515+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v33'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2db8051070 con 0x56187b4addb0 2024-09-18T01:45:46.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.515+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94663147759344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4bd090 con 0x56187b4addb0 2024-09-18T01:45:46.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.515+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4bd930 con 0x7f2dc0018810 2024-09-18T01:45:46.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.516+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v33'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2db8051070 con 0x7f2dc0018810 2024-09-18T01:45:46.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.516+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94663147759344] v33'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2db8051070 con 0x56187b4addb0 2024-09-18T01:45:46.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.516+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94663147770000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4bd9e0 con 0x7f2dc0018810 2024-09-18T01:45:46.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.516+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4b9a30 con 0x7f2dc0018810 2024-09-18T01:45:46.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.517+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94663147770000] v33'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2db8051070 con 0x7f2dc0018810 2024-09-18T01:45:46.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.517+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v33'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2db8051070 con 0x7f2dc0018810 2024-09-18T01:45:46.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.517+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94663147771056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4bd9a0 con 0x7f2dc0018810 2024-09-18T01:45:46.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.517+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4be990 con 0x7f2dc0018810 2024-09-18T01:45:46.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.518+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(58 notify.7 [create] v33'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2db8051070 con 0x7f2dc0018810 2024-09-18T01:45:46.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.518+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94663147771056] v33'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2db8051070 con 0x7f2dc0018810 2024-09-18T01:45:46.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.518+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94663147775104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4bee00 con 0x7f2dc0018810 2024-09-18T01:45:46.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.518+0000 7f2dd3f3e800 20 add_watcher() i=0 2024-09-18T01:45:46.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.518+0000 7f2dd3f3e800 20 add_watcher() i=1 2024-09-18T01:45:46.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.518+0000 7f2dd3f3e800 20 add_watcher() i=2 2024-09-18T01:45:46.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.518+0000 7f2dd3f3e800 20 add_watcher() i=3 2024-09-18T01:45:46.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.518+0000 7f2dd3f3e800 20 add_watcher() i=4 2024-09-18T01:45:46.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.518+0000 7f2dd3f3e800 20 add_watcher() i=5 2024-09-18T01:45:46.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.518+0000 7f2dd3f3e800 20 add_watcher() i=6 2024-09-18T01:45:46.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.519+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94663147775104] v33'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2db8051070 con 0x7f2dc0018810 2024-09-18T01:45:46.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.519+0000 7f2dd3f3e800 20 add_watcher() i=7 2024-09-18T01:45:46.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.519+0000 7f2dd3f3e800 2 all 8 watchers are set, enabling cache 2024-09-18T01:45:46.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.519+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56187b4bee00 con 0x56187b4addb0 2024-09-18T01:45:46.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.519+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2db8051070 con 0x56187b4addb0 2024-09-18T01:45:46.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.519+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94663147776336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4beda0 con 0x56187b4addb0 2024-09-18T01:45:46.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.520+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94663147776336] v33'197 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2db8051070 con 0x56187b4addb0 2024-09-18T01:45:46.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.520+0000 7f2c85fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:46.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.520+0000 7f2dd3f3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:45:46.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.520+0000 7f2dd3f3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:45:46.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.520+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4ca790 con 0x56187b4addb0 2024-09-18T01:45:46.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.522+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'56 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2db8051070 con 0x56187b4addb0 2024-09-18T01:45:46.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.522+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4cae60 con 0x7f2dc0018810 2024-09-18T01:45:46.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.523+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2db8051070 con 0x7f2dc0018810 2024-09-18T01:45:46.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.523+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4cb2e0 con 0x56187b4b4020 2024-09-18T01:45:46.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.524+0000 7f2dd0435640 1 -- 172.21.15.146:0/435629532 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2dc803c030 con 0x56187b4b4020 2024-09-18T01:45:46.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.524+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4cb2d0 con 0x56187b4addb0 2024-09-18T01:45:46.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.525+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'198 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2db8051070 con 0x56187b4addb0 2024-09-18T01:45:46.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.525+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4cb840 con 0x7f2dc803f060 2024-09-18T01:45:46.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.526+0000 7f2dcfc34640 1 -- 172.21.15.146:0/435629532 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'71 uv57 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2dc002d070 con 0x7f2dc803f060 2024-09-18T01:45:46.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.526+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4cbdb0 con 0x56187b4b4020 2024-09-18T01:45:46.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.527+0000 7f2dd0435640 1 -- 172.21.15.146:0/435629532 <== osd.3 v2:172.21.15.146:6809/4106661138 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'59 uv50 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2dc803c030 con 0x56187b4b4020 2024-09-18T01:45:46.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.527+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4cbdb0 con 0x56187b4addb0 2024-09-18T01:45:46.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.528+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2db8051070 con 0x56187b4addb0 2024-09-18T01:45:46.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.528+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4cc170 con 0x7f2dc0018810 2024-09-18T01:45:46.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.529+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'49 uv40 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2db8051070 con 0x7f2dc0018810 2024-09-18T01:45:46.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.529+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4cc170 con 0x7f2dc803f060 2024-09-18T01:45:46.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.530+0000 7f2dcfc34640 1 -- 172.21.15.146:0/435629532 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2dc002d070 con 0x7f2dc803f060 2024-09-18T01:45:46.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.530+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4cc170 con 0x56187b4b4020 2024-09-18T01:45:46.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.531+0000 7f2dd0435640 1 -- 172.21.15.146:0/435629532 <== osd.3 v2:172.21.15.146:6809/4106661138 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2dc803c030 con 0x56187b4b4020 2024-09-18T01:45:46.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.531+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4cc170 con 0x7f2dc803f060 2024-09-18T01:45:46.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.532+0000 7f2dcfc34640 1 -- 172.21.15.146:0/435629532 <== osd.2 v2:172.21.15.146:6800/3820039304 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'72 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2dc002d070 con 0x7f2dc803f060 2024-09-18T01:45:46.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.532+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4cc170 con 0x7f2dc0018810 2024-09-18T01:45:46.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.533+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2db8051070 con 0x7f2dc0018810 2024-09-18T01:45:46.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.533+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4cc170 con 0x7f2dc803f060 2024-09-18T01:45:46.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.534+0000 7f2dcfc34640 1 -- 172.21.15.146:0/435629532 <== osd.2 v2:172.21.15.146:6800/3820039304 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2dc002d070 con 0x7f2dc803f060 2024-09-18T01:45:46.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.534+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4cc170 con 0x7f2dc0018810 2024-09-18T01:45:46.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.535+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'61 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2db8051070 con 0x7f2dc0018810 2024-09-18T01:45:46.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.535+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4cc170 con 0x56187b4addb0 2024-09-18T01:45:46.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.536+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'199 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2db8051070 con 0x56187b4addb0 2024-09-18T01:45:46.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.536+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4cc170 con 0x56187b4b4020 2024-09-18T01:45:46.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.538+0000 7f2dd0435640 1 -- 172.21.15.146:0/435629532 <== osd.3 v2:172.21.15.146:6809/4106661138 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'66 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2dc803c030 con 0x56187b4b4020 2024-09-18T01:45:46.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.538+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4cc170 con 0x7f2dc803f060 2024-09-18T01:45:46.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.539+0000 7f2dcfc34640 1 -- 172.21.15.146:0/435629532 <== osd.2 v2:172.21.15.146:6800/3820039304 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'73 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2dc002d070 con 0x7f2dc803f060 2024-09-18T01:45:46.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.539+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4cc170 con 0x56187b4b4020 2024-09-18T01:45:46.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.540+0000 7f2dd0435640 1 -- 172.21.15.146:0/435629532 <== osd.3 v2:172.21.15.146:6809/4106661138 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'38 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2dc803c030 con 0x56187b4b4020 2024-09-18T01:45:46.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.540+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4cc170 con 0x56187b4addb0 2024-09-18T01:45:46.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.541+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2db8051070 con 0x56187b4addb0 2024-09-18T01:45:46.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.541+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4cc170 con 0x56187b4addb0 2024-09-18T01:45:46.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.542+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'200 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2db8051070 con 0x56187b4addb0 2024-09-18T01:45:46.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.542+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4cc170 con 0x56187b4b4020 2024-09-18T01:45:46.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.543+0000 7f2dd0435640 1 -- 172.21.15.146:0/435629532 <== osd.3 v2:172.21.15.146:6809/4106661138 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'67 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2dc803c030 con 0x56187b4b4020 2024-09-18T01:45:46.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.543+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4cc170 con 0x7f2dc803f060 2024-09-18T01:45:46.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.544+0000 7f2dcfc34640 1 -- 172.21.15.146:0/435629532 <== osd.2 v2:172.21.15.146:6800/3820039304 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'41 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2dc002d070 con 0x7f2dc803f060 2024-09-18T01:45:46.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.544+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4cc170 con 0x56187b4b4020 2024-09-18T01:45:46.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.545+0000 7f2dd0435640 1 -- 172.21.15.146:0/435629532 <== osd.3 v2:172.21.15.146:6809/4106661138 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2dc803c030 con 0x56187b4b4020 2024-09-18T01:45:46.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.545+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4cc170 con 0x56187b4b4020 2024-09-18T01:45:46.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.546+0000 7f2dd0435640 1 -- 172.21.15.146:0/435629532 <== osd.3 v2:172.21.15.146:6809/4106661138 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'43 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2dc803c030 con 0x56187b4b4020 2024-09-18T01:45:46.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.546+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4cc170 con 0x56187b4b4020 2024-09-18T01:45:46.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.547+0000 7f2dd0435640 1 -- 172.21.15.146:0/435629532 <== osd.3 v2:172.21.15.146:6809/4106661138 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2dc803c030 con 0x56187b4b4020 2024-09-18T01:45:46.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.547+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4cc170 con 0x56187b4b4020 2024-09-18T01:45:46.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.548+0000 7f2dd0435640 1 -- 172.21.15.146:0/435629532 <== osd.3 v2:172.21.15.146:6809/4106661138 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'60 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2dc803c030 con 0x56187b4b4020 2024-09-18T01:45:46.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.548+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4cc170 con 0x7f2dc0018810 2024-09-18T01:45:46.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.549+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'34 uv30 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2db8051070 con 0x7f2dc0018810 2024-09-18T01:45:46.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.549+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4cc170 con 0x56187b4b4020 2024-09-18T01:45:46.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.550+0000 7f2dd0435640 1 -- 172.21.15.146:0/435629532 <== osd.3 v2:172.21.15.146:6809/4106661138 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'37 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2dc803c030 con 0x56187b4b4020 2024-09-18T01:45:46.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.550+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4cc170 con 0x7f2dc0018810 2024-09-18T01:45:46.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.551+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.0 v2:172.21.15.129:6800/1759265424 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'50 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2db8051070 con 0x7f2dc0018810 2024-09-18T01:45:46.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.551+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4cc170 con 0x56187b4b4020 2024-09-18T01:45:46.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.552+0000 7f2dd0435640 1 -- 172.21.15.146:0/435629532 <== osd.3 v2:172.21.15.146:6809/4106661138 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'68 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2dc803c030 con 0x56187b4b4020 2024-09-18T01:45:46.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.552+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4cc170 con 0x7f2dc0018810 2024-09-18T01:45:46.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.553+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.0 v2:172.21.15.129:6800/1759265424 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'62 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2db8051070 con 0x7f2dc0018810 2024-09-18T01:45:46.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.553+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4cc170 con 0x7f2dc803f060 2024-09-18T01:45:46.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.554+0000 7f2dcfc34640 1 -- 172.21.15.146:0/435629532 <== osd.2 v2:172.21.15.146:6800/3820039304 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2dc002d070 con 0x7f2dc803f060 2024-09-18T01:45:46.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.554+0000 7f2c84fe1640 20 reqs_thread_entry: start 2024-09-18T01:45:46.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.554+0000 7f2dd3f3e800 20 init_complete bucket index max shards: 11 2024-09-18T01:45:46.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.554+0000 7f2dd3f3e800 20 Filter name: none 2024-09-18T01:45:46.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.554+0000 7f2bfe7fc640 20 reqs_thread_entry: start 2024-09-18T01:45:46.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.555+0000 7f2dd3f3e800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T01:45:46.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.555+0000 7f2dd3f3e800 20 rados->read ofs=0 len=0 2024-09-18T01:45:46.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.555+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56187b4f72a0 con 0x56187b4addb0 2024-09-18T01:45:46.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.555+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.1 v2:172.21.15.146:6808/3930274777 28 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f2db8051070 con 0x56187b4addb0 2024-09-18T01:45:46.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.555+0000 7f2dd3f3e800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:45:46.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.555+0000 7f2dd3f3e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T01:45:46.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.555+0000 7f2dd3f3e800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:45:46.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.555+0000 7f2dd3f3e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:45:46.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.555+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56187b4f9640 con 0x7f2dc803f060 2024-09-18T01:45:46.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.555+0000 7f2dcfc34640 1 -- 172.21.15.146:0/435629532 <== osd.2 v2:172.21.15.146:6800/3820039304 19 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv41 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f2dc002d070 con 0x7f2dc803f060 2024-09-18T01:45:46.558 INFO:teuthology.orchestra.run.smithi146.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-18T01:45:46.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.556+0000 7f2c85fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:45:46.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.556+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94663147776336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4c74b0 con 0x56187b4addb0 2024-09-18T01:45:46.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.557+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.1 v2:172.21.15.146:6808/3930274777 29 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94663147776336] v33'201 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2db8051070 con 0x56187b4addb0 2024-09-18T01:45:46.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.557+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94663147751792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4be950 con 0x7f2dc803f060 2024-09-18T01:45:46.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.558+0000 7f2dcfc34640 1 -- 172.21.15.146:0/435629532 <== osd.2 v2:172.21.15.146:6800/3820039304 20 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94663147751792] v33'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dc002d070 con 0x7f2dc803f060 2024-09-18T01:45:46.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.558+0000 7f2dd3f3e800 20 remove_watcher() i=0 2024-09-18T01:45:46.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.558+0000 7f2dd3f3e800 2 removed watcher, disabling cache 2024-09-18T01:45:46.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.558+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94663147758064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4b8970 con 0x56187b4addb0 2024-09-18T01:45:46.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.559+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.1 v2:172.21.15.146:6808/3930274777 30 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94663147758064] v33'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2db8051070 con 0x56187b4addb0 2024-09-18T01:45:46.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.559+0000 7f2dd3f3e800 20 remove_watcher() i=1 2024-09-18T01:45:46.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.559+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94663147762320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4b8970 con 0x56187b4b4020 2024-09-18T01:45:46.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.560+0000 7f2dd0435640 1 -- 172.21.15.146:0/435629532 <== osd.3 v2:172.21.15.146:6809/4106661138 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94663147762320] v33'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dc803c030 con 0x56187b4b4020 2024-09-18T01:45:46.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.560+0000 7f2dd3f3e800 20 remove_watcher() i=2 2024-09-18T01:45:46.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.560+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94663147765072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4b8970 con 0x7f2dc803f060 2024-09-18T01:45:46.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.561+0000 7f2dcfc34640 1 -- 172.21.15.146:0/435629532 <== osd.2 v2:172.21.15.146:6800/3820039304 21 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94663147765072] v33'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dc002d070 con 0x7f2dc803f060 2024-09-18T01:45:46.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.561+0000 7f2dd3f3e800 20 remove_watcher() i=3 2024-09-18T01:45:46.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.561+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94663147759344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4bbd50 con 0x56187b4addb0 2024-09-18T01:45:46.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.562+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.1 v2:172.21.15.146:6808/3930274777 31 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94663147759344] v33'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2db8051070 con 0x56187b4addb0 2024-09-18T01:45:46.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.562+0000 7f2dd3f3e800 20 remove_watcher() i=4 2024-09-18T01:45:46.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.562+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94663147770000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4b8970 con 0x7f2dc0018810 2024-09-18T01:45:46.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.563+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.0 v2:172.21.15.129:6800/1759265424 24 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94663147770000] v33'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2db8051070 con 0x7f2dc0018810 2024-09-18T01:45:46.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.564+0000 7f2dd3f3e800 20 remove_watcher() i=5 2024-09-18T01:45:46.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.564+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94663147771056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4bbd50 con 0x7f2dc0018810 2024-09-18T01:45:46.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.564+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.0 v2:172.21.15.129:6800/1759265424 25 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94663147771056] v33'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2db8051070 con 0x7f2dc0018810 2024-09-18T01:45:46.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.564+0000 7f2dd3f3e800 20 remove_watcher() i=6 2024-09-18T01:45:46.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.564+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94663147775104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56187b4b8970 con 0x7f2dc0018810 2024-09-18T01:45:46.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.565+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 <== osd.0 v2:172.21.15.129:6800/1759265424 26 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94663147775104] v33'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2db8051070 con 0x7f2dc0018810 2024-09-18T01:45:46.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.565+0000 7f2dd3f3e800 20 remove_watcher() i=7 2024-09-18T01:45:46.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.565+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f2dc0018810 msgr2=0x7f2dc003f1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.565+0000 7f2dd3f3e800 1 --2- 172.21.15.146:0/435629532 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f2dc0018810 0x7f2dc003f1e0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.566+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56187b4addb0 msgr2=0x56187b4b0270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.566+0000 7f2dd3f3e800 1 --2- 172.21.15.146:0/435629532 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56187b4addb0 0x56187b4b0270 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.566+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f2dc803f060 msgr2=0x7f2dc8022a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.566+0000 7f2dd3f3e800 1 --2- 172.21.15.146:0/435629532 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f2dc803f060 0x7f2dc8022a90 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.566+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x56187b4b4020 msgr2=0x56187b4b6410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.566+0000 7f2dd3f3e800 1 --2- 172.21.15.146:0/435629532 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x56187b4b4020 0x56187b4b6410 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.566+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2c98036b40 msgr2=0x7f2c98039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.566+0000 7f2dd3f3e800 1 --2- 172.21.15.146:0/435629532 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2c98036b40 0x7f2c98039000 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2dc000bc50 tx=0x7f2dc0033000 comp rx=0 tx=0).stop 2024-09-18T01:45:46.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.566+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56187b49ace0 msgr2=0x56187b4a2150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.566+0000 7f2dd3f3e800 1 --2- 172.21.15.146:0/435629532 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56187b49ace0 0x56187b4a2150 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f2dc80127e0 tx=0x7f2dc804c820 comp rx=0 tx=0).stop 2024-09-18T01:45:46.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.566+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 reap_dead start 2024-09-18T01:45:46.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.566+0000 7f2dc7433640 1 -- 172.21.15.146:0/435629532 reap_dead start 2024-09-18T01:45:46.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.566+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 shutdown_connections 2024-09-18T01:45:46.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.566+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 >> 172.21.15.146:0/435629532 conn(0x56187b497040 msgr2=0x56187b495110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:46.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.566+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 shutdown_connections 2024-09-18T01:45:46.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.566+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/435629532 wait complete. 2024-09-18T01:45:46.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.566+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/2315399816 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2ca8036b90 msgr2=0x7f2ca8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.566+0000 7f2dd3f3e800 1 --2- 172.21.15.146:0/2315399816 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2ca8036b90 0x7f2ca8039050 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0001630 tx=0x7f2dc004b640 comp rx=0 tx=0).stop 2024-09-18T01:45:46.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.566+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/2315399816 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56187b48e060 msgr2=0x56187b48e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.566+0000 7f2dd3f3e800 1 --2- 172.21.15.146:0/2315399816 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56187b48e060 0x56187b48e480 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x56187b47acb0 tx=0x7f2dc80178e0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.566+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/2315399816 shutdown_connections 2024-09-18T01:45:46.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.566+0000 7f2dd3f3e800 1 --2- 172.21.15.146:0/2315399816 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2ca8036b90 0x7f2ca8039050 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.566+0000 7f2dd3f3e800 1 --2- 172.21.15.146:0/2315399816 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56187b48e060 0x56187b48e480 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.566+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/2315399816 >> 172.21.15.146:0/2315399816 conn(0x56187b482ff0 msgr2=0x56187b485b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:46.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.566+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/2315399816 shutdown_connections 2024-09-18T01:45:46.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.566+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/2315399816 wait complete. 2024-09-18T01:45:46.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.566+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/2275734454 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56187b37e8f0 msgr2=0x56187b47a350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.567+0000 7f2dd3f3e800 1 --2- 172.21.15.146:0/2275734454 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56187b37e8f0 0x56187b47a350 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.567+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/2275734454 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x56187b47c300 msgr2=0x56187b47fb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.567+0000 7f2dd3f3e800 1 --2- 172.21.15.146:0/2275734454 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x56187b47c300 0x56187b47fb40 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.567+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/2275734454 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2cb8036b90 msgr2=0x7f2cb8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.567+0000 7f2dd3f3e800 1 --2- 172.21.15.146:0/2275734454 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2cb8036b90 0x7f2cb8039050 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2db8057000 tx=0x7f2db8052000 comp rx=0 tx=0).stop 2024-09-18T01:45:46.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.567+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/2275734454 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56187b2ee6b0 msgr2=0x56187b4732e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:45:46.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.567+0000 7f2dd3f3e800 1 --2- 172.21.15.146:0/2275734454 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56187b2ee6b0 0x56187b4732e0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x56187b37a200 tx=0x7f2dc0000ed0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.567+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/2275734454 shutdown_connections 2024-09-18T01:45:46.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.567+0000 7f2dd3f3e800 1 --2- 172.21.15.146:0/2275734454 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x56187b47c300 0x56187b47fb40 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.567+0000 7f2dd3f3e800 1 --2- 172.21.15.146:0/2275734454 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56187b37e8f0 0x56187b47a350 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.567+0000 7f2dd3f3e800 1 --2- 172.21.15.146:0/2275734454 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2cb8036b90 0x7f2cb8039050 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.567+0000 7f2dd3f3e800 1 --2- 172.21.15.146:0/2275734454 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56187b2ee6b0 0x56187b4732e0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:45:46.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.567+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/2275734454 >> 172.21.15.146:0/2275734454 conn(0x56187b374de0 msgr2=0x56187b464be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:45:46.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.567+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/2275734454 shutdown_connections 2024-09-18T01:45:46.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:45:46.567+0000 7f2dd3f3e800 1 -- 172.21.15.146:0/2275734454 wait complete. 2024-09-18T01:45:46.576 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-18T01:45:46.591 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-18T01:45:46.595 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-18T01:46:21.597 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--categories', 'delete_obj'] 2024-09-18T01:46:21.597 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--categories', 'delete_obj'] 2024-09-18T01:46:21.598 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --categories delete_obj 2024-09-18T01:46:21.650 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:46:21.650 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:46:21.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.650+0000 7efe3dc30800 1 Processor -- start 2024-09-18T01:46:21.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.650+0000 7efe3dc30800 1 -- start start 2024-09-18T01:46:21.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.651+0000 7efe3dc30800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x564ad287a8e0 0x564ad287ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:21.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.651+0000 7efe3dc30800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564ad2735b30 con 0x564ad27e9e10 2024-09-18T01:46:21.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.651+0000 7efe3dc30800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x564ad2717360 con 0x564ad287a8e0 2024-09-18T01:46:21.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.651+0000 7efe33fff640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x564ad287a8e0 0x564ad287ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:21.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.651+0000 7efe38fd6640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x564ad27e9e10 0x564ad28791c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:49858/0 (socket says 172.21.15.146:49858) 2024-09-18T01:46:21.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.651+0000 7efe38fd6640 1 -- 172.21.15.146:0/2281908160 learned_addr learned my addr 172.21.15.146:0/2281908160 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:46:21.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.651+0000 7efe33fff640 1 -- 172.21.15.146:0/2281908160 >> v1:172.21.15.129:6789/0 conn(0x564ad27e9e10 legacy=0x564ad28791c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:21.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.651+0000 7efe337fe640 1 -- 172.21.15.146:0/2281908160 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1926448199 0 0) 0x564ad2735b30 con 0x564ad27e9e10 2024-09-18T01:46:21.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.651+0000 7efe33fff640 1 -- 172.21.15.146:0/2281908160 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ad273de00 con 0x564ad287a8e0 2024-09-18T01:46:21.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.653+0000 7efe33fff640 1 --2- 172.21.15.146:0/2281908160 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ad287a8e0 0x564ad287ccd0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7efe2400a470 tx=0x7efe24045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7646a3a7562bc67c server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:21.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.654+0000 7efe337fe640 1 -- 172.21.15.146:0/2281908160 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe24053570 con 0x564ad287a8e0 2024-09-18T01:46:21.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.654+0000 7efe337fe640 1 -- 172.21.15.146:0/2281908160 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe24058070 con 0x564ad287a8e0 2024-09-18T01:46:21.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.654+0000 7efe337fe640 1 -- 172.21.15.146:0/2281908160 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe24053880 con 0x564ad287a8e0 2024-09-18T01:46:21.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.654+0000 7efe3dc30800 1 -- 172.21.15.146:0/2281908160 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ad287a8e0 msgr2=0x564ad287ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:21.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.654+0000 7efe3dc30800 1 --2- 172.21.15.146:0/2281908160 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ad287a8e0 0x564ad287ccd0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7efe2400a470 tx=0x7efe24045a20 comp rx=0 tx=0).stop 2024-09-18T01:46:21.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.654+0000 7efe3dc30800 1 -- 172.21.15.146:0/2281908160 shutdown_connections 2024-09-18T01:46:21.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.654+0000 7efe3dc30800 1 --2- 172.21.15.146:0/2281908160 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ad287a8e0 0x564ad287ccd0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:21.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.654+0000 7efe3dc30800 1 -- 172.21.15.146:0/2281908160 >> 172.21.15.146:0/2281908160 conn(0x564ad2870df0 msgr2=0x564ad2873210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:21.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.654+0000 7efe3dc30800 1 -- 172.21.15.146:0/2281908160 shutdown_connections 2024-09-18T01:46:21.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.654+0000 7efe3dc30800 1 -- 172.21.15.146:0/2281908160 wait complete. 2024-09-18T01:46:21.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.670+0000 7efe3dc30800 1 Processor -- start 2024-09-18T01:46:21.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.670+0000 7efe3dc30800 1 -- start start 2024-09-18T01:46:21.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.670+0000 7efe3dc30800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ad27e9e10 0x564ad2965640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:21.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.670+0000 7efe3dc30800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x564ad27c2330 con 0x564ad27e9e10 2024-09-18T01:46:21.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.670+0000 7efe38fd6640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ad27e9e10 0x564ad2965640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:21.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.671+0000 7efe38fd6640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ad27e9e10 0x564ad2965640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:43696/0 (socket says 172.21.15.146:43696) 2024-09-18T01:46:21.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.671+0000 7efe38fd6640 1 -- 172.21.15.146:0/944844847 learned_addr learned my addr 172.21.15.146:0/944844847 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:21.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.671+0000 7efe38fd6640 1 -- 172.21.15.146:0/944844847 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ad270fbc0 con 0x564ad27e9e10 2024-09-18T01:46:21.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.671+0000 7efe38fd6640 1 --2- 172.21.15.146:0/944844847 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ad27e9e10 0x564ad2965640 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7efe2c00b240 tx=0x7efe2c00b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=190bdc32cf1c1b16 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:21.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.671+0000 7efd26e05640 1 -- 172.21.15.146:0/944844847 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe2c008070 con 0x564ad27e9e10 2024-09-18T01:46:21.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.671+0000 7efd26e05640 1 -- 172.21.15.146:0/944844847 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe2c00d500 con 0x564ad27e9e10 2024-09-18T01:46:21.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.671+0000 7efd26e05640 1 -- 172.21.15.146:0/944844847 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe2c00d860 con 0x564ad27e9e10 2024-09-18T01:46:21.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.672+0000 7efe3dc30800 1 -- 172.21.15.146:0/944844847 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ad27e9e10 msgr2=0x564ad2965640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:21.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.672+0000 7efe3dc30800 1 --2- 172.21.15.146:0/944844847 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ad27e9e10 0x564ad2965640 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7efe2c00b240 tx=0x7efe2c00b700 comp rx=0 tx=0).stop 2024-09-18T01:46:21.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.672+0000 7efe3dc30800 1 -- 172.21.15.146:0/944844847 shutdown_connections 2024-09-18T01:46:21.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.672+0000 7efe3dc30800 1 --2- 172.21.15.146:0/944844847 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ad27e9e10 0x564ad2965640 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:21.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.672+0000 7efe3dc30800 1 -- 172.21.15.146:0/944844847 >> 172.21.15.146:0/944844847 conn(0x564ad2870df0 msgr2=0x564ad2961000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:21.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.672+0000 7efe3dc30800 1 -- 172.21.15.146:0/944844847 shutdown_connections 2024-09-18T01:46:21.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.672+0000 7efe3dc30800 1 -- 172.21.15.146:0/944844847 wait complete. 2024-09-18T01:46:21.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.672+0000 7efe3dc30800 1 Processor -- start 2024-09-18T01:46:21.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.672+0000 7efe3dc30800 1 -- start start 2024-09-18T01:46:21.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.673+0000 7efe3dc30800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ad27e9e10 0x564ad2876af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:21.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.673+0000 7efe3dc30800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x564ad287d600 con 0x564ad27e9e10 2024-09-18T01:46:21.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.673+0000 7efe38fd6640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ad27e9e10 0x564ad2876af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:21.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.673+0000 7efe38fd6640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ad27e9e10 0x564ad2876af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:43706/0 (socket says 172.21.15.146:43706) 2024-09-18T01:46:21.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.673+0000 7efe38fd6640 1 -- 172.21.15.146:0/1664162195 learned_addr learned my addr 172.21.15.146:0/1664162195 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:21.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.673+0000 7efe38fd6640 1 -- 172.21.15.146:0/1664162195 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ad2723fe0 con 0x564ad27e9e10 2024-09-18T01:46:21.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.673+0000 7efe38fd6640 1 --2- 172.21.15.146:0/1664162195 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ad27e9e10 0x564ad2876af0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x564ad29664a0 tx=0x7efe2c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:21.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.673+0000 7efd25602640 1 -- 172.21.15.146:0/1664162195 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe2c019870 con 0x564ad27e9e10 2024-09-18T01:46:21.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.673+0000 7efd25602640 1 -- 172.21.15.146:0/1664162195 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe2c019a10 con 0x564ad27e9e10 2024-09-18T01:46:21.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.673+0000 7efe3dc30800 1 -- 172.21.15.146:0/1664162195 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564ad28751e0 con 0x564ad27e9e10 2024-09-18T01:46:21.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.673+0000 7efd25602640 1 -- 172.21.15.146:0/1664162195 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe2c019d30 con 0x564ad27e9e10 2024-09-18T01:46:21.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.674+0000 7efe3dc30800 1 -- 172.21.15.146:0/1664162195 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ad2875700 con 0x564ad27e9e10 2024-09-18T01:46:21.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.674+0000 7efd25602640 1 -- 172.21.15.146:0/1664162195 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7efe2c017040 con 0x564ad27e9e10 2024-09-18T01:46:21.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.675+0000 7efd25602640 1 --2- 172.21.15.146:0/1664162195 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7efd20036b40 0x7efd20039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:21.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.675+0000 7efd25602640 1 -- 172.21.15.146:0/1664162195 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7efe2c015020 con 0x564ad27e9e10 2024-09-18T01:46:21.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.675+0000 7efe33fff640 1 --2- 172.21.15.146:0/1664162195 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7efd20036b40 0x7efd20039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:21.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.675+0000 7efe3dc30800 1 --2- 172.21.15.146:0/1664162195 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564ad287a8e0 0x564ad29764b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:21.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.675+0000 7efe3dc30800 1 -- 172.21.15.146:0/1664162195 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564ad29769f0 con 0x564ad287a8e0 2024-09-18T01:46:21.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.675+0000 7efe397d7640 1 --2- 172.21.15.146:0/1664162195 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564ad287a8e0 0x564ad29764b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:21.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.675+0000 7efe33fff640 1 --2- 172.21.15.146:0/1664162195 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7efd20036b40 0x7efd20039000 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7efe24057000 tx=0x7efe24052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:21.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.675+0000 7efe397d7640 1 --2- 172.21.15.146:0/1664162195 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564ad287a8e0 0x564ad29764b0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:21.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.676+0000 7efe397d7640 1 -- 172.21.15.146:0/1664162195 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efe3400a4a0 con 0x564ad287a8e0 2024-09-18T01:46:21.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.676+0000 7efe3dc30800 1 -- 172.21.15.146:0/1664162195 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564ad2977240 con 0x564ad287a8e0 2024-09-18T01:46:21.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.676+0000 7efe397d7640 1 -- 172.21.15.146:0/1664162195 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efe3400a4a0 con 0x564ad287a8e0 2024-09-18T01:46:21.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.676+0000 7efe3dc30800 1 -- 172.21.15.146:0/1664162195 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564ad29785f0 con 0x564ad287a8e0 2024-09-18T01:46:21.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.676+0000 7efe397d7640 1 -- 172.21.15.146:0/1664162195 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7efe3400a4a0 con 0x564ad287a8e0 2024-09-18T01:46:21.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.676+0000 7efe3dc30800 1 -- 172.21.15.146:0/1664162195 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564ad2977a90 con 0x564ad287a8e0 2024-09-18T01:46:21.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.676+0000 7efe397d7640 1 -- 172.21.15.146:0/1664162195 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efe3400a4a0 con 0x564ad287a8e0 2024-09-18T01:46:21.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.676+0000 7efe3dc30800 1 --2- 172.21.15.146:0/1664162195 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x564ad29799a0 0x564ad297bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:21.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.676+0000 7efe3dc30800 1 -- 172.21.15.146:0/1664162195 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564ad297c3e0 con 0x564ad29799a0 2024-09-18T01:46:21.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.677+0000 7efe38fd6640 1 --2- 172.21.15.146:0/1664162195 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x564ad29799a0 0x564ad297bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:21.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.677+0000 7efe38fd6640 1 --2- 172.21.15.146:0/1664162195 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x564ad29799a0 0x564ad297bd90 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:21.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.677+0000 7efe38fd6640 1 -- 172.21.15.146:0/1664162195 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7efe2c02d070 con 0x564ad29799a0 2024-09-18T01:46:21.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.678+0000 7efe3dc30800 1 Processor -- start 2024-09-18T01:46:21.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.678+0000 7efe3dc30800 1 -- start start 2024-09-18T01:46:21.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.678+0000 7efe3dc30800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ad298a170 0x564ad298a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:21.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.678+0000 7efe3dc30800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x564ad2877030 con 0x564ad298a170 2024-09-18T01:46:21.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.678+0000 7efe397d7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ad298a170 0x564ad298a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:21.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.678+0000 7efe397d7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ad298a170 0x564ad298a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:43710/0 (socket says 172.21.15.146:43710) 2024-09-18T01:46:21.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.678+0000 7efe397d7640 1 -- 172.21.15.146:0/2681200899 learned_addr learned my addr 172.21.15.146:0/2681200899 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:21.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.679+0000 7efe397d7640 1 -- 172.21.15.146:0/2681200899 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ad298aad0 con 0x564ad298a170 2024-09-18T01:46:21.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.679+0000 7efe397d7640 1 --2- 172.21.15.146:0/2681200899 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ad298a170 0x564ad298a590 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x564ad2876100 tx=0x7efe340178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:21.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.679+0000 7efd1e7fc640 1 -- 172.21.15.146:0/2681200899 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe34013440 con 0x564ad298a170 2024-09-18T01:46:21.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.679+0000 7efd1e7fc640 1 -- 172.21.15.146:0/2681200899 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe340135e0 con 0x564ad298a170 2024-09-18T01:46:21.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.679+0000 7efe3dc30800 1 -- 172.21.15.146:0/2681200899 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564ad298ad60 con 0x564ad298a170 2024-09-18T01:46:21.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.679+0000 7efd1e7fc640 1 -- 172.21.15.146:0/2681200899 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe340138c0 con 0x564ad298a170 2024-09-18T01:46:21.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.679+0000 7efe3dc30800 1 -- 172.21.15.146:0/2681200899 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ad298da40 con 0x564ad298a170 2024-09-18T01:46:21.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.680+0000 7efd1e7fc640 1 -- 172.21.15.146:0/2681200899 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7efe34011040 con 0x564ad298a170 2024-09-18T01:46:21.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.680+0000 7efd1e7fc640 1 --2- 172.21.15.146:0/2681200899 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7efd10036b90 0x7efd10039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:21.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.680+0000 7efd1e7fc640 1 -- 172.21.15.146:0/2681200899 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7efe3401d070 con 0x564ad298a170 2024-09-18T01:46:21.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.680+0000 7efe38fd6640 1 --2- 172.21.15.146:0/2681200899 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7efd10036b90 0x7efd10039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:21.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.680+0000 7efe3dc30800 1 Processor -- start 2024-09-18T01:46:21.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.680+0000 7efe38fd6640 1 --2- 172.21.15.146:0/2681200899 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7efd10036b90 0x7efd10039050 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7efe2c04b7a0 tx=0x7efe2c01b540 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:21.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.681+0000 7efe3dc30800 1 -- start start 2024-09-18T01:46:21.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.681+0000 7efe3dc30800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ad2996df0 0x564ad29971f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:21.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.681+0000 7efe3dc30800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x564ad2711580 con 0x564ad2996df0 2024-09-18T01:46:21.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.681+0000 7efe397d7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ad2996df0 0x564ad29971f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:21.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.681+0000 7efe397d7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ad2996df0 0x564ad29971f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:43724/0 (socket says 172.21.15.146:43724) 2024-09-18T01:46:21.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.681+0000 7efe397d7640 1 -- 172.21.15.146:0/1293761243 learned_addr learned my addr 172.21.15.146:0/1293761243 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:21.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.681+0000 7efe397d7640 1 -- 172.21.15.146:0/1293761243 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ad29977c0 con 0x564ad2996df0 2024-09-18T01:46:21.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.681+0000 7efe397d7640 1 --2- 172.21.15.146:0/1293761243 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ad2996df0 0x564ad29971f0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7efe3404c860 tx=0x7efe3404cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a0e7cc3d2096d92 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:21.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.682+0000 7efd0ffff640 1 -- 172.21.15.146:0/1293761243 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe34012c90 con 0x564ad2996df0 2024-09-18T01:46:21.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.682+0000 7efd0ffff640 1 -- 172.21.15.146:0/1293761243 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe34012e30 con 0x564ad2996df0 2024-09-18T01:46:21.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.682+0000 7efd0ffff640 1 -- 172.21.15.146:0/1293761243 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe340124d0 con 0x564ad2996df0 2024-09-18T01:46:21.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.682+0000 7efe3dc30800 1 -- 172.21.15.146:0/1293761243 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ad2996df0 msgr2=0x564ad29971f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:21.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.682+0000 7efe3dc30800 1 --2- 172.21.15.146:0/1293761243 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ad2996df0 0x564ad29971f0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7efe3404c860 tx=0x7efe3404cb10 comp rx=0 tx=0).stop 2024-09-18T01:46:21.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.682+0000 7efe3dc30800 1 -- 172.21.15.146:0/1293761243 shutdown_connections 2024-09-18T01:46:21.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.682+0000 7efe3dc30800 1 --2- 172.21.15.146:0/1293761243 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ad2996df0 0x564ad29971f0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:21.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.682+0000 7efe3dc30800 1 -- 172.21.15.146:0/1293761243 >> 172.21.15.146:0/1293761243 conn(0x564ad2993100 msgr2=0x564ad2991250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:21.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.682+0000 7efe3dc30800 1 -- 172.21.15.146:0/1293761243 shutdown_connections 2024-09-18T01:46:21.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.682+0000 7efe3dc30800 1 -- 172.21.15.146:0/1293761243 wait complete. 2024-09-18T01:46:21.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.682+0000 7efe3dc30800 1 Processor -- start 2024-09-18T01:46:21.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.683+0000 7efe3dc30800 1 -- start start 2024-09-18T01:46:21.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.683+0000 7efe3dc30800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ad2996df0 0x564ad299e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:21.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.683+0000 7efe3dc30800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x564ad2997bf0 con 0x564ad2996df0 2024-09-18T01:46:21.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.683+0000 7efe397d7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ad2996df0 0x564ad299e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:21.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.683+0000 7efe397d7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ad2996df0 0x564ad299e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:43736/0 (socket says 172.21.15.146:43736) 2024-09-18T01:46:21.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.683+0000 7efe397d7640 1 -- 172.21.15.146:0/80729255 learned_addr learned my addr 172.21.15.146:0/80729255 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:21.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.683+0000 7efe397d7640 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ad299e640 con 0x564ad2996df0 2024-09-18T01:46:21.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.683+0000 7efe397d7640 1 --2- 172.21.15.146:0/80729255 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ad2996df0 0x564ad299e100 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7efe34015fd0 tx=0x7efe3404c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:21.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.684+0000 7efd0e7fc640 1 -- 172.21.15.146:0/80729255 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe34012c90 con 0x564ad2996df0 2024-09-18T01:46:21.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.684+0000 7efd0e7fc640 1 -- 172.21.15.146:0/80729255 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe34001520 con 0x564ad2996df0 2024-09-18T01:46:21.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.684+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564ad299e8d0 con 0x564ad2996df0 2024-09-18T01:46:21.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.684+0000 7efd0e7fc640 1 -- 172.21.15.146:0/80729255 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe34001c30 con 0x564ad2996df0 2024-09-18T01:46:21.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.684+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ad29a1580 con 0x564ad2996df0 2024-09-18T01:46:21.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.685+0000 7efd0e7fc640 1 -- 172.21.15.146:0/80729255 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7efe34013b90 con 0x564ad2996df0 2024-09-18T01:46:21.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.685+0000 7efd0e7fc640 1 --2- 172.21.15.146:0/80729255 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7efd04036b90 0x7efd04039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:21.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.685+0000 7efd0e7fc640 1 -- 172.21.15.146:0/80729255 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7efe3400e040 con 0x564ad2996df0 2024-09-18T01:46:21.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.685+0000 7efe38fd6640 1 --2- 172.21.15.146:0/80729255 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7efd04036b90 0x7efd04039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:21.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.685+0000 7efe3dc30800 20 rados->read ofs=0 len=0 2024-09-18T01:46:21.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.685+0000 7efe38fd6640 1 --2- 172.21.15.146:0/80729255 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7efd04036b90 0x7efd04039050 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7efe2c03ffd0 tx=0x7efe2c04d000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:21.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.685+0000 7efe3dc30800 1 --2- 172.21.15.146:0/80729255 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564ad29a9c90 0x564ad29ac150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:21.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.685+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564ad29ac8a0 con 0x564ad29a9c90 2024-09-18T01:46:21.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.685+0000 7efe33fff640 1 --2- 172.21.15.146:0/80729255 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564ad29a9c90 0x564ad29ac150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:21.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.686+0000 7efe33fff640 1 --2- 172.21.15.146:0/80729255 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564ad29a9c90 0x564ad29ac150 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:21.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.686+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efe24051070 con 0x564ad29a9c90 2024-09-18T01:46:21.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.686+0000 7efe3dc30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:21.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.686+0000 7efe3dc30800 20 realm 2024-09-18T01:46:21.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.686+0000 7efe3dc30800 20 rados->read ofs=0 len=0 2024-09-18T01:46:21.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.686+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564ad29accd0 con 0x564ad29a9c90 2024-09-18T01:46:21.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.686+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efe24051070 con 0x564ad29a9c90 2024-09-18T01:46:21.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.686+0000 7efe3dc30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:21.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.686+0000 7efe3dc30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:46:21.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.686+0000 7efe3dc30800 20 rados->read ofs=0 len=0 2024-09-18T01:46:21.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.686+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564ad29ad5a0 con 0x564ad29a9c90 2024-09-18T01:46:21.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.686+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efe24051070 con 0x564ad29a9c90 2024-09-18T01:46:21.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.686+0000 7efe3dc30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:21.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.686+0000 7efe3dc30800 20 rados->read ofs=0 len=0 2024-09-18T01:46:21.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.686+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564ad29ad940 con 0x564ad29a9c90 2024-09-18T01:46:21.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.687+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efe24051070 con 0x564ad29a9c90 2024-09-18T01:46:21.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.687+0000 7efe3dc30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:46:21.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.687+0000 7efe3dc30800 20 rados->read ofs=0 len=0 2024-09-18T01:46:21.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.687+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564ad29ad1b0 con 0x564ad29a9c90 2024-09-18T01:46:21.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.687+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7efe24051070 con 0x564ad29a9c90 2024-09-18T01:46:21.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.687+0000 7efe3dc30800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:46:21.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.687+0000 7efe3dc30800 20 searching for the correct realm 2024-09-18T01:46:21.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.687+0000 7efe3dc30800 1 --2- 172.21.15.146:0/80729255 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x564ad29afe00 0x564ad29b2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:21.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.687+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564ad29b28e0 con 0x564ad29afe00 2024-09-18T01:46:21.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.687+0000 7efe397d7640 1 --2- 172.21.15.146:0/80729255 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x564ad29afe00 0x564ad29b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:21.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.687+0000 7efe397d7640 1 --2- 172.21.15.146:0/80729255 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x564ad29afe00 0x564ad29b2210 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:21.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.688+0000 7efe397d7640 1 -- 172.21.15.146:0/80729255 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe34035070 con 0x564ad29afe00 2024-09-18T01:46:21.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.688+0000 7efe397d7640 1 --2- 172.21.15.146:0/80729255 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7efe34022420 0x7efe3402aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:21.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.688+0000 7efe397d7640 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564ad29b28e0 con 0x7efe34022420 2024-09-18T01:46:21.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.688+0000 7efe38fd6640 1 --2- 172.21.15.146:0/80729255 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7efe34022420 0x7efe3402aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:21.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.688+0000 7efe38fd6640 1 --2- 172.21.15.146:0/80729255 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7efe34022420 0x7efe3402aa60 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:21.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.688+0000 7efe38fd6640 1 -- 172.21.15.146:0/80729255 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe2c02d070 con 0x7efe34022420 2024-09-18T01:46:21.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.689+0000 7efe38fd6640 1 --2- 172.21.15.146:0/80729255 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7efe2c0187f0 0x7efe2c01c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:21.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.689+0000 7efe38fd6640 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564ad29b28e0 con 0x7efe2c0187f0 2024-09-18T01:46:21.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.689+0000 7efe33fff640 1 --2- 172.21.15.146:0/80729255 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7efe2c0187f0 0x7efe2c01c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:21.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.689+0000 7efe33fff640 1 --2- 172.21.15.146:0/80729255 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7efe2c0187f0 0x7efe2c01c610 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:21.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.689+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe24051070 con 0x7efe2c0187f0 2024-09-18T01:46:21.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.689+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564ad29b28e0 con 0x564ad29a9c90 2024-09-18T01:46:21.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.690+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7efe24051070 con 0x564ad29a9c90 2024-09-18T01:46:21.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.690+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564ad29b28e0 con 0x564ad29a9c90 2024-09-18T01:46:21.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.690+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe24051070 con 0x564ad29a9c90 2024-09-18T01:46:21.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.690+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564ad29b28e0 con 0x7efe2c0187f0 2024-09-18T01:46:21.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.690+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe24051070 con 0x7efe2c0187f0 2024-09-18T01:46:21.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.690+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564ad29b28e0 con 0x7efe2c0187f0 2024-09-18T01:46:21.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.691+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe24051070 con 0x7efe2c0187f0 2024-09-18T01:46:21.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.691+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564ad29b28e0 con 0x7efe34022420 2024-09-18T01:46:21.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.691+0000 7efe38fd6640 1 -- 172.21.15.146:0/80729255 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe2c02d070 con 0x7efe34022420 2024-09-18T01:46:21.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.691+0000 7efe38fd6640 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564ad29b28e0 con 0x564ad29afe00 2024-09-18T01:46:21.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.691+0000 7efe397d7640 1 -- 172.21.15.146:0/80729255 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe34035070 con 0x564ad29afe00 2024-09-18T01:46:21.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.691+0000 7efe397d7640 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564ad29b28e0 con 0x564ad29a9c90 2024-09-18T01:46:21.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.691+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe24051070 con 0x564ad29a9c90 2024-09-18T01:46:21.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.691+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564ad29b28e0 con 0x7efe2c0187f0 2024-09-18T01:46:21.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.692+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe24051070 con 0x7efe2c0187f0 2024-09-18T01:46:21.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.692+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564ad29b28e0 con 0x564ad29a9c90 2024-09-18T01:46:21.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.692+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe24051070 con 0x564ad29a9c90 2024-09-18T01:46:21.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.692+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564ad29b28e0 con 0x7efe34022420 2024-09-18T01:46:21.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.692+0000 7efe38fd6640 1 -- 172.21.15.146:0/80729255 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7efe2c02d070 con 0x7efe34022420 2024-09-18T01:46:21.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.692+0000 7efe38fd6640 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564ad29b28e0 con 0x564ad29afe00 2024-09-18T01:46:21.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.692+0000 7efe397d7640 1 -- 172.21.15.146:0/80729255 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe3405e040 con 0x564ad29afe00 2024-09-18T01:46:21.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.692+0000 7efe397d7640 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564ad29b28e0 con 0x564ad29afe00 2024-09-18T01:46:21.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.693+0000 7efe397d7640 1 -- 172.21.15.146:0/80729255 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe3405e040 con 0x564ad29afe00 2024-09-18T01:46:21.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.693+0000 7efe397d7640 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564ad29b28e0 con 0x7efe2c0187f0 2024-09-18T01:46:21.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.693+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe24051070 con 0x7efe2c0187f0 2024-09-18T01:46:21.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.693+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564ad29b28e0 con 0x564ad29afe00 2024-09-18T01:46:21.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.693+0000 7efe397d7640 1 -- 172.21.15.146:0/80729255 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe3405e040 con 0x564ad29afe00 2024-09-18T01:46:21.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.693+0000 7efe397d7640 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564ad29b28e0 con 0x564ad29afe00 2024-09-18T01:46:21.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.694+0000 7efe397d7640 1 -- 172.21.15.146:0/80729255 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe3405e040 con 0x564ad29afe00 2024-09-18T01:46:21.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.694+0000 7efe397d7640 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564ad29b28e0 con 0x564ad29a9c90 2024-09-18T01:46:21.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.694+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe24051070 con 0x564ad29a9c90 2024-09-18T01:46:21.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.694+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564ad29b28e0 con 0x564ad29a9c90 2024-09-18T01:46:21.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.694+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7efe24051070 con 0x564ad29a9c90 2024-09-18T01:46:21.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.694+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564ad29b28e0 con 0x7efe2c0187f0 2024-09-18T01:46:21.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.694+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe24051070 con 0x7efe2c0187f0 2024-09-18T01:46:21.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.694+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564ad29b28e0 con 0x564ad29afe00 2024-09-18T01:46:21.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.695+0000 7efe397d7640 1 -- 172.21.15.146:0/80729255 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe3405e040 con 0x564ad29afe00 2024-09-18T01:46:21.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.695+0000 7efe397d7640 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564ad29b28e0 con 0x7efe34022420 2024-09-18T01:46:21.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.695+0000 7efe38fd6640 1 -- 172.21.15.146:0/80729255 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe2c02d070 con 0x7efe34022420 2024-09-18T01:46:21.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.695+0000 7efe38fd6640 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564ad29b28e0 con 0x564ad29a9c90 2024-09-18T01:46:21.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.695+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe24051070 con 0x564ad29a9c90 2024-09-18T01:46:21.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.695+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564ad29b28e0 con 0x7efe2c0187f0 2024-09-18T01:46:21.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.696+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe24051070 con 0x7efe2c0187f0 2024-09-18T01:46:21.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.696+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564ad29b28e0 con 0x564ad29afe00 2024-09-18T01:46:21.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.696+0000 7efe397d7640 1 -- 172.21.15.146:0/80729255 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe3405e040 con 0x564ad29afe00 2024-09-18T01:46:21.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.696+0000 7efe397d7640 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564ad29b28e0 con 0x7efe2c0187f0 2024-09-18T01:46:21.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.696+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe24051070 con 0x7efe2c0187f0 2024-09-18T01:46:21.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.696+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564ad29b28e0 con 0x7efe34022420 2024-09-18T01:46:21.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.696+0000 7efe38fd6640 1 -- 172.21.15.146:0/80729255 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe2c02d070 con 0x7efe34022420 2024-09-18T01:46:21.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.696+0000 7efe38fd6640 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564ad29b28e0 con 0x564ad29afe00 2024-09-18T01:46:21.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.697+0000 7efe397d7640 1 -- 172.21.15.146:0/80729255 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe3405e040 con 0x564ad29afe00 2024-09-18T01:46:21.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.697+0000 7efe397d7640 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564ad29b28e0 con 0x7efe2c0187f0 2024-09-18T01:46:21.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.697+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe24051070 con 0x7efe2c0187f0 2024-09-18T01:46:21.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.697+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564ad29b28e0 con 0x564ad29a9c90 2024-09-18T01:46:21.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.697+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7efe24051070 con 0x564ad29a9c90 2024-09-18T01:46:21.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.697+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564ad29b28e0 con 0x7efe34022420 2024-09-18T01:46:21.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.697+0000 7efe38fd6640 1 -- 172.21.15.146:0/80729255 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe2c02d070 con 0x7efe34022420 2024-09-18T01:46:21.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.698+0000 7efe3dc30800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:46:21.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.698+0000 7efe3dc30800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:46:21.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.698+0000 7efe3dc30800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:46:21.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.698+0000 7efe3dc30800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:46:21.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.698+0000 7efe3dc30800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:46:21.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.698+0000 7efe3dc30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:46:21.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.698+0000 7efe3dc30800 20 rados->read ofs=0 len=0 2024-09-18T01:46:21.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.698+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564ad29ae850 con 0x564ad29a9c90 2024-09-18T01:46:21.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.698+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efe24051070 con 0x564ad29a9c90 2024-09-18T01:46:21.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.698+0000 7efe3dc30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:21.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.698+0000 7efe3dc30800 20 rados->read ofs=0 len=0 2024-09-18T01:46:21.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.698+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564ad29af0f0 con 0x564ad29a9c90 2024-09-18T01:46:21.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.698+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efe24051070 con 0x564ad29a9c90 2024-09-18T01:46:21.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.698+0000 7efe3dc30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:46:21.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.698+0000 7efe3dc30800 20 rados->read ofs=0 len=0 2024-09-18T01:46:21.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.698+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564ad29ae490 con 0x7efe34022420 2024-09-18T01:46:21.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.698+0000 7efe38fd6640 1 -- 172.21.15.146:0/80729255 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7efe2c02d070 con 0x7efe34022420 2024-09-18T01:46:21.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.698+0000 7efe3dc30800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:46:21.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.698+0000 7efe3dc30800 20 zone default found 2024-09-18T01:46:21.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.698+0000 7efe3dc30800 4 Realm: () 2024-09-18T01:46:21.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.698+0000 7efe3dc30800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:46:21.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.698+0000 7efe3dc30800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:46:21.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.698+0000 7efe3dc30800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:46:21.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.698+0000 7efe3dc30800 20 zonegroup default 2024-09-18T01:46:21.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.698+0000 7efe3dc30800 20 rados->read ofs=0 len=0 2024-09-18T01:46:21.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.698+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564ad29b3210 con 0x7efe2c0187f0 2024-09-18T01:46:21.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.699+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7efe24051070 con 0x7efe2c0187f0 2024-09-18T01:46:21.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.699+0000 7efe3dc30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:21.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.699+0000 7efe3dc30800 20 rados->read ofs=0 len=0 2024-09-18T01:46:21.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.699+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564ad29b4d70 con 0x564ad29afe00 2024-09-18T01:46:21.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.699+0000 7efe397d7640 1 -- 172.21.15.146:0/80729255 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efe3405e040 con 0x564ad29afe00 2024-09-18T01:46:21.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.699+0000 7efe3dc30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:21.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.699+0000 7efe3dc30800 20 rados->read ofs=0 len=0 2024-09-18T01:46:21.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.699+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564ad29b5270 con 0x564ad29afe00 2024-09-18T01:46:21.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.699+0000 7efe397d7640 1 -- 172.21.15.146:0/80729255 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efe3405e040 con 0x564ad29afe00 2024-09-18T01:46:21.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.699+0000 7efe3dc30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:21.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.699+0000 7efe3dc30800 20 started sync module instance, tier type = 2024-09-18T01:46:21.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.699+0000 7efe3dc30800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:46:21.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.699+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564ad29b3c70 con 0x7efe34022420 2024-09-18T01:46:21.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.701+0000 7efe38fd6640 1 -- 172.21.15.146:0/80729255 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v33'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe2c02d070 con 0x7efe34022420 2024-09-18T01:46:21.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.701+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94879360958560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564ad29b5b80 con 0x7efe34022420 2024-09-18T01:46:21.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.701+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564ad29b63d0 con 0x564ad29a9c90 2024-09-18T01:46:21.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.702+0000 7efe38fd6640 1 -- 172.21.15.146:0/80729255 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94879360958560] v33'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe2c02d070 con 0x7efe34022420 2024-09-18T01:46:21.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.702+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v33'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe24051070 con 0x564ad29a9c90 2024-09-18T01:46:21.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.702+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94879360964304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564ad29b6430 con 0x564ad29a9c90 2024-09-18T01:46:21.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.702+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564ad29b6f40 con 0x564ad29afe00 2024-09-18T01:46:21.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.703+0000 7efe397d7640 1 -- 172.21.15.146:0/80729255 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v33'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe3405e040 con 0x564ad29afe00 2024-09-18T01:46:21.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.703+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94879360969200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564ad29b6f40 con 0x564ad29afe00 2024-09-18T01:46:21.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.703+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564ad29b7f40 con 0x7efe34022420 2024-09-18T01:46:21.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.703+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94879360964304] v33'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe24051070 con 0x564ad29a9c90 2024-09-18T01:46:21.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.704+0000 7efe38fd6640 1 -- 172.21.15.146:0/80729255 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v33'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe2c02d070 con 0x7efe34022420 2024-09-18T01:46:21.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.704+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94879360973360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564ad29b8330 con 0x7efe34022420 2024-09-18T01:46:21.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.704+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564ad29b8d50 con 0x564ad29a9c90 2024-09-18T01:46:21.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.705+0000 7efe397d7640 1 -- 172.21.15.146:0/80729255 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94879360969200] v33'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe3405e040 con 0x564ad29afe00 2024-09-18T01:46:21.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.706+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v33'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe24051070 con 0x564ad29a9c90 2024-09-18T01:46:21.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.706+0000 7efe38fd6640 1 -- 172.21.15.146:0/80729255 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94879360973360] v33'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe2c02d070 con 0x7efe34022420 2024-09-18T01:46:21.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.706+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94879360976960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564ad29b7330 con 0x564ad29a9c90 2024-09-18T01:46:21.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.706+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564ad29b9620 con 0x7efe2c0187f0 2024-09-18T01:46:21.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.707+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94879360976960] v33'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe24051070 con 0x564ad29a9c90 2024-09-18T01:46:21.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.707+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v33'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe24051070 con 0x7efe2c0187f0 2024-09-18T01:46:21.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.707+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94879360966432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564ad29b95d0 con 0x7efe2c0187f0 2024-09-18T01:46:21.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.707+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564ad29b9fd0 con 0x7efe2c0187f0 2024-09-18T01:46:21.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.708+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94879360966432] v33'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe24051070 con 0x7efe2c0187f0 2024-09-18T01:46:21.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.708+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v33'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe24051070 con 0x7efe2c0187f0 2024-09-18T01:46:21.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.708+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94879360981728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564ad29b95d0 con 0x7efe2c0187f0 2024-09-18T01:46:21.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.708+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564ad29ba9e0 con 0x7efe2c0187f0 2024-09-18T01:46:21.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.709+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94879360981728] v33'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe24051070 con 0x7efe2c0187f0 2024-09-18T01:46:21.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.709+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v33'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe24051070 con 0x7efe2c0187f0 2024-09-18T01:46:21.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.709+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94879360979232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564ad29babc0 con 0x7efe2c0187f0 2024-09-18T01:46:21.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.709+0000 7efe3dc30800 20 add_watcher() i=0 2024-09-18T01:46:21.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.709+0000 7efe3dc30800 20 add_watcher() i=1 2024-09-18T01:46:21.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.709+0000 7efe3dc30800 20 add_watcher() i=2 2024-09-18T01:46:21.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.709+0000 7efe3dc30800 20 add_watcher() i=3 2024-09-18T01:46:21.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.709+0000 7efe3dc30800 20 add_watcher() i=4 2024-09-18T01:46:21.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.709+0000 7efe3dc30800 20 add_watcher() i=5 2024-09-18T01:46:21.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.709+0000 7efe3dc30800 20 add_watcher() i=6 2024-09-18T01:46:21.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.710+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94879360979232] v33'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe24051070 con 0x7efe2c0187f0 2024-09-18T01:46:21.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.710+0000 7efe3dc30800 20 add_watcher() i=7 2024-09-18T01:46:21.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.710+0000 7efe3dc30800 2 all 8 watchers are set, enabling cache 2024-09-18T01:46:21.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.710+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564ad29bdd70 con 0x564ad29a9c90 2024-09-18T01:46:21.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.711+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7efe24051070 con 0x564ad29a9c90 2024-09-18T01:46:21.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.711+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94879360984944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564ad29bb040 con 0x564ad29a9c90 2024-09-18T01:46:21.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.712+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94879360984944] v33'202 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efe24051070 con 0x564ad29a9c90 2024-09-18T01:46:21.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.712+0000 7efceefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:46:21.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.712+0000 7efe3dc30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:46:21.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.712+0000 7efe3dc30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:46:21.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.712+0000 7efe3dc30800 5 note: GC not initialized 2024-09-18T01:46:21.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.712+0000 7efcedfe3640 20 reqs_thread_entry: start 2024-09-18T01:46:21.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.712+0000 7efe3dc30800 20 init_complete bucket index max shards: 11 2024-09-18T01:46:21.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.712+0000 7efe3dc30800 20 Filter name: none 2024-09-18T01:46:21.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.712+0000 7efc5f7fe640 20 reqs_thread_entry: start 2024-09-18T01:46:21.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.712+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564ad29f15a0 con 0x564ad29a9c90 2024-09-18T01:46:21.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.713+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7efe24051070 con 0x564ad29a9c90 2024-09-18T01:46:21.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.713+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564ad29f15a0 con 0x7efe34022420 2024-09-18T01:46:21.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.713+0000 7efe38fd6640 1 -- 172.21.15.146:0/80729255 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7efe2c02d070 con 0x7efe34022420 2024-09-18T01:46:21.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.713+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564ad29f15a0 con 0x564ad29a9c90 2024-09-18T01:46:21.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.713+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7efe24051070 con 0x564ad29a9c90 2024-09-18T01:46:21.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.713+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564ad29f1560 con 0x564ad29afe00 2024-09-18T01:46:21.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.714+0000 7efe397d7640 1 -- 172.21.15.146:0/80729255 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7efe3405e040 con 0x564ad29afe00 2024-09-18T01:46:21.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.714+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564ad29f15a0 con 0x564ad29afe00 2024-09-18T01:46:21.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.714+0000 7efe397d7640 1 -- 172.21.15.146:0/80729255 <== osd.3 v2:172.21.15.146:6809/4106661138 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7efe3405e040 con 0x564ad29afe00 2024-09-18T01:46:21.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.714+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564ad29f15a0 con 0x564ad29afe00 2024-09-18T01:46:21.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.714+0000 7efe397d7640 1 -- 172.21.15.146:0/80729255 <== osd.3 v2:172.21.15.146:6809/4106661138 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7efe3405e040 con 0x564ad29afe00 2024-09-18T01:46:21.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.714+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564ad29f1560 con 0x564ad29a9c90 2024-09-18T01:46:21.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.714+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7efe24051070 con 0x564ad29a9c90 2024-09-18T01:46:21.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.714+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564ad29f1560 con 0x564ad29a9c90 2024-09-18T01:46:21.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.714+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7efe24051070 con 0x564ad29a9c90 2024-09-18T01:46:21.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.714+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564ad29f1560 con 0x564ad29afe00 2024-09-18T01:46:21.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.715+0000 7efe397d7640 1 -- 172.21.15.146:0/80729255 <== osd.3 v2:172.21.15.146:6809/4106661138 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7efe3405e040 con 0x564ad29afe00 2024-09-18T01:46:21.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.715+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564ad29f1560 con 0x564ad29afe00 2024-09-18T01:46:21.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.715+0000 7efe397d7640 1 -- 172.21.15.146:0/80729255 <== osd.3 v2:172.21.15.146:6809/4106661138 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7efe3405e040 con 0x564ad29afe00 2024-09-18T01:46:21.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.715+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564ad29f1560 con 0x7efe2c0187f0 2024-09-18T01:46:21.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.716+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7efe24051070 con 0x7efe2c0187f0 2024-09-18T01:46:21.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.716+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564ad29f31a0 con 0x564ad29a9c90 2024-09-18T01:46:21.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.716+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efe24051070 con 0x564ad29a9c90 2024-09-18T01:46:21.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.716+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564ad29f31a0 con 0x7efe34022420 2024-09-18T01:46:21.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.716+0000 7efe38fd6640 1 -- 172.21.15.146:0/80729255 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efe2c02d070 con 0x7efe34022420 2024-09-18T01:46:21.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.716+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564ad29f31a0 con 0x564ad29afe00 2024-09-18T01:46:21.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.716+0000 7efe397d7640 1 -- 172.21.15.146:0/80729255 <== osd.3 v2:172.21.15.146:6809/4106661138 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efe3405e040 con 0x564ad29afe00 2024-09-18T01:46:21.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.716+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564ad29f31a0 con 0x7efe2c0187f0 2024-09-18T01:46:21.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.717+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efe24051070 con 0x7efe2c0187f0 2024-09-18T01:46:21.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.717+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564ad29f3100 con 0x7efe2c0187f0 2024-09-18T01:46:21.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.717+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efe24051070 con 0x7efe2c0187f0 2024-09-18T01:46:21.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.717+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564ad29f3100 con 0x564ad29afe00 2024-09-18T01:46:21.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.717+0000 7efe397d7640 1 -- 172.21.15.146:0/80729255 <== osd.3 v2:172.21.15.146:6809/4106661138 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efe3405e040 con 0x564ad29afe00 2024-09-18T01:46:21.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.717+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564ad29f3100 con 0x7efe2c0187f0 2024-09-18T01:46:21.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.717+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) ==== 152+0+163 (crc 0 0 0) 0x7efe24051070 con 0x7efe2c0187f0 2024-09-18T01:46:21.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.717+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564ad29f30e0 con 0x564ad29a9c90 2024-09-18T01:46:21.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.718+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efe24051070 con 0x564ad29a9c90 2024-09-18T01:46:21.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.718+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564ad29f30e0 con 0x564ad29afe00 2024-09-18T01:46:21.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.718+0000 7efe397d7640 1 -- 172.21.15.146:0/80729255 <== osd.3 v2:172.21.15.146:6809/4106661138 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efe3405e040 con 0x564ad29afe00 2024-09-18T01:46:21.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.718+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564ad29f30e0 con 0x7efe2c0187f0 2024-09-18T01:46:21.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.718+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efe24087040 con 0x7efe2c0187f0 2024-09-18T01:46:21.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.718+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564ad29f30e0 con 0x7efe34022420 2024-09-18T01:46:21.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.718+0000 7efe38fd6640 1 -- 172.21.15.146:0/80729255 <== osd.2 v2:172.21.15.146:6800/3820039304 14 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efe2c02d070 con 0x7efe34022420 2024-09-18T01:46:21.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.718+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564ad29f30e0 con 0x7efe2c0187f0 2024-09-18T01:46:21.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.719+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.0 v2:172.21.15.129:6800/1759265424 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efe24087040 con 0x7efe2c0187f0 2024-09-18T01:46:21.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.719+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564ad29f30e0 con 0x564ad29a9c90 2024-09-18T01:46:21.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.719+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.1 v2:172.21.15.146:6808/3930274777 28 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efe24087040 con 0x564ad29a9c90 2024-09-18T01:46:21.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.719+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564ad29f30e0 con 0x564ad29a9c90 2024-09-18T01:46:21.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.719+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.1 v2:172.21.15.146:6808/3930274777 29 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efe24087040 con 0x564ad29a9c90 2024-09-18T01:46:21.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.719+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564ad29f30e0 con 0x564ad29afe00 2024-09-18T01:46:21.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.719+0000 7efe397d7640 1 -- 172.21.15.146:0/80729255 <== osd.3 v2:172.21.15.146:6809/4106661138 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efe3405e040 con 0x564ad29afe00 2024-09-18T01:46:21.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.720+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564ad29f30e0 con 0x564ad29a9c90 2024-09-18T01:46:21.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.720+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.1 v2:172.21.15.146:6808/3930274777 30 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efe24087040 con 0x564ad29a9c90 2024-09-18T01:46:21.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.720+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564ad29f30e0 con 0x564ad29a9c90 2024-09-18T01:46:21.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.720+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.1 v2:172.21.15.146:6808/3930274777 31 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efe24087040 con 0x564ad29a9c90 2024-09-18T01:46:21.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.720+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564ad29f30e0 con 0x564ad29afe00 2024-09-18T01:46:21.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.720+0000 7efe397d7640 1 -- 172.21.15.146:0/80729255 <== osd.3 v2:172.21.15.146:6809/4106661138 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efe3405e040 con 0x564ad29afe00 2024-09-18T01:46:21.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.720+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564ad29f30e0 con 0x564ad29afe00 2024-09-18T01:46:21.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.720+0000 7efe397d7640 1 -- 172.21.15.146:0/80729255 <== osd.3 v2:172.21.15.146:6809/4106661138 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efe3405e040 con 0x564ad29afe00 2024-09-18T01:46:21.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.720+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564ad29f30e0 con 0x564ad29afe00 2024-09-18T01:46:21.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.721+0000 7efe397d7640 1 -- 172.21.15.146:0/80729255 <== osd.3 v2:172.21.15.146:6809/4106661138 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efe3405e040 con 0x564ad29afe00 2024-09-18T01:46:21.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.721+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564ad29f30e0 con 0x7efe2c0187f0 2024-09-18T01:46:21.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.721+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.0 v2:172.21.15.129:6800/1759265424 23 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efe24087040 con 0x7efe2c0187f0 2024-09-18T01:46:21.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.722+0000 7efceefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:46:21.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.722+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94879360984944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564ad29a7120 con 0x564ad29a9c90 2024-09-18T01:46:21.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.723+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.1 v2:172.21.15.146:6808/3930274777 32 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94879360984944] v33'203 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efe24087040 con 0x564ad29a9c90 2024-09-18T01:46:21.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.723+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94879360958560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564ad29ba770 con 0x7efe34022420 2024-09-18T01:46:21.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.724+0000 7efe38fd6640 1 -- 172.21.15.146:0/80729255 <== osd.2 v2:172.21.15.146:6800/3820039304 15 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94879360958560] v33'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe2c02d070 con 0x7efe34022420 2024-09-18T01:46:21.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.724+0000 7efe3dc30800 20 remove_watcher() i=0 2024-09-18T01:46:21.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.724+0000 7efe3dc30800 2 removed watcher, disabling cache 2024-09-18T01:46:21.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.724+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94879360964304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564ad29ba770 con 0x564ad29a9c90 2024-09-18T01:46:21.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.725+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.1 v2:172.21.15.146:6808/3930274777 33 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94879360964304] v33'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe24087040 con 0x564ad29a9c90 2024-09-18T01:46:21.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.725+0000 7efe3dc30800 20 remove_watcher() i=1 2024-09-18T01:46:21.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.725+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94879360969200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564ad29b56d0 con 0x564ad29afe00 2024-09-18T01:46:21.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.726+0000 7efe397d7640 1 -- 172.21.15.146:0/80729255 <== osd.3 v2:172.21.15.146:6809/4106661138 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94879360969200] v33'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe3405e040 con 0x564ad29afe00 2024-09-18T01:46:21.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.726+0000 7efe3dc30800 20 remove_watcher() i=2 2024-09-18T01:46:21.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.726+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94879360973360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564ad29ba770 con 0x7efe34022420 2024-09-18T01:46:21.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.727+0000 7efe38fd6640 1 -- 172.21.15.146:0/80729255 <== osd.2 v2:172.21.15.146:6800/3820039304 16 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94879360973360] v33'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe2c02d070 con 0x7efe34022420 2024-09-18T01:46:21.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.727+0000 7efe3dc30800 20 remove_watcher() i=3 2024-09-18T01:46:21.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.727+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94879360976960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564ad29b56d0 con 0x564ad29a9c90 2024-09-18T01:46:21.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.728+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.1 v2:172.21.15.146:6808/3930274777 34 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94879360976960] v33'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe24087040 con 0x564ad29a9c90 2024-09-18T01:46:21.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.728+0000 7efe3dc30800 20 remove_watcher() i=4 2024-09-18T01:46:21.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.728+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94879360966432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564ad29b7a30 con 0x7efe2c0187f0 2024-09-18T01:46:21.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.730+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.0 v2:172.21.15.129:6800/1759265424 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94879360966432] v33'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe24087040 con 0x7efe2c0187f0 2024-09-18T01:46:21.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.730+0000 7efe3dc30800 20 remove_watcher() i=5 2024-09-18T01:46:21.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.730+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94879360981728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564ad29ba770 con 0x7efe2c0187f0 2024-09-18T01:46:21.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.731+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.0 v2:172.21.15.129:6800/1759265424 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94879360981728] v33'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe24087040 con 0x7efe2c0187f0 2024-09-18T01:46:21.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.731+0000 7efe3dc30800 20 remove_watcher() i=6 2024-09-18T01:46:21.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.731+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94879360979232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564ad29b56d0 con 0x7efe2c0187f0 2024-09-18T01:46:21.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.732+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 <== osd.0 v2:172.21.15.129:6800/1759265424 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94879360979232] v33'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe24087040 con 0x7efe2c0187f0 2024-09-18T01:46:21.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.732+0000 7efe3dc30800 20 remove_watcher() i=7 2024-09-18T01:46:21.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.732+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7efe2c0187f0 msgr2=0x7efe2c01c610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:21.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.732+0000 7efe3dc30800 1 --2- 172.21.15.146:0/80729255 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7efe2c0187f0 0x7efe2c01c610 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:21.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.732+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564ad29a9c90 msgr2=0x564ad29ac150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:21.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.732+0000 7efe3dc30800 1 --2- 172.21.15.146:0/80729255 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564ad29a9c90 0x564ad29ac150 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:21.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.732+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7efe34022420 msgr2=0x7efe3402aa60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:21.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.732+0000 7efe3dc30800 1 --2- 172.21.15.146:0/80729255 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7efe34022420 0x7efe3402aa60 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:21.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.732+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x564ad29afe00 msgr2=0x564ad29b2210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:21.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.732+0000 7efe3dc30800 1 --2- 172.21.15.146:0/80729255 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x564ad29afe00 0x564ad29b2210 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:21.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.732+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7efd04036b90 msgr2=0x7efd04039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:21.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.732+0000 7efe3dc30800 1 --2- 172.21.15.146:0/80729255 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7efd04036b90 0x7efd04039050 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7efe2c03ffd0 tx=0x7efe2c04d000 comp rx=0 tx=0).stop 2024-09-18T01:46:21.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.732+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ad2996df0 msgr2=0x564ad299e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:21.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.732+0000 7efe3dc30800 1 --2- 172.21.15.146:0/80729255 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ad2996df0 0x564ad299e100 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7efe34015fd0 tx=0x7efe3404c7f0 comp rx=0 tx=0).stop 2024-09-18T01:46:21.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.732+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 reap_dead start 2024-09-18T01:46:21.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.732+0000 7efe33fff640 1 -- 172.21.15.146:0/80729255 reap_dead start 2024-09-18T01:46:21.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.732+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 shutdown_connections 2024-09-18T01:46:21.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.732+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 >> 172.21.15.146:0/80729255 conn(0x564ad2993100 msgr2=0x564ad29911c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:21.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.733+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 shutdown_connections 2024-09-18T01:46:21.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.733+0000 7efe3dc30800 1 -- 172.21.15.146:0/80729255 wait complete. 2024-09-18T01:46:21.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.733+0000 7efe3dc30800 1 -- 172.21.15.146:0/2681200899 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7efd10036b90 msgr2=0x7efd10039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:21.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.733+0000 7efe3dc30800 1 --2- 172.21.15.146:0/2681200899 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7efd10036b90 0x7efd10039050 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7efe2c04b7a0 tx=0x7efe2c01b540 comp rx=0 tx=0).stop 2024-09-18T01:46:21.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.733+0000 7efe3dc30800 1 -- 172.21.15.146:0/2681200899 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ad298a170 msgr2=0x564ad298a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:21.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.733+0000 7efe3dc30800 1 --2- 172.21.15.146:0/2681200899 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ad298a170 0x564ad298a590 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x564ad2876100 tx=0x7efe340178e0 comp rx=0 tx=0).stop 2024-09-18T01:46:21.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.733+0000 7efe3dc30800 1 -- 172.21.15.146:0/2681200899 shutdown_connections 2024-09-18T01:46:21.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.733+0000 7efe3dc30800 1 --2- 172.21.15.146:0/2681200899 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7efd10036b90 0x7efd10039050 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:21.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.733+0000 7efe3dc30800 1 --2- 172.21.15.146:0/2681200899 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ad298a170 0x564ad298a590 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:21.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.733+0000 7efe3dc30800 1 -- 172.21.15.146:0/2681200899 >> 172.21.15.146:0/2681200899 conn(0x564ad297f100 msgr2=0x564ad2981c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:21.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.733+0000 7efe3dc30800 1 -- 172.21.15.146:0/2681200899 shutdown_connections 2024-09-18T01:46:21.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.733+0000 7efe3dc30800 1 -- 172.21.15.146:0/2681200899 wait complete. 2024-09-18T01:46:21.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.733+0000 7efe3dc30800 1 -- 172.21.15.146:0/1664162195 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564ad287a8e0 msgr2=0x564ad29764b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:21.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.733+0000 7efe3dc30800 1 --2- 172.21.15.146:0/1664162195 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564ad287a8e0 0x564ad29764b0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:21.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.733+0000 7efe3dc30800 1 -- 172.21.15.146:0/1664162195 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x564ad29799a0 msgr2=0x564ad297bd90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:21.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.733+0000 7efe3dc30800 1 --2- 172.21.15.146:0/1664162195 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x564ad29799a0 0x564ad297bd90 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:21.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.733+0000 7efe3dc30800 1 -- 172.21.15.146:0/1664162195 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7efd20036b40 msgr2=0x7efd20039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:21.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.733+0000 7efe3dc30800 1 --2- 172.21.15.146:0/1664162195 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7efd20036b40 0x7efd20039000 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7efe24057000 tx=0x7efe24052000 comp rx=0 tx=0).stop 2024-09-18T01:46:21.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.733+0000 7efe3dc30800 1 -- 172.21.15.146:0/1664162195 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ad27e9e10 msgr2=0x564ad2876af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:21.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.733+0000 7efe3dc30800 1 --2- 172.21.15.146:0/1664162195 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ad27e9e10 0x564ad2876af0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x564ad29664a0 tx=0x7efe2c000ed0 comp rx=0 tx=0).stop 2024-09-18T01:46:21.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.733+0000 7efe3dc30800 1 -- 172.21.15.146:0/1664162195 shutdown_connections 2024-09-18T01:46:21.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.733+0000 7efe3dc30800 1 --2- 172.21.15.146:0/1664162195 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x564ad29799a0 0x564ad297bd90 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:21.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.733+0000 7efe3dc30800 1 --2- 172.21.15.146:0/1664162195 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x564ad287a8e0 0x564ad29764b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:21.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.733+0000 7efe3dc30800 1 --2- 172.21.15.146:0/1664162195 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7efd20036b40 0x7efd20039000 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:21.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.733+0000 7efe3dc30800 1 --2- 172.21.15.146:0/1664162195 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x564ad27e9e10 0x564ad2876af0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:21.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.733+0000 7efe3dc30800 1 -- 172.21.15.146:0/1664162195 >> 172.21.15.146:0/1664162195 conn(0x564ad2870df0 msgr2=0x564ad295f970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:21.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.734+0000 7efe3dc30800 1 -- 172.21.15.146:0/1664162195 shutdown_connections 2024-09-18T01:46:21.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.734+0000 7efe3dc30800 1 -- 172.21.15.146:0/1664162195 wait complete. 2024-09-18T01:46:21.745 INFO:teuthology.orchestra.run.smithi146.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"anonymous","categories":[]}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[]}]}],"summary":[{"user":"anonymous","categories":[],"total":{"bytes_sent":0,"bytes_received":0,"ops":0,"successful_ops":0}},{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2024-09-18T01:46:21.746 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'anonymous', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-09-18T01:46:21.746 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-18T01:46:21.746 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-18T01:46:21.746 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-18T01:46:21.788 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:46:21.788 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:46:21.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.788+0000 7fa1bd230800 1 Processor -- start 2024-09-18T01:46:21.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.789+0000 7fa1bd230800 1 -- start start 2024-09-18T01:46:21.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.789+0000 7fa1bd230800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55a318a9d540 0x55a318a9d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:21.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.789+0000 7fa1bd230800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a31895db30 con 0x55a318a9de80 2024-09-18T01:46:21.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.789+0000 7fa1bd230800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x55a31893f360 con 0x55a318a9d540 2024-09-18T01:46:21.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.789+0000 7fa1b854b640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55a318a9d540 0x55a318a9d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:21.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.789+0000 7fa1b854b640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55a318a9d540 0x55a318a9d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:43748/0 (socket says 172.21.15.146:43748) 2024-09-18T01:46:21.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.789+0000 7fa1b7d4a640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x55a318a9de80 0x55a318aa2a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:49874/0 (socket says 172.21.15.146:49874) 2024-09-18T01:46:21.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.789+0000 7fa1b854b640 1 -- 172.21.15.146:0/3476055105 learned_addr learned my addr 172.21.15.146:0/3476055105 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:21.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.789+0000 7fa1b854b640 1 -- 172.21.15.146:0/3476055105 >> v1:172.21.15.129:6789/0 conn(0x55a318a9de80 legacy=0x55a318aa2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:21.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.789+0000 7fa1b854b640 1 -- 172.21.15.146:0/3476055105 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a318965e00 con 0x55a318a9d540 2024-09-18T01:46:21.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.791+0000 7fa1b854b640 1 --2- 172.21.15.146:0/3476055105 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a318a9d540 0x55a318a9d940 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fa1a800a520 tx=0x7fa1a8045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=437733e30003746b server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:21.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.791+0000 7fa1b7549640 1 -- 172.21.15.146:0/3476055105 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1a8055070 con 0x55a318a9d540 2024-09-18T01:46:21.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.791+0000 7fa1b7549640 1 -- 172.21.15.146:0/3476055105 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1a80515b0 con 0x55a318a9d540 2024-09-18T01:46:21.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.791+0000 7fa1b7549640 1 -- 172.21.15.146:0/3476055105 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1a80518d0 con 0x55a318a9d540 2024-09-18T01:46:21.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.792+0000 7fa1bd230800 1 -- 172.21.15.146:0/3476055105 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a318a9d540 msgr2=0x55a318a9d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:21.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.792+0000 7fa1bd230800 1 --2- 172.21.15.146:0/3476055105 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a318a9d540 0x55a318a9d940 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fa1a800a520 tx=0x7fa1a8045ba0 comp rx=0 tx=0).stop 2024-09-18T01:46:21.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.792+0000 7fa1bd230800 1 -- 172.21.15.146:0/3476055105 shutdown_connections 2024-09-18T01:46:21.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.792+0000 7fa1bd230800 1 --2- 172.21.15.146:0/3476055105 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a318a9d540 0x55a318a9d940 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:21.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.792+0000 7fa1bd230800 1 -- 172.21.15.146:0/3476055105 >> 172.21.15.146:0/3476055105 conn(0x55a318a98dd0 msgr2=0x55a318a9b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:21.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.792+0000 7fa1bd230800 1 -- 172.21.15.146:0/3476055105 shutdown_connections 2024-09-18T01:46:21.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.792+0000 7fa1bd230800 1 -- 172.21.15.146:0/3476055105 wait complete. 2024-09-18T01:46:21.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.806+0000 7fa1bd230800 1 Processor -- start 2024-09-18T01:46:21.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.806+0000 7fa1bd230800 1 -- start start 2024-09-18T01:46:21.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.806+0000 7fa1bd230800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a318a9d540 0x55a318a12590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:21.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.806+0000 7fa1bd230800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55a3189ea320 con 0x55a318a9d540 2024-09-18T01:46:21.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.806+0000 7fa1b854b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a318a9d540 0x55a318a12590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:21.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.806+0000 7fa1b854b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a318a9d540 0x55a318a12590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:43762/0 (socket says 172.21.15.146:43762) 2024-09-18T01:46:21.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.806+0000 7fa1b854b640 1 -- 172.21.15.146:0/3203036076 learned_addr learned my addr 172.21.15.146:0/3203036076 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:21.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.807+0000 7fa1b854b640 1 -- 172.21.15.146:0/3203036076 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a318937bc0 con 0x55a318a9d540 2024-09-18T01:46:21.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.807+0000 7fa1b854b640 1 --2- 172.21.15.146:0/3203036076 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a318a9d540 0x55a318a12590 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fa1a8025da0 tx=0x7fa1a8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8be59942ee061a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:21.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.807+0000 7fa0a660c640 1 -- 172.21.15.146:0/3203036076 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1a8051950 con 0x55a318a9d540 2024-09-18T01:46:21.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.807+0000 7fa0a660c640 1 -- 172.21.15.146:0/3203036076 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1a8051af0 con 0x55a318a9d540 2024-09-18T01:46:21.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.807+0000 7fa0a660c640 1 -- 172.21.15.146:0/3203036076 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1a8051dd0 con 0x55a318a9d540 2024-09-18T01:46:21.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.808+0000 7fa1bd230800 1 -- 172.21.15.146:0/3203036076 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a318a9d540 msgr2=0x55a318a12590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:21.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.808+0000 7fa1bd230800 1 --2- 172.21.15.146:0/3203036076 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a318a9d540 0x55a318a12590 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fa1a8025da0 tx=0x7fa1a8051000 comp rx=0 tx=0).stop 2024-09-18T01:46:21.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.808+0000 7fa1bd230800 1 -- 172.21.15.146:0/3203036076 shutdown_connections 2024-09-18T01:46:21.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.808+0000 7fa1bd230800 1 --2- 172.21.15.146:0/3203036076 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a318a9d540 0x55a318a12590 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:21.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.808+0000 7fa1bd230800 1 -- 172.21.15.146:0/3203036076 >> 172.21.15.146:0/3203036076 conn(0x55a318a98dd0 msgr2=0x55a318b88140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:21.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.808+0000 7fa1bd230800 1 -- 172.21.15.146:0/3203036076 shutdown_connections 2024-09-18T01:46:21.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.808+0000 7fa1bd230800 1 -- 172.21.15.146:0/3203036076 wait complete. 2024-09-18T01:46:21.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.808+0000 7fa1bd230800 1 Processor -- start 2024-09-18T01:46:21.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.808+0000 7fa1bd230800 1 -- start start 2024-09-18T01:46:21.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.808+0000 7fa1bd230800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a318a9d540 0x55a318b95140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:21.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.808+0000 7fa1bd230800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55a318aa4560 con 0x55a318a9d540 2024-09-18T01:46:21.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.808+0000 7fa1b854b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a318a9d540 0x55a318b95140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:21.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.808+0000 7fa1b854b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a318a9d540 0x55a318b95140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:43764/0 (socket says 172.21.15.146:43764) 2024-09-18T01:46:21.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.808+0000 7fa1b854b640 1 -- 172.21.15.146:0/1973661348 learned_addr learned my addr 172.21.15.146:0/1973661348 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:21.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.809+0000 7fa1b854b640 1 -- 172.21.15.146:0/1973661348 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a31894bfe0 con 0x55a318a9d540 2024-09-18T01:46:21.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.809+0000 7fa1b854b640 1 --2- 172.21.15.146:0/1973661348 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a318a9d540 0x55a318b95140 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fa1a8067040 tx=0x7fa1a8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:21.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.809+0000 7fa0a4e09640 1 -- 172.21.15.146:0/1973661348 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1a8073070 con 0x55a318a9d540 2024-09-18T01:46:21.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.809+0000 7fa0a4e09640 1 -- 172.21.15.146:0/1973661348 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1a805a450 con 0x55a318a9d540 2024-09-18T01:46:21.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.809+0000 7fa0a4e09640 1 -- 172.21.15.146:0/1973661348 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1a805a730 con 0x55a318a9d540 2024-09-18T01:46:21.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.809+0000 7fa1bd230800 1 -- 172.21.15.146:0/1973661348 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a318b95680 con 0x55a318a9d540 2024-09-18T01:46:21.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.809+0000 7fa1bd230800 1 -- 172.21.15.146:0/1973661348 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a318b95c00 con 0x55a318a9d540 2024-09-18T01:46:21.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.810+0000 7fa0a4e09640 1 -- 172.21.15.146:0/1973661348 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa1a8076070 con 0x55a318a9d540 2024-09-18T01:46:21.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.810+0000 7fa0a4e09640 1 --2- 172.21.15.146:0/1973661348 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fa0a0036b90 0x7fa0a0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:21.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.810+0000 7fa0a4e09640 1 -- 172.21.15.146:0/1973661348 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7fa1a8062070 con 0x55a318a9d540 2024-09-18T01:46:21.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.810+0000 7fa1b7d4a640 1 --2- 172.21.15.146:0/1973661348 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fa0a0036b90 0x7fa0a0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:21.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.810+0000 7fa1bd230800 1 --2- 172.21.15.146:0/1973661348 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a318a9de80 0x55a318b9c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:21.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.810+0000 7fa1bd230800 1 -- 172.21.15.146:0/1973661348 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a318b9c730 con 0x55a318a9de80 2024-09-18T01:46:21.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.810+0000 7fa1b8d4c640 1 --2- 172.21.15.146:0/1973661348 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a318a9de80 0x55a318b9c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:21.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.811+0000 7fa1b7d4a640 1 --2- 172.21.15.146:0/1973661348 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fa0a0036b90 0x7fa0a0039050 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac000f60 tx=0x7fa1ac001370 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:21.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.811+0000 7fa1b8d4c640 1 --2- 172.21.15.146:0/1973661348 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a318a9de80 0x55a318b9c1b0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:21.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.811+0000 7fa1b8d4c640 1 -- 172.21.15.146:0/1973661348 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa1b000a4a0 con 0x55a318a9de80 2024-09-18T01:46:21.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.811+0000 7fa1bd230800 1 -- 172.21.15.146:0/1973661348 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a318b99780 con 0x55a318a9de80 2024-09-18T01:46:21.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.811+0000 7fa1b8d4c640 1 -- 172.21.15.146:0/1973661348 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa1b000a4a0 con 0x55a318a9de80 2024-09-18T01:46:21.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.811+0000 7fa1bd230800 1 -- 172.21.15.146:0/1973661348 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a318b9e550 con 0x55a318a9de80 2024-09-18T01:46:21.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.812+0000 7fa1b8d4c640 1 -- 172.21.15.146:0/1973661348 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa1b000a4a0 con 0x55a318a9de80 2024-09-18T01:46:21.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.812+0000 7fa1bd230800 1 -- 172.21.15.146:0/1973661348 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a318b9d690 con 0x55a318a9de80 2024-09-18T01:46:21.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.812+0000 7fa1b8d4c640 1 -- 172.21.15.146:0/1973661348 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa1b000a4a0 con 0x55a318a9de80 2024-09-18T01:46:21.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.812+0000 7fa1bd230800 1 --2- 172.21.15.146:0/1973661348 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55a318b9e160 0x55a318ba19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:21.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.812+0000 7fa1bd230800 1 -- 172.21.15.146:0/1973661348 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a318ba2130 con 0x55a318b9e160 2024-09-18T01:46:21.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.812+0000 7fa1b854b640 1 --2- 172.21.15.146:0/1973661348 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55a318b9e160 0x55a318ba19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:21.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.812+0000 7fa1b854b640 1 --2- 172.21.15.146:0/1973661348 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55a318b9e160 0x55a318ba19a0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:21.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.813+0000 7fa1b854b640 1 -- 172.21.15.146:0/1973661348 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa1a8075030 con 0x55a318b9e160 2024-09-18T01:46:21.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.813+0000 7fa1bd230800 1 Processor -- start 2024-09-18T01:46:21.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.813+0000 7fa1bd230800 1 -- start start 2024-09-18T01:46:21.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.813+0000 7fa1bd230800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a318bafec0 0x55a318bb02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:21.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.813+0000 7fa1bd230800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55a318939580 con 0x55a318bafec0 2024-09-18T01:46:21.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.813+0000 7fa1b8d4c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a318bafec0 0x55a318bb02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:21.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.813+0000 7fa1b8d4c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a318bafec0 0x55a318bb02e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:43766/0 (socket says 172.21.15.146:43766) 2024-09-18T01:46:21.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.813+0000 7fa1b8d4c640 1 -- 172.21.15.146:0/961568134 learned_addr learned my addr 172.21.15.146:0/961568134 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:21.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.814+0000 7fa1b8d4c640 1 -- 172.21.15.146:0/961568134 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a318bb0820 con 0x55a318bafec0 2024-09-18T01:46:21.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.814+0000 7fa1b8d4c640 1 --2- 172.21.15.146:0/961568134 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a318bafec0 0x55a318bb02e0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x55a318b9cb10 tx=0x7fa1b00178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:21.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.814+0000 7fa09dffb640 1 -- 172.21.15.146:0/961568134 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1b0013440 con 0x55a318bafec0 2024-09-18T01:46:21.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.814+0000 7fa09dffb640 1 -- 172.21.15.146:0/961568134 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1b00135e0 con 0x55a318bafec0 2024-09-18T01:46:21.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.814+0000 7fa09dffb640 1 -- 172.21.15.146:0/961568134 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1b00138c0 con 0x55a318bafec0 2024-09-18T01:46:21.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.814+0000 7fa1bd230800 1 -- 172.21.15.146:0/961568134 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a318bb0ab0 con 0x55a318bafec0 2024-09-18T01:46:21.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.814+0000 7fa1bd230800 1 -- 172.21.15.146:0/961568134 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a318bb3790 con 0x55a318bafec0 2024-09-18T01:46:21.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.815+0000 7fa09dffb640 1 -- 172.21.15.146:0/961568134 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa1b0011040 con 0x55a318bafec0 2024-09-18T01:46:21.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.815+0000 7fa09dffb640 1 --2- 172.21.15.146:0/961568134 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fa090036b40 0x7fa090039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:21.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.815+0000 7fa09dffb640 1 -- 172.21.15.146:0/961568134 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7fa1b001d070 con 0x55a318bafec0 2024-09-18T01:46:21.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.815+0000 7fa1b854b640 1 --2- 172.21.15.146:0/961568134 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fa090036b40 0x7fa090039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:21.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.815+0000 7fa1bd230800 1 Processor -- start 2024-09-18T01:46:21.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.815+0000 7fa1bd230800 1 -- start start 2024-09-18T01:46:21.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.815+0000 7fa1b854b640 1 --2- 172.21.15.146:0/961568134 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fa090036b40 0x7fa090039000 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x55a318ba2530 tx=0x7fa1a808f550 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:21.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.816+0000 7fa1bd230800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a318bbcb90 0x55a318bbcf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:21.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.816+0000 7fa1bd230800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55a318b906a0 con 0x55a318bbcb90 2024-09-18T01:46:21.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.816+0000 7fa1b8d4c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a318bbcb90 0x55a318bbcf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:21.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.816+0000 7fa1b8d4c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a318bbcb90 0x55a318bbcf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:43774/0 (socket says 172.21.15.146:43774) 2024-09-18T01:46:21.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.816+0000 7fa1b8d4c640 1 -- 172.21.15.146:0/3085356153 learned_addr learned my addr 172.21.15.146:0/3085356153 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:21.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.816+0000 7fa1b8d4c640 1 -- 172.21.15.146:0/3085356153 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a318bbd560 con 0x55a318bbcb90 2024-09-18T01:46:21.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.816+0000 7fa1b8d4c640 1 --2- 172.21.15.146:0/3085356153 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a318bbcb90 0x55a318bbcf90 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fa1b004c9f0 tx=0x7fa1b004cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=547c29c1754373b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:21.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.816+0000 7fa08f7fe640 1 -- 172.21.15.146:0/3085356153 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1b004a020 con 0x55a318bbcb90 2024-09-18T01:46:21.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.816+0000 7fa08f7fe640 1 -- 172.21.15.146:0/3085356153 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1b0015560 con 0x55a318bbcb90 2024-09-18T01:46:21.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.816+0000 7fa08f7fe640 1 -- 172.21.15.146:0/3085356153 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1b002a480 con 0x55a318bbcb90 2024-09-18T01:46:21.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.817+0000 7fa1bd230800 1 -- 172.21.15.146:0/3085356153 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a318bbcb90 msgr2=0x55a318bbcf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:21.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.817+0000 7fa1bd230800 1 --2- 172.21.15.146:0/3085356153 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a318bbcb90 0x55a318bbcf90 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fa1b004c9f0 tx=0x7fa1b004cca0 comp rx=0 tx=0).stop 2024-09-18T01:46:21.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.817+0000 7fa1bd230800 1 -- 172.21.15.146:0/3085356153 shutdown_connections 2024-09-18T01:46:21.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.817+0000 7fa1bd230800 1 --2- 172.21.15.146:0/3085356153 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a318bbcb90 0x55a318bbcf90 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:21.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.817+0000 7fa1bd230800 1 -- 172.21.15.146:0/3085356153 >> 172.21.15.146:0/3085356153 conn(0x55a318bb8ef0 msgr2=0x55a318bb6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:21.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.817+0000 7fa1bd230800 1 -- 172.21.15.146:0/3085356153 shutdown_connections 2024-09-18T01:46:21.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.817+0000 7fa1bd230800 1 -- 172.21.15.146:0/3085356153 wait complete. 2024-09-18T01:46:21.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.817+0000 7fa1bd230800 1 Processor -- start 2024-09-18T01:46:21.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.817+0000 7fa1bd230800 1 -- start start 2024-09-18T01:46:21.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.817+0000 7fa1bd230800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a318bbcb90 0x55a318bc4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:21.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.817+0000 7fa1bd230800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55a318bbdbd0 con 0x55a318bbcb90 2024-09-18T01:46:21.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.817+0000 7fa1b8d4c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a318bbcb90 0x55a318bc4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:21.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.817+0000 7fa1b8d4c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a318bbcb90 0x55a318bc4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:43778/0 (socket says 172.21.15.146:43778) 2024-09-18T01:46:21.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.817+0000 7fa1b8d4c640 1 -- 172.21.15.146:0/1962009 learned_addr learned my addr 172.21.15.146:0/1962009 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:21.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.818+0000 7fa1b8d4c640 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a318bc4540 con 0x55a318bbcb90 2024-09-18T01:46:21.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.818+0000 7fa1b8d4c640 1 --2- 172.21.15.146:0/1962009 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a318bbcb90 0x55a318bc4000 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fa1b004c9f0 tx=0x7fa1b004c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:21.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.818+0000 7fa08dffb640 1 -- 172.21.15.146:0/1962009 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1b0039070 con 0x55a318bbcb90 2024-09-18T01:46:21.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.818+0000 7fa08dffb640 1 -- 172.21.15.146:0/1962009 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1b002a8c0 con 0x55a318bbcb90 2024-09-18T01:46:21.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.818+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a318bc47d0 con 0x55a318bbcb90 2024-09-18T01:46:21.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.818+0000 7fa08dffb640 1 -- 172.21.15.146:0/1962009 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1b0045040 con 0x55a318bbcb90 2024-09-18T01:46:21.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.818+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a318bc7480 con 0x55a318bbcb90 2024-09-18T01:46:21.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.819+0000 7fa08dffb640 1 -- 172.21.15.146:0/1962009 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa1b003c070 con 0x55a318bbcb90 2024-09-18T01:46:21.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.819+0000 7fa08dffb640 1 --2- 172.21.15.146:0/1962009 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fa080036b40 0x7fa080039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:21.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.819+0000 7fa08dffb640 1 -- 172.21.15.146:0/1962009 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7fa1b004ce00 con 0x55a318bbcb90 2024-09-18T01:46:21.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.819+0000 7fa1b854b640 1 --2- 172.21.15.146:0/1962009 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fa080036b40 0x7fa080039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:21.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.819+0000 7fa1bd230800 20 rados->read ofs=0 len=0 2024-09-18T01:46:21.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.819+0000 7fa1bd230800 1 --2- 172.21.15.146:0/1962009 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a318bcfc00 0x55a318bd20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:21.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.819+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a318bd2810 con 0x55a318bcfc00 2024-09-18T01:46:21.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.819+0000 7fa1b7d4a640 1 --2- 172.21.15.146:0/1962009 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a318bcfc00 0x55a318bd20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:21.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.820+0000 7fa1b854b640 1 --2- 172.21.15.146:0/1962009 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fa080036b40 0x7fa080039000 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa1a8064930 tx=0x7fa1a808c000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:21.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.820+0000 7fa1b7d4a640 1 --2- 172.21.15.146:0/1962009 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a318bcfc00 0x55a318bd20c0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:21.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.820+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa1ac00f610 con 0x55a318bcfc00 2024-09-18T01:46:21.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.820+0000 7fa1bd230800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:21.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.820+0000 7fa1bd230800 20 realm 2024-09-18T01:46:21.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.820+0000 7fa1bd230800 20 rados->read ofs=0 len=0 2024-09-18T01:46:21.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.820+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a318bcf0a0 con 0x55a318bcfc00 2024-09-18T01:46:21.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.820+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa1ac00f610 con 0x55a318bcfc00 2024-09-18T01:46:21.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.820+0000 7fa1bd230800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:21.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.820+0000 7fa1bd230800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:46:21.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.820+0000 7fa1bd230800 20 rados->read ofs=0 len=0 2024-09-18T01:46:21.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.820+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a318bd32f0 con 0x55a318bcfc00 2024-09-18T01:46:21.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.820+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa1ac00f610 con 0x55a318bcfc00 2024-09-18T01:46:21.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.820+0000 7fa1bd230800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:21.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.820+0000 7fa1bd230800 20 rados->read ofs=0 len=0 2024-09-18T01:46:21.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.820+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a318bd3bc0 con 0x55a318bcfc00 2024-09-18T01:46:21.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.821+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa1ac00f610 con 0x55a318bcfc00 2024-09-18T01:46:21.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.821+0000 7fa1bd230800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:46:21.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.821+0000 7fa1bd230800 20 rados->read ofs=0 len=0 2024-09-18T01:46:21.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.821+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a318bd3f60 con 0x55a318bcfc00 2024-09-18T01:46:21.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.821+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa1ac00f610 con 0x55a318bcfc00 2024-09-18T01:46:21.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.821+0000 7fa1bd230800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:46:21.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.821+0000 7fa1bd230800 20 searching for the correct realm 2024-09-18T01:46:21.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.821+0000 7fa1bd230800 1 --2- 172.21.15.146:0/1962009 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55a318bd5e40 0x55a318bd8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:21.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.821+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a318bd88e0 con 0x55a318bd5e40 2024-09-18T01:46:21.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.821+0000 7fa1b8d4c640 1 --2- 172.21.15.146:0/1962009 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55a318bd5e40 0x55a318bd8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:21.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.821+0000 7fa1b8d4c640 1 --2- 172.21.15.146:0/1962009 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55a318bd5e40 0x55a318bd8230 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:21.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.822+0000 7fa1b8d4c640 1 -- 172.21.15.146:0/1962009 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1b003b030 con 0x55a318bd5e40 2024-09-18T01:46:21.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.822+0000 7fa1b8d4c640 1 --2- 172.21.15.146:0/1962009 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fa1b0008a10 0x7fa1b004ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:21.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.822+0000 7fa1b8d4c640 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a318bd88e0 con 0x7fa1b0008a10 2024-09-18T01:46:21.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.822+0000 7fa1b854b640 1 --2- 172.21.15.146:0/1962009 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fa1b0008a10 0x7fa1b004ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:21.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.822+0000 7fa1b854b640 1 --2- 172.21.15.146:0/1962009 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fa1b0008a10 0x7fa1b004ebb0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:21.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.822+0000 7fa1b854b640 1 -- 172.21.15.146:0/1962009 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1a8075030 con 0x7fa1b0008a10 2024-09-18T01:46:21.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.822+0000 7fa1b854b640 1 --2- 172.21.15.146:0/1962009 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fa1a80a0070 0x7fa1a804f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:21.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.822+0000 7fa1b854b640 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a318bd88e0 con 0x7fa1a80a0070 2024-09-18T01:46:21.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.823+0000 7fa1b7d4a640 1 --2- 172.21.15.146:0/1962009 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fa1a80a0070 0x7fa1a804f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:21.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.823+0000 7fa1b7d4a640 1 --2- 172.21.15.146:0/1962009 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fa1a80a0070 0x7fa1a804f360 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:21.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.823+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1ac00f610 con 0x7fa1a80a0070 2024-09-18T01:46:21.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.823+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a318bd88e0 con 0x55a318bcfc00 2024-09-18T01:46:21.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.823+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa1ac00f610 con 0x55a318bcfc00 2024-09-18T01:46:21.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.823+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a318bd88e0 con 0x55a318bcfc00 2024-09-18T01:46:21.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.824+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1ac00f610 con 0x55a318bcfc00 2024-09-18T01:46:21.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.824+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a318bd88e0 con 0x7fa1a80a0070 2024-09-18T01:46:21.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.824+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1ac00f610 con 0x7fa1a80a0070 2024-09-18T01:46:21.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.824+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a318bd88e0 con 0x7fa1a80a0070 2024-09-18T01:46:21.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.824+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1ac00f610 con 0x7fa1a80a0070 2024-09-18T01:46:21.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.824+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a318bd88e0 con 0x7fa1b0008a10 2024-09-18T01:46:21.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.824+0000 7fa1b854b640 1 -- 172.21.15.146:0/1962009 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1a8075030 con 0x7fa1b0008a10 2024-09-18T01:46:21.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.824+0000 7fa1b854b640 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a318bd88e0 con 0x55a318bd5e40 2024-09-18T01:46:21.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.825+0000 7fa1b8d4c640 1 -- 172.21.15.146:0/1962009 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1b003b030 con 0x55a318bd5e40 2024-09-18T01:46:21.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.825+0000 7fa1b8d4c640 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a318bd88e0 con 0x55a318bcfc00 2024-09-18T01:46:21.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.825+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1ac00f610 con 0x55a318bcfc00 2024-09-18T01:46:21.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.825+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a318bd88e0 con 0x7fa1a80a0070 2024-09-18T01:46:21.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.825+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1ac00f610 con 0x7fa1a80a0070 2024-09-18T01:46:21.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.825+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a318bd88e0 con 0x55a318bcfc00 2024-09-18T01:46:21.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.825+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1ac00f610 con 0x55a318bcfc00 2024-09-18T01:46:21.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.825+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a318bd88e0 con 0x7fa1b0008a10 2024-09-18T01:46:21.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.826+0000 7fa1b854b640 1 -- 172.21.15.146:0/1962009 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fa1a80af040 con 0x7fa1b0008a10 2024-09-18T01:46:21.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.826+0000 7fa1b854b640 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a318bd88e0 con 0x55a318bd5e40 2024-09-18T01:46:21.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.826+0000 7fa1b8d4c640 1 -- 172.21.15.146:0/1962009 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1b003b030 con 0x55a318bd5e40 2024-09-18T01:46:21.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.826+0000 7fa1b8d4c640 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a318bd88e0 con 0x55a318bd5e40 2024-09-18T01:46:21.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.826+0000 7fa1b8d4c640 1 -- 172.21.15.146:0/1962009 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1b003b030 con 0x55a318bd5e40 2024-09-18T01:46:21.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.826+0000 7fa1b8d4c640 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a318bd88e0 con 0x7fa1a80a0070 2024-09-18T01:46:21.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.826+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1ac00f610 con 0x7fa1a80a0070 2024-09-18T01:46:21.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.826+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a318bd88e0 con 0x55a318bd5e40 2024-09-18T01:46:21.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.827+0000 7fa1b8d4c640 1 -- 172.21.15.146:0/1962009 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1b003b030 con 0x55a318bd5e40 2024-09-18T01:46:21.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.827+0000 7fa1b8d4c640 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a318bd88e0 con 0x55a318bd5e40 2024-09-18T01:46:21.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.827+0000 7fa1b8d4c640 1 -- 172.21.15.146:0/1962009 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1b003b030 con 0x55a318bd5e40 2024-09-18T01:46:21.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.827+0000 7fa1b8d4c640 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a318bd88e0 con 0x55a318bcfc00 2024-09-18T01:46:21.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.827+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1ac00f610 con 0x55a318bcfc00 2024-09-18T01:46:21.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.827+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a318bd88e0 con 0x55a318bcfc00 2024-09-18T01:46:21.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.827+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa1ac00f610 con 0x55a318bcfc00 2024-09-18T01:46:21.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.827+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a318bd88e0 con 0x7fa1a80a0070 2024-09-18T01:46:21.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.828+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1ac00f610 con 0x7fa1a80a0070 2024-09-18T01:46:21.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.828+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a318bd88e0 con 0x55a318bd5e40 2024-09-18T01:46:21.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.828+0000 7fa1b8d4c640 1 -- 172.21.15.146:0/1962009 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1b003b030 con 0x55a318bd5e40 2024-09-18T01:46:21.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.828+0000 7fa1b8d4c640 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a318bd88e0 con 0x7fa1b0008a10 2024-09-18T01:46:21.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.828+0000 7fa1b854b640 1 -- 172.21.15.146:0/1962009 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1a80af040 con 0x7fa1b0008a10 2024-09-18T01:46:21.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.828+0000 7fa1b854b640 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a318bd88e0 con 0x55a318bcfc00 2024-09-18T01:46:21.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.828+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1ac00f610 con 0x55a318bcfc00 2024-09-18T01:46:21.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.828+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a318bd88e0 con 0x7fa1a80a0070 2024-09-18T01:46:21.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.829+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1ac00f610 con 0x7fa1a80a0070 2024-09-18T01:46:21.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.829+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a318bd88e0 con 0x55a318bd5e40 2024-09-18T01:46:21.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.829+0000 7fa1b8d4c640 1 -- 172.21.15.146:0/1962009 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1b003b030 con 0x55a318bd5e40 2024-09-18T01:46:21.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.829+0000 7fa1b8d4c640 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a318bd88e0 con 0x7fa1a80a0070 2024-09-18T01:46:21.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.829+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1ac00f610 con 0x7fa1a80a0070 2024-09-18T01:46:21.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.829+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a318bd88e0 con 0x7fa1b0008a10 2024-09-18T01:46:21.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.829+0000 7fa1b854b640 1 -- 172.21.15.146:0/1962009 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1a80af040 con 0x7fa1b0008a10 2024-09-18T01:46:21.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.829+0000 7fa1b854b640 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a318bd88e0 con 0x55a318bd5e40 2024-09-18T01:46:21.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.830+0000 7fa1b8d4c640 1 -- 172.21.15.146:0/1962009 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1b003b030 con 0x55a318bd5e40 2024-09-18T01:46:21.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.830+0000 7fa1b8d4c640 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a318bd88e0 con 0x7fa1a80a0070 2024-09-18T01:46:21.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.830+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1ac00f610 con 0x7fa1a80a0070 2024-09-18T01:46:21.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.830+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a318bd88e0 con 0x55a318bcfc00 2024-09-18T01:46:21.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.830+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa1ac00f610 con 0x55a318bcfc00 2024-09-18T01:46:21.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.830+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a318bd88e0 con 0x7fa1b0008a10 2024-09-18T01:46:21.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.830+0000 7fa1b854b640 1 -- 172.21.15.146:0/1962009 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1a80af040 con 0x7fa1b0008a10 2024-09-18T01:46:21.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.830+0000 7fa1bd230800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:46:21.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.830+0000 7fa1bd230800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:46:21.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.830+0000 7fa1bd230800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:46:21.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.830+0000 7fa1bd230800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:46:21.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.830+0000 7fa1bd230800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:46:21.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.830+0000 7fa1bd230800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:46:21.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.830+0000 7fa1bd230800 20 rados->read ofs=0 len=0 2024-09-18T01:46:21.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.830+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a318bd48e0 con 0x55a318bcfc00 2024-09-18T01:46:21.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.831+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa1ac00f610 con 0x55a318bcfc00 2024-09-18T01:46:21.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.831+0000 7fa1bd230800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:21.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.831+0000 7fa1bd230800 20 rados->read ofs=0 len=0 2024-09-18T01:46:21.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.831+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a318bd5180 con 0x55a318bcfc00 2024-09-18T01:46:21.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.831+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa1ac00f610 con 0x55a318bcfc00 2024-09-18T01:46:21.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.831+0000 7fa1bd230800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:46:21.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.831+0000 7fa1bd230800 20 rados->read ofs=0 len=0 2024-09-18T01:46:21.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.831+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a318bd4520 con 0x7fa1b0008a10 2024-09-18T01:46:21.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.831+0000 7fa1b854b640 1 -- 172.21.15.146:0/1962009 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa1a80af040 con 0x7fa1b0008a10 2024-09-18T01:46:21.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.831+0000 7fa1bd230800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:46:21.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.831+0000 7fa1bd230800 20 zone default found 2024-09-18T01:46:21.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.831+0000 7fa1bd230800 4 Realm: () 2024-09-18T01:46:21.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.831+0000 7fa1bd230800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:46:21.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.831+0000 7fa1bd230800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:46:21.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.831+0000 7fa1bd230800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:46:21.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.831+0000 7fa1bd230800 20 zonegroup default 2024-09-18T01:46:21.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.831+0000 7fa1bd230800 20 rados->read ofs=0 len=0 2024-09-18T01:46:21.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.831+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a318bd9210 con 0x7fa1a80a0070 2024-09-18T01:46:21.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.832+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa1ac00f610 con 0x7fa1a80a0070 2024-09-18T01:46:21.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.832+0000 7fa1bd230800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:21.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.832+0000 7fa1bd230800 20 rados->read ofs=0 len=0 2024-09-18T01:46:21.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.832+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a318bdad70 con 0x55a318bd5e40 2024-09-18T01:46:21.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.832+0000 7fa1b8d4c640 1 -- 172.21.15.146:0/1962009 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa1b003b030 con 0x55a318bd5e40 2024-09-18T01:46:21.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.832+0000 7fa1bd230800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:21.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.832+0000 7fa1bd230800 20 rados->read ofs=0 len=0 2024-09-18T01:46:21.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.832+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a318bdb1c0 con 0x55a318bd5e40 2024-09-18T01:46:21.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.832+0000 7fa1b8d4c640 1 -- 172.21.15.146:0/1962009 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa1b003b030 con 0x55a318bd5e40 2024-09-18T01:46:21.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.832+0000 7fa1bd230800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:21.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.832+0000 7fa1bd230800 20 started sync module instance, tier type = 2024-09-18T01:46:21.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.832+0000 7fa1bd230800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:46:21.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.832+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a318bd9c70 con 0x7fa1b0008a10 2024-09-18T01:46:21.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.833+0000 7fa1b854b640 1 -- 172.21.15.146:0/1962009 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v33'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1a80af040 con 0x7fa1b0008a10 2024-09-18T01:46:21.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.833+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94158983110752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a318bd98d0 con 0x7fa1b0008a10 2024-09-18T01:46:21.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.833+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a318bdc0d0 con 0x55a318bcfc00 2024-09-18T01:46:21.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.834+0000 7fa1b854b640 1 -- 172.21.15.146:0/1962009 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94158983110752] v33'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1a80af040 con 0x7fa1b0008a10 2024-09-18T01:46:21.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.834+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v33'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1ac00f610 con 0x55a318bcfc00 2024-09-18T01:46:21.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.834+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94158983117856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a318bdc4f0 con 0x55a318bcfc00 2024-09-18T01:46:21.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.835+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a318bdceb0 con 0x55a318bd5e40 2024-09-18T01:46:21.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.837+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94158983117856] v33'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1ac00f610 con 0x55a318bcfc00 2024-09-18T01:46:21.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.837+0000 7fa1b8d4c640 1 -- 172.21.15.146:0/1962009 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v33'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1b003b030 con 0x55a318bd5e40 2024-09-18T01:46:21.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.837+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94158983121888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a318bdc4f0 con 0x55a318bd5e40 2024-09-18T01:46:21.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.837+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a318bdd9f0 con 0x7fa1b0008a10 2024-09-18T01:46:21.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.838+0000 7fa1b8d4c640 1 -- 172.21.15.146:0/1962009 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94158983121888] v33'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1b003b030 con 0x55a318bd5e40 2024-09-18T01:46:21.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.838+0000 7fa1b854b640 1 -- 172.21.15.146:0/1962009 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v33'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1a80af040 con 0x7fa1b0008a10 2024-09-18T01:46:21.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.838+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94158983118912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a318bdc460 con 0x7fa1b0008a10 2024-09-18T01:46:21.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.838+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a318bde8b0 con 0x55a318bcfc00 2024-09-18T01:46:21.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.839+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v33'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1ac00f610 con 0x55a318bcfc00 2024-09-18T01:46:21.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.839+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94158983128064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a318bde860 con 0x55a318bcfc00 2024-09-18T01:46:21.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.839+0000 7fa1b854b640 1 -- 172.21.15.146:0/1962009 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94158983118912] v33'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1a80af040 con 0x7fa1b0008a10 2024-09-18T01:46:21.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.839+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a318bdde20 con 0x7fa1a80a0070 2024-09-18T01:46:21.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.840+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94158983128064] v33'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1ac00f610 con 0x55a318bcfc00 2024-09-18T01:46:21.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.840+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v33'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1ac00f610 con 0x7fa1a80a0070 2024-09-18T01:46:21.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.840+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94158983130192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a318bde820 con 0x7fa1a80a0070 2024-09-18T01:46:21.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.840+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a318bdfdf0 con 0x7fa1a80a0070 2024-09-18T01:46:21.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.842+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94158983130192] v33'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1ac00f610 con 0x7fa1a80a0070 2024-09-18T01:46:21.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.842+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v33'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1ac00f610 con 0x7fa1a80a0070 2024-09-18T01:46:21.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.842+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94158983131936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a318bdfdf0 con 0x7fa1a80a0070 2024-09-18T01:46:21.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.842+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a318be06c0 con 0x7fa1a80a0070 2024-09-18T01:46:21.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.843+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(58 notify.7 [create] v33'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1ac00f610 con 0x7fa1a80a0070 2024-09-18T01:46:21.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.843+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94158983134704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a318be0d50 con 0x7fa1a80a0070 2024-09-18T01:46:21.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.843+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94158983131936] v33'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1ac00f610 con 0x7fa1a80a0070 2024-09-18T01:46:21.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.843+0000 7fa1bd230800 20 add_watcher() i=0 2024-09-18T01:46:21.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.843+0000 7fa1bd230800 20 add_watcher() i=1 2024-09-18T01:46:21.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.843+0000 7fa1bd230800 20 add_watcher() i=2 2024-09-18T01:46:21.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.843+0000 7fa1bd230800 20 add_watcher() i=3 2024-09-18T01:46:21.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.843+0000 7fa1bd230800 20 add_watcher() i=4 2024-09-18T01:46:21.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.843+0000 7fa1bd230800 20 add_watcher() i=5 2024-09-18T01:46:21.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.843+0000 7fa1bd230800 20 add_watcher() i=6 2024-09-18T01:46:21.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.844+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94158983134704] v33'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1ac00f610 con 0x7fa1a80a0070 2024-09-18T01:46:21.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.844+0000 7fa1bd230800 20 add_watcher() i=7 2024-09-18T01:46:21.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.844+0000 7fa1bd230800 2 all 8 watchers are set, enabling cache 2024-09-18T01:46:21.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.844+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a318be3c70 con 0x55a318bcfc00 2024-09-18T01:46:21.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.844+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa1ac00f610 con 0x55a318bcfc00 2024-09-18T01:46:21.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.844+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94158983137168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a318be1060 con 0x55a318bcfc00 2024-09-18T01:46:21.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.845+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94158983137168] v33'204 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa1ac00f610 con 0x55a318bcfc00 2024-09-18T01:46:21.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.845+0000 7fa06e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:46:21.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.845+0000 7fa1bd230800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:46:21.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.845+0000 7fa1bd230800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:46:21.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.845+0000 7fa1bd230800 5 note: GC not initialized 2024-09-18T01:46:21.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.846+0000 7fa06d7e2640 20 reqs_thread_entry: start 2024-09-18T01:46:21.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.846+0000 7fa1bd230800 20 init_complete bucket index max shards: 11 2024-09-18T01:46:21.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.846+0000 7fa1bd230800 20 Filter name: none 2024-09-18T01:46:21.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.846+0000 7f9fdeffd640 20 reqs_thread_entry: start 2024-09-18T01:46:21.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.846+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a318c17340 con 0x55a318bcfc00 2024-09-18T01:46:21.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.846+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fa1ac00f610 con 0x55a318bcfc00 2024-09-18T01:46:21.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.846+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a318c17340 con 0x7fa1b0008a10 2024-09-18T01:46:21.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.846+0000 7fa1b854b640 1 -- 172.21.15.146:0/1962009 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fa1a80af040 con 0x7fa1b0008a10 2024-09-18T01:46:21.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.846+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a318c17340 con 0x55a318bcfc00 2024-09-18T01:46:21.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.847+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fa1ac00f610 con 0x55a318bcfc00 2024-09-18T01:46:21.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.847+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a318c17300 con 0x55a318bd5e40 2024-09-18T01:46:21.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.847+0000 7fa1b8d4c640 1 -- 172.21.15.146:0/1962009 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fa1b003b030 con 0x55a318bd5e40 2024-09-18T01:46:21.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.847+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a318c17300 con 0x55a318bd5e40 2024-09-18T01:46:21.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.847+0000 7fa1b8d4c640 1 -- 172.21.15.146:0/1962009 <== osd.3 v2:172.21.15.146:6809/4106661138 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fa1b003b030 con 0x55a318bd5e40 2024-09-18T01:46:21.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.847+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a318c17300 con 0x55a318bd5e40 2024-09-18T01:46:21.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.847+0000 7fa1b8d4c640 1 -- 172.21.15.146:0/1962009 <== osd.3 v2:172.21.15.146:6809/4106661138 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fa1b003b030 con 0x55a318bd5e40 2024-09-18T01:46:21.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.847+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a318c17300 con 0x55a318bcfc00 2024-09-18T01:46:21.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.847+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fa1ac00f610 con 0x55a318bcfc00 2024-09-18T01:46:21.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.847+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a318c17300 con 0x55a318bcfc00 2024-09-18T01:46:21.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.848+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fa1ac00f610 con 0x55a318bcfc00 2024-09-18T01:46:21.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.848+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a318c17300 con 0x55a318bd5e40 2024-09-18T01:46:21.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.848+0000 7fa1b8d4c640 1 -- 172.21.15.146:0/1962009 <== osd.3 v2:172.21.15.146:6809/4106661138 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fa1b003b030 con 0x55a318bd5e40 2024-09-18T01:46:21.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.848+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a318c17300 con 0x55a318bd5e40 2024-09-18T01:46:21.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.848+0000 7fa1b8d4c640 1 -- 172.21.15.146:0/1962009 <== osd.3 v2:172.21.15.146:6809/4106661138 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fa1b003b030 con 0x55a318bd5e40 2024-09-18T01:46:21.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.848+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a318c17300 con 0x7fa1a80a0070 2024-09-18T01:46:21.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.849+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7fa1ac00f610 con 0x7fa1a80a0070 2024-09-18T01:46:21.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.849+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a318c18ec0 con 0x55a318bcfc00 2024-09-18T01:46:21.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.849+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fa1ac00f610 con 0x55a318bcfc00 2024-09-18T01:46:21.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.849+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a318c18ec0 con 0x7fa1b0008a10 2024-09-18T01:46:21.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.849+0000 7fa1b854b640 1 -- 172.21.15.146:0/1962009 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fa1a80af040 con 0x7fa1b0008a10 2024-09-18T01:46:21.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.849+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a318c18ec0 con 0x55a318bd5e40 2024-09-18T01:46:21.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.849+0000 7fa1b8d4c640 1 -- 172.21.15.146:0/1962009 <== osd.3 v2:172.21.15.146:6809/4106661138 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fa1b003b030 con 0x55a318bd5e40 2024-09-18T01:46:21.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.849+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a318c18ec0 con 0x7fa1a80a0070 2024-09-18T01:46:21.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.850+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fa1ac00f610 con 0x7fa1a80a0070 2024-09-18T01:46:21.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.850+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a318c18e70 con 0x7fa1a80a0070 2024-09-18T01:46:21.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.850+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fa1ac00f610 con 0x7fa1a80a0070 2024-09-18T01:46:21.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.850+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a318c18e70 con 0x55a318bd5e40 2024-09-18T01:46:21.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.850+0000 7fa1b8d4c640 1 -- 172.21.15.146:0/1962009 <== osd.3 v2:172.21.15.146:6809/4106661138 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fa1b003b030 con 0x55a318bd5e40 2024-09-18T01:46:21.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.850+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a318c18e70 con 0x7fa1a80a0070 2024-09-18T01:46:21.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.850+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) ==== 152+0+163 (crc 0 0 0) 0x7fa1ac00f610 con 0x7fa1a80a0070 2024-09-18T01:46:21.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.850+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a318c18e20 con 0x55a318bcfc00 2024-09-18T01:46:21.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.851+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fa1ac00f610 con 0x55a318bcfc00 2024-09-18T01:46:21.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.851+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a318c18e20 con 0x55a318bd5e40 2024-09-18T01:46:21.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.851+0000 7fa1b8d4c640 1 -- 172.21.15.146:0/1962009 <== osd.3 v2:172.21.15.146:6809/4106661138 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fa1b003b030 con 0x55a318bd5e40 2024-09-18T01:46:21.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.851+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a318c18e20 con 0x7fa1a80a0070 2024-09-18T01:46:21.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.851+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fa1ac00f610 con 0x7fa1a80a0070 2024-09-18T01:46:21.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.851+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a318c18e20 con 0x7fa1b0008a10 2024-09-18T01:46:21.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.851+0000 7fa1b854b640 1 -- 172.21.15.146:0/1962009 <== osd.2 v2:172.21.15.146:6800/3820039304 14 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fa1a80af040 con 0x7fa1b0008a10 2024-09-18T01:46:21.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.851+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a318c18e20 con 0x7fa1a80a0070 2024-09-18T01:46:21.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.852+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.0 v2:172.21.15.129:6800/1759265424 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fa1ac00f610 con 0x7fa1a80a0070 2024-09-18T01:46:21.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.852+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a318c18e20 con 0x55a318bcfc00 2024-09-18T01:46:21.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.852+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.1 v2:172.21.15.146:6808/3930274777 28 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fa1ac00f610 con 0x55a318bcfc00 2024-09-18T01:46:21.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.852+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a318c18e20 con 0x55a318bcfc00 2024-09-18T01:46:21.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.852+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.1 v2:172.21.15.146:6808/3930274777 29 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fa1ac00f610 con 0x55a318bcfc00 2024-09-18T01:46:21.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.852+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a318c18e20 con 0x55a318bd5e40 2024-09-18T01:46:21.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.853+0000 7fa1b8d4c640 1 -- 172.21.15.146:0/1962009 <== osd.3 v2:172.21.15.146:6809/4106661138 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fa1b003b030 con 0x55a318bd5e40 2024-09-18T01:46:21.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.853+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a318c18e20 con 0x55a318bcfc00 2024-09-18T01:46:21.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.853+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.1 v2:172.21.15.146:6808/3930274777 30 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fa1ac00f610 con 0x55a318bcfc00 2024-09-18T01:46:21.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.853+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a318c18e20 con 0x55a318bcfc00 2024-09-18T01:46:21.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.853+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.1 v2:172.21.15.146:6808/3930274777 31 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fa1ac00f610 con 0x55a318bcfc00 2024-09-18T01:46:21.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.853+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a318c18e20 con 0x55a318bd5e40 2024-09-18T01:46:21.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.853+0000 7fa1b8d4c640 1 -- 172.21.15.146:0/1962009 <== osd.3 v2:172.21.15.146:6809/4106661138 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fa1b003b030 con 0x55a318bd5e40 2024-09-18T01:46:21.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.853+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a318c18e20 con 0x55a318bd5e40 2024-09-18T01:46:21.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.853+0000 7fa1b8d4c640 1 -- 172.21.15.146:0/1962009 <== osd.3 v2:172.21.15.146:6809/4106661138 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fa1b003b030 con 0x55a318bd5e40 2024-09-18T01:46:21.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.853+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a318c18e20 con 0x55a318bd5e40 2024-09-18T01:46:21.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.853+0000 7fa1b8d4c640 1 -- 172.21.15.146:0/1962009 <== osd.3 v2:172.21.15.146:6809/4106661138 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fa1b003b030 con 0x55a318bd5e40 2024-09-18T01:46:21.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.854+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a318c18e20 con 0x7fa1a80a0070 2024-09-18T01:46:21.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.854+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.0 v2:172.21.15.129:6800/1759265424 23 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fa1ac00f610 con 0x7fa1a80a0070 2024-09-18T01:46:21.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.855+0000 7fa06e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:46:21.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.855+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94158983137168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a318c18970 con 0x55a318bcfc00 2024-09-18T01:46:21.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.856+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.1 v2:172.21.15.146:6808/3930274777 32 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94158983137168] v33'205 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa1ac00f610 con 0x55a318bcfc00 2024-09-18T01:46:21.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.856+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94158983110752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a318be0790 con 0x7fa1b0008a10 2024-09-18T01:46:21.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.857+0000 7fa1b854b640 1 -- 172.21.15.146:0/1962009 <== osd.2 v2:172.21.15.146:6800/3820039304 15 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94158983110752] v33'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1a80af040 con 0x7fa1b0008a10 2024-09-18T01:46:21.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.857+0000 7fa1bd230800 20 remove_watcher() i=0 2024-09-18T01:46:21.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.857+0000 7fa1bd230800 2 removed watcher, disabling cache 2024-09-18T01:46:21.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.857+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94158983117856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a318be0790 con 0x55a318bcfc00 2024-09-18T01:46:21.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.858+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.1 v2:172.21.15.146:6808/3930274777 33 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94158983117856] v33'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1ac00f610 con 0x55a318bcfc00 2024-09-18T01:46:21.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.858+0000 7fa1bd230800 20 remove_watcher() i=1 2024-09-18T01:46:21.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.858+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94158983121888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a318bdbc20 con 0x55a318bd5e40 2024-09-18T01:46:21.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.859+0000 7fa1b8d4c640 1 -- 172.21.15.146:0/1962009 <== osd.3 v2:172.21.15.146:6809/4106661138 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94158983121888] v33'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1b003b030 con 0x55a318bd5e40 2024-09-18T01:46:21.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.859+0000 7fa1bd230800 20 remove_watcher() i=2 2024-09-18T01:46:21.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.859+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94158983118912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a318be0790 con 0x7fa1b0008a10 2024-09-18T01:46:21.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.860+0000 7fa1b854b640 1 -- 172.21.15.146:0/1962009 <== osd.2 v2:172.21.15.146:6800/3820039304 16 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94158983118912] v33'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1a80af040 con 0x7fa1b0008a10 2024-09-18T01:46:21.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.860+0000 7fa1bd230800 20 remove_watcher() i=3 2024-09-18T01:46:21.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.860+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94158983128064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a318bdcbe0 con 0x55a318bcfc00 2024-09-18T01:46:21.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.861+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.1 v2:172.21.15.146:6808/3930274777 34 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94158983128064] v33'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1ac00f610 con 0x55a318bcfc00 2024-09-18T01:46:21.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.861+0000 7fa1bd230800 20 remove_watcher() i=4 2024-09-18T01:46:21.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.861+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94158983130192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a318be0790 con 0x7fa1a80a0070 2024-09-18T01:46:21.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.862+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.0 v2:172.21.15.129:6800/1759265424 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94158983130192] v33'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1ac00f610 con 0x7fa1a80a0070 2024-09-18T01:46:21.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.862+0000 7fa1bd230800 20 remove_watcher() i=5 2024-09-18T01:46:21.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.862+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94158983131936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a318bde400 con 0x7fa1a80a0070 2024-09-18T01:46:21.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.863+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.0 v2:172.21.15.129:6800/1759265424 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94158983131936] v33'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1ac00f610 con 0x7fa1a80a0070 2024-09-18T01:46:21.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.863+0000 7fa1bd230800 20 remove_watcher() i=6 2024-09-18T01:46:21.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.863+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94158983134704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a318bde400 con 0x7fa1a80a0070 2024-09-18T01:46:21.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.865+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 <== osd.0 v2:172.21.15.129:6800/1759265424 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94158983134704] v33'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1ac00f610 con 0x7fa1a80a0070 2024-09-18T01:46:21.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.865+0000 7fa1bd230800 20 remove_watcher() i=7 2024-09-18T01:46:21.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.865+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fa1a80a0070 msgr2=0x7fa1a804f360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:21.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.865+0000 7fa1bd230800 1 --2- 172.21.15.146:0/1962009 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fa1a80a0070 0x7fa1a804f360 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:21.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.865+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a318bcfc00 msgr2=0x55a318bd20c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:21.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.865+0000 7fa1bd230800 1 --2- 172.21.15.146:0/1962009 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a318bcfc00 0x55a318bd20c0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:21.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.865+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fa1b0008a10 msgr2=0x7fa1b004ebb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:21.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.865+0000 7fa1bd230800 1 --2- 172.21.15.146:0/1962009 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fa1b0008a10 0x7fa1b004ebb0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:21.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.865+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55a318bd5e40 msgr2=0x55a318bd8230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:21.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.865+0000 7fa1bd230800 1 --2- 172.21.15.146:0/1962009 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55a318bd5e40 0x55a318bd8230 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:21.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.865+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fa080036b40 msgr2=0x7fa080039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:21.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.865+0000 7fa1bd230800 1 --2- 172.21.15.146:0/1962009 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fa080036b40 0x7fa080039000 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa1a8064930 tx=0x7fa1a808c000 comp rx=0 tx=0).stop 2024-09-18T01:46:21.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.865+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a318bbcb90 msgr2=0x55a318bc4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:21.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.865+0000 7fa1b7d4a640 1 -- 172.21.15.146:0/1962009 reap_dead start 2024-09-18T01:46:21.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.865+0000 7fa1bd230800 1 --2- 172.21.15.146:0/1962009 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a318bbcb90 0x55a318bc4000 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fa1b004c9f0 tx=0x7fa1b004c980 comp rx=0 tx=0).stop 2024-09-18T01:46:21.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.865+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 shutdown_connections 2024-09-18T01:46:21.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.865+0000 7fa1bd230800 1 --2- 172.21.15.146:0/1962009 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a318bbcb90 0x55a318bc4000 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:21.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.865+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 >> 172.21.15.146:0/1962009 conn(0x55a318bb8ef0 msgr2=0x55a318bb6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:21.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.865+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 shutdown_connections 2024-09-18T01:46:21.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.865+0000 7fa1bd230800 1 -- 172.21.15.146:0/1962009 wait complete. 2024-09-18T01:46:21.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.865+0000 7fa1bd230800 1 -- 172.21.15.146:0/961568134 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fa090036b40 msgr2=0x7fa090039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:21.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.865+0000 7fa1bd230800 1 --2- 172.21.15.146:0/961568134 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fa090036b40 0x7fa090039000 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x55a318ba2530 tx=0x7fa1a808f550 comp rx=0 tx=0).stop 2024-09-18T01:46:21.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.865+0000 7fa1bd230800 1 -- 172.21.15.146:0/961568134 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a318bafec0 msgr2=0x55a318bb02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:21.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.865+0000 7fa1bd230800 1 --2- 172.21.15.146:0/961568134 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a318bafec0 0x55a318bb02e0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x55a318b9cb10 tx=0x7fa1b00178e0 comp rx=0 tx=0).stop 2024-09-18T01:46:21.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.865+0000 7fa1bd230800 1 -- 172.21.15.146:0/961568134 shutdown_connections 2024-09-18T01:46:21.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.865+0000 7fa1bd230800 1 --2- 172.21.15.146:0/961568134 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fa090036b40 0x7fa090039000 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:21.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.865+0000 7fa1bd230800 1 --2- 172.21.15.146:0/961568134 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a318bafec0 0x55a318bb02e0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:21.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.865+0000 7fa1bd230800 1 -- 172.21.15.146:0/961568134 >> 172.21.15.146:0/961568134 conn(0x55a318ba4e50 msgr2=0x55a318ba79d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:21.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.866+0000 7fa1bd230800 1 -- 172.21.15.146:0/961568134 shutdown_connections 2024-09-18T01:46:21.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.866+0000 7fa1bd230800 1 -- 172.21.15.146:0/961568134 wait complete. 2024-09-18T01:46:21.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.866+0000 7fa1bd230800 1 -- 172.21.15.146:0/1973661348 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a318a9de80 msgr2=0x55a318b9c1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:21.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.866+0000 7fa1bd230800 1 --2- 172.21.15.146:0/1973661348 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a318a9de80 0x55a318b9c1b0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:21.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.866+0000 7fa1bd230800 1 -- 172.21.15.146:0/1973661348 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55a318b9e160 msgr2=0x55a318ba19a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:21.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.866+0000 7fa1bd230800 1 --2- 172.21.15.146:0/1973661348 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55a318b9e160 0x55a318ba19a0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:21.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.866+0000 7fa1bd230800 1 -- 172.21.15.146:0/1973661348 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fa0a0036b90 msgr2=0x7fa0a0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:21.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.866+0000 7fa1bd230800 1 --2- 172.21.15.146:0/1973661348 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fa0a0036b90 0x7fa0a0039050 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac000f60 tx=0x7fa1ac001370 comp rx=0 tx=0).stop 2024-09-18T01:46:21.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.866+0000 7fa1bd230800 1 -- 172.21.15.146:0/1973661348 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a318a9d540 msgr2=0x55a318b95140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:21.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.866+0000 7fa1bd230800 1 --2- 172.21.15.146:0/1973661348 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a318a9d540 0x55a318b95140 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fa1a8067040 tx=0x7fa1a8002fb0 comp rx=0 tx=0).stop 2024-09-18T01:46:21.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.866+0000 7fa1bd230800 1 -- 172.21.15.146:0/1973661348 shutdown_connections 2024-09-18T01:46:21.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.866+0000 7fa1bd230800 1 --2- 172.21.15.146:0/1973661348 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55a318b9e160 0x55a318ba19a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:21.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.866+0000 7fa1bd230800 1 --2- 172.21.15.146:0/1973661348 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a318a9de80 0x55a318b9c1b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:21.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.866+0000 7fa1bd230800 1 --2- 172.21.15.146:0/1973661348 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fa0a0036b90 0x7fa0a0039050 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:21.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.866+0000 7fa1bd230800 1 --2- 172.21.15.146:0/1973661348 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a318a9d540 0x55a318b95140 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:21.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.866+0000 7fa1bd230800 1 -- 172.21.15.146:0/1973661348 >> 172.21.15.146:0/1973661348 conn(0x55a318a98dd0 msgr2=0x55a318b869b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:21.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.866+0000 7fa1bd230800 1 -- 172.21.15.146:0/1973661348 shutdown_connections 2024-09-18T01:46:21.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.866+0000 7fa1bd230800 1 -- 172.21.15.146:0/1973661348 wait complete. 2024-09-18T01:46:21.876 INFO:teuthology.orchestra.run.smithi146.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}]}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"total":{"bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}},{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2024-09-18T01:46:21.877 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-09-18T01:46:21.877 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-18T01:46:21.877 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-18T01:46:21.877 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-18T01:46:21.961 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:46:21.961 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:46:21.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.961+0000 7f1bd0015800 1 Processor -- start 2024-09-18T01:46:21.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.961+0000 7f1bd0015800 1 -- start start 2024-09-18T01:46:21.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.961+0000 7f1bd0015800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55b048ed98f0 0x55b048edbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:21.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.961+0000 7f1bd0015800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b048d94b30 con 0x55b048e496b0 2024-09-18T01:46:21.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.961+0000 7f1bd0015800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x55b048d76360 con 0x55b048ed98f0 2024-09-18T01:46:21.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.961+0000 7f1bcaf9b640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55b048ed98f0 0x55b048edbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:21.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.961+0000 7f1bcaf9b640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55b048ed98f0 0x55b048edbd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:43786/0 (socket says 172.21.15.146:43786) 2024-09-18T01:46:21.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.961+0000 7f1bcb79c640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x55b048e496b0 0x55b048ed81d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:49880/0 (socket says 172.21.15.146:49880) 2024-09-18T01:46:21.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.961+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/3214152290 learned_addr learned my addr 172.21.15.146:0/3214152290 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:21.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.962+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/3214152290 >> v1:172.21.15.129:6789/0 conn(0x55b048e496b0 legacy=0x55b048ed81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:21.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.962+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/3214152290 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b048d9ce00 con 0x55b048ed98f0 2024-09-18T01:46:21.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.963+0000 7f1bcaf9b640 1 --2- 172.21.15.146:0/3214152290 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b048ed98f0 0x55b048edbd00 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f1bc000a520 tx=0x7f1bc0045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2276b729360b9380 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:21.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.964+0000 7f1bca79a640 1 -- 172.21.15.146:0/3214152290 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bc0055070 con 0x55b048ed98f0 2024-09-18T01:46:21.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.964+0000 7f1bca79a640 1 -- 172.21.15.146:0/3214152290 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bc00515b0 con 0x55b048ed98f0 2024-09-18T01:46:21.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.964+0000 7f1bca79a640 1 -- 172.21.15.146:0/3214152290 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bc00518d0 con 0x55b048ed98f0 2024-09-18T01:46:21.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.964+0000 7f1bd0015800 1 -- 172.21.15.146:0/3214152290 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b048ed98f0 msgr2=0x55b048edbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:21.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.964+0000 7f1bd0015800 1 --2- 172.21.15.146:0/3214152290 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b048ed98f0 0x55b048edbd00 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f1bc000a520 tx=0x7f1bc0045ba0 comp rx=0 tx=0).stop 2024-09-18T01:46:21.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.964+0000 7f1bd0015800 1 -- 172.21.15.146:0/3214152290 shutdown_connections 2024-09-18T01:46:21.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.964+0000 7f1bd0015800 1 --2- 172.21.15.146:0/3214152290 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b048ed98f0 0x55b048edbd00 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:21.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.964+0000 7f1bd0015800 1 -- 172.21.15.146:0/3214152290 >> 172.21.15.146:0/3214152290 conn(0x55b048ecfde0 msgr2=0x55b048ed2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:21.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.964+0000 7f1bd0015800 1 -- 172.21.15.146:0/3214152290 shutdown_connections 2024-09-18T01:46:21.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.964+0000 7f1bd0015800 1 -- 172.21.15.146:0/3214152290 wait complete. 2024-09-18T01:46:21.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.977+0000 7f1bd0015800 1 Processor -- start 2024-09-18T01:46:21.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.978+0000 7f1bd0015800 1 -- start start 2024-09-18T01:46:21.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.978+0000 7f1bd0015800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b048e496b0 0x55b048ed5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:21.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.978+0000 7f1bd0015800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55b048e21330 con 0x55b048e496b0 2024-09-18T01:46:21.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.978+0000 7f1bcb79c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b048e496b0 0x55b048ed5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:21.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.978+0000 7f1bcb79c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b048e496b0 0x55b048ed5b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:43792/0 (socket says 172.21.15.146:43792) 2024-09-18T01:46:21.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.978+0000 7f1bcb79c640 1 -- 172.21.15.146:0/3488611458 learned_addr learned my addr 172.21.15.146:0/3488611458 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:21.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.978+0000 7f1bcb79c640 1 -- 172.21.15.146:0/3488611458 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b048d6ebc0 con 0x55b048e496b0 2024-09-18T01:46:21.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.979+0000 7f1bcb79c640 1 --2- 172.21.15.146:0/3488611458 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b048e496b0 0x55b048ed5b00 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc00b230 tx=0x7f1bbc00b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd859dd72867b663 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:21.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.979+0000 7f1ab960a640 1 -- 172.21.15.146:0/3488611458 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bbc00e5c0 con 0x55b048e496b0 2024-09-18T01:46:21.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.979+0000 7f1ab960a640 1 -- 172.21.15.146:0/3488611458 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bbc006070 con 0x55b048e496b0 2024-09-18T01:46:21.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.979+0000 7f1ab960a640 1 -- 172.21.15.146:0/3488611458 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bbc00e890 con 0x55b048e496b0 2024-09-18T01:46:21.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.979+0000 7f1bd0015800 1 -- 172.21.15.146:0/3488611458 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b048e496b0 msgr2=0x55b048ed5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:21.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.979+0000 7f1bd0015800 1 --2- 172.21.15.146:0/3488611458 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b048e496b0 0x55b048ed5b00 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc00b230 tx=0x7f1bbc00b6f0 comp rx=0 tx=0).stop 2024-09-18T01:46:21.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.979+0000 7f1bd0015800 1 -- 172.21.15.146:0/3488611458 shutdown_connections 2024-09-18T01:46:21.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.979+0000 7f1bd0015800 1 --2- 172.21.15.146:0/3488611458 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b048e496b0 0x55b048ed5b00 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:21.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.979+0000 7f1bd0015800 1 -- 172.21.15.146:0/3488611458 >> 172.21.15.146:0/3488611458 conn(0x55b048ecfde0 msgr2=0x55b048fc0240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:21.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.980+0000 7f1bd0015800 1 -- 172.21.15.146:0/3488611458 shutdown_connections 2024-09-18T01:46:21.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.980+0000 7f1bd0015800 1 -- 172.21.15.146:0/3488611458 wait complete. 2024-09-18T01:46:21.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.980+0000 7f1bd0015800 1 Processor -- start 2024-09-18T01:46:21.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.980+0000 7f1bd0015800 1 -- start start 2024-09-18T01:46:21.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.980+0000 7f1bd0015800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b048e496b0 0x55b048fce540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:21.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.980+0000 7f1bd0015800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55b048edc680 con 0x55b048e496b0 2024-09-18T01:46:21.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.980+0000 7f1bcb79c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b048e496b0 0x55b048fce540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:21.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.980+0000 7f1bcb79c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b048e496b0 0x55b048fce540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:43800/0 (socket says 172.21.15.146:43800) 2024-09-18T01:46:21.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.980+0000 7f1bcb79c640 1 -- 172.21.15.146:0/1914677641 learned_addr learned my addr 172.21.15.146:0/1914677641 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:21.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.980+0000 7f1bcb79c640 1 -- 172.21.15.146:0/1914677641 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b048d82fe0 con 0x55b048e496b0 2024-09-18T01:46:21.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.981+0000 7f1bcb79c640 1 --2- 172.21.15.146:0/1914677641 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b048e496b0 0x55b048fce540 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc000fd0 tx=0x7f1bbc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:21.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.981+0000 7f1ab7e07640 1 -- 172.21.15.146:0/1914677641 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bbc00f8d0 con 0x55b048e496b0 2024-09-18T01:46:21.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.981+0000 7f1ab7e07640 1 -- 172.21.15.146:0/1914677641 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bbc00fa90 con 0x55b048e496b0 2024-09-18T01:46:21.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.981+0000 7f1ab7e07640 1 -- 172.21.15.146:0/1914677641 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bbc00fdb0 con 0x55b048e496b0 2024-09-18T01:46:21.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.981+0000 7f1bd0015800 1 -- 172.21.15.146:0/1914677641 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b048fcea80 con 0x55b048e496b0 2024-09-18T01:46:21.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.981+0000 7f1bd0015800 1 -- 172.21.15.146:0/1914677641 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b048fcefa0 con 0x55b048e496b0 2024-09-18T01:46:21.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.982+0000 7f1ab7e07640 1 -- 172.21.15.146:0/1914677641 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1bbc017070 con 0x55b048e496b0 2024-09-18T01:46:21.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.982+0000 7f1ab7e07640 1 --2- 172.21.15.146:0/1914677641 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1ab0036b90 0x7f1ab0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:21.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.982+0000 7f1ab7e07640 1 -- 172.21.15.146:0/1914677641 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f1bbc015020 con 0x55b048e496b0 2024-09-18T01:46:21.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.982+0000 7f1bcaf9b640 1 --2- 172.21.15.146:0/1914677641 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1ab0036b90 0x7f1ab0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:21.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.982+0000 7f1bd0015800 1 --2- 172.21.15.146:0/1914677641 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55b048ed98f0 0x55b048fd55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:21.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.982+0000 7f1bd0015800 1 -- 172.21.15.146:0/1914677641 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b048fd5b30 con 0x55b048ed98f0 2024-09-18T01:46:21.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.982+0000 7f1bcbf9d640 1 --2- 172.21.15.146:0/1914677641 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55b048ed98f0 0x55b048fd55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:21.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.982+0000 7f1bcaf9b640 1 --2- 172.21.15.146:0/1914677641 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1ab0036b90 0x7f1ab0039050 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0057000 tx=0x7f1bc0052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:21.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.983+0000 7f1bcbf9d640 1 --2- 172.21.15.146:0/1914677641 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55b048ed98f0 0x55b048fd55b0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:21.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.983+0000 7f1bcbf9d640 1 -- 172.21.15.146:0/1914677641 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1bc400a4a0 con 0x55b048ed98f0 2024-09-18T01:46:21.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.983+0000 7f1bd0015800 1 -- 172.21.15.146:0/1914677641 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b048fd2b80 con 0x55b048ed98f0 2024-09-18T01:46:21.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.983+0000 7f1bcbf9d640 1 -- 172.21.15.146:0/1914677641 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1bc400a4a0 con 0x55b048ed98f0 2024-09-18T01:46:21.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.983+0000 7f1bd0015800 1 -- 172.21.15.146:0/1914677641 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b048fd7950 con 0x55b048ed98f0 2024-09-18T01:46:21.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.983+0000 7f1bcbf9d640 1 -- 172.21.15.146:0/1914677641 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1bc400a4a0 con 0x55b048ed98f0 2024-09-18T01:46:21.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.983+0000 7f1bd0015800 1 -- 172.21.15.146:0/1914677641 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b048fd6b80 con 0x55b048ed98f0 2024-09-18T01:46:21.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.984+0000 7f1bcbf9d640 1 -- 172.21.15.146:0/1914677641 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1bc400a4a0 con 0x55b048ed98f0 2024-09-18T01:46:21.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.984+0000 7f1bd0015800 1 --2- 172.21.15.146:0/1914677641 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55b048fd8d00 0x55b048fdb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:21.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.984+0000 7f1bd0015800 1 -- 172.21.15.146:0/1914677641 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b048fdb630 con 0x55b048fd8d00 2024-09-18T01:46:21.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.984+0000 7f1bcb79c640 1 --2- 172.21.15.146:0/1914677641 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55b048fd8d00 0x55b048fdb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:21.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.984+0000 7f1bcb79c640 1 --2- 172.21.15.146:0/1914677641 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55b048fd8d00 0x55b048fdb0f0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:21.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.984+0000 7f1bcb79c640 1 -- 172.21.15.146:0/1914677641 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1bbc02e070 con 0x55b048fd8d00 2024-09-18T01:46:21.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.985+0000 7f1bd0015800 1 Processor -- start 2024-09-18T01:46:21.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.985+0000 7f1bd0015800 1 -- start start 2024-09-18T01:46:21.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.985+0000 7f1bd0015800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b048fe9230 0x55b048fe9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:21.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.985+0000 7f1bd0015800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55b048d70580 con 0x55b048fe9230 2024-09-18T01:46:21.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.985+0000 7f1bcbf9d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b048fe9230 0x55b048fe9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:21.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.985+0000 7f1bcbf9d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b048fe9230 0x55b048fe9650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:43812/0 (socket says 172.21.15.146:43812) 2024-09-18T01:46:21.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.985+0000 7f1bcbf9d640 1 -- 172.21.15.146:0/3255096922 learned_addr learned my addr 172.21.15.146:0/3255096922 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:21.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.985+0000 7f1bcbf9d640 1 -- 172.21.15.146:0/3255096922 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b048fe9b90 con 0x55b048fe9230 2024-09-18T01:46:21.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.985+0000 7f1bcbf9d640 1 --2- 172.21.15.146:0/3255096922 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b048fe9230 0x55b048fe9650 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x55b048fcf940 tx=0x7f1bc40178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:21.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.986+0000 7f1ab5602640 1 -- 172.21.15.146:0/3255096922 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bc4013440 con 0x55b048fe9230 2024-09-18T01:46:21.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.986+0000 7f1ab5602640 1 -- 172.21.15.146:0/3255096922 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bc40135e0 con 0x55b048fe9230 2024-09-18T01:46:21.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.986+0000 7f1bd0015800 1 -- 172.21.15.146:0/3255096922 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b048fe9e20 con 0x55b048fe9230 2024-09-18T01:46:21.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.986+0000 7f1ab5602640 1 -- 172.21.15.146:0/3255096922 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bc40138c0 con 0x55b048fe9230 2024-09-18T01:46:21.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.986+0000 7f1bd0015800 1 -- 172.21.15.146:0/3255096922 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b048fecb00 con 0x55b048fe9230 2024-09-18T01:46:21.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.986+0000 7f1ab5602640 1 -- 172.21.15.146:0/3255096922 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1bc4011040 con 0x55b048fe9230 2024-09-18T01:46:21.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.987+0000 7f1ab5602640 1 --2- 172.21.15.146:0/3255096922 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1aa4036b90 0x7f1aa4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:21.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.987+0000 7f1ab5602640 1 -- 172.21.15.146:0/3255096922 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f1bc401d070 con 0x55b048fe9230 2024-09-18T01:46:21.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.987+0000 7f1bcb79c640 1 --2- 172.21.15.146:0/3255096922 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1aa4036b90 0x7f1aa4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:21.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.987+0000 7f1bd0015800 1 Processor -- start 2024-09-18T01:46:21.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.987+0000 7f1bcb79c640 1 --2- 172.21.15.146:0/3255096922 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1aa4036b90 0x7f1aa4039050 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc01dfd0 tx=0x7f1bbc01d450 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:21.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.987+0000 7f1bd0015800 1 -- start start 2024-09-18T01:46:21.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.987+0000 7f1bd0015800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b048ff5ed0 0x55b048ff62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:21.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.987+0000 7f1bd0015800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55b048ed41d0 con 0x55b048ff5ed0 2024-09-18T01:46:21.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.988+0000 7f1bcbf9d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b048ff5ed0 0x55b048ff62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:21.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.988+0000 7f1bcbf9d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b048ff5ed0 0x55b048ff62d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:43820/0 (socket says 172.21.15.146:43820) 2024-09-18T01:46:21.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.988+0000 7f1bcbf9d640 1 -- 172.21.15.146:0/4177707038 learned_addr learned my addr 172.21.15.146:0/4177707038 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:21.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.988+0000 7f1bcbf9d640 1 -- 172.21.15.146:0/4177707038 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b048ff68a0 con 0x55b048ff5ed0 2024-09-18T01:46:21.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.988+0000 7f1bcbf9d640 1 --2- 172.21.15.146:0/4177707038 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b048ff5ed0 0x55b048ff62d0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f1bc404c8c0 tx=0x7f1bc4001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb459f7742bd0c54 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:21.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.988+0000 7f1aaeffd640 1 -- 172.21.15.146:0/4177707038 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bc4027040 con 0x55b048ff5ed0 2024-09-18T01:46:21.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.988+0000 7f1aaeffd640 1 -- 172.21.15.146:0/4177707038 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bc4012cc0 con 0x55b048ff5ed0 2024-09-18T01:46:21.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.988+0000 7f1aaeffd640 1 -- 172.21.15.146:0/4177707038 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bc404b250 con 0x55b048ff5ed0 2024-09-18T01:46:21.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.989+0000 7f1bd0015800 1 -- 172.21.15.146:0/4177707038 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b048ff5ed0 msgr2=0x55b048ff62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:21.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.989+0000 7f1bd0015800 1 --2- 172.21.15.146:0/4177707038 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b048ff5ed0 0x55b048ff62d0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f1bc404c8c0 tx=0x7f1bc4001940 comp rx=0 tx=0).stop 2024-09-18T01:46:21.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.989+0000 7f1bd0015800 1 -- 172.21.15.146:0/4177707038 shutdown_connections 2024-09-18T01:46:21.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.989+0000 7f1bd0015800 1 --2- 172.21.15.146:0/4177707038 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b048ff5ed0 0x55b048ff62d0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:21.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.989+0000 7f1bd0015800 1 -- 172.21.15.146:0/4177707038 >> 172.21.15.146:0/4177707038 conn(0x55b048ff2230 msgr2=0x55b048ff0330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:21.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.989+0000 7f1bd0015800 1 -- 172.21.15.146:0/4177707038 shutdown_connections 2024-09-18T01:46:21.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.989+0000 7f1bd0015800 1 -- 172.21.15.146:0/4177707038 wait complete. 2024-09-18T01:46:21.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.989+0000 7f1bd0015800 1 Processor -- start 2024-09-18T01:46:21.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.989+0000 7f1bd0015800 1 -- start start 2024-09-18T01:46:21.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.989+0000 7f1bd0015800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b048ff5ed0 0x55b048ffd340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:21.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.989+0000 7f1bd0015800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55b048ff6f10 con 0x55b048ff5ed0 2024-09-18T01:46:21.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.989+0000 7f1bcbf9d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b048ff5ed0 0x55b048ffd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:21.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.989+0000 7f1bcbf9d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b048ff5ed0 0x55b048ffd340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:43836/0 (socket says 172.21.15.146:43836) 2024-09-18T01:46:21.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.989+0000 7f1bcbf9d640 1 -- 172.21.15.146:0/1778890545 learned_addr learned my addr 172.21.15.146:0/1778890545 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:21.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.990+0000 7f1bcbf9d640 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b048ffd880 con 0x55b048ff5ed0 2024-09-18T01:46:21.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.990+0000 7f1bcbf9d640 1 --2- 172.21.15.146:0/1778890545 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b048ff5ed0 0x55b048ffd340 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4001df0 tx=0x7f1bc404c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:21.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.990+0000 7f1aad7fa640 1 -- 172.21.15.146:0/1778890545 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bc4027070 con 0x55b048ff5ed0 2024-09-18T01:46:21.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.990+0000 7f1aad7fa640 1 -- 172.21.15.146:0/1778890545 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bc40015f0 con 0x55b048ff5ed0 2024-09-18T01:46:21.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.990+0000 7f1bd0015800 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b048ffdb10 con 0x55b048ff5ed0 2024-09-18T01:46:21.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.990+0000 7f1aad7fa640 1 -- 172.21.15.146:0/1778890545 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bc402aa60 con 0x55b048ff5ed0 2024-09-18T01:46:21.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.990+0000 7f1bd0015800 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0490007c0 con 0x55b048ff5ed0 2024-09-18T01:46:21.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.991+0000 7f1aad7fa640 1 -- 172.21.15.146:0/1778890545 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1bc402ac00 con 0x55b048ff5ed0 2024-09-18T01:46:21.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.991+0000 7f1aad7fa640 1 --2- 172.21.15.146:0/1778890545 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1a94036b40 0x7f1a94039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:21.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.991+0000 7f1aad7fa640 1 -- 172.21.15.146:0/1778890545 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f1bc4033070 con 0x55b048ff5ed0 2024-09-18T01:46:21.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.991+0000 7f1bcb79c640 1 --2- 172.21.15.146:0/1778890545 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1a94036b40 0x7f1a94039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:21.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.991+0000 7f1bd0015800 20 rados->read ofs=0 len=0 2024-09-18T01:46:21.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.991+0000 7f1bd0015800 1 --2- 172.21.15.146:0/1778890545 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55b049008fe0 0x55b04900b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:21.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.991+0000 7f1bd0015800 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b04900bbf0 con 0x55b049008fe0 2024-09-18T01:46:22.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.991+0000 7f1bcaf9b640 1 --2- 172.21.15.146:0/1778890545 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55b049008fe0 0x55b04900b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.991+0000 7f1bcb79c640 1 --2- 172.21.15.146:0/1778890545 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1a94036b40 0x7f1a94039000 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc0197f0 tx=0x7f1bbc04d000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.992+0000 7f1bcaf9b640 1 --2- 172.21.15.146:0/1778890545 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55b049008fe0 0x55b04900b4a0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.992+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1bc0057030 con 0x55b049008fe0 2024-09-18T01:46:22.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.992+0000 7f1bd0015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:22.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.992+0000 7f1bd0015800 20 realm 2024-09-18T01:46:22.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.992+0000 7f1bd0015800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.992+0000 7f1bd0015800 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b04900c020 con 0x55b049008fe0 2024-09-18T01:46:22.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.992+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1bc0057030 con 0x55b049008fe0 2024-09-18T01:46:22.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.992+0000 7f1bd0015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:22.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.992+0000 7f1bd0015800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:46:22.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.992+0000 7f1bd0015800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.992+0000 7f1bd0015800 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b04900c8c0 con 0x55b049008fe0 2024-09-18T01:46:22.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.992+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1bc0057030 con 0x55b049008fe0 2024-09-18T01:46:22.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.992+0000 7f1bd0015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:22.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.992+0000 7f1bd0015800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.992+0000 7f1bd0015800 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b04900cc60 con 0x55b049008fe0 2024-09-18T01:46:22.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.993+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1bc0057030 con 0x55b049008fe0 2024-09-18T01:46:22.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.993+0000 7f1bd0015800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:46:22.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.993+0000 7f1bd0015800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.993+0000 7f1bd0015800 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b04900c510 con 0x55b049008fe0 2024-09-18T01:46:22.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.993+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1bc0057030 con 0x55b049008fe0 2024-09-18T01:46:22.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.993+0000 7f1bd0015800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:46:22.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.993+0000 7f1bd0015800 20 searching for the correct realm 2024-09-18T01:46:22.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.993+0000 7f1bd0015800 1 --2- 172.21.15.146:0/1778890545 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55b04900f110 0x55b049011520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.993+0000 7f1bd0015800 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b049011bf0 con 0x55b04900f110 2024-09-18T01:46:22.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.993+0000 7f1bcbf9d640 1 --2- 172.21.15.146:0/1778890545 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55b04900f110 0x55b049011520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.993+0000 7f1bcbf9d640 1 --2- 172.21.15.146:0/1778890545 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55b04900f110 0x55b049011520 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.993+0000 7f1bcbf9d640 1 -- 172.21.15.146:0/1778890545 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bc4057040 con 0x55b04900f110 2024-09-18T01:46:22.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.993+0000 7f1bcbf9d640 1 --2- 172.21.15.146:0/1778890545 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f1bc40123a0 0x7f1bc4036580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.993+0000 7f1bcbf9d640 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b049011bf0 con 0x7f1bc40123a0 2024-09-18T01:46:22.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.994+0000 7f1bcb79c640 1 --2- 172.21.15.146:0/1778890545 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f1bc40123a0 0x7f1bc4036580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.994+0000 7f1bcb79c640 1 --2- 172.21.15.146:0/1778890545 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f1bc40123a0 0x7f1bc4036580 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.994+0000 7f1bcb79c640 1 -- 172.21.15.146:0/1778890545 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bbc02e070 con 0x7f1bc40123a0 2024-09-18T01:46:22.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.994+0000 7f1bcb79c640 1 --2- 172.21.15.146:0/1778890545 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f1bbc00f070 0x7f1bbc04b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.994+0000 7f1bcb79c640 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b049011bf0 con 0x7f1bbc00f070 2024-09-18T01:46:22.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.994+0000 7f1bcaf9b640 1 --2- 172.21.15.146:0/1778890545 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f1bbc00f070 0x7f1bbc04b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.995+0000 7f1bcaf9b640 1 --2- 172.21.15.146:0/1778890545 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f1bbc00f070 0x7f1bbc04b7f0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.995+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bc0057030 con 0x7f1bbc00f070 2024-09-18T01:46:22.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.995+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b049011bf0 con 0x55b049008fe0 2024-09-18T01:46:22.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.995+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1bc0057030 con 0x55b049008fe0 2024-09-18T01:46:22.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.995+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b049011bf0 con 0x55b049008fe0 2024-09-18T01:46:22.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.995+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bc0057030 con 0x55b049008fe0 2024-09-18T01:46:22.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.995+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b049011bf0 con 0x7f1bbc00f070 2024-09-18T01:46:22.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.996+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bc0057030 con 0x7f1bbc00f070 2024-09-18T01:46:22.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.996+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b049011bf0 con 0x7f1bbc00f070 2024-09-18T01:46:22.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.996+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bc0057030 con 0x7f1bbc00f070 2024-09-18T01:46:22.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.996+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b049011bf0 con 0x7f1bc40123a0 2024-09-18T01:46:22.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.996+0000 7f1bcb79c640 1 -- 172.21.15.146:0/1778890545 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bbc02e070 con 0x7f1bc40123a0 2024-09-18T01:46:22.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.996+0000 7f1bcb79c640 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b049011bf0 con 0x55b04900f110 2024-09-18T01:46:22.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.996+0000 7f1bcbf9d640 1 -- 172.21.15.146:0/1778890545 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bc4057040 con 0x55b04900f110 2024-09-18T01:46:22.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.996+0000 7f1bcbf9d640 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b049011bf0 con 0x55b049008fe0 2024-09-18T01:46:22.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.997+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bc0057030 con 0x55b049008fe0 2024-09-18T01:46:22.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.997+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b049011bf0 con 0x7f1bbc00f070 2024-09-18T01:46:22.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.997+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bc0057030 con 0x7f1bbc00f070 2024-09-18T01:46:22.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.997+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b049011bf0 con 0x55b049008fe0 2024-09-18T01:46:22.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.997+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bc0057030 con 0x55b049008fe0 2024-09-18T01:46:22.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.997+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b049011bf0 con 0x7f1bc40123a0 2024-09-18T01:46:22.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.998+0000 7f1bcb79c640 1 -- 172.21.15.146:0/1778890545 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f1bbc02e070 con 0x7f1bc40123a0 2024-09-18T01:46:22.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.998+0000 7f1bcb79c640 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b049011bf0 con 0x55b04900f110 2024-09-18T01:46:22.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.998+0000 7f1bcbf9d640 1 -- 172.21.15.146:0/1778890545 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bc4057040 con 0x55b04900f110 2024-09-18T01:46:22.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.998+0000 7f1bcbf9d640 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b049011bf0 con 0x55b04900f110 2024-09-18T01:46:22.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.998+0000 7f1bcbf9d640 1 -- 172.21.15.146:0/1778890545 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bc4057040 con 0x55b04900f110 2024-09-18T01:46:22.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.998+0000 7f1bcbf9d640 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b049011bf0 con 0x7f1bbc00f070 2024-09-18T01:46:22.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.998+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bc0057030 con 0x7f1bbc00f070 2024-09-18T01:46:22.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.998+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b049011bf0 con 0x55b04900f110 2024-09-18T01:46:22.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.999+0000 7f1bcbf9d640 1 -- 172.21.15.146:0/1778890545 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bc4057040 con 0x55b04900f110 2024-09-18T01:46:22.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.999+0000 7f1bcbf9d640 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b049011bf0 con 0x55b04900f110 2024-09-18T01:46:22.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.999+0000 7f1bcbf9d640 1 -- 172.21.15.146:0/1778890545 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bc4057040 con 0x55b04900f110 2024-09-18T01:46:22.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.999+0000 7f1bcbf9d640 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b049011bf0 con 0x55b049008fe0 2024-09-18T01:46:22.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.999+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bc0057030 con 0x55b049008fe0 2024-09-18T01:46:22.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.999+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b049011bf0 con 0x55b049008fe0 2024-09-18T01:46:22.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.999+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1bc0057030 con 0x55b049008fe0 2024-09-18T01:46:22.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:21.999+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b049011bf0 con 0x7f1bbc00f070 2024-09-18T01:46:22.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.000+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bc0057030 con 0x7f1bbc00f070 2024-09-18T01:46:22.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.000+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b049011bf0 con 0x55b04900f110 2024-09-18T01:46:22.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.000+0000 7f1bcbf9d640 1 -- 172.21.15.146:0/1778890545 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bc4057040 con 0x55b04900f110 2024-09-18T01:46:22.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.000+0000 7f1bcbf9d640 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b049011bf0 con 0x7f1bc40123a0 2024-09-18T01:46:22.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.000+0000 7f1bcb79c640 1 -- 172.21.15.146:0/1778890545 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bbc02e070 con 0x7f1bc40123a0 2024-09-18T01:46:22.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.000+0000 7f1bcb79c640 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b049011bf0 con 0x55b049008fe0 2024-09-18T01:46:22.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.000+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bc0057030 con 0x55b049008fe0 2024-09-18T01:46:22.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.000+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b049011bf0 con 0x7f1bbc00f070 2024-09-18T01:46:22.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.001+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bc0057030 con 0x7f1bbc00f070 2024-09-18T01:46:22.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.001+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b049011bf0 con 0x55b04900f110 2024-09-18T01:46:22.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.001+0000 7f1bcbf9d640 1 -- 172.21.15.146:0/1778890545 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bc4057040 con 0x55b04900f110 2024-09-18T01:46:22.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.001+0000 7f1bcbf9d640 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b049011bf0 con 0x7f1bbc00f070 2024-09-18T01:46:22.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.001+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bc0057030 con 0x7f1bbc00f070 2024-09-18T01:46:22.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.001+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b049011bf0 con 0x7f1bc40123a0 2024-09-18T01:46:22.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.001+0000 7f1bcb79c640 1 -- 172.21.15.146:0/1778890545 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bbc02e070 con 0x7f1bc40123a0 2024-09-18T01:46:22.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.001+0000 7f1bcb79c640 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b049011bf0 con 0x55b04900f110 2024-09-18T01:46:22.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.002+0000 7f1bcbf9d640 1 -- 172.21.15.146:0/1778890545 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bc4057040 con 0x55b04900f110 2024-09-18T01:46:22.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.002+0000 7f1bcbf9d640 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b049011bf0 con 0x7f1bbc00f070 2024-09-18T01:46:22.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.002+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bc0057030 con 0x7f1bbc00f070 2024-09-18T01:46:22.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.002+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b049011bf0 con 0x55b049008fe0 2024-09-18T01:46:22.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.002+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1bc0057030 con 0x55b049008fe0 2024-09-18T01:46:22.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.002+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b049011bf0 con 0x7f1bc40123a0 2024-09-18T01:46:22.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.002+0000 7f1bcb79c640 1 -- 172.21.15.146:0/1778890545 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bbc02e070 con 0x7f1bc40123a0 2024-09-18T01:46:22.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.002+0000 7f1bd0015800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:46:22.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.002+0000 7f1bd0015800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:46:22.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.002+0000 7f1bd0015800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:46:22.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.002+0000 7f1bd0015800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:46:22.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.002+0000 7f1bd0015800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:46:22.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.002+0000 7f1bd0015800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:46:22.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.002+0000 7f1bd0015800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.002+0000 7f1bd0015800 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b04900dbe0 con 0x55b049008fe0 2024-09-18T01:46:22.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.002+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1bc0057030 con 0x55b049008fe0 2024-09-18T01:46:22.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.003+0000 7f1bd0015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:22.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.003+0000 7f1bd0015800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.003+0000 7f1bd0015800 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b04900e480 con 0x55b049008fe0 2024-09-18T01:46:22.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.003+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1bc0057030 con 0x55b049008fe0 2024-09-18T01:46:22.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.003+0000 7f1bd0015800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:46:22.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.003+0000 7f1bd0015800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.003+0000 7f1bd0015800 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b04900d820 con 0x7f1bc40123a0 2024-09-18T01:46:22.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.003+0000 7f1bcb79c640 1 -- 172.21.15.146:0/1778890545 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1bbc02e070 con 0x7f1bc40123a0 2024-09-18T01:46:22.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.003+0000 7f1bd0015800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:46:22.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.003+0000 7f1bd0015800 20 zone default found 2024-09-18T01:46:22.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.003+0000 7f1bd0015800 4 Realm: () 2024-09-18T01:46:22.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.003+0000 7f1bd0015800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:46:22.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.003+0000 7f1bd0015800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:46:22.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.003+0000 7f1bd0015800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:46:22.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.003+0000 7f1bd0015800 20 zonegroup default 2024-09-18T01:46:22.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.003+0000 7f1bd0015800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.003+0000 7f1bd0015800 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b049012570 con 0x7f1bbc00f070 2024-09-18T01:46:22.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.004+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1bc0057030 con 0x7f1bbc00f070 2024-09-18T01:46:22.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.004+0000 7f1bd0015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:22.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.004+0000 7f1bd0015800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.004+0000 7f1bd0015800 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b0490147a0 con 0x55b04900f110 2024-09-18T01:46:22.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.004+0000 7f1bcbf9d640 1 -- 172.21.15.146:0/1778890545 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1bc4057040 con 0x55b04900f110 2024-09-18T01:46:22.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.004+0000 7f1bd0015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:22.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.004+0000 7f1bd0015800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.004+0000 7f1bd0015800 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b049014b40 con 0x55b04900f110 2024-09-18T01:46:22.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.004+0000 7f1bcbf9d640 1 -- 172.21.15.146:0/1778890545 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1bc4057040 con 0x55b04900f110 2024-09-18T01:46:22.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.004+0000 7f1bd0015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:22.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.004+0000 7f1bd0015800 20 started sync module instance, tier type = 2024-09-18T01:46:22.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.004+0000 7f1bd0015800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:46:22.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.004+0000 7f1bd0015800 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b049013be0 con 0x7f1bc40123a0 2024-09-18T01:46:22.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.005+0000 7f1bcb79c640 1 -- 172.21.15.146:0/1778890545 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v33'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bbc02e070 con 0x7f1bc40123a0 2024-09-18T01:46:22.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.005+0000 7f1bd0015800 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94215627421488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b049014ee0 con 0x7f1bc40123a0 2024-09-18T01:46:22.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.005+0000 7f1bd0015800 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b0490158a0 con 0x55b049008fe0 2024-09-18T01:46:22.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.006+0000 7f1bcb79c640 1 -- 172.21.15.146:0/1778890545 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94215627421488] v33'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bbc02e070 con 0x7f1bc40123a0 2024-09-18T01:46:22.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.006+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v33'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bc0057030 con 0x55b049008fe0 2024-09-18T01:46:22.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.006+0000 7f1bd0015800 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94215627428848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b049015cc0 con 0x55b049008fe0 2024-09-18T01:46:22.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.006+0000 7f1bd0015800 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b049016590 con 0x55b04900f110 2024-09-18T01:46:22.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.007+0000 7f1bcbf9d640 1 -- 172.21.15.146:0/1778890545 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v33'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bc4057040 con 0x55b04900f110 2024-09-18T01:46:22.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.008+0000 7f1bd0015800 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94215627431104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b049016140 con 0x55b04900f110 2024-09-18T01:46:22.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.008+0000 7f1bd0015800 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b049017560 con 0x7f1bc40123a0 2024-09-18T01:46:22.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.008+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94215627428848] v33'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bc0057030 con 0x55b049008fe0 2024-09-18T01:46:22.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.009+0000 7f1bcbf9d640 1 -- 172.21.15.146:0/1778890545 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94215627431104] v33'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bc4057040 con 0x55b04900f110 2024-09-18T01:46:22.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.009+0000 7f1bcb79c640 1 -- 172.21.15.146:0/1778890545 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v33'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bbc02e070 con 0x7f1bc40123a0 2024-09-18T01:46:22.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.009+0000 7f1bd0015800 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94215627434368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b049015810 con 0x7f1bc40123a0 2024-09-18T01:46:22.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.009+0000 7f1bd0015800 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b049017e30 con 0x55b049008fe0 2024-09-18T01:46:22.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.010+0000 7f1bcb79c640 1 -- 172.21.15.146:0/1778890545 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94215627434368] v33'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bbc02e070 con 0x7f1bc40123a0 2024-09-18T01:46:22.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.010+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v33'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bc0057030 con 0x55b049008fe0 2024-09-18T01:46:22.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.010+0000 7f1bd0015800 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94215627438464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b049017da0 con 0x55b049008fe0 2024-09-18T01:46:22.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.010+0000 7f1bd0015800 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b049018bc0 con 0x7f1bbc00f070 2024-09-18T01:46:22.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.011+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v33'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bc0057030 con 0x7f1bbc00f070 2024-09-18T01:46:22.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.011+0000 7f1bd0015800 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94215627441872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b049018b30 con 0x7f1bbc00f070 2024-09-18T01:46:22.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.011+0000 7f1bd0015800 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b049019b50 con 0x7f1bbc00f070 2024-09-18T01:46:22.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.011+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94215627438464] v33'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bc0057030 con 0x55b049008fe0 2024-09-18T01:46:22.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.012+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94215627441872] v33'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bc0057030 con 0x7f1bbc00f070 2024-09-18T01:46:22.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.012+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v33'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bc0057030 con 0x7f1bbc00f070 2024-09-18T01:46:22.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.012+0000 7f1bd0015800 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94215627444192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b049019630 con 0x7f1bbc00f070 2024-09-18T01:46:22.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.012+0000 7f1bd0015800 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b04901a000 con 0x7f1bbc00f070 2024-09-18T01:46:22.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.013+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(58 notify.7 [create] v33'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bc0057030 con 0x7f1bbc00f070 2024-09-18T01:46:22.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.013+0000 7f1bd0015800 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94215627447120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b049019f70 con 0x7f1bbc00f070 2024-09-18T01:46:22.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.013+0000 7f1bd0015800 20 add_watcher() i=0 2024-09-18T01:46:22.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.013+0000 7f1bd0015800 20 add_watcher() i=1 2024-09-18T01:46:22.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.013+0000 7f1bd0015800 20 add_watcher() i=2 2024-09-18T01:46:22.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.013+0000 7f1bd0015800 20 add_watcher() i=3 2024-09-18T01:46:22.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.013+0000 7f1bd0015800 20 add_watcher() i=4 2024-09-18T01:46:22.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.013+0000 7f1bd0015800 20 add_watcher() i=5 2024-09-18T01:46:22.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.013+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94215627444192] v33'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bc0057030 con 0x7f1bbc00f070 2024-09-18T01:46:22.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.013+0000 7f1bd0015800 20 add_watcher() i=6 2024-09-18T01:46:22.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.014+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94215627447120] v33'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bc0057030 con 0x7f1bbc00f070 2024-09-18T01:46:22.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.014+0000 7f1bd0015800 20 add_watcher() i=7 2024-09-18T01:46:22.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.014+0000 7f1bd0015800 2 all 8 watchers are set, enabling cache 2024-09-18T01:46:22.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.014+0000 7f1bd0015800 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b049018220 con 0x55b049008fe0 2024-09-18T01:46:22.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.014+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1bc0057030 con 0x55b049008fe0 2024-09-18T01:46:22.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.015+0000 7f1bd0015800 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94215627440672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b04901a990 con 0x55b049008fe0 2024-09-18T01:46:22.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.015+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94215627440672] v33'206 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1bc0057030 con 0x55b049008fe0 2024-09-18T01:46:22.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.016+0000 7f1a81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:46:22.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.016+0000 7f1bd0015800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:46:22.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.016+0000 7f1bd0015800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:46:22.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.016+0000 7f1bd0015800 5 note: GC not initialized 2024-09-18T01:46:22.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.016+0000 7f1a80fe1640 20 reqs_thread_entry: start 2024-09-18T01:46:22.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.016+0000 7f1bd0015800 20 init_complete bucket index max shards: 11 2024-09-18T01:46:22.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.016+0000 7f1bd0015800 20 Filter name: none 2024-09-18T01:46:22.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.016+0000 7f19fa7fc640 20 reqs_thread_entry: start 2024-09-18T01:46:22.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.016+0000 7f1bd0015800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.016+0000 7f1bd0015800 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b049050420 con 0x55b049008fe0 2024-09-18T01:46:22.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.016+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f1bc0057030 con 0x55b049008fe0 2024-09-18T01:46:22.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.017+0000 7f1bd0015800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:46:22.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.017+0000 7f1bd0015800 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b049051970 con 0x7f1bbc00f070 2024-09-18T01:46:22.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.017+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f1bc0057030 con 0x7f1bbc00f070 2024-09-18T01:46:22.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.018+0000 7f1a81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:46:22.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.018+0000 7f1bd0015800 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94215627440672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b04901b290 con 0x55b049008fe0 2024-09-18T01:46:22.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.019+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94215627440672] v33'207 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1bc0057030 con 0x55b049008fe0 2024-09-18T01:46:22.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.019+0000 7f1bd0015800 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94215627421488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b049018220 con 0x7f1bc40123a0 2024-09-18T01:46:22.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.020+0000 7f1bcb79c640 1 -- 172.21.15.146:0/1778890545 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94215627421488] v33'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bbc02e070 con 0x7f1bc40123a0 2024-09-18T01:46:22.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.020+0000 7f1bd0015800 20 remove_watcher() i=0 2024-09-18T01:46:22.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.020+0000 7f1bd0015800 2 removed watcher, disabling cache 2024-09-18T01:46:22.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.020+0000 7f1bd0015800 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94215627428848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b049013730 con 0x55b049008fe0 2024-09-18T01:46:22.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.021+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94215627428848] v33'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bc0057030 con 0x55b049008fe0 2024-09-18T01:46:22.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.021+0000 7f1bd0015800 20 remove_watcher() i=1 2024-09-18T01:46:22.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.021+0000 7f1bd0015800 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94215627431104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b049013730 con 0x55b04900f110 2024-09-18T01:46:22.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.022+0000 7f1bcbf9d640 1 -- 172.21.15.146:0/1778890545 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94215627431104] v33'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bc4057040 con 0x55b04900f110 2024-09-18T01:46:22.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.022+0000 7f1bd0015800 20 remove_watcher() i=2 2024-09-18T01:46:22.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.022+0000 7f1bd0015800 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94215627434368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b049015cc0 con 0x7f1bc40123a0 2024-09-18T01:46:22.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.023+0000 7f1bcb79c640 1 -- 172.21.15.146:0/1778890545 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94215627434368] v33'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bbc02e070 con 0x7f1bc40123a0 2024-09-18T01:46:22.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.023+0000 7f1bd0015800 20 remove_watcher() i=3 2024-09-18T01:46:22.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.023+0000 7f1bd0015800 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94215627438464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b049013730 con 0x55b049008fe0 2024-09-18T01:46:22.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.024+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94215627438464] v33'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bc0057030 con 0x55b049008fe0 2024-09-18T01:46:22.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.024+0000 7f1bd0015800 20 remove_watcher() i=4 2024-09-18T01:46:22.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.024+0000 7f1bd0015800 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94215627441872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b049015cc0 con 0x7f1bbc00f070 2024-09-18T01:46:22.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.025+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94215627441872] v33'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bc0057030 con 0x7f1bbc00f070 2024-09-18T01:46:22.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.025+0000 7f1bd0015800 20 remove_watcher() i=5 2024-09-18T01:46:22.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.025+0000 7f1bd0015800 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94215627444192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b049015cc0 con 0x7f1bbc00f070 2024-09-18T01:46:22.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.027+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94215627444192] v33'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bc0057030 con 0x7f1bbc00f070 2024-09-18T01:46:22.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.027+0000 7f1bd0015800 20 remove_watcher() i=6 2024-09-18T01:46:22.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.027+0000 7f1bd0015800 1 -- 172.21.15.146:0/1778890545 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94215627447120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b049015c80 con 0x7f1bbc00f070 2024-09-18T01:46:22.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.028+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94215627447120] v33'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bc0057030 con 0x7f1bbc00f070 2024-09-18T01:46:22.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.028+0000 7f1bd0015800 20 remove_watcher() i=7 2024-09-18T01:46:22.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.028+0000 7f1bd0015800 1 -- 172.21.15.146:0/1778890545 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f1bbc00f070 msgr2=0x7f1bbc04b7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.028+0000 7f1bd0015800 1 --2- 172.21.15.146:0/1778890545 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f1bbc00f070 0x7f1bbc04b7f0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.028+0000 7f1bd0015800 1 -- 172.21.15.146:0/1778890545 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55b049008fe0 msgr2=0x55b04900b4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.028+0000 7f1bd0015800 1 --2- 172.21.15.146:0/1778890545 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55b049008fe0 0x55b04900b4a0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.028+0000 7f1bd0015800 1 -- 172.21.15.146:0/1778890545 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f1bc40123a0 msgr2=0x7f1bc4036580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.028+0000 7f1bd0015800 1 --2- 172.21.15.146:0/1778890545 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f1bc40123a0 0x7f1bc4036580 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.028+0000 7f1bd0015800 1 -- 172.21.15.146:0/1778890545 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55b04900f110 msgr2=0x55b049011520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.028+0000 7f1bd0015800 1 --2- 172.21.15.146:0/1778890545 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55b04900f110 0x55b049011520 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.028+0000 7f1bd0015800 1 -- 172.21.15.146:0/1778890545 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1a94036b40 msgr2=0x7f1a94039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.028+0000 7f1bd0015800 1 --2- 172.21.15.146:0/1778890545 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1a94036b40 0x7f1a94039000 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc0197f0 tx=0x7f1bbc04d000 comp rx=0 tx=0).stop 2024-09-18T01:46:22.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.028+0000 7f1bd0015800 1 -- 172.21.15.146:0/1778890545 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b048ff5ed0 msgr2=0x55b048ffd340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.028+0000 7f1bd0015800 1 --2- 172.21.15.146:0/1778890545 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b048ff5ed0 0x55b048ffd340 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4001df0 tx=0x7f1bc404c820 comp rx=0 tx=0).stop 2024-09-18T01:46:22.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.028+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 reap_dead start 2024-09-18T01:46:22.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.028+0000 7f1bcaf9b640 1 -- 172.21.15.146:0/1778890545 reap_dead start 2024-09-18T01:46:22.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.028+0000 7f1bd0015800 1 -- 172.21.15.146:0/1778890545 shutdown_connections 2024-09-18T01:46:22.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.028+0000 7f1bd0015800 1 -- 172.21.15.146:0/1778890545 >> 172.21.15.146:0/1778890545 conn(0x55b048ff2230 msgr2=0x55b048ff0300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:22.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.028+0000 7f1bd0015800 1 -- 172.21.15.146:0/1778890545 shutdown_connections 2024-09-18T01:46:22.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.028+0000 7f1bd0015800 1 -- 172.21.15.146:0/1778890545 wait complete. 2024-09-18T01:46:22.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.028+0000 7f1bd0015800 1 -- 172.21.15.146:0/3255096922 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1aa4036b90 msgr2=0x7f1aa4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.029+0000 7f1bd0015800 1 --2- 172.21.15.146:0/3255096922 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1aa4036b90 0x7f1aa4039050 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc01dfd0 tx=0x7f1bbc01d450 comp rx=0 tx=0).stop 2024-09-18T01:46:22.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.029+0000 7f1bd0015800 1 -- 172.21.15.146:0/3255096922 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b048fe9230 msgr2=0x55b048fe9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.029+0000 7f1bd0015800 1 --2- 172.21.15.146:0/3255096922 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b048fe9230 0x55b048fe9650 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x55b048fcf940 tx=0x7f1bc40178e0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.029+0000 7f1bd0015800 1 -- 172.21.15.146:0/3255096922 shutdown_connections 2024-09-18T01:46:22.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.029+0000 7f1bd0015800 1 --2- 172.21.15.146:0/3255096922 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1aa4036b90 0x7f1aa4039050 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.029+0000 7f1bd0015800 1 --2- 172.21.15.146:0/3255096922 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b048fe9230 0x55b048fe9650 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.029+0000 7f1bd0015800 1 -- 172.21.15.146:0/3255096922 >> 172.21.15.146:0/3255096922 conn(0x55b048fde1c0 msgr2=0x55b048fe0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:22.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.029+0000 7f1bd0015800 1 -- 172.21.15.146:0/3255096922 shutdown_connections 2024-09-18T01:46:22.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.029+0000 7f1bd0015800 1 -- 172.21.15.146:0/3255096922 wait complete. 2024-09-18T01:46:22.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.029+0000 7f1bd0015800 1 -- 172.21.15.146:0/1914677641 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55b048ed98f0 msgr2=0x55b048fd55b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.029+0000 7f1bd0015800 1 --2- 172.21.15.146:0/1914677641 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55b048ed98f0 0x55b048fd55b0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.029+0000 7f1bd0015800 1 -- 172.21.15.146:0/1914677641 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55b048fd8d00 msgr2=0x55b048fdb0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.029+0000 7f1bd0015800 1 --2- 172.21.15.146:0/1914677641 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55b048fd8d00 0x55b048fdb0f0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.029+0000 7f1bd0015800 1 -- 172.21.15.146:0/1914677641 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1ab0036b90 msgr2=0x7f1ab0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.029+0000 7f1bd0015800 1 --2- 172.21.15.146:0/1914677641 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1ab0036b90 0x7f1ab0039050 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0057000 tx=0x7f1bc0052000 comp rx=0 tx=0).stop 2024-09-18T01:46:22.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.029+0000 7f1bd0015800 1 -- 172.21.15.146:0/1914677641 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b048e496b0 msgr2=0x55b048fce540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.029+0000 7f1bd0015800 1 --2- 172.21.15.146:0/1914677641 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b048e496b0 0x55b048fce540 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc000fd0 tx=0x7f1bbc000ed0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.029+0000 7f1bd0015800 1 -- 172.21.15.146:0/1914677641 shutdown_connections 2024-09-18T01:46:22.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.029+0000 7f1bd0015800 1 --2- 172.21.15.146:0/1914677641 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55b048fd8d00 0x55b048fdb0f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.029+0000 7f1bd0015800 1 --2- 172.21.15.146:0/1914677641 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55b048ed98f0 0x55b048fd55b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.029+0000 7f1bd0015800 1 --2- 172.21.15.146:0/1914677641 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f1ab0036b90 0x7f1ab0039050 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.029+0000 7f1bd0015800 1 --2- 172.21.15.146:0/1914677641 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55b048e496b0 0x55b048fce540 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.029+0000 7f1bd0015800 1 -- 172.21.15.146:0/1914677641 >> 172.21.15.146:0/1914677641 conn(0x55b048ecfde0 msgr2=0x55b048fbfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:22.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.029+0000 7f1bd0015800 1 -- 172.21.15.146:0/1914677641 shutdown_connections 2024-09-18T01:46:22.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.029+0000 7f1bd0015800 1 -- 172.21.15.146:0/1914677641 wait complete. 2024-09-18T01:46:22.038 INFO:teuthology.orchestra.run.smithi146.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2024-09-18T01:46:22.039 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-09-18T01:46:22.039 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-18T01:46:22.039 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-18T01:46:22.039 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories create_bucket 2024-09-18T01:46:22.087 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:46:22.087 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:46:22.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.087+0000 7fc85c636800 1 Processor -- start 2024-09-18T01:46:22.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.087+0000 7fc85c636800 1 -- start start 2024-09-18T01:46:22.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.087+0000 7fc85c636800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x558c0fe26630 0x558c0feb7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.087+0000 7fc85c636800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558c0fd71b30 con 0x558c0feb7b40 2024-09-18T01:46:22.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.087+0000 7fc85c636800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x558c0fd53360 con 0x558c0fe26630 2024-09-18T01:46:22.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.087+0000 7fc857952640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x558c0fe26630 0x558c0feb7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.087+0000 7fc857151640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x558c0feb7b40 0x558c0feb9f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:49890/0 (socket says 172.21.15.146:49890) 2024-09-18T01:46:22.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.088+0000 7fc857151640 1 -- 172.21.15.146:0/3772148434 learned_addr learned my addr 172.21.15.146:0/3772148434 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:46:22.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.088+0000 7fc857952640 1 --2- 172.21.15.146:0/3772148434 >> v2:172.21.15.129:3300/0 conn(0x558c0fe26630 0x558c0feb7600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:43848/0 (socket says 172.21.15.146:43848) 2024-09-18T01:46:22.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.088+0000 7fc857952640 1 -- 172.21.15.146:0/3772148434 >> v1:172.21.15.129:6789/0 conn(0x558c0feb7b40 legacy=0x558c0feb9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.088+0000 7fc856950640 1 -- 172.21.15.146:0/3772148434 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1480342941 0 0) 0x558c0fd71b30 con 0x558c0feb7b40 2024-09-18T01:46:22.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.088+0000 7fc857952640 1 -- 172.21.15.146:0/3772148434 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c0fd79e00 con 0x558c0fe26630 2024-09-18T01:46:22.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.090+0000 7fc857952640 1 --2- 172.21.15.146:0/3772148434 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x558c0fe26630 0x558c0feb7600 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fc84800a470 tx=0x7fc848045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62c63a74fd387262 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.090+0000 7fc856950640 1 -- 172.21.15.146:0/3772148434 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc848053570 con 0x558c0fe26630 2024-09-18T01:46:22.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.090+0000 7fc856950640 1 -- 172.21.15.146:0/3772148434 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc848058070 con 0x558c0fe26630 2024-09-18T01:46:22.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.090+0000 7fc856950640 1 -- 172.21.15.146:0/3772148434 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc848053880 con 0x558c0fe26630 2024-09-18T01:46:22.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.090+0000 7fc85c636800 1 -- 172.21.15.146:0/3772148434 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x558c0fe26630 msgr2=0x558c0feb7600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.090+0000 7fc85c636800 1 --2- 172.21.15.146:0/3772148434 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x558c0fe26630 0x558c0feb7600 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fc84800a470 tx=0x7fc848045a20 comp rx=0 tx=0).stop 2024-09-18T01:46:22.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.090+0000 7fc85c636800 1 -- 172.21.15.146:0/3772148434 shutdown_connections 2024-09-18T01:46:22.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.090+0000 7fc85c636800 1 --2- 172.21.15.146:0/3772148434 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x558c0fe26630 0x558c0feb7600 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.090+0000 7fc85c636800 1 -- 172.21.15.146:0/3772148434 >> 172.21.15.146:0/3772148434 conn(0x558c0feacdb0 msgr2=0x558c0feaf1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:22.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.090+0000 7fc85c636800 1 -- 172.21.15.146:0/3772148434 shutdown_connections 2024-09-18T01:46:22.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.090+0000 7fc85c636800 1 -- 172.21.15.146:0/3772148434 wait complete. 2024-09-18T01:46:22.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.104+0000 7fc85c636800 1 Processor -- start 2024-09-18T01:46:22.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.104+0000 7fc85c636800 1 -- start start 2024-09-18T01:46:22.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.104+0000 7fc85c636800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x558c0fe26630 0x558c0ffa3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.104+0000 7fc85c636800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x558c0fdfe360 con 0x558c0fe26630 2024-09-18T01:46:22.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.105+0000 7fc857952640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x558c0fe26630 0x558c0ffa3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.105+0000 7fc857952640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x558c0fe26630 0x558c0ffa3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:43854/0 (socket says 172.21.15.146:43854) 2024-09-18T01:46:22.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.105+0000 7fc857952640 1 -- 172.21.15.146:0/4215828157 learned_addr learned my addr 172.21.15.146:0/4215828157 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:22.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.105+0000 7fc857952640 1 -- 172.21.15.146:0/4215828157 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c0fd4bbc0 con 0x558c0fe26630 2024-09-18T01:46:22.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.105+0000 7fc857952640 1 --2- 172.21.15.146:0/4215828157 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x558c0fe26630 0x558c0ffa3880 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fc848045f50 tx=0x7fc848051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dafa3b3158a9ce7 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.105+0000 7fc745e0b640 1 -- 172.21.15.146:0/4215828157 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc848053c20 con 0x558c0fe26630 2024-09-18T01:46:22.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.105+0000 7fc745e0b640 1 -- 172.21.15.146:0/4215828157 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc848063030 con 0x558c0fe26630 2024-09-18T01:46:22.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.105+0000 7fc745e0b640 1 -- 172.21.15.146:0/4215828157 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc848053440 con 0x558c0fe26630 2024-09-18T01:46:22.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.106+0000 7fc85c636800 1 -- 172.21.15.146:0/4215828157 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x558c0fe26630 msgr2=0x558c0ffa3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.106+0000 7fc85c636800 1 --2- 172.21.15.146:0/4215828157 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x558c0fe26630 0x558c0ffa3880 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fc848045f50 tx=0x7fc848051000 comp rx=0 tx=0).stop 2024-09-18T01:46:22.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.106+0000 7fc85c636800 1 -- 172.21.15.146:0/4215828157 shutdown_connections 2024-09-18T01:46:22.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.106+0000 7fc85c636800 1 --2- 172.21.15.146:0/4215828157 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x558c0fe26630 0x558c0ffa3880 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.106+0000 7fc85c636800 1 -- 172.21.15.146:0/4215828157 >> 172.21.15.146:0/4215828157 conn(0x558c0feacdb0 msgr2=0x558c0ff9f240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:22.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.106+0000 7fc85c636800 1 -- 172.21.15.146:0/4215828157 shutdown_connections 2024-09-18T01:46:22.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.106+0000 7fc85c636800 1 -- 172.21.15.146:0/4215828157 wait complete. 2024-09-18T01:46:22.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.107+0000 7fc85c636800 1 Processor -- start 2024-09-18T01:46:22.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.107+0000 7fc85c636800 1 -- start start 2024-09-18T01:46:22.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.107+0000 7fc85c636800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x558c0fe26630 0x558c0ffab200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.107+0000 7fc85c636800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x558c0febb920 con 0x558c0fe26630 2024-09-18T01:46:22.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.107+0000 7fc857952640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x558c0fe26630 0x558c0ffab200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.107+0000 7fc857952640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x558c0fe26630 0x558c0ffab200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:43866/0 (socket says 172.21.15.146:43866) 2024-09-18T01:46:22.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.107+0000 7fc857952640 1 -- 172.21.15.146:0/1812552545 learned_addr learned my addr 172.21.15.146:0/1812552545 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:22.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.107+0000 7fc857952640 1 -- 172.21.15.146:0/1812552545 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c0fd5ffe0 con 0x558c0fe26630 2024-09-18T01:46:22.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.107+0000 7fc857952640 1 --2- 172.21.15.146:0/1812552545 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x558c0fe26630 0x558c0ffab200 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fc848045f20 tx=0x7fc848002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.107+0000 7fc73ffff640 1 -- 172.21.15.146:0/1812552545 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc848053570 con 0x558c0fe26630 2024-09-18T01:46:22.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.108+0000 7fc73ffff640 1 -- 172.21.15.146:0/1812552545 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc848053710 con 0x558c0fe26630 2024-09-18T01:46:22.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.108+0000 7fc85c636800 1 -- 172.21.15.146:0/1812552545 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558c0ffab740 con 0x558c0fe26630 2024-09-18T01:46:22.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.108+0000 7fc73ffff640 1 -- 172.21.15.146:0/1812552545 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc848068420 con 0x558c0fe26630 2024-09-18T01:46:22.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.108+0000 7fc85c636800 1 -- 172.21.15.146:0/1812552545 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c0ffabbe0 con 0x558c0fe26630 2024-09-18T01:46:22.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.108+0000 7fc73ffff640 1 -- 172.21.15.146:0/1812552545 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc8480685c0 con 0x558c0fe26630 2024-09-18T01:46:22.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.108+0000 7fc73ffff640 1 --2- 172.21.15.146:0/1812552545 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc740036b90 0x7fc740039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.109+0000 7fc73ffff640 1 -- 172.21.15.146:0/1812552545 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7fc848070070 con 0x558c0fe26630 2024-09-18T01:46:22.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.109+0000 7fc857151640 1 --2- 172.21.15.146:0/1812552545 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc740036b90 0x7fc740039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.109+0000 7fc85c636800 1 --2- 172.21.15.146:0/1812552545 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x558c0feb7b40 0x558c0ffb2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.109+0000 7fc85c636800 1 -- 172.21.15.146:0/1812552545 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558c0ffb27b0 con 0x558c0feb7b40 2024-09-18T01:46:22.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.109+0000 7fc858153640 1 --2- 172.21.15.146:0/1812552545 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x558c0feb7b40 0x558c0ffb2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.109+0000 7fc857151640 1 --2- 172.21.15.146:0/1812552545 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc740036b90 0x7fc740039050 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc840000c00 tx=0x7fc8400013b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.109+0000 7fc858153640 1 --2- 172.21.15.146:0/1812552545 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x558c0feb7b40 0x558c0ffb2270 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.109+0000 7fc858153640 1 -- 172.21.15.146:0/1812552545 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc85000a4a0 con 0x558c0feb7b40 2024-09-18T01:46:22.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.109+0000 7fc85c636800 1 -- 172.21.15.146:0/1812552545 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558c0ffaf800 con 0x558c0feb7b40 2024-09-18T01:46:22.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.110+0000 7fc858153640 1 -- 172.21.15.146:0/1812552545 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc85000a4a0 con 0x558c0feb7b40 2024-09-18T01:46:22.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.110+0000 7fc85c636800 1 -- 172.21.15.146:0/1812552545 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558c0ffb4570 con 0x558c0feb7b40 2024-09-18T01:46:22.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.110+0000 7fc858153640 1 -- 172.21.15.146:0/1812552545 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc85000a4a0 con 0x558c0feb7b40 2024-09-18T01:46:22.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.110+0000 7fc85c636800 1 -- 172.21.15.146:0/1812552545 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558c0ffb35f0 con 0x558c0feb7b40 2024-09-18T01:46:22.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.110+0000 7fc858153640 1 -- 172.21.15.146:0/1812552545 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc85000a4a0 con 0x558c0feb7b40 2024-09-18T01:46:22.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.110+0000 7fc85c636800 1 --2- 172.21.15.146:0/1812552545 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x558c0ffb40c0 0x558c0ffb7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.110+0000 7fc85c636800 1 -- 172.21.15.146:0/1812552545 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558c0ffb8070 con 0x558c0ffb40c0 2024-09-18T01:46:22.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.110+0000 7fc857952640 1 --2- 172.21.15.146:0/1812552545 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x558c0ffb40c0 0x558c0ffb7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.111+0000 7fc857952640 1 --2- 172.21.15.146:0/1812552545 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x558c0ffb40c0 0x558c0ffb7930 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.111+0000 7fc857952640 1 -- 172.21.15.146:0/1812552545 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc848051070 con 0x558c0ffb40c0 2024-09-18T01:46:22.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.111+0000 7fc85c636800 1 Processor -- start 2024-09-18T01:46:22.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.111+0000 7fc85c636800 1 -- start start 2024-09-18T01:46:22.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.111+0000 7fc85c636800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x558c0ffc5e00 0x558c0ffc6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.111+0000 7fc85c636800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x558c0fd4d580 con 0x558c0ffc5e00 2024-09-18T01:46:22.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.112+0000 7fc858153640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x558c0ffc5e00 0x558c0ffc6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.112+0000 7fc858153640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x558c0ffc5e00 0x558c0ffc6220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:43870/0 (socket says 172.21.15.146:43870) 2024-09-18T01:46:22.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.112+0000 7fc858153640 1 -- 172.21.15.146:0/2585783443 learned_addr learned my addr 172.21.15.146:0/2585783443 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:22.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.112+0000 7fc858153640 1 -- 172.21.15.146:0/2585783443 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c0ffc6760 con 0x558c0ffc5e00 2024-09-18T01:46:22.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.112+0000 7fc858153640 1 --2- 172.21.15.146:0/2585783443 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x558c0ffc5e00 0x558c0ffc6220 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x558c0ffb2b50 tx=0x7fc8500178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.112+0000 7fc73d7fa640 1 -- 172.21.15.146:0/2585783443 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc850013440 con 0x558c0ffc5e00 2024-09-18T01:46:22.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.112+0000 7fc73d7fa640 1 -- 172.21.15.146:0/2585783443 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8500135e0 con 0x558c0ffc5e00 2024-09-18T01:46:22.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.113+0000 7fc85c636800 1 -- 172.21.15.146:0/2585783443 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558c0ffc69f0 con 0x558c0ffc5e00 2024-09-18T01:46:22.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.113+0000 7fc73d7fa640 1 -- 172.21.15.146:0/2585783443 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8500138c0 con 0x558c0ffc5e00 2024-09-18T01:46:22.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.113+0000 7fc85c636800 1 -- 172.21.15.146:0/2585783443 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c0ffc96d0 con 0x558c0ffc5e00 2024-09-18T01:46:22.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.113+0000 7fc73d7fa640 1 -- 172.21.15.146:0/2585783443 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc850011040 con 0x558c0ffc5e00 2024-09-18T01:46:22.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.113+0000 7fc73d7fa640 1 --2- 172.21.15.146:0/2585783443 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc730036b40 0x7fc730039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.113+0000 7fc73d7fa640 1 -- 172.21.15.146:0/2585783443 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7fc85001d070 con 0x558c0ffc5e00 2024-09-18T01:46:22.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.114+0000 7fc857952640 1 --2- 172.21.15.146:0/2585783443 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc730036b40 0x7fc730039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.114+0000 7fc85c636800 1 Processor -- start 2024-09-18T01:46:22.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.114+0000 7fc85c636800 1 -- start start 2024-09-18T01:46:22.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.114+0000 7fc857952640 1 --2- 172.21.15.146:0/2585783443 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc730036b40 0x7fc730039000 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x558c0ffb8470 tx=0x7fc848067610 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.114+0000 7fc85c636800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x558c0ffd2aa0 0x558c0ffd2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.114+0000 7fc85c636800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x558c0ffa3fd0 con 0x558c0ffd2aa0 2024-09-18T01:46:22.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.114+0000 7fc858153640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x558c0ffd2aa0 0x558c0ffd2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.114+0000 7fc858153640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x558c0ffd2aa0 0x558c0ffd2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:43884/0 (socket says 172.21.15.146:43884) 2024-09-18T01:46:22.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.114+0000 7fc858153640 1 -- 172.21.15.146:0/516507406 learned_addr learned my addr 172.21.15.146:0/516507406 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:22.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.114+0000 7fc858153640 1 -- 172.21.15.146:0/516507406 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c0ffd3470 con 0x558c0ffd2aa0 2024-09-18T01:46:22.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.115+0000 7fc858153640 1 --2- 172.21.15.146:0/516507406 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x558c0ffd2aa0 0x558c0ffd2ea0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fc850001450 tx=0x7fc85004caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1dce00a50819ab4 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.115+0000 7fc736ffd640 1 -- 172.21.15.146:0/516507406 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc850045070 con 0x558c0ffd2aa0 2024-09-18T01:46:22.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.115+0000 7fc736ffd640 1 -- 172.21.15.146:0/516507406 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc850015560 con 0x558c0ffd2aa0 2024-09-18T01:46:22.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.115+0000 7fc736ffd640 1 -- 172.21.15.146:0/516507406 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc85002ad80 con 0x558c0ffd2aa0 2024-09-18T01:46:22.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.115+0000 7fc85c636800 1 -- 172.21.15.146:0/516507406 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x558c0ffd2aa0 msgr2=0x558c0ffd2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.115+0000 7fc85c636800 1 --2- 172.21.15.146:0/516507406 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x558c0ffd2aa0 0x558c0ffd2ea0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fc850001450 tx=0x7fc85004caf0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.115+0000 7fc85c636800 1 -- 172.21.15.146:0/516507406 shutdown_connections 2024-09-18T01:46:22.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.115+0000 7fc85c636800 1 --2- 172.21.15.146:0/516507406 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x558c0ffd2aa0 0x558c0ffd2ea0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.115+0000 7fc85c636800 1 -- 172.21.15.146:0/516507406 >> 172.21.15.146:0/516507406 conn(0x558c0ffcee50 msgr2=0x558c0ffccf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:22.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.115+0000 7fc85c636800 1 -- 172.21.15.146:0/516507406 shutdown_connections 2024-09-18T01:46:22.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.115+0000 7fc85c636800 1 -- 172.21.15.146:0/516507406 wait complete. 2024-09-18T01:46:22.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.115+0000 7fc85c636800 1 Processor -- start 2024-09-18T01:46:22.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.115+0000 7fc85c636800 1 -- start start 2024-09-18T01:46:22.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.116+0000 7fc85c636800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x558c0ffd2aa0 0x558c0ffd9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.116+0000 7fc85c636800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x558c0ffd3a40 con 0x558c0ffd2aa0 2024-09-18T01:46:22.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.116+0000 7fc858153640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x558c0ffd2aa0 0x558c0ffd9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.116+0000 7fc858153640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x558c0ffd2aa0 0x558c0ffd9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:43896/0 (socket says 172.21.15.146:43896) 2024-09-18T01:46:22.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.116+0000 7fc858153640 1 -- 172.21.15.146:0/1571982087 learned_addr learned my addr 172.21.15.146:0/1571982087 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:22.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.116+0000 7fc858153640 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c0ffda410 con 0x558c0ffd2aa0 2024-09-18T01:46:22.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.116+0000 7fc858153640 1 --2- 172.21.15.146:0/1571982087 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x558c0ffd2aa0 0x558c0ffd9ed0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fc850001450 tx=0x7fc85004c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.116+0000 7fc7357fa640 1 -- 172.21.15.146:0/1571982087 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc850045040 con 0x558c0ffd2aa0 2024-09-18T01:46:22.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.116+0000 7fc7357fa640 1 -- 172.21.15.146:0/1571982087 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8500014f0 con 0x558c0ffd2aa0 2024-09-18T01:46:22.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.116+0000 7fc85c636800 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558c0ffda6a0 con 0x558c0ffd2aa0 2024-09-18T01:46:22.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.116+0000 7fc7357fa640 1 -- 172.21.15.146:0/1571982087 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc850001810 con 0x558c0ffd2aa0 2024-09-18T01:46:22.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.116+0000 7fc85c636800 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c0ffdd350 con 0x558c0ffd2aa0 2024-09-18T01:46:22.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.117+0000 7fc7357fa640 1 -- 172.21.15.146:0/1571982087 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc85003d060 con 0x558c0ffd2aa0 2024-09-18T01:46:22.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.117+0000 7fc7357fa640 1 --2- 172.21.15.146:0/1571982087 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc720036d30 0x7fc7200391f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.117+0000 7fc7357fa640 1 -- 172.21.15.146:0/1571982087 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7fc85000e040 con 0x558c0ffd2aa0 2024-09-18T01:46:22.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.117+0000 7fc857952640 1 --2- 172.21.15.146:0/1571982087 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc720036d30 0x7fc7200391f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.118+0000 7fc85c636800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.118+0000 7fc857952640 1 --2- 172.21.15.146:0/1571982087 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc720036d30 0x7fc7200391f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc848068b10 tx=0x7fc848087000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.118+0000 7fc85c636800 1 --2- 172.21.15.146:0/1571982087 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x558c0ffe5be0 0x558c0ffe80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.118+0000 7fc85c636800 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558c0ffe87f0 con 0x558c0ffe5be0 2024-09-18T01:46:22.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.118+0000 7fc857151640 1 --2- 172.21.15.146:0/1571982087 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x558c0ffe5be0 0x558c0ffe80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.118+0000 7fc857151640 1 --2- 172.21.15.146:0/1571982087 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x558c0ffe5be0 0x558c0ffe80a0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.118+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc84000f5f0 con 0x558c0ffe5be0 2024-09-18T01:46:22.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.118+0000 7fc85c636800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:22.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.119+0000 7fc85c636800 20 realm 2024-09-18T01:46:22.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.119+0000 7fc85c636800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.119+0000 7fc85c636800 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558c0ffe5030 con 0x558c0ffe5be0 2024-09-18T01:46:22.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.119+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc84000f5f0 con 0x558c0ffe5be0 2024-09-18T01:46:22.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.119+0000 7fc85c636800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:22.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.119+0000 7fc85c636800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:46:22.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.119+0000 7fc85c636800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.119+0000 7fc85c636800 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558c0ffe92d0 con 0x558c0ffe5be0 2024-09-18T01:46:22.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.119+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc84000f5f0 con 0x558c0ffe5be0 2024-09-18T01:46:22.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.119+0000 7fc85c636800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:22.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.119+0000 7fc85c636800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.119+0000 7fc85c636800 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558c0ffe9ba0 con 0x558c0ffe5be0 2024-09-18T01:46:22.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.119+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc84000f5f0 con 0x558c0ffe5be0 2024-09-18T01:46:22.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.119+0000 7fc85c636800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:46:22.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.119+0000 7fc85c636800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.119+0000 7fc85c636800 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558c0ffe9f40 con 0x558c0ffe5be0 2024-09-18T01:46:22.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.119+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc84000f5f0 con 0x558c0ffe5be0 2024-09-18T01:46:22.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.119+0000 7fc85c636800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:46:22.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.119+0000 7fc85c636800 20 searching for the correct realm 2024-09-18T01:46:22.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.119+0000 7fc85c636800 1 --2- 172.21.15.146:0/1571982087 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x558c0ffebe20 0x558c0ffee230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.119+0000 7fc85c636800 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c0ffee900 con 0x558c0ffebe20 2024-09-18T01:46:22.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.120+0000 7fc858153640 1 --2- 172.21.15.146:0/1571982087 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x558c0ffebe20 0x558c0ffee230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.120+0000 7fc858153640 1 --2- 172.21.15.146:0/1571982087 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x558c0ffebe20 0x558c0ffee230 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.120+0000 7fc858153640 1 -- 172.21.15.146:0/1571982087 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc850029070 con 0x558c0ffebe20 2024-09-18T01:46:22.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.120+0000 7fc858153640 1 --2- 172.21.15.146:0/1571982087 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fc85003f070 0x7fc85002a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.120+0000 7fc858153640 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c0ffee900 con 0x7fc85003f070 2024-09-18T01:46:22.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.120+0000 7fc857952640 1 --2- 172.21.15.146:0/1571982087 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fc85003f070 0x7fc85002a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.120+0000 7fc857952640 1 --2- 172.21.15.146:0/1571982087 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fc85003f070 0x7fc85002a4f0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.121+0000 7fc857952640 1 -- 172.21.15.146:0/1571982087 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84808a050 con 0x7fc85003f070 2024-09-18T01:46:22.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.121+0000 7fc857952640 1 --2- 172.21.15.146:0/1571982087 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fc84805f040 0x7fc84805c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.121+0000 7fc857952640 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c0ffee900 con 0x7fc84805f040 2024-09-18T01:46:22.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.121+0000 7fc857151640 1 --2- 172.21.15.146:0/1571982087 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fc84805f040 0x7fc84805c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.121+0000 7fc857151640 1 --2- 172.21.15.146:0/1571982087 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fc84805f040 0x7fc84805c410 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.122+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84000f5f0 con 0x7fc84805f040 2024-09-18T01:46:22.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.122+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c0ffee900 con 0x558c0ffe5be0 2024-09-18T01:46:22.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.122+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc84000f5f0 con 0x558c0ffe5be0 2024-09-18T01:46:22.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.122+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c0ffee900 con 0x558c0ffe5be0 2024-09-18T01:46:22.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.122+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84000f5f0 con 0x558c0ffe5be0 2024-09-18T01:46:22.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.122+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c0ffee900 con 0x7fc84805f040 2024-09-18T01:46:22.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.122+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84000f5f0 con 0x7fc84805f040 2024-09-18T01:46:22.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.123+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c0ffee900 con 0x7fc84805f040 2024-09-18T01:46:22.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.123+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84000f5f0 con 0x7fc84805f040 2024-09-18T01:46:22.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.123+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c0ffee900 con 0x7fc85003f070 2024-09-18T01:46:22.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.123+0000 7fc857952640 1 -- 172.21.15.146:0/1571982087 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84808a050 con 0x7fc85003f070 2024-09-18T01:46:22.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.123+0000 7fc857952640 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c0ffee900 con 0x558c0ffebe20 2024-09-18T01:46:22.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.123+0000 7fc858153640 1 -- 172.21.15.146:0/1571982087 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc850029070 con 0x558c0ffebe20 2024-09-18T01:46:22.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.123+0000 7fc858153640 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c0ffee900 con 0x558c0ffe5be0 2024-09-18T01:46:22.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.123+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84000f5f0 con 0x558c0ffe5be0 2024-09-18T01:46:22.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.123+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c0ffee900 con 0x7fc84805f040 2024-09-18T01:46:22.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.124+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84000f5f0 con 0x7fc84805f040 2024-09-18T01:46:22.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.124+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c0ffee900 con 0x558c0ffe5be0 2024-09-18T01:46:22.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.124+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84000f5f0 con 0x558c0ffe5be0 2024-09-18T01:46:22.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.124+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c0ffee900 con 0x7fc85003f070 2024-09-18T01:46:22.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.124+0000 7fc857952640 1 -- 172.21.15.146:0/1571982087 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fc84808a050 con 0x7fc85003f070 2024-09-18T01:46:22.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.124+0000 7fc857952640 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c0ffee900 con 0x558c0ffebe20 2024-09-18T01:46:22.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.124+0000 7fc858153640 1 -- 172.21.15.146:0/1571982087 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc850029070 con 0x558c0ffebe20 2024-09-18T01:46:22.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.124+0000 7fc858153640 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c0ffee900 con 0x558c0ffebe20 2024-09-18T01:46:22.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.125+0000 7fc858153640 1 -- 172.21.15.146:0/1571982087 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc850029070 con 0x558c0ffebe20 2024-09-18T01:46:22.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.125+0000 7fc858153640 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c0ffee900 con 0x7fc84805f040 2024-09-18T01:46:22.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.125+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84000f5f0 con 0x7fc84805f040 2024-09-18T01:46:22.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.125+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c0ffee900 con 0x558c0ffebe20 2024-09-18T01:46:22.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.125+0000 7fc858153640 1 -- 172.21.15.146:0/1571982087 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc850029070 con 0x558c0ffebe20 2024-09-18T01:46:22.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.125+0000 7fc858153640 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c0ffee900 con 0x558c0ffebe20 2024-09-18T01:46:22.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.125+0000 7fc858153640 1 -- 172.21.15.146:0/1571982087 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc850029070 con 0x558c0ffebe20 2024-09-18T01:46:22.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.125+0000 7fc858153640 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c0ffee900 con 0x558c0ffe5be0 2024-09-18T01:46:22.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.126+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84000f5f0 con 0x558c0ffe5be0 2024-09-18T01:46:22.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.126+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c0ffee900 con 0x558c0ffe5be0 2024-09-18T01:46:22.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.126+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc84000f5f0 con 0x558c0ffe5be0 2024-09-18T01:46:22.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.126+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c0ffee900 con 0x7fc84805f040 2024-09-18T01:46:22.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.126+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84000f5f0 con 0x7fc84805f040 2024-09-18T01:46:22.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.126+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c0ffee900 con 0x558c0ffebe20 2024-09-18T01:46:22.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.126+0000 7fc858153640 1 -- 172.21.15.146:0/1571982087 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc850029070 con 0x558c0ffebe20 2024-09-18T01:46:22.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.126+0000 7fc858153640 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c0ffee900 con 0x7fc85003f070 2024-09-18T01:46:22.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.127+0000 7fc857952640 1 -- 172.21.15.146:0/1571982087 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84808a050 con 0x7fc85003f070 2024-09-18T01:46:22.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.127+0000 7fc857952640 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c0ffee900 con 0x558c0ffe5be0 2024-09-18T01:46:22.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.127+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84000f5f0 con 0x558c0ffe5be0 2024-09-18T01:46:22.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.127+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c0ffee900 con 0x7fc84805f040 2024-09-18T01:46:22.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.127+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84003b040 con 0x7fc84805f040 2024-09-18T01:46:22.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.127+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c0ffee900 con 0x558c0ffebe20 2024-09-18T01:46:22.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.127+0000 7fc858153640 1 -- 172.21.15.146:0/1571982087 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc850029070 con 0x558c0ffebe20 2024-09-18T01:46:22.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.127+0000 7fc858153640 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c0ffee900 con 0x7fc84805f040 2024-09-18T01:46:22.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.128+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84003b040 con 0x7fc84805f040 2024-09-18T01:46:22.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.128+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c0ffee900 con 0x7fc85003f070 2024-09-18T01:46:22.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.128+0000 7fc857952640 1 -- 172.21.15.146:0/1571982087 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84808a050 con 0x7fc85003f070 2024-09-18T01:46:22.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.128+0000 7fc857952640 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c0ffee900 con 0x558c0ffebe20 2024-09-18T01:46:22.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.128+0000 7fc858153640 1 -- 172.21.15.146:0/1571982087 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc850029070 con 0x558c0ffebe20 2024-09-18T01:46:22.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.128+0000 7fc858153640 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c0ffee900 con 0x7fc84805f040 2024-09-18T01:46:22.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.128+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84003b040 con 0x7fc84805f040 2024-09-18T01:46:22.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.128+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c0ffee900 con 0x558c0ffe5be0 2024-09-18T01:46:22.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.129+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc84003b040 con 0x558c0ffe5be0 2024-09-18T01:46:22.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.129+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c0ffee900 con 0x7fc85003f070 2024-09-18T01:46:22.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.129+0000 7fc857952640 1 -- 172.21.15.146:0/1571982087 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84808a050 con 0x7fc85003f070 2024-09-18T01:46:22.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.129+0000 7fc85c636800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:46:22.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.129+0000 7fc85c636800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:46:22.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.129+0000 7fc85c636800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:46:22.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.129+0000 7fc85c636800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:46:22.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.129+0000 7fc85c636800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:46:22.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.129+0000 7fc85c636800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:46:22.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.129+0000 7fc85c636800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.129+0000 7fc85c636800 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558c0ffea8f0 con 0x558c0ffe5be0 2024-09-18T01:46:22.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.129+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc84003b040 con 0x558c0ffe5be0 2024-09-18T01:46:22.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.129+0000 7fc85c636800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:22.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.129+0000 7fc85c636800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.129+0000 7fc85c636800 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558c0ffeb190 con 0x558c0ffe5be0 2024-09-18T01:46:22.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.129+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc84003b040 con 0x558c0ffe5be0 2024-09-18T01:46:22.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.129+0000 7fc85c636800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:46:22.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.129+0000 7fc85c636800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.129+0000 7fc85c636800 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558c0ffea530 con 0x7fc85003f070 2024-09-18T01:46:22.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.130+0000 7fc857952640 1 -- 172.21.15.146:0/1571982087 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc84808a050 con 0x7fc85003f070 2024-09-18T01:46:22.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.130+0000 7fc85c636800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:46:22.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.130+0000 7fc85c636800 20 zone default found 2024-09-18T01:46:22.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.130+0000 7fc85c636800 4 Realm: () 2024-09-18T01:46:22.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.130+0000 7fc85c636800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:46:22.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.130+0000 7fc85c636800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:46:22.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.130+0000 7fc85c636800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:46:22.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.130+0000 7fc85c636800 20 zonegroup default 2024-09-18T01:46:22.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.130+0000 7fc85c636800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.130+0000 7fc85c636800 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558c0ffeed80 con 0x7fc84805f040 2024-09-18T01:46:22.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.130+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc84003b040 con 0x7fc84805f040 2024-09-18T01:46:22.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.130+0000 7fc85c636800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:22.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.130+0000 7fc85c636800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.130+0000 7fc85c636800 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558c0fff0c10 con 0x558c0ffebe20 2024-09-18T01:46:22.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.130+0000 7fc858153640 1 -- 172.21.15.146:0/1571982087 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc850029070 con 0x558c0ffebe20 2024-09-18T01:46:22.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.130+0000 7fc85c636800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:22.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.130+0000 7fc85c636800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.130+0000 7fc85c636800 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558c0fff0fb0 con 0x558c0ffebe20 2024-09-18T01:46:22.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.130+0000 7fc858153640 1 -- 172.21.15.146:0/1571982087 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc850029070 con 0x558c0ffebe20 2024-09-18T01:46:22.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.131+0000 7fc85c636800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:22.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.131+0000 7fc85c636800 20 started sync module instance, tier type = 2024-09-18T01:46:22.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.131+0000 7fc85c636800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:46:22.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.131+0000 7fc85c636800 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558c0fff00a0 con 0x7fc85003f070 2024-09-18T01:46:22.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.132+0000 7fc857952640 1 -- 172.21.15.146:0/1571982087 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v33'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84808a050 con 0x7fc85003f070 2024-09-18T01:46:22.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.132+0000 7fc85c636800 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94060052153536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558c0ffefd00 con 0x7fc85003f070 2024-09-18T01:46:22.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.132+0000 7fc85c636800 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558c0fff1e20 con 0x558c0ffe5be0 2024-09-18T01:46:22.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.133+0000 7fc857952640 1 -- 172.21.15.146:0/1571982087 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94060052153536] v33'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84808a050 con 0x7fc85003f070 2024-09-18T01:46:22.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.133+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v33'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84003b040 con 0x558c0ffe5be0 2024-09-18T01:46:22.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.133+0000 7fc85c636800 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94060052158832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558c0fff2240 con 0x558c0ffe5be0 2024-09-18T01:46:22.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.133+0000 7fc85c636800 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558c0fff2c00 con 0x558c0ffebe20 2024-09-18T01:46:22.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.134+0000 7fc858153640 1 -- 172.21.15.146:0/1571982087 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v33'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc850029070 con 0x558c0ffebe20 2024-09-18T01:46:22.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.134+0000 7fc85c636800 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94060052162384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558c0fff3450 con 0x558c0ffebe20 2024-09-18T01:46:22.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.134+0000 7fc85c636800 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558c0fff3f30 con 0x7fc85003f070 2024-09-18T01:46:22.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.134+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94060052158832] v33'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84003b040 con 0x558c0ffe5be0 2024-09-18T01:46:22.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.135+0000 7fc858153640 1 -- 172.21.15.146:0/1571982087 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94060052162384] v33'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc850029070 con 0x558c0ffebe20 2024-09-18T01:46:22.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.135+0000 7fc857952640 1 -- 172.21.15.146:0/1571982087 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v33'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84808a050 con 0x7fc85003f070 2024-09-18T01:46:22.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.135+0000 7fc85c636800 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94060052167232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558c0fff2fa0 con 0x7fc85003f070 2024-09-18T01:46:22.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.135+0000 7fc85c636800 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558c0fff47d0 con 0x558c0ffe5be0 2024-09-18T01:46:22.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.136+0000 7fc857952640 1 -- 172.21.15.146:0/1571982087 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94060052167232] v33'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84808a050 con 0x7fc85003f070 2024-09-18T01:46:22.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.137+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v33'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84003b040 con 0x558c0ffe5be0 2024-09-18T01:46:22.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.137+0000 7fc85c636800 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94060052159888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558c0fff2fa0 con 0x558c0ffe5be0 2024-09-18T01:46:22.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.137+0000 7fc85c636800 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558c0fff4ef0 con 0x7fc84805f040 2024-09-18T01:46:22.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.138+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94060052159888] v33'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84003b040 con 0x558c0ffe5be0 2024-09-18T01:46:22.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.138+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v33'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84003b040 con 0x7fc84805f040 2024-09-18T01:46:22.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.138+0000 7fc85c636800 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94060052171200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558c0fff4eb0 con 0x7fc84805f040 2024-09-18T01:46:22.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.138+0000 7fc85c636800 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558c0fff5900 con 0x7fc84805f040 2024-09-18T01:46:22.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.139+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94060052171200] v33'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84003b040 con 0x7fc84805f040 2024-09-18T01:46:22.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.139+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v33'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84003b040 con 0x7fc84805f040 2024-09-18T01:46:22.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.139+0000 7fc85c636800 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94060052169504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558c0fff5900 con 0x7fc84805f040 2024-09-18T01:46:22.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.139+0000 7fc85c636800 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558c0fff62c0 con 0x7fc84805f040 2024-09-18T01:46:22.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.140+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(58 notify.7 [create] v33'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84003b040 con 0x7fc84805f040 2024-09-18T01:46:22.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.140+0000 7fc85c636800 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94060052176400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558c0fff66e0 con 0x7fc84805f040 2024-09-18T01:46:22.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.140+0000 7fc85c636800 20 add_watcher() i=0 2024-09-18T01:46:22.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.140+0000 7fc85c636800 20 add_watcher() i=1 2024-09-18T01:46:22.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.140+0000 7fc85c636800 20 add_watcher() i=2 2024-09-18T01:46:22.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.140+0000 7fc85c636800 20 add_watcher() i=3 2024-09-18T01:46:22.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.140+0000 7fc85c636800 20 add_watcher() i=4 2024-09-18T01:46:22.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.140+0000 7fc85c636800 20 add_watcher() i=5 2024-09-18T01:46:22.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.140+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94060052169504] v33'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84003b040 con 0x7fc84805f040 2024-09-18T01:46:22.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.140+0000 7fc85c636800 20 add_watcher() i=6 2024-09-18T01:46:22.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.141+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94060052176400] v33'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84003b040 con 0x7fc84805f040 2024-09-18T01:46:22.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.141+0000 7fc85c636800 20 add_watcher() i=7 2024-09-18T01:46:22.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.141+0000 7fc85c636800 2 all 8 watchers are set, enabling cache 2024-09-18T01:46:22.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.141+0000 7fc85c636800 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558c0fff5450 con 0x558c0ffe5be0 2024-09-18T01:46:22.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.141+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc84003b040 con 0x558c0ffe5be0 2024-09-18T01:46:22.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.141+0000 7fc85c636800 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94060052177456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558c0fff5450 con 0x558c0ffe5be0 2024-09-18T01:46:22.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.142+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94060052177456] v33'208 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc84003b040 con 0x558c0ffe5be0 2024-09-18T01:46:22.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.142+0000 7fc70dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:46:22.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.142+0000 7fc85c636800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:46:22.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.142+0000 7fc85c636800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:46:22.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.142+0000 7fc85c636800 5 note: GC not initialized 2024-09-18T01:46:22.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.142+0000 7fc70cfe1640 20 reqs_thread_entry: start 2024-09-18T01:46:22.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.143+0000 7fc85c636800 20 init_complete bucket index max shards: 11 2024-09-18T01:46:22.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.143+0000 7fc85c636800 20 Filter name: none 2024-09-18T01:46:22.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.143+0000 7fc6867fc640 20 reqs_thread_entry: start 2024-09-18T01:46:22.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.143+0000 7fc85c636800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.143+0000 7fc85c636800 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558c1002c740 con 0x558c0ffe5be0 2024-09-18T01:46:22.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.143+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc84003b040 con 0x558c0ffe5be0 2024-09-18T01:46:22.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.143+0000 7fc85c636800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:46:22.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.143+0000 7fc85c636800 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558c1002dc90 con 0x7fc84805f040 2024-09-18T01:46:22.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.144+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7fc84003b040 con 0x7fc84805f040 2024-09-18T01:46:22.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.144+0000 7fc70dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:46:22.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.145+0000 7fc85c636800 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94060052177456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558c1002b1f0 con 0x558c0ffe5be0 2024-09-18T01:46:22.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.145+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94060052177456] v33'209 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc84003b040 con 0x558c0ffe5be0 2024-09-18T01:46:22.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.146+0000 7fc85c636800 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94060052153536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558c0fff6230 con 0x7fc85003f070 2024-09-18T01:46:22.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.146+0000 7fc857952640 1 -- 172.21.15.146:0/1571982087 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94060052153536] v33'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84808a050 con 0x7fc85003f070 2024-09-18T01:46:22.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.147+0000 7fc85c636800 20 remove_watcher() i=0 2024-09-18T01:46:22.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.147+0000 7fc85c636800 2 removed watcher, disabling cache 2024-09-18T01:46:22.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.147+0000 7fc85c636800 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94060052158832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558c0fff6230 con 0x558c0ffe5be0 2024-09-18T01:46:22.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.148+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94060052158832] v33'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84003b040 con 0x558c0ffe5be0 2024-09-18T01:46:22.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.148+0000 7fc85c636800 20 remove_watcher() i=1 2024-09-18T01:46:22.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.148+0000 7fc85c636800 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94060052162384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558c0fff1970 con 0x558c0ffebe20 2024-09-18T01:46:22.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.149+0000 7fc858153640 1 -- 172.21.15.146:0/1571982087 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94060052162384] v33'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc850029070 con 0x558c0ffebe20 2024-09-18T01:46:22.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.149+0000 7fc85c636800 20 remove_watcher() i=2 2024-09-18T01:46:22.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.149+0000 7fc85c636800 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94060052167232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558c0fff6230 con 0x7fc85003f070 2024-09-18T01:46:22.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.150+0000 7fc857952640 1 -- 172.21.15.146:0/1571982087 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94060052167232] v33'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84808a050 con 0x7fc85003f070 2024-09-18T01:46:22.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.150+0000 7fc85c636800 20 remove_watcher() i=3 2024-09-18T01:46:22.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.150+0000 7fc85c636800 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94060052159888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558c0fff1970 con 0x558c0ffe5be0 2024-09-18T01:46:22.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.151+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94060052159888] v33'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84003b040 con 0x558c0ffe5be0 2024-09-18T01:46:22.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.151+0000 7fc85c636800 20 remove_watcher() i=4 2024-09-18T01:46:22.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.151+0000 7fc85c636800 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94060052171200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558c0fff6230 con 0x7fc84805f040 2024-09-18T01:46:22.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.152+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94060052171200] v33'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84003b040 con 0x7fc84805f040 2024-09-18T01:46:22.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.152+0000 7fc85c636800 20 remove_watcher() i=5 2024-09-18T01:46:22.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.152+0000 7fc85c636800 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94060052169504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558c0fff1e20 con 0x7fc84805f040 2024-09-18T01:46:22.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.154+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94060052169504] v33'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84003b040 con 0x7fc84805f040 2024-09-18T01:46:22.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.154+0000 7fc85c636800 20 remove_watcher() i=6 2024-09-18T01:46:22.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.154+0000 7fc85c636800 1 -- 172.21.15.146:0/1571982087 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94060052176400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558c0fff6230 con 0x7fc84805f040 2024-09-18T01:46:22.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.155+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94060052176400] v33'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84003b040 con 0x7fc84805f040 2024-09-18T01:46:22.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.155+0000 7fc85c636800 20 remove_watcher() i=7 2024-09-18T01:46:22.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.155+0000 7fc85c636800 1 -- 172.21.15.146:0/1571982087 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fc84805f040 msgr2=0x7fc84805c410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.155+0000 7fc85c636800 1 --2- 172.21.15.146:0/1571982087 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fc84805f040 0x7fc84805c410 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.155+0000 7fc85c636800 1 -- 172.21.15.146:0/1571982087 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x558c0ffe5be0 msgr2=0x558c0ffe80a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.155+0000 7fc85c636800 1 --2- 172.21.15.146:0/1571982087 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x558c0ffe5be0 0x558c0ffe80a0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.155+0000 7fc85c636800 1 -- 172.21.15.146:0/1571982087 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fc85003f070 msgr2=0x7fc85002a4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.155+0000 7fc85c636800 1 --2- 172.21.15.146:0/1571982087 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fc85003f070 0x7fc85002a4f0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.155+0000 7fc85c636800 1 -- 172.21.15.146:0/1571982087 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x558c0ffebe20 msgr2=0x558c0ffee230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.155+0000 7fc85c636800 1 --2- 172.21.15.146:0/1571982087 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x558c0ffebe20 0x558c0ffee230 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.155+0000 7fc85c636800 1 -- 172.21.15.146:0/1571982087 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc720036d30 msgr2=0x7fc7200391f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.155+0000 7fc85c636800 1 --2- 172.21.15.146:0/1571982087 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc720036d30 0x7fc7200391f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc848068b10 tx=0x7fc848087000 comp rx=0 tx=0).stop 2024-09-18T01:46:22.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.155+0000 7fc85c636800 1 -- 172.21.15.146:0/1571982087 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x558c0ffd2aa0 msgr2=0x558c0ffd9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.155+0000 7fc85c636800 1 --2- 172.21.15.146:0/1571982087 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x558c0ffd2aa0 0x558c0ffd9ed0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fc850001450 tx=0x7fc85004c880 comp rx=0 tx=0).stop 2024-09-18T01:46:22.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.155+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 reap_dead start 2024-09-18T01:46:22.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.155+0000 7fc857151640 1 -- 172.21.15.146:0/1571982087 reap_dead start 2024-09-18T01:46:22.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.155+0000 7fc85c636800 1 -- 172.21.15.146:0/1571982087 shutdown_connections 2024-09-18T01:46:22.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.155+0000 7fc85c636800 1 -- 172.21.15.146:0/1571982087 >> 172.21.15.146:0/1571982087 conn(0x558c0ffcee50 msgr2=0x558c0ffd41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:22.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.155+0000 7fc85c636800 1 -- 172.21.15.146:0/1571982087 shutdown_connections 2024-09-18T01:46:22.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.155+0000 7fc85c636800 1 -- 172.21.15.146:0/1571982087 wait complete. 2024-09-18T01:46:22.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.155+0000 7fc85c636800 1 -- 172.21.15.146:0/2585783443 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc730036b40 msgr2=0x7fc730039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.155+0000 7fc85c636800 1 --2- 172.21.15.146:0/2585783443 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc730036b40 0x7fc730039000 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x558c0ffb8470 tx=0x7fc848067610 comp rx=0 tx=0).stop 2024-09-18T01:46:22.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.155+0000 7fc85c636800 1 -- 172.21.15.146:0/2585783443 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x558c0ffc5e00 msgr2=0x558c0ffc6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.155+0000 7fc85c636800 1 --2- 172.21.15.146:0/2585783443 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x558c0ffc5e00 0x558c0ffc6220 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x558c0ffb2b50 tx=0x7fc8500178e0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.155+0000 7fc85c636800 1 -- 172.21.15.146:0/2585783443 shutdown_connections 2024-09-18T01:46:22.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.155+0000 7fc85c636800 1 --2- 172.21.15.146:0/2585783443 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc730036b40 0x7fc730039000 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.155+0000 7fc85c636800 1 --2- 172.21.15.146:0/2585783443 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x558c0ffc5e00 0x558c0ffc6220 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.155+0000 7fc85c636800 1 -- 172.21.15.146:0/2585783443 >> 172.21.15.146:0/2585783443 conn(0x558c0ffbad90 msgr2=0x558c0ffbd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:22.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.156+0000 7fc85c636800 1 -- 172.21.15.146:0/2585783443 shutdown_connections 2024-09-18T01:46:22.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.156+0000 7fc85c636800 1 -- 172.21.15.146:0/2585783443 wait complete. 2024-09-18T01:46:22.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.156+0000 7fc85c636800 1 -- 172.21.15.146:0/1812552545 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x558c0feb7b40 msgr2=0x558c0ffb2270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.156+0000 7fc85c636800 1 --2- 172.21.15.146:0/1812552545 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x558c0feb7b40 0x558c0ffb2270 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.156+0000 7fc85c636800 1 -- 172.21.15.146:0/1812552545 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x558c0ffb40c0 msgr2=0x558c0ffb7930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.156+0000 7fc85c636800 1 --2- 172.21.15.146:0/1812552545 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x558c0ffb40c0 0x558c0ffb7930 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.156+0000 7fc85c636800 1 -- 172.21.15.146:0/1812552545 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc740036b90 msgr2=0x7fc740039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.156+0000 7fc85c636800 1 --2- 172.21.15.146:0/1812552545 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc740036b90 0x7fc740039050 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc840000c00 tx=0x7fc8400013b0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.156+0000 7fc85c636800 1 -- 172.21.15.146:0/1812552545 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x558c0fe26630 msgr2=0x558c0ffab200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.156+0000 7fc85c636800 1 --2- 172.21.15.146:0/1812552545 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x558c0fe26630 0x558c0ffab200 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fc848045f20 tx=0x7fc848002fb0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.156+0000 7fc85c636800 1 -- 172.21.15.146:0/1812552545 shutdown_connections 2024-09-18T01:46:22.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.156+0000 7fc85c636800 1 --2- 172.21.15.146:0/1812552545 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x558c0ffb40c0 0x558c0ffb7930 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.156+0000 7fc85c636800 1 --2- 172.21.15.146:0/1812552545 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x558c0feb7b40 0x558c0ffb2270 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.156+0000 7fc85c636800 1 --2- 172.21.15.146:0/1812552545 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc740036b90 0x7fc740039050 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.156+0000 7fc85c636800 1 --2- 172.21.15.146:0/1812552545 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x558c0fe26630 0x558c0ffab200 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.156+0000 7fc85c636800 1 -- 172.21.15.146:0/1812552545 >> 172.21.15.146:0/1812552545 conn(0x558c0feacdb0 msgr2=0x558c0ff9db10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:22.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.156+0000 7fc85c636800 1 -- 172.21.15.146:0/1812552545 shutdown_connections 2024-09-18T01:46:22.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.156+0000 7fc85c636800 1 -- 172.21.15.146:0/1812552545 wait complete. 2024-09-18T01:46:22.165 INFO:teuthology.orchestra.run.smithi146.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5}]},{"bucket":"myfoo2","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}],"total":{"bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}}]} 2024-09-18T01:46:22.165 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}]}, {'bucket': 'myfoo2', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}}]} 2024-09-18T01:46:22.166 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-18T01:46:22.166 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-18T01:46:22.166 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories put_obj 2024-09-18T01:46:22.212 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:46:22.213 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:46:22.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.213+0000 7f645f323800 1 Processor -- start 2024-09-18T01:46:22.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.213+0000 7f645f323800 1 -- start start 2024-09-18T01:46:22.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.213+0000 7f645f323800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x5562aa464920 0x5562aa466d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.213+0000 7f645f323800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5562aa31fb30 con 0x5562aa3d4630 2024-09-18T01:46:22.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.213+0000 7f645f323800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x5562aa301360 con 0x5562aa464920 2024-09-18T01:46:22.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.213+0000 7f645284d640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x5562aa464920 0x5562aa466d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.213+0000 7f645b04e640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x5562aa3d4630 0x5562aa463200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:49898/0 (socket says 172.21.15.146:49898) 2024-09-18T01:46:22.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.213+0000 7f645b04e640 1 -- 172.21.15.146:0/3489234328 learned_addr learned my addr 172.21.15.146:0/3489234328 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:46:22.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.213+0000 7f645284d640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x5562aa464920 0x5562aa466d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:43908/0 (socket says 172.21.15.146:43908) 2024-09-18T01:46:22.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.214+0000 7f645284d640 1 -- 172.21.15.146:0/3489234328 >> v1:172.21.15.129:6789/0 conn(0x5562aa3d4630 legacy=0x5562aa463200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.214+0000 7f645284d640 1 -- 172.21.15.146:0/3489234328 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562aa327e00 con 0x5562aa464920 2024-09-18T01:46:22.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.215+0000 7f645284d640 1 --2- 172.21.15.146:0/3489234328 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562aa464920 0x5562aa466d10 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f644400a470 tx=0x7f6444045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e97503c95cc6f65a server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.215+0000 7f645a84d640 1 -- 172.21.15.146:0/3489234328 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6444053570 con 0x5562aa464920 2024-09-18T01:46:22.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.216+0000 7f645a84d640 1 -- 172.21.15.146:0/3489234328 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6444058070 con 0x5562aa464920 2024-09-18T01:46:22.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.216+0000 7f645a84d640 1 -- 172.21.15.146:0/3489234328 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6444053880 con 0x5562aa464920 2024-09-18T01:46:22.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.216+0000 7f645f323800 1 -- 172.21.15.146:0/3489234328 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562aa464920 msgr2=0x5562aa466d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.216+0000 7f645f323800 1 --2- 172.21.15.146:0/3489234328 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562aa464920 0x5562aa466d10 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f644400a470 tx=0x7f6444045a20 comp rx=0 tx=0).stop 2024-09-18T01:46:22.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.216+0000 7f645f323800 1 -- 172.21.15.146:0/3489234328 shutdown_connections 2024-09-18T01:46:22.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.216+0000 7f645f323800 1 --2- 172.21.15.146:0/3489234328 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562aa464920 0x5562aa466d10 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.216+0000 7f645f323800 1 -- 172.21.15.146:0/3489234328 >> 172.21.15.146:0/3489234328 conn(0x5562aa45adb0 msgr2=0x5562aa45d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:22.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.216+0000 7f645f323800 1 -- 172.21.15.146:0/3489234328 shutdown_connections 2024-09-18T01:46:22.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.216+0000 7f645f323800 1 -- 172.21.15.146:0/3489234328 wait complete. 2024-09-18T01:46:22.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.230+0000 7f645f323800 1 Processor -- start 2024-09-18T01:46:22.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.230+0000 7f645f323800 1 -- start start 2024-09-18T01:46:22.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.230+0000 7f645f323800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562aa3d4630 0x5562aa460b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.230+0000 7f645f323800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5562aa3ac360 con 0x5562aa3d4630 2024-09-18T01:46:22.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.231+0000 7f645b04e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562aa3d4630 0x5562aa460b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.231+0000 7f645b04e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562aa3d4630 0x5562aa460b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:43914/0 (socket says 172.21.15.146:43914) 2024-09-18T01:46:22.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.231+0000 7f645b04e640 1 -- 172.21.15.146:0/3387800777 learned_addr learned my addr 172.21.15.146:0/3387800777 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:22.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.231+0000 7f645b04e640 1 -- 172.21.15.146:0/3387800777 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562aa2f9bc0 con 0x5562aa3d4630 2024-09-18T01:46:22.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.231+0000 7f645b04e640 1 --2- 172.21.15.146:0/3387800777 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562aa3d4630 0x5562aa460b30 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f644c001d80 tx=0x7f644c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a888b95eae87501 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.232+0000 7f634960a640 1 -- 172.21.15.146:0/3387800777 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f644c013030 con 0x5562aa3d4630 2024-09-18T01:46:22.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.232+0000 7f634960a640 1 -- 172.21.15.146:0/3387800777 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f644c00e470 con 0x5562aa3d4630 2024-09-18T01:46:22.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.232+0000 7f634960a640 1 -- 172.21.15.146:0/3387800777 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f644c00e810 con 0x5562aa3d4630 2024-09-18T01:46:22.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.232+0000 7f645f323800 1 -- 172.21.15.146:0/3387800777 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562aa3d4630 msgr2=0x5562aa460b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.232+0000 7f645f323800 1 --2- 172.21.15.146:0/3387800777 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562aa3d4630 0x5562aa460b30 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f644c001d80 tx=0x7f644c001e70 comp rx=0 tx=0).stop 2024-09-18T01:46:22.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.232+0000 7f645f323800 1 -- 172.21.15.146:0/3387800777 shutdown_connections 2024-09-18T01:46:22.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.232+0000 7f645f323800 1 --2- 172.21.15.146:0/3387800777 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562aa3d4630 0x5562aa460b30 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.232+0000 7f645f323800 1 -- 172.21.15.146:0/3387800777 >> 172.21.15.146:0/3387800777 conn(0x5562aa45adb0 msgr2=0x5562aa54b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:22.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.232+0000 7f645f323800 1 -- 172.21.15.146:0/3387800777 shutdown_connections 2024-09-18T01:46:22.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.232+0000 7f645f323800 1 -- 172.21.15.146:0/3387800777 wait complete. 2024-09-18T01:46:22.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.233+0000 7f645f323800 1 Processor -- start 2024-09-18T01:46:22.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.233+0000 7f645f323800 1 -- start start 2024-09-18T01:46:22.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.233+0000 7f645f323800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562aa3d4630 0x5562aa5594e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.233+0000 7f645f323800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5562aa467610 con 0x5562aa3d4630 2024-09-18T01:46:22.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.233+0000 7f645b04e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562aa3d4630 0x5562aa5594e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.233+0000 7f645b04e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562aa3d4630 0x5562aa5594e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:43922/0 (socket says 172.21.15.146:43922) 2024-09-18T01:46:22.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.233+0000 7f645b04e640 1 -- 172.21.15.146:0/1321234221 learned_addr learned my addr 172.21.15.146:0/1321234221 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:22.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.233+0000 7f645b04e640 1 -- 172.21.15.146:0/1321234221 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562aa30dfe0 con 0x5562aa3d4630 2024-09-18T01:46:22.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.234+0000 7f645b04e640 1 --2- 172.21.15.146:0/1321234221 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562aa3d4630 0x5562aa5594e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f644c004000 tx=0x7f644c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.234+0000 7f6347e07640 1 -- 172.21.15.146:0/1321234221 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f644c027070 con 0x5562aa3d4630 2024-09-18T01:46:22.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.234+0000 7f6347e07640 1 -- 172.21.15.146:0/1321234221 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f644c019900 con 0x5562aa3d4630 2024-09-18T01:46:22.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.234+0000 7f6347e07640 1 -- 172.21.15.146:0/1321234221 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f644c019c60 con 0x5562aa3d4630 2024-09-18T01:46:22.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.234+0000 7f645f323800 1 -- 172.21.15.146:0/1321234221 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5562aa559a20 con 0x5562aa3d4630 2024-09-18T01:46:22.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.234+0000 7f645f323800 1 -- 172.21.15.146:0/1321234221 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562aa559f40 con 0x5562aa3d4630 2024-09-18T01:46:22.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.235+0000 7f6347e07640 1 -- 172.21.15.146:0/1321234221 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f644c02a070 con 0x5562aa3d4630 2024-09-18T01:46:22.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.235+0000 7f6347e07640 1 --2- 172.21.15.146:0/1321234221 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6340036b40 0x7f6340039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.235+0000 7f6347e07640 1 -- 172.21.15.146:0/1321234221 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f644c01f070 con 0x5562aa3d4630 2024-09-18T01:46:22.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.235+0000 7f645284d640 1 --2- 172.21.15.146:0/1321234221 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6340036b40 0x7f6340039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.235+0000 7f645f323800 1 --2- 172.21.15.146:0/1321234221 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5562aa464920 0x5562aa560550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.235+0000 7f645f323800 1 -- 172.21.15.146:0/1321234221 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5562aa560ad0 con 0x5562aa464920 2024-09-18T01:46:22.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.235+0000 7f645b84f640 1 --2- 172.21.15.146:0/1321234221 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5562aa464920 0x5562aa560550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.235+0000 7f645284d640 1 --2- 172.21.15.146:0/1321234221 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6340036b40 0x7f6340039000 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6444057000 tx=0x7f6444052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.236+0000 7f645b84f640 1 --2- 172.21.15.146:0/1321234221 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5562aa464920 0x5562aa560550 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.236+0000 7f645b84f640 1 -- 172.21.15.146:0/1321234221 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f645400a4a0 con 0x5562aa464920 2024-09-18T01:46:22.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.236+0000 7f645f323800 1 -- 172.21.15.146:0/1321234221 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5562aa55db20 con 0x5562aa464920 2024-09-18T01:46:22.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.236+0000 7f645b84f640 1 -- 172.21.15.146:0/1321234221 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f645400a4a0 con 0x5562aa464920 2024-09-18T01:46:22.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.236+0000 7f645f323800 1 -- 172.21.15.146:0/1321234221 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5562aa562910 con 0x5562aa464920 2024-09-18T01:46:22.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.236+0000 7f645b84f640 1 -- 172.21.15.146:0/1321234221 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f645400a4a0 con 0x5562aa464920 2024-09-18T01:46:22.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.236+0000 7f645f323800 1 -- 172.21.15.146:0/1321234221 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5562aa561b40 con 0x5562aa464920 2024-09-18T01:46:22.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.237+0000 7f645b84f640 1 -- 172.21.15.146:0/1321234221 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f645400a4a0 con 0x5562aa464920 2024-09-18T01:46:22.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.237+0000 7f645f323800 1 --2- 172.21.15.146:0/1321234221 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5562aa563cc0 0x5562aa5660b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.237+0000 7f645f323800 1 -- 172.21.15.146:0/1321234221 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5562aa5665f0 con 0x5562aa563cc0 2024-09-18T01:46:22.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.237+0000 7f645b04e640 1 --2- 172.21.15.146:0/1321234221 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5562aa563cc0 0x5562aa5660b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.237+0000 7f645b04e640 1 --2- 172.21.15.146:0/1321234221 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5562aa563cc0 0x5562aa5660b0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.237+0000 7f645b04e640 1 -- 172.21.15.146:0/1321234221 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f644c029030 con 0x5562aa563cc0 2024-09-18T01:46:22.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.238+0000 7f645f323800 1 Processor -- start 2024-09-18T01:46:22.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.238+0000 7f645f323800 1 -- start start 2024-09-18T01:46:22.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.238+0000 7f645f323800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562aa574270 0x5562aa574690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.238+0000 7f645f323800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5562aa2fb580 con 0x5562aa574270 2024-09-18T01:46:22.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.238+0000 7f645b84f640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562aa574270 0x5562aa574690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.238+0000 7f645b84f640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562aa574270 0x5562aa574690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:43932/0 (socket says 172.21.15.146:43932) 2024-09-18T01:46:22.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.238+0000 7f645b84f640 1 -- 172.21.15.146:0/1498418557 learned_addr learned my addr 172.21.15.146:0/1498418557 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:22.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.238+0000 7f645b84f640 1 -- 172.21.15.146:0/1498418557 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562aa574bd0 con 0x5562aa574270 2024-09-18T01:46:22.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.239+0000 7f645b84f640 1 --2- 172.21.15.146:0/1498418557 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562aa574270 0x5562aa574690 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x5562aa55a8e0 tx=0x7f64540178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.239+0000 7f6345602640 1 -- 172.21.15.146:0/1498418557 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6454013440 con 0x5562aa574270 2024-09-18T01:46:22.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.239+0000 7f6345602640 1 -- 172.21.15.146:0/1498418557 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64540135e0 con 0x5562aa574270 2024-09-18T01:46:22.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.239+0000 7f645f323800 1 -- 172.21.15.146:0/1498418557 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5562aa574e60 con 0x5562aa574270 2024-09-18T01:46:22.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.239+0000 7f6345602640 1 -- 172.21.15.146:0/1498418557 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64540138c0 con 0x5562aa574270 2024-09-18T01:46:22.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.239+0000 7f645f323800 1 -- 172.21.15.146:0/1498418557 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562aa577b40 con 0x5562aa574270 2024-09-18T01:46:22.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.240+0000 7f6345602640 1 -- 172.21.15.146:0/1498418557 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6454011040 con 0x5562aa574270 2024-09-18T01:46:22.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.240+0000 7f6345602640 1 --2- 172.21.15.146:0/1498418557 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6334036b90 0x7f6334039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.240+0000 7f6345602640 1 -- 172.21.15.146:0/1498418557 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f645401d070 con 0x5562aa574270 2024-09-18T01:46:22.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.240+0000 7f645b04e640 1 --2- 172.21.15.146:0/1498418557 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6334036b90 0x7f6334039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.240+0000 7f645f323800 1 Processor -- start 2024-09-18T01:46:22.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.240+0000 7f645b04e640 1 --2- 172.21.15.146:0/1498418557 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6334036b90 0x7f6334039050 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f644c016fd0 tx=0x7f644c04ad80 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.240+0000 7f645f323800 1 -- start start 2024-09-18T01:46:22.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.240+0000 7f645f323800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562aa580ef0 0x5562aa5812f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.240+0000 7f645f323800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5562aa45f200 con 0x5562aa580ef0 2024-09-18T01:46:22.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.241+0000 7f645b84f640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562aa580ef0 0x5562aa5812f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.241+0000 7f645b84f640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562aa580ef0 0x5562aa5812f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:43946/0 (socket says 172.21.15.146:43946) 2024-09-18T01:46:22.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.241+0000 7f645b84f640 1 -- 172.21.15.146:0/3365647577 learned_addr learned my addr 172.21.15.146:0/3365647577 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:22.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.241+0000 7f645b84f640 1 -- 172.21.15.146:0/3365647577 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562aa5818c0 con 0x5562aa580ef0 2024-09-18T01:46:22.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.241+0000 7f645b84f640 1 --2- 172.21.15.146:0/3365647577 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562aa580ef0 0x5562aa5812f0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f645404c8c0 tx=0x7f6454001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bc39bf3bf595f13 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.241+0000 7f633effd640 1 -- 172.21.15.146:0/3365647577 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6454027040 con 0x5562aa580ef0 2024-09-18T01:46:22.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.241+0000 7f633effd640 1 -- 172.21.15.146:0/3365647577 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6454012cc0 con 0x5562aa580ef0 2024-09-18T01:46:22.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.241+0000 7f633effd640 1 -- 172.21.15.146:0/3365647577 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f645404b250 con 0x5562aa580ef0 2024-09-18T01:46:22.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.242+0000 7f645f323800 1 -- 172.21.15.146:0/3365647577 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562aa580ef0 msgr2=0x5562aa5812f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.242+0000 7f645f323800 1 --2- 172.21.15.146:0/3365647577 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562aa580ef0 0x5562aa5812f0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f645404c8c0 tx=0x7f6454001940 comp rx=0 tx=0).stop 2024-09-18T01:46:22.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.242+0000 7f645f323800 1 -- 172.21.15.146:0/3365647577 shutdown_connections 2024-09-18T01:46:22.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.242+0000 7f645f323800 1 --2- 172.21.15.146:0/3365647577 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562aa580ef0 0x5562aa5812f0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.242+0000 7f645f323800 1 -- 172.21.15.146:0/3365647577 >> 172.21.15.146:0/3365647577 conn(0x5562aa57d290 msgr2=0x5562aa57b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:22.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.242+0000 7f645f323800 1 -- 172.21.15.146:0/3365647577 shutdown_connections 2024-09-18T01:46:22.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.242+0000 7f645f323800 1 -- 172.21.15.146:0/3365647577 wait complete. 2024-09-18T01:46:22.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.242+0000 7f645f323800 1 Processor -- start 2024-09-18T01:46:22.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.242+0000 7f645f323800 1 -- start start 2024-09-18T01:46:22.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.242+0000 7f645f323800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562aa580ef0 0x5562aa5882f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.242+0000 7f645f323800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5562aa581ee0 con 0x5562aa580ef0 2024-09-18T01:46:22.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.242+0000 7f645b84f640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562aa580ef0 0x5562aa5882f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.242+0000 7f645b84f640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562aa580ef0 0x5562aa5882f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:43954/0 (socket says 172.21.15.146:43954) 2024-09-18T01:46:22.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.242+0000 7f645b84f640 1 -- 172.21.15.146:0/3799275091 learned_addr learned my addr 172.21.15.146:0/3799275091 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:22.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.243+0000 7f645b84f640 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562aa588830 con 0x5562aa580ef0 2024-09-18T01:46:22.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.243+0000 7f645b84f640 1 --2- 172.21.15.146:0/3799275091 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562aa580ef0 0x5562aa5882f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f6454001df0 tx=0x7f645404c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.243+0000 7f633d7fa640 1 -- 172.21.15.146:0/3799275091 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6454027070 con 0x5562aa580ef0 2024-09-18T01:46:22.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.243+0000 7f633d7fa640 1 -- 172.21.15.146:0/3799275091 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64540015f0 con 0x5562aa580ef0 2024-09-18T01:46:22.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.243+0000 7f645f323800 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5562aa588ac0 con 0x5562aa580ef0 2024-09-18T01:46:22.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.243+0000 7f633d7fa640 1 -- 172.21.15.146:0/3799275091 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f645402aa60 con 0x5562aa580ef0 2024-09-18T01:46:22.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.243+0000 7f645f323800 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562aa58b770 con 0x5562aa580ef0 2024-09-18T01:46:22.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.244+0000 7f633d7fa640 1 -- 172.21.15.146:0/3799275091 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f645402ac00 con 0x5562aa580ef0 2024-09-18T01:46:22.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.244+0000 7f633d7fa640 1 --2- 172.21.15.146:0/3799275091 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6324036b40 0x7f6324039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.244+0000 7f633d7fa640 1 -- 172.21.15.146:0/3799275091 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f6454033070 con 0x5562aa580ef0 2024-09-18T01:46:22.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.244+0000 7f645b04e640 1 --2- 172.21.15.146:0/3799275091 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6324036b40 0x7f6324039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.244+0000 7f645f323800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.244+0000 7f645f323800 1 --2- 172.21.15.146:0/3799275091 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5562aa593ff0 0x5562aa5964b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.244+0000 7f645f323800 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5562aa596c00 con 0x5562aa593ff0 2024-09-18T01:46:22.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.244+0000 7f645284d640 1 --2- 172.21.15.146:0/3799275091 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5562aa593ff0 0x5562aa5964b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.245+0000 7f645b04e640 1 --2- 172.21.15.146:0/3799275091 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6324036b40 0x7f6324039000 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f644c02af70 tx=0x7f644c033000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.245+0000 7f645284d640 1 --2- 172.21.15.146:0/3799275091 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5562aa593ff0 0x5562aa5964b0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.245+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6444051070 con 0x5562aa593ff0 2024-09-18T01:46:22.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.245+0000 7f645f323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:22.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.245+0000 7f645f323800 20 realm 2024-09-18T01:46:22.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.245+0000 7f645f323800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.245+0000 7f645f323800 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5562aa597030 con 0x5562aa593ff0 2024-09-18T01:46:22.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.245+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6444051070 con 0x5562aa593ff0 2024-09-18T01:46:22.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.245+0000 7f645f323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:22.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.245+0000 7f645f323800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:46:22.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.245+0000 7f645f323800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.245+0000 7f645f323800 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5562aa597900 con 0x5562aa593ff0 2024-09-18T01:46:22.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.245+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6444051070 con 0x5562aa593ff0 2024-09-18T01:46:22.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.245+0000 7f645f323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:22.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.245+0000 7f645f323800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.246+0000 7f645f323800 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5562aa597ca0 con 0x5562aa593ff0 2024-09-18T01:46:22.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.246+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6444051070 con 0x5562aa593ff0 2024-09-18T01:46:22.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.246+0000 7f645f323800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:46:22.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.246+0000 7f645f323800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.246+0000 7f645f323800 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5562aa597510 con 0x5562aa593ff0 2024-09-18T01:46:22.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.246+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6444051070 con 0x5562aa593ff0 2024-09-18T01:46:22.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.246+0000 7f645f323800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:46:22.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.246+0000 7f645f323800 20 searching for the correct realm 2024-09-18T01:46:22.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.246+0000 7f645f323800 1 --2- 172.21.15.146:0/3799275091 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5562aa59a160 0x5562aa59c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.246+0000 7f645f323800 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5562aa59cc40 con 0x5562aa59a160 2024-09-18T01:46:22.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.246+0000 7f645b84f640 1 --2- 172.21.15.146:0/3799275091 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5562aa59a160 0x5562aa59c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.246+0000 7f645b84f640 1 --2- 172.21.15.146:0/3799275091 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5562aa59a160 0x5562aa59c570 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.247+0000 7f645b84f640 1 -- 172.21.15.146:0/3799275091 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6454057040 con 0x5562aa59a160 2024-09-18T01:46:22.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.247+0000 7f645b84f640 1 --2- 172.21.15.146:0/3799275091 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f64540123a0 0x7f6454036580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.247+0000 7f645b84f640 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5562aa59cc40 con 0x7f64540123a0 2024-09-18T01:46:22.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.247+0000 7f645b04e640 1 --2- 172.21.15.146:0/3799275091 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f64540123a0 0x7f6454036580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.247+0000 7f645b04e640 1 --2- 172.21.15.146:0/3799275091 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f64540123a0 0x7f6454036580 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.247+0000 7f645b04e640 1 -- 172.21.15.146:0/3799275091 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f644c029030 con 0x7f64540123a0 2024-09-18T01:46:22.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.247+0000 7f645b04e640 1 --2- 172.21.15.146:0/3799275091 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f644c02c060 0x7f644c00caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.247+0000 7f645b04e640 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5562aa59cc40 con 0x7f644c02c060 2024-09-18T01:46:22.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.248+0000 7f645284d640 1 --2- 172.21.15.146:0/3799275091 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f644c02c060 0x7f644c00caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.248+0000 7f645284d640 1 --2- 172.21.15.146:0/3799275091 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f644c02c060 0x7f644c00caa0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.248+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6444051070 con 0x7f644c02c060 2024-09-18T01:46:22.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.248+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5562aa59cc40 con 0x5562aa593ff0 2024-09-18T01:46:22.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.248+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6444051070 con 0x5562aa593ff0 2024-09-18T01:46:22.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.248+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5562aa59cc40 con 0x5562aa593ff0 2024-09-18T01:46:22.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.249+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6444051070 con 0x5562aa593ff0 2024-09-18T01:46:22.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.249+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5562aa59cc40 con 0x7f644c02c060 2024-09-18T01:46:22.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.249+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6444051070 con 0x7f644c02c060 2024-09-18T01:46:22.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.249+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5562aa59cc40 con 0x7f644c02c060 2024-09-18T01:46:22.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.249+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6444051070 con 0x7f644c02c060 2024-09-18T01:46:22.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.249+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5562aa59cc40 con 0x7f64540123a0 2024-09-18T01:46:22.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.249+0000 7f645b04e640 1 -- 172.21.15.146:0/3799275091 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f644c029030 con 0x7f64540123a0 2024-09-18T01:46:22.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.249+0000 7f645b04e640 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5562aa59cc40 con 0x5562aa59a160 2024-09-18T01:46:22.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.250+0000 7f645b84f640 1 -- 172.21.15.146:0/3799275091 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6454057040 con 0x5562aa59a160 2024-09-18T01:46:22.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.250+0000 7f645b84f640 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5562aa59cc40 con 0x5562aa593ff0 2024-09-18T01:46:22.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.250+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6444051070 con 0x5562aa593ff0 2024-09-18T01:46:22.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.250+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5562aa59cc40 con 0x7f644c02c060 2024-09-18T01:46:22.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.250+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6444051070 con 0x7f644c02c060 2024-09-18T01:46:22.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.250+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5562aa59cc40 con 0x5562aa593ff0 2024-09-18T01:46:22.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.250+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6444051070 con 0x5562aa593ff0 2024-09-18T01:46:22.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.250+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5562aa59cc40 con 0x7f64540123a0 2024-09-18T01:46:22.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.251+0000 7f645b04e640 1 -- 172.21.15.146:0/3799275091 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f644c029030 con 0x7f64540123a0 2024-09-18T01:46:22.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.251+0000 7f645b04e640 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5562aa59cc40 con 0x5562aa59a160 2024-09-18T01:46:22.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.251+0000 7f645b84f640 1 -- 172.21.15.146:0/3799275091 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6454057040 con 0x5562aa59a160 2024-09-18T01:46:22.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.251+0000 7f645b84f640 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5562aa59cc40 con 0x5562aa59a160 2024-09-18T01:46:22.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.251+0000 7f645b84f640 1 -- 172.21.15.146:0/3799275091 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6454057040 con 0x5562aa59a160 2024-09-18T01:46:22.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.251+0000 7f645b84f640 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5562aa59cc40 con 0x7f644c02c060 2024-09-18T01:46:22.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.251+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6444051070 con 0x7f644c02c060 2024-09-18T01:46:22.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.251+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5562aa59cc40 con 0x5562aa59a160 2024-09-18T01:46:22.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.252+0000 7f645b84f640 1 -- 172.21.15.146:0/3799275091 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6454057040 con 0x5562aa59a160 2024-09-18T01:46:22.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.252+0000 7f645b84f640 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5562aa59cc40 con 0x5562aa59a160 2024-09-18T01:46:22.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.252+0000 7f645b84f640 1 -- 172.21.15.146:0/3799275091 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6454057040 con 0x5562aa59a160 2024-09-18T01:46:22.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.252+0000 7f645b84f640 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5562aa59cc40 con 0x5562aa593ff0 2024-09-18T01:46:22.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.252+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6444051070 con 0x5562aa593ff0 2024-09-18T01:46:22.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.252+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5562aa59cc40 con 0x5562aa593ff0 2024-09-18T01:46:22.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.252+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6444051070 con 0x5562aa593ff0 2024-09-18T01:46:22.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.252+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5562aa59cc40 con 0x7f644c02c060 2024-09-18T01:46:22.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.253+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6444051070 con 0x7f644c02c060 2024-09-18T01:46:22.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.253+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5562aa59cc40 con 0x5562aa59a160 2024-09-18T01:46:22.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.253+0000 7f645b84f640 1 -- 172.21.15.146:0/3799275091 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6454057040 con 0x5562aa59a160 2024-09-18T01:46:22.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.253+0000 7f645b84f640 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5562aa59cc40 con 0x7f64540123a0 2024-09-18T01:46:22.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.253+0000 7f645b04e640 1 -- 172.21.15.146:0/3799275091 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f644c029030 con 0x7f64540123a0 2024-09-18T01:46:22.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.253+0000 7f645b04e640 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5562aa59cc40 con 0x5562aa593ff0 2024-09-18T01:46:22.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.253+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6444051070 con 0x5562aa593ff0 2024-09-18T01:46:22.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.253+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5562aa59cc40 con 0x7f644c02c060 2024-09-18T01:46:22.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.254+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6444051070 con 0x7f644c02c060 2024-09-18T01:46:22.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.254+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5562aa59cc40 con 0x5562aa59a160 2024-09-18T01:46:22.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.254+0000 7f645b84f640 1 -- 172.21.15.146:0/3799275091 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6454057040 con 0x5562aa59a160 2024-09-18T01:46:22.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.254+0000 7f645b84f640 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5562aa59cc40 con 0x7f644c02c060 2024-09-18T01:46:22.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.254+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6444051070 con 0x7f644c02c060 2024-09-18T01:46:22.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.254+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5562aa59cc40 con 0x7f64540123a0 2024-09-18T01:46:22.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.254+0000 7f645b04e640 1 -- 172.21.15.146:0/3799275091 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f644c029030 con 0x7f64540123a0 2024-09-18T01:46:22.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.254+0000 7f645b04e640 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5562aa59cc40 con 0x5562aa59a160 2024-09-18T01:46:22.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.255+0000 7f645b84f640 1 -- 172.21.15.146:0/3799275091 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6454057040 con 0x5562aa59a160 2024-09-18T01:46:22.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.255+0000 7f645b84f640 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5562aa59cc40 con 0x7f644c02c060 2024-09-18T01:46:22.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.255+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6444051070 con 0x7f644c02c060 2024-09-18T01:46:22.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.255+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5562aa59cc40 con 0x5562aa593ff0 2024-09-18T01:46:22.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.255+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6444051070 con 0x5562aa593ff0 2024-09-18T01:46:22.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.255+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5562aa59cc40 con 0x7f64540123a0 2024-09-18T01:46:22.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.255+0000 7f645b04e640 1 -- 172.21.15.146:0/3799275091 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f644c060040 con 0x7f64540123a0 2024-09-18T01:46:22.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.255+0000 7f645f323800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:46:22.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.255+0000 7f645f323800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:46:22.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.255+0000 7f645f323800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:46:22.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.255+0000 7f645f323800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:46:22.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.255+0000 7f645f323800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:46:22.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.255+0000 7f645f323800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:46:22.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.255+0000 7f645f323800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.255+0000 7f645f323800 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5562aa598be0 con 0x5562aa593ff0 2024-09-18T01:46:22.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.256+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6444051070 con 0x5562aa593ff0 2024-09-18T01:46:22.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.256+0000 7f645f323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:22.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.256+0000 7f645f323800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.256+0000 7f645f323800 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5562aa599480 con 0x5562aa593ff0 2024-09-18T01:46:22.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.256+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6444051070 con 0x5562aa593ff0 2024-09-18T01:46:22.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.256+0000 7f645f323800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:46:22.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.256+0000 7f645f323800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.256+0000 7f645f323800 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5562aa598820 con 0x7f64540123a0 2024-09-18T01:46:22.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.256+0000 7f645b04e640 1 -- 172.21.15.146:0/3799275091 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f644c060040 con 0x7f64540123a0 2024-09-18T01:46:22.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.256+0000 7f645f323800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:46:22.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.256+0000 7f645f323800 20 zone default found 2024-09-18T01:46:22.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.256+0000 7f645f323800 4 Realm: () 2024-09-18T01:46:22.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.256+0000 7f645f323800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:46:22.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.256+0000 7f645f323800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:46:22.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.256+0000 7f645f323800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:46:22.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.256+0000 7f645f323800 20 zonegroup default 2024-09-18T01:46:22.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.256+0000 7f645f323800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.256+0000 7f645f323800 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5562aa59d570 con 0x7f644c02c060 2024-09-18T01:46:22.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.256+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6444051070 con 0x7f644c02c060 2024-09-18T01:46:22.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.256+0000 7f645f323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:22.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.256+0000 7f645f323800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.256+0000 7f645f323800 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5562aa59f0d0 con 0x5562aa59a160 2024-09-18T01:46:22.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.257+0000 7f645b84f640 1 -- 172.21.15.146:0/3799275091 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6454057040 con 0x5562aa59a160 2024-09-18T01:46:22.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.257+0000 7f645f323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:22.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.257+0000 7f645f323800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.257+0000 7f645f323800 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5562aa59f5f0 con 0x5562aa59a160 2024-09-18T01:46:22.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.257+0000 7f645b84f640 1 -- 172.21.15.146:0/3799275091 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6454057040 con 0x5562aa59a160 2024-09-18T01:46:22.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.257+0000 7f645f323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:22.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.257+0000 7f645f323800 20 started sync module instance, tier type = 2024-09-18T01:46:22.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.257+0000 7f645f323800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:46:22.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.257+0000 7f645f323800 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562aa59dfd0 con 0x7f64540123a0 2024-09-18T01:46:22.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.258+0000 7f645b04e640 1 -- 172.21.15.146:0/3799275091 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v33'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f644c060040 con 0x7f64540123a0 2024-09-18T01:46:22.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.258+0000 7f645f323800 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93882253173696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562aa59ff00 con 0x7f64540123a0 2024-09-18T01:46:22.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.258+0000 7f645f323800 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562aa5a0750 con 0x5562aa593ff0 2024-09-18T01:46:22.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.259+0000 7f645b04e640 1 -- 172.21.15.146:0/3799275091 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93882253173696] v33'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f644c060040 con 0x7f64540123a0 2024-09-18T01:46:22.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.259+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v33'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6444051070 con 0x5562aa593ff0 2024-09-18T01:46:22.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.259+0000 7f645f323800 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93882253179472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562aa5a0810 con 0x5562aa593ff0 2024-09-18T01:46:22.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.259+0000 7f645f323800 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562aa5a1330 con 0x5562aa59a160 2024-09-18T01:46:22.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.260+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93882253179472] v33'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6444051070 con 0x5562aa593ff0 2024-09-18T01:46:22.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.261+0000 7f645b84f640 1 -- 172.21.15.146:0/3799275091 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v33'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6454057040 con 0x5562aa59a160 2024-09-18T01:46:22.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.261+0000 7f645f323800 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93882253184512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562aa5a12f0 con 0x5562aa59a160 2024-09-18T01:46:22.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.261+0000 7f645f323800 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562aa5a1de0 con 0x7f64540123a0 2024-09-18T01:46:22.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.262+0000 7f645b84f640 1 -- 172.21.15.146:0/3799275091 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93882253184512] v33'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6454057040 con 0x5562aa59a160 2024-09-18T01:46:22.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.262+0000 7f645b04e640 1 -- 172.21.15.146:0/3799275091 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v33'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f644c060040 con 0x7f64540123a0 2024-09-18T01:46:22.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.262+0000 7f645f323800 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93882253187312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562aa5a2200 con 0x7f64540123a0 2024-09-18T01:46:22.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.262+0000 7f645f323800 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562aa5a2c20 con 0x5562aa593ff0 2024-09-18T01:46:22.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.263+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v33'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6444051070 con 0x5562aa593ff0 2024-09-18T01:46:22.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.263+0000 7f645f323800 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93882253190928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562aa5a2be0 con 0x5562aa593ff0 2024-09-18T01:46:22.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.263+0000 7f645b04e640 1 -- 172.21.15.146:0/3799275091 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93882253187312] v33'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f644c060040 con 0x7f64540123a0 2024-09-18T01:46:22.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.263+0000 7f645f323800 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562aa5a3be0 con 0x7f644c02c060 2024-09-18T01:46:22.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.264+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v33'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6444051070 con 0x7f644c02c060 2024-09-18T01:46:22.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.264+0000 7f645f323800 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93882253181680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562aa5a3be0 con 0x7f644c02c060 2024-09-18T01:46:22.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.264+0000 7f645f323800 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562aa5a45e0 con 0x7f644c02c060 2024-09-18T01:46:22.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.264+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93882253190928] v33'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6444051070 con 0x5562aa593ff0 2024-09-18T01:46:22.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.265+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93882253181680] v33'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6444051070 con 0x7f644c02c060 2024-09-18T01:46:22.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.265+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v33'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6444051070 con 0x7f644c02c060 2024-09-18T01:46:22.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.265+0000 7f645f323800 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93882253195024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562aa5a40f0 con 0x7f644c02c060 2024-09-18T01:46:22.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.265+0000 7f645f323800 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562aa5a4ab0 con 0x7f644c02c060 2024-09-18T01:46:22.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.266+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(58 notify.7 [create] v33'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6444051070 con 0x7f644c02c060 2024-09-18T01:46:22.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.266+0000 7f645f323800 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93882253198848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562aa5a4ed0 con 0x7f644c02c060 2024-09-18T01:46:22.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.266+0000 7f645f323800 20 add_watcher() i=0 2024-09-18T01:46:22.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.266+0000 7f645f323800 20 add_watcher() i=1 2024-09-18T01:46:22.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.266+0000 7f645f323800 20 add_watcher() i=2 2024-09-18T01:46:22.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.266+0000 7f645f323800 20 add_watcher() i=3 2024-09-18T01:46:22.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.266+0000 7f645f323800 20 add_watcher() i=4 2024-09-18T01:46:22.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.266+0000 7f645f323800 20 add_watcher() i=5 2024-09-18T01:46:22.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.266+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93882253195024] v33'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6444051070 con 0x7f644c02c060 2024-09-18T01:46:22.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.266+0000 7f645f323800 20 add_watcher() i=6 2024-09-18T01:46:22.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.267+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93882253198848] v33'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6444051070 con 0x7f644c02c060 2024-09-18T01:46:22.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.267+0000 7f645f323800 20 add_watcher() i=7 2024-09-18T01:46:22.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.267+0000 7f645f323800 2 all 8 watchers are set, enabling cache 2024-09-18T01:46:22.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.267+0000 7f645f323800 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5562aa5a4ed0 con 0x5562aa593ff0 2024-09-18T01:46:22.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.268+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6444051070 con 0x5562aa593ff0 2024-09-18T01:46:22.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.268+0000 7f645f323800 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93882253199904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562aa5a4e40 con 0x5562aa593ff0 2024-09-18T01:46:22.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.269+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93882253199904] v33'210 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6444051070 con 0x5562aa593ff0 2024-09-18T01:46:22.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.269+0000 7f6311fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:46:22.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.269+0000 7f645f323800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:46:22.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.269+0000 7f645f323800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:46:22.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.269+0000 7f645f323800 5 note: GC not initialized 2024-09-18T01:46:22.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.269+0000 7f6310fe1640 20 reqs_thread_entry: start 2024-09-18T01:46:22.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.269+0000 7f645f323800 20 init_complete bucket index max shards: 11 2024-09-18T01:46:22.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.269+0000 7f645f323800 20 Filter name: none 2024-09-18T01:46:22.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.269+0000 7f628a7fc640 20 reqs_thread_entry: start 2024-09-18T01:46:22.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.269+0000 7f645f323800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.269+0000 7f645f323800 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5562aa5dad90 con 0x5562aa593ff0 2024-09-18T01:46:22.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.270+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f6444051070 con 0x5562aa593ff0 2024-09-18T01:46:22.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.270+0000 7f645f323800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:46:22.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.270+0000 7f645f323800 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5562aa5dc2e0 con 0x7f644c02c060 2024-09-18T01:46:22.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.270+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f6444051070 con 0x7f644c02c060 2024-09-18T01:46:22.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.271+0000 7f6311fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:46:22.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.271+0000 7f645f323800 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93882253199904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562aa5d9840 con 0x5562aa593ff0 2024-09-18T01:46:22.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.272+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93882253199904] v33'211 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6444051070 con 0x5562aa593ff0 2024-09-18T01:46:22.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.272+0000 7f645f323800 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93882253173696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562aa5a4a20 con 0x7f64540123a0 2024-09-18T01:46:22.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.273+0000 7f645b04e640 1 -- 172.21.15.146:0/3799275091 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93882253173696] v33'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f644c060040 con 0x7f64540123a0 2024-09-18T01:46:22.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.273+0000 7f645f323800 20 remove_watcher() i=0 2024-09-18T01:46:22.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.273+0000 7f645f323800 2 removed watcher, disabling cache 2024-09-18T01:46:22.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.273+0000 7f645f323800 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93882253179472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562aa5a4a20 con 0x5562aa593ff0 2024-09-18T01:46:22.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.274+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93882253179472] v33'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6444051070 con 0x5562aa593ff0 2024-09-18T01:46:22.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.274+0000 7f645f323800 20 remove_watcher() i=1 2024-09-18T01:46:22.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.274+0000 7f645f323800 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93882253184512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562aa59fa50 con 0x5562aa59a160 2024-09-18T01:46:22.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.276+0000 7f645b84f640 1 -- 172.21.15.146:0/3799275091 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93882253184512] v33'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6454057040 con 0x5562aa59a160 2024-09-18T01:46:22.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.276+0000 7f645f323800 20 remove_watcher() i=2 2024-09-18T01:46:22.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.276+0000 7f645f323800 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93882253187312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562aa5a4a20 con 0x7f64540123a0 2024-09-18T01:46:22.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.276+0000 7f645b04e640 1 -- 172.21.15.146:0/3799275091 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93882253187312] v33'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f644c060040 con 0x7f64540123a0 2024-09-18T01:46:22.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.277+0000 7f645f323800 20 remove_watcher() i=3 2024-09-18T01:46:22.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.277+0000 7f645f323800 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93882253190928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562aa5a18f0 con 0x5562aa593ff0 2024-09-18T01:46:22.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.278+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93882253190928] v33'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6444051070 con 0x5562aa593ff0 2024-09-18T01:46:22.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.278+0000 7f645f323800 20 remove_watcher() i=4 2024-09-18T01:46:22.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.278+0000 7f645f323800 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93882253181680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562aa5a4a20 con 0x7f644c02c060 2024-09-18T01:46:22.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.279+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93882253181680] v33'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6444051070 con 0x7f644c02c060 2024-09-18T01:46:22.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.279+0000 7f645f323800 20 remove_watcher() i=5 2024-09-18T01:46:22.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.279+0000 7f645f323800 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93882253195024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562aa5a02f0 con 0x7f644c02c060 2024-09-18T01:46:22.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.280+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93882253195024] v33'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6444051070 con 0x7f644c02c060 2024-09-18T01:46:22.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.280+0000 7f645f323800 20 remove_watcher() i=6 2024-09-18T01:46:22.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.280+0000 7f645f323800 1 -- 172.21.15.146:0/3799275091 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93882253198848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562aa5a02a0 con 0x7f644c02c060 2024-09-18T01:46:22.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.281+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93882253198848] v33'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6444051070 con 0x7f644c02c060 2024-09-18T01:46:22.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.281+0000 7f645f323800 20 remove_watcher() i=7 2024-09-18T01:46:22.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.281+0000 7f645f323800 1 -- 172.21.15.146:0/3799275091 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f644c02c060 msgr2=0x7f644c00caa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.281+0000 7f645f323800 1 --2- 172.21.15.146:0/3799275091 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f644c02c060 0x7f644c00caa0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.281+0000 7f645f323800 1 -- 172.21.15.146:0/3799275091 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5562aa593ff0 msgr2=0x5562aa5964b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.281+0000 7f645f323800 1 --2- 172.21.15.146:0/3799275091 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5562aa593ff0 0x5562aa5964b0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.281+0000 7f645f323800 1 -- 172.21.15.146:0/3799275091 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f64540123a0 msgr2=0x7f6454036580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.281+0000 7f645f323800 1 --2- 172.21.15.146:0/3799275091 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f64540123a0 0x7f6454036580 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.281+0000 7f645f323800 1 -- 172.21.15.146:0/3799275091 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5562aa59a160 msgr2=0x5562aa59c570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.281+0000 7f645f323800 1 --2- 172.21.15.146:0/3799275091 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5562aa59a160 0x5562aa59c570 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.281+0000 7f645f323800 1 -- 172.21.15.146:0/3799275091 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6324036b40 msgr2=0x7f6324039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.281+0000 7f645f323800 1 --2- 172.21.15.146:0/3799275091 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6324036b40 0x7f6324039000 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f644c02af70 tx=0x7f644c033000 comp rx=0 tx=0).stop 2024-09-18T01:46:22.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.281+0000 7f645f323800 1 -- 172.21.15.146:0/3799275091 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562aa580ef0 msgr2=0x5562aa5882f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.281+0000 7f645284d640 1 -- 172.21.15.146:0/3799275091 reap_dead start 2024-09-18T01:46:22.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.281+0000 7f645f323800 1 --2- 172.21.15.146:0/3799275091 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562aa580ef0 0x5562aa5882f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f6454001df0 tx=0x7f645404c820 comp rx=0 tx=0).stop 2024-09-18T01:46:22.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.281+0000 7f645f323800 1 -- 172.21.15.146:0/3799275091 shutdown_connections 2024-09-18T01:46:22.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.281+0000 7f645f323800 1 --2- 172.21.15.146:0/3799275091 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562aa580ef0 0x5562aa5882f0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.281+0000 7f645f323800 1 -- 172.21.15.146:0/3799275091 >> 172.21.15.146:0/3799275091 conn(0x5562aa57d290 msgr2=0x5562aa57b360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:22.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.282+0000 7f645f323800 1 -- 172.21.15.146:0/3799275091 shutdown_connections 2024-09-18T01:46:22.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.282+0000 7f645f323800 1 -- 172.21.15.146:0/3799275091 wait complete. 2024-09-18T01:46:22.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.282+0000 7f645f323800 1 -- 172.21.15.146:0/1498418557 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6334036b90 msgr2=0x7f6334039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.282+0000 7f645f323800 1 --2- 172.21.15.146:0/1498418557 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6334036b90 0x7f6334039050 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f644c016fd0 tx=0x7f644c04ad80 comp rx=0 tx=0).stop 2024-09-18T01:46:22.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.282+0000 7f645f323800 1 -- 172.21.15.146:0/1498418557 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562aa574270 msgr2=0x5562aa574690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.282+0000 7f645f323800 1 --2- 172.21.15.146:0/1498418557 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562aa574270 0x5562aa574690 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x5562aa55a8e0 tx=0x7f64540178e0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.282+0000 7f645f323800 1 -- 172.21.15.146:0/1498418557 shutdown_connections 2024-09-18T01:46:22.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.282+0000 7f645f323800 1 --2- 172.21.15.146:0/1498418557 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6334036b90 0x7f6334039050 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.282+0000 7f645f323800 1 --2- 172.21.15.146:0/1498418557 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562aa574270 0x5562aa574690 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.282+0000 7f645f323800 1 -- 172.21.15.146:0/1498418557 >> 172.21.15.146:0/1498418557 conn(0x5562aa569200 msgr2=0x5562aa56bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:22.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.282+0000 7f645f323800 1 -- 172.21.15.146:0/1498418557 shutdown_connections 2024-09-18T01:46:22.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.282+0000 7f645f323800 1 -- 172.21.15.146:0/1498418557 wait complete. 2024-09-18T01:46:22.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.282+0000 7f645f323800 1 -- 172.21.15.146:0/1321234221 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5562aa464920 msgr2=0x5562aa560550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.282+0000 7f645f323800 1 --2- 172.21.15.146:0/1321234221 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5562aa464920 0x5562aa560550 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.282+0000 7f645f323800 1 -- 172.21.15.146:0/1321234221 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5562aa563cc0 msgr2=0x5562aa5660b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.282+0000 7f645f323800 1 --2- 172.21.15.146:0/1321234221 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5562aa563cc0 0x5562aa5660b0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.282+0000 7f645f323800 1 -- 172.21.15.146:0/1321234221 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6340036b40 msgr2=0x7f6340039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.282+0000 7f645f323800 1 --2- 172.21.15.146:0/1321234221 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6340036b40 0x7f6340039000 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6444057000 tx=0x7f6444052000 comp rx=0 tx=0).stop 2024-09-18T01:46:22.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.282+0000 7f645f323800 1 -- 172.21.15.146:0/1321234221 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562aa3d4630 msgr2=0x5562aa5594e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.282+0000 7f645f323800 1 --2- 172.21.15.146:0/1321234221 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562aa3d4630 0x5562aa5594e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f644c004000 tx=0x7f644c000bc0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.282+0000 7f645f323800 1 -- 172.21.15.146:0/1321234221 shutdown_connections 2024-09-18T01:46:22.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.282+0000 7f645f323800 1 --2- 172.21.15.146:0/1321234221 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5562aa563cc0 0x5562aa5660b0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.282+0000 7f645f323800 1 --2- 172.21.15.146:0/1321234221 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5562aa464920 0x5562aa560550 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.282+0000 7f645f323800 1 --2- 172.21.15.146:0/1321234221 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6340036b40 0x7f6340039000 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.282+0000 7f645f323800 1 --2- 172.21.15.146:0/1321234221 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562aa3d4630 0x5562aa5594e0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.282+0000 7f645f323800 1 -- 172.21.15.146:0/1321234221 >> 172.21.15.146:0/1321234221 conn(0x5562aa45adb0 msgr2=0x5562aa54ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:22.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.282+0000 7f645f323800 1 -- 172.21.15.146:0/1321234221 shutdown_connections 2024-09-18T01:46:22.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.282+0000 7f645f323800 1 -- 172.21.15.146:0/1321234221 wait complete. 2024-09-18T01:46:22.291 INFO:teuthology.orchestra.run.smithi146.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}}]} 2024-09-18T01:46:22.292 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}}]} 2024-09-18T01:46:22.292 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-18T01:46:22.292 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-18T01:46:22.292 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_obj 2024-09-18T01:46:22.338 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:46:22.338 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:46:22.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.338+0000 7f0686720800 1 Processor -- start 2024-09-18T01:46:22.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.338+0000 7f0686720800 1 -- start start 2024-09-18T01:46:22.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.338+0000 7f0686720800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x56468e2e54e0 0x56468e2e58e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.338+0000 7f0686720800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56468e1a5b30 con 0x56468e2e5e20 2024-09-18T01:46:22.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.338+0000 7f0686720800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x56468e187360 con 0x56468e2e54e0 2024-09-18T01:46:22.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.339+0000 7f0681c15640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x56468e2e5e20 0x56468e2ea9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:49910/0 (socket says 172.21.15.146:49910) 2024-09-18T01:46:22.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.339+0000 7f0681c15640 1 -- 172.21.15.146:0/2766102287 learned_addr learned my addr 172.21.15.146:0/2766102287 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:46:22.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.339+0000 7f0682416640 1 --2- 172.21.15.146:0/2766102287 >> v2:172.21.15.129:3300/0 conn(0x56468e2e54e0 0x56468e2e58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.339+0000 7f0681414640 1 -- 172.21.15.146:0/2766102287 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1393915164 0 0) 0x56468e1a5b30 con 0x56468e2e5e20 2024-09-18T01:46:22.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.339+0000 7f0681414640 1 -- 172.21.15.146:0/2766102287 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f066c001e10 con 0x56468e2e5e20 2024-09-18T01:46:22.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.339+0000 7f0682416640 1 -- 172.21.15.146:0/2766102287 >> v1:172.21.15.129:6789/0 conn(0x56468e2e5e20 legacy=0x56468e2ea9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.339+0000 7f0682416640 1 -- 172.21.15.146:0/2766102287 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56468e1ade00 con 0x56468e2e54e0 2024-09-18T01:46:22.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.341+0000 7f0682416640 1 --2- 172.21.15.146:0/2766102287 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56468e2e54e0 0x56468e2e58e0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f067400a470 tx=0x7f0674045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2935e31bfccba7aa server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.341+0000 7f0681414640 1 -- 172.21.15.146:0/2766102287 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0674059070 con 0x56468e2e54e0 2024-09-18T01:46:22.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.341+0000 7f0681414640 1 -- 172.21.15.146:0/2766102287 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0674054570 con 0x56468e2e54e0 2024-09-18T01:46:22.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.341+0000 7f0681414640 1 -- 172.21.15.146:0/2766102287 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0674054870 con 0x56468e2e54e0 2024-09-18T01:46:22.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.341+0000 7f0686720800 1 -- 172.21.15.146:0/2766102287 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56468e2e54e0 msgr2=0x56468e2e58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.341+0000 7f0686720800 1 --2- 172.21.15.146:0/2766102287 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56468e2e54e0 0x56468e2e58e0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f067400a470 tx=0x7f0674045920 comp rx=0 tx=0).stop 2024-09-18T01:46:22.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.342+0000 7f0686720800 1 -- 172.21.15.146:0/2766102287 shutdown_connections 2024-09-18T01:46:22.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.342+0000 7f0686720800 1 --2- 172.21.15.146:0/2766102287 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56468e2e54e0 0x56468e2e58e0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.342+0000 7f0686720800 1 -- 172.21.15.146:0/2766102287 >> 172.21.15.146:0/2766102287 conn(0x56468e2e0db0 msgr2=0x56468e2e31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:22.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.342+0000 7f0686720800 1 -- 172.21.15.146:0/2766102287 shutdown_connections 2024-09-18T01:46:22.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.342+0000 7f0686720800 1 -- 172.21.15.146:0/2766102287 wait complete. 2024-09-18T01:46:22.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.355+0000 7f0686720800 1 Processor -- start 2024-09-18T01:46:22.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.355+0000 7f0686720800 1 -- start start 2024-09-18T01:46:22.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.355+0000 7f0686720800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56468e2e54e0 0x56468e25a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.356+0000 7f0686720800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x56468e232360 con 0x56468e2e54e0 2024-09-18T01:46:22.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.356+0000 7f0682416640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56468e2e54e0 0x56468e25a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.356+0000 7f0682416640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56468e2e54e0 0x56468e25a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:43976/0 (socket says 172.21.15.146:43976) 2024-09-18T01:46:22.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.356+0000 7f0682416640 1 -- 172.21.15.146:0/828352990 learned_addr learned my addr 172.21.15.146:0/828352990 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:22.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.356+0000 7f0682416640 1 -- 172.21.15.146:0/828352990 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56468e17fbc0 con 0x56468e2e54e0 2024-09-18T01:46:22.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.356+0000 7f0682416640 1 --2- 172.21.15.146:0/828352990 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56468e2e54e0 0x56468e25a5c0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f0674025b20 tx=0x7f067404e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5e4dfd0b2b4f72 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.357+0000 7f0570608640 1 -- 172.21.15.146:0/828352990 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0674062070 con 0x56468e2e54e0 2024-09-18T01:46:22.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.357+0000 7f0570608640 1 -- 172.21.15.146:0/828352990 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f067400a230 con 0x56468e2e54e0 2024-09-18T01:46:22.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.357+0000 7f0570608640 1 -- 172.21.15.146:0/828352990 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0674059040 con 0x56468e2e54e0 2024-09-18T01:46:22.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.357+0000 7f0686720800 1 -- 172.21.15.146:0/828352990 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56468e2e54e0 msgr2=0x56468e25a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.357+0000 7f0686720800 1 --2- 172.21.15.146:0/828352990 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56468e2e54e0 0x56468e25a5c0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f0674025b20 tx=0x7f067404e000 comp rx=0 tx=0).stop 2024-09-18T01:46:22.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.357+0000 7f0686720800 1 -- 172.21.15.146:0/828352990 shutdown_connections 2024-09-18T01:46:22.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.357+0000 7f0686720800 1 --2- 172.21.15.146:0/828352990 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56468e2e54e0 0x56468e25a5c0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.357+0000 7f0686720800 1 -- 172.21.15.146:0/828352990 >> 172.21.15.146:0/828352990 conn(0x56468e2e0db0 msgr2=0x56468e3cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:22.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.357+0000 7f0686720800 1 -- 172.21.15.146:0/828352990 shutdown_connections 2024-09-18T01:46:22.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.357+0000 7f0686720800 1 -- 172.21.15.146:0/828352990 wait complete. 2024-09-18T01:46:22.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.358+0000 7f0686720800 1 Processor -- start 2024-09-18T01:46:22.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.358+0000 7f0686720800 1 -- start start 2024-09-18T01:46:22.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.358+0000 7f0686720800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56468e2e54e0 0x56468e3dcfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.358+0000 7f0686720800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x56468e2ec500 con 0x56468e2e54e0 2024-09-18T01:46:22.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.358+0000 7f0682416640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56468e2e54e0 0x56468e3dcfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.358+0000 7f0682416640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56468e2e54e0 0x56468e3dcfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:43986/0 (socket says 172.21.15.146:43986) 2024-09-18T01:46:22.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.358+0000 7f0682416640 1 -- 172.21.15.146:0/835282005 learned_addr learned my addr 172.21.15.146:0/835282005 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:22.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.358+0000 7f0682416640 1 -- 172.21.15.146:0/835282005 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56468e193fe0 con 0x56468e2e54e0 2024-09-18T01:46:22.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.358+0000 7f0682416640 1 --2- 172.21.15.146:0/835282005 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56468e2e54e0 0x56468e3dcfa0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f0674045960 tx=0x7f0674002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.359+0000 7f056ee05640 1 -- 172.21.15.146:0/835282005 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0674062070 con 0x56468e2e54e0 2024-09-18T01:46:22.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.359+0000 7f056ee05640 1 -- 172.21.15.146:0/835282005 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06740549a0 con 0x56468e2e54e0 2024-09-18T01:46:22.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.359+0000 7f0686720800 1 -- 172.21.15.146:0/835282005 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56468e3dd4e0 con 0x56468e2e54e0 2024-09-18T01:46:22.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.359+0000 7f056ee05640 1 -- 172.21.15.146:0/835282005 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0674059040 con 0x56468e2e54e0 2024-09-18T01:46:22.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.359+0000 7f0686720800 1 -- 172.21.15.146:0/835282005 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56468e3dda00 con 0x56468e2e54e0 2024-09-18T01:46:22.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.361+0000 7f056ee05640 1 -- 172.21.15.146:0/835282005 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0674065040 con 0x56468e2e54e0 2024-09-18T01:46:22.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.361+0000 7f056ee05640 1 --2- 172.21.15.146:0/835282005 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0568036b90 0x7f0568039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.361+0000 7f056ee05640 1 -- 172.21.15.146:0/835282005 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f067408fc90 con 0x56468e2e54e0 2024-09-18T01:46:22.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.362+0000 7f0681c15640 1 --2- 172.21.15.146:0/835282005 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0568036b90 0x7f0568039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.362+0000 7f0686720800 1 --2- 172.21.15.146:0/835282005 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56468e2e5e20 0x56468e3e4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.362+0000 7f0686720800 1 -- 172.21.15.146:0/835282005 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56468e3e4550 con 0x56468e2e5e20 2024-09-18T01:46:22.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.362+0000 7f0682c17640 1 --2- 172.21.15.146:0/835282005 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56468e2e5e20 0x56468e3e4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.362+0000 7f0681c15640 1 --2- 172.21.15.146:0/835282005 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0568036b90 0x7f0568039050 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0678000f60 tx=0x7f06780010a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.362+0000 7f0682c17640 1 --2- 172.21.15.146:0/835282005 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56468e2e5e20 0x56468e3e4010 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.362+0000 7f0682c17640 1 -- 172.21.15.146:0/835282005 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f067c00a4a0 con 0x56468e2e5e20 2024-09-18T01:46:22.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.362+0000 7f0686720800 1 -- 172.21.15.146:0/835282005 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56468e3e15c0 con 0x56468e2e5e20 2024-09-18T01:46:22.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.363+0000 7f0682c17640 1 -- 172.21.15.146:0/835282005 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f067c00a4a0 con 0x56468e2e5e20 2024-09-18T01:46:22.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.363+0000 7f0686720800 1 -- 172.21.15.146:0/835282005 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56468e3e6310 con 0x56468e2e5e20 2024-09-18T01:46:22.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.363+0000 7f0682c17640 1 -- 172.21.15.146:0/835282005 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f067c00a4a0 con 0x56468e2e5e20 2024-09-18T01:46:22.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.363+0000 7f0686720800 1 -- 172.21.15.146:0/835282005 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56468e3e5450 con 0x56468e2e5e20 2024-09-18T01:46:22.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.363+0000 7f0682c17640 1 -- 172.21.15.146:0/835282005 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f067c00a4a0 con 0x56468e2e5e20 2024-09-18T01:46:22.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.363+0000 7f0686720800 1 --2- 172.21.15.146:0/835282005 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x56468e3e5ef0 0x56468e3e9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.363+0000 7f0686720800 1 -- 172.21.15.146:0/835282005 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56468e3e9ee0 con 0x56468e3e5ef0 2024-09-18T01:46:22.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.363+0000 7f0682416640 1 --2- 172.21.15.146:0/835282005 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x56468e3e5ef0 0x56468e3e9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.364+0000 7f0682416640 1 --2- 172.21.15.146:0/835282005 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x56468e3e5ef0 0x56468e3e9750 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.364+0000 7f0682416640 1 -- 172.21.15.146:0/835282005 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f067405c040 con 0x56468e3e5ef0 2024-09-18T01:46:22.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.364+0000 7f0686720800 1 Processor -- start 2024-09-18T01:46:22.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.364+0000 7f0686720800 1 -- start start 2024-09-18T01:46:22.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.364+0000 7f0686720800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56468e3f7c90 0x56468e3f80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.364+0000 7f0686720800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x56468e181580 con 0x56468e3f7c90 2024-09-18T01:46:22.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.365+0000 7f0682c17640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56468e3f7c90 0x56468e3f80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.365+0000 7f0682c17640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56468e3f7c90 0x56468e3f80b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:43998/0 (socket says 172.21.15.146:43998) 2024-09-18T01:46:22.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.365+0000 7f0682c17640 1 -- 172.21.15.146:0/2609101651 learned_addr learned my addr 172.21.15.146:0/2609101651 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:22.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.365+0000 7f0682c17640 1 -- 172.21.15.146:0/2609101651 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56468e3f85f0 con 0x56468e3f7c90 2024-09-18T01:46:22.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.365+0000 7f0682c17640 1 --2- 172.21.15.146:0/2609101651 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56468e3f7c90 0x56468e3f80b0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x56468e3e48f0 tx=0x7f067c0178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.365+0000 7f0567fff640 1 -- 172.21.15.146:0/2609101651 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f067c013440 con 0x56468e3f7c90 2024-09-18T01:46:22.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.365+0000 7f0567fff640 1 -- 172.21.15.146:0/2609101651 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f067c0135e0 con 0x56468e3f7c90 2024-09-18T01:46:22.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.365+0000 7f0686720800 1 -- 172.21.15.146:0/2609101651 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56468e3f8880 con 0x56468e3f7c90 2024-09-18T01:46:22.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.365+0000 7f0567fff640 1 -- 172.21.15.146:0/2609101651 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f067c0138c0 con 0x56468e3f7c90 2024-09-18T01:46:22.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.365+0000 7f0686720800 1 -- 172.21.15.146:0/2609101651 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56468e3fb560 con 0x56468e3f7c90 2024-09-18T01:46:22.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.366+0000 7f0567fff640 1 -- 172.21.15.146:0/2609101651 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f067c011040 con 0x56468e3f7c90 2024-09-18T01:46:22.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.366+0000 7f0567fff640 1 --2- 172.21.15.146:0/2609101651 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f055c036b40 0x7f055c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.366+0000 7f0567fff640 1 -- 172.21.15.146:0/2609101651 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f067c01d070 con 0x56468e3f7c90 2024-09-18T01:46:22.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.366+0000 7f0682416640 1 --2- 172.21.15.146:0/2609101651 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f055c036b40 0x7f055c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.367+0000 7f0686720800 1 Processor -- start 2024-09-18T01:46:22.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.367+0000 7f0686720800 1 -- start start 2024-09-18T01:46:22.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.367+0000 7f0682416640 1 --2- 172.21.15.146:0/2609101651 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f055c036b40 0x7f055c039000 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x56468e3e57f0 tx=0x7f067408dec0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.367+0000 7f0686720800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56468e404930 0x56468e404d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.367+0000 7f0686720800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x56468e3d8500 con 0x56468e404930 2024-09-18T01:46:22.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.367+0000 7f0682c17640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56468e404930 0x56468e404d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.367+0000 7f0682c17640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56468e404930 0x56468e404d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:44006/0 (socket says 172.21.15.146:44006) 2024-09-18T01:46:22.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.367+0000 7f0682c17640 1 -- 172.21.15.146:0/808811433 learned_addr learned my addr 172.21.15.146:0/808811433 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:22.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.367+0000 7f0682c17640 1 -- 172.21.15.146:0/808811433 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56468e405300 con 0x56468e404930 2024-09-18T01:46:22.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.367+0000 7f0682c17640 1 --2- 172.21.15.146:0/808811433 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56468e404930 0x56468e404d30 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f067c001450 tx=0x7f067c04caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9f1ef994d8e3eeb server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.368+0000 7f0565ffb640 1 -- 172.21.15.146:0/808811433 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f067c045070 con 0x56468e404930 2024-09-18T01:46:22.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.368+0000 7f0565ffb640 1 -- 172.21.15.146:0/808811433 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f067c015560 con 0x56468e404930 2024-09-18T01:46:22.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.368+0000 7f0565ffb640 1 -- 172.21.15.146:0/808811433 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f067c02ad80 con 0x56468e404930 2024-09-18T01:46:22.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.368+0000 7f0686720800 1 -- 172.21.15.146:0/808811433 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56468e404930 msgr2=0x56468e404d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.368+0000 7f0686720800 1 --2- 172.21.15.146:0/808811433 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56468e404930 0x56468e404d30 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f067c001450 tx=0x7f067c04caf0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.368+0000 7f0686720800 1 -- 172.21.15.146:0/808811433 shutdown_connections 2024-09-18T01:46:22.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.368+0000 7f0686720800 1 --2- 172.21.15.146:0/808811433 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56468e404930 0x56468e404d30 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.368+0000 7f0686720800 1 -- 172.21.15.146:0/808811433 >> 172.21.15.146:0/808811433 conn(0x56468e400ce0 msgr2=0x56468e3fede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:22.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.368+0000 7f0686720800 1 -- 172.21.15.146:0/808811433 shutdown_connections 2024-09-18T01:46:22.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.368+0000 7f0686720800 1 -- 172.21.15.146:0/808811433 wait complete. 2024-09-18T01:46:22.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.368+0000 7f0686720800 1 Processor -- start 2024-09-18T01:46:22.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.368+0000 7f0686720800 1 -- start start 2024-09-18T01:46:22.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.369+0000 7f0686720800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56468e404930 0x56468e40bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.369+0000 7f0686720800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x56468e4058d0 con 0x56468e404930 2024-09-18T01:46:22.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.369+0000 7f0682c17640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56468e404930 0x56468e40bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.369+0000 7f0682c17640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56468e404930 0x56468e40bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:44018/0 (socket says 172.21.15.146:44018) 2024-09-18T01:46:22.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.369+0000 7f0682c17640 1 -- 172.21.15.146:0/1918475132 learned_addr learned my addr 172.21.15.146:0/1918475132 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:22.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.369+0000 7f0682c17640 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56468e40c260 con 0x56468e404930 2024-09-18T01:46:22.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.369+0000 7f0682c17640 1 --2- 172.21.15.146:0/1918475132 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56468e404930 0x56468e40bd20 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f067c043040 tx=0x7f067c04c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.369+0000 7f0553fff640 1 -- 172.21.15.146:0/1918475132 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f067c03a070 con 0x56468e404930 2024-09-18T01:46:22.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.370+0000 7f0686720800 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56468e40c4f0 con 0x56468e404930 2024-09-18T01:46:22.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.370+0000 7f0553fff640 1 -- 172.21.15.146:0/1918475132 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f067c0014f0 con 0x56468e404930 2024-09-18T01:46:22.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.370+0000 7f0553fff640 1 -- 172.21.15.146:0/1918475132 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f067c045040 con 0x56468e404930 2024-09-18T01:46:22.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.370+0000 7f0686720800 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56468e40f1a0 con 0x56468e404930 2024-09-18T01:46:22.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.370+0000 7f0553fff640 1 -- 172.21.15.146:0/1918475132 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f067c03d070 con 0x56468e404930 2024-09-18T01:46:22.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.370+0000 7f0553fff640 1 --2- 172.21.15.146:0/1918475132 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f054c036b40 0x7f054c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.371+0000 7f0553fff640 1 -- 172.21.15.146:0/1918475132 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f067c00e040 con 0x56468e404930 2024-09-18T01:46:22.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.371+0000 7f0682416640 1 --2- 172.21.15.146:0/1918475132 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f054c036b40 0x7f054c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.371+0000 7f0686720800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.371+0000 7f0686720800 1 --2- 172.21.15.146:0/1918475132 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56468e4179a0 0x56468e419e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.371+0000 7f0686720800 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56468e41a5b0 con 0x56468e4179a0 2024-09-18T01:46:22.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.371+0000 7f0681c15640 1 --2- 172.21.15.146:0/1918475132 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56468e4179a0 0x56468e419e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.371+0000 7f0682416640 1 --2- 172.21.15.146:0/1918475132 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f054c036b40 0x7f054c039000 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0674067f90 tx=0x7f0674084000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.371+0000 7f0681c15640 1 --2- 172.21.15.146:0/1918475132 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56468e4179a0 0x56468e419e60 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.371+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0678009050 con 0x56468e4179a0 2024-09-18T01:46:22.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.371+0000 7f0686720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:22.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.371+0000 7f0686720800 20 realm 2024-09-18T01:46:22.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.371+0000 7f0686720800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.372+0000 7f0686720800 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56468e416e40 con 0x56468e4179a0 2024-09-18T01:46:22.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.372+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0678009050 con 0x56468e4179a0 2024-09-18T01:46:22.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.372+0000 7f0686720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:22.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.372+0000 7f0686720800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:46:22.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.372+0000 7f0686720800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.372+0000 7f0686720800 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56468e41b090 con 0x56468e4179a0 2024-09-18T01:46:22.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.372+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0678009050 con 0x56468e4179a0 2024-09-18T01:46:22.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.372+0000 7f0686720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:22.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.372+0000 7f0686720800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.372+0000 7f0686720800 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56468e41b960 con 0x56468e4179a0 2024-09-18T01:46:22.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.372+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0678009050 con 0x56468e4179a0 2024-09-18T01:46:22.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.372+0000 7f0686720800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:46:22.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.372+0000 7f0686720800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.372+0000 7f0686720800 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56468e41bd00 con 0x56468e4179a0 2024-09-18T01:46:22.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.372+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0678009050 con 0x56468e4179a0 2024-09-18T01:46:22.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.372+0000 7f0686720800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:46:22.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.373+0000 7f0686720800 20 searching for the correct realm 2024-09-18T01:46:22.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.373+0000 7f0686720800 1 --2- 172.21.15.146:0/1918475132 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x56468e41dbe0 0x56468e41ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.373+0000 7f0686720800 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56468e4206a0 con 0x56468e41dbe0 2024-09-18T01:46:22.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.373+0000 7f0682c17640 1 --2- 172.21.15.146:0/1918475132 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x56468e41dbe0 0x56468e41ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.373+0000 7f0682c17640 1 --2- 172.21.15.146:0/1918475132 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x56468e41dbe0 0x56468e41ffd0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.373+0000 7f0682c17640 1 -- 172.21.15.146:0/1918475132 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f067c03c030 con 0x56468e41dbe0 2024-09-18T01:46:22.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.373+0000 7f0682c17640 1 --2- 172.21.15.146:0/1918475132 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f067c03f060 0x7f067c0233f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.373+0000 7f0682c17640 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56468e4206a0 con 0x7f067c03f060 2024-09-18T01:46:22.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.373+0000 7f0682416640 1 --2- 172.21.15.146:0/1918475132 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f067c03f060 0x7f067c0233f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.374+0000 7f0682416640 1 --2- 172.21.15.146:0/1918475132 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f067c03f060 0x7f067c0233f0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.374+0000 7f0682416640 1 -- 172.21.15.146:0/1918475132 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0674098030 con 0x7f067c03f060 2024-09-18T01:46:22.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.374+0000 7f0682416640 1 --2- 172.21.15.146:0/1918475132 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f067409c040 0x7f067405d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.374+0000 7f0682416640 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56468e4206a0 con 0x7f067409c040 2024-09-18T01:46:22.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.374+0000 7f0681c15640 1 --2- 172.21.15.146:0/1918475132 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f067409c040 0x7f067405d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.374+0000 7f0681c15640 1 --2- 172.21.15.146:0/1918475132 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f067409c040 0x7f067405d5a0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.375+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0678009050 con 0x7f067409c040 2024-09-18T01:46:22.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.375+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56468e4206a0 con 0x56468e4179a0 2024-09-18T01:46:22.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.375+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0678009050 con 0x56468e4179a0 2024-09-18T01:46:22.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.375+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56468e4206a0 con 0x56468e4179a0 2024-09-18T01:46:22.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.375+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f067802a040 con 0x56468e4179a0 2024-09-18T01:46:22.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.375+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56468e4206a0 con 0x7f067409c040 2024-09-18T01:46:22.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.375+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f067802a040 con 0x7f067409c040 2024-09-18T01:46:22.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.375+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56468e4206a0 con 0x7f067409c040 2024-09-18T01:46:22.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.376+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f067802a040 con 0x7f067409c040 2024-09-18T01:46:22.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.376+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56468e4206a0 con 0x7f067c03f060 2024-09-18T01:46:22.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.376+0000 7f0682416640 1 -- 172.21.15.146:0/1918475132 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0674098030 con 0x7f067c03f060 2024-09-18T01:46:22.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.376+0000 7f0682416640 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56468e4206a0 con 0x56468e41dbe0 2024-09-18T01:46:22.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.376+0000 7f0682c17640 1 -- 172.21.15.146:0/1918475132 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f067c03c030 con 0x56468e41dbe0 2024-09-18T01:46:22.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.376+0000 7f0682c17640 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56468e4206a0 con 0x56468e4179a0 2024-09-18T01:46:22.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.376+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f067802a040 con 0x56468e4179a0 2024-09-18T01:46:22.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.376+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56468e4206a0 con 0x7f067409c040 2024-09-18T01:46:22.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.377+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f067802a040 con 0x7f067409c040 2024-09-18T01:46:22.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.377+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56468e4206a0 con 0x56468e4179a0 2024-09-18T01:46:22.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.377+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f067802a040 con 0x56468e4179a0 2024-09-18T01:46:22.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.377+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56468e4206a0 con 0x7f067c03f060 2024-09-18T01:46:22.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.377+0000 7f0682416640 1 -- 172.21.15.146:0/1918475132 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f0674098030 con 0x7f067c03f060 2024-09-18T01:46:22.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.377+0000 7f0682416640 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f06740aa0a0 con 0x56468e41dbe0 2024-09-18T01:46:22.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.377+0000 7f0682c17640 1 -- 172.21.15.146:0/1918475132 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f067c03c030 con 0x56468e41dbe0 2024-09-18T01:46:22.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.377+0000 7f0682c17640 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f06740aa0a0 con 0x56468e41dbe0 2024-09-18T01:46:22.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.378+0000 7f0682c17640 1 -- 172.21.15.146:0/1918475132 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f067c03c030 con 0x56468e41dbe0 2024-09-18T01:46:22.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.378+0000 7f0682c17640 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f06740aa0a0 con 0x7f067409c040 2024-09-18T01:46:22.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.378+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f067802a040 con 0x7f067409c040 2024-09-18T01:46:22.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.378+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f06740aa0a0 con 0x56468e41dbe0 2024-09-18T01:46:22.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.378+0000 7f0682c17640 1 -- 172.21.15.146:0/1918475132 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f067c03c030 con 0x56468e41dbe0 2024-09-18T01:46:22.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.378+0000 7f0682c17640 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f06740aa0a0 con 0x56468e41dbe0 2024-09-18T01:46:22.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.378+0000 7f0682c17640 1 -- 172.21.15.146:0/1918475132 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f067c03c030 con 0x56468e41dbe0 2024-09-18T01:46:22.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.378+0000 7f0682c17640 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f06740aa0a0 con 0x56468e4179a0 2024-09-18T01:46:22.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.379+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f067802a040 con 0x56468e4179a0 2024-09-18T01:46:22.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.379+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f06740aa0a0 con 0x56468e4179a0 2024-09-18T01:46:22.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.379+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f067802a040 con 0x56468e4179a0 2024-09-18T01:46:22.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.379+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f06740aa0a0 con 0x7f067409c040 2024-09-18T01:46:22.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.379+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f067802a040 con 0x7f067409c040 2024-09-18T01:46:22.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.379+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f06740aa0a0 con 0x56468e41dbe0 2024-09-18T01:46:22.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.379+0000 7f0682c17640 1 -- 172.21.15.146:0/1918475132 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f067c03c030 con 0x56468e41dbe0 2024-09-18T01:46:22.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.379+0000 7f0682c17640 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f06740aa0a0 con 0x7f067c03f060 2024-09-18T01:46:22.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.380+0000 7f0682416640 1 -- 172.21.15.146:0/1918475132 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0674098030 con 0x7f067c03f060 2024-09-18T01:46:22.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.380+0000 7f0682416640 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f06740aa0a0 con 0x56468e4179a0 2024-09-18T01:46:22.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.380+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f067802a040 con 0x56468e4179a0 2024-09-18T01:46:22.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.380+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f06740aa0a0 con 0x7f067409c040 2024-09-18T01:46:22.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.380+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f067802a040 con 0x7f067409c040 2024-09-18T01:46:22.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.380+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f06740aa0a0 con 0x56468e41dbe0 2024-09-18T01:46:22.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.380+0000 7f0682c17640 1 -- 172.21.15.146:0/1918475132 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f067c03c030 con 0x56468e41dbe0 2024-09-18T01:46:22.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.380+0000 7f0682c17640 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f06740aa0a0 con 0x7f067409c040 2024-09-18T01:46:22.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.381+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f067802a040 con 0x7f067409c040 2024-09-18T01:46:22.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.381+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f06740aa0a0 con 0x7f067c03f060 2024-09-18T01:46:22.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.381+0000 7f0682416640 1 -- 172.21.15.146:0/1918475132 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0674098030 con 0x7f067c03f060 2024-09-18T01:46:22.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.381+0000 7f0682416640 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f06740aa0a0 con 0x56468e41dbe0 2024-09-18T01:46:22.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.381+0000 7f0682c17640 1 -- 172.21.15.146:0/1918475132 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f067c03c030 con 0x56468e41dbe0 2024-09-18T01:46:22.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.381+0000 7f0682c17640 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f06740aa0a0 con 0x7f067409c040 2024-09-18T01:46:22.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.381+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f067802a040 con 0x7f067409c040 2024-09-18T01:46:22.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.381+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f06740aa0a0 con 0x56468e4179a0 2024-09-18T01:46:22.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.382+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f067802a040 con 0x56468e4179a0 2024-09-18T01:46:22.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.382+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f06740aa0a0 con 0x7f067c03f060 2024-09-18T01:46:22.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.382+0000 7f0682416640 1 -- 172.21.15.146:0/1918475132 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0674098030 con 0x7f067c03f060 2024-09-18T01:46:22.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.382+0000 7f0686720800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:46:22.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.382+0000 7f0686720800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:46:22.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.382+0000 7f0686720800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:46:22.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.382+0000 7f0686720800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:46:22.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.382+0000 7f0686720800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:46:22.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.382+0000 7f0686720800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:46:22.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.382+0000 7f0686720800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.382+0000 7f0686720800 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56468e41c680 con 0x56468e4179a0 2024-09-18T01:46:22.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.382+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f067802a040 con 0x56468e4179a0 2024-09-18T01:46:22.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.382+0000 7f0686720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:22.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.382+0000 7f0686720800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.382+0000 7f0686720800 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56468e41cf20 con 0x56468e4179a0 2024-09-18T01:46:22.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.382+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f067802a040 con 0x56468e4179a0 2024-09-18T01:46:22.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.382+0000 7f0686720800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:46:22.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.382+0000 7f0686720800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.382+0000 7f0686720800 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56468e41c2c0 con 0x7f067c03f060 2024-09-18T01:46:22.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.383+0000 7f0682416640 1 -- 172.21.15.146:0/1918475132 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0674098030 con 0x7f067c03f060 2024-09-18T01:46:22.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.383+0000 7f0686720800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:46:22.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.383+0000 7f0686720800 20 zone default found 2024-09-18T01:46:22.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.383+0000 7f0686720800 4 Realm: () 2024-09-18T01:46:22.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.383+0000 7f0686720800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:46:22.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.383+0000 7f0686720800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:46:22.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.383+0000 7f0686720800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:46:22.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.383+0000 7f0686720800 20 zonegroup default 2024-09-18T01:46:22.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.383+0000 7f0686720800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.383+0000 7f0686720800 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56468e420fd0 con 0x7f067409c040 2024-09-18T01:46:22.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.383+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f067802a040 con 0x7f067409c040 2024-09-18T01:46:22.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.383+0000 7f0686720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:22.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.383+0000 7f0686720800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.383+0000 7f0686720800 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56468e422ad0 con 0x56468e41dbe0 2024-09-18T01:46:22.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.383+0000 7f0682c17640 1 -- 172.21.15.146:0/1918475132 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f067c03c030 con 0x56468e41dbe0 2024-09-18T01:46:22.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.383+0000 7f0686720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:22.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.383+0000 7f0686720800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.383+0000 7f0686720800 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56468e422fe0 con 0x56468e41dbe0 2024-09-18T01:46:22.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.384+0000 7f0682c17640 1 -- 172.21.15.146:0/1918475132 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f067c03c030 con 0x56468e41dbe0 2024-09-18T01:46:22.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.384+0000 7f0686720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:22.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.384+0000 7f0686720800 20 started sync module instance, tier type = 2024-09-18T01:46:22.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.384+0000 7f0686720800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:46:22.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.384+0000 7f0686720800 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56468e4219d0 con 0x7f067c03f060 2024-09-18T01:46:22.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.385+0000 7f0682416640 1 -- 172.21.15.146:0/1918475132 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v33'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0674098030 con 0x7f067c03f060 2024-09-18T01:46:22.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.385+0000 7f0686720800 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94861034397120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56468e4238f0 con 0x7f067c03f060 2024-09-18T01:46:22.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.385+0000 7f0686720800 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56468e424140 con 0x56468e4179a0 2024-09-18T01:46:22.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.386+0000 7f0682416640 1 -- 172.21.15.146:0/1918475132 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94861034397120] v33'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0674098030 con 0x7f067c03f060 2024-09-18T01:46:22.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.386+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v33'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f067802a040 con 0x56468e4179a0 2024-09-18T01:46:22.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.386+0000 7f0686720800 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94861034402880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56468e4241c0 con 0x56468e4179a0 2024-09-18T01:46:22.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.386+0000 7f0686720800 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56468e424cc0 con 0x56468e41dbe0 2024-09-18T01:46:22.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.387+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94861034402880] v33'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f067802a040 con 0x56468e4179a0 2024-09-18T01:46:22.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.387+0000 7f0682c17640 1 -- 172.21.15.146:0/1918475132 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v33'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f067c03c030 con 0x56468e41dbe0 2024-09-18T01:46:22.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.387+0000 7f0686720800 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94861034407856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56468e425060 con 0x56468e41dbe0 2024-09-18T01:46:22.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.387+0000 7f0686720800 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56468e425b50 con 0x7f067c03f060 2024-09-18T01:46:22.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.388+0000 7f0682416640 1 -- 172.21.15.146:0/1918475132 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v33'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0674098030 con 0x7f067c03f060 2024-09-18T01:46:22.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.388+0000 7f0686720800 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94861034411552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56468e425060 con 0x7f067c03f060 2024-09-18T01:46:22.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.388+0000 7f0686720800 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56468e426b30 con 0x56468e4179a0 2024-09-18T01:46:22.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.389+0000 7f0682c17640 1 -- 172.21.15.146:0/1918475132 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94861034407856] v33'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f067c03c030 con 0x56468e41dbe0 2024-09-18T01:46:22.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.389+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v33'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f067802a040 con 0x56468e4179a0 2024-09-18T01:46:22.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.389+0000 7f0686720800 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94861034415680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56468e426b30 con 0x56468e4179a0 2024-09-18T01:46:22.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.389+0000 7f0686720800 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56468e427580 con 0x7f067409c040 2024-09-18T01:46:22.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.390+0000 7f0682416640 1 -- 172.21.15.146:0/1918475132 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94861034411552] v33'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0674098030 con 0x7f067c03f060 2024-09-18T01:46:22.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.391+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v33'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f067802a040 con 0x7f067409c040 2024-09-18T01:46:22.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.391+0000 7f0686720800 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94861034413888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56468e427540 con 0x7f067409c040 2024-09-18T01:46:22.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.391+0000 7f0686720800 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56468e427fc0 con 0x7f067409c040 2024-09-18T01:46:22.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.391+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94861034415680] v33'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f067802a040 con 0x56468e4179a0 2024-09-18T01:46:22.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.391+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94861034413888] v33'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f067802a040 con 0x7f067409c040 2024-09-18T01:46:22.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.392+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v33'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f067802a040 con 0x7f067409c040 2024-09-18T01:46:22.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.392+0000 7f0686720800 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94861034418320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56468e4274b0 con 0x7f067409c040 2024-09-18T01:46:22.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.392+0000 7f0686720800 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56468e428470 con 0x7f067409c040 2024-09-18T01:46:22.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.393+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94861034418320] v33'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f067802a040 con 0x7f067409c040 2024-09-18T01:46:22.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.393+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v33'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f067802a040 con 0x7f067409c040 2024-09-18T01:46:22.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.393+0000 7f0686720800 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94861034421008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56468e4283e0 con 0x7f067409c040 2024-09-18T01:46:22.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.393+0000 7f0686720800 20 add_watcher() i=0 2024-09-18T01:46:22.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.393+0000 7f0686720800 20 add_watcher() i=1 2024-09-18T01:46:22.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.393+0000 7f0686720800 20 add_watcher() i=2 2024-09-18T01:46:22.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.393+0000 7f0686720800 20 add_watcher() i=3 2024-09-18T01:46:22.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.393+0000 7f0686720800 20 add_watcher() i=4 2024-09-18T01:46:22.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.393+0000 7f0686720800 20 add_watcher() i=5 2024-09-18T01:46:22.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.393+0000 7f0686720800 20 add_watcher() i=6 2024-09-18T01:46:22.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.394+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94861034421008] v33'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f067802a040 con 0x7f067409c040 2024-09-18T01:46:22.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.394+0000 7f0686720800 20 add_watcher() i=7 2024-09-18T01:46:22.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.394+0000 7f0686720800 2 all 8 watchers are set, enabling cache 2024-09-18T01:46:22.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.394+0000 7f0686720800 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56468e42b8a0 con 0x56468e4179a0 2024-09-18T01:46:22.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.394+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f067802a040 con 0x56468e4179a0 2024-09-18T01:46:22.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.394+0000 7f0686720800 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94861034422528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56468e428d90 con 0x56468e4179a0 2024-09-18T01:46:22.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.395+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94861034422528] v33'212 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f067802a040 con 0x56468e4179a0 2024-09-18T01:46:22.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.395+0000 7f0538fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:46:22.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.395+0000 7f0686720800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:46:22.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.395+0000 7f0686720800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:46:22.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.395+0000 7f0686720800 5 note: GC not initialized 2024-09-18T01:46:22.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.396+0000 7f04b37fe640 20 reqs_thread_entry: start 2024-09-18T01:46:22.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.396+0000 7f0686720800 20 init_complete bucket index max shards: 11 2024-09-18T01:46:22.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.396+0000 7f0686720800 20 Filter name: none 2024-09-18T01:46:22.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.396+0000 7f04b17fa640 20 reqs_thread_entry: start 2024-09-18T01:46:22.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.396+0000 7f0686720800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.396+0000 7f0686720800 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56468e45e7d0 con 0x56468e4179a0 2024-09-18T01:46:22.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.396+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f067802a040 con 0x56468e4179a0 2024-09-18T01:46:22.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.396+0000 7f0686720800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:46:22.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.396+0000 7f0686720800 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56468e45fd20 con 0x7f067409c040 2024-09-18T01:46:22.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.397+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f067802a040 con 0x7f067409c040 2024-09-18T01:46:22.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.397+0000 7f0538fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:46:22.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.398+0000 7f0686720800 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94861034422528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56468e42b1d0 con 0x56468e4179a0 2024-09-18T01:46:22.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.399+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94861034422528] v33'213 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f067802a040 con 0x56468e4179a0 2024-09-18T01:46:22.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.399+0000 7f0686720800 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94861034397120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56468e4280d0 con 0x7f067c03f060 2024-09-18T01:46:22.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.400+0000 7f0682416640 1 -- 172.21.15.146:0/1918475132 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94861034397120] v33'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0674098030 con 0x7f067c03f060 2024-09-18T01:46:22.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.400+0000 7f0686720800 20 remove_watcher() i=0 2024-09-18T01:46:22.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.400+0000 7f0686720800 2 removed watcher, disabling cache 2024-09-18T01:46:22.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.400+0000 7f0686720800 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94861034402880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56468e421dc0 con 0x56468e4179a0 2024-09-18T01:46:22.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.401+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94861034402880] v33'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f067802a040 con 0x56468e4179a0 2024-09-18T01:46:22.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.401+0000 7f0686720800 20 remove_watcher() i=1 2024-09-18T01:46:22.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.401+0000 7f0686720800 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94861034407856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56468e421dc0 con 0x56468e41dbe0 2024-09-18T01:46:22.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.402+0000 7f0682c17640 1 -- 172.21.15.146:0/1918475132 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94861034407856] v33'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f067c03c030 con 0x56468e41dbe0 2024-09-18T01:46:22.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.402+0000 7f0686720800 20 remove_watcher() i=2 2024-09-18T01:46:22.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.402+0000 7f0686720800 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94861034411552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56468e421dc0 con 0x7f067c03f060 2024-09-18T01:46:22.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.403+0000 7f0682416640 1 -- 172.21.15.146:0/1918475132 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94861034411552] v33'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0674098030 con 0x7f067c03f060 2024-09-18T01:46:22.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.403+0000 7f0686720800 20 remove_watcher() i=3 2024-09-18T01:46:22.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.403+0000 7f0686720800 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94861034415680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56468e421dc0 con 0x56468e4179a0 2024-09-18T01:46:22.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.404+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94861034415680] v33'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f067802a040 con 0x56468e4179a0 2024-09-18T01:46:22.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.404+0000 7f0686720800 20 remove_watcher() i=4 2024-09-18T01:46:22.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.404+0000 7f0686720800 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94861034413888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56468e426640 con 0x7f067409c040 2024-09-18T01:46:22.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.405+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94861034413888] v33'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f067802a040 con 0x7f067409c040 2024-09-18T01:46:22.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.405+0000 7f0686720800 20 remove_watcher() i=5 2024-09-18T01:46:22.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.405+0000 7f0686720800 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94861034418320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56468e4247b0 con 0x7f067409c040 2024-09-18T01:46:22.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.406+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94861034418320] v33'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f067802a040 con 0x7f067409c040 2024-09-18T01:46:22.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.406+0000 7f0686720800 20 remove_watcher() i=6 2024-09-18T01:46:22.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.406+0000 7f0686720800 1 -- 172.21.15.146:0/1918475132 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94861034421008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56468e4247b0 con 0x7f067409c040 2024-09-18T01:46:22.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.407+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94861034421008] v33'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f067802a040 con 0x7f067409c040 2024-09-18T01:46:22.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.407+0000 7f0686720800 20 remove_watcher() i=7 2024-09-18T01:46:22.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.407+0000 7f0686720800 1 -- 172.21.15.146:0/1918475132 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f067409c040 msgr2=0x7f067405d5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.407+0000 7f0686720800 1 --2- 172.21.15.146:0/1918475132 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f067409c040 0x7f067405d5a0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.407+0000 7f0686720800 1 -- 172.21.15.146:0/1918475132 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56468e4179a0 msgr2=0x56468e419e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.407+0000 7f0686720800 1 --2- 172.21.15.146:0/1918475132 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56468e4179a0 0x56468e419e60 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.407+0000 7f0686720800 1 -- 172.21.15.146:0/1918475132 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f067c03f060 msgr2=0x7f067c0233f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.407+0000 7f0686720800 1 --2- 172.21.15.146:0/1918475132 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f067c03f060 0x7f067c0233f0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.407+0000 7f0686720800 1 -- 172.21.15.146:0/1918475132 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x56468e41dbe0 msgr2=0x56468e41ffd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.407+0000 7f0686720800 1 --2- 172.21.15.146:0/1918475132 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x56468e41dbe0 0x56468e41ffd0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.407+0000 7f0686720800 1 -- 172.21.15.146:0/1918475132 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f054c036b40 msgr2=0x7f054c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.407+0000 7f0686720800 1 --2- 172.21.15.146:0/1918475132 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f054c036b40 0x7f054c039000 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0674067f90 tx=0x7f0674084000 comp rx=0 tx=0).stop 2024-09-18T01:46:22.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.407+0000 7f0686720800 1 -- 172.21.15.146:0/1918475132 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56468e404930 msgr2=0x56468e40bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.407+0000 7f0681c15640 1 -- 172.21.15.146:0/1918475132 reap_dead start 2024-09-18T01:46:22.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.407+0000 7f0686720800 1 --2- 172.21.15.146:0/1918475132 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56468e404930 0x56468e40bd20 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f067c043040 tx=0x7f067c04c880 comp rx=0 tx=0).stop 2024-09-18T01:46:22.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.407+0000 7f0686720800 1 -- 172.21.15.146:0/1918475132 shutdown_connections 2024-09-18T01:46:22.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.407+0000 7f0686720800 1 --2- 172.21.15.146:0/1918475132 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56468e404930 0x56468e40bd20 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.407+0000 7f0686720800 1 -- 172.21.15.146:0/1918475132 >> 172.21.15.146:0/1918475132 conn(0x56468e400ce0 msgr2=0x56468e406040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:22.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.407+0000 7f0686720800 1 -- 172.21.15.146:0/1918475132 shutdown_connections 2024-09-18T01:46:22.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.407+0000 7f0686720800 1 -- 172.21.15.146:0/1918475132 wait complete. 2024-09-18T01:46:22.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.407+0000 7f0686720800 1 -- 172.21.15.146:0/2609101651 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f055c036b40 msgr2=0x7f055c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.407+0000 7f0686720800 1 --2- 172.21.15.146:0/2609101651 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f055c036b40 0x7f055c039000 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x56468e3e57f0 tx=0x7f067408dec0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.407+0000 7f0686720800 1 -- 172.21.15.146:0/2609101651 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56468e3f7c90 msgr2=0x56468e3f80b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.408+0000 7f0686720800 1 --2- 172.21.15.146:0/2609101651 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56468e3f7c90 0x56468e3f80b0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x56468e3e48f0 tx=0x7f067c0178e0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.408+0000 7f0686720800 1 -- 172.21.15.146:0/2609101651 shutdown_connections 2024-09-18T01:46:22.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.408+0000 7f0686720800 1 --2- 172.21.15.146:0/2609101651 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f055c036b40 0x7f055c039000 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.408+0000 7f0686720800 1 --2- 172.21.15.146:0/2609101651 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56468e3f7c90 0x56468e3f80b0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.408+0000 7f0686720800 1 -- 172.21.15.146:0/2609101651 >> 172.21.15.146:0/2609101651 conn(0x56468e3ecc20 msgr2=0x56468e3ef7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:22.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.408+0000 7f0686720800 1 -- 172.21.15.146:0/2609101651 shutdown_connections 2024-09-18T01:46:22.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.408+0000 7f0686720800 1 -- 172.21.15.146:0/2609101651 wait complete. 2024-09-18T01:46:22.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.408+0000 7f0686720800 1 -- 172.21.15.146:0/835282005 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56468e2e5e20 msgr2=0x56468e3e4010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.408+0000 7f0686720800 1 --2- 172.21.15.146:0/835282005 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56468e2e5e20 0x56468e3e4010 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.408+0000 7f0686720800 1 -- 172.21.15.146:0/835282005 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x56468e3e5ef0 msgr2=0x56468e3e9750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.408+0000 7f0686720800 1 --2- 172.21.15.146:0/835282005 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x56468e3e5ef0 0x56468e3e9750 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.408+0000 7f0686720800 1 -- 172.21.15.146:0/835282005 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0568036b90 msgr2=0x7f0568039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.408+0000 7f0686720800 1 --2- 172.21.15.146:0/835282005 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0568036b90 0x7f0568039050 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0678000f60 tx=0x7f06780010a0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.408+0000 7f0686720800 1 -- 172.21.15.146:0/835282005 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56468e2e54e0 msgr2=0x56468e3dcfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.408+0000 7f0686720800 1 --2- 172.21.15.146:0/835282005 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56468e2e54e0 0x56468e3dcfa0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f0674045960 tx=0x7f0674002fb0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.408+0000 7f0686720800 1 -- 172.21.15.146:0/835282005 shutdown_connections 2024-09-18T01:46:22.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.408+0000 7f0686720800 1 --2- 172.21.15.146:0/835282005 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x56468e3e5ef0 0x56468e3e9750 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.408+0000 7f0686720800 1 --2- 172.21.15.146:0/835282005 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x56468e2e5e20 0x56468e3e4010 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.408+0000 7f0686720800 1 --2- 172.21.15.146:0/835282005 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0568036b90 0x7f0568039050 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.408+0000 7f0686720800 1 --2- 172.21.15.146:0/835282005 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56468e2e54e0 0x56468e3dcfa0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.408+0000 7f0686720800 1 -- 172.21.15.146:0/835282005 >> 172.21.15.146:0/835282005 conn(0x56468e2e0db0 msgr2=0x56468e3ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:22.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.408+0000 7f0686720800 1 -- 172.21.15.146:0/835282005 shutdown_connections 2024-09-18T01:46:22.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.408+0000 7f0686720800 1 -- 172.21.15.146:0/835282005 wait complete. 2024-09-18T01:46:22.417 INFO:teuthology.orchestra.run.smithi146.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2024-09-18T01:46:22.418 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-09-18T01:46:22.418 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-18T01:46:22.418 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-18T01:46:22.418 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_bucket 2024-09-18T01:46:22.466 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:46:22.466 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:46:22.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.466+0000 7f7645739800 1 Processor -- start 2024-09-18T01:46:22.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.466+0000 7f7645739800 1 -- start start 2024-09-18T01:46:22.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.466+0000 7f7645739800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x5581fd2ca5d0 0x5581fd2c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.466+0000 7f7645739800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5581fd213b30 con 0x5581fd2c92f0 2024-09-18T01:46:22.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.466+0000 7f7645739800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x5581fd1f5360 con 0x5581fd2ca5d0 2024-09-18T01:46:22.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.467+0000 7f76413f5640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x5581fd2ca5d0 0x5581fd2c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.467+0000 7f76413f5640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x5581fd2ca5d0 0x5581fd2c8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:44026/0 (socket says 172.21.15.146:44026) 2024-09-18T01:46:22.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.467+0000 7f76413f5640 1 -- 172.21.15.146:0/924679425 learned_addr learned my addr 172.21.15.146:0/924679425 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:22.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.467+0000 7f763bfff640 1 --1- 172.21.15.146:0/924679425 >> v1:172.21.15.129:6789/0 conn(0x5581fd2c92f0 0x5581fd35c680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:49926/0 (socket says 172.21.15.146:49926) 2024-09-18T01:46:22.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.467+0000 7f76413f5640 1 -- 172.21.15.146:0/924679425 >> v1:172.21.15.129:6789/0 conn(0x5581fd2c92f0 legacy=0x5581fd35c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.467+0000 7f76413f5640 1 -- 172.21.15.146:0/924679425 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581fd21be00 con 0x5581fd2ca5d0 2024-09-18T01:46:22.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.469+0000 7f76413f5640 1 --2- 172.21.15.146:0/924679425 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5581fd2ca5d0 0x5581fd2c8db0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f763400a520 tx=0x7f7634045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cad135afaefda6e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.469+0000 7f7640bf4640 1 -- 172.21.15.146:0/924679425 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7634055070 con 0x5581fd2ca5d0 2024-09-18T01:46:22.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.469+0000 7f7640bf4640 1 -- 172.21.15.146:0/924679425 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76340515b0 con 0x5581fd2ca5d0 2024-09-18T01:46:22.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.469+0000 7f7640bf4640 1 -- 172.21.15.146:0/924679425 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76340518d0 con 0x5581fd2ca5d0 2024-09-18T01:46:22.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.469+0000 7f7645739800 1 -- 172.21.15.146:0/924679425 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5581fd2ca5d0 msgr2=0x5581fd2c8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.469+0000 7f7645739800 1 --2- 172.21.15.146:0/924679425 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5581fd2ca5d0 0x5581fd2c8db0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f763400a520 tx=0x7f7634045ba0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.469+0000 7f7645739800 1 -- 172.21.15.146:0/924679425 shutdown_connections 2024-09-18T01:46:22.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.469+0000 7f7645739800 1 --2- 172.21.15.146:0/924679425 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5581fd2ca5d0 0x5581fd2c8db0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.469+0000 7f7645739800 1 -- 172.21.15.146:0/924679425 >> 172.21.15.146:0/924679425 conn(0x5581fd34ffe0 msgr2=0x5581fd352400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:22.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.469+0000 7f7645739800 1 -- 172.21.15.146:0/924679425 shutdown_connections 2024-09-18T01:46:22.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.469+0000 7f7645739800 1 -- 172.21.15.146:0/924679425 wait complete. 2024-09-18T01:46:22.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.483+0000 7f7645739800 1 Processor -- start 2024-09-18T01:46:22.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.483+0000 7f7645739800 1 -- start start 2024-09-18T01:46:22.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.483+0000 7f7645739800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5581fd2c92f0 0x5581fd445ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.483+0000 7f7645739800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5581fd2a0360 con 0x5581fd2c92f0 2024-09-18T01:46:22.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.484+0000 7f76413f5640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5581fd2c92f0 0x5581fd445ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.484+0000 7f76413f5640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5581fd2c92f0 0x5581fd445ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:44036/0 (socket says 172.21.15.146:44036) 2024-09-18T01:46:22.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.484+0000 7f76413f5640 1 -- 172.21.15.146:0/183152306 learned_addr learned my addr 172.21.15.146:0/183152306 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:22.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.484+0000 7f76413f5640 1 -- 172.21.15.146:0/183152306 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581fd1edbc0 con 0x5581fd2c92f0 2024-09-18T01:46:22.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.484+0000 7f76413f5640 1 --2- 172.21.15.146:0/183152306 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5581fd2c92f0 0x5581fd445ad0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f7634025da0 tx=0x7f7634051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b90e69e75e5ede6e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.484+0000 7f752f606640 1 -- 172.21.15.146:0/183152306 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7634051950 con 0x5581fd2c92f0 2024-09-18T01:46:22.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.484+0000 7f752f606640 1 -- 172.21.15.146:0/183152306 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7634051af0 con 0x5581fd2c92f0 2024-09-18T01:46:22.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.484+0000 7f752f606640 1 -- 172.21.15.146:0/183152306 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7634051dd0 con 0x5581fd2c92f0 2024-09-18T01:46:22.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.485+0000 7f7645739800 1 -- 172.21.15.146:0/183152306 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5581fd2c92f0 msgr2=0x5581fd445ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.485+0000 7f7645739800 1 --2- 172.21.15.146:0/183152306 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5581fd2c92f0 0x5581fd445ad0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f7634025da0 tx=0x7f7634051000 comp rx=0 tx=0).stop 2024-09-18T01:46:22.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.485+0000 7f7645739800 1 -- 172.21.15.146:0/183152306 shutdown_connections 2024-09-18T01:46:22.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.485+0000 7f7645739800 1 --2- 172.21.15.146:0/183152306 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5581fd2c92f0 0x5581fd445ad0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.485+0000 7f7645739800 1 -- 172.21.15.146:0/183152306 >> 172.21.15.146:0/183152306 conn(0x5581fd34ffe0 msgr2=0x5581fd441490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:22.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.485+0000 7f7645739800 1 -- 172.21.15.146:0/183152306 shutdown_connections 2024-09-18T01:46:22.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.485+0000 7f7645739800 1 -- 172.21.15.146:0/183152306 wait complete. 2024-09-18T01:46:22.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.485+0000 7f7645739800 1 Processor -- start 2024-09-18T01:46:22.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.485+0000 7f7645739800 1 -- start start 2024-09-18T01:46:22.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.485+0000 7f7645739800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5581fd2c92f0 0x5581fd44d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.485+0000 7f7645739800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5581fd2c99e0 con 0x5581fd2c92f0 2024-09-18T01:46:22.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.486+0000 7f76413f5640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5581fd2c92f0 0x5581fd44d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.486+0000 7f76413f5640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5581fd2c92f0 0x5581fd44d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:44046/0 (socket says 172.21.15.146:44046) 2024-09-18T01:46:22.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.486+0000 7f76413f5640 1 -- 172.21.15.146:0/4073099690 learned_addr learned my addr 172.21.15.146:0/4073099690 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:22.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.486+0000 7f76413f5640 1 -- 172.21.15.146:0/4073099690 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581fd201fe0 con 0x5581fd2c92f0 2024-09-18T01:46:22.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.486+0000 7f76413f5640 1 --2- 172.21.15.146:0/4073099690 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5581fd2c92f0 0x5581fd44d400 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f7634067040 tx=0x7f7634002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.486+0000 7f752de03640 1 -- 172.21.15.146:0/4073099690 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7634073070 con 0x5581fd2c92f0 2024-09-18T01:46:22.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.486+0000 7f752de03640 1 -- 172.21.15.146:0/4073099690 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f763405a450 con 0x5581fd2c92f0 2024-09-18T01:46:22.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.486+0000 7f7645739800 1 -- 172.21.15.146:0/4073099690 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5581fd44d940 con 0x5581fd2c92f0 2024-09-18T01:46:22.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.486+0000 7f752de03640 1 -- 172.21.15.146:0/4073099690 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f763405a730 con 0x5581fd2c92f0 2024-09-18T01:46:22.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.486+0000 7f7645739800 1 -- 172.21.15.146:0/4073099690 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581fd44dec0 con 0x5581fd2c92f0 2024-09-18T01:46:22.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.487+0000 7f752de03640 1 -- 172.21.15.146:0/4073099690 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7634076070 con 0x5581fd2c92f0 2024-09-18T01:46:22.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.487+0000 7f752de03640 1 --2- 172.21.15.146:0/4073099690 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7528036b40 0x7f7528039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.487+0000 7f752de03640 1 -- 172.21.15.146:0/4073099690 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f7634062070 con 0x5581fd2c92f0 2024-09-18T01:46:22.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.487+0000 7f763bfff640 1 --2- 172.21.15.146:0/4073099690 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7528036b40 0x7f7528039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.487+0000 7f7645739800 1 --2- 172.21.15.146:0/4073099690 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5581fd2ca5d0 0x5581fd454470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.487+0000 7f7645739800 1 -- 172.21.15.146:0/4073099690 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5581fd4549f0 con 0x5581fd2ca5d0 2024-09-18T01:46:22.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.488+0000 7f7641bf6640 1 --2- 172.21.15.146:0/4073099690 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5581fd2ca5d0 0x5581fd454470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.488+0000 7f763bfff640 1 --2- 172.21.15.146:0/4073099690 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7528036b40 0x7f7528039000 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f762c000f60 tx=0x7f762c001370 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.488+0000 7f7641bf6640 1 --2- 172.21.15.146:0/4073099690 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5581fd2ca5d0 0x5581fd454470 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.488+0000 7f7641bf6640 1 -- 172.21.15.146:0/4073099690 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f763c00a4a0 con 0x5581fd2ca5d0 2024-09-18T01:46:22.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.488+0000 7f7645739800 1 -- 172.21.15.146:0/4073099690 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5581fd451a20 con 0x5581fd2ca5d0 2024-09-18T01:46:22.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.488+0000 7f7641bf6640 1 -- 172.21.15.146:0/4073099690 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f763c00a4a0 con 0x5581fd2ca5d0 2024-09-18T01:46:22.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.488+0000 7f7645739800 1 -- 172.21.15.146:0/4073099690 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5581fd456810 con 0x5581fd2ca5d0 2024-09-18T01:46:22.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.489+0000 7f7641bf6640 1 -- 172.21.15.146:0/4073099690 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f763c00a4a0 con 0x5581fd2ca5d0 2024-09-18T01:46:22.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.489+0000 7f7645739800 1 -- 172.21.15.146:0/4073099690 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5581fd455950 con 0x5581fd2ca5d0 2024-09-18T01:46:22.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.489+0000 7f7641bf6640 1 -- 172.21.15.146:0/4073099690 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f763c00a4a0 con 0x5581fd2ca5d0 2024-09-18T01:46:22.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.489+0000 7f7645739800 1 --2- 172.21.15.146:0/4073099690 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5581fd4563f0 0x5581fd459c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.489+0000 7f7645739800 1 -- 172.21.15.146:0/4073099690 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5581fd45a3e0 con 0x5581fd4563f0 2024-09-18T01:46:22.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.489+0000 7f76413f5640 1 --2- 172.21.15.146:0/4073099690 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5581fd4563f0 0x5581fd459c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.489+0000 7f76413f5640 1 --2- 172.21.15.146:0/4073099690 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5581fd4563f0 0x5581fd459c50 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.490+0000 7f76413f5640 1 -- 172.21.15.146:0/4073099690 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7634075030 con 0x5581fd4563f0 2024-09-18T01:46:22.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.490+0000 7f7645739800 1 Processor -- start 2024-09-18T01:46:22.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.490+0000 7f7645739800 1 -- start start 2024-09-18T01:46:22.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.490+0000 7f7645739800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5581fd468130 0x5581fd468550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.490+0000 7f7645739800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5581fd1ef580 con 0x5581fd468130 2024-09-18T01:46:22.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.491+0000 7f7641bf6640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5581fd468130 0x5581fd468550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.491+0000 7f7641bf6640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5581fd468130 0x5581fd468550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:44056/0 (socket says 172.21.15.146:44056) 2024-09-18T01:46:22.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.491+0000 7f7641bf6640 1 -- 172.21.15.146:0/2755825855 learned_addr learned my addr 172.21.15.146:0/2755825855 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:22.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.491+0000 7f7641bf6640 1 -- 172.21.15.146:0/2755825855 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581fd468a90 con 0x5581fd468130 2024-09-18T01:46:22.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.491+0000 7f7641bf6640 1 --2- 172.21.15.146:0/2755825855 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5581fd468130 0x5581fd468550 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x5581fd454df0 tx=0x7f763c0178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.491+0000 7f7526ffd640 1 -- 172.21.15.146:0/2755825855 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f763c013440 con 0x5581fd468130 2024-09-18T01:46:22.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.491+0000 7f7526ffd640 1 -- 172.21.15.146:0/2755825855 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f763c0135e0 con 0x5581fd468130 2024-09-18T01:46:22.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.491+0000 7f7645739800 1 -- 172.21.15.146:0/2755825855 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5581fd468d20 con 0x5581fd468130 2024-09-18T01:46:22.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.491+0000 7f7526ffd640 1 -- 172.21.15.146:0/2755825855 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f763c0138c0 con 0x5581fd468130 2024-09-18T01:46:22.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.491+0000 7f7645739800 1 -- 172.21.15.146:0/2755825855 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581fd46ba00 con 0x5581fd468130 2024-09-18T01:46:22.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.492+0000 7f7526ffd640 1 -- 172.21.15.146:0/2755825855 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f763c011040 con 0x5581fd468130 2024-09-18T01:46:22.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.492+0000 7f7526ffd640 1 --2- 172.21.15.146:0/2755825855 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7518036b90 0x7f7518039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.492+0000 7f7526ffd640 1 -- 172.21.15.146:0/2755825855 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f763c01d070 con 0x5581fd468130 2024-09-18T01:46:22.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.492+0000 7f76413f5640 1 --2- 172.21.15.146:0/2755825855 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7518036b90 0x7f7518039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.493+0000 7f7645739800 1 Processor -- start 2024-09-18T01:46:22.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.493+0000 7f76413f5640 1 --2- 172.21.15.146:0/2755825855 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7518036b90 0x7f7518039050 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x5581fd455cf0 tx=0x7f763408f2d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.493+0000 7f7645739800 1 -- start start 2024-09-18T01:46:22.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.493+0000 7f7645739800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5581fd474e40 0x5581fd475240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.493+0000 7f7645739800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5581fd4461c0 con 0x5581fd474e40 2024-09-18T01:46:22.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.493+0000 7f7641bf6640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5581fd474e40 0x5581fd475240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.493+0000 7f7641bf6640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5581fd474e40 0x5581fd475240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:44068/0 (socket says 172.21.15.146:44068) 2024-09-18T01:46:22.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.493+0000 7f7641bf6640 1 -- 172.21.15.146:0/3322255973 learned_addr learned my addr 172.21.15.146:0/3322255973 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:22.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.493+0000 7f7641bf6640 1 -- 172.21.15.146:0/3322255973 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581fd475810 con 0x5581fd474e40 2024-09-18T01:46:22.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.493+0000 7f7641bf6640 1 --2- 172.21.15.146:0/3322255973 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5581fd474e40 0x5581fd475240 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f763c04c860 tx=0x7f763c04cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18e0d0fdbbeebe98 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.494+0000 7f7524ff9640 1 -- 172.21.15.146:0/3322255973 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f763c012c90 con 0x5581fd474e40 2024-09-18T01:46:22.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.494+0000 7f7524ff9640 1 -- 172.21.15.146:0/3322255973 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f763c012e30 con 0x5581fd474e40 2024-09-18T01:46:22.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.494+0000 7f7524ff9640 1 -- 172.21.15.146:0/3322255973 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f763c0124d0 con 0x5581fd474e40 2024-09-18T01:46:22.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.494+0000 7f7645739800 1 -- 172.21.15.146:0/3322255973 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5581fd474e40 msgr2=0x5581fd475240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.494+0000 7f7645739800 1 --2- 172.21.15.146:0/3322255973 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5581fd474e40 0x5581fd475240 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f763c04c860 tx=0x7f763c04cb10 comp rx=0 tx=0).stop 2024-09-18T01:46:22.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.494+0000 7f7645739800 1 -- 172.21.15.146:0/3322255973 shutdown_connections 2024-09-18T01:46:22.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.494+0000 7f7645739800 1 --2- 172.21.15.146:0/3322255973 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5581fd474e40 0x5581fd475240 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.494+0000 7f7645739800 1 -- 172.21.15.146:0/3322255973 >> 172.21.15.146:0/3322255973 conn(0x5581fd4710e0 msgr2=0x5581fd46f230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:22.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.494+0000 7f7645739800 1 -- 172.21.15.146:0/3322255973 shutdown_connections 2024-09-18T01:46:22.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.494+0000 7f7645739800 1 -- 172.21.15.146:0/3322255973 wait complete. 2024-09-18T01:46:22.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.494+0000 7f7645739800 1 Processor -- start 2024-09-18T01:46:22.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.494+0000 7f7645739800 1 -- start start 2024-09-18T01:46:22.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.495+0000 7f7645739800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5581fd474e40 0x5581fd47c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.495+0000 7f7645739800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5581fd475de0 con 0x5581fd474e40 2024-09-18T01:46:22.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.495+0000 7f7641bf6640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5581fd474e40 0x5581fd47c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.495+0000 7f7641bf6640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5581fd474e40 0x5581fd47c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:44074/0 (socket says 172.21.15.146:44074) 2024-09-18T01:46:22.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.495+0000 7f7641bf6640 1 -- 172.21.15.146:0/1200354838 learned_addr learned my addr 172.21.15.146:0/1200354838 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:22.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.495+0000 7f7641bf6640 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581fd47c7b0 con 0x5581fd474e40 2024-09-18T01:46:22.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.495+0000 7f7641bf6640 1 --2- 172.21.15.146:0/1200354838 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5581fd474e40 0x5581fd47c270 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f763c015fd0 tx=0x7f763c04c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.495+0000 7f7516ffd640 1 -- 172.21.15.146:0/1200354838 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f763c012c90 con 0x5581fd474e40 2024-09-18T01:46:22.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.495+0000 7f7516ffd640 1 -- 172.21.15.146:0/1200354838 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f763c001520 con 0x5581fd474e40 2024-09-18T01:46:22.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.495+0000 7f7516ffd640 1 -- 172.21.15.146:0/1200354838 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f763c04b4d0 con 0x5581fd474e40 2024-09-18T01:46:22.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.495+0000 7f7645739800 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5581fd47ca40 con 0x5581fd474e40 2024-09-18T01:46:22.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.495+0000 7f7645739800 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581fd47f6f0 con 0x5581fd474e40 2024-09-18T01:46:22.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.496+0000 7f7516ffd640 1 -- 172.21.15.146:0/1200354838 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f763c013b90 con 0x5581fd474e40 2024-09-18T01:46:22.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.496+0000 7f7516ffd640 1 --2- 172.21.15.146:0/1200354838 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f750c036b90 0x7f750c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.496+0000 7f7516ffd640 1 -- 172.21.15.146:0/1200354838 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f763c00e040 con 0x5581fd474e40 2024-09-18T01:46:22.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.497+0000 7f76413f5640 1 --2- 172.21.15.146:0/1200354838 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f750c036b90 0x7f750c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.497+0000 7f7645739800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.497+0000 7f7645739800 1 --2- 172.21.15.146:0/1200354838 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5581fd487e00 0x5581fd48a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.497+0000 7f7645739800 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5581fd48aa10 con 0x5581fd487e00 2024-09-18T01:46:22.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.497+0000 7f763bfff640 1 --2- 172.21.15.146:0/1200354838 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5581fd487e00 0x5581fd48a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.497+0000 7f76413f5640 1 --2- 172.21.15.146:0/1200354838 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f750c036b90 0x7f750c039050 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7634091200 tx=0x7f763408d000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.497+0000 7f763bfff640 1 --2- 172.21.15.146:0/1200354838 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5581fd487e00 0x5581fd48a2c0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.497+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f762c00f610 con 0x5581fd487e00 2024-09-18T01:46:22.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.497+0000 7f7645739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:22.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.497+0000 7f7645739800 20 realm 2024-09-18T01:46:22.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.497+0000 7f7645739800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.497+0000 7f7645739800 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5581fd487250 con 0x5581fd487e00 2024-09-18T01:46:22.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.498+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f762c00f610 con 0x5581fd487e00 2024-09-18T01:46:22.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.498+0000 7f7645739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:22.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.498+0000 7f7645739800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:46:22.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.498+0000 7f7645739800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.498+0000 7f7645739800 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5581fd48b4f0 con 0x5581fd487e00 2024-09-18T01:46:22.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.498+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f762c00f610 con 0x5581fd487e00 2024-09-18T01:46:22.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.498+0000 7f7645739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:22.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.498+0000 7f7645739800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.498+0000 7f7645739800 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5581fd48bdc0 con 0x5581fd487e00 2024-09-18T01:46:22.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.498+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f762c00f610 con 0x5581fd487e00 2024-09-18T01:46:22.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.498+0000 7f7645739800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:46:22.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.498+0000 7f7645739800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.498+0000 7f7645739800 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5581fd48c160 con 0x5581fd487e00 2024-09-18T01:46:22.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.498+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f762c00f610 con 0x5581fd487e00 2024-09-18T01:46:22.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.498+0000 7f7645739800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:46:22.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.499+0000 7f7645739800 20 searching for the correct realm 2024-09-18T01:46:22.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.499+0000 7f7645739800 1 --2- 172.21.15.146:0/1200354838 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5581fd48e090 0x5581fd490480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.499+0000 7f7645739800 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5581fd490b50 con 0x5581fd48e090 2024-09-18T01:46:22.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.499+0000 7f7641bf6640 1 --2- 172.21.15.146:0/1200354838 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5581fd48e090 0x5581fd490480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.499+0000 7f7641bf6640 1 --2- 172.21.15.146:0/1200354838 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5581fd48e090 0x5581fd490480 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.499+0000 7f7641bf6640 1 -- 172.21.15.146:0/1200354838 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f763c035070 con 0x5581fd48e090 2024-09-18T01:46:22.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.499+0000 7f7641bf6640 1 --2- 172.21.15.146:0/1200354838 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f763c0300d0 0x7f763c002ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.499+0000 7f7641bf6640 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5581fd490b50 con 0x7f763c0300d0 2024-09-18T01:46:22.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.499+0000 7f76413f5640 1 --2- 172.21.15.146:0/1200354838 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f763c0300d0 0x7f763c002ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.500+0000 7f76413f5640 1 --2- 172.21.15.146:0/1200354838 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f763c0300d0 0x7f763c002ad0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.500+0000 7f76413f5640 1 -- 172.21.15.146:0/1200354838 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7634075030 con 0x7f763c0300d0 2024-09-18T01:46:22.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.500+0000 7f76413f5640 1 --2- 172.21.15.146:0/1200354838 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f7634078070 0x7f763408f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.500+0000 7f76413f5640 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5581fd490b50 con 0x7f7634078070 2024-09-18T01:46:22.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.500+0000 7f763bfff640 1 --2- 172.21.15.146:0/1200354838 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f7634078070 0x7f763408f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.500+0000 7f763bfff640 1 --2- 172.21.15.146:0/1200354838 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f7634078070 0x7f763408f920 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.501+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f762c00f610 con 0x7f7634078070 2024-09-18T01:46:22.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.501+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5581fd490b50 con 0x5581fd487e00 2024-09-18T01:46:22.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.501+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f762c00f610 con 0x5581fd487e00 2024-09-18T01:46:22.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.501+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5581fd490b50 con 0x5581fd487e00 2024-09-18T01:46:22.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.501+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f762c00f610 con 0x5581fd487e00 2024-09-18T01:46:22.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.501+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5581fd490b50 con 0x7f7634078070 2024-09-18T01:46:22.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.501+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f762c00f610 con 0x7f7634078070 2024-09-18T01:46:22.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.501+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5581fd490b50 con 0x7f7634078070 2024-09-18T01:46:22.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.502+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f762c00f610 con 0x7f7634078070 2024-09-18T01:46:22.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.502+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5581fd490b50 con 0x7f763c0300d0 2024-09-18T01:46:22.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.502+0000 7f76413f5640 1 -- 172.21.15.146:0/1200354838 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7634075030 con 0x7f763c0300d0 2024-09-18T01:46:22.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.502+0000 7f76413f5640 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5581fd490b50 con 0x5581fd48e090 2024-09-18T01:46:22.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.502+0000 7f7641bf6640 1 -- 172.21.15.146:0/1200354838 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f763c035070 con 0x5581fd48e090 2024-09-18T01:46:22.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.502+0000 7f7641bf6640 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5581fd490b50 con 0x5581fd487e00 2024-09-18T01:46:22.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.502+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f762c00f610 con 0x5581fd487e00 2024-09-18T01:46:22.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.502+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5581fd490b50 con 0x7f7634078070 2024-09-18T01:46:22.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.503+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f762c00f610 con 0x7f7634078070 2024-09-18T01:46:22.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.503+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5581fd490b50 con 0x5581fd487e00 2024-09-18T01:46:22.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.503+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f762c00f610 con 0x5581fd487e00 2024-09-18T01:46:22.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.503+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5581fd490b50 con 0x7f763c0300d0 2024-09-18T01:46:22.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.503+0000 7f76413f5640 1 -- 172.21.15.146:0/1200354838 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f7634075030 con 0x7f763c0300d0 2024-09-18T01:46:22.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.503+0000 7f76413f5640 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5581fd490b50 con 0x5581fd48e090 2024-09-18T01:46:22.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.504+0000 7f7641bf6640 1 -- 172.21.15.146:0/1200354838 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f763c035070 con 0x5581fd48e090 2024-09-18T01:46:22.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.504+0000 7f7641bf6640 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5581fd490b50 con 0x5581fd48e090 2024-09-18T01:46:22.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.504+0000 7f7641bf6640 1 -- 172.21.15.146:0/1200354838 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f763c035070 con 0x5581fd48e090 2024-09-18T01:46:22.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.504+0000 7f7641bf6640 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5581fd490b50 con 0x7f7634078070 2024-09-18T01:46:22.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.504+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f762c00f610 con 0x7f7634078070 2024-09-18T01:46:22.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.504+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5581fd490b50 con 0x5581fd48e090 2024-09-18T01:46:22.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.504+0000 7f7641bf6640 1 -- 172.21.15.146:0/1200354838 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f763c035070 con 0x5581fd48e090 2024-09-18T01:46:22.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.504+0000 7f7641bf6640 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5581fd490b50 con 0x5581fd48e090 2024-09-18T01:46:22.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.505+0000 7f7641bf6640 1 -- 172.21.15.146:0/1200354838 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f763c035070 con 0x5581fd48e090 2024-09-18T01:46:22.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.505+0000 7f7641bf6640 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5581fd490b50 con 0x5581fd487e00 2024-09-18T01:46:22.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.505+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f762c00f610 con 0x5581fd487e00 2024-09-18T01:46:22.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.505+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5581fd490b50 con 0x5581fd487e00 2024-09-18T01:46:22.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.505+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f762c00f610 con 0x5581fd487e00 2024-09-18T01:46:22.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.505+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5581fd490b50 con 0x7f7634078070 2024-09-18T01:46:22.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.506+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f762c00f610 con 0x7f7634078070 2024-09-18T01:46:22.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.506+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5581fd490b50 con 0x5581fd48e090 2024-09-18T01:46:22.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.506+0000 7f7641bf6640 1 -- 172.21.15.146:0/1200354838 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f763c035070 con 0x5581fd48e090 2024-09-18T01:46:22.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.506+0000 7f7641bf6640 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5581fd490b50 con 0x7f763c0300d0 2024-09-18T01:46:22.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.506+0000 7f76413f5640 1 -- 172.21.15.146:0/1200354838 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7634075030 con 0x7f763c0300d0 2024-09-18T01:46:22.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.506+0000 7f76413f5640 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5581fd490b50 con 0x5581fd487e00 2024-09-18T01:46:22.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.506+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f762c00f610 con 0x5581fd487e00 2024-09-18T01:46:22.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.506+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5581fd490b50 con 0x7f7634078070 2024-09-18T01:46:22.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.507+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f762c00f610 con 0x7f7634078070 2024-09-18T01:46:22.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.507+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5581fd490b50 con 0x5581fd48e090 2024-09-18T01:46:22.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.507+0000 7f7641bf6640 1 -- 172.21.15.146:0/1200354838 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f763c035070 con 0x5581fd48e090 2024-09-18T01:46:22.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.507+0000 7f7641bf6640 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5581fd490b50 con 0x7f7634078070 2024-09-18T01:46:22.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.507+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f762c00f610 con 0x7f7634078070 2024-09-18T01:46:22.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.507+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5581fd490b50 con 0x7f763c0300d0 2024-09-18T01:46:22.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.508+0000 7f76413f5640 1 -- 172.21.15.146:0/1200354838 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7634075030 con 0x7f763c0300d0 2024-09-18T01:46:22.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.508+0000 7f76413f5640 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5581fd490b50 con 0x5581fd48e090 2024-09-18T01:46:22.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.508+0000 7f7641bf6640 1 -- 172.21.15.146:0/1200354838 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f763c035070 con 0x5581fd48e090 2024-09-18T01:46:22.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.508+0000 7f7641bf6640 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5581fd490b50 con 0x7f7634078070 2024-09-18T01:46:22.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.508+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f762c00f610 con 0x7f7634078070 2024-09-18T01:46:22.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.508+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5581fd490b50 con 0x5581fd487e00 2024-09-18T01:46:22.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.508+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f762c00f610 con 0x5581fd487e00 2024-09-18T01:46:22.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.508+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5581fd490b50 con 0x7f763c0300d0 2024-09-18T01:46:22.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.509+0000 7f76413f5640 1 -- 172.21.15.146:0/1200354838 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76340b1040 con 0x7f763c0300d0 2024-09-18T01:46:22.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.509+0000 7f7645739800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:46:22.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.509+0000 7f7645739800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:46:22.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.509+0000 7f7645739800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:46:22.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.509+0000 7f7645739800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:46:22.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.509+0000 7f7645739800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:46:22.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.509+0000 7f7645739800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:46:22.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.509+0000 7f7645739800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.509+0000 7f7645739800 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5581fd48cb10 con 0x5581fd487e00 2024-09-18T01:46:22.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.509+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f762c00f610 con 0x5581fd487e00 2024-09-18T01:46:22.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.509+0000 7f7645739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:22.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.509+0000 7f7645739800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.509+0000 7f7645739800 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5581fd48d3b0 con 0x5581fd487e00 2024-09-18T01:46:22.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.509+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f762c00f610 con 0x5581fd487e00 2024-09-18T01:46:22.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.509+0000 7f7645739800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:46:22.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.509+0000 7f7645739800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.509+0000 7f7645739800 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5581fd48c750 con 0x7f763c0300d0 2024-09-18T01:46:22.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.509+0000 7f76413f5640 1 -- 172.21.15.146:0/1200354838 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f76340b1040 con 0x7f763c0300d0 2024-09-18T01:46:22.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.509+0000 7f7645739800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:46:22.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.509+0000 7f7645739800 20 zone default found 2024-09-18T01:46:22.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.509+0000 7f7645739800 4 Realm: () 2024-09-18T01:46:22.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.509+0000 7f7645739800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:46:22.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.509+0000 7f7645739800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:46:22.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.509+0000 7f7645739800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:46:22.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.509+0000 7f7645739800 20 zonegroup default 2024-09-18T01:46:22.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.509+0000 7f7645739800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.509+0000 7f7645739800 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5581fd491480 con 0x7f7634078070 2024-09-18T01:46:22.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.510+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f762c00f610 con 0x7f7634078070 2024-09-18T01:46:22.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.510+0000 7f7645739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:22.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.510+0000 7f7645739800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.510+0000 7f7645739800 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5581fd492fe0 con 0x5581fd48e090 2024-09-18T01:46:22.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.510+0000 7f7641bf6640 1 -- 172.21.15.146:0/1200354838 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f763c035070 con 0x5581fd48e090 2024-09-18T01:46:22.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.510+0000 7f7645739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:22.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.510+0000 7f7645739800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.510+0000 7f7645739800 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5581fd493450 con 0x5581fd48e090 2024-09-18T01:46:22.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.511+0000 7f7641bf6640 1 -- 172.21.15.146:0/1200354838 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f763c035070 con 0x5581fd48e090 2024-09-18T01:46:22.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.511+0000 7f7645739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:22.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.511+0000 7f7645739800 20 started sync module instance, tier type = 2024-09-18T01:46:22.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.511+0000 7f7645739800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:46:22.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.511+0000 7f7645739800 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5581fd491ee0 con 0x7f763c0300d0 2024-09-18T01:46:22.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.512+0000 7f76413f5640 1 -- 172.21.15.146:0/1200354838 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v33'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76340b1040 con 0x7f763c0300d0 2024-09-18T01:46:22.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.512+0000 7f7645739800 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94016788570832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5581fd493d60 con 0x7f763c0300d0 2024-09-18T01:46:22.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.512+0000 7f7645739800 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5581fd4945b0 con 0x5581fd487e00 2024-09-18T01:46:22.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.513+0000 7f76413f5640 1 -- 172.21.15.146:0/1200354838 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94016788570832] v33'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76340b1040 con 0x7f763c0300d0 2024-09-18T01:46:22.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.513+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v33'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f762c00f610 con 0x5581fd487e00 2024-09-18T01:46:22.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.513+0000 7f7645739800 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94016788576432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5581fd4945b0 con 0x5581fd487e00 2024-09-18T01:46:22.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.513+0000 7f7645739800 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5581fd495090 con 0x5581fd48e090 2024-09-18T01:46:22.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.514+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94016788576432] v33'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f762c00f610 con 0x5581fd487e00 2024-09-18T01:46:22.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.514+0000 7f7641bf6640 1 -- 172.21.15.146:0/1200354838 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v33'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f763c035070 con 0x5581fd48e090 2024-09-18T01:46:22.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.514+0000 7f7645739800 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94016788578560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5581fd494520 con 0x5581fd48e090 2024-09-18T01:46:22.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.515+0000 7f7645739800 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5581fd495f50 con 0x7f763c0300d0 2024-09-18T01:46:22.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.517+0000 7f7641bf6640 1 -- 172.21.15.146:0/1200354838 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94016788578560] v33'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f763c035070 con 0x5581fd48e090 2024-09-18T01:46:22.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.517+0000 7f76413f5640 1 -- 172.21.15.146:0/1200354838 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v33'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76340b1040 con 0x7f763c0300d0 2024-09-18T01:46:22.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.517+0000 7f7645739800 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94016788585120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5581fd496340 con 0x7f763c0300d0 2024-09-18T01:46:22.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.517+0000 7f7645739800 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5581fd496d40 con 0x5581fd487e00 2024-09-18T01:46:22.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.518+0000 7f76413f5640 1 -- 172.21.15.146:0/1200354838 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94016788585120] v33'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76340b1040 con 0x7f763c0300d0 2024-09-18T01:46:22.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.518+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v33'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f762c00f610 con 0x5581fd487e00 2024-09-18T01:46:22.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.518+0000 7f7645739800 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94016788583552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5581fd496d00 con 0x5581fd487e00 2024-09-18T01:46:22.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.518+0000 7f7645739800 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5581fd4977d0 con 0x7f7634078070 2024-09-18T01:46:22.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.519+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v33'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f762c00f610 con 0x7f7634078070 2024-09-18T01:46:22.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.519+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94016788583552] v33'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f762c00f610 con 0x5581fd487e00 2024-09-18T01:46:22.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.519+0000 7f7645739800 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94016788591360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5581fd4977d0 con 0x7f7634078070 2024-09-18T01:46:22.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.519+0000 7f7645739800 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5581fd498210 con 0x7f7634078070 2024-09-18T01:46:22.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.522+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94016788591360] v33'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f762c00f610 con 0x7f7634078070 2024-09-18T01:46:22.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.522+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v33'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f762c00f610 con 0x7f7634078070 2024-09-18T01:46:22.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.522+0000 7f7645739800 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94016788588624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5581fd498210 con 0x7f7634078070 2024-09-18T01:46:22.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.522+0000 7f7645739800 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5581fd498bd0 con 0x7f7634078070 2024-09-18T01:46:22.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.523+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94016788588624] v33'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f762c00f610 con 0x7f7634078070 2024-09-18T01:46:22.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.523+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v33'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f762c00f610 con 0x7f7634078070 2024-09-18T01:46:22.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.523+0000 7f7645739800 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94016788593520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5581fd498bd0 con 0x7f7634078070 2024-09-18T01:46:22.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.523+0000 7f7645739800 20 add_watcher() i=0 2024-09-18T01:46:22.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.523+0000 7f7645739800 20 add_watcher() i=1 2024-09-18T01:46:22.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.523+0000 7f7645739800 20 add_watcher() i=2 2024-09-18T01:46:22.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.523+0000 7f7645739800 20 add_watcher() i=3 2024-09-18T01:46:22.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.523+0000 7f7645739800 20 add_watcher() i=4 2024-09-18T01:46:22.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.523+0000 7f7645739800 20 add_watcher() i=5 2024-09-18T01:46:22.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.523+0000 7f7645739800 20 add_watcher() i=6 2024-09-18T01:46:22.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.524+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94016788593520] v33'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f762c00f610 con 0x7f7634078070 2024-09-18T01:46:22.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.524+0000 7f7645739800 20 add_watcher() i=7 2024-09-18T01:46:22.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.524+0000 7f7645739800 2 all 8 watchers are set, enabling cache 2024-09-18T01:46:22.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.524+0000 7f7645739800 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5581fd49bf10 con 0x5581fd487e00 2024-09-18T01:46:22.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.524+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f762c00f610 con 0x5581fd487e00 2024-09-18T01:46:22.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.524+0000 7f7645739800 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94016788596880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5581fd499160 con 0x5581fd487e00 2024-09-18T01:46:22.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.525+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94016788596880] v33'214 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f762c00f610 con 0x5581fd487e00 2024-09-18T01:46:22.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.525+0000 7f74f77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:46:22.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.525+0000 7f7645739800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:46:22.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.525+0000 7f7645739800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:46:22.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.526+0000 7f7645739800 5 note: GC not initialized 2024-09-18T01:46:22.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.526+0000 7f74f67e4640 20 reqs_thread_entry: start 2024-09-18T01:46:22.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.526+0000 7f7645739800 20 init_complete bucket index max shards: 11 2024-09-18T01:46:22.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.526+0000 7f7645739800 20 Filter name: none 2024-09-18T01:46:22.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.526+0000 7f7467fff640 20 reqs_thread_entry: start 2024-09-18T01:46:22.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.526+0000 7f7645739800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.526+0000 7f7645739800 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5581fd4cef90 con 0x5581fd487e00 2024-09-18T01:46:22.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.526+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f762c00f610 con 0x5581fd487e00 2024-09-18T01:46:22.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.526+0000 7f7645739800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:46:22.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.527+0000 7f7645739800 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5581fd4d04e0 con 0x7f7634078070 2024-09-18T01:46:22.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.527+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f762c00f610 con 0x7f7634078070 2024-09-18T01:46:22.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.528+0000 7f74f77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:46:22.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.528+0000 7f7645739800 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94016788596880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5581fd4ce9b0 con 0x5581fd487e00 2024-09-18T01:46:22.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.529+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94016788596880] v33'215 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f762c00f610 con 0x5581fd487e00 2024-09-18T01:46:22.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.529+0000 7f7645739800 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94016788570832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5581fd498890 con 0x7f763c0300d0 2024-09-18T01:46:22.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.530+0000 7f76413f5640 1 -- 172.21.15.146:0/1200354838 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94016788570832] v33'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76340b1040 con 0x7f763c0300d0 2024-09-18T01:46:22.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.530+0000 7f7645739800 20 remove_watcher() i=0 2024-09-18T01:46:22.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.530+0000 7f7645739800 2 removed watcher, disabling cache 2024-09-18T01:46:22.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.530+0000 7f7645739800 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94016788576432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5581fd498890 con 0x5581fd487e00 2024-09-18T01:46:22.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.531+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94016788576432] v33'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f762c00f610 con 0x5581fd487e00 2024-09-18T01:46:22.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.531+0000 7f7645739800 20 remove_watcher() i=1 2024-09-18T01:46:22.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.532+0000 7f7645739800 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94016788578560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5581fd4938b0 con 0x5581fd48e090 2024-09-18T01:46:22.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.533+0000 7f7641bf6640 1 -- 172.21.15.146:0/1200354838 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94016788578560] v33'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f763c035070 con 0x5581fd48e090 2024-09-18T01:46:22.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.533+0000 7f7645739800 20 remove_watcher() i=2 2024-09-18T01:46:22.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.533+0000 7f7645739800 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94016788585120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5581fd498890 con 0x7f763c0300d0 2024-09-18T01:46:22.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.534+0000 7f76413f5640 1 -- 172.21.15.146:0/1200354838 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94016788585120] v33'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76340b1040 con 0x7f763c0300d0 2024-09-18T01:46:22.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.534+0000 7f7645739800 20 remove_watcher() i=3 2024-09-18T01:46:22.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.534+0000 7f7645739800 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94016788583552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5581fd494100 con 0x5581fd487e00 2024-09-18T01:46:22.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.535+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94016788583552] v33'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f762c00f610 con 0x5581fd487e00 2024-09-18T01:46:22.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.535+0000 7f7645739800 20 remove_watcher() i=4 2024-09-18T01:46:22.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.535+0000 7f7645739800 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94016788591360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5581fd498890 con 0x7f7634078070 2024-09-18T01:46:22.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.536+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94016788591360] v33'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f762c00f610 con 0x7f7634078070 2024-09-18T01:46:22.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.536+0000 7f7645739800 20 remove_watcher() i=5 2024-09-18T01:46:22.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.536+0000 7f7645739800 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94016788588624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5581fd495480 con 0x7f7634078070 2024-09-18T01:46:22.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.537+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94016788588624] v33'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f762c00f610 con 0x7f7634078070 2024-09-18T01:46:22.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.537+0000 7f7645739800 20 remove_watcher() i=6 2024-09-18T01:46:22.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.537+0000 7f7645739800 1 -- 172.21.15.146:0/1200354838 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94016788593520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5581fd494100 con 0x7f7634078070 2024-09-18T01:46:22.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.538+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94016788593520] v33'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f762c00f610 con 0x7f7634078070 2024-09-18T01:46:22.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.538+0000 7f7645739800 20 remove_watcher() i=7 2024-09-18T01:46:22.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.538+0000 7f7645739800 1 -- 172.21.15.146:0/1200354838 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f7634078070 msgr2=0x7f763408f920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.538+0000 7f7645739800 1 --2- 172.21.15.146:0/1200354838 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f7634078070 0x7f763408f920 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.538+0000 7f7645739800 1 -- 172.21.15.146:0/1200354838 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5581fd487e00 msgr2=0x5581fd48a2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.538+0000 7f7645739800 1 --2- 172.21.15.146:0/1200354838 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5581fd487e00 0x5581fd48a2c0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.538+0000 7f7645739800 1 -- 172.21.15.146:0/1200354838 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f763c0300d0 msgr2=0x7f763c002ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.538+0000 7f7645739800 1 --2- 172.21.15.146:0/1200354838 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f763c0300d0 0x7f763c002ad0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.538+0000 7f7645739800 1 -- 172.21.15.146:0/1200354838 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5581fd48e090 msgr2=0x5581fd490480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.538+0000 7f7645739800 1 --2- 172.21.15.146:0/1200354838 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5581fd48e090 0x5581fd490480 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.538+0000 7f7645739800 1 -- 172.21.15.146:0/1200354838 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f750c036b90 msgr2=0x7f750c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.538+0000 7f7645739800 1 --2- 172.21.15.146:0/1200354838 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f750c036b90 0x7f750c039050 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7634091200 tx=0x7f763408d000 comp rx=0 tx=0).stop 2024-09-18T01:46:22.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.538+0000 7f7645739800 1 -- 172.21.15.146:0/1200354838 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5581fd474e40 msgr2=0x5581fd47c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.538+0000 7f7645739800 1 --2- 172.21.15.146:0/1200354838 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5581fd474e40 0x5581fd47c270 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f763c015fd0 tx=0x7f763c04c7f0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.538+0000 7f763bfff640 1 -- 172.21.15.146:0/1200354838 reap_dead start 2024-09-18T01:46:22.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.538+0000 7f7645739800 1 -- 172.21.15.146:0/1200354838 shutdown_connections 2024-09-18T01:46:22.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.538+0000 7f7645739800 1 --2- 172.21.15.146:0/1200354838 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5581fd474e40 0x5581fd47c270 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.538+0000 7f7645739800 1 -- 172.21.15.146:0/1200354838 >> 172.21.15.146:0/1200354838 conn(0x5581fd4710e0 msgr2=0x5581fd46f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:22.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.538+0000 7f7645739800 1 -- 172.21.15.146:0/1200354838 shutdown_connections 2024-09-18T01:46:22.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.538+0000 7f7645739800 1 -- 172.21.15.146:0/1200354838 wait complete. 2024-09-18T01:46:22.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.538+0000 7f7645739800 1 -- 172.21.15.146:0/2755825855 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7518036b90 msgr2=0x7f7518039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.538+0000 7f7645739800 1 --2- 172.21.15.146:0/2755825855 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7518036b90 0x7f7518039050 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x5581fd455cf0 tx=0x7f763408f2d0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.538+0000 7f7645739800 1 -- 172.21.15.146:0/2755825855 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5581fd468130 msgr2=0x5581fd468550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.538+0000 7f7645739800 1 --2- 172.21.15.146:0/2755825855 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5581fd468130 0x5581fd468550 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x5581fd454df0 tx=0x7f763c0178e0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.538+0000 7f7645739800 1 -- 172.21.15.146:0/2755825855 shutdown_connections 2024-09-18T01:46:22.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.538+0000 7f7645739800 1 --2- 172.21.15.146:0/2755825855 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7518036b90 0x7f7518039050 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.538+0000 7f7645739800 1 --2- 172.21.15.146:0/2755825855 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5581fd468130 0x5581fd468550 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.538+0000 7f7645739800 1 -- 172.21.15.146:0/2755825855 >> 172.21.15.146:0/2755825855 conn(0x5581fd45d0c0 msgr2=0x5581fd45fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:22.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.538+0000 7f7645739800 1 -- 172.21.15.146:0/2755825855 shutdown_connections 2024-09-18T01:46:22.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.538+0000 7f7645739800 1 -- 172.21.15.146:0/2755825855 wait complete. 2024-09-18T01:46:22.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.539+0000 7f7645739800 1 -- 172.21.15.146:0/4073099690 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5581fd2ca5d0 msgr2=0x5581fd454470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.539+0000 7f7645739800 1 --2- 172.21.15.146:0/4073099690 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5581fd2ca5d0 0x5581fd454470 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.539+0000 7f7645739800 1 -- 172.21.15.146:0/4073099690 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5581fd4563f0 msgr2=0x5581fd459c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.539+0000 7f7645739800 1 --2- 172.21.15.146:0/4073099690 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5581fd4563f0 0x5581fd459c50 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.539+0000 7f7645739800 1 -- 172.21.15.146:0/4073099690 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7528036b40 msgr2=0x7f7528039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.539+0000 7f7645739800 1 --2- 172.21.15.146:0/4073099690 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7528036b40 0x7f7528039000 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f762c000f60 tx=0x7f762c001370 comp rx=0 tx=0).stop 2024-09-18T01:46:22.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.539+0000 7f7645739800 1 -- 172.21.15.146:0/4073099690 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5581fd2c92f0 msgr2=0x5581fd44d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.539+0000 7f7645739800 1 --2- 172.21.15.146:0/4073099690 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5581fd2c92f0 0x5581fd44d400 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f7634067040 tx=0x7f7634002fb0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.539+0000 7f7645739800 1 -- 172.21.15.146:0/4073099690 shutdown_connections 2024-09-18T01:46:22.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.539+0000 7f7645739800 1 --2- 172.21.15.146:0/4073099690 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5581fd4563f0 0x5581fd459c50 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.539+0000 7f7645739800 1 --2- 172.21.15.146:0/4073099690 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5581fd2ca5d0 0x5581fd454470 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.539+0000 7f7645739800 1 --2- 172.21.15.146:0/4073099690 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7528036b40 0x7f7528039000 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.539+0000 7f7645739800 1 --2- 172.21.15.146:0/4073099690 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5581fd2c92f0 0x5581fd44d400 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.539+0000 7f7645739800 1 -- 172.21.15.146:0/4073099690 >> 172.21.15.146:0/4073099690 conn(0x5581fd34ffe0 msgr2=0x5581fd43fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:22.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.539+0000 7f7645739800 1 -- 172.21.15.146:0/4073099690 shutdown_connections 2024-09-18T01:46:22.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.539+0000 7f7645739800 1 -- 172.21.15.146:0/4073099690 wait complete. 2024-09-18T01:46:22.548 INFO:teuthology.orchestra.run.smithi146.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1}]},{"bucket":"myfoo2","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-09-18T01:00:00.000000Z","epoch":1726621200,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}],"total":{"bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}}]} 2024-09-18T01:46:22.548 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}]}, {'bucket': 'myfoo2', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}], 'total': {'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}}]} 2024-09-18T01:46:22.548 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-18T01:46:22.548 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-18T01:46:22.549 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid bar --display-name Bar --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --max-buckets 4 2024-09-18T01:46:22.600 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:46:22.601 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:46:22.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.601+0000 7ffa7cc20800 1 Processor -- start 2024-09-18T01:46:22.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.601+0000 7ffa7cc20800 1 -- start start 2024-09-18T01:46:22.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.601+0000 7ffa7cc20800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x5566f71b5670 0x5566f7244290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.601+0000 7ffa7cc20800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5566f7100b30 con 0x5566f72447d0 2024-09-18T01:46:22.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.601+0000 7ffa7cc20800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x5566f70e2360 con 0x5566f71b5670 2024-09-18T01:46:22.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.601+0000 7ffa7a71b640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x5566f71b5670 0x5566f7244290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.601+0000 7ffa7a71b640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x5566f71b5670 0x5566f7244290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:44082/0 (socket says 172.21.15.146:44082) 2024-09-18T01:46:22.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.601+0000 7ffa7a71b640 1 -- 172.21.15.146:0/3803877813 learned_addr learned my addr 172.21.15.146:0/3803877813 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:22.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.601+0000 7ffa73fff640 1 --1- 172.21.15.146:0/3803877813 >> v1:172.21.15.129:6789/0 conn(0x5566f72447d0 0x5566f7246bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:49932/0 (socket says 172.21.15.146:49932) 2024-09-18T01:46:22.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.602+0000 7ffa7a71b640 1 -- 172.21.15.146:0/3803877813 >> v1:172.21.15.129:6789/0 conn(0x5566f72447d0 legacy=0x5566f7246bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.602+0000 7ffa7a71b640 1 -- 172.21.15.146:0/3803877813 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566f7108e00 con 0x5566f71b5670 2024-09-18T01:46:22.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.603+0000 7ffa7a71b640 1 --2- 172.21.15.146:0/3803877813 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5566f71b5670 0x5566f7244290 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c00a520 tx=0x7ffa6c045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80decc46c2f16f9c server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.604+0000 7ffa79f1a640 1 -- 172.21.15.146:0/3803877813 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa6c055070 con 0x5566f71b5670 2024-09-18T01:46:22.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.604+0000 7ffa79f1a640 1 -- 172.21.15.146:0/3803877813 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa6c0515b0 con 0x5566f71b5670 2024-09-18T01:46:22.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.604+0000 7ffa79f1a640 1 -- 172.21.15.146:0/3803877813 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa6c0518d0 con 0x5566f71b5670 2024-09-18T01:46:22.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.604+0000 7ffa7cc20800 1 -- 172.21.15.146:0/3803877813 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5566f71b5670 msgr2=0x5566f7244290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.604+0000 7ffa7cc20800 1 --2- 172.21.15.146:0/3803877813 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5566f71b5670 0x5566f7244290 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c00a520 tx=0x7ffa6c045ba0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.604+0000 7ffa7cc20800 1 -- 172.21.15.146:0/3803877813 shutdown_connections 2024-09-18T01:46:22.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.604+0000 7ffa7cc20800 1 --2- 172.21.15.146:0/3803877813 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5566f71b5670 0x5566f7244290 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.604+0000 7ffa7cc20800 1 -- 172.21.15.146:0/3803877813 >> 172.21.15.146:0/3803877813 conn(0x5566f723be20 msgr2=0x5566f723e240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:22.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.604+0000 7ffa7cc20800 1 -- 172.21.15.146:0/3803877813 shutdown_connections 2024-09-18T01:46:22.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.604+0000 7ffa7cc20800 1 -- 172.21.15.146:0/3803877813 wait complete. 2024-09-18T01:46:22.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.618+0000 7ffa7cc20800 1 Processor -- start 2024-09-18T01:46:22.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.618+0000 7ffa7cc20800 1 -- start start 2024-09-18T01:46:22.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.618+0000 7ffa7cc20800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5566f71b5670 0x5566f7330990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.618+0000 7ffa7cc20800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5566f718d370 con 0x5566f71b5670 2024-09-18T01:46:22.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.619+0000 7ffa7a71b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5566f71b5670 0x5566f7330990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.619+0000 7ffa7a71b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5566f71b5670 0x5566f7330990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:44098/0 (socket says 172.21.15.146:44098) 2024-09-18T01:46:22.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.619+0000 7ffa7a71b640 1 -- 172.21.15.146:0/462970391 learned_addr learned my addr 172.21.15.146:0/462970391 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:22.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.619+0000 7ffa7a71b640 1 -- 172.21.15.146:0/462970391 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566f70dabc0 con 0x5566f71b5670 2024-09-18T01:46:22.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.619+0000 7ffa7a71b640 1 --2- 172.21.15.146:0/462970391 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5566f71b5670 0x5566f7330990 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c025da0 tx=0x7ffa6c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63eb95546f84d504 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.619+0000 7ff968608640 1 -- 172.21.15.146:0/462970391 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa6c051950 con 0x5566f71b5670 2024-09-18T01:46:22.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.619+0000 7ff968608640 1 -- 172.21.15.146:0/462970391 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa6c051af0 con 0x5566f71b5670 2024-09-18T01:46:22.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.619+0000 7ff968608640 1 -- 172.21.15.146:0/462970391 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa6c051dd0 con 0x5566f71b5670 2024-09-18T01:46:22.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.620+0000 7ffa7cc20800 1 -- 172.21.15.146:0/462970391 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5566f71b5670 msgr2=0x5566f7330990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.620+0000 7ffa7cc20800 1 --2- 172.21.15.146:0/462970391 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5566f71b5670 0x5566f7330990 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c025da0 tx=0x7ffa6c051000 comp rx=0 tx=0).stop 2024-09-18T01:46:22.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.620+0000 7ffa7cc20800 1 -- 172.21.15.146:0/462970391 shutdown_connections 2024-09-18T01:46:22.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.620+0000 7ffa7cc20800 1 --2- 172.21.15.146:0/462970391 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5566f71b5670 0x5566f7330990 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.620+0000 7ffa7cc20800 1 -- 172.21.15.146:0/462970391 >> 172.21.15.146:0/462970391 conn(0x5566f723be20 msgr2=0x5566f732c350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:22.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.620+0000 7ffa7cc20800 1 -- 172.21.15.146:0/462970391 shutdown_connections 2024-09-18T01:46:22.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.620+0000 7ffa7cc20800 1 -- 172.21.15.146:0/462970391 wait complete. 2024-09-18T01:46:22.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.620+0000 7ffa7cc20800 1 Processor -- start 2024-09-18T01:46:22.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.620+0000 7ffa7cc20800 1 -- start start 2024-09-18T01:46:22.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.620+0000 7ffa7cc20800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5566f71b5670 0x5566f7241ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.620+0000 7ffa7cc20800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5566f72486d0 con 0x5566f71b5670 2024-09-18T01:46:22.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.621+0000 7ffa7a71b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5566f71b5670 0x5566f7241ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.621+0000 7ffa7a71b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5566f71b5670 0x5566f7241ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:44114/0 (socket says 172.21.15.146:44114) 2024-09-18T01:46:22.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.621+0000 7ffa7a71b640 1 -- 172.21.15.146:0/2510576448 learned_addr learned my addr 172.21.15.146:0/2510576448 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:22.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.621+0000 7ffa7a71b640 1 -- 172.21.15.146:0/2510576448 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566f70eefe0 con 0x5566f71b5670 2024-09-18T01:46:22.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.621+0000 7ffa7a71b640 1 --2- 172.21.15.146:0/2510576448 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5566f71b5670 0x5566f7241ba0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c067040 tx=0x7ffa6c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.621+0000 7ff966e05640 1 -- 172.21.15.146:0/2510576448 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa6c073070 con 0x5566f71b5670 2024-09-18T01:46:22.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.621+0000 7ff966e05640 1 -- 172.21.15.146:0/2510576448 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa6c05a450 con 0x5566f71b5670 2024-09-18T01:46:22.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.621+0000 7ffa7cc20800 1 -- 172.21.15.146:0/2510576448 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5566f7240290 con 0x5566f71b5670 2024-09-18T01:46:22.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.621+0000 7ff966e05640 1 -- 172.21.15.146:0/2510576448 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa6c05a730 con 0x5566f71b5670 2024-09-18T01:46:22.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.621+0000 7ffa7cc20800 1 -- 172.21.15.146:0/2510576448 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566f7240810 con 0x5566f71b5670 2024-09-18T01:46:22.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.622+0000 7ff966e05640 1 -- 172.21.15.146:0/2510576448 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ffa6c076070 con 0x5566f71b5670 2024-09-18T01:46:22.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.622+0000 7ff966e05640 1 --2- 172.21.15.146:0/2510576448 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff960036b40 0x7ff960039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.622+0000 7ff966e05640 1 -- 172.21.15.146:0/2510576448 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7ffa6c062070 con 0x5566f71b5670 2024-09-18T01:46:22.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.622+0000 7ffa73fff640 1 --2- 172.21.15.146:0/2510576448 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff960036b40 0x7ff960039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.622+0000 7ffa7cc20800 1 --2- 172.21.15.146:0/2510576448 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5566f72447d0 0x5566f7341660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.622+0000 7ffa7cc20800 1 -- 172.21.15.146:0/2510576448 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5566f7341ba0 con 0x5566f72447d0 2024-09-18T01:46:22.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.623+0000 7ffa7af1c640 1 --2- 172.21.15.146:0/2510576448 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5566f72447d0 0x5566f7341660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.623+0000 7ffa73fff640 1 --2- 172.21.15.146:0/2510576448 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff960036b40 0x7ff960039000 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ffa64000f60 tx=0x7ffa64001370 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.623+0000 7ffa7af1c640 1 --2- 172.21.15.146:0/2510576448 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5566f72447d0 0x5566f7341660 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.623+0000 7ffa7af1c640 1 -- 172.21.15.146:0/2510576448 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa7400a4a0 con 0x5566f72447d0 2024-09-18T01:46:22.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.623+0000 7ffa7cc20800 1 -- 172.21.15.146:0/2510576448 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5566f7341f80 con 0x5566f72447d0 2024-09-18T01:46:22.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.623+0000 7ffa7af1c640 1 -- 172.21.15.146:0/2510576448 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffa7400a4a0 con 0x5566f72447d0 2024-09-18T01:46:22.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.623+0000 7ffa7cc20800 1 -- 172.21.15.146:0/2510576448 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5566f7343850 con 0x5566f72447d0 2024-09-18T01:46:22.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.624+0000 7ffa7af1c640 1 -- 172.21.15.146:0/2510576448 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ffa7400a4a0 con 0x5566f72447d0 2024-09-18T01:46:22.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.624+0000 7ffa7cc20800 1 -- 172.21.15.146:0/2510576448 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5566f7342a80 con 0x5566f72447d0 2024-09-18T01:46:22.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.624+0000 7ffa7af1c640 1 -- 172.21.15.146:0/2510576448 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffa7400a4a0 con 0x5566f72447d0 2024-09-18T01:46:22.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.624+0000 7ffa7cc20800 1 --2- 172.21.15.146:0/2510576448 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5566f7344c00 0x5566f7346ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.624+0000 7ffa7cc20800 1 -- 172.21.15.146:0/2510576448 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5566f7347530 con 0x5566f7344c00 2024-09-18T01:46:22.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.624+0000 7ffa7a71b640 1 --2- 172.21.15.146:0/2510576448 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5566f7344c00 0x5566f7346ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.624+0000 7ffa7a71b640 1 --2- 172.21.15.146:0/2510576448 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5566f7344c00 0x5566f7346ff0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.625+0000 7ffa7a71b640 1 -- 172.21.15.146:0/2510576448 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ffa6c075030 con 0x5566f7344c00 2024-09-18T01:46:22.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.625+0000 7ffa7cc20800 1 Processor -- start 2024-09-18T01:46:22.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.625+0000 7ffa7cc20800 1 -- start start 2024-09-18T01:46:22.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.625+0000 7ffa7cc20800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5566f7355280 0x5566f73556a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.625+0000 7ffa7cc20800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5566f70dc580 con 0x5566f7355280 2024-09-18T01:46:22.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.625+0000 7ffa7af1c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5566f7355280 0x5566f73556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.625+0000 7ffa7af1c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5566f7355280 0x5566f73556a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:44116/0 (socket says 172.21.15.146:44116) 2024-09-18T01:46:22.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.625+0000 7ffa7af1c640 1 -- 172.21.15.146:0/1234037617 learned_addr learned my addr 172.21.15.146:0/1234037617 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:22.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.626+0000 7ffa7af1c640 1 -- 172.21.15.146:0/1234037617 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566f7355be0 con 0x5566f7355280 2024-09-18T01:46:22.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.626+0000 7ffa7af1c640 1 --2- 172.21.15.146:0/1234037617 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5566f7355280 0x5566f73556a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x5566f72411f0 tx=0x7ffa740178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.626+0000 7ff95ffff640 1 -- 172.21.15.146:0/1234037617 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa74013440 con 0x5566f7355280 2024-09-18T01:46:22.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.626+0000 7ff95ffff640 1 -- 172.21.15.146:0/1234037617 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa740135e0 con 0x5566f7355280 2024-09-18T01:46:22.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.626+0000 7ff95ffff640 1 -- 172.21.15.146:0/1234037617 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa740138c0 con 0x5566f7355280 2024-09-18T01:46:22.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.626+0000 7ffa7cc20800 1 -- 172.21.15.146:0/1234037617 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5566f7355e70 con 0x5566f7355280 2024-09-18T01:46:22.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.626+0000 7ffa7cc20800 1 -- 172.21.15.146:0/1234037617 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566f7358b50 con 0x5566f7355280 2024-09-18T01:46:22.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.627+0000 7ff95ffff640 1 -- 172.21.15.146:0/1234037617 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ffa74011040 con 0x5566f7355280 2024-09-18T01:46:22.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.627+0000 7ff95ffff640 1 --2- 172.21.15.146:0/1234037617 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff954036b90 0x7ff954039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.627+0000 7ff95ffff640 1 -- 172.21.15.146:0/1234037617 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7ffa7401d070 con 0x5566f7355280 2024-09-18T01:46:22.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.627+0000 7ffa7a71b640 1 --2- 172.21.15.146:0/1234037617 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff954036b90 0x7ff954039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.627+0000 7ffa7cc20800 1 Processor -- start 2024-09-18T01:46:22.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.627+0000 7ffa7a71b640 1 --2- 172.21.15.146:0/1234037617 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff954036b90 0x7ff954039050 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x5566f7347910 tx=0x7ffa6c08f2d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.627+0000 7ffa7cc20800 1 -- start start 2024-09-18T01:46:22.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.627+0000 7ffa7cc20800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5566f7361ee0 0x5566f73622e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.627+0000 7ffa7cc20800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5566f7331080 con 0x5566f7361ee0 2024-09-18T01:46:22.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.628+0000 7ffa7af1c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5566f7361ee0 0x5566f73622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.628+0000 7ffa7af1c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5566f7361ee0 0x5566f73622e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:44118/0 (socket says 172.21.15.146:44118) 2024-09-18T01:46:22.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.628+0000 7ffa7af1c640 1 -- 172.21.15.146:0/1846827747 learned_addr learned my addr 172.21.15.146:0/1846827747 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:22.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.628+0000 7ffa7af1c640 1 -- 172.21.15.146:0/1846827747 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566f73628b0 con 0x5566f7361ee0 2024-09-18T01:46:22.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.628+0000 7ffa7af1c640 1 --2- 172.21.15.146:0/1846827747 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5566f7361ee0 0x5566f73622e0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7ffa7404c860 tx=0x7ffa7404cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7d4c68a651dc1e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.628+0000 7ff95dffb640 1 -- 172.21.15.146:0/1846827747 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa74012c90 con 0x5566f7361ee0 2024-09-18T01:46:22.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.628+0000 7ff95dffb640 1 -- 172.21.15.146:0/1846827747 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa74012e30 con 0x5566f7361ee0 2024-09-18T01:46:22.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.628+0000 7ff95dffb640 1 -- 172.21.15.146:0/1846827747 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa740124d0 con 0x5566f7361ee0 2024-09-18T01:46:22.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.629+0000 7ffa7cc20800 1 -- 172.21.15.146:0/1846827747 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5566f7361ee0 msgr2=0x5566f73622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.629+0000 7ffa7cc20800 1 --2- 172.21.15.146:0/1846827747 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5566f7361ee0 0x5566f73622e0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7ffa7404c860 tx=0x7ffa7404cb10 comp rx=0 tx=0).stop 2024-09-18T01:46:22.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.629+0000 7ffa7cc20800 1 -- 172.21.15.146:0/1846827747 shutdown_connections 2024-09-18T01:46:22.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.629+0000 7ffa7cc20800 1 --2- 172.21.15.146:0/1846827747 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5566f7361ee0 0x5566f73622e0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.629+0000 7ffa7cc20800 1 -- 172.21.15.146:0/1846827747 >> 172.21.15.146:0/1846827747 conn(0x5566f735e280 msgr2=0x5566f735c380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:22.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.629+0000 7ffa7cc20800 1 -- 172.21.15.146:0/1846827747 shutdown_connections 2024-09-18T01:46:22.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.629+0000 7ffa7cc20800 1 -- 172.21.15.146:0/1846827747 wait complete. 2024-09-18T01:46:22.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.629+0000 7ffa7cc20800 1 Processor -- start 2024-09-18T01:46:22.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.629+0000 7ffa7cc20800 1 -- start start 2024-09-18T01:46:22.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.629+0000 7ffa7cc20800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5566f7361ee0 0x5566f7369380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.629+0000 7ffa7cc20800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5566f7362ed0 con 0x5566f7361ee0 2024-09-18T01:46:22.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.629+0000 7ffa7af1c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5566f7361ee0 0x5566f7369380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.629+0000 7ffa7af1c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5566f7361ee0 0x5566f7369380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:44122/0 (socket says 172.21.15.146:44122) 2024-09-18T01:46:22.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.629+0000 7ffa7af1c640 1 -- 172.21.15.146:0/498619510 learned_addr learned my addr 172.21.15.146:0/498619510 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:22.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.630+0000 7ffa7af1c640 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566f73698c0 con 0x5566f7361ee0 2024-09-18T01:46:22.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.630+0000 7ffa7af1c640 1 --2- 172.21.15.146:0/498619510 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5566f7361ee0 0x5566f7369380 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7ffa74015fd0 tx=0x7ffa7404c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.630+0000 7ff94bfff640 1 -- 172.21.15.146:0/498619510 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa74012c90 con 0x5566f7361ee0 2024-09-18T01:46:22.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.630+0000 7ff94bfff640 1 -- 172.21.15.146:0/498619510 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa74001520 con 0x5566f7361ee0 2024-09-18T01:46:22.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.630+0000 7ff94bfff640 1 -- 172.21.15.146:0/498619510 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa74001c30 con 0x5566f7361ee0 2024-09-18T01:46:22.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.630+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5566f7369b50 con 0x5566f7361ee0 2024-09-18T01:46:22.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.630+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566f736c800 con 0x5566f7361ee0 2024-09-18T01:46:22.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.631+0000 7ff94bfff640 1 -- 172.21.15.146:0/498619510 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ffa74013b90 con 0x5566f7361ee0 2024-09-18T01:46:22.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.631+0000 7ff94bfff640 1 --2- 172.21.15.146:0/498619510 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff944036b90 0x7ff944039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.631+0000 7ff94bfff640 1 -- 172.21.15.146:0/498619510 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7ffa7400e040 con 0x5566f7361ee0 2024-09-18T01:46:22.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.631+0000 7ffa7a71b640 1 --2- 172.21.15.146:0/498619510 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff944036b90 0x7ff944039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.631+0000 7ffa7a71b640 1 --2- 172.21.15.146:0/498619510 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff944036b90 0x7ff944039050 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c08f870 tx=0x7ffa6c08d000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.632+0000 7ffa7cc20800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.632+0000 7ffa7cc20800 1 --2- 172.21.15.146:0/498619510 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5566f7374ff0 0x5566f73774b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.632+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5566f7377c00 con 0x5566f7374ff0 2024-09-18T01:46:22.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.632+0000 7ffa73fff640 1 --2- 172.21.15.146:0/498619510 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5566f7374ff0 0x5566f73774b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.632+0000 7ffa73fff640 1 --2- 172.21.15.146:0/498619510 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5566f7374ff0 0x5566f73774b0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.632+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa6400f610 con 0x5566f7374ff0 2024-09-18T01:46:22.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.632+0000 7ffa7cc20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:22.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.632+0000 7ffa7cc20800 20 realm 2024-09-18T01:46:22.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.632+0000 7ffa7cc20800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.632+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5566f7374440 con 0x5566f7374ff0 2024-09-18T01:46:22.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.632+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa6400f610 con 0x5566f7374ff0 2024-09-18T01:46:22.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.632+0000 7ffa7cc20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:22.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.632+0000 7ffa7cc20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:46:22.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.632+0000 7ffa7cc20800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.632+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5566f73786f0 con 0x5566f7374ff0 2024-09-18T01:46:22.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.633+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa6400f610 con 0x5566f7374ff0 2024-09-18T01:46:22.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.633+0000 7ffa7cc20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:22.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.633+0000 7ffa7cc20800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.633+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5566f7378fc0 con 0x5566f7374ff0 2024-09-18T01:46:22.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.633+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffa6400f610 con 0x5566f7374ff0 2024-09-18T01:46:22.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.633+0000 7ffa7cc20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:46:22.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.633+0000 7ffa7cc20800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.633+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5566f7379360 con 0x5566f7374ff0 2024-09-18T01:46:22.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.633+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ffa6400f610 con 0x5566f7374ff0 2024-09-18T01:46:22.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.633+0000 7ffa7cc20800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:46:22.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.633+0000 7ffa7cc20800 20 searching for the correct realm 2024-09-18T01:46:22.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.633+0000 7ffa7cc20800 1 --2- 172.21.15.146:0/498619510 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5566f737b240 0x5566f737d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.633+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5566f737dd40 con 0x5566f737b240 2024-09-18T01:46:22.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.633+0000 7ffa7af1c640 1 --2- 172.21.15.146:0/498619510 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5566f737b240 0x5566f737d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.633+0000 7ffa7af1c640 1 --2- 172.21.15.146:0/498619510 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5566f737b240 0x5566f737d670 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.634+0000 7ffa7af1c640 1 -- 172.21.15.146:0/498619510 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa74035070 con 0x5566f737b240 2024-09-18T01:46:22.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.634+0000 7ffa7af1c640 1 --2- 172.21.15.146:0/498619510 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7ffa74040910 0x7ffa74022420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.634+0000 7ffa7af1c640 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5566f737dd40 con 0x7ffa74040910 2024-09-18T01:46:22.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.634+0000 7ffa7a71b640 1 --2- 172.21.15.146:0/498619510 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7ffa74040910 0x7ffa74022420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.634+0000 7ffa7a71b640 1 --2- 172.21.15.146:0/498619510 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7ffa74040910 0x7ffa74022420 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.634+0000 7ffa7a71b640 1 -- 172.21.15.146:0/498619510 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6c075030 con 0x7ffa74040910 2024-09-18T01:46:22.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.634+0000 7ffa7a71b640 1 --2- 172.21.15.146:0/498619510 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7ffa6c078070 0x7ffa6c08f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.634+0000 7ffa7a71b640 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5566f737dd40 con 0x7ffa6c078070 2024-09-18T01:46:22.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.635+0000 7ffa73fff640 1 --2- 172.21.15.146:0/498619510 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7ffa6c078070 0x7ffa6c08f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.635+0000 7ffa73fff640 1 --2- 172.21.15.146:0/498619510 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7ffa6c078070 0x7ffa6c08f920 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.635+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6400f610 con 0x7ffa6c078070 2024-09-18T01:46:22.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.635+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5566f737dd40 con 0x5566f7374ff0 2024-09-18T01:46:22.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.636+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ffa6400f610 con 0x5566f7374ff0 2024-09-18T01:46:22.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.636+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5566f737dd40 con 0x5566f7374ff0 2024-09-18T01:46:22.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.636+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6400f610 con 0x5566f7374ff0 2024-09-18T01:46:22.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.636+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5566f737dd40 con 0x7ffa6c078070 2024-09-18T01:46:22.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.636+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6400f610 con 0x7ffa6c078070 2024-09-18T01:46:22.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.636+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5566f737dd40 con 0x7ffa6c078070 2024-09-18T01:46:22.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.636+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6400f610 con 0x7ffa6c078070 2024-09-18T01:46:22.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.636+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5566f737dd40 con 0x7ffa74040910 2024-09-18T01:46:22.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.637+0000 7ffa7a71b640 1 -- 172.21.15.146:0/498619510 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6c075030 con 0x7ffa74040910 2024-09-18T01:46:22.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.637+0000 7ffa7a71b640 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5566f737dd40 con 0x5566f737b240 2024-09-18T01:46:22.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.637+0000 7ffa7af1c640 1 -- 172.21.15.146:0/498619510 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa74035070 con 0x5566f737b240 2024-09-18T01:46:22.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.637+0000 7ffa7af1c640 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5566f737dd40 con 0x5566f7374ff0 2024-09-18T01:46:22.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.637+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6400f610 con 0x5566f7374ff0 2024-09-18T01:46:22.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.637+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5566f737dd40 con 0x7ffa6c078070 2024-09-18T01:46:22.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.637+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6400f610 con 0x7ffa6c078070 2024-09-18T01:46:22.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.637+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5566f737dd40 con 0x5566f7374ff0 2024-09-18T01:46:22.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.637+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6400f610 con 0x5566f7374ff0 2024-09-18T01:46:22.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.637+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5566f737dd40 con 0x7ffa74040910 2024-09-18T01:46:22.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.638+0000 7ffa7a71b640 1 -- 172.21.15.146:0/498619510 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7ffa6c075030 con 0x7ffa74040910 2024-09-18T01:46:22.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.638+0000 7ffa7a71b640 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5566f737dd40 con 0x5566f737b240 2024-09-18T01:46:22.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.638+0000 7ffa7af1c640 1 -- 172.21.15.146:0/498619510 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa7405e040 con 0x5566f737b240 2024-09-18T01:46:22.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.638+0000 7ffa7af1c640 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5566f737dd40 con 0x5566f737b240 2024-09-18T01:46:22.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.638+0000 7ffa7af1c640 1 -- 172.21.15.146:0/498619510 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa7405e040 con 0x5566f737b240 2024-09-18T01:46:22.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.638+0000 7ffa7af1c640 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5566f737dd40 con 0x7ffa6c078070 2024-09-18T01:46:22.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.638+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6400f610 con 0x7ffa6c078070 2024-09-18T01:46:22.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.638+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5566f737dd40 con 0x5566f737b240 2024-09-18T01:46:22.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.639+0000 7ffa7af1c640 1 -- 172.21.15.146:0/498619510 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa7405e040 con 0x5566f737b240 2024-09-18T01:46:22.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.639+0000 7ffa7af1c640 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5566f737dd40 con 0x5566f737b240 2024-09-18T01:46:22.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.639+0000 7ffa7af1c640 1 -- 172.21.15.146:0/498619510 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa7405e040 con 0x5566f737b240 2024-09-18T01:46:22.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.639+0000 7ffa7af1c640 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5566f737dd40 con 0x5566f7374ff0 2024-09-18T01:46:22.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.639+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6400f610 con 0x5566f7374ff0 2024-09-18T01:46:22.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.639+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5566f737dd40 con 0x5566f7374ff0 2024-09-18T01:46:22.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.639+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ffa6400f610 con 0x5566f7374ff0 2024-09-18T01:46:22.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.639+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5566f737dd40 con 0x7ffa6c078070 2024-09-18T01:46:22.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.640+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6400f610 con 0x7ffa6c078070 2024-09-18T01:46:22.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.640+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5566f737dd40 con 0x5566f737b240 2024-09-18T01:46:22.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.640+0000 7ffa7af1c640 1 -- 172.21.15.146:0/498619510 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa7405e040 con 0x5566f737b240 2024-09-18T01:46:22.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.640+0000 7ffa7af1c640 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5566f737dd40 con 0x7ffa74040910 2024-09-18T01:46:22.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.640+0000 7ffa7a71b640 1 -- 172.21.15.146:0/498619510 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6c075030 con 0x7ffa74040910 2024-09-18T01:46:22.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.640+0000 7ffa7a71b640 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5566f737dd40 con 0x5566f7374ff0 2024-09-18T01:46:22.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.640+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6400f610 con 0x5566f7374ff0 2024-09-18T01:46:22.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.640+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5566f737dd40 con 0x7ffa6c078070 2024-09-18T01:46:22.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.641+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6400f610 con 0x7ffa6c078070 2024-09-18T01:46:22.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.641+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5566f737dd40 con 0x5566f737b240 2024-09-18T01:46:22.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.641+0000 7ffa7af1c640 1 -- 172.21.15.146:0/498619510 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa7405e040 con 0x5566f737b240 2024-09-18T01:46:22.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.641+0000 7ffa7af1c640 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5566f737dd40 con 0x7ffa6c078070 2024-09-18T01:46:22.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.641+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6400f610 con 0x7ffa6c078070 2024-09-18T01:46:22.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.641+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5566f737dd40 con 0x7ffa74040910 2024-09-18T01:46:22.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.641+0000 7ffa7a71b640 1 -- 172.21.15.146:0/498619510 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6c075030 con 0x7ffa74040910 2024-09-18T01:46:22.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.641+0000 7ffa7a71b640 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5566f737dd40 con 0x5566f737b240 2024-09-18T01:46:22.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.642+0000 7ffa7af1c640 1 -- 172.21.15.146:0/498619510 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa7405e040 con 0x5566f737b240 2024-09-18T01:46:22.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.642+0000 7ffa7af1c640 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5566f737dd40 con 0x7ffa6c078070 2024-09-18T01:46:22.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.642+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6400f610 con 0x7ffa6c078070 2024-09-18T01:46:22.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.642+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5566f737dd40 con 0x5566f7374ff0 2024-09-18T01:46:22.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.642+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ffa6400f610 con 0x5566f7374ff0 2024-09-18T01:46:22.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.642+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5566f737dd40 con 0x7ffa74040910 2024-09-18T01:46:22.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.642+0000 7ffa7a71b640 1 -- 172.21.15.146:0/498619510 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6c0b2040 con 0x7ffa74040910 2024-09-18T01:46:22.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.642+0000 7ffa7cc20800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:46:22.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.642+0000 7ffa7cc20800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:46:22.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.642+0000 7ffa7cc20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:46:22.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.642+0000 7ffa7cc20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:46:22.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.642+0000 7ffa7cc20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:46:22.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.642+0000 7ffa7cc20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:46:22.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.642+0000 7ffa7cc20800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.642+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5566f7379ce0 con 0x5566f7374ff0 2024-09-18T01:46:22.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.643+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa6400f610 con 0x5566f7374ff0 2024-09-18T01:46:22.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.643+0000 7ffa7cc20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:22.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.643+0000 7ffa7cc20800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.643+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5566f737a580 con 0x5566f7374ff0 2024-09-18T01:46:22.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.643+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffa6400f610 con 0x5566f7374ff0 2024-09-18T01:46:22.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.643+0000 7ffa7cc20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:46:22.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.643+0000 7ffa7cc20800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.643+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5566f737e1c0 con 0x7ffa74040910 2024-09-18T01:46:22.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.643+0000 7ffa7a71b640 1 -- 172.21.15.146:0/498619510 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ffa6c0b2040 con 0x7ffa74040910 2024-09-18T01:46:22.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.643+0000 7ffa7cc20800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:46:22.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.643+0000 7ffa7cc20800 20 zone default found 2024-09-18T01:46:22.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.643+0000 7ffa7cc20800 4 Realm: () 2024-09-18T01:46:22.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.643+0000 7ffa7cc20800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:46:22.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.643+0000 7ffa7cc20800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:46:22.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.643+0000 7ffa7cc20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:46:22.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.643+0000 7ffa7cc20800 20 zonegroup default 2024-09-18T01:46:22.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.643+0000 7ffa7cc20800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.643+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5566f737ea10 con 0x7ffa6c078070 2024-09-18T01:46:22.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.644+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ffa6400f610 con 0x7ffa6c078070 2024-09-18T01:46:22.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.644+0000 7ffa7cc20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:22.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.644+0000 7ffa7cc20800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.644+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5566f73803f0 con 0x5566f737b240 2024-09-18T01:46:22.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.644+0000 7ffa7af1c640 1 -- 172.21.15.146:0/498619510 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffa7405e040 con 0x5566f737b240 2024-09-18T01:46:22.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.644+0000 7ffa7cc20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:22.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.644+0000 7ffa7cc20800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.644+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5566f73808b0 con 0x5566f737b240 2024-09-18T01:46:22.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.644+0000 7ffa7af1c640 1 -- 172.21.15.146:0/498619510 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffa7405e040 con 0x5566f737b240 2024-09-18T01:46:22.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.644+0000 7ffa7cc20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:22.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.644+0000 7ffa7cc20800 20 started sync module instance, tier type = 2024-09-18T01:46:22.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.644+0000 7ffa7cc20800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:46:22.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.644+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5566f737f880 con 0x7ffa74040910 2024-09-18T01:46:22.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.645+0000 7ffa7a71b640 1 -- 172.21.15.146:0/498619510 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v33'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6c0b2040 con 0x7ffa74040910 2024-09-18T01:46:22.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.645+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93900722666608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5566f73811c0 con 0x7ffa74040910 2024-09-18T01:46:22.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.645+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5566f7381a10 con 0x5566f7374ff0 2024-09-18T01:46:22.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.646+0000 7ffa7a71b640 1 -- 172.21.15.146:0/498619510 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93900722666608] v33'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6c0b2040 con 0x7ffa74040910 2024-09-18T01:46:22.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.646+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v33'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6400f610 con 0x5566f7374ff0 2024-09-18T01:46:22.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.646+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93900722670864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5566f7381a10 con 0x5566f7374ff0 2024-09-18T01:46:22.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.646+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5566f7382430 con 0x5566f737b240 2024-09-18T01:46:22.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.647+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93900722670864] v33'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6400f610 con 0x5566f7374ff0 2024-09-18T01:46:22.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.648+0000 7ffa7af1c640 1 -- 172.21.15.146:0/498619510 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v33'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa7405e040 con 0x5566f737b240 2024-09-18T01:46:22.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.648+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93900722675488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5566f73823f0 con 0x5566f737b240 2024-09-18T01:46:22.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.648+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5566f7382ed0 con 0x7ffa74040910 2024-09-18T01:46:22.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.649+0000 7ffa7a71b640 1 -- 172.21.15.146:0/498619510 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v33'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6c0b2040 con 0x7ffa74040910 2024-09-18T01:46:22.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.649+0000 7ffa7af1c640 1 -- 172.21.15.146:0/498619510 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93900722675488] v33'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa7405e040 con 0x5566f737b240 2024-09-18T01:46:22.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.649+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93900722678240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5566f73837a0 con 0x7ffa74040910 2024-09-18T01:46:22.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.649+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5566f73837a0 con 0x5566f7374ff0 2024-09-18T01:46:22.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.650+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v33'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6400f610 con 0x5566f7374ff0 2024-09-18T01:46:22.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.650+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93900722673136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5566f7384210 con 0x5566f7374ff0 2024-09-18T01:46:22.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.650+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5566f7384cf0 con 0x7ffa6c078070 2024-09-18T01:46:22.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.650+0000 7ffa7a71b640 1 -- 172.21.15.146:0/498619510 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93900722678240] v33'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6c0b2040 con 0x7ffa74040910 2024-09-18T01:46:22.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.651+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v33'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6400f610 con 0x7ffa6c078070 2024-09-18T01:46:22.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.651+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93900722680560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5566f7384cb0 con 0x7ffa6c078070 2024-09-18T01:46:22.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.651+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5566f7385720 con 0x7ffa6c078070 2024-09-18T01:46:22.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.651+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93900722673136] v33'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6400f610 con 0x5566f7374ff0 2024-09-18T01:46:22.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.652+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93900722680560] v33'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6400f610 con 0x7ffa6c078070 2024-09-18T01:46:22.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.652+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v33'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6400f610 con 0x7ffa6c078070 2024-09-18T01:46:22.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.652+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93900722688496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5566f7384800 con 0x7ffa6c078070 2024-09-18T01:46:22.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.652+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5566f7385fc0 con 0x7ffa6c078070 2024-09-18T01:46:22.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.653+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93900722688496] v33'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6400f610 con 0x7ffa6c078070 2024-09-18T01:46:22.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.653+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v33'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6400f610 con 0x7ffa6c078070 2024-09-18T01:46:22.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.653+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93900722683232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5566f7384800 con 0x7ffa6c078070 2024-09-18T01:46:22.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.653+0000 7ffa7cc20800 20 add_watcher() i=0 2024-09-18T01:46:22.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.653+0000 7ffa7cc20800 20 add_watcher() i=1 2024-09-18T01:46:22.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.653+0000 7ffa7cc20800 20 add_watcher() i=2 2024-09-18T01:46:22.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.653+0000 7ffa7cc20800 20 add_watcher() i=3 2024-09-18T01:46:22.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.653+0000 7ffa7cc20800 20 add_watcher() i=4 2024-09-18T01:46:22.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.653+0000 7ffa7cc20800 20 add_watcher() i=5 2024-09-18T01:46:22.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.653+0000 7ffa7cc20800 20 add_watcher() i=6 2024-09-18T01:46:22.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.654+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93900722683232] v33'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6400f610 con 0x7ffa6c078070 2024-09-18T01:46:22.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.654+0000 7ffa7cc20800 20 add_watcher() i=7 2024-09-18T01:46:22.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.654+0000 7ffa7cc20800 2 all 8 watchers are set, enabling cache 2024-09-18T01:46:22.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.654+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5566f7388fa0 con 0x5566f7374ff0 2024-09-18T01:46:22.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.654+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ffa6400f610 con 0x5566f7374ff0 2024-09-18T01:46:22.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.654+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93900722690656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5566f7386460 con 0x5566f7374ff0 2024-09-18T01:46:22.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.655+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93900722690656] v33'216 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffa6400f610 con 0x5566f7374ff0 2024-09-18T01:46:22.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.655+0000 7ff930fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:46:22.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.655+0000 7ffa7cc20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:46:22.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.655+0000 7ffa7cc20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:46:22.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.655+0000 7ffa7cc20800 5 note: GC not initialized 2024-09-18T01:46:22.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.655+0000 7ff8ab7fe640 20 reqs_thread_entry: start 2024-09-18T01:46:22.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.656+0000 7ffa7cc20800 20 init_complete bucket index max shards: 11 2024-09-18T01:46:22.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.656+0000 7ffa7cc20800 20 Filter name: none 2024-09-18T01:46:22.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.656+0000 7ff8a97fa640 20 reqs_thread_entry: start 2024-09-18T01:46:22.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.656+0000 7ffa7cc20800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-18T01:46:22.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.656+0000 7ffa7cc20800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.656+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5566f73bc420 con 0x7ffa6c078070 2024-09-18T01:46:22.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.656+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(62 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7ffa6400f610 con 0x7ffa6c078070 2024-09-18T01:46:22.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.656+0000 7ffa7cc20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:22.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.656+0000 7ffa7cc20800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-18T01:46:22.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.656+0000 7ffa7cc20800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-18T01:46:22.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.656+0000 7ffa7cc20800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-18T01:46:22.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.656+0000 7ffa7cc20800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.656+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:63 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5566f73baa60 con 0x5566f7374ff0 2024-09-18T01:46:22.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.656+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(63 NX5QOQKC6BH2IDN8HC7A [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7ffa6400f610 con 0x5566f7374ff0 2024-09-18T01:46:22.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.656+0000 7ffa7cc20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:22.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.656+0000 7ffa7cc20800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-09-18T01:46:22.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.656+0000 7ffa7cc20800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-18T01:46:22.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.657+0000 7ffa7cc20800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-18T01:46:22.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.657+0000 7ffa7cc20800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-18T01:46:22.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.657+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:64 8.e 8:718f6a54:users.uid::bar:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5566f73bb300 con 0x7ffa6c078070 2024-09-18T01:46:22.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.658+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(64 bar [delete,create,call,writefull 0~380] v33'7 uv7 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7ffa6400f610 con 0x7ffa6c078070 2024-09-18T01:46:22.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.658+0000 7ffa7cc20800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-18T01:46:22.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.658+0000 7ffa7cc20800 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-18T01:46:22.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.658+0000 7ffa7cc20800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-18T01:46:22.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.658+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:65 7.9 7:93e5b521:::notify.7:head [notify cookie 93900722908752 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5566f73bfec0 con 0x7ffa6c078070 2024-09-18T01:46:22.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.658+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== watch-notify(notify (1) cookie 93900722683232 notify 141733920797 ret 0) ==== 598+0+0 (crc 0 0 0) 0x5566f73bb6a0 con 0x7ffa6c078070 2024-09-18T01:46:22.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.658+0000 7ff95dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920797 cookie 93900722683232 notifier 4733 bl.length()=556 2024-09-18T01:46:22.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.658+0000 7ff95dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-18T01:46:22.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.658+0000 7ff95dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-18T01:46:22.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.658+0000 7ff95dffb640 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:66 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7ff940003ea0 con 0x7ffa6c078070 2024-09-18T01:46:22.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.658+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(65 notify.7 [notify cookie 93900722908752 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ffa6400f610 con 0x7ffa6c078070 2024-09-18T01:46:22.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.658+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== osd_op_reply(66 notify.7 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6400f610 con 0x7ffa6c078070 2024-09-18T01:46:22.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.658+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 <== osd.0 v2:172.21.15.129:6800/1759265424 22 ==== watch-notify(notify_complete (2) cookie 93900722908752 notify 141733920797 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5566f73bbe70 con 0x7ffa6c078070 2024-09-18T01:46:22.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.659+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:67 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5566f73bd950 con 0x5566f7374ff0 2024-09-18T01:46:22.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.660+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(67 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v33'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7ffa6400f610 con 0x5566f7374ff0 2024-09-18T01:46:22.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.660+0000 7ffa7cc20800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-18T01:46:22.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.660+0000 7ffa7cc20800 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-18T01:46:22.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.660+0000 7ffa7cc20800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-18T01:46:22.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.660+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 93900722908672 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5566f73bfe20 con 0x7ffa6c078070 2024-09-18T01:46:22.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.660+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 <== osd.0 v2:172.21.15.129:6800/1759265424 23 ==== watch-notify(notify (1) cookie 93900722680560 notify 141733920798 ret 0) ==== 219+0+0 (crc 0 0 0) 0x5566f73bbe70 con 0x7ffa6c078070 2024-09-18T01:46:22.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.660+0000 7ff95d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920798 cookie 93900722680560 notifier 4733 bl.length()=177 2024-09-18T01:46:22.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.660+0000 7ff95d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-18T01:46:22.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.660+0000 7ff95d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-18T01:46:22.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.660+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 <== osd.0 v2:172.21.15.129:6800/1759265424 24 ==== osd_op_reply(68 notify.5 [notify cookie 93900722908672 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ffa6400f610 con 0x7ffa6c078070 2024-09-18T01:46:22.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.660+0000 7ff95d7fa640 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7ff8b0003400 con 0x7ffa6c078070 2024-09-18T01:46:22.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.660+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 <== osd.0 v2:172.21.15.129:6800/1759265424 25 ==== watch-notify(notify_complete (2) cookie 93900722908672 notify 141733920798 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7ffa64018040 con 0x7ffa6c078070 2024-09-18T01:46:22.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.660+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 <== osd.0 v2:172.21.15.129:6800/1759265424 26 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6400f610 con 0x7ffa6c078070 2024-09-18T01:46:22.675 INFO:teuthology.orchestra.run.smithi146.stdout:{"user_id":"bar","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bar","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-09-18T01:46:22.657471Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:46:22.657461Z","tags":[],"group_ids":[]} 2024-09-18T01:46:22.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.661+0000 7ff930fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:46:22.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.661+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93900722690656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5566f73ba100 con 0x5566f7374ff0 2024-09-18T01:46:22.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.662+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93900722690656] v33'217 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffa6400f610 con 0x5566f7374ff0 2024-09-18T01:46:22.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.662+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93900722666608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5566f73ba100 con 0x7ffa74040910 2024-09-18T01:46:22.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.663+0000 7ffa7a71b640 1 -- 172.21.15.146:0/498619510 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93900722666608] v33'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6c0b2040 con 0x7ffa74040910 2024-09-18T01:46:22.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.663+0000 7ffa7cc20800 20 remove_watcher() i=0 2024-09-18T01:46:22.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.663+0000 7ffa7cc20800 2 removed watcher, disabling cache 2024-09-18T01:46:22.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.663+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93900722670864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5566f73ba100 con 0x5566f7374ff0 2024-09-18T01:46:22.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.665+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93900722670864] v33'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6400f610 con 0x5566f7374ff0 2024-09-18T01:46:22.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.665+0000 7ffa7cc20800 20 remove_watcher() i=1 2024-09-18T01:46:22.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.665+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93900722675488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5566f73ba100 con 0x5566f737b240 2024-09-18T01:46:22.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.666+0000 7ffa7af1c640 1 -- 172.21.15.146:0/498619510 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93900722675488] v33'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa7405e040 con 0x5566f737b240 2024-09-18T01:46:22.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.666+0000 7ffa7cc20800 20 remove_watcher() i=2 2024-09-18T01:46:22.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.666+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93900722678240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5566f73ba100 con 0x7ffa74040910 2024-09-18T01:46:22.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.667+0000 7ffa7a71b640 1 -- 172.21.15.146:0/498619510 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93900722678240] v33'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6c0b2040 con 0x7ffa74040910 2024-09-18T01:46:22.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.667+0000 7ffa7cc20800 20 remove_watcher() i=3 2024-09-18T01:46:22.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.667+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93900722673136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5566f73ba100 con 0x5566f7374ff0 2024-09-18T01:46:22.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.668+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93900722673136] v33'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6400f610 con 0x5566f7374ff0 2024-09-18T01:46:22.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.668+0000 7ffa7cc20800 20 remove_watcher() i=4 2024-09-18T01:46:22.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.668+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93900722680560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5566f73ba100 con 0x7ffa6c078070 2024-09-18T01:46:22.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.669+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 <== osd.0 v2:172.21.15.129:6800/1759265424 27 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93900722680560] v33'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6400f610 con 0x7ffa6c078070 2024-09-18T01:46:22.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.669+0000 7ffa7cc20800 20 remove_watcher() i=5 2024-09-18T01:46:22.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.669+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93900722688496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5566f73ba100 con 0x7ffa6c078070 2024-09-18T01:46:22.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.670+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 <== osd.0 v2:172.21.15.129:6800/1759265424 28 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93900722688496] v33'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6400f610 con 0x7ffa6c078070 2024-09-18T01:46:22.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.670+0000 7ffa7cc20800 20 remove_watcher() i=6 2024-09-18T01:46:22.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.670+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93900722683232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5566f73ba100 con 0x7ffa6c078070 2024-09-18T01:46:22.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.671+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 <== osd.0 v2:172.21.15.129:6800/1759265424 29 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93900722683232] v33'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6400f610 con 0x7ffa6c078070 2024-09-18T01:46:22.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.671+0000 7ffa7cc20800 20 remove_watcher() i=7 2024-09-18T01:46:22.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.671+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7ffa6c078070 msgr2=0x7ffa6c08f920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.671+0000 7ffa7cc20800 1 --2- 172.21.15.146:0/498619510 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7ffa6c078070 0x7ffa6c08f920 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.671+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5566f7374ff0 msgr2=0x5566f73774b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.671+0000 7ffa7cc20800 1 --2- 172.21.15.146:0/498619510 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5566f7374ff0 0x5566f73774b0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.671+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7ffa74040910 msgr2=0x7ffa74022420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.671+0000 7ffa7cc20800 1 --2- 172.21.15.146:0/498619510 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7ffa74040910 0x7ffa74022420 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.671+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5566f737b240 msgr2=0x5566f737d670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.671+0000 7ffa7cc20800 1 --2- 172.21.15.146:0/498619510 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5566f737b240 0x5566f737d670 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.671+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff944036b90 msgr2=0x7ff944039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.671+0000 7ffa7cc20800 1 --2- 172.21.15.146:0/498619510 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff944036b90 0x7ff944039050 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c08f870 tx=0x7ffa6c08d000 comp rx=0 tx=0).stop 2024-09-18T01:46:22.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.671+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5566f7361ee0 msgr2=0x5566f7369380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.671+0000 7ffa73fff640 1 -- 172.21.15.146:0/498619510 reap_dead start 2024-09-18T01:46:22.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.671+0000 7ffa7cc20800 1 --2- 172.21.15.146:0/498619510 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5566f7361ee0 0x5566f7369380 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7ffa74015fd0 tx=0x7ffa7404c7f0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.672+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 shutdown_connections 2024-09-18T01:46:22.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.672+0000 7ffa7cc20800 1 --2- 172.21.15.146:0/498619510 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5566f7361ee0 0x5566f7369380 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.672+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 >> 172.21.15.146:0/498619510 conn(0x5566f735e280 msgr2=0x5566f735c350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:22.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.672+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 shutdown_connections 2024-09-18T01:46:22.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.672+0000 7ffa7cc20800 1 -- 172.21.15.146:0/498619510 wait complete. 2024-09-18T01:46:22.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.672+0000 7ffa7cc20800 1 -- 172.21.15.146:0/1234037617 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff954036b90 msgr2=0x7ff954039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.672+0000 7ffa7cc20800 1 --2- 172.21.15.146:0/1234037617 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff954036b90 0x7ff954039050 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x5566f7347910 tx=0x7ffa6c08f2d0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.672+0000 7ffa7cc20800 1 -- 172.21.15.146:0/1234037617 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5566f7355280 msgr2=0x5566f73556a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.672+0000 7ffa7cc20800 1 --2- 172.21.15.146:0/1234037617 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5566f7355280 0x5566f73556a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x5566f72411f0 tx=0x7ffa740178e0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.672+0000 7ffa7cc20800 1 -- 172.21.15.146:0/1234037617 shutdown_connections 2024-09-18T01:46:22.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.672+0000 7ffa7cc20800 1 --2- 172.21.15.146:0/1234037617 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff954036b90 0x7ff954039050 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.672+0000 7ffa7cc20800 1 --2- 172.21.15.146:0/1234037617 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5566f7355280 0x5566f73556a0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.672+0000 7ffa7cc20800 1 -- 172.21.15.146:0/1234037617 >> 172.21.15.146:0/1234037617 conn(0x5566f734a210 msgr2=0x5566f734cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:22.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.672+0000 7ffa7cc20800 1 -- 172.21.15.146:0/1234037617 shutdown_connections 2024-09-18T01:46:22.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.672+0000 7ffa7cc20800 1 -- 172.21.15.146:0/1234037617 wait complete. 2024-09-18T01:46:22.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.672+0000 7ffa7cc20800 1 -- 172.21.15.146:0/2510576448 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5566f72447d0 msgr2=0x5566f7341660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.672+0000 7ffa7cc20800 1 --2- 172.21.15.146:0/2510576448 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5566f72447d0 0x5566f7341660 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.672+0000 7ffa7cc20800 1 -- 172.21.15.146:0/2510576448 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5566f7344c00 msgr2=0x5566f7346ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.672+0000 7ffa7cc20800 1 --2- 172.21.15.146:0/2510576448 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5566f7344c00 0x5566f7346ff0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.672+0000 7ffa7cc20800 1 -- 172.21.15.146:0/2510576448 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff960036b40 msgr2=0x7ff960039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.672+0000 7ffa7cc20800 1 --2- 172.21.15.146:0/2510576448 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff960036b40 0x7ff960039000 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ffa64000f60 tx=0x7ffa64001370 comp rx=0 tx=0).stop 2024-09-18T01:46:22.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.672+0000 7ffa7cc20800 1 -- 172.21.15.146:0/2510576448 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5566f71b5670 msgr2=0x5566f7241ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.672+0000 7ffa7cc20800 1 --2- 172.21.15.146:0/2510576448 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5566f71b5670 0x5566f7241ba0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c067040 tx=0x7ffa6c002fb0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.672+0000 7ffa7cc20800 1 -- 172.21.15.146:0/2510576448 shutdown_connections 2024-09-18T01:46:22.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.673+0000 7ffa7cc20800 1 --2- 172.21.15.146:0/2510576448 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5566f7344c00 0x5566f7346ff0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.673+0000 7ffa7cc20800 1 --2- 172.21.15.146:0/2510576448 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5566f72447d0 0x5566f7341660 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.673+0000 7ffa7cc20800 1 --2- 172.21.15.146:0/2510576448 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff960036b40 0x7ff960039000 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.673+0000 7ffa7cc20800 1 --2- 172.21.15.146:0/2510576448 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5566f71b5670 0x5566f7241ba0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.673+0000 7ffa7cc20800 1 -- 172.21.15.146:0/2510576448 >> 172.21.15.146:0/2510576448 conn(0x5566f723be20 msgr2=0x5566f732abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:22.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.673+0000 7ffa7cc20800 1 -- 172.21.15.146:0/2510576448 shutdown_connections 2024-09-18T01:46:22.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.673+0000 7ffa7cc20800 1 -- 172.21.15.146:0/2510576448 wait complete. 2024-09-18T01:46:22.687 DEBUG:tasks.util.rgw: json result: {'user_id': 'bar', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bar', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-09-18T01:46:22.657471Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:46:22.657461Z', 'tags': [], 'group_ids': []} 2024-09-18T01:46:22.699 INFO:tasks.radosgw_admin:RL: create_bucket myfoo6 bar bytes_out=0 bytes_in=0 failed=False 2024-09-18T01:46:22.704 INFO:tasks.radosgw_admin:RL: put_obj myfoo6 bar bytes_out=8 bytes_in=0 failed=False 2024-09-18T01:46:22.704 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-18T01:46:22.704 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-18T01:46:22.704 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bar --new-uid bud 2024-09-18T01:46:22.750 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:46:22.751 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:46:22.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.751+0000 7f0f33210800 1 Processor -- start 2024-09-18T01:46:22.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.751+0000 7f0f33210800 1 -- start start 2024-09-18T01:46:22.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.751+0000 7f0f33210800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55c019ae6920 0x55c019ae8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.751+0000 7f0f33210800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c0199a2b30 con 0x55c019ae24e0 2024-09-18T01:46:22.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.751+0000 7f0f33210800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x55c019984360 con 0x55c019ae6920 2024-09-18T01:46:22.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.751+0000 7f0f260c0640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55c019ae6920 0x55c019ae8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.751+0000 7f0f260c0640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55c019ae6920 0x55c019ae8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:44132/0 (socket says 172.21.15.146:44132) 2024-09-18T01:46:22.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.751+0000 7f0f260c0640 1 -- 172.21.15.146:0/2142880503 learned_addr learned my addr 172.21.15.146:0/2142880503 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:22.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.751+0000 7f0f2e8c1640 1 --1- 172.21.15.146:0/2142880503 >> v1:172.21.15.129:6789/0 conn(0x55c019ae24e0 0x55c019ae28e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:49942/0 (socket says 172.21.15.146:49942) 2024-09-18T01:46:22.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.751+0000 7f0f260c0640 1 -- 172.21.15.146:0/2142880503 >> v1:172.21.15.129:6789/0 conn(0x55c019ae24e0 legacy=0x55c019ae28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.751+0000 7f0f2e0c0640 1 -- 172.21.15.146:0/2142880503 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2480376190 0 0) 0x55c0199a2b30 con 0x55c019ae24e0 2024-09-18T01:46:22.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.751+0000 7f0f260c0640 1 -- 172.21.15.146:0/2142880503 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0199aae00 con 0x55c019ae6920 2024-09-18T01:46:22.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.753+0000 7f0f260c0640 1 --2- 172.21.15.146:0/2142880503 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c019ae6920 0x55c019ae8d10 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f0f1800a520 tx=0x7f0f18045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b9d002c327aeb78 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.753+0000 7f0f2e0c0640 1 -- 172.21.15.146:0/2142880503 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f18055070 con 0x55c019ae6920 2024-09-18T01:46:22.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.753+0000 7f0f2e0c0640 1 -- 172.21.15.146:0/2142880503 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f180515b0 con 0x55c019ae6920 2024-09-18T01:46:22.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.753+0000 7f0f2e0c0640 1 -- 172.21.15.146:0/2142880503 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f180518d0 con 0x55c019ae6920 2024-09-18T01:46:22.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.754+0000 7f0f33210800 1 -- 172.21.15.146:0/2142880503 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c019ae6920 msgr2=0x55c019ae8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.754+0000 7f0f33210800 1 --2- 172.21.15.146:0/2142880503 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c019ae6920 0x55c019ae8d10 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f0f1800a520 tx=0x7f0f18045ba0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.754+0000 7f0f33210800 1 -- 172.21.15.146:0/2142880503 shutdown_connections 2024-09-18T01:46:22.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.754+0000 7f0f33210800 1 --2- 172.21.15.146:0/2142880503 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c019ae6920 0x55c019ae8d10 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.754+0000 7f0f33210800 1 -- 172.21.15.146:0/2142880503 >> 172.21.15.146:0/2142880503 conn(0x55c019adddb0 msgr2=0x55c019ae01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:22.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.754+0000 7f0f33210800 1 -- 172.21.15.146:0/2142880503 shutdown_connections 2024-09-18T01:46:22.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.754+0000 7f0f33210800 1 -- 172.21.15.146:0/2142880503 wait complete. 2024-09-18T01:46:22.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.768+0000 7f0f33210800 1 Processor -- start 2024-09-18T01:46:22.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.768+0000 7f0f33210800 1 -- start start 2024-09-18T01:46:22.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.768+0000 7f0f33210800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c019ae24e0 0x55c019a575c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.768+0000 7f0f33210800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55c019a2f360 con 0x55c019ae24e0 2024-09-18T01:46:22.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.768+0000 7f0f2e8c1640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c019ae24e0 0x55c019a575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.769+0000 7f0f2e8c1640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c019ae24e0 0x55c019a575c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:44134/0 (socket says 172.21.15.146:44134) 2024-09-18T01:46:22.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.769+0000 7f0f2e8c1640 1 -- 172.21.15.146:0/2826722757 learned_addr learned my addr 172.21.15.146:0/2826722757 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:22.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.769+0000 7f0f2e8c1640 1 -- 172.21.15.146:0/2826722757 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c01997cbc0 con 0x55c019ae24e0 2024-09-18T01:46:22.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.769+0000 7f0f2e8c1640 1 --2- 172.21.15.146:0/2826722757 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c019ae24e0 0x55c019a575c0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f0f2000b240 tx=0x7f0f2000b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28cf58da66682bd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.769+0000 7f0e1ce09640 1 -- 172.21.15.146:0/2826722757 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f20008070 con 0x55c019ae24e0 2024-09-18T01:46:22.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.769+0000 7f0e1ce09640 1 -- 172.21.15.146:0/2826722757 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f2000d500 con 0x55c019ae24e0 2024-09-18T01:46:22.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.769+0000 7f0e1ce09640 1 -- 172.21.15.146:0/2826722757 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f2000d860 con 0x55c019ae24e0 2024-09-18T01:46:22.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.770+0000 7f0f33210800 1 -- 172.21.15.146:0/2826722757 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c019ae24e0 msgr2=0x55c019a575c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.770+0000 7f0f33210800 1 --2- 172.21.15.146:0/2826722757 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c019ae24e0 0x55c019a575c0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f0f2000b240 tx=0x7f0f2000b700 comp rx=0 tx=0).stop 2024-09-18T01:46:22.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.770+0000 7f0f33210800 1 -- 172.21.15.146:0/2826722757 shutdown_connections 2024-09-18T01:46:22.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.770+0000 7f0f33210800 1 --2- 172.21.15.146:0/2826722757 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c019ae24e0 0x55c019a575c0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.770+0000 7f0f33210800 1 -- 172.21.15.146:0/2826722757 >> 172.21.15.146:0/2826722757 conn(0x55c019adddb0 msgr2=0x55c019bccee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:22.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.770+0000 7f0f33210800 1 -- 172.21.15.146:0/2826722757 shutdown_connections 2024-09-18T01:46:22.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.770+0000 7f0f33210800 1 -- 172.21.15.146:0/2826722757 wait complete. 2024-09-18T01:46:22.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.770+0000 7f0f33210800 1 Processor -- start 2024-09-18T01:46:22.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.770+0000 7f0f33210800 1 -- start start 2024-09-18T01:46:22.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.770+0000 7f0f33210800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c019ae24e0 0x55c019bda0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.770+0000 7f0f33210800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55c019ae9550 con 0x55c019ae24e0 2024-09-18T01:46:22.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.771+0000 7f0f2e8c1640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c019ae24e0 0x55c019bda0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.771+0000 7f0f2e8c1640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c019ae24e0 0x55c019bda0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:44150/0 (socket says 172.21.15.146:44150) 2024-09-18T01:46:22.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.771+0000 7f0f2e8c1640 1 -- 172.21.15.146:0/579348914 learned_addr learned my addr 172.21.15.146:0/579348914 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:22.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.771+0000 7f0f2e8c1640 1 -- 172.21.15.146:0/579348914 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c019990fe0 con 0x55c019ae24e0 2024-09-18T01:46:22.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.771+0000 7f0f2e8c1640 1 --2- 172.21.15.146:0/579348914 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c019ae24e0 0x55c019bda0e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x55c019a56cc0 tx=0x7f0f20000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.771+0000 7f0e1b606640 1 -- 172.21.15.146:0/579348914 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f20019870 con 0x55c019ae24e0 2024-09-18T01:46:22.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.771+0000 7f0e1b606640 1 -- 172.21.15.146:0/579348914 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f20019a10 con 0x55c019ae24e0 2024-09-18T01:46:22.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.771+0000 7f0f33210800 1 -- 172.21.15.146:0/579348914 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c019bda620 con 0x55c019ae24e0 2024-09-18T01:46:22.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.771+0000 7f0e1b606640 1 -- 172.21.15.146:0/579348914 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f20019d30 con 0x55c019ae24e0 2024-09-18T01:46:22.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.771+0000 7f0f33210800 1 -- 172.21.15.146:0/579348914 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c019bdab40 con 0x55c019ae24e0 2024-09-18T01:46:22.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.772+0000 7f0e1b606640 1 -- 172.21.15.146:0/579348914 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0f20017040 con 0x55c019ae24e0 2024-09-18T01:46:22.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.772+0000 7f0e1b606640 1 --2- 172.21.15.146:0/579348914 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0e14036b40 0x7f0e14039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.772+0000 7f0e1b606640 1 -- 172.21.15.146:0/579348914 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f0f20015020 con 0x55c019ae24e0 2024-09-18T01:46:22.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.772+0000 7f0f260c0640 1 --2- 172.21.15.146:0/579348914 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0e14036b40 0x7f0e14039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.772+0000 7f0f33210800 1 --2- 172.21.15.146:0/579348914 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55c019ae6920 0x55c019be1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.772+0000 7f0f33210800 1 -- 172.21.15.146:0/579348914 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c019be1640 con 0x55c019ae6920 2024-09-18T01:46:22.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.773+0000 7f0f2f0c2640 1 --2- 172.21.15.146:0/579348914 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55c019ae6920 0x55c019be1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.773+0000 7f0f260c0640 1 --2- 172.21.15.146:0/579348914 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0e14036b40 0x7f0e14039000 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0f18057000 tx=0x7f0f18052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.773+0000 7f0f2f0c2640 1 --2- 172.21.15.146:0/579348914 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55c019ae6920 0x55c019be1100 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.773+0000 7f0f2f0c2640 1 -- 172.21.15.146:0/579348914 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0f2800a4a0 con 0x55c019ae6920 2024-09-18T01:46:22.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.773+0000 7f0f33210800 1 -- 172.21.15.146:0/579348914 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c019bde6b0 con 0x55c019ae6920 2024-09-18T01:46:22.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.773+0000 7f0f2f0c2640 1 -- 172.21.15.146:0/579348914 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0f2800a4a0 con 0x55c019ae6920 2024-09-18T01:46:22.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.773+0000 7f0f33210800 1 -- 172.21.15.146:0/579348914 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c019be3440 con 0x55c019ae6920 2024-09-18T01:46:22.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.774+0000 7f0f2f0c2640 1 -- 172.21.15.146:0/579348914 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0f2800a4a0 con 0x55c019ae6920 2024-09-18T01:46:22.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.774+0000 7f0f33210800 1 -- 172.21.15.146:0/579348914 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c019be2580 con 0x55c019ae6920 2024-09-18T01:46:22.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.774+0000 7f0f2f0c2640 1 -- 172.21.15.146:0/579348914 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0f2800a4a0 con 0x55c019ae6920 2024-09-18T01:46:22.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.774+0000 7f0f33210800 1 --2- 172.21.15.146:0/579348914 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55c019be3020 0x55c019be6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.774+0000 7f0f33210800 1 -- 172.21.15.146:0/579348914 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c019be7010 con 0x55c019be3020 2024-09-18T01:46:22.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.774+0000 7f0f2e8c1640 1 --2- 172.21.15.146:0/579348914 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55c019be3020 0x55c019be6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.774+0000 7f0f2e8c1640 1 --2- 172.21.15.146:0/579348914 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55c019be3020 0x55c019be6880 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.775+0000 7f0f2e8c1640 1 -- 172.21.15.146:0/579348914 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0f2002d070 con 0x55c019be3020 2024-09-18T01:46:22.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.775+0000 7f0f33210800 1 Processor -- start 2024-09-18T01:46:22.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.775+0000 7f0f33210800 1 -- start start 2024-09-18T01:46:22.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.775+0000 7f0f33210800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c019bd2d20 0x55c019bd1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.775+0000 7f0f33210800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55c01997e580 con 0x55c019bd2d20 2024-09-18T01:46:22.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.775+0000 7f0f2f0c2640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c019bd2d20 0x55c019bd1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.775+0000 7f0f2f0c2640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c019bd2d20 0x55c019bd1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:44158/0 (socket says 172.21.15.146:44158) 2024-09-18T01:46:22.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.775+0000 7f0f2f0c2640 1 -- 172.21.15.146:0/2824159944 learned_addr learned my addr 172.21.15.146:0/2824159944 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:22.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.776+0000 7f0f2f0c2640 1 -- 172.21.15.146:0/2824159944 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c019bd3140 con 0x55c019bd2d20 2024-09-18T01:46:22.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.776+0000 7f0f2f0c2640 1 --2- 172.21.15.146:0/2824159944 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c019bd2d20 0x55c019bd1370 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x55c019be1a20 tx=0x7f0f280178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.776+0000 7f0e18e01640 1 -- 172.21.15.146:0/2824159944 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f28013440 con 0x55c019bd2d20 2024-09-18T01:46:22.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.776+0000 7f0e18e01640 1 -- 172.21.15.146:0/2824159944 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f280135e0 con 0x55c019bd2d20 2024-09-18T01:46:22.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.776+0000 7f0f33210800 1 -- 172.21.15.146:0/2824159944 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c019bd1970 con 0x55c019bd2d20 2024-09-18T01:46:22.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.776+0000 7f0e18e01640 1 -- 172.21.15.146:0/2824159944 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f280138c0 con 0x55c019bd2d20 2024-09-18T01:46:22.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.776+0000 7f0f33210800 1 -- 172.21.15.146:0/2824159944 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c019bd1e70 con 0x55c019bd2d20 2024-09-18T01:46:22.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.777+0000 7f0e18e01640 1 -- 172.21.15.146:0/2824159944 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0f28011040 con 0x55c019bd2d20 2024-09-18T01:46:22.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.777+0000 7f0e18e01640 1 --2- 172.21.15.146:0/2824159944 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0e08036b90 0x7f0e08039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.777+0000 7f0e18e01640 1 -- 172.21.15.146:0/2824159944 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f0f2801d070 con 0x55c019bd2d20 2024-09-18T01:46:22.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.777+0000 7f0f2e8c1640 1 --2- 172.21.15.146:0/2824159944 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0e08036b90 0x7f0e08039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.777+0000 7f0f33210800 1 Processor -- start 2024-09-18T01:46:22.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.777+0000 7f0f33210800 1 -- start start 2024-09-18T01:46:22.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.777+0000 7f0f2e8c1640 1 --2- 172.21.15.146:0/2824159944 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0e08036b90 0x7f0e08039050 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x55c019be2920 tx=0x7f0f2004b670 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.777+0000 7f0f33210800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c019c03bf0 0x55c019c03ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.777+0000 7f0f33210800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55c019bd5500 con 0x55c019c03bf0 2024-09-18T01:46:22.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.778+0000 7f0f2f0c2640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c019c03bf0 0x55c019c03ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.778+0000 7f0f2f0c2640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c019c03bf0 0x55c019c03ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:44172/0 (socket says 172.21.15.146:44172) 2024-09-18T01:46:22.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.778+0000 7f0f2f0c2640 1 -- 172.21.15.146:0/2945455119 learned_addr learned my addr 172.21.15.146:0/2945455119 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:22.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.778+0000 7f0f2f0c2640 1 -- 172.21.15.146:0/2945455119 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c019c04530 con 0x55c019c03bf0 2024-09-18T01:46:22.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.778+0000 7f0f2f0c2640 1 --2- 172.21.15.146:0/2945455119 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c019c03bf0 0x55c019c03ff0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f0f2804c890 tx=0x7f0f280127a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=256aaf57e8911f78 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.778+0000 7f0e127fc640 1 -- 172.21.15.146:0/2945455119 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f28045070 con 0x55c019c03bf0 2024-09-18T01:46:22.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.778+0000 7f0e127fc640 1 -- 172.21.15.146:0/2945455119 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f2804e0d0 con 0x55c019c03bf0 2024-09-18T01:46:22.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.778+0000 7f0e127fc640 1 -- 172.21.15.146:0/2945455119 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f28021a50 con 0x55c019c03bf0 2024-09-18T01:46:22.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.779+0000 7f0f33210800 1 -- 172.21.15.146:0/2945455119 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c019c03bf0 msgr2=0x55c019c03ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.779+0000 7f0f33210800 1 --2- 172.21.15.146:0/2945455119 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c019c03bf0 0x55c019c03ff0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f0f2804c890 tx=0x7f0f280127a0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.779+0000 7f0f33210800 1 -- 172.21.15.146:0/2945455119 shutdown_connections 2024-09-18T01:46:22.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.779+0000 7f0f33210800 1 --2- 172.21.15.146:0/2945455119 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c019c03bf0 0x55c019c03ff0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.779+0000 7f0f33210800 1 -- 172.21.15.146:0/2945455119 >> 172.21.15.146:0/2945455119 conn(0x55c019bfffa0 msgr2=0x55c019bfe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:22.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.779+0000 7f0f33210800 1 -- 172.21.15.146:0/2945455119 shutdown_connections 2024-09-18T01:46:22.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.779+0000 7f0f33210800 1 -- 172.21.15.146:0/2945455119 wait complete. 2024-09-18T01:46:22.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.779+0000 7f0f33210800 1 Processor -- start 2024-09-18T01:46:22.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.779+0000 7f0f33210800 1 -- start start 2024-09-18T01:46:22.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.779+0000 7f0f33210800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c019c03bf0 0x55c019c0b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.779+0000 7f0f33210800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55c019c04bd0 con 0x55c019c03bf0 2024-09-18T01:46:22.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.779+0000 7f0f2f0c2640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c019c03bf0 0x55c019c0b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.779+0000 7f0f2f0c2640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c019c03bf0 0x55c019c0b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:44178/0 (socket says 172.21.15.146:44178) 2024-09-18T01:46:22.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.779+0000 7f0f2f0c2640 1 -- 172.21.15.146:0/1389318226 learned_addr learned my addr 172.21.15.146:0/1389318226 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:22.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.780+0000 7f0f2f0c2640 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c019c0b5c0 con 0x55c019c03bf0 2024-09-18T01:46:22.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.780+0000 7f0f2f0c2640 1 --2- 172.21.15.146:0/1389318226 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c019c03bf0 0x55c019c0b080 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f0f280127e0 tx=0x7f0f2804c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.780+0000 7f0e10ff9640 1 -- 172.21.15.146:0/1389318226 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f2803a070 con 0x55c019c03bf0 2024-09-18T01:46:22.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.780+0000 7f0e10ff9640 1 -- 172.21.15.146:0/1389318226 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f28013a60 con 0x55c019c03bf0 2024-09-18T01:46:22.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.780+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c019c0b850 con 0x55c019c03bf0 2024-09-18T01:46:22.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.780+0000 7f0e10ff9640 1 -- 172.21.15.146:0/1389318226 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f28045040 con 0x55c019c03bf0 2024-09-18T01:46:22.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.780+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c019c0e500 con 0x55c019c03bf0 2024-09-18T01:46:22.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.781+0000 7f0e10ff9640 1 -- 172.21.15.146:0/1389318226 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0f2803d070 con 0x55c019c03bf0 2024-09-18T01:46:22.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.781+0000 7f0e10ff9640 1 --2- 172.21.15.146:0/1389318226 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0df8036b40 0x7f0df8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.781+0000 7f0e10ff9640 1 -- 172.21.15.146:0/1389318226 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f0f28032070 con 0x55c019c03bf0 2024-09-18T01:46:22.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.781+0000 7f0f2e8c1640 1 --2- 172.21.15.146:0/1389318226 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0df8036b40 0x7f0df8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.781+0000 7f0f2e8c1640 1 --2- 172.21.15.146:0/1389318226 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0df8036b40 0x7f0df8039000 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0f2004b7a0 tx=0x7f0f20033000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.781+0000 7f0f33210800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.782+0000 7f0f33210800 1 --2- 172.21.15.146:0/1389318226 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55c019c16d40 0x55c019c19200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.782+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c019c19950 con 0x55c019c16d40 2024-09-18T01:46:22.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.782+0000 7f0f260c0640 1 --2- 172.21.15.146:0/1389318226 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55c019c16d40 0x55c019c19200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.782+0000 7f0f260c0640 1 --2- 172.21.15.146:0/1389318226 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55c019c16d40 0x55c019c19200 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.782+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0f18057030 con 0x55c019c16d40 2024-09-18T01:46:22.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.782+0000 7f0f33210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:22.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.782+0000 7f0f33210800 20 realm 2024-09-18T01:46:22.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.782+0000 7f0f33210800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.782+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c019c19d80 con 0x55c019c16d40 2024-09-18T01:46:22.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.782+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0f18057030 con 0x55c019c16d40 2024-09-18T01:46:22.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.782+0000 7f0f33210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:22.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.782+0000 7f0f33210800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:46:22.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.782+0000 7f0f33210800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.782+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c019c1a650 con 0x55c019c16d40 2024-09-18T01:46:22.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.783+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0f18057030 con 0x55c019c16d40 2024-09-18T01:46:22.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.783+0000 7f0f33210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:22.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.783+0000 7f0f33210800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.783+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c019c1a9f0 con 0x55c019c16d40 2024-09-18T01:46:22.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.783+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0f18057030 con 0x55c019c16d40 2024-09-18T01:46:22.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.783+0000 7f0f33210800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:46:22.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.783+0000 7f0f33210800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.783+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c019c1b240 con 0x55c019c16d40 2024-09-18T01:46:22.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.783+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0f18057030 con 0x55c019c16d40 2024-09-18T01:46:22.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.783+0000 7f0f33210800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:46:22.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.783+0000 7f0f33210800 20 searching for the correct realm 2024-09-18T01:46:22.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.783+0000 7f0f33210800 1 --2- 172.21.15.146:0/1389318226 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55c019c1cfb0 0x55c019c1f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.783+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c019c1f9d0 con 0x55c019c1cfb0 2024-09-18T01:46:22.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.783+0000 7f0f2f0c2640 1 --2- 172.21.15.146:0/1389318226 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55c019c1cfb0 0x55c019c1f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.784+0000 7f0f2f0c2640 1 --2- 172.21.15.146:0/1389318226 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55c019c1cfb0 0x55c019c1f3a0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.784+0000 7f0f2f0c2640 1 -- 172.21.15.146:0/1389318226 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f2803c030 con 0x55c019c1cfb0 2024-09-18T01:46:22.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.784+0000 7f0f2f0c2640 1 --2- 172.21.15.146:0/1389318226 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f0f2803f060 0x7f0f28022a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.784+0000 7f0f2f0c2640 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c019c1f9d0 con 0x7f0f2803f060 2024-09-18T01:46:22.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.784+0000 7f0f2e8c1640 1 --2- 172.21.15.146:0/1389318226 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f0f2803f060 0x7f0f28022a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.784+0000 7f0f2e8c1640 1 --2- 172.21.15.146:0/1389318226 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f0f2803f060 0x7f0f28022a90 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.784+0000 7f0f2e8c1640 1 -- 172.21.15.146:0/1389318226 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f20044d70 con 0x7f0f2803f060 2024-09-18T01:46:22.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.784+0000 7f0f2e8c1640 1 --2- 172.21.15.146:0/1389318226 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f0f200187f0 0x7f0f2001c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:22.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.784+0000 7f0f2e8c1640 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c019c1f9d0 con 0x7f0f200187f0 2024-09-18T01:46:22.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.785+0000 7f0f260c0640 1 --2- 172.21.15.146:0/1389318226 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f0f200187f0 0x7f0f2001c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:22.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.785+0000 7f0f260c0640 1 --2- 172.21.15.146:0/1389318226 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f0f200187f0 0x7f0f2001c610 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:22.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.785+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f18057030 con 0x7f0f200187f0 2024-09-18T01:46:22.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.785+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c019c1f9d0 con 0x55c019c16d40 2024-09-18T01:46:22.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.785+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0f18057030 con 0x55c019c16d40 2024-09-18T01:46:22.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.786+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c019c1f9d0 con 0x55c019c16d40 2024-09-18T01:46:22.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.786+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f18057030 con 0x55c019c16d40 2024-09-18T01:46:22.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.786+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c019c1f9d0 con 0x7f0f200187f0 2024-09-18T01:46:22.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.786+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f18057030 con 0x7f0f200187f0 2024-09-18T01:46:22.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.786+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c019c1f9d0 con 0x7f0f200187f0 2024-09-18T01:46:22.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.786+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f18057030 con 0x7f0f200187f0 2024-09-18T01:46:22.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.786+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c019c1f9d0 con 0x7f0f2803f060 2024-09-18T01:46:22.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.786+0000 7f0f2e8c1640 1 -- 172.21.15.146:0/1389318226 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f20044d70 con 0x7f0f2803f060 2024-09-18T01:46:22.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.786+0000 7f0f2e8c1640 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c019c1f9d0 con 0x55c019c1cfb0 2024-09-18T01:46:22.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.787+0000 7f0f2f0c2640 1 -- 172.21.15.146:0/1389318226 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f2803c030 con 0x55c019c1cfb0 2024-09-18T01:46:22.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.787+0000 7f0f2f0c2640 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c019c1f9d0 con 0x55c019c16d40 2024-09-18T01:46:22.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.787+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f18057030 con 0x55c019c16d40 2024-09-18T01:46:22.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.787+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c019c1f9d0 con 0x7f0f200187f0 2024-09-18T01:46:22.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.787+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f18057030 con 0x7f0f200187f0 2024-09-18T01:46:22.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.787+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c019c1f9d0 con 0x55c019c16d40 2024-09-18T01:46:22.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.787+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f18057030 con 0x55c019c16d40 2024-09-18T01:46:22.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.787+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c019c1f9d0 con 0x7f0f2803f060 2024-09-18T01:46:22.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.788+0000 7f0f2e8c1640 1 -- 172.21.15.146:0/1389318226 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f0f20044d70 con 0x7f0f2803f060 2024-09-18T01:46:22.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.788+0000 7f0f2e8c1640 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0f2005a0a0 con 0x55c019c1cfb0 2024-09-18T01:46:22.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.788+0000 7f0f2f0c2640 1 -- 172.21.15.146:0/1389318226 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f2803c030 con 0x55c019c1cfb0 2024-09-18T01:46:22.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.788+0000 7f0f2f0c2640 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0f2005a0a0 con 0x55c019c1cfb0 2024-09-18T01:46:22.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.788+0000 7f0f2f0c2640 1 -- 172.21.15.146:0/1389318226 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f2803c030 con 0x55c019c1cfb0 2024-09-18T01:46:22.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.788+0000 7f0f2f0c2640 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0f2005a0a0 con 0x7f0f200187f0 2024-09-18T01:46:22.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.788+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f18057030 con 0x7f0f200187f0 2024-09-18T01:46:22.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.788+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0f2005a0a0 con 0x55c019c1cfb0 2024-09-18T01:46:22.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.788+0000 7f0f2f0c2640 1 -- 172.21.15.146:0/1389318226 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f2803c030 con 0x55c019c1cfb0 2024-09-18T01:46:22.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.788+0000 7f0f2f0c2640 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0f2005a0a0 con 0x55c019c1cfb0 2024-09-18T01:46:22.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.789+0000 7f0f2f0c2640 1 -- 172.21.15.146:0/1389318226 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f2803c030 con 0x55c019c1cfb0 2024-09-18T01:46:22.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.789+0000 7f0f2f0c2640 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0f2005a0a0 con 0x55c019c16d40 2024-09-18T01:46:22.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.789+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f18057030 con 0x55c019c16d40 2024-09-18T01:46:22.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.789+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0f2005a0a0 con 0x55c019c16d40 2024-09-18T01:46:22.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.789+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0f18057030 con 0x55c019c16d40 2024-09-18T01:46:22.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.789+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0f2005a0a0 con 0x7f0f200187f0 2024-09-18T01:46:22.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.789+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f18057030 con 0x7f0f200187f0 2024-09-18T01:46:22.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.789+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0f2005a0a0 con 0x55c019c1cfb0 2024-09-18T01:46:22.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.789+0000 7f0f2f0c2640 1 -- 172.21.15.146:0/1389318226 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f2803c030 con 0x55c019c1cfb0 2024-09-18T01:46:22.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.789+0000 7f0f2f0c2640 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0f2005a0a0 con 0x7f0f2803f060 2024-09-18T01:46:22.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.790+0000 7f0f2e8c1640 1 -- 172.21.15.146:0/1389318226 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f20044d70 con 0x7f0f2803f060 2024-09-18T01:46:22.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.790+0000 7f0f2e8c1640 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0f2005a0a0 con 0x55c019c16d40 2024-09-18T01:46:22.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.790+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f18057030 con 0x55c019c16d40 2024-09-18T01:46:22.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.790+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0f2005a0a0 con 0x7f0f200187f0 2024-09-18T01:46:22.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.790+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f18057030 con 0x7f0f200187f0 2024-09-18T01:46:22.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.790+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0f2005a0a0 con 0x55c019c1cfb0 2024-09-18T01:46:22.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.790+0000 7f0f2f0c2640 1 -- 172.21.15.146:0/1389318226 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f2803c030 con 0x55c019c1cfb0 2024-09-18T01:46:22.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.790+0000 7f0f2f0c2640 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0f2005a0a0 con 0x7f0f200187f0 2024-09-18T01:46:22.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.791+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f18057030 con 0x7f0f200187f0 2024-09-18T01:46:22.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.791+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0f2005a0a0 con 0x7f0f2803f060 2024-09-18T01:46:22.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.791+0000 7f0f2e8c1640 1 -- 172.21.15.146:0/1389318226 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f20044d70 con 0x7f0f2803f060 2024-09-18T01:46:22.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.791+0000 7f0f2e8c1640 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0f2005a0a0 con 0x55c019c1cfb0 2024-09-18T01:46:22.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.791+0000 7f0f2f0c2640 1 -- 172.21.15.146:0/1389318226 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f2803c030 con 0x55c019c1cfb0 2024-09-18T01:46:22.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.791+0000 7f0f2f0c2640 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0f2005a0a0 con 0x7f0f200187f0 2024-09-18T01:46:22.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.791+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f18057030 con 0x7f0f200187f0 2024-09-18T01:46:22.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.791+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0f2005a0a0 con 0x55c019c16d40 2024-09-18T01:46:22.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.792+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0f18057030 con 0x55c019c16d40 2024-09-18T01:46:22.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.792+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0f2005a0a0 con 0x7f0f2803f060 2024-09-18T01:46:22.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.792+0000 7f0f2e8c1640 1 -- 172.21.15.146:0/1389318226 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f20044d70 con 0x7f0f2803f060 2024-09-18T01:46:22.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.792+0000 7f0f33210800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:46:22.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.792+0000 7f0f33210800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:46:22.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.792+0000 7f0f33210800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:46:22.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.792+0000 7f0f33210800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:46:22.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.792+0000 7f0f33210800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:46:22.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.792+0000 7f0f33210800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:46:22.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.792+0000 7f0f33210800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.792+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c019c1bbc0 con 0x55c019c16d40 2024-09-18T01:46:22.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.792+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0f18057030 con 0x55c019c16d40 2024-09-18T01:46:22.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.792+0000 7f0f33210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:22.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.792+0000 7f0f33210800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.792+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c019c1c460 con 0x55c019c16d40 2024-09-18T01:46:22.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.792+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0f18057030 con 0x55c019c16d40 2024-09-18T01:46:22.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.792+0000 7f0f33210800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:46:22.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.792+0000 7f0f33210800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.792+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c019c1fe50 con 0x7f0f2803f060 2024-09-18T01:46:22.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.793+0000 7f0f2e8c1640 1 -- 172.21.15.146:0/1389318226 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0f20044d70 con 0x7f0f2803f060 2024-09-18T01:46:22.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.793+0000 7f0f33210800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:46:22.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.793+0000 7f0f33210800 20 zone default found 2024-09-18T01:46:22.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.793+0000 7f0f33210800 4 Realm: () 2024-09-18T01:46:22.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.793+0000 7f0f33210800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:46:22.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.793+0000 7f0f33210800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:46:22.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.793+0000 7f0f33210800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:46:22.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.793+0000 7f0f33210800 20 zonegroup default 2024-09-18T01:46:22.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.793+0000 7f0f33210800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.793+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c019c206a0 con 0x7f0f200187f0 2024-09-18T01:46:22.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.793+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0f18057030 con 0x7f0f200187f0 2024-09-18T01:46:22.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.793+0000 7f0f33210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:22.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.793+0000 7f0f33210800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.793+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c019c22080 con 0x55c019c1cfb0 2024-09-18T01:46:22.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.793+0000 7f0f2f0c2640 1 -- 172.21.15.146:0/1389318226 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0f2803c030 con 0x55c019c1cfb0 2024-09-18T01:46:22.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.793+0000 7f0f33210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:22.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.793+0000 7f0f33210800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.793+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c019c22550 con 0x55c019c1cfb0 2024-09-18T01:46:22.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.793+0000 7f0f2f0c2640 1 -- 172.21.15.146:0/1389318226 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0f2803c030 con 0x55c019c1cfb0 2024-09-18T01:46:22.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.794+0000 7f0f33210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:22.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.794+0000 7f0f33210800 20 started sync module instance, tier type = 2024-09-18T01:46:22.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.794+0000 7f0f33210800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:46:22.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.794+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c019c21510 con 0x7f0f2803f060 2024-09-18T01:46:22.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.795+0000 7f0f2e8c1640 1 -- 172.21.15.146:0/1389318226 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v33'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f20044d70 con 0x7f0f2803f060 2024-09-18T01:46:22.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.795+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94283554232576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c019c22e60 con 0x7f0f2803f060 2024-09-18T01:46:22.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.795+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c019c236b0 con 0x55c019c16d40 2024-09-18T01:46:22.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.796+0000 7f0f2e8c1640 1 -- 172.21.15.146:0/1389318226 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94283554232576] v33'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f20044d70 con 0x7f0f2803f060 2024-09-18T01:46:22.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.796+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v33'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f18057030 con 0x55c019c16d40 2024-09-18T01:46:22.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.796+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94283554236848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c019c236f0 con 0x55c019c16d40 2024-09-18T01:46:22.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.796+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c019c241e0 con 0x55c019c1cfb0 2024-09-18T01:46:22.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.797+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94283554236848] v33'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f18057030 con 0x55c019c16d40 2024-09-18T01:46:22.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.797+0000 7f0f2f0c2640 1 -- 172.21.15.146:0/1389318226 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v33'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f2803c030 con 0x55c019c1cfb0 2024-09-18T01:46:22.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.797+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94283554241712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c019c241a0 con 0x55c019c1cfb0 2024-09-18T01:46:22.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.797+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c019c24c70 con 0x7f0f2803f060 2024-09-18T01:46:22.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.798+0000 7f0f2e8c1640 1 -- 172.21.15.146:0/1389318226 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v33'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f20044d70 con 0x7f0f2803f060 2024-09-18T01:46:22.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.798+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94283554244416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c019c25510 con 0x7f0f2803f060 2024-09-18T01:46:22.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.798+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c019c25ff0 con 0x55c019c16d40 2024-09-18T01:46:22.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.799+0000 7f0f2f0c2640 1 -- 172.21.15.146:0/1389318226 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94283554241712] v33'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f2803c030 con 0x55c019c1cfb0 2024-09-18T01:46:22.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.799+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v33'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f18057030 con 0x55c019c16d40 2024-09-18T01:46:22.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.799+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94283554249472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c019c25ff0 con 0x55c019c16d40 2024-09-18T01:46:22.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.800+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c019c26a80 con 0x7f0f200187f0 2024-09-18T01:46:22.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.800+0000 7f0f2e8c1640 1 -- 172.21.15.146:0/1389318226 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94283554244416] v33'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f20044d70 con 0x7f0f2803f060 2024-09-18T01:46:22.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.800+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v33'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f18057030 con 0x7f0f200187f0 2024-09-18T01:46:22.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.801+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94283554252112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c019c26a40 con 0x7f0f200187f0 2024-09-18T01:46:22.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.801+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c019c274b0 con 0x7f0f200187f0 2024-09-18T01:46:22.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.801+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94283554249472] v33'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f18057030 con 0x55c019c16d40 2024-09-18T01:46:22.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.801+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94283554252112] v33'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f18057030 con 0x7f0f200187f0 2024-09-18T01:46:22.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.802+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v33'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f18057030 con 0x7f0f200187f0 2024-09-18T01:46:22.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.802+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94283554246752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c019c23200 con 0x7f0f200187f0 2024-09-18T01:46:22.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.802+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c019c27960 con 0x7f0f200187f0 2024-09-18T01:46:22.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.803+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94283554246752] v33'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f18057030 con 0x7f0f200187f0 2024-09-18T01:46:22.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.803+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v33'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f18057030 con 0x7f0f200187f0 2024-09-18T01:46:22.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.803+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94283554254816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c019c27960 con 0x7f0f200187f0 2024-09-18T01:46:22.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.803+0000 7f0f33210800 20 add_watcher() i=0 2024-09-18T01:46:22.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.803+0000 7f0f33210800 20 add_watcher() i=1 2024-09-18T01:46:22.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.803+0000 7f0f33210800 20 add_watcher() i=2 2024-09-18T01:46:22.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.803+0000 7f0f33210800 20 add_watcher() i=3 2024-09-18T01:46:22.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.803+0000 7f0f33210800 20 add_watcher() i=4 2024-09-18T01:46:22.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.803+0000 7f0f33210800 20 add_watcher() i=5 2024-09-18T01:46:22.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.803+0000 7f0f33210800 20 add_watcher() i=6 2024-09-18T01:46:22.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.804+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94283554254816] v33'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f18057030 con 0x7f0f200187f0 2024-09-18T01:46:22.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.804+0000 7f0f33210800 20 add_watcher() i=7 2024-09-18T01:46:22.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.804+0000 7f0f33210800 2 all 8 watchers are set, enabling cache 2024-09-18T01:46:22.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.804+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c019c2ad60 con 0x55c019c16d40 2024-09-18T01:46:22.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.804+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0f18057030 con 0x55c019c16d40 2024-09-18T01:46:22.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.804+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94283554256512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c019c282b0 con 0x55c019c16d40 2024-09-18T01:46:22.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.805+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94283554256512] v33'218 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0f18057030 con 0x55c019c16d40 2024-09-18T01:46:22.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.805+0000 7f0de57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:46:22.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.805+0000 7f0f33210800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:46:22.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.805+0000 7f0f33210800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:46:22.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.805+0000 7f0f33210800 5 note: GC not initialized 2024-09-18T01:46:22.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.805+0000 7f0d5ffff640 20 reqs_thread_entry: start 2024-09-18T01:46:22.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.806+0000 7f0f33210800 20 init_complete bucket index max shards: 11 2024-09-18T01:46:22.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.806+0000 7f0f33210800 20 Filter name: none 2024-09-18T01:46:22.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.806+0000 7f0d5dffb640 20 reqs_thread_entry: start 2024-09-18T01:46:22.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.806+0000 7f0f33210800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-18T01:46:22.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.806+0000 7f0f33210800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.806+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c019c5e090 con 0x7f0f200187f0 2024-09-18T01:46:22.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.807+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(62 bar [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f0f18057030 con 0x7f0f200187f0 2024-09-18T01:46:22.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.807+0000 7f0f33210800 20 rados_obj.operate() r=0 bl.length=380 2024-09-18T01:46:22.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.807+0000 7f0f33210800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x13 2024-09-18T01:46:22.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.807+0000 7f0f33210800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-18T01:46:22.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.807+0000 7f0f33210800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:46:22.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.807+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:63 8.4 8:267425a8:users.uid::bud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c019c62440 con 0x7f0f2803f060 2024-09-18T01:46:22.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.808+0000 7f0f2e8c1640 1 -- 172.21.15.146:0/1389318226 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(63 bud [create,call,writefull 0~206] v33'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f0f20044d70 con 0x7f0f2803f060 2024-09-18T01:46:22.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.808+0000 7f0f33210800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-18T01:46:22.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.808+0000 7f0f33210800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-18T01:46:22.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.808+0000 7f0f33210800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-18T01:46:22.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.808+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:64 7.3 7:c609908c:::notify.5:head [notify cookie 94283554496000 in=394b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c019c63110 con 0x7f0f200187f0 2024-09-18T01:46:22.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.808+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== watch-notify(notify (1) cookie 94283554252112 notify 141733920799 ret 0) ==== 424+0+0 (crc 0 0 0) 0x7f0f18076040 con 0x7f0f200187f0 2024-09-18T01:46:22.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.808+0000 7f0e127fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920799 cookie 94283554252112 notifier 4740 bl.length()=382 2024-09-18T01:46:22.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.808+0000 7f0e127fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-18T01:46:22.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.808+0000 7f0e127fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-18T01:46:22.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.808+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(64 notify.5 [notify cookie 94283554496000 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0f18057030 con 0x7f0f200187f0 2024-09-18T01:46:22.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.808+0000 7f0e127fc640 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f0df4003ea0 con 0x7f0f200187f0 2024-09-18T01:46:22.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.809+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(65 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f18057030 con 0x7f0f200187f0 2024-09-18T01:46:22.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.809+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== watch-notify(notify_complete (2) cookie 94283554496000 notify 141733920799 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c0199aae00 con 0x7f0f200187f0 2024-09-18T01:46:22.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.809+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:66 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c019c61e00 con 0x55c019c16d40 2024-09-18T01:46:22.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.809+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(66 bar.buckets [call out=184b] v0'0 uv3 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7f0f18057030 con 0x55c019c16d40 2024-09-18T01:46:22.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.809+0000 7f0f33210800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9 : miss 2024-09-18T01:46:22.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.809+0000 7f0f33210800 20 rados->read ofs=0 len=0 2024-09-18T01:46:22.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.809+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:67 8.4 8:20837f84:root::.bucket.meta.myfoo6%3a8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c019c60230 con 0x7f0f2803f060 2024-09-18T01:46:22.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.810+0000 7f0f2e8c1640 1 -- 172.21.15.146:0/1389318226 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(67 .bucket.meta.myfoo6:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9 [call out=48b,stat out=16b,read 0~380 out=380b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 333+0+662 (crc 0 0 0) 0x7f0f20044d70 con 0x7f0f2803f060 2024-09-18T01:46:22.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.810+0000 7f0f33210800 20 rados_obj.operate() r=0 bl.length=380 2024-09-18T01:46:22.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.810+0000 7f0f33210800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9 info.flags=0x17 2024-09-18T01:46:22.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.810+0000 7f0f33210800 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9 to cache LRU end 2024-09-18T01:46:22.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.810+0000 7f0f33210800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:46:22.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.810+0000 7f0f33210800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T01:46:22.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.810+0000 7f0f33210800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9 2024-09-18T01:46:22.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.810+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:68 8.4 8:20837f84:root::.bucket.meta.myfoo6%3a8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~380 in=380b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c019c6a2e0 con 0x7f0f2803f060 2024-09-18T01:46:22.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.811+0000 7f0f2e8c1640 1 -- 172.21.15.146:0/1389318226 <== osd.2 v2:172.21.15.146:6800/3820039304 14 ==== osd_op_reply(68 .bucket.meta.myfoo6:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9 [delete,create,call,call,writefull 0~380,setxattr (117)] v33'3 uv3 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7f0f20044d70 con 0x7f0f2803f060 2024-09-18T01:46:22.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.811+0000 7f0f33210800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9 info.flags=0x17 2024-09-18T01:46:22.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.811+0000 7f0f33210800 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9 to cache LRU end 2024-09-18T01:46:22.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.811+0000 7f0f33210800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-18T01:46:22.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.811+0000 7f0f33210800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9, ofs0, ns] 2024-09-18T01:46:22.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.811+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94283554483568 in=760b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c019c68f90 con 0x7f0f2803f060 2024-09-18T01:46:22.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.811+0000 7f0f2e8c1640 1 -- 172.21.15.146:0/1389318226 <== osd.2 v2:172.21.15.146:6800/3820039304 15 ==== watch-notify(notify (1) cookie 94283554232576 notify 141733920790 ret 0) ==== 790+0+0 (crc 0 0 0) 0x55c019c60620 con 0x7f0f2803f060 2024-09-18T01:46:22.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.811+0000 7f0e11ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920790 cookie 94283554232576 notifier 4740 bl.length()=748 2024-09-18T01:46:22.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.811+0000 7f0e11ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9 info.flags=0x17 2024-09-18T01:46:22.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.811+0000 7f0e11ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9 to cache LRU end 2024-09-18T01:46:22.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.811+0000 7f0e11ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-18T01:46:22.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.811+0000 7f0e11ffb640 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f0d64003530 con 0x7f0f2803f060 2024-09-18T01:46:22.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.811+0000 7f0f2e8c1640 1 -- 172.21.15.146:0/1389318226 <== osd.2 v2:172.21.15.146:6800/3820039304 16 ==== osd_op_reply(69 notify.0 [notify cookie 94283554483568 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0f20044d70 con 0x7f0f2803f060 2024-09-18T01:46:22.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.812+0000 7f0f2e8c1640 1 -- 172.21.15.146:0/1389318226 <== osd.2 v2:172.21.15.146:6800/3820039304 17 ==== osd_op_reply(70 notify.0 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f20044d70 con 0x7f0f2803f060 2024-09-18T01:46:22.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.812+0000 7f0f2e8c1640 1 -- 172.21.15.146:0/1389318226 <== osd.2 v2:172.21.15.146:6800/3820039304 18 ==== watch-notify(notify_complete (2) cookie 94283554483568 notify 141733920790 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c019c61f60 con 0x7f0f2803f060 2024-09-18T01:46:22.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.812+0000 7f0f33210800 20 handle_bi_update(): bucket=:myfoo6[8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9]): orig_sources= new_sources= 2024-09-18T01:46:22.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.812+0000 7f0f33210800 20 handle_bi_update(): bucket=:myfoo6[8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9]): potential sources added=[] removed=[] 2024-09-18T01:46:22.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.812+0000 7f0f33210800 20 handle_bi_update(): bucket=:myfoo6[8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9]): orig_dests= new_dests= 2024-09-18T01:46:22.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.812+0000 7f0f33210800 20 handle_bi_update(): bucket=:myfoo6[8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9]): potential dests added=[] removed=[] 2024-09-18T01:46:22.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.812+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:71 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c019c5ed70 con 0x55c019c16d40 2024-09-18T01:46:22.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.813+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(71 bud.buckets [call] v33'3 uv0 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f0f18057030 con 0x55c019c16d40 2024-09-18T01:46:22.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.813+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:72 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c019c5ed70 con 0x55c019c16d40 2024-09-18T01:46:22.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.814+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(72 bud.buckets [call] v33'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f0f18081040 con 0x55c019c16d40 2024-09-18T01:46:22.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.814+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:73 8.18 8:1944a257:root::myfoo6:head [delete,create,call version.inc in=38b,writefull 0~166 in=166b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c019c5ed70 con 0x55c019c16d40 2024-09-18T01:46:22.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.815+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(73 myfoo6 [delete,create,call,writefull 0~166] v33'17 uv17 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7f0f18081040 con 0x55c019c16d40 2024-09-18T01:46:22.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.815+0000 7f0f33210800 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-18T01:46:22.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.815+0000 7f0f33210800 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-18T01:46:22.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.815+0000 7f0f33210800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-18T01:46:22.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.815+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [notify cookie 94283554483568 in=328b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c019c63540 con 0x7f0f2803f060 2024-09-18T01:46:22.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.815+0000 7f0f2e8c1640 1 -- 172.21.15.146:0/1389318226 <== osd.2 v2:172.21.15.146:6800/3820039304 19 ==== watch-notify(notify (1) cookie 94283554244416 notify 141733920791 ret 0) ==== 358+0+0 (crc 0 0 0) 0x7f0f20054040 con 0x7f0f2803f060 2024-09-18T01:46:22.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.815+0000 7f0e127fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920791 cookie 94283554244416 notifier 4740 bl.length()=316 2024-09-18T01:46:22.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.815+0000 7f0e127fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-18T01:46:22.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.815+0000 7f0e127fc640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-18T01:46:22.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.815+0000 7f0e127fc640 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:75 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f0df4003ea0 con 0x7f0f2803f060 2024-09-18T01:46:22.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.815+0000 7f0f2e8c1640 1 -- 172.21.15.146:0/1389318226 <== osd.2 v2:172.21.15.146:6800/3820039304 20 ==== osd_op_reply(74 notify.3 [notify cookie 94283554483568 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0f20044d70 con 0x7f0f2803f060 2024-09-18T01:46:22.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.815+0000 7f0f2e8c1640 1 -- 172.21.15.146:0/1389318226 <== osd.2 v2:172.21.15.146:6800/3820039304 21 ==== watch-notify(notify_complete (2) cookie 94283554483568 notify 141733920791 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c019bdab40 con 0x7f0f2803f060 2024-09-18T01:46:22.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.815+0000 7f0f2e8c1640 1 -- 172.21.15.146:0/1389318226 <== osd.2 v2:172.21.15.146:6800/3820039304 22 ==== osd_op_reply(75 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f20044d70 con 0x7f0f2803f060 2024-09-18T01:46:22.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.815+0000 7f0f33210800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9 : hit (requested=0x17, cached=0x17) 2024-09-18T01:46:22.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.815+0000 7f0f33210800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9 2024-09-18T01:46:22.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.815+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:76 8.4 8:20837f84:root::.bucket.meta.myfoo6%3a8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~380 in=380b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c019c5fc30 con 0x7f0f2803f060 2024-09-18T01:46:22.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.816+0000 7f0f2e8c1640 1 -- 172.21.15.146:0/1389318226 <== osd.2 v2:172.21.15.146:6800/3820039304 23 ==== osd_op_reply(76 .bucket.meta.myfoo6:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9 [delete,create,call,call,writefull 0~380,setxattr (117)] v33'4 uv4 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7f0f20044d70 con 0x7f0f2803f060 2024-09-18T01:46:22.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.816+0000 7f0f33210800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9 info.flags=0x17 2024-09-18T01:46:22.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.816+0000 7f0f33210800 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9 to cache LRU end 2024-09-18T01:46:22.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.816+0000 7f0f33210800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-18T01:46:22.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.816+0000 7f0f33210800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9, ofs0, ns] 2024-09-18T01:46:22.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.816+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:77 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94283554484816 in=760b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c019c5fc00 con 0x7f0f2803f060 2024-09-18T01:46:22.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.817+0000 7f0f2e8c1640 1 -- 172.21.15.146:0/1389318226 <== osd.2 v2:172.21.15.146:6800/3820039304 24 ==== watch-notify(notify (1) cookie 94283554232576 notify 141733920792 ret 0) ==== 790+0+0 (crc 0 0 0) 0x55c019bdab40 con 0x7f0f2803f060 2024-09-18T01:46:22.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.817+0000 7f0e11ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920792 cookie 94283554232576 notifier 4740 bl.length()=748 2024-09-18T01:46:22.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.817+0000 7f0e11ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9 info.flags=0x17 2024-09-18T01:46:22.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.817+0000 7f0e11ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9 to cache LRU end 2024-09-18T01:46:22.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.817+0000 7f0e11ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-18T01:46:22.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.817+0000 7f0f2e8c1640 1 -- 172.21.15.146:0/1389318226 <== osd.2 v2:172.21.15.146:6800/3820039304 25 ==== osd_op_reply(77 notify.0 [notify cookie 94283554484816 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0f20044d70 con 0x7f0f2803f060 2024-09-18T01:46:22.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.817+0000 7f0e11ffb640 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f0d64003510 con 0x7f0f2803f060 2024-09-18T01:46:22.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.817+0000 7f0f2e8c1640 1 -- 172.21.15.146:0/1389318226 <== osd.2 v2:172.21.15.146:6800/3820039304 26 ==== osd_op_reply(78 notify.0 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f20044d70 con 0x7f0f2803f060 2024-09-18T01:46:22.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.817+0000 7f0f2e8c1640 1 -- 172.21.15.146:0/1389318226 <== osd.2 v2:172.21.15.146:6800/3820039304 27 ==== watch-notify(notify_complete (2) cookie 94283554484816 notify 141733920792 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c019bda620 con 0x7f0f2803f060 2024-09-18T01:46:22.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.817+0000 7f0f33210800 20 handle_bi_update(): bucket=:myfoo6[8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9]): orig_sources= new_sources= 2024-09-18T01:46:22.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.817+0000 7f0f33210800 20 handle_bi_update(): bucket=:myfoo6[8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9]): potential sources added=[] removed=[] 2024-09-18T01:46:22.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.817+0000 7f0f33210800 20 handle_bi_update(): bucket=:myfoo6[8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9]): orig_dests= new_dests= 2024-09-18T01:46:22.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.817+0000 7f0f33210800 20 handle_bi_update(): bucket=:myfoo6[8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9]): potential dests added=[] removed=[] 2024-09-18T01:46:22.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.817+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:79 4.9 4:90e93b08:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c019c5f6e0 con 0x55c019c16d40 2024-09-18T01:46:22.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.817+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(79 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0f18081040 con 0x55c019c16d40 2024-09-18T01:46:22.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.818+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:80 4.19 4:994d88dc:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c019c5f230 con 0x55c019c1cfb0 2024-09-18T01:46:22.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.818+0000 7f0f2f0c2640 1 -- 172.21.15.146:0/1389318226 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(80 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.1 [call out=85b] v0'0 uv13 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0f2803c030 con 0x55c019c1cfb0 2024-09-18T01:46:22.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.818+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:81 4.2c 4:347cbc36:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c019c5f230 con 0x55c019c16d40 2024-09-18T01:46:22.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.818+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== osd_op_reply(81 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0f18081040 con 0x55c019c16d40 2024-09-18T01:46:22.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.818+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:82 4.35 4:acd8b154:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c019c5f1f0 con 0x55c019c16d40 2024-09-18T01:46:22.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.818+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.1 v2:172.21.15.146:6808/3930274777 28 ==== osd_op_reply(82 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.3 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0f18081040 con 0x55c019c16d40 2024-09-18T01:46:22.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.818+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:83 4.3d 4:bf3e72b3:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c019c5f1f0 con 0x55c019c1cfb0 2024-09-18T01:46:22.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.819+0000 7f0f2f0c2640 1 -- 172.21.15.146:0/1389318226 <== osd.3 v2:172.21.15.146:6809/4106661138 15 ==== osd_op_reply(83 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0f2803c030 con 0x55c019c1cfb0 2024-09-18T01:46:22.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.819+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:84 4.25 4:a595c840:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c019c5f1f0 con 0x55c019c1cfb0 2024-09-18T01:46:22.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.819+0000 7f0f2f0c2640 1 -- 172.21.15.146:0/1389318226 <== osd.3 v2:172.21.15.146:6809/4106661138 16 ==== osd_op_reply(84 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0f2803c030 con 0x55c019c1cfb0 2024-09-18T01:46:22.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.819+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:85 4.2b 4:d684112f:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c019c5f1f0 con 0x55c019c16d40 2024-09-18T01:46:22.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.819+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.1 v2:172.21.15.146:6808/3930274777 29 ==== osd_op_reply(85 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0f18081040 con 0x55c019c16d40 2024-09-18T01:46:22.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.819+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:86 4.1 4:815be0e8:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c019c5f1f0 con 0x7f0f2803f060 2024-09-18T01:46:22.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.820+0000 7f0f2e8c1640 1 -- 172.21.15.146:0/1389318226 <== osd.2 v2:172.21.15.146:6800/3820039304 28 ==== osd_op_reply(86 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.7 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0f20044d70 con 0x7f0f2803f060 2024-09-18T01:46:22.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.820+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:87 4.2c 4:36355ce0:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c019c5f1f0 con 0x55c019c16d40 2024-09-18T01:46:22.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.820+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.1 v2:172.21.15.146:6808/3930274777 30 ==== osd_op_reply(87 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.8 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0f1808a040 con 0x55c019c16d40 2024-09-18T01:46:22.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.820+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:88 4.35 4:acafbc8a:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c019c5f1f0 con 0x55c019c16d40 2024-09-18T01:46:22.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.820+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.1 v2:172.21.15.146:6808/3930274777 31 ==== osd_op_reply(88 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.9 [call out=377b] v0'0 uv8 ondisk = 0) ==== 194+0+377 (crc 0 0 0) 0x7f0f1808a040 con 0x55c019c16d40 2024-09-18T01:46:22.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.820+0000 7f0f33210800 10 cls_bucket_list_unordered: got thirteen 2024-09-18T01:46:22.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.820+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:89 4.d 4:b24c95ca:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c019c5f1f0 con 0x55c019c1cfb0 2024-09-18T01:46:22.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.821+0000 7f0f2f0c2640 1 -- 172.21.15.146:0/1389318226 <== osd.3 v2:172.21.15.146:6809/4106661138 17 ==== osd_op_reply(89 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f0f2803c030 con 0x55c019c1cfb0 2024-09-18T01:46:22.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.821+0000 7f0f33210800 20 get_obj_state: octx=0x55c019c61d80 obj=myfoo6:thirteen state=0x55c019c68cc8 s->prefetch_data=0 2024-09-18T01:46:22.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.821+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:90 3.3ds0 3:bdef5186:::8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c019c5fbc0 con 0x55c019c1cfb0 2024-09-18T01:46:22.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.821+0000 7f0f2f0c2640 1 -- 172.21.15.146:0/1389318226 <== osd.3 v2:172.21.15.146:6809/4106661138 18 ==== osd_op_reply(90 8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9_thirteen [getxattrs out=854b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 238+0+870 (crc 0 0 0) 0x7f0f2806f040 con 0x55c019c1cfb0 2024-09-18T01:46:22.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.821+0000 7f0f33210800 10 manifest: total_size = 8 2024-09-18T01:46:22.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.821+0000 7f0f33210800 20 get_obj_state: setting s->obj_tag to 8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.6383027659352919286 2024-09-18T01:46:22.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.821+0000 7f0f33210800 20 Read xattr rgw_rados: user.rgw.acl 2024-09-18T01:46:22.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.821+0000 7f0f33210800 20 Read xattr rgw_rados: user.rgw.content_type 2024-09-18T01:46:22.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.821+0000 7f0f33210800 20 Read xattr rgw_rados: user.rgw.etag 2024-09-18T01:46:22.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.821+0000 7f0f33210800 20 Read xattr rgw_rados: user.rgw.idtag 2024-09-18T01:46:22.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.821+0000 7f0f33210800 20 Read xattr rgw_rados: user.rgw.manifest 2024-09-18T01:46:22.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.821+0000 7f0f33210800 20 Read xattr rgw_rados: user.rgw.pg_ver 2024-09-18T01:46:22.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.821+0000 7f0f33210800 20 Read xattr rgw_rados: user.rgw.source_zone 2024-09-18T01:46:22.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.821+0000 7f0f33210800 20 Read xattr rgw_rados: user.rgw.tail_tag 2024-09-18T01:46:22.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.821+0000 7f0f33210800 20 get_obj_state: octx=0x55c019c61d80 obj=myfoo6:thirteen state=0x55c019c68cc8 s->prefetch_data=0 2024-09-18T01:46:22.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.821+0000 7f0f33210800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9 : hit (requested=0x17, cached=0x17) 2024-09-18T01:46:22.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.821+0000 7f0f33210800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9 2024-09-18T01:46:22.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.821+0000 7f0f33210800 20 bucket index object: :.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.9 2024-09-18T01:46:22.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.821+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:91 4.35 4:acafbc8a:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c019c5f610 con 0x55c019c16d40 2024-09-18T01:46:22.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.822+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.1 v2:172.21.15.146:6808/3930274777 32 ==== osd_op_reply(91 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.9 [stat,call,call] v33'9 uv9 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f0f1808a040 con 0x55c019c16d40 2024-09-18T01:46:22.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.822+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:92 3.3ds0 3:bdef5186:::8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9_thirteen:head [cmpxattr user.rgw.idtag (62) op 1 mode 1 in=76b,setxattr user.rgw.acl (117) in=129b,setxattr user.rgw.idtag (33) in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c019c6b990 con 0x55c019c1cfb0 2024-09-18T01:46:22.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.824+0000 7f0f2f0c2640 1 -- 172.21.15.146:0/1389318226 <== osd.3 v2:172.21.15.146:6809/4106661138 19 ==== osd_op_reply(92 8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9_thirteen [cmpxattr (62) op 1 mode 1,setxattr (117),setxattr (33)] v33'2 uv2 ondisk = 0) ==== 280+0+0 (crc 0 0 0) 0x7f0f2806f040 con 0x55c019c1cfb0 2024-09-18T01:46:22.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.824+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:93 4.35 4:acafbc8a:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=323b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c019c6d220 con 0x55c019c16d40 2024-09-18T01:46:22.839 INFO:teuthology.orchestra.run.smithi146.stderr:1 objects processed in :myfoo6[8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9]). Next marker thirteen 2024-09-18T01:46:22.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.824+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c019c6d220 con 0x7f0f2803f060 2024-09-18T01:46:22.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.825+0000 7f0f2e8c1640 1 -- 172.21.15.146:0/1389318226 <== osd.2 v2:172.21.15.146:6800/3820039304 29 ==== osd_op_reply(94 bud [delete,create,call,writefull 0~380] v33'5 uv5 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f0f20044d70 con 0x7f0f2803f060 2024-09-18T01:46:22.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.825+0000 7f0f33210800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-18T01:46:22.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.825+0000 7f0f33210800 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-18T01:46:22.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.825+0000 7f0f33210800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-18T01:46:22.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.825+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [notify cookie 94283554518864 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c019c6d220 con 0x7f0f200187f0 2024-09-18T01:46:22.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.825+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.0 v2:172.21.15.129:6800/1759265424 22 ==== watch-notify(notify (1) cookie 94283554252112 notify 141733920800 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55c019c6a420 con 0x7f0f200187f0 2024-09-18T01:46:22.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.825+0000 7f0e127fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920800 cookie 94283554252112 notifier 4740 bl.length()=556 2024-09-18T01:46:22.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.825+0000 7f0e127fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-18T01:46:22.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.825+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.1 v2:172.21.15.146:6808/3930274777 33 ==== osd_op_reply(93 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.9 [stat,call,call] v33'10 uv10 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f0f1808a040 con 0x55c019c16d40 2024-09-18T01:46:22.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.825+0000 7f0e127fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-18T01:46:22.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.825+0000 7f0e127fc640 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:96 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f0df4003ea0 con 0x7f0f200187f0 2024-09-18T01:46:22.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.825+0000 7f0e127fc640 20 handle_completion(): completion ok for obj=thirteen 2024-09-18T01:46:22.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.825+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.0 v2:172.21.15.129:6800/1759265424 23 ==== osd_op_reply(95 notify.5 [notify cookie 94283554518864 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0f1808a040 con 0x7f0f200187f0 2024-09-18T01:46:22.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.826+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.0 v2:172.21.15.129:6800/1759265424 24 ==== osd_op_reply(96 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f1808a040 con 0x7f0f200187f0 2024-09-18T01:46:22.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.826+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.0 v2:172.21.15.129:6800/1759265424 25 ==== watch-notify(notify_complete (2) cookie 94283554518864 notify 141733920800 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c019c67580 con 0x7f0f200187f0 2024-09-18T01:46:22.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.826+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:97 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c019c62aa0 con 0x55c019c16d40 2024-09-18T01:46:22.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.827+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.1 v2:172.21.15.146:6808/3930274777 34 ==== osd_op_reply(97 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v33'2 uv2 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f0f1808a040 con 0x55c019c16d40 2024-09-18T01:46:22.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.827+0000 7f0f33210800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-18T01:46:22.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.827+0000 7f0f33210800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-18T01:46:22.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.827+0000 7f0f33210800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-18T01:46:22.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.827+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify cookie 94283554521488 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c019c62aa0 con 0x7f0f200187f0 2024-09-18T01:46:22.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.828+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.0 v2:172.21.15.129:6800/1759265424 26 ==== watch-notify(notify (1) cookie 94283554252112 notify 141733920801 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55c019c67580 con 0x7f0f200187f0 2024-09-18T01:46:22.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.828+0000 7f0e11ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920801 cookie 94283554252112 notifier 4740 bl.length()=177 2024-09-18T01:46:22.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.828+0000 7f0e11ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-18T01:46:22.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.828+0000 7f0e11ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-18T01:46:22.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.828+0000 7f0e11ffb640 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:99 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f0d64003540 con 0x7f0f200187f0 2024-09-18T01:46:22.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.828+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.0 v2:172.21.15.129:6800/1759265424 27 ==== osd_op_reply(98 notify.5 [notify cookie 94283554521488 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0f1808a040 con 0x7f0f200187f0 2024-09-18T01:46:22.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.828+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.0 v2:172.21.15.129:6800/1759265424 28 ==== osd_op_reply(99 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f1808a040 con 0x7f0f200187f0 2024-09-18T01:46:22.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.828+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.0 v2:172.21.15.129:6800/1759265424 29 ==== watch-notify(notify_complete (2) cookie 94283554521488 notify 141733920801 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c0199aae00 con 0x7f0f200187f0 2024-09-18T01:46:22.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.828+0000 7f0f33210800 10 removing user index: bar 2024-09-18T01:46:22.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.828+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:100 8.e 8:718f6a54:users.uid::bar:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c019c67750 con 0x7f0f200187f0 2024-09-18T01:46:22.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.829+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.0 v2:172.21.15.129:6800/1759265424 30 ==== osd_op_reply(100 bar [delete] v33'8 uv8 ondisk = 0) ==== 147+0+0 (crc 0 0 0) 0x7f0f1808a040 con 0x7f0f200187f0 2024-09-18T01:46:22.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.829+0000 7f0f33210800 10 removing default.rgw.meta+users.uid+bar from cache 2024-09-18T01:46:22.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.829+0000 7f0f33210800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-18T01:46:22.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.829+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:101 7.9 7:93e5b521:::notify.7:head [notify cookie 94283554521488 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c019c62aa0 con 0x7f0f200187f0 2024-09-18T01:46:22.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.829+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.0 v2:172.21.15.129:6800/1759265424 31 ==== watch-notify(notify (1) cookie 94283554254816 notify 141733920802 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55c0199aae00 con 0x7f0f200187f0 2024-09-18T01:46:22.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.829+0000 7f0e127fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920802 cookie 94283554254816 notifier 4740 bl.length()=152 2024-09-18T01:46:22.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.829+0000 7f0e127fc640 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f0df4003ea0 con 0x7f0f200187f0 2024-09-18T01:46:22.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.829+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.0 v2:172.21.15.129:6800/1759265424 32 ==== osd_op_reply(101 notify.7 [notify cookie 94283554521488 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0f1808a040 con 0x7f0f200187f0 2024-09-18T01:46:22.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.829+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.0 v2:172.21.15.129:6800/1759265424 33 ==== osd_op_reply(102 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f1808a040 con 0x7f0f200187f0 2024-09-18T01:46:22.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.830+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.0 v2:172.21.15.129:6800/1759265424 34 ==== watch-notify(notify_complete (2) cookie 94283554521488 notify 141733920802 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f0f1808d590 con 0x7f0f200187f0 2024-09-18T01:46:22.842 INFO:teuthology.orchestra.run.smithi146.stdout:{"user_id":"bud","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bud","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-09-18T01:46:22.657471Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:46:22.657461Z","tags":[],"group_ids":[]} 2024-09-18T01:46:22.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.830+0000 7f0de57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:46:22.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.830+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94283554256512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c019c5be00 con 0x55c019c16d40 2024-09-18T01:46:22.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.831+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.1 v2:172.21.15.146:6808/3930274777 35 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94283554256512] v33'219 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0f1808a040 con 0x55c019c16d40 2024-09-18T01:46:22.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.831+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94283554232576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c019c5be00 con 0x7f0f2803f060 2024-09-18T01:46:22.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.832+0000 7f0f2e8c1640 1 -- 172.21.15.146:0/1389318226 <== osd.2 v2:172.21.15.146:6800/3820039304 30 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94283554232576] v33'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f20044d70 con 0x7f0f2803f060 2024-09-18T01:46:22.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.832+0000 7f0f33210800 20 remove_watcher() i=0 2024-09-18T01:46:22.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.832+0000 7f0f33210800 2 removed watcher, disabling cache 2024-09-18T01:46:22.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.832+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94283554236848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c019c5be00 con 0x55c019c16d40 2024-09-18T01:46:22.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.833+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.1 v2:172.21.15.146:6808/3930274777 36 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94283554236848] v33'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f1808a040 con 0x55c019c16d40 2024-09-18T01:46:22.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.834+0000 7f0f33210800 20 remove_watcher() i=1 2024-09-18T01:46:22.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.834+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94283554241712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c019c5be00 con 0x55c019c1cfb0 2024-09-18T01:46:22.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.835+0000 7f0f2f0c2640 1 -- 172.21.15.146:0/1389318226 <== osd.3 v2:172.21.15.146:6809/4106661138 20 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94283554241712] v33'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f2806f040 con 0x55c019c1cfb0 2024-09-18T01:46:22.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.835+0000 7f0f33210800 20 remove_watcher() i=2 2024-09-18T01:46:22.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.835+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94283554244416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c019c5be00 con 0x7f0f2803f060 2024-09-18T01:46:22.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.836+0000 7f0f2e8c1640 1 -- 172.21.15.146:0/1389318226 <== osd.2 v2:172.21.15.146:6800/3820039304 31 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94283554244416] v33'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f20044d70 con 0x7f0f2803f060 2024-09-18T01:46:22.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.836+0000 7f0f33210800 20 remove_watcher() i=3 2024-09-18T01:46:22.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.836+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94283554249472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c019c5be00 con 0x55c019c16d40 2024-09-18T01:46:22.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.837+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.1 v2:172.21.15.146:6808/3930274777 37 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94283554249472] v33'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f1808a040 con 0x55c019c16d40 2024-09-18T01:46:22.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.837+0000 7f0f33210800 20 remove_watcher() i=4 2024-09-18T01:46:22.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.837+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94283554252112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c019c5be00 con 0x7f0f200187f0 2024-09-18T01:46:22.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.838+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.0 v2:172.21.15.129:6800/1759265424 35 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94283554252112] v33'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f1808a040 con 0x7f0f200187f0 2024-09-18T01:46:22.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.838+0000 7f0f33210800 20 remove_watcher() i=5 2024-09-18T01:46:22.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.838+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94283554246752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c019c5be00 con 0x7f0f200187f0 2024-09-18T01:46:22.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.839+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.0 v2:172.21.15.129:6800/1759265424 36 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94283554246752] v33'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f1808a040 con 0x7f0f200187f0 2024-09-18T01:46:22.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.839+0000 7f0f33210800 20 remove_watcher() i=6 2024-09-18T01:46:22.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.839+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94283554254816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c019c5be00 con 0x7f0f200187f0 2024-09-18T01:46:22.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.840+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 <== osd.0 v2:172.21.15.129:6800/1759265424 37 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94283554254816] v33'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f1808a040 con 0x7f0f200187f0 2024-09-18T01:46:22.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.840+0000 7f0f33210800 20 remove_watcher() i=7 2024-09-18T01:46:22.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.840+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f0f200187f0 msgr2=0x7f0f2001c610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.840+0000 7f0f33210800 1 --2- 172.21.15.146:0/1389318226 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f0f200187f0 0x7f0f2001c610 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.840+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55c019c16d40 msgr2=0x55c019c19200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.840+0000 7f0f33210800 1 --2- 172.21.15.146:0/1389318226 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55c019c16d40 0x55c019c19200 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.840+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f0f2803f060 msgr2=0x7f0f28022a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.840+0000 7f0f33210800 1 --2- 172.21.15.146:0/1389318226 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f0f2803f060 0x7f0f28022a90 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.840+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55c019c1cfb0 msgr2=0x55c019c1f3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.840+0000 7f0f33210800 1 --2- 172.21.15.146:0/1389318226 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55c019c1cfb0 0x55c019c1f3a0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.840+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0df8036b40 msgr2=0x7f0df8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.840+0000 7f0f33210800 1 --2- 172.21.15.146:0/1389318226 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0df8036b40 0x7f0df8039000 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0f2004b7a0 tx=0x7f0f20033000 comp rx=0 tx=0).stop 2024-09-18T01:46:22.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.840+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c019c03bf0 msgr2=0x55c019c0b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.840+0000 7f0f260c0640 1 -- 172.21.15.146:0/1389318226 reap_dead start 2024-09-18T01:46:22.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.840+0000 7f0f33210800 1 --2- 172.21.15.146:0/1389318226 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c019c03bf0 0x55c019c0b080 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f0f280127e0 tx=0x7f0f2804c820 comp rx=0 tx=0).stop 2024-09-18T01:46:22.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.840+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 shutdown_connections 2024-09-18T01:46:22.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.841+0000 7f0f33210800 1 --2- 172.21.15.146:0/1389318226 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c019c03bf0 0x55c019c0b080 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.841+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 >> 172.21.15.146:0/1389318226 conn(0x55c019bfffa0 msgr2=0x55c019bfe070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:22.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.841+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 shutdown_connections 2024-09-18T01:46:22.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.841+0000 7f0f33210800 1 -- 172.21.15.146:0/1389318226 wait complete. 2024-09-18T01:46:22.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.841+0000 7f0f33210800 1 -- 172.21.15.146:0/2824159944 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0e08036b90 msgr2=0x7f0e08039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.841+0000 7f0f33210800 1 --2- 172.21.15.146:0/2824159944 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0e08036b90 0x7f0e08039050 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x55c019be2920 tx=0x7f0f2004b670 comp rx=0 tx=0).stop 2024-09-18T01:46:22.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.841+0000 7f0f33210800 1 -- 172.21.15.146:0/2824159944 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c019bd2d20 msgr2=0x55c019bd1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.841+0000 7f0f33210800 1 --2- 172.21.15.146:0/2824159944 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c019bd2d20 0x55c019bd1370 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x55c019be1a20 tx=0x7f0f280178e0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.841+0000 7f0f33210800 1 -- 172.21.15.146:0/2824159944 shutdown_connections 2024-09-18T01:46:22.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.841+0000 7f0f33210800 1 --2- 172.21.15.146:0/2824159944 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0e08036b90 0x7f0e08039050 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.841+0000 7f0f33210800 1 --2- 172.21.15.146:0/2824159944 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c019bd2d20 0x55c019bd1370 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.841+0000 7f0f33210800 1 -- 172.21.15.146:0/2824159944 >> 172.21.15.146:0/2824159944 conn(0x55c019be9d50 msgr2=0x55c019bec8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:22.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.841+0000 7f0f33210800 1 -- 172.21.15.146:0/2824159944 shutdown_connections 2024-09-18T01:46:22.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.841+0000 7f0f33210800 1 -- 172.21.15.146:0/2824159944 wait complete. 2024-09-18T01:46:22.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.841+0000 7f0f33210800 1 -- 172.21.15.146:0/579348914 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55c019ae6920 msgr2=0x55c019be1100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.841+0000 7f0f33210800 1 --2- 172.21.15.146:0/579348914 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55c019ae6920 0x55c019be1100 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.841+0000 7f0f33210800 1 -- 172.21.15.146:0/579348914 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55c019be3020 msgr2=0x55c019be6880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.841+0000 7f0f33210800 1 --2- 172.21.15.146:0/579348914 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55c019be3020 0x55c019be6880 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.841+0000 7f0f33210800 1 -- 172.21.15.146:0/579348914 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0e14036b40 msgr2=0x7f0e14039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.841+0000 7f0f33210800 1 --2- 172.21.15.146:0/579348914 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0e14036b40 0x7f0e14039000 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0f18057000 tx=0x7f0f18052000 comp rx=0 tx=0).stop 2024-09-18T01:46:22.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.841+0000 7f0f33210800 1 -- 172.21.15.146:0/579348914 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c019ae24e0 msgr2=0x55c019bda0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:22.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.841+0000 7f0f33210800 1 --2- 172.21.15.146:0/579348914 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c019ae24e0 0x55c019bda0e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x55c019a56cc0 tx=0x7f0f20000ed0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.841+0000 7f0f33210800 1 -- 172.21.15.146:0/579348914 shutdown_connections 2024-09-18T01:46:22.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.841+0000 7f0f33210800 1 --2- 172.21.15.146:0/579348914 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55c019be3020 0x55c019be6880 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.841+0000 7f0f33210800 1 --2- 172.21.15.146:0/579348914 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55c019ae6920 0x55c019be1100 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.841+0000 7f0f33210800 1 --2- 172.21.15.146:0/579348914 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0e14036b40 0x7f0e14039000 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.841+0000 7f0f33210800 1 --2- 172.21.15.146:0/579348914 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c019ae24e0 0x55c019bda0e0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:22.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.841+0000 7f0f33210800 1 -- 172.21.15.146:0/579348914 >> 172.21.15.146:0/579348914 conn(0x55c019adddb0 msgr2=0x55c019bcb830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:22.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.842+0000 7f0f33210800 1 -- 172.21.15.146:0/579348914 shutdown_connections 2024-09-18T01:46:22.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:22.842+0000 7f0f33210800 1 -- 172.21.15.146:0/579348914 wait complete. 2024-09-18T01:46:22.854 DEBUG:tasks.util.rgw: json result: {'user_id': 'bud', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bud', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-09-18T01:46:22.657471Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:46:22.657461Z', 'tags': [], 'group_ids': []} 2024-09-18T01:46:27.863 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-18T01:46:27.863 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-18T01:46:27.863 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-18T01:46:27.863 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-18T01:46:27.864 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 4 2024-09-18T01:46:27.923 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:46:27.923 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:46:27.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.924+0000 7f68ce432800 1 Processor -- start 2024-09-18T01:46:27.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.924+0000 7f68ce432800 1 -- start start 2024-09-18T01:46:27.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.924+0000 7f68ce432800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x559f5408faa0 0x559f54091e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:27.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.924+0000 7f68ce432800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559f53f4ab30 con 0x559f5408b7a0 2024-09-18T01:46:27.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.924+0000 7f68ce432800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x559f53f2c360 con 0x559f5408faa0 2024-09-18T01:46:27.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.924+0000 7f68c8e72640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x559f5408faa0 0x559f54091e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:27.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.924+0000 7f68c8e72640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x559f5408faa0 0x559f54091e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:55748/0 (socket says 172.21.15.146:55748) 2024-09-18T01:46:27.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.924+0000 7f68c8e72640 1 -- 172.21.15.146:0/426784436 learned_addr learned my addr 172.21.15.146:0/426784436 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:27.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.924+0000 7f68c9673640 1 --1- 172.21.15.146:0/426784436 >> v1:172.21.15.129:6789/0 conn(0x559f5408b7a0 0x559f5408bba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:49422/0 (socket says 172.21.15.146:49422) 2024-09-18T01:46:27.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.925+0000 7f68c8e72640 1 -- 172.21.15.146:0/426784436 >> v1:172.21.15.129:6789/0 conn(0x559f5408b7a0 legacy=0x559f5408bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:27.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.925+0000 7f68c8e72640 1 -- 172.21.15.146:0/426784436 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f53f52e00 con 0x559f5408faa0 2024-09-18T01:46:27.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.926+0000 7f68c8e72640 1 --2- 172.21.15.146:0/426784436 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559f5408faa0 0x559f54091e90 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f68c000a520 tx=0x7f68c0045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c75e6b58f29942 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:27.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.927+0000 7f68bbfff640 1 -- 172.21.15.146:0/426784436 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68c0055070 con 0x559f5408faa0 2024-09-18T01:46:27.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.927+0000 7f68bbfff640 1 -- 172.21.15.146:0/426784436 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68c00515b0 con 0x559f5408faa0 2024-09-18T01:46:27.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.927+0000 7f68bbfff640 1 -- 172.21.15.146:0/426784436 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68c00518d0 con 0x559f5408faa0 2024-09-18T01:46:27.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.927+0000 7f68ce432800 1 -- 172.21.15.146:0/426784436 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559f5408faa0 msgr2=0x559f54091e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:27.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.927+0000 7f68ce432800 1 --2- 172.21.15.146:0/426784436 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559f5408faa0 0x559f54091e90 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f68c000a520 tx=0x7f68c0045ba0 comp rx=0 tx=0).stop 2024-09-18T01:46:27.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.927+0000 7f68ce432800 1 -- 172.21.15.146:0/426784436 shutdown_connections 2024-09-18T01:46:27.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.927+0000 7f68ce432800 1 --2- 172.21.15.146:0/426784436 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559f5408faa0 0x559f54091e90 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:27.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.927+0000 7f68ce432800 1 -- 172.21.15.146:0/426784436 >> 172.21.15.146:0/426784436 conn(0x559f54087030 msgr2=0x559f54089450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:27.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.927+0000 7f68ce432800 1 -- 172.21.15.146:0/426784436 shutdown_connections 2024-09-18T01:46:27.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.927+0000 7f68ce432800 1 -- 172.21.15.146:0/426784436 wait complete. 2024-09-18T01:46:27.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.943+0000 7f68ce432800 1 Processor -- start 2024-09-18T01:46:27.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.943+0000 7f68ce432800 1 -- start start 2024-09-18T01:46:27.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.943+0000 7f68ce432800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559f5408b7a0 0x559f54001700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:27.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.943+0000 7f68ce432800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x559f53fd7370 con 0x559f5408b7a0 2024-09-18T01:46:27.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.943+0000 7f68c9673640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559f5408b7a0 0x559f54001700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:27.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.943+0000 7f68c9673640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559f5408b7a0 0x559f54001700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:55764/0 (socket says 172.21.15.146:55764) 2024-09-18T01:46:27.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.943+0000 7f68c9673640 1 -- 172.21.15.146:0/4257103476 learned_addr learned my addr 172.21.15.146:0/4257103476 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:27.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.944+0000 7f68c9673640 1 -- 172.21.15.146:0/4257103476 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f53f24bc0 con 0x559f5408b7a0 2024-09-18T01:46:27.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.944+0000 7f68c9673640 1 --2- 172.21.15.146:0/4257103476 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559f5408b7a0 0x559f54001700 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f68bc001650 tx=0x7f68bc001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b56ec03e9e6654dc server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:27.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.944+0000 7f67b7606640 1 -- 172.21.15.146:0/4257103476 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68bc013420 con 0x559f5408b7a0 2024-09-18T01:46:27.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.944+0000 7f67b7606640 1 -- 172.21.15.146:0/4257103476 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68bc0135c0 con 0x559f5408b7a0 2024-09-18T01:46:27.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.944+0000 7f67b7606640 1 -- 172.21.15.146:0/4257103476 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68bc0138c0 con 0x559f5408b7a0 2024-09-18T01:46:27.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.945+0000 7f68ce432800 1 -- 172.21.15.146:0/4257103476 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559f5408b7a0 msgr2=0x559f54001700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:27.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.945+0000 7f68ce432800 1 --2- 172.21.15.146:0/4257103476 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559f5408b7a0 0x559f54001700 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f68bc001650 tx=0x7f68bc001b10 comp rx=0 tx=0).stop 2024-09-18T01:46:27.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.945+0000 7f68ce432800 1 -- 172.21.15.146:0/4257103476 shutdown_connections 2024-09-18T01:46:27.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.945+0000 7f68ce432800 1 --2- 172.21.15.146:0/4257103476 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559f5408b7a0 0x559f54001700 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:27.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.945+0000 7f68ce432800 1 -- 172.21.15.146:0/4257103476 >> 172.21.15.146:0/4257103476 conn(0x559f54087030 msgr2=0x559f54176320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:27.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.945+0000 7f68ce432800 1 -- 172.21.15.146:0/4257103476 shutdown_connections 2024-09-18T01:46:27.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.945+0000 7f68ce432800 1 -- 172.21.15.146:0/4257103476 wait complete. 2024-09-18T01:46:27.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.945+0000 7f68ce432800 1 Processor -- start 2024-09-18T01:46:27.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.945+0000 7f68ce432800 1 -- start start 2024-09-18T01:46:27.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.945+0000 7f68ce432800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559f5408faa0 0x559f541847b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:27.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.945+0000 7f68ce432800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x559f540926d0 con 0x559f5408faa0 2024-09-18T01:46:27.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.946+0000 7f68c9673640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559f5408faa0 0x559f541847b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:27.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.946+0000 7f68c9673640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559f5408faa0 0x559f541847b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:55778/0 (socket says 172.21.15.146:55778) 2024-09-18T01:46:27.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.946+0000 7f68c9673640 1 -- 172.21.15.146:0/1195916838 learned_addr learned my addr 172.21.15.146:0/1195916838 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:27.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.946+0000 7f68c9673640 1 -- 172.21.15.146:0/1195916838 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f53f38fe0 con 0x559f5408faa0 2024-09-18T01:46:27.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.946+0000 7f68c9673640 1 --2- 172.21.15.146:0/1195916838 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559f5408faa0 0x559f541847b0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x559f54000e00 tx=0x7f68bc001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:27.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.946+0000 7f67b5e03640 1 -- 172.21.15.146:0/1195916838 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68bc022020 con 0x559f5408faa0 2024-09-18T01:46:27.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.946+0000 7f67b5e03640 1 -- 172.21.15.146:0/1195916838 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68bc006830 con 0x559f5408faa0 2024-09-18T01:46:27.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.946+0000 7f67b5e03640 1 -- 172.21.15.146:0/1195916838 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68bc004a90 con 0x559f5408faa0 2024-09-18T01:46:27.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.946+0000 7f68ce432800 1 -- 172.21.15.146:0/1195916838 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559f54184cf0 con 0x559f5408faa0 2024-09-18T01:46:27.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.946+0000 7f68ce432800 1 -- 172.21.15.146:0/1195916838 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f54185210 con 0x559f5408faa0 2024-09-18T01:46:27.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.947+0000 7f67b5e03640 1 -- 172.21.15.146:0/1195916838 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f68bc025020 con 0x559f5408faa0 2024-09-18T01:46:27.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.947+0000 7f67b5e03640 1 --2- 172.21.15.146:0/1195916838 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f67b0036b40 0x7f67b0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:27.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.948+0000 7f67b5e03640 1 -- 172.21.15.146:0/1195916838 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f68bc018030 con 0x559f5408faa0 2024-09-18T01:46:27.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.948+0000 7f68c8e72640 1 --2- 172.21.15.146:0/1195916838 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f67b0036b40 0x7f67b0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:27.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.948+0000 7f68ce432800 1 --2- 172.21.15.146:0/1195916838 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559f54189810 0x559f5418bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:27.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.948+0000 7f68ce432800 1 -- 172.21.15.146:0/1195916838 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559f5418c140 con 0x559f54189810 2024-09-18T01:46:27.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.948+0000 7f68c9e74640 1 --2- 172.21.15.146:0/1195916838 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559f54189810 0x559f5418bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:27.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.948+0000 7f68c8e72640 1 --2- 172.21.15.146:0/1195916838 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f67b0036b40 0x7f67b0039000 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f68c0057000 tx=0x7f68c0052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:27.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.948+0000 7f68c9e74640 1 --2- 172.21.15.146:0/1195916838 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559f54189810 0x559f5418bc00 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:27.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.948+0000 7f68c9e74640 1 -- 172.21.15.146:0/1195916838 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f68c40083e0 con 0x559f54189810 2024-09-18T01:46:27.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.949+0000 7f68ce432800 1 -- 172.21.15.146:0/1195916838 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559f54188dd0 con 0x559f54189810 2024-09-18T01:46:27.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.949+0000 7f68c9e74640 1 -- 172.21.15.146:0/1195916838 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f68c40083e0 con 0x559f54189810 2024-09-18T01:46:27.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.949+0000 7f68ce432800 1 -- 172.21.15.146:0/1195916838 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559f5418df20 con 0x559f54189810 2024-09-18T01:46:27.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.949+0000 7f68c9e74640 1 -- 172.21.15.146:0/1195916838 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f68c40083e0 con 0x559f54189810 2024-09-18T01:46:27.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.949+0000 7f68ce432800 1 -- 172.21.15.146:0/1195916838 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559f5418d150 con 0x559f54189810 2024-09-18T01:46:27.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.949+0000 7f68c9e74640 1 -- 172.21.15.146:0/1195916838 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f68c40083e0 con 0x559f54189810 2024-09-18T01:46:27.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.949+0000 7f68ce432800 1 --2- 172.21.15.146:0/1195916838 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x559f5418f2d0 0x559f541916c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:27.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.949+0000 7f68ce432800 1 -- 172.21.15.146:0/1195916838 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559f54191c00 con 0x559f5418f2d0 2024-09-18T01:46:27.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.950+0000 7f68c9673640 1 --2- 172.21.15.146:0/1195916838 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x559f5418f2d0 0x559f541916c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:27.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.950+0000 7f68c9673640 1 --2- 172.21.15.146:0/1195916838 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x559f5418f2d0 0x559f541916c0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:27.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.950+0000 7f68c9673640 1 -- 172.21.15.146:0/1195916838 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f68bc01b070 con 0x559f5418f2d0 2024-09-18T01:46:27.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.950+0000 7f68ce432800 1 Processor -- start 2024-09-18T01:46:27.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.951+0000 7f68ce432800 1 -- start start 2024-09-18T01:46:27.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.951+0000 7f68ce432800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559f5419f8c0 0x559f5419fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:27.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.951+0000 7f68ce432800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x559f53f26580 con 0x559f5419f8c0 2024-09-18T01:46:27.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.951+0000 7f68c9e74640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559f5419f8c0 0x559f5419fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:27.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.951+0000 7f68c9e74640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559f5419f8c0 0x559f5419fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:55780/0 (socket says 172.21.15.146:55780) 2024-09-18T01:46:27.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.951+0000 7f68c9e74640 1 -- 172.21.15.146:0/347513156 learned_addr learned my addr 172.21.15.146:0/347513156 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:27.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.951+0000 7f68c9e74640 1 -- 172.21.15.146:0/347513156 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f541a0220 con 0x559f5419f8c0 2024-09-18T01:46:27.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.952+0000 7f68c9e74640 1 --2- 172.21.15.146:0/347513156 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559f5419f8c0 0x559f5419fce0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x559f54185bb0 tx=0x7f68c400ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:27.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.952+0000 7f67aeffd640 1 -- 172.21.15.146:0/347513156 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68c401c070 con 0x559f5419f8c0 2024-09-18T01:46:27.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.952+0000 7f67aeffd640 1 -- 172.21.15.146:0/347513156 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68c400bdc0 con 0x559f5419f8c0 2024-09-18T01:46:27.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.952+0000 7f67aeffd640 1 -- 172.21.15.146:0/347513156 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68c4018540 con 0x559f5419f8c0 2024-09-18T01:46:27.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.952+0000 7f68ce432800 1 -- 172.21.15.146:0/347513156 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559f541a04b0 con 0x559f5419f8c0 2024-09-18T01:46:27.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.952+0000 7f68ce432800 1 -- 172.21.15.146:0/347513156 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f541a3190 con 0x559f5419f8c0 2024-09-18T01:46:27.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.953+0000 7f67aeffd640 1 -- 172.21.15.146:0/347513156 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f68c401f070 con 0x559f5419f8c0 2024-09-18T01:46:27.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.953+0000 7f67aeffd640 1 --2- 172.21.15.146:0/347513156 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f67a4036b40 0x7f67a4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:27.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.953+0000 7f67aeffd640 1 -- 172.21.15.146:0/347513156 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f68c404e6a0 con 0x559f5419f8c0 2024-09-18T01:46:27.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.953+0000 7f68c9673640 1 --2- 172.21.15.146:0/347513156 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f67a4036b40 0x7f67a4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:27.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.953+0000 7f68ce432800 1 Processor -- start 2024-09-18T01:46:27.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.953+0000 7f68ce432800 1 -- start start 2024-09-18T01:46:27.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.953+0000 7f68c9673640 1 --2- 172.21.15.146:0/347513156 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f67a4036b40 0x7f67a4039000 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f68bc006470 tx=0x7f68bc04af90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:27.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.953+0000 7f68ce432800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559f541ac580 0x559f541ac980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:27.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.953+0000 7f68ce432800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x559f53fffdd0 con 0x559f541ac580 2024-09-18T01:46:27.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.954+0000 7f68c9e74640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559f541ac580 0x559f541ac980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:27.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.954+0000 7f68c9e74640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559f541ac580 0x559f541ac980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:55796/0 (socket says 172.21.15.146:55796) 2024-09-18T01:46:27.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.954+0000 7f68c9e74640 1 -- 172.21.15.146:0/3115542486 learned_addr learned my addr 172.21.15.146:0/3115542486 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:27.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.954+0000 7f68c9e74640 1 -- 172.21.15.146:0/3115542486 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f541acf50 con 0x559f541ac580 2024-09-18T01:46:27.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.954+0000 7f68c9e74640 1 --2- 172.21.15.146:0/3115542486 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559f541ac580 0x559f541ac980 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f68c404c940 tx=0x7f68c404cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3096366de946baef server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:27.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.955+0000 7f67acff9640 1 -- 172.21.15.146:0/3115542486 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68c4017520 con 0x559f541ac580 2024-09-18T01:46:27.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.955+0000 7f67acff9640 1 -- 172.21.15.146:0/3115542486 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68c404a030 con 0x559f541ac580 2024-09-18T01:46:27.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.955+0000 7f67acff9640 1 -- 172.21.15.146:0/3115542486 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68c4029da0 con 0x559f541ac580 2024-09-18T01:46:27.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.955+0000 7f68ce432800 1 -- 172.21.15.146:0/3115542486 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559f541ac580 msgr2=0x559f541ac980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:27.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.955+0000 7f68ce432800 1 --2- 172.21.15.146:0/3115542486 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559f541ac580 0x559f541ac980 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f68c404c940 tx=0x7f68c404cbf0 comp rx=0 tx=0).stop 2024-09-18T01:46:27.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.955+0000 7f68ce432800 1 -- 172.21.15.146:0/3115542486 shutdown_connections 2024-09-18T01:46:27.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.955+0000 7f68ce432800 1 --2- 172.21.15.146:0/3115542486 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559f541ac580 0x559f541ac980 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:27.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.955+0000 7f68ce432800 1 -- 172.21.15.146:0/3115542486 >> 172.21.15.146:0/3115542486 conn(0x559f541a8930 msgr2=0x559f541a6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:27.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.955+0000 7f68ce432800 1 -- 172.21.15.146:0/3115542486 shutdown_connections 2024-09-18T01:46:27.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.955+0000 7f68ce432800 1 -- 172.21.15.146:0/3115542486 wait complete. 2024-09-18T01:46:27.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.955+0000 7f68ce432800 1 Processor -- start 2024-09-18T01:46:27.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.955+0000 7f68ce432800 1 -- start start 2024-09-18T01:46:27.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.956+0000 7f68ce432800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559f541ac580 0x559f541b3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:27.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.956+0000 7f68ce432800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x559f541ad520 con 0x559f541ac580 2024-09-18T01:46:27.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.956+0000 7f68c9e74640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559f541ac580 0x559f541b3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:27.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.956+0000 7f68c9e74640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559f541ac580 0x559f541b3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:55812/0 (socket says 172.21.15.146:55812) 2024-09-18T01:46:27.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.956+0000 7f68c9e74640 1 -- 172.21.15.146:0/1411127708 learned_addr learned my addr 172.21.15.146:0/1411127708 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:27.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.956+0000 7f68c9e74640 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f541b3f50 con 0x559f541ac580 2024-09-18T01:46:27.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.956+0000 7f68c9e74640 1 --2- 172.21.15.146:0/1411127708 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559f541ac580 0x559f541b3a10 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f68c40146e0 tx=0x7f68c404c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:27.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.956+0000 7f679affd640 1 -- 172.21.15.146:0/1411127708 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68c403a070 con 0x559f541ac580 2024-09-18T01:46:27.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.957+0000 7f679affd640 1 -- 172.21.15.146:0/1411127708 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68c404b170 con 0x559f541ac580 2024-09-18T01:46:27.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.957+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559f541b41e0 con 0x559f541ac580 2024-09-18T01:46:27.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.957+0000 7f679affd640 1 -- 172.21.15.146:0/1411127708 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68c404b470 con 0x559f541ac580 2024-09-18T01:46:27.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.957+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f541b6e90 con 0x559f541ac580 2024-09-18T01:46:27.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.957+0000 7f679affd640 1 -- 172.21.15.146:0/1411127708 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f68c403d070 con 0x559f541ac580 2024-09-18T01:46:27.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.958+0000 7f679affd640 1 --2- 172.21.15.146:0/1411127708 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6794036b90 0x7f6794039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:27.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.958+0000 7f679affd640 1 -- 172.21.15.146:0/1411127708 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f68c4032070 con 0x559f541ac580 2024-09-18T01:46:27.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.958+0000 7f68c9673640 1 --2- 172.21.15.146:0/1411127708 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6794036b90 0x7f6794039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:27.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.958+0000 7f68c9673640 1 --2- 172.21.15.146:0/1411127708 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6794036b90 0x7f6794039050 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f68bc044470 tx=0x7f68bc034000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:27.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.958+0000 7f68ce432800 20 rados->read ofs=0 len=0 2024-09-18T01:46:27.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.958+0000 7f68ce432800 1 --2- 172.21.15.146:0/1411127708 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559f541bf4a0 0x559f541c1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:27.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.958+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559f541c20b0 con 0x559f541bf4a0 2024-09-18T01:46:27.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.958+0000 7f68c8e72640 1 --2- 172.21.15.146:0/1411127708 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559f541bf4a0 0x559f541c1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:27.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.959+0000 7f68c8e72640 1 --2- 172.21.15.146:0/1411127708 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559f541bf4a0 0x559f541c1960 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:27.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.959+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f68c0057030 con 0x559f541bf4a0 2024-09-18T01:46:27.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.959+0000 7f68ce432800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:27.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.959+0000 7f68ce432800 20 realm 2024-09-18T01:46:27.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.959+0000 7f68ce432800 20 rados->read ofs=0 len=0 2024-09-18T01:46:27.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.959+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559f541c24e0 con 0x559f541bf4a0 2024-09-18T01:46:27.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.959+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f68c0057030 con 0x559f541bf4a0 2024-09-18T01:46:27.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.959+0000 7f68ce432800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:27.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.959+0000 7f68ce432800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:46:27.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.959+0000 7f68ce432800 20 rados->read ofs=0 len=0 2024-09-18T01:46:27.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.959+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559f541c2db0 con 0x559f541bf4a0 2024-09-18T01:46:27.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.960+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f68c0057030 con 0x559f541bf4a0 2024-09-18T01:46:27.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.960+0000 7f68ce432800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:27.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.960+0000 7f68ce432800 20 rados->read ofs=0 len=0 2024-09-18T01:46:27.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.960+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559f541c3150 con 0x559f541bf4a0 2024-09-18T01:46:27.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.960+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f68c0057030 con 0x559f541bf4a0 2024-09-18T01:46:27.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.960+0000 7f68ce432800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:46:27.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.960+0000 7f68ce432800 20 rados->read ofs=0 len=0 2024-09-18T01:46:27.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.960+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559f541c39a0 con 0x559f541bf4a0 2024-09-18T01:46:27.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.960+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f68c0057030 con 0x559f541bf4a0 2024-09-18T01:46:27.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.960+0000 7f68ce432800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:46:27.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.960+0000 7f68ce432800 20 searching for the correct realm 2024-09-18T01:46:27.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.960+0000 7f68ce432800 1 --2- 172.21.15.146:0/1411127708 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x559f541c5710 0x559f541c7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:27.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.960+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559f541c8130 con 0x559f541c5710 2024-09-18T01:46:27.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.960+0000 7f68c9e74640 1 --2- 172.21.15.146:0/1411127708 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x559f541c5710 0x559f541c7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:27.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.961+0000 7f68c9e74640 1 --2- 172.21.15.146:0/1411127708 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x559f541c5710 0x559f541c7b00 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:27.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.961+0000 7f68c9e74640 1 -- 172.21.15.146:0/1411127708 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68c403c030 con 0x559f541c5710 2024-09-18T01:46:27.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.961+0000 7f68c9e74640 1 --2- 172.21.15.146:0/1411127708 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f68c403f060 0x7f68c4016a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:27.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.961+0000 7f68c9e74640 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559f541c8130 con 0x7f68c403f060 2024-09-18T01:46:27.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.961+0000 7f68c9673640 1 --2- 172.21.15.146:0/1411127708 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f68c403f060 0x7f68c4016a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:27.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.961+0000 7f68c9673640 1 --2- 172.21.15.146:0/1411127708 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f68c403f060 0x7f68c4016a60 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:27.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.962+0000 7f68c9673640 1 -- 172.21.15.146:0/1411127708 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68bc01b070 con 0x7f68c403f060 2024-09-18T01:46:27.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.962+0000 7f68c9673640 1 --2- 172.21.15.146:0/1411127708 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f68bc027020 0x7f68bc0123c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:27.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.962+0000 7f68c9673640 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559f541c8130 con 0x7f68bc027020 2024-09-18T01:46:27.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.962+0000 7f68c8e72640 1 --2- 172.21.15.146:0/1411127708 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f68bc027020 0x7f68bc0123c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:27.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.962+0000 7f68c8e72640 1 --2- 172.21.15.146:0/1411127708 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f68bc027020 0x7f68bc0123c0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:27.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.963+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68c0057030 con 0x7f68bc027020 2024-09-18T01:46:27.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.963+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559f541c8130 con 0x559f541bf4a0 2024-09-18T01:46:27.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.963+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f68c0057030 con 0x559f541bf4a0 2024-09-18T01:46:27.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.963+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559f541c8130 con 0x559f541bf4a0 2024-09-18T01:46:27.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.963+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68c0057030 con 0x559f541bf4a0 2024-09-18T01:46:27.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.963+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559f541c8130 con 0x7f68bc027020 2024-09-18T01:46:27.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.964+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68c0057030 con 0x7f68bc027020 2024-09-18T01:46:27.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.964+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559f541c8130 con 0x7f68bc027020 2024-09-18T01:46:27.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.964+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68c0057030 con 0x7f68bc027020 2024-09-18T01:46:27.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.964+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559f541c8130 con 0x7f68c403f060 2024-09-18T01:46:27.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.964+0000 7f68c9673640 1 -- 172.21.15.146:0/1411127708 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68bc01b070 con 0x7f68c403f060 2024-09-18T01:46:27.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.964+0000 7f68c9673640 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559f541c8130 con 0x559f541c5710 2024-09-18T01:46:27.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.964+0000 7f68c9e74640 1 -- 172.21.15.146:0/1411127708 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68c403c030 con 0x559f541c5710 2024-09-18T01:46:27.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.964+0000 7f68c9e74640 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559f541c8130 con 0x559f541bf4a0 2024-09-18T01:46:27.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.965+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68c0057030 con 0x559f541bf4a0 2024-09-18T01:46:27.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.965+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559f541c8130 con 0x7f68bc027020 2024-09-18T01:46:27.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.965+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68c0057030 con 0x7f68bc027020 2024-09-18T01:46:27.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.965+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559f541c8130 con 0x559f541bf4a0 2024-09-18T01:46:27.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.965+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68c0057030 con 0x559f541bf4a0 2024-09-18T01:46:27.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.965+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559f541c8130 con 0x7f68c403f060 2024-09-18T01:46:27.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.965+0000 7f68c9673640 1 -- 172.21.15.146:0/1411127708 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f68bc01b070 con 0x7f68c403f060 2024-09-18T01:46:27.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.966+0000 7f68c9673640 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559f541c8130 con 0x559f541c5710 2024-09-18T01:46:27.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.966+0000 7f68c9e74640 1 -- 172.21.15.146:0/1411127708 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68c403c030 con 0x559f541c5710 2024-09-18T01:46:27.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.966+0000 7f68c9e74640 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559f541c8130 con 0x559f541c5710 2024-09-18T01:46:27.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.966+0000 7f68c9e74640 1 -- 172.21.15.146:0/1411127708 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68c403c030 con 0x559f541c5710 2024-09-18T01:46:27.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.966+0000 7f68c9e74640 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559f541c8130 con 0x7f68bc027020 2024-09-18T01:46:27.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.967+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68c0057030 con 0x7f68bc027020 2024-09-18T01:46:27.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.967+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559f541c8130 con 0x559f541c5710 2024-09-18T01:46:27.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.967+0000 7f68c9e74640 1 -- 172.21.15.146:0/1411127708 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68c403c030 con 0x559f541c5710 2024-09-18T01:46:27.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.967+0000 7f68c9e74640 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559f541c8130 con 0x559f541c5710 2024-09-18T01:46:27.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.967+0000 7f68c9e74640 1 -- 172.21.15.146:0/1411127708 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68c403c030 con 0x559f541c5710 2024-09-18T01:46:27.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.967+0000 7f68c9e74640 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559f541c8130 con 0x559f541bf4a0 2024-09-18T01:46:27.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.967+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68c0057030 con 0x559f541bf4a0 2024-09-18T01:46:27.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.967+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559f541c8130 con 0x559f541bf4a0 2024-09-18T01:46:27.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.967+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f68c0057030 con 0x559f541bf4a0 2024-09-18T01:46:27.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.967+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559f541c8130 con 0x7f68bc027020 2024-09-18T01:46:27.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.968+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68c0057030 con 0x7f68bc027020 2024-09-18T01:46:27.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.968+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559f541c8130 con 0x559f541c5710 2024-09-18T01:46:27.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.968+0000 7f68c9e74640 1 -- 172.21.15.146:0/1411127708 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68c403c030 con 0x559f541c5710 2024-09-18T01:46:27.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.968+0000 7f68c9e74640 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559f541c8130 con 0x7f68c403f060 2024-09-18T01:46:27.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.968+0000 7f68c9673640 1 -- 172.21.15.146:0/1411127708 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68bc01b070 con 0x7f68c403f060 2024-09-18T01:46:27.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.968+0000 7f68c9673640 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559f541c8130 con 0x559f541bf4a0 2024-09-18T01:46:27.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.969+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68c0057030 con 0x559f541bf4a0 2024-09-18T01:46:27.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.969+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559f541c8130 con 0x7f68bc027020 2024-09-18T01:46:27.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.969+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68c0057030 con 0x7f68bc027020 2024-09-18T01:46:27.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.969+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559f541c8130 con 0x559f541c5710 2024-09-18T01:46:27.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.969+0000 7f68c9e74640 1 -- 172.21.15.146:0/1411127708 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68c403c030 con 0x559f541c5710 2024-09-18T01:46:27.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.969+0000 7f68c9e74640 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559f541c8130 con 0x7f68bc027020 2024-09-18T01:46:27.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.970+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68c0057030 con 0x7f68bc027020 2024-09-18T01:46:27.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.970+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559f541c8130 con 0x7f68c403f060 2024-09-18T01:46:27.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.970+0000 7f68c9673640 1 -- 172.21.15.146:0/1411127708 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68bc01b070 con 0x7f68c403f060 2024-09-18T01:46:27.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.970+0000 7f68c9673640 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559f541c8130 con 0x559f541c5710 2024-09-18T01:46:27.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.970+0000 7f68c9e74640 1 -- 172.21.15.146:0/1411127708 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68c403c030 con 0x559f541c5710 2024-09-18T01:46:27.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.970+0000 7f68c9e74640 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559f541c8130 con 0x7f68bc027020 2024-09-18T01:46:27.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.970+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68c0057030 con 0x7f68bc027020 2024-09-18T01:46:27.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.970+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559f541c8130 con 0x559f541bf4a0 2024-09-18T01:46:27.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.971+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f68c0057030 con 0x559f541bf4a0 2024-09-18T01:46:27.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.971+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559f541c8130 con 0x7f68c403f060 2024-09-18T01:46:27.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.971+0000 7f68c9673640 1 -- 172.21.15.146:0/1411127708 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68bc061040 con 0x7f68c403f060 2024-09-18T01:46:27.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.971+0000 7f68ce432800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:46:27.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.971+0000 7f68ce432800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:46:27.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.971+0000 7f68ce432800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:46:27.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.971+0000 7f68ce432800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:46:27.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.971+0000 7f68ce432800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:46:27.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.971+0000 7f68ce432800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:46:27.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.971+0000 7f68ce432800 20 rados->read ofs=0 len=0 2024-09-18T01:46:27.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.971+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559f541c4320 con 0x559f541bf4a0 2024-09-18T01:46:27.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.971+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f68c0057030 con 0x559f541bf4a0 2024-09-18T01:46:27.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.971+0000 7f68ce432800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:27.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.971+0000 7f68ce432800 20 rados->read ofs=0 len=0 2024-09-18T01:46:27.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.971+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559f541c4bc0 con 0x559f541bf4a0 2024-09-18T01:46:27.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.971+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f68c0057030 con 0x559f541bf4a0 2024-09-18T01:46:27.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.971+0000 7f68ce432800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:46:27.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.971+0000 7f68ce432800 20 rados->read ofs=0 len=0 2024-09-18T01:46:27.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.971+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559f541c85b0 con 0x7f68c403f060 2024-09-18T01:46:27.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.972+0000 7f68c9673640 1 -- 172.21.15.146:0/1411127708 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f68bc061040 con 0x7f68c403f060 2024-09-18T01:46:27.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.972+0000 7f68ce432800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:46:27.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.972+0000 7f68ce432800 20 zone default found 2024-09-18T01:46:27.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.972+0000 7f68ce432800 4 Realm: () 2024-09-18T01:46:27.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.972+0000 7f68ce432800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:46:27.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.972+0000 7f68ce432800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:46:27.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.972+0000 7f68ce432800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:46:27.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.972+0000 7f68ce432800 20 zonegroup default 2024-09-18T01:46:27.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.972+0000 7f68ce432800 20 rados->read ofs=0 len=0 2024-09-18T01:46:27.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.972+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559f541c8e00 con 0x7f68bc027020 2024-09-18T01:46:27.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.972+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f68c0057030 con 0x7f68bc027020 2024-09-18T01:46:27.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.972+0000 7f68ce432800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:27.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.972+0000 7f68ce432800 20 rados->read ofs=0 len=0 2024-09-18T01:46:27.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.972+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559f541ca7e0 con 0x559f541c5710 2024-09-18T01:46:27.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.972+0000 7f68c9e74640 1 -- 172.21.15.146:0/1411127708 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f68c403c030 con 0x559f541c5710 2024-09-18T01:46:27.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.973+0000 7f68ce432800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:27.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.973+0000 7f68ce432800 20 rados->read ofs=0 len=0 2024-09-18T01:46:27.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.973+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559f541cac50 con 0x559f541c5710 2024-09-18T01:46:27.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.973+0000 7f68c9e74640 1 -- 172.21.15.146:0/1411127708 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f68c403c030 con 0x559f541c5710 2024-09-18T01:46:27.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.973+0000 7f68ce432800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:27.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.973+0000 7f68ce432800 20 started sync module instance, tier type = 2024-09-18T01:46:27.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.973+0000 7f68ce432800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:46:27.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.973+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559f541c9c20 con 0x7f68c403f060 2024-09-18T01:46:27.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.974+0000 7f68c9673640 1 -- 172.21.15.146:0/1411127708 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v33'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68bc061040 con 0x7f68c403f060 2024-09-18T01:46:27.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.974+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94142799320944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559f541cb0b0 con 0x7f68c403f060 2024-09-18T01:46:27.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.974+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559f541cb900 con 0x559f541bf4a0 2024-09-18T01:46:27.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.975+0000 7f68c9673640 1 -- 172.21.15.146:0/1411127708 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94142799320944] v33'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68bc061040 con 0x7f68c403f060 2024-09-18T01:46:27.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.975+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v33'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68c0057030 con 0x559f541bf4a0 2024-09-18T01:46:27.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.975+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94142799328336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559f541cbd20 con 0x559f541bf4a0 2024-09-18T01:46:27.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.975+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559f541cc5b0 con 0x559f541c5710 2024-09-18T01:46:27.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.977+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94142799328336] v33'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68c0057030 con 0x559f541bf4a0 2024-09-18T01:46:27.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.977+0000 7f68c9e74640 1 -- 172.21.15.146:0/1411127708 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v33'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68c403c030 con 0x559f541c5710 2024-09-18T01:46:27.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.977+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94142799329392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559f541cc140 con 0x559f541c5710 2024-09-18T01:46:27.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.977+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559f541cd010 con 0x7f68c403f060 2024-09-18T01:46:27.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.978+0000 7f68c9673640 1 -- 172.21.15.146:0/1411127708 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v33'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68bc061040 con 0x7f68c403f060 2024-09-18T01:46:27.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.978+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94142799334160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559f541cd8b0 con 0x7f68c403f060 2024-09-18T01:46:27.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.978+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559f541ce3d0 con 0x559f541bf4a0 2024-09-18T01:46:27.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.979+0000 7f68c9e74640 1 -- 172.21.15.146:0/1411127708 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94142799329392] v33'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68c403c030 con 0x559f541c5710 2024-09-18T01:46:27.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.979+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v33'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68c0057030 con 0x559f541bf4a0 2024-09-18T01:46:27.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.979+0000 7f68c9673640 1 -- 172.21.15.146:0/1411127708 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94142799334160] v33'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68bc061040 con 0x7f68c403f060 2024-09-18T01:46:27.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.979+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94142799339168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559f541ce390 con 0x559f541bf4a0 2024-09-18T01:46:27.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.979+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559f541cd400 con 0x7f68bc027020 2024-09-18T01:46:27.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.980+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94142799339168] v33'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68c0057030 con 0x559f541bf4a0 2024-09-18T01:46:27.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.981+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v33'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68c0057030 con 0x7f68bc027020 2024-09-18T01:46:27.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.981+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94142799330448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559f541ce960 con 0x7f68bc027020 2024-09-18T01:46:27.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.981+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559f541cf320 con 0x7f68bc027020 2024-09-18T01:46:27.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.982+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94142799330448] v33'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68c0057030 con 0x7f68bc027020 2024-09-18T01:46:27.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.982+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v33'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68c0057030 con 0x7f68bc027020 2024-09-18T01:46:27.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.982+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94142799336448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559f541cf320 con 0x7f68bc027020 2024-09-18T01:46:27.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.982+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559f541cfce0 con 0x7f68bc027020 2024-09-18T01:46:27.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.983+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94142799336448] v33'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68c0057030 con 0x7f68bc027020 2024-09-18T01:46:27.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.983+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v33'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68c0057030 con 0x7f68bc027020 2024-09-18T01:46:27.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.983+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94142799343696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559f541cfce0 con 0x7f68bc027020 2024-09-18T01:46:27.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.983+0000 7f68ce432800 20 add_watcher() i=0 2024-09-18T01:46:27.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.983+0000 7f68ce432800 20 add_watcher() i=1 2024-09-18T01:46:27.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.983+0000 7f68ce432800 20 add_watcher() i=2 2024-09-18T01:46:27.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.983+0000 7f68ce432800 20 add_watcher() i=3 2024-09-18T01:46:27.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.983+0000 7f68ce432800 20 add_watcher() i=4 2024-09-18T01:46:27.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.983+0000 7f68ce432800 20 add_watcher() i=5 2024-09-18T01:46:27.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.983+0000 7f68ce432800 20 add_watcher() i=6 2024-09-18T01:46:27.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.984+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94142799343696] v33'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68c0057030 con 0x7f68bc027020 2024-09-18T01:46:27.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.984+0000 7f68ce432800 20 add_watcher() i=7 2024-09-18T01:46:27.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.984+0000 7f68ce432800 2 all 8 watchers are set, enabling cache 2024-09-18T01:46:27.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.984+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559f541d30e0 con 0x559f541bf4a0 2024-09-18T01:46:27.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.984+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f68c0057030 con 0x559f541bf4a0 2024-09-18T01:46:27.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.984+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94142799346176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559f541d0600 con 0x559f541bf4a0 2024-09-18T01:46:27.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.985+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94142799346176] v33'220 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f68c0057030 con 0x559f541bf4a0 2024-09-18T01:46:27.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.986+0000 7f677f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:46:27.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.986+0000 7f68ce432800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:46:27.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.986+0000 7f68ce432800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:46:27.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.986+0000 7f68ce432800 5 note: GC not initialized 2024-09-18T01:46:27.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.986+0000 7f677e7e4640 20 reqs_thread_entry: start 2024-09-18T01:46:27.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.986+0000 7f68ce432800 20 init_complete bucket index max shards: 11 2024-09-18T01:46:27.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.986+0000 7f68ce432800 20 Filter name: none 2024-09-18T01:46:27.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.986+0000 7f66effff640 20 reqs_thread_entry: start 2024-09-18T01:46:27.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.986+0000 7f68ce432800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-18T01:46:27.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.986+0000 7f68ce432800 20 rados->read ofs=0 len=0 2024-09-18T01:46:27.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.986+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559f54206500 con 0x7f68bc027020 2024-09-18T01:46:27.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.987+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f68c0057030 con 0x7f68bc027020 2024-09-18T01:46:27.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.987+0000 7f68ce432800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:27.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.987+0000 7f68ce432800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-18T01:46:27.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.987+0000 7f68ce432800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-18T01:46:27.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.987+0000 7f68ce432800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-18T01:46:27.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.987+0000 7f68ce432800 20 rados->read ofs=0 len=0 2024-09-18T01:46:27.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.987+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559f54204b40 con 0x7f68bc027020 2024-09-18T01:46:27.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.987+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f68c0057030 con 0x7f68bc027020 2024-09-18T01:46:27.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.987+0000 7f68ce432800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:27.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.987+0000 7f68ce432800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-18T01:46:27.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.987+0000 7f68ce432800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-18T01:46:27.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.987+0000 7f68ce432800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-18T01:46:27.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.987+0000 7f68ce432800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-18T01:46:27.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.987+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559f542053e0 con 0x7f68bc027020 2024-09-18T01:46:27.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.988+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v33'9 uv9 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f68c0057030 con 0x7f68bc027020 2024-09-18T01:46:27.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.988+0000 7f68ce432800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-18T01:46:27.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.988+0000 7f68ce432800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-18T01:46:27.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.988+0000 7f68ce432800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-18T01:46:27.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.988+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94142799564592 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559f54209fa0 con 0x7f68bc027020 2024-09-18T01:46:27.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.989+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== watch-notify(notify (1) cookie 94142799330448 notify 141733920803 ret 0) ==== 598+0+0 (crc 0 0 0) 0x559f54205780 con 0x7f68bc027020 2024-09-18T01:46:27.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.989+0000 7f679bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920803 cookie 94142799330448 notifier 4747 bl.length()=556 2024-09-18T01:46:27.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.989+0000 7f679bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-18T01:46:27.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.989+0000 7f679bfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-18T01:46:27.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.989+0000 7f679bfff640 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f678c003ea0 con 0x7f68bc027020 2024-09-18T01:46:27.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.989+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== osd_op_reply(65 notify.5 [notify cookie 94142799564592 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f68c0057030 con 0x7f68bc027020 2024-09-18T01:46:27.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.989+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 <== osd.0 v2:172.21.15.129:6800/1759265424 22 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68c0057030 con 0x7f68bc027020 2024-09-18T01:46:27.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.989+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 <== osd.0 v2:172.21.15.129:6800/1759265424 23 ==== watch-notify(notify_complete (2) cookie 94142799564592 notify 141733920803 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559f54205f50 con 0x7f68bc027020 2024-09-18T01:46:27.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.989+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559f54207ad0 con 0x7f68bc027020 2024-09-18T01:46:27.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.990+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 <== osd.0 v2:172.21.15.129:6800/1759265424 24 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v33'17 uv17 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f68c0057030 con 0x7f68bc027020 2024-09-18T01:46:27.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.990+0000 7f68ce432800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-18T01:46:27.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.990+0000 7f68ce432800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-18T01:46:27.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.990+0000 7f68ce432800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-18T01:46:27.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.990+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94142799564480 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559f54209fa0 con 0x559f541c5710 2024-09-18T01:46:27.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.991+0000 7f68c9e74640 1 -- 172.21.15.146:0/1411127708 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== watch-notify(notify (1) cookie 94142799329392 notify 141733920774 ret 0) ==== 219+0+0 (crc 0 0 0) 0x559f541b41e0 con 0x559f541c5710 2024-09-18T01:46:27.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.991+0000 7f67acff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920774 cookie 94142799329392 notifier 4747 bl.length()=177 2024-09-18T01:46:27.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.991+0000 7f67acff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-18T01:46:27.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.991+0000 7f67acff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-18T01:46:27.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.991+0000 7f67acff9640 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f66fc003400 con 0x559f541c5710 2024-09-18T01:46:27.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.991+0000 7f68c9e74640 1 -- 172.21.15.146:0/1411127708 <== osd.3 v2:172.21.15.146:6809/4106661138 15 ==== osd_op_reply(68 notify.2 [notify cookie 94142799564480 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f68c403c030 con 0x559f541c5710 2024-09-18T01:46:27.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.991+0000 7f68c9e74640 1 -- 172.21.15.146:0/1411127708 <== osd.3 v2:172.21.15.146:6809/4106661138 16 ==== watch-notify(notify_complete (2) cookie 94142799564480 notify 141733920774 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559f541b3f50 con 0x559f541c5710 2024-09-18T01:46:27.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.991+0000 7f68c9e74640 1 -- 172.21.15.146:0/1411127708 <== osd.3 v2:172.21.15.146:6809/4106661138 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68c403c030 con 0x559f541c5710 2024-09-18T01:46:27.997 INFO:teuthology.orchestra.run.smithi146.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-18T01:46:27.987963Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:46:27.987947Z","tags":[],"group_ids":[]} 2024-09-18T01:46:27.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.992+0000 7f677f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:46:27.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.992+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94142799346176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559f542041e0 con 0x559f541bf4a0 2024-09-18T01:46:28.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.993+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94142799346176] v33'221 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f68c0057030 con 0x559f541bf4a0 2024-09-18T01:46:28.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.993+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94142799320944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559f542041e0 con 0x7f68c403f060 2024-09-18T01:46:28.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.994+0000 7f68c9673640 1 -- 172.21.15.146:0/1411127708 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94142799320944] v33'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68bc061040 con 0x7f68c403f060 2024-09-18T01:46:28.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.994+0000 7f68ce432800 20 remove_watcher() i=0 2024-09-18T01:46:28.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.994+0000 7f68ce432800 2 removed watcher, disabling cache 2024-09-18T01:46:28.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.994+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94142799328336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559f542041e0 con 0x559f541bf4a0 2024-09-18T01:46:28.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.995+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94142799328336] v33'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68c0057030 con 0x559f541bf4a0 2024-09-18T01:46:28.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.995+0000 7f68ce432800 20 remove_watcher() i=1 2024-09-18T01:46:28.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.995+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94142799329392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559f542041e0 con 0x559f541c5710 2024-09-18T01:46:28.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.996+0000 7f68c9e74640 1 -- 172.21.15.146:0/1411127708 <== osd.3 v2:172.21.15.146:6809/4106661138 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94142799329392] v33'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68c403c030 con 0x559f541c5710 2024-09-18T01:46:28.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.996+0000 7f68ce432800 20 remove_watcher() i=2 2024-09-18T01:46:28.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.996+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94142799334160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559f542041e0 con 0x7f68c403f060 2024-09-18T01:46:28.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.998+0000 7f68c9673640 1 -- 172.21.15.146:0/1411127708 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94142799334160] v33'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68bc061040 con 0x7f68c403f060 2024-09-18T01:46:28.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.998+0000 7f68ce432800 20 remove_watcher() i=3 2024-09-18T01:46:28.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.998+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94142799339168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559f542041e0 con 0x559f541bf4a0 2024-09-18T01:46:28.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.999+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94142799339168] v33'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68c0057030 con 0x559f541bf4a0 2024-09-18T01:46:28.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.999+0000 7f68ce432800 20 remove_watcher() i=4 2024-09-18T01:46:28.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:27.999+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94142799330448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559f542041e0 con 0x7f68bc027020 2024-09-18T01:46:28.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.000+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 <== osd.0 v2:172.21.15.129:6800/1759265424 25 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94142799330448] v33'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68c0057030 con 0x7f68bc027020 2024-09-18T01:46:28.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.000+0000 7f68ce432800 20 remove_watcher() i=5 2024-09-18T01:46:28.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.000+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94142799336448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559f542041e0 con 0x7f68bc027020 2024-09-18T01:46:28.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.001+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 <== osd.0 v2:172.21.15.129:6800/1759265424 26 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94142799336448] v33'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68c0057030 con 0x7f68bc027020 2024-09-18T01:46:28.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.001+0000 7f68ce432800 20 remove_watcher() i=6 2024-09-18T01:46:28.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.001+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94142799343696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559f542041e0 con 0x7f68bc027020 2024-09-18T01:46:28.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.002+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 <== osd.0 v2:172.21.15.129:6800/1759265424 27 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94142799343696] v33'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68c0057030 con 0x7f68bc027020 2024-09-18T01:46:28.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.002+0000 7f68ce432800 20 remove_watcher() i=7 2024-09-18T01:46:28.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.003+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f68bc027020 msgr2=0x7f68bc0123c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.003+0000 7f68ce432800 1 --2- 172.21.15.146:0/1411127708 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f68bc027020 0x7f68bc0123c0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.003+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559f541bf4a0 msgr2=0x559f541c1960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.003+0000 7f68ce432800 1 --2- 172.21.15.146:0/1411127708 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559f541bf4a0 0x559f541c1960 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.003+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f68c403f060 msgr2=0x7f68c4016a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.003+0000 7f68ce432800 1 --2- 172.21.15.146:0/1411127708 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f68c403f060 0x7f68c4016a60 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.003+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x559f541c5710 msgr2=0x559f541c7b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.003+0000 7f68ce432800 1 --2- 172.21.15.146:0/1411127708 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x559f541c5710 0x559f541c7b00 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.003+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6794036b90 msgr2=0x7f6794039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.003+0000 7f68ce432800 1 --2- 172.21.15.146:0/1411127708 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6794036b90 0x7f6794039050 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f68bc044470 tx=0x7f68bc034000 comp rx=0 tx=0).stop 2024-09-18T01:46:28.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.003+0000 7f68c8e72640 1 -- 172.21.15.146:0/1411127708 reap_dead start 2024-09-18T01:46:28.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.003+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559f541ac580 msgr2=0x559f541b3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.003+0000 7f68ce432800 1 --2- 172.21.15.146:0/1411127708 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559f541ac580 0x559f541b3a10 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f68c40146e0 tx=0x7f68c404c8d0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.003+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 shutdown_connections 2024-09-18T01:46:28.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.003+0000 7f68ce432800 1 --2- 172.21.15.146:0/1411127708 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559f541ac580 0x559f541b3a10 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.003+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 >> 172.21.15.146:0/1411127708 conn(0x559f541a8930 msgr2=0x559f541adc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:28.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.003+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 shutdown_connections 2024-09-18T01:46:28.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.003+0000 7f68ce432800 1 -- 172.21.15.146:0/1411127708 wait complete. 2024-09-18T01:46:28.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.003+0000 7f68ce432800 1 -- 172.21.15.146:0/347513156 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f67a4036b40 msgr2=0x7f67a4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.003+0000 7f68ce432800 1 --2- 172.21.15.146:0/347513156 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f67a4036b40 0x7f67a4039000 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f68bc006470 tx=0x7f68bc04af90 comp rx=0 tx=0).stop 2024-09-18T01:46:28.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.003+0000 7f68ce432800 1 -- 172.21.15.146:0/347513156 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559f5419f8c0 msgr2=0x559f5419fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.003+0000 7f68ce432800 1 --2- 172.21.15.146:0/347513156 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559f5419f8c0 0x559f5419fce0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x559f54185bb0 tx=0x7f68c400ef30 comp rx=0 tx=0).stop 2024-09-18T01:46:28.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.003+0000 7f68ce432800 1 -- 172.21.15.146:0/347513156 shutdown_connections 2024-09-18T01:46:28.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.003+0000 7f68ce432800 1 --2- 172.21.15.146:0/347513156 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f67a4036b40 0x7f67a4039000 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.003+0000 7f68ce432800 1 --2- 172.21.15.146:0/347513156 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559f5419f8c0 0x559f5419fce0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.003+0000 7f68ce432800 1 -- 172.21.15.146:0/347513156 >> 172.21.15.146:0/347513156 conn(0x559f54194850 msgr2=0x559f541973d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:28.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.003+0000 7f68ce432800 1 -- 172.21.15.146:0/347513156 shutdown_connections 2024-09-18T01:46:28.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.003+0000 7f68ce432800 1 -- 172.21.15.146:0/347513156 wait complete. 2024-09-18T01:46:28.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.004+0000 7f68ce432800 1 -- 172.21.15.146:0/1195916838 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559f54189810 msgr2=0x559f5418bc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.004+0000 7f68ce432800 1 --2- 172.21.15.146:0/1195916838 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559f54189810 0x559f5418bc00 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.004+0000 7f68ce432800 1 -- 172.21.15.146:0/1195916838 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x559f5418f2d0 msgr2=0x559f541916c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.004+0000 7f68ce432800 1 --2- 172.21.15.146:0/1195916838 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x559f5418f2d0 0x559f541916c0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.004+0000 7f68ce432800 1 -- 172.21.15.146:0/1195916838 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f67b0036b40 msgr2=0x7f67b0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.004+0000 7f68ce432800 1 --2- 172.21.15.146:0/1195916838 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f67b0036b40 0x7f67b0039000 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f68c0057000 tx=0x7f68c0052000 comp rx=0 tx=0).stop 2024-09-18T01:46:28.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.004+0000 7f68ce432800 1 -- 172.21.15.146:0/1195916838 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559f5408faa0 msgr2=0x559f541847b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.004+0000 7f68ce432800 1 --2- 172.21.15.146:0/1195916838 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559f5408faa0 0x559f541847b0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x559f54000e00 tx=0x7f68bc001250 comp rx=0 tx=0).stop 2024-09-18T01:46:28.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.004+0000 7f68ce432800 1 -- 172.21.15.146:0/1195916838 shutdown_connections 2024-09-18T01:46:28.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.004+0000 7f68ce432800 1 --2- 172.21.15.146:0/1195916838 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x559f5418f2d0 0x559f541916c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.004+0000 7f68ce432800 1 --2- 172.21.15.146:0/1195916838 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559f54189810 0x559f5418bc00 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.004+0000 7f68ce432800 1 --2- 172.21.15.146:0/1195916838 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f67b0036b40 0x7f67b0039000 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.004+0000 7f68ce432800 1 --2- 172.21.15.146:0/1195916838 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559f5408faa0 0x559f541847b0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.004+0000 7f68ce432800 1 -- 172.21.15.146:0/1195916838 >> 172.21.15.146:0/1195916838 conn(0x559f54087030 msgr2=0x559f54175ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:28.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.004+0000 7f68ce432800 1 -- 172.21.15.146:0/1195916838 shutdown_connections 2024-09-18T01:46:28.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.004+0000 7f68ce432800 1 -- 172.21.15.146:0/1195916838 wait complete. 2024-09-18T01:46:28.013 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-18T01:46:27.987963Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:46:27.987947Z', 'tags': [], 'group_ids': []} 2024-09-18T01:46:28.029 INFO:tasks.radosgw_admin:RL: create_bucket myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-18T01:46:28.035 INFO:tasks.radosgw_admin:RL: put_obj myfoo7 fud bytes_out=8 bytes_in=0 failed=False 2024-09-18T01:46:28.035 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-18T01:46:28.035 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-18T01:46:28.035 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bud --new-uid fud 2024-09-18T01:46:28.081 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:46:28.081 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:46:28.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.081+0000 7fe9ff630800 1 Processor -- start 2024-09-18T01:46:28.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.081+0000 7fe9ff630800 1 -- start start 2024-09-18T01:46:28.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.081+0000 7fe9ff630800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x5649bb574d20 0x5649bb577110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:28.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.081+0000 7fe9ff630800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5649bb42db30 con 0x5649bb4e2630 2024-09-18T01:46:28.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.081+0000 7fe9ff630800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x5649bb40f360 con 0x5649bb574d20 2024-09-18T01:46:28.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.082+0000 7fe9f3fff640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x5649bb574d20 0x5649bb577110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:28.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.082+0000 7fe9fa9d6640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x5649bb4e2630 0x5649bb573600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:49428/0 (socket says 172.21.15.146:49428) 2024-09-18T01:46:28.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.082+0000 7fe9fa9d6640 1 -- 172.21.15.146:0/2598065725 learned_addr learned my addr 172.21.15.146:0/2598065725 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:46:28.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.082+0000 7fe9f3fff640 1 -- 172.21.15.146:0/2598065725 >> v1:172.21.15.129:6789/0 conn(0x5649bb4e2630 legacy=0x5649bb573600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.082+0000 7fe9f3fff640 1 -- 172.21.15.146:0/2598065725 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649bb435e00 con 0x5649bb574d20 2024-09-18T01:46:28.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.084+0000 7fe9f3fff640 1 --2- 172.21.15.146:0/2598065725 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5649bb574d20 0x5649bb577110 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fe9e400a470 tx=0x7fe9e4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba4c652871dbc37e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:28.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.084+0000 7fe9fa1d5640 1 -- 172.21.15.146:0/2598065725 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9e4053570 con 0x5649bb574d20 2024-09-18T01:46:28.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.084+0000 7fe9fa1d5640 1 -- 172.21.15.146:0/2598065725 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9e4058070 con 0x5649bb574d20 2024-09-18T01:46:28.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.084+0000 7fe9fa1d5640 1 -- 172.21.15.146:0/2598065725 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9e4053880 con 0x5649bb574d20 2024-09-18T01:46:28.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.085+0000 7fe9ff630800 1 -- 172.21.15.146:0/2598065725 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5649bb574d20 msgr2=0x5649bb577110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.085+0000 7fe9ff630800 1 --2- 172.21.15.146:0/2598065725 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5649bb574d20 0x5649bb577110 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fe9e400a470 tx=0x7fe9e4045a20 comp rx=0 tx=0).stop 2024-09-18T01:46:28.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.085+0000 7fe9ff630800 1 -- 172.21.15.146:0/2598065725 shutdown_connections 2024-09-18T01:46:28.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.085+0000 7fe9ff630800 1 --2- 172.21.15.146:0/2598065725 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5649bb574d20 0x5649bb577110 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.085+0000 7fe9ff630800 1 -- 172.21.15.146:0/2598065725 >> 172.21.15.146:0/2598065725 conn(0x5649bb568db0 msgr2=0x5649bb56b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:28.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.085+0000 7fe9ff630800 1 -- 172.21.15.146:0/2598065725 shutdown_connections 2024-09-18T01:46:28.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.085+0000 7fe9ff630800 1 -- 172.21.15.146:0/2598065725 wait complete. 2024-09-18T01:46:28.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.098+0000 7fe9ff630800 1 Processor -- start 2024-09-18T01:46:28.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.098+0000 7fe9ff630800 1 -- start start 2024-09-18T01:46:28.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.098+0000 7fe9ff630800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5649bb4e2630 0x5649bb65fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:28.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.098+0000 7fe9ff630800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5649bb4ba360 con 0x5649bb4e2630 2024-09-18T01:46:28.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.099+0000 7fe9fa9d6640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5649bb4e2630 0x5649bb65fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:28.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.099+0000 7fe9fa9d6640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5649bb4e2630 0x5649bb65fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:55826/0 (socket says 172.21.15.146:55826) 2024-09-18T01:46:28.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.099+0000 7fe9fa9d6640 1 -- 172.21.15.146:0/4055346265 learned_addr learned my addr 172.21.15.146:0/4055346265 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:28.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.099+0000 7fe9fa9d6640 1 -- 172.21.15.146:0/4055346265 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649bb407bc0 con 0x5649bb4e2630 2024-09-18T01:46:28.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.099+0000 7fe9fa9d6640 1 --2- 172.21.15.146:0/4055346265 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5649bb4e2630 0x5649bb65fa90 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec001e10 tx=0x7fe9ec00b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e1c66523c93327b server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:28.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.100+0000 7fe8e8e09640 1 -- 172.21.15.146:0/4055346265 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9ec012020 con 0x5649bb4e2630 2024-09-18T01:46:28.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.100+0000 7fe8e8e09640 1 -- 172.21.15.146:0/4055346265 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9ec00e5a0 con 0x5649bb4e2630 2024-09-18T01:46:28.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.100+0000 7fe8e8e09640 1 -- 172.21.15.146:0/4055346265 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9ec00e8e0 con 0x5649bb4e2630 2024-09-18T01:46:28.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.100+0000 7fe9ff630800 1 -- 172.21.15.146:0/4055346265 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5649bb4e2630 msgr2=0x5649bb65fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.100+0000 7fe9ff630800 1 --2- 172.21.15.146:0/4055346265 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5649bb4e2630 0x5649bb65fa90 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec001e10 tx=0x7fe9ec00b780 comp rx=0 tx=0).stop 2024-09-18T01:46:28.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.100+0000 7fe9ff630800 1 -- 172.21.15.146:0/4055346265 shutdown_connections 2024-09-18T01:46:28.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.100+0000 7fe9ff630800 1 --2- 172.21.15.146:0/4055346265 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5649bb4e2630 0x5649bb65fa90 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.100+0000 7fe9ff630800 1 -- 172.21.15.146:0/4055346265 >> 172.21.15.146:0/4055346265 conn(0x5649bb568db0 msgr2=0x5649bb65b450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:28.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.100+0000 7fe9ff630800 1 -- 172.21.15.146:0/4055346265 shutdown_connections 2024-09-18T01:46:28.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.100+0000 7fe9ff630800 1 -- 172.21.15.146:0/4055346265 wait complete. 2024-09-18T01:46:28.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.101+0000 7fe9ff630800 1 Processor -- start 2024-09-18T01:46:28.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.101+0000 7fe9ff630800 1 -- start start 2024-09-18T01:46:28.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.101+0000 7fe9ff630800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5649bb4e2630 0x5649bb667470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:28.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.101+0000 7fe9ff630800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5649bb577920 con 0x5649bb4e2630 2024-09-18T01:46:28.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.101+0000 7fe9fa9d6640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5649bb4e2630 0x5649bb667470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:28.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.101+0000 7fe9fa9d6640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5649bb4e2630 0x5649bb667470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:55840/0 (socket says 172.21.15.146:55840) 2024-09-18T01:46:28.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.101+0000 7fe9fa9d6640 1 -- 172.21.15.146:0/4055549379 learned_addr learned my addr 172.21.15.146:0/4055549379 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:28.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.101+0000 7fe9fa9d6640 1 -- 172.21.15.146:0/4055549379 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649bb41bfe0 con 0x5649bb4e2630 2024-09-18T01:46:28.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.101+0000 7fe9fa9d6640 1 --2- 172.21.15.146:0/4055549379 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5649bb4e2630 0x5649bb667470 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec001e10 tx=0x7fe9ec000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:28.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.102+0000 7fe8e7606640 1 -- 172.21.15.146:0/4055549379 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9ec012030 con 0x5649bb4e2630 2024-09-18T01:46:28.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.102+0000 7fe8e7606640 1 -- 172.21.15.146:0/4055549379 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9ec01a7a0 con 0x5649bb4e2630 2024-09-18T01:46:28.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.102+0000 7fe8e7606640 1 -- 172.21.15.146:0/4055549379 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9ec01aac0 con 0x5649bb4e2630 2024-09-18T01:46:28.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.102+0000 7fe9ff630800 1 -- 172.21.15.146:0/4055549379 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5649bb6679b0 con 0x5649bb4e2630 2024-09-18T01:46:28.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.102+0000 7fe9ff630800 1 -- 172.21.15.146:0/4055549379 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649bb667ed0 con 0x5649bb4e2630 2024-09-18T01:46:28.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.102+0000 7fe8e7606640 1 -- 172.21.15.146:0/4055549379 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe9ec015020 con 0x5649bb4e2630 2024-09-18T01:46:28.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.103+0000 7fe8e7606640 1 --2- 172.21.15.146:0/4055549379 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fe8e0036b40 0x7fe8e0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:28.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.103+0000 7fe8e7606640 1 -- 172.21.15.146:0/4055549379 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7fe9ec020030 con 0x5649bb4e2630 2024-09-18T01:46:28.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.103+0000 7fe9f3fff640 1 --2- 172.21.15.146:0/4055549379 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fe8e0036b40 0x7fe8e0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:28.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.103+0000 7fe9ff630800 1 --2- 172.21.15.146:0/4055549379 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5649bb574d20 0x5649bb66e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:28.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.103+0000 7fe9ff630800 1 -- 172.21.15.146:0/4055549379 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5649bb66ea20 con 0x5649bb574d20 2024-09-18T01:46:28.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.103+0000 7fe9fb1d7640 1 --2- 172.21.15.146:0/4055549379 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5649bb574d20 0x5649bb66e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:28.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.103+0000 7fe9f3fff640 1 --2- 172.21.15.146:0/4055549379 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fe8e0036b40 0x7fe8e0039000 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4057000 tx=0x7fe9e4052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:28.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.103+0000 7fe9fb1d7640 1 --2- 172.21.15.146:0/4055549379 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5649bb574d20 0x5649bb66e4e0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:28.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.103+0000 7fe9fb1d7640 1 -- 172.21.15.146:0/4055549379 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe9f400a4a0 con 0x5649bb574d20 2024-09-18T01:46:28.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.104+0000 7fe9ff630800 1 -- 172.21.15.146:0/4055549379 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5649bb66bab0 con 0x5649bb574d20 2024-09-18T01:46:28.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.104+0000 7fe9fb1d7640 1 -- 172.21.15.146:0/4055549379 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe9f400a4a0 con 0x5649bb574d20 2024-09-18T01:46:28.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.104+0000 7fe9ff630800 1 -- 172.21.15.146:0/4055549379 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5649bb670820 con 0x5649bb574d20 2024-09-18T01:46:28.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.104+0000 7fe9fb1d7640 1 -- 172.21.15.146:0/4055549379 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe9f400a4a0 con 0x5649bb574d20 2024-09-18T01:46:28.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.104+0000 7fe9ff630800 1 -- 172.21.15.146:0/4055549379 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5649bb66fa50 con 0x5649bb574d20 2024-09-18T01:46:28.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.104+0000 7fe9fb1d7640 1 -- 172.21.15.146:0/4055549379 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe9f400a4a0 con 0x5649bb574d20 2024-09-18T01:46:28.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.104+0000 7fe9ff630800 1 --2- 172.21.15.146:0/4055549379 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5649bb671bd0 0x5649bb673fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:28.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.104+0000 7fe9ff630800 1 -- 172.21.15.146:0/4055549379 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5649bb674500 con 0x5649bb671bd0 2024-09-18T01:46:28.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.105+0000 7fe9fa9d6640 1 --2- 172.21.15.146:0/4055549379 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5649bb671bd0 0x5649bb673fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:28.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.105+0000 7fe9fa9d6640 1 --2- 172.21.15.146:0/4055549379 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5649bb671bd0 0x5649bb673fc0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:28.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.105+0000 7fe9fa9d6640 1 -- 172.21.15.146:0/4055549379 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe9ec00dcd0 con 0x5649bb671bd0 2024-09-18T01:46:28.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.105+0000 7fe9ff630800 1 Processor -- start 2024-09-18T01:46:28.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.105+0000 7fe9ff630800 1 -- start start 2024-09-18T01:46:28.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.106+0000 7fe9ff630800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5649bb682180 0x5649bb6825a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:28.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.106+0000 7fe9ff630800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5649bb409580 con 0x5649bb682180 2024-09-18T01:46:28.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.106+0000 7fe9fb1d7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5649bb682180 0x5649bb6825a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:28.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.106+0000 7fe9fb1d7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5649bb682180 0x5649bb6825a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:55852/0 (socket says 172.21.15.146:55852) 2024-09-18T01:46:28.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.106+0000 7fe9fb1d7640 1 -- 172.21.15.146:0/4145386378 learned_addr learned my addr 172.21.15.146:0/4145386378 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:28.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.106+0000 7fe9fb1d7640 1 -- 172.21.15.146:0/4145386378 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649bb682ae0 con 0x5649bb682180 2024-09-18T01:46:28.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.106+0000 7fe9fb1d7640 1 --2- 172.21.15.146:0/4145386378 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5649bb682180 0x5649bb6825a0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x5649bb668870 tx=0x7fe9f40178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:28.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.107+0000 7fe8e4e01640 1 -- 172.21.15.146:0/4145386378 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9f4013440 con 0x5649bb682180 2024-09-18T01:46:28.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.107+0000 7fe8e4e01640 1 -- 172.21.15.146:0/4145386378 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9f40135e0 con 0x5649bb682180 2024-09-18T01:46:28.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.107+0000 7fe9ff630800 1 -- 172.21.15.146:0/4145386378 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5649bb682d70 con 0x5649bb682180 2024-09-18T01:46:28.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.107+0000 7fe8e4e01640 1 -- 172.21.15.146:0/4145386378 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9f40138c0 con 0x5649bb682180 2024-09-18T01:46:28.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.107+0000 7fe9ff630800 1 -- 172.21.15.146:0/4145386378 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649bb685a50 con 0x5649bb682180 2024-09-18T01:46:28.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.107+0000 7fe8e4e01640 1 -- 172.21.15.146:0/4145386378 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe9f4011040 con 0x5649bb682180 2024-09-18T01:46:28.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.107+0000 7fe8e4e01640 1 --2- 172.21.15.146:0/4145386378 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fe8d4036b40 0x7fe8d4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:28.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.108+0000 7fe8e4e01640 1 -- 172.21.15.146:0/4145386378 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7fe9f401d070 con 0x5649bb682180 2024-09-18T01:46:28.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.108+0000 7fe9fa9d6640 1 --2- 172.21.15.146:0/4145386378 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fe8d4036b40 0x7fe8d4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:28.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.108+0000 7fe9ff630800 1 Processor -- start 2024-09-18T01:46:28.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.108+0000 7fe9ff630800 1 -- start start 2024-09-18T01:46:28.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.108+0000 7fe9fa9d6640 1 --2- 172.21.15.146:0/4145386378 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fe8d4036b40 0x7fe8d4039000 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec001750 tx=0x7fe9ec024000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:28.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.108+0000 7fe9ff630800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5649bb68ee40 0x5649bb68f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:28.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.108+0000 7fe9ff630800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5649bb660240 con 0x5649bb68ee40 2024-09-18T01:46:28.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.108+0000 7fe9fb1d7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5649bb68ee40 0x5649bb68f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:28.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.108+0000 7fe9fb1d7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5649bb68ee40 0x5649bb68f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:55868/0 (socket says 172.21.15.146:55868) 2024-09-18T01:46:28.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.108+0000 7fe9fb1d7640 1 -- 172.21.15.146:0/1035848502 learned_addr learned my addr 172.21.15.146:0/1035848502 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:28.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.108+0000 7fe9fb1d7640 1 -- 172.21.15.146:0/1035848502 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649bb68f810 con 0x5649bb68ee40 2024-09-18T01:46:28.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.109+0000 7fe9fb1d7640 1 --2- 172.21.15.146:0/1035848502 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5649bb68ee40 0x5649bb68f240 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fe9f404c8f0 tx=0x7fe9f4001f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11cac1ebe5d8261f server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:28.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.109+0000 7fe8de7fc640 1 -- 172.21.15.146:0/1035848502 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9f404e110 con 0x5649bb68ee40 2024-09-18T01:46:28.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.109+0000 7fe8de7fc640 1 -- 172.21.15.146:0/1035848502 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9f404e2b0 con 0x5649bb68ee40 2024-09-18T01:46:28.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.109+0000 7fe8de7fc640 1 -- 172.21.15.146:0/1035848502 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9f404b250 con 0x5649bb68ee40 2024-09-18T01:46:28.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.109+0000 7fe9ff630800 1 -- 172.21.15.146:0/1035848502 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5649bb68ee40 msgr2=0x5649bb68f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.109+0000 7fe9ff630800 1 --2- 172.21.15.146:0/1035848502 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5649bb68ee40 0x5649bb68f240 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fe9f404c8f0 tx=0x7fe9f4001f40 comp rx=0 tx=0).stop 2024-09-18T01:46:28.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.109+0000 7fe9ff630800 1 -- 172.21.15.146:0/1035848502 shutdown_connections 2024-09-18T01:46:28.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.109+0000 7fe9ff630800 1 --2- 172.21.15.146:0/1035848502 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5649bb68ee40 0x5649bb68f240 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.109+0000 7fe9ff630800 1 -- 172.21.15.146:0/1035848502 >> 172.21.15.146:0/1035848502 conn(0x5649bb68b1f0 msgr2=0x5649bb6892f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:28.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.109+0000 7fe9ff630800 1 -- 172.21.15.146:0/1035848502 shutdown_connections 2024-09-18T01:46:28.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.109+0000 7fe9ff630800 1 -- 172.21.15.146:0/1035848502 wait complete. 2024-09-18T01:46:28.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.109+0000 7fe9ff630800 1 Processor -- start 2024-09-18T01:46:28.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.110+0000 7fe9ff630800 1 -- start start 2024-09-18T01:46:28.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.110+0000 7fe9ff630800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5649bb68ee40 0x5649bb6962d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:28.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.110+0000 7fe9ff630800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5649bb68fde0 con 0x5649bb68ee40 2024-09-18T01:46:28.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.110+0000 7fe9fb1d7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5649bb68ee40 0x5649bb6962d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:28.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.110+0000 7fe9fb1d7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5649bb68ee40 0x5649bb6962d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:55884/0 (socket says 172.21.15.146:55884) 2024-09-18T01:46:28.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.110+0000 7fe9fb1d7640 1 -- 172.21.15.146:0/3886333947 learned_addr learned my addr 172.21.15.146:0/3886333947 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:28.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.110+0000 7fe9fb1d7640 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649bb696810 con 0x5649bb68ee40 2024-09-18T01:46:28.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.110+0000 7fe9fb1d7640 1 --2- 172.21.15.146:0/3886333947 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5649bb68ee40 0x5649bb6962d0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fe9f4001f80 tx=0x7fe9f404c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:28.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.110+0000 7fe8dcff9640 1 -- 172.21.15.146:0/3886333947 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9f4046040 con 0x5649bb68ee40 2024-09-18T01:46:28.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.110+0000 7fe8dcff9640 1 -- 172.21.15.146:0/3886333947 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9f4041050 con 0x5649bb68ee40 2024-09-18T01:46:28.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.110+0000 7fe9ff630800 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5649bb696aa0 con 0x5649bb68ee40 2024-09-18T01:46:28.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.110+0000 7fe8dcff9640 1 -- 172.21.15.146:0/3886333947 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9f404e110 con 0x5649bb68ee40 2024-09-18T01:46:28.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.111+0000 7fe9ff630800 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649bb699750 con 0x5649bb68ee40 2024-09-18T01:46:28.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.111+0000 7fe8dcff9640 1 -- 172.21.15.146:0/3886333947 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe9f404ca30 con 0x5649bb68ee40 2024-09-18T01:46:28.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.111+0000 7fe8dcff9640 1 --2- 172.21.15.146:0/3886333947 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fe8c4036b40 0x7fe8c4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:28.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.111+0000 7fe8dcff9640 1 -- 172.21.15.146:0/3886333947 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7fe9f4034070 con 0x5649bb68ee40 2024-09-18T01:46:28.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.112+0000 7fe9fa9d6640 1 --2- 172.21.15.146:0/3886333947 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fe8c4036b40 0x7fe8c4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:28.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.112+0000 7fe9fa9d6640 1 --2- 172.21.15.146:0/3886333947 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fe8c4036b40 0x7fe8c4039000 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x5649bb670780 tx=0x7fe9ec036000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:28.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.112+0000 7fe9ff630800 20 rados->read ofs=0 len=0 2024-09-18T01:46:28.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.112+0000 7fe9ff630800 1 --2- 172.21.15.146:0/3886333947 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5649bb6a1f20 0x5649bb6a43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:28.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.112+0000 7fe9ff630800 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6a4b30 con 0x5649bb6a1f20 2024-09-18T01:46:28.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.112+0000 7fe9f3fff640 1 --2- 172.21.15.146:0/3886333947 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5649bb6a1f20 0x5649bb6a43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:28.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.113+0000 7fe9f3fff640 1 --2- 172.21.15.146:0/3886333947 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5649bb6a1f20 0x5649bb6a43e0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:28.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.113+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe9e4051070 con 0x5649bb6a1f20 2024-09-18T01:46:28.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.113+0000 7fe9ff630800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:28.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.113+0000 7fe9ff630800 20 realm 2024-09-18T01:46:28.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.113+0000 7fe9ff630800 20 rados->read ofs=0 len=0 2024-09-18T01:46:28.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.113+0000 7fe9ff630800 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6a4f60 con 0x5649bb6a1f20 2024-09-18T01:46:28.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.113+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe9e4051070 con 0x5649bb6a1f20 2024-09-18T01:46:28.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.113+0000 7fe9ff630800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:28.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.113+0000 7fe9ff630800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:46:28.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.113+0000 7fe9ff630800 20 rados->read ofs=0 len=0 2024-09-18T01:46:28.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.113+0000 7fe9ff630800 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6a5830 con 0x5649bb6a1f20 2024-09-18T01:46:28.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.113+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe9e4051070 con 0x5649bb6a1f20 2024-09-18T01:46:28.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.113+0000 7fe9ff630800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:28.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.113+0000 7fe9ff630800 20 rados->read ofs=0 len=0 2024-09-18T01:46:28.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.113+0000 7fe9ff630800 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6a5bd0 con 0x5649bb6a1f20 2024-09-18T01:46:28.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.114+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe9e4051070 con 0x5649bb6a1f20 2024-09-18T01:46:28.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.114+0000 7fe9ff630800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:46:28.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.114+0000 7fe9ff630800 20 rados->read ofs=0 len=0 2024-09-18T01:46:28.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.114+0000 7fe9ff630800 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6a6420 con 0x5649bb6a1f20 2024-09-18T01:46:28.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.114+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe9e4051070 con 0x5649bb6a1f20 2024-09-18T01:46:28.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.114+0000 7fe9ff630800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:46:28.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.114+0000 7fe9ff630800 20 searching for the correct realm 2024-09-18T01:46:28.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.114+0000 7fe9ff630800 1 --2- 172.21.15.146:0/3886333947 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5649bb6a8190 0x5649bb6aa580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:28.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.114+0000 7fe9ff630800 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6aabb0 con 0x5649bb6a8190 2024-09-18T01:46:28.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.114+0000 7fe9fb1d7640 1 --2- 172.21.15.146:0/3886333947 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5649bb6a8190 0x5649bb6aa580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:28.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.114+0000 7fe9fb1d7640 1 --2- 172.21.15.146:0/3886333947 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5649bb6a8190 0x5649bb6aa580 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:28.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.115+0000 7fe9fb1d7640 1 -- 172.21.15.146:0/3886333947 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9f403e020 con 0x5649bb6a8190 2024-09-18T01:46:28.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.115+0000 7fe9fb1d7640 1 --2- 172.21.15.146:0/3886333947 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fe9f40123a0 0x7fe9f4007050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:28.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.115+0000 7fe9fb1d7640 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6aabb0 con 0x7fe9f40123a0 2024-09-18T01:46:28.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.115+0000 7fe9fa9d6640 1 --2- 172.21.15.146:0/3886333947 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fe9f40123a0 0x7fe9f4007050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:28.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.115+0000 7fe9fa9d6640 1 --2- 172.21.15.146:0/3886333947 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fe9f40123a0 0x7fe9f4007050 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:28.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.115+0000 7fe9fa9d6640 1 -- 172.21.15.146:0/3886333947 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9ec034030 con 0x7fe9f40123a0 2024-09-18T01:46:28.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.115+0000 7fe9fa9d6640 1 --2- 172.21.15.146:0/3886333947 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fe9ec017050 0x7fe9ec04c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:28.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.115+0000 7fe9fa9d6640 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6aabb0 con 0x7fe9ec017050 2024-09-18T01:46:28.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.115+0000 7fe9f3fff640 1 --2- 172.21.15.146:0/3886333947 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fe9ec017050 0x7fe9ec04c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:28.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.116+0000 7fe9f3fff640 1 --2- 172.21.15.146:0/3886333947 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fe9ec017050 0x7fe9ec04c130 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:28.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.116+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9e4051070 con 0x7fe9ec017050 2024-09-18T01:46:28.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.116+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6aabb0 con 0x5649bb6a1f20 2024-09-18T01:46:28.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.116+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe9e4051070 con 0x5649bb6a1f20 2024-09-18T01:46:28.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.116+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6aabb0 con 0x5649bb6a1f20 2024-09-18T01:46:28.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.117+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9e4051070 con 0x5649bb6a1f20 2024-09-18T01:46:28.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.117+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6aabb0 con 0x7fe9ec017050 2024-09-18T01:46:28.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.117+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9e4051070 con 0x7fe9ec017050 2024-09-18T01:46:28.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.117+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6aabb0 con 0x7fe9ec017050 2024-09-18T01:46:28.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.117+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9e4051070 con 0x7fe9ec017050 2024-09-18T01:46:28.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.117+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6aabb0 con 0x7fe9f40123a0 2024-09-18T01:46:28.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.117+0000 7fe9fa9d6640 1 -- 172.21.15.146:0/3886333947 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9ec034030 con 0x7fe9f40123a0 2024-09-18T01:46:28.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.117+0000 7fe9fa9d6640 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6aabb0 con 0x5649bb6a8190 2024-09-18T01:46:28.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.118+0000 7fe9fb1d7640 1 -- 172.21.15.146:0/3886333947 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9f403e020 con 0x5649bb6a8190 2024-09-18T01:46:28.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.118+0000 7fe9fb1d7640 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6aabb0 con 0x5649bb6a1f20 2024-09-18T01:46:28.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.118+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9e4051070 con 0x5649bb6a1f20 2024-09-18T01:46:28.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.118+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6aabb0 con 0x7fe9ec017050 2024-09-18T01:46:28.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.118+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9e4051070 con 0x7fe9ec017050 2024-09-18T01:46:28.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.118+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6aabb0 con 0x5649bb6a1f20 2024-09-18T01:46:28.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.118+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9e4051070 con 0x5649bb6a1f20 2024-09-18T01:46:28.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.118+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6aabb0 con 0x7fe9f40123a0 2024-09-18T01:46:28.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.118+0000 7fe9fa9d6640 1 -- 172.21.15.146:0/3886333947 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fe9ec034030 con 0x7fe9f40123a0 2024-09-18T01:46:28.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.118+0000 7fe9fa9d6640 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6aabb0 con 0x5649bb6a8190 2024-09-18T01:46:28.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.119+0000 7fe9fb1d7640 1 -- 172.21.15.146:0/3886333947 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9f403e020 con 0x5649bb6a8190 2024-09-18T01:46:28.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.119+0000 7fe9fb1d7640 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6aabb0 con 0x5649bb6a8190 2024-09-18T01:46:28.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.119+0000 7fe9fb1d7640 1 -- 172.21.15.146:0/3886333947 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9f403e020 con 0x5649bb6a8190 2024-09-18T01:46:28.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.119+0000 7fe9fb1d7640 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6aabb0 con 0x7fe9ec017050 2024-09-18T01:46:28.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.119+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9e4051070 con 0x7fe9ec017050 2024-09-18T01:46:28.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.119+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6aabb0 con 0x5649bb6a8190 2024-09-18T01:46:28.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.119+0000 7fe9fb1d7640 1 -- 172.21.15.146:0/3886333947 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9f403e020 con 0x5649bb6a8190 2024-09-18T01:46:28.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.119+0000 7fe9fb1d7640 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6aabb0 con 0x5649bb6a8190 2024-09-18T01:46:28.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.120+0000 7fe9fb1d7640 1 -- 172.21.15.146:0/3886333947 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9f403e020 con 0x5649bb6a8190 2024-09-18T01:46:28.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.120+0000 7fe9fb1d7640 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6aabb0 con 0x5649bb6a1f20 2024-09-18T01:46:28.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.120+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9e4051070 con 0x5649bb6a1f20 2024-09-18T01:46:28.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.120+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6aabb0 con 0x5649bb6a1f20 2024-09-18T01:46:28.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.120+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe9e4051070 con 0x5649bb6a1f20 2024-09-18T01:46:28.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.120+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6aabb0 con 0x7fe9ec017050 2024-09-18T01:46:28.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.120+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9e4051070 con 0x7fe9ec017050 2024-09-18T01:46:28.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.120+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6aabb0 con 0x5649bb6a8190 2024-09-18T01:46:28.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.121+0000 7fe9fb1d7640 1 -- 172.21.15.146:0/3886333947 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9f403e020 con 0x5649bb6a8190 2024-09-18T01:46:28.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.121+0000 7fe9fb1d7640 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6aabb0 con 0x7fe9f40123a0 2024-09-18T01:46:28.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.121+0000 7fe9fa9d6640 1 -- 172.21.15.146:0/3886333947 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9ec034030 con 0x7fe9f40123a0 2024-09-18T01:46:28.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.121+0000 7fe9fa9d6640 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6aabb0 con 0x5649bb6a1f20 2024-09-18T01:46:28.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.121+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9e4051070 con 0x5649bb6a1f20 2024-09-18T01:46:28.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.121+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6aabb0 con 0x7fe9ec017050 2024-09-18T01:46:28.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.121+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9e4051070 con 0x7fe9ec017050 2024-09-18T01:46:28.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.121+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6aabb0 con 0x5649bb6a8190 2024-09-18T01:46:28.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.122+0000 7fe9fb1d7640 1 -- 172.21.15.146:0/3886333947 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9f403e020 con 0x5649bb6a8190 2024-09-18T01:46:28.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.122+0000 7fe9fb1d7640 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6aabb0 con 0x7fe9ec017050 2024-09-18T01:46:28.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.122+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9e4051070 con 0x7fe9ec017050 2024-09-18T01:46:28.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.122+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6aabb0 con 0x7fe9f40123a0 2024-09-18T01:46:28.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.122+0000 7fe9fa9d6640 1 -- 172.21.15.146:0/3886333947 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9ec034030 con 0x7fe9f40123a0 2024-09-18T01:46:28.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.122+0000 7fe9fa9d6640 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6aabb0 con 0x5649bb6a8190 2024-09-18T01:46:28.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.122+0000 7fe9fb1d7640 1 -- 172.21.15.146:0/3886333947 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9f403e020 con 0x5649bb6a8190 2024-09-18T01:46:28.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.122+0000 7fe9fb1d7640 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6aabb0 con 0x7fe9ec017050 2024-09-18T01:46:28.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.123+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9e4051070 con 0x7fe9ec017050 2024-09-18T01:46:28.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.123+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6aabb0 con 0x5649bb6a1f20 2024-09-18T01:46:28.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.123+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe9e4051070 con 0x5649bb6a1f20 2024-09-18T01:46:28.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.123+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6aabb0 con 0x7fe9f40123a0 2024-09-18T01:46:28.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.123+0000 7fe9fa9d6640 1 -- 172.21.15.146:0/3886333947 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9ec060040 con 0x7fe9f40123a0 2024-09-18T01:46:28.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.124+0000 7fe9ff630800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:46:28.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.124+0000 7fe9ff630800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:46:28.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.124+0000 7fe9ff630800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:46:28.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.124+0000 7fe9ff630800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:46:28.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.124+0000 7fe9ff630800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:46:28.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.124+0000 7fe9ff630800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:46:28.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.124+0000 7fe9ff630800 20 rados->read ofs=0 len=0 2024-09-18T01:46:28.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.124+0000 7fe9ff630800 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6a6dd0 con 0x5649bb6a1f20 2024-09-18T01:46:28.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.124+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe9e4051070 con 0x5649bb6a1f20 2024-09-18T01:46:28.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.124+0000 7fe9ff630800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:28.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.124+0000 7fe9ff630800 20 rados->read ofs=0 len=0 2024-09-18T01:46:28.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.124+0000 7fe9ff630800 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6a7670 con 0x5649bb6a1f20 2024-09-18T01:46:28.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.124+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe9e4051070 con 0x5649bb6a1f20 2024-09-18T01:46:28.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.124+0000 7fe9ff630800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:46:28.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.124+0000 7fe9ff630800 20 rados->read ofs=0 len=0 2024-09-18T01:46:28.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.124+0000 7fe9ff630800 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6ab030 con 0x7fe9f40123a0 2024-09-18T01:46:28.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.124+0000 7fe9fa9d6640 1 -- 172.21.15.146:0/3886333947 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe9ec060040 con 0x7fe9f40123a0 2024-09-18T01:46:28.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.124+0000 7fe9ff630800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:46:28.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.124+0000 7fe9ff630800 20 zone default found 2024-09-18T01:46:28.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.124+0000 7fe9ff630800 4 Realm: () 2024-09-18T01:46:28.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.124+0000 7fe9ff630800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:46:28.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.124+0000 7fe9ff630800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:46:28.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.124+0000 7fe9ff630800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:46:28.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.124+0000 7fe9ff630800 20 zonegroup default 2024-09-18T01:46:28.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.124+0000 7fe9ff630800 20 rados->read ofs=0 len=0 2024-09-18T01:46:28.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.124+0000 7fe9ff630800 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6ab880 con 0x7fe9ec017050 2024-09-18T01:46:28.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.125+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe9e4051070 con 0x7fe9ec017050 2024-09-18T01:46:28.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.125+0000 7fe9ff630800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:28.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.125+0000 7fe9ff630800 20 rados->read ofs=0 len=0 2024-09-18T01:46:28.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.125+0000 7fe9ff630800 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6ad260 con 0x5649bb6a8190 2024-09-18T01:46:28.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.125+0000 7fe9fb1d7640 1 -- 172.21.15.146:0/3886333947 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe9f403e020 con 0x5649bb6a8190 2024-09-18T01:46:28.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.125+0000 7fe9ff630800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:28.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.125+0000 7fe9ff630800 20 rados->read ofs=0 len=0 2024-09-18T01:46:28.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.125+0000 7fe9ff630800 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6ad770 con 0x5649bb6a8190 2024-09-18T01:46:28.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.125+0000 7fe9fb1d7640 1 -- 172.21.15.146:0/3886333947 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe9f403e020 con 0x5649bb6a8190 2024-09-18T01:46:28.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.125+0000 7fe9ff630800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:28.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.125+0000 7fe9ff630800 20 started sync module instance, tier type = 2024-09-18T01:46:28.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.125+0000 7fe9ff630800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:46:28.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.125+0000 7fe9ff630800 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6ac6f0 con 0x7fe9f40123a0 2024-09-18T01:46:28.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.126+0000 7fe9fa9d6640 1 -- 172.21.15.146:0/3886333947 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v33'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9ec060040 con 0x7fe9f40123a0 2024-09-18T01:46:28.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.126+0000 7fe9ff630800 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94874676939488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6ae080 con 0x7fe9f40123a0 2024-09-18T01:46:28.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.126+0000 7fe9ff630800 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6ae8d0 con 0x5649bb6a1f20 2024-09-18T01:46:28.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.127+0000 7fe9fa9d6640 1 -- 172.21.15.146:0/3886333947 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94874676939488] v33'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9ec060040 con 0x7fe9f40123a0 2024-09-18T01:46:28.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.128+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v33'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9e4051070 con 0x5649bb6a1f20 2024-09-18T01:46:28.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.128+0000 7fe9ff630800 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94874676943824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6ae8d0 con 0x5649bb6a1f20 2024-09-18T01:46:28.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.128+0000 7fe9ff630800 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6af390 con 0x5649bb6a8190 2024-09-18T01:46:28.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.129+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94874676943824] v33'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9e4051070 con 0x5649bb6a1f20 2024-09-18T01:46:28.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.129+0000 7fe9fb1d7640 1 -- 172.21.15.146:0/3886333947 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v33'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9f403e020 con 0x5649bb6a8190 2024-09-18T01:46:28.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.129+0000 7fe9ff630800 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94874676948576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6ae8d0 con 0x5649bb6a8190 2024-09-18T01:46:28.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.129+0000 7fe9ff630800 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6afe00 con 0x7fe9f40123a0 2024-09-18T01:46:28.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.130+0000 7fe9fb1d7640 1 -- 172.21.15.146:0/3886333947 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94874676948576] v33'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9f403e020 con 0x5649bb6a8190 2024-09-18T01:46:28.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.130+0000 7fe9fa9d6640 1 -- 172.21.15.146:0/3886333947 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v33'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9ec060040 con 0x7fe9f40123a0 2024-09-18T01:46:28.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.130+0000 7fe9ff630800 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94874676945952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6ae840 con 0x7fe9f40123a0 2024-09-18T01:46:28.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.130+0000 7fe9ff630800 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6b0cf0 con 0x5649bb6a1f20 2024-09-18T01:46:28.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.131+0000 7fe9fa9d6640 1 -- 172.21.15.146:0/3886333947 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94874676945952] v33'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9ec060040 con 0x7fe9f40123a0 2024-09-18T01:46:28.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.132+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v33'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9e4051070 con 0x5649bb6a1f20 2024-09-18T01:46:28.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.132+0000 7fe9ff630800 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94874676955200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6b0c60 con 0x5649bb6a1f20 2024-09-18T01:46:28.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.132+0000 7fe9ff630800 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6b1bb0 con 0x7fe9ec017050 2024-09-18T01:46:28.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.133+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v33'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9e4051070 con 0x7fe9ec017050 2024-09-18T01:46:28.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.133+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94874676955200] v33'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9e4051070 con 0x5649bb6a1f20 2024-09-18T01:46:28.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.133+0000 7fe9ff630800 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94874676958976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6b1fd0 con 0x7fe9ec017050 2024-09-18T01:46:28.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.133+0000 7fe9ff630800 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6b10e0 con 0x7fe9ec017050 2024-09-18T01:46:28.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.134+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(56 notify.6 [create] v33'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9e4051070 con 0x7fe9ec017050 2024-09-18T01:46:28.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.134+0000 7fe9ff630800 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94874676957408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6b29f0 con 0x7fe9ec017050 2024-09-18T01:46:28.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.134+0000 7fe9ff630800 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6b3460 con 0x7fe9ec017050 2024-09-18T01:46:28.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.134+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94874676958976] v33'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9e4051070 con 0x7fe9ec017050 2024-09-18T01:46:28.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.135+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94874676957408] v33'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9e4051070 con 0x7fe9ec017050 2024-09-18T01:46:28.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.135+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v33'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9e4051070 con 0x7fe9ec017050 2024-09-18T01:46:28.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.135+0000 7fe9ff630800 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94874676965168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6b2540 con 0x7fe9ec017050 2024-09-18T01:46:28.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.135+0000 7fe9ff630800 20 add_watcher() i=0 2024-09-18T01:46:28.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.135+0000 7fe9ff630800 20 add_watcher() i=1 2024-09-18T01:46:28.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.135+0000 7fe9ff630800 20 add_watcher() i=2 2024-09-18T01:46:28.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.135+0000 7fe9ff630800 20 add_watcher() i=3 2024-09-18T01:46:28.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.135+0000 7fe9ff630800 20 add_watcher() i=4 2024-09-18T01:46:28.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.135+0000 7fe9ff630800 20 add_watcher() i=5 2024-09-18T01:46:28.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.135+0000 7fe9ff630800 20 add_watcher() i=6 2024-09-18T01:46:28.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.135+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94874676965168] v33'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9e4051070 con 0x7fe9ec017050 2024-09-18T01:46:28.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.135+0000 7fe9ff630800 20 add_watcher() i=7 2024-09-18T01:46:28.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.135+0000 7fe9ff630800 2 all 8 watchers are set, enabling cache 2024-09-18T01:46:28.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.136+0000 7fe9ff630800 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6b6560 con 0x5649bb6a1f20 2024-09-18T01:46:28.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.136+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe9e4051070 con 0x5649bb6a1f20 2024-09-18T01:46:28.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.136+0000 7fe9ff630800 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94874676960032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6b39e0 con 0x5649bb6a1f20 2024-09-18T01:46:28.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.137+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94874676960032] v33'222 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe9e4051070 con 0x5649bb6a1f20 2024-09-18T01:46:28.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.137+0000 7fe8b17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:46:28.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.137+0000 7fe9ff630800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:46:28.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.137+0000 7fe9ff630800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:46:28.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.137+0000 7fe9ff630800 5 note: GC not initialized 2024-09-18T01:46:28.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.137+0000 7fe82bfff640 20 reqs_thread_entry: start 2024-09-18T01:46:28.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.137+0000 7fe9ff630800 20 init_complete bucket index max shards: 11 2024-09-18T01:46:28.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.137+0000 7fe9ff630800 20 Filter name: none 2024-09-18T01:46:28.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.138+0000 7fe829ffb640 20 reqs_thread_entry: start 2024-09-18T01:46:28.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.138+0000 7fe9ff630800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-18T01:46:28.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.138+0000 7fe9ff630800 20 rados->read ofs=0 len=0 2024-09-18T01:46:28.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.138+0000 7fe9ff630800 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:62 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6e96a0 con 0x7fe9f40123a0 2024-09-18T01:46:28.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.138+0000 7fe9fa9d6640 1 -- 172.21.15.146:0/3886333947 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(62 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fe9ec060040 con 0x7fe9f40123a0 2024-09-18T01:46:28.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.138+0000 7fe9ff630800 20 rados_obj.operate() r=0 bl.length=380 2024-09-18T01:46:28.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.138+0000 7fe9ff630800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-18T01:46:28.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.138+0000 7fe9ff630800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-18T01:46:28.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.138+0000 7fe9ff630800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:46:28.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.138+0000 7fe9ff630800 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:63 8.e 8:75f48285:users.uid::fud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6edac0 con 0x7fe9ec017050 2024-09-18T01:46:28.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.139+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(63 fud [create,call,writefull 0~206] v33'10 uv9 ondisk = -17 ((17) File exists)) ==== 231+0+0 (crc 0 0 0) 0x7fe9e4051070 con 0x7fe9ec017050 2024-09-18T01:46:28.148 INFO:teuthology.orchestra.run.smithi146.stderr:could not rename user: unable to rename user, user name given by --new-uid already exists. to overwrite this user, add --yes-i-really-mean-it 2024-09-18T01:46:28.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.140+0000 7fe8b17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:46:28.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.140+0000 7fe9ff630800 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94874676960032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6e73f0 con 0x5649bb6a1f20 2024-09-18T01:46:28.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.141+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94874676960032] v33'223 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe9e4051070 con 0x5649bb6a1f20 2024-09-18T01:46:28.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.141+0000 7fe9ff630800 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94874676939488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6e73f0 con 0x7fe9f40123a0 2024-09-18T01:46:28.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.142+0000 7fe9fa9d6640 1 -- 172.21.15.146:0/3886333947 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94874676939488] v33'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9ec060040 con 0x7fe9f40123a0 2024-09-18T01:46:28.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.142+0000 7fe9ff630800 20 remove_watcher() i=0 2024-09-18T01:46:28.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.142+0000 7fe9ff630800 2 removed watcher, disabling cache 2024-09-18T01:46:28.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.142+0000 7fe9ff630800 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94874676943824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6e73f0 con 0x5649bb6a1f20 2024-09-18T01:46:28.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.143+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94874676943824] v33'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9e4051070 con 0x5649bb6a1f20 2024-09-18T01:46:28.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.143+0000 7fe9ff630800 20 remove_watcher() i=1 2024-09-18T01:46:28.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.143+0000 7fe9ff630800 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94874676948576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6e73f0 con 0x5649bb6a8190 2024-09-18T01:46:28.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.144+0000 7fe9fb1d7640 1 -- 172.21.15.146:0/3886333947 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94874676948576] v33'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9f403e020 con 0x5649bb6a8190 2024-09-18T01:46:28.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.144+0000 7fe9ff630800 20 remove_watcher() i=2 2024-09-18T01:46:28.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.144+0000 7fe9ff630800 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94874676945952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6e73f0 con 0x7fe9f40123a0 2024-09-18T01:46:28.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.145+0000 7fe9fa9d6640 1 -- 172.21.15.146:0/3886333947 <== osd.2 v2:172.21.15.146:6800/3820039304 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94874676945952] v33'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9ec060040 con 0x7fe9f40123a0 2024-09-18T01:46:28.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.145+0000 7fe9ff630800 20 remove_watcher() i=3 2024-09-18T01:46:28.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.145+0000 7fe9ff630800 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94874676955200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6e73f0 con 0x5649bb6a1f20 2024-09-18T01:46:28.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.146+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94874676955200] v33'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9e4051070 con 0x5649bb6a1f20 2024-09-18T01:46:28.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.146+0000 7fe9ff630800 20 remove_watcher() i=4 2024-09-18T01:46:28.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.146+0000 7fe9ff630800 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94874676958976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6e73f0 con 0x7fe9ec017050 2024-09-18T01:46:28.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.147+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94874676958976] v33'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9e4051070 con 0x7fe9ec017050 2024-09-18T01:46:28.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.147+0000 7fe9ff630800 20 remove_watcher() i=5 2024-09-18T01:46:28.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.147+0000 7fe9ff630800 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94874676957408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6e73f0 con 0x7fe9ec017050 2024-09-18T01:46:28.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.148+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94874676957408] v33'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9e4051070 con 0x7fe9ec017050 2024-09-18T01:46:28.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.148+0000 7fe9ff630800 20 remove_watcher() i=6 2024-09-18T01:46:28.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.148+0000 7fe9ff630800 1 -- 172.21.15.146:0/3886333947 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94874676965168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5649bb6e73f0 con 0x7fe9ec017050 2024-09-18T01:46:28.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.149+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94874676965168] v33'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9e4051070 con 0x7fe9ec017050 2024-09-18T01:46:28.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.149+0000 7fe9ff630800 20 remove_watcher() i=7 2024-09-18T01:46:28.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.149+0000 7fe9ff630800 1 -- 172.21.15.146:0/3886333947 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fe9ec017050 msgr2=0x7fe9ec04c130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.149+0000 7fe9ff630800 1 --2- 172.21.15.146:0/3886333947 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fe9ec017050 0x7fe9ec04c130 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.149+0000 7fe9ff630800 1 -- 172.21.15.146:0/3886333947 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5649bb6a1f20 msgr2=0x5649bb6a43e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.149+0000 7fe9ff630800 1 --2- 172.21.15.146:0/3886333947 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5649bb6a1f20 0x5649bb6a43e0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.149+0000 7fe9ff630800 1 -- 172.21.15.146:0/3886333947 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fe9f40123a0 msgr2=0x7fe9f4007050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.149+0000 7fe9ff630800 1 --2- 172.21.15.146:0/3886333947 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fe9f40123a0 0x7fe9f4007050 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.149+0000 7fe9ff630800 1 -- 172.21.15.146:0/3886333947 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5649bb6a8190 msgr2=0x5649bb6aa580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.149+0000 7fe9ff630800 1 --2- 172.21.15.146:0/3886333947 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5649bb6a8190 0x5649bb6aa580 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.150+0000 7fe9ff630800 1 -- 172.21.15.146:0/3886333947 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fe8c4036b40 msgr2=0x7fe8c4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.150+0000 7fe9ff630800 1 --2- 172.21.15.146:0/3886333947 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fe8c4036b40 0x7fe8c4039000 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x5649bb670780 tx=0x7fe9ec036000 comp rx=0 tx=0).stop 2024-09-18T01:46:28.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.150+0000 7fe9ff630800 1 -- 172.21.15.146:0/3886333947 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5649bb68ee40 msgr2=0x5649bb6962d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.150+0000 7fe9f3fff640 1 -- 172.21.15.146:0/3886333947 reap_dead start 2024-09-18T01:46:28.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.150+0000 7fe9ff630800 1 --2- 172.21.15.146:0/3886333947 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5649bb68ee40 0x5649bb6962d0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fe9f4001f80 tx=0x7fe9f404c880 comp rx=0 tx=0).stop 2024-09-18T01:46:28.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.150+0000 7fe9ff630800 1 -- 172.21.15.146:0/3886333947 shutdown_connections 2024-09-18T01:46:28.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.150+0000 7fe9ff630800 1 --2- 172.21.15.146:0/3886333947 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5649bb68ee40 0x5649bb6962d0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.150+0000 7fe9ff630800 1 -- 172.21.15.146:0/3886333947 >> 172.21.15.146:0/3886333947 conn(0x5649bb68b1f0 msgr2=0x5649bb690550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:28.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.150+0000 7fe9ff630800 1 -- 172.21.15.146:0/3886333947 shutdown_connections 2024-09-18T01:46:28.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.150+0000 7fe9ff630800 1 -- 172.21.15.146:0/3886333947 wait complete. 2024-09-18T01:46:28.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.150+0000 7fe9ff630800 1 -- 172.21.15.146:0/4145386378 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fe8d4036b40 msgr2=0x7fe8d4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.150+0000 7fe9ff630800 1 --2- 172.21.15.146:0/4145386378 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fe8d4036b40 0x7fe8d4039000 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec001750 tx=0x7fe9ec024000 comp rx=0 tx=0).stop 2024-09-18T01:46:28.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.150+0000 7fe9ff630800 1 -- 172.21.15.146:0/4145386378 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5649bb682180 msgr2=0x5649bb6825a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.150+0000 7fe9ff630800 1 --2- 172.21.15.146:0/4145386378 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5649bb682180 0x5649bb6825a0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x5649bb668870 tx=0x7fe9f40178e0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.150+0000 7fe9ff630800 1 -- 172.21.15.146:0/4145386378 shutdown_connections 2024-09-18T01:46:28.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.150+0000 7fe9ff630800 1 --2- 172.21.15.146:0/4145386378 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fe8d4036b40 0x7fe8d4039000 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.150+0000 7fe9ff630800 1 --2- 172.21.15.146:0/4145386378 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5649bb682180 0x5649bb6825a0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.150+0000 7fe9ff630800 1 -- 172.21.15.146:0/4145386378 >> 172.21.15.146:0/4145386378 conn(0x5649bb677110 msgr2=0x5649bb679c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:28.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.150+0000 7fe9ff630800 1 -- 172.21.15.146:0/4145386378 shutdown_connections 2024-09-18T01:46:28.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.150+0000 7fe9ff630800 1 -- 172.21.15.146:0/4145386378 wait complete. 2024-09-18T01:46:28.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.150+0000 7fe9ff630800 1 -- 172.21.15.146:0/4055549379 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5649bb574d20 msgr2=0x5649bb66e4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.151+0000 7fe9ff630800 1 --2- 172.21.15.146:0/4055549379 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5649bb574d20 0x5649bb66e4e0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.151+0000 7fe9ff630800 1 -- 172.21.15.146:0/4055549379 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5649bb671bd0 msgr2=0x5649bb673fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.151+0000 7fe9ff630800 1 --2- 172.21.15.146:0/4055549379 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5649bb671bd0 0x5649bb673fc0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.151+0000 7fe9ff630800 1 -- 172.21.15.146:0/4055549379 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fe8e0036b40 msgr2=0x7fe8e0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.151+0000 7fe9ff630800 1 --2- 172.21.15.146:0/4055549379 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fe8e0036b40 0x7fe8e0039000 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4057000 tx=0x7fe9e4052000 comp rx=0 tx=0).stop 2024-09-18T01:46:28.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.151+0000 7fe9ff630800 1 -- 172.21.15.146:0/4055549379 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5649bb4e2630 msgr2=0x5649bb667470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.151+0000 7fe9ff630800 1 --2- 172.21.15.146:0/4055549379 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5649bb4e2630 0x5649bb667470 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec001e10 tx=0x7fe9ec000ed0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.151+0000 7fe9ff630800 1 -- 172.21.15.146:0/4055549379 shutdown_connections 2024-09-18T01:46:28.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.151+0000 7fe9ff630800 1 --2- 172.21.15.146:0/4055549379 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5649bb671bd0 0x5649bb673fc0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.151+0000 7fe9ff630800 1 --2- 172.21.15.146:0/4055549379 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5649bb574d20 0x5649bb66e4e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.151+0000 7fe9ff630800 1 --2- 172.21.15.146:0/4055549379 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fe8e0036b40 0x7fe8e0039000 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.151+0000 7fe9ff630800 1 --2- 172.21.15.146:0/4055549379 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5649bb4e2630 0x5649bb667470 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.151+0000 7fe9ff630800 1 -- 172.21.15.146:0/4055549379 >> 172.21.15.146:0/4055549379 conn(0x5649bb568db0 msgr2=0x5649bb659d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:28.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.151+0000 7fe9ff630800 1 -- 172.21.15.146:0/4055549379 shutdown_connections 2024-09-18T01:46:28.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.151+0000 7fe9ff630800 1 -- 172.21.15.146:0/4055549379 wait complete. 2024-09-18T01:46:28.159 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-18T01:46:28.205 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-18T01:46:28.205 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-18T01:46:28.209 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-18T01:46:28.210 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=8 failed=False 2024-09-18T01:46:28.210 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-18T01:46:28.210 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-18T01:46:28.210 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud --purge-data 2024-09-18T01:46:28.255 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:46:28.255 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:46:28.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.255+0000 7f798c830800 1 Processor -- start 2024-09-18T01:46:28.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.255+0000 7f798c830800 1 -- start start 2024-09-18T01:46:28.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.255+0000 7f798c830800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55c5925f8710 0x55c5925f8b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:28.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.255+0000 7f798c830800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c5924b7b30 con 0x55c5925f9050 2024-09-18T01:46:28.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.255+0000 7f798c830800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x55c592499360 con 0x55c5925f8710 2024-09-18T01:46:28.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.256+0000 7f7987b60640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55c5925f8710 0x55c5925f8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:28.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.256+0000 7f797ffff640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x55c5925f9050 0x55c5925fda90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:49430/0 (socket says 172.21.15.146:49430) 2024-09-18T01:46:28.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.256+0000 7f7987b60640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55c5925f8710 0x55c5925f8b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:55896/0 (socket says 172.21.15.146:55896) 2024-09-18T01:46:28.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.256+0000 7f797ffff640 1 -- 172.21.15.146:0/1971629948 learned_addr learned my addr 172.21.15.146:0/1971629948 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:46:28.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.256+0000 7f7987b60640 1 -- 172.21.15.146:0/1971629948 >> v1:172.21.15.129:6789/0 conn(0x55c5925f9050 legacy=0x55c5925fda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.256+0000 7f798735f640 1 -- 172.21.15.146:0/1971629948 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 458541827 0 0) 0x55c5924b7b30 con 0x55c5925f9050 2024-09-18T01:46:28.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.256+0000 7f7987b60640 1 -- 172.21.15.146:0/1971629948 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5924bfe00 con 0x55c5925f8710 2024-09-18T01:46:28.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.258+0000 7f7987b60640 1 --2- 172.21.15.146:0/1971629948 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c5925f8710 0x55c5925f8b10 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f797800a470 tx=0x7f7978045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7213ecf92c3b33a server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:28.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.258+0000 7f798735f640 1 -- 172.21.15.146:0/1971629948 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7978053570 con 0x55c5925f8710 2024-09-18T01:46:28.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.258+0000 7f798735f640 1 -- 172.21.15.146:0/1971629948 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7978058070 con 0x55c5925f8710 2024-09-18T01:46:28.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.258+0000 7f798735f640 1 -- 172.21.15.146:0/1971629948 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7978053880 con 0x55c5925f8710 2024-09-18T01:46:28.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.258+0000 7f798c830800 1 -- 172.21.15.146:0/1971629948 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c5925f8710 msgr2=0x55c5925f8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.259+0000 7f798c830800 1 --2- 172.21.15.146:0/1971629948 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c5925f8710 0x55c5925f8b10 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f797800a470 tx=0x7f7978045a20 comp rx=0 tx=0).stop 2024-09-18T01:46:28.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.259+0000 7f798c830800 1 -- 172.21.15.146:0/1971629948 shutdown_connections 2024-09-18T01:46:28.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.259+0000 7f798c830800 1 --2- 172.21.15.146:0/1971629948 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c5925f8710 0x55c5925f8b10 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.259+0000 7f798c830800 1 -- 172.21.15.146:0/1971629948 >> 172.21.15.146:0/1971629948 conn(0x55c5925f3fe0 msgr2=0x55c5925f6400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:28.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.259+0000 7f798c830800 1 -- 172.21.15.146:0/1971629948 shutdown_connections 2024-09-18T01:46:28.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.259+0000 7f798c830800 1 -- 172.21.15.146:0/1971629948 wait complete. 2024-09-18T01:46:28.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.272+0000 7f798c830800 1 Processor -- start 2024-09-18T01:46:28.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.273+0000 7f798c830800 1 -- start start 2024-09-18T01:46:28.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.273+0000 7f798c830800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c5925f8710 0x55c5926e7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:28.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.273+0000 7f798c830800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55c592544360 con 0x55c5925f8710 2024-09-18T01:46:28.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.273+0000 7f7987b60640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c5925f8710 0x55c5926e7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:28.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.273+0000 7f7987b60640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c5925f8710 0x55c5926e7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:55908/0 (socket says 172.21.15.146:55908) 2024-09-18T01:46:28.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.273+0000 7f7987b60640 1 -- 172.21.15.146:0/1758100523 learned_addr learned my addr 172.21.15.146:0/1758100523 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:28.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.273+0000 7f7987b60640 1 -- 172.21.15.146:0/1758100523 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c592491bc0 con 0x55c5925f8710 2024-09-18T01:46:28.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.273+0000 7f7987b60640 1 --2- 172.21.15.146:0/1758100523 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c5925f8710 0x55c5926e7650 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f7978045f50 tx=0x7f7978051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40efaad569b42d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:28.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.274+0000 7f7875e0b640 1 -- 172.21.15.146:0/1758100523 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7978053c20 con 0x55c5925f8710 2024-09-18T01:46:28.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.274+0000 7f7875e0b640 1 -- 172.21.15.146:0/1758100523 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7978063030 con 0x55c5925f8710 2024-09-18T01:46:28.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.274+0000 7f7875e0b640 1 -- 172.21.15.146:0/1758100523 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7978053440 con 0x55c5925f8710 2024-09-18T01:46:28.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.274+0000 7f798c830800 1 -- 172.21.15.146:0/1758100523 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c5925f8710 msgr2=0x55c5926e7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.274+0000 7f798c830800 1 --2- 172.21.15.146:0/1758100523 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c5925f8710 0x55c5926e7650 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f7978045f50 tx=0x7f7978051000 comp rx=0 tx=0).stop 2024-09-18T01:46:28.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.274+0000 7f798c830800 1 -- 172.21.15.146:0/1758100523 shutdown_connections 2024-09-18T01:46:28.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.274+0000 7f798c830800 1 --2- 172.21.15.146:0/1758100523 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c5925f8710 0x55c5926e7650 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.274+0000 7f798c830800 1 -- 172.21.15.146:0/1758100523 >> 172.21.15.146:0/1758100523 conn(0x55c5925f3fe0 msgr2=0x55c5926e3010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:28.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.275+0000 7f798c830800 1 -- 172.21.15.146:0/1758100523 shutdown_connections 2024-09-18T01:46:28.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.275+0000 7f798c830800 1 -- 172.21.15.146:0/1758100523 wait complete. 2024-09-18T01:46:28.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.275+0000 7f798c830800 1 Processor -- start 2024-09-18T01:46:28.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.275+0000 7f798c830800 1 -- start start 2024-09-18T01:46:28.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.275+0000 7f798c830800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c5925f8710 0x55c5926eefd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:28.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.275+0000 7f798c830800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55c5925ff5f0 con 0x55c5925f8710 2024-09-18T01:46:28.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.275+0000 7f7987b60640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c5925f8710 0x55c5926eefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:28.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.275+0000 7f7987b60640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c5925f8710 0x55c5926eefd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:55910/0 (socket says 172.21.15.146:55910) 2024-09-18T01:46:28.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.275+0000 7f7987b60640 1 -- 172.21.15.146:0/1334576874 learned_addr learned my addr 172.21.15.146:0/1334576874 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:28.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.275+0000 7f7987b60640 1 -- 172.21.15.146:0/1334576874 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5924a5fe0 con 0x55c5925f8710 2024-09-18T01:46:28.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.276+0000 7f7987b60640 1 --2- 172.21.15.146:0/1334576874 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c5925f8710 0x55c5926eefd0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f7978045f20 tx=0x7f7978002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:28.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.276+0000 7f786ffff640 1 -- 172.21.15.146:0/1334576874 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7978053570 con 0x55c5925f8710 2024-09-18T01:46:28.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.276+0000 7f786ffff640 1 -- 172.21.15.146:0/1334576874 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7978053710 con 0x55c5925f8710 2024-09-18T01:46:28.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.276+0000 7f786ffff640 1 -- 172.21.15.146:0/1334576874 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7978068420 con 0x55c5925f8710 2024-09-18T01:46:28.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.276+0000 7f798c830800 1 -- 172.21.15.146:0/1334576874 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c5926ef510 con 0x55c5925f8710 2024-09-18T01:46:28.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.276+0000 7f798c830800 1 -- 172.21.15.146:0/1334576874 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5926ef9b0 con 0x55c5925f8710 2024-09-18T01:46:28.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.277+0000 7f786ffff640 1 -- 172.21.15.146:0/1334576874 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7978068610 con 0x55c5925f8710 2024-09-18T01:46:28.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.277+0000 7f786ffff640 1 --2- 172.21.15.146:0/1334576874 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7870036b40 0x7f7870039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:28.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.277+0000 7f786ffff640 1 -- 172.21.15.146:0/1334576874 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f7978070070 con 0x55c5925f8710 2024-09-18T01:46:28.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.277+0000 7f797ffff640 1 --2- 172.21.15.146:0/1334576874 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7870036b40 0x7f7870039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:28.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.277+0000 7f798c830800 1 --2- 172.21.15.146:0/1334576874 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55c5925f9050 0x55c5926f6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:28.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.277+0000 7f798c830800 1 -- 172.21.15.146:0/1334576874 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c5926f6580 con 0x55c5925f9050 2024-09-18T01:46:28.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.277+0000 7f7988361640 1 --2- 172.21.15.146:0/1334576874 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55c5925f9050 0x55c5926f6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:28.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.277+0000 7f797ffff640 1 --2- 172.21.15.146:0/1334576874 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7870036b40 0x7f7870039000 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f7970000c00 tx=0x7f79700013b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:28.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.277+0000 7f7988361640 1 --2- 172.21.15.146:0/1334576874 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55c5925f9050 0x55c5926f6040 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:28.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.278+0000 7f7988361640 1 -- 172.21.15.146:0/1334576874 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f798000a4a0 con 0x55c5925f9050 2024-09-18T01:46:28.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.278+0000 7f798c830800 1 -- 172.21.15.146:0/1334576874 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c5926f3590 con 0x55c5925f9050 2024-09-18T01:46:28.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.278+0000 7f7988361640 1 -- 172.21.15.146:0/1334576874 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f798000a4a0 con 0x55c5925f9050 2024-09-18T01:46:28.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.278+0000 7f798c830800 1 -- 172.21.15.146:0/1334576874 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c5926f7f80 con 0x55c5925f9050 2024-09-18T01:46:28.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.278+0000 7f7988361640 1 -- 172.21.15.146:0/1334576874 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f798000a4a0 con 0x55c5925f9050 2024-09-18T01:46:28.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.278+0000 7f798c830800 1 -- 172.21.15.146:0/1334576874 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c5926f6e00 con 0x55c5925f9050 2024-09-18T01:46:28.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.279+0000 7f7988361640 1 -- 172.21.15.146:0/1334576874 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f798000a4a0 con 0x55c5925f9050 2024-09-18T01:46:28.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.279+0000 7f798c830800 1 --2- 172.21.15.146:0/1334576874 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55c5926f9430 0x55c5926fb820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:28.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.279+0000 7f798c830800 1 -- 172.21.15.146:0/1334576874 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c5926fbde0 con 0x55c5926f9430 2024-09-18T01:46:28.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.279+0000 7f7987b60640 1 --2- 172.21.15.146:0/1334576874 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55c5926f9430 0x55c5926fb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:28.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.279+0000 7f7987b60640 1 --2- 172.21.15.146:0/1334576874 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55c5926f9430 0x55c5926fb820 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:28.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.279+0000 7f7987b60640 1 -- 172.21.15.146:0/1334576874 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7978051070 con 0x55c5926f9430 2024-09-18T01:46:28.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.279+0000 7f798c830800 1 Processor -- start 2024-09-18T01:46:28.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.280+0000 7f798c830800 1 -- start start 2024-09-18T01:46:28.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.280+0000 7f798c830800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c59256e780 0x55c59256cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:28.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.280+0000 7f798c830800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55c592493580 con 0x55c59256e780 2024-09-18T01:46:28.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.280+0000 7f7988361640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c59256e780 0x55c59256cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:28.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.280+0000 7f7988361640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c59256e780 0x55c59256cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:55918/0 (socket says 172.21.15.146:55918) 2024-09-18T01:46:28.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.280+0000 7f7988361640 1 -- 172.21.15.146:0/1205064145 learned_addr learned my addr 172.21.15.146:0/1205064145 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:28.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.280+0000 7f7988361640 1 -- 172.21.15.146:0/1205064145 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c59256eba0 con 0x55c59256e780 2024-09-18T01:46:28.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.281+0000 7f7988361640 1 --2- 172.21.15.146:0/1205064145 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c59256e780 0x55c59256cdd0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x55c5926f6920 tx=0x7f79800178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:28.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.281+0000 7f786d7fa640 1 -- 172.21.15.146:0/1205064145 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7980013440 con 0x55c59256e780 2024-09-18T01:46:28.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.281+0000 7f786d7fa640 1 -- 172.21.15.146:0/1205064145 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79800135e0 con 0x55c59256e780 2024-09-18T01:46:28.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.281+0000 7f798c830800 1 -- 172.21.15.146:0/1205064145 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c59256d3d0 con 0x55c59256e780 2024-09-18T01:46:28.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.281+0000 7f786d7fa640 1 -- 172.21.15.146:0/1205064145 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79800138c0 con 0x55c59256e780 2024-09-18T01:46:28.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.281+0000 7f798c830800 1 -- 172.21.15.146:0/1205064145 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c59256d8d0 con 0x55c59256e780 2024-09-18T01:46:28.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.281+0000 7f786d7fa640 1 -- 172.21.15.146:0/1205064145 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7980011040 con 0x55c59256e780 2024-09-18T01:46:28.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.282+0000 7f786d7fa640 1 --2- 172.21.15.146:0/1205064145 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7860036b40 0x7f7860039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:28.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.282+0000 7f786d7fa640 1 -- 172.21.15.146:0/1205064145 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f798001d070 con 0x55c59256e780 2024-09-18T01:46:28.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.282+0000 7f7987b60640 1 --2- 172.21.15.146:0/1205064145 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7860036b40 0x7f7860039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:28.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.282+0000 7f798c830800 1 Processor -- start 2024-09-18T01:46:28.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.282+0000 7f798c830800 1 -- start start 2024-09-18T01:46:28.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.282+0000 7f7987b60640 1 --2- 172.21.15.146:0/1205064145 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7860036b40 0x7f7860039000 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x55c5926f79a0 tx=0x7f797808f0e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:28.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.282+0000 7f798c830800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c5927189d0 0x55c592718dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:28.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.282+0000 7f798c830800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55c5926e7da0 con 0x55c5927189d0 2024-09-18T01:46:28.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.282+0000 7f7988361640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c5927189d0 0x55c592718dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:28.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.282+0000 7f7988361640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c5927189d0 0x55c592718dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:55922/0 (socket says 172.21.15.146:55922) 2024-09-18T01:46:28.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.282+0000 7f7988361640 1 -- 172.21.15.146:0/31729733 learned_addr learned my addr 172.21.15.146:0/31729733 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:28.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.283+0000 7f7988361640 1 -- 172.21.15.146:0/31729733 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5927193a0 con 0x55c5927189d0 2024-09-18T01:46:28.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.283+0000 7f7988361640 1 --2- 172.21.15.146:0/31729733 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c5927189d0 0x55c592718dd0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f798004c9f0 tx=0x7f798004cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1467ff309da5ec1a server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:28.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.283+0000 7f7866ffd640 1 -- 172.21.15.146:0/31729733 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f798004a020 con 0x55c5927189d0 2024-09-18T01:46:28.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.283+0000 7f7866ffd640 1 -- 172.21.15.146:0/31729733 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7980015560 con 0x55c5927189d0 2024-09-18T01:46:28.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.283+0000 7f7866ffd640 1 -- 172.21.15.146:0/31729733 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f798002a480 con 0x55c5927189d0 2024-09-18T01:46:28.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.283+0000 7f798c830800 1 -- 172.21.15.146:0/31729733 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c5927189d0 msgr2=0x55c592718dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.283+0000 7f798c830800 1 --2- 172.21.15.146:0/31729733 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c5927189d0 0x55c592718dd0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f798004c9f0 tx=0x7f798004cca0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.283+0000 7f798c830800 1 -- 172.21.15.146:0/31729733 shutdown_connections 2024-09-18T01:46:28.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.283+0000 7f798c830800 1 --2- 172.21.15.146:0/31729733 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c5927189d0 0x55c592718dd0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.283+0000 7f798c830800 1 -- 172.21.15.146:0/31729733 >> 172.21.15.146:0/31729733 conn(0x55c592714d80 msgr2=0x55c592712e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:28.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.283+0000 7f798c830800 1 -- 172.21.15.146:0/31729733 shutdown_connections 2024-09-18T01:46:28.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.283+0000 7f798c830800 1 -- 172.21.15.146:0/31729733 wait complete. 2024-09-18T01:46:28.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.284+0000 7f798c830800 1 Processor -- start 2024-09-18T01:46:28.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.284+0000 7f798c830800 1 -- start start 2024-09-18T01:46:28.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.284+0000 7f798c830800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c5927189d0 0x55c59271fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:28.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.284+0000 7f798c830800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55c592719970 con 0x55c5927189d0 2024-09-18T01:46:28.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.284+0000 7f7988361640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c5927189d0 0x55c59271fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:28.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.284+0000 7f7988361640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c5927189d0 0x55c59271fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:55930/0 (socket says 172.21.15.146:55930) 2024-09-18T01:46:28.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.284+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 learned_addr learned my addr 172.21.15.146:0/2896098109 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:28.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.284+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5927203a0 con 0x55c5927189d0 2024-09-18T01:46:28.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.285+0000 7f7988361640 1 --2- 172.21.15.146:0/2896098109 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c5927189d0 0x55c59271fe60 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f798004c9f0 tx=0x7f798004c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:28.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.285+0000 7f78657fa640 1 -- 172.21.15.146:0/2896098109 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7980039070 con 0x55c5927189d0 2024-09-18T01:46:28.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.285+0000 7f78657fa640 1 -- 172.21.15.146:0/2896098109 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f798002a8c0 con 0x55c5927189d0 2024-09-18T01:46:28.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.285+0000 7f78657fa640 1 -- 172.21.15.146:0/2896098109 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7980045040 con 0x55c5927189d0 2024-09-18T01:46:28.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.285+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c592720630 con 0x55c5927189d0 2024-09-18T01:46:28.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.285+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5927232e0 con 0x55c5927189d0 2024-09-18T01:46:28.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.285+0000 7f78657fa640 1 -- 172.21.15.146:0/2896098109 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f798003c070 con 0x55c5927189d0 2024-09-18T01:46:28.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.286+0000 7f78657fa640 1 --2- 172.21.15.146:0/2896098109 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7850036b90 0x7f7850039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:28.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.286+0000 7f78657fa640 1 -- 172.21.15.146:0/2896098109 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f798004ce00 con 0x55c5927189d0 2024-09-18T01:46:28.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.286+0000 7f7987b60640 1 --2- 172.21.15.146:0/2896098109 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7850036b90 0x7f7850039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:28.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.286+0000 7f7987b60640 1 --2- 172.21.15.146:0/2896098109 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7850036b90 0x7f7850039050 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x55c5926fc1c0 tx=0x7f7978089000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:28.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.286+0000 7f798c830800 20 rados->read ofs=0 len=0 2024-09-18T01:46:28.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.287+0000 7f798c830800 1 --2- 172.21.15.146:0/2896098109 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55c59272bac0 0x55c59272df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:28.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.287+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c59272e6d0 con 0x55c59272bac0 2024-09-18T01:46:28.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.287+0000 7f797ffff640 1 --2- 172.21.15.146:0/2896098109 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55c59272bac0 0x55c59272df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:28.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.287+0000 7f797ffff640 1 --2- 172.21.15.146:0/2896098109 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55c59272bac0 0x55c59272df80 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:28.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.287+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f797000f5f0 con 0x55c59272bac0 2024-09-18T01:46:28.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.287+0000 7f798c830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:28.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.287+0000 7f798c830800 20 realm 2024-09-18T01:46:28.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.287+0000 7f798c830800 20 rados->read ofs=0 len=0 2024-09-18T01:46:28.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.287+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c59272af10 con 0x55c59272bac0 2024-09-18T01:46:28.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.287+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f797000f5f0 con 0x55c59272bac0 2024-09-18T01:46:28.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.287+0000 7f798c830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:28.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.287+0000 7f798c830800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:46:28.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.287+0000 7f798c830800 20 rados->read ofs=0 len=0 2024-09-18T01:46:28.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.287+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c59272f1c0 con 0x55c59272bac0 2024-09-18T01:46:28.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.288+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f797000f5f0 con 0x55c59272bac0 2024-09-18T01:46:28.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.288+0000 7f798c830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:28.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.288+0000 7f798c830800 20 rados->read ofs=0 len=0 2024-09-18T01:46:28.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.288+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c59272fa90 con 0x55c59272bac0 2024-09-18T01:46:28.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.288+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f797000f5f0 con 0x55c59272bac0 2024-09-18T01:46:28.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.288+0000 7f798c830800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:46:28.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.288+0000 7f798c830800 20 rados->read ofs=0 len=0 2024-09-18T01:46:28.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.288+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c59272fe30 con 0x55c59272bac0 2024-09-18T01:46:28.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.288+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f797000f5f0 con 0x55c59272bac0 2024-09-18T01:46:28.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.288+0000 7f798c830800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:46:28.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.288+0000 7f798c830800 20 searching for the correct realm 2024-09-18T01:46:28.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.288+0000 7f798c830800 1 --2- 172.21.15.146:0/2896098109 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55c592731d60 0x55c592734170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:28.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.288+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c592734840 con 0x55c592731d60 2024-09-18T01:46:28.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.289+0000 7f7988361640 1 --2- 172.21.15.146:0/2896098109 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55c592731d60 0x55c592734170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:28.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.289+0000 7f7988361640 1 --2- 172.21.15.146:0/2896098109 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55c592731d60 0x55c592734170 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:28.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.289+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f798003b030 con 0x55c592731d60 2024-09-18T01:46:28.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.289+0000 7f7988361640 1 --2- 172.21.15.146:0/2896098109 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f798004ebb0 0x7f798002c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:28.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.289+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c592734840 con 0x7f798004ebb0 2024-09-18T01:46:28.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.289+0000 7f7987b60640 1 --2- 172.21.15.146:0/2896098109 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f798004ebb0 0x7f798002c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:28.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.290+0000 7f7987b60640 1 --2- 172.21.15.146:0/2896098109 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f798004ebb0 0x7f798002c430 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:28.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.290+0000 7f7987b60640 1 -- 172.21.15.146:0/2896098109 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f797808a040 con 0x7f798004ebb0 2024-09-18T01:46:28.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.290+0000 7f7987b60640 1 --2- 172.21.15.146:0/2896098109 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f7978090c20 0x7f7978073750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:28.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.290+0000 7f7987b60640 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c592734840 con 0x7f7978090c20 2024-09-18T01:46:28.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.290+0000 7f797ffff640 1 --2- 172.21.15.146:0/2896098109 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f7978090c20 0x7f7978073750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:28.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.290+0000 7f797ffff640 1 --2- 172.21.15.146:0/2896098109 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f7978090c20 0x7f7978073750 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:28.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.291+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f797000f5f0 con 0x7f7978090c20 2024-09-18T01:46:28.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.291+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c592734840 con 0x55c59272bac0 2024-09-18T01:46:28.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.291+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f797000f5f0 con 0x55c59272bac0 2024-09-18T01:46:28.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.291+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c592734840 con 0x55c59272bac0 2024-09-18T01:46:28.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.291+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f797000f5f0 con 0x55c59272bac0 2024-09-18T01:46:28.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.291+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c592734840 con 0x7f7978090c20 2024-09-18T01:46:28.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.291+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f797000f5f0 con 0x7f7978090c20 2024-09-18T01:46:28.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.291+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c592734840 con 0x7f7978090c20 2024-09-18T01:46:28.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.291+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f797000f5f0 con 0x7f7978090c20 2024-09-18T01:46:28.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.291+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c592734840 con 0x7f798004ebb0 2024-09-18T01:46:28.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.292+0000 7f7987b60640 1 -- 172.21.15.146:0/2896098109 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f797808a040 con 0x7f798004ebb0 2024-09-18T01:46:28.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.292+0000 7f7987b60640 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c592734840 con 0x55c592731d60 2024-09-18T01:46:28.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.292+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f798003b030 con 0x55c592731d60 2024-09-18T01:46:28.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.292+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c592734840 con 0x55c59272bac0 2024-09-18T01:46:28.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.292+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f797000f5f0 con 0x55c59272bac0 2024-09-18T01:46:28.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.292+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c592734840 con 0x7f7978090c20 2024-09-18T01:46:28.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.293+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f797000f5f0 con 0x7f7978090c20 2024-09-18T01:46:28.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.293+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c592734840 con 0x55c59272bac0 2024-09-18T01:46:28.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.293+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f797000f5f0 con 0x55c59272bac0 2024-09-18T01:46:28.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.293+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c592734840 con 0x7f798004ebb0 2024-09-18T01:46:28.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.293+0000 7f7987b60640 1 -- 172.21.15.146:0/2896098109 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f797808a040 con 0x7f798004ebb0 2024-09-18T01:46:28.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.293+0000 7f7987b60640 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c592734840 con 0x55c592731d60 2024-09-18T01:46:28.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.293+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f798003b030 con 0x55c592731d60 2024-09-18T01:46:28.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.293+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c592734840 con 0x55c592731d60 2024-09-18T01:46:28.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.293+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f798003b030 con 0x55c592731d60 2024-09-18T01:46:28.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.294+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c592734840 con 0x7f7978090c20 2024-09-18T01:46:28.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.294+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f797000f5f0 con 0x7f7978090c20 2024-09-18T01:46:28.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.294+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c592734840 con 0x55c592731d60 2024-09-18T01:46:28.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.294+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f798003b030 con 0x55c592731d60 2024-09-18T01:46:28.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.294+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c592734840 con 0x55c592731d60 2024-09-18T01:46:28.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.294+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f798003b030 con 0x55c592731d60 2024-09-18T01:46:28.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.294+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c592734840 con 0x55c59272bac0 2024-09-18T01:46:28.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.294+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f797000f5f0 con 0x55c59272bac0 2024-09-18T01:46:28.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.294+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c592734840 con 0x55c59272bac0 2024-09-18T01:46:28.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.295+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f797000f5f0 con 0x55c59272bac0 2024-09-18T01:46:28.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.295+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c592734840 con 0x7f7978090c20 2024-09-18T01:46:28.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.295+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f797000f5f0 con 0x7f7978090c20 2024-09-18T01:46:28.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.295+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c592734840 con 0x55c592731d60 2024-09-18T01:46:28.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.295+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f798003b030 con 0x55c592731d60 2024-09-18T01:46:28.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.295+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c592734840 con 0x7f798004ebb0 2024-09-18T01:46:28.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.295+0000 7f7987b60640 1 -- 172.21.15.146:0/2896098109 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f797808a040 con 0x7f798004ebb0 2024-09-18T01:46:28.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.295+0000 7f7987b60640 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c592734840 con 0x55c59272bac0 2024-09-18T01:46:28.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.296+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f797000f5f0 con 0x55c59272bac0 2024-09-18T01:46:28.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.296+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c592734840 con 0x7f7978090c20 2024-09-18T01:46:28.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.296+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f797003b040 con 0x7f7978090c20 2024-09-18T01:46:28.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.296+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c592734840 con 0x55c592731d60 2024-09-18T01:46:28.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.296+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f798003b030 con 0x55c592731d60 2024-09-18T01:46:28.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.296+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c592734840 con 0x7f7978090c20 2024-09-18T01:46:28.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.297+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f797003b040 con 0x7f7978090c20 2024-09-18T01:46:28.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.297+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c592734840 con 0x7f798004ebb0 2024-09-18T01:46:28.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.297+0000 7f7987b60640 1 -- 172.21.15.146:0/2896098109 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f797808a040 con 0x7f798004ebb0 2024-09-18T01:46:28.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.297+0000 7f7987b60640 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c592734840 con 0x55c592731d60 2024-09-18T01:46:28.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.297+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f798003b030 con 0x55c592731d60 2024-09-18T01:46:28.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.297+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c592734840 con 0x7f7978090c20 2024-09-18T01:46:28.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.298+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f797003b040 con 0x7f7978090c20 2024-09-18T01:46:28.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.298+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c592734840 con 0x55c59272bac0 2024-09-18T01:46:28.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.298+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f797003b040 con 0x55c59272bac0 2024-09-18T01:46:28.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.298+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c592734840 con 0x7f798004ebb0 2024-09-18T01:46:28.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.298+0000 7f7987b60640 1 -- 172.21.15.146:0/2896098109 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f797808a040 con 0x7f798004ebb0 2024-09-18T01:46:28.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.298+0000 7f798c830800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:46:28.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.298+0000 7f798c830800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:46:28.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.298+0000 7f798c830800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:46:28.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.298+0000 7f798c830800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:46:28.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.298+0000 7f798c830800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:46:28.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.298+0000 7f798c830800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:46:28.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.298+0000 7f798c830800 20 rados->read ofs=0 len=0 2024-09-18T01:46:28.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.298+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c592730800 con 0x55c59272bac0 2024-09-18T01:46:28.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.298+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f797003b040 con 0x55c59272bac0 2024-09-18T01:46:28.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.298+0000 7f798c830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:28.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.298+0000 7f798c830800 20 rados->read ofs=0 len=0 2024-09-18T01:46:28.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.298+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c5927310a0 con 0x55c59272bac0 2024-09-18T01:46:28.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.299+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f797003b040 con 0x55c59272bac0 2024-09-18T01:46:28.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.299+0000 7f798c830800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:46:28.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.299+0000 7f798c830800 20 rados->read ofs=0 len=0 2024-09-18T01:46:28.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.299+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c5927310a0 con 0x7f798004ebb0 2024-09-18T01:46:28.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.299+0000 7f7987b60640 1 -- 172.21.15.146:0/2896098109 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f797808a040 con 0x7f798004ebb0 2024-09-18T01:46:28.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.299+0000 7f798c830800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:46:28.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.299+0000 7f798c830800 20 zone default found 2024-09-18T01:46:28.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.299+0000 7f798c830800 4 Realm: () 2024-09-18T01:46:28.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.299+0000 7f798c830800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:46:28.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.299+0000 7f798c830800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:46:28.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.299+0000 7f798c830800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:46:28.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.299+0000 7f798c830800 20 zonegroup default 2024-09-18T01:46:28.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.299+0000 7f798c830800 20 rados->read ofs=0 len=0 2024-09-18T01:46:28.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.299+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c592735170 con 0x7f7978090c20 2024-09-18T01:46:28.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.299+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f797003b040 con 0x7f7978090c20 2024-09-18T01:46:28.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.299+0000 7f798c830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:28.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.299+0000 7f798c830800 20 rados->read ofs=0 len=0 2024-09-18T01:46:28.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.299+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c592736b50 con 0x55c592731d60 2024-09-18T01:46:28.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.300+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f798003b030 con 0x55c592731d60 2024-09-18T01:46:28.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.300+0000 7f798c830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:28.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.300+0000 7f798c830800 20 rados->read ofs=0 len=0 2024-09-18T01:46:28.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.300+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c592736ff0 con 0x55c592731d60 2024-09-18T01:46:28.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.300+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f798003b030 con 0x55c592731d60 2024-09-18T01:46:28.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.300+0000 7f798c830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:28.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.300+0000 7f798c830800 20 started sync module instance, tier type = 2024-09-18T01:46:28.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.300+0000 7f798c830800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:46:28.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.300+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c592735fe0 con 0x7f798004ebb0 2024-09-18T01:46:28.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.301+0000 7f7987b60640 1 -- 172.21.15.146:0/2896098109 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v33'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f797808a040 con 0x7f798004ebb0 2024-09-18T01:46:28.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.301+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94307053954000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c592735c40 con 0x7f798004ebb0 2024-09-18T01:46:28.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.301+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c592737f20 con 0x55c59272bac0 2024-09-18T01:46:28.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.302+0000 7f7987b60640 1 -- 172.21.15.146:0/2896098109 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94307053954000] v33'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f797808a040 con 0x7f798004ebb0 2024-09-18T01:46:28.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.302+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v33'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f797003b040 con 0x55c59272bac0 2024-09-18T01:46:28.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.302+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94307053958224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c592737f20 con 0x55c59272bac0 2024-09-18T01:46:28.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.302+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c592738920 con 0x55c592731d60 2024-09-18T01:46:28.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.304+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v33'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f798003b030 con 0x55c592731d60 2024-09-18T01:46:28.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.304+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94307053958224] v33'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f797003b040 con 0x55c59272bac0 2024-09-18T01:46:28.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.304+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94307053962288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c5927388b0 con 0x55c592731d60 2024-09-18T01:46:28.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.304+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c592737a70 con 0x7f798004ebb0 2024-09-18T01:46:28.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.305+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94307053962288] v33'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f798003b030 con 0x55c592731d60 2024-09-18T01:46:28.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.305+0000 7f7987b60640 1 -- 172.21.15.146:0/2896098109 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v33'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f797808a040 con 0x7f798004ebb0 2024-09-18T01:46:28.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.305+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94307053964560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c592738870 con 0x7f798004ebb0 2024-09-18T01:46:28.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.305+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c592739e60 con 0x55c59272bac0 2024-09-18T01:46:28.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.306+0000 7f7987b60640 1 -- 172.21.15.146:0/2896098109 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94307053964560] v33'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f797808a040 con 0x7f798004ebb0 2024-09-18T01:46:28.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.306+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v33'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f797003b040 con 0x55c59272bac0 2024-09-18T01:46:28.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.306+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94307053966224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c592739e60 con 0x55c59272bac0 2024-09-18T01:46:28.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.306+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c59273a820 con 0x7f7978090c20 2024-09-18T01:46:28.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.307+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v33'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f797003b040 con 0x7f7978090c20 2024-09-18T01:46:28.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.307+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94307053970288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c59273a790 con 0x7f7978090c20 2024-09-18T01:46:28.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.307+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c59273b7d0 con 0x7f7978090c20 2024-09-18T01:46:28.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.307+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94307053966224] v33'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f797003b040 con 0x55c59272bac0 2024-09-18T01:46:28.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.308+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94307053970288] v33'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f797003b040 con 0x7f7978090c20 2024-09-18T01:46:28.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.308+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v33'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f797003b040 con 0x7f7978090c20 2024-09-18T01:46:28.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.308+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94307053967792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c59273b7d0 con 0x7f7978090c20 2024-09-18T01:46:28.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.308+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c59273bc20 con 0x7f7978090c20 2024-09-18T01:46:28.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.309+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94307053967792] v33'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f797003b040 con 0x7f7978090c20 2024-09-18T01:46:28.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.309+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v33'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f797003b040 con 0x7f7978090c20 2024-09-18T01:46:28.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.309+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94307053972416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c59273bbe0 con 0x7f7978090c20 2024-09-18T01:46:28.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.309+0000 7f798c830800 20 add_watcher() i=0 2024-09-18T01:46:28.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.309+0000 7f798c830800 20 add_watcher() i=1 2024-09-18T01:46:28.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.309+0000 7f798c830800 20 add_watcher() i=2 2024-09-18T01:46:28.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.309+0000 7f798c830800 20 add_watcher() i=3 2024-09-18T01:46:28.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.309+0000 7f798c830800 20 add_watcher() i=4 2024-09-18T01:46:28.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.309+0000 7f798c830800 20 add_watcher() i=5 2024-09-18T01:46:28.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.309+0000 7f798c830800 20 add_watcher() i=6 2024-09-18T01:46:28.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.310+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94307053972416] v33'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f797003b040 con 0x7f7978090c20 2024-09-18T01:46:28.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.310+0000 7f798c830800 20 add_watcher() i=7 2024-09-18T01:46:28.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.310+0000 7f798c830800 2 all 8 watchers are set, enabling cache 2024-09-18T01:46:28.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.310+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c59273f040 con 0x55c59272bac0 2024-09-18T01:46:28.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.311+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f797003b040 con 0x55c59272bac0 2024-09-18T01:46:28.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.311+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94307053974192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c59273c590 con 0x55c59272bac0 2024-09-18T01:46:28.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.312+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94307053974192] v33'224 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f797003b040 con 0x55c59272bac0 2024-09-18T01:46:28.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.312+0000 7f783dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:46:28.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.312+0000 7f798c830800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:46:28.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.312+0000 7f798c830800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:46:28.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.312+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c592747b20 con 0x55c59272bac0 2024-09-18T01:46:28.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.313+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'57 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f797003b040 con 0x55c59272bac0 2024-09-18T01:46:28.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.313+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c592748170 con 0x7f7978090c20 2024-09-18T01:46:28.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.315+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f797003b040 con 0x7f7978090c20 2024-09-18T01:46:28.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.315+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c5927485d0 con 0x55c592731d60 2024-09-18T01:46:28.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.316+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f798003b030 con 0x55c592731d60 2024-09-18T01:46:28.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.316+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c592748570 con 0x55c59272bac0 2024-09-18T01:46:28.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.316+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'225 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f797003b040 con 0x55c59272bac0 2024-09-18T01:46:28.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.317+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c592748ae0 con 0x7f798004ebb0 2024-09-18T01:46:28.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.318+0000 7f7987b60640 1 -- 172.21.15.146:0/2896098109 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'74 uv57 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f797808a040 con 0x7f798004ebb0 2024-09-18T01:46:28.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.318+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c592748f90 con 0x55c592731d60 2024-09-18T01:46:28.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.319+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 <== osd.3 v2:172.21.15.146:6809/4106661138 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'61 uv50 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f798003b030 con 0x55c592731d60 2024-09-18T01:46:28.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.319+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c592748f90 con 0x55c59272bac0 2024-09-18T01:46:28.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.320+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f797003b040 con 0x55c59272bac0 2024-09-18T01:46:28.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.320+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c5927437a0 con 0x7f7978090c20 2024-09-18T01:46:28.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.321+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'51 uv40 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f797003b040 con 0x7f7978090c20 2024-09-18T01:46:28.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.321+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c5927437a0 con 0x7f798004ebb0 2024-09-18T01:46:28.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.322+0000 7f7987b60640 1 -- 172.21.15.146:0/2896098109 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f797808a040 con 0x7f798004ebb0 2024-09-18T01:46:28.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.322+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c5927437a0 con 0x55c592731d60 2024-09-18T01:46:28.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.323+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 <== osd.3 v2:172.21.15.146:6809/4106661138 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f798003b030 con 0x55c592731d60 2024-09-18T01:46:28.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.323+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c5927437a0 con 0x7f798004ebb0 2024-09-18T01:46:28.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.324+0000 7f7987b60640 1 -- 172.21.15.146:0/2896098109 <== osd.2 v2:172.21.15.146:6800/3820039304 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'75 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f797808a040 con 0x7f798004ebb0 2024-09-18T01:46:28.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.324+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c5927437a0 con 0x7f7978090c20 2024-09-18T01:46:28.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.325+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f797003b040 con 0x7f7978090c20 2024-09-18T01:46:28.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.325+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c5927437a0 con 0x7f798004ebb0 2024-09-18T01:46:28.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.326+0000 7f7987b60640 1 -- 172.21.15.146:0/2896098109 <== osd.2 v2:172.21.15.146:6800/3820039304 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f797808a040 con 0x7f798004ebb0 2024-09-18T01:46:28.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.326+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c592743890 con 0x7f7978090c20 2024-09-18T01:46:28.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.327+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'63 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f797003b040 con 0x7f7978090c20 2024-09-18T01:46:28.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.327+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c592743890 con 0x55c59272bac0 2024-09-18T01:46:28.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.328+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'226 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f797003b040 con 0x55c59272bac0 2024-09-18T01:46:28.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.328+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c592743830 con 0x55c592731d60 2024-09-18T01:46:28.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.329+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 <== osd.3 v2:172.21.15.146:6809/4106661138 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'69 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f798003b030 con 0x55c592731d60 2024-09-18T01:46:28.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.329+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c592743830 con 0x7f798004ebb0 2024-09-18T01:46:28.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.330+0000 7f7987b60640 1 -- 172.21.15.146:0/2896098109 <== osd.2 v2:172.21.15.146:6800/3820039304 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'76 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f797808a040 con 0x7f798004ebb0 2024-09-18T01:46:28.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.330+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c592749900 con 0x55c592731d60 2024-09-18T01:46:28.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.331+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 <== osd.3 v2:172.21.15.146:6809/4106661138 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'39 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f798003b030 con 0x55c592731d60 2024-09-18T01:46:28.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.331+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c592749900 con 0x55c59272bac0 2024-09-18T01:46:28.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.332+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f797003b040 con 0x55c59272bac0 2024-09-18T01:46:28.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.333+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c592749900 con 0x55c59272bac0 2024-09-18T01:46:28.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.333+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'227 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f797003b040 con 0x55c59272bac0 2024-09-18T01:46:28.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.333+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c592749900 con 0x55c592731d60 2024-09-18T01:46:28.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.335+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 <== osd.3 v2:172.21.15.146:6809/4106661138 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'70 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f798003b030 con 0x55c592731d60 2024-09-18T01:46:28.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.335+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c5927437a0 con 0x7f798004ebb0 2024-09-18T01:46:28.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.336+0000 7f7987b60640 1 -- 172.21.15.146:0/2896098109 <== osd.2 v2:172.21.15.146:6800/3820039304 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'42 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f797808a040 con 0x7f798004ebb0 2024-09-18T01:46:28.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.336+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c5927437a0 con 0x55c592731d60 2024-09-18T01:46:28.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.337+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 <== osd.3 v2:172.21.15.146:6809/4106661138 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f798003b030 con 0x55c592731d60 2024-09-18T01:46:28.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.337+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c5927437a0 con 0x55c592731d60 2024-09-18T01:46:28.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.338+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 <== osd.3 v2:172.21.15.146:6809/4106661138 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'44 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f798003b030 con 0x55c592731d60 2024-09-18T01:46:28.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.338+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c5927437a0 con 0x55c592731d60 2024-09-18T01:46:28.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.339+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 <== osd.3 v2:172.21.15.146:6809/4106661138 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f798003b030 con 0x55c592731d60 2024-09-18T01:46:28.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.339+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c5927437a0 con 0x55c592731d60 2024-09-18T01:46:28.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.340+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 <== osd.3 v2:172.21.15.146:6809/4106661138 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'62 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f798003b030 con 0x55c592731d60 2024-09-18T01:46:28.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.340+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c5927437a0 con 0x7f7978090c20 2024-09-18T01:46:28.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.341+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'35 uv30 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f797003b040 con 0x7f7978090c20 2024-09-18T01:46:28.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.341+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c5927437a0 con 0x55c592731d60 2024-09-18T01:46:28.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.342+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 <== osd.3 v2:172.21.15.146:6809/4106661138 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'38 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f798003b030 con 0x55c592731d60 2024-09-18T01:46:28.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.342+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c5927437a0 con 0x7f7978090c20 2024-09-18T01:46:28.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.343+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.0 v2:172.21.15.129:6800/1759265424 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'52 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f797003b040 con 0x7f7978090c20 2024-09-18T01:46:28.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.343+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c5927437a0 con 0x55c592731d60 2024-09-18T01:46:28.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.344+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 <== osd.3 v2:172.21.15.146:6809/4106661138 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'71 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f798003b030 con 0x55c592731d60 2024-09-18T01:46:28.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.344+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c5927437a0 con 0x7f7978090c20 2024-09-18T01:46:28.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.345+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.0 v2:172.21.15.129:6800/1759265424 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'64 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f797003b040 con 0x7f7978090c20 2024-09-18T01:46:28.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.345+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c5927437a0 con 0x7f798004ebb0 2024-09-18T01:46:28.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.346+0000 7f7987b60640 1 -- 172.21.15.146:0/2896098109 <== osd.2 v2:172.21.15.146:6800/3820039304 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f797808a040 con 0x7f798004ebb0 2024-09-18T01:46:28.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.346+0000 7f783cfe1640 20 reqs_thread_entry: start 2024-09-18T01:46:28.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.346+0000 7f798c830800 20 init_complete bucket index max shards: 11 2024-09-18T01:46:28.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.346+0000 7f798c830800 20 Filter name: none 2024-09-18T01:46:28.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.347+0000 7f77b67fc640 20 reqs_thread_entry: start 2024-09-18T01:46:28.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.347+0000 7f798c830800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-18T01:46:28.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.347+0000 7f798c830800 20 rados->read ofs=0 len=0 2024-09-18T01:46:28.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.347+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c592774490 con 0x7f798004ebb0 2024-09-18T01:46:28.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.347+0000 7f7987b60640 1 -- 172.21.15.146:0/2896098109 <== osd.2 v2:172.21.15.146:6800/3820039304 19 ==== osd_op_reply(94 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f797808a040 con 0x7f798004ebb0 2024-09-18T01:46:28.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.347+0000 7f798c830800 20 rados_obj.operate() r=0 bl.length=380 2024-09-18T01:46:28.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.347+0000 7f798c830800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-18T01:46:28.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.347+0000 7f798c830800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-18T01:46:28.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.347+0000 7f798c830800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:46:28.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.347+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:95 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c592776e60 con 0x55c59272bac0 2024-09-18T01:46:28.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.347+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 28 ==== osd_op_reply(95 bud.buckets [call out=184b] v0'0 uv4 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7f797003b040 con 0x55c59272bac0 2024-09-18T01:46:28.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.347+0000 7f798c830800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9 : miss 2024-09-18T01:46:28.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.347+0000 7f798c830800 20 rados->read ofs=0 len=0 2024-09-18T01:46:28.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.347+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:96 8.4 8:20837f84:root::.bucket.meta.myfoo6%3a8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c592776ce0 con 0x7f798004ebb0 2024-09-18T01:46:28.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.348+0000 7f7987b60640 1 -- 172.21.15.146:0/2896098109 <== osd.2 v2:172.21.15.146:6800/3820039304 20 ==== osd_op_reply(96 .bucket.meta.myfoo6:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9 [call out=48b,stat out=16b,read 0~380 out=380b,getxattrs out=212b] v0'0 uv4 ondisk = 0) ==== 333+0+656 (crc 0 0 0) 0x7f797808a040 con 0x7f798004ebb0 2024-09-18T01:46:28.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.348+0000 7f798c830800 20 rados_obj.operate() r=0 bl.length=380 2024-09-18T01:46:28.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.348+0000 7f798c830800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9 info.flags=0x17 2024-09-18T01:46:28.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.348+0000 7f798c830800 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9 to cache LRU end 2024-09-18T01:46:28.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.348+0000 7f798c830800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:46:28.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.348+0000 7f798c830800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-18T01:46:28.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.348+0000 7f798c830800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9 2024-09-18T01:46:28.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.348+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:97 4.9 4:90e93b08:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c5927f4170 con 0x55c59272bac0 2024-09-18T01:46:28.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.348+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 29 ==== osd_op_reply(97 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f797003b040 con 0x55c59272bac0 2024-09-18T01:46:28.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.348+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:98 4.19 4:994d88dc:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c5927f4170 con 0x55c592731d60 2024-09-18T01:46:28.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.349+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 <== osd.3 v2:172.21.15.146:6809/4106661138 26 ==== osd_op_reply(98 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.1 [call out=85b] v0'0 uv13 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f798003b030 con 0x55c592731d60 2024-09-18T01:46:28.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.349+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:99 4.2c 4:347cbc36:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c5927f41b0 con 0x55c59272bac0 2024-09-18T01:46:28.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.349+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 30 ==== osd_op_reply(99 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f797003b040 con 0x55c59272bac0 2024-09-18T01:46:28.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.349+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:100 4.35 4:acd8b154:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c5927f41b0 con 0x55c59272bac0 2024-09-18T01:46:28.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.349+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 31 ==== osd_op_reply(100 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.3 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f797003b040 con 0x55c59272bac0 2024-09-18T01:46:28.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.349+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:101 4.3d 4:bf3e72b3:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c5927f41f0 con 0x55c592731d60 2024-09-18T01:46:28.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.349+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 <== osd.3 v2:172.21.15.146:6809/4106661138 27 ==== osd_op_reply(101 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f798003b030 con 0x55c592731d60 2024-09-18T01:46:28.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.349+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:102 4.25 4:a595c840:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c5927f41f0 con 0x55c592731d60 2024-09-18T01:46:28.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.350+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 <== osd.3 v2:172.21.15.146:6809/4106661138 28 ==== osd_op_reply(102 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f798003b030 con 0x55c592731d60 2024-09-18T01:46:28.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.350+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:103 4.2b 4:d684112f:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c5927f41f0 con 0x55c59272bac0 2024-09-18T01:46:28.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.350+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 32 ==== osd_op_reply(103 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f797003b040 con 0x55c59272bac0 2024-09-18T01:46:28.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.350+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:104 4.1 4:815be0e8:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c5927f41f0 con 0x7f798004ebb0 2024-09-18T01:46:28.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.350+0000 7f7987b60640 1 -- 172.21.15.146:0/2896098109 <== osd.2 v2:172.21.15.146:6800/3820039304 21 ==== osd_op_reply(104 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.7 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f797808a040 con 0x7f798004ebb0 2024-09-18T01:46:28.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.350+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:105 4.2c 4:36355ce0:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c5927f41f0 con 0x55c59272bac0 2024-09-18T01:46:28.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.351+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 33 ==== osd_op_reply(105 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.8 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f797003b040 con 0x55c59272bac0 2024-09-18T01:46:28.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.351+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:106 4.35 4:acafbc8a:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c5927f41b0 con 0x55c59272bac0 2024-09-18T01:46:28.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.351+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 34 ==== osd_op_reply(106 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.9 [call out=345b] v0'0 uv10 ondisk = 0) ==== 194+0+345 (crc 0 0 0) 0x7f797003b040 con 0x55c59272bac0 2024-09-18T01:46:28.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.351+0000 7f798c830800 10 cls_bucket_list_unordered: got thirteen 2024-09-18T01:46:28.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.351+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:107 4.d 4:b24c95ca:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c5927f41b0 con 0x55c592731d60 2024-09-18T01:46:28.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.351+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 <== osd.3 v2:172.21.15.146:6809/4106661138 29 ==== osd_op_reply(107 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f798003b030 con 0x55c592731d60 2024-09-18T01:46:28.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.351+0000 7f798c830800 20 get_obj_state: octx=0x7f797000f570 obj=myfoo6:thirteen state=0x55c5927f2218 s->prefetch_data=0 2024-09-18T01:46:28.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.351+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:108 3.3ds0 3:bdef5186:::8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c5927f3040 con 0x55c592731d60 2024-09-18T01:46:28.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.352+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 <== osd.3 v2:172.21.15.146:6809/4106661138 30 ==== osd_op_reply(108 8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9_thirteen [getxattrs out=819b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 238+0+835 (crc 0 0 0) 0x7f798006e350 con 0x55c592731d60 2024-09-18T01:46:28.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.352+0000 7f798c830800 10 manifest: total_size = 8 2024-09-18T01:46:28.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.352+0000 7f798c830800 20 get_obj_state: setting s->obj_tag to _73Wf0HhYbo9v1yzhDMs-AWibYeMlOr1 2024-09-18T01:46:28.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.352+0000 7f798c830800 20 get_obj_state: octx=0x7f797000f570 obj=myfoo6:thirteen state=0x55c5927f2218 s->prefetch_data=0 2024-09-18T01:46:28.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.352+0000 7f798c830800 20 prepare_atomic_modification: state is not atomic. state=0x55c5927f2218 2024-09-18T01:46:28.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.352+0000 7f798c830800 20 bucket index object: :.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.9 2024-09-18T01:46:28.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.352+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:109 4.35 4:acafbc8a:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c5927f3900 con 0x55c59272bac0 2024-09-18T01:46:28.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.353+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 35 ==== osd_op_reply(109 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.9 [stat,call,call] v33'11 uv11 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f797003b040 con 0x55c59272bac0 2024-09-18T01:46:28.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.353+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:110 3.3ds0 3:bdef5186:::8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9_thirteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c5927f3900 con 0x55c592731d60 2024-09-18T01:46:28.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.354+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 <== osd.3 v2:172.21.15.146:6809/4106661138 31 ==== osd_op_reply(110 8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9_thirteen [call] v33'3 uv3 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7f798006e350 con 0x55c592731d60 2024-09-18T01:46:28.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.354+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:111 4.35 4:acafbc8a:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=264b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c5927f3870 con 0x55c59272bac0 2024-09-18T01:46:28.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.354+0000 7f798c830800 20 list_objects_ordered: starting attempt 1 2024-09-18T01:46:28.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.354+0000 7f798c830800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-18T01:46:28.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.354+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:112 4.9 4:90e93b08:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c59277d290 con 0x55c59272bac0 2024-09-18T01:46:28.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.354+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:113 4.19 4:994d88dc:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c59277fb50 con 0x55c592731d60 2024-09-18T01:46:28.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.354+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:114 4.2c 4:347cbc36:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c5927f3870 con 0x55c59272bac0 2024-09-18T01:46:28.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.355+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 <== osd.3 v2:172.21.15.146:6809/4106661138 32 ==== osd_op_reply(113 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.1 [call out=85b] v0'0 uv13 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f798006e350 con 0x55c592731d60 2024-09-18T01:46:28.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.355+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:115 4.35 4:acd8b154:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c59277d290 con 0x55c59272bac0 2024-09-18T01:46:28.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.355+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:116 4.3d 4:bf3e72b3:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c59277fb50 con 0x55c592731d60 2024-09-18T01:46:28.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.355+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:117 4.25 4:a595c840:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c5927870d0 con 0x55c592731d60 2024-09-18T01:46:28.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.355+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:118 4.2b 4:d684112f:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c592789ed0 con 0x55c59272bac0 2024-09-18T01:46:28.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.355+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 36 ==== osd_op_reply(112 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f797004b040 con 0x55c59272bac0 2024-09-18T01:46:28.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.355+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 37 ==== osd_op_reply(114 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f797004b040 con 0x55c59272bac0 2024-09-18T01:46:28.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.355+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:119 4.1 4:815be0e8:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c592789ed0 con 0x7f798004ebb0 2024-09-18T01:46:28.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.355+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 38 ==== osd_op_reply(118 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f797004b040 con 0x55c59272bac0 2024-09-18T01:46:28.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.355+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:120 4.2c 4:36355ce0:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c59278a360 con 0x55c59272bac0 2024-09-18T01:46:28.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.356+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 <== osd.3 v2:172.21.15.146:6809/4106661138 33 ==== osd_op_reply(116 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f798006e350 con 0x55c592731d60 2024-09-18T01:46:28.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.356+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 39 ==== osd_op_reply(115 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.3 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f797004b040 con 0x55c59272bac0 2024-09-18T01:46:28.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.356+0000 7f7987b60640 1 -- 172.21.15.146:0/2896098109 <== osd.2 v2:172.21.15.146:6800/3820039304 22 ==== osd_op_reply(119 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.7 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f797808a040 con 0x7f798004ebb0 2024-09-18T01:46:28.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.356+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:121 4.35 4:acafbc8a:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c5927870d0 con 0x55c59272bac0 2024-09-18T01:46:28.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.356+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:122 4.d 4:b24c95ca:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c59277d680 con 0x55c592731d60 2024-09-18T01:46:28.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.356+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 <== osd.3 v2:172.21.15.146:6809/4106661138 34 ==== osd_op_reply(117 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f798006e350 con 0x55c592731d60 2024-09-18T01:46:28.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.356+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 40 ==== osd_op_reply(120 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.8 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f797004b040 con 0x55c59272bac0 2024-09-18T01:46:28.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.356+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 <== osd.3 v2:172.21.15.146:6809/4106661138 35 ==== osd_op_reply(122 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f798006e350 con 0x55c592731d60 2024-09-18T01:46:28.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.357+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 41 ==== osd_op_reply(111 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.9 [stat,call,call] v33'12 uv12 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f797004b040 con 0x55c59272bac0 2024-09-18T01:46:28.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.357+0000 7f78667fc640 20 handle_completion(): completion ok for obj=thirteen 2024-09-18T01:46:28.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.357+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 42 ==== osd_op_reply(121 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.9 [call out=124b] v0'0 uv12 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f797004b040 con 0x55c59272bac0 2024-09-18T01:46:28.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.357+0000 7f798c830800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-18T01:46:28.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.357+0000 7f798c830800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-18T01:46:28.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.357+0000 7f798c830800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-18T01:46:28.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.357+0000 7f798c830800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-18T01:46:28.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.357+0000 7f798c830800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo6[8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9])"; uploads.size()=0; is_truncated=0 2024-09-18T01:46:28.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.357+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:123 4.9 4:90e93b08:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c59277d680 con 0x55c59272bac0 2024-09-18T01:46:28.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.357+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:124 4.19 4:994d88dc:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c592786a80 con 0x55c592731d60 2024-09-18T01:46:28.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.357+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:125 4.2c 4:347cbc36:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c592777360 con 0x55c59272bac0 2024-09-18T01:46:28.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.357+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:126 4.35 4:acd8b154:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c592779cc0 con 0x55c59272bac0 2024-09-18T01:46:28.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.357+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:127 4.3d 4:bf3e72b3:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c592780fa0 con 0x55c592731d60 2024-09-18T01:46:28.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.357+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:128 4.25 4:a595c840:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c59277d680 con 0x55c592731d60 2024-09-18T01:46:28.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.357+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:129 4.2b 4:d684112f:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c592786a80 con 0x55c59272bac0 2024-09-18T01:46:28.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.357+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:130 4.1 4:815be0e8:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c59277d680 con 0x7f798004ebb0 2024-09-18T01:46:28.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.358+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:131 4.2c 4:36355ce0:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c592786a80 con 0x55c59272bac0 2024-09-18T01:46:28.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.358+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:132 4.35 4:acafbc8a:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c592780fa0 con 0x55c59272bac0 2024-09-18T01:46:28.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.358+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:133 4.d 4:b24c95ca:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c592793170 con 0x55c592731d60 2024-09-18T01:46:28.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.358+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 <== osd.3 v2:172.21.15.146:6809/4106661138 36 ==== osd_op_reply(124 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.1 [call out=85b] v0'0 uv13 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f798006e350 con 0x55c592731d60 2024-09-18T01:46:28.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.358+0000 7f7987b60640 1 -- 172.21.15.146:0/2896098109 <== osd.2 v2:172.21.15.146:6800/3820039304 23 ==== osd_op_reply(130 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.7 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f797808a040 con 0x7f798004ebb0 2024-09-18T01:46:28.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.358+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 43 ==== osd_op_reply(123 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f797004b040 con 0x55c59272bac0 2024-09-18T01:46:28.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.358+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 44 ==== osd_op_reply(125 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f797004b040 con 0x55c59272bac0 2024-09-18T01:46:28.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.358+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 45 ==== osd_op_reply(126 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.3 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f797004b040 con 0x55c59272bac0 2024-09-18T01:46:28.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.358+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 46 ==== osd_op_reply(129 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f797004b040 con 0x55c59272bac0 2024-09-18T01:46:28.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.358+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 <== osd.3 v2:172.21.15.146:6809/4106661138 37 ==== osd_op_reply(127 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f798006e350 con 0x55c592731d60 2024-09-18T01:46:28.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.358+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 <== osd.3 v2:172.21.15.146:6809/4106661138 38 ==== osd_op_reply(128 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f798006e350 con 0x55c592731d60 2024-09-18T01:46:28.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.358+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 <== osd.3 v2:172.21.15.146:6809/4106661138 39 ==== osd_op_reply(133 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f798006e350 con 0x55c592731d60 2024-09-18T01:46:28.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.358+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 47 ==== osd_op_reply(131 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.8 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f797004b040 con 0x55c59272bac0 2024-09-18T01:46:28.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.358+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 48 ==== osd_op_reply(132 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.9 [call out=124b] v0'0 uv12 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f797004b040 con 0x55c59272bac0 2024-09-18T01:46:28.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.358+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:134 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c59277d680 con 0x55c59272bac0 2024-09-18T01:46:28.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.359+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 49 ==== osd_op_reply(134 bud.buckets [call] v33'5 uv5 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f797004b040 con 0x55c59272bac0 2024-09-18T01:46:28.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.359+0000 7f798c830800 10 cache get: name=default.rgw.meta+root+myfoo6 : miss 2024-09-18T01:46:28.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.359+0000 7f798c830800 20 rados->read ofs=0 len=0 2024-09-18T01:46:28.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.359+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:135 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c59277d680 con 0x55c59272bac0 2024-09-18T01:46:28.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.360+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 50 ==== osd_op_reply(135 myfoo6 [call out=48b,read 0~166 out=166b] v0'0 uv17 ondisk = 0) ==== 192+0+214 (crc 0 0 0) 0x7f797004b040 con 0x55c59272bac0 2024-09-18T01:46:28.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.360+0000 7f798c830800 20 rados_obj.operate() r=0 bl.length=166 2024-09-18T01:46:28.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.360+0000 7f798c830800 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x11 2024-09-18T01:46:28.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.360+0000 7f798c830800 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-18T01:46:28.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.360+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:136 8.18 8:1944a257:root::myfoo6:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c59277d680 con 0x55c59272bac0 2024-09-18T01:46:28.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.361+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 51 ==== osd_op_reply(136 myfoo6 [call,call,delete] v33'18 uv18 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f797004b040 con 0x55c59272bac0 2024-09-18T01:46:28.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.361+0000 7f798c830800 10 removing default.rgw.meta+root+myfoo6 from cache 2024-09-18T01:46:28.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.361+0000 7f798c830800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-18T01:46:28.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.361+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94307054294896 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c59277d680 con 0x7f798004ebb0 2024-09-18T01:46:28.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.361+0000 7f7987b60640 1 -- 172.21.15.146:0/2896098109 <== osd.2 v2:172.21.15.146:6800/3820039304 24 ==== watch-notify(notify (1) cookie 94307053964560 notify 141733920794 ret 0) ==== 192+0+0 (crc 0 0 0) 0x55c592776250 con 0x7f798004ebb0 2024-09-18T01:46:28.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.361+0000 7f7866ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920794 cookie 94307053964560 notifier 4761 bl.length()=150 2024-09-18T01:46:28.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.361+0000 7f7987b60640 1 -- 172.21.15.146:0/2896098109 <== osd.2 v2:172.21.15.146:6800/3820039304 25 ==== osd_op_reply(137 notify.3 [notify cookie 94307054294896 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f797808a040 con 0x7f798004ebb0 2024-09-18T01:46:28.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.361+0000 7f7866ffd640 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f784c003d60 con 0x7f798004ebb0 2024-09-18T01:46:28.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.361+0000 7f7987b60640 1 -- 172.21.15.146:0/2896098109 <== osd.2 v2:172.21.15.146:6800/3820039304 26 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f797808a040 con 0x7f798004ebb0 2024-09-18T01:46:28.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.362+0000 7f7987b60640 1 -- 172.21.15.146:0/2896098109 <== osd.2 v2:172.21.15.146:6800/3820039304 27 ==== watch-notify(notify_complete (2) cookie 94307054294896 notify 141733920794 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f79780ad040 con 0x7f798004ebb0 2024-09-18T01:46:28.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.362+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:139 8.4 8:20837f84:root::.bucket.meta.myfoo6%3a8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c59277d680 con 0x7f798004ebb0 2024-09-18T01:46:28.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.363+0000 7f7987b60640 1 -- 172.21.15.146:0/2896098109 <== osd.2 v2:172.21.15.146:6800/3820039304 28 ==== osd_op_reply(139 .bucket.meta.myfoo6:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9 [call,call,delete] v33'6 uv6 ondisk = 0) ==== 291+0+0 (crc 0 0 0) 0x7f797808a040 con 0x7f798004ebb0 2024-09-18T01:46:28.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.363+0000 7f798c830800 10 removing default.rgw.meta+root+.bucket.meta.myfoo6:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9 from cache 2024-09-18T01:46:28.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.363+0000 7f798c830800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo6:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9, ofs0, ns] 2024-09-18T01:46:28.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.363+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:140 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94307054218320 in=219b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c59277d680 con 0x7f798004ebb0 2024-09-18T01:46:28.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.363+0000 7f7987b60640 1 -- 172.21.15.146:0/2896098109 <== osd.2 v2:172.21.15.146:6800/3820039304 29 ==== watch-notify(notify (1) cookie 94307053954000 notify 141733920795 ret 0) ==== 249+0+0 (crc 0 0 0) 0x7f79780ad040 con 0x7f798004ebb0 2024-09-18T01:46:28.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.363+0000 7f78667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920795 cookie 94307053954000 notifier 4761 bl.length()=207 2024-09-18T01:46:28.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.363+0000 7f78667fc640 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:141 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f77bc0032c0 con 0x7f798004ebb0 2024-09-18T01:46:28.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.363+0000 7f7987b60640 1 -- 172.21.15.146:0/2896098109 <== osd.2 v2:172.21.15.146:6800/3820039304 30 ==== osd_op_reply(140 notify.0 [notify cookie 94307054218320 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f797808a040 con 0x7f798004ebb0 2024-09-18T01:46:28.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.363+0000 7f7987b60640 1 -- 172.21.15.146:0/2896098109 <== osd.2 v2:172.21.15.146:6800/3820039304 31 ==== osd_op_reply(141 notify.0 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f797808a040 con 0x7f798004ebb0 2024-09-18T01:46:28.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.363+0000 7f7987b60640 1 -- 172.21.15.146:0/2896098109 <== osd.2 v2:172.21.15.146:6800/3820039304 32 ==== watch-notify(notify_complete (2) cookie 94307054218320 notify 141733920795 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c5926ef9b0 con 0x7f798004ebb0 2024-09-18T01:46:28.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.363+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:142 4.9 4:90e93b08:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c59277d680 con 0x55c59272bac0 2024-09-18T01:46:28.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.363+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:143 4.19 4:994d88dc:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c592786890 con 0x55c592731d60 2024-09-18T01:46:28.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.363+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:144 4.2c 4:347cbc36:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c5927875c0 con 0x55c59272bac0 2024-09-18T01:46:28.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.363+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:145 4.35 4:acd8b154:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c592787ed0 con 0x55c59272bac0 2024-09-18T01:46:28.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.363+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:146 4.3d 4:bf3e72b3:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c59277d680 con 0x55c592731d60 2024-09-18T01:46:28.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.363+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:147 4.25 4:a595c840:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c5927875c0 con 0x55c592731d60 2024-09-18T01:46:28.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.363+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:148 4.2b 4:d684112f:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c592786890 con 0x55c59272bac0 2024-09-18T01:46:28.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.363+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:149 4.1 4:815be0e8:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c592787ed0 con 0x7f798004ebb0 2024-09-18T01:46:28.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.363+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:150 4.2c 4:36355ce0:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c59277d680 con 0x55c59272bac0 2024-09-18T01:46:28.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.363+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:151 4.35 4:acafbc8a:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c5927875c0 con 0x55c59272bac0 2024-09-18T01:46:28.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.363+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:152 4.d 4:b24c95ca:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c592786890 con 0x55c592731d60 2024-09-18T01:46:28.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.365+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 52 ==== osd_op_reply(142 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.0 [delete] v33'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f797004b040 con 0x55c59272bac0 2024-09-18T01:46:28.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.365+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 53 ==== osd_op_reply(144 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.2 [delete] v33'5 uv5 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f797004b040 con 0x55c59272bac0 2024-09-18T01:46:28.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.365+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 <== osd.3 v2:172.21.15.146:6809/4106661138 40 ==== osd_op_reply(143 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.1 [delete] v33'14 uv14 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f798006e350 con 0x55c592731d60 2024-09-18T01:46:28.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.366+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 54 ==== osd_op_reply(148 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.6 [delete] v33'5 uv5 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f797004b040 con 0x55c59272bac0 2024-09-18T01:46:28.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.366+0000 7f7987b60640 1 -- 172.21.15.146:0/2896098109 <== osd.2 v2:172.21.15.146:6800/3820039304 33 ==== osd_op_reply(149 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.7 [delete] v33'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f797808a040 con 0x7f798004ebb0 2024-09-18T01:46:28.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.366+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 <== osd.3 v2:172.21.15.146:6809/4106661138 41 ==== osd_op_reply(147 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.5 [delete] v33'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f798006e350 con 0x55c592731d60 2024-09-18T01:46:28.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.366+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 55 ==== osd_op_reply(145 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.3 [delete] v33'13 uv13 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f797004b040 con 0x55c59272bac0 2024-09-18T01:46:28.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.366+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 56 ==== osd_op_reply(150 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.8 [delete] v33'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f797004b040 con 0x55c59272bac0 2024-09-18T01:46:28.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.367+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 <== osd.3 v2:172.21.15.146:6809/4106661138 42 ==== osd_op_reply(146 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.4 [delete] v33'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f798006e350 con 0x55c592731d60 2024-09-18T01:46:28.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.367+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 <== osd.3 v2:172.21.15.146:6809/4106661138 43 ==== osd_op_reply(152 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.10 [delete] v33'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f798006e350 con 0x55c592731d60 2024-09-18T01:46:28.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.368+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 57 ==== osd_op_reply(151 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9.9 [delete] v33'14 uv14 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f797004b040 con 0x55c59272bac0 2024-09-18T01:46:28.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.368+0000 7f798c830800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo6/8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9 : miss 2024-09-18T01:46:28.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.368+0000 7f798c830800 20 rados->read ofs=0 len=0 2024-09-18T01:46:28.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.368+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:153 6.9 6:97bcbed7:::pubsub..bucket.myfoo6%2f8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c59277d680 con 0x55c592731d60 2024-09-18T01:46:28.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.369+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 <== osd.3 v2:172.21.15.146:6809/4106661138 44 ==== osd_op_reply(153 pubsub..bucket.myfoo6/8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7f798006e350 con 0x55c592731d60 2024-09-18T01:46:28.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.369+0000 7f798c830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:28.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.369+0000 7f798c830800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo6/8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9 info.flags=0x0 2024-09-18T01:46:28.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.369+0000 7f798c830800 10 adding default.rgw.log++pubsub..bucket.myfoo6/8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9 to cache LRU end 2024-09-18T01:46:28.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.369+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:154 6.9 6:97bcbed7:::pubsub..bucket.myfoo6%2f8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c59277d680 con 0x55c592731d60 2024-09-18T01:46:28.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.370+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 <== osd.3 v2:172.21.15.146:6809/4106661138 45 ==== osd_op_reply(154 pubsub..bucket.myfoo6/8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.9 [delete] v33'63 uv52 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7f798006e350 con 0x55c592731d60 2024-09-18T01:46:28.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.370+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:155 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c59277d680 con 0x55c59272bac0 2024-09-18T01:46:28.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.371+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 58 ==== osd_op_reply(155 bud.buckets [call] v33'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f797004b040 con 0x55c59272bac0 2024-09-18T01:46:28.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.371+0000 7f798c830800 10 removing key index: NX5QOQKC6BH2IDN8HC7A 2024-09-18T01:46:28.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.371+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:156 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c592774990 con 0x55c59272bac0 2024-09-18T01:46:28.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.373+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 59 ==== osd_op_reply(156 NX5QOQKC6BH2IDN8HC7A [delete] v33'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f797004b040 con 0x55c59272bac0 2024-09-18T01:46:28.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.373+0000 7f798c830800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-18T01:46:28.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.373+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:157 7.3 7:c609908c:::notify.5:head [notify cookie 94307054218192 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c5927886e0 con 0x7f7978090c20 2024-09-18T01:46:28.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.373+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.0 v2:172.21.15.129:6800/1759265424 24 ==== watch-notify(notify (1) cookie 94307053970288 notify 141733920804 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55c592749900 con 0x7f7978090c20 2024-09-18T01:46:28.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.373+0000 7f78667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920804 cookie 94307053970288 notifier 4761 bl.length()=170 2024-09-18T01:46:28.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.373+0000 7f78667fc640 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:158 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f77bc0032c0 con 0x7f7978090c20 2024-09-18T01:46:28.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.373+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.0 v2:172.21.15.129:6800/1759265424 25 ==== osd_op_reply(157 notify.5 [notify cookie 94307054218192 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f797004b040 con 0x7f7978090c20 2024-09-18T01:46:28.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.373+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.0 v2:172.21.15.129:6800/1759265424 26 ==== osd_op_reply(158 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f797004b040 con 0x7f7978090c20 2024-09-18T01:46:28.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.373+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.0 v2:172.21.15.129:6800/1759265424 27 ==== watch-notify(notify_complete (2) cookie 94307054218192 notify 141733920804 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c5927232e0 con 0x7f7978090c20 2024-09-18T01:46:28.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.374+0000 7f798c830800 10 removing email index: 2024-09-18T01:46:28.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.374+0000 7f798c830800 10 removing user buckets index 2024-09-18T01:46:28.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.374+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:159 8.19 8:99adfd5d:users.uid::bud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c592774990 con 0x55c59272bac0 2024-09-18T01:46:28.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.374+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 60 ==== osd_op_reply(159 bud.buckets [delete] v33'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f797004b040 con 0x55c59272bac0 2024-09-18T01:46:28.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.374+0000 7f798c830800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:bud.buckets, ofs0, ns] 2024-09-18T01:46:28.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.374+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94307054218192 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c5927886e0 con 0x7f7978090c20 2024-09-18T01:46:28.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.375+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.0 v2:172.21.15.129:6800/1759265424 28 ==== watch-notify(notify (1) cookie 94307053967792 notify 141733920805 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55c5927232e0 con 0x7f7978090c20 2024-09-18T01:46:28.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.375+0000 7f7866ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920805 cookie 94307053967792 notifier 4761 bl.length()=160 2024-09-18T01:46:28.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.375+0000 7f7866ffd640 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f784c003d60 con 0x7f7978090c20 2024-09-18T01:46:28.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.375+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.0 v2:172.21.15.129:6800/1759265424 29 ==== osd_op_reply(160 notify.6 [notify cookie 94307054218192 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f797004b040 con 0x7f7978090c20 2024-09-18T01:46:28.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.375+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.0 v2:172.21.15.129:6800/1759265424 30 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f797004b040 con 0x7f7978090c20 2024-09-18T01:46:28.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.375+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.0 v2:172.21.15.129:6800/1759265424 31 ==== watch-notify(notify_complete (2) cookie 94307054218192 notify 141733920805 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c592747cf0 con 0x7f7978090c20 2024-09-18T01:46:28.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.375+0000 7f798c830800 10 removing user index: bud 2024-09-18T01:46:28.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.375+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:162 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c59277cde0 con 0x7f798004ebb0 2024-09-18T01:46:28.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.376+0000 7f7987b60640 1 -- 172.21.15.146:0/2896098109 <== osd.2 v2:172.21.15.146:6800/3820039304 34 ==== osd_op_reply(162 bud [call,call,delete] v33'7 uv7 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f797808a040 con 0x7f798004ebb0 2024-09-18T01:46:28.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.376+0000 7f798c830800 10 removing default.rgw.meta+users.uid+bud from cache 2024-09-18T01:46:28.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.376+0000 7f798c830800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-18T01:46:28.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.376+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94307054218144 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c59277c280 con 0x7f7978090c20 2024-09-18T01:46:28.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.376+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.0 v2:172.21.15.129:6800/1759265424 32 ==== watch-notify(notify (1) cookie 94307053970288 notify 141733920806 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55c592747cf0 con 0x7f7978090c20 2024-09-18T01:46:28.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.376+0000 7f78667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920806 cookie 94307053970288 notifier 4761 bl.length()=152 2024-09-18T01:46:28.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.376+0000 7f78667fc640 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f77bc0032c0 con 0x7f7978090c20 2024-09-18T01:46:28.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.376+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.0 v2:172.21.15.129:6800/1759265424 33 ==== osd_op_reply(163 notify.5 [notify cookie 94307054218144 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f797004b040 con 0x7f7978090c20 2024-09-18T01:46:28.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.377+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.0 v2:172.21.15.129:6800/1759265424 34 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f797004b040 con 0x7f7978090c20 2024-09-18T01:46:28.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.377+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.0 v2:172.21.15.129:6800/1759265424 35 ==== watch-notify(notify_complete (2) cookie 94307054218144 notify 141733920806 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c592747ae0 con 0x7f7978090c20 2024-09-18T01:46:28.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.377+0000 7f783dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:46:28.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.378+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94307053974192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c592745bb0 con 0x55c59272bac0 2024-09-18T01:46:28.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.379+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 61 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94307053974192] v33'228 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f797004b040 con 0x55c59272bac0 2024-09-18T01:46:28.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.379+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94307053954000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c59273b2b0 con 0x7f798004ebb0 2024-09-18T01:46:28.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.380+0000 7f7987b60640 1 -- 172.21.15.146:0/2896098109 <== osd.2 v2:172.21.15.146:6800/3820039304 35 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94307053954000] v33'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f797808a040 con 0x7f798004ebb0 2024-09-18T01:46:28.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.380+0000 7f798c830800 20 remove_watcher() i=0 2024-09-18T01:46:28.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.380+0000 7f798c830800 2 removed watcher, disabling cache 2024-09-18T01:46:28.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.380+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94307053958224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c59273b2b0 con 0x55c59272bac0 2024-09-18T01:46:28.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.381+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 62 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94307053958224] v33'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f797004b040 con 0x55c59272bac0 2024-09-18T01:46:28.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.381+0000 7f798c830800 20 remove_watcher() i=1 2024-09-18T01:46:28.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.381+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94307053962288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c592737450 con 0x55c592731d60 2024-09-18T01:46:28.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.382+0000 7f7988361640 1 -- 172.21.15.146:0/2896098109 <== osd.3 v2:172.21.15.146:6809/4106661138 46 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94307053962288] v33'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f798006e350 con 0x55c592731d60 2024-09-18T01:46:28.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.382+0000 7f798c830800 20 remove_watcher() i=2 2024-09-18T01:46:28.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.382+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94307053964560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c59273b2b0 con 0x7f798004ebb0 2024-09-18T01:46:28.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.383+0000 7f7987b60640 1 -- 172.21.15.146:0/2896098109 <== osd.2 v2:172.21.15.146:6800/3820039304 36 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94307053964560] v33'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f797808a040 con 0x7f798004ebb0 2024-09-18T01:46:28.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.383+0000 7f798c830800 20 remove_watcher() i=3 2024-09-18T01:46:28.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.383+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94307053966224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c592738430 con 0x55c59272bac0 2024-09-18T01:46:28.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.384+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.1 v2:172.21.15.146:6808/3930274777 63 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94307053966224] v33'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f797004b040 con 0x55c59272bac0 2024-09-18T01:46:28.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.384+0000 7f798c830800 20 remove_watcher() i=4 2024-09-18T01:46:28.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.384+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94307053970288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c59273b2b0 con 0x7f7978090c20 2024-09-18T01:46:28.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.385+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.0 v2:172.21.15.129:6800/1759265424 36 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94307053970288] v33'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f797004b040 con 0x7f7978090c20 2024-09-18T01:46:28.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.385+0000 7f798c830800 20 remove_watcher() i=5 2024-09-18T01:46:28.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.385+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94307053967792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c592738430 con 0x7f7978090c20 2024-09-18T01:46:28.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.386+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.0 v2:172.21.15.129:6800/1759265424 37 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94307053967792] v33'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f797004b040 con 0x7f7978090c20 2024-09-18T01:46:28.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.386+0000 7f798c830800 20 remove_watcher() i=6 2024-09-18T01:46:28.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.386+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94307053972416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c59273a370 con 0x7f7978090c20 2024-09-18T01:46:28.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.387+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 <== osd.0 v2:172.21.15.129:6800/1759265424 38 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94307053972416] v33'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f797004b040 con 0x7f7978090c20 2024-09-18T01:46:28.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.387+0000 7f798c830800 20 remove_watcher() i=7 2024-09-18T01:46:28.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.387+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f7978090c20 msgr2=0x7f7978073750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.387+0000 7f798c830800 1 --2- 172.21.15.146:0/2896098109 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f7978090c20 0x7f7978073750 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.387+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55c59272bac0 msgr2=0x55c59272df80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.387+0000 7f798c830800 1 --2- 172.21.15.146:0/2896098109 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55c59272bac0 0x55c59272df80 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.387+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f798004ebb0 msgr2=0x7f798002c430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.387+0000 7f798c830800 1 --2- 172.21.15.146:0/2896098109 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f798004ebb0 0x7f798002c430 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.387+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55c592731d60 msgr2=0x55c592734170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.387+0000 7f798c830800 1 --2- 172.21.15.146:0/2896098109 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55c592731d60 0x55c592734170 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.387+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7850036b90 msgr2=0x7f7850039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.387+0000 7f798c830800 1 --2- 172.21.15.146:0/2896098109 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7850036b90 0x7f7850039050 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x55c5926fc1c0 tx=0x7f7978089000 comp rx=0 tx=0).stop 2024-09-18T01:46:28.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.387+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c5927189d0 msgr2=0x55c59271fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.387+0000 7f797ffff640 1 -- 172.21.15.146:0/2896098109 reap_dead start 2024-09-18T01:46:28.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.387+0000 7f798c830800 1 --2- 172.21.15.146:0/2896098109 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c5927189d0 0x55c59271fe60 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f798004c9f0 tx=0x7f798004c980 comp rx=0 tx=0).stop 2024-09-18T01:46:28.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.388+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 shutdown_connections 2024-09-18T01:46:28.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.388+0000 7f798c830800 1 --2- 172.21.15.146:0/2896098109 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c5927189d0 0x55c59271fe60 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.388+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 >> 172.21.15.146:0/2896098109 conn(0x55c592714d80 msgr2=0x55c59271a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:28.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.388+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 shutdown_connections 2024-09-18T01:46:28.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.388+0000 7f798c830800 1 -- 172.21.15.146:0/2896098109 wait complete. 2024-09-18T01:46:28.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.388+0000 7f798c830800 1 -- 172.21.15.146:0/1205064145 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7860036b40 msgr2=0x7f7860039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.388+0000 7f798c830800 1 --2- 172.21.15.146:0/1205064145 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7860036b40 0x7f7860039000 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x55c5926f79a0 tx=0x7f797808f0e0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.388+0000 7f798c830800 1 -- 172.21.15.146:0/1205064145 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c59256e780 msgr2=0x55c59256cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.388+0000 7f798c830800 1 --2- 172.21.15.146:0/1205064145 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c59256e780 0x55c59256cdd0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x55c5926f6920 tx=0x7f79800178e0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.388+0000 7f798c830800 1 -- 172.21.15.146:0/1205064145 shutdown_connections 2024-09-18T01:46:28.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.388+0000 7f798c830800 1 --2- 172.21.15.146:0/1205064145 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7860036b40 0x7f7860039000 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.388+0000 7f798c830800 1 --2- 172.21.15.146:0/1205064145 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c59256e780 0x55c59256cdd0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.388+0000 7f798c830800 1 -- 172.21.15.146:0/1205064145 >> 172.21.15.146:0/1205064145 conn(0x55c5926feaf0 msgr2=0x55c592701670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:28.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.388+0000 7f798c830800 1 -- 172.21.15.146:0/1205064145 shutdown_connections 2024-09-18T01:46:28.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.388+0000 7f798c830800 1 -- 172.21.15.146:0/1205064145 wait complete. 2024-09-18T01:46:28.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.388+0000 7f798c830800 1 -- 172.21.15.146:0/1334576874 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55c5925f9050 msgr2=0x55c5926f6040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.388+0000 7f798c830800 1 --2- 172.21.15.146:0/1334576874 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55c5925f9050 0x55c5926f6040 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.388+0000 7f798c830800 1 -- 172.21.15.146:0/1334576874 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55c5926f9430 msgr2=0x55c5926fb820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.388+0000 7f798c830800 1 --2- 172.21.15.146:0/1334576874 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55c5926f9430 0x55c5926fb820 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.388+0000 7f798c830800 1 -- 172.21.15.146:0/1334576874 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7870036b40 msgr2=0x7f7870039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.388+0000 7f798c830800 1 --2- 172.21.15.146:0/1334576874 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7870036b40 0x7f7870039000 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f7970000c00 tx=0x7f79700013b0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.388+0000 7f798c830800 1 -- 172.21.15.146:0/1334576874 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c5925f8710 msgr2=0x55c5926eefd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.388+0000 7f798c830800 1 --2- 172.21.15.146:0/1334576874 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c5925f8710 0x55c5926eefd0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f7978045f20 tx=0x7f7978002fb0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.389+0000 7f798c830800 1 -- 172.21.15.146:0/1334576874 shutdown_connections 2024-09-18T01:46:28.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.389+0000 7f798c830800 1 --2- 172.21.15.146:0/1334576874 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55c5926f9430 0x55c5926fb820 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.389+0000 7f798c830800 1 --2- 172.21.15.146:0/1334576874 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55c5925f9050 0x55c5926f6040 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.389+0000 7f798c830800 1 --2- 172.21.15.146:0/1334576874 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7870036b40 0x7f7870039000 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.389+0000 7f798c830800 1 --2- 172.21.15.146:0/1334576874 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55c5925f8710 0x55c5926eefd0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.389+0000 7f798c830800 1 -- 172.21.15.146:0/1334576874 >> 172.21.15.146:0/1334576874 conn(0x55c5925f3fe0 msgr2=0x55c5926e18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:28.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.389+0000 7f798c830800 1 -- 172.21.15.146:0/1334576874 shutdown_connections 2024-09-18T01:46:28.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.389+0000 7f798c830800 1 -- 172.21.15.146:0/1334576874 wait complete. 2024-09-18T01:46:28.397 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-18T01:46:28.397 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-18T01:46:28.398 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud --purge-data 2024-09-18T01:46:28.442 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:46:28.443 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:46:28.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.443+0000 7f9aefd24800 1 Processor -- start 2024-09-18T01:46:28.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.443+0000 7f9aefd24800 1 -- start start 2024-09-18T01:46:28.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.443+0000 7f9aefd24800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x5650683454e0 0x5650683458e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:28.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.443+0000 7f9aefd24800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x565068205b30 con 0x565068345e20 2024-09-18T01:46:28.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.443+0000 7f9aefd24800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x5650681e7360 con 0x5650683454e0 2024-09-18T01:46:28.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.443+0000 7f9aebae0640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x5650683454e0 0x5650683458e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:28.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.443+0000 7f9ae3fff640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x565068345e20 0x56506834a9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:49434/0 (socket says 172.21.15.146:49434) 2024-09-18T01:46:28.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.443+0000 7f9ae3fff640 1 -- 172.21.15.146:0/2429782439 learned_addr learned my addr 172.21.15.146:0/2429782439 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:46:28.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.443+0000 7f9aebae0640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x5650683454e0 0x5650683458e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:55934/0 (socket says 172.21.15.146:55934) 2024-09-18T01:46:28.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.444+0000 7f9aebae0640 1 -- 172.21.15.146:0/2429782439 >> v1:172.21.15.129:6789/0 conn(0x565068345e20 legacy=0x56506834a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.444+0000 7f9aebae0640 1 -- 172.21.15.146:0/2429782439 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56506820de00 con 0x5650683454e0 2024-09-18T01:46:28.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.445+0000 7f9aebae0640 1 --2- 172.21.15.146:0/2429782439 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5650683454e0 0x5650683458e0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f9adc00a470 tx=0x7f9adc045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d027030821e951c server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:28.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.446+0000 7f9aeb2df640 1 -- 172.21.15.146:0/2429782439 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9adc053570 con 0x5650683454e0 2024-09-18T01:46:28.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.446+0000 7f9aeb2df640 1 -- 172.21.15.146:0/2429782439 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9adc058070 con 0x5650683454e0 2024-09-18T01:46:28.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.446+0000 7f9aeb2df640 1 -- 172.21.15.146:0/2429782439 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9adc053880 con 0x5650683454e0 2024-09-18T01:46:28.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.446+0000 7f9aefd24800 1 -- 172.21.15.146:0/2429782439 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5650683454e0 msgr2=0x5650683458e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.446+0000 7f9aefd24800 1 --2- 172.21.15.146:0/2429782439 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5650683454e0 0x5650683458e0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f9adc00a470 tx=0x7f9adc045a20 comp rx=0 tx=0).stop 2024-09-18T01:46:28.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.446+0000 7f9aefd24800 1 -- 172.21.15.146:0/2429782439 shutdown_connections 2024-09-18T01:46:28.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.446+0000 7f9aefd24800 1 --2- 172.21.15.146:0/2429782439 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5650683454e0 0x5650683458e0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.446+0000 7f9aefd24800 1 -- 172.21.15.146:0/2429782439 >> 172.21.15.146:0/2429782439 conn(0x565068340dd0 msgr2=0x5650683431f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:28.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.446+0000 7f9aefd24800 1 -- 172.21.15.146:0/2429782439 shutdown_connections 2024-09-18T01:46:28.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.446+0000 7f9aefd24800 1 -- 172.21.15.146:0/2429782439 wait complete. 2024-09-18T01:46:28.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.460+0000 7f9aefd24800 1 Processor -- start 2024-09-18T01:46:28.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.460+0000 7f9aefd24800 1 -- start start 2024-09-18T01:46:28.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.460+0000 7f9aefd24800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5650683454e0 0x5650682b9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:28.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.460+0000 7f9aefd24800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x565068292360 con 0x5650683454e0 2024-09-18T01:46:28.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.460+0000 7f9aebae0640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5650683454e0 0x5650682b9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:28.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.460+0000 7f9aebae0640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5650683454e0 0x5650682b9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:55940/0 (socket says 172.21.15.146:55940) 2024-09-18T01:46:28.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.460+0000 7f9aebae0640 1 -- 172.21.15.146:0/3569133680 learned_addr learned my addr 172.21.15.146:0/3569133680 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:28.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.461+0000 7f9aebae0640 1 -- 172.21.15.146:0/3569133680 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650681dfbc0 con 0x5650683454e0 2024-09-18T01:46:28.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.461+0000 7f9aebae0640 1 --2- 172.21.15.146:0/3569133680 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5650683454e0 0x5650682b9da0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f9adc025c20 tx=0x7f9adc051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b57e50b799d402e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:28.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.461+0000 7f99d9e0b640 1 -- 172.21.15.146:0/3569133680 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9adc053ba0 con 0x5650683454e0 2024-09-18T01:46:28.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.461+0000 7f99d9e0b640 1 -- 172.21.15.146:0/3569133680 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9adc063030 con 0x5650683454e0 2024-09-18T01:46:28.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.461+0000 7f99d9e0b640 1 -- 172.21.15.146:0/3569133680 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9adc053440 con 0x5650683454e0 2024-09-18T01:46:28.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.462+0000 7f9aefd24800 1 -- 172.21.15.146:0/3569133680 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5650683454e0 msgr2=0x5650682b9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.462+0000 7f9aefd24800 1 --2- 172.21.15.146:0/3569133680 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5650683454e0 0x5650682b9da0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f9adc025c20 tx=0x7f9adc051000 comp rx=0 tx=0).stop 2024-09-18T01:46:28.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.462+0000 7f9aefd24800 1 -- 172.21.15.146:0/3569133680 shutdown_connections 2024-09-18T01:46:28.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.462+0000 7f9aefd24800 1 --2- 172.21.15.146:0/3569133680 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5650683454e0 0x5650682b9da0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.462+0000 7f9aefd24800 1 -- 172.21.15.146:0/3569133680 >> 172.21.15.146:0/3569133680 conn(0x565068340dd0 msgr2=0x565068430140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:28.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.462+0000 7f9aefd24800 1 -- 172.21.15.146:0/3569133680 shutdown_connections 2024-09-18T01:46:28.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.462+0000 7f9aefd24800 1 -- 172.21.15.146:0/3569133680 wait complete. 2024-09-18T01:46:28.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.462+0000 7f9aefd24800 1 Processor -- start 2024-09-18T01:46:28.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.462+0000 7f9aefd24800 1 -- start start 2024-09-18T01:46:28.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.462+0000 7f9aefd24800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5650683454e0 0x56506843d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:28.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.462+0000 7f9aefd24800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x56506834c500 con 0x5650683454e0 2024-09-18T01:46:28.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.462+0000 7f9aebae0640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5650683454e0 0x56506843d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:28.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.462+0000 7f9aebae0640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5650683454e0 0x56506843d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:55956/0 (socket says 172.21.15.146:55956) 2024-09-18T01:46:28.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.462+0000 7f9aebae0640 1 -- 172.21.15.146:0/4127218935 learned_addr learned my addr 172.21.15.146:0/4127218935 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:28.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.463+0000 7f9aebae0640 1 -- 172.21.15.146:0/4127218935 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650681f3fe0 con 0x5650683454e0 2024-09-18T01:46:28.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.463+0000 7f9aebae0640 1 --2- 172.21.15.146:0/4127218935 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5650683454e0 0x56506843d170 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x5650682b94a0 tx=0x7f9adc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:28.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.463+0000 7f99d3fff640 1 -- 172.21.15.146:0/4127218935 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9adc078070 con 0x5650683454e0 2024-09-18T01:46:28.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.463+0000 7f99d3fff640 1 -- 172.21.15.146:0/4127218935 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9adc053570 con 0x5650683454e0 2024-09-18T01:46:28.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.463+0000 7f9aefd24800 1 -- 172.21.15.146:0/4127218935 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56506843d6b0 con 0x5650683454e0 2024-09-18T01:46:28.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.463+0000 7f99d3fff640 1 -- 172.21.15.146:0/4127218935 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9adc053850 con 0x5650683454e0 2024-09-18T01:46:28.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.463+0000 7f9aefd24800 1 -- 172.21.15.146:0/4127218935 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56506843dc30 con 0x5650683454e0 2024-09-18T01:46:28.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.464+0000 7f99d3fff640 1 -- 172.21.15.146:0/4127218935 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9adc07b070 con 0x5650683454e0 2024-09-18T01:46:28.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.464+0000 7f99d3fff640 1 --2- 172.21.15.146:0/4127218935 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f99d4036b40 0x7f99d4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:28.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.464+0000 7f99d3fff640 1 -- 172.21.15.146:0/4127218935 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f9adc070070 con 0x5650683454e0 2024-09-18T01:46:28.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.464+0000 7f9ae3fff640 1 --2- 172.21.15.146:0/4127218935 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f99d4036b40 0x7f99d4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:28.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.464+0000 7f9aefd24800 1 --2- 172.21.15.146:0/4127218935 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x565068345e20 0x5650684441e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:28.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.464+0000 7f9aefd24800 1 -- 172.21.15.146:0/4127218935 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565068444830 con 0x565068345e20 2024-09-18T01:46:28.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.464+0000 7f9aec2e1640 1 --2- 172.21.15.146:0/4127218935 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x565068345e20 0x5650684441e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:28.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.464+0000 7f9ae3fff640 1 --2- 172.21.15.146:0/4127218935 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f99d4036b40 0x7f99d4039000 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9ad4000f60 tx=0x7f9ad40012b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:28.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.465+0000 7f9aec2e1640 1 --2- 172.21.15.146:0/4127218935 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x565068345e20 0x5650684441e0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:28.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.465+0000 7f9aec2e1640 1 -- 172.21.15.146:0/4127218935 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ae400a4a0 con 0x565068345e20 2024-09-18T01:46:28.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.465+0000 7f9aefd24800 1 -- 172.21.15.146:0/4127218935 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5650684417b0 con 0x565068345e20 2024-09-18T01:46:28.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.465+0000 7f9aec2e1640 1 -- 172.21.15.146:0/4127218935 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9ae400a4a0 con 0x565068345e20 2024-09-18T01:46:28.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.465+0000 7f9aefd24800 1 -- 172.21.15.146:0/4127218935 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565068446680 con 0x565068345e20 2024-09-18T01:46:28.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.466+0000 7f9aec2e1640 1 -- 172.21.15.146:0/4127218935 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9ae400a4a0 con 0x565068345e20 2024-09-18T01:46:28.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.466+0000 7f9aefd24800 1 -- 172.21.15.146:0/4127218935 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565068445760 con 0x565068345e20 2024-09-18T01:46:28.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.466+0000 7f9aec2e1640 1 -- 172.21.15.146:0/4127218935 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9ae400a4a0 con 0x565068345e20 2024-09-18T01:46:28.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.466+0000 7f9aefd24800 1 --2- 172.21.15.146:0/4127218935 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x565068446230 0x565068449a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:28.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.466+0000 7f9aefd24800 1 -- 172.21.15.146:0/4127218935 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56506844a1b0 con 0x565068446230 2024-09-18T01:46:28.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.466+0000 7f9aebae0640 1 --2- 172.21.15.146:0/4127218935 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x565068446230 0x565068449a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:28.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.466+0000 7f9aebae0640 1 --2- 172.21.15.146:0/4127218935 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x565068446230 0x565068449a40 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:28.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.466+0000 7f9aebae0640 1 -- 172.21.15.146:0/4127218935 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9adc07a030 con 0x565068446230 2024-09-18T01:46:28.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.467+0000 7f9aefd24800 1 Processor -- start 2024-09-18T01:46:28.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.467+0000 7f9aefd24800 1 -- start start 2024-09-18T01:46:28.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.467+0000 7f9aefd24800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x565068435f60 0x5650684345b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:28.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.467+0000 7f9aefd24800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5650681e1580 con 0x565068435f60 2024-09-18T01:46:28.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.467+0000 7f9aec2e1640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x565068435f60 0x5650684345b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:28.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.467+0000 7f9aec2e1640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x565068435f60 0x5650684345b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:55966/0 (socket says 172.21.15.146:55966) 2024-09-18T01:46:28.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.467+0000 7f9aec2e1640 1 -- 172.21.15.146:0/129776182 learned_addr learned my addr 172.21.15.146:0/129776182 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:28.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.468+0000 7f9aec2e1640 1 -- 172.21.15.146:0/129776182 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565068436380 con 0x565068435f60 2024-09-18T01:46:28.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.468+0000 7f9aec2e1640 1 --2- 172.21.15.146:0/129776182 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x565068435f60 0x5650684345b0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x56506843de20 tx=0x7f9ae40178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:28.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.468+0000 7f99d17fa640 1 -- 172.21.15.146:0/129776182 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ae4013440 con 0x565068435f60 2024-09-18T01:46:28.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.468+0000 7f99d17fa640 1 -- 172.21.15.146:0/129776182 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ae40135e0 con 0x565068435f60 2024-09-18T01:46:28.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.468+0000 7f9aefd24800 1 -- 172.21.15.146:0/129776182 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565068434bb0 con 0x565068435f60 2024-09-18T01:46:28.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.468+0000 7f99d17fa640 1 -- 172.21.15.146:0/129776182 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ae40138c0 con 0x565068435f60 2024-09-18T01:46:28.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.468+0000 7f9aefd24800 1 -- 172.21.15.146:0/129776182 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650684350b0 con 0x565068435f60 2024-09-18T01:46:28.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.469+0000 7f99d17fa640 1 -- 172.21.15.146:0/129776182 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9ae4011040 con 0x565068435f60 2024-09-18T01:46:28.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.469+0000 7f99d17fa640 1 --2- 172.21.15.146:0/129776182 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f99c4036b40 0x7f99c4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:28.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.469+0000 7f99d17fa640 1 -- 172.21.15.146:0/129776182 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f9ae401d070 con 0x565068435f60 2024-09-18T01:46:28.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.469+0000 7f9aebae0640 1 --2- 172.21.15.146:0/129776182 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f99c4036b40 0x7f99c4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:28.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.469+0000 7f9aefd24800 1 Processor -- start 2024-09-18T01:46:28.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.469+0000 7f9aebae0640 1 --2- 172.21.15.146:0/129776182 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f99c4036b40 0x7f99c4039000 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9adc05ffd0 tx=0x7f9adc08ec10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:28.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.469+0000 7f9aefd24800 1 -- start start 2024-09-18T01:46:28.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.469+0000 7f9aefd24800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x565068466e30 0x565068467230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:28.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.469+0000 7f9aefd24800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x565068438700 con 0x565068466e30 2024-09-18T01:46:28.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.470+0000 7f9aec2e1640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x565068466e30 0x565068467230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:28.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.470+0000 7f9aec2e1640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x565068466e30 0x565068467230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:55970/0 (socket says 172.21.15.146:55970) 2024-09-18T01:46:28.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.470+0000 7f9aec2e1640 1 -- 172.21.15.146:0/2796325709 learned_addr learned my addr 172.21.15.146:0/2796325709 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:28.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.470+0000 7f9aec2e1640 1 -- 172.21.15.146:0/2796325709 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565068467800 con 0x565068466e30 2024-09-18T01:46:28.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.470+0000 7f9aec2e1640 1 --2- 172.21.15.146:0/2796325709 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x565068466e30 0x565068467230 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f9ae404c8f0 tx=0x7f9ae4001f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3a25daa82e0183c server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:28.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.470+0000 7f99caffd640 1 -- 172.21.15.146:0/2796325709 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ae404e110 con 0x565068466e30 2024-09-18T01:46:28.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.470+0000 7f99caffd640 1 -- 172.21.15.146:0/2796325709 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ae404e2b0 con 0x565068466e30 2024-09-18T01:46:28.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.470+0000 7f99caffd640 1 -- 172.21.15.146:0/2796325709 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ae404b250 con 0x565068466e30 2024-09-18T01:46:28.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.471+0000 7f9aefd24800 1 -- 172.21.15.146:0/2796325709 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x565068466e30 msgr2=0x565068467230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.471+0000 7f9aefd24800 1 --2- 172.21.15.146:0/2796325709 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x565068466e30 0x565068467230 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f9ae404c8f0 tx=0x7f9ae4001f40 comp rx=0 tx=0).stop 2024-09-18T01:46:28.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.471+0000 7f9aefd24800 1 -- 172.21.15.146:0/2796325709 shutdown_connections 2024-09-18T01:46:28.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.471+0000 7f9aefd24800 1 --2- 172.21.15.146:0/2796325709 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x565068466e30 0x565068467230 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.471+0000 7f9aefd24800 1 -- 172.21.15.146:0/2796325709 >> 172.21.15.146:0/2796325709 conn(0x565068463190 msgr2=0x565068461290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:28.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.471+0000 7f9aefd24800 1 -- 172.21.15.146:0/2796325709 shutdown_connections 2024-09-18T01:46:28.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.471+0000 7f9aefd24800 1 -- 172.21.15.146:0/2796325709 wait complete. 2024-09-18T01:46:28.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.471+0000 7f9aefd24800 1 Processor -- start 2024-09-18T01:46:28.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.471+0000 7f9aefd24800 1 -- start start 2024-09-18T01:46:28.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.471+0000 7f9aefd24800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x565068466e30 0x56506846e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:28.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.471+0000 7f9aefd24800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x565068467e70 con 0x565068466e30 2024-09-18T01:46:28.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.471+0000 7f9aec2e1640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x565068466e30 0x56506846e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:28.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.471+0000 7f9aec2e1640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x565068466e30 0x56506846e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:55974/0 (socket says 172.21.15.146:55974) 2024-09-18T01:46:28.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.471+0000 7f9aec2e1640 1 -- 172.21.15.146:0/3817297769 learned_addr learned my addr 172.21.15.146:0/3817297769 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:46:28.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.471+0000 7f9aec2e1640 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56506846e7e0 con 0x565068466e30 2024-09-18T01:46:28.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.472+0000 7f9aec2e1640 1 --2- 172.21.15.146:0/3817297769 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x565068466e30 0x56506846e2a0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f9ae4001f80 tx=0x7f9ae404c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:28.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.472+0000 7f99c97fa640 1 -- 172.21.15.146:0/3817297769 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ae4046040 con 0x565068466e30 2024-09-18T01:46:28.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.472+0000 7f99c97fa640 1 -- 172.21.15.146:0/3817297769 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ae4041050 con 0x565068466e30 2024-09-18T01:46:28.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.472+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56506846ea70 con 0x565068466e30 2024-09-18T01:46:28.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.472+0000 7f99c97fa640 1 -- 172.21.15.146:0/3817297769 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ae404e110 con 0x565068466e30 2024-09-18T01:46:28.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.472+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565068471720 con 0x565068466e30 2024-09-18T01:46:28.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.472+0000 7f99c97fa640 1 -- 172.21.15.146:0/3817297769 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9ae404ca30 con 0x565068466e30 2024-09-18T01:46:28.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.473+0000 7f99c97fa640 1 --2- 172.21.15.146:0/3817297769 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f99b4036b40 0x7f99b4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:28.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.473+0000 7f99c97fa640 1 -- 172.21.15.146:0/3817297769 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f9ae4034070 con 0x565068466e30 2024-09-18T01:46:28.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.473+0000 7f9aebae0640 1 --2- 172.21.15.146:0/3817297769 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f99b4036b40 0x7f99b4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:28.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.473+0000 7f9aebae0640 1 --2- 172.21.15.146:0/3817297769 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f99b4036b40 0x7f99b4039000 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9adc08eee0 tx=0x7f9adc094000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:28.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.473+0000 7f9aefd24800 20 rados->read ofs=0 len=0 2024-09-18T01:46:28.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.474+0000 7f9aefd24800 1 --2- 172.21.15.146:0/3817297769 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x565068479ef0 0x56506847c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:28.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.474+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56506847cb00 con 0x565068479ef0 2024-09-18T01:46:28.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.474+0000 7f9ae3fff640 1 --2- 172.21.15.146:0/3817297769 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x565068479ef0 0x56506847c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:28.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.474+0000 7f9ae3fff640 1 --2- 172.21.15.146:0/3817297769 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x565068479ef0 0x56506847c3b0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:28.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.474+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ad4009050 con 0x565068479ef0 2024-09-18T01:46:28.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.474+0000 7f9aefd24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:28.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.474+0000 7f9aefd24800 20 realm 2024-09-18T01:46:28.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.474+0000 7f9aefd24800 20 rados->read ofs=0 len=0 2024-09-18T01:46:28.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.474+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565068479340 con 0x565068479ef0 2024-09-18T01:46:28.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.474+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ad4009050 con 0x565068479ef0 2024-09-18T01:46:28.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.474+0000 7f9aefd24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:28.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.474+0000 7f9aefd24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:46:28.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.474+0000 7f9aefd24800 20 rados->read ofs=0 len=0 2024-09-18T01:46:28.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.474+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56506847d5f0 con 0x565068479ef0 2024-09-18T01:46:28.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.475+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ad4009050 con 0x565068479ef0 2024-09-18T01:46:28.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.475+0000 7f9aefd24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:28.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.475+0000 7f9aefd24800 20 rados->read ofs=0 len=0 2024-09-18T01:46:28.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.475+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56506847dec0 con 0x565068479ef0 2024-09-18T01:46:28.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.475+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9ad4009050 con 0x565068479ef0 2024-09-18T01:46:28.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.475+0000 7f9aefd24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:46:28.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.475+0000 7f9aefd24800 20 rados->read ofs=0 len=0 2024-09-18T01:46:28.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.475+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56506847e260 con 0x565068479ef0 2024-09-18T01:46:28.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.475+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9ad4009050 con 0x565068479ef0 2024-09-18T01:46:28.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.475+0000 7f9aefd24800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:46:28.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.475+0000 7f9aefd24800 20 searching for the correct realm 2024-09-18T01:46:28.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.475+0000 7f9aefd24800 1 --2- 172.21.15.146:0/3817297769 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x565068480140 0x565068482530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:28.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.475+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565068482be0 con 0x565068480140 2024-09-18T01:46:28.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.475+0000 7f9aec2e1640 1 --2- 172.21.15.146:0/3817297769 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x565068480140 0x565068482530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:28.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.476+0000 7f9aec2e1640 1 --2- 172.21.15.146:0/3817297769 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x565068480140 0x565068482530 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:28.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.476+0000 7f9aec2e1640 1 -- 172.21.15.146:0/3817297769 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ae403e020 con 0x565068480140 2024-09-18T01:46:28.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.476+0000 7f9aec2e1640 1 --2- 172.21.15.146:0/3817297769 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f9ae40123a0 0x7f9ae40375a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:28.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.476+0000 7f9aec2e1640 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565068482be0 con 0x7f9ae40123a0 2024-09-18T01:46:28.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.476+0000 7f9aebae0640 1 --2- 172.21.15.146:0/3817297769 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f9ae40123a0 0x7f9ae40375a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:28.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.476+0000 7f9aebae0640 1 --2- 172.21.15.146:0/3817297769 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f9ae40123a0 0x7f9ae40375a0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:28.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.476+0000 7f9aebae0640 1 -- 172.21.15.146:0/3817297769 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9adc09a040 con 0x7f9ae40123a0 2024-09-18T01:46:28.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.476+0000 7f9aebae0640 1 --2- 172.21.15.146:0/3817297769 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f9adc07d060 0x7f9adc004280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:46:28.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.476+0000 7f9aebae0640 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565068482be0 con 0x7f9adc07d060 2024-09-18T01:46:28.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.477+0000 7f9ae3fff640 1 --2- 172.21.15.146:0/3817297769 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f9adc07d060 0x7f9adc004280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:46:28.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.477+0000 7f9ae3fff640 1 --2- 172.21.15.146:0/3817297769 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f9adc07d060 0x7f9adc004280 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:46:28.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.477+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ad4009050 con 0x7f9adc07d060 2024-09-18T01:46:28.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.477+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565068482be0 con 0x565068479ef0 2024-09-18T01:46:28.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.477+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9ad4009050 con 0x565068479ef0 2024-09-18T01:46:28.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.477+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565068482be0 con 0x565068479ef0 2024-09-18T01:46:28.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.478+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ad402a040 con 0x565068479ef0 2024-09-18T01:46:28.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.478+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565068482be0 con 0x7f9adc07d060 2024-09-18T01:46:28.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.478+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ad402a040 con 0x7f9adc07d060 2024-09-18T01:46:28.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.478+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565068482be0 con 0x7f9adc07d060 2024-09-18T01:46:28.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.478+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ad402a040 con 0x7f9adc07d060 2024-09-18T01:46:28.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.478+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565068482be0 con 0x7f9ae40123a0 2024-09-18T01:46:28.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.478+0000 7f9aebae0640 1 -- 172.21.15.146:0/3817297769 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9adc09a040 con 0x7f9ae40123a0 2024-09-18T01:46:28.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.478+0000 7f9aebae0640 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565068482be0 con 0x565068480140 2024-09-18T01:46:28.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.479+0000 7f9aec2e1640 1 -- 172.21.15.146:0/3817297769 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ae403e020 con 0x565068480140 2024-09-18T01:46:28.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.479+0000 7f9aec2e1640 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565068482be0 con 0x565068479ef0 2024-09-18T01:46:28.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.479+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ad402a040 con 0x565068479ef0 2024-09-18T01:46:28.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.479+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565068482be0 con 0x7f9adc07d060 2024-09-18T01:46:28.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.479+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ad402a040 con 0x7f9adc07d060 2024-09-18T01:46:28.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.479+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565068482be0 con 0x565068479ef0 2024-09-18T01:46:28.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.479+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ad402a040 con 0x565068479ef0 2024-09-18T01:46:28.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.479+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565068482be0 con 0x7f9ae40123a0 2024-09-18T01:46:28.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.479+0000 7f9aebae0640 1 -- 172.21.15.146:0/3817297769 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f9adc09a040 con 0x7f9ae40123a0 2024-09-18T01:46:28.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.479+0000 7f9aebae0640 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565068482be0 con 0x565068480140 2024-09-18T01:46:28.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.480+0000 7f9aec2e1640 1 -- 172.21.15.146:0/3817297769 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ae403e020 con 0x565068480140 2024-09-18T01:46:28.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.480+0000 7f9aec2e1640 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565068482be0 con 0x565068480140 2024-09-18T01:46:28.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.480+0000 7f9aec2e1640 1 -- 172.21.15.146:0/3817297769 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ae403e020 con 0x565068480140 2024-09-18T01:46:28.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.480+0000 7f9aec2e1640 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565068482be0 con 0x7f9adc07d060 2024-09-18T01:46:28.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.480+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ad402a040 con 0x7f9adc07d060 2024-09-18T01:46:28.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.480+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565068482be0 con 0x565068480140 2024-09-18T01:46:28.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.480+0000 7f9aec2e1640 1 -- 172.21.15.146:0/3817297769 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ae403e020 con 0x565068480140 2024-09-18T01:46:28.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.480+0000 7f9aec2e1640 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565068482be0 con 0x565068480140 2024-09-18T01:46:28.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.481+0000 7f9aec2e1640 1 -- 172.21.15.146:0/3817297769 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ae403e020 con 0x565068480140 2024-09-18T01:46:28.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.481+0000 7f9aec2e1640 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565068482be0 con 0x565068479ef0 2024-09-18T01:46:28.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.481+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ad402a040 con 0x565068479ef0 2024-09-18T01:46:28.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.481+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565068482be0 con 0x565068479ef0 2024-09-18T01:46:28.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.481+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9ad402a040 con 0x565068479ef0 2024-09-18T01:46:28.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.481+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565068482be0 con 0x7f9adc07d060 2024-09-18T01:46:28.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.481+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ad402a040 con 0x7f9adc07d060 2024-09-18T01:46:28.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.481+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565068482be0 con 0x565068480140 2024-09-18T01:46:28.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.481+0000 7f9aec2e1640 1 -- 172.21.15.146:0/3817297769 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ae403e020 con 0x565068480140 2024-09-18T01:46:28.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.481+0000 7f9aec2e1640 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565068482be0 con 0x7f9ae40123a0 2024-09-18T01:46:28.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.482+0000 7f9aebae0640 1 -- 172.21.15.146:0/3817297769 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9adc09a040 con 0x7f9ae40123a0 2024-09-18T01:46:28.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.482+0000 7f9aebae0640 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565068482be0 con 0x565068479ef0 2024-09-18T01:46:28.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.482+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ad402a040 con 0x565068479ef0 2024-09-18T01:46:28.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.482+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565068482be0 con 0x7f9adc07d060 2024-09-18T01:46:28.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.482+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ad402a040 con 0x7f9adc07d060 2024-09-18T01:46:28.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.482+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565068482be0 con 0x565068480140 2024-09-18T01:46:28.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.482+0000 7f9aec2e1640 1 -- 172.21.15.146:0/3817297769 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ae403e020 con 0x565068480140 2024-09-18T01:46:28.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.482+0000 7f9aec2e1640 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565068482be0 con 0x7f9adc07d060 2024-09-18T01:46:28.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.483+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ad402a040 con 0x7f9adc07d060 2024-09-18T01:46:28.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.483+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565068482be0 con 0x7f9ae40123a0 2024-09-18T01:46:28.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.483+0000 7f9aebae0640 1 -- 172.21.15.146:0/3817297769 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9adc09a040 con 0x7f9ae40123a0 2024-09-18T01:46:28.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.483+0000 7f9aebae0640 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565068482be0 con 0x565068480140 2024-09-18T01:46:28.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.483+0000 7f9aec2e1640 1 -- 172.21.15.146:0/3817297769 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ae403e020 con 0x565068480140 2024-09-18T01:46:28.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.483+0000 7f9aec2e1640 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565068482be0 con 0x7f9adc07d060 2024-09-18T01:46:28.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.483+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ad402a040 con 0x7f9adc07d060 2024-09-18T01:46:28.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.483+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565068482be0 con 0x565068479ef0 2024-09-18T01:46:28.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.484+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9ad402a040 con 0x565068479ef0 2024-09-18T01:46:28.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.484+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565068482be0 con 0x7f9ae40123a0 2024-09-18T01:46:28.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.484+0000 7f9aebae0640 1 -- 172.21.15.146:0/3817297769 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9adc0b1040 con 0x7f9ae40123a0 2024-09-18T01:46:28.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.484+0000 7f9aefd24800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:46:28.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.484+0000 7f9aefd24800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:46:28.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.484+0000 7f9aefd24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:46:28.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.484+0000 7f9aefd24800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:46:28.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.484+0000 7f9aefd24800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:46:28.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.484+0000 7f9aefd24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:46:28.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.484+0000 7f9aefd24800 20 rados->read ofs=0 len=0 2024-09-18T01:46:28.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.484+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56506847ec10 con 0x565068479ef0 2024-09-18T01:46:28.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.484+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ad402a040 con 0x565068479ef0 2024-09-18T01:46:28.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.484+0000 7f9aefd24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:28.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.484+0000 7f9aefd24800 20 rados->read ofs=0 len=0 2024-09-18T01:46:28.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.484+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56506847f4b0 con 0x565068479ef0 2024-09-18T01:46:28.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.484+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9ad402a040 con 0x565068479ef0 2024-09-18T01:46:28.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.484+0000 7f9aefd24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:46:28.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.484+0000 7f9aefd24800 20 rados->read ofs=0 len=0 2024-09-18T01:46:28.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.484+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565068483060 con 0x7f9ae40123a0 2024-09-18T01:46:28.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.485+0000 7f9aebae0640 1 -- 172.21.15.146:0/3817297769 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9adc0b1040 con 0x7f9ae40123a0 2024-09-18T01:46:28.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.485+0000 7f9aefd24800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:46:28.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.485+0000 7f9aefd24800 20 zone default found 2024-09-18T01:46:28.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.485+0000 7f9aefd24800 4 Realm: () 2024-09-18T01:46:28.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.485+0000 7f9aefd24800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:46:28.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.485+0000 7f9aefd24800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:46:28.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.485+0000 7f9aefd24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:46:28.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.485+0000 7f9aefd24800 20 zonegroup default 2024-09-18T01:46:28.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.485+0000 7f9aefd24800 20 rados->read ofs=0 len=0 2024-09-18T01:46:28.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.485+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5650684838b0 con 0x7f9adc07d060 2024-09-18T01:46:28.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.485+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9ad402a040 con 0x7f9adc07d060 2024-09-18T01:46:28.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.485+0000 7f9aefd24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:28.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.485+0000 7f9aefd24800 20 rados->read ofs=0 len=0 2024-09-18T01:46:28.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.485+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5650684852c0 con 0x565068480140 2024-09-18T01:46:28.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.485+0000 7f9aec2e1640 1 -- 172.21.15.146:0/3817297769 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9ae403e020 con 0x565068480140 2024-09-18T01:46:28.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.485+0000 7f9aefd24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:28.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.485+0000 7f9aefd24800 20 rados->read ofs=0 len=0 2024-09-18T01:46:28.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.485+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565068485770 con 0x565068480140 2024-09-18T01:46:28.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.486+0000 7f9aec2e1640 1 -- 172.21.15.146:0/3817297769 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9ae403e020 con 0x565068480140 2024-09-18T01:46:28.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.486+0000 7f9aefd24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:28.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.486+0000 7f9aefd24800 20 started sync module instance, tier type = 2024-09-18T01:46:28.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.486+0000 7f9aefd24800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:46:28.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.486+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565068484720 con 0x7f9ae40123a0 2024-09-18T01:46:28.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.487+0000 7f9aebae0640 1 -- 172.21.15.146:0/3817297769 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v33'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9adc0b1040 con 0x7f9ae40123a0 2024-09-18T01:46:28.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.487+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94903346940688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565068484380 con 0x7f9ae40123a0 2024-09-18T01:46:28.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.487+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5650684866a0 con 0x565068479ef0 2024-09-18T01:46:28.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.488+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v33'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ad402a040 con 0x565068479ef0 2024-09-18T01:46:28.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.488+0000 7f9aebae0640 1 -- 172.21.15.146:0/3817297769 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94903346940688] v33'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9adc0b1040 con 0x7f9ae40123a0 2024-09-18T01:46:28.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.488+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94903346947024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565068486e80 con 0x565068479ef0 2024-09-18T01:46:28.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.488+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565068487470 con 0x565068480140 2024-09-18T01:46:28.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.489+0000 7f9aec2e1640 1 -- 172.21.15.146:0/3817297769 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v33'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ae403e020 con 0x565068480140 2024-09-18T01:46:28.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.489+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94903346944976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565068487470 con 0x565068480140 2024-09-18T01:46:28.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.489+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565068488430 con 0x7f9ae40123a0 2024-09-18T01:46:28.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.489+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94903346947024] v33'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ad402a040 con 0x565068479ef0 2024-09-18T01:46:28.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.490+0000 7f9aebae0640 1 -- 172.21.15.146:0/3817297769 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v33'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9adc0b1040 con 0x7f9ae40123a0 2024-09-18T01:46:28.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.490+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94903346954080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565068488850 con 0x7f9ae40123a0 2024-09-18T01:46:28.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.490+0000 7f9aec2e1640 1 -- 172.21.15.146:0/3817297769 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94903346944976] v33'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ae403e020 con 0x565068480140 2024-09-18T01:46:28.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.490+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565068487860 con 0x565068479ef0 2024-09-18T01:46:28.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.491+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v33'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ad402a040 con 0x565068479ef0 2024-09-18T01:46:28.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.491+0000 7f9aebae0640 1 -- 172.21.15.146:0/3817297769 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94903346954080] v33'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9adc0b1040 con 0x7f9ae40123a0 2024-09-18T01:46:28.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.491+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94903346948304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565068487860 con 0x565068479ef0 2024-09-18T01:46:28.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.491+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565068489830 con 0x7f9adc07d060 2024-09-18T01:46:28.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.492+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v33'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ad402a040 con 0x7f9adc07d060 2024-09-18T01:46:28.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.492+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94903346948304] v33'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ad402a040 con 0x565068479ef0 2024-09-18T01:46:28.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.492+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94903346959232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565068489c50 con 0x7f9adc07d060 2024-09-18T01:46:28.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.492+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565068488da0 con 0x7f9adc07d060 2024-09-18T01:46:28.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.493+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94903346959232] v33'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ad402a040 con 0x7f9adc07d060 2024-09-18T01:46:28.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.494+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v33'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ad402a040 con 0x7f9adc07d060 2024-09-18T01:46:28.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.494+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94903346960288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565068489bc0 con 0x7f9adc07d060 2024-09-18T01:46:28.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.494+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56506848abc0 con 0x7f9adc07d060 2024-09-18T01:46:28.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.495+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94903346960288] v33'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ad402a040 con 0x7f9adc07d060 2024-09-18T01:46:28.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.495+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v33'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ad402a040 con 0x7f9adc07d060 2024-09-18T01:46:28.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.495+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94903346962912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56506848ab80 con 0x7f9adc07d060 2024-09-18T01:46:28.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.495+0000 7f9aefd24800 20 add_watcher() i=0 2024-09-18T01:46:28.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.495+0000 7f9aefd24800 20 add_watcher() i=1 2024-09-18T01:46:28.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.495+0000 7f9aefd24800 20 add_watcher() i=2 2024-09-18T01:46:28.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.495+0000 7f9aefd24800 20 add_watcher() i=3 2024-09-18T01:46:28.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.495+0000 7f9aefd24800 20 add_watcher() i=4 2024-09-18T01:46:28.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.495+0000 7f9aefd24800 20 add_watcher() i=5 2024-09-18T01:46:28.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.495+0000 7f9aefd24800 20 add_watcher() i=6 2024-09-18T01:46:28.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.496+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94903346962912] v33'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ad402a040 con 0x7f9adc07d060 2024-09-18T01:46:28.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.496+0000 7f9aefd24800 20 add_watcher() i=7 2024-09-18T01:46:28.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.496+0000 7f9aefd24800 2 all 8 watchers are set, enabling cache 2024-09-18T01:46:28.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.496+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56506848dfb0 con 0x565068479ef0 2024-09-18T01:46:28.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.496+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9ad402a040 con 0x565068479ef0 2024-09-18T01:46:28.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.496+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94903346963968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56506848b470 con 0x565068479ef0 2024-09-18T01:46:28.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.497+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94903346963968] v33'229 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9ad402a040 con 0x565068479ef0 2024-09-18T01:46:28.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.497+0000 7f99a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:46:28.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.497+0000 7f9aefd24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:46:28.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.497+0000 7f9aefd24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:46:28.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.497+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56506848de10 con 0x565068479ef0 2024-09-18T01:46:28.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.498+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'58 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9ad402a040 con 0x565068479ef0 2024-09-18T01:46:28.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.498+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565068497180 con 0x7f9adc07d060 2024-09-18T01:46:28.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.499+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9ad402a040 con 0x7f9adc07d060 2024-09-18T01:46:28.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.499+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5650684975a0 con 0x565068480140 2024-09-18T01:46:28.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.500+0000 7f9aec2e1640 1 -- 172.21.15.146:0/3817297769 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9ae403e020 con 0x565068480140 2024-09-18T01:46:28.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.500+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5650684974e0 con 0x565068479ef0 2024-09-18T01:46:28.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.501+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'230 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9ad402a040 con 0x565068479ef0 2024-09-18T01:46:28.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.501+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565068497a90 con 0x7f9ae40123a0 2024-09-18T01:46:28.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.502+0000 7f9aebae0640 1 -- 172.21.15.146:0/3817297769 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'77 uv57 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9adc0b1040 con 0x7f9ae40123a0 2024-09-18T01:46:28.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.502+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565068497f10 con 0x565068480140 2024-09-18T01:46:28.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.503+0000 7f9aec2e1640 1 -- 172.21.15.146:0/3817297769 <== osd.3 v2:172.21.15.146:6809/4106661138 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'64 uv50 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9ae403e020 con 0x565068480140 2024-09-18T01:46:28.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.503+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565068497f10 con 0x565068479ef0 2024-09-18T01:46:28.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.505+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9ad402a040 con 0x565068479ef0 2024-09-18T01:46:28.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.505+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5650684983c0 con 0x7f9adc07d060 2024-09-18T01:46:28.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.506+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'53 uv40 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9ad402a040 con 0x7f9adc07d060 2024-09-18T01:46:28.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.506+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5650684983c0 con 0x7f9ae40123a0 2024-09-18T01:46:28.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.507+0000 7f9aebae0640 1 -- 172.21.15.146:0/3817297769 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9adc0b1040 con 0x7f9ae40123a0 2024-09-18T01:46:28.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.507+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5650684983c0 con 0x565068480140 2024-09-18T01:46:28.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.508+0000 7f9aec2e1640 1 -- 172.21.15.146:0/3817297769 <== osd.3 v2:172.21.15.146:6809/4106661138 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9ae403e020 con 0x565068480140 2024-09-18T01:46:28.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.508+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5650684983c0 con 0x7f9ae40123a0 2024-09-18T01:46:28.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.509+0000 7f9aebae0640 1 -- 172.21.15.146:0/3817297769 <== osd.2 v2:172.21.15.146:6800/3820039304 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'78 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9adc0b1040 con 0x7f9ae40123a0 2024-09-18T01:46:28.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.509+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5650684983c0 con 0x7f9adc07d060 2024-09-18T01:46:28.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.510+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ad402a040 con 0x7f9adc07d060 2024-09-18T01:46:28.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.510+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5650684983c0 con 0x7f9ae40123a0 2024-09-18T01:46:28.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.511+0000 7f9aebae0640 1 -- 172.21.15.146:0/3817297769 <== osd.2 v2:172.21.15.146:6800/3820039304 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9adc0b1040 con 0x7f9ae40123a0 2024-09-18T01:46:28.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.511+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5650684984a0 con 0x7f9adc07d060 2024-09-18T01:46:28.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.512+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'65 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ad402a040 con 0x7f9adc07d060 2024-09-18T01:46:28.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.512+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5650684984a0 con 0x565068479ef0 2024-09-18T01:46:28.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.513+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'231 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ad402a040 con 0x565068479ef0 2024-09-18T01:46:28.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.513+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5650684984a0 con 0x565068480140 2024-09-18T01:46:28.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.514+0000 7f9aec2e1640 1 -- 172.21.15.146:0/3817297769 <== osd.3 v2:172.21.15.146:6809/4106661138 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'72 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ae403e020 con 0x565068480140 2024-09-18T01:46:28.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.514+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5650684984a0 con 0x7f9ae40123a0 2024-09-18T01:46:28.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.515+0000 7f9aebae0640 1 -- 172.21.15.146:0/3817297769 <== osd.2 v2:172.21.15.146:6800/3820039304 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'79 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9adc0b1040 con 0x7f9ae40123a0 2024-09-18T01:46:28.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.515+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5650684984a0 con 0x565068480140 2024-09-18T01:46:28.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.516+0000 7f9aec2e1640 1 -- 172.21.15.146:0/3817297769 <== osd.3 v2:172.21.15.146:6809/4106661138 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'40 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ae403e020 con 0x565068480140 2024-09-18T01:46:28.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.516+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5650684984a0 con 0x565068479ef0 2024-09-18T01:46:28.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.517+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ad402a040 con 0x565068479ef0 2024-09-18T01:46:28.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.517+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5650684984a0 con 0x565068479ef0 2024-09-18T01:46:28.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.518+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'232 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ad402a040 con 0x565068479ef0 2024-09-18T01:46:28.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.518+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5650684984a0 con 0x565068480140 2024-09-18T01:46:28.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.519+0000 7f9aec2e1640 1 -- 172.21.15.146:0/3817297769 <== osd.3 v2:172.21.15.146:6809/4106661138 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'73 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ae403e020 con 0x565068480140 2024-09-18T01:46:28.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.519+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5650684984a0 con 0x7f9ae40123a0 2024-09-18T01:46:28.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.520+0000 7f9aebae0640 1 -- 172.21.15.146:0/3817297769 <== osd.2 v2:172.21.15.146:6800/3820039304 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'43 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9adc0b1040 con 0x7f9ae40123a0 2024-09-18T01:46:28.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.520+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5650684984a0 con 0x565068480140 2024-09-18T01:46:28.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.521+0000 7f9aec2e1640 1 -- 172.21.15.146:0/3817297769 <== osd.3 v2:172.21.15.146:6809/4106661138 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ae403e020 con 0x565068480140 2024-09-18T01:46:28.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.521+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5650684984a0 con 0x565068480140 2024-09-18T01:46:28.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.522+0000 7f9aec2e1640 1 -- 172.21.15.146:0/3817297769 <== osd.3 v2:172.21.15.146:6809/4106661138 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'45 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ae403e020 con 0x565068480140 2024-09-18T01:46:28.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.522+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5650684984a0 con 0x565068480140 2024-09-18T01:46:28.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.523+0000 7f9aec2e1640 1 -- 172.21.15.146:0/3817297769 <== osd.3 v2:172.21.15.146:6809/4106661138 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ae403e020 con 0x565068480140 2024-09-18T01:46:28.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.523+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5650684984a0 con 0x565068480140 2024-09-18T01:46:28.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.524+0000 7f9aec2e1640 1 -- 172.21.15.146:0/3817297769 <== osd.3 v2:172.21.15.146:6809/4106661138 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'65 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ae403e020 con 0x565068480140 2024-09-18T01:46:28.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.524+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5650684984a0 con 0x7f9adc07d060 2024-09-18T01:46:28.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.525+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'36 uv30 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ad402a040 con 0x7f9adc07d060 2024-09-18T01:46:28.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.525+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5650684984a0 con 0x565068480140 2024-09-18T01:46:28.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.526+0000 7f9aec2e1640 1 -- 172.21.15.146:0/3817297769 <== osd.3 v2:172.21.15.146:6809/4106661138 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'39 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ae403e020 con 0x565068480140 2024-09-18T01:46:28.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.526+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5650684984a0 con 0x7f9adc07d060 2024-09-18T01:46:28.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.527+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.0 v2:172.21.15.129:6800/1759265424 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'54 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ad402a040 con 0x7f9adc07d060 2024-09-18T01:46:28.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.527+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5650684984a0 con 0x565068480140 2024-09-18T01:46:28.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.528+0000 7f9aec2e1640 1 -- 172.21.15.146:0/3817297769 <== osd.3 v2:172.21.15.146:6809/4106661138 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'74 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ae403e020 con 0x565068480140 2024-09-18T01:46:28.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.529+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5650684984a0 con 0x7f9adc07d060 2024-09-18T01:46:28.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.529+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.0 v2:172.21.15.129:6800/1759265424 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'66 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ad402a040 con 0x7f9adc07d060 2024-09-18T01:46:28.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.530+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5650684984a0 con 0x7f9ae40123a0 2024-09-18T01:46:28.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.530+0000 7f9aebae0640 1 -- 172.21.15.146:0/3817297769 <== osd.2 v2:172.21.15.146:6800/3820039304 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9adc0b1040 con 0x7f9ae40123a0 2024-09-18T01:46:28.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.531+0000 7f99a0fe1640 20 reqs_thread_entry: start 2024-09-18T01:46:28.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.531+0000 7f9aefd24800 20 init_complete bucket index max shards: 11 2024-09-18T01:46:28.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.531+0000 7f9aefd24800 20 Filter name: none 2024-09-18T01:46:28.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.531+0000 7f991a7fc640 20 reqs_thread_entry: start 2024-09-18T01:46:28.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.531+0000 7f9aefd24800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-18T01:46:28.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.531+0000 7f9aefd24800 20 rados->read ofs=0 len=0 2024-09-18T01:46:28.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.531+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5650684c35f0 con 0x7f9adc07d060 2024-09-18T01:46:28.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.532+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.0 v2:172.21.15.129:6800/1759265424 24 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f9ad402a040 con 0x7f9adc07d060 2024-09-18T01:46:28.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.532+0000 7f9aefd24800 20 rados_obj.operate() r=0 bl.length=380 2024-09-18T01:46:28.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.532+0000 7f9aefd24800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-18T01:46:28.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.532+0000 7f9aefd24800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-18T01:46:28.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.532+0000 7f9aefd24800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:46:28.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.532+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5650684c6010 con 0x7f9adc07d060 2024-09-18T01:46:28.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.532+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.0 v2:172.21.15.129:6800/1759265424 25 ==== osd_op_reply(95 fud.buckets [call out=186b] v0'0 uv5 ondisk = 0) ==== 155+0+186 (crc 0 0 0) 0x7f9ad402a040 con 0x7f9adc07d060 2024-09-18T01:46:28.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.532+0000 7f9aefd24800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10 : miss 2024-09-18T01:46:28.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.532+0000 7f9aefd24800 20 rados->read ofs=0 len=0 2024-09-18T01:46:28.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.532+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:96 8.a 8:565a1648:root::.bucket.meta.myfoo7%3a8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5650684c5e70 con 0x565068479ef0 2024-09-18T01:46:28.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.533+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.1 v2:172.21.15.146:6808/3930274777 28 ==== osd_op_reply(96 .bucket.meta.myfoo7:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10 [call out=48b,stat out=16b,read 0~382 out=382b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 334+0+664 (crc 0 0 0) 0x7f9ad402a040 con 0x565068479ef0 2024-09-18T01:46:28.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.533+0000 7f9aefd24800 20 rados_obj.operate() r=0 bl.length=382 2024-09-18T01:46:28.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.533+0000 7f9aefd24800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10 info.flags=0x17 2024-09-18T01:46:28.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.533+0000 7f9aefd24800 10 adding default.rgw.meta+root+.bucket.meta.myfoo7:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10 to cache LRU end 2024-09-18T01:46:28.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.533+0000 7f9aefd24800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:46:28.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.533+0000 7f9aefd24800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T01:46:28.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.533+0000 7f9aefd24800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo7:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10 2024-09-18T01:46:28.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.533+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:97 4.16 4:692d16e3:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5650685433c0 con 0x565068480140 2024-09-18T01:46:28.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.533+0000 7f9aec2e1640 1 -- 172.21.15.146:0/3817297769 <== osd.3 v2:172.21.15.146:6809/4106661138 26 ==== osd_op_reply(97 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.0 [call out=85b] v0'0 uv7 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9ae403e020 con 0x565068480140 2024-09-18T01:46:28.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.533+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:98 4.b 4:d0958f61:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565068543400 con 0x7f9ae40123a0 2024-09-18T01:46:28.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.533+0000 7f9aebae0640 1 -- 172.21.15.146:0/3817297769 <== osd.2 v2:172.21.15.146:6800/3820039304 19 ==== osd_op_reply(98 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9adc0b1040 con 0x7f9ae40123a0 2024-09-18T01:46:28.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.533+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:99 4.a 4:530f0bb2:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565068543400 con 0x7f9ae40123a0 2024-09-18T01:46:28.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.534+0000 7f9aebae0640 1 -- 172.21.15.146:0/3817297769 <== osd.2 v2:172.21.15.146:6800/3820039304 20 ==== osd_op_reply(99 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9adc0b1040 con 0x7f9ae40123a0 2024-09-18T01:46:28.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.534+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:100 4.b 4:d33704ef:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565068543400 con 0x7f9ae40123a0 2024-09-18T01:46:28.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.534+0000 7f9aebae0640 1 -- 172.21.15.146:0/3817297769 <== osd.2 v2:172.21.15.146:6800/3820039304 21 ==== osd_op_reply(100 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.3 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9adc0b1040 con 0x7f9ae40123a0 2024-09-18T01:46:28.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.534+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:101 4.14 4:28d8d2f1:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565068543400 con 0x565068480140 2024-09-18T01:46:28.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.534+0000 7f9aec2e1640 1 -- 172.21.15.146:0/3817297769 <== osd.3 v2:172.21.15.146:6809/4106661138 27 ==== osd_op_reply(101 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9ae403e020 con 0x565068480140 2024-09-18T01:46:28.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.534+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:102 4.37 4:ef7b80c5:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565068543400 con 0x7f9adc07d060 2024-09-18T01:46:28.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.535+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.0 v2:172.21.15.129:6800/1759265424 26 ==== osd_op_reply(102 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.5 [call out=378b] v0'0 uv7 ondisk = 0) ==== 195+0+378 (crc 0 0 0) 0x7f9ad402a040 con 0x7f9adc07d060 2024-09-18T01:46:28.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.535+0000 7f9aefd24800 10 cls_bucket_list_unordered: got fourteen 2024-09-18T01:46:28.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.535+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:103 4.6 4:6326e90f:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565068543400 con 0x7f9ae40123a0 2024-09-18T01:46:28.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.535+0000 7f9aebae0640 1 -- 172.21.15.146:0/3817297769 <== osd.2 v2:172.21.15.146:6800/3820039304 22 ==== osd_op_reply(103 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9adc0b9060 con 0x7f9ae40123a0 2024-09-18T01:46:28.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.535+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:104 4.10 4:0bf593b4:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5650685433c0 con 0x565068480140 2024-09-18T01:46:28.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.536+0000 7f9aec2e1640 1 -- 172.21.15.146:0/3817297769 <== osd.3 v2:172.21.15.146:6809/4106661138 28 ==== osd_op_reply(104 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.7 [call out=85b] v0'0 uv12 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9ae403e020 con 0x565068480140 2024-09-18T01:46:28.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.536+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:105 4.18 4:1863599f:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5650685433c0 con 0x7f9ae40123a0 2024-09-18T01:46:28.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.536+0000 7f9aebae0640 1 -- 172.21.15.146:0/3817297769 <== osd.2 v2:172.21.15.146:6800/3820039304 23 ==== osd_op_reply(105 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.8 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9adc0b9060 con 0x7f9ae40123a0 2024-09-18T01:46:28.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.536+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:106 4.c 4:31751a72:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5650685433c0 con 0x565068479ef0 2024-09-18T01:46:28.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.536+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.1 v2:172.21.15.146:6808/3930274777 29 ==== osd_op_reply(106 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9ad402a040 con 0x565068479ef0 2024-09-18T01:46:28.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.536+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:107 4.2b 4:d6268b75:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565068543400 con 0x565068479ef0 2024-09-18T01:46:28.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.537+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.1 v2:172.21.15.146:6808/3930274777 30 ==== osd_op_reply(107 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.10 [call out=85b] v0'0 uv4 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7f9ad402a040 con 0x565068479ef0 2024-09-18T01:46:28.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.537+0000 7f9aefd24800 20 get_obj_state: octx=0x7f9ad400e510 obj=myfoo7:fourteen state=0x565068541428 s->prefetch_data=0 2024-09-18T01:46:28.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.537+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:108 3.16s0 3:6a94775b:::8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10_fourteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565068542250 con 0x7f9ae40123a0 2024-09-18T01:46:28.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.537+0000 7f9aebae0640 1 -- 172.21.15.146:0/3817297769 <== osd.2 v2:172.21.15.146:6800/3820039304 24 ==== osd_op_reply(108 8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10_fourteen [getxattrs out=858b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 239+0+874 (crc 0 0 0) 0x7f9adc0b9060 con 0x7f9ae40123a0 2024-09-18T01:46:28.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.537+0000 7f9aefd24800 10 manifest: total_size = 8 2024-09-18T01:46:28.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.537+0000 7f9aefd24800 20 get_obj_state: setting s->obj_tag to 8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.16861987011066978788 2024-09-18T01:46:28.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.537+0000 7f9aefd24800 20 get_obj_state: octx=0x7f9ad400e510 obj=myfoo7:fourteen state=0x565068541428 s->prefetch_data=0 2024-09-18T01:46:28.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.537+0000 7f9aefd24800 20 prepare_atomic_modification: state is not atomic. state=0x565068541428 2024-09-18T01:46:28.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.537+0000 7f9aefd24800 20 bucket index object: :.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.5 2024-09-18T01:46:28.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.537+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:109 4.37 4:ef7b80c5:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=188b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565068542be0 con 0x7f9adc07d060 2024-09-18T01:46:28.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.538+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.0 v2:172.21.15.129:6800/1759265424 27 ==== osd_op_reply(109 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.5 [stat,call,call] v33'8 uv8 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f9ad402a040 con 0x7f9adc07d060 2024-09-18T01:46:28.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.538+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:110 3.16s0 3:6a94775b:::8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10_fourteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565068542be0 con 0x7f9ae40123a0 2024-09-18T01:46:28.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.539+0000 7f9aebae0640 1 -- 172.21.15.146:0/3817297769 <== osd.2 v2:172.21.15.146:6800/3820039304 25 ==== osd_op_reply(110 8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10_fourteen [call] v33'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7f9adc0b9060 con 0x7f9ae40123a0 2024-09-18T01:46:28.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.540+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:111 4.37 4:ef7b80c5:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=265b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5650684caa20 con 0x7f9adc07d060 2024-09-18T01:46:28.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.540+0000 7f9aefd24800 20 list_objects_ordered: starting attempt 1 2024-09-18T01:46:28.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.540+0000 7f9aefd24800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-18T01:46:28.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.540+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:112 4.16 4:692d16e3:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5650684cc2f0 con 0x565068480140 2024-09-18T01:46:28.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.540+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:113 4.b 4:d0958f61:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5650684ceb60 con 0x7f9ae40123a0 2024-09-18T01:46:28.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.540+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:114 4.a 4:530f0bb2:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5650684cc2f0 con 0x7f9ae40123a0 2024-09-18T01:46:28.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.540+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:115 4.b 4:d33704ef:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5650684d3a10 con 0x7f9ae40123a0 2024-09-18T01:46:28.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.540+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:116 4.14 4:28d8d2f1:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5650684d67e0 con 0x565068480140 2024-09-18T01:46:28.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.540+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:117 4.37 4:ef7b80c5:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5650684d9130 con 0x7f9adc07d060 2024-09-18T01:46:28.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.540+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:118 4.6 4:6326e90f:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5650684dbfb0 con 0x7f9ae40123a0 2024-09-18T01:46:28.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.540+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:119 4.10 4:0bf593b4:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5650684dee30 con 0x565068480140 2024-09-18T01:46:28.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.540+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:120 4.18 4:1863599f:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5650684e1810 con 0x7f9ae40123a0 2024-09-18T01:46:28.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.540+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:121 4.c 4:31751a72:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5650684e4690 con 0x565068479ef0 2024-09-18T01:46:28.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.540+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:122 4.2b 4:d6268b75:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5650684e74c0 con 0x565068479ef0 2024-09-18T01:46:28.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.540+0000 7f9aec2e1640 1 -- 172.21.15.146:0/3817297769 <== osd.3 v2:172.21.15.146:6809/4106661138 29 ==== osd_op_reply(112 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.0 [call out=85b] v0'0 uv7 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9ae403e020 con 0x565068480140 2024-09-18T01:46:28.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.540+0000 7f9aebae0640 1 -- 172.21.15.146:0/3817297769 <== osd.2 v2:172.21.15.146:6800/3820039304 26 ==== osd_op_reply(113 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9adc0b9060 con 0x7f9ae40123a0 2024-09-18T01:46:28.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.540+0000 7f9aec2e1640 1 -- 172.21.15.146:0/3817297769 <== osd.3 v2:172.21.15.146:6809/4106661138 30 ==== osd_op_reply(116 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9ae403e020 con 0x565068480140 2024-09-18T01:46:28.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.540+0000 7f9aec2e1640 1 -- 172.21.15.146:0/3817297769 <== osd.3 v2:172.21.15.146:6809/4106661138 31 ==== osd_op_reply(119 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.7 [call out=85b] v0'0 uv12 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9ae403e020 con 0x565068480140 2024-09-18T01:46:28.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.541+0000 7f9aebae0640 1 -- 172.21.15.146:0/3817297769 <== osd.2 v2:172.21.15.146:6800/3820039304 27 ==== osd_op_reply(114 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9adc0b9060 con 0x7f9ae40123a0 2024-09-18T01:46:28.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.541+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.1 v2:172.21.15.146:6808/3930274777 31 ==== osd_op_reply(121 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9ad402a040 con 0x565068479ef0 2024-09-18T01:46:28.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.541+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.1 v2:172.21.15.146:6808/3930274777 32 ==== osd_op_reply(122 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.10 [call out=85b] v0'0 uv4 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7f9ad402a040 con 0x565068479ef0 2024-09-18T01:46:28.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.541+0000 7f9aebae0640 1 -- 172.21.15.146:0/3817297769 <== osd.2 v2:172.21.15.146:6800/3820039304 28 ==== osd_op_reply(118 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9adc0b9060 con 0x7f9ae40123a0 2024-09-18T01:46:28.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.541+0000 7f9aebae0640 1 -- 172.21.15.146:0/3817297769 <== osd.2 v2:172.21.15.146:6800/3820039304 29 ==== osd_op_reply(120 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.8 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9adc0b9060 con 0x7f9ae40123a0 2024-09-18T01:46:28.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.541+0000 7f9aebae0640 1 -- 172.21.15.146:0/3817297769 <== osd.2 v2:172.21.15.146:6800/3820039304 30 ==== osd_op_reply(115 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.3 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9adc0b9060 con 0x7f9ae40123a0 2024-09-18T01:46:28.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.541+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.0 v2:172.21.15.129:6800/1759265424 28 ==== osd_op_reply(111 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.5 [stat,call,call] v33'9 uv9 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f9ad402a040 con 0x7f9adc07d060 2024-09-18T01:46:28.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.541+0000 7f99ca7fc640 20 handle_completion(): completion ok for obj=fourteen 2024-09-18T01:46:28.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.541+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.0 v2:172.21.15.129:6800/1759265424 29 ==== osd_op_reply(117 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.5 [call out=124b] v0'0 uv9 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f9ad402a040 con 0x7f9adc07d060 2024-09-18T01:46:28.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.541+0000 7f9aefd24800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-18T01:46:28.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.541+0000 7f9aefd24800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-18T01:46:28.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.541+0000 7f9aefd24800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-18T01:46:28.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.541+0000 7f9aefd24800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-18T01:46:28.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.541+0000 7f9aefd24800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo7[8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10])"; uploads.size()=0; is_truncated=0 2024-09-18T01:46:28.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.541+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:123 4.16 4:692d16e3:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5650684dee90 con 0x565068480140 2024-09-18T01:46:28.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.541+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:124 4.b 4:d0958f61:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5650684e74c0 con 0x7f9ae40123a0 2024-09-18T01:46:28.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.541+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:125 4.a 4:530f0bb2:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5650684d67e0 con 0x7f9ae40123a0 2024-09-18T01:46:28.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.541+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:126 4.b 4:d33704ef:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5650684d9130 con 0x7f9ae40123a0 2024-09-18T01:46:28.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.541+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:127 4.14 4:28d8d2f1:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5650684e4690 con 0x565068480140 2024-09-18T01:46:28.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.541+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:128 4.37 4:ef7b80c5:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5650684e1360 con 0x7f9adc07d060 2024-09-18T01:46:28.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.541+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:129 4.6 4:6326e90f:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5650684e74c0 con 0x7f9ae40123a0 2024-09-18T01:46:28.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.541+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:130 4.10 4:0bf593b4:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5650684d67e0 con 0x565068480140 2024-09-18T01:46:28.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.541+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:131 4.18 4:1863599f:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5650684e74c0 con 0x7f9ae40123a0 2024-09-18T01:46:28.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.541+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:132 4.c 4:31751a72:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5650684e1360 con 0x565068479ef0 2024-09-18T01:46:28.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.541+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:133 4.2b 4:d6268b75:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5650684dbfd0 con 0x565068479ef0 2024-09-18T01:46:28.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.542+0000 7f9aebae0640 1 -- 172.21.15.146:0/3817297769 <== osd.2 v2:172.21.15.146:6800/3820039304 31 ==== osd_op_reply(124 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9adc0c3040 con 0x7f9ae40123a0 2024-09-18T01:46:28.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.542+0000 7f9aebae0640 1 -- 172.21.15.146:0/3817297769 <== osd.2 v2:172.21.15.146:6800/3820039304 32 ==== osd_op_reply(125 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9adc0c3040 con 0x7f9ae40123a0 2024-09-18T01:46:28.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.542+0000 7f9aebae0640 1 -- 172.21.15.146:0/3817297769 <== osd.2 v2:172.21.15.146:6800/3820039304 33 ==== osd_op_reply(129 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9adc0c3040 con 0x7f9ae40123a0 2024-09-18T01:46:28.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.542+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.0 v2:172.21.15.129:6800/1759265424 30 ==== osd_op_reply(128 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.5 [call out=124b] v0'0 uv9 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f9ad402a040 con 0x7f9adc07d060 2024-09-18T01:46:28.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.542+0000 7f9aebae0640 1 -- 172.21.15.146:0/3817297769 <== osd.2 v2:172.21.15.146:6800/3820039304 34 ==== osd_op_reply(131 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.8 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9adc0c3040 con 0x7f9ae40123a0 2024-09-18T01:46:28.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.542+0000 7f9aebae0640 1 -- 172.21.15.146:0/3817297769 <== osd.2 v2:172.21.15.146:6800/3820039304 35 ==== osd_op_reply(126 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.3 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9adc0c3040 con 0x7f9ae40123a0 2024-09-18T01:46:28.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.542+0000 7f9aec2e1640 1 -- 172.21.15.146:0/3817297769 <== osd.3 v2:172.21.15.146:6809/4106661138 32 ==== osd_op_reply(123 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.0 [call out=85b] v0'0 uv7 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9ae403e020 con 0x565068480140 2024-09-18T01:46:28.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.542+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.1 v2:172.21.15.146:6808/3930274777 33 ==== osd_op_reply(132 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9ad402a040 con 0x565068479ef0 2024-09-18T01:46:28.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.542+0000 7f9aec2e1640 1 -- 172.21.15.146:0/3817297769 <== osd.3 v2:172.21.15.146:6809/4106661138 33 ==== osd_op_reply(127 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9ae403e020 con 0x565068480140 2024-09-18T01:46:28.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.542+0000 7f9aec2e1640 1 -- 172.21.15.146:0/3817297769 <== osd.3 v2:172.21.15.146:6809/4106661138 34 ==== osd_op_reply(130 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.7 [call out=85b] v0'0 uv12 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9ae403e020 con 0x565068480140 2024-09-18T01:46:28.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.542+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.1 v2:172.21.15.146:6808/3930274777 34 ==== osd_op_reply(133 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.10 [call out=85b] v0'0 uv4 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7f9ad402a040 con 0x565068479ef0 2024-09-18T01:46:28.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.542+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:134 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5650684e1810 con 0x7f9adc07d060 2024-09-18T01:46:28.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.544+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.0 v2:172.21.15.129:6800/1759265424 31 ==== osd_op_reply(134 fud.buckets [call] v33'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f9ad402a040 con 0x7f9adc07d060 2024-09-18T01:46:28.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.544+0000 7f9aefd24800 10 cache get: name=default.rgw.meta+root+myfoo7 : miss 2024-09-18T01:46:28.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.544+0000 7f9aefd24800 20 rados->read ofs=0 len=0 2024-09-18T01:46:28.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.544+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:135 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5650684e1810 con 0x7f9ae40123a0 2024-09-18T01:46:28.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.544+0000 7f9aebae0640 1 -- 172.21.15.146:0/3817297769 <== osd.2 v2:172.21.15.146:6800/3820039304 36 ==== osd_op_reply(135 myfoo7 [call out=48b,read 0~168 out=168b] v0'0 uv44 ondisk = 0) ==== 192+0+216 (crc 0 0 0) 0x7f9adc0c3040 con 0x7f9ae40123a0 2024-09-18T01:46:28.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.544+0000 7f9aefd24800 20 rados_obj.operate() r=0 bl.length=168 2024-09-18T01:46:28.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.544+0000 7f9aefd24800 10 cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x11 2024-09-18T01:46:28.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.544+0000 7f9aefd24800 10 adding default.rgw.meta+root+myfoo7 to cache LRU end 2024-09-18T01:46:28.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.544+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:136 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5650684e1810 con 0x7f9ae40123a0 2024-09-18T01:46:28.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.545+0000 7f9aebae0640 1 -- 172.21.15.146:0/3817297769 <== osd.2 v2:172.21.15.146:6800/3820039304 37 ==== osd_op_reply(136 myfoo7 [call,call,delete] v33'45 uv45 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f9adc0c3040 con 0x7f9ae40123a0 2024-09-18T01:46:28.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.545+0000 7f9aefd24800 10 removing default.rgw.meta+root+myfoo7 from cache 2024-09-18T01:46:28.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.545+0000 7f9aefd24800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo7, ofs0, ns] 2024-09-18T01:46:28.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.545+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94903347320848 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5650684de6d0 con 0x7f9ae40123a0 2024-09-18T01:46:28.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.546+0000 7f9aebae0640 1 -- 172.21.15.146:0/3817297769 <== osd.2 v2:172.21.15.146:6800/3820039304 38 ==== watch-notify(notify (1) cookie 94903346954080 notify 141733920796 ret 0) ==== 192+0+0 (crc 0 0 0) 0x565068497a90 con 0x7f9ae40123a0 2024-09-18T01:46:28.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.546+0000 7f99caffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920796 cookie 94903346954080 notifier 4768 bl.length()=150 2024-09-18T01:46:28.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.546+0000 7f9aebae0640 1 -- 172.21.15.146:0/3817297769 <== osd.2 v2:172.21.15.146:6800/3820039304 39 ==== osd_op_reply(137 notify.3 [notify cookie 94903347320848 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9adc0c3040 con 0x7f9ae40123a0 2024-09-18T01:46:28.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.546+0000 7f99caffd640 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f99b0003d60 con 0x7f9ae40123a0 2024-09-18T01:46:28.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.546+0000 7f9aebae0640 1 -- 172.21.15.146:0/3817297769 <== osd.2 v2:172.21.15.146:6800/3820039304 40 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9adc0c3040 con 0x7f9ae40123a0 2024-09-18T01:46:28.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.546+0000 7f9aebae0640 1 -- 172.21.15.146:0/3817297769 <== osd.2 v2:172.21.15.146:6800/3820039304 41 ==== watch-notify(notify_complete (2) cookie 94903347320848 notify 141733920796 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f9adc0a3040 con 0x7f9ae40123a0 2024-09-18T01:46:28.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.546+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:139 8.a 8:565a1648:root::.bucket.meta.myfoo7%3a8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5650684e1810 con 0x565068479ef0 2024-09-18T01:46:28.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.547+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.1 v2:172.21.15.146:6808/3930274777 35 ==== osd_op_reply(139 .bucket.meta.myfoo7:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10 [call,call,delete] v33'5 uv5 ondisk = 0) ==== 292+0+0 (crc 0 0 0) 0x7f9ad402a040 con 0x565068479ef0 2024-09-18T01:46:28.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.547+0000 7f9aefd24800 10 removing default.rgw.meta+root+.bucket.meta.myfoo7:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10 from cache 2024-09-18T01:46:28.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.547+0000 7f9aefd24800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo7:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10, ofs0, ns] 2024-09-18T01:46:28.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.547+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:140 7.0 7:05bf5b68:::notify.1:head [notify cookie 94903347273744 in=220b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5650684e1810 con 0x565068479ef0 2024-09-18T01:46:28.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.547+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.1 v2:172.21.15.146:6808/3930274777 36 ==== watch-notify(notify (1) cookie 94903346947024 notify 141733920789 ret 0) ==== 250+0+0 (crc 0 0 0) 0x5650684c5370 con 0x565068479ef0 2024-09-18T01:46:28.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.547+0000 7f99caffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920789 cookie 94903346947024 notifier 4768 bl.length()=208 2024-09-18T01:46:28.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.547+0000 7f99caffd640 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:141 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f99b0003d60 con 0x565068479ef0 2024-09-18T01:46:28.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.547+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.1 v2:172.21.15.146:6808/3930274777 37 ==== osd_op_reply(140 notify.1 [notify cookie 94903347273744 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9ad402a040 con 0x565068479ef0 2024-09-18T01:46:28.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.548+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.1 v2:172.21.15.146:6808/3930274777 38 ==== osd_op_reply(141 notify.1 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ad402a040 con 0x565068479ef0 2024-09-18T01:46:28.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.548+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.1 v2:172.21.15.146:6808/3930274777 39 ==== watch-notify(notify_complete (2) cookie 94903347273744 notify 141733920789 ret 0) ==== 42+0+48 (crc 0 0 0) 0x565068497880 con 0x565068479ef0 2024-09-18T01:46:28.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.548+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:142 4.16 4:692d16e3:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5650684e1810 con 0x565068480140 2024-09-18T01:46:28.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.548+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:143 4.b 4:d0958f61:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5650684de6d0 con 0x7f9ae40123a0 2024-09-18T01:46:28.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.548+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:144 4.a 4:530f0bb2:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5650684e3f30 con 0x7f9ae40123a0 2024-09-18T01:46:28.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.548+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:145 4.b 4:d33704ef:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5650684c4650 con 0x7f9ae40123a0 2024-09-18T01:46:28.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.548+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:146 4.14 4:28d8d2f1:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5650684e4b60 con 0x565068480140 2024-09-18T01:46:28.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.548+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:147 4.37 4:ef7b80c5:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5650684e53f0 con 0x7f9adc07d060 2024-09-18T01:46:28.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.548+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:148 4.6 4:6326e90f:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5650684e1810 con 0x7f9ae40123a0 2024-09-18T01:46:28.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.548+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:149 4.10 4:0bf593b4:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5650684dc900 con 0x565068480140 2024-09-18T01:46:28.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.548+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:150 4.18 4:1863599f:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5650684e3f30 con 0x7f9ae40123a0 2024-09-18T01:46:28.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.548+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:151 4.c 4:31751a72:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5650684e53f0 con 0x565068479ef0 2024-09-18T01:46:28.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.548+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:152 4.2b 4:d6268b75:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5650684e4b60 con 0x565068479ef0 2024-09-18T01:46:28.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.549+0000 7f9aec2e1640 1 -- 172.21.15.146:0/3817297769 <== osd.3 v2:172.21.15.146:6809/4106661138 35 ==== osd_op_reply(142 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.0 [delete] v33'8 uv8 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f9ae403e020 con 0x565068480140 2024-09-18T01:46:28.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.549+0000 7f9aec2e1640 1 -- 172.21.15.146:0/3817297769 <== osd.3 v2:172.21.15.146:6809/4106661138 36 ==== osd_op_reply(146 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.4 [delete] v33'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f9ae403e020 con 0x565068480140 2024-09-18T01:46:28.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.550+0000 7f9aebae0640 1 -- 172.21.15.146:0/3817297769 <== osd.2 v2:172.21.15.146:6800/3820039304 42 ==== osd_op_reply(150 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.8 [delete] v33'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f9adc0c3040 con 0x7f9ae40123a0 2024-09-18T01:46:28.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.550+0000 7f9aebae0640 1 -- 172.21.15.146:0/3817297769 <== osd.2 v2:172.21.15.146:6800/3820039304 43 ==== osd_op_reply(148 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.6 [delete] v33'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f9adc0c3040 con 0x7f9ae40123a0 2024-09-18T01:46:28.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.550+0000 7f9aebae0640 1 -- 172.21.15.146:0/3817297769 <== osd.2 v2:172.21.15.146:6800/3820039304 44 ==== osd_op_reply(143 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.1 [delete] v33'3 uv3 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f9adc0c3040 con 0x7f9ae40123a0 2024-09-18T01:46:28.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.550+0000 7f9aebae0640 1 -- 172.21.15.146:0/3817297769 <== osd.2 v2:172.21.15.146:6800/3820039304 45 ==== osd_op_reply(145 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.3 [delete] v33'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f9adc0c3040 con 0x7f9ae40123a0 2024-09-18T01:46:28.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.550+0000 7f9aebae0640 1 -- 172.21.15.146:0/3817297769 <== osd.2 v2:172.21.15.146:6800/3820039304 46 ==== osd_op_reply(144 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.2 [delete] v33'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f9adc0c3040 con 0x7f9ae40123a0 2024-09-18T01:46:28.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.552+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.1 v2:172.21.15.146:6808/3930274777 40 ==== osd_op_reply(151 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.9 [delete] v33'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f9ad402a040 con 0x565068479ef0 2024-09-18T01:46:28.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.552+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.0 v2:172.21.15.129:6800/1759265424 32 ==== osd_op_reply(147 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.5 [delete] v33'10 uv10 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f9ad402a040 con 0x7f9adc07d060 2024-09-18T01:46:28.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.552+0000 7f9aec2e1640 1 -- 172.21.15.146:0/3817297769 <== osd.3 v2:172.21.15.146:6809/4106661138 37 ==== osd_op_reply(149 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.7 [delete] v33'13 uv13 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f9ae403e020 con 0x565068480140 2024-09-18T01:46:28.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.552+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.1 v2:172.21.15.146:6808/3930274777 41 ==== osd_op_reply(152 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10.10 [delete] v33'6 uv6 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7f9ad402a040 con 0x565068479ef0 2024-09-18T01:46:28.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.552+0000 7f9aefd24800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo7/8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10 : miss 2024-09-18T01:46:28.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.552+0000 7f9aefd24800 20 rados->read ofs=0 len=0 2024-09-18T01:46:28.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.552+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:153 6.1f 6:f861a96d:::pubsub..bucket.myfoo7%2f8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5650684e3f30 con 0x7f9adc07d060 2024-09-18T01:46:28.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.552+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.0 v2:172.21.15.129:6800/1759265424 33 ==== osd_op_reply(153 pubsub..bucket.myfoo7/8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7f9ad402a040 con 0x7f9adc07d060 2024-09-18T01:46:28.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.552+0000 7f9aefd24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:46:28.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.552+0000 7f9aefd24800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo7/8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10 info.flags=0x0 2024-09-18T01:46:28.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.552+0000 7f9aefd24800 10 adding default.rgw.log++pubsub..bucket.myfoo7/8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10 to cache LRU end 2024-09-18T01:46:28.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.552+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:154 6.1f 6:f861a96d:::pubsub..bucket.myfoo7%2f8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5650684e3f30 con 0x7f9adc07d060 2024-09-18T01:46:28.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.553+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.0 v2:172.21.15.129:6800/1759265424 34 ==== osd_op_reply(154 pubsub..bucket.myfoo7/8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.10 [delete] v33'37 uv30 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7f9ad402a040 con 0x7f9adc07d060 2024-09-18T01:46:28.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.553+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:155 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=147b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5650684e3f30 con 0x7f9adc07d060 2024-09-18T01:46:28.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.554+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.0 v2:172.21.15.129:6800/1759265424 35 ==== osd_op_reply(155 fud.buckets [call] v33'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f9ad402a040 con 0x7f9adc07d060 2024-09-18T01:46:28.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.554+0000 7f9aefd24800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-18T01:46:28.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.554+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:156 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5650684e3f30 con 0x7f9adc07d060 2024-09-18T01:46:28.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.555+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.0 v2:172.21.15.129:6800/1759265424 36 ==== osd_op_reply(156 p5YnriCv1nAtykxBrupQ [delete] v33'18 uv18 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f9ad402a040 con 0x7f9adc07d060 2024-09-18T01:46:28.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.555+0000 7f9aefd24800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-18T01:46:28.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.555+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:157 7.15 7:a93a5511:::notify.2:head [notify cookie 94903347273744 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5650684e3f30 con 0x565068480140 2024-09-18T01:46:28.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.556+0000 7f9aec2e1640 1 -- 172.21.15.146:0/3817297769 <== osd.3 v2:172.21.15.146:6809/4106661138 38 ==== watch-notify(notify (1) cookie 94903346944976 notify 141733920775 ret 0) ==== 212+0+0 (crc 0 0 0) 0x5650684974e0 con 0x565068480140 2024-09-18T01:46:28.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.556+0000 7f99caffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920775 cookie 94903346944976 notifier 4768 bl.length()=170 2024-09-18T01:46:28.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.556+0000 7f99caffd640 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:158 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f99b0003d60 con 0x565068480140 2024-09-18T01:46:28.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.556+0000 7f9aec2e1640 1 -- 172.21.15.146:0/3817297769 <== osd.3 v2:172.21.15.146:6809/4106661138 39 ==== osd_op_reply(157 notify.2 [notify cookie 94903347273744 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9ae403e020 con 0x565068480140 2024-09-18T01:46:28.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.556+0000 7f9aec2e1640 1 -- 172.21.15.146:0/3817297769 <== osd.3 v2:172.21.15.146:6809/4106661138 40 ==== watch-notify(notify_complete (2) cookie 94903347273744 notify 141733920775 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56506846ea70 con 0x565068480140 2024-09-18T01:46:28.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.556+0000 7f9aefd24800 10 removing email index: 2024-09-18T01:46:28.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.556+0000 7f9aefd24800 10 removing user buckets index 2024-09-18T01:46:28.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.556+0000 7f9aec2e1640 1 -- 172.21.15.146:0/3817297769 <== osd.3 v2:172.21.15.146:6809/4106661138 41 ==== osd_op_reply(158 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ae403e020 con 0x565068480140 2024-09-18T01:46:28.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.556+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:159 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5650684e46f0 con 0x7f9adc07d060 2024-09-18T01:46:28.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.557+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.0 v2:172.21.15.129:6800/1759265424 37 ==== osd_op_reply(159 fud.buckets [delete] v33'8 uv8 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f9ad402a040 con 0x7f9adc07d060 2024-09-18T01:46:28.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.557+0000 7f9aefd24800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-18T01:46:28.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.557+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94903347207648 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5650684e46f0 con 0x7f9adc07d060 2024-09-18T01:46:28.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.557+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.0 v2:172.21.15.129:6800/1759265424 38 ==== watch-notify(notify (1) cookie 94903346960288 notify 141733920807 ret 0) ==== 202+0+0 (crc 0 0 0) 0x565068497880 con 0x7f9adc07d060 2024-09-18T01:46:28.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.557+0000 7f99ca7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920807 cookie 94903346960288 notifier 4768 bl.length()=160 2024-09-18T01:46:28.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.557+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.0 v2:172.21.15.129:6800/1759265424 39 ==== osd_op_reply(160 notify.6 [notify cookie 94903347207648 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9ad402a040 con 0x7f9adc07d060 2024-09-18T01:46:28.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.557+0000 7f99ca7fc640 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f99200032c0 con 0x7f9adc07d060 2024-09-18T01:46:28.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.558+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.0 v2:172.21.15.129:6800/1759265424 40 ==== watch-notify(notify_complete (2) cookie 94903347207648 notify 141733920807 ret 0) ==== 42+0+48 (crc 0 0 0) 0x565068471720 con 0x7f9adc07d060 2024-09-18T01:46:28.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.558+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.0 v2:172.21.15.129:6800/1759265424 41 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ad402a040 con 0x7f9adc07d060 2024-09-18T01:46:28.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.558+0000 7f9aefd24800 10 removing user index: fud 2024-09-18T01:46:28.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.558+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:162 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5650684e46f0 con 0x7f9adc07d060 2024-09-18T01:46:28.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.559+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.0 v2:172.21.15.129:6800/1759265424 42 ==== osd_op_reply(162 fud [call,call,delete] v33'11 uv11 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f9ad402a040 con 0x7f9adc07d060 2024-09-18T01:46:28.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.559+0000 7f9aefd24800 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-18T01:46:28.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.559+0000 7f9aefd24800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-18T01:46:28.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.559+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94903347203296 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5650684e46f0 con 0x7f9adc07d060 2024-09-18T01:46:28.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.559+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.0 v2:172.21.15.129:6800/1759265424 43 ==== watch-notify(notify (1) cookie 94903346959232 notify 141733920808 ret 0) ==== 194+0+0 (crc 0 0 0) 0x565068471720 con 0x7f9adc07d060 2024-09-18T01:46:28.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.559+0000 7f99ca7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920808 cookie 94903346959232 notifier 4768 bl.length()=152 2024-09-18T01:46:28.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.559+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.0 v2:172.21.15.129:6800/1759265424 44 ==== osd_op_reply(163 notify.5 [notify cookie 94903347203296 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9ad402a040 con 0x7f9adc07d060 2024-09-18T01:46:28.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.559+0000 7f99ca7fc640 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f99200032c0 con 0x7f9adc07d060 2024-09-18T01:46:28.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.559+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.0 v2:172.21.15.129:6800/1759265424 45 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ad402a040 con 0x7f9adc07d060 2024-09-18T01:46:28.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.559+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.0 v2:172.21.15.129:6800/1759265424 46 ==== watch-notify(notify_complete (2) cookie 94903347203296 notify 141733920808 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56506848dfa0 con 0x7f9adc07d060 2024-09-18T01:46:28.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.560+0000 7f99a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:46:28.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.560+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94903346963968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5650684e46f0 con 0x565068479ef0 2024-09-18T01:46:28.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.561+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.1 v2:172.21.15.146:6808/3930274777 42 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94903346963968] v33'233 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9ad402a040 con 0x565068479ef0 2024-09-18T01:46:28.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.561+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94903346940688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5650684e46f0 con 0x7f9ae40123a0 2024-09-18T01:46:28.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.562+0000 7f9aebae0640 1 -- 172.21.15.146:0/3817297769 <== osd.2 v2:172.21.15.146:6800/3820039304 47 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94903346940688] v33'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9adc0c3040 con 0x7f9ae40123a0 2024-09-18T01:46:28.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.562+0000 7f9aefd24800 20 remove_watcher() i=0 2024-09-18T01:46:28.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.562+0000 7f9aefd24800 2 removed watcher, disabling cache 2024-09-18T01:46:28.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.562+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94903346947024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565068484b10 con 0x565068479ef0 2024-09-18T01:46:28.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.563+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.1 v2:172.21.15.146:6808/3930274777 43 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94903346947024] v33'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ad402a040 con 0x565068479ef0 2024-09-18T01:46:28.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.563+0000 7f9aefd24800 20 remove_watcher() i=1 2024-09-18T01:46:28.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.563+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94903346944976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565068484b10 con 0x565068480140 2024-09-18T01:46:28.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.564+0000 7f9aec2e1640 1 -- 172.21.15.146:0/3817297769 <== osd.3 v2:172.21.15.146:6809/4106661138 42 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94903346944976] v33'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ae403e020 con 0x565068480140 2024-09-18T01:46:28.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.564+0000 7f9aefd24800 20 remove_watcher() i=2 2024-09-18T01:46:28.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.564+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94903346954080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565068484b10 con 0x7f9ae40123a0 2024-09-18T01:46:28.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.565+0000 7f9aebae0640 1 -- 172.21.15.146:0/3817297769 <== osd.2 v2:172.21.15.146:6800/3820039304 48 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94903346954080] v33'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9adc0c3040 con 0x7f9ae40123a0 2024-09-18T01:46:28.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.565+0000 7f9aefd24800 20 remove_watcher() i=3 2024-09-18T01:46:28.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.565+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94903346948304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565068484b10 con 0x565068479ef0 2024-09-18T01:46:28.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.566+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.1 v2:172.21.15.146:6808/3930274777 44 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94903346948304] v33'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ad402a040 con 0x565068479ef0 2024-09-18T01:46:28.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.566+0000 7f9aefd24800 20 remove_watcher() i=4 2024-09-18T01:46:28.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.566+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94903346959232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565068484b10 con 0x7f9adc07d060 2024-09-18T01:46:28.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.567+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.0 v2:172.21.15.129:6800/1759265424 47 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94903346959232] v33'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ad402a040 con 0x7f9adc07d060 2024-09-18T01:46:28.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.567+0000 7f9aefd24800 20 remove_watcher() i=5 2024-09-18T01:46:28.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.567+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94903346960288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565068489380 con 0x7f9adc07d060 2024-09-18T01:46:28.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.568+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.0 v2:172.21.15.129:6800/1759265424 48 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94903346960288] v33'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ad402a040 con 0x7f9adc07d060 2024-09-18T01:46:28.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.568+0000 7f9aefd24800 20 remove_watcher() i=6 2024-09-18T01:46:28.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.568+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94903346962912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565068484b10 con 0x7f9adc07d060 2024-09-18T01:46:28.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.569+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 <== osd.0 v2:172.21.15.129:6800/1759265424 49 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94903346962912] v33'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ad402a040 con 0x7f9adc07d060 2024-09-18T01:46:28.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.569+0000 7f9aefd24800 20 remove_watcher() i=7 2024-09-18T01:46:28.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.569+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f9adc07d060 msgr2=0x7f9adc004280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.569+0000 7f9aefd24800 1 --2- 172.21.15.146:0/3817297769 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f9adc07d060 0x7f9adc004280 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.569+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x565068479ef0 msgr2=0x56506847c3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.569+0000 7f9aefd24800 1 --2- 172.21.15.146:0/3817297769 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x565068479ef0 0x56506847c3b0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.570+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f9ae40123a0 msgr2=0x7f9ae40375a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.570+0000 7f9aefd24800 1 --2- 172.21.15.146:0/3817297769 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f9ae40123a0 0x7f9ae40375a0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.570+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x565068480140 msgr2=0x565068482530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.570+0000 7f9aefd24800 1 --2- 172.21.15.146:0/3817297769 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x565068480140 0x565068482530 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.570+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f99b4036b40 msgr2=0x7f99b4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.570+0000 7f9aefd24800 1 --2- 172.21.15.146:0/3817297769 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f99b4036b40 0x7f99b4039000 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9adc08eee0 tx=0x7f9adc094000 comp rx=0 tx=0).stop 2024-09-18T01:46:28.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.570+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x565068466e30 msgr2=0x56506846e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.570+0000 7f9aefd24800 1 --2- 172.21.15.146:0/3817297769 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x565068466e30 0x56506846e2a0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f9ae4001f80 tx=0x7f9ae404c880 comp rx=0 tx=0).stop 2024-09-18T01:46:28.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.570+0000 7f9ae3fff640 1 -- 172.21.15.146:0/3817297769 reap_dead start 2024-09-18T01:46:28.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.570+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 shutdown_connections 2024-09-18T01:46:28.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.570+0000 7f9aefd24800 1 --2- 172.21.15.146:0/3817297769 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x565068466e30 0x56506846e2a0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.570+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 >> 172.21.15.146:0/3817297769 conn(0x565068463190 msgr2=0x565068461260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:28.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.570+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 shutdown_connections 2024-09-18T01:46:28.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.570+0000 7f9aefd24800 1 -- 172.21.15.146:0/3817297769 wait complete. 2024-09-18T01:46:28.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.570+0000 7f9aefd24800 1 -- 172.21.15.146:0/129776182 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f99c4036b40 msgr2=0x7f99c4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.570+0000 7f9aefd24800 1 --2- 172.21.15.146:0/129776182 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f99c4036b40 0x7f99c4039000 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9adc05ffd0 tx=0x7f9adc08ec10 comp rx=0 tx=0).stop 2024-09-18T01:46:28.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.570+0000 7f9aefd24800 1 -- 172.21.15.146:0/129776182 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x565068435f60 msgr2=0x5650684345b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.570+0000 7f9aefd24800 1 --2- 172.21.15.146:0/129776182 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x565068435f60 0x5650684345b0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x56506843de20 tx=0x7f9ae40178e0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.570+0000 7f9aefd24800 1 -- 172.21.15.146:0/129776182 shutdown_connections 2024-09-18T01:46:28.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.570+0000 7f9aefd24800 1 --2- 172.21.15.146:0/129776182 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f99c4036b40 0x7f99c4039000 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.570+0000 7f9aefd24800 1 --2- 172.21.15.146:0/129776182 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x565068435f60 0x5650684345b0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.570+0000 7f9aefd24800 1 -- 172.21.15.146:0/129776182 >> 172.21.15.146:0/129776182 conn(0x56506844ced0 msgr2=0x56506844fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:28.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.570+0000 7f9aefd24800 1 -- 172.21.15.146:0/129776182 shutdown_connections 2024-09-18T01:46:28.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.570+0000 7f9aefd24800 1 -- 172.21.15.146:0/129776182 wait complete. 2024-09-18T01:46:28.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.570+0000 7f9aefd24800 1 -- 172.21.15.146:0/4127218935 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x565068345e20 msgr2=0x5650684441e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.571+0000 7f9aefd24800 1 --2- 172.21.15.146:0/4127218935 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x565068345e20 0x5650684441e0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.571+0000 7f9aefd24800 1 -- 172.21.15.146:0/4127218935 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x565068446230 msgr2=0x565068449a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.571+0000 7f9aefd24800 1 --2- 172.21.15.146:0/4127218935 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x565068446230 0x565068449a40 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.571+0000 7f9aefd24800 1 -- 172.21.15.146:0/4127218935 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f99d4036b40 msgr2=0x7f99d4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.571+0000 7f9aefd24800 1 --2- 172.21.15.146:0/4127218935 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f99d4036b40 0x7f99d4039000 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9ad4000f60 tx=0x7f9ad40012b0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.571+0000 7f9aefd24800 1 -- 172.21.15.146:0/4127218935 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5650683454e0 msgr2=0x56506843d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:46:28.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.571+0000 7f9aefd24800 1 --2- 172.21.15.146:0/4127218935 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5650683454e0 0x56506843d170 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x5650682b94a0 tx=0x7f9adc002fb0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.571+0000 7f9aefd24800 1 -- 172.21.15.146:0/4127218935 shutdown_connections 2024-09-18T01:46:28.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.571+0000 7f9aefd24800 1 --2- 172.21.15.146:0/4127218935 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x565068446230 0x565068449a40 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.571+0000 7f9aefd24800 1 --2- 172.21.15.146:0/4127218935 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x565068345e20 0x5650684441e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.571+0000 7f9aefd24800 1 --2- 172.21.15.146:0/4127218935 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f99d4036b40 0x7f99d4039000 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.571+0000 7f9aefd24800 1 --2- 172.21.15.146:0/4127218935 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5650683454e0 0x56506843d170 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:46:28.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.571+0000 7f9aefd24800 1 -- 172.21.15.146:0/4127218935 >> 172.21.15.146:0/4127218935 conn(0x565068340dd0 msgr2=0x56506842e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:46:28.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.571+0000 7f9aefd24800 1 -- 172.21.15.146:0/4127218935 shutdown_connections 2024-09-18T01:46:28.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:46:28.571+0000 7f9aefd24800 1 -- 172.21.15.146:0/4127218935 wait complete. 2024-09-18T01:47:08.581 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'trim', '--uid', 'foo'] 2024-09-18T01:47:08.582 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'trim', '--uid', 'foo'] 2024-09-18T01:47:08.582 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage trim --uid foo 2024-09-18T01:47:08.634 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:47:08.634 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:47:08.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.634+0000 7fc36fb19800 1 Processor -- start 2024-09-18T01:47:08.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.634+0000 7fc36fb19800 1 -- start start 2024-09-18T01:47:08.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.635+0000 7fc36fb19800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x556ca5112970 0x556ca5114d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:08.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.635+0000 7fc36fb19800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556ca4fcdb30 con 0x556ca5082630 2024-09-18T01:47:08.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.635+0000 7fc36fb19800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x556ca4faf360 con 0x556ca5112970 2024-09-18T01:47:08.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.635+0000 7fc364e0c640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x556ca5112970 0x556ca5114d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:08.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.635+0000 7fc364e0c640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x556ca5112970 0x556ca5114d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:36830/0 (socket says 172.21.15.146:36830) 2024-09-18T01:47:08.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.635+0000 7fc364e0c640 1 -- 172.21.15.146:0/137060526 learned_addr learned my addr 172.21.15.146:0/137060526 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:08.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.635+0000 7fc36d60d640 1 --1- 172.21.15.146:0/137060526 >> v1:172.21.15.129:6789/0 conn(0x556ca5082630 0x556ca5111250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:52974/0 (socket says 172.21.15.146:52974) 2024-09-18T01:47:08.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.635+0000 7fc364e0c640 1 -- 172.21.15.146:0/137060526 >> v1:172.21.15.129:6789/0 conn(0x556ca5082630 legacy=0x556ca5111250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:08.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.635+0000 7fc364e0c640 1 -- 172.21.15.146:0/137060526 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ca4fd5e00 con 0x556ca5112970 2024-09-18T01:47:08.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.637+0000 7fc364e0c640 1 --2- 172.21.15.146:0/137060526 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556ca5112970 0x556ca5114d60 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fc35800a520 tx=0x7fc358045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cbe708d42a75dba server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:08.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.637+0000 7fc36ce0c640 1 -- 172.21.15.146:0/137060526 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc358055070 con 0x556ca5112970 2024-09-18T01:47:08.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.637+0000 7fc36ce0c640 1 -- 172.21.15.146:0/137060526 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3580515b0 con 0x556ca5112970 2024-09-18T01:47:08.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.637+0000 7fc36ce0c640 1 -- 172.21.15.146:0/137060526 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3580518d0 con 0x556ca5112970 2024-09-18T01:47:08.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.638+0000 7fc36fb19800 1 -- 172.21.15.146:0/137060526 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556ca5112970 msgr2=0x556ca5114d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:08.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.638+0000 7fc36fb19800 1 --2- 172.21.15.146:0/137060526 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556ca5112970 0x556ca5114d60 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fc35800a520 tx=0x7fc358045ba0 comp rx=0 tx=0).stop 2024-09-18T01:47:08.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.638+0000 7fc36fb19800 1 -- 172.21.15.146:0/137060526 shutdown_connections 2024-09-18T01:47:08.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.638+0000 7fc36fb19800 1 --2- 172.21.15.146:0/137060526 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556ca5112970 0x556ca5114d60 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:08.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.638+0000 7fc36fb19800 1 -- 172.21.15.146:0/137060526 >> 172.21.15.146:0/137060526 conn(0x556ca5108de0 msgr2=0x556ca510b200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:08.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.638+0000 7fc36fb19800 1 -- 172.21.15.146:0/137060526 shutdown_connections 2024-09-18T01:47:08.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.638+0000 7fc36fb19800 1 -- 172.21.15.146:0/137060526 wait complete. 2024-09-18T01:47:08.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.654+0000 7fc36fb19800 1 Processor -- start 2024-09-18T01:47:08.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.654+0000 7fc36fb19800 1 -- start start 2024-09-18T01:47:08.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.654+0000 7fc36fb19800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556ca5082630 0x556ca510eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:08.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.654+0000 7fc36fb19800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x556ca505a330 con 0x556ca5082630 2024-09-18T01:47:08.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.654+0000 7fc36d60d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556ca5082630 0x556ca510eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:08.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.654+0000 7fc36d60d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556ca5082630 0x556ca510eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:36838/0 (socket says 172.21.15.146:36838) 2024-09-18T01:47:08.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.654+0000 7fc36d60d640 1 -- 172.21.15.146:0/2331268621 learned_addr learned my addr 172.21.15.146:0/2331268621 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:08.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.655+0000 7fc36d60d640 1 -- 172.21.15.146:0/2331268621 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ca4fa7bc0 con 0x556ca5082630 2024-09-18T01:47:08.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.655+0000 7fc36d60d640 1 --2- 172.21.15.146:0/2331268621 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556ca5082630 0x556ca510eb80 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fc36000b230 tx=0x7fc36000b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f177ba3610e93f6e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:08.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.655+0000 7fc25b606640 1 -- 172.21.15.146:0/2331268621 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc36000e5c0 con 0x556ca5082630 2024-09-18T01:47:08.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.655+0000 7fc25b606640 1 -- 172.21.15.146:0/2331268621 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc360006070 con 0x556ca5082630 2024-09-18T01:47:08.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.655+0000 7fc25b606640 1 -- 172.21.15.146:0/2331268621 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc36000e890 con 0x556ca5082630 2024-09-18T01:47:08.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.656+0000 7fc36fb19800 1 -- 172.21.15.146:0/2331268621 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556ca5082630 msgr2=0x556ca510eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:08.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.656+0000 7fc36fb19800 1 --2- 172.21.15.146:0/2331268621 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556ca5082630 0x556ca510eb80 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fc36000b230 tx=0x7fc36000b6f0 comp rx=0 tx=0).stop 2024-09-18T01:47:08.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.656+0000 7fc36fb19800 1 -- 172.21.15.146:0/2331268621 shutdown_connections 2024-09-18T01:47:08.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.656+0000 7fc36fb19800 1 --2- 172.21.15.146:0/2331268621 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556ca5082630 0x556ca510eb80 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:08.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.656+0000 7fc36fb19800 1 -- 172.21.15.146:0/2331268621 >> 172.21.15.146:0/2331268621 conn(0x556ca5108de0 msgr2=0x556ca51f9230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:08.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.656+0000 7fc36fb19800 1 -- 172.21.15.146:0/2331268621 shutdown_connections 2024-09-18T01:47:08.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.656+0000 7fc36fb19800 1 -- 172.21.15.146:0/2331268621 wait complete. 2024-09-18T01:47:08.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.656+0000 7fc36fb19800 1 Processor -- start 2024-09-18T01:47:08.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.656+0000 7fc36fb19800 1 -- start start 2024-09-18T01:47:08.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.657+0000 7fc36fb19800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556ca5082630 0x556ca5207540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:08.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.657+0000 7fc36fb19800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x556ca5115690 con 0x556ca5082630 2024-09-18T01:47:08.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.657+0000 7fc36d60d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556ca5082630 0x556ca5207540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:08.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.657+0000 7fc36d60d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556ca5082630 0x556ca5207540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:36840/0 (socket says 172.21.15.146:36840) 2024-09-18T01:47:08.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.657+0000 7fc36d60d640 1 -- 172.21.15.146:0/3015476464 learned_addr learned my addr 172.21.15.146:0/3015476464 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:08.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.657+0000 7fc36d60d640 1 -- 172.21.15.146:0/3015476464 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ca4fbbfe0 con 0x556ca5082630 2024-09-18T01:47:08.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.657+0000 7fc36d60d640 1 --2- 172.21.15.146:0/3015476464 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556ca5082630 0x556ca5207540 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fc360000fd0 tx=0x7fc360000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:08.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.657+0000 7fc259e03640 1 -- 172.21.15.146:0/3015476464 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc36000f8d0 con 0x556ca5082630 2024-09-18T01:47:08.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.658+0000 7fc259e03640 1 -- 172.21.15.146:0/3015476464 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc36000fa90 con 0x556ca5082630 2024-09-18T01:47:08.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.658+0000 7fc36fb19800 1 -- 172.21.15.146:0/3015476464 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556ca5207a80 con 0x556ca5082630 2024-09-18T01:47:08.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.658+0000 7fc259e03640 1 -- 172.21.15.146:0/3015476464 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc36000fdb0 con 0x556ca5082630 2024-09-18T01:47:08.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.658+0000 7fc36fb19800 1 -- 172.21.15.146:0/3015476464 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ca5207fa0 con 0x556ca5082630 2024-09-18T01:47:08.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.658+0000 7fc259e03640 1 -- 172.21.15.146:0/3015476464 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc360017070 con 0x556ca5082630 2024-09-18T01:47:08.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.659+0000 7fc259e03640 1 --2- 172.21.15.146:0/3015476464 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc254036b40 0x7fc254039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:08.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.659+0000 7fc259e03640 1 -- 172.21.15.146:0/3015476464 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7fc360015020 con 0x556ca5082630 2024-09-18T01:47:08.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.659+0000 7fc364e0c640 1 --2- 172.21.15.146:0/3015476464 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc254036b40 0x7fc254039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:08.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.659+0000 7fc36fb19800 1 --2- 172.21.15.146:0/3015476464 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x556ca5112970 0x556ca520e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:08.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.659+0000 7fc36fb19800 1 -- 172.21.15.146:0/3015476464 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556ca520eb40 con 0x556ca5112970 2024-09-18T01:47:08.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.659+0000 7fc36de0e640 1 --2- 172.21.15.146:0/3015476464 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x556ca5112970 0x556ca520e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:08.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.659+0000 7fc364e0c640 1 --2- 172.21.15.146:0/3015476464 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc254036b40 0x7fc254039000 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc358057000 tx=0x7fc358052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:08.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.659+0000 7fc36de0e640 1 --2- 172.21.15.146:0/3015476464 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x556ca5112970 0x556ca520e5b0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:08.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.660+0000 7fc36de0e640 1 -- 172.21.15.146:0/3015476464 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc36800a4a0 con 0x556ca5112970 2024-09-18T01:47:08.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.660+0000 7fc36fb19800 1 -- 172.21.15.146:0/3015476464 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556ca520bb60 con 0x556ca5112970 2024-09-18T01:47:08.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.660+0000 7fc36de0e640 1 -- 172.21.15.146:0/3015476464 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc36800a4a0 con 0x556ca5112970 2024-09-18T01:47:08.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.660+0000 7fc36fb19800 1 -- 172.21.15.146:0/3015476464 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556ca5210960 con 0x556ca5112970 2024-09-18T01:47:08.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.660+0000 7fc36de0e640 1 -- 172.21.15.146:0/3015476464 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc36800a4a0 con 0x556ca5112970 2024-09-18T01:47:08.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.660+0000 7fc36fb19800 1 -- 172.21.15.146:0/3015476464 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556ca520faa0 con 0x556ca5112970 2024-09-18T01:47:08.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.661+0000 7fc36de0e640 1 -- 172.21.15.146:0/3015476464 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc36800a4a0 con 0x556ca5112970 2024-09-18T01:47:08.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.661+0000 7fc36fb19800 1 --2- 172.21.15.146:0/3015476464 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x556ca5210540 0x556ca5213da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:08.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.661+0000 7fc36fb19800 1 -- 172.21.15.146:0/3015476464 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556ca5214530 con 0x556ca5210540 2024-09-18T01:47:08.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.661+0000 7fc36d60d640 1 --2- 172.21.15.146:0/3015476464 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x556ca5210540 0x556ca5213da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:08.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.661+0000 7fc36d60d640 1 --2- 172.21.15.146:0/3015476464 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x556ca5210540 0x556ca5213da0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:08.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.661+0000 7fc36d60d640 1 -- 172.21.15.146:0/3015476464 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc36002e070 con 0x556ca5210540 2024-09-18T01:47:08.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.662+0000 7fc36fb19800 1 Processor -- start 2024-09-18T01:47:08.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.662+0000 7fc36fb19800 1 -- start start 2024-09-18T01:47:08.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.662+0000 7fc36fb19800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556ca5222280 0x556ca52226a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:08.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.662+0000 7fc36fb19800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x556ca4fa9580 con 0x556ca5222280 2024-09-18T01:47:08.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.662+0000 7fc36de0e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556ca5222280 0x556ca52226a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:08.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.662+0000 7fc36de0e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556ca5222280 0x556ca52226a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:36854/0 (socket says 172.21.15.146:36854) 2024-09-18T01:47:08.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.662+0000 7fc36de0e640 1 -- 172.21.15.146:0/4000809846 learned_addr learned my addr 172.21.15.146:0/4000809846 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:08.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.663+0000 7fc36de0e640 1 -- 172.21.15.146:0/4000809846 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ca5222be0 con 0x556ca5222280 2024-09-18T01:47:08.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.663+0000 7fc36de0e640 1 --2- 172.21.15.146:0/4000809846 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556ca5222280 0x556ca52226a0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x556ca520ef40 tx=0x7fc3680178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:08.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.663+0000 7fc252ffd640 1 -- 172.21.15.146:0/4000809846 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc368013440 con 0x556ca5222280 2024-09-18T01:47:08.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.663+0000 7fc252ffd640 1 -- 172.21.15.146:0/4000809846 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3680135e0 con 0x556ca5222280 2024-09-18T01:47:08.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.663+0000 7fc36fb19800 1 -- 172.21.15.146:0/4000809846 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556ca5222e70 con 0x556ca5222280 2024-09-18T01:47:08.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.663+0000 7fc252ffd640 1 -- 172.21.15.146:0/4000809846 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3680138c0 con 0x556ca5222280 2024-09-18T01:47:08.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.663+0000 7fc36fb19800 1 -- 172.21.15.146:0/4000809846 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ca5225b50 con 0x556ca5222280 2024-09-18T01:47:08.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.664+0000 7fc252ffd640 1 -- 172.21.15.146:0/4000809846 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc368011040 con 0x556ca5222280 2024-09-18T01:47:08.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.664+0000 7fc252ffd640 1 --2- 172.21.15.146:0/4000809846 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc244036b90 0x7fc244039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:08.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.664+0000 7fc252ffd640 1 -- 172.21.15.146:0/4000809846 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7fc36801d070 con 0x556ca5222280 2024-09-18T01:47:08.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.664+0000 7fc36d60d640 1 --2- 172.21.15.146:0/4000809846 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc244036b90 0x7fc244039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:08.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.665+0000 7fc36fb19800 1 Processor -- start 2024-09-18T01:47:08.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.665+0000 7fc36fb19800 1 -- start start 2024-09-18T01:47:08.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.665+0000 7fc36d60d640 1 --2- 172.21.15.146:0/4000809846 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc244036b90 0x7fc244039050 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x556ca520fe40 tx=0x7fc3600173c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:08.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.665+0000 7fc36fb19800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556ca522ef50 0x556ca522f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:08.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.665+0000 7fc36fb19800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x556ca510d250 con 0x556ca522ef50 2024-09-18T01:47:08.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.665+0000 7fc36de0e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556ca522ef50 0x556ca522f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:08.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.665+0000 7fc36de0e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556ca522ef50 0x556ca522f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:36866/0 (socket says 172.21.15.146:36866) 2024-09-18T01:47:08.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.665+0000 7fc36de0e640 1 -- 172.21.15.146:0/893852981 learned_addr learned my addr 172.21.15.146:0/893852981 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:08.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.665+0000 7fc36de0e640 1 -- 172.21.15.146:0/893852981 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ca522f920 con 0x556ca522ef50 2024-09-18T01:47:08.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.666+0000 7fc36de0e640 1 --2- 172.21.15.146:0/893852981 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556ca522ef50 0x556ca522f350 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fc368001450 tx=0x7fc368012a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f959341ab97b921 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:08.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.666+0000 7fc250ff9640 1 -- 172.21.15.146:0/893852981 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc368045070 con 0x556ca522ef50 2024-09-18T01:47:08.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.666+0000 7fc250ff9640 1 -- 172.21.15.146:0/893852981 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc36802ac50 con 0x556ca522ef50 2024-09-18T01:47:08.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.666+0000 7fc250ff9640 1 -- 172.21.15.146:0/893852981 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc36804b250 con 0x556ca522ef50 2024-09-18T01:47:08.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.666+0000 7fc36fb19800 1 -- 172.21.15.146:0/893852981 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556ca522ef50 msgr2=0x556ca522f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:08.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.666+0000 7fc36fb19800 1 --2- 172.21.15.146:0/893852981 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556ca522ef50 0x556ca522f350 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fc368001450 tx=0x7fc368012a60 comp rx=0 tx=0).stop 2024-09-18T01:47:08.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.666+0000 7fc36fb19800 1 -- 172.21.15.146:0/893852981 shutdown_connections 2024-09-18T01:47:08.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.666+0000 7fc36fb19800 1 --2- 172.21.15.146:0/893852981 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556ca522ef50 0x556ca522f350 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:08.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.666+0000 7fc36fb19800 1 -- 172.21.15.146:0/893852981 >> 172.21.15.146:0/893852981 conn(0x556ca522b2b0 msgr2=0x556ca52293b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:08.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.666+0000 7fc36fb19800 1 -- 172.21.15.146:0/893852981 shutdown_connections 2024-09-18T01:47:08.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.666+0000 7fc36fb19800 1 -- 172.21.15.146:0/893852981 wait complete. 2024-09-18T01:47:08.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.667+0000 7fc36fb19800 1 Processor -- start 2024-09-18T01:47:08.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.667+0000 7fc36fb19800 1 -- start start 2024-09-18T01:47:08.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.667+0000 7fc36fb19800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556ca522ef50 0x556ca5236330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:08.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.667+0000 7fc36fb19800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x556ca522ff90 con 0x556ca522ef50 2024-09-18T01:47:08.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.667+0000 7fc36de0e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556ca522ef50 0x556ca5236330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:08.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.667+0000 7fc36de0e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556ca522ef50 0x556ca5236330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:36872/0 (socket says 172.21.15.146:36872) 2024-09-18T01:47:08.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.667+0000 7fc36de0e640 1 -- 172.21.15.146:0/2415965072 learned_addr learned my addr 172.21.15.146:0/2415965072 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:08.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.667+0000 7fc36de0e640 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ca5236870 con 0x556ca522ef50 2024-09-18T01:47:08.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.668+0000 7fc36de0e640 1 --2- 172.21.15.146:0/2415965072 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556ca522ef50 0x556ca5236330 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fc368012bb0 tx=0x7fc36804c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:08.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.668+0000 7fc242ffd640 1 -- 172.21.15.146:0/2415965072 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc36803a070 con 0x556ca522ef50 2024-09-18T01:47:08.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.668+0000 7fc242ffd640 1 -- 172.21.15.146:0/2415965072 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc368001720 con 0x556ca522ef50 2024-09-18T01:47:08.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.668+0000 7fc242ffd640 1 -- 172.21.15.146:0/2415965072 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc368045040 con 0x556ca522ef50 2024-09-18T01:47:08.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.668+0000 7fc36fb19800 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556ca5236b00 con 0x556ca522ef50 2024-09-18T01:47:08.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.668+0000 7fc36fb19800 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ca52397b0 con 0x556ca522ef50 2024-09-18T01:47:08.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.668+0000 7fc242ffd640 1 -- 172.21.15.146:0/2415965072 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc36803d070 con 0x556ca522ef50 2024-09-18T01:47:08.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.669+0000 7fc242ffd640 1 --2- 172.21.15.146:0/2415965072 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc238036b40 0x7fc238039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:08.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.669+0000 7fc242ffd640 1 -- 172.21.15.146:0/2415965072 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7fc368032070 con 0x556ca522ef50 2024-09-18T01:47:08.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.669+0000 7fc36d60d640 1 --2- 172.21.15.146:0/2415965072 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc238036b40 0x7fc238039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:08.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.669+0000 7fc36d60d640 1 --2- 172.21.15.146:0/2415965072 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc238036b40 0x7fc238039000 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc36000ff70 tx=0x7fc360044000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:08.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.669+0000 7fc36fb19800 20 rados->read ofs=0 len=0 2024-09-18T01:47:08.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.670+0000 7fc36fb19800 1 --2- 172.21.15.146:0/2415965072 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x556ca5242060 0x556ca5244520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:08.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.670+0000 7fc36fb19800 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556ca5244c70 con 0x556ca5242060 2024-09-18T01:47:08.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.670+0000 7fc364e0c640 1 --2- 172.21.15.146:0/2415965072 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x556ca5242060 0x556ca5244520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:08.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.670+0000 7fc364e0c640 1 --2- 172.21.15.146:0/2415965072 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x556ca5242060 0x556ca5244520 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:08.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.670+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc358057030 con 0x556ca5242060 2024-09-18T01:47:08.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.670+0000 7fc36fb19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:08.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.670+0000 7fc36fb19800 20 realm 2024-09-18T01:47:08.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.670+0000 7fc36fb19800 20 rados->read ofs=0 len=0 2024-09-18T01:47:08.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.670+0000 7fc36fb19800 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556ca52450a0 con 0x556ca5242060 2024-09-18T01:47:08.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.670+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc358057030 con 0x556ca5242060 2024-09-18T01:47:08.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.670+0000 7fc36fb19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:08.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.670+0000 7fc36fb19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:47:08.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.670+0000 7fc36fb19800 20 rados->read ofs=0 len=0 2024-09-18T01:47:08.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.670+0000 7fc36fb19800 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556ca5245970 con 0x556ca5242060 2024-09-18T01:47:08.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.671+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc358057030 con 0x556ca5242060 2024-09-18T01:47:08.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.671+0000 7fc36fb19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:08.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.671+0000 7fc36fb19800 20 rados->read ofs=0 len=0 2024-09-18T01:47:08.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.671+0000 7fc36fb19800 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556ca5245d10 con 0x556ca5242060 2024-09-18T01:47:08.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.671+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc358057030 con 0x556ca5242060 2024-09-18T01:47:08.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.671+0000 7fc36fb19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:47:08.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.671+0000 7fc36fb19800 20 rados->read ofs=0 len=0 2024-09-18T01:47:08.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.671+0000 7fc36fb19800 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556ca5246560 con 0x556ca5242060 2024-09-18T01:47:08.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.671+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc358057030 con 0x556ca5242060 2024-09-18T01:47:08.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.671+0000 7fc36fb19800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:47:08.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.671+0000 7fc36fb19800 20 searching for the correct realm 2024-09-18T01:47:08.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.671+0000 7fc36fb19800 1 --2- 172.21.15.146:0/2415965072 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x556ca52482d0 0x556ca524a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:08.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.671+0000 7fc36fb19800 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ca524acf0 con 0x556ca52482d0 2024-09-18T01:47:08.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.671+0000 7fc36de0e640 1 --2- 172.21.15.146:0/2415965072 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x556ca52482d0 0x556ca524a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:08.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.672+0000 7fc36de0e640 1 --2- 172.21.15.146:0/2415965072 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x556ca52482d0 0x556ca524a6c0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:08.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.672+0000 7fc36de0e640 1 -- 172.21.15.146:0/2415965072 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc36803c030 con 0x556ca52482d0 2024-09-18T01:47:08.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.672+0000 7fc36de0e640 1 --2- 172.21.15.146:0/2415965072 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fc36803f060 0x7fc368023770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:08.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.672+0000 7fc36de0e640 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ca524acf0 con 0x7fc36803f060 2024-09-18T01:47:08.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.672+0000 7fc36d60d640 1 --2- 172.21.15.146:0/2415965072 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fc36803f060 0x7fc368023770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:08.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.672+0000 7fc36d60d640 1 --2- 172.21.15.146:0/2415965072 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fc36803f060 0x7fc368023770 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:08.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.673+0000 7fc36d60d640 1 -- 172.21.15.146:0/2415965072 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc36002e070 con 0x7fc36803f060 2024-09-18T01:47:08.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.673+0000 7fc36d60d640 1 --2- 172.21.15.146:0/2415965072 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fc36000f070 0x7fc36001c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:08.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.673+0000 7fc36d60d640 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ca524acf0 con 0x7fc36000f070 2024-09-18T01:47:08.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.673+0000 7fc364e0c640 1 --2- 172.21.15.146:0/2415965072 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fc36000f070 0x7fc36001c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:08.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.673+0000 7fc364e0c640 1 --2- 172.21.15.146:0/2415965072 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fc36000f070 0x7fc36001c620 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:08.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.674+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc358057030 con 0x7fc36000f070 2024-09-18T01:47:08.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.674+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ca524acf0 con 0x556ca5242060 2024-09-18T01:47:08.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.674+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc358057030 con 0x556ca5242060 2024-09-18T01:47:08.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.674+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ca524acf0 con 0x556ca5242060 2024-09-18T01:47:08.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.674+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc358057030 con 0x556ca5242060 2024-09-18T01:47:08.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.674+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ca524acf0 con 0x7fc36000f070 2024-09-18T01:47:08.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.675+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc358057030 con 0x7fc36000f070 2024-09-18T01:47:08.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.675+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ca524acf0 con 0x7fc36000f070 2024-09-18T01:47:08.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.675+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc358057030 con 0x7fc36000f070 2024-09-18T01:47:08.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.675+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ca524acf0 con 0x7fc36803f060 2024-09-18T01:47:08.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.675+0000 7fc36d60d640 1 -- 172.21.15.146:0/2415965072 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc36002e070 con 0x7fc36803f060 2024-09-18T01:47:08.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.675+0000 7fc36d60d640 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ca524acf0 con 0x556ca52482d0 2024-09-18T01:47:08.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.675+0000 7fc36de0e640 1 -- 172.21.15.146:0/2415965072 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc36803c030 con 0x556ca52482d0 2024-09-18T01:47:08.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.675+0000 7fc36de0e640 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ca524acf0 con 0x556ca5242060 2024-09-18T01:47:08.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.676+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc358057030 con 0x556ca5242060 2024-09-18T01:47:08.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.676+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ca524acf0 con 0x7fc36000f070 2024-09-18T01:47:08.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.676+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc358057030 con 0x7fc36000f070 2024-09-18T01:47:08.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.676+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ca524acf0 con 0x556ca5242060 2024-09-18T01:47:08.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.676+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc358057030 con 0x556ca5242060 2024-09-18T01:47:08.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.676+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ca524acf0 con 0x7fc36803f060 2024-09-18T01:47:08.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.676+0000 7fc36d60d640 1 -- 172.21.15.146:0/2415965072 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fc36002e070 con 0x7fc36803f060 2024-09-18T01:47:08.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.676+0000 7fc36d60d640 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ca524acf0 con 0x556ca52482d0 2024-09-18T01:47:08.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.677+0000 7fc36de0e640 1 -- 172.21.15.146:0/2415965072 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc36803c030 con 0x556ca52482d0 2024-09-18T01:47:08.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.677+0000 7fc36de0e640 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ca524acf0 con 0x556ca52482d0 2024-09-18T01:47:08.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.677+0000 7fc36de0e640 1 -- 172.21.15.146:0/2415965072 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc36803c030 con 0x556ca52482d0 2024-09-18T01:47:08.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.677+0000 7fc36de0e640 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ca524acf0 con 0x7fc36000f070 2024-09-18T01:47:08.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.677+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc358057030 con 0x7fc36000f070 2024-09-18T01:47:08.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.677+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ca524acf0 con 0x556ca52482d0 2024-09-18T01:47:08.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.678+0000 7fc36de0e640 1 -- 172.21.15.146:0/2415965072 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc36803c030 con 0x556ca52482d0 2024-09-18T01:47:08.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.678+0000 7fc36de0e640 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ca524acf0 con 0x556ca52482d0 2024-09-18T01:47:08.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.678+0000 7fc36de0e640 1 -- 172.21.15.146:0/2415965072 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc36803c030 con 0x556ca52482d0 2024-09-18T01:47:08.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.678+0000 7fc36de0e640 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ca524acf0 con 0x556ca5242060 2024-09-18T01:47:08.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.678+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc358057030 con 0x556ca5242060 2024-09-18T01:47:08.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.678+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ca524acf0 con 0x556ca5242060 2024-09-18T01:47:08.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.678+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc358057030 con 0x556ca5242060 2024-09-18T01:47:08.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.678+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ca524acf0 con 0x7fc36000f070 2024-09-18T01:47:08.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.679+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc358057030 con 0x7fc36000f070 2024-09-18T01:47:08.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.679+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ca524acf0 con 0x556ca52482d0 2024-09-18T01:47:08.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.679+0000 7fc36de0e640 1 -- 172.21.15.146:0/2415965072 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc36803c030 con 0x556ca52482d0 2024-09-18T01:47:08.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.679+0000 7fc36de0e640 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ca524acf0 con 0x7fc36803f060 2024-09-18T01:47:08.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.679+0000 7fc36d60d640 1 -- 172.21.15.146:0/2415965072 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc36002e070 con 0x7fc36803f060 2024-09-18T01:47:08.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.679+0000 7fc36d60d640 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ca524acf0 con 0x556ca5242060 2024-09-18T01:47:08.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.680+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc358057030 con 0x556ca5242060 2024-09-18T01:47:08.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.680+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ca524acf0 con 0x7fc36000f070 2024-09-18T01:47:08.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.680+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc358057030 con 0x7fc36000f070 2024-09-18T01:47:08.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.680+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ca524acf0 con 0x556ca52482d0 2024-09-18T01:47:08.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.680+0000 7fc36de0e640 1 -- 172.21.15.146:0/2415965072 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc36803c030 con 0x556ca52482d0 2024-09-18T01:47:08.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.680+0000 7fc36de0e640 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ca524acf0 con 0x7fc36000f070 2024-09-18T01:47:08.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.681+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc358057030 con 0x7fc36000f070 2024-09-18T01:47:08.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.681+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ca524acf0 con 0x7fc36803f060 2024-09-18T01:47:08.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.681+0000 7fc36d60d640 1 -- 172.21.15.146:0/2415965072 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc36002e070 con 0x7fc36803f060 2024-09-18T01:47:08.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.681+0000 7fc36d60d640 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ca524acf0 con 0x556ca52482d0 2024-09-18T01:47:08.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.681+0000 7fc36de0e640 1 -- 172.21.15.146:0/2415965072 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc36803c030 con 0x556ca52482d0 2024-09-18T01:47:08.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.681+0000 7fc36de0e640 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ca524acf0 con 0x7fc36000f070 2024-09-18T01:47:08.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.682+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc358057030 con 0x7fc36000f070 2024-09-18T01:47:08.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.682+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ca524acf0 con 0x556ca5242060 2024-09-18T01:47:08.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.682+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc358057030 con 0x556ca5242060 2024-09-18T01:47:08.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.682+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ca524acf0 con 0x7fc36803f060 2024-09-18T01:47:08.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.682+0000 7fc36d60d640 1 -- 172.21.15.146:0/2415965072 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc36002e070 con 0x7fc36803f060 2024-09-18T01:47:08.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.682+0000 7fc36fb19800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:47:08.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.682+0000 7fc36fb19800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:47:08.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.682+0000 7fc36fb19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:47:08.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.682+0000 7fc36fb19800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:47:08.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.682+0000 7fc36fb19800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:47:08.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.682+0000 7fc36fb19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:47:08.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.682+0000 7fc36fb19800 20 rados->read ofs=0 len=0 2024-09-18T01:47:08.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.682+0000 7fc36fb19800 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556ca5246f10 con 0x556ca5242060 2024-09-18T01:47:08.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.682+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc358057030 con 0x556ca5242060 2024-09-18T01:47:08.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.683+0000 7fc36fb19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:08.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.683+0000 7fc36fb19800 20 rados->read ofs=0 len=0 2024-09-18T01:47:08.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.683+0000 7fc36fb19800 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556ca52477b0 con 0x556ca5242060 2024-09-18T01:47:08.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.683+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc358057030 con 0x556ca5242060 2024-09-18T01:47:08.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.683+0000 7fc36fb19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:47:08.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.683+0000 7fc36fb19800 20 rados->read ofs=0 len=0 2024-09-18T01:47:08.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.683+0000 7fc36fb19800 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556ca524b170 con 0x7fc36803f060 2024-09-18T01:47:08.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.683+0000 7fc36d60d640 1 -- 172.21.15.146:0/2415965072 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc36002e070 con 0x7fc36803f060 2024-09-18T01:47:08.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.683+0000 7fc36fb19800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:47:08.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.683+0000 7fc36fb19800 20 zone default found 2024-09-18T01:47:08.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.683+0000 7fc36fb19800 4 Realm: () 2024-09-18T01:47:08.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.683+0000 7fc36fb19800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:47:08.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.683+0000 7fc36fb19800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:47:08.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.683+0000 7fc36fb19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:47:08.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.683+0000 7fc36fb19800 20 zonegroup default 2024-09-18T01:47:08.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.683+0000 7fc36fb19800 20 rados->read ofs=0 len=0 2024-09-18T01:47:08.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.683+0000 7fc36fb19800 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556ca524b9c0 con 0x7fc36000f070 2024-09-18T01:47:08.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.683+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc358057030 con 0x7fc36000f070 2024-09-18T01:47:08.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.684+0000 7fc36fb19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:08.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.684+0000 7fc36fb19800 20 rados->read ofs=0 len=0 2024-09-18T01:47:08.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.684+0000 7fc36fb19800 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556ca524d3a0 con 0x556ca52482d0 2024-09-18T01:47:08.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.684+0000 7fc36de0e640 1 -- 172.21.15.146:0/2415965072 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc36803c030 con 0x556ca52482d0 2024-09-18T01:47:08.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.684+0000 7fc36fb19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:08.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.684+0000 7fc36fb19800 20 rados->read ofs=0 len=0 2024-09-18T01:47:08.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.684+0000 7fc36fb19800 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556ca524d840 con 0x556ca52482d0 2024-09-18T01:47:08.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.684+0000 7fc36de0e640 1 -- 172.21.15.146:0/2415965072 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc36803c030 con 0x556ca52482d0 2024-09-18T01:47:08.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.684+0000 7fc36fb19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:08.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.684+0000 7fc36fb19800 20 started sync module instance, tier type = 2024-09-18T01:47:08.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.684+0000 7fc36fb19800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:47:08.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.684+0000 7fc36fb19800 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556ca524c830 con 0x7fc36803f060 2024-09-18T01:47:08.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.685+0000 7fc36d60d640 1 -- 172.21.15.146:0/2415965072 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v33'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc36002e070 con 0x7fc36803f060 2024-09-18T01:47:08.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.685+0000 7fc36fb19800 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93925115481120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556ca524e150 con 0x7fc36803f060 2024-09-18T01:47:08.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.685+0000 7fc36fb19800 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556ca524e9a0 con 0x556ca5242060 2024-09-18T01:47:08.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.686+0000 7fc36d60d640 1 -- 172.21.15.146:0/2415965072 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93925115481120] v33'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc36002e070 con 0x7fc36803f060 2024-09-18T01:47:08.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.687+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v33'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc358057030 con 0x556ca5242060 2024-09-18T01:47:08.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.687+0000 7fc36fb19800 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93925115485344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556ca524e9a0 con 0x556ca5242060 2024-09-18T01:47:08.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.687+0000 7fc36fb19800 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556ca524f4c0 con 0x556ca52482d0 2024-09-18T01:47:08.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.688+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93925115485344] v33'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc358057030 con 0x556ca5242060 2024-09-18T01:47:08.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.688+0000 7fc36de0e640 1 -- 172.21.15.146:0/2415965072 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v33'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc36803c030 con 0x556ca52482d0 2024-09-18T01:47:08.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.688+0000 7fc36fb19800 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93925115490192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556ca524e9a0 con 0x556ca52482d0 2024-09-18T01:47:08.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.688+0000 7fc36fb19800 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556ca524ff50 con 0x7fc36803f060 2024-09-18T01:47:08.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.690+0000 7fc36d60d640 1 -- 172.21.15.146:0/2415965072 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v33'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc36002e070 con 0x7fc36803f060 2024-09-18T01:47:08.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.690+0000 7fc36fb19800 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93925115492896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556ca52507f0 con 0x7fc36803f060 2024-09-18T01:47:08.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.690+0000 7fc36fb19800 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556ca52512e0 con 0x556ca5242060 2024-09-18T01:47:08.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.690+0000 7fc36de0e640 1 -- 172.21.15.146:0/2415965072 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93925115490192] v33'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc36803c030 con 0x556ca52482d0 2024-09-18T01:47:08.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.691+0000 7fc36d60d640 1 -- 172.21.15.146:0/2415965072 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93925115492896] v33'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc36002e070 con 0x7fc36803f060 2024-09-18T01:47:08.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.691+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v33'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc358057030 con 0x556ca5242060 2024-09-18T01:47:08.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.691+0000 7fc36fb19800 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93925115495232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556ca524e4f0 con 0x556ca5242060 2024-09-18T01:47:08.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.691+0000 7fc36fb19800 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556ca5251bc0 con 0x7fc36000f070 2024-09-18T01:47:08.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.692+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93925115495232] v33'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc358057030 con 0x556ca5242060 2024-09-18T01:47:08.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.692+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v33'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc358057030 con 0x7fc36000f070 2024-09-18T01:47:08.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.693+0000 7fc36fb19800 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93925115497904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556ca5251b30 con 0x7fc36000f070 2024-09-18T01:47:08.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.693+0000 7fc36fb19800 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556ca5252610 con 0x7fc36000f070 2024-09-18T01:47:08.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.694+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93925115497904] v33'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc358057030 con 0x7fc36000f070 2024-09-18T01:47:08.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.694+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v33'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc358057030 con 0x7fc36000f070 2024-09-18T01:47:08.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.694+0000 7fc36fb19800 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93925115502880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556ca52527f0 con 0x7fc36000f070 2024-09-18T01:47:08.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.694+0000 7fc36fb19800 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556ca5253040 con 0x7fc36000f070 2024-09-18T01:47:08.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.695+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(58 notify.7 [create] v33'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc358057030 con 0x7fc36000f070 2024-09-18T01:47:08.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.695+0000 7fc36fb19800 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93925115505104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556ca52533e0 con 0x7fc36000f070 2024-09-18T01:47:08.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.695+0000 7fc36fb19800 20 add_watcher() i=0 2024-09-18T01:47:08.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.695+0000 7fc36fb19800 20 add_watcher() i=1 2024-09-18T01:47:08.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.695+0000 7fc36fb19800 20 add_watcher() i=2 2024-09-18T01:47:08.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.695+0000 7fc36fb19800 20 add_watcher() i=3 2024-09-18T01:47:08.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.695+0000 7fc36fb19800 20 add_watcher() i=4 2024-09-18T01:47:08.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.695+0000 7fc36fb19800 20 add_watcher() i=5 2024-09-18T01:47:08.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.695+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93925115502880] v33'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc358057030 con 0x7fc36000f070 2024-09-18T01:47:08.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.695+0000 7fc36fb19800 20 add_watcher() i=6 2024-09-18T01:47:08.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.696+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93925115505104] v33'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc358057030 con 0x7fc36000f070 2024-09-18T01:47:08.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.696+0000 7fc36fb19800 20 add_watcher() i=7 2024-09-18T01:47:08.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.696+0000 7fc36fb19800 2 all 8 watchers are set, enabling cache 2024-09-18T01:47:08.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.696+0000 7fc36fb19800 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556ca5251680 con 0x556ca5242060 2024-09-18T01:47:08.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.696+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc358057030 con 0x556ca5242060 2024-09-18T01:47:08.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.696+0000 7fc36fb19800 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93925115500160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556ca5253920 con 0x556ca5242060 2024-09-18T01:47:08.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.698+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93925115500160] v33'234 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc358057030 con 0x556ca5242060 2024-09-18T01:47:08.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.698+0000 7fc2237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:47:08.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.698+0000 7fc36fb19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:47:08.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.698+0000 7fc36fb19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:47:08.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.698+0000 7fc36fb19800 5 note: GC not initialized 2024-09-18T01:47:08.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.698+0000 7fc2227e4640 20 reqs_thread_entry: start 2024-09-18T01:47:08.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.698+0000 7fc36fb19800 20 init_complete bucket index max shards: 11 2024-09-18T01:47:08.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.698+0000 7fc36fb19800 20 Filter name: none 2024-09-18T01:47:08.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.698+0000 7fc193fff640 20 reqs_thread_entry: start 2024-09-18T01:47:08.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.698+0000 7fc36fb19800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T01:47:08.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.698+0000 7fc36fb19800 20 rados->read ofs=0 len=0 2024-09-18T01:47:08.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.698+0000 7fc36fb19800 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556ca5289760 con 0x556ca5242060 2024-09-18T01:47:08.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.699+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc358057030 con 0x556ca5242060 2024-09-18T01:47:08.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.699+0000 7fc36fb19800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:47:08.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.699+0000 7fc36fb19800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T01:47:08.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.699+0000 7fc36fb19800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:47:08.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.699+0000 7fc36fb19800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:47:08.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.699+0000 7fc36fb19800 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556ca528c1f0 con 0x7fc36000f070 2024-09-18T01:47:08.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.700+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(63 usage.10 [call] v33'32 uv32 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc358057030 con 0x7fc36000f070 2024-09-18T01:47:08.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.700+0000 7fc36fb19800 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:64 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556ca528c1f0 con 0x7fc36000f070 2024-09-18T01:47:08.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.701+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(64 usage.10 [call] v33'33 uv32 ondisk = -61 ((61) No data available)) ==== 152+0+0 (crc 0 0 0) 0x7fc358057030 con 0x7fc36000f070 2024-09-18T01:47:08.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.702+0000 7fc2237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:47:08.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.702+0000 7fc36fb19800 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93925115500160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556ca523b9d0 con 0x556ca5242060 2024-09-18T01:47:08.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.703+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 93925115500160] v33'235 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc358057030 con 0x556ca5242060 2024-09-18T01:47:08.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.703+0000 7fc36fb19800 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93925115481120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556ca5251680 con 0x7fc36803f060 2024-09-18T01:47:08.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.704+0000 7fc36d60d640 1 -- 172.21.15.146:0/2415965072 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 93925115481120] v33'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc36002e070 con 0x7fc36803f060 2024-09-18T01:47:08.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.704+0000 7fc36fb19800 20 remove_watcher() i=0 2024-09-18T01:47:08.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.704+0000 7fc36fb19800 2 removed watcher, disabling cache 2024-09-18T01:47:08.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.704+0000 7fc36fb19800 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93925115485344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556ca5289300 con 0x556ca5242060 2024-09-18T01:47:08.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.706+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 93925115485344] v33'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc358057030 con 0x556ca5242060 2024-09-18T01:47:08.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.706+0000 7fc36fb19800 20 remove_watcher() i=1 2024-09-18T01:47:08.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.706+0000 7fc36fb19800 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93925115490192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556ca5289300 con 0x556ca52482d0 2024-09-18T01:47:08.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.707+0000 7fc36de0e640 1 -- 172.21.15.146:0/2415965072 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 93925115490192] v33'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc36803c030 con 0x556ca52482d0 2024-09-18T01:47:08.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.707+0000 7fc36fb19800 20 remove_watcher() i=2 2024-09-18T01:47:08.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.707+0000 7fc36fb19800 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93925115492896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556ca5289300 con 0x7fc36803f060 2024-09-18T01:47:08.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.708+0000 7fc36d60d640 1 -- 172.21.15.146:0/2415965072 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 93925115492896] v33'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc36002e070 con 0x7fc36803f060 2024-09-18T01:47:08.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.708+0000 7fc36fb19800 20 remove_watcher() i=3 2024-09-18T01:47:08.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.708+0000 7fc36fb19800 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93925115495232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556ca5289300 con 0x556ca5242060 2024-09-18T01:47:08.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.709+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 93925115495232] v33'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc358057030 con 0x556ca5242060 2024-09-18T01:47:08.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.709+0000 7fc36fb19800 20 remove_watcher() i=4 2024-09-18T01:47:08.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.709+0000 7fc36fb19800 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93925115497904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556ca5289300 con 0x7fc36000f070 2024-09-18T01:47:08.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.710+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 93925115497904] v33'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc358057030 con 0x7fc36000f070 2024-09-18T01:47:08.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.710+0000 7fc36fb19800 20 remove_watcher() i=5 2024-09-18T01:47:08.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.710+0000 7fc36fb19800 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93925115502880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556ca5289300 con 0x7fc36000f070 2024-09-18T01:47:08.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.711+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 93925115502880] v33'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc358057030 con 0x7fc36000f070 2024-09-18T01:47:08.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.711+0000 7fc36fb19800 20 remove_watcher() i=6 2024-09-18T01:47:08.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.711+0000 7fc36fb19800 1 -- 172.21.15.146:0/2415965072 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93925115505104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556ca5289300 con 0x7fc36000f070 2024-09-18T01:47:08.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.712+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 93925115505104] v33'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc358057030 con 0x7fc36000f070 2024-09-18T01:47:08.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.712+0000 7fc36fb19800 20 remove_watcher() i=7 2024-09-18T01:47:08.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.713+0000 7fc36fb19800 1 -- 172.21.15.146:0/2415965072 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fc36000f070 msgr2=0x7fc36001c620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:08.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.713+0000 7fc36fb19800 1 --2- 172.21.15.146:0/2415965072 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fc36000f070 0x7fc36001c620 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:08.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.713+0000 7fc36fb19800 1 -- 172.21.15.146:0/2415965072 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x556ca5242060 msgr2=0x556ca5244520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:08.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.713+0000 7fc36fb19800 1 --2- 172.21.15.146:0/2415965072 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x556ca5242060 0x556ca5244520 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:08.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.713+0000 7fc36fb19800 1 -- 172.21.15.146:0/2415965072 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fc36803f060 msgr2=0x7fc368023770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:08.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.713+0000 7fc36fb19800 1 --2- 172.21.15.146:0/2415965072 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fc36803f060 0x7fc368023770 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:08.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.713+0000 7fc36fb19800 1 -- 172.21.15.146:0/2415965072 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x556ca52482d0 msgr2=0x556ca524a6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:08.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.713+0000 7fc36fb19800 1 --2- 172.21.15.146:0/2415965072 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x556ca52482d0 0x556ca524a6c0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:08.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.713+0000 7fc36fb19800 1 -- 172.21.15.146:0/2415965072 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc238036b40 msgr2=0x7fc238039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:08.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.713+0000 7fc36fb19800 1 --2- 172.21.15.146:0/2415965072 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc238036b40 0x7fc238039000 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc36000ff70 tx=0x7fc360044000 comp rx=0 tx=0).stop 2024-09-18T01:47:08.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.713+0000 7fc36fb19800 1 -- 172.21.15.146:0/2415965072 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556ca522ef50 msgr2=0x556ca5236330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:08.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.713+0000 7fc36fb19800 1 --2- 172.21.15.146:0/2415965072 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556ca522ef50 0x556ca5236330 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fc368012bb0 tx=0x7fc36804c880 comp rx=0 tx=0).stop 2024-09-18T01:47:08.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.713+0000 7fc364e0c640 1 -- 172.21.15.146:0/2415965072 reap_dead start 2024-09-18T01:47:08.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.713+0000 7fc36fb19800 1 -- 172.21.15.146:0/2415965072 shutdown_connections 2024-09-18T01:47:08.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.713+0000 7fc36fb19800 1 --2- 172.21.15.146:0/2415965072 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556ca522ef50 0x556ca5236330 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:08.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.713+0000 7fc36fb19800 1 -- 172.21.15.146:0/2415965072 >> 172.21.15.146:0/2415965072 conn(0x556ca522b2b0 msgr2=0x556ca5229380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:08.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.713+0000 7fc36fb19800 1 -- 172.21.15.146:0/2415965072 shutdown_connections 2024-09-18T01:47:08.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.713+0000 7fc36fb19800 1 -- 172.21.15.146:0/2415965072 wait complete. 2024-09-18T01:47:08.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.713+0000 7fc36fb19800 1 -- 172.21.15.146:0/4000809846 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc244036b90 msgr2=0x7fc244039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:08.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.713+0000 7fc36fb19800 1 --2- 172.21.15.146:0/4000809846 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc244036b90 0x7fc244039050 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x556ca520fe40 tx=0x7fc3600173c0 comp rx=0 tx=0).stop 2024-09-18T01:47:08.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.713+0000 7fc36fb19800 1 -- 172.21.15.146:0/4000809846 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556ca5222280 msgr2=0x556ca52226a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:08.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.713+0000 7fc36fb19800 1 --2- 172.21.15.146:0/4000809846 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556ca5222280 0x556ca52226a0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x556ca520ef40 tx=0x7fc3680178e0 comp rx=0 tx=0).stop 2024-09-18T01:47:08.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.713+0000 7fc36fb19800 1 -- 172.21.15.146:0/4000809846 shutdown_connections 2024-09-18T01:47:08.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.713+0000 7fc36fb19800 1 --2- 172.21.15.146:0/4000809846 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc244036b90 0x7fc244039050 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:08.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.713+0000 7fc36fb19800 1 --2- 172.21.15.146:0/4000809846 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556ca5222280 0x556ca52226a0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:08.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.713+0000 7fc36fb19800 1 -- 172.21.15.146:0/4000809846 >> 172.21.15.146:0/4000809846 conn(0x556ca5217210 msgr2=0x556ca5219d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:08.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.713+0000 7fc36fb19800 1 -- 172.21.15.146:0/4000809846 shutdown_connections 2024-09-18T01:47:08.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.713+0000 7fc36fb19800 1 -- 172.21.15.146:0/4000809846 wait complete. 2024-09-18T01:47:08.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.714+0000 7fc36fb19800 1 -- 172.21.15.146:0/3015476464 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x556ca5112970 msgr2=0x556ca520e5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:08.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.714+0000 7fc36fb19800 1 --2- 172.21.15.146:0/3015476464 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x556ca5112970 0x556ca520e5b0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:08.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.714+0000 7fc36fb19800 1 -- 172.21.15.146:0/3015476464 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x556ca5210540 msgr2=0x556ca5213da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:08.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.714+0000 7fc36fb19800 1 --2- 172.21.15.146:0/3015476464 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x556ca5210540 0x556ca5213da0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:08.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.714+0000 7fc36fb19800 1 -- 172.21.15.146:0/3015476464 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc254036b40 msgr2=0x7fc254039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:08.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.714+0000 7fc36fb19800 1 --2- 172.21.15.146:0/3015476464 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc254036b40 0x7fc254039000 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc358057000 tx=0x7fc358052000 comp rx=0 tx=0).stop 2024-09-18T01:47:08.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.714+0000 7fc36fb19800 1 -- 172.21.15.146:0/3015476464 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556ca5082630 msgr2=0x556ca5207540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:08.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.714+0000 7fc36fb19800 1 --2- 172.21.15.146:0/3015476464 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556ca5082630 0x556ca5207540 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fc360000fd0 tx=0x7fc360000ed0 comp rx=0 tx=0).stop 2024-09-18T01:47:08.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.714+0000 7fc36fb19800 1 -- 172.21.15.146:0/3015476464 shutdown_connections 2024-09-18T01:47:08.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.714+0000 7fc36fb19800 1 --2- 172.21.15.146:0/3015476464 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x556ca5210540 0x556ca5213da0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:08.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.714+0000 7fc36fb19800 1 --2- 172.21.15.146:0/3015476464 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x556ca5112970 0x556ca520e5b0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:08.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.714+0000 7fc36fb19800 1 --2- 172.21.15.146:0/3015476464 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fc254036b40 0x7fc254039000 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:08.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.714+0000 7fc36fb19800 1 --2- 172.21.15.146:0/3015476464 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556ca5082630 0x556ca5207540 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:08.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.714+0000 7fc36fb19800 1 -- 172.21.15.146:0/3015476464 >> 172.21.15.146:0/3015476464 conn(0x556ca5108de0 msgr2=0x556ca51f8e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:08.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.714+0000 7fc36fb19800 1 -- 172.21.15.146:0/3015476464 shutdown_connections 2024-09-18T01:47:08.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.714+0000 7fc36fb19800 1 -- 172.21.15.146:0/3015476464 wait complete. 2024-09-18T01:47:08.723 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-18T01:47:08.723 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-18T01:47:08.724 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-18T01:47:08.768 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:47:08.768 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:47:08.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.768+0000 7f95eec0e800 1 Processor -- start 2024-09-18T01:47:08.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.768+0000 7f95eec0e800 1 -- start start 2024-09-18T01:47:08.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.768+0000 7f95eec0e800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x562970e1f4c0 0x562970e1f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:08.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.768+0000 7f95eec0e800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562970cdfb30 con 0x562970e1fe00 2024-09-18T01:47:08.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.768+0000 7f95eec0e800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x562970cc1360 con 0x562970e1f4c0 2024-09-18T01:47:08.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.768+0000 7f95ea30c640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x562970e1f4c0 0x562970e1f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:08.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.768+0000 7f95ea30c640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x562970e1f4c0 0x562970e1f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:36878/0 (socket says 172.21.15.146:36878) 2024-09-18T01:47:08.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.768+0000 7f95e1b0b640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x562970e1fe00 0x562970e24980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:52990/0 (socket says 172.21.15.146:52990) 2024-09-18T01:47:08.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.768+0000 7f95ea30c640 1 -- 172.21.15.146:0/460052981 learned_addr learned my addr 172.21.15.146:0/460052981 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:08.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.769+0000 7f95ea30c640 1 -- 172.21.15.146:0/460052981 >> v1:172.21.15.129:6789/0 conn(0x562970e1fe00 legacy=0x562970e24980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:08.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.769+0000 7f95e9b0b640 1 -- 172.21.15.146:0/460052981 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4271584562 0 0) 0x562970cdfb30 con 0x562970e1fe00 2024-09-18T01:47:08.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.769+0000 7f95ea30c640 1 -- 172.21.15.146:0/460052981 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562970ce7e00 con 0x562970e1f4c0 2024-09-18T01:47:08.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.770+0000 7f95ea30c640 1 --2- 172.21.15.146:0/460052981 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562970e1f4c0 0x562970e1f8c0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f95dc00a6b0 tx=0x7f95dc047e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60b50a6798a9a3dc server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:08.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.771+0000 7f95e9b0b640 1 -- 172.21.15.146:0/460052981 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95dc00a200 con 0x562970e1f4c0 2024-09-18T01:47:08.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.771+0000 7f95e9b0b640 1 -- 172.21.15.146:0/460052981 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95dc00a3a0 con 0x562970e1f4c0 2024-09-18T01:47:08.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.771+0000 7f95e9b0b640 1 -- 172.21.15.146:0/460052981 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95dc008700 con 0x562970e1f4c0 2024-09-18T01:47:08.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.771+0000 7f95eec0e800 1 -- 172.21.15.146:0/460052981 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562970e1f4c0 msgr2=0x562970e1f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:08.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.771+0000 7f95eec0e800 1 --2- 172.21.15.146:0/460052981 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562970e1f4c0 0x562970e1f8c0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f95dc00a6b0 tx=0x7f95dc047e30 comp rx=0 tx=0).stop 2024-09-18T01:47:08.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.771+0000 7f95eec0e800 1 -- 172.21.15.146:0/460052981 shutdown_connections 2024-09-18T01:47:08.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.771+0000 7f95eec0e800 1 --2- 172.21.15.146:0/460052981 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562970e1f4c0 0x562970e1f8c0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:08.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.771+0000 7f95eec0e800 1 -- 172.21.15.146:0/460052981 >> 172.21.15.146:0/460052981 conn(0x562970e1adf0 msgr2=0x562970e1d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:08.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.771+0000 7f95eec0e800 1 -- 172.21.15.146:0/460052981 shutdown_connections 2024-09-18T01:47:08.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.771+0000 7f95eec0e800 1 -- 172.21.15.146:0/460052981 wait complete. 2024-09-18T01:47:08.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.785+0000 7f95eec0e800 1 Processor -- start 2024-09-18T01:47:08.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.785+0000 7f95eec0e800 1 -- start start 2024-09-18T01:47:08.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.785+0000 7f95eec0e800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562970e1f4c0 0x562970f0d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:08.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.785+0000 7f95eec0e800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x562970d6c330 con 0x562970e1f4c0 2024-09-18T01:47:08.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.785+0000 7f95ea30c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562970e1f4c0 0x562970f0d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:08.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.785+0000 7f95ea30c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562970e1f4c0 0x562970f0d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:36886/0 (socket says 172.21.15.146:36886) 2024-09-18T01:47:08.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.785+0000 7f95ea30c640 1 -- 172.21.15.146:0/385870987 learned_addr learned my addr 172.21.15.146:0/385870987 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:08.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.786+0000 7f95ea30c640 1 -- 172.21.15.146:0/385870987 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562970cb9bc0 con 0x562970e1f4c0 2024-09-18T01:47:08.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.786+0000 7f95ea30c640 1 --2- 172.21.15.146:0/385870987 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562970e1f4c0 0x562970f0d3c0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f95dc048360 tx=0x7f95dc051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3f72eda626fce64 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:08.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.786+0000 7f94d8608640 1 -- 172.21.15.146:0/385870987 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95dc00a200 con 0x562970e1f4c0 2024-09-18T01:47:08.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.786+0000 7f94d8608640 1 -- 172.21.15.146:0/385870987 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95dc008590 con 0x562970e1f4c0 2024-09-18T01:47:08.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.786+0000 7f94d8608640 1 -- 172.21.15.146:0/385870987 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95dc0088f0 con 0x562970e1f4c0 2024-09-18T01:47:08.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.787+0000 7f95eec0e800 1 -- 172.21.15.146:0/385870987 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562970e1f4c0 msgr2=0x562970f0d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:08.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.787+0000 7f95eec0e800 1 --2- 172.21.15.146:0/385870987 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562970e1f4c0 0x562970f0d3c0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f95dc048360 tx=0x7f95dc051000 comp rx=0 tx=0).stop 2024-09-18T01:47:08.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.787+0000 7f95eec0e800 1 -- 172.21.15.146:0/385870987 shutdown_connections 2024-09-18T01:47:08.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.787+0000 7f95eec0e800 1 --2- 172.21.15.146:0/385870987 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562970e1f4c0 0x562970f0d3c0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:08.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.787+0000 7f95eec0e800 1 -- 172.21.15.146:0/385870987 >> 172.21.15.146:0/385870987 conn(0x562970e1adf0 msgr2=0x562970f08d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:08.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.787+0000 7f95eec0e800 1 -- 172.21.15.146:0/385870987 shutdown_connections 2024-09-18T01:47:08.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.787+0000 7f95eec0e800 1 -- 172.21.15.146:0/385870987 wait complete. 2024-09-18T01:47:08.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.787+0000 7f95eec0e800 1 Processor -- start 2024-09-18T01:47:08.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.787+0000 7f95eec0e800 1 -- start start 2024-09-18T01:47:08.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.787+0000 7f95eec0e800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562970e1f4c0 0x562970f14db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:08.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.787+0000 7f95eec0e800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x562970e26480 con 0x562970e1f4c0 2024-09-18T01:47:08.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.788+0000 7f95ea30c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562970e1f4c0 0x562970f14db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:08.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.788+0000 7f95ea30c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562970e1f4c0 0x562970f14db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:36900/0 (socket says 172.21.15.146:36900) 2024-09-18T01:47:08.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.788+0000 7f95ea30c640 1 -- 172.21.15.146:0/2509577788 learned_addr learned my addr 172.21.15.146:0/2509577788 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:08.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.788+0000 7f95ea30c640 1 -- 172.21.15.146:0/2509577788 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562970ccdfe0 con 0x562970e1f4c0 2024-09-18T01:47:08.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.788+0000 7f95ea30c640 1 --2- 172.21.15.146:0/2509577788 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562970e1f4c0 0x562970f14db0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f95dc047e70 tx=0x7f95dc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:08.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.788+0000 7f94d6e05640 1 -- 172.21.15.146:0/2509577788 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95dc070070 con 0x562970e1f4c0 2024-09-18T01:47:08.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.788+0000 7f94d6e05640 1 -- 172.21.15.146:0/2509577788 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95dc00a1a0 con 0x562970e1f4c0 2024-09-18T01:47:08.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.788+0000 7f94d6e05640 1 -- 172.21.15.146:0/2509577788 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95dc04f610 con 0x562970e1f4c0 2024-09-18T01:47:08.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.788+0000 7f95eec0e800 1 -- 172.21.15.146:0/2509577788 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562970f152f0 con 0x562970e1f4c0 2024-09-18T01:47:08.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.788+0000 7f95eec0e800 1 -- 172.21.15.146:0/2509577788 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562970f15810 con 0x562970e1f4c0 2024-09-18T01:47:08.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.789+0000 7f94d6e05640 1 -- 172.21.15.146:0/2509577788 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f95dc073070 con 0x562970e1f4c0 2024-09-18T01:47:08.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.789+0000 7f94d6e05640 1 --2- 172.21.15.146:0/2509577788 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f94d0036b40 0x7f94d0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:08.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.789+0000 7f94d6e05640 1 -- 172.21.15.146:0/2509577788 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f95dc065020 con 0x562970e1f4c0 2024-09-18T01:47:08.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.789+0000 7f95e1b0b640 1 --2- 172.21.15.146:0/2509577788 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f94d0036b40 0x7f94d0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:08.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.790+0000 7f95eec0e800 1 --2- 172.21.15.146:0/2509577788 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x562970e1fe00 0x562970f1be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:08.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.790+0000 7f95eec0e800 1 -- 172.21.15.146:0/2509577788 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562970f1c360 con 0x562970e1fe00 2024-09-18T01:47:08.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.790+0000 7f95eab0d640 1 --2- 172.21.15.146:0/2509577788 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x562970e1fe00 0x562970f1be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:08.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.790+0000 7f95e1b0b640 1 --2- 172.21.15.146:0/2509577788 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f94d0036b40 0x7f94d0039000 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f95d4000c00 tx=0x7f95d40013b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:08.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.790+0000 7f95eab0d640 1 --2- 172.21.15.146:0/2509577788 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x562970e1fe00 0x562970f1be20 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:08.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.790+0000 7f95eab0d640 1 -- 172.21.15.146:0/2509577788 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f95e400a4a0 con 0x562970e1fe00 2024-09-18T01:47:08.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.790+0000 7f95eec0e800 1 -- 172.21.15.146:0/2509577788 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562970f193d0 con 0x562970e1fe00 2024-09-18T01:47:08.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.790+0000 7f95eab0d640 1 -- 172.21.15.146:0/2509577788 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f95e400a4a0 con 0x562970e1fe00 2024-09-18T01:47:08.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.790+0000 7f95eec0e800 1 -- 172.21.15.146:0/2509577788 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562970f1e120 con 0x562970e1fe00 2024-09-18T01:47:08.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.791+0000 7f95eab0d640 1 -- 172.21.15.146:0/2509577788 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f95e400a4a0 con 0x562970e1fe00 2024-09-18T01:47:08.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.791+0000 7f95eec0e800 1 -- 172.21.15.146:0/2509577788 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562970f1d350 con 0x562970e1fe00 2024-09-18T01:47:08.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.791+0000 7f95eab0d640 1 -- 172.21.15.146:0/2509577788 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f95e400a4a0 con 0x562970e1fe00 2024-09-18T01:47:08.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.791+0000 7f95eec0e800 1 --2- 172.21.15.146:0/2509577788 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x562970f1f4d0 0x562970f218c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:08.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.791+0000 7f95eec0e800 1 -- 172.21.15.146:0/2509577788 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562970f21e00 con 0x562970f1f4d0 2024-09-18T01:47:08.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.791+0000 7f95ea30c640 1 --2- 172.21.15.146:0/2509577788 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x562970f1f4d0 0x562970f218c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:08.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.791+0000 7f95ea30c640 1 --2- 172.21.15.146:0/2509577788 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x562970f1f4d0 0x562970f218c0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:08.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.792+0000 7f95ea30c640 1 -- 172.21.15.146:0/2509577788 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f95dc07c070 con 0x562970f1f4d0 2024-09-18T01:47:08.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.792+0000 7f95eec0e800 1 Processor -- start 2024-09-18T01:47:08.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.792+0000 7f95eec0e800 1 -- start start 2024-09-18T01:47:08.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.792+0000 7f95eec0e800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562970f2fa80 0x562970f2fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:08.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.792+0000 7f95eec0e800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x562970cbb580 con 0x562970f2fa80 2024-09-18T01:47:08.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.792+0000 7f95eab0d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562970f2fa80 0x562970f2fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:08.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.792+0000 7f95eab0d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562970f2fa80 0x562970f2fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:36902/0 (socket says 172.21.15.146:36902) 2024-09-18T01:47:08.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.792+0000 7f95eab0d640 1 -- 172.21.15.146:0/3883558457 learned_addr learned my addr 172.21.15.146:0/3883558457 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:08.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.793+0000 7f95eab0d640 1 -- 172.21.15.146:0/3883558457 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562970f303e0 con 0x562970f2fa80 2024-09-18T01:47:08.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.793+0000 7f95eab0d640 1 --2- 172.21.15.146:0/3883558457 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562970f2fa80 0x562970f2fea0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x562970f161b0 tx=0x7f95e40178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:08.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.793+0000 7f94cffff640 1 -- 172.21.15.146:0/3883558457 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95e4013440 con 0x562970f2fa80 2024-09-18T01:47:08.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.793+0000 7f94cffff640 1 -- 172.21.15.146:0/3883558457 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95e40135e0 con 0x562970f2fa80 2024-09-18T01:47:08.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.793+0000 7f95eec0e800 1 -- 172.21.15.146:0/3883558457 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562970f30670 con 0x562970f2fa80 2024-09-18T01:47:08.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.793+0000 7f94cffff640 1 -- 172.21.15.146:0/3883558457 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95e40138c0 con 0x562970f2fa80 2024-09-18T01:47:08.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.793+0000 7f95eec0e800 1 -- 172.21.15.146:0/3883558457 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562970f33350 con 0x562970f2fa80 2024-09-18T01:47:08.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.794+0000 7f94cffff640 1 -- 172.21.15.146:0/3883558457 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f95e4011040 con 0x562970f2fa80 2024-09-18T01:47:08.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.794+0000 7f94cffff640 1 --2- 172.21.15.146:0/3883558457 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f94c4036b40 0x7f94c4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:08.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.794+0000 7f94cffff640 1 -- 172.21.15.146:0/3883558457 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f95e401d070 con 0x562970f2fa80 2024-09-18T01:47:08.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.794+0000 7f95ea30c640 1 --2- 172.21.15.146:0/3883558457 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f94c4036b40 0x7f94c4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:08.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.794+0000 7f95eec0e800 1 Processor -- start 2024-09-18T01:47:08.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.795+0000 7f95ea30c640 1 --2- 172.21.15.146:0/3883558457 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f94c4036b40 0x7f94c4039000 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x562970f1e080 tx=0x7f95dc0569e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:08.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.795+0000 7f95eec0e800 1 -- start start 2024-09-18T01:47:08.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.795+0000 7f95eec0e800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562970f3c770 0x562970f3cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:08.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.795+0000 7f95eec0e800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x562970f0db10 con 0x562970f3c770 2024-09-18T01:47:08.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.795+0000 7f95eab0d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562970f3c770 0x562970f3cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:08.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.795+0000 7f95eab0d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562970f3c770 0x562970f3cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:36918/0 (socket says 172.21.15.146:36918) 2024-09-18T01:47:08.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.795+0000 7f95eab0d640 1 -- 172.21.15.146:0/1783810010 learned_addr learned my addr 172.21.15.146:0/1783810010 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:08.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.795+0000 7f95eab0d640 1 -- 172.21.15.146:0/1783810010 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562970f3d140 con 0x562970f3c770 2024-09-18T01:47:08.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.795+0000 7f95eab0d640 1 --2- 172.21.15.146:0/1783810010 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562970f3c770 0x562970f3cb70 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f95e404c8f0 tx=0x7f95e4001f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a10511382351895 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:08.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.795+0000 7f94cdffb640 1 -- 172.21.15.146:0/1783810010 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95e404e110 con 0x562970f3c770 2024-09-18T01:47:08.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.795+0000 7f94cdffb640 1 -- 172.21.15.146:0/1783810010 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95e404e2b0 con 0x562970f3c770 2024-09-18T01:47:08.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.796+0000 7f94cdffb640 1 -- 172.21.15.146:0/1783810010 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95e404b250 con 0x562970f3c770 2024-09-18T01:47:08.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.796+0000 7f95eec0e800 1 -- 172.21.15.146:0/1783810010 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562970f3c770 msgr2=0x562970f3cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:08.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.796+0000 7f95eec0e800 1 --2- 172.21.15.146:0/1783810010 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562970f3c770 0x562970f3cb70 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f95e404c8f0 tx=0x7f95e4001f40 comp rx=0 tx=0).stop 2024-09-18T01:47:08.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.796+0000 7f95eec0e800 1 -- 172.21.15.146:0/1783810010 shutdown_connections 2024-09-18T01:47:08.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.796+0000 7f95eec0e800 1 --2- 172.21.15.146:0/1783810010 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562970f3c770 0x562970f3cb70 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:08.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.796+0000 7f95eec0e800 1 -- 172.21.15.146:0/1783810010 >> 172.21.15.146:0/1783810010 conn(0x562970f38ad0 msgr2=0x562970f36bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:08.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.796+0000 7f95eec0e800 1 -- 172.21.15.146:0/1783810010 shutdown_connections 2024-09-18T01:47:08.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.796+0000 7f95eec0e800 1 -- 172.21.15.146:0/1783810010 wait complete. 2024-09-18T01:47:08.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.796+0000 7f95eec0e800 1 Processor -- start 2024-09-18T01:47:08.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.796+0000 7f95eec0e800 1 -- start start 2024-09-18T01:47:08.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.796+0000 7f95eec0e800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562970f3c770 0x562970f48030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:08.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.796+0000 7f95eec0e800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x562970f3d7b0 con 0x562970f3c770 2024-09-18T01:47:08.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.797+0000 7f95eab0d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562970f3c770 0x562970f48030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:08.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.797+0000 7f95eab0d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562970f3c770 0x562970f48030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:36924/0 (socket says 172.21.15.146:36924) 2024-09-18T01:47:08.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.797+0000 7f95eab0d640 1 -- 172.21.15.146:0/3259678870 learned_addr learned my addr 172.21.15.146:0/3259678870 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:08.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.797+0000 7f95eab0d640 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562970f48570 con 0x562970f3c770 2024-09-18T01:47:08.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.797+0000 7f95eab0d640 1 --2- 172.21.15.146:0/3259678870 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562970f3c770 0x562970f48030 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f95e4001f80 tx=0x7f95e404c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:08.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.797+0000 7f94bbfff640 1 -- 172.21.15.146:0/3259678870 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95e4046040 con 0x562970f3c770 2024-09-18T01:47:08.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.797+0000 7f94bbfff640 1 -- 172.21.15.146:0/3259678870 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95e4041050 con 0x562970f3c770 2024-09-18T01:47:08.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.797+0000 7f95eec0e800 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562970f48800 con 0x562970f3c770 2024-09-18T01:47:08.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.797+0000 7f94bbfff640 1 -- 172.21.15.146:0/3259678870 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95e404e110 con 0x562970f3c770 2024-09-18T01:47:08.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.797+0000 7f95eec0e800 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562970f4b4b0 con 0x562970f3c770 2024-09-18T01:47:08.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.798+0000 7f94bbfff640 1 -- 172.21.15.146:0/3259678870 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f95e404ca30 con 0x562970f3c770 2024-09-18T01:47:08.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.798+0000 7f94bbfff640 1 --2- 172.21.15.146:0/3259678870 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f94b4036b40 0x7f94b4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:08.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.798+0000 7f94bbfff640 1 -- 172.21.15.146:0/3259678870 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f95e4034070 con 0x562970f3c770 2024-09-18T01:47:08.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.798+0000 7f95ea30c640 1 --2- 172.21.15.146:0/3259678870 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f94b4036b40 0x7f94b4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:08.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.799+0000 7f95eec0e800 20 rados->read ofs=0 len=0 2024-09-18T01:47:08.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.799+0000 7f95eec0e800 1 --2- 172.21.15.146:0/3259678870 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x562970f53bb0 0x562970f56070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:08.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.799+0000 7f95eec0e800 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562970f567c0 con 0x562970f53bb0 2024-09-18T01:47:08.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.799+0000 7f95e1b0b640 1 --2- 172.21.15.146:0/3259678870 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x562970f53bb0 0x562970f56070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:08.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.799+0000 7f95ea30c640 1 --2- 172.21.15.146:0/3259678870 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f94b4036b40 0x7f94b4039000 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f95dc008560 tx=0x7f95dc08d000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:08.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.799+0000 7f95e1b0b640 1 --2- 172.21.15.146:0/3259678870 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x562970f53bb0 0x562970f56070 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:08.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.799+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f95d400f5f0 con 0x562970f53bb0 2024-09-18T01:47:08.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.799+0000 7f95eec0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:08.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.799+0000 7f95eec0e800 20 realm 2024-09-18T01:47:08.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.799+0000 7f95eec0e800 20 rados->read ofs=0 len=0 2024-09-18T01:47:08.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.799+0000 7f95eec0e800 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562970f53000 con 0x562970f53bb0 2024-09-18T01:47:08.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.800+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f95d400f5f0 con 0x562970f53bb0 2024-09-18T01:47:08.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.800+0000 7f95eec0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:08.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.800+0000 7f95eec0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:47:08.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.800+0000 7f95eec0e800 20 rados->read ofs=0 len=0 2024-09-18T01:47:08.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.800+0000 7f95eec0e800 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562970f572a0 con 0x562970f53bb0 2024-09-18T01:47:08.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.800+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f95d400f5f0 con 0x562970f53bb0 2024-09-18T01:47:08.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.800+0000 7f95eec0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:08.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.800+0000 7f95eec0e800 20 rados->read ofs=0 len=0 2024-09-18T01:47:08.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.800+0000 7f95eec0e800 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562970f57b70 con 0x562970f53bb0 2024-09-18T01:47:08.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.800+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f95d400f5f0 con 0x562970f53bb0 2024-09-18T01:47:08.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.800+0000 7f95eec0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:47:08.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.800+0000 7f95eec0e800 20 rados->read ofs=0 len=0 2024-09-18T01:47:08.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.800+0000 7f95eec0e800 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562970f57f10 con 0x562970f53bb0 2024-09-18T01:47:08.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.800+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f95d400f5f0 con 0x562970f53bb0 2024-09-18T01:47:08.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.800+0000 7f95eec0e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:47:08.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.800+0000 7f95eec0e800 20 searching for the correct realm 2024-09-18T01:47:08.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.800+0000 7f95eec0e800 1 --2- 172.21.15.146:0/3259678870 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x562970f59df0 0x562970f5c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:08.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.800+0000 7f95eec0e800 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562970f5c8d0 con 0x562970f59df0 2024-09-18T01:47:08.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.800+0000 7f95eab0d640 1 --2- 172.21.15.146:0/3259678870 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x562970f59df0 0x562970f5c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:08.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.801+0000 7f95eab0d640 1 --2- 172.21.15.146:0/3259678870 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x562970f59df0 0x562970f5c200 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:08.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.801+0000 7f95eab0d640 1 -- 172.21.15.146:0/3259678870 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95e403e020 con 0x562970f59df0 2024-09-18T01:47:08.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.801+0000 7f95eab0d640 1 --2- 172.21.15.146:0/3259678870 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f95e40123a0 0x7f95e4007050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:08.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.801+0000 7f95eab0d640 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562970f5c8d0 con 0x7f95e40123a0 2024-09-18T01:47:08.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.801+0000 7f95ea30c640 1 --2- 172.21.15.146:0/3259678870 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f95e40123a0 0x7f95e4007050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:08.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.801+0000 7f95ea30c640 1 --2- 172.21.15.146:0/3259678870 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f95e40123a0 0x7f95e4007050 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:08.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.801+0000 7f95ea30c640 1 -- 172.21.15.146:0/3259678870 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95dc07c070 con 0x7f95e40123a0 2024-09-18T01:47:08.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.802+0000 7f95ea30c640 1 --2- 172.21.15.146:0/3259678870 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f95dc0a0040 0x7f95dc08f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:08.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.802+0000 7f95ea30c640 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562970f5c8d0 con 0x7f95dc0a0040 2024-09-18T01:47:08.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.802+0000 7f95e1b0b640 1 --2- 172.21.15.146:0/3259678870 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f95dc0a0040 0x7f95dc08f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:08.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.802+0000 7f95e1b0b640 1 --2- 172.21.15.146:0/3259678870 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f95dc0a0040 0x7f95dc08f0d0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:08.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.802+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95d400f5f0 con 0x7f95dc0a0040 2024-09-18T01:47:08.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.803+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562970f5c8d0 con 0x562970f53bb0 2024-09-18T01:47:08.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.803+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f95d400f5f0 con 0x562970f53bb0 2024-09-18T01:47:08.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.803+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562970f5c8d0 con 0x562970f53bb0 2024-09-18T01:47:08.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.803+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95d400f5f0 con 0x562970f53bb0 2024-09-18T01:47:08.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.803+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562970f5c8d0 con 0x7f95dc0a0040 2024-09-18T01:47:08.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.803+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95d400f5f0 con 0x7f95dc0a0040 2024-09-18T01:47:08.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.803+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562970f5c8d0 con 0x7f95dc0a0040 2024-09-18T01:47:08.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.803+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95d400f5f0 con 0x7f95dc0a0040 2024-09-18T01:47:08.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.803+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562970f5c8d0 con 0x7f95e40123a0 2024-09-18T01:47:08.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.804+0000 7f95ea30c640 1 -- 172.21.15.146:0/3259678870 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95dc07c070 con 0x7f95e40123a0 2024-09-18T01:47:08.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.804+0000 7f95ea30c640 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562970f5c8d0 con 0x562970f59df0 2024-09-18T01:47:08.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.804+0000 7f95eab0d640 1 -- 172.21.15.146:0/3259678870 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95e403e020 con 0x562970f59df0 2024-09-18T01:47:08.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.804+0000 7f95eab0d640 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562970f5c8d0 con 0x562970f53bb0 2024-09-18T01:47:08.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.804+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95d400f5f0 con 0x562970f53bb0 2024-09-18T01:47:08.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.804+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562970f5c8d0 con 0x7f95dc0a0040 2024-09-18T01:47:08.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.805+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95d400f5f0 con 0x7f95dc0a0040 2024-09-18T01:47:08.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.805+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562970f5c8d0 con 0x562970f53bb0 2024-09-18T01:47:08.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.805+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95d400f5f0 con 0x562970f53bb0 2024-09-18T01:47:08.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.805+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562970f5c8d0 con 0x7f95e40123a0 2024-09-18T01:47:08.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.805+0000 7f95ea30c640 1 -- 172.21.15.146:0/3259678870 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f95dc07c070 con 0x7f95e40123a0 2024-09-18T01:47:08.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.805+0000 7f95ea30c640 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562970f5c8d0 con 0x562970f59df0 2024-09-18T01:47:08.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.805+0000 7f95eab0d640 1 -- 172.21.15.146:0/3259678870 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95e403e020 con 0x562970f59df0 2024-09-18T01:47:08.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.805+0000 7f95eab0d640 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562970f5c8d0 con 0x562970f59df0 2024-09-18T01:47:08.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.805+0000 7f95eab0d640 1 -- 172.21.15.146:0/3259678870 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95e403e020 con 0x562970f59df0 2024-09-18T01:47:08.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.805+0000 7f95eab0d640 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562970f5c8d0 con 0x7f95dc0a0040 2024-09-18T01:47:08.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.806+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95d400f5f0 con 0x7f95dc0a0040 2024-09-18T01:47:08.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.806+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562970f5c8d0 con 0x562970f59df0 2024-09-18T01:47:08.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.806+0000 7f95eab0d640 1 -- 172.21.15.146:0/3259678870 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95e403e020 con 0x562970f59df0 2024-09-18T01:47:08.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.806+0000 7f95eab0d640 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562970f5c8d0 con 0x562970f59df0 2024-09-18T01:47:08.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.806+0000 7f95eab0d640 1 -- 172.21.15.146:0/3259678870 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95e403e020 con 0x562970f59df0 2024-09-18T01:47:08.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.806+0000 7f95eab0d640 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562970f5c8d0 con 0x562970f53bb0 2024-09-18T01:47:08.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.806+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95d400f5f0 con 0x562970f53bb0 2024-09-18T01:47:08.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.806+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562970f5c8d0 con 0x562970f53bb0 2024-09-18T01:47:08.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.807+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f95d400f5f0 con 0x562970f53bb0 2024-09-18T01:47:08.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.807+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562970f5c8d0 con 0x7f95dc0a0040 2024-09-18T01:47:08.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.807+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95d400f5f0 con 0x7f95dc0a0040 2024-09-18T01:47:08.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.807+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562970f5c8d0 con 0x562970f59df0 2024-09-18T01:47:08.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.807+0000 7f95eab0d640 1 -- 172.21.15.146:0/3259678870 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95e403e020 con 0x562970f59df0 2024-09-18T01:47:08.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.807+0000 7f95eab0d640 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562970f5c8d0 con 0x7f95e40123a0 2024-09-18T01:47:08.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.807+0000 7f95ea30c640 1 -- 172.21.15.146:0/3259678870 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95dc07c070 con 0x7f95e40123a0 2024-09-18T01:47:08.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.807+0000 7f95ea30c640 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562970f5c8d0 con 0x562970f53bb0 2024-09-18T01:47:08.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.808+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95d400f5f0 con 0x562970f53bb0 2024-09-18T01:47:08.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.808+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562970f5c8d0 con 0x7f95dc0a0040 2024-09-18T01:47:08.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.808+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95d403b040 con 0x7f95dc0a0040 2024-09-18T01:47:08.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.808+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562970f5c8d0 con 0x562970f59df0 2024-09-18T01:47:08.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.808+0000 7f95eab0d640 1 -- 172.21.15.146:0/3259678870 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95e403e020 con 0x562970f59df0 2024-09-18T01:47:08.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.808+0000 7f95eab0d640 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562970f5c8d0 con 0x7f95dc0a0040 2024-09-18T01:47:08.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.809+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95d403b040 con 0x7f95dc0a0040 2024-09-18T01:47:08.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.809+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562970f5c8d0 con 0x7f95e40123a0 2024-09-18T01:47:08.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.809+0000 7f95ea30c640 1 -- 172.21.15.146:0/3259678870 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95dc07c070 con 0x7f95e40123a0 2024-09-18T01:47:08.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.809+0000 7f95ea30c640 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562970f5c8d0 con 0x562970f59df0 2024-09-18T01:47:08.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.809+0000 7f95eab0d640 1 -- 172.21.15.146:0/3259678870 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95e403e020 con 0x562970f59df0 2024-09-18T01:47:08.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.809+0000 7f95eab0d640 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562970f5c8d0 con 0x7f95dc0a0040 2024-09-18T01:47:08.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.809+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95d403b040 con 0x7f95dc0a0040 2024-09-18T01:47:08.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.809+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562970f5c8d0 con 0x562970f53bb0 2024-09-18T01:47:08.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.810+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f95d403b040 con 0x562970f53bb0 2024-09-18T01:47:08.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.810+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562970f5c8d0 con 0x7f95e40123a0 2024-09-18T01:47:08.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.810+0000 7f95ea30c640 1 -- 172.21.15.146:0/3259678870 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95dc07c070 con 0x7f95e40123a0 2024-09-18T01:47:08.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.810+0000 7f95eec0e800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:47:08.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.810+0000 7f95eec0e800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:47:08.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.810+0000 7f95eec0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:47:08.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.810+0000 7f95eec0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:47:08.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.810+0000 7f95eec0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:47:08.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.810+0000 7f95eec0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:47:08.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.810+0000 7f95eec0e800 20 rados->read ofs=0 len=0 2024-09-18T01:47:08.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.810+0000 7f95eec0e800 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562970f588c0 con 0x562970f53bb0 2024-09-18T01:47:08.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.810+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f95d403b040 con 0x562970f53bb0 2024-09-18T01:47:08.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.810+0000 7f95eec0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:08.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.810+0000 7f95eec0e800 20 rados->read ofs=0 len=0 2024-09-18T01:47:08.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.810+0000 7f95eec0e800 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562970f59160 con 0x562970f53bb0 2024-09-18T01:47:08.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.810+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f95d403b040 con 0x562970f53bb0 2024-09-18T01:47:08.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.810+0000 7f95eec0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:47:08.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.810+0000 7f95eec0e800 20 rados->read ofs=0 len=0 2024-09-18T01:47:08.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.810+0000 7f95eec0e800 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562970f58500 con 0x7f95e40123a0 2024-09-18T01:47:08.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.811+0000 7f95ea30c640 1 -- 172.21.15.146:0/3259678870 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f95dc07c070 con 0x7f95e40123a0 2024-09-18T01:47:08.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.811+0000 7f95eec0e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:47:08.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.811+0000 7f95eec0e800 20 zone default found 2024-09-18T01:47:08.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.811+0000 7f95eec0e800 4 Realm: () 2024-09-18T01:47:08.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.811+0000 7f95eec0e800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:47:08.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.811+0000 7f95eec0e800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:47:08.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.811+0000 7f95eec0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:47:08.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.811+0000 7f95eec0e800 20 zonegroup default 2024-09-18T01:47:08.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.811+0000 7f95eec0e800 20 rados->read ofs=0 len=0 2024-09-18T01:47:08.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.811+0000 7f95eec0e800 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562970f5cd50 con 0x7f95dc0a0040 2024-09-18T01:47:08.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.811+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f95d403b040 con 0x7f95dc0a0040 2024-09-18T01:47:08.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.811+0000 7f95eec0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:08.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.811+0000 7f95eec0e800 20 rados->read ofs=0 len=0 2024-09-18T01:47:08.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.811+0000 7f95eec0e800 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562970f5ebe0 con 0x562970f59df0 2024-09-18T01:47:08.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.811+0000 7f95eab0d640 1 -- 172.21.15.146:0/3259678870 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f95e403e020 con 0x562970f59df0 2024-09-18T01:47:08.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.811+0000 7f95eec0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:08.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.811+0000 7f95eec0e800 20 rados->read ofs=0 len=0 2024-09-18T01:47:08.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.811+0000 7f95eec0e800 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562970f5ef80 con 0x562970f59df0 2024-09-18T01:47:08.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.811+0000 7f95eab0d640 1 -- 172.21.15.146:0/3259678870 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f95e403e020 con 0x562970f59df0 2024-09-18T01:47:08.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.812+0000 7f95eec0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:08.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.812+0000 7f95eec0e800 20 started sync module instance, tier type = 2024-09-18T01:47:08.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.812+0000 7f95eec0e800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:47:08.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.812+0000 7f95eec0e800 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562970f5e020 con 0x7f95e40123a0 2024-09-18T01:47:08.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.813+0000 7f95ea30c640 1 -- 172.21.15.146:0/3259678870 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v33'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95dc07c070 con 0x7f95e40123a0 2024-09-18T01:47:08.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.813+0000 7f95eec0e800 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94735988810816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562970f5dc80 con 0x7f95e40123a0 2024-09-18T01:47:08.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.813+0000 7f95eec0e800 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562970f5fdf0 con 0x562970f53bb0 2024-09-18T01:47:08.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.814+0000 7f95ea30c640 1 -- 172.21.15.146:0/3259678870 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94735988810816] v33'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95dc07c070 con 0x7f95e40123a0 2024-09-18T01:47:08.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.814+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v33'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95d403b040 con 0x562970f53bb0 2024-09-18T01:47:08.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.814+0000 7f95eec0e800 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94735988816192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562970f60210 con 0x562970f53bb0 2024-09-18T01:47:08.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.814+0000 7f95eec0e800 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562970f60bd0 con 0x562970f59df0 2024-09-18T01:47:08.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.815+0000 7f95eab0d640 1 -- 172.21.15.146:0/3259678870 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v33'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95e403e020 con 0x562970f59df0 2024-09-18T01:47:08.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.815+0000 7f95eec0e800 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94735988819744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562970f61030 con 0x562970f59df0 2024-09-18T01:47:08.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.815+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94735988816192] v33'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95d403b040 con 0x562970f53bb0 2024-09-18T01:47:08.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.815+0000 7f95eec0e800 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562970f5fda0 con 0x7f95e40123a0 2024-09-18T01:47:08.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.816+0000 7f95ea30c640 1 -- 172.21.15.146:0/3259678870 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v33'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95dc07c070 con 0x7f95e40123a0 2024-09-18T01:47:08.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.816+0000 7f95eec0e800 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94735988823584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562970f61ef0 con 0x7f95e40123a0 2024-09-18T01:47:08.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.816+0000 7f95eab0d640 1 -- 172.21.15.146:0/3259678870 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94735988819744] v33'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95e403e020 con 0x562970f59df0 2024-09-18T01:47:08.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.816+0000 7f95eec0e800 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562970f60b80 con 0x562970f53bb0 2024-09-18T01:47:08.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.818+0000 7f95ea30c640 1 -- 172.21.15.146:0/3259678870 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94735988823584] v33'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95dc07c070 con 0x7f95e40123a0 2024-09-18T01:47:08.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.818+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v33'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95d403b040 con 0x562970f53bb0 2024-09-18T01:47:08.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.818+0000 7f95eec0e800 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94735988824640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562970f628e0 con 0x562970f53bb0 2024-09-18T01:47:08.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.818+0000 7f95eec0e800 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562970f632a0 con 0x7f95dc0a0040 2024-09-18T01:47:08.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.819+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v33'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95d403b040 con 0x7f95dc0a0040 2024-09-18T01:47:08.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.819+0000 7f95eec0e800 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94735988829680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562970f636c0 con 0x7f95dc0a0040 2024-09-18T01:47:08.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.819+0000 7f95eec0e800 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562970f64160 con 0x7f95dc0a0040 2024-09-18T01:47:08.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.820+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94735988824640] v33'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95d403b040 con 0x562970f53bb0 2024-09-18T01:47:08.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.821+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94735988829680] v33'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95d403b040 con 0x7f95dc0a0040 2024-09-18T01:47:08.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.821+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v33'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95d403b040 con 0x7f95dc0a0040 2024-09-18T01:47:08.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.821+0000 7f95eec0e800 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94735988833360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562970f63210 con 0x7f95dc0a0040 2024-09-18T01:47:08.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.821+0000 7f95eec0e800 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562970f645d0 con 0x7f95dc0a0040 2024-09-18T01:47:08.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.823+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94735988833360] v33'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95d403b040 con 0x7f95dc0a0040 2024-09-18T01:47:08.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.823+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v33'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95d403b040 con 0x7f95dc0a0040 2024-09-18T01:47:08.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.823+0000 7f95eec0e800 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94735988827184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562970f645d0 con 0x7f95dc0a0040 2024-09-18T01:47:08.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.823+0000 7f95eec0e800 20 add_watcher() i=0 2024-09-18T01:47:08.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.823+0000 7f95eec0e800 20 add_watcher() i=1 2024-09-18T01:47:08.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.823+0000 7f95eec0e800 20 add_watcher() i=2 2024-09-18T01:47:08.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.823+0000 7f95eec0e800 20 add_watcher() i=3 2024-09-18T01:47:08.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.823+0000 7f95eec0e800 20 add_watcher() i=4 2024-09-18T01:47:08.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.823+0000 7f95eec0e800 20 add_watcher() i=5 2024-09-18T01:47:08.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.823+0000 7f95eec0e800 20 add_watcher() i=6 2024-09-18T01:47:08.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.824+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94735988827184] v33'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95d403b040 con 0x7f95dc0a0040 2024-09-18T01:47:08.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.824+0000 7f95eec0e800 20 add_watcher() i=7 2024-09-18T01:47:08.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.824+0000 7f95eec0e800 2 all 8 watchers are set, enabling cache 2024-09-18T01:47:08.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.824+0000 7f95eec0e800 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562970f67a00 con 0x562970f53bb0 2024-09-18T01:47:08.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.825+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f95d403b040 con 0x562970f53bb0 2024-09-18T01:47:08.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.825+0000 7f95eec0e800 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94735988835056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562970f64ef0 con 0x562970f53bb0 2024-09-18T01:47:08.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.826+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94735988835056] v33'236 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f95d403b040 con 0x562970f53bb0 2024-09-18T01:47:08.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.826+0000 7f94a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:47:08.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.826+0000 7f95eec0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:47:08.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.826+0000 7f95eec0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:47:08.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.826+0000 7f95eec0e800 5 note: GC not initialized 2024-09-18T01:47:08.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.826+0000 7f941b7fe640 20 reqs_thread_entry: start 2024-09-18T01:47:08.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.826+0000 7f95eec0e800 20 init_complete bucket index max shards: 11 2024-09-18T01:47:08.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.826+0000 7f95eec0e800 20 Filter name: none 2024-09-18T01:47:08.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.826+0000 7f94197fa640 20 reqs_thread_entry: start 2024-09-18T01:47:08.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.827+0000 7f95eec0e800 20 rados->read ofs=0 len=0 2024-09-18T01:47:08.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.827+0000 7f95eec0e800 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562970f9a940 con 0x562970f53bb0 2024-09-18T01:47:08.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.827+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f95d403b040 con 0x562970f53bb0 2024-09-18T01:47:08.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.827+0000 7f95eec0e800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:47:08.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.827+0000 7f95eec0e800 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562970f9be90 con 0x7f95dc0a0040 2024-09-18T01:47:08.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.827+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(63 usage.10 [call out=15b] v0'0 uv32 ondisk = 0) ==== 152+0+15 (crc 0 0 0) 0x7f95d403b040 con 0x7f95dc0a0040 2024-09-18T01:47:08.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.828+0000 7f94a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:47:08.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.828+0000 7f95eec0e800 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94735988835056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562970f649d0 con 0x562970f53bb0 2024-09-18T01:47:08.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.829+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94735988835056] v33'237 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f95d403b040 con 0x562970f53bb0 2024-09-18T01:47:08.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.829+0000 7f95eec0e800 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94735988810816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562970f642c0 con 0x7f95e40123a0 2024-09-18T01:47:08.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.830+0000 7f95ea30c640 1 -- 172.21.15.146:0/3259678870 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94735988810816] v33'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95dc07c070 con 0x7f95e40123a0 2024-09-18T01:47:08.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.830+0000 7f95eec0e800 20 remove_watcher() i=0 2024-09-18T01:47:08.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.830+0000 7f95eec0e800 2 removed watcher, disabling cache 2024-09-18T01:47:08.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.830+0000 7f95eec0e800 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94735988816192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562970f5e440 con 0x562970f53bb0 2024-09-18T01:47:08.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.831+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94735988816192] v33'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95d403b040 con 0x562970f53bb0 2024-09-18T01:47:08.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.831+0000 7f95eec0e800 20 remove_watcher() i=1 2024-09-18T01:47:08.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.831+0000 7f95eec0e800 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94735988819744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562970f5e440 con 0x562970f59df0 2024-09-18T01:47:08.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.833+0000 7f95eab0d640 1 -- 172.21.15.146:0/3259678870 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94735988819744] v33'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95e403e020 con 0x562970f59df0 2024-09-18T01:47:08.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.833+0000 7f95eec0e800 20 remove_watcher() i=2 2024-09-18T01:47:08.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.833+0000 7f95eec0e800 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94735988823584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562970f60720 con 0x7f95e40123a0 2024-09-18T01:47:08.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.834+0000 7f95ea30c640 1 -- 172.21.15.146:0/3259678870 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94735988823584] v33'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95dc07c070 con 0x7f95e40123a0 2024-09-18T01:47:08.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.834+0000 7f95eec0e800 20 remove_watcher() i=3 2024-09-18T01:47:08.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.834+0000 7f95eec0e800 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94735988824640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562970f5e440 con 0x562970f53bb0 2024-09-18T01:47:08.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.835+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94735988824640] v33'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95d403b040 con 0x562970f53bb0 2024-09-18T01:47:08.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.835+0000 7f95eec0e800 20 remove_watcher() i=4 2024-09-18T01:47:08.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.835+0000 7f95eec0e800 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94735988829680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562970f60720 con 0x7f95dc0a0040 2024-09-18T01:47:08.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.836+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94735988829680] v33'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95d403b040 con 0x7f95dc0a0040 2024-09-18T01:47:08.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.836+0000 7f95eec0e800 20 remove_watcher() i=5 2024-09-18T01:47:08.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.836+0000 7f95eec0e800 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94735988833360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562970f5e440 con 0x7f95dc0a0040 2024-09-18T01:47:08.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.837+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94735988833360] v33'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95d403b040 con 0x7f95dc0a0040 2024-09-18T01:47:08.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.837+0000 7f95eec0e800 20 remove_watcher() i=6 2024-09-18T01:47:08.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.837+0000 7f95eec0e800 1 -- 172.21.15.146:0/3259678870 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94735988827184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562970f62df0 con 0x7f95dc0a0040 2024-09-18T01:47:08.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.838+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94735988827184] v33'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95d403b040 con 0x7f95dc0a0040 2024-09-18T01:47:08.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.838+0000 7f95eec0e800 20 remove_watcher() i=7 2024-09-18T01:47:08.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.838+0000 7f95eec0e800 1 -- 172.21.15.146:0/3259678870 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f95dc0a0040 msgr2=0x7f95dc08f0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:08.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.838+0000 7f95eec0e800 1 --2- 172.21.15.146:0/3259678870 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f95dc0a0040 0x7f95dc08f0d0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:08.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.838+0000 7f95eec0e800 1 -- 172.21.15.146:0/3259678870 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x562970f53bb0 msgr2=0x562970f56070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:08.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.838+0000 7f95eec0e800 1 --2- 172.21.15.146:0/3259678870 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x562970f53bb0 0x562970f56070 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:08.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.838+0000 7f95eec0e800 1 -- 172.21.15.146:0/3259678870 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f95e40123a0 msgr2=0x7f95e4007050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:08.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.838+0000 7f95eec0e800 1 --2- 172.21.15.146:0/3259678870 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f95e40123a0 0x7f95e4007050 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:08.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.838+0000 7f95eec0e800 1 -- 172.21.15.146:0/3259678870 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x562970f59df0 msgr2=0x562970f5c200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:08.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.838+0000 7f95eec0e800 1 --2- 172.21.15.146:0/3259678870 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x562970f59df0 0x562970f5c200 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:08.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.838+0000 7f95eec0e800 1 -- 172.21.15.146:0/3259678870 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f94b4036b40 msgr2=0x7f94b4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:08.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.838+0000 7f95eec0e800 1 --2- 172.21.15.146:0/3259678870 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f94b4036b40 0x7f94b4039000 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f95dc008560 tx=0x7f95dc08d000 comp rx=0 tx=0).stop 2024-09-18T01:47:08.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.838+0000 7f95eec0e800 1 -- 172.21.15.146:0/3259678870 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562970f3c770 msgr2=0x562970f48030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:08.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.838+0000 7f95eec0e800 1 --2- 172.21.15.146:0/3259678870 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562970f3c770 0x562970f48030 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f95e4001f80 tx=0x7f95e404c880 comp rx=0 tx=0).stop 2024-09-18T01:47:08.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.838+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 reap_dead start 2024-09-18T01:47:08.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.838+0000 7f95e1b0b640 1 -- 172.21.15.146:0/3259678870 reap_dead start 2024-09-18T01:47:08.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.838+0000 7f95eec0e800 1 -- 172.21.15.146:0/3259678870 shutdown_connections 2024-09-18T01:47:08.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.838+0000 7f95eec0e800 1 -- 172.21.15.146:0/3259678870 >> 172.21.15.146:0/3259678870 conn(0x562970f38ad0 msgr2=0x562970f36ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:08.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.839+0000 7f95eec0e800 1 -- 172.21.15.146:0/3259678870 shutdown_connections 2024-09-18T01:47:08.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.839+0000 7f95eec0e800 1 -- 172.21.15.146:0/3259678870 wait complete. 2024-09-18T01:47:08.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.839+0000 7f95eec0e800 1 -- 172.21.15.146:0/3883558457 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f94c4036b40 msgr2=0x7f94c4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:08.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.839+0000 7f95eec0e800 1 --2- 172.21.15.146:0/3883558457 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f94c4036b40 0x7f94c4039000 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x562970f1e080 tx=0x7f95dc0569e0 comp rx=0 tx=0).stop 2024-09-18T01:47:08.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.839+0000 7f95eec0e800 1 -- 172.21.15.146:0/3883558457 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562970f2fa80 msgr2=0x562970f2fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:08.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.839+0000 7f95eec0e800 1 --2- 172.21.15.146:0/3883558457 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562970f2fa80 0x562970f2fea0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x562970f161b0 tx=0x7f95e40178e0 comp rx=0 tx=0).stop 2024-09-18T01:47:08.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.839+0000 7f95eec0e800 1 -- 172.21.15.146:0/3883558457 shutdown_connections 2024-09-18T01:47:08.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.839+0000 7f95eec0e800 1 --2- 172.21.15.146:0/3883558457 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f94c4036b40 0x7f94c4039000 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:08.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.839+0000 7f95eec0e800 1 --2- 172.21.15.146:0/3883558457 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562970f2fa80 0x562970f2fea0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:08.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.839+0000 7f95eec0e800 1 -- 172.21.15.146:0/3883558457 >> 172.21.15.146:0/3883558457 conn(0x562970f24a10 msgr2=0x562970f27590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:08.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.839+0000 7f95eec0e800 1 -- 172.21.15.146:0/3883558457 shutdown_connections 2024-09-18T01:47:08.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.839+0000 7f95eec0e800 1 -- 172.21.15.146:0/3883558457 wait complete. 2024-09-18T01:47:08.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.839+0000 7f95eec0e800 1 -- 172.21.15.146:0/2509577788 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x562970e1fe00 msgr2=0x562970f1be20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:08.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.839+0000 7f95eec0e800 1 --2- 172.21.15.146:0/2509577788 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x562970e1fe00 0x562970f1be20 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:08.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.839+0000 7f95eec0e800 1 -- 172.21.15.146:0/2509577788 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x562970f1f4d0 msgr2=0x562970f218c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:08.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.839+0000 7f95eec0e800 1 --2- 172.21.15.146:0/2509577788 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x562970f1f4d0 0x562970f218c0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:08.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.839+0000 7f95eec0e800 1 -- 172.21.15.146:0/2509577788 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f94d0036b40 msgr2=0x7f94d0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:08.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.839+0000 7f95eec0e800 1 --2- 172.21.15.146:0/2509577788 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f94d0036b40 0x7f94d0039000 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f95d4000c00 tx=0x7f95d40013b0 comp rx=0 tx=0).stop 2024-09-18T01:47:08.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.839+0000 7f95eec0e800 1 -- 172.21.15.146:0/2509577788 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562970e1f4c0 msgr2=0x562970f14db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:08.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.839+0000 7f95eec0e800 1 --2- 172.21.15.146:0/2509577788 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562970e1f4c0 0x562970f14db0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f95dc047e70 tx=0x7f95dc002fb0 comp rx=0 tx=0).stop 2024-09-18T01:47:08.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.839+0000 7f95eec0e800 1 -- 172.21.15.146:0/2509577788 shutdown_connections 2024-09-18T01:47:08.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.839+0000 7f95eec0e800 1 --2- 172.21.15.146:0/2509577788 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x562970f1f4d0 0x562970f218c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:08.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.839+0000 7f95eec0e800 1 --2- 172.21.15.146:0/2509577788 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x562970e1fe00 0x562970f1be20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:08.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.839+0000 7f95eec0e800 1 --2- 172.21.15.146:0/2509577788 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f94d0036b40 0x7f94d0039000 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:08.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.839+0000 7f95eec0e800 1 --2- 172.21.15.146:0/2509577788 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562970e1f4c0 0x562970f14db0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:08.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.839+0000 7f95eec0e800 1 -- 172.21.15.146:0/2509577788 >> 172.21.15.146:0/2509577788 conn(0x562970e1adf0 msgr2=0x562970f07690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:08.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.840+0000 7f95eec0e800 1 -- 172.21.15.146:0/2509577788 shutdown_connections 2024-09-18T01:47:08.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.840+0000 7f95eec0e800 1 -- 172.21.15.146:0/2509577788 wait complete. 2024-09-18T01:47:08.851 INFO:teuthology.orchestra.run.smithi146.stdout:{"entries":[],"summary":[]} 2024-09-18T01:47:08.852 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-18T01:47:08.852 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-18T01:47:08.852 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-18T01:47:08.852 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo --purge-data 2024-09-18T01:47:08.897 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:47:08.897 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:47:08.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.897+0000 7fb2c1151800 1 Processor -- start 2024-09-18T01:47:08.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.897+0000 7fb2c1151800 1 -- start start 2024-09-18T01:47:08.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.897+0000 7fb2c1151800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x556facff0880 0x556facff2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:08.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.897+0000 7fb2c1151800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556faceabb30 con 0x556facf606d0 2024-09-18T01:47:08.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.897+0000 7fb2c1151800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x556face8d360 con 0x556facff0880 2024-09-18T01:47:08.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.898+0000 7fb2be444640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x556facff0880 0x556facff2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:08.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.898+0000 7fb2bec45640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x556facf606d0 0x556facfef160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:52998/0 (socket says 172.21.15.146:52998) 2024-09-18T01:47:08.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.898+0000 7fb2be444640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x556facff0880 0x556facff2c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:36930/0 (socket says 172.21.15.146:36930) 2024-09-18T01:47:08.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.898+0000 7fb2bec45640 1 -- 172.21.15.146:0/1656794813 learned_addr learned my addr 172.21.15.146:0/1656794813 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:47:08.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.898+0000 7fb2be444640 1 -- 172.21.15.146:0/1656794813 >> v1:172.21.15.129:6789/0 conn(0x556facf606d0 legacy=0x556facfef160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:08.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.898+0000 7fb2be444640 1 -- 172.21.15.146:0/1656794813 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556faceb3e00 con 0x556facff0880 2024-09-18T01:47:08.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.900+0000 7fb2be444640 1 --2- 172.21.15.146:0/1656794813 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556facff0880 0x556facff2c90 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fb2b400a470 tx=0x7fb2b4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a767d022038648bc server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:08.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.900+0000 7fb2bdc43640 1 -- 172.21.15.146:0/1656794813 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2b4053570 con 0x556facff0880 2024-09-18T01:47:08.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.900+0000 7fb2bdc43640 1 -- 172.21.15.146:0/1656794813 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2b4058070 con 0x556facff0880 2024-09-18T01:47:08.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.900+0000 7fb2bdc43640 1 -- 172.21.15.146:0/1656794813 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2b4053880 con 0x556facff0880 2024-09-18T01:47:08.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.901+0000 7fb2c1151800 1 -- 172.21.15.146:0/1656794813 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556facff0880 msgr2=0x556facff2c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:08.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.901+0000 7fb2c1151800 1 --2- 172.21.15.146:0/1656794813 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556facff0880 0x556facff2c90 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fb2b400a470 tx=0x7fb2b4045a20 comp rx=0 tx=0).stop 2024-09-18T01:47:08.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.901+0000 7fb2c1151800 1 -- 172.21.15.146:0/1656794813 shutdown_connections 2024-09-18T01:47:08.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.901+0000 7fb2c1151800 1 --2- 172.21.15.146:0/1656794813 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556facff0880 0x556facff2c90 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:08.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.901+0000 7fb2c1151800 1 -- 172.21.15.146:0/1656794813 >> 172.21.15.146:0/1656794813 conn(0x556facfe6db0 msgr2=0x556facfe91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:08.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.901+0000 7fb2c1151800 1 -- 172.21.15.146:0/1656794813 shutdown_connections 2024-09-18T01:47:08.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.901+0000 7fb2c1151800 1 -- 172.21.15.146:0/1656794813 wait complete. 2024-09-18T01:47:08.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.914+0000 7fb2c1151800 1 Processor -- start 2024-09-18T01:47:08.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.914+0000 7fb2c1151800 1 -- start start 2024-09-18T01:47:08.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.915+0000 7fb2c1151800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556facf606d0 0x556fad0db870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:08.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.915+0000 7fb2c1151800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x556facf38360 con 0x556facf606d0 2024-09-18T01:47:08.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.915+0000 7fb2bec45640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556facf606d0 0x556fad0db870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:08.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.915+0000 7fb2bec45640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556facf606d0 0x556fad0db870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:36940/0 (socket says 172.21.15.146:36940) 2024-09-18T01:47:08.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.915+0000 7fb2bec45640 1 -- 172.21.15.146:0/2622311316 learned_addr learned my addr 172.21.15.146:0/2622311316 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:08.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.915+0000 7fb2bec45640 1 -- 172.21.15.146:0/2622311316 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556face85bc0 con 0x556facf606d0 2024-09-18T01:47:08.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.915+0000 7fb2bec45640 1 --2- 172.21.15.146:0/2622311316 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556facf606d0 0x556fad0db870 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fb2b0001d80 tx=0x7fb2b0001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baf1750498b02f65 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:08.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.916+0000 7fb1ace09640 1 -- 172.21.15.146:0/2622311316 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2b0013030 con 0x556facf606d0 2024-09-18T01:47:08.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.916+0000 7fb1ace09640 1 -- 172.21.15.146:0/2622311316 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2b000e470 con 0x556facf606d0 2024-09-18T01:47:08.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.916+0000 7fb1ace09640 1 -- 172.21.15.146:0/2622311316 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2b000e810 con 0x556facf606d0 2024-09-18T01:47:08.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.916+0000 7fb2c1151800 1 -- 172.21.15.146:0/2622311316 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556facf606d0 msgr2=0x556fad0db870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:08.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.916+0000 7fb2c1151800 1 --2- 172.21.15.146:0/2622311316 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556facf606d0 0x556fad0db870 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fb2b0001d80 tx=0x7fb2b0001e70 comp rx=0 tx=0).stop 2024-09-18T01:47:08.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.916+0000 7fb2c1151800 1 -- 172.21.15.146:0/2622311316 shutdown_connections 2024-09-18T01:47:08.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.916+0000 7fb2c1151800 1 --2- 172.21.15.146:0/2622311316 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556facf606d0 0x556fad0db870 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:08.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.916+0000 7fb2c1151800 1 -- 172.21.15.146:0/2622311316 >> 172.21.15.146:0/2622311316 conn(0x556facfe6db0 msgr2=0x556fad0d7230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:08.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.916+0000 7fb2c1151800 1 -- 172.21.15.146:0/2622311316 shutdown_connections 2024-09-18T01:47:08.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.916+0000 7fb2c1151800 1 -- 172.21.15.146:0/2622311316 wait complete. 2024-09-18T01:47:08.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.917+0000 7fb2c1151800 1 Processor -- start 2024-09-18T01:47:08.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.917+0000 7fb2c1151800 1 -- start start 2024-09-18T01:47:08.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.917+0000 7fb2c1151800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556facf606d0 0x556fad0e32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:08.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.917+0000 7fb2c1151800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x556facff3610 con 0x556facf606d0 2024-09-18T01:47:08.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.917+0000 7fb2bec45640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556facf606d0 0x556fad0e32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:08.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.917+0000 7fb2bec45640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556facf606d0 0x556fad0e32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:36956/0 (socket says 172.21.15.146:36956) 2024-09-18T01:47:08.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.917+0000 7fb2bec45640 1 -- 172.21.15.146:0/3243136361 learned_addr learned my addr 172.21.15.146:0/3243136361 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:08.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.917+0000 7fb2bec45640 1 -- 172.21.15.146:0/3243136361 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556face99fe0 con 0x556facf606d0 2024-09-18T01:47:08.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.918+0000 7fb2bec45640 1 --2- 172.21.15.146:0/3243136361 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556facf606d0 0x556fad0e32a0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fb2b0004000 tx=0x7fb2b0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:08.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.918+0000 7fb1ab606640 1 -- 172.21.15.146:0/3243136361 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2b0027070 con 0x556facf606d0 2024-09-18T01:47:08.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.918+0000 7fb1ab606640 1 -- 172.21.15.146:0/3243136361 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2b0019900 con 0x556facf606d0 2024-09-18T01:47:08.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.918+0000 7fb2c1151800 1 -- 172.21.15.146:0/3243136361 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556fad0e37e0 con 0x556facf606d0 2024-09-18T01:47:08.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.918+0000 7fb1ab606640 1 -- 172.21.15.146:0/3243136361 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2b0019c60 con 0x556facf606d0 2024-09-18T01:47:08.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.918+0000 7fb2c1151800 1 -- 172.21.15.146:0/3243136361 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556fad0e3d00 con 0x556facf606d0 2024-09-18T01:47:08.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.919+0000 7fb1ab606640 1 -- 172.21.15.146:0/3243136361 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb2b002a070 con 0x556facf606d0 2024-09-18T01:47:08.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.919+0000 7fb1ab606640 1 --2- 172.21.15.146:0/3243136361 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb1a4036b40 0x7fb1a4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:08.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.919+0000 7fb1ab606640 1 -- 172.21.15.146:0/3243136361 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7fb2b001f070 con 0x556facf606d0 2024-09-18T01:47:08.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.919+0000 7fb2be444640 1 --2- 172.21.15.146:0/3243136361 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb1a4036b40 0x7fb1a4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:08.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.919+0000 7fb2c1151800 1 --2- 172.21.15.146:0/3243136361 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x556facff0880 0x556fad0ea310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:08.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.919+0000 7fb2c1151800 1 -- 172.21.15.146:0/3243136361 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad0ea8a0 con 0x556facff0880 2024-09-18T01:47:08.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.919+0000 7fb2bf446640 1 --2- 172.21.15.146:0/3243136361 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x556facff0880 0x556fad0ea310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:08.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.919+0000 7fb2be444640 1 --2- 172.21.15.146:0/3243136361 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb1a4036b40 0x7fb1a4039000 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4057000 tx=0x7fb2b4052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:08.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.919+0000 7fb2bf446640 1 --2- 172.21.15.146:0/3243136361 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x556facff0880 0x556fad0ea310 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:08.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.920+0000 7fb2bf446640 1 -- 172.21.15.146:0/3243136361 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb2b800a4a0 con 0x556facff0880 2024-09-18T01:47:08.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.920+0000 7fb2c1151800 1 -- 172.21.15.146:0/3243136361 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad0e78e0 con 0x556facff0880 2024-09-18T01:47:08.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.920+0000 7fb2bf446640 1 -- 172.21.15.146:0/3243136361 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb2b800a4a0 con 0x556facff0880 2024-09-18T01:47:08.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.920+0000 7fb2c1151800 1 -- 172.21.15.146:0/3243136361 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad0ec6e0 con 0x556facff0880 2024-09-18T01:47:08.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.920+0000 7fb2bf446640 1 -- 172.21.15.146:0/3243136361 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb2b800a4a0 con 0x556facff0880 2024-09-18T01:47:08.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.920+0000 7fb2c1151800 1 -- 172.21.15.146:0/3243136361 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad0eb820 con 0x556facff0880 2024-09-18T01:47:08.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.921+0000 7fb2bf446640 1 -- 172.21.15.146:0/3243136361 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb2b800a4a0 con 0x556facff0880 2024-09-18T01:47:08.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.921+0000 7fb2c1151800 1 --2- 172.21.15.146:0/3243136361 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x556fad0ec2f0 0x556fad0efb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:08.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.921+0000 7fb2c1151800 1 -- 172.21.15.146:0/3243136361 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad0f02c0 con 0x556fad0ec2f0 2024-09-18T01:47:08.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.921+0000 7fb2bec45640 1 --2- 172.21.15.146:0/3243136361 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x556fad0ec2f0 0x556fad0efb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:08.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.921+0000 7fb2bec45640 1 --2- 172.21.15.146:0/3243136361 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x556fad0ec2f0 0x556fad0efb30 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:08.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.921+0000 7fb2bec45640 1 -- 172.21.15.146:0/3243136361 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb2b0029030 con 0x556fad0ec2f0 2024-09-18T01:47:08.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.922+0000 7fb2c1151800 1 Processor -- start 2024-09-18T01:47:08.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.922+0000 7fb2c1151800 1 -- start start 2024-09-18T01:47:08.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.922+0000 7fb2c1151800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556facfecb10 0x556facfeb160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:08.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.922+0000 7fb2c1151800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x556face87580 con 0x556facfecb10 2024-09-18T01:47:08.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.922+0000 7fb2bf446640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556facfecb10 0x556facfeb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:08.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.922+0000 7fb2bf446640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556facfecb10 0x556facfeb160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:36962/0 (socket says 172.21.15.146:36962) 2024-09-18T01:47:08.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.922+0000 7fb2bf446640 1 -- 172.21.15.146:0/1378153563 learned_addr learned my addr 172.21.15.146:0/1378153563 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:08.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.922+0000 7fb2bf446640 1 -- 172.21.15.146:0/1378153563 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556facfecf30 con 0x556facfecb10 2024-09-18T01:47:08.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.923+0000 7fb2bf446640 1 --2- 172.21.15.146:0/1378153563 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556facfecb10 0x556facfeb160 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x556fad0eaca0 tx=0x7fb2b80178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:08.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.923+0000 7fb1a8e01640 1 -- 172.21.15.146:0/1378153563 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2b8013440 con 0x556facfecb10 2024-09-18T01:47:08.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.923+0000 7fb1a8e01640 1 -- 172.21.15.146:0/1378153563 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2b80135e0 con 0x556facfecb10 2024-09-18T01:47:08.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.923+0000 7fb1a8e01640 1 -- 172.21.15.146:0/1378153563 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2b80138c0 con 0x556facfecb10 2024-09-18T01:47:08.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.923+0000 7fb2c1151800 1 -- 172.21.15.146:0/1378153563 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556facfeb760 con 0x556facfecb10 2024-09-18T01:47:08.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.923+0000 7fb2c1151800 1 -- 172.21.15.146:0/1378153563 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556facfebc60 con 0x556facfecb10 2024-09-18T01:47:08.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.924+0000 7fb1a8e01640 1 -- 172.21.15.146:0/1378153563 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb2b8011040 con 0x556facfecb10 2024-09-18T01:47:08.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.924+0000 7fb1a8e01640 1 --2- 172.21.15.146:0/1378153563 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb198036b40 0x7fb198039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:08.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.924+0000 7fb1a8e01640 1 -- 172.21.15.146:0/1378153563 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7fb2b801d070 con 0x556facfecb10 2024-09-18T01:47:08.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.924+0000 7fb2bec45640 1 --2- 172.21.15.146:0/1378153563 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb198036b40 0x7fb198039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:08.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.924+0000 7fb2c1151800 1 Processor -- start 2024-09-18T01:47:08.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.924+0000 7fb2bec45640 1 --2- 172.21.15.146:0/1378153563 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb198036b40 0x7fb198039000 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb2b0016fd0 tx=0x7fb2b004ad80 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:08.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.924+0000 7fb2c1151800 1 -- start start 2024-09-18T01:47:08.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.924+0000 7fb2c1151800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556fad10cef0 0x556fad10d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:08.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.924+0000 7fb2c1151800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x556fad0dc020 con 0x556fad10cef0 2024-09-18T01:47:08.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.925+0000 7fb2bf446640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556fad10cef0 0x556fad10d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:08.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.925+0000 7fb2bf446640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556fad10cef0 0x556fad10d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:36972/0 (socket says 172.21.15.146:36972) 2024-09-18T01:47:08.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.925+0000 7fb2bf446640 1 -- 172.21.15.146:0/1011928857 learned_addr learned my addr 172.21.15.146:0/1011928857 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:08.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.925+0000 7fb2bf446640 1 -- 172.21.15.146:0/1011928857 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fad10d8c0 con 0x556fad10cef0 2024-09-18T01:47:08.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.925+0000 7fb2bf446640 1 --2- 172.21.15.146:0/1011928857 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556fad10cef0 0x556fad10d2f0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8001450 tx=0x7fb2b804caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89c0d7988013b46d server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:08.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.925+0000 7fb1a27fc640 1 -- 172.21.15.146:0/1011928857 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2b8045070 con 0x556fad10cef0 2024-09-18T01:47:08.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.925+0000 7fb1a27fc640 1 -- 172.21.15.146:0/1011928857 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2b8015560 con 0x556fad10cef0 2024-09-18T01:47:08.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.925+0000 7fb1a27fc640 1 -- 172.21.15.146:0/1011928857 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2b802ad80 con 0x556fad10cef0 2024-09-18T01:47:08.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.926+0000 7fb2c1151800 1 -- 172.21.15.146:0/1011928857 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556fad10cef0 msgr2=0x556fad10d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:08.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.926+0000 7fb2c1151800 1 --2- 172.21.15.146:0/1011928857 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556fad10cef0 0x556fad10d2f0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8001450 tx=0x7fb2b804caf0 comp rx=0 tx=0).stop 2024-09-18T01:47:08.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.926+0000 7fb2c1151800 1 -- 172.21.15.146:0/1011928857 shutdown_connections 2024-09-18T01:47:08.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.926+0000 7fb2c1151800 1 --2- 172.21.15.146:0/1011928857 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556fad10cef0 0x556fad10d2f0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:08.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.926+0000 7fb2c1151800 1 -- 172.21.15.146:0/1011928857 >> 172.21.15.146:0/1011928857 conn(0x556fad1092a0 msgr2=0x556fad1073a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:08.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.926+0000 7fb2c1151800 1 -- 172.21.15.146:0/1011928857 shutdown_connections 2024-09-18T01:47:08.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.926+0000 7fb2c1151800 1 -- 172.21.15.146:0/1011928857 wait complete. 2024-09-18T01:47:08.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.926+0000 7fb2c1151800 1 Processor -- start 2024-09-18T01:47:08.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.926+0000 7fb2c1151800 1 -- start start 2024-09-18T01:47:08.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.926+0000 7fb2c1151800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556fad10cef0 0x556fad1142f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:08.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.926+0000 7fb2c1151800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x556fad10de90 con 0x556fad10cef0 2024-09-18T01:47:08.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.926+0000 7fb2bf446640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556fad10cef0 0x556fad1142f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:08.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.926+0000 7fb2bf446640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556fad10cef0 0x556fad1142f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:36982/0 (socket says 172.21.15.146:36982) 2024-09-18T01:47:08.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.926+0000 7fb2bf446640 1 -- 172.21.15.146:0/3169435660 learned_addr learned my addr 172.21.15.146:0/3169435660 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:08.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.926+0000 7fb2bf446640 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fad114830 con 0x556fad10cef0 2024-09-18T01:47:08.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.927+0000 7fb2bf446640 1 --2- 172.21.15.146:0/3169435660 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556fad10cef0 0x556fad1142f0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8043040 tx=0x7fb2b804c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:08.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.927+0000 7fb1a0ff9640 1 -- 172.21.15.146:0/3169435660 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2b803a070 con 0x556fad10cef0 2024-09-18T01:47:08.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.927+0000 7fb1a0ff9640 1 -- 172.21.15.146:0/3169435660 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2b80014f0 con 0x556fad10cef0 2024-09-18T01:47:08.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.927+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556fad114ac0 con 0x556fad10cef0 2024-09-18T01:47:08.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.927+0000 7fb1a0ff9640 1 -- 172.21.15.146:0/3169435660 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2b8045040 con 0x556fad10cef0 2024-09-18T01:47:08.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.927+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556fad117770 con 0x556fad10cef0 2024-09-18T01:47:08.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.928+0000 7fb1a0ff9640 1 -- 172.21.15.146:0/3169435660 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb2b803d070 con 0x556fad10cef0 2024-09-18T01:47:08.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.928+0000 7fb1a0ff9640 1 --2- 172.21.15.146:0/3169435660 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb188036b40 0x7fb188039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:08.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.928+0000 7fb1a0ff9640 1 -- 172.21.15.146:0/3169435660 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7fb2b800e040 con 0x556fad10cef0 2024-09-18T01:47:08.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.928+0000 7fb2bec45640 1 --2- 172.21.15.146:0/3169435660 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb188036b40 0x7fb188039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:08.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.928+0000 7fb2bec45640 1 --2- 172.21.15.146:0/3169435660 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb188036b40 0x7fb188039000 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb2b002af70 tx=0x7fb2b0033000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:08.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.928+0000 7fb2c1151800 20 rados->read ofs=0 len=0 2024-09-18T01:47:08.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.928+0000 7fb2c1151800 1 --2- 172.21.15.146:0/3169435660 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x556fad120020 0x556fad1224e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:08.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.928+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad122c30 con 0x556fad120020 2024-09-18T01:47:08.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.929+0000 7fb2be444640 1 --2- 172.21.15.146:0/3169435660 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x556fad120020 0x556fad1224e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:08.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.929+0000 7fb2be444640 1 --2- 172.21.15.146:0/3169435660 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x556fad120020 0x556fad1224e0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:08.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.929+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb2b4051070 con 0x556fad120020 2024-09-18T01:47:08.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.929+0000 7fb2c1151800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:08.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.929+0000 7fb2c1151800 20 realm 2024-09-18T01:47:08.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.929+0000 7fb2c1151800 20 rados->read ofs=0 len=0 2024-09-18T01:47:08.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.929+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad123060 con 0x556fad120020 2024-09-18T01:47:08.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.929+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb2b4051070 con 0x556fad120020 2024-09-18T01:47:08.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.929+0000 7fb2c1151800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:08.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.929+0000 7fb2c1151800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:47:08.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.929+0000 7fb2c1151800 20 rados->read ofs=0 len=0 2024-09-18T01:47:08.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.929+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad123930 con 0x556fad120020 2024-09-18T01:47:08.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.930+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb2b4051070 con 0x556fad120020 2024-09-18T01:47:08.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.930+0000 7fb2c1151800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:08.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.930+0000 7fb2c1151800 20 rados->read ofs=0 len=0 2024-09-18T01:47:08.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.930+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad123cd0 con 0x556fad120020 2024-09-18T01:47:08.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.930+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb2b4051070 con 0x556fad120020 2024-09-18T01:47:08.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.930+0000 7fb2c1151800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:47:08.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.930+0000 7fb2c1151800 20 rados->read ofs=0 len=0 2024-09-18T01:47:08.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.930+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad124520 con 0x556fad120020 2024-09-18T01:47:08.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.930+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb2b4051070 con 0x556fad120020 2024-09-18T01:47:08.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.930+0000 7fb2c1151800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:47:08.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.930+0000 7fb2c1151800 20 searching for the correct realm 2024-09-18T01:47:08.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.930+0000 7fb2c1151800 1 --2- 172.21.15.146:0/3169435660 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x556fad126290 0x556fad128680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:08.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.930+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fad128cb0 con 0x556fad126290 2024-09-18T01:47:08.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.930+0000 7fb2bf446640 1 --2- 172.21.15.146:0/3169435660 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x556fad126290 0x556fad128680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:08.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.930+0000 7fb2bf446640 1 --2- 172.21.15.146:0/3169435660 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x556fad126290 0x556fad128680 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:08.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.931+0000 7fb2bf446640 1 -- 172.21.15.146:0/3169435660 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2b803c030 con 0x556fad126290 2024-09-18T01:47:08.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.931+0000 7fb2bf446640 1 --2- 172.21.15.146:0/3169435660 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fb2b803f060 0x7fb2b803e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:08.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.931+0000 7fb2bf446640 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fad128cb0 con 0x7fb2b803f060 2024-09-18T01:47:08.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.931+0000 7fb2bec45640 1 --2- 172.21.15.146:0/3169435660 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fb2b803f060 0x7fb2b803e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:08.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.931+0000 7fb2bec45640 1 --2- 172.21.15.146:0/3169435660 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fb2b803f060 0x7fb2b803e9f0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:08.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.931+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2b0029030 con 0x7fb2b803f060 2024-09-18T01:47:08.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.931+0000 7fb2bec45640 1 --2- 172.21.15.146:0/3169435660 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fb2b002c060 0x7fb2b000caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:08.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.931+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fad128cb0 con 0x7fb2b002c060 2024-09-18T01:47:08.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.932+0000 7fb2be444640 1 --2- 172.21.15.146:0/3169435660 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fb2b002c060 0x7fb2b000caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:08.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.932+0000 7fb2be444640 1 --2- 172.21.15.146:0/3169435660 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fb2b002c060 0x7fb2b000caa0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:08.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.932+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2b4051070 con 0x7fb2b002c060 2024-09-18T01:47:08.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.932+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fad128cb0 con 0x556fad120020 2024-09-18T01:47:08.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.932+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb2b4051070 con 0x556fad120020 2024-09-18T01:47:08.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.932+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fad128cb0 con 0x556fad120020 2024-09-18T01:47:08.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.933+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2b4051070 con 0x556fad120020 2024-09-18T01:47:08.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.933+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fad128cb0 con 0x7fb2b002c060 2024-09-18T01:47:08.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.933+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2b4051070 con 0x7fb2b002c060 2024-09-18T01:47:08.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.933+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fad128cb0 con 0x7fb2b002c060 2024-09-18T01:47:08.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.933+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2b4051070 con 0x7fb2b002c060 2024-09-18T01:47:08.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.933+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fad128cb0 con 0x7fb2b803f060 2024-09-18T01:47:08.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.933+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2b0029030 con 0x7fb2b803f060 2024-09-18T01:47:08.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.933+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fad128cb0 con 0x556fad126290 2024-09-18T01:47:08.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.934+0000 7fb2bf446640 1 -- 172.21.15.146:0/3169435660 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2b803c030 con 0x556fad126290 2024-09-18T01:47:08.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.934+0000 7fb2bf446640 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fad128cb0 con 0x556fad120020 2024-09-18T01:47:08.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.934+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2b4051070 con 0x556fad120020 2024-09-18T01:47:08.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.934+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fad128cb0 con 0x7fb2b002c060 2024-09-18T01:47:08.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.934+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2b4051070 con 0x7fb2b002c060 2024-09-18T01:47:08.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.934+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fad128cb0 con 0x556fad120020 2024-09-18T01:47:08.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.934+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2b4051070 con 0x556fad120020 2024-09-18T01:47:08.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.934+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fad128cb0 con 0x7fb2b803f060 2024-09-18T01:47:08.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.935+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fb2b0029030 con 0x7fb2b803f060 2024-09-18T01:47:08.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.935+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fad128cb0 con 0x556fad126290 2024-09-18T01:47:08.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.935+0000 7fb2bf446640 1 -- 172.21.15.146:0/3169435660 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2b803c030 con 0x556fad126290 2024-09-18T01:47:08.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.935+0000 7fb2bf446640 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fad128cb0 con 0x556fad126290 2024-09-18T01:47:08.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.935+0000 7fb2bf446640 1 -- 172.21.15.146:0/3169435660 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2b803c030 con 0x556fad126290 2024-09-18T01:47:08.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.935+0000 7fb2bf446640 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fad128cb0 con 0x7fb2b002c060 2024-09-18T01:47:08.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.935+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2b4051070 con 0x7fb2b002c060 2024-09-18T01:47:08.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.935+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fad128cb0 con 0x556fad126290 2024-09-18T01:47:08.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.936+0000 7fb2bf446640 1 -- 172.21.15.146:0/3169435660 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2b803c030 con 0x556fad126290 2024-09-18T01:47:08.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.936+0000 7fb2bf446640 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fad128cb0 con 0x556fad126290 2024-09-18T01:47:08.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.936+0000 7fb2bf446640 1 -- 172.21.15.146:0/3169435660 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2b803c030 con 0x556fad126290 2024-09-18T01:47:08.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.936+0000 7fb2bf446640 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fad128cb0 con 0x556fad120020 2024-09-18T01:47:08.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.936+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2b4051070 con 0x556fad120020 2024-09-18T01:47:08.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.936+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fad128cb0 con 0x556fad120020 2024-09-18T01:47:08.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.936+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb2b4051070 con 0x556fad120020 2024-09-18T01:47:08.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.936+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fad128cb0 con 0x7fb2b002c060 2024-09-18T01:47:08.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.936+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2b4051070 con 0x7fb2b002c060 2024-09-18T01:47:08.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.936+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fad128cb0 con 0x556fad126290 2024-09-18T01:47:08.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.937+0000 7fb2bf446640 1 -- 172.21.15.146:0/3169435660 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2b803c030 con 0x556fad126290 2024-09-18T01:47:08.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.937+0000 7fb2bf446640 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fad128cb0 con 0x7fb2b803f060 2024-09-18T01:47:08.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.937+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2b0029030 con 0x7fb2b803f060 2024-09-18T01:47:08.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.937+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fad128cb0 con 0x556fad120020 2024-09-18T01:47:08.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.937+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2b4051070 con 0x556fad120020 2024-09-18T01:47:08.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.937+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fad128cb0 con 0x7fb2b002c060 2024-09-18T01:47:08.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.937+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2b4051070 con 0x7fb2b002c060 2024-09-18T01:47:08.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.937+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fad128cb0 con 0x556fad126290 2024-09-18T01:47:08.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.938+0000 7fb2bf446640 1 -- 172.21.15.146:0/3169435660 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2b803c030 con 0x556fad126290 2024-09-18T01:47:08.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.938+0000 7fb2bf446640 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fad128cb0 con 0x7fb2b002c060 2024-09-18T01:47:08.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.938+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2b4051070 con 0x7fb2b002c060 2024-09-18T01:47:08.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.938+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fad128cb0 con 0x7fb2b803f060 2024-09-18T01:47:08.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.938+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2b0029030 con 0x7fb2b803f060 2024-09-18T01:47:08.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.938+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fad128cb0 con 0x556fad126290 2024-09-18T01:47:08.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.938+0000 7fb2bf446640 1 -- 172.21.15.146:0/3169435660 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2b803c030 con 0x556fad126290 2024-09-18T01:47:08.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.938+0000 7fb2bf446640 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fad128cb0 con 0x7fb2b002c060 2024-09-18T01:47:08.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.939+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2b4051070 con 0x7fb2b002c060 2024-09-18T01:47:08.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.939+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fad128cb0 con 0x556fad120020 2024-09-18T01:47:08.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.939+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb2b4051070 con 0x556fad120020 2024-09-18T01:47:08.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.939+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556fad128cb0 con 0x7fb2b803f060 2024-09-18T01:47:08.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.939+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2b0060040 con 0x7fb2b803f060 2024-09-18T01:47:08.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.939+0000 7fb2c1151800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:47:08.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.939+0000 7fb2c1151800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:47:08.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.939+0000 7fb2c1151800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:47:08.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.939+0000 7fb2c1151800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:47:08.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.939+0000 7fb2c1151800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:47:08.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.939+0000 7fb2c1151800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:47:08.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.939+0000 7fb2c1151800 20 rados->read ofs=0 len=0 2024-09-18T01:47:08.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.939+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad124ea0 con 0x556fad120020 2024-09-18T01:47:08.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.939+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb2b4051070 con 0x556fad120020 2024-09-18T01:47:08.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.939+0000 7fb2c1151800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:08.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.939+0000 7fb2c1151800 20 rados->read ofs=0 len=0 2024-09-18T01:47:08.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.939+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad125740 con 0x556fad120020 2024-09-18T01:47:08.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.939+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb2b4051070 con 0x556fad120020 2024-09-18T01:47:08.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.940+0000 7fb2c1151800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:47:08.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.940+0000 7fb2c1151800 20 rados->read ofs=0 len=0 2024-09-18T01:47:08.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.940+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad129130 con 0x7fb2b803f060 2024-09-18T01:47:08.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.940+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb2b0060040 con 0x7fb2b803f060 2024-09-18T01:47:08.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.940+0000 7fb2c1151800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:47:08.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.940+0000 7fb2c1151800 20 zone default found 2024-09-18T01:47:08.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.940+0000 7fb2c1151800 4 Realm: () 2024-09-18T01:47:08.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.940+0000 7fb2c1151800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:47:08.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.940+0000 7fb2c1151800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:47:08.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.940+0000 7fb2c1151800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:47:08.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.940+0000 7fb2c1151800 20 zonegroup default 2024-09-18T01:47:08.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.940+0000 7fb2c1151800 20 rados->read ofs=0 len=0 2024-09-18T01:47:08.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.940+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad129980 con 0x7fb2b002c060 2024-09-18T01:47:08.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.940+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb2b4051070 con 0x7fb2b002c060 2024-09-18T01:47:08.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.940+0000 7fb2c1151800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:08.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.940+0000 7fb2c1151800 20 rados->read ofs=0 len=0 2024-09-18T01:47:08.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.940+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad12b360 con 0x556fad126290 2024-09-18T01:47:08.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.940+0000 7fb2bf446640 1 -- 172.21.15.146:0/3169435660 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb2b803c030 con 0x556fad126290 2024-09-18T01:47:08.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.940+0000 7fb2c1151800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:08.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.940+0000 7fb2c1151800 20 rados->read ofs=0 len=0 2024-09-18T01:47:08.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.940+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad12b800 con 0x556fad126290 2024-09-18T01:47:08.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.941+0000 7fb2bf446640 1 -- 172.21.15.146:0/3169435660 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb2b803c030 con 0x556fad126290 2024-09-18T01:47:08.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.941+0000 7fb2c1151800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:08.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.941+0000 7fb2c1151800 20 started sync module instance, tier type = 2024-09-18T01:47:08.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.941+0000 7fb2c1151800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:47:08.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.941+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad12a7f0 con 0x7fb2b803f060 2024-09-18T01:47:08.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.942+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v33'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2b0060040 con 0x7fb2b803f060 2024-09-18T01:47:08.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.942+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93938133412832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad12a450 con 0x7fb2b803f060 2024-09-18T01:47:08.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.942+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad12c730 con 0x556fad120020 2024-09-18T01:47:08.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.943+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93938133412832] v33'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2b0060040 con 0x7fb2b803f060 2024-09-18T01:47:08.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.943+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v33'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2b4051070 con 0x556fad120020 2024-09-18T01:47:08.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.943+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93938133418624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad12cb50 con 0x556fad120020 2024-09-18T01:47:08.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.943+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad12d510 con 0x556fad126290 2024-09-18T01:47:08.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.944+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93938133418624] v33'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2b4051070 con 0x556fad120020 2024-09-18T01:47:08.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.945+0000 7fb2bf446640 1 -- 172.21.15.146:0/3169435660 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v33'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2b803c030 con 0x556fad126290 2024-09-18T01:47:08.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.945+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93938133419680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad12cac0 con 0x556fad126290 2024-09-18T01:47:08.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.945+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad12e3d0 con 0x7fb2b803f060 2024-09-18T01:47:08.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.946+0000 7fb2bf446640 1 -- 172.21.15.146:0/3169435660 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93938133419680] v33'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2b803c030 con 0x556fad126290 2024-09-18T01:47:08.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.946+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v33'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2b0060040 con 0x7fb2b803f060 2024-09-18T01:47:08.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.946+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93938133425952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad12e770 con 0x7fb2b803f060 2024-09-18T01:47:08.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.946+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad12f190 con 0x556fad120020 2024-09-18T01:47:08.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.947+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v33'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2b4051070 con 0x556fad120020 2024-09-18T01:47:08.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.947+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93938133425952] v33'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2b0060040 con 0x7fb2b803f060 2024-09-18T01:47:08.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.947+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93938133429376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad12f680 con 0x556fad120020 2024-09-18T01:47:08.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.947+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad12d940 con 0x7fb2b002c060 2024-09-18T01:47:08.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.948+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v33'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2b4051070 con 0x7fb2b002c060 2024-09-18T01:47:08.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.948+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93938133433360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad12d940 con 0x7fb2b002c060 2024-09-18T01:47:08.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.948+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad130b40 con 0x7fb2b002c060 2024-09-18T01:47:08.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.948+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93938133429376] v33'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2b4051070 con 0x556fad120020 2024-09-18T01:47:08.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.950+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93938133433360] v33'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2b4051070 con 0x7fb2b002c060 2024-09-18T01:47:08.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.950+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v33'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2b4051070 con 0x7fb2b002c060 2024-09-18T01:47:08.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.951+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93938133434416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad130650 con 0x7fb2b002c060 2024-09-18T01:47:08.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.951+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad131010 con 0x7fb2b002c060 2024-09-18T01:47:08.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.952+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93938133434416] v33'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2b4051070 con 0x7fb2b002c060 2024-09-18T01:47:08.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.952+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v33'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2b4051070 con 0x7fb2b002c060 2024-09-18T01:47:08.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.952+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93938133430608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad131010 con 0x7fb2b002c060 2024-09-18T01:47:08.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.952+0000 7fb2c1151800 20 add_watcher() i=0 2024-09-18T01:47:08.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.952+0000 7fb2c1151800 20 add_watcher() i=1 2024-09-18T01:47:08.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.952+0000 7fb2c1151800 20 add_watcher() i=2 2024-09-18T01:47:08.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.952+0000 7fb2c1151800 20 add_watcher() i=3 2024-09-18T01:47:08.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.952+0000 7fb2c1151800 20 add_watcher() i=4 2024-09-18T01:47:08.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.952+0000 7fb2c1151800 20 add_watcher() i=5 2024-09-18T01:47:08.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.952+0000 7fb2c1151800 20 add_watcher() i=6 2024-09-18T01:47:08.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.953+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93938133430608] v33'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2b4051070 con 0x7fb2b002c060 2024-09-18T01:47:08.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.953+0000 7fb2c1151800 20 add_watcher() i=7 2024-09-18T01:47:08.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.953+0000 7fb2c1151800 2 all 8 watchers are set, enabling cache 2024-09-18T01:47:08.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.953+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad134370 con 0x556fad120020 2024-09-18T01:47:08.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.953+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb2b4051070 con 0x556fad120020 2024-09-18T01:47:08.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.953+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93938133437648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad1315a0 con 0x556fad120020 2024-09-18T01:47:08.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.954+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93938133437648] v33'238 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb2b4051070 con 0x556fad120020 2024-09-18T01:47:08.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.954+0000 7fb1757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:47:08.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.955+0000 7fb2c1151800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:47:08.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.955+0000 7fb2c1151800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:47:08.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.955+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad133c10 con 0x556fad120020 2024-09-18T01:47:08.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.956+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'59 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb2b4051070 con 0x556fad120020 2024-09-18T01:47:08.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.956+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad13d530 con 0x7fb2b002c060 2024-09-18T01:47:08.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.957+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb2b4051070 con 0x7fb2b002c060 2024-09-18T01:47:08.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.957+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad13daa0 con 0x556fad126290 2024-09-18T01:47:08.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.958+0000 7fb2bf446640 1 -- 172.21.15.146:0/3169435660 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb2b803c030 con 0x556fad126290 2024-09-18T01:47:08.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.958+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad13daa0 con 0x556fad120020 2024-09-18T01:47:08.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.959+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'239 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb2b4051070 con 0x556fad120020 2024-09-18T01:47:08.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.959+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad13e010 con 0x7fb2b803f060 2024-09-18T01:47:08.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.960+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'80 uv57 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb2b0060040 con 0x7fb2b803f060 2024-09-18T01:47:08.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.960+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad13e4c0 con 0x556fad126290 2024-09-18T01:47:08.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.961+0000 7fb2bf446640 1 -- 172.21.15.146:0/3169435660 <== osd.3 v2:172.21.15.146:6809/4106661138 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'66 uv50 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb2b803c030 con 0x556fad126290 2024-09-18T01:47:08.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.961+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad13e4c0 con 0x556fad120020 2024-09-18T01:47:08.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.963+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb2b4051070 con 0x556fad120020 2024-09-18T01:47:08.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.963+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad13e380 con 0x7fb2b002c060 2024-09-18T01:47:08.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.964+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'55 uv40 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb2b4051070 con 0x7fb2b002c060 2024-09-18T01:47:08.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.964+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad13e410 con 0x7fb2b803f060 2024-09-18T01:47:08.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.966+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb2b0060040 con 0x7fb2b803f060 2024-09-18T01:47:08.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.966+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad13e9c0 con 0x556fad126290 2024-09-18T01:47:08.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.967+0000 7fb2bf446640 1 -- 172.21.15.146:0/3169435660 <== osd.3 v2:172.21.15.146:6809/4106661138 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb2b803c030 con 0x556fad126290 2024-09-18T01:47:08.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.967+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad13e9c0 con 0x7fb2b803f060 2024-09-18T01:47:08.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.968+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 <== osd.2 v2:172.21.15.146:6800/3820039304 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'81 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2b0060040 con 0x7fb2b803f060 2024-09-18T01:47:08.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.968+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad13e9c0 con 0x7fb2b002c060 2024-09-18T01:47:08.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.969+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'34 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2b4051070 con 0x7fb2b002c060 2024-09-18T01:47:08.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.969+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad13e9c0 con 0x7fb2b803f060 2024-09-18T01:47:08.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.970+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 <== osd.2 v2:172.21.15.146:6800/3820039304 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2b0060040 con 0x7fb2b803f060 2024-09-18T01:47:08.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.970+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad13e9c0 con 0x7fb2b002c060 2024-09-18T01:47:08.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.971+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'67 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2b4051070 con 0x7fb2b002c060 2024-09-18T01:47:08.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.971+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad13e9c0 con 0x556fad120020 2024-09-18T01:47:08.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.972+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'240 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2b4051070 con 0x556fad120020 2024-09-18T01:47:08.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.972+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad13e9c0 con 0x556fad126290 2024-09-18T01:47:08.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.973+0000 7fb2bf446640 1 -- 172.21.15.146:0/3169435660 <== osd.3 v2:172.21.15.146:6809/4106661138 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'75 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2b803c030 con 0x556fad126290 2024-09-18T01:47:08.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.973+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad13e9c0 con 0x7fb2b803f060 2024-09-18T01:47:08.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.974+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 <== osd.2 v2:172.21.15.146:6800/3820039304 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'82 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2b0060040 con 0x7fb2b803f060 2024-09-18T01:47:08.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.974+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad13e9c0 con 0x556fad126290 2024-09-18T01:47:08.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.975+0000 7fb2bf446640 1 -- 172.21.15.146:0/3169435660 <== osd.3 v2:172.21.15.146:6809/4106661138 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'41 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2b803c030 con 0x556fad126290 2024-09-18T01:47:08.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.975+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad13e9c0 con 0x556fad120020 2024-09-18T01:47:08.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.976+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2b4051070 con 0x556fad120020 2024-09-18T01:47:08.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.976+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad13e9c0 con 0x556fad120020 2024-09-18T01:47:08.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.977+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'241 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2b4051070 con 0x556fad120020 2024-09-18T01:47:08.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.977+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad13e9c0 con 0x556fad126290 2024-09-18T01:47:08.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.978+0000 7fb2bf446640 1 -- 172.21.15.146:0/3169435660 <== osd.3 v2:172.21.15.146:6809/4106661138 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'76 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2b803c030 con 0x556fad126290 2024-09-18T01:47:08.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.978+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad13e9c0 con 0x7fb2b803f060 2024-09-18T01:47:08.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.979+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 <== osd.2 v2:172.21.15.146:6800/3820039304 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'44 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2b0060040 con 0x7fb2b803f060 2024-09-18T01:47:08.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.979+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad13e9c0 con 0x556fad126290 2024-09-18T01:47:08.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.980+0000 7fb2bf446640 1 -- 172.21.15.146:0/3169435660 <== osd.3 v2:172.21.15.146:6809/4106661138 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2b803c030 con 0x556fad126290 2024-09-18T01:47:08.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.980+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad13e9c0 con 0x556fad126290 2024-09-18T01:47:08.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.981+0000 7fb2bf446640 1 -- 172.21.15.146:0/3169435660 <== osd.3 v2:172.21.15.146:6809/4106661138 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'46 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2b803c030 con 0x556fad126290 2024-09-18T01:47:08.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.981+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad13e9c0 con 0x556fad126290 2024-09-18T01:47:08.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.982+0000 7fb2bf446640 1 -- 172.21.15.146:0/3169435660 <== osd.3 v2:172.21.15.146:6809/4106661138 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2b803c030 con 0x556fad126290 2024-09-18T01:47:08.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.982+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad13e9c0 con 0x556fad126290 2024-09-18T01:47:08.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.983+0000 7fb2bf446640 1 -- 172.21.15.146:0/3169435660 <== osd.3 v2:172.21.15.146:6809/4106661138 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'67 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2b803c030 con 0x556fad126290 2024-09-18T01:47:08.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.983+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad13e9c0 con 0x7fb2b002c060 2024-09-18T01:47:08.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.984+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'38 uv30 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2b4051070 con 0x7fb2b002c060 2024-09-18T01:47:08.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.984+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad13e9c0 con 0x556fad126290 2024-09-18T01:47:08.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.985+0000 7fb2bf446640 1 -- 172.21.15.146:0/3169435660 <== osd.3 v2:172.21.15.146:6809/4106661138 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'41 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2b803c030 con 0x556fad126290 2024-09-18T01:47:08.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.985+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad13e9c0 con 0x7fb2b002c060 2024-09-18T01:47:08.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.987+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.0 v2:172.21.15.129:6800/1759265424 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'56 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2b4051070 con 0x7fb2b002c060 2024-09-18T01:47:08.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.987+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad13e9c0 con 0x556fad126290 2024-09-18T01:47:08.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.988+0000 7fb2bf446640 1 -- 172.21.15.146:0/3169435660 <== osd.3 v2:172.21.15.146:6809/4106661138 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'77 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2b803c030 con 0x556fad126290 2024-09-18T01:47:08.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.988+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad13e9c0 con 0x7fb2b002c060 2024-09-18T01:47:08.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.989+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.0 v2:172.21.15.129:6800/1759265424 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'68 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2b4051070 con 0x7fb2b002c060 2024-09-18T01:47:08.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.989+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad13e9c0 con 0x7fb2b803f060 2024-09-18T01:47:08.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.990+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 <== osd.2 v2:172.21.15.146:6800/3820039304 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2b0060040 con 0x7fb2b803f060 2024-09-18T01:47:08.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.991+0000 7fb0effff640 20 reqs_thread_entry: start 2024-09-18T01:47:08.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.991+0000 7fb2c1151800 20 init_complete bucket index max shards: 11 2024-09-18T01:47:08.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.991+0000 7fb2c1151800 20 Filter name: none 2024-09-18T01:47:08.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.991+0000 7fb2c1151800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-18T01:47:08.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.991+0000 7fb0edffb640 20 reqs_thread_entry: start 2024-09-18T01:47:08.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.991+0000 7fb2c1151800 20 rados->read ofs=0 len=0 2024-09-18T01:47:08.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.991+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad1699a0 con 0x556fad120020 2024-09-18T01:47:08.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.991+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.1 v2:172.21.15.146:6808/3930274777 28 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb2b4051070 con 0x556fad120020 2024-09-18T01:47:08.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.991+0000 7fb2c1151800 20 rados_obj.operate() r=0 bl.length=391 2024-09-18T01:47:08.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.991+0000 7fb2c1151800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-18T01:47:08.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.991+0000 7fb2c1151800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-18T01:47:08.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.991+0000 7fb2c1151800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:47:08.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.991+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad169910 con 0x7fb2b803f060 2024-09-18T01:47:08.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.992+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 <== osd.2 v2:172.21.15.146:6800/3820039304 19 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv43 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fb2b0060040 con 0x7fb2b803f060 2024-09-18T01:47:08.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.992+0000 7fb2c1151800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7 : miss 2024-09-18T01:47:08.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.992+0000 7fb2c1151800 20 rados->read ofs=0 len=0 2024-09-18T01:47:08.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.992+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:96 8.6 8:60d0cf6b:root::.bucket.meta.myfoo%3a8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad16bf60 con 0x7fb2b002c060 2024-09-18T01:47:08.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.992+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.0 v2:172.21.15.129:6800/1759265424 24 ==== osd_op_reply(96 .bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fb2b4051070 con 0x7fb2b002c060 2024-09-18T01:47:08.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.992+0000 7fb2c1151800 20 rados_obj.operate() r=0 bl.length=379 2024-09-18T01:47:08.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.992+0000 7fb2c1151800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7 info.flags=0x17 2024-09-18T01:47:08.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.993+0000 7fb2c1151800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7 to cache LRU end 2024-09-18T01:47:08.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.993+0000 7fb2c1151800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:47:08.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.993+0000 7fb2c1151800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-18T01:47:08.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.993+0000 7fb2c1151800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7 2024-09-18T01:47:08.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.993+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:97 4.1d 4:bb2473be:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad1e95e0 con 0x556fad126290 2024-09-18T01:47:08.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.993+0000 7fb2bf446640 1 -- 172.21.15.146:0/3169435660 <== osd.3 v2:172.21.15.146:6809/4106661138 26 ==== osd_op_reply(97 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb2b803c030 con 0x556fad126290 2024-09-18T01:47:08.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.993+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:98 4.1a 4:5a87cd5e:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad1e9620 con 0x7fb2b803f060 2024-09-18T01:47:08.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.993+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 <== osd.2 v2:172.21.15.146:6800/3820039304 20 ==== osd_op_reply(98 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb2b0060040 con 0x7fb2b803f060 2024-09-18T01:47:08.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.993+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:99 4.30 4:0dcfc323:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad1e9620 con 0x556fad126290 2024-09-18T01:47:08.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.993+0000 7fb2bf446640 1 -- 172.21.15.146:0/3169435660 <== osd.3 v2:172.21.15.146:6809/4106661138 27 ==== osd_op_reply(99 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb2b803c030 con 0x556fad126290 2024-09-18T01:47:08.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.994+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:100 4.27 4:e706e298:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad1e9660 con 0x556fad120020 2024-09-18T01:47:08.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.994+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.1 v2:172.21.15.146:6808/3930274777 29 ==== osd_op_reply(100 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb2b4051070 con 0x556fad120020 2024-09-18T01:47:08.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.994+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:101 4.34 4:2e563f38:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad1e9660 con 0x7fb2b803f060 2024-09-18T01:47:08.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.994+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 <== osd.2 v2:172.21.15.146:6800/3820039304 21 ==== osd_op_reply(101 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.4 [call out=425b] v0'0 uv5 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7fb2b0060040 con 0x7fb2b803f060 2024-09-18T01:47:08.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.994+0000 7fb2c1151800 10 cls_bucket_list_unordered: got 15f6f8dc036519d7fe15b39338f6e5db 2024-09-18T01:47:08.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.994+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:102 4.3f 4:fd5463da:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad1e9660 con 0x7fb2b803f060 2024-09-18T01:47:08.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.994+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 <== osd.2 v2:172.21.15.146:6800/3820039304 22 ==== osd_op_reply(102 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.5 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb2b0060040 con 0x7fb2b803f060 2024-09-18T01:47:08.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.995+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:103 4.22 4:47864aee:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad1e9ce0 con 0x556fad120020 2024-09-18T01:47:09.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.995+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.1 v2:172.21.15.146:6808/3930274777 30 ==== osd_op_reply(103 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb2b4051070 con 0x556fad120020 2024-09-18T01:47:09.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.995+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:104 4.3a 4:5ef96a5f:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad1e9ce0 con 0x556fad126290 2024-09-18T01:47:09.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.995+0000 7fb2bf446640 1 -- 172.21.15.146:0/3169435660 <== osd.3 v2:172.21.15.146:6809/4106661138 28 ==== osd_op_reply(104 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.7 [call out=85b] v0'0 uv17 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb2b803c030 con 0x556fad126290 2024-09-18T01:47:09.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.995+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:105 4.31 4:8f7a47c8:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad1e9ce0 con 0x556fad120020 2024-09-18T01:47:09.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.996+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.1 v2:172.21.15.146:6808/3930274777 31 ==== osd_op_reply(105 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.8 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb2b4051070 con 0x556fad120020 2024-09-18T01:47:09.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.996+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:106 4.3e 4:7f2fa82e:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad1e9ce0 con 0x7fb2b803f060 2024-09-18T01:47:09.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.996+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 <== osd.2 v2:172.21.15.146:6800/3820039304 23 ==== osd_op_reply(106 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.9 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb2b0060040 con 0x7fb2b803f060 2024-09-18T01:47:09.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.996+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:107 4.10 4:0ad24565:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad1e9ce0 con 0x556fad126290 2024-09-18T01:47:09.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.996+0000 7fb2bf446640 1 -- 172.21.15.146:0/3169435660 <== osd.3 v2:172.21.15.146:6809/4106661138 29 ==== osd_op_reply(107 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.10 [call out=85b] v0'0 uv11 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb2b803c030 con 0x556fad126290 2024-09-18T01:47:09.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.996+0000 7fb2c1151800 20 get_obj_state: octx=0x7fb2b4053c10 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x556fad1e7858 s->prefetch_data=0 2024-09-18T01:47:09.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.996+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:108 3.9s0 3:92657a7c:::8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7_15f6f8dc036519d7fe15b39338f6e5db:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad1e8740 con 0x556fad126290 2024-09-18T01:47:09.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.997+0000 7fb2bf446640 1 -- 172.21.15.146:0/3169435660 <== osd.3 v2:172.21.15.146:6809/4106661138 30 ==== osd_op_reply(108 8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7_15f6f8dc036519d7fe15b39338f6e5db [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7fb2b803c030 con 0x556fad126290 2024-09-18T01:47:09.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.997+0000 7fb2c1151800 10 manifest: total_size = 6 2024-09-18T01:47:09.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.997+0000 7fb2c1151800 20 get_obj_state: setting s->obj_tag to 8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.6904022238714947804 2024-09-18T01:47:09.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.997+0000 7fb2c1151800 20 get_obj_state: octx=0x7fb2b4053c10 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x556fad1e7858 s->prefetch_data=0 2024-09-18T01:47:09.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.997+0000 7fb2c1151800 20 prepare_atomic_modification: state is not atomic. state=0x556fad1e7858 2024-09-18T01:47:09.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.997+0000 7fb2c1151800 20 bucket index object: :.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.4 2024-09-18T01:47:09.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.997+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:109 4.34 4:2e563f38:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad1e90c0 con 0x7fb2b803f060 2024-09-18T01:47:09.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.998+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 <== osd.2 v2:172.21.15.146:6800/3820039304 24 ==== osd_op_reply(109 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.4 [stat,call,call] v33'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fb2b0060040 con 0x7fb2b803f060 2024-09-18T01:47:09.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.998+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:110 3.9s0 3:92657a7c:::8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7_15f6f8dc036519d7fe15b39338f6e5db:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad1e90c0 con 0x556fad126290 2024-09-18T01:47:09.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.999+0000 7fb2bf446640 1 -- 172.21.15.146:0/3169435660 <== osd.3 v2:172.21.15.146:6809/4106661138 31 ==== osd_op_reply(110 8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7_15f6f8dc036519d7fe15b39338f6e5db [call] v33'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fb2b803c030 con 0x556fad126290 2024-09-18T01:47:09.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.999+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:111 4.34 4:2e563f38:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad170d10 con 0x7fb2b803f060 2024-09-18T01:47:09.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.999+0000 7fb2c1151800 20 list_objects_ordered: starting attempt 1 2024-09-18T01:47:09.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.999+0000 7fb2c1151800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-18T01:47:09.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.999+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:112 4.1d 4:bb2473be:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad170d10 con 0x556fad126290 2024-09-18T01:47:09.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.999+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:113 4.1a 4:5a87cd5e:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad170d10 con 0x7fb2b803f060 2024-09-18T01:47:09.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.999+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:114 4.30 4:0dcfc323:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad1773f0 con 0x556fad126290 2024-09-18T01:47:09.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.999+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:115 4.27 4:e706e298:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad179ea0 con 0x556fad120020 2024-09-18T01:47:09.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.999+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:116 4.34 4:2e563f38:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad170d10 con 0x7fb2b803f060 2024-09-18T01:47:09.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.999+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:117 4.3f 4:fd5463da:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad17ecd0 con 0x7fb2b803f060 2024-09-18T01:47:09.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:08.999+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:118 4.22 4:47864aee:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad181ac0 con 0x556fad120020 2024-09-18T01:47:09.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.000+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:119 4.3a 4:5ef96a5f:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad184440 con 0x556fad126290 2024-09-18T01:47:09.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.000+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:120 4.31 4:8f7a47c8:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad1872c0 con 0x556fad120020 2024-09-18T01:47:09.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.000+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:121 4.3e 4:7f2fa82e:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad189cd0 con 0x7fb2b803f060 2024-09-18T01:47:09.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.000+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:122 4.10 4:0ad24565:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad18cb30 con 0x556fad126290 2024-09-18T01:47:09.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.000+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.1 v2:172.21.15.146:6808/3930274777 32 ==== osd_op_reply(115 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb2b4051070 con 0x556fad120020 2024-09-18T01:47:09.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.000+0000 7fb2bf446640 1 -- 172.21.15.146:0/3169435660 <== osd.3 v2:172.21.15.146:6809/4106661138 32 ==== osd_op_reply(112 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb2b803c030 con 0x556fad126290 2024-09-18T01:47:09.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.000+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 <== osd.2 v2:172.21.15.146:6800/3820039304 25 ==== osd_op_reply(113 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb2b0060040 con 0x7fb2b803f060 2024-09-18T01:47:09.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.000+0000 7fb2bf446640 1 -- 172.21.15.146:0/3169435660 <== osd.3 v2:172.21.15.146:6809/4106661138 33 ==== osd_op_reply(114 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb2b803c030 con 0x556fad126290 2024-09-18T01:47:09.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.000+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.1 v2:172.21.15.146:6808/3930274777 33 ==== osd_op_reply(118 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb2b4051070 con 0x556fad120020 2024-09-18T01:47:09.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.000+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.1 v2:172.21.15.146:6808/3930274777 34 ==== osd_op_reply(120 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.8 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb2b4051070 con 0x556fad120020 2024-09-18T01:47:09.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.000+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 <== osd.2 v2:172.21.15.146:6800/3820039304 26 ==== osd_op_reply(111 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.4 [stat,call,call] v33'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fb2b0060040 con 0x7fb2b803f060 2024-09-18T01:47:09.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.001+0000 7fb2bf446640 1 -- 172.21.15.146:0/3169435660 <== osd.3 v2:172.21.15.146:6809/4106661138 34 ==== osd_op_reply(122 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.10 [call out=85b] v0'0 uv11 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb2b803c030 con 0x556fad126290 2024-09-18T01:47:09.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.001+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 <== osd.2 v2:172.21.15.146:6800/3820039304 27 ==== osd_op_reply(117 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.5 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb2b0060040 con 0x7fb2b803f060 2024-09-18T01:47:09.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.001+0000 7fb2bf446640 1 -- 172.21.15.146:0/3169435660 <== osd.3 v2:172.21.15.146:6809/4106661138 35 ==== osd_op_reply(119 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.7 [call out=85b] v0'0 uv17 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb2b803c030 con 0x556fad126290 2024-09-18T01:47:09.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.001+0000 7fb1a1ffb640 20 handle_completion(): completion ok for obj=15f6f8dc036519d7fe15b39338f6e5db 2024-09-18T01:47:09.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.001+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 <== osd.2 v2:172.21.15.146:6800/3820039304 28 ==== osd_op_reply(121 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.9 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb2b0060040 con 0x7fb2b803f060 2024-09-18T01:47:09.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.001+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 <== osd.2 v2:172.21.15.146:6800/3820039304 29 ==== osd_op_reply(116 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.4 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fb2b0060040 con 0x7fb2b803f060 2024-09-18T01:47:09.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.001+0000 7fb2c1151800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-18T01:47:09.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.001+0000 7fb2c1151800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-18T01:47:09.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.001+0000 7fb2c1151800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-18T01:47:09.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.001+0000 7fb2c1151800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-18T01:47:09.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.001+0000 7fb2c1151800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7])"; uploads.size()=0; is_truncated=0 2024-09-18T01:47:09.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.001+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:123 4.1d 4:bb2473be:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad187320 con 0x556fad126290 2024-09-18T01:47:09.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.001+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:124 4.1a 4:5a87cd5e:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad189cd0 con 0x7fb2b803f060 2024-09-18T01:47:09.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.001+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:125 4.30 4:0dcfc323:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad187320 con 0x556fad126290 2024-09-18T01:47:09.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.001+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:126 4.27 4:e706e298:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad170c70 con 0x556fad120020 2024-09-18T01:47:09.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.001+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:127 4.34 4:2e563f38:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad187320 con 0x7fb2b803f060 2024-09-18T01:47:09.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.001+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:128 4.3f 4:fd5463da:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad170c70 con 0x7fb2b803f060 2024-09-18T01:47:09.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.001+0000 7fb2bf446640 1 -- 172.21.15.146:0/3169435660 <== osd.3 v2:172.21.15.146:6809/4106661138 36 ==== osd_op_reply(123 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb2b803c030 con 0x556fad126290 2024-09-18T01:47:09.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.001+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:129 4.22 4:47864aee:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad170c70 con 0x556fad120020 2024-09-18T01:47:09.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.001+0000 7fb2bf446640 1 -- 172.21.15.146:0/3169435660 <== osd.3 v2:172.21.15.146:6809/4106661138 37 ==== osd_op_reply(125 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb2b803c030 con 0x556fad126290 2024-09-18T01:47:09.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.001+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:130 4.3a 4:5ef96a5f:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad187320 con 0x556fad126290 2024-09-18T01:47:09.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.001+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.1 v2:172.21.15.146:6808/3930274777 35 ==== osd_op_reply(126 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb2b4051070 con 0x556fad120020 2024-09-18T01:47:09.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.001+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 <== osd.2 v2:172.21.15.146:6800/3820039304 30 ==== osd_op_reply(124 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb2b0060040 con 0x7fb2b803f060 2024-09-18T01:47:09.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.001+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 <== osd.2 v2:172.21.15.146:6800/3820039304 31 ==== osd_op_reply(127 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.4 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fb2b0060040 con 0x7fb2b803f060 2024-09-18T01:47:09.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.001+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:131 4.31 4:8f7a47c8:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad187320 con 0x556fad120020 2024-09-18T01:47:09.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.001+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:132 4.3e 4:7f2fa82e:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad170c70 con 0x7fb2b803f060 2024-09-18T01:47:09.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.001+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:133 4.10 4:0ad24565:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad170c70 con 0x556fad126290 2024-09-18T01:47:09.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.002+0000 7fb2bf446640 1 -- 172.21.15.146:0/3169435660 <== osd.3 v2:172.21.15.146:6809/4106661138 38 ==== osd_op_reply(130 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.7 [call out=85b] v0'0 uv17 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb2b803c030 con 0x556fad126290 2024-09-18T01:47:09.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.002+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 <== osd.2 v2:172.21.15.146:6800/3820039304 32 ==== osd_op_reply(128 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.5 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb2b0060040 con 0x7fb2b803f060 2024-09-18T01:47:09.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.002+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.1 v2:172.21.15.146:6808/3930274777 36 ==== osd_op_reply(129 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb2b4051070 con 0x556fad120020 2024-09-18T01:47:09.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.002+0000 7fb2bf446640 1 -- 172.21.15.146:0/3169435660 <== osd.3 v2:172.21.15.146:6809/4106661138 39 ==== osd_op_reply(133 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.10 [call out=85b] v0'0 uv11 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb2b803c030 con 0x556fad126290 2024-09-18T01:47:09.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.002+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 <== osd.2 v2:172.21.15.146:6800/3820039304 33 ==== osd_op_reply(132 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.9 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb2b0060040 con 0x7fb2b803f060 2024-09-18T01:47:09.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.002+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.1 v2:172.21.15.146:6808/3930274777 37 ==== osd_op_reply(131 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.8 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb2b4051070 con 0x556fad120020 2024-09-18T01:47:09.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.002+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:134 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad189cd0 con 0x7fb2b803f060 2024-09-18T01:47:09.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.003+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 <== osd.2 v2:172.21.15.146:6800/3820039304 34 ==== osd_op_reply(134 foo.buckets [call] v33'46 uv46 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb2b0060040 con 0x7fb2b803f060 2024-09-18T01:47:09.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.003+0000 7fb2c1151800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-18T01:47:09.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.003+0000 7fb2c1151800 20 rados->read ofs=0 len=0 2024-09-18T01:47:09.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.003+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:135 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad186af0 con 0x7fb2b803f060 2024-09-18T01:47:09.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.004+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 <== osd.2 v2:172.21.15.146:6800/3820039304 35 ==== osd_op_reply(135 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv40 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fb2b0060040 con 0x7fb2b803f060 2024-09-18T01:47:09.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.004+0000 7fb2c1151800 20 rados_obj.operate() r=0 bl.length=165 2024-09-18T01:47:09.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.004+0000 7fb2c1151800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-18T01:47:09.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.004+0000 7fb2c1151800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-18T01:47:09.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.004+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:136 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad186af0 con 0x7fb2b803f060 2024-09-18T01:47:09.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.005+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 <== osd.2 v2:172.21.15.146:6800/3820039304 36 ==== osd_op_reply(136 myfoo [call,call,delete] v33'47 uv47 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7fb2b0060040 con 0x7fb2b803f060 2024-09-18T01:47:09.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.005+0000 7fb2c1151800 10 removing default.rgw.meta+root+myfoo from cache 2024-09-18T01:47:09.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.005+0000 7fb2c1151800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-18T01:47:09.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.005+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:137 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93938133767408 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad1707c0 con 0x7fb2b002c060 2024-09-18T01:47:09.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.005+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.0 v2:172.21.15.129:6800/1759265424 25 ==== watch-notify(notify (1) cookie 93938133434416 notify 141733920809 ret 0) ==== 191+0+0 (crc 0 0 0) 0x556fad16b560 con 0x7fb2b002c060 2024-09-18T01:47:09.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.005+0000 7fb1a1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920809 cookie 93938133434416 notifier 4789 bl.length()=149 2024-09-18T01:47:09.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.005+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.0 v2:172.21.15.129:6800/1759265424 26 ==== osd_op_reply(137 notify.6 [notify cookie 93938133767408 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb2b4051070 con 0x7fb2b002c060 2024-09-18T01:47:09.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.005+0000 7fb1a1ffb640 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:138 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fb0f40032c0 con 0x7fb2b002c060 2024-09-18T01:47:09.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.006+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.0 v2:172.21.15.129:6800/1759265424 27 ==== osd_op_reply(138 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2b4051070 con 0x7fb2b002c060 2024-09-18T01:47:09.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.006+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.0 v2:172.21.15.129:6800/1759265424 28 ==== watch-notify(notify_complete (2) cookie 93938133767408 notify 141733920809 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556fad117770 con 0x7fb2b002c060 2024-09-18T01:47:09.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.006+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:139 8.6 8:60d0cf6b:root::.bucket.meta.myfoo%3a8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad186af0 con 0x7fb2b002c060 2024-09-18T01:47:09.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.007+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.0 v2:172.21.15.129:6800/1759265424 29 ==== osd_op_reply(139 .bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7 [call,call,delete] v33'2 uv2 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7fb2b4051070 con 0x7fb2b002c060 2024-09-18T01:47:09.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.007+0000 7fb2c1151800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7 from cache 2024-09-18T01:47:09.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.007+0000 7fb2c1151800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7, ofs0, ns] 2024-09-18T01:47:09.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.007+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:140 7.3 7:c609908c:::notify.5:head [notify cookie 93938133767408 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad16b830 con 0x7fb2b002c060 2024-09-18T01:47:09.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.007+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.0 v2:172.21.15.129:6800/1759265424 30 ==== watch-notify(notify (1) cookie 93938133433360 notify 141733920810 ret 0) ==== 248+0+0 (crc 0 0 0) 0x556fad117770 con 0x7fb2b002c060 2024-09-18T01:47:09.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.007+0000 7fb1a27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920810 cookie 93938133433360 notifier 4789 bl.length()=206 2024-09-18T01:47:09.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.007+0000 7fb1a27fc640 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:141 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fb184003d60 con 0x7fb2b002c060 2024-09-18T01:47:09.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.007+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.0 v2:172.21.15.129:6800/1759265424 31 ==== osd_op_reply(140 notify.5 [notify cookie 93938133767408 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb2b4051070 con 0x7fb2b002c060 2024-09-18T01:47:09.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.007+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.0 v2:172.21.15.129:6800/1759265424 32 ==== osd_op_reply(141 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2b4051070 con 0x7fb2b002c060 2024-09-18T01:47:09.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.008+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.0 v2:172.21.15.129:6800/1759265424 33 ==== watch-notify(notify_complete (2) cookie 93938133767408 notify 141733920810 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556fad13d8d0 con 0x7fb2b002c060 2024-09-18T01:47:09.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.008+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:142 4.1d 4:bb2473be:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad1814c0 con 0x556fad126290 2024-09-18T01:47:09.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.008+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:143 4.1a 4:5a87cd5e:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad1707c0 con 0x7fb2b803f060 2024-09-18T01:47:09.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.008+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:144 4.30 4:0dcfc323:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad16a3f0 con 0x556fad126290 2024-09-18T01:47:09.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.008+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:145 4.27 4:e706e298:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad16acc0 con 0x556fad120020 2024-09-18T01:47:09.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.008+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:146 4.34 4:2e563f38:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad16a3f0 con 0x7fb2b803f060 2024-09-18T01:47:09.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.008+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:147 4.3f 4:fd5463da:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad1707c0 con 0x7fb2b803f060 2024-09-18T01:47:09.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.008+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:148 4.22 4:47864aee:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad16acc0 con 0x556fad120020 2024-09-18T01:47:09.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.008+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:149 4.3a 4:5ef96a5f:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad16a3f0 con 0x556fad126290 2024-09-18T01:47:09.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.008+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:150 4.31 4:8f7a47c8:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad1707c0 con 0x556fad120020 2024-09-18T01:47:09.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.008+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:151 4.3e 4:7f2fa82e:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad185260 con 0x7fb2b803f060 2024-09-18T01:47:09.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.008+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:152 4.10 4:0ad24565:::.dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad180790 con 0x556fad126290 2024-09-18T01:47:09.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.009+0000 7fb2bf446640 1 -- 172.21.15.146:0/3169435660 <== osd.3 v2:172.21.15.146:6809/4106661138 40 ==== osd_op_reply(142 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.0 [delete] v33'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb2b803c030 con 0x556fad126290 2024-09-18T01:47:09.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.010+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 <== osd.2 v2:172.21.15.146:6800/3820039304 37 ==== osd_op_reply(143 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.1 [delete] v33'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb2b0060040 con 0x7fb2b803f060 2024-09-18T01:47:09.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.010+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 <== osd.2 v2:172.21.15.146:6800/3820039304 38 ==== osd_op_reply(147 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.5 [delete] v33'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb2b0060040 con 0x7fb2b803f060 2024-09-18T01:47:09.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.010+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.1 v2:172.21.15.146:6808/3930274777 38 ==== osd_op_reply(148 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.6 [delete] v33'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb2b4051070 con 0x556fad120020 2024-09-18T01:47:09.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.010+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 <== osd.2 v2:172.21.15.146:6800/3820039304 39 ==== osd_op_reply(146 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.4 [delete] v33'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb2b0060040 con 0x7fb2b803f060 2024-09-18T01:47:09.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.010+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 <== osd.2 v2:172.21.15.146:6800/3820039304 40 ==== osd_op_reply(151 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.9 [delete] v33'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb2b0060040 con 0x7fb2b803f060 2024-09-18T01:47:09.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.010+0000 7fb2bf446640 1 -- 172.21.15.146:0/3169435660 <== osd.3 v2:172.21.15.146:6809/4106661138 41 ==== osd_op_reply(149 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.7 [delete] v33'18 uv18 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb2b803c030 con 0x556fad126290 2024-09-18T01:47:09.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.010+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.1 v2:172.21.15.146:6808/3930274777 39 ==== osd_op_reply(145 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.3 [delete] v33'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb2b4051070 con 0x556fad120020 2024-09-18T01:47:09.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.010+0000 7fb2bf446640 1 -- 172.21.15.146:0/3169435660 <== osd.3 v2:172.21.15.146:6809/4106661138 42 ==== osd_op_reply(152 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.10 [delete] v33'14 uv14 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fb2b803c030 con 0x556fad126290 2024-09-18T01:47:09.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.010+0000 7fb2bf446640 1 -- 172.21.15.146:0/3169435660 <== osd.3 v2:172.21.15.146:6809/4106661138 43 ==== osd_op_reply(144 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.2 [delete] v33'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb2b803c030 con 0x556fad126290 2024-09-18T01:47:09.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.010+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.1 v2:172.21.15.146:6808/3930274777 40 ==== osd_op_reply(150 .dir.8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7.8 [delete] v33'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb2b4051070 con 0x556fad120020 2024-09-18T01:47:09.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.010+0000 7fb2c1151800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7 : miss 2024-09-18T01:47:09.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.010+0000 7fb2c1151800 20 rados->read ofs=0 len=0 2024-09-18T01:47:09.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.011+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:153 6.f 6:f5b71ea3:::pubsub..bucket.myfoo%2f8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad16b7e0 con 0x7fb2b803f060 2024-09-18T01:47:09.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.011+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 <== osd.2 v2:172.21.15.146:6800/3820039304 41 ==== osd_op_reply(153 pubsub..bucket.myfoo/8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fb2b0060040 con 0x7fb2b803f060 2024-09-18T01:47:09.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.011+0000 7fb2c1151800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:09.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.011+0000 7fb2c1151800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7 info.flags=0x0 2024-09-18T01:47:09.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.011+0000 7fb2c1151800 10 adding default.rgw.log++pubsub..bucket.myfoo/8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7 to cache LRU end 2024-09-18T01:47:09.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.011+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:154 6.f 6:f5b71ea3:::pubsub..bucket.myfoo%2f8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad16b7e0 con 0x7fb2b803f060 2024-09-18T01:47:09.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.012+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 <== osd.2 v2:172.21.15.146:6800/3820039304 42 ==== osd_op_reply(154 pubsub..bucket.myfoo/8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.7 [delete] v33'35 uv27 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fb2b0060040 con 0x7fb2b803f060 2024-09-18T01:47:09.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.012+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:155 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad16b7e0 con 0x7fb2b803f060 2024-09-18T01:47:09.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.013+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 <== osd.2 v2:172.21.15.146:6800/3820039304 43 ==== osd_op_reply(155 foo.buckets [call] v33'48 uv48 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb2b0060040 con 0x7fb2b803f060 2024-09-18T01:47:09.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.013+0000 7fb2c1151800 10 removing key index: 9te6NH5mcdcq0Tc5i8i1 2024-09-18T01:47:09.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.013+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:156 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad16b730 con 0x7fb2b002c060 2024-09-18T01:47:09.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.014+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.0 v2:172.21.15.129:6800/1759265424 34 ==== osd_op_reply(156 9te6NH5mcdcq0Tc5i8i1 [delete] v33'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fb2b4051070 con 0x7fb2b002c060 2024-09-18T01:47:09.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.014+0000 7fb2c1151800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-18T01:47:09.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.014+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:157 7.e 7:7759931f:::notify.3:head [notify cookie 93938133767360 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad180c20 con 0x7fb2b803f060 2024-09-18T01:47:09.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.015+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 <== osd.2 v2:172.21.15.146:6800/3820039304 44 ==== watch-notify(notify (1) cookie 93938133425952 notify 141733920797 ret 0) ==== 212+0+0 (crc 0 0 0) 0x556fad133890 con 0x7fb2b803f060 2024-09-18T01:47:09.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.015+0000 7fb1a27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920797 cookie 93938133425952 notifier 4789 bl.length()=170 2024-09-18T01:47:09.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.015+0000 7fb1a27fc640 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:158 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fb184003d60 con 0x7fb2b803f060 2024-09-18T01:47:09.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.015+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 <== osd.2 v2:172.21.15.146:6800/3820039304 45 ==== osd_op_reply(157 notify.3 [notify cookie 93938133767360 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb2b0060040 con 0x7fb2b803f060 2024-09-18T01:47:09.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.015+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 <== osd.2 v2:172.21.15.146:6800/3820039304 46 ==== osd_op_reply(158 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2b0060040 con 0x7fb2b803f060 2024-09-18T01:47:09.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.015+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 <== osd.2 v2:172.21.15.146:6800/3820039304 47 ==== watch-notify(notify_complete (2) cookie 93938133767360 notify 141733920797 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fb2b0052040 con 0x7fb2b803f060 2024-09-18T01:47:09.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.015+0000 7fb2c1151800 10 removing email index: foo@foo.com 2024-09-18T01:47:09.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.015+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:159 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad16b730 con 0x556fad120020 2024-09-18T01:47:09.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.016+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.1 v2:172.21.15.146:6808/3930274777 41 ==== osd_op_reply(159 foo@foo.com [delete] v33'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb2b4051070 con 0x556fad120020 2024-09-18T01:47:09.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.016+0000 7fb2c1151800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-18T01:47:09.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.016+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:160 7.e 7:7759931f:::notify.3:head [notify cookie 93938133767360 in=174b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad180c20 con 0x7fb2b803f060 2024-09-18T01:47:09.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.016+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 <== osd.2 v2:172.21.15.146:6800/3820039304 48 ==== watch-notify(notify (1) cookie 93938133425952 notify 141733920798 ret 0) ==== 204+0+0 (crc 0 0 0) 0x7fb2b0052040 con 0x7fb2b803f060 2024-09-18T01:47:09.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.016+0000 7fb1a1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920798 cookie 93938133425952 notifier 4789 bl.length()=162 2024-09-18T01:47:09.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.016+0000 7fb1a1ffb640 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:161 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fb0f40032c0 con 0x7fb2b803f060 2024-09-18T01:47:09.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.016+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 <== osd.2 v2:172.21.15.146:6800/3820039304 49 ==== osd_op_reply(160 notify.3 [notify cookie 93938133767360 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb2b0060040 con 0x7fb2b803f060 2024-09-18T01:47:09.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.017+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 <== osd.2 v2:172.21.15.146:6800/3820039304 50 ==== osd_op_reply(161 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2b0060040 con 0x7fb2b803f060 2024-09-18T01:47:09.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.017+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 <== osd.2 v2:172.21.15.146:6800/3820039304 51 ==== watch-notify(notify_complete (2) cookie 93938133767360 notify 141733920798 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556fad0e3d00 con 0x7fb2b803f060 2024-09-18T01:47:09.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.017+0000 7fb2c1151800 10 removing user buckets index 2024-09-18T01:47:09.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.017+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:162 8.9 8:96d98480:users.uid::foo.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad16b730 con 0x7fb2b803f060 2024-09-18T01:47:09.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.018+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 <== osd.2 v2:172.21.15.146:6800/3820039304 52 ==== osd_op_reply(162 foo.buckets [delete] v33'49 uv49 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb2b0060040 con 0x7fb2b803f060 2024-09-18T01:47:09.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.018+0000 7fb2c1151800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:foo.buckets, ofs0, ns] 2024-09-18T01:47:09.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.018+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 93938133767360 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad180c20 con 0x7fb2b002c060 2024-09-18T01:47:09.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.018+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.0 v2:172.21.15.129:6800/1759265424 35 ==== watch-notify(notify (1) cookie 93938133433360 notify 141733920811 ret 0) ==== 202+0+0 (crc 0 0 0) 0x556fad13d8d0 con 0x7fb2b002c060 2024-09-18T01:47:09.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.018+0000 7fb1a27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920811 cookie 93938133433360 notifier 4789 bl.length()=160 2024-09-18T01:47:09.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.018+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.0 v2:172.21.15.129:6800/1759265424 36 ==== osd_op_reply(163 notify.5 [notify cookie 93938133767360 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb2b4051070 con 0x7fb2b002c060 2024-09-18T01:47:09.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.018+0000 7fb1a27fc640 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fb184003d60 con 0x7fb2b002c060 2024-09-18T01:47:09.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.019+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.0 v2:172.21.15.129:6800/1759265424 37 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2b4051070 con 0x7fb2b002c060 2024-09-18T01:47:09.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.019+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.0 v2:172.21.15.129:6800/1759265424 38 ==== watch-notify(notify_complete (2) cookie 93938133767360 notify 141733920811 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556fad1336c0 con 0x7fb2b002c060 2024-09-18T01:47:09.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.019+0000 7fb2c1151800 10 removing user index: foo 2024-09-18T01:47:09.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.019+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:165 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad186a90 con 0x556fad120020 2024-09-18T01:47:09.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.020+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.1 v2:172.21.15.146:6808/3930274777 42 ==== osd_op_reply(165 foo [call,call,delete] v33'19 uv19 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fb2b4051070 con 0x556fad120020 2024-09-18T01:47:09.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.020+0000 7fb2c1151800 10 removing default.rgw.meta+users.uid+foo from cache 2024-09-18T01:47:09.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.020+0000 7fb2c1151800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-18T01:47:09.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.020+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:166 7.d 7:b4812045:::notify.4:head [notify cookie 93938133767360 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556fad180c20 con 0x556fad120020 2024-09-18T01:47:09.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.020+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.1 v2:172.21.15.146:6808/3930274777 43 ==== watch-notify(notify (1) cookie 93938133429376 notify 141733920790 ret 0) ==== 194+0+0 (crc 0 0 0) 0x556fad1336c0 con 0x556fad120020 2024-09-18T01:47:09.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.020+0000 7fb1a1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920790 cookie 93938133429376 notifier 4789 bl.length()=152 2024-09-18T01:47:09.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.020+0000 7fb1a1ffb640 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:167 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fb0f40032c0 con 0x556fad120020 2024-09-18T01:47:09.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.020+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.1 v2:172.21.15.146:6808/3930274777 44 ==== osd_op_reply(166 notify.4 [notify cookie 93938133767360 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb2b4051070 con 0x556fad120020 2024-09-18T01:47:09.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.020+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.1 v2:172.21.15.146:6808/3930274777 45 ==== watch-notify(notify_complete (2) cookie 93938133767360 notify 141733920790 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556fad133fb0 con 0x556fad120020 2024-09-18T01:47:09.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.020+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.1 v2:172.21.15.146:6808/3930274777 46 ==== osd_op_reply(167 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2b4051070 con 0x556fad120020 2024-09-18T01:47:09.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.021+0000 7fb1757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:47:09.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.021+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:168 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93938133437648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad139760 con 0x556fad120020 2024-09-18T01:47:09.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.022+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.1 v2:172.21.15.146:6808/3930274777 47 ==== osd_op_reply(168 data_loggenerations_metadata [watch unwatch cookie 93938133437648] v33'242 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb2b4051070 con 0x556fad120020 2024-09-18T01:47:09.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.022+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:169 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93938133412832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad139760 con 0x7fb2b803f060 2024-09-18T01:47:09.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.023+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 <== osd.2 v2:172.21.15.146:6800/3820039304 53 ==== osd_op_reply(169 notify.0 [watch unwatch cookie 93938133412832] v33'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2b0060040 con 0x7fb2b803f060 2024-09-18T01:47:09.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.023+0000 7fb2c1151800 20 remove_watcher() i=0 2024-09-18T01:47:09.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.023+0000 7fb2c1151800 2 removed watcher, disabling cache 2024-09-18T01:47:09.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.023+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:170 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93938133418624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad139760 con 0x556fad120020 2024-09-18T01:47:09.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.025+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.1 v2:172.21.15.146:6808/3930274777 48 ==== osd_op_reply(170 notify.1 [watch unwatch cookie 93938133418624] v33'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2b4051070 con 0x556fad120020 2024-09-18T01:47:09.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.025+0000 7fb2c1151800 20 remove_watcher() i=1 2024-09-18T01:47:09.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.025+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:171 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93938133419680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad139760 con 0x556fad126290 2024-09-18T01:47:09.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.026+0000 7fb2bf446640 1 -- 172.21.15.146:0/3169435660 <== osd.3 v2:172.21.15.146:6809/4106661138 44 ==== osd_op_reply(171 notify.2 [watch unwatch cookie 93938133419680] v33'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2b803c030 con 0x556fad126290 2024-09-18T01:47:09.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.026+0000 7fb2c1151800 20 remove_watcher() i=2 2024-09-18T01:47:09.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.026+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:172 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93938133425952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad139760 con 0x7fb2b803f060 2024-09-18T01:47:09.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.027+0000 7fb2bec45640 1 -- 172.21.15.146:0/3169435660 <== osd.2 v2:172.21.15.146:6800/3820039304 54 ==== osd_op_reply(172 notify.3 [watch unwatch cookie 93938133425952] v33'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2b0060040 con 0x7fb2b803f060 2024-09-18T01:47:09.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.027+0000 7fb2c1151800 20 remove_watcher() i=3 2024-09-18T01:47:09.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.027+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:173 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93938133429376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad139760 con 0x556fad120020 2024-09-18T01:47:09.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.028+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.1 v2:172.21.15.146:6808/3930274777 49 ==== osd_op_reply(173 notify.4 [watch unwatch cookie 93938133429376] v33'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2b4051070 con 0x556fad120020 2024-09-18T01:47:09.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.028+0000 7fb2c1151800 20 remove_watcher() i=4 2024-09-18T01:47:09.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.028+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:174 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93938133433360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad139760 con 0x7fb2b002c060 2024-09-18T01:47:09.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.029+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.0 v2:172.21.15.129:6800/1759265424 39 ==== osd_op_reply(174 notify.5 [watch unwatch cookie 93938133433360] v33'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2b4051070 con 0x7fb2b002c060 2024-09-18T01:47:09.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.029+0000 7fb2c1151800 20 remove_watcher() i=5 2024-09-18T01:47:09.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.029+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:175 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93938133434416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad139760 con 0x7fb2b002c060 2024-09-18T01:47:09.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.030+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.0 v2:172.21.15.129:6800/1759265424 40 ==== osd_op_reply(175 notify.6 [watch unwatch cookie 93938133434416] v33'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2b4051070 con 0x7fb2b002c060 2024-09-18T01:47:09.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.030+0000 7fb2c1151800 20 remove_watcher() i=6 2024-09-18T01:47:09.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.030+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:176 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93938133430608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556fad139760 con 0x7fb2b002c060 2024-09-18T01:47:09.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.031+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 <== osd.0 v2:172.21.15.129:6800/1759265424 41 ==== osd_op_reply(176 notify.7 [watch unwatch cookie 93938133430608] v33'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2b4051070 con 0x7fb2b002c060 2024-09-18T01:47:09.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.031+0000 7fb2c1151800 20 remove_watcher() i=7 2024-09-18T01:47:09.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.031+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fb2b002c060 msgr2=0x7fb2b000caa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.031+0000 7fb2c1151800 1 --2- 172.21.15.146:0/3169435660 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fb2b002c060 0x7fb2b000caa0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.032+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x556fad120020 msgr2=0x556fad1224e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.032+0000 7fb2c1151800 1 --2- 172.21.15.146:0/3169435660 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x556fad120020 0x556fad1224e0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.032+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fb2b803f060 msgr2=0x7fb2b803e9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.032+0000 7fb2c1151800 1 --2- 172.21.15.146:0/3169435660 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fb2b803f060 0x7fb2b803e9f0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.032+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x556fad126290 msgr2=0x556fad128680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.032+0000 7fb2c1151800 1 --2- 172.21.15.146:0/3169435660 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x556fad126290 0x556fad128680 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.032+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb188036b40 msgr2=0x7fb188039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.032+0000 7fb2c1151800 1 --2- 172.21.15.146:0/3169435660 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb188036b40 0x7fb188039000 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb2b002af70 tx=0x7fb2b0033000 comp rx=0 tx=0).stop 2024-09-18T01:47:09.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.032+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556fad10cef0 msgr2=0x556fad1142f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.032+0000 7fb2be444640 1 -- 172.21.15.146:0/3169435660 reap_dead start 2024-09-18T01:47:09.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.032+0000 7fb2c1151800 1 --2- 172.21.15.146:0/3169435660 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556fad10cef0 0x556fad1142f0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8043040 tx=0x7fb2b804c880 comp rx=0 tx=0).stop 2024-09-18T01:47:09.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.032+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 shutdown_connections 2024-09-18T01:47:09.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.032+0000 7fb2c1151800 1 --2- 172.21.15.146:0/3169435660 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556fad10cef0 0x556fad1142f0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.032+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 >> 172.21.15.146:0/3169435660 conn(0x556fad1092a0 msgr2=0x556fad10e600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:09.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.032+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 shutdown_connections 2024-09-18T01:47:09.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.032+0000 7fb2c1151800 1 -- 172.21.15.146:0/3169435660 wait complete. 2024-09-18T01:47:09.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.032+0000 7fb2c1151800 1 -- 172.21.15.146:0/1378153563 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb198036b40 msgr2=0x7fb198039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.032+0000 7fb2c1151800 1 --2- 172.21.15.146:0/1378153563 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb198036b40 0x7fb198039000 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb2b0016fd0 tx=0x7fb2b004ad80 comp rx=0 tx=0).stop 2024-09-18T01:47:09.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.032+0000 7fb2c1151800 1 -- 172.21.15.146:0/1378153563 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556facfecb10 msgr2=0x556facfeb160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.032+0000 7fb2c1151800 1 --2- 172.21.15.146:0/1378153563 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556facfecb10 0x556facfeb160 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x556fad0eaca0 tx=0x7fb2b80178e0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.032+0000 7fb2c1151800 1 -- 172.21.15.146:0/1378153563 shutdown_connections 2024-09-18T01:47:09.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.032+0000 7fb2c1151800 1 --2- 172.21.15.146:0/1378153563 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb198036b40 0x7fb198039000 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.032+0000 7fb2c1151800 1 --2- 172.21.15.146:0/1378153563 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556facfecb10 0x556facfeb160 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.032+0000 7fb2c1151800 1 -- 172.21.15.146:0/1378153563 >> 172.21.15.146:0/1378153563 conn(0x556fad0f2fe0 msgr2=0x556fad0f5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:09.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.032+0000 7fb2c1151800 1 -- 172.21.15.146:0/1378153563 shutdown_connections 2024-09-18T01:47:09.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.032+0000 7fb2c1151800 1 -- 172.21.15.146:0/1378153563 wait complete. 2024-09-18T01:47:09.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.033+0000 7fb2c1151800 1 -- 172.21.15.146:0/3243136361 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x556facff0880 msgr2=0x556fad0ea310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.033+0000 7fb2c1151800 1 --2- 172.21.15.146:0/3243136361 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x556facff0880 0x556fad0ea310 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.033+0000 7fb2c1151800 1 -- 172.21.15.146:0/3243136361 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x556fad0ec2f0 msgr2=0x556fad0efb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.033+0000 7fb2c1151800 1 --2- 172.21.15.146:0/3243136361 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x556fad0ec2f0 0x556fad0efb30 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.033+0000 7fb2c1151800 1 -- 172.21.15.146:0/3243136361 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb1a4036b40 msgr2=0x7fb1a4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.033+0000 7fb2c1151800 1 --2- 172.21.15.146:0/3243136361 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb1a4036b40 0x7fb1a4039000 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4057000 tx=0x7fb2b4052000 comp rx=0 tx=0).stop 2024-09-18T01:47:09.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.033+0000 7fb2c1151800 1 -- 172.21.15.146:0/3243136361 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556facf606d0 msgr2=0x556fad0e32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.033+0000 7fb2c1151800 1 --2- 172.21.15.146:0/3243136361 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556facf606d0 0x556fad0e32a0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fb2b0004000 tx=0x7fb2b0000bc0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.033+0000 7fb2c1151800 1 -- 172.21.15.146:0/3243136361 shutdown_connections 2024-09-18T01:47:09.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.033+0000 7fb2c1151800 1 --2- 172.21.15.146:0/3243136361 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x556fad0ec2f0 0x556fad0efb30 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.033+0000 7fb2c1151800 1 --2- 172.21.15.146:0/3243136361 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x556facff0880 0x556fad0ea310 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.033+0000 7fb2c1151800 1 --2- 172.21.15.146:0/3243136361 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb1a4036b40 0x7fb1a4039000 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.033+0000 7fb2c1151800 1 --2- 172.21.15.146:0/3243136361 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556facf606d0 0x556fad0e32a0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.033+0000 7fb2c1151800 1 -- 172.21.15.146:0/3243136361 >> 172.21.15.146:0/3243136361 conn(0x556facfe6db0 msgr2=0x556fad0d5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:09.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.033+0000 7fb2c1151800 1 -- 172.21.15.146:0/3243136361 shutdown_connections 2024-09-18T01:47:09.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.033+0000 7fb2c1151800 1 -- 172.21.15.146:0/3243136361 wait complete. 2024-09-18T01:47:09.042 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-18T01:47:09.042 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-18T01:47:09.043 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-18T01:47:09.087 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:47:09.087 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:47:09.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.087+0000 7f2bcf731800 1 Processor -- start 2024-09-18T01:47:09.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.087+0000 7f2bcf731800 1 -- start start 2024-09-18T01:47:09.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.087+0000 7f2bcf731800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x5651722f8610 0x565172389670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.087+0000 7f2bcf731800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x565172243b30 con 0x565172389bb0 2024-09-18T01:47:09.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.087+0000 7f2bcf731800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x565172225360 con 0x5651722f8610 2024-09-18T01:47:09.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.087+0000 7f2bcb424640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x5651722f8610 0x565172389670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.087+0000 7f2bc3fff640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x565172389bb0 0x56517238bfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:53002/0 (socket says 172.21.15.146:53002) 2024-09-18T01:47:09.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.087+0000 7f2bcb424640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x5651722f8610 0x565172389670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:36984/0 (socket says 172.21.15.146:36984) 2024-09-18T01:47:09.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.087+0000 7f2bc3fff640 1 -- 172.21.15.146:0/1136766639 learned_addr learned my addr 172.21.15.146:0/1136766639 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:47:09.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.087+0000 7f2bcb424640 1 -- 172.21.15.146:0/1136766639 >> v1:172.21.15.129:6789/0 conn(0x565172389bb0 legacy=0x56517238bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.088+0000 7f2bcb424640 1 -- 172.21.15.146:0/1136766639 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56517224be00 con 0x5651722f8610 2024-09-18T01:47:09.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.089+0000 7f2bcb424640 1 --2- 172.21.15.146:0/1136766639 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5651722f8610 0x565172389670 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc00a470 tx=0x7f2bbc045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab9da1624528898d server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.089+0000 7f2bcac23640 1 -- 172.21.15.146:0/1136766639 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2bbc053570 con 0x5651722f8610 2024-09-18T01:47:09.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.090+0000 7f2bcac23640 1 -- 172.21.15.146:0/1136766639 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bbc058070 con 0x5651722f8610 2024-09-18T01:47:09.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.090+0000 7f2bcac23640 1 -- 172.21.15.146:0/1136766639 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2bbc053880 con 0x5651722f8610 2024-09-18T01:47:09.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.090+0000 7f2bcf731800 1 -- 172.21.15.146:0/1136766639 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5651722f8610 msgr2=0x565172389670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.090+0000 7f2bcf731800 1 --2- 172.21.15.146:0/1136766639 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5651722f8610 0x565172389670 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc00a470 tx=0x7f2bbc045a20 comp rx=0 tx=0).stop 2024-09-18T01:47:09.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.090+0000 7f2bcf731800 1 -- 172.21.15.146:0/1136766639 shutdown_connections 2024-09-18T01:47:09.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.090+0000 7f2bcf731800 1 --2- 172.21.15.146:0/1136766639 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5651722f8610 0x565172389670 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.090+0000 7f2bcf731800 1 -- 172.21.15.146:0/1136766639 >> 172.21.15.146:0/1136766639 conn(0x56517237ede0 msgr2=0x565172381200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:09.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.090+0000 7f2bcf731800 1 -- 172.21.15.146:0/1136766639 shutdown_connections 2024-09-18T01:47:09.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.090+0000 7f2bcf731800 1 -- 172.21.15.146:0/1136766639 wait complete. 2024-09-18T01:47:09.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.104+0000 7f2bcf731800 1 Processor -- start 2024-09-18T01:47:09.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.104+0000 7f2bcf731800 1 -- start start 2024-09-18T01:47:09.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.104+0000 7f2bcf731800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5651722f8610 0x565172475a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.104+0000 7f2bcf731800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5651722d0330 con 0x5651722f8610 2024-09-18T01:47:09.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.104+0000 7f2bcb424640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5651722f8610 0x565172475a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.104+0000 7f2bcb424640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5651722f8610 0x565172475a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37000/0 (socket says 172.21.15.146:37000) 2024-09-18T01:47:09.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.104+0000 7f2bcb424640 1 -- 172.21.15.146:0/548347189 learned_addr learned my addr 172.21.15.146:0/548347189 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:09.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.105+0000 7f2bcb424640 1 -- 172.21.15.146:0/548347189 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56517221dbc0 con 0x5651722f8610 2024-09-18T01:47:09.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.105+0000 7f2bcb424640 1 --2- 172.21.15.146:0/548347189 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5651722f8610 0x565172475a80 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc025c20 tx=0x7f2bbc051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e48e9faf8cf4b3cf server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.105+0000 7f2ab960a640 1 -- 172.21.15.146:0/548347189 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2bbc05c580 con 0x5651722f8610 2024-09-18T01:47:09.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.105+0000 7f2ab960a640 1 -- 172.21.15.146:0/548347189 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bbc063030 con 0x5651722f8610 2024-09-18T01:47:09.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.105+0000 7f2ab960a640 1 -- 172.21.15.146:0/548347189 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2bbc05c850 con 0x5651722f8610 2024-09-18T01:47:09.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.106+0000 7f2bcf731800 1 -- 172.21.15.146:0/548347189 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5651722f8610 msgr2=0x565172475a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.106+0000 7f2bcf731800 1 --2- 172.21.15.146:0/548347189 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5651722f8610 0x565172475a80 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc025c20 tx=0x7f2bbc051000 comp rx=0 tx=0).stop 2024-09-18T01:47:09.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.106+0000 7f2bcf731800 1 -- 172.21.15.146:0/548347189 shutdown_connections 2024-09-18T01:47:09.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.106+0000 7f2bcf731800 1 --2- 172.21.15.146:0/548347189 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5651722f8610 0x565172475a80 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.106+0000 7f2bcf731800 1 -- 172.21.15.146:0/548347189 >> 172.21.15.146:0/548347189 conn(0x56517237ede0 msgr2=0x565172471440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:09.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.106+0000 7f2bcf731800 1 -- 172.21.15.146:0/548347189 shutdown_connections 2024-09-18T01:47:09.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.106+0000 7f2bcf731800 1 -- 172.21.15.146:0/548347189 wait complete. 2024-09-18T01:47:09.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.106+0000 7f2bcf731800 1 Processor -- start 2024-09-18T01:47:09.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.106+0000 7f2bcf731800 1 -- start start 2024-09-18T01:47:09.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.106+0000 7f2bcf731800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5651722f8610 0x56517247d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.106+0000 7f2bcf731800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x56517238d990 con 0x5651722f8610 2024-09-18T01:47:09.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.106+0000 7f2bcb424640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5651722f8610 0x56517247d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.106+0000 7f2bcb424640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5651722f8610 0x56517247d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37006/0 (socket says 172.21.15.146:37006) 2024-09-18T01:47:09.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.106+0000 7f2bcb424640 1 -- 172.21.15.146:0/3572297088 learned_addr learned my addr 172.21.15.146:0/3572297088 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:09.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.107+0000 7f2bcb424640 1 -- 172.21.15.146:0/3572297088 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565172231fe0 con 0x5651722f8610 2024-09-18T01:47:09.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.107+0000 7f2bcb424640 1 --2- 172.21.15.146:0/3572297088 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5651722f8610 0x56517247d380 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc00a330 tx=0x7f2bbc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.107+0000 7f2ab7e07640 1 -- 172.21.15.146:0/3572297088 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2bbc06c030 con 0x5651722f8610 2024-09-18T01:47:09.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.107+0000 7f2ab7e07640 1 -- 172.21.15.146:0/3572297088 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bbc05c580 con 0x5651722f8610 2024-09-18T01:47:09.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.107+0000 7f2ab7e07640 1 -- 172.21.15.146:0/3572297088 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2bbc05c860 con 0x5651722f8610 2024-09-18T01:47:09.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.107+0000 7f2bcf731800 1 -- 172.21.15.146:0/3572297088 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56517247d8c0 con 0x5651722f8610 2024-09-18T01:47:09.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.107+0000 7f2bcf731800 1 -- 172.21.15.146:0/3572297088 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56517247de40 con 0x5651722f8610 2024-09-18T01:47:09.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.108+0000 7f2ab7e07640 1 -- 172.21.15.146:0/3572297088 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2bbc053440 con 0x5651722f8610 2024-09-18T01:47:09.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.108+0000 7f2ab7e07640 1 --2- 172.21.15.146:0/3572297088 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2ab0036b90 0x7f2ab0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.108+0000 7f2ab7e07640 1 -- 172.21.15.146:0/3572297088 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f2bbc070020 con 0x5651722f8610 2024-09-18T01:47:09.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.108+0000 7f2bc3fff640 1 --2- 172.21.15.146:0/3572297088 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2ab0036b90 0x7f2ab0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.108+0000 7f2bcf731800 1 --2- 172.21.15.146:0/3572297088 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x565172389bb0 0x5651724843f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.108+0000 7f2bcf731800 1 -- 172.21.15.146:0/3572297088 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565172484930 con 0x565172389bb0 2024-09-18T01:47:09.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.108+0000 7f2bcbc25640 1 --2- 172.21.15.146:0/3572297088 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x565172389bb0 0x5651724843f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.109+0000 7f2bc3fff640 1 --2- 172.21.15.146:0/3572297088 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2ab0036b90 0x7f2ab0039050 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4000f60 tx=0x7f2bb40012b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.109+0000 7f2bcbc25640 1 --2- 172.21.15.146:0/3572297088 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x565172389bb0 0x5651724843f0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.109+0000 7f2bcbc25640 1 -- 172.21.15.146:0/3572297088 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2bc400a4a0 con 0x565172389bb0 2024-09-18T01:47:09.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.109+0000 7f2bcf731800 1 -- 172.21.15.146:0/3572297088 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5651724819c0 con 0x565172389bb0 2024-09-18T01:47:09.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.109+0000 7f2bcbc25640 1 -- 172.21.15.146:0/3572297088 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2bc400a4a0 con 0x565172389bb0 2024-09-18T01:47:09.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.109+0000 7f2bcf731800 1 -- 172.21.15.146:0/3572297088 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565172486770 con 0x565172389bb0 2024-09-18T01:47:09.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.110+0000 7f2bcbc25640 1 -- 172.21.15.146:0/3572297088 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2bc400a4a0 con 0x565172389bb0 2024-09-18T01:47:09.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.110+0000 7f2bcf731800 1 -- 172.21.15.146:0/3572297088 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5651724858b0 con 0x565172389bb0 2024-09-18T01:47:09.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.110+0000 7f2bcbc25640 1 -- 172.21.15.146:0/3572297088 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2bc400a4a0 con 0x565172389bb0 2024-09-18T01:47:09.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.110+0000 7f2bcf731800 1 --2- 172.21.15.146:0/3572297088 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x565172486380 0x565172489bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.110+0000 7f2bcf731800 1 -- 172.21.15.146:0/3572297088 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56517248a350 con 0x565172486380 2024-09-18T01:47:09.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.110+0000 7f2bcb424640 1 --2- 172.21.15.146:0/3572297088 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x565172486380 0x565172489bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.110+0000 7f2bcb424640 1 --2- 172.21.15.146:0/3572297088 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x565172486380 0x565172489bc0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.111+0000 7f2bcb424640 1 -- 172.21.15.146:0/3572297088 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2bbc07b070 con 0x565172486380 2024-09-18T01:47:09.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.111+0000 7f2bcf731800 1 Processor -- start 2024-09-18T01:47:09.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.111+0000 7f2bcf731800 1 -- start start 2024-09-18T01:47:09.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.111+0000 7f2bcf731800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5651724980e0 0x565172498500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.111+0000 7f2bcf731800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x56517221f580 con 0x5651724980e0 2024-09-18T01:47:09.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.111+0000 7f2bcbc25640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5651724980e0 0x565172498500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.111+0000 7f2bcbc25640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5651724980e0 0x565172498500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37014/0 (socket says 172.21.15.146:37014) 2024-09-18T01:47:09.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.111+0000 7f2bcbc25640 1 -- 172.21.15.146:0/235743000 learned_addr learned my addr 172.21.15.146:0/235743000 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:09.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.112+0000 7f2bcbc25640 1 -- 172.21.15.146:0/235743000 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565172498a40 con 0x5651724980e0 2024-09-18T01:47:09.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.112+0000 7f2bcbc25640 1 --2- 172.21.15.146:0/235743000 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5651724980e0 0x565172498500 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x565172484d30 tx=0x7f2bc40178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.112+0000 7f2ab5602640 1 -- 172.21.15.146:0/235743000 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2bc4013440 con 0x5651724980e0 2024-09-18T01:47:09.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.112+0000 7f2ab5602640 1 -- 172.21.15.146:0/235743000 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bc40135e0 con 0x5651724980e0 2024-09-18T01:47:09.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.112+0000 7f2ab5602640 1 -- 172.21.15.146:0/235743000 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2bc40138c0 con 0x5651724980e0 2024-09-18T01:47:09.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.112+0000 7f2bcf731800 1 -- 172.21.15.146:0/235743000 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565172498cd0 con 0x5651724980e0 2024-09-18T01:47:09.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.112+0000 7f2bcf731800 1 -- 172.21.15.146:0/235743000 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56517249b9b0 con 0x5651724980e0 2024-09-18T01:47:09.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.113+0000 7f2ab5602640 1 -- 172.21.15.146:0/235743000 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2bc4011040 con 0x5651724980e0 2024-09-18T01:47:09.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.113+0000 7f2ab5602640 1 --2- 172.21.15.146:0/235743000 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2aa4036b40 0x7f2aa4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.113+0000 7f2ab5602640 1 -- 172.21.15.146:0/235743000 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f2bc401d070 con 0x5651724980e0 2024-09-18T01:47:09.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.113+0000 7f2bcb424640 1 --2- 172.21.15.146:0/235743000 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2aa4036b40 0x7f2aa4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.113+0000 7f2bcf731800 1 Processor -- start 2024-09-18T01:47:09.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.113+0000 7f2bcf731800 1 -- start start 2024-09-18T01:47:09.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.113+0000 7f2bcb424640 1 --2- 172.21.15.146:0/235743000 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2aa4036b40 0x7f2aa4039000 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc067b80 tx=0x7f2bbc000bc0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.114+0000 7f2bcf731800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5651724a4d60 0x5651724a5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.114+0000 7f2bcf731800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5651724761d0 con 0x5651724a4d60 2024-09-18T01:47:09.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.114+0000 7f2bcbc25640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5651724a4d60 0x5651724a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.114+0000 7f2bcbc25640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5651724a4d60 0x5651724a5160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37022/0 (socket says 172.21.15.146:37022) 2024-09-18T01:47:09.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.114+0000 7f2bcbc25640 1 -- 172.21.15.146:0/2059464908 learned_addr learned my addr 172.21.15.146:0/2059464908 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:09.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.114+0000 7f2bcbc25640 1 -- 172.21.15.146:0/2059464908 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651724a56a0 con 0x5651724a4d60 2024-09-18T01:47:09.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.114+0000 7f2bcbc25640 1 --2- 172.21.15.146:0/2059464908 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5651724a4d60 0x5651724a5160 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f2bc4001450 tx=0x7f2bc404caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7276e27a6c43e491 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.114+0000 7f2aaeffd640 1 -- 172.21.15.146:0/2059464908 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2bc4045070 con 0x5651724a4d60 2024-09-18T01:47:09.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.114+0000 7f2aaeffd640 1 -- 172.21.15.146:0/2059464908 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bc4015560 con 0x5651724a4d60 2024-09-18T01:47:09.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.114+0000 7f2aaeffd640 1 -- 172.21.15.146:0/2059464908 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2bc402ad80 con 0x5651724a4d60 2024-09-18T01:47:09.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.115+0000 7f2bcf731800 1 -- 172.21.15.146:0/2059464908 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5651724a4d60 msgr2=0x5651724a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.115+0000 7f2bcf731800 1 --2- 172.21.15.146:0/2059464908 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5651724a4d60 0x5651724a5160 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f2bc4001450 tx=0x7f2bc404caf0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.115+0000 7f2bcf731800 1 -- 172.21.15.146:0/2059464908 shutdown_connections 2024-09-18T01:47:09.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.115+0000 7f2bcf731800 1 --2- 172.21.15.146:0/2059464908 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5651724a4d60 0x5651724a5160 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.115+0000 7f2bcf731800 1 -- 172.21.15.146:0/2059464908 >> 172.21.15.146:0/2059464908 conn(0x5651724a1110 msgr2=0x56517249f210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:09.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.115+0000 7f2bcf731800 1 -- 172.21.15.146:0/2059464908 shutdown_connections 2024-09-18T01:47:09.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.115+0000 7f2bcf731800 1 -- 172.21.15.146:0/2059464908 wait complete. 2024-09-18T01:47:09.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.115+0000 7f2bcf731800 1 Processor -- start 2024-09-18T01:47:09.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.115+0000 7f2bcf731800 1 -- start start 2024-09-18T01:47:09.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.115+0000 7f2bcf731800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5651724a4d60 0x5651724ac1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.115+0000 7f2bcf731800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5651724a5d40 con 0x5651724a4d60 2024-09-18T01:47:09.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.115+0000 7f2bcbc25640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5651724a4d60 0x5651724ac1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.115+0000 7f2bcbc25640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5651724a4d60 0x5651724ac1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37026/0 (socket says 172.21.15.146:37026) 2024-09-18T01:47:09.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.115+0000 7f2bcbc25640 1 -- 172.21.15.146:0/2200364640 learned_addr learned my addr 172.21.15.146:0/2200364640 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:09.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.116+0000 7f2bcbc25640 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651724ac710 con 0x5651724a4d60 2024-09-18T01:47:09.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.116+0000 7f2bcbc25640 1 --2- 172.21.15.146:0/2200364640 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5651724a4d60 0x5651724ac1d0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f2bc4043040 tx=0x7f2bc404c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.116+0000 7f2aad7fa640 1 -- 172.21.15.146:0/2200364640 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2bc403a070 con 0x5651724a4d60 2024-09-18T01:47:09.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.116+0000 7f2aad7fa640 1 -- 172.21.15.146:0/2200364640 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bc40014f0 con 0x5651724a4d60 2024-09-18T01:47:09.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.116+0000 7f2bcf731800 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5651724ac9a0 con 0x5651724a4d60 2024-09-18T01:47:09.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.116+0000 7f2aad7fa640 1 -- 172.21.15.146:0/2200364640 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2bc4045040 con 0x5651724a4d60 2024-09-18T01:47:09.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.116+0000 7f2bcf731800 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651724af650 con 0x5651724a4d60 2024-09-18T01:47:09.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.117+0000 7f2aad7fa640 1 -- 172.21.15.146:0/2200364640 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2bc403d070 con 0x5651724a4d60 2024-09-18T01:47:09.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.117+0000 7f2aad7fa640 1 --2- 172.21.15.146:0/2200364640 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2a94036b40 0x7f2a94039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.117+0000 7f2aad7fa640 1 -- 172.21.15.146:0/2200364640 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f2bc400e040 con 0x5651724a4d60 2024-09-18T01:47:09.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.117+0000 7f2bcb424640 1 --2- 172.21.15.146:0/2200364640 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2a94036b40 0x7f2a94039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.117+0000 7f2bcf731800 20 rados->read ofs=0 len=0 2024-09-18T01:47:09.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.117+0000 7f2bcf731800 1 --2- 172.21.15.146:0/2200364640 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5651724b7eb0 0x5651724ba370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.117+0000 7f2bcf731800 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5651724baac0 con 0x5651724b7eb0 2024-09-18T01:47:09.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.117+0000 7f2bc3fff640 1 --2- 172.21.15.146:0/2200364640 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5651724b7eb0 0x5651724ba370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.118+0000 7f2bcb424640 1 --2- 172.21.15.146:0/2200364640 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2a94036b40 0x7f2a94039000 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc067950 tx=0x7f2bbc087000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.118+0000 7f2bc3fff640 1 --2- 172.21.15.146:0/2200364640 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5651724b7eb0 0x5651724ba370 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.118+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2bb4009050 con 0x5651724b7eb0 2024-09-18T01:47:09.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.118+0000 7f2bcf731800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:09.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.118+0000 7f2bcf731800 20 realm 2024-09-18T01:47:09.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.118+0000 7f2bcf731800 20 rados->read ofs=0 len=0 2024-09-18T01:47:09.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.118+0000 7f2bcf731800 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5651724b7300 con 0x5651724b7eb0 2024-09-18T01:47:09.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.118+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2bb4009050 con 0x5651724b7eb0 2024-09-18T01:47:09.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.118+0000 7f2bcf731800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:09.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.118+0000 7f2bcf731800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:47:09.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.118+0000 7f2bcf731800 20 rados->read ofs=0 len=0 2024-09-18T01:47:09.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.118+0000 7f2bcf731800 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5651724bb5a0 con 0x5651724b7eb0 2024-09-18T01:47:09.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.118+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2bb4009050 con 0x5651724b7eb0 2024-09-18T01:47:09.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.119+0000 7f2bcf731800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:09.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.119+0000 7f2bcf731800 20 rados->read ofs=0 len=0 2024-09-18T01:47:09.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.119+0000 7f2bcf731800 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5651724bbe70 con 0x5651724b7eb0 2024-09-18T01:47:09.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.119+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2bb4009050 con 0x5651724b7eb0 2024-09-18T01:47:09.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.119+0000 7f2bcf731800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:47:09.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.119+0000 7f2bcf731800 20 rados->read ofs=0 len=0 2024-09-18T01:47:09.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.119+0000 7f2bcf731800 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5651724bc210 con 0x5651724b7eb0 2024-09-18T01:47:09.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.119+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2bb4009050 con 0x5651724b7eb0 2024-09-18T01:47:09.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.119+0000 7f2bcf731800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:47:09.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.119+0000 7f2bcf731800 20 searching for the correct realm 2024-09-18T01:47:09.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.119+0000 7f2bcf731800 1 --2- 172.21.15.146:0/2200364640 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5651724be0f0 0x5651724c04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.119+0000 7f2bcf731800 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651724c0b90 con 0x5651724be0f0 2024-09-18T01:47:09.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.119+0000 7f2bcbc25640 1 --2- 172.21.15.146:0/2200364640 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5651724be0f0 0x5651724c04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.119+0000 7f2bcbc25640 1 --2- 172.21.15.146:0/2200364640 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5651724be0f0 0x5651724c04e0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.120+0000 7f2bcbc25640 1 -- 172.21.15.146:0/2200364640 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2bc403c030 con 0x5651724be0f0 2024-09-18T01:47:09.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.120+0000 7f2bcbc25640 1 --2- 172.21.15.146:0/2200364640 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f2bc403f060 0x7f2bc403e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.120+0000 7f2bcbc25640 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651724c0b90 con 0x7f2bc403f060 2024-09-18T01:47:09.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.120+0000 7f2bcb424640 1 --2- 172.21.15.146:0/2200364640 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f2bc403f060 0x7f2bc403e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.120+0000 7f2bcb424640 1 --2- 172.21.15.146:0/2200364640 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f2bc403f060 0x7f2bc403e9f0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.120+0000 7f2bcb424640 1 -- 172.21.15.146:0/2200364640 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2bbc07b070 con 0x7f2bc403f060 2024-09-18T01:47:09.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.120+0000 7f2bcb424640 1 --2- 172.21.15.146:0/2200364640 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f2bbc090c20 0x7f2bbc0902a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.120+0000 7f2bcb424640 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651724c0b90 con 0x7f2bbc090c20 2024-09-18T01:47:09.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.121+0000 7f2bc3fff640 1 --2- 172.21.15.146:0/2200364640 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f2bbc090c20 0x7f2bbc0902a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.121+0000 7f2bc3fff640 1 --2- 172.21.15.146:0/2200364640 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f2bbc090c20 0x7f2bbc0902a0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.121+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2bb4009050 con 0x7f2bbc090c20 2024-09-18T01:47:09.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.121+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651724c0b90 con 0x5651724b7eb0 2024-09-18T01:47:09.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.122+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2bb4009050 con 0x5651724b7eb0 2024-09-18T01:47:09.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.122+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651724c0b90 con 0x5651724b7eb0 2024-09-18T01:47:09.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.122+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2bb402a040 con 0x5651724b7eb0 2024-09-18T01:47:09.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.122+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651724c0b90 con 0x7f2bbc090c20 2024-09-18T01:47:09.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.122+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2bb402a040 con 0x7f2bbc090c20 2024-09-18T01:47:09.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.122+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651724c0b90 con 0x7f2bbc090c20 2024-09-18T01:47:09.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.122+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2bb402a040 con 0x7f2bbc090c20 2024-09-18T01:47:09.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.122+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651724c0b90 con 0x7f2bc403f060 2024-09-18T01:47:09.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.123+0000 7f2bcb424640 1 -- 172.21.15.146:0/2200364640 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2bbc07b070 con 0x7f2bc403f060 2024-09-18T01:47:09.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.123+0000 7f2bcb424640 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651724c0b90 con 0x5651724be0f0 2024-09-18T01:47:09.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.123+0000 7f2bcbc25640 1 -- 172.21.15.146:0/2200364640 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2bc403c030 con 0x5651724be0f0 2024-09-18T01:47:09.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.123+0000 7f2bcbc25640 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651724c0b90 con 0x5651724b7eb0 2024-09-18T01:47:09.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.123+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2bb402a040 con 0x5651724b7eb0 2024-09-18T01:47:09.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.123+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651724c0b90 con 0x7f2bbc090c20 2024-09-18T01:47:09.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.123+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2bb402a040 con 0x7f2bbc090c20 2024-09-18T01:47:09.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.123+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651724c0b90 con 0x5651724b7eb0 2024-09-18T01:47:09.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.124+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2bb402a040 con 0x5651724b7eb0 2024-09-18T01:47:09.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.124+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651724c0b90 con 0x7f2bc403f060 2024-09-18T01:47:09.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.124+0000 7f2bcb424640 1 -- 172.21.15.146:0/2200364640 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f2bbc07b070 con 0x7f2bc403f060 2024-09-18T01:47:09.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.124+0000 7f2bcb424640 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651724c0b90 con 0x5651724be0f0 2024-09-18T01:47:09.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.124+0000 7f2bcbc25640 1 -- 172.21.15.146:0/2200364640 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2bc403c030 con 0x5651724be0f0 2024-09-18T01:47:09.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.124+0000 7f2bcbc25640 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651724c0b90 con 0x5651724be0f0 2024-09-18T01:47:09.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.124+0000 7f2bcbc25640 1 -- 172.21.15.146:0/2200364640 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2bc403c030 con 0x5651724be0f0 2024-09-18T01:47:09.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.124+0000 7f2bcbc25640 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651724c0b90 con 0x7f2bbc090c20 2024-09-18T01:47:09.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.124+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2bb402a040 con 0x7f2bbc090c20 2024-09-18T01:47:09.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.124+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651724c0b90 con 0x5651724be0f0 2024-09-18T01:47:09.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.125+0000 7f2bcbc25640 1 -- 172.21.15.146:0/2200364640 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2bc403c030 con 0x5651724be0f0 2024-09-18T01:47:09.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.125+0000 7f2bcbc25640 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651724c0b90 con 0x5651724be0f0 2024-09-18T01:47:09.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.125+0000 7f2bcbc25640 1 -- 172.21.15.146:0/2200364640 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2bc403c030 con 0x5651724be0f0 2024-09-18T01:47:09.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.125+0000 7f2bcbc25640 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651724c0b90 con 0x5651724b7eb0 2024-09-18T01:47:09.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.125+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2bb402a040 con 0x5651724b7eb0 2024-09-18T01:47:09.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.125+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651724c0b90 con 0x5651724b7eb0 2024-09-18T01:47:09.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.125+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2bb402a040 con 0x5651724b7eb0 2024-09-18T01:47:09.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.125+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651724c0b90 con 0x7f2bbc090c20 2024-09-18T01:47:09.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.126+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2bb402a040 con 0x7f2bbc090c20 2024-09-18T01:47:09.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.126+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651724c0b90 con 0x5651724be0f0 2024-09-18T01:47:09.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.126+0000 7f2bcbc25640 1 -- 172.21.15.146:0/2200364640 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2bc403c030 con 0x5651724be0f0 2024-09-18T01:47:09.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.126+0000 7f2bcbc25640 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651724c0b90 con 0x7f2bc403f060 2024-09-18T01:47:09.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.126+0000 7f2bcb424640 1 -- 172.21.15.146:0/2200364640 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2bbc07b070 con 0x7f2bc403f060 2024-09-18T01:47:09.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.126+0000 7f2bcb424640 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651724c0b90 con 0x5651724b7eb0 2024-09-18T01:47:09.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.126+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2bb402a040 con 0x5651724b7eb0 2024-09-18T01:47:09.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.126+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651724c0b90 con 0x7f2bbc090c20 2024-09-18T01:47:09.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.127+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2bb402a040 con 0x7f2bbc090c20 2024-09-18T01:47:09.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.127+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651724c0b90 con 0x5651724be0f0 2024-09-18T01:47:09.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.127+0000 7f2bcbc25640 1 -- 172.21.15.146:0/2200364640 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2bc403c030 con 0x5651724be0f0 2024-09-18T01:47:09.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.127+0000 7f2bcbc25640 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651724c0b90 con 0x7f2bbc090c20 2024-09-18T01:47:09.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.128+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2bb402a040 con 0x7f2bbc090c20 2024-09-18T01:47:09.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.128+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651724c0b90 con 0x7f2bc403f060 2024-09-18T01:47:09.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.128+0000 7f2bcb424640 1 -- 172.21.15.146:0/2200364640 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2bbc07b070 con 0x7f2bc403f060 2024-09-18T01:47:09.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.128+0000 7f2bcb424640 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651724c0b90 con 0x5651724be0f0 2024-09-18T01:47:09.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.128+0000 7f2bcbc25640 1 -- 172.21.15.146:0/2200364640 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2bc403c030 con 0x5651724be0f0 2024-09-18T01:47:09.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.128+0000 7f2bcbc25640 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651724c0b90 con 0x7f2bbc090c20 2024-09-18T01:47:09.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.128+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2bb402a040 con 0x7f2bbc090c20 2024-09-18T01:47:09.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.128+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651724c0b90 con 0x5651724b7eb0 2024-09-18T01:47:09.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.129+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2bb402a040 con 0x5651724b7eb0 2024-09-18T01:47:09.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.129+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651724c0b90 con 0x7f2bc403f060 2024-09-18T01:47:09.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.129+0000 7f2bcb424640 1 -- 172.21.15.146:0/2200364640 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2bbc0af040 con 0x7f2bc403f060 2024-09-18T01:47:09.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.129+0000 7f2bcf731800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:47:09.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.129+0000 7f2bcf731800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:47:09.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.129+0000 7f2bcf731800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:47:09.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.129+0000 7f2bcf731800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:47:09.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.129+0000 7f2bcf731800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:47:09.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.129+0000 7f2bcf731800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:47:09.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.129+0000 7f2bcf731800 20 rados->read ofs=0 len=0 2024-09-18T01:47:09.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.129+0000 7f2bcf731800 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5651724bcbc0 con 0x5651724b7eb0 2024-09-18T01:47:09.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.129+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2bb402a040 con 0x5651724b7eb0 2024-09-18T01:47:09.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.129+0000 7f2bcf731800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:09.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.129+0000 7f2bcf731800 20 rados->read ofs=0 len=0 2024-09-18T01:47:09.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.129+0000 7f2bcf731800 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5651724bd460 con 0x5651724b7eb0 2024-09-18T01:47:09.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.129+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2bb402a040 con 0x5651724b7eb0 2024-09-18T01:47:09.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.129+0000 7f2bcf731800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:47:09.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.129+0000 7f2bcf731800 20 rados->read ofs=0 len=0 2024-09-18T01:47:09.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.129+0000 7f2bcf731800 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5651724bc800 con 0x7f2bc403f060 2024-09-18T01:47:09.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.130+0000 7f2bcb424640 1 -- 172.21.15.146:0/2200364640 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2bbc0af040 con 0x7f2bc403f060 2024-09-18T01:47:09.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.130+0000 7f2bcf731800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:47:09.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.130+0000 7f2bcf731800 20 zone default found 2024-09-18T01:47:09.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.130+0000 7f2bcf731800 4 Realm: () 2024-09-18T01:47:09.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.130+0000 7f2bcf731800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:47:09.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.130+0000 7f2bcf731800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:47:09.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.130+0000 7f2bcf731800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:47:09.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.130+0000 7f2bcf731800 20 zonegroup default 2024-09-18T01:47:09.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.130+0000 7f2bcf731800 20 rados->read ofs=0 len=0 2024-09-18T01:47:09.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.130+0000 7f2bcf731800 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5651724c14a0 con 0x7f2bbc090c20 2024-09-18T01:47:09.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.130+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2bb402a040 con 0x7f2bbc090c20 2024-09-18T01:47:09.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.130+0000 7f2bcf731800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:09.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.130+0000 7f2bcf731800 20 rados->read ofs=0 len=0 2024-09-18T01:47:09.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.130+0000 7f2bcf731800 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5651724c3000 con 0x5651724be0f0 2024-09-18T01:47:09.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.130+0000 7f2bcbc25640 1 -- 172.21.15.146:0/2200364640 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2bc403c030 con 0x5651724be0f0 2024-09-18T01:47:09.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.130+0000 7f2bcf731800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:09.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.130+0000 7f2bcf731800 20 rados->read ofs=0 len=0 2024-09-18T01:47:09.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.130+0000 7f2bcf731800 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5651724c3510 con 0x5651724be0f0 2024-09-18T01:47:09.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.131+0000 7f2bcbc25640 1 -- 172.21.15.146:0/2200364640 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2bc403c030 con 0x5651724be0f0 2024-09-18T01:47:09.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.131+0000 7f2bcf731800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:09.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.131+0000 7f2bcf731800 20 started sync module instance, tier type = 2024-09-18T01:47:09.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.131+0000 7f2bcf731800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:47:09.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.131+0000 7f2bcf731800 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5651724c1f00 con 0x7f2bc403f060 2024-09-18T01:47:09.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.132+0000 7f2bcb424640 1 -- 172.21.15.146:0/2200364640 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v33'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2bbc0af040 con 0x7f2bc403f060 2024-09-18T01:47:09.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.132+0000 7f2bcf731800 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94907809932016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5651724c3e20 con 0x7f2bc403f060 2024-09-18T01:47:09.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.132+0000 7f2bcf731800 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5651724c4670 con 0x5651724b7eb0 2024-09-18T01:47:09.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.133+0000 7f2bcb424640 1 -- 172.21.15.146:0/2200364640 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94907809932016] v33'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2bbc0af040 con 0x7f2bc403f060 2024-09-18T01:47:09.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.133+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v33'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2bb402a040 con 0x5651724b7eb0 2024-09-18T01:47:09.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.133+0000 7f2bcf731800 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94907809937776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5651724c4670 con 0x5651724b7eb0 2024-09-18T01:47:09.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.133+0000 7f2bcf731800 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5651724c5170 con 0x5651724be0f0 2024-09-18T01:47:09.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.134+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94907809937776] v33'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2bb402a040 con 0x5651724b7eb0 2024-09-18T01:47:09.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.134+0000 7f2bcbc25640 1 -- 172.21.15.146:0/2200364640 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v33'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2bc403c030 con 0x5651724be0f0 2024-09-18T01:47:09.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.134+0000 7f2bcf731800 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94907809939904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5651724c45e0 con 0x5651724be0f0 2024-09-18T01:47:09.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.134+0000 7f2bcf731800 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5651724c6030 con 0x7f2bc403f060 2024-09-18T01:47:09.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.135+0000 7f2bcb424640 1 -- 172.21.15.146:0/2200364640 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v33'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2bbc0af040 con 0x7f2bc403f060 2024-09-18T01:47:09.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.136+0000 7f2bcf731800 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94907809946496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5651724c6880 con 0x7f2bc403f060 2024-09-18T01:47:09.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.136+0000 7f2bcf731800 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5651724c72f0 con 0x5651724b7eb0 2024-09-18T01:47:09.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.136+0000 7f2bcbc25640 1 -- 172.21.15.146:0/2200364640 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94907809939904] v33'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2bc403c030 con 0x5651724be0f0 2024-09-18T01:47:09.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.137+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v33'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2bb402a040 con 0x5651724b7eb0 2024-09-18T01:47:09.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.137+0000 7f2bcf731800 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94907809951168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5651724c72b0 con 0x5651724b7eb0 2024-09-18T01:47:09.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.137+0000 7f2bcf731800 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5651724c7d80 con 0x7f2bbc090c20 2024-09-18T01:47:09.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.137+0000 7f2bcb424640 1 -- 172.21.15.146:0/2200364640 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94907809946496] v33'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2bbc0af040 con 0x7f2bc403f060 2024-09-18T01:47:09.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.138+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v33'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2bb402a040 con 0x7f2bbc090c20 2024-09-18T01:47:09.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.138+0000 7f2bcf731800 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94907809953872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5651724c7d40 con 0x7f2bbc090c20 2024-09-18T01:47:09.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.138+0000 7f2bcf731800 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5651724c8780 con 0x7f2bbc090c20 2024-09-18T01:47:09.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.138+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94907809951168] v33'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2bb402a040 con 0x5651724b7eb0 2024-09-18T01:47:09.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.140+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(56 notify.6 [create] v33'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2bb402a040 con 0x7f2bbc090c20 2024-09-18T01:47:09.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.140+0000 7f2bcf731800 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94907809956432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5651724c8740 con 0x7f2bbc090c20 2024-09-18T01:47:09.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.140+0000 7f2bcf731800 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5651724c9140 con 0x7f2bbc090c20 2024-09-18T01:47:09.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.140+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94907809953872] v33'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2bb402a040 con 0x7f2bbc090c20 2024-09-18T01:47:09.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.141+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(58 notify.7 [create] v33'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2bb402a040 con 0x7f2bbc090c20 2024-09-18T01:47:09.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.141+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94907809956432] v33'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2bb402a040 con 0x7f2bbc090c20 2024-09-18T01:47:09.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.141+0000 7f2bcf731800 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94907809948624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5651724c8c50 con 0x7f2bbc090c20 2024-09-18T01:47:09.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.141+0000 7f2bcf731800 20 add_watcher() i=0 2024-09-18T01:47:09.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.141+0000 7f2bcf731800 20 add_watcher() i=1 2024-09-18T01:47:09.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.141+0000 7f2bcf731800 20 add_watcher() i=2 2024-09-18T01:47:09.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.141+0000 7f2bcf731800 20 add_watcher() i=3 2024-09-18T01:47:09.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.141+0000 7f2bcf731800 20 add_watcher() i=4 2024-09-18T01:47:09.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.141+0000 7f2bcf731800 20 add_watcher() i=5 2024-09-18T01:47:09.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.141+0000 7f2bcf731800 20 add_watcher() i=6 2024-09-18T01:47:09.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.142+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94907809948624] v33'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2bb402a040 con 0x7f2bbc090c20 2024-09-18T01:47:09.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.142+0000 7f2bcf731800 20 add_watcher() i=7 2024-09-18T01:47:09.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.142+0000 7f2bcf731800 2 all 8 watchers are set, enabling cache 2024-09-18T01:47:09.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.142+0000 7f2bcf731800 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5651724cc050 con 0x5651724b7eb0 2024-09-18T01:47:09.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.143+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2bb402a040 con 0x5651724b7eb0 2024-09-18T01:47:09.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.143+0000 7f2bcf731800 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94907809944928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5651724c9570 con 0x5651724b7eb0 2024-09-18T01:47:09.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.144+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94907809944928] v33'243 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2bb402a040 con 0x5651724b7eb0 2024-09-18T01:47:09.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.144+0000 7f2a81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:47:09.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.144+0000 7f2bcf731800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:47:09.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.144+0000 7f2bcf731800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:47:09.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.144+0000 7f2bcf731800 5 note: GC not initialized 2024-09-18T01:47:09.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.144+0000 7f2a80fe1640 20 reqs_thread_entry: start 2024-09-18T01:47:09.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.144+0000 7f2bcf731800 20 init_complete bucket index max shards: 11 2024-09-18T01:47:09.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.144+0000 7f2bcf731800 20 Filter name: none 2024-09-18T01:47:09.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.144+0000 7f29fa7fc640 20 reqs_thread_entry: start 2024-09-18T01:47:09.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.145+0000 7f2bcf731800 20 rados->read ofs=0 len=0 2024-09-18T01:47:09.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.145+0000 7f2bcf731800 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5651724ff040 con 0x5651724b7eb0 2024-09-18T01:47:09.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.145+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f2bb402a040 con 0x5651724b7eb0 2024-09-18T01:47:09.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.145+0000 7f2bcf731800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:09.156 INFO:teuthology.orchestra.run.smithi146.stderr:could not fetch user info: no user info saved 2024-09-18T01:47:09.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.146+0000 7f2a81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:47:09.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.146+0000 7f2bcf731800 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94907809944928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5651724ff000 con 0x5651724b7eb0 2024-09-18T01:47:09.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.147+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94907809944928] v33'244 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2bb402a040 con 0x5651724b7eb0 2024-09-18T01:47:09.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.147+0000 7f2bcf731800 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94907809932016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5651724fce50 con 0x7f2bc403f060 2024-09-18T01:47:09.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.148+0000 7f2bcb424640 1 -- 172.21.15.146:0/2200364640 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94907809932016] v33'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2bbc0af040 con 0x7f2bc403f060 2024-09-18T01:47:09.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.148+0000 7f2bcf731800 20 remove_watcher() i=0 2024-09-18T01:47:09.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.148+0000 7f2bcf731800 2 removed watcher, disabling cache 2024-09-18T01:47:09.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.148+0000 7f2bcf731800 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94907809937776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5651724fce50 con 0x5651724b7eb0 2024-09-18T01:47:09.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.149+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94907809937776] v33'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2bb402a040 con 0x5651724b7eb0 2024-09-18T01:47:09.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.149+0000 7f2bcf731800 20 remove_watcher() i=1 2024-09-18T01:47:09.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.149+0000 7f2bcf731800 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94907809939904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5651724fce50 con 0x5651724be0f0 2024-09-18T01:47:09.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.150+0000 7f2bcbc25640 1 -- 172.21.15.146:0/2200364640 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94907809939904] v33'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2bc403c030 con 0x5651724be0f0 2024-09-18T01:47:09.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.150+0000 7f2bcf731800 20 remove_watcher() i=2 2024-09-18T01:47:09.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.150+0000 7f2bcf731800 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94907809946496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5651724fce50 con 0x7f2bc403f060 2024-09-18T01:47:09.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.151+0000 7f2bcb424640 1 -- 172.21.15.146:0/2200364640 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94907809946496] v33'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2bbc0af040 con 0x7f2bc403f060 2024-09-18T01:47:09.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.151+0000 7f2bcf731800 20 remove_watcher() i=3 2024-09-18T01:47:09.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.151+0000 7f2bcf731800 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94907809951168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5651724fce50 con 0x5651724b7eb0 2024-09-18T01:47:09.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.152+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94907809951168] v33'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2bb402a040 con 0x5651724b7eb0 2024-09-18T01:47:09.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.152+0000 7f2bcf731800 20 remove_watcher() i=4 2024-09-18T01:47:09.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.152+0000 7f2bcf731800 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94907809953872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5651724fce50 con 0x7f2bbc090c20 2024-09-18T01:47:09.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.153+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94907809953872] v33'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2bb402a040 con 0x7f2bbc090c20 2024-09-18T01:47:09.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.153+0000 7f2bcf731800 20 remove_watcher() i=5 2024-09-18T01:47:09.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.153+0000 7f2bcf731800 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94907809956432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5651724fce50 con 0x7f2bbc090c20 2024-09-18T01:47:09.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.154+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94907809956432] v33'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2bb402a040 con 0x7f2bbc090c20 2024-09-18T01:47:09.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.154+0000 7f2bcf731800 20 remove_watcher() i=6 2024-09-18T01:47:09.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.154+0000 7f2bcf731800 1 -- 172.21.15.146:0/2200364640 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94907809948624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5651724fce50 con 0x7f2bbc090c20 2024-09-18T01:47:09.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.156+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94907809948624] v33'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2bb402a040 con 0x7f2bbc090c20 2024-09-18T01:47:09.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.156+0000 7f2bcf731800 20 remove_watcher() i=7 2024-09-18T01:47:09.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.156+0000 7f2bcf731800 1 -- 172.21.15.146:0/2200364640 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f2bbc090c20 msgr2=0x7f2bbc0902a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.156+0000 7f2bcf731800 1 --2- 172.21.15.146:0/2200364640 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f2bbc090c20 0x7f2bbc0902a0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.156+0000 7f2bcf731800 1 -- 172.21.15.146:0/2200364640 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5651724b7eb0 msgr2=0x5651724ba370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.156+0000 7f2bcf731800 1 --2- 172.21.15.146:0/2200364640 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5651724b7eb0 0x5651724ba370 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.156+0000 7f2bcf731800 1 -- 172.21.15.146:0/2200364640 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f2bc403f060 msgr2=0x7f2bc403e9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.156+0000 7f2bcf731800 1 --2- 172.21.15.146:0/2200364640 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f2bc403f060 0x7f2bc403e9f0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.156+0000 7f2bcf731800 1 -- 172.21.15.146:0/2200364640 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5651724be0f0 msgr2=0x5651724c04e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.156+0000 7f2bcf731800 1 --2- 172.21.15.146:0/2200364640 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5651724be0f0 0x5651724c04e0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.156+0000 7f2bcf731800 1 -- 172.21.15.146:0/2200364640 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2a94036b40 msgr2=0x7f2a94039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.156+0000 7f2bcf731800 1 --2- 172.21.15.146:0/2200364640 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2a94036b40 0x7f2a94039000 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc067950 tx=0x7f2bbc087000 comp rx=0 tx=0).stop 2024-09-18T01:47:09.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.156+0000 7f2bcf731800 1 -- 172.21.15.146:0/2200364640 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5651724a4d60 msgr2=0x5651724ac1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.156+0000 7f2bc3fff640 1 -- 172.21.15.146:0/2200364640 reap_dead start 2024-09-18T01:47:09.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.156+0000 7f2bcf731800 1 --2- 172.21.15.146:0/2200364640 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5651724a4d60 0x5651724ac1d0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f2bc4043040 tx=0x7f2bc404c880 comp rx=0 tx=0).stop 2024-09-18T01:47:09.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.156+0000 7f2bcf731800 1 -- 172.21.15.146:0/2200364640 shutdown_connections 2024-09-18T01:47:09.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.156+0000 7f2bcf731800 1 --2- 172.21.15.146:0/2200364640 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5651724a4d60 0x5651724ac1d0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.156+0000 7f2bcf731800 1 -- 172.21.15.146:0/2200364640 >> 172.21.15.146:0/2200364640 conn(0x5651724a1110 msgr2=0x56517249f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:09.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.156+0000 7f2bcf731800 1 -- 172.21.15.146:0/2200364640 shutdown_connections 2024-09-18T01:47:09.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.156+0000 7f2bcf731800 1 -- 172.21.15.146:0/2200364640 wait complete. 2024-09-18T01:47:09.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.156+0000 7f2bcf731800 1 -- 172.21.15.146:0/235743000 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2aa4036b40 msgr2=0x7f2aa4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.156+0000 7f2bcf731800 1 --2- 172.21.15.146:0/235743000 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2aa4036b40 0x7f2aa4039000 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc067b80 tx=0x7f2bbc000bc0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.156+0000 7f2bcf731800 1 -- 172.21.15.146:0/235743000 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5651724980e0 msgr2=0x565172498500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.156+0000 7f2bcf731800 1 --2- 172.21.15.146:0/235743000 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5651724980e0 0x565172498500 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x565172484d30 tx=0x7f2bc40178e0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.156+0000 7f2bcf731800 1 -- 172.21.15.146:0/235743000 shutdown_connections 2024-09-18T01:47:09.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.156+0000 7f2bcf731800 1 --2- 172.21.15.146:0/235743000 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2aa4036b40 0x7f2aa4039000 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.156+0000 7f2bcf731800 1 --2- 172.21.15.146:0/235743000 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5651724980e0 0x565172498500 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.156+0000 7f2bcf731800 1 -- 172.21.15.146:0/235743000 >> 172.21.15.146:0/235743000 conn(0x56517248d070 msgr2=0x56517248fbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:09.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.157+0000 7f2bcf731800 1 -- 172.21.15.146:0/235743000 shutdown_connections 2024-09-18T01:47:09.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.157+0000 7f2bcf731800 1 -- 172.21.15.146:0/235743000 wait complete. 2024-09-18T01:47:09.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.157+0000 7f2bcf731800 1 -- 172.21.15.146:0/3572297088 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x565172389bb0 msgr2=0x5651724843f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.157+0000 7f2bcf731800 1 --2- 172.21.15.146:0/3572297088 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x565172389bb0 0x5651724843f0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.157+0000 7f2bcf731800 1 -- 172.21.15.146:0/3572297088 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x565172486380 msgr2=0x565172489bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.157+0000 7f2bcf731800 1 --2- 172.21.15.146:0/3572297088 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x565172486380 0x565172489bc0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.157+0000 7f2bcf731800 1 -- 172.21.15.146:0/3572297088 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2ab0036b90 msgr2=0x7f2ab0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.157+0000 7f2bcf731800 1 --2- 172.21.15.146:0/3572297088 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2ab0036b90 0x7f2ab0039050 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4000f60 tx=0x7f2bb40012b0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.157+0000 7f2bcf731800 1 -- 172.21.15.146:0/3572297088 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5651722f8610 msgr2=0x56517247d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.157+0000 7f2bcf731800 1 --2- 172.21.15.146:0/3572297088 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5651722f8610 0x56517247d380 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc00a330 tx=0x7f2bbc002fb0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.157+0000 7f2bcf731800 1 -- 172.21.15.146:0/3572297088 shutdown_connections 2024-09-18T01:47:09.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.157+0000 7f2bcf731800 1 --2- 172.21.15.146:0/3572297088 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x565172486380 0x565172489bc0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.157+0000 7f2bcf731800 1 --2- 172.21.15.146:0/3572297088 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x565172389bb0 0x5651724843f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.157+0000 7f2bcf731800 1 --2- 172.21.15.146:0/3572297088 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2ab0036b90 0x7f2ab0039050 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.157+0000 7f2bcf731800 1 --2- 172.21.15.146:0/3572297088 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5651722f8610 0x56517247d380 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.157+0000 7f2bcf731800 1 -- 172.21.15.146:0/3572297088 >> 172.21.15.146:0/3572297088 conn(0x56517237ede0 msgr2=0x56517246fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:09.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.157+0000 7f2bcf731800 1 -- 172.21.15.146:0/3572297088 shutdown_connections 2024-09-18T01:47:09.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.157+0000 7f2bcf731800 1 -- 172.21.15.146:0/3572297088 wait complete. 2024-09-18T01:47:09.167 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-18T01:47:09.168 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get', '--rgw-zone', 'default'] 2024-09-18T01:47:09.168 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get', '--rgw-zone', 'default'] 2024-09-18T01:47:09.168 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get --rgw-zone default 2024-09-18T01:47:09.211 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:47:09.211 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:47:09.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.212+0000 7f86a1fa2800 1 Processor -- start 2024-09-18T01:47:09.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.212+0000 7f86a1fa2800 1 -- start start 2024-09-18T01:47:09.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.212+0000 7f86a1fa2800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55a1f85bc700 0x55a1f864d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.212+0000 7f86a1fa2800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a1f8507b30 con 0x55a1f864dbd0 2024-09-18T01:47:09.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.212+0000 7f86a1fa2800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x55a1f84e9360 con 0x55a1f85bc700 2024-09-18T01:47:09.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.212+0000 7f869fa96640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55a1f85bc700 0x55a1f864d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.212+0000 7f8697fff640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x55a1f864dbd0 0x55a1f864ffc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:53004/0 (socket says 172.21.15.146:53004) 2024-09-18T01:47:09.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.212+0000 7f869fa96640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55a1f85bc700 0x55a1f864d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37028/0 (socket says 172.21.15.146:37028) 2024-09-18T01:47:09.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.212+0000 7f8697fff640 1 -- 172.21.15.146:0/2838172725 learned_addr learned my addr 172.21.15.146:0/2838172725 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:47:09.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.212+0000 7f869fa96640 1 -- 172.21.15.146:0/2838172725 >> v1:172.21.15.129:6789/0 conn(0x55a1f864dbd0 legacy=0x55a1f864ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.212+0000 7f869f295640 1 -- 172.21.15.146:0/2838172725 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 191235497 0 0) 0x55a1f8507b30 con 0x55a1f864dbd0 2024-09-18T01:47:09.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.212+0000 7f869fa96640 1 -- 172.21.15.146:0/2838172725 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1f850fe00 con 0x55a1f85bc700 2024-09-18T01:47:09.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.214+0000 7f869fa96640 1 --2- 172.21.15.146:0/2838172725 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a1f85bc700 0x55a1f864d690 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f869000a470 tx=0x7f8690045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcac99cedc9c318f server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.214+0000 7f869f295640 1 -- 172.21.15.146:0/2838172725 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8690053570 con 0x55a1f85bc700 2024-09-18T01:47:09.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.214+0000 7f869f295640 1 -- 172.21.15.146:0/2838172725 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8690058070 con 0x55a1f85bc700 2024-09-18T01:47:09.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.214+0000 7f869f295640 1 -- 172.21.15.146:0/2838172725 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8690053880 con 0x55a1f85bc700 2024-09-18T01:47:09.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.215+0000 7f86a1fa2800 1 -- 172.21.15.146:0/2838172725 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a1f85bc700 msgr2=0x55a1f864d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.215+0000 7f86a1fa2800 1 --2- 172.21.15.146:0/2838172725 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a1f85bc700 0x55a1f864d690 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f869000a470 tx=0x7f8690045a20 comp rx=0 tx=0).stop 2024-09-18T01:47:09.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.215+0000 7f86a1fa2800 1 -- 172.21.15.146:0/2838172725 shutdown_connections 2024-09-18T01:47:09.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.215+0000 7f86a1fa2800 1 --2- 172.21.15.146:0/2838172725 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a1f85bc700 0x55a1f864d690 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.215+0000 7f86a1fa2800 1 -- 172.21.15.146:0/2838172725 >> 172.21.15.146:0/2838172725 conn(0x55a1f8642e20 msgr2=0x55a1f8645240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:09.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.215+0000 7f86a1fa2800 1 -- 172.21.15.146:0/2838172725 shutdown_connections 2024-09-18T01:47:09.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.215+0000 7f86a1fa2800 1 -- 172.21.15.146:0/2838172725 wait complete. 2024-09-18T01:47:09.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.229+0000 7f86a1fa2800 1 Processor -- start 2024-09-18T01:47:09.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.229+0000 7f86a1fa2800 1 -- start start 2024-09-18T01:47:09.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.229+0000 7f86a1fa2800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a1f85bc700 0x55a1f8739920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.229+0000 7f86a1fa2800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55a1f8594330 con 0x55a1f85bc700 2024-09-18T01:47:09.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.229+0000 7f869fa96640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a1f85bc700 0x55a1f8739920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.229+0000 7f869fa96640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a1f85bc700 0x55a1f8739920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37042/0 (socket says 172.21.15.146:37042) 2024-09-18T01:47:09.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.229+0000 7f869fa96640 1 -- 172.21.15.146:0/2259076497 learned_addr learned my addr 172.21.15.146:0/2259076497 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:09.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.229+0000 7f869fa96640 1 -- 172.21.15.146:0/2259076497 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1f84e1bc0 con 0x55a1f85bc700 2024-09-18T01:47:09.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.230+0000 7f869fa96640 1 --2- 172.21.15.146:0/2259076497 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a1f85bc700 0x55a1f8739920 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f8690045f50 tx=0x7f8690051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a17b70eed895cd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.230+0000 7f858de0b640 1 -- 172.21.15.146:0/2259076497 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8690053c20 con 0x55a1f85bc700 2024-09-18T01:47:09.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.230+0000 7f858de0b640 1 -- 172.21.15.146:0/2259076497 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8690063030 con 0x55a1f85bc700 2024-09-18T01:47:09.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.230+0000 7f858de0b640 1 -- 172.21.15.146:0/2259076497 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8690053440 con 0x55a1f85bc700 2024-09-18T01:47:09.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.230+0000 7f86a1fa2800 1 -- 172.21.15.146:0/2259076497 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a1f85bc700 msgr2=0x55a1f8739920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.230+0000 7f86a1fa2800 1 --2- 172.21.15.146:0/2259076497 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a1f85bc700 0x55a1f8739920 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f8690045f50 tx=0x7f8690051000 comp rx=0 tx=0).stop 2024-09-18T01:47:09.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.231+0000 7f86a1fa2800 1 -- 172.21.15.146:0/2259076497 shutdown_connections 2024-09-18T01:47:09.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.231+0000 7f86a1fa2800 1 --2- 172.21.15.146:0/2259076497 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a1f85bc700 0x55a1f8739920 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.231+0000 7f86a1fa2800 1 -- 172.21.15.146:0/2259076497 >> 172.21.15.146:0/2259076497 conn(0x55a1f8642e20 msgr2=0x55a1f87352e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:09.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.231+0000 7f86a1fa2800 1 -- 172.21.15.146:0/2259076497 shutdown_connections 2024-09-18T01:47:09.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.231+0000 7f86a1fa2800 1 -- 172.21.15.146:0/2259076497 wait complete. 2024-09-18T01:47:09.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.231+0000 7f86a1fa2800 1 Processor -- start 2024-09-18T01:47:09.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.231+0000 7f86a1fa2800 1 -- start start 2024-09-18T01:47:09.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.231+0000 7f86a1fa2800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a1f85bc700 0x55a1f87412a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.231+0000 7f86a1fa2800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55a1f86519b0 con 0x55a1f85bc700 2024-09-18T01:47:09.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.231+0000 7f869fa96640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a1f85bc700 0x55a1f87412a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.231+0000 7f869fa96640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a1f85bc700 0x55a1f87412a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37046/0 (socket says 172.21.15.146:37046) 2024-09-18T01:47:09.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.231+0000 7f869fa96640 1 -- 172.21.15.146:0/4010858159 learned_addr learned my addr 172.21.15.146:0/4010858159 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:09.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.232+0000 7f869fa96640 1 -- 172.21.15.146:0/4010858159 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1f84f5fe0 con 0x55a1f85bc700 2024-09-18T01:47:09.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.232+0000 7f869fa96640 1 --2- 172.21.15.146:0/4010858159 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a1f85bc700 0x55a1f87412a0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f8690045f20 tx=0x7f8690002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.232+0000 7f8587fff640 1 -- 172.21.15.146:0/4010858159 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8690053570 con 0x55a1f85bc700 2024-09-18T01:47:09.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.232+0000 7f8587fff640 1 -- 172.21.15.146:0/4010858159 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8690053710 con 0x55a1f85bc700 2024-09-18T01:47:09.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.232+0000 7f86a1fa2800 1 -- 172.21.15.146:0/4010858159 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a1f87417e0 con 0x55a1f85bc700 2024-09-18T01:47:09.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.232+0000 7f8587fff640 1 -- 172.21.15.146:0/4010858159 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8690068420 con 0x55a1f85bc700 2024-09-18T01:47:09.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.232+0000 7f86a1fa2800 1 -- 172.21.15.146:0/4010858159 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1f8741c80 con 0x55a1f85bc700 2024-09-18T01:47:09.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.233+0000 7f86a1fa2800 1 Processor -- start 2024-09-18T01:47:09.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.233+0000 7f86a1fa2800 1 -- start start 2024-09-18T01:47:09.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.233+0000 7f8587fff640 1 -- 172.21.15.146:0/4010858159 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f86900685c0 con 0x55a1f85bc700 2024-09-18T01:47:09.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.233+0000 7f86a1fa2800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a1f874df20 0x55a1f874e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.233+0000 7f86a1fa2800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55a1f84e3580 con 0x55a1f874df20 2024-09-18T01:47:09.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.233+0000 7f8587fff640 1 --2- 172.21.15.146:0/4010858159 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8588036b90 0x7f8588039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.233+0000 7f8587fff640 1 -- 172.21.15.146:0/4010858159 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f8690070070 con 0x55a1f85bc700 2024-09-18T01:47:09.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.233+0000 7f869fa96640 1 --2- 172.21.15.146:0/4010858159 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8588036b90 0x7f8588039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.233+0000 7f86a0297640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a1f874df20 0x55a1f874e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.233+0000 7f86a0297640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a1f874df20 0x55a1f874e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37052/0 (socket says 172.21.15.146:37052) 2024-09-18T01:47:09.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.233+0000 7f86a0297640 1 -- 172.21.15.146:0/425447157 learned_addr learned my addr 172.21.15.146:0/425447157 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:09.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.233+0000 7f869fa96640 1 --2- 172.21.15.146:0/4010858159 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8588036b90 0x7f8588039050 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8690067900 tx=0x7f8690067790 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.233+0000 7f86a0297640 1 -- 172.21.15.146:0/425447157 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1f874e860 con 0x55a1f874df20 2024-09-18T01:47:09.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.234+0000 7f86a0297640 1 --2- 172.21.15.146:0/425447157 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a1f874df20 0x55a1f874e320 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f869800a430 tx=0x7f869800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52004ce9db73545a server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.234+0000 7f8585ffb640 1 -- 172.21.15.146:0/425447157 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8698015070 con 0x55a1f874df20 2024-09-18T01:47:09.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.234+0000 7f8585ffb640 1 -- 172.21.15.146:0/425447157 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8698001670 con 0x55a1f874df20 2024-09-18T01:47:09.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.234+0000 7f8585ffb640 1 -- 172.21.15.146:0/425447157 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8698001990 con 0x55a1f874df20 2024-09-18T01:47:09.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.234+0000 7f86a1fa2800 1 -- 172.21.15.146:0/425447157 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a1f874df20 msgr2=0x55a1f874e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.234+0000 7f86a1fa2800 1 --2- 172.21.15.146:0/425447157 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a1f874df20 0x55a1f874e320 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f869800a430 tx=0x7f869800a8f0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.234+0000 7f86a1fa2800 1 -- 172.21.15.146:0/425447157 shutdown_connections 2024-09-18T01:47:09.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.234+0000 7f86a1fa2800 1 --2- 172.21.15.146:0/425447157 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a1f874df20 0x55a1f874e320 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.234+0000 7f86a1fa2800 1 -- 172.21.15.146:0/425447157 >> 172.21.15.146:0/425447157 conn(0x55a1f864dbd0 msgr2=0x55a1f87496a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:09.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.234+0000 7f86a1fa2800 1 -- 172.21.15.146:0/425447157 shutdown_connections 2024-09-18T01:47:09.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.234+0000 7f86a1fa2800 1 -- 172.21.15.146:0/425447157 wait complete. 2024-09-18T01:47:09.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.235+0000 7f86a1fa2800 1 Processor -- start 2024-09-18T01:47:09.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.235+0000 7f86a1fa2800 1 -- start start 2024-09-18T01:47:09.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.235+0000 7f86a1fa2800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a1f874df20 0x55a1f87553c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.235+0000 7f86a1fa2800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55a1f874f210 con 0x55a1f874df20 2024-09-18T01:47:09.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.235+0000 7f86a0297640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a1f874df20 0x55a1f87553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.235+0000 7f86a0297640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a1f874df20 0x55a1f87553c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37056/0 (socket says 172.21.15.146:37056) 2024-09-18T01:47:09.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.235+0000 7f86a0297640 1 -- 172.21.15.146:0/1210045574 learned_addr learned my addr 172.21.15.146:0/1210045574 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:09.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.235+0000 7f86a0297640 1 -- 172.21.15.146:0/1210045574 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1f8755900 con 0x55a1f874df20 2024-09-18T01:47:09.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.235+0000 7f86a0297640 1 --2- 172.21.15.146:0/1210045574 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a1f874df20 0x55a1f87553c0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f8698013040 tx=0x7f8698003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.236+0000 7f857ffff640 1 -- 172.21.15.146:0/1210045574 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8698020020 con 0x55a1f874df20 2024-09-18T01:47:09.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.236+0000 7f857ffff640 1 -- 172.21.15.146:0/1210045574 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86980108e0 con 0x55a1f874df20 2024-09-18T01:47:09.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.236+0000 7f857ffff640 1 -- 172.21.15.146:0/1210045574 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8698015040 con 0x55a1f874df20 2024-09-18T01:47:09.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.236+0000 7f86a1fa2800 1 -- 172.21.15.146:0/1210045574 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a1f8755b90 con 0x55a1f874df20 2024-09-18T01:47:09.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.236+0000 7f86a1fa2800 1 -- 172.21.15.146:0/1210045574 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1f8758840 con 0x55a1f874df20 2024-09-18T01:47:09.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.236+0000 7f857ffff640 1 -- 172.21.15.146:0/1210045574 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8698023020 con 0x55a1f874df20 2024-09-18T01:47:09.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.237+0000 7f857ffff640 1 --2- 172.21.15.146:0/1210045574 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8578036b90 0x7f8578039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.237+0000 7f857ffff640 1 -- 172.21.15.146:0/1210045574 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f869804c380 con 0x55a1f874df20 2024-09-18T01:47:09.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.237+0000 7f8697fff640 1 --2- 172.21.15.146:0/1210045574 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8578036b90 0x7f8578039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.237+0000 7f86a1fa2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:47:09.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.237+0000 7f86a1fa2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:47:09.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.237+0000 7f8697fff640 1 --2- 172.21.15.146:0/1210045574 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8578036b90 0x7f8578039050 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8688000c00 tx=0x7f8688001330 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.238+0000 7f86a1fa2800 1 Processor -- start 2024-09-18T01:47:09.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.238+0000 7f86a1fa2800 1 -- start start 2024-09-18T01:47:09.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.238+0000 7f86a1fa2800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a1f876f410 0x55a1f876f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.238+0000 7f86a1fa2800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55a1f873a070 con 0x55a1f876f410 2024-09-18T01:47:09.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.238+0000 7f869fa96640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a1f876f410 0x55a1f876f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.238+0000 7f869fa96640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a1f876f410 0x55a1f876f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37058/0 (socket says 172.21.15.146:37058) 2024-09-18T01:47:09.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.238+0000 7f869fa96640 1 -- 172.21.15.146:0/551668590 learned_addr learned my addr 172.21.15.146:0/551668590 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:09.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.239+0000 7f869fa96640 1 -- 172.21.15.146:0/551668590 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1f876fe00 con 0x55a1f876f410 2024-09-18T01:47:09.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.239+0000 7f869fa96640 1 --2- 172.21.15.146:0/551668590 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a1f876f410 0x55a1f876f830 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f8690053ea0 tx=0x7f869005cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.239+0000 7f8564fe1640 1 -- 172.21.15.146:0/551668590 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f869005cce0 con 0x55a1f876f410 2024-09-18T01:47:09.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.239+0000 7f8564fe1640 1 -- 172.21.15.146:0/551668590 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8690094030 con 0x55a1f876f410 2024-09-18T01:47:09.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.239+0000 7f8564fe1640 1 -- 172.21.15.146:0/551668590 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f869005c410 con 0x55a1f876f410 2024-09-18T01:47:09.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.239+0000 7f86a1fa2800 1 -- 172.21.15.146:0/551668590 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a1f8772a50 con 0x55a1f876f410 2024-09-18T01:47:09.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.239+0000 7f86a1fa2800 1 -- 172.21.15.146:0/551668590 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1f8772e30 con 0x55a1f876f410 2024-09-18T01:47:09.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.240+0000 7f8564fe1640 1 -- 172.21.15.146:0/551668590 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8690073b20 con 0x55a1f876f410 2024-09-18T01:47:09.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.240+0000 7f8564fe1640 1 --2- 172.21.15.146:0/551668590 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f84d8036b40 0x7f84d8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.240+0000 7f8564fe1640 1 -- 172.21.15.146:0/551668590 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f869009ad10 con 0x55a1f876f410 2024-09-18T01:47:09.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.240+0000 7f8697fff640 1 --2- 172.21.15.146:0/551668590 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f84d8036b40 0x7f84d8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.240+0000 7f855dffb640 20 reqs_thread_entry: start 2024-09-18T01:47:09.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.240+0000 7f86a1fa2800 1 --2- 172.21.15.146:0/4010858159 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a1f877ce10 0x55a1f877f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.240+0000 7f86a1fa2800 1 -- 172.21.15.146:0/4010858159 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a1f877f980 con 0x55a1f877ce10 2024-09-18T01:47:09.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.240+0000 7f8697fff640 1 --2- 172.21.15.146:0/551668590 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f84d8036b40 0x7f84d8039000 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8688000f60 tx=0x7f8688006000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.241+0000 7f86a0297640 1 --2- 172.21.15.146:0/4010858159 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a1f877ce10 0x55a1f877f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.241+0000 7f86a0297640 1 --2- 172.21.15.146:0/4010858159 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a1f877ce10 0x55a1f877f2b0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.241+0000 7f86a0297640 1 -- 172.21.15.146:0/4010858159 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f869800e070 con 0x55a1f877ce10 2024-09-18T01:47:09.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.241+0000 7f86a1fa2800 1 -- 172.21.15.146:0/4010858159 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a1f8781290 con 0x55a1f877ce10 2024-09-18T01:47:09.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.241+0000 7f86a0297640 1 -- 172.21.15.146:0/4010858159 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f869800e070 con 0x55a1f877ce10 2024-09-18T01:47:09.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.242+0000 7f86a1fa2800 1 -- 172.21.15.146:0/1210045574 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8578036b90 msgr2=0x7f8578039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.242+0000 7f86a1fa2800 1 --2- 172.21.15.146:0/1210045574 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8578036b90 0x7f8578039050 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8688000c00 tx=0x7f8688001330 comp rx=0 tx=0).stop 2024-09-18T01:47:09.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.242+0000 7f86a1fa2800 1 -- 172.21.15.146:0/1210045574 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a1f874df20 msgr2=0x55a1f87553c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.242+0000 7f86a1fa2800 1 --2- 172.21.15.146:0/1210045574 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a1f874df20 0x55a1f87553c0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f8698013040 tx=0x7f8698003370 comp rx=0 tx=0).stop 2024-09-18T01:47:09.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.242+0000 7f86a1fa2800 1 -- 172.21.15.146:0/1210045574 shutdown_connections 2024-09-18T01:47:09.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.242+0000 7f86a1fa2800 1 --2- 172.21.15.146:0/1210045574 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8578036b90 0x7f8578039050 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.242+0000 7f86a1fa2800 1 --2- 172.21.15.146:0/1210045574 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a1f874df20 0x55a1f87553c0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.242+0000 7f86a1fa2800 1 -- 172.21.15.146:0/1210045574 >> 172.21.15.146:0/1210045574 conn(0x55a1f864dbd0 msgr2=0x55a1f8749270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:09.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.242+0000 7f86a1fa2800 1 -- 172.21.15.146:0/1210045574 shutdown_connections 2024-09-18T01:47:09.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.242+0000 7f86a1fa2800 1 -- 172.21.15.146:0/1210045574 wait complete. 2024-09-18T01:47:09.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.243+0000 7f86a1fa2800 1 -- 172.21.15.146:0/551668590 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f84d8036b40 msgr2=0x7f84d8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.243+0000 7f86a1fa2800 1 --2- 172.21.15.146:0/551668590 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f84d8036b40 0x7f84d8039000 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8688000f60 tx=0x7f8688006000 comp rx=0 tx=0).stop 2024-09-18T01:47:09.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.243+0000 7f86a1fa2800 1 -- 172.21.15.146:0/551668590 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a1f876f410 msgr2=0x55a1f876f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.243+0000 7f86a1fa2800 1 --2- 172.21.15.146:0/551668590 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a1f876f410 0x55a1f876f830 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f8690053ea0 tx=0x7f869005cba0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.243+0000 7f86a1fa2800 1 -- 172.21.15.146:0/551668590 shutdown_connections 2024-09-18T01:47:09.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.243+0000 7f86a1fa2800 1 --2- 172.21.15.146:0/551668590 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f84d8036b40 0x7f84d8039000 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.243+0000 7f86a1fa2800 1 --2- 172.21.15.146:0/551668590 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a1f876f410 0x55a1f876f830 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.243+0000 7f86a1fa2800 1 -- 172.21.15.146:0/551668590 >> 172.21.15.146:0/551668590 conn(0x55a1f8764320 msgr2=0x55a1f8766c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:09.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.243+0000 7f86a1fa2800 1 -- 172.21.15.146:0/551668590 shutdown_connections 2024-09-18T01:47:09.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.243+0000 7f86a1fa2800 1 -- 172.21.15.146:0/551668590 wait complete. 2024-09-18T01:47:09.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.243+0000 7f86a1fa2800 1 -- 172.21.15.146:0/4010858159 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a1f877ce10 msgr2=0x55a1f877f2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.243+0000 7f86a1fa2800 1 --2- 172.21.15.146:0/4010858159 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a1f877ce10 0x55a1f877f2b0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.243+0000 7f86a1fa2800 1 -- 172.21.15.146:0/4010858159 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8588036b90 msgr2=0x7f8588039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.243+0000 7f86a1fa2800 1 --2- 172.21.15.146:0/4010858159 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8588036b90 0x7f8588039050 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8690067900 tx=0x7f8690067790 comp rx=0 tx=0).stop 2024-09-18T01:47:09.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.243+0000 7f86a1fa2800 1 -- 172.21.15.146:0/4010858159 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a1f85bc700 msgr2=0x55a1f87412a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.243+0000 7f86a1fa2800 1 --2- 172.21.15.146:0/4010858159 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a1f85bc700 0x55a1f87412a0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f8690045f20 tx=0x7f8690002fb0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.243+0000 7f86a1fa2800 1 -- 172.21.15.146:0/4010858159 shutdown_connections 2024-09-18T01:47:09.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.243+0000 7f86a1fa2800 1 --2- 172.21.15.146:0/4010858159 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a1f877ce10 0x55a1f877f2b0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.243+0000 7f86a1fa2800 1 --2- 172.21.15.146:0/4010858159 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8588036b90 0x7f8588039050 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.243+0000 7f86a1fa2800 1 --2- 172.21.15.146:0/4010858159 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a1f85bc700 0x55a1f87412a0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.243+0000 7f86a1fa2800 1 -- 172.21.15.146:0/4010858159 >> 172.21.15.146:0/4010858159 conn(0x55a1f8642e20 msgr2=0x55a1f8733bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:09.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.243+0000 7f86a1fa2800 1 -- 172.21.15.146:0/4010858159 shutdown_connections 2024-09-18T01:47:09.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.243+0000 7f86a1fa2800 1 -- 172.21.15.146:0/4010858159 wait complete. 2024-09-18T01:47:09.252 INFO:teuthology.orchestra.run.smithi146.stdout:{"id":"8ac01ed4-7422-45e2-b799-bf55088fb4fc","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-18T01:47:09.252 DEBUG:tasks.util.rgw: json result: {'id': '8ac01ed4-7422-45e2-b799-bf55088fb4fc', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-18T01:47:09.253 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'set'] 2024-09-18T01:47:09.253 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'set'] 2024-09-18T01:47:09.253 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone set 2024-09-18T01:47:09.335 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:47:09.335 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:47:09.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.335+0000 7fdb59f1f800 1 Processor -- start 2024-09-18T01:47:09.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.335+0000 7fdb59f1f800 1 -- start start 2024-09-18T01:47:09.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.335+0000 7fdb59f1f800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x5619ffc67960 0x5619ffc69d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.335+0000 7fdb59f1f800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5619ffb22b30 con 0x5619ffbd7620 2024-09-18T01:47:09.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.335+0000 7fdb59f1f800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x5619ffb04360 con 0x5619ffc67960 2024-09-18T01:47:09.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.335+0000 7fdb55394640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x5619ffc67960 0x5619ffc69d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.335+0000 7fdb55b95640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x5619ffbd7620 0x5619ffc66240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:53014/0 (socket says 172.21.15.146:53014) 2024-09-18T01:47:09.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.335+0000 7fdb55394640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x5619ffc67960 0x5619ffc69d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37068/0 (socket says 172.21.15.146:37068) 2024-09-18T01:47:09.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.335+0000 7fdb55b95640 1 -- 172.21.15.146:0/1730180019 learned_addr learned my addr 172.21.15.146:0/1730180019 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:47:09.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.335+0000 7fdb55394640 1 -- 172.21.15.146:0/1730180019 >> v1:172.21.15.129:6789/0 conn(0x5619ffbd7620 legacy=0x5619ffc66240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.335+0000 7fdb55394640 1 -- 172.21.15.146:0/1730180019 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619ffb2ae00 con 0x5619ffc67960 2024-09-18T01:47:09.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.337+0000 7fdb55394640 1 --2- 172.21.15.146:0/1730180019 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5619ffc67960 0x5619ffc69d50 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c00a470 tx=0x7fdb4c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a30aedadb8ce869 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.337+0000 7fdb54b93640 1 -- 172.21.15.146:0/1730180019 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb4c053570 con 0x5619ffc67960 2024-09-18T01:47:09.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.337+0000 7fdb54b93640 1 -- 172.21.15.146:0/1730180019 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb4c058070 con 0x5619ffc67960 2024-09-18T01:47:09.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.337+0000 7fdb54b93640 1 -- 172.21.15.146:0/1730180019 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb4c053880 con 0x5619ffc67960 2024-09-18T01:47:09.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.338+0000 7fdb59f1f800 1 -- 172.21.15.146:0/1730180019 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5619ffc67960 msgr2=0x5619ffc69d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.338+0000 7fdb59f1f800 1 --2- 172.21.15.146:0/1730180019 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5619ffc67960 0x5619ffc69d50 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c00a470 tx=0x7fdb4c045a20 comp rx=0 tx=0).stop 2024-09-18T01:47:09.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.338+0000 7fdb59f1f800 1 -- 172.21.15.146:0/1730180019 shutdown_connections 2024-09-18T01:47:09.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.338+0000 7fdb59f1f800 1 --2- 172.21.15.146:0/1730180019 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5619ffc67960 0x5619ffc69d50 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.338+0000 7fdb59f1f800 1 -- 172.21.15.146:0/1730180019 >> 172.21.15.146:0/1730180019 conn(0x5619ffc5ddd0 msgr2=0x5619ffc601f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:09.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.338+0000 7fdb59f1f800 1 -- 172.21.15.146:0/1730180019 shutdown_connections 2024-09-18T01:47:09.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.338+0000 7fdb59f1f800 1 -- 172.21.15.146:0/1730180019 wait complete. 2024-09-18T01:47:09.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.352+0000 7fdb59f1f800 1 Processor -- start 2024-09-18T01:47:09.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.352+0000 7fdb59f1f800 1 -- start start 2024-09-18T01:47:09.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.352+0000 7fdb59f1f800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5619ffbd7620 0x5619ffd52860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.352+0000 7fdb59f1f800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5619ffbaf320 con 0x5619ffbd7620 2024-09-18T01:47:09.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.352+0000 7fdb55b95640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5619ffbd7620 0x5619ffd52860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.352+0000 7fdb55b95640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5619ffbd7620 0x5619ffd52860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37084/0 (socket says 172.21.15.146:37084) 2024-09-18T01:47:09.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.352+0000 7fdb55b95640 1 -- 172.21.15.146:0/2958854257 learned_addr learned my addr 172.21.15.146:0/2958854257 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:09.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.353+0000 7fdb55b95640 1 -- 172.21.15.146:0/2958854257 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619ffafcbc0 con 0x5619ffbd7620 2024-09-18T01:47:09.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.353+0000 7fdb55b95640 1 --2- 172.21.15.146:0/2958854257 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5619ffbd7620 0x5619ffd52860 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fdb48001d80 tx=0x7fdb48001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37643681cadd03b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.353+0000 7fda43e07640 1 -- 172.21.15.146:0/2958854257 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb48013030 con 0x5619ffbd7620 2024-09-18T01:47:09.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.353+0000 7fda43e07640 1 -- 172.21.15.146:0/2958854257 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb4800e470 con 0x5619ffbd7620 2024-09-18T01:47:09.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.353+0000 7fda43e07640 1 -- 172.21.15.146:0/2958854257 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb4800e810 con 0x5619ffbd7620 2024-09-18T01:47:09.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.354+0000 7fdb59f1f800 1 -- 172.21.15.146:0/2958854257 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5619ffbd7620 msgr2=0x5619ffd52860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.354+0000 7fdb59f1f800 1 --2- 172.21.15.146:0/2958854257 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5619ffbd7620 0x5619ffd52860 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fdb48001d80 tx=0x7fdb48001e70 comp rx=0 tx=0).stop 2024-09-18T01:47:09.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.354+0000 7fdb59f1f800 1 -- 172.21.15.146:0/2958854257 shutdown_connections 2024-09-18T01:47:09.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.354+0000 7fdb59f1f800 1 --2- 172.21.15.146:0/2958854257 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5619ffbd7620 0x5619ffd52860 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.354+0000 7fdb59f1f800 1 -- 172.21.15.146:0/2958854257 >> 172.21.15.146:0/2958854257 conn(0x5619ffc5ddd0 msgr2=0x5619ffd4e220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:09.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.354+0000 7fdb59f1f800 1 -- 172.21.15.146:0/2958854257 shutdown_connections 2024-09-18T01:47:09.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.354+0000 7fdb59f1f800 1 -- 172.21.15.146:0/2958854257 wait complete. 2024-09-18T01:47:09.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.354+0000 7fdb59f1f800 1 Processor -- start 2024-09-18T01:47:09.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.354+0000 7fdb59f1f800 1 -- start start 2024-09-18T01:47:09.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.354+0000 7fdb59f1f800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5619ffbd7620 0x5619ffd5a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.354+0000 7fdb59f1f800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5619ffc6a680 con 0x5619ffbd7620 2024-09-18T01:47:09.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.354+0000 7fdb55b95640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5619ffbd7620 0x5619ffd5a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.354+0000 7fdb55b95640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5619ffbd7620 0x5619ffd5a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37100/0 (socket says 172.21.15.146:37100) 2024-09-18T01:47:09.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.354+0000 7fdb55b95640 1 -- 172.21.15.146:0/1883283267 learned_addr learned my addr 172.21.15.146:0/1883283267 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:09.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.355+0000 7fdb55b95640 1 -- 172.21.15.146:0/1883283267 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619ffb10fe0 con 0x5619ffbd7620 2024-09-18T01:47:09.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.355+0000 7fdb55b95640 1 --2- 172.21.15.146:0/1883283267 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5619ffbd7620 0x5619ffd5a290 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fdb48004000 tx=0x7fdb48000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.355+0000 7fda42604640 1 -- 172.21.15.146:0/1883283267 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb48027070 con 0x5619ffbd7620 2024-09-18T01:47:09.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.355+0000 7fda42604640 1 -- 172.21.15.146:0/1883283267 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb48001400 con 0x5619ffbd7620 2024-09-18T01:47:09.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.355+0000 7fdb59f1f800 1 -- 172.21.15.146:0/1883283267 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5619ffd5a7d0 con 0x5619ffbd7620 2024-09-18T01:47:09.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.355+0000 7fda42604640 1 -- 172.21.15.146:0/1883283267 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb48019a70 con 0x5619ffbd7620 2024-09-18T01:47:09.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.355+0000 7fdb59f1f800 1 -- 172.21.15.146:0/1883283267 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619ffd5acf0 con 0x5619ffbd7620 2024-09-18T01:47:09.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.356+0000 7fdb59f1f800 1 Processor -- start 2024-09-18T01:47:09.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.356+0000 7fdb59f1f800 1 -- start start 2024-09-18T01:47:09.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.356+0000 7fda42604640 1 -- 172.21.15.146:0/1883283267 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fdb4802a070 con 0x5619ffbd7620 2024-09-18T01:47:09.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.356+0000 7fdb59f1f800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5619ffd67030 0x5619ffd67430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.356+0000 7fdb59f1f800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5619ffafe580 con 0x5619ffd67030 2024-09-18T01:47:09.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.356+0000 7fda42604640 1 --2- 172.21.15.146:0/1883283267 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fda3c036b40 0x7fda3c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.356+0000 7fdb56396640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5619ffd67030 0x5619ffd67430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.356+0000 7fdb56396640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5619ffd67030 0x5619ffd67430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37102/0 (socket says 172.21.15.146:37102) 2024-09-18T01:47:09.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.356+0000 7fdb56396640 1 -- 172.21.15.146:0/359865168 learned_addr learned my addr 172.21.15.146:0/359865168 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:09.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.356+0000 7fda42604640 1 -- 172.21.15.146:0/1883283267 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7fdb4801f070 con 0x5619ffbd7620 2024-09-18T01:47:09.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.356+0000 7fdb55b95640 1 --2- 172.21.15.146:0/1883283267 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fda3c036b40 0x7fda3c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.356+0000 7fdb56396640 1 -- 172.21.15.146:0/359865168 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619ffd67970 con 0x5619ffd67030 2024-09-18T01:47:09.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.357+0000 7fdb55b95640 1 --2- 172.21.15.146:0/1883283267 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fda3c036b40 0x7fda3c039000 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fdb4800c4d0 tx=0x7fdb4800c3a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.357+0000 7fdb56396640 1 --2- 172.21.15.146:0/359865168 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5619ffd67030 0x5619ffd67430 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fdb5000a430 tx=0x7fdb5000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99a1398d69107488 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.357+0000 7fda3bfff640 1 -- 172.21.15.146:0/359865168 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb50015070 con 0x5619ffd67030 2024-09-18T01:47:09.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.357+0000 7fda3bfff640 1 -- 172.21.15.146:0/359865168 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb50001670 con 0x5619ffd67030 2024-09-18T01:47:09.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.357+0000 7fda3bfff640 1 -- 172.21.15.146:0/359865168 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb50001990 con 0x5619ffd67030 2024-09-18T01:47:09.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.357+0000 7fdb59f1f800 1 -- 172.21.15.146:0/359865168 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5619ffd67030 msgr2=0x5619ffd67430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.357+0000 7fdb59f1f800 1 --2- 172.21.15.146:0/359865168 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5619ffd67030 0x5619ffd67430 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fdb5000a430 tx=0x7fdb5000a8f0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.357+0000 7fdb59f1f800 1 -- 172.21.15.146:0/359865168 shutdown_connections 2024-09-18T01:47:09.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.357+0000 7fdb59f1f800 1 --2- 172.21.15.146:0/359865168 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5619ffd67030 0x5619ffd67430 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.357+0000 7fdb59f1f800 1 -- 172.21.15.146:0/359865168 >> 172.21.15.146:0/359865168 conn(0x5619ffc67960 msgr2=0x5619ffd627b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:09.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.357+0000 7fdb59f1f800 1 -- 172.21.15.146:0/359865168 shutdown_connections 2024-09-18T01:47:09.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.357+0000 7fdb59f1f800 1 -- 172.21.15.146:0/359865168 wait complete. 2024-09-18T01:47:09.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.357+0000 7fdb59f1f800 1 Processor -- start 2024-09-18T01:47:09.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.357+0000 7fdb59f1f800 1 -- start start 2024-09-18T01:47:09.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.358+0000 7fdb59f1f800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5619ffd67030 0x5619ffd6e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.358+0000 7fdb59f1f800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5619ffd68320 con 0x5619ffd67030 2024-09-18T01:47:09.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.358+0000 7fdb56396640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5619ffd67030 0x5619ffd6e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.358+0000 7fdb56396640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5619ffd67030 0x5619ffd6e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37106/0 (socket says 172.21.15.146:37106) 2024-09-18T01:47:09.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.358+0000 7fdb56396640 1 -- 172.21.15.146:0/2857638649 learned_addr learned my addr 172.21.15.146:0/2857638649 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:09.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.358+0000 7fdb56396640 1 -- 172.21.15.146:0/2857638649 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619ffd6eb70 con 0x5619ffd67030 2024-09-18T01:47:09.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.358+0000 7fdb56396640 1 --2- 172.21.15.146:0/2857638649 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5619ffd67030 0x5619ffd6e630 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fdb5000a930 tx=0x7fdb50003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.358+0000 7fda3a7fc640 1 -- 172.21.15.146:0/2857638649 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb50020020 con 0x5619ffd67030 2024-09-18T01:47:09.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.358+0000 7fda3a7fc640 1 -- 172.21.15.146:0/2857638649 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb500108b0 con 0x5619ffd67030 2024-09-18T01:47:09.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.358+0000 7fdb59f1f800 1 -- 172.21.15.146:0/2857638649 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5619ffd6ee00 con 0x5619ffd67030 2024-09-18T01:47:09.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.358+0000 7fda3a7fc640 1 -- 172.21.15.146:0/2857638649 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb50015040 con 0x5619ffd67030 2024-09-18T01:47:09.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.359+0000 7fdb59f1f800 1 -- 172.21.15.146:0/2857638649 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619ffd71ab0 con 0x5619ffd67030 2024-09-18T01:47:09.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.359+0000 7fda3a7fc640 1 -- 172.21.15.146:0/2857638649 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fdb50023020 con 0x5619ffd67030 2024-09-18T01:47:09.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.359+0000 7fda3a7fc640 1 --2- 172.21.15.146:0/2857638649 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fda30036b40 0x7fda30039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.359+0000 7fda3a7fc640 1 -- 172.21.15.146:0/2857638649 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7fdb5004c3b0 con 0x5619ffd67030 2024-09-18T01:47:09.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.360+0000 7fdb55394640 1 --2- 172.21.15.146:0/2857638649 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fda30036b40 0x7fda30039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.360+0000 7fdb59f1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:47:09.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.360+0000 7fdb59f1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:47:09.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.360+0000 7fdb55394640 1 --2- 172.21.15.146:0/2857638649 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fda30036b40 0x7fda30039000 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c057000 tx=0x7fdb4c052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.360+0000 7fdb59f1f800 1 Processor -- start 2024-09-18T01:47:09.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.360+0000 7fdb59f1f800 1 -- start start 2024-09-18T01:47:09.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.360+0000 7fdb59f1f800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5619ffd88640 0x5619ffd88a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.360+0000 7fdb59f1f800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5619ffd53010 con 0x5619ffd88640 2024-09-18T01:47:09.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.361+0000 7fdb55b95640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5619ffd88640 0x5619ffd88a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.361+0000 7fdb55b95640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5619ffd88640 0x5619ffd88a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37116/0 (socket says 172.21.15.146:37116) 2024-09-18T01:47:09.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.361+0000 7fdb55b95640 1 -- 172.21.15.146:0/2206240098 learned_addr learned my addr 172.21.15.146:0/2206240098 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:09.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.361+0000 7fdb55b95640 1 -- 172.21.15.146:0/2206240098 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619ffd89030 con 0x5619ffd88640 2024-09-18T01:47:09.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.361+0000 7fdb55b95640 1 --2- 172.21.15.146:0/2206240098 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5619ffd88640 0x5619ffd88a60 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fdb4804ad50 tx=0x7fdb4804ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.361+0000 7fda1a7e4640 1 -- 172.21.15.146:0/2206240098 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb4804c0b0 con 0x5619ffd88640 2024-09-18T01:47:09.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.361+0000 7fda1a7e4640 1 -- 172.21.15.146:0/2206240098 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb48047070 con 0x5619ffd88640 2024-09-18T01:47:09.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.361+0000 7fdb59f1f800 1 -- 172.21.15.146:0/2206240098 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5619ffd8bc80 con 0x5619ffd88640 2024-09-18T01:47:09.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.361+0000 7fda1a7e4640 1 -- 172.21.15.146:0/2206240098 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb4804c3c0 con 0x5619ffd88640 2024-09-18T01:47:09.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.361+0000 7fdb59f1f800 1 -- 172.21.15.146:0/2206240098 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619ffd8c060 con 0x5619ffd88640 2024-09-18T01:47:09.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.362+0000 7fda1a7e4640 1 -- 172.21.15.146:0/2206240098 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fdb48016070 con 0x5619ffd88640 2024-09-18T01:47:09.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.362+0000 7fda1a7e4640 1 --2- 172.21.15.146:0/2206240098 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd998036b40 0x7fd998039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.362+0000 7fda1a7e4640 1 -- 172.21.15.146:0/2206240098 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7fdb48014070 con 0x5619ffd88640 2024-09-18T01:47:09.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.362+0000 7fdb55394640 1 --2- 172.21.15.146:0/2206240098 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd998036b40 0x7fd998039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.362+0000 7fd98bfff640 20 reqs_thread_entry: start 2024-09-18T01:47:09.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.362+0000 7fdb59f1f800 1 --2- 172.21.15.146:0/1883283267 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5619ffd96040 0x5619ffd98430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.362+0000 7fdb59f1f800 1 -- 172.21.15.146:0/1883283267 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5619ffd98ab0 con 0x5619ffd96040 2024-09-18T01:47:09.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.363+0000 7fdb55394640 1 --2- 172.21.15.146:0/2206240098 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd998036b40 0x7fd998039000 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c045f20 tx=0x7fdb4c005a00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.363+0000 7fdb56396640 1 --2- 172.21.15.146:0/1883283267 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5619ffd96040 0x5619ffd98430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.363+0000 7fdb56396640 1 --2- 172.21.15.146:0/1883283267 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5619ffd96040 0x5619ffd98430 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.363+0000 7fdb56396640 1 -- 172.21.15.146:0/1883283267 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb5000e070 con 0x5619ffd96040 2024-09-18T01:47:09.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.363+0000 7fdb59f1f800 1 -- 172.21.15.146:0/1883283267 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5619ffd99390 con 0x5619ffd96040 2024-09-18T01:47:09.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.363+0000 7fdb56396640 1 -- 172.21.15.146:0/1883283267 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdb5000e070 con 0x5619ffd96040 2024-09-18T01:47:09.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.363+0000 7fdb59f1f800 1 -- 172.21.15.146:0/1883283267 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5619ffd9a740 con 0x5619ffd96040 2024-09-18T01:47:09.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.364+0000 7fdb56396640 1 -- 172.21.15.146:0/1883283267 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdb5000e070 con 0x5619ffd96040 2024-09-18T01:47:09.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.364+0000 7fdb59f1f800 1 -- 172.21.15.146:0/1883283267 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5619ffda75a0 con 0x5619ffd96040 2024-09-18T01:47:09.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.364+0000 7fdb56396640 1 -- 172.21.15.146:0/1883283267 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb5000e070 con 0x5619ffd96040 2024-09-18T01:47:09.378 INFO:teuthology.orchestra.run.smithi146.stderr:NOTICE: set zone's realm_id= 2024-09-18T01:47:09.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.364+0000 7fdb59f1f800 1 --2- 172.21.15.146:0/1883283267 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5619ffd9b1a0 0x5619ffda18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.364+0000 7fdb59f1f800 1 -- 172.21.15.146:0/1883283267 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:5 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5619ffd9e9a0 con 0x5619ffd9b1a0 2024-09-18T01:47:09.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.364+0000 7fdb55b95640 1 --2- 172.21.15.146:0/1883283267 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5619ffd9b1a0 0x5619ffda18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.364+0000 7fdb55b95640 1 --2- 172.21.15.146:0/1883283267 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5619ffd9b1a0 0x5619ffda18d0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.365+0000 7fdb55b95640 1 -- 172.21.15.146:0/1883283267 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(5 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb48029030 con 0x5619ffd9b1a0 2024-09-18T01:47:09.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.365+0000 7fdb55b95640 1 --2- 172.21.15.146:0/1883283267 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fdb48042070 0x7fdb48021700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.365+0000 7fdb55b95640 1 -- 172.21.15.146:0/1883283267 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:6 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5619ffd9e9a0 con 0x7fdb48042070 2024-09-18T01:47:09.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.365+0000 7fdb55394640 1 --2- 172.21.15.146:0/1883283267 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fdb48042070 0x7fdb48021700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.365+0000 7fdb55394640 1 --2- 172.21.15.146:0/1883283267 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fdb48042070 0x7fdb48021700 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.365+0000 7fdb55394640 1 -- 172.21.15.146:0/1883283267 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb4c051070 con 0x7fdb48042070 2024-09-18T01:47:09.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.365+0000 7fdb55394640 1 --2- 172.21.15.146:0/1883283267 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fdb4c078040 0x7fdb4c078420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.365+0000 7fdb55394640 1 -- 172.21.15.146:0/1883283267 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:7 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5619ffd9e9a0 con 0x7fdb4c078040 2024-09-18T01:47:09.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.366+0000 7fdb56396640 1 --2- 172.21.15.146:0/1883283267 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fdb4c078040 0x7fdb4c078420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.366+0000 7fdb56396640 1 --2- 172.21.15.146:0/1883283267 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fdb4c078040 0x7fdb4c078420 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.366+0000 7fdb56396640 1 -- 172.21.15.146:0/1883283267 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb5000e070 con 0x7fdb4c078040 2024-09-18T01:47:09.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.366+0000 7fdb56396640 1 -- 172.21.15.146:0/1883283267 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:8 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5619ffd9e9a0 con 0x5619ffd96040 2024-09-18T01:47:09.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.367+0000 7fdb56396640 1 -- 172.21.15.146:0/1883283267 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(8 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdb5000e070 con 0x5619ffd96040 2024-09-18T01:47:09.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.367+0000 7fdb56396640 1 -- 172.21.15.146:0/1883283267 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5619ffd9e9a0 con 0x5619ffd96040 2024-09-18T01:47:09.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.367+0000 7fdb56396640 1 -- 172.21.15.146:0/1883283267 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb5000e070 con 0x5619ffd96040 2024-09-18T01:47:09.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.367+0000 7fdb56396640 1 -- 172.21.15.146:0/1883283267 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:10 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5619ffd9e9a0 con 0x7fdb4c078040 2024-09-18T01:47:09.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.367+0000 7fdb56396640 1 -- 172.21.15.146:0/1883283267 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb5000e070 con 0x7fdb4c078040 2024-09-18T01:47:09.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.367+0000 7fdb56396640 1 -- 172.21.15.146:0/1883283267 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5619ffd9e9a0 con 0x7fdb4c078040 2024-09-18T01:47:09.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.367+0000 7fdb56396640 1 -- 172.21.15.146:0/1883283267 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb5000e070 con 0x7fdb4c078040 2024-09-18T01:47:09.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.367+0000 7fdb56396640 1 -- 172.21.15.146:0/1883283267 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:12 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5619ffd9e9a0 con 0x7fdb48042070 2024-09-18T01:47:09.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.368+0000 7fdb55394640 1 -- 172.21.15.146:0/1883283267 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb4c051070 con 0x7fdb48042070 2024-09-18T01:47:09.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.368+0000 7fdb55394640 1 -- 172.21.15.146:0/1883283267 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:13 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5619ffd9e9a0 con 0x5619ffd9b1a0 2024-09-18T01:47:09.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.368+0000 7fdb55b95640 1 -- 172.21.15.146:0/1883283267 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb48029030 con 0x5619ffd9b1a0 2024-09-18T01:47:09.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.368+0000 7fdb55b95640 1 -- 172.21.15.146:0/1883283267 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:14 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5619ffd9e9a0 con 0x5619ffd96040 2024-09-18T01:47:09.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.368+0000 7fdb56396640 1 -- 172.21.15.146:0/1883283267 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb5000e070 con 0x5619ffd96040 2024-09-18T01:47:09.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.368+0000 7fdb56396640 1 -- 172.21.15.146:0/1883283267 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:15 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5619ffd9e9a0 con 0x7fdb4c078040 2024-09-18T01:47:09.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.368+0000 7fdb56396640 1 -- 172.21.15.146:0/1883283267 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb5000e070 con 0x7fdb4c078040 2024-09-18T01:47:09.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.368+0000 7fdb56396640 1 -- 172.21.15.146:0/1883283267 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:16 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5619ffd9e9a0 con 0x5619ffd96040 2024-09-18T01:47:09.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.369+0000 7fdb56396640 1 -- 172.21.15.146:0/1883283267 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb5000e070 con 0x5619ffd96040 2024-09-18T01:47:09.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.369+0000 7fdb56396640 1 -- 172.21.15.146:0/1883283267 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:17 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5619ffd9e9a0 con 0x7fdb48042070 2024-09-18T01:47:09.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.369+0000 7fdb55394640 1 -- 172.21.15.146:0/1883283267 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(17 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fdb4c051070 con 0x7fdb48042070 2024-09-18T01:47:09.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.369+0000 7fdb55394640 1 -- 172.21.15.146:0/1883283267 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:18 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5619ffd9e9a0 con 0x5619ffd9b1a0 2024-09-18T01:47:09.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.369+0000 7fdb55b95640 1 -- 172.21.15.146:0/1883283267 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb48029030 con 0x5619ffd9b1a0 2024-09-18T01:47:09.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.369+0000 7fdb55b95640 1 -- 172.21.15.146:0/1883283267 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5619ffd9e9a0 con 0x5619ffd9b1a0 2024-09-18T01:47:09.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.369+0000 7fdb55b95640 1 -- 172.21.15.146:0/1883283267 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb48029030 con 0x5619ffd9b1a0 2024-09-18T01:47:09.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.369+0000 7fdb55b95640 1 -- 172.21.15.146:0/1883283267 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:20 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5619ffd9e9a0 con 0x7fdb4c078040 2024-09-18T01:47:09.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.370+0000 7fdb56396640 1 -- 172.21.15.146:0/1883283267 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb5000e070 con 0x7fdb4c078040 2024-09-18T01:47:09.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.370+0000 7fdb56396640 1 -- 172.21.15.146:0/1883283267 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:21 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5619ffd9e9a0 con 0x5619ffd9b1a0 2024-09-18T01:47:09.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.370+0000 7fdb55b95640 1 -- 172.21.15.146:0/1883283267 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb48029030 con 0x5619ffd9b1a0 2024-09-18T01:47:09.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.370+0000 7fdb55b95640 1 -- 172.21.15.146:0/1883283267 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5619ffd9e9a0 con 0x5619ffd9b1a0 2024-09-18T01:47:09.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.370+0000 7fdb55b95640 1 -- 172.21.15.146:0/1883283267 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb48029030 con 0x5619ffd9b1a0 2024-09-18T01:47:09.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.370+0000 7fdb55b95640 1 -- 172.21.15.146:0/1883283267 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:23 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5619ffd9e9a0 con 0x5619ffd96040 2024-09-18T01:47:09.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.370+0000 7fdb56396640 1 -- 172.21.15.146:0/1883283267 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb5000e070 con 0x5619ffd96040 2024-09-18T01:47:09.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.370+0000 7fdb56396640 1 -- 172.21.15.146:0/1883283267 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5619ffd9e9a0 con 0x5619ffd96040 2024-09-18T01:47:09.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.371+0000 7fdb56396640 1 -- 172.21.15.146:0/1883283267 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdb5000e070 con 0x5619ffd96040 2024-09-18T01:47:09.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.371+0000 7fdb56396640 1 -- 172.21.15.146:0/1883283267 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:25 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5619ffd9e9a0 con 0x7fdb4c078040 2024-09-18T01:47:09.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.371+0000 7fdb56396640 1 -- 172.21.15.146:0/1883283267 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb5000e070 con 0x7fdb4c078040 2024-09-18T01:47:09.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.371+0000 7fdb56396640 1 -- 172.21.15.146:0/1883283267 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:26 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5619ffd9e9a0 con 0x5619ffd9b1a0 2024-09-18T01:47:09.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.371+0000 7fdb55b95640 1 -- 172.21.15.146:0/1883283267 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb48029030 con 0x5619ffd9b1a0 2024-09-18T01:47:09.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.371+0000 7fdb55b95640 1 -- 172.21.15.146:0/1883283267 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:27 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5619ffd9e9a0 con 0x7fdb48042070 2024-09-18T01:47:09.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.371+0000 7fdb55394640 1 -- 172.21.15.146:0/1883283267 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb4c051070 con 0x7fdb48042070 2024-09-18T01:47:09.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.371+0000 7fdb55394640 1 -- 172.21.15.146:0/1883283267 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:28 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5619ffd9e9a0 con 0x5619ffd96040 2024-09-18T01:47:09.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.372+0000 7fdb56396640 1 -- 172.21.15.146:0/1883283267 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb5000e070 con 0x5619ffd96040 2024-09-18T01:47:09.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.372+0000 7fdb56396640 1 -- 172.21.15.146:0/1883283267 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:29 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5619ffd9e9a0 con 0x7fdb4c078040 2024-09-18T01:47:09.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.372+0000 7fdb56396640 1 -- 172.21.15.146:0/1883283267 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb5000e070 con 0x7fdb4c078040 2024-09-18T01:47:09.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.372+0000 7fdb56396640 1 -- 172.21.15.146:0/1883283267 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:30 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5619ffd9e9a0 con 0x5619ffd9b1a0 2024-09-18T01:47:09.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.372+0000 7fdb55b95640 1 -- 172.21.15.146:0/1883283267 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb48029030 con 0x5619ffd9b1a0 2024-09-18T01:47:09.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.372+0000 7fdb55b95640 1 -- 172.21.15.146:0/1883283267 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:31 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5619ffd9e9a0 con 0x7fdb4c078040 2024-09-18T01:47:09.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.372+0000 7fdb56396640 1 -- 172.21.15.146:0/1883283267 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb5000e070 con 0x7fdb4c078040 2024-09-18T01:47:09.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.372+0000 7fdb56396640 1 -- 172.21.15.146:0/1883283267 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:32 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5619ffd9e9a0 con 0x7fdb48042070 2024-09-18T01:47:09.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.373+0000 7fdb55394640 1 -- 172.21.15.146:0/1883283267 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb4c051070 con 0x7fdb48042070 2024-09-18T01:47:09.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.373+0000 7fdb55394640 1 -- 172.21.15.146:0/1883283267 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:33 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5619ffd9e9a0 con 0x5619ffd9b1a0 2024-09-18T01:47:09.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.373+0000 7fdb55b95640 1 -- 172.21.15.146:0/1883283267 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb48029030 con 0x5619ffd9b1a0 2024-09-18T01:47:09.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.373+0000 7fdb55b95640 1 -- 172.21.15.146:0/1883283267 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:34 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5619ffd9e9a0 con 0x7fdb4c078040 2024-09-18T01:47:09.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.373+0000 7fdb56396640 1 -- 172.21.15.146:0/1883283267 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb5000e070 con 0x7fdb4c078040 2024-09-18T01:47:09.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.373+0000 7fdb56396640 1 -- 172.21.15.146:0/1883283267 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:35 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5619ffd9e9a0 con 0x5619ffd96040 2024-09-18T01:47:09.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.373+0000 7fdb56396640 1 -- 172.21.15.146:0/1883283267 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(35 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdb5000e070 con 0x5619ffd96040 2024-09-18T01:47:09.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.373+0000 7fdb56396640 1 -- 172.21.15.146:0/1883283267 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:36 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5619ffd9e9a0 con 0x7fdb48042070 2024-09-18T01:47:09.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.374+0000 7fdb55394640 1 -- 172.21.15.146:0/1883283267 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(36 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb4c051070 con 0x7fdb48042070 2024-09-18T01:47:09.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.374+0000 7fdb59f1f800 1 -- 172.21.15.146:0/1883283267 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:37 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5619ffda1450 con 0x5619ffd96040 2024-09-18T01:47:09.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.374+0000 7fdb56396640 1 -- 172.21.15.146:0/1883283267 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(37 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdb5000e070 con 0x5619ffd96040 2024-09-18T01:47:09.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.374+0000 7fdb59f1f800 1 -- 172.21.15.146:0/1883283267 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5619ffda54b0 con 0x5619ffd96040 2024-09-18T01:47:09.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.374+0000 7fdb56396640 1 -- 172.21.15.146:0/1883283267 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdb5000e070 con 0x5619ffd96040 2024-09-18T01:47:09.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.374+0000 7fdb59f1f800 1 -- 172.21.15.146:0/1883283267 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [create,call version.set in=58b,writefull 0~1155 in=1155b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5619ffda0ce0 con 0x5619ffd96040 2024-09-18T01:47:09.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.375+0000 7fdb56396640 1 -- 172.21.15.146:0/1883283267 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [create,call,writefull 0~1155] v33'3 uv3 ondisk = 0) ==== 274+0+0 (crc 0 0 0) 0x7fdb5000e070 con 0x5619ffd96040 2024-09-18T01:47:09.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.375+0000 7fdb59f1f800 1 -- 172.21.15.146:0/1883283267 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:40 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=58b,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5619ffda2a80 con 0x5619ffd96040 2024-09-18T01:47:09.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.377+0000 7fdb56396640 1 -- 172.21.15.146:0/1883283267 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(40 zone_names.default [create,call,writefull 0~46] v33'3 uv3 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7fdb5000e070 con 0x5619ffd96040 2024-09-18T01:47:09.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.377+0000 7fdb59f1f800 1 -- 172.21.15.146:0/1883283267 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:41 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5619ffda2a80 con 0x5619ffd96040 2024-09-18T01:47:09.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.379+0000 7fdb56396640 1 -- 172.21.15.146:0/1883283267 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(41 default.zone. [create,writefull 0~46] v33'2 uv1 ondisk = -17 ((17) File exists)) ==== 199+0+0 (crc 0 0 0) 0x7fdb5000e070 con 0x5619ffd96040 2024-09-18T01:47:09.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.380+0000 7fdb59f1f800 1 -- 172.21.15.146:0/2857638649 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fda30036b40 msgr2=0x7fda30039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.380+0000 7fdb59f1f800 1 --2- 172.21.15.146:0/2857638649 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fda30036b40 0x7fda30039000 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c057000 tx=0x7fdb4c052000 comp rx=0 tx=0).stop 2024-09-18T01:47:09.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.380+0000 7fdb59f1f800 1 -- 172.21.15.146:0/2857638649 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5619ffd67030 msgr2=0x5619ffd6e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.380+0000 7fdb59f1f800 1 --2- 172.21.15.146:0/2857638649 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5619ffd67030 0x5619ffd6e630 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fdb5000a930 tx=0x7fdb50003370 comp rx=0 tx=0).stop 2024-09-18T01:47:09.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.380+0000 7fdb59f1f800 1 -- 172.21.15.146:0/2857638649 shutdown_connections 2024-09-18T01:47:09.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.380+0000 7fdb59f1f800 1 --2- 172.21.15.146:0/2857638649 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fda30036b40 0x7fda30039000 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.380+0000 7fdb59f1f800 1 --2- 172.21.15.146:0/2857638649 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5619ffd67030 0x5619ffd6e630 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.380+0000 7fdb59f1f800 1 -- 172.21.15.146:0/2857638649 >> 172.21.15.146:0/2857638649 conn(0x5619ffc67960 msgr2=0x5619ffd62380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:09.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.380+0000 7fdb59f1f800 1 -- 172.21.15.146:0/2857638649 shutdown_connections 2024-09-18T01:47:09.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.380+0000 7fdb59f1f800 1 -- 172.21.15.146:0/2857638649 wait complete. 2024-09-18T01:47:09.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.380+0000 7fdb59f1f800 1 -- 172.21.15.146:0/2206240098 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd998036b40 msgr2=0x7fd998039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.380+0000 7fdb59f1f800 1 --2- 172.21.15.146:0/2206240098 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd998036b40 0x7fd998039000 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c045f20 tx=0x7fdb4c005a00 comp rx=0 tx=0).stop 2024-09-18T01:47:09.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.380+0000 7fdb59f1f800 1 -- 172.21.15.146:0/2206240098 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5619ffd88640 msgr2=0x5619ffd88a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.380+0000 7fdb59f1f800 1 --2- 172.21.15.146:0/2206240098 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5619ffd88640 0x5619ffd88a60 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fdb4804ad50 tx=0x7fdb4804ace0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.381+0000 7fdb59f1f800 1 -- 172.21.15.146:0/2206240098 shutdown_connections 2024-09-18T01:47:09.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.381+0000 7fdb59f1f800 1 --2- 172.21.15.146:0/2206240098 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd998036b40 0x7fd998039000 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.381+0000 7fdb59f1f800 1 --2- 172.21.15.146:0/2206240098 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5619ffd88640 0x5619ffd88a60 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.381+0000 7fdb59f1f800 1 -- 172.21.15.146:0/2206240098 >> 172.21.15.146:0/2206240098 conn(0x5619ffd7d5a0 msgr2=0x5619ffd7fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:09.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.381+0000 7fdb59f1f800 1 -- 172.21.15.146:0/2206240098 shutdown_connections 2024-09-18T01:47:09.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.381+0000 7fdb59f1f800 1 -- 172.21.15.146:0/2206240098 wait complete. 2024-09-18T01:47:09.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.381+0000 7fdb59f1f800 1 -- 172.21.15.146:0/1883283267 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fdb4c078040 msgr2=0x7fdb4c078420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.381+0000 7fdb59f1f800 1 --2- 172.21.15.146:0/1883283267 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fdb4c078040 0x7fdb4c078420 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.381+0000 7fdb59f1f800 1 -- 172.21.15.146:0/1883283267 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5619ffd96040 msgr2=0x5619ffd98430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.381+0000 7fdb59f1f800 1 --2- 172.21.15.146:0/1883283267 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5619ffd96040 0x5619ffd98430 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.381+0000 7fdb59f1f800 1 -- 172.21.15.146:0/1883283267 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fdb48042070 msgr2=0x7fdb48021700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.381+0000 7fdb59f1f800 1 --2- 172.21.15.146:0/1883283267 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fdb48042070 0x7fdb48021700 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.381+0000 7fdb59f1f800 1 -- 172.21.15.146:0/1883283267 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5619ffd9b1a0 msgr2=0x5619ffda18d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.381+0000 7fdb59f1f800 1 --2- 172.21.15.146:0/1883283267 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5619ffd9b1a0 0x5619ffda18d0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.381+0000 7fdb59f1f800 1 -- 172.21.15.146:0/1883283267 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fda3c036b40 msgr2=0x7fda3c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.381+0000 7fdb59f1f800 1 --2- 172.21.15.146:0/1883283267 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fda3c036b40 0x7fda3c039000 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fdb4800c4d0 tx=0x7fdb4800c3a0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.381+0000 7fdb59f1f800 1 -- 172.21.15.146:0/1883283267 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5619ffbd7620 msgr2=0x5619ffd5a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.381+0000 7fdb59f1f800 1 --2- 172.21.15.146:0/1883283267 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5619ffbd7620 0x5619ffd5a290 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fdb48004000 tx=0x7fdb48000bc0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.381+0000 7fdb56396640 1 -- 172.21.15.146:0/1883283267 reap_dead start 2024-09-18T01:47:09.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.381+0000 7fdb56396640 1 -- 172.21.15.146:0/1883283267 reap_dead start 2024-09-18T01:47:09.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.381+0000 7fdb59f1f800 1 -- 172.21.15.146:0/1883283267 shutdown_connections 2024-09-18T01:47:09.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.381+0000 7fdb59f1f800 1 -- 172.21.15.146:0/1883283267 >> 172.21.15.146:0/1883283267 conn(0x5619ffc5ddd0 msgr2=0x5619ffd4ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:09.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.381+0000 7fdb59f1f800 1 -- 172.21.15.146:0/1883283267 shutdown_connections 2024-09-18T01:47:09.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.381+0000 7fdb59f1f800 1 -- 172.21.15.146:0/1883283267 wait complete. 2024-09-18T01:47:09.390 INFO:teuthology.orchestra.run.smithi146.stdout:{"id":"8ac01ed4-7422-45e2-b799-bf55088fb4fc","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-18T01:47:09.391 DEBUG:tasks.util.rgw: json result: {'id': '8ac01ed4-7422-45e2-b799-bf55088fb4fc', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-18T01:47:09.391 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get'] 2024-09-18T01:47:09.391 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get'] 2024-09-18T01:47:09.391 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get 2024-09-18T01:47:09.473 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:47:09.473 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:47:09.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.473+0000 7fcdc3834800 1 Processor -- start 2024-09-18T01:47:09.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.473+0000 7fcdc3834800 1 -- start start 2024-09-18T01:47:09.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.473+0000 7fcdc3834800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55afdddc1980 0x55afdddc3d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.473+0000 7fcdc3834800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55afddc7db30 con 0x55afdddbd540 2024-09-18T01:47:09.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.473+0000 7fcdc3834800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x55afddc5f360 con 0x55afdddc1980 2024-09-18T01:47:09.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.474+0000 7fcdb7fff640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55afdddc1980 0x55afdddc3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.474+0000 7fcdbeb4b640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x55afdddbd540 0x55afdddbd940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:53024/0 (socket says 172.21.15.146:53024) 2024-09-18T01:47:09.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.474+0000 7fcdbeb4b640 1 -- 172.21.15.146:0/3006889471 learned_addr learned my addr 172.21.15.146:0/3006889471 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:47:09.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.474+0000 7fcdb7fff640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55afdddc1980 0x55afdddc3d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37132/0 (socket says 172.21.15.146:37132) 2024-09-18T01:47:09.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.474+0000 7fcdb7fff640 1 -- 172.21.15.146:0/3006889471 >> v1:172.21.15.129:6789/0 conn(0x55afdddbd540 legacy=0x55afdddbd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.474+0000 7fcdbe34a640 1 -- 172.21.15.146:0/3006889471 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3481007195 0 0) 0x55afddc7db30 con 0x55afdddbd540 2024-09-18T01:47:09.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.474+0000 7fcdb7fff640 1 -- 172.21.15.146:0/3006889471 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afddc85e00 con 0x55afdddc1980 2024-09-18T01:47:09.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.476+0000 7fcdb7fff640 1 --2- 172.21.15.146:0/3006889471 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55afdddc1980 0x55afdddc3d70 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fcda800a470 tx=0x7fcda8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=191fa511749e06fb server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.476+0000 7fcdbe34a640 1 -- 172.21.15.146:0/3006889471 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcda8053570 con 0x55afdddc1980 2024-09-18T01:47:09.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.476+0000 7fcdbe34a640 1 -- 172.21.15.146:0/3006889471 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcda8058070 con 0x55afdddc1980 2024-09-18T01:47:09.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.476+0000 7fcdbe34a640 1 -- 172.21.15.146:0/3006889471 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcda8053880 con 0x55afdddc1980 2024-09-18T01:47:09.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.477+0000 7fcdc3834800 1 -- 172.21.15.146:0/3006889471 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55afdddc1980 msgr2=0x55afdddc3d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.477+0000 7fcdc3834800 1 --2- 172.21.15.146:0/3006889471 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55afdddc1980 0x55afdddc3d70 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fcda800a470 tx=0x7fcda8045a20 comp rx=0 tx=0).stop 2024-09-18T01:47:09.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.477+0000 7fcdc3834800 1 -- 172.21.15.146:0/3006889471 shutdown_connections 2024-09-18T01:47:09.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.477+0000 7fcdc3834800 1 --2- 172.21.15.146:0/3006889471 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55afdddc1980 0x55afdddc3d70 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.477+0000 7fcdc3834800 1 -- 172.21.15.146:0/3006889471 >> 172.21.15.146:0/3006889471 conn(0x55afdddb8dd0 msgr2=0x55afdddbb1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:09.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.477+0000 7fcdc3834800 1 -- 172.21.15.146:0/3006889471 shutdown_connections 2024-09-18T01:47:09.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.477+0000 7fcdc3834800 1 -- 172.21.15.146:0/3006889471 wait complete. 2024-09-18T01:47:09.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.490+0000 7fcdc3834800 1 Processor -- start 2024-09-18T01:47:09.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.491+0000 7fcdc3834800 1 -- start start 2024-09-18T01:47:09.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.491+0000 7fcdc3834800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55afdddbd540 0x55afddeac590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.491+0000 7fcdc3834800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55afddd0a320 con 0x55afdddbd540 2024-09-18T01:47:09.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.491+0000 7fcdbeb4b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55afdddbd540 0x55afddeac590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.491+0000 7fcdbeb4b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55afdddbd540 0x55afddeac590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37136/0 (socket says 172.21.15.146:37136) 2024-09-18T01:47:09.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.491+0000 7fcdbeb4b640 1 -- 172.21.15.146:0/731726163 learned_addr learned my addr 172.21.15.146:0/731726163 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:09.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.491+0000 7fcdbeb4b640 1 -- 172.21.15.146:0/731726163 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afddc57bc0 con 0x55afdddbd540 2024-09-18T01:47:09.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.491+0000 7fcdbeb4b640 1 --2- 172.21.15.146:0/731726163 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55afdddbd540 0x55afddeac590 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fcdb000d450 tx=0x7fcdb000d540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=382a951e069e3195 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.492+0000 7fccace09640 1 -- 172.21.15.146:0/731726163 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdb000a420 con 0x55afdddbd540 2024-09-18T01:47:09.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.492+0000 7fccace09640 1 -- 172.21.15.146:0/731726163 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdb000a5c0 con 0x55afdddbd540 2024-09-18T01:47:09.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.492+0000 7fccace09640 1 -- 172.21.15.146:0/731726163 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdb000a920 con 0x55afdddbd540 2024-09-18T01:47:09.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.492+0000 7fcdc3834800 1 -- 172.21.15.146:0/731726163 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55afdddbd540 msgr2=0x55afddeac590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.492+0000 7fcdc3834800 1 --2- 172.21.15.146:0/731726163 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55afdddbd540 0x55afddeac590 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fcdb000d450 tx=0x7fcdb000d540 comp rx=0 tx=0).stop 2024-09-18T01:47:09.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.492+0000 7fcdc3834800 1 -- 172.21.15.146:0/731726163 shutdown_connections 2024-09-18T01:47:09.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.492+0000 7fcdc3834800 1 --2- 172.21.15.146:0/731726163 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55afdddbd540 0x55afddeac590 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.492+0000 7fcdc3834800 1 -- 172.21.15.146:0/731726163 >> 172.21.15.146:0/731726163 conn(0x55afdddb8dd0 msgr2=0x55afddea7f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:09.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.492+0000 7fcdc3834800 1 -- 172.21.15.146:0/731726163 shutdown_connections 2024-09-18T01:47:09.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.492+0000 7fcdc3834800 1 -- 172.21.15.146:0/731726163 wait complete. 2024-09-18T01:47:09.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.493+0000 7fcdc3834800 1 Processor -- start 2024-09-18T01:47:09.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.493+0000 7fcdc3834800 1 -- start start 2024-09-18T01:47:09.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.493+0000 7fcdc3834800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55afdddbd540 0x55afddeb72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.493+0000 7fcdc3834800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55afdddc45b0 con 0x55afdddbd540 2024-09-18T01:47:09.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.493+0000 7fcdbeb4b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55afdddbd540 0x55afddeb72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.493+0000 7fcdbeb4b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55afdddbd540 0x55afddeb72d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37140/0 (socket says 172.21.15.146:37140) 2024-09-18T01:47:09.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.493+0000 7fcdbeb4b640 1 -- 172.21.15.146:0/3427592605 learned_addr learned my addr 172.21.15.146:0/3427592605 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:09.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.493+0000 7fcdbeb4b640 1 -- 172.21.15.146:0/3427592605 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afddc6bfe0 con 0x55afdddbd540 2024-09-18T01:47:09.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.493+0000 7fcdbeb4b640 1 --2- 172.21.15.146:0/3427592605 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55afdddbd540 0x55afddeb72d0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x55afddead3f0 tx=0x7fcdb0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.494+0000 7fccab606640 1 -- 172.21.15.146:0/3427592605 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdb0021550 con 0x55afdddbd540 2024-09-18T01:47:09.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.494+0000 7fccab606640 1 -- 172.21.15.146:0/3427592605 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdb00216f0 con 0x55afdddbd540 2024-09-18T01:47:09.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.494+0000 7fccab606640 1 -- 172.21.15.146:0/3427592605 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdb0021a10 con 0x55afdddbd540 2024-09-18T01:47:09.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.494+0000 7fcdc3834800 1 -- 172.21.15.146:0/3427592605 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55afddeb7810 con 0x55afdddbd540 2024-09-18T01:47:09.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.494+0000 7fcdc3834800 1 -- 172.21.15.146:0/3427592605 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55afddeb7d30 con 0x55afdddbd540 2024-09-18T01:47:09.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.494+0000 7fcdc3834800 1 Processor -- start 2024-09-18T01:47:09.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.494+0000 7fcdc3834800 1 -- start start 2024-09-18T01:47:09.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.495+0000 7fccab606640 1 -- 172.21.15.146:0/3427592605 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fcdb0008030 con 0x55afdddbd540 2024-09-18T01:47:09.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.495+0000 7fcdc3834800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55afddec4070 0x55afddec4470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.495+0000 7fcdc3834800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55afddc59580 con 0x55afddec4070 2024-09-18T01:47:09.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.495+0000 7fccab606640 1 --2- 172.21.15.146:0/3427592605 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fcca4036b90 0x7fcca4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.495+0000 7fcdbf34c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55afddec4070 0x55afddec4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.495+0000 7fcdbf34c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55afddec4070 0x55afddec4470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37152/0 (socket says 172.21.15.146:37152) 2024-09-18T01:47:09.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.495+0000 7fcdbf34c640 1 -- 172.21.15.146:0/2310399809 learned_addr learned my addr 172.21.15.146:0/2310399809 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:09.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.495+0000 7fccab606640 1 -- 172.21.15.146:0/3427592605 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7fcdb001d070 con 0x55afdddbd540 2024-09-18T01:47:09.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.495+0000 7fcdbeb4b640 1 --2- 172.21.15.146:0/3427592605 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fcca4036b90 0x7fcca4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.495+0000 7fcdbf34c640 1 -- 172.21.15.146:0/2310399809 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afddec49b0 con 0x55afddec4070 2024-09-18T01:47:09.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.495+0000 7fcdbeb4b640 1 --2- 172.21.15.146:0/3427592605 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fcca4036b90 0x7fcca4039050 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fcdb0016fb0 tx=0x7fcdb000af30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.495+0000 7fcdbf34c640 1 --2- 172.21.15.146:0/2310399809 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55afddec4070 0x55afddec4470 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fcdb800a430 tx=0x7fcdb800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dc0f06cf4cdf8bd server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.495+0000 7fcca9602640 1 -- 172.21.15.146:0/2310399809 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdb8015070 con 0x55afddec4070 2024-09-18T01:47:09.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.495+0000 7fcca9602640 1 -- 172.21.15.146:0/2310399809 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdb8001670 con 0x55afddec4070 2024-09-18T01:47:09.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.495+0000 7fcca9602640 1 -- 172.21.15.146:0/2310399809 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdb8001990 con 0x55afddec4070 2024-09-18T01:47:09.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.496+0000 7fcdc3834800 1 -- 172.21.15.146:0/2310399809 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55afddec4070 msgr2=0x55afddec4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.496+0000 7fcdc3834800 1 --2- 172.21.15.146:0/2310399809 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55afddec4070 0x55afddec4470 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fcdb800a430 tx=0x7fcdb800a8f0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.496+0000 7fcdc3834800 1 -- 172.21.15.146:0/2310399809 shutdown_connections 2024-09-18T01:47:09.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.496+0000 7fcdc3834800 1 --2- 172.21.15.146:0/2310399809 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55afddec4070 0x55afddec4470 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.496+0000 7fcdc3834800 1 -- 172.21.15.146:0/2310399809 >> 172.21.15.146:0/2310399809 conn(0x55afdddc1980 msgr2=0x55afddebf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:09.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.496+0000 7fcdc3834800 1 -- 172.21.15.146:0/2310399809 shutdown_connections 2024-09-18T01:47:09.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.496+0000 7fcdc3834800 1 -- 172.21.15.146:0/2310399809 wait complete. 2024-09-18T01:47:09.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.496+0000 7fcdc3834800 1 Processor -- start 2024-09-18T01:47:09.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.496+0000 7fcdc3834800 1 -- start start 2024-09-18T01:47:09.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.496+0000 7fcdc3834800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55afddec4070 0x55afddecb680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.496+0000 7fcdc3834800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55afddec5360 con 0x55afddec4070 2024-09-18T01:47:09.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.496+0000 7fcdbf34c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55afddec4070 0x55afddecb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.496+0000 7fcdbf34c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55afddec4070 0x55afddecb680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37168/0 (socket says 172.21.15.146:37168) 2024-09-18T01:47:09.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.496+0000 7fcdbf34c640 1 -- 172.21.15.146:0/1695547810 learned_addr learned my addr 172.21.15.146:0/1695547810 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:09.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.497+0000 7fcdbf34c640 1 -- 172.21.15.146:0/1695547810 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afddecbbc0 con 0x55afddec4070 2024-09-18T01:47:09.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.497+0000 7fcdbf34c640 1 --2- 172.21.15.146:0/1695547810 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55afddec4070 0x55afddecb680 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fcdb800a930 tx=0x7fcdb8003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.497+0000 7fcca37fe640 1 -- 172.21.15.146:0/1695547810 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdb8020020 con 0x55afddec4070 2024-09-18T01:47:09.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.497+0000 7fcca37fe640 1 -- 172.21.15.146:0/1695547810 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdb80108b0 con 0x55afddec4070 2024-09-18T01:47:09.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.497+0000 7fcdc3834800 1 -- 172.21.15.146:0/1695547810 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55afddecbe50 con 0x55afddec4070 2024-09-18T01:47:09.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.497+0000 7fcca37fe640 1 -- 172.21.15.146:0/1695547810 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdb8015040 con 0x55afddec4070 2024-09-18T01:47:09.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.497+0000 7fcdc3834800 1 -- 172.21.15.146:0/1695547810 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55afddeceb00 con 0x55afddec4070 2024-09-18T01:47:09.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.498+0000 7fcca37fe640 1 -- 172.21.15.146:0/1695547810 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fcdb8023020 con 0x55afddec4070 2024-09-18T01:47:09.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.498+0000 7fcca37fe640 1 --2- 172.21.15.146:0/1695547810 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fcc98036b40 0x7fcc98039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.498+0000 7fcca37fe640 1 -- 172.21.15.146:0/1695547810 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7fcdb804c3b0 con 0x55afddec4070 2024-09-18T01:47:09.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.498+0000 7fcdb7fff640 1 --2- 172.21.15.146:0/1695547810 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fcc98036b40 0x7fcc98039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.498+0000 7fcdc3834800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:47:09.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.498+0000 7fcdc3834800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:47:09.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.499+0000 7fcdc3834800 1 Processor -- start 2024-09-18T01:47:09.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.499+0000 7fcdb7fff640 1 --2- 172.21.15.146:0/1695547810 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fcc98036b40 0x7fcc98039000 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fcda8057000 tx=0x7fcda8052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.499+0000 7fcdc3834800 1 -- start start 2024-09-18T01:47:09.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.499+0000 7fcdc3834800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55afddee56a0 0x55afddee5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.499+0000 7fcdc3834800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55afddeacd40 con 0x55afddee56a0 2024-09-18T01:47:09.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.499+0000 7fcdbeb4b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55afddee56a0 0x55afddee5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.499+0000 7fcdbeb4b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55afddee56a0 0x55afddee5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37170/0 (socket says 172.21.15.146:37170) 2024-09-18T01:47:09.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.499+0000 7fcdbeb4b640 1 -- 172.21.15.146:0/3733402586 learned_addr learned my addr 172.21.15.146:0/3733402586 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:09.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.499+0000 7fcdbeb4b640 1 -- 172.21.15.146:0/3733402586 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afddee6090 con 0x55afddee56a0 2024-09-18T01:47:09.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.500+0000 7fcdbeb4b640 1 --2- 172.21.15.146:0/3733402586 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55afddee56a0 0x55afddee5ac0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fcdb0001630 tx=0x7fcdb001ff20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.500+0000 7fcc7effd640 1 -- 172.21.15.146:0/3733402586 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdb001f4b0 con 0x55afddee56a0 2024-09-18T01:47:09.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.500+0000 7fcc7effd640 1 -- 172.21.15.146:0/3733402586 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdb00163b0 con 0x55afddee56a0 2024-09-18T01:47:09.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.500+0000 7fcdc3834800 1 -- 172.21.15.146:0/3733402586 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55afddee8ce0 con 0x55afddee56a0 2024-09-18T01:47:09.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.500+0000 7fcc7effd640 1 -- 172.21.15.146:0/3733402586 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdb002a660 con 0x55afddee56a0 2024-09-18T01:47:09.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.500+0000 7fcdc3834800 1 -- 172.21.15.146:0/3733402586 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55afddee90c0 con 0x55afddee56a0 2024-09-18T01:47:09.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.500+0000 7fcc7effd640 1 -- 172.21.15.146:0/3733402586 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fcdb002a800 con 0x55afddee56a0 2024-09-18T01:47:09.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.501+0000 7fcc7effd640 1 --2- 172.21.15.146:0/3733402586 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fcbf8036b40 0x7fcbf8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.501+0000 7fcc7effd640 1 -- 172.21.15.146:0/3733402586 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7fcdb0040070 con 0x55afddee56a0 2024-09-18T01:47:09.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.501+0000 7fcdb7fff640 1 --2- 172.21.15.146:0/3733402586 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fcbf8036b40 0x7fcbf8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.501+0000 7fcc7cff9640 20 reqs_thread_entry: start 2024-09-18T01:47:09.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.501+0000 7fcdc3834800 1 --2- 172.21.15.146:0/3427592605 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55afddef3230 0x55afddef56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.501+0000 7fcdb7fff640 1 --2- 172.21.15.146:0/3733402586 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fcbf8036b40 0x7fcbf8039000 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x55afdddbe340 tx=0x7fcda8005a00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.501+0000 7fcdc3834800 1 -- 172.21.15.146:0/3427592605 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55afddef5d40 con 0x55afddef3230 2024-09-18T01:47:09.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.501+0000 7fcdbf34c640 1 --2- 172.21.15.146:0/3427592605 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55afddef3230 0x55afddef56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.502+0000 7fcdbf34c640 1 --2- 172.21.15.146:0/3427592605 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55afddef3230 0x55afddef56c0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.502+0000 7fcdbf34c640 1 -- 172.21.15.146:0/3427592605 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcdb800e070 con 0x55afddef3230 2024-09-18T01:47:09.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.502+0000 7fcdc3834800 1 -- 172.21.15.146:0/3427592605 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55afddef6620 con 0x55afddef3230 2024-09-18T01:47:09.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.502+0000 7fcdbf34c640 1 -- 172.21.15.146:0/3427592605 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcdb800e070 con 0x55afddef3230 2024-09-18T01:47:09.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.502+0000 7fcdc3834800 1 -- 172.21.15.146:0/3427592605 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55afddef79d0 con 0x55afddef3230 2024-09-18T01:47:09.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.502+0000 7fcdbf34c640 1 -- 172.21.15.146:0/3427592605 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7fcdb800e070 con 0x55afddef3230 2024-09-18T01:47:09.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.503+0000 7fcdc3834800 1 -- 172.21.15.146:0/1695547810 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fcc98036b40 msgr2=0x7fcc98039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.503+0000 7fcdc3834800 1 --2- 172.21.15.146:0/1695547810 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fcc98036b40 0x7fcc98039000 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fcda8057000 tx=0x7fcda8052000 comp rx=0 tx=0).stop 2024-09-18T01:47:09.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.503+0000 7fcdc3834800 1 -- 172.21.15.146:0/1695547810 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55afddec4070 msgr2=0x55afddecb680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.503+0000 7fcdc3834800 1 --2- 172.21.15.146:0/1695547810 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55afddec4070 0x55afddecb680 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fcdb800a930 tx=0x7fcdb8003370 comp rx=0 tx=0).stop 2024-09-18T01:47:09.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.503+0000 7fcdc3834800 1 -- 172.21.15.146:0/1695547810 shutdown_connections 2024-09-18T01:47:09.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.503+0000 7fcdc3834800 1 --2- 172.21.15.146:0/1695547810 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fcc98036b40 0x7fcc98039000 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.503+0000 7fcdc3834800 1 --2- 172.21.15.146:0/1695547810 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55afddec4070 0x55afddecb680 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.503+0000 7fcdc3834800 1 -- 172.21.15.146:0/1695547810 >> 172.21.15.146:0/1695547810 conn(0x55afdddc1980 msgr2=0x55afddebf3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:09.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.503+0000 7fcdc3834800 1 -- 172.21.15.146:0/1695547810 shutdown_connections 2024-09-18T01:47:09.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.503+0000 7fcdc3834800 1 -- 172.21.15.146:0/1695547810 wait complete. 2024-09-18T01:47:09.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.504+0000 7fcdc3834800 1 -- 172.21.15.146:0/3733402586 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fcbf8036b40 msgr2=0x7fcbf8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.504+0000 7fcdc3834800 1 --2- 172.21.15.146:0/3733402586 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fcbf8036b40 0x7fcbf8039000 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x55afdddbe340 tx=0x7fcda8005a00 comp rx=0 tx=0).stop 2024-09-18T01:47:09.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.504+0000 7fcdc3834800 1 -- 172.21.15.146:0/3733402586 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55afddee56a0 msgr2=0x55afddee5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.504+0000 7fcdc3834800 1 --2- 172.21.15.146:0/3733402586 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55afddee56a0 0x55afddee5ac0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fcdb0001630 tx=0x7fcdb001ff20 comp rx=0 tx=0).stop 2024-09-18T01:47:09.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.504+0000 7fcdc3834800 1 -- 172.21.15.146:0/3733402586 shutdown_connections 2024-09-18T01:47:09.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.504+0000 7fcdc3834800 1 --2- 172.21.15.146:0/3733402586 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fcbf8036b40 0x7fcbf8039000 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.504+0000 7fcdc3834800 1 --2- 172.21.15.146:0/3733402586 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55afddee56a0 0x55afddee5ac0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.504+0000 7fcdc3834800 1 -- 172.21.15.146:0/3733402586 >> 172.21.15.146:0/3733402586 conn(0x55afddeda5d0 msgr2=0x55afddedcec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:09.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.504+0000 7fcdc3834800 1 -- 172.21.15.146:0/3733402586 shutdown_connections 2024-09-18T01:47:09.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.504+0000 7fcdc3834800 1 -- 172.21.15.146:0/3733402586 wait complete. 2024-09-18T01:47:09.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.504+0000 7fcdc3834800 1 -- 172.21.15.146:0/3427592605 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55afddef3230 msgr2=0x55afddef56c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.504+0000 7fcdc3834800 1 --2- 172.21.15.146:0/3427592605 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55afddef3230 0x55afddef56c0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.504+0000 7fcdc3834800 1 -- 172.21.15.146:0/3427592605 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fcca4036b90 msgr2=0x7fcca4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.504+0000 7fcdc3834800 1 --2- 172.21.15.146:0/3427592605 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fcca4036b90 0x7fcca4039050 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fcdb0016fb0 tx=0x7fcdb000af30 comp rx=0 tx=0).stop 2024-09-18T01:47:09.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.504+0000 7fcdc3834800 1 -- 172.21.15.146:0/3427592605 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55afdddbd540 msgr2=0x55afddeb72d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.504+0000 7fcdc3834800 1 --2- 172.21.15.146:0/3427592605 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55afdddbd540 0x55afddeb72d0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x55afddead3f0 tx=0x7fcdb0000ed0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.504+0000 7fcdc3834800 1 -- 172.21.15.146:0/3427592605 shutdown_connections 2024-09-18T01:47:09.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.504+0000 7fcdc3834800 1 --2- 172.21.15.146:0/3427592605 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55afddef3230 0x55afddef56c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.504+0000 7fcdc3834800 1 --2- 172.21.15.146:0/3427592605 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fcca4036b90 0x7fcca4039050 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.504+0000 7fcdc3834800 1 --2- 172.21.15.146:0/3427592605 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55afdddbd540 0x55afddeb72d0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.504+0000 7fcdc3834800 1 -- 172.21.15.146:0/3427592605 >> 172.21.15.146:0/3427592605 conn(0x55afdddb8dd0 msgr2=0x55afddea6800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:09.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.504+0000 7fcdc3834800 1 -- 172.21.15.146:0/3427592605 shutdown_connections 2024-09-18T01:47:09.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.504+0000 7fcdc3834800 1 -- 172.21.15.146:0/3427592605 wait complete. 2024-09-18T01:47:09.514 INFO:teuthology.orchestra.run.smithi146.stdout:{"id":"8ac01ed4-7422-45e2-b799-bf55088fb4fc","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-18T01:47:09.514 DEBUG:tasks.util.rgw: json result: {'id': '8ac01ed4-7422-45e2-b799-bf55088fb4fc', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-18T01:47:09.514 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-18T01:47:09.514 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-18T01:47:09.515 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-18T01:47:09.600 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:47:09.601 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:47:09.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.601+0000 7f31a0615800 1 Processor -- start 2024-09-18T01:47:09.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.601+0000 7f31a0615800 1 -- start start 2024-09-18T01:47:09.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.601+0000 7f31a0615800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x559b35445a20 0x559b35447e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.601+0000 7f31a0615800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559b35301b30 con 0x559b354415e0 2024-09-18T01:47:09.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.601+0000 7f31a0615800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x559b352e3360 con 0x559b35445a20 2024-09-18T01:47:09.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.601+0000 7f319b59b640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x559b35445a20 0x559b35447e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.601+0000 7f319bd9c640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x559b354415e0 0x559b354419e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:53032/0 (socket says 172.21.15.146:53032) 2024-09-18T01:47:09.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.601+0000 7f319b59b640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x559b35445a20 0x559b35447e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37184/0 (socket says 172.21.15.146:37184) 2024-09-18T01:47:09.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.601+0000 7f319bd9c640 1 -- 172.21.15.146:0/3141310643 learned_addr learned my addr 172.21.15.146:0/3141310643 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:47:09.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.602+0000 7f319b59b640 1 -- 172.21.15.146:0/3141310643 >> v1:172.21.15.129:6789/0 conn(0x559b354415e0 legacy=0x559b354419e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.602+0000 7f319ad9a640 1 -- 172.21.15.146:0/3141310643 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 903017503 0 0) 0x559b35301b30 con 0x559b354415e0 2024-09-18T01:47:09.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.602+0000 7f319b59b640 1 -- 172.21.15.146:0/3141310643 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b35309e00 con 0x559b35445a20 2024-09-18T01:47:09.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.603+0000 7f319b59b640 1 --2- 172.21.15.146:0/3141310643 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559b35445a20 0x559b35447e10 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f319000a470 tx=0x7f3190045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d085dce546beb139 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.603+0000 7f319ad9a640 1 -- 172.21.15.146:0/3141310643 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3190053570 con 0x559b35445a20 2024-09-18T01:47:09.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.604+0000 7f319ad9a640 1 -- 172.21.15.146:0/3141310643 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3190058070 con 0x559b35445a20 2024-09-18T01:47:09.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.604+0000 7f319ad9a640 1 -- 172.21.15.146:0/3141310643 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3190053880 con 0x559b35445a20 2024-09-18T01:47:09.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.604+0000 7f31a0615800 1 -- 172.21.15.146:0/3141310643 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559b35445a20 msgr2=0x559b35447e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.604+0000 7f31a0615800 1 --2- 172.21.15.146:0/3141310643 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559b35445a20 0x559b35447e10 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f319000a470 tx=0x7f3190045a20 comp rx=0 tx=0).stop 2024-09-18T01:47:09.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.604+0000 7f31a0615800 1 -- 172.21.15.146:0/3141310643 shutdown_connections 2024-09-18T01:47:09.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.604+0000 7f31a0615800 1 --2- 172.21.15.146:0/3141310643 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559b35445a20 0x559b35447e10 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.604+0000 7f31a0615800 1 -- 172.21.15.146:0/3141310643 >> 172.21.15.146:0/3141310643 conn(0x559b3543ce90 msgr2=0x559b3543f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:09.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.604+0000 7f31a0615800 1 -- 172.21.15.146:0/3141310643 shutdown_connections 2024-09-18T01:47:09.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.604+0000 7f31a0615800 1 -- 172.21.15.146:0/3141310643 wait complete. 2024-09-18T01:47:09.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.617+0000 7f31a0615800 1 Processor -- start 2024-09-18T01:47:09.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.618+0000 7f31a0615800 1 -- start start 2024-09-18T01:47:09.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.618+0000 7f31a0615800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559b354415e0 0x559b35531700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.618+0000 7f31a0615800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x559b3538e350 con 0x559b354415e0 2024-09-18T01:47:09.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.618+0000 7f319bd9c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559b354415e0 0x559b35531700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.618+0000 7f319bd9c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559b354415e0 0x559b35531700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37188/0 (socket says 172.21.15.146:37188) 2024-09-18T01:47:09.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.618+0000 7f319bd9c640 1 -- 172.21.15.146:0/3068790309 learned_addr learned my addr 172.21.15.146:0/3068790309 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:09.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.618+0000 7f319bd9c640 1 -- 172.21.15.146:0/3068790309 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b352dbbc0 con 0x559b354415e0 2024-09-18T01:47:09.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.619+0000 7f319bd9c640 1 --2- 172.21.15.146:0/3068790309 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559b354415e0 0x559b35531700 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f318c00b240 tx=0x7f318c00b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=813788d7c51624e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.619+0000 7f3089e0b640 1 -- 172.21.15.146:0/3068790309 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f318c008070 con 0x559b354415e0 2024-09-18T01:47:09.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.619+0000 7f3089e0b640 1 -- 172.21.15.146:0/3068790309 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f318c00d500 con 0x559b354415e0 2024-09-18T01:47:09.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.619+0000 7f3089e0b640 1 -- 172.21.15.146:0/3068790309 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f318c00d860 con 0x559b354415e0 2024-09-18T01:47:09.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.619+0000 7f31a0615800 1 -- 172.21.15.146:0/3068790309 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559b354415e0 msgr2=0x559b35531700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.619+0000 7f31a0615800 1 --2- 172.21.15.146:0/3068790309 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559b354415e0 0x559b35531700 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f318c00b240 tx=0x7f318c00b700 comp rx=0 tx=0).stop 2024-09-18T01:47:09.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.619+0000 7f31a0615800 1 -- 172.21.15.146:0/3068790309 shutdown_connections 2024-09-18T01:47:09.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.619+0000 7f31a0615800 1 --2- 172.21.15.146:0/3068790309 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559b354415e0 0x559b35531700 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.619+0000 7f31a0615800 1 -- 172.21.15.146:0/3068790309 >> 172.21.15.146:0/3068790309 conn(0x559b3543ce90 msgr2=0x559b3552d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:09.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.619+0000 7f31a0615800 1 -- 172.21.15.146:0/3068790309 shutdown_connections 2024-09-18T01:47:09.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.620+0000 7f31a0615800 1 -- 172.21.15.146:0/3068790309 wait complete. 2024-09-18T01:47:09.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.620+0000 7f31a0615800 1 Processor -- start 2024-09-18T01:47:09.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.620+0000 7f31a0615800 1 -- start start 2024-09-18T01:47:09.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.620+0000 7f31a0615800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559b354415e0 0x559b35539180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.620+0000 7f31a0615800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x559b35448650 con 0x559b354415e0 2024-09-18T01:47:09.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.620+0000 7f319bd9c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559b354415e0 0x559b35539180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.620+0000 7f319bd9c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559b354415e0 0x559b35539180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37194/0 (socket says 172.21.15.146:37194) 2024-09-18T01:47:09.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.620+0000 7f319bd9c640 1 -- 172.21.15.146:0/1914918313 learned_addr learned my addr 172.21.15.146:0/1914918313 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:09.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.621+0000 7f319bd9c640 1 -- 172.21.15.146:0/1914918313 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b352effe0 con 0x559b354415e0 2024-09-18T01:47:09.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.621+0000 7f319bd9c640 1 --2- 172.21.15.146:0/1914918313 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559b354415e0 0x559b35539180 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x559b35532560 tx=0x7f318c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.621+0000 7f3083fff640 1 -- 172.21.15.146:0/1914918313 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f318c019870 con 0x559b354415e0 2024-09-18T01:47:09.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.621+0000 7f3083fff640 1 -- 172.21.15.146:0/1914918313 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f318c019a10 con 0x559b354415e0 2024-09-18T01:47:09.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.621+0000 7f31a0615800 1 -- 172.21.15.146:0/1914918313 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559b355396c0 con 0x559b354415e0 2024-09-18T01:47:09.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.621+0000 7f3083fff640 1 -- 172.21.15.146:0/1914918313 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f318c019d30 con 0x559b354415e0 2024-09-18T01:47:09.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.621+0000 7f31a0615800 1 -- 172.21.15.146:0/1914918313 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b35539be0 con 0x559b354415e0 2024-09-18T01:47:09.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.622+0000 7f31a0615800 1 Processor -- start 2024-09-18T01:47:09.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.622+0000 7f31a0615800 1 -- start start 2024-09-18T01:47:09.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.622+0000 7f3083fff640 1 -- 172.21.15.146:0/1914918313 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f318c017040 con 0x559b354415e0 2024-09-18T01:47:09.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.622+0000 7f31a0615800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559b3544b0e0 0x559b35449630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.622+0000 7f31a0615800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x559b352dd580 con 0x559b3544b0e0 2024-09-18T01:47:09.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.622+0000 7f3083fff640 1 --2- 172.21.15.146:0/1914918313 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f3084036b40 0x7f3084039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.622+0000 7f3083fff640 1 -- 172.21.15.146:0/1914918313 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f318c015020 con 0x559b354415e0 2024-09-18T01:47:09.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.622+0000 7f319c59d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559b3544b0e0 0x559b35449630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.622+0000 7f319c59d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559b3544b0e0 0x559b35449630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37200/0 (socket says 172.21.15.146:37200) 2024-09-18T01:47:09.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.622+0000 7f319c59d640 1 -- 172.21.15.146:0/3301658725 learned_addr learned my addr 172.21.15.146:0/3301658725 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:09.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.622+0000 7f319bd9c640 1 --2- 172.21.15.146:0/1914918313 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f3084036b40 0x7f3084039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.622+0000 7f319c59d640 1 -- 172.21.15.146:0/3301658725 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b35449b70 con 0x559b3544b0e0 2024-09-18T01:47:09.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.622+0000 7f319bd9c640 1 --2- 172.21.15.146:0/1914918313 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f3084036b40 0x7f3084039000 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f318c04b7a0 tx=0x7f318c00e7a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.622+0000 7f319c59d640 1 --2- 172.21.15.146:0/3301658725 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559b3544b0e0 0x559b35449630 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f319400a430 tx=0x7f319400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60bb1d25b60248ce server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.623+0000 7f3081ffb640 1 -- 172.21.15.146:0/3301658725 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3194015070 con 0x559b3544b0e0 2024-09-18T01:47:09.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.623+0000 7f3081ffb640 1 -- 172.21.15.146:0/3301658725 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3194001670 con 0x559b3544b0e0 2024-09-18T01:47:09.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.623+0000 7f3081ffb640 1 -- 172.21.15.146:0/3301658725 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3194001990 con 0x559b3544b0e0 2024-09-18T01:47:09.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.623+0000 7f31a0615800 1 -- 172.21.15.146:0/3301658725 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559b3544b0e0 msgr2=0x559b35449630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.623+0000 7f31a0615800 1 --2- 172.21.15.146:0/3301658725 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559b3544b0e0 0x559b35449630 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f319400a430 tx=0x7f319400a8f0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.623+0000 7f31a0615800 1 -- 172.21.15.146:0/3301658725 shutdown_connections 2024-09-18T01:47:09.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.623+0000 7f31a0615800 1 --2- 172.21.15.146:0/3301658725 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559b3544b0e0 0x559b35449630 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.623+0000 7f31a0615800 1 -- 172.21.15.146:0/3301658725 >> 172.21.15.146:0/3301658725 conn(0x559b35445a20 msgr2=0x559b355416a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:09.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.623+0000 7f31a0615800 1 -- 172.21.15.146:0/3301658725 shutdown_connections 2024-09-18T01:47:09.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.623+0000 7f31a0615800 1 -- 172.21.15.146:0/3301658725 wait complete. 2024-09-18T01:47:09.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.623+0000 7f31a0615800 1 Processor -- start 2024-09-18T01:47:09.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.623+0000 7f31a0615800 1 -- start start 2024-09-18T01:47:09.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.624+0000 7f31a0615800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559b3544b0e0 0x559b3554f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.624+0000 7f31a0615800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x559b35449e00 con 0x559b3544b0e0 2024-09-18T01:47:09.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.624+0000 7f319c59d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559b3544b0e0 0x559b3554f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.624+0000 7f319c59d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559b3544b0e0 0x559b3554f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37202/0 (socket says 172.21.15.146:37202) 2024-09-18T01:47:09.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.624+0000 7f319c59d640 1 -- 172.21.15.146:0/3038370775 learned_addr learned my addr 172.21.15.146:0/3038370775 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:09.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.624+0000 7f319c59d640 1 -- 172.21.15.146:0/3038370775 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b3554fbe0 con 0x559b3544b0e0 2024-09-18T01:47:09.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.624+0000 7f319c59d640 1 --2- 172.21.15.146:0/3038370775 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559b3544b0e0 0x559b3554f6a0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f319400a930 tx=0x7f3194003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.624+0000 7f307bfff640 1 -- 172.21.15.146:0/3038370775 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3194020020 con 0x559b3544b0e0 2024-09-18T01:47:09.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.624+0000 7f307bfff640 1 -- 172.21.15.146:0/3038370775 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31940108b0 con 0x559b3544b0e0 2024-09-18T01:47:09.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.624+0000 7f31a0615800 1 -- 172.21.15.146:0/3038370775 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559b3554fe70 con 0x559b3544b0e0 2024-09-18T01:47:09.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.624+0000 7f307bfff640 1 -- 172.21.15.146:0/3038370775 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3194015040 con 0x559b3544b0e0 2024-09-18T01:47:09.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.624+0000 7f31a0615800 1 -- 172.21.15.146:0/3038370775 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b35552b20 con 0x559b3544b0e0 2024-09-18T01:47:09.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.625+0000 7f307bfff640 1 -- 172.21.15.146:0/3038370775 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3194023020 con 0x559b3544b0e0 2024-09-18T01:47:09.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.625+0000 7f307bfff640 1 --2- 172.21.15.146:0/3038370775 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f3074036b40 0x7f3074039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.625+0000 7f307bfff640 1 -- 172.21.15.146:0/3038370775 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f319404c3b0 con 0x559b3544b0e0 2024-09-18T01:47:09.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.626+0000 7f319b59b640 1 --2- 172.21.15.146:0/3038370775 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f3074036b40 0x7f3074039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.626+0000 7f31a0615800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:47:09.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.626+0000 7f31a0615800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:47:09.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.626+0000 7f319b59b640 1 --2- 172.21.15.146:0/3038370775 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f3074036b40 0x7f3074039000 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3190057000 tx=0x7f3190052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.626+0000 7f31a0615800 1 Processor -- start 2024-09-18T01:47:09.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.626+0000 7f31a0615800 1 -- start start 2024-09-18T01:47:09.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.626+0000 7f31a0615800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559b35569690 0x559b35569ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.626+0000 7f31a0615800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x559b35531eb0 con 0x559b35569690 2024-09-18T01:47:09.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.626+0000 7f319bd9c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559b35569690 0x559b35569ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.627+0000 7f319bd9c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559b35569690 0x559b35569ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37214/0 (socket says 172.21.15.146:37214) 2024-09-18T01:47:09.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.627+0000 7f319bd9c640 1 -- 172.21.15.146:0/2796373013 learned_addr learned my addr 172.21.15.146:0/2796373013 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:09.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.627+0000 7f319bd9c640 1 -- 172.21.15.146:0/2796373013 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b3556a080 con 0x559b35569690 2024-09-18T01:47:09.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.627+0000 7f319bd9c640 1 --2- 172.21.15.146:0/2796373013 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559b35569690 0x559b35569ab0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f318c01a560 tx=0x7f318c04b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.627+0000 7f300bfff640 1 -- 172.21.15.146:0/2796373013 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f318c00edd0 con 0x559b35569690 2024-09-18T01:47:09.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.627+0000 7f300bfff640 1 -- 172.21.15.146:0/2796373013 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f318c00f470 con 0x559b35569690 2024-09-18T01:47:09.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.627+0000 7f31a0615800 1 -- 172.21.15.146:0/2796373013 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559b3556ccd0 con 0x559b35569690 2024-09-18T01:47:09.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.627+0000 7f300bfff640 1 -- 172.21.15.146:0/2796373013 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f318c00f750 con 0x559b35569690 2024-09-18T01:47:09.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.627+0000 7f31a0615800 1 -- 172.21.15.146:0/2796373013 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b3556d0b0 con 0x559b35569690 2024-09-18T01:47:09.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.628+0000 7f300bfff640 1 -- 172.21.15.146:0/2796373013 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f318c04b1c0 con 0x559b35569690 2024-09-18T01:47:09.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.628+0000 7f300bfff640 1 --2- 172.21.15.146:0/2796373013 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2fdc036b40 0x7f2fdc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.628+0000 7f300bfff640 1 -- 172.21.15.146:0/2796373013 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f318c043030 con 0x559b35569690 2024-09-18T01:47:09.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.628+0000 7f319b59b640 1 --2- 172.21.15.146:0/2796373013 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2fdc036b40 0x7f2fdc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.628+0000 7f3009ffb640 20 reqs_thread_entry: start 2024-09-18T01:47:09.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.628+0000 7f31a0615800 1 --2- 172.21.15.146:0/1914918313 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559b35577240 0x559b35579700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.628+0000 7f31a0615800 1 -- 172.21.15.146:0/1914918313 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b35579dd0 con 0x559b35577240 2024-09-18T01:47:09.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.628+0000 7f319b59b640 1 --2- 172.21.15.146:0/2796373013 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2fdc036b40 0x7f2fdc039000 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x559b354423e0 tx=0x7f3190005a00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.629+0000 7f319c59d640 1 --2- 172.21.15.146:0/1914918313 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559b35577240 0x559b35579700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.629+0000 7f319c59d640 1 --2- 172.21.15.146:0/1914918313 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559b35577240 0x559b35579700 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.629+0000 7f319c59d640 1 -- 172.21.15.146:0/1914918313 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f319400e070 con 0x559b35577240 2024-09-18T01:47:09.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.629+0000 7f31a0615800 1 -- 172.21.15.146:0/1914918313 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b3557b690 con 0x559b35577240 2024-09-18T01:47:09.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.629+0000 7f319c59d640 1 -- 172.21.15.146:0/1914918313 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f319400e070 con 0x559b35577240 2024-09-18T01:47:09.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.629+0000 7f31a0615800 1 -- 172.21.15.146:0/1914918313 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b3557b010 con 0x559b35577240 2024-09-18T01:47:09.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.631+0000 7f319c59d640 1 -- 172.21.15.146:0/1914918313 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [stat,call,call,writefull 0~993] v33'4 uv4 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f319400e070 con 0x559b35577240 2024-09-18T01:47:09.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.631+0000 7f31a0615800 1 -- 172.21.15.146:0/3038370775 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f3074036b40 msgr2=0x7f3074039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.631+0000 7f31a0615800 1 --2- 172.21.15.146:0/3038370775 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f3074036b40 0x7f3074039000 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3190057000 tx=0x7f3190052000 comp rx=0 tx=0).stop 2024-09-18T01:47:09.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.631+0000 7f31a0615800 1 -- 172.21.15.146:0/3038370775 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559b3544b0e0 msgr2=0x559b3554f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.631+0000 7f31a0615800 1 --2- 172.21.15.146:0/3038370775 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559b3544b0e0 0x559b3554f6a0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f319400a930 tx=0x7f3194003370 comp rx=0 tx=0).stop 2024-09-18T01:47:09.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.631+0000 7f31a0615800 1 -- 172.21.15.146:0/3038370775 shutdown_connections 2024-09-18T01:47:09.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.631+0000 7f31a0615800 1 --2- 172.21.15.146:0/3038370775 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f3074036b40 0x7f3074039000 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.631+0000 7f31a0615800 1 --2- 172.21.15.146:0/3038370775 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559b3544b0e0 0x559b3554f6a0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.631+0000 7f31a0615800 1 -- 172.21.15.146:0/3038370775 >> 172.21.15.146:0/3038370775 conn(0x559b35445a20 msgr2=0x559b355445d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:09.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.631+0000 7f31a0615800 1 -- 172.21.15.146:0/3038370775 shutdown_connections 2024-09-18T01:47:09.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.632+0000 7f31a0615800 1 -- 172.21.15.146:0/3038370775 wait complete. 2024-09-18T01:47:09.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.632+0000 7f31a0615800 1 -- 172.21.15.146:0/2796373013 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2fdc036b40 msgr2=0x7f2fdc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.632+0000 7f31a0615800 1 --2- 172.21.15.146:0/2796373013 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2fdc036b40 0x7f2fdc039000 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x559b354423e0 tx=0x7f3190005a00 comp rx=0 tx=0).stop 2024-09-18T01:47:09.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.632+0000 7f31a0615800 1 -- 172.21.15.146:0/2796373013 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559b35569690 msgr2=0x559b35569ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.632+0000 7f31a0615800 1 --2- 172.21.15.146:0/2796373013 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559b35569690 0x559b35569ab0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f318c01a560 tx=0x7f318c04b670 comp rx=0 tx=0).stop 2024-09-18T01:47:09.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.632+0000 7f31a0615800 1 -- 172.21.15.146:0/2796373013 shutdown_connections 2024-09-18T01:47:09.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.632+0000 7f31a0615800 1 --2- 172.21.15.146:0/2796373013 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2fdc036b40 0x7f2fdc039000 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.632+0000 7f31a0615800 1 --2- 172.21.15.146:0/2796373013 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559b35569690 0x559b35569ab0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.632+0000 7f31a0615800 1 -- 172.21.15.146:0/2796373013 >> 172.21.15.146:0/2796373013 conn(0x559b3555e570 msgr2=0x559b35560eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:09.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.632+0000 7f31a0615800 1 -- 172.21.15.146:0/2796373013 shutdown_connections 2024-09-18T01:47:09.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.632+0000 7f31a0615800 1 -- 172.21.15.146:0/2796373013 wait complete. 2024-09-18T01:47:09.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.632+0000 7f31a0615800 1 -- 172.21.15.146:0/1914918313 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559b35577240 msgr2=0x559b35579700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.632+0000 7f31a0615800 1 --2- 172.21.15.146:0/1914918313 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559b35577240 0x559b35579700 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.632+0000 7f31a0615800 1 -- 172.21.15.146:0/1914918313 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f3084036b40 msgr2=0x7f3084039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.632+0000 7f31a0615800 1 --2- 172.21.15.146:0/1914918313 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f3084036b40 0x7f3084039000 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f318c04b7a0 tx=0x7f318c00e7a0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.632+0000 7f31a0615800 1 -- 172.21.15.146:0/1914918313 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559b354415e0 msgr2=0x559b35539180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.632+0000 7f31a0615800 1 --2- 172.21.15.146:0/1914918313 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559b354415e0 0x559b35539180 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x559b35532560 tx=0x7f318c000ed0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.632+0000 7f31a0615800 1 -- 172.21.15.146:0/1914918313 shutdown_connections 2024-09-18T01:47:09.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.632+0000 7f31a0615800 1 --2- 172.21.15.146:0/1914918313 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x559b35577240 0x559b35579700 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.632+0000 7f31a0615800 1 --2- 172.21.15.146:0/1914918313 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f3084036b40 0x7f3084039000 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.632+0000 7f31a0615800 1 --2- 172.21.15.146:0/1914918313 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x559b354415e0 0x559b35539180 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.632+0000 7f31a0615800 1 -- 172.21.15.146:0/1914918313 >> 172.21.15.146:0/1914918313 conn(0x559b3543ce90 msgr2=0x559b3552ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:09.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.632+0000 7f31a0615800 1 -- 172.21.15.146:0/1914918313 shutdown_connections 2024-09-18T01:47:09.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.632+0000 7f31a0615800 1 -- 172.21.15.146:0/1914918313 wait complete. 2024-09-18T01:47:09.643 INFO:teuthology.orchestra.run.smithi146.stdout:{"id":"8ac01ed4-7422-45e2-b799-bf55088fb4fc","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-18T01:47:09.643 DEBUG:tasks.util.rgw: json result: {'id': '8ac01ed4-7422-45e2-b799-bf55088fb4fc', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-18T01:47:09.644 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'get'] 2024-09-18T01:47:09.644 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'get'] 2024-09-18T01:47:09.644 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup get 2024-09-18T01:47:09.685 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:47:09.686 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:47:09.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.686+0000 7f3976b24800 1 Processor -- start 2024-09-18T01:47:09.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.686+0000 7f3976b24800 1 -- start start 2024-09-18T01:47:09.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.686+0000 7f3976b24800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x555edd95e540 0x555edd95e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.686+0000 7f3976b24800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555edd81eb30 con 0x555edd95ee80 2024-09-18T01:47:09.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.686+0000 7f3976b24800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x555edd800360 con 0x555edd95e540 2024-09-18T01:47:09.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.686+0000 7f39728e0640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x555edd95e540 0x555edd95e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.686+0000 7f39728e0640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x555edd95e540 0x555edd95e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37216/0 (socket says 172.21.15.146:37216) 2024-09-18T01:47:09.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.686+0000 7f39728e0640 1 -- 172.21.15.146:0/3110882689 learned_addr learned my addr 172.21.15.146:0/3110882689 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:09.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.687+0000 7f39728e0640 1 -- 172.21.15.146:0/3110882689 >> v1:172.21.15.129:6789/0 conn(0x555edd95ee80 legacy=0x555edd963a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.687+0000 7f39728e0640 1 -- 172.21.15.146:0/3110882689 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555edd826e00 con 0x555edd95e540 2024-09-18T01:47:09.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.687+0000 7f39720df640 1 -- 172.21.15.146:0/3110882689 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1317919353 0 0) 0x555edd81eb30 con 0x555edd95ee80 2024-09-18T01:47:09.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.688+0000 7f39728e0640 1 --2- 172.21.15.146:0/3110882689 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555edd95e540 0x555edd95e940 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f396400a520 tx=0x7f3964045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f879e710348434e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.689+0000 7f39720df640 1 -- 172.21.15.146:0/3110882689 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3964055070 con 0x555edd95e540 2024-09-18T01:47:09.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.689+0000 7f39720df640 1 -- 172.21.15.146:0/3110882689 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39640515b0 con 0x555edd95e540 2024-09-18T01:47:09.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.689+0000 7f39720df640 1 -- 172.21.15.146:0/3110882689 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39640518d0 con 0x555edd95e540 2024-09-18T01:47:09.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.689+0000 7f3976b24800 1 -- 172.21.15.146:0/3110882689 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555edd95e540 msgr2=0x555edd95e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.689+0000 7f3976b24800 1 --2- 172.21.15.146:0/3110882689 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555edd95e540 0x555edd95e940 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f396400a520 tx=0x7f3964045ba0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.689+0000 7f3976b24800 1 -- 172.21.15.146:0/3110882689 shutdown_connections 2024-09-18T01:47:09.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.689+0000 7f3976b24800 1 --2- 172.21.15.146:0/3110882689 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555edd95e540 0x555edd95e940 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.689+0000 7f3976b24800 1 -- 172.21.15.146:0/3110882689 >> 172.21.15.146:0/3110882689 conn(0x555edd959dd0 msgr2=0x555edd95c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:09.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.689+0000 7f3976b24800 1 -- 172.21.15.146:0/3110882689 shutdown_connections 2024-09-18T01:47:09.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.689+0000 7f3976b24800 1 -- 172.21.15.146:0/3110882689 wait complete. 2024-09-18T01:47:09.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.703+0000 7f3976b24800 1 Processor -- start 2024-09-18T01:47:09.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.703+0000 7f3976b24800 1 -- start start 2024-09-18T01:47:09.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.703+0000 7f3976b24800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555edd95ee80 0x555edda4c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.703+0000 7f3976b24800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x555edd8ab320 con 0x555edd95ee80 2024-09-18T01:47:09.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.703+0000 7f39728e0640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555edd95ee80 0x555edda4c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.703+0000 7f39728e0640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555edd95ee80 0x555edda4c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37226/0 (socket says 172.21.15.146:37226) 2024-09-18T01:47:09.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.703+0000 7f39728e0640 1 -- 172.21.15.146:0/2718672173 learned_addr learned my addr 172.21.15.146:0/2718672173 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:09.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.703+0000 7f39728e0640 1 -- 172.21.15.146:0/2718672173 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555edd7f8bc0 con 0x555edd95ee80 2024-09-18T01:47:09.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.704+0000 7f39728e0640 1 --2- 172.21.15.146:0/2718672173 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555edd95ee80 0x555edda4c590 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f3964046050 tx=0x7f3964051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=947437f3e23c6c5a server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.704+0000 7f3860e09640 1 -- 172.21.15.146:0/2718672173 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3964051890 con 0x555edd95ee80 2024-09-18T01:47:09.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.704+0000 7f3860e09640 1 -- 172.21.15.146:0/2718672173 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3964051a30 con 0x555edd95ee80 2024-09-18T01:47:09.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.704+0000 7f3860e09640 1 -- 172.21.15.146:0/2718672173 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3964051d30 con 0x555edd95ee80 2024-09-18T01:47:09.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.704+0000 7f3976b24800 1 -- 172.21.15.146:0/2718672173 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555edd95ee80 msgr2=0x555edda4c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.704+0000 7f3976b24800 1 --2- 172.21.15.146:0/2718672173 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555edd95ee80 0x555edda4c590 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f3964046050 tx=0x7f3964051000 comp rx=0 tx=0).stop 2024-09-18T01:47:09.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.705+0000 7f3976b24800 1 -- 172.21.15.146:0/2718672173 shutdown_connections 2024-09-18T01:47:09.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.705+0000 7f3976b24800 1 --2- 172.21.15.146:0/2718672173 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555edd95ee80 0x555edda4c590 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.705+0000 7f3976b24800 1 -- 172.21.15.146:0/2718672173 >> 172.21.15.146:0/2718672173 conn(0x555edd959dd0 msgr2=0x555edda47eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:09.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.705+0000 7f3976b24800 1 -- 172.21.15.146:0/2718672173 shutdown_connections 2024-09-18T01:47:09.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.705+0000 7f3976b24800 1 -- 172.21.15.146:0/2718672173 wait complete. 2024-09-18T01:47:09.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.705+0000 7f3976b24800 1 Processor -- start 2024-09-18T01:47:09.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.705+0000 7f3976b24800 1 -- start start 2024-09-18T01:47:09.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.705+0000 7f3976b24800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555edd95ee80 0x555edda53dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.705+0000 7f3976b24800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x555edd965560 con 0x555edd95ee80 2024-09-18T01:47:09.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.705+0000 7f39728e0640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555edd95ee80 0x555edda53dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.705+0000 7f39728e0640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555edd95ee80 0x555edda53dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37232/0 (socket says 172.21.15.146:37232) 2024-09-18T01:47:09.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.705+0000 7f39728e0640 1 -- 172.21.15.146:0/3955547992 learned_addr learned my addr 172.21.15.146:0/3955547992 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:09.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.705+0000 7f39728e0640 1 -- 172.21.15.146:0/3955547992 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555edd80cfe0 con 0x555edd95ee80 2024-09-18T01:47:09.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.706+0000 7f39728e0640 1 --2- 172.21.15.146:0/3955547992 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555edd95ee80 0x555edda53dd0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f3964025da0 tx=0x7f3964002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.706+0000 7f385f606640 1 -- 172.21.15.146:0/3955547992 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3964073030 con 0x555edd95ee80 2024-09-18T01:47:09.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.706+0000 7f385f606640 1 -- 172.21.15.146:0/3955547992 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f396406f450 con 0x555edd95ee80 2024-09-18T01:47:09.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.706+0000 7f3976b24800 1 -- 172.21.15.146:0/3955547992 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555edda54310 con 0x555edd95ee80 2024-09-18T01:47:09.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.706+0000 7f385f606640 1 -- 172.21.15.146:0/3955547992 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3964000e60 con 0x555edd95ee80 2024-09-18T01:47:09.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.706+0000 7f3976b24800 1 -- 172.21.15.146:0/3955547992 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555edda54890 con 0x555edd95ee80 2024-09-18T01:47:09.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.706+0000 7f3976b24800 1 Processor -- start 2024-09-18T01:47:09.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.706+0000 7f3976b24800 1 -- start start 2024-09-18T01:47:09.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.707+0000 7f385f606640 1 -- 172.21.15.146:0/3955547992 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3964076070 con 0x555edd95ee80 2024-09-18T01:47:09.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.707+0000 7f3976b24800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555edda60f70 0x555edda61370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.707+0000 7f3976b24800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x555edd7fa580 con 0x555edda60f70 2024-09-18T01:47:09.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.707+0000 7f385f606640 1 --2- 172.21.15.146:0/3955547992 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f3858036b40 0x7f3858039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.707+0000 7f39730e1640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555edda60f70 0x555edda61370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.707+0000 7f39730e1640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555edda60f70 0x555edda61370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37248/0 (socket says 172.21.15.146:37248) 2024-09-18T01:47:09.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.707+0000 7f39730e1640 1 -- 172.21.15.146:0/1950417971 learned_addr learned my addr 172.21.15.146:0/1950417971 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:09.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.707+0000 7f385f606640 1 -- 172.21.15.146:0/3955547992 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f3964074070 con 0x555edd95ee80 2024-09-18T01:47:09.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.707+0000 7f39728e0640 1 --2- 172.21.15.146:0/3955547992 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f3858036b40 0x7f3858039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.707+0000 7f39730e1640 1 -- 172.21.15.146:0/1950417971 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555edda618b0 con 0x555edda60f70 2024-09-18T01:47:09.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.707+0000 7f39728e0640 1 --2- 172.21.15.146:0/3955547992 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f3858036b40 0x7f3858039000 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f396404efd0 tx=0x7f3964085040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.707+0000 7f39730e1640 1 --2- 172.21.15.146:0/1950417971 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555edda60f70 0x555edda61370 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f396c00a430 tx=0x7f396c00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2587dd5ddf8d7f52 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.707+0000 7f385d602640 1 -- 172.21.15.146:0/1950417971 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f396c015070 con 0x555edda60f70 2024-09-18T01:47:09.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.707+0000 7f385d602640 1 -- 172.21.15.146:0/1950417971 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f396c001670 con 0x555edda60f70 2024-09-18T01:47:09.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.707+0000 7f385d602640 1 -- 172.21.15.146:0/1950417971 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f396c001990 con 0x555edda60f70 2024-09-18T01:47:09.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.708+0000 7f3976b24800 1 -- 172.21.15.146:0/1950417971 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555edda60f70 msgr2=0x555edda61370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.708+0000 7f3976b24800 1 --2- 172.21.15.146:0/1950417971 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555edda60f70 0x555edda61370 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f396c00a430 tx=0x7f396c00a8f0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.708+0000 7f3976b24800 1 -- 172.21.15.146:0/1950417971 shutdown_connections 2024-09-18T01:47:09.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.708+0000 7f3976b24800 1 --2- 172.21.15.146:0/1950417971 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555edda60f70 0x555edda61370 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.708+0000 7f3976b24800 1 -- 172.21.15.146:0/1950417971 >> 172.21.15.146:0/1950417971 conn(0x555edda5c2e0 msgr2=0x555edda5f230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:09.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.708+0000 7f3976b24800 1 -- 172.21.15.146:0/1950417971 shutdown_connections 2024-09-18T01:47:09.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.708+0000 7f3976b24800 1 -- 172.21.15.146:0/1950417971 wait complete. 2024-09-18T01:47:09.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.708+0000 7f3976b24800 1 Processor -- start 2024-09-18T01:47:09.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.708+0000 7f3976b24800 1 -- start start 2024-09-18T01:47:09.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.708+0000 7f3976b24800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555edda60f70 0x555edda685c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.708+0000 7f3976b24800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x555edda62260 con 0x555edda60f70 2024-09-18T01:47:09.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.709+0000 7f39730e1640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555edda60f70 0x555edda685c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.709+0000 7f39730e1640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555edda60f70 0x555edda685c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37260/0 (socket says 172.21.15.146:37260) 2024-09-18T01:47:09.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.709+0000 7f39730e1640 1 -- 172.21.15.146:0/125323158 learned_addr learned my addr 172.21.15.146:0/125323158 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:09.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.709+0000 7f39730e1640 1 -- 172.21.15.146:0/125323158 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555edda68b00 con 0x555edda60f70 2024-09-18T01:47:09.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.709+0000 7f39730e1640 1 --2- 172.21.15.146:0/125323158 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555edda60f70 0x555edda685c0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f396c00a930 tx=0x7f396c003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.709+0000 7f38577fe640 1 -- 172.21.15.146:0/125323158 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f396c020020 con 0x555edda60f70 2024-09-18T01:47:09.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.709+0000 7f38577fe640 1 -- 172.21.15.146:0/125323158 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f396c0108b0 con 0x555edda60f70 2024-09-18T01:47:09.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.709+0000 7f38577fe640 1 -- 172.21.15.146:0/125323158 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f396c015040 con 0x555edda60f70 2024-09-18T01:47:09.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.709+0000 7f3976b24800 1 -- 172.21.15.146:0/125323158 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555edda68d90 con 0x555edda60f70 2024-09-18T01:47:09.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.709+0000 7f3976b24800 1 -- 172.21.15.146:0/125323158 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555edda6ba40 con 0x555edda60f70 2024-09-18T01:47:09.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.710+0000 7f38577fe640 1 -- 172.21.15.146:0/125323158 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f396c023020 con 0x555edda60f70 2024-09-18T01:47:09.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.710+0000 7f38577fe640 1 --2- 172.21.15.146:0/125323158 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f384c036b40 0x7f384c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.710+0000 7f38577fe640 1 -- 172.21.15.146:0/125323158 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f396c04c3b0 con 0x555edda60f70 2024-09-18T01:47:09.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.710+0000 7f396a0df640 1 --2- 172.21.15.146:0/125323158 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f384c036b40 0x7f384c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.711+0000 7f3976b24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:47:09.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.711+0000 7f3976b24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:47:09.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.711+0000 7f396a0df640 1 --2- 172.21.15.146:0/125323158 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f384c036b40 0x7f384c039000 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f395c000f60 tx=0x7f395c001370 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.711+0000 7f3976b24800 1 Processor -- start 2024-09-18T01:47:09.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.711+0000 7f3976b24800 1 -- start start 2024-09-18T01:47:09.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.711+0000 7f3976b24800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555edda869d0 0x555edda86df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.711+0000 7f3976b24800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x555edda4cc80 con 0x555edda869d0 2024-09-18T01:47:09.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.711+0000 7f39728e0640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555edda869d0 0x555edda86df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.711+0000 7f39728e0640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555edda869d0 0x555edda86df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37266/0 (socket says 172.21.15.146:37266) 2024-09-18T01:47:09.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.711+0000 7f39728e0640 1 -- 172.21.15.146:0/3167163379 learned_addr learned my addr 172.21.15.146:0/3167163379 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:09.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.712+0000 7f39728e0640 1 -- 172.21.15.146:0/3167163379 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555edda873c0 con 0x555edda869d0 2024-09-18T01:47:09.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.712+0000 7f39728e0640 1 --2- 172.21.15.146:0/3167163379 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555edda869d0 0x555edda86df0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f3964064e90 tx=0x7f3964064f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.712+0000 7f38377e6640 1 -- 172.21.15.146:0/3167163379 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f396404eaf0 con 0x555edda869d0 2024-09-18T01:47:09.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.712+0000 7f38377e6640 1 -- 172.21.15.146:0/3167163379 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f396404ed30 con 0x555edda869d0 2024-09-18T01:47:09.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.712+0000 7f3976b24800 1 -- 172.21.15.146:0/3167163379 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555edda8a010 con 0x555edda869d0 2024-09-18T01:47:09.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.712+0000 7f38377e6640 1 -- 172.21.15.146:0/3167163379 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f396406c2b0 con 0x555edda869d0 2024-09-18T01:47:09.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.712+0000 7f3976b24800 1 -- 172.21.15.146:0/3167163379 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555edda8a010 con 0x555edda869d0 2024-09-18T01:47:09.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.713+0000 7f38377e6640 1 -- 172.21.15.146:0/3167163379 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3964058070 con 0x555edda869d0 2024-09-18T01:47:09.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.713+0000 7f38377e6640 1 --2- 172.21.15.146:0/3167163379 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f37b4036b40 0x7f37b4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.713+0000 7f38377e6640 1 -- 172.21.15.146:0/3167163379 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f396406b040 con 0x555edda869d0 2024-09-18T01:47:09.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.713+0000 7f396a0df640 1 --2- 172.21.15.146:0/3167163379 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f37b4036b40 0x7f37b4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.713+0000 7f38357e2640 20 reqs_thread_entry: start 2024-09-18T01:47:09.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.713+0000 7f3976b24800 1 --2- 172.21.15.146:0/3955547992 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x555edda94200 0x555edda96610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.713+0000 7f396a0df640 1 --2- 172.21.15.146:0/3167163379 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f37b4036b40 0x7f37b4039000 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x555edda5cea0 tx=0x7f395c006000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.713+0000 7f3976b24800 1 -- 172.21.15.146:0/3955547992 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555edda96c90 con 0x555edda94200 2024-09-18T01:47:09.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.714+0000 7f39730e1640 1 --2- 172.21.15.146:0/3955547992 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x555edda94200 0x555edda96610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.714+0000 7f39730e1640 1 --2- 172.21.15.146:0/3955547992 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x555edda94200 0x555edda96610 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.714+0000 7f39730e1640 1 -- 172.21.15.146:0/3955547992 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f396c00e070 con 0x555edda94200 2024-09-18T01:47:09.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.714+0000 7f3976b24800 1 -- 172.21.15.146:0/3955547992 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555edda97570 con 0x555edda94200 2024-09-18T01:47:09.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.714+0000 7f39730e1640 1 -- 172.21.15.146:0/3955547992 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f396c00e070 con 0x555edda94200 2024-09-18T01:47:09.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.714+0000 7f3976b24800 1 --2- 172.21.15.146:0/3955547992 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x555edda98e80 0x555edda9b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.714+0000 7f3976b24800 1 -- 172.21.15.146:0/3955547992 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:3 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555edda9b9d0 con 0x555edda98e80 2024-09-18T01:47:09.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.715+0000 7f39728e0640 1 --2- 172.21.15.146:0/3955547992 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x555edda98e80 0x555edda9b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.715+0000 7f39728e0640 1 --2- 172.21.15.146:0/3955547992 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x555edda98e80 0x555edda9b310 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.715+0000 7f39728e0640 1 -- 172.21.15.146:0/3955547992 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(3 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3964057030 con 0x555edda98e80 2024-09-18T01:47:09.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.716+0000 7f3976b24800 1 -- 172.21.15.146:0/125323158 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f384c036b40 msgr2=0x7f384c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.716+0000 7f3976b24800 1 --2- 172.21.15.146:0/125323158 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f384c036b40 0x7f384c039000 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f395c000f60 tx=0x7f395c001370 comp rx=0 tx=0).stop 2024-09-18T01:47:09.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.716+0000 7f3976b24800 1 -- 172.21.15.146:0/125323158 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555edda60f70 msgr2=0x555edda685c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.716+0000 7f3976b24800 1 --2- 172.21.15.146:0/125323158 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555edda60f70 0x555edda685c0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f396c00a930 tx=0x7f396c003370 comp rx=0 tx=0).stop 2024-09-18T01:47:09.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.716+0000 7f3976b24800 1 -- 172.21.15.146:0/125323158 shutdown_connections 2024-09-18T01:47:09.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.716+0000 7f3976b24800 1 --2- 172.21.15.146:0/125323158 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f384c036b40 0x7f384c039000 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.716+0000 7f3976b24800 1 --2- 172.21.15.146:0/125323158 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555edda60f70 0x555edda685c0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.716+0000 7f3976b24800 1 -- 172.21.15.146:0/125323158 >> 172.21.15.146:0/125323158 conn(0x555edda5c2e0 msgr2=0x555edda5a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:09.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.716+0000 7f3976b24800 1 -- 172.21.15.146:0/125323158 shutdown_connections 2024-09-18T01:47:09.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.716+0000 7f3976b24800 1 -- 172.21.15.146:0/125323158 wait complete. 2024-09-18T01:47:09.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.716+0000 7f3976b24800 1 -- 172.21.15.146:0/3167163379 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f37b4036b40 msgr2=0x7f37b4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.716+0000 7f3976b24800 1 --2- 172.21.15.146:0/3167163379 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f37b4036b40 0x7f37b4039000 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x555edda5cea0 tx=0x7f395c006000 comp rx=0 tx=0).stop 2024-09-18T01:47:09.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.716+0000 7f3976b24800 1 -- 172.21.15.146:0/3167163379 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555edda869d0 msgr2=0x555edda86df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.716+0000 7f3976b24800 1 --2- 172.21.15.146:0/3167163379 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555edda869d0 0x555edda86df0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f3964064e90 tx=0x7f3964064f80 comp rx=0 tx=0).stop 2024-09-18T01:47:09.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.716+0000 7f3976b24800 1 -- 172.21.15.146:0/3167163379 shutdown_connections 2024-09-18T01:47:09.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.716+0000 7f3976b24800 1 --2- 172.21.15.146:0/3167163379 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f37b4036b40 0x7f37b4039000 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.716+0000 7f3976b24800 1 --2- 172.21.15.146:0/3167163379 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555edda869d0 0x555edda86df0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.716+0000 7f3976b24800 1 -- 172.21.15.146:0/3167163379 >> 172.21.15.146:0/3167163379 conn(0x555edda774f0 msgr2=0x555edda79de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:09.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.716+0000 7f3976b24800 1 -- 172.21.15.146:0/3167163379 shutdown_connections 2024-09-18T01:47:09.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.716+0000 7f3976b24800 1 -- 172.21.15.146:0/3167163379 wait complete. 2024-09-18T01:47:09.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.717+0000 7f3976b24800 1 -- 172.21.15.146:0/3955547992 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x555edda94200 msgr2=0x555edda96610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.717+0000 7f3976b24800 1 --2- 172.21.15.146:0/3955547992 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x555edda94200 0x555edda96610 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.717+0000 7f3976b24800 1 -- 172.21.15.146:0/3955547992 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x555edda98e80 msgr2=0x555edda9b310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.717+0000 7f3976b24800 1 --2- 172.21.15.146:0/3955547992 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x555edda98e80 0x555edda9b310 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.717+0000 7f3976b24800 1 -- 172.21.15.146:0/3955547992 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f3858036b40 msgr2=0x7f3858039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.717+0000 7f3976b24800 1 --2- 172.21.15.146:0/3955547992 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f3858036b40 0x7f3858039000 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f396404efd0 tx=0x7f3964085040 comp rx=0 tx=0).stop 2024-09-18T01:47:09.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.717+0000 7f3976b24800 1 -- 172.21.15.146:0/3955547992 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555edd95ee80 msgr2=0x555edda53dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.717+0000 7f3976b24800 1 --2- 172.21.15.146:0/3955547992 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555edd95ee80 0x555edda53dd0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f3964025da0 tx=0x7f3964002fb0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.717+0000 7f3976b24800 1 -- 172.21.15.146:0/3955547992 shutdown_connections 2024-09-18T01:47:09.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.717+0000 7f3976b24800 1 --2- 172.21.15.146:0/3955547992 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x555edda98e80 0x555edda9b310 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.717+0000 7f3976b24800 1 --2- 172.21.15.146:0/3955547992 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x555edda94200 0x555edda96610 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.717+0000 7f3976b24800 1 --2- 172.21.15.146:0/3955547992 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f3858036b40 0x7f3858039000 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.717+0000 7f3976b24800 1 --2- 172.21.15.146:0/3955547992 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555edd95ee80 0x555edda53dd0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.717+0000 7f3976b24800 1 -- 172.21.15.146:0/3955547992 >> 172.21.15.146:0/3955547992 conn(0x555edd959dd0 msgr2=0x555edda46720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:09.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.717+0000 7f3976b24800 1 -- 172.21.15.146:0/3955547992 shutdown_connections 2024-09-18T01:47:09.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.717+0000 7f3976b24800 1 -- 172.21.15.146:0/3955547992 wait complete. 2024-09-18T01:47:09.728 INFO:teuthology.orchestra.run.smithi146.stdout:{"id":"069822df-7f2c-4cd0-aee2-64a07ebf49c5","name":"default","api_name":"default","is_master":true,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"8ac01ed4-7422-45e2-b799-bf55088fb4fc","zones":[{"id":"8ac01ed4-7422-45e2-b799-bf55088fb4fc","name":"default","endpoints":[],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]} 2024-09-18T01:47:09.728 DEBUG:tasks.util.rgw: json result: {'id': '069822df-7f2c-4cd0-aee2-64a07ebf49c5', 'name': 'default', 'api_name': 'default', 'is_master': True, 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': '8ac01ed4-7422-45e2-b799-bf55088fb4fc', 'zones': [{'id': '8ac01ed4-7422-45e2-b799-bf55088fb4fc', 'name': 'default', 'endpoints': [], 'log_meta': False, 'log_data': False, 'bucket_index_max_shards': 11, 'read_only': False, 'tier_type': '', 'sync_from_all': True, 'sync_from': [], 'redirect_zone': '', 'supported_features': ['notification_v2', 'resharding']}], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': ['STANDARD']}], 'default_placement': 'default-placement', 'realm_id': '', 'sync_policy': {'groups': []}, 'enabled_features': ['notification_v2', 'resharding']} 2024-09-18T01:47:09.731 INFO:teuthology.run_tasks:Running task radosgw-admin-rest... 2024-09-18T01:47:09.748 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-18T01:47:09.748 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-18T01:47:09.749 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid ada --display-name 'Ms. Admin User' --access-key MH1WC2XQ1S8UISFDZC8W --secret dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG --max-buckets 0 --caps 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write' 2024-09-18T01:47:09.823 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:47:09.823 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:47:09.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.823+0000 7f874e142800 1 Processor -- start 2024-09-18T01:47:09.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.823+0000 7f874e142800 1 -- start start 2024-09-18T01:47:09.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.823+0000 7f874e142800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x555c16022930 0x555c16024d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.823+0000 7f874e142800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555c15eddb30 con 0x555c15f91e60 2024-09-18T01:47:09.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.823+0000 7f874e142800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x555c15ebf360 con 0x555c16022930 2024-09-18T01:47:09.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.824+0000 7f874968f640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x555c16022930 0x555c16024d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.824+0000 7f874968f640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x555c16022930 0x555c16024d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37272/0 (socket says 172.21.15.146:37272) 2024-09-18T01:47:09.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.824+0000 7f874968f640 1 -- 172.21.15.146:0/462999691 learned_addr learned my addr 172.21.15.146:0/462999691 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:09.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.824+0000 7f8749e90640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x555c15f91e60 0x555c16021210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:53056/0 (socket says 172.21.15.146:53056) 2024-09-18T01:47:09.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.824+0000 7f874968f640 1 -- 172.21.15.146:0/462999691 >> v1:172.21.15.129:6789/0 conn(0x555c15f91e60 legacy=0x555c16021210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.824+0000 7f874968f640 1 -- 172.21.15.146:0/462999691 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c15ee5e00 con 0x555c16022930 2024-09-18T01:47:09.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.826+0000 7f874968f640 1 --2- 172.21.15.146:0/462999691 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555c16022930 0x555c16024d20 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f874000a520 tx=0x7f8740045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55783d833c3d70c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.826+0000 7f8748e8e640 1 -- 172.21.15.146:0/462999691 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8740055070 con 0x555c16022930 2024-09-18T01:47:09.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.826+0000 7f8748e8e640 1 -- 172.21.15.146:0/462999691 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87400515b0 con 0x555c16022930 2024-09-18T01:47:09.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.826+0000 7f8748e8e640 1 -- 172.21.15.146:0/462999691 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87400518d0 con 0x555c16022930 2024-09-18T01:47:09.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.826+0000 7f874e142800 1 -- 172.21.15.146:0/462999691 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555c16022930 msgr2=0x555c16024d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.826+0000 7f874e142800 1 --2- 172.21.15.146:0/462999691 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555c16022930 0x555c16024d20 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f874000a520 tx=0x7f8740045ba0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.827+0000 7f874e142800 1 -- 172.21.15.146:0/462999691 shutdown_connections 2024-09-18T01:47:09.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.827+0000 7f874e142800 1 --2- 172.21.15.146:0/462999691 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555c16022930 0x555c16024d20 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.827+0000 7f874e142800 1 -- 172.21.15.146:0/462999691 >> 172.21.15.146:0/462999691 conn(0x555c16018e00 msgr2=0x555c1601b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:09.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.827+0000 7f874e142800 1 -- 172.21.15.146:0/462999691 shutdown_connections 2024-09-18T01:47:09.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.827+0000 7f874e142800 1 -- 172.21.15.146:0/462999691 wait complete. 2024-09-18T01:47:09.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.840+0000 7f874e142800 1 Processor -- start 2024-09-18T01:47:09.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.840+0000 7f874e142800 1 -- start start 2024-09-18T01:47:09.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.841+0000 7f874e142800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555c15f91e60 0x555c1610da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.841+0000 7f874e142800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x555c15f6a450 con 0x555c15f91e60 2024-09-18T01:47:09.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.841+0000 7f8749e90640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555c15f91e60 0x555c1610da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.841+0000 7f8749e90640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555c15f91e60 0x555c1610da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37274/0 (socket says 172.21.15.146:37274) 2024-09-18T01:47:09.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.841+0000 7f8749e90640 1 -- 172.21.15.146:0/2969105068 learned_addr learned my addr 172.21.15.146:0/2969105068 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:09.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.841+0000 7f8749e90640 1 -- 172.21.15.146:0/2969105068 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c15eb7bc0 con 0x555c15f91e60 2024-09-18T01:47:09.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.841+0000 7f8749e90640 1 --2- 172.21.15.146:0/2969105068 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555c15f91e60 0x555c1610da20 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f873c001650 tx=0x7f873c001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fdfda28c35a7a63 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.842+0000 7f8637e07640 1 -- 172.21.15.146:0/2969105068 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f873c013420 con 0x555c15f91e60 2024-09-18T01:47:09.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.842+0000 7f8637e07640 1 -- 172.21.15.146:0/2969105068 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f873c0135c0 con 0x555c15f91e60 2024-09-18T01:47:09.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.842+0000 7f8637e07640 1 -- 172.21.15.146:0/2969105068 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f873c0138c0 con 0x555c15f91e60 2024-09-18T01:47:09.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.842+0000 7f874e142800 1 -- 172.21.15.146:0/2969105068 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555c15f91e60 msgr2=0x555c1610da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.842+0000 7f874e142800 1 --2- 172.21.15.146:0/2969105068 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555c15f91e60 0x555c1610da20 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f873c001650 tx=0x7f873c001b10 comp rx=0 tx=0).stop 2024-09-18T01:47:09.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.842+0000 7f874e142800 1 -- 172.21.15.146:0/2969105068 shutdown_connections 2024-09-18T01:47:09.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.842+0000 7f874e142800 1 --2- 172.21.15.146:0/2969105068 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555c15f91e60 0x555c1610da20 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.842+0000 7f874e142800 1 -- 172.21.15.146:0/2969105068 >> 172.21.15.146:0/2969105068 conn(0x555c16018e00 msgr2=0x555c161093e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:09.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.842+0000 7f874e142800 1 -- 172.21.15.146:0/2969105068 shutdown_connections 2024-09-18T01:47:09.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.842+0000 7f874e142800 1 -- 172.21.15.146:0/2969105068 wait complete. 2024-09-18T01:47:09.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.843+0000 7f874e142800 1 Processor -- start 2024-09-18T01:47:09.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.843+0000 7f874e142800 1 -- start start 2024-09-18T01:47:09.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.843+0000 7f874e142800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555c15f91e60 0x555c1601eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.843+0000 7f874e142800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x555c16025650 con 0x555c15f91e60 2024-09-18T01:47:09.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.843+0000 7f8749e90640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555c15f91e60 0x555c1601eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.843+0000 7f8749e90640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555c15f91e60 0x555c1601eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37280/0 (socket says 172.21.15.146:37280) 2024-09-18T01:47:09.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.843+0000 7f8749e90640 1 -- 172.21.15.146:0/435866624 learned_addr learned my addr 172.21.15.146:0/435866624 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:09.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.843+0000 7f8749e90640 1 -- 172.21.15.146:0/435866624 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c15ecbfe0 con 0x555c15f91e60 2024-09-18T01:47:09.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.843+0000 7f8749e90640 1 --2- 172.21.15.146:0/435866624 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555c15f91e60 0x555c1601eb40 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x555c1610e880 tx=0x7f873c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.844+0000 7f8636604640 1 -- 172.21.15.146:0/435866624 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f873c022020 con 0x555c15f91e60 2024-09-18T01:47:09.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.844+0000 7f8636604640 1 -- 172.21.15.146:0/435866624 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f873c006830 con 0x555c15f91e60 2024-09-18T01:47:09.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.844+0000 7f874e142800 1 -- 172.21.15.146:0/435866624 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555c1601d230 con 0x555c15f91e60 2024-09-18T01:47:09.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.844+0000 7f8636604640 1 -- 172.21.15.146:0/435866624 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f873c004b30 con 0x555c15f91e60 2024-09-18T01:47:09.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.844+0000 7f874e142800 1 -- 172.21.15.146:0/435866624 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c1601d750 con 0x555c15f91e60 2024-09-18T01:47:09.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.844+0000 7f8636604640 1 -- 172.21.15.146:0/435866624 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f873c025020 con 0x555c15f91e60 2024-09-18T01:47:09.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.845+0000 7f8636604640 1 --2- 172.21.15.146:0/435866624 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8630036b40 0x7f8630039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.845+0000 7f8636604640 1 -- 172.21.15.146:0/435866624 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f873c018030 con 0x555c15f91e60 2024-09-18T01:47:09.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.845+0000 7f874968f640 1 --2- 172.21.15.146:0/435866624 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8630036b40 0x7f8630039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.845+0000 7f874e142800 1 --2- 172.21.15.146:0/435866624 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x555c16022930 0x555c1611e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.845+0000 7f874e142800 1 -- 172.21.15.146:0/435866624 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555c1611ed60 con 0x555c16022930 2024-09-18T01:47:09.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.845+0000 7f874a691640 1 --2- 172.21.15.146:0/435866624 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x555c16022930 0x555c1611e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.845+0000 7f874968f640 1 --2- 172.21.15.146:0/435866624 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8630036b40 0x7f8630039000 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8740057000 tx=0x7f8740052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.845+0000 7f874a691640 1 --2- 172.21.15.146:0/435866624 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x555c16022930 0x555c1611e820 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.845+0000 7f874a691640 1 -- 172.21.15.146:0/435866624 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f87440083e0 con 0x555c16022930 2024-09-18T01:47:09.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.846+0000 7f874e142800 1 -- 172.21.15.146:0/435866624 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555c1611f5b0 con 0x555c16022930 2024-09-18T01:47:09.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.846+0000 7f874a691640 1 -- 172.21.15.146:0/435866624 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f87440083e0 con 0x555c16022930 2024-09-18T01:47:09.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.846+0000 7f874e142800 1 -- 172.21.15.146:0/435866624 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555c16120960 con 0x555c16022930 2024-09-18T01:47:09.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.846+0000 7f874a691640 1 -- 172.21.15.146:0/435866624 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f87440083e0 con 0x555c16022930 2024-09-18T01:47:09.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.846+0000 7f874e142800 1 -- 172.21.15.146:0/435866624 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555c1611fe00 con 0x555c16022930 2024-09-18T01:47:09.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.847+0000 7f874a691640 1 -- 172.21.15.146:0/435866624 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f87440083e0 con 0x555c16022930 2024-09-18T01:47:09.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.847+0000 7f874e142800 1 --2- 172.21.15.146:0/435866624 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x555c16121d60 0x555c16124150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.847+0000 7f874e142800 1 -- 172.21.15.146:0/435866624 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555c161247b0 con 0x555c16121d60 2024-09-18T01:47:09.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.847+0000 7f8749e90640 1 --2- 172.21.15.146:0/435866624 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x555c16121d60 0x555c16124150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.847+0000 7f8749e90640 1 --2- 172.21.15.146:0/435866624 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x555c16121d60 0x555c16124150 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.847+0000 7f8749e90640 1 -- 172.21.15.146:0/435866624 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f873c01b070 con 0x555c16121d60 2024-09-18T01:47:09.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.847+0000 7f874e142800 1 Processor -- start 2024-09-18T01:47:09.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.848+0000 7f874e142800 1 -- start start 2024-09-18T01:47:09.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.848+0000 7f874e142800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555c16132520 0x555c16132940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.848+0000 7f874e142800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x555c1601f080 con 0x555c16132520 2024-09-18T01:47:09.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.848+0000 7f874a691640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555c16132520 0x555c16132940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.848+0000 7f874a691640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555c16132520 0x555c16132940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37290/0 (socket says 172.21.15.146:37290) 2024-09-18T01:47:09.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.848+0000 7f874a691640 1 -- 172.21.15.146:0/3280284648 learned_addr learned my addr 172.21.15.146:0/3280284648 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:09.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.848+0000 7f874a691640 1 -- 172.21.15.146:0/3280284648 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c16132e80 con 0x555c16132520 2024-09-18T01:47:09.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.849+0000 7f874a691640 1 --2- 172.21.15.146:0/3280284648 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555c16132520 0x555c16132940 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x555c1601e880 tx=0x7f874400ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.849+0000 7f862f7fe640 1 -- 172.21.15.146:0/3280284648 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f874401c070 con 0x555c16132520 2024-09-18T01:47:09.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.849+0000 7f862f7fe640 1 -- 172.21.15.146:0/3280284648 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f874400bdc0 con 0x555c16132520 2024-09-18T01:47:09.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.849+0000 7f862f7fe640 1 -- 172.21.15.146:0/3280284648 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8744018540 con 0x555c16132520 2024-09-18T01:47:09.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.849+0000 7f874e142800 1 -- 172.21.15.146:0/3280284648 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555c16133110 con 0x555c16132520 2024-09-18T01:47:09.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.849+0000 7f874e142800 1 -- 172.21.15.146:0/3280284648 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c16135df0 con 0x555c16132520 2024-09-18T01:47:09.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.850+0000 7f862f7fe640 1 -- 172.21.15.146:0/3280284648 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f874401f070 con 0x555c16132520 2024-09-18T01:47:09.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.850+0000 7f862f7fe640 1 --2- 172.21.15.146:0/3280284648 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8624036b40 0x7f8624039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.850+0000 7f862f7fe640 1 -- 172.21.15.146:0/3280284648 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f874404e660 con 0x555c16132520 2024-09-18T01:47:09.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.850+0000 7f8749e90640 1 --2- 172.21.15.146:0/3280284648 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8624036b40 0x7f8624039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.850+0000 7f874e142800 1 Processor -- start 2024-09-18T01:47:09.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.850+0000 7f874e142800 1 -- start start 2024-09-18T01:47:09.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.850+0000 7f8749e90640 1 --2- 172.21.15.146:0/3280284648 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8624036b40 0x7f8624039000 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f873c04b030 tx=0x7f873c04af00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.850+0000 7f874e142800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555c1613f210 0x555c1613f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.850+0000 7f874e142800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x555c15eb9580 con 0x555c1613f210 2024-09-18T01:47:09.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.850+0000 7f874a691640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555c1613f210 0x555c1613f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.851+0000 7f874a691640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555c1613f210 0x555c1613f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37300/0 (socket says 172.21.15.146:37300) 2024-09-18T01:47:09.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.851+0000 7f874a691640 1 -- 172.21.15.146:0/2263928599 learned_addr learned my addr 172.21.15.146:0/2263928599 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:09.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.851+0000 7f874a691640 1 -- 172.21.15.146:0/2263928599 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c1613fbe0 con 0x555c1613f210 2024-09-18T01:47:09.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.851+0000 7f874a691640 1 --2- 172.21.15.146:0/2263928599 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555c1613f210 0x555c1613f610 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f874404c940 tx=0x7f874404cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6fedd72d100a524 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.851+0000 7f862d7fa640 1 -- 172.21.15.146:0/2263928599 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8744017520 con 0x555c1613f210 2024-09-18T01:47:09.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.851+0000 7f862d7fa640 1 -- 172.21.15.146:0/2263928599 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f874404a030 con 0x555c1613f210 2024-09-18T01:47:09.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.851+0000 7f862d7fa640 1 -- 172.21.15.146:0/2263928599 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8744029da0 con 0x555c1613f210 2024-09-18T01:47:09.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.852+0000 7f874e142800 1 -- 172.21.15.146:0/2263928599 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555c1613f210 msgr2=0x555c1613f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.852+0000 7f874e142800 1 --2- 172.21.15.146:0/2263928599 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555c1613f210 0x555c1613f610 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f874404c940 tx=0x7f874404cbf0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.852+0000 7f874e142800 1 -- 172.21.15.146:0/2263928599 shutdown_connections 2024-09-18T01:47:09.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.852+0000 7f874e142800 1 --2- 172.21.15.146:0/2263928599 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555c1613f210 0x555c1613f610 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.852+0000 7f874e142800 1 -- 172.21.15.146:0/2263928599 >> 172.21.15.146:0/2263928599 conn(0x555c1613b570 msgr2=0x555c16139670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:09.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.852+0000 7f874e142800 1 -- 172.21.15.146:0/2263928599 shutdown_connections 2024-09-18T01:47:09.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.852+0000 7f874e142800 1 -- 172.21.15.146:0/2263928599 wait complete. 2024-09-18T01:47:09.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.852+0000 7f874e142800 1 Processor -- start 2024-09-18T01:47:09.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.852+0000 7f874e142800 1 -- start start 2024-09-18T01:47:09.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.852+0000 7f874e142800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555c1613f210 0x555c16146520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.852+0000 7f874e142800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x555c161400d0 con 0x555c1613f210 2024-09-18T01:47:09.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.852+0000 7f874a691640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555c1613f210 0x555c16146520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.852+0000 7f874a691640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555c1613f210 0x555c16146520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37304/0 (socket says 172.21.15.146:37304) 2024-09-18T01:47:09.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.852+0000 7f874a691640 1 -- 172.21.15.146:0/4118641629 learned_addr learned my addr 172.21.15.146:0/4118641629 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:09.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.852+0000 7f874a691640 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c16146a60 con 0x555c1613f210 2024-09-18T01:47:09.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.853+0000 7f874a691640 1 --2- 172.21.15.146:0/4118641629 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555c1613f210 0x555c16146520 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f874404c940 tx=0x7f874404c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.853+0000 7f861b7fe640 1 -- 172.21.15.146:0/4118641629 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8744016b90 con 0x555c1613f210 2024-09-18T01:47:09.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.853+0000 7f861b7fe640 1 -- 172.21.15.146:0/4118641629 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8744016d30 con 0x555c1613f210 2024-09-18T01:47:09.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.853+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555c16146cf0 con 0x555c1613f210 2024-09-18T01:47:09.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.853+0000 7f861b7fe640 1 -- 172.21.15.146:0/4118641629 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8744018730 con 0x555c1613f210 2024-09-18T01:47:09.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.853+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c161499a0 con 0x555c1613f210 2024-09-18T01:47:09.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.854+0000 7f861b7fe640 1 -- 172.21.15.146:0/4118641629 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f874404cd10 con 0x555c1613f210 2024-09-18T01:47:09.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.854+0000 7f861b7fe640 1 --2- 172.21.15.146:0/4118641629 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8614036b90 0x7f8614039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.854+0000 7f861b7fe640 1 -- 172.21.15.146:0/4118641629 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f8744033030 con 0x555c1613f210 2024-09-18T01:47:09.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.854+0000 7f8749e90640 1 --2- 172.21.15.146:0/4118641629 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8614036b90 0x7f8614039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.854+0000 7f8749e90640 1 --2- 172.21.15.146:0/4118641629 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8614036b90 0x7f8614039050 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f873c044cf0 tx=0x7f873c034000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.854+0000 7f874e142800 20 rados->read ofs=0 len=0 2024-09-18T01:47:09.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.854+0000 7f874e142800 1 --2- 172.21.15.146:0/4118641629 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x555c16151f40 0x555c16154400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.855+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555c16154b50 con 0x555c16151f40 2024-09-18T01:47:09.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.855+0000 7f874968f640 1 --2- 172.21.15.146:0/4118641629 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x555c16151f40 0x555c16154400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.855+0000 7f874968f640 1 --2- 172.21.15.146:0/4118641629 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x555c16151f40 0x555c16154400 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.855+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8740057030 con 0x555c16151f40 2024-09-18T01:47:09.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.855+0000 7f874e142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:09.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.855+0000 7f874e142800 20 realm 2024-09-18T01:47:09.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.855+0000 7f874e142800 20 rados->read ofs=0 len=0 2024-09-18T01:47:09.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.855+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555c16154f80 con 0x555c16151f40 2024-09-18T01:47:09.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.855+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8740057030 con 0x555c16151f40 2024-09-18T01:47:09.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.855+0000 7f874e142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:09.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.855+0000 7f874e142800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:47:09.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.855+0000 7f874e142800 20 rados->read ofs=0 len=0 2024-09-18T01:47:09.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.855+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555c16155850 con 0x555c16151f40 2024-09-18T01:47:09.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.856+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8740057030 con 0x555c16151f40 2024-09-18T01:47:09.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.856+0000 7f874e142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:09.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.856+0000 7f874e142800 20 rados->read ofs=0 len=0 2024-09-18T01:47:09.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.856+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555c16155bf0 con 0x555c16151f40 2024-09-18T01:47:09.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.856+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8740057030 con 0x555c16151f40 2024-09-18T01:47:09.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.856+0000 7f874e142800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:47:09.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.856+0000 7f874e142800 20 rados->read ofs=0 len=0 2024-09-18T01:47:09.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.856+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555c16156440 con 0x555c16151f40 2024-09-18T01:47:09.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.856+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8740057030 con 0x555c16151f40 2024-09-18T01:47:09.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.856+0000 7f874e142800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:47:09.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.856+0000 7f874e142800 20 searching for the correct realm 2024-09-18T01:47:09.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.856+0000 7f874e142800 1 --2- 172.21.15.146:0/4118641629 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x555c161581b0 0x555c1615a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.856+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c1615abd0 con 0x555c161581b0 2024-09-18T01:47:09.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.856+0000 7f874a691640 1 --2- 172.21.15.146:0/4118641629 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x555c161581b0 0x555c1615a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.857+0000 7f874a691640 1 --2- 172.21.15.146:0/4118641629 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x555c161581b0 0x555c1615a5a0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.857+0000 7f874a691640 1 -- 172.21.15.146:0/4118641629 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8744057040 con 0x555c161581b0 2024-09-18T01:47:09.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.857+0000 7f874a691640 1 --2- 172.21.15.146:0/4118641629 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f87440163a0 0x7f874402b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.857+0000 7f874a691640 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c1615abd0 con 0x7f87440163a0 2024-09-18T01:47:09.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.857+0000 7f8749e90640 1 --2- 172.21.15.146:0/4118641629 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f87440163a0 0x7f874402b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.857+0000 7f8749e90640 1 --2- 172.21.15.146:0/4118641629 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f87440163a0 0x7f874402b960 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.857+0000 7f8749e90640 1 -- 172.21.15.146:0/4118641629 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f873c053040 con 0x7f87440163a0 2024-09-18T01:47:09.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.857+0000 7f8749e90640 1 --2- 172.21.15.146:0/4118641629 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f873c056040 0x7f873c026ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:09.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.857+0000 7f8749e90640 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c1615abd0 con 0x7f873c056040 2024-09-18T01:47:09.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.858+0000 7f874968f640 1 --2- 172.21.15.146:0/4118641629 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f873c056040 0x7f873c026ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:09.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.858+0000 7f874968f640 1 --2- 172.21.15.146:0/4118641629 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f873c056040 0x7f873c026ae0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:09.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.858+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8740057030 con 0x7f873c056040 2024-09-18T01:47:09.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.858+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c1615abd0 con 0x555c16151f40 2024-09-18T01:47:09.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.859+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v33'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8740057030 con 0x555c16151f40 2024-09-18T01:47:09.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.859+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c1615abd0 con 0x555c16151f40 2024-09-18T01:47:09.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.859+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8740057030 con 0x555c16151f40 2024-09-18T01:47:09.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.859+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c1615abd0 con 0x7f873c056040 2024-09-18T01:47:09.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.859+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8740057030 con 0x7f873c056040 2024-09-18T01:47:09.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.859+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c1615abd0 con 0x7f873c056040 2024-09-18T01:47:09.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.859+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8740057030 con 0x7f873c056040 2024-09-18T01:47:09.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.859+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c1615abd0 con 0x7f87440163a0 2024-09-18T01:47:09.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.860+0000 7f8749e90640 1 -- 172.21.15.146:0/4118641629 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f873c053040 con 0x7f87440163a0 2024-09-18T01:47:09.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.860+0000 7f8749e90640 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c1615abd0 con 0x555c161581b0 2024-09-18T01:47:09.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.860+0000 7f874a691640 1 -- 172.21.15.146:0/4118641629 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8744057040 con 0x555c161581b0 2024-09-18T01:47:09.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.860+0000 7f874a691640 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c1615abd0 con 0x555c16151f40 2024-09-18T01:47:09.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.860+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8740057030 con 0x555c16151f40 2024-09-18T01:47:09.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.860+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c1615abd0 con 0x7f873c056040 2024-09-18T01:47:09.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.860+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8740057030 con 0x7f873c056040 2024-09-18T01:47:09.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.860+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c1615abd0 con 0x555c16151f40 2024-09-18T01:47:09.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.861+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8740057030 con 0x555c16151f40 2024-09-18T01:47:09.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.861+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c1615abd0 con 0x7f87440163a0 2024-09-18T01:47:09.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.861+0000 7f8749e90640 1 -- 172.21.15.146:0/4118641629 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f873c053040 con 0x7f87440163a0 2024-09-18T01:47:09.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.861+0000 7f8749e90640 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c1615abd0 con 0x555c161581b0 2024-09-18T01:47:09.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.861+0000 7f874a691640 1 -- 172.21.15.146:0/4118641629 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8744057040 con 0x555c161581b0 2024-09-18T01:47:09.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.861+0000 7f874a691640 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c1615abd0 con 0x555c161581b0 2024-09-18T01:47:09.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.861+0000 7f874a691640 1 -- 172.21.15.146:0/4118641629 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8744057040 con 0x555c161581b0 2024-09-18T01:47:09.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.861+0000 7f874a691640 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c1615abd0 con 0x7f873c056040 2024-09-18T01:47:09.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.862+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8740057030 con 0x7f873c056040 2024-09-18T01:47:09.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.862+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c1615abd0 con 0x555c161581b0 2024-09-18T01:47:09.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.862+0000 7f874a691640 1 -- 172.21.15.146:0/4118641629 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8744057040 con 0x555c161581b0 2024-09-18T01:47:09.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.862+0000 7f874a691640 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c1615abd0 con 0x555c161581b0 2024-09-18T01:47:09.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.862+0000 7f874a691640 1 -- 172.21.15.146:0/4118641629 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8744057040 con 0x555c161581b0 2024-09-18T01:47:09.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.862+0000 7f874a691640 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c1615abd0 con 0x555c16151f40 2024-09-18T01:47:09.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.862+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8740057030 con 0x555c16151f40 2024-09-18T01:47:09.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.862+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c1615abd0 con 0x555c16151f40 2024-09-18T01:47:09.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.862+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v33'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8740057030 con 0x555c16151f40 2024-09-18T01:47:09.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.863+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c1615abd0 con 0x7f873c056040 2024-09-18T01:47:09.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.863+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8740057030 con 0x7f873c056040 2024-09-18T01:47:09.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.863+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c1615abd0 con 0x555c161581b0 2024-09-18T01:47:09.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.863+0000 7f874a691640 1 -- 172.21.15.146:0/4118641629 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8744057040 con 0x555c161581b0 2024-09-18T01:47:09.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.863+0000 7f874a691640 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c1615abd0 con 0x7f87440163a0 2024-09-18T01:47:09.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.863+0000 7f8749e90640 1 -- 172.21.15.146:0/4118641629 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f873c053040 con 0x7f87440163a0 2024-09-18T01:47:09.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.863+0000 7f8749e90640 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c1615abd0 con 0x555c16151f40 2024-09-18T01:47:09.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.864+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8740057030 con 0x555c16151f40 2024-09-18T01:47:09.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.864+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c1615abd0 con 0x7f873c056040 2024-09-18T01:47:09.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.864+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8740057030 con 0x7f873c056040 2024-09-18T01:47:09.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.864+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c1615abd0 con 0x555c161581b0 2024-09-18T01:47:09.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.864+0000 7f874a691640 1 -- 172.21.15.146:0/4118641629 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8744057040 con 0x555c161581b0 2024-09-18T01:47:09.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.864+0000 7f874a691640 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c1615abd0 con 0x7f873c056040 2024-09-18T01:47:09.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.864+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8740057030 con 0x7f873c056040 2024-09-18T01:47:09.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.864+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c1615abd0 con 0x7f87440163a0 2024-09-18T01:47:09.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.865+0000 7f8749e90640 1 -- 172.21.15.146:0/4118641629 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f873c053040 con 0x7f87440163a0 2024-09-18T01:47:09.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.865+0000 7f8749e90640 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c1615abd0 con 0x555c161581b0 2024-09-18T01:47:09.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.865+0000 7f874a691640 1 -- 172.21.15.146:0/4118641629 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8744057040 con 0x555c161581b0 2024-09-18T01:47:09.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.865+0000 7f874a691640 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c1615abd0 con 0x7f873c056040 2024-09-18T01:47:09.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.865+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8740057030 con 0x7f873c056040 2024-09-18T01:47:09.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.865+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c1615abd0 con 0x555c16151f40 2024-09-18T01:47:09.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.865+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v33'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8740057030 con 0x555c16151f40 2024-09-18T01:47:09.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.865+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555c1615abd0 con 0x7f87440163a0 2024-09-18T01:47:09.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.866+0000 7f8749e90640 1 -- 172.21.15.146:0/4118641629 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f873c062040 con 0x7f87440163a0 2024-09-18T01:47:09.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.866+0000 7f874e142800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:47:09.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.866+0000 7f874e142800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:47:09.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.866+0000 7f874e142800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:47:09.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.866+0000 7f874e142800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:47:09.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.866+0000 7f874e142800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:47:09.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.866+0000 7f874e142800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:47:09.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.866+0000 7f874e142800 20 rados->read ofs=0 len=0 2024-09-18T01:47:09.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.866+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555c16156df0 con 0x555c16151f40 2024-09-18T01:47:09.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.866+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8740057030 con 0x555c16151f40 2024-09-18T01:47:09.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.866+0000 7f874e142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:09.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.866+0000 7f874e142800 20 rados->read ofs=0 len=0 2024-09-18T01:47:09.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.866+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555c16157690 con 0x555c16151f40 2024-09-18T01:47:09.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.866+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8740057030 con 0x555c16151f40 2024-09-18T01:47:09.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.866+0000 7f874e142800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:47:09.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.866+0000 7f874e142800 20 rados->read ofs=0 len=0 2024-09-18T01:47:09.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.866+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555c1615b050 con 0x7f87440163a0 2024-09-18T01:47:09.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.866+0000 7f8749e90640 1 -- 172.21.15.146:0/4118641629 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f873c062040 con 0x7f87440163a0 2024-09-18T01:47:09.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.866+0000 7f874e142800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:47:09.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.867+0000 7f874e142800 20 zone default found 2024-09-18T01:47:09.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.867+0000 7f874e142800 4 Realm: () 2024-09-18T01:47:09.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.867+0000 7f874e142800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:47:09.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.867+0000 7f874e142800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:47:09.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.867+0000 7f874e142800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:47:09.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.867+0000 7f874e142800 20 zonegroup default 2024-09-18T01:47:09.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.867+0000 7f874e142800 20 rados->read ofs=0 len=0 2024-09-18T01:47:09.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.867+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555c1615b8a0 con 0x7f873c056040 2024-09-18T01:47:09.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.867+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8740057030 con 0x7f873c056040 2024-09-18T01:47:09.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.867+0000 7f874e142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:09.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.867+0000 7f874e142800 20 rados->read ofs=0 len=0 2024-09-18T01:47:09.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.867+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555c1615d280 con 0x555c161581b0 2024-09-18T01:47:09.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.867+0000 7f874a691640 1 -- 172.21.15.146:0/4118641629 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8744057040 con 0x555c161581b0 2024-09-18T01:47:09.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.867+0000 7f874e142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:09.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.867+0000 7f874e142800 20 rados->read ofs=0 len=0 2024-09-18T01:47:09.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.867+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555c1615d720 con 0x555c161581b0 2024-09-18T01:47:09.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.867+0000 7f874a691640 1 -- 172.21.15.146:0/4118641629 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8744057040 con 0x555c161581b0 2024-09-18T01:47:09.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.867+0000 7f874e142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:09.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.867+0000 7f874e142800 20 started sync module instance, tier type = 2024-09-18T01:47:09.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.867+0000 7f874e142800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:47:09.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.867+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c1615c710 con 0x7f87440163a0 2024-09-18T01:47:09.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.868+0000 7f8749e90640 1 -- 172.21.15.146:0/4118641629 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v33'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f873c062040 con 0x7f87440163a0 2024-09-18T01:47:09.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.868+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93853995879168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c1615e030 con 0x7f87440163a0 2024-09-18T01:47:09.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.869+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c1615e880 con 0x555c16151f40 2024-09-18T01:47:09.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.870+0000 7f8749e90640 1 -- 172.21.15.146:0/4118641629 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93853995879168] v33'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f873c062040 con 0x7f87440163a0 2024-09-18T01:47:09.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.870+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v33'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8740057030 con 0x555c16151f40 2024-09-18T01:47:09.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.870+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93853995883392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c1615e8c0 con 0x555c16151f40 2024-09-18T01:47:09.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.870+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c1615f3b0 con 0x555c161581b0 2024-09-18T01:47:09.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.871+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93853995883392] v33'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8740057030 con 0x555c16151f40 2024-09-18T01:47:09.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.872+0000 7f874a691640 1 -- 172.21.15.146:0/4118641629 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v33'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8744057040 con 0x555c161581b0 2024-09-18T01:47:09.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.872+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93853995888256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c1615f370 con 0x555c161581b0 2024-09-18T01:47:09.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.872+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c1615fe60 con 0x7f87440163a0 2024-09-18T01:47:09.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.873+0000 7f8749e90640 1 -- 172.21.15.146:0/4118641629 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v33'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f873c062040 con 0x7f87440163a0 2024-09-18T01:47:09.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.873+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93853995891056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c16160700 con 0x7f87440163a0 2024-09-18T01:47:09.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.873+0000 7f874a691640 1 -- 172.21.15.146:0/4118641629 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93853995888256] v33'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8744057040 con 0x555c161581b0 2024-09-18T01:47:09.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.873+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c1615e3f0 con 0x555c16151f40 2024-09-18T01:47:09.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.874+0000 7f8749e90640 1 -- 172.21.15.146:0/4118641629 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93853995891056] v33'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f873c062040 con 0x7f87440163a0 2024-09-18T01:47:09.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.874+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v33'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8740057030 con 0x555c16151f40 2024-09-18T01:47:09.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.874+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93853995893328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c16160670 con 0x555c16151f40 2024-09-18T01:47:09.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.874+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c161617c0 con 0x7f873c056040 2024-09-18T01:47:09.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.875+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v33'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8740057030 con 0x7f873c056040 2024-09-18T01:47:09.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.875+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93853995893328] v33'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8740057030 con 0x555c16151f40 2024-09-18T01:47:09.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.875+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93853995897616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c16161be0 con 0x7f873c056040 2024-09-18T01:47:09.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.875+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c16160d20 con 0x7f873c056040 2024-09-18T01:47:09.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.876+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93853995897616] v33'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8740057030 con 0x7f873c056040 2024-09-18T01:47:09.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.876+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v33'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8740057030 con 0x7f873c056040 2024-09-18T01:47:09.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.876+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93853995898672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c16161b50 con 0x7f873c056040 2024-09-18T01:47:09.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.876+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c16162b00 con 0x7f873c056040 2024-09-18T01:47:09.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.877+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93853995898672] v33'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8740057030 con 0x7f873c056040 2024-09-18T01:47:09.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.877+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v33'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8740057030 con 0x7f873c056040 2024-09-18T01:47:09.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.877+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93853995901216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c16162ac0 con 0x7f873c056040 2024-09-18T01:47:09.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.877+0000 7f874e142800 20 add_watcher() i=0 2024-09-18T01:47:09.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.877+0000 7f874e142800 20 add_watcher() i=1 2024-09-18T01:47:09.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.877+0000 7f874e142800 20 add_watcher() i=2 2024-09-18T01:47:09.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.877+0000 7f874e142800 20 add_watcher() i=3 2024-09-18T01:47:09.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.877+0000 7f874e142800 20 add_watcher() i=4 2024-09-18T01:47:09.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.877+0000 7f874e142800 20 add_watcher() i=5 2024-09-18T01:47:09.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.877+0000 7f874e142800 20 add_watcher() i=6 2024-09-18T01:47:09.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.878+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93853995901216] v33'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8740057030 con 0x7f873c056040 2024-09-18T01:47:09.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.878+0000 7f874e142800 20 add_watcher() i=7 2024-09-18T01:47:09.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.878+0000 7f874e142800 2 all 8 watchers are set, enabling cache 2024-09-18T01:47:09.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.878+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555c16165ef0 con 0x555c16151f40 2024-09-18T01:47:09.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.879+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8740057030 con 0x555c16151f40 2024-09-18T01:47:09.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.879+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93853995902272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c161633e0 con 0x555c16151f40 2024-09-18T01:47:09.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.880+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93853995902272] v33'245 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8740057030 con 0x555c16151f40 2024-09-18T01:47:09.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.880+0000 7f85fb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:47:09.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.880+0000 7f874e142800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:47:09.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.880+0000 7f874e142800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:47:09.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.880+0000 7f874e142800 5 note: GC not initialized 2024-09-18T01:47:09.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.880+0000 7f85fa7fc640 20 reqs_thread_entry: start 2024-09-18T01:47:09.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.880+0000 7f874e142800 20 init_complete bucket index max shards: 11 2024-09-18T01:47:09.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.880+0000 7f874e142800 20 Filter name: none 2024-09-18T01:47:09.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.881+0000 7f856bfff640 20 reqs_thread_entry: start 2024-09-18T01:47:09.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.881+0000 7f874e142800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-18T01:47:09.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.881+0000 7f874e142800 20 rados->read ofs=0 len=0 2024-09-18T01:47:09.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.881+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555c161992e0 con 0x7f873c056040 2024-09-18T01:47:09.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.881+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(62 ada [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f8740057030 con 0x7f873c056040 2024-09-18T01:47:09.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.881+0000 7f874e142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:09.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.881+0000 7f874e142800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x0 2024-09-18T01:47:09.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.881+0000 7f874e142800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:47:09.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.881+0000 7f874e142800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : miss 2024-09-18T01:47:09.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.881+0000 7f874e142800 20 rados->read ofs=0 len=0 2024-09-18T01:47:09.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.881+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:63 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555c16197920 con 0x555c16151f40 2024-09-18T01:47:09.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.881+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(63 MH1WC2XQ1S8UISFDZC8W [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f8740057030 con 0x555c16151f40 2024-09-18T01:47:09.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.881+0000 7f874e142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:09.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.881+0000 7f874e142800 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x0 2024-09-18T01:47:09.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.881+0000 7f874e142800 10 adding default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-18T01:47:09.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.881+0000 7f874e142800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-18T01:47:09.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.881+0000 7f874e142800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-18T01:47:09.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.882+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:64 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c16198280 con 0x7f873c056040 2024-09-18T01:47:09.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.883+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(64 ada [delete,create,call,writefull 0~473] v33'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f8740057030 con 0x7f873c056040 2024-09-18T01:47:09.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.883+0000 7f874e142800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T01:47:09.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.883+0000 7f874e142800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:47:09.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.883+0000 7f874e142800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-18T01:47:09.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.883+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 93853996121392 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555c1619cd80 con 0x555c16151f40 2024-09-18T01:47:09.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.883+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== watch-notify(notify (1) cookie 93853995893328 notify 141733920791 ret 0) ==== 691+0+0 (crc 0 0 0) 0x555c16198620 con 0x555c16151f40 2024-09-18T01:47:09.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.883+0000 7f862d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920791 cookie 93853995893328 notifier 4838 bl.length()=649 2024-09-18T01:47:09.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.883+0000 7f862d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T01:47:09.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.883+0000 7f862d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:47:09.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.883+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(65 notify.4 [notify cookie 93853996121392 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8740057030 con 0x555c16151f40 2024-09-18T01:47:09.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.883+0000 7f862d7fa640 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f860c003ea0 con 0x555c16151f40 2024-09-18T01:47:09.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.883+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8740057030 con 0x555c16151f40 2024-09-18T01:47:09.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.883+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== watch-notify(notify_complete (2) cookie 93853996121392 notify 141733920791 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555c16198f20 con 0x555c16151f40 2024-09-18T01:47:09.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.883+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:67 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c16197ce0 con 0x555c16151f40 2024-09-18T01:47:09.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.884+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== osd_op_reply(67 MH1WC2XQ1S8UISFDZC8W [delete,create,writefull 0~7] v33'20 uv20 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f8740057030 con 0x555c16151f40 2024-09-18T01:47:09.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.884+0000 7f874e142800 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-18T01:47:09.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.884+0000 7f874e142800 10 moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-18T01:47:09.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.884+0000 7f874e142800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:MH1WC2XQ1S8UISFDZC8W, ofs0, ns] 2024-09-18T01:47:09.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.884+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 93853996121312 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555c1619d1b0 con 0x555c161581b0 2024-09-18T01:47:09.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.885+0000 7f874a691640 1 -- 172.21.15.146:0/4118641629 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== watch-notify(notify (1) cookie 93853995888256 notify 141733920776 ret 0) ==== 219+0+0 (crc 0 0 0) 0x555c16146cf0 con 0x555c161581b0 2024-09-18T01:47:09.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.885+0000 7f862cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920776 cookie 93853995888256 notifier 4838 bl.length()=177 2024-09-18T01:47:09.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.885+0000 7f862cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-18T01:47:09.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.885+0000 7f862cff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-18T01:47:09.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.885+0000 7f874a691640 1 -- 172.21.15.146:0/4118641629 <== osd.3 v2:172.21.15.146:6809/4106661138 15 ==== osd_op_reply(68 notify.2 [notify cookie 93853996121312 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8744057040 con 0x555c161581b0 2024-09-18T01:47:09.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.885+0000 7f862cff9640 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f8574003400 con 0x555c161581b0 2024-09-18T01:47:09.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.885+0000 7f874a691640 1 -- 172.21.15.146:0/4118641629 <== osd.3 v2:172.21.15.146:6809/4106661138 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8744057040 con 0x555c161581b0 2024-09-18T01:47:09.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.885+0000 7f874a691640 1 -- 172.21.15.146:0/4118641629 <== osd.3 v2:172.21.15.146:6809/4106661138 17 ==== watch-notify(notify_complete (2) cookie 93853996121312 notify 141733920776 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555c16146a60 con 0x555c161581b0 2024-09-18T01:47:09.897 INFO:teuthology.orchestra.run.smithi146.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-18T01:47:09.882428Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:47:09.882414Z","tags":[],"group_ids":[]} 2024-09-18T01:47:09.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.886+0000 7f85fb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:47:09.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.886+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93853995902272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c16196fc0 con 0x555c16151f40 2024-09-18T01:47:09.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.887+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 <== osd.1 v2:172.21.15.146:6808/3930274777 28 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93853995902272] v33'246 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8740057030 con 0x555c16151f40 2024-09-18T01:47:09.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.887+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93853995879168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c16196fc0 con 0x7f87440163a0 2024-09-18T01:47:09.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.888+0000 7f8749e90640 1 -- 172.21.15.146:0/4118641629 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93853995879168] v33'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f873c062040 con 0x7f87440163a0 2024-09-18T01:47:09.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.888+0000 7f874e142800 20 remove_watcher() i=0 2024-09-18T01:47:09.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.888+0000 7f874e142800 2 removed watcher, disabling cache 2024-09-18T01:47:09.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.888+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93853995883392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c16196fc0 con 0x555c16151f40 2024-09-18T01:47:09.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.889+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 <== osd.1 v2:172.21.15.146:6808/3930274777 29 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93853995883392] v33'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8740057030 con 0x555c16151f40 2024-09-18T01:47:09.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.889+0000 7f874e142800 20 remove_watcher() i=1 2024-09-18T01:47:09.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.889+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93853995888256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c16196fc0 con 0x555c161581b0 2024-09-18T01:47:09.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.890+0000 7f874a691640 1 -- 172.21.15.146:0/4118641629 <== osd.3 v2:172.21.15.146:6809/4106661138 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93853995888256] v33'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8744057040 con 0x555c161581b0 2024-09-18T01:47:09.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.890+0000 7f874e142800 20 remove_watcher() i=2 2024-09-18T01:47:09.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.890+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93853995891056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c16196fc0 con 0x7f87440163a0 2024-09-18T01:47:09.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.891+0000 7f8749e90640 1 -- 172.21.15.146:0/4118641629 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93853995891056] v33'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f873c062040 con 0x7f87440163a0 2024-09-18T01:47:09.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.891+0000 7f874e142800 20 remove_watcher() i=3 2024-09-18T01:47:09.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.891+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93853995893328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c16196fc0 con 0x555c16151f40 2024-09-18T01:47:09.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.894+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 <== osd.1 v2:172.21.15.146:6808/3930274777 30 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93853995893328] v33'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8740057030 con 0x555c16151f40 2024-09-18T01:47:09.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.894+0000 7f874e142800 20 remove_watcher() i=4 2024-09-18T01:47:09.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.894+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93853995897616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c16196fc0 con 0x7f873c056040 2024-09-18T01:47:09.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.895+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93853995897616] v33'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8740057030 con 0x7f873c056040 2024-09-18T01:47:09.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.895+0000 7f874e142800 20 remove_watcher() i=5 2024-09-18T01:47:09.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.895+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93853995898672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c16196fc0 con 0x7f873c056040 2024-09-18T01:47:09.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.896+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93853995898672] v33'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8740057030 con 0x7f873c056040 2024-09-18T01:47:09.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.896+0000 7f874e142800 20 remove_watcher() i=6 2024-09-18T01:47:09.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.896+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93853995901216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555c16196fc0 con 0x7f873c056040 2024-09-18T01:47:09.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.898+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93853995901216] v33'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8740057030 con 0x7f873c056040 2024-09-18T01:47:09.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.898+0000 7f874e142800 20 remove_watcher() i=7 2024-09-18T01:47:09.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.898+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f873c056040 msgr2=0x7f873c026ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.898+0000 7f874e142800 1 --2- 172.21.15.146:0/4118641629 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f873c056040 0x7f873c026ae0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.898+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x555c16151f40 msgr2=0x555c16154400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.898+0000 7f874e142800 1 --2- 172.21.15.146:0/4118641629 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x555c16151f40 0x555c16154400 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.898+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f87440163a0 msgr2=0x7f874402b960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.898+0000 7f874e142800 1 --2- 172.21.15.146:0/4118641629 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f87440163a0 0x7f874402b960 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.898+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x555c161581b0 msgr2=0x555c1615a5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.898+0000 7f874e142800 1 --2- 172.21.15.146:0/4118641629 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x555c161581b0 0x555c1615a5a0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.898+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8614036b90 msgr2=0x7f8614039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.898+0000 7f874e142800 1 --2- 172.21.15.146:0/4118641629 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8614036b90 0x7f8614039050 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f873c044cf0 tx=0x7f873c034000 comp rx=0 tx=0).stop 2024-09-18T01:47:09.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.898+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555c1613f210 msgr2=0x555c16146520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.898+0000 7f874e142800 1 --2- 172.21.15.146:0/4118641629 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555c1613f210 0x555c16146520 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f874404c940 tx=0x7f874404c8d0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.898+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 reap_dead start 2024-09-18T01:47:09.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.898+0000 7f874968f640 1 -- 172.21.15.146:0/4118641629 reap_dead start 2024-09-18T01:47:09.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.898+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 shutdown_connections 2024-09-18T01:47:09.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.898+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 >> 172.21.15.146:0/4118641629 conn(0x555c1613b570 msgr2=0x555c16139640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:09.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.898+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 shutdown_connections 2024-09-18T01:47:09.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.898+0000 7f874e142800 1 -- 172.21.15.146:0/4118641629 wait complete. 2024-09-18T01:47:09.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.899+0000 7f874e142800 1 -- 172.21.15.146:0/3280284648 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8624036b40 msgr2=0x7f8624039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.899+0000 7f874e142800 1 --2- 172.21.15.146:0/3280284648 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8624036b40 0x7f8624039000 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f873c04b030 tx=0x7f873c04af00 comp rx=0 tx=0).stop 2024-09-18T01:47:09.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.899+0000 7f874e142800 1 -- 172.21.15.146:0/3280284648 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555c16132520 msgr2=0x555c16132940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.899+0000 7f874e142800 1 --2- 172.21.15.146:0/3280284648 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555c16132520 0x555c16132940 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x555c1601e880 tx=0x7f874400ef30 comp rx=0 tx=0).stop 2024-09-18T01:47:09.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.899+0000 7f874e142800 1 -- 172.21.15.146:0/3280284648 shutdown_connections 2024-09-18T01:47:09.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.899+0000 7f874e142800 1 --2- 172.21.15.146:0/3280284648 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8624036b40 0x7f8624039000 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.899+0000 7f874e142800 1 --2- 172.21.15.146:0/3280284648 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555c16132520 0x555c16132940 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.899+0000 7f874e142800 1 -- 172.21.15.146:0/3280284648 >> 172.21.15.146:0/3280284648 conn(0x555c161274b0 msgr2=0x555c1612a030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:09.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.899+0000 7f874e142800 1 -- 172.21.15.146:0/3280284648 shutdown_connections 2024-09-18T01:47:09.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.899+0000 7f874e142800 1 -- 172.21.15.146:0/3280284648 wait complete. 2024-09-18T01:47:09.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.899+0000 7f874e142800 1 -- 172.21.15.146:0/435866624 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x555c16022930 msgr2=0x555c1611e820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.899+0000 7f874e142800 1 --2- 172.21.15.146:0/435866624 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x555c16022930 0x555c1611e820 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.899+0000 7f874e142800 1 -- 172.21.15.146:0/435866624 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x555c16121d60 msgr2=0x555c16124150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.899+0000 7f874e142800 1 --2- 172.21.15.146:0/435866624 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x555c16121d60 0x555c16124150 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.899+0000 7f874e142800 1 -- 172.21.15.146:0/435866624 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8630036b40 msgr2=0x7f8630039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.899+0000 7f874e142800 1 --2- 172.21.15.146:0/435866624 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8630036b40 0x7f8630039000 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8740057000 tx=0x7f8740052000 comp rx=0 tx=0).stop 2024-09-18T01:47:09.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.899+0000 7f874e142800 1 -- 172.21.15.146:0/435866624 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555c15f91e60 msgr2=0x555c1601eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:09.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.899+0000 7f874e142800 1 --2- 172.21.15.146:0/435866624 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555c15f91e60 0x555c1601eb40 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x555c1610e880 tx=0x7f873c001250 comp rx=0 tx=0).stop 2024-09-18T01:47:09.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.899+0000 7f874e142800 1 -- 172.21.15.146:0/435866624 shutdown_connections 2024-09-18T01:47:09.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.899+0000 7f874e142800 1 --2- 172.21.15.146:0/435866624 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x555c16121d60 0x555c16124150 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.899+0000 7f874e142800 1 --2- 172.21.15.146:0/435866624 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x555c16022930 0x555c1611e820 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.899+0000 7f874e142800 1 --2- 172.21.15.146:0/435866624 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f8630036b40 0x7f8630039000 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.899+0000 7f874e142800 1 --2- 172.21.15.146:0/435866624 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x555c15f91e60 0x555c1601eb40 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:09.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.899+0000 7f874e142800 1 -- 172.21.15.146:0/435866624 >> 172.21.15.146:0/435866624 conn(0x555c16018e00 msgr2=0x555c16107cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:09.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.899+0000 7f874e142800 1 -- 172.21.15.146:0/435866624 shutdown_connections 2024-09-18T01:47:09.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:09.899+0000 7f874e142800 1 -- 172.21.15.146:0/435866624 wait complete. 2024-09-18T01:47:09.908 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T01:47:09.882428Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:47:09.882414Z', 'tags': [], 'group_ids': []} 2024-09-18T01:47:09.909 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T01:47:09.882428Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:47:09.882414Z', 'tags': [], 'group_ids': []} 2024-09-18T01:47:09.909 ERROR:root:0 2024-09-18T01:47:09.909 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-18T01:47:09.915 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx00000b6fa5245fc78631c-0066ea311d-4236-default', 'HostId': '4236-default-default'} 2024-09-18T01:47:09.916 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'foo', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '4'} 2024-09-18T01:47:09.927 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T01:47:09.927 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 0} 2024-09-18T01:47:09.939 INFO:tasks.radosgw_admin_rest: json result: {'keys': [], 'truncated': True, 'count': 0, 'marker': '8:1e6ca5ed:users.uid::foo:head'} 2024-09-18T01:47:09.939 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1} 2024-09-18T01:47:09.953 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['foo'], 'truncated': True, 'count': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-18T01:47:09.953 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-18T01:47:09.961 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['ada'], 'truncated': False, 'count': 1} 2024-09-18T01:47:09.961 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-18T01:47:09.964 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T01:47:09.965 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'access-key': '9te6NH5mcdcq0Tc5i8i1', 'uid': 'uid_not_exist'} 2024-09-18T01:47:09.968 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T01:47:09.969 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-18T01:47:09.969 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-18T01:47:09.969 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write' 2024-09-18T01:47:10.015 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:47:10.015 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:47:10.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.015+0000 7f3af6f26800 1 Processor -- start 2024-09-18T01:47:10.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.015+0000 7f3af6f26800 1 -- start start 2024-09-18T01:47:10.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.015+0000 7f3af6f26800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55a324d6a900 0x55a324d6ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.015+0000 7f3af6f26800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a324c25b30 con 0x55a324cda650 2024-09-18T01:47:10.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.015+0000 7f3af6f26800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x55a324c07360 con 0x55a324d6a900 2024-09-18T01:47:10.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.016+0000 7f3af23e2640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55a324d6a900 0x55a324d6ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.016+0000 7f3af2be3640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x55a324cda650 0x55a324d691e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:53064/0 (socket says 172.21.15.146:53064) 2024-09-18T01:47:10.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.016+0000 7f3af2be3640 1 -- 172.21.15.146:0/293665680 learned_addr learned my addr 172.21.15.146:0/293665680 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:47:10.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.016+0000 7f3af23e2640 1 -- 172.21.15.146:0/293665680 >> v1:172.21.15.129:6789/0 conn(0x55a324cda650 legacy=0x55a324d691e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.016+0000 7f3af23e2640 1 -- 172.21.15.146:0/293665680 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a324c2de00 con 0x55a324d6a900 2024-09-18T01:47:10.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.018+0000 7f3af23e2640 1 --2- 172.21.15.146:0/293665680 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a324d6a900 0x55a324d6ccf0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f3ae800a470 tx=0x7f3ae8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec22c7e68e5c807b server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.018+0000 7f3af1be1640 1 -- 172.21.15.146:0/293665680 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ae8053570 con 0x55a324d6a900 2024-09-18T01:47:10.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.018+0000 7f3af1be1640 1 -- 172.21.15.146:0/293665680 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ae8058070 con 0x55a324d6a900 2024-09-18T01:47:10.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.018+0000 7f3af1be1640 1 -- 172.21.15.146:0/293665680 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ae8053880 con 0x55a324d6a900 2024-09-18T01:47:10.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.018+0000 7f3af6f26800 1 -- 172.21.15.146:0/293665680 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a324d6a900 msgr2=0x55a324d6ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.018+0000 7f3af6f26800 1 --2- 172.21.15.146:0/293665680 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a324d6a900 0x55a324d6ccf0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f3ae800a470 tx=0x7f3ae8045a20 comp rx=0 tx=0).stop 2024-09-18T01:47:10.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.018+0000 7f3af6f26800 1 -- 172.21.15.146:0/293665680 shutdown_connections 2024-09-18T01:47:10.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.018+0000 7f3af6f26800 1 --2- 172.21.15.146:0/293665680 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a324d6a900 0x55a324d6ccf0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.018+0000 7f3af6f26800 1 -- 172.21.15.146:0/293665680 >> 172.21.15.146:0/293665680 conn(0x55a324d60db0 msgr2=0x55a324d631d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:10.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.018+0000 7f3af6f26800 1 -- 172.21.15.146:0/293665680 shutdown_connections 2024-09-18T01:47:10.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.018+0000 7f3af6f26800 1 -- 172.21.15.146:0/293665680 wait complete. 2024-09-18T01:47:10.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.032+0000 7f3af6f26800 1 Processor -- start 2024-09-18T01:47:10.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.032+0000 7f3af6f26800 1 -- start start 2024-09-18T01:47:10.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.032+0000 7f3af6f26800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a324cda650 0x55a324e558c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.032+0000 7f3af6f26800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55a324cb2360 con 0x55a324cda650 2024-09-18T01:47:10.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.033+0000 7f3af2be3640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a324cda650 0x55a324e558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.033+0000 7f3af2be3640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a324cda650 0x55a324e558c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37328/0 (socket says 172.21.15.146:37328) 2024-09-18T01:47:10.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.033+0000 7f3af2be3640 1 -- 172.21.15.146:0/2047788065 learned_addr learned my addr 172.21.15.146:0/2047788065 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:10.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.033+0000 7f3af2be3640 1 -- 172.21.15.146:0/2047788065 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a324bffbc0 con 0x55a324cda650 2024-09-18T01:47:10.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.033+0000 7f3af2be3640 1 --2- 172.21.15.146:0/2047788065 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a324cda650 0x55a324e558c0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4001610 tx=0x7f3ae4001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=170c37c56a1288e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.033+0000 7f39e0e09640 1 -- 172.21.15.146:0/2047788065 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ae4004520 con 0x55a324cda650 2024-09-18T01:47:10.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.033+0000 7f39e0e09640 1 -- 172.21.15.146:0/2047788065 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ae40046c0 con 0x55a324cda650 2024-09-18T01:47:10.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.033+0000 7f39e0e09640 1 -- 172.21.15.146:0/2047788065 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ae4004a20 con 0x55a324cda650 2024-09-18T01:47:10.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.034+0000 7f3af6f26800 1 -- 172.21.15.146:0/2047788065 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a324cda650 msgr2=0x55a324e558c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.034+0000 7f3af6f26800 1 --2- 172.21.15.146:0/2047788065 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a324cda650 0x55a324e558c0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4001610 tx=0x7f3ae4001ad0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.034+0000 7f3af6f26800 1 -- 172.21.15.146:0/2047788065 shutdown_connections 2024-09-18T01:47:10.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.034+0000 7f3af6f26800 1 --2- 172.21.15.146:0/2047788065 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a324cda650 0x55a324e558c0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.034+0000 7f3af6f26800 1 -- 172.21.15.146:0/2047788065 >> 172.21.15.146:0/2047788065 conn(0x55a324d60db0 msgr2=0x55a324e51280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:10.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.034+0000 7f3af6f26800 1 -- 172.21.15.146:0/2047788065 shutdown_connections 2024-09-18T01:47:10.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.034+0000 7f3af6f26800 1 -- 172.21.15.146:0/2047788065 wait complete. 2024-09-18T01:47:10.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.034+0000 7f3af6f26800 1 Processor -- start 2024-09-18T01:47:10.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.035+0000 7f3af6f26800 1 -- start start 2024-09-18T01:47:10.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.035+0000 7f3af6f26800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a324cda650 0x55a324d66b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.035+0000 7f3af6f26800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55a324d6d620 con 0x55a324cda650 2024-09-18T01:47:10.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.035+0000 7f3af2be3640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a324cda650 0x55a324d66b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.035+0000 7f3af2be3640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a324cda650 0x55a324d66b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37338/0 (socket says 172.21.15.146:37338) 2024-09-18T01:47:10.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.035+0000 7f3af2be3640 1 -- 172.21.15.146:0/2952044158 learned_addr learned my addr 172.21.15.146:0/2952044158 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:10.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.035+0000 7f3af2be3640 1 -- 172.21.15.146:0/2952044158 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a324c13fe0 con 0x55a324cda650 2024-09-18T01:47:10.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.035+0000 7f3af2be3640 1 --2- 172.21.15.146:0/2952044158 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a324cda650 0x55a324d66b10 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4001b10 tx=0x7f3ae4000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.035+0000 7f39df606640 1 -- 172.21.15.146:0/2952044158 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ae4022030 con 0x55a324cda650 2024-09-18T01:47:10.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.035+0000 7f39df606640 1 -- 172.21.15.146:0/2952044158 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ae4019040 con 0x55a324cda650 2024-09-18T01:47:10.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.036+0000 7f3af6f26800 1 -- 172.21.15.146:0/2952044158 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a324d65200 con 0x55a324cda650 2024-09-18T01:47:10.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.036+0000 7f39df606640 1 -- 172.21.15.146:0/2952044158 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ae40042c0 con 0x55a324cda650 2024-09-18T01:47:10.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.036+0000 7f3af6f26800 1 -- 172.21.15.146:0/2952044158 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a324d656c0 con 0x55a324cda650 2024-09-18T01:47:10.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.036+0000 7f39df606640 1 -- 172.21.15.146:0/2952044158 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3ae4025070 con 0x55a324cda650 2024-09-18T01:47:10.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.037+0000 7f39df606640 1 --2- 172.21.15.146:0/2952044158 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f39d8036b90 0x7f39d8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.037+0000 7f39df606640 1 -- 172.21.15.146:0/2952044158 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f3ae4023070 con 0x55a324cda650 2024-09-18T01:47:10.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.037+0000 7f3af23e2640 1 --2- 172.21.15.146:0/2952044158 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f39d8036b90 0x7f39d8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.037+0000 7f3af6f26800 1 --2- 172.21.15.146:0/2952044158 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a324d6a900 0x55a324e666c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.037+0000 7f3af6f26800 1 -- 172.21.15.146:0/2952044158 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a324e66c00 con 0x55a324d6a900 2024-09-18T01:47:10.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.037+0000 7f3af33e4640 1 --2- 172.21.15.146:0/2952044158 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a324d6a900 0x55a324e666c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.037+0000 7f3af23e2640 1 --2- 172.21.15.146:0/2952044158 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f39d8036b90 0x7f39d8039050 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3ae8057000 tx=0x7f3ae8052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.037+0000 7f3af33e4640 1 --2- 172.21.15.146:0/2952044158 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a324d6a900 0x55a324e666c0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.037+0000 7f3af33e4640 1 -- 172.21.15.146:0/2952044158 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3aec0083e0 con 0x55a324d6a900 2024-09-18T01:47:10.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.037+0000 7f3af6f26800 1 -- 172.21.15.146:0/2952044158 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a324e67450 con 0x55a324d6a900 2024-09-18T01:47:10.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.038+0000 7f3af33e4640 1 -- 172.21.15.146:0/2952044158 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3aec0083e0 con 0x55a324d6a900 2024-09-18T01:47:10.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.038+0000 7f3af6f26800 1 -- 172.21.15.146:0/2952044158 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a324e68800 con 0x55a324d6a900 2024-09-18T01:47:10.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.038+0000 7f3af33e4640 1 -- 172.21.15.146:0/2952044158 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3aec0083e0 con 0x55a324d6a900 2024-09-18T01:47:10.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.038+0000 7f3af6f26800 1 -- 172.21.15.146:0/2952044158 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a324e67ca0 con 0x55a324d6a900 2024-09-18T01:47:10.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.038+0000 7f3af33e4640 1 -- 172.21.15.146:0/2952044158 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3aec0083e0 con 0x55a324d6a900 2024-09-18T01:47:10.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.038+0000 7f3af6f26800 1 --2- 172.21.15.146:0/2952044158 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55a324e69bb0 0x55a324e6bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.038+0000 7f3af6f26800 1 -- 172.21.15.146:0/2952044158 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a324e6c5f0 con 0x55a324e69bb0 2024-09-18T01:47:10.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.038+0000 7f3af2be3640 1 --2- 172.21.15.146:0/2952044158 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55a324e69bb0 0x55a324e6bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.039+0000 7f3af2be3640 1 --2- 172.21.15.146:0/2952044158 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55a324e69bb0 0x55a324e6bfa0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.039+0000 7f3af2be3640 1 -- 172.21.15.146:0/2952044158 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3ae400f030 con 0x55a324e69bb0 2024-09-18T01:47:10.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.039+0000 7f3af6f26800 1 Processor -- start 2024-09-18T01:47:10.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.039+0000 7f3af6f26800 1 -- start start 2024-09-18T01:47:10.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.039+0000 7f3af6f26800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a324e7a340 0x55a324e7a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.039+0000 7f3af6f26800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55a324d67050 con 0x55a324e7a340 2024-09-18T01:47:10.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.040+0000 7f3af33e4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a324e7a340 0x55a324e7a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.040+0000 7f3af33e4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a324e7a340 0x55a324e7a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37340/0 (socket says 172.21.15.146:37340) 2024-09-18T01:47:10.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.040+0000 7f3af33e4640 1 -- 172.21.15.146:0/4114478972 learned_addr learned my addr 172.21.15.146:0/4114478972 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:10.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.040+0000 7f3af33e4640 1 -- 172.21.15.146:0/4114478972 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a324e7aca0 con 0x55a324e7a340 2024-09-18T01:47:10.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.040+0000 7f3af33e4640 1 --2- 172.21.15.146:0/4114478972 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a324e7a340 0x55a324e7a760 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x55a324d66500 tx=0x7f3aec00ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.041+0000 7f39dce01640 1 -- 172.21.15.146:0/4114478972 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3aec01c070 con 0x55a324e7a340 2024-09-18T01:47:10.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.041+0000 7f39dce01640 1 -- 172.21.15.146:0/4114478972 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3aec018410 con 0x55a324e7a340 2024-09-18T01:47:10.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.041+0000 7f3af6f26800 1 -- 172.21.15.146:0/4114478972 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a324e7af30 con 0x55a324e7a340 2024-09-18T01:47:10.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.041+0000 7f39dce01640 1 -- 172.21.15.146:0/4114478972 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3aec018730 con 0x55a324e7a340 2024-09-18T01:47:10.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.041+0000 7f3af6f26800 1 -- 172.21.15.146:0/4114478972 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a324e7dc10 con 0x55a324e7a340 2024-09-18T01:47:10.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.041+0000 7f39dce01640 1 -- 172.21.15.146:0/4114478972 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3aec01f070 con 0x55a324e7a340 2024-09-18T01:47:10.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.042+0000 7f39dce01640 1 --2- 172.21.15.146:0/4114478972 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f39cc036b40 0x7f39cc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.042+0000 7f39dce01640 1 -- 172.21.15.146:0/4114478972 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f3aec04e5f0 con 0x55a324e7a340 2024-09-18T01:47:10.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.042+0000 7f3af2be3640 1 --2- 172.21.15.146:0/4114478972 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f39cc036b40 0x7f39cc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.042+0000 7f3af6f26800 1 Processor -- start 2024-09-18T01:47:10.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.042+0000 7f3af6f26800 1 -- start start 2024-09-18T01:47:10.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.042+0000 7f3af2be3640 1 --2- 172.21.15.146:0/4114478972 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f39cc036b40 0x7f39cc039000 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4026570 tx=0x7f3ae404ae10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.042+0000 7f3af6f26800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a324e87050 0x55a324e87450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.042+0000 7f3af6f26800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55a324c01580 con 0x55a324e87050 2024-09-18T01:47:10.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.042+0000 7f3af33e4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a324e87050 0x55a324e87450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.042+0000 7f3af33e4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a324e87050 0x55a324e87450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37344/0 (socket says 172.21.15.146:37344) 2024-09-18T01:47:10.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.042+0000 7f3af33e4640 1 -- 172.21.15.146:0/2224649457 learned_addr learned my addr 172.21.15.146:0/2224649457 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:10.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.043+0000 7f3af33e4640 1 -- 172.21.15.146:0/2224649457 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a324e87a20 con 0x55a324e87050 2024-09-18T01:47:10.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.043+0000 7f3af33e4640 1 --2- 172.21.15.146:0/2224649457 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a324e87050 0x55a324e87450 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f3aec014800 tx=0x7f3aec0146a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c2ea882e5b9139c server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.043+0000 7f39d67fc640 1 -- 172.21.15.146:0/2224649457 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3aec016db0 con 0x55a324e87050 2024-09-18T01:47:10.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.043+0000 7f39d67fc640 1 -- 172.21.15.146:0/2224649457 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3aec040e50 con 0x55a324e87050 2024-09-18T01:47:10.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.043+0000 7f39d67fc640 1 -- 172.21.15.146:0/2224649457 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3aec04e220 con 0x55a324e87050 2024-09-18T01:47:10.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.043+0000 7f3af6f26800 1 -- 172.21.15.146:0/2224649457 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a324e87050 msgr2=0x55a324e87450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.043+0000 7f3af6f26800 1 --2- 172.21.15.146:0/2224649457 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a324e87050 0x55a324e87450 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f3aec014800 tx=0x7f3aec0146a0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.043+0000 7f3af6f26800 1 -- 172.21.15.146:0/2224649457 shutdown_connections 2024-09-18T01:47:10.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.043+0000 7f3af6f26800 1 --2- 172.21.15.146:0/2224649457 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a324e87050 0x55a324e87450 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.043+0000 7f3af6f26800 1 -- 172.21.15.146:0/2224649457 >> 172.21.15.146:0/2224649457 conn(0x55a324e833b0 msgr2=0x55a324e814b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:10.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.043+0000 7f3af6f26800 1 -- 172.21.15.146:0/2224649457 shutdown_connections 2024-09-18T01:47:10.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.043+0000 7f3af6f26800 1 -- 172.21.15.146:0/2224649457 wait complete. 2024-09-18T01:47:10.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.044+0000 7f3af6f26800 1 Processor -- start 2024-09-18T01:47:10.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.044+0000 7f3af6f26800 1 -- start start 2024-09-18T01:47:10.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.044+0000 7f3af6f26800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a324e87050 0x55a324e8e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.044+0000 7f3af6f26800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55a324e87f10 con 0x55a324e87050 2024-09-18T01:47:10.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.044+0000 7f3af33e4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a324e87050 0x55a324e8e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.044+0000 7f3af33e4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a324e87050 0x55a324e8e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37348/0 (socket says 172.21.15.146:37348) 2024-09-18T01:47:10.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.044+0000 7f3af33e4640 1 -- 172.21.15.146:0/753418588 learned_addr learned my addr 172.21.15.146:0/753418588 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:10.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.044+0000 7f3af33e4640 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a324e8e8c0 con 0x55a324e87050 2024-09-18T01:47:10.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.044+0000 7f3af33e4640 1 --2- 172.21.15.146:0/753418588 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a324e87050 0x55a324e8e380 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f3aec014800 tx=0x7f3aec04c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.044+0000 7f39d4ff9640 1 -- 172.21.15.146:0/753418588 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3aec007b50 con 0x55a324e87050 2024-09-18T01:47:10.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.045+0000 7f39d4ff9640 1 -- 172.21.15.146:0/753418588 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3aec04a030 con 0x55a324e87050 2024-09-18T01:47:10.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.045+0000 7f3af6f26800 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a324e8eb50 con 0x55a324e87050 2024-09-18T01:47:10.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.045+0000 7f39d4ff9640 1 -- 172.21.15.146:0/753418588 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3aec007e40 con 0x55a324e87050 2024-09-18T01:47:10.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.045+0000 7f3af6f26800 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a324e91800 con 0x55a324e87050 2024-09-18T01:47:10.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.045+0000 7f39d4ff9640 1 -- 172.21.15.146:0/753418588 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3aec0189a0 con 0x55a324e87050 2024-09-18T01:47:10.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.045+0000 7f39d4ff9640 1 --2- 172.21.15.146:0/753418588 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f39bc036b90 0x7f39bc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.045+0000 7f39d4ff9640 1 -- 172.21.15.146:0/753418588 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f3aec033070 con 0x55a324e87050 2024-09-18T01:47:10.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.046+0000 7f3af2be3640 1 --2- 172.21.15.146:0/753418588 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f39bc036b90 0x7f39bc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.046+0000 7f3af2be3640 1 --2- 172.21.15.146:0/753418588 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f39bc036b90 0x7f39bc039050 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4011e60 tx=0x7f3ae4043000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.046+0000 7f3af6f26800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.046+0000 7f3af6f26800 1 --2- 172.21.15.146:0/753418588 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a324e99df0 0x55a324e9c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.046+0000 7f3af6f26800 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a324e9ca00 con 0x55a324e99df0 2024-09-18T01:47:10.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.046+0000 7f3af23e2640 1 --2- 172.21.15.146:0/753418588 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a324e99df0 0x55a324e9c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.047+0000 7f3af23e2640 1 --2- 172.21.15.146:0/753418588 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a324e99df0 0x55a324e9c2b0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.047+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3ae8051070 con 0x55a324e99df0 2024-09-18T01:47:10.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.047+0000 7f3af6f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:10.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.047+0000 7f3af6f26800 20 realm 2024-09-18T01:47:10.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.047+0000 7f3af6f26800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.047+0000 7f3af6f26800 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a324e9ce30 con 0x55a324e99df0 2024-09-18T01:47:10.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.047+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3ae8051070 con 0x55a324e99df0 2024-09-18T01:47:10.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.047+0000 7f3af6f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:10.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.047+0000 7f3af6f26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:47:10.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.047+0000 7f3af6f26800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.047+0000 7f3af6f26800 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a324e9d700 con 0x55a324e99df0 2024-09-18T01:47:10.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.047+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3ae8051070 con 0x55a324e99df0 2024-09-18T01:47:10.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.047+0000 7f3af6f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:10.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.047+0000 7f3af6f26800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.047+0000 7f3af6f26800 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a324e9daa0 con 0x55a324e99df0 2024-09-18T01:47:10.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.048+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3ae8051070 con 0x55a324e99df0 2024-09-18T01:47:10.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.048+0000 7f3af6f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:47:10.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.048+0000 7f3af6f26800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.048+0000 7f3af6f26800 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a324e9e2f0 con 0x55a324e99df0 2024-09-18T01:47:10.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.048+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3ae8051070 con 0x55a324e99df0 2024-09-18T01:47:10.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.048+0000 7f3af6f26800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:47:10.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.048+0000 7f3af6f26800 20 searching for the correct realm 2024-09-18T01:47:10.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.048+0000 7f3af6f26800 1 --2- 172.21.15.146:0/753418588 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55a324ea0060 0x55a324ea2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.048+0000 7f3af6f26800 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a324ea2a80 con 0x55a324ea0060 2024-09-18T01:47:10.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.048+0000 7f3af33e4640 1 --2- 172.21.15.146:0/753418588 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55a324ea0060 0x55a324ea2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.048+0000 7f3af33e4640 1 --2- 172.21.15.146:0/753418588 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55a324ea0060 0x55a324ea2450 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.048+0000 7f3af33e4640 1 -- 172.21.15.146:0/753418588 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3aec057040 con 0x55a324ea0060 2024-09-18T01:47:10.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.048+0000 7f3af33e4640 1 --2- 172.21.15.146:0/753418588 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f3aec021070 0x7f3aec043120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.048+0000 7f3af33e4640 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a324ea2a80 con 0x7f3aec021070 2024-09-18T01:47:10.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.049+0000 7f3af2be3640 1 --2- 172.21.15.146:0/753418588 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f3aec021070 0x7f3aec043120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.049+0000 7f3af2be3640 1 --2- 172.21.15.146:0/753418588 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f3aec021070 0x7f3aec043120 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.049+0000 7f3af2be3640 1 -- 172.21.15.146:0/753418588 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ae4043070 con 0x7f3aec021070 2024-09-18T01:47:10.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.049+0000 7f3af2be3640 1 --2- 172.21.15.146:0/753418588 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f3ae4027030 0x7f3ae40123c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.049+0000 7f3af2be3640 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a324ea2a80 con 0x7f3ae4027030 2024-09-18T01:47:10.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.049+0000 7f3af23e2640 1 --2- 172.21.15.146:0/753418588 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f3ae4027030 0x7f3ae40123c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.050+0000 7f3af23e2640 1 --2- 172.21.15.146:0/753418588 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f3ae4027030 0x7f3ae40123c0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.050+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ae8051070 con 0x7f3ae4027030 2024-09-18T01:47:10.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.050+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a324ea2a80 con 0x55a324e99df0 2024-09-18T01:47:10.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.050+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v33'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3ae8051070 con 0x55a324e99df0 2024-09-18T01:47:10.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.050+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a324ea2a80 con 0x55a324e99df0 2024-09-18T01:47:10.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.050+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ae8051070 con 0x55a324e99df0 2024-09-18T01:47:10.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.050+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a324ea2a80 con 0x7f3ae4027030 2024-09-18T01:47:10.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.051+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ae8051070 con 0x7f3ae4027030 2024-09-18T01:47:10.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.051+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a324ea2a80 con 0x7f3ae4027030 2024-09-18T01:47:10.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.051+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ae8051070 con 0x7f3ae4027030 2024-09-18T01:47:10.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.051+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a324ea2a80 con 0x7f3aec021070 2024-09-18T01:47:10.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.051+0000 7f3af2be3640 1 -- 172.21.15.146:0/753418588 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ae4043070 con 0x7f3aec021070 2024-09-18T01:47:10.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.051+0000 7f3af2be3640 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a324ea2a80 con 0x55a324ea0060 2024-09-18T01:47:10.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.051+0000 7f3af33e4640 1 -- 172.21.15.146:0/753418588 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3aec057040 con 0x55a324ea0060 2024-09-18T01:47:10.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.051+0000 7f3af33e4640 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a324ea2a80 con 0x55a324e99df0 2024-09-18T01:47:10.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.052+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ae8051070 con 0x55a324e99df0 2024-09-18T01:47:10.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.052+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a324ea2a80 con 0x7f3ae4027030 2024-09-18T01:47:10.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.052+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ae8051070 con 0x7f3ae4027030 2024-09-18T01:47:10.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.052+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a324ea2a80 con 0x55a324e99df0 2024-09-18T01:47:10.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.052+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ae8051070 con 0x55a324e99df0 2024-09-18T01:47:10.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.052+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a324ea2a80 con 0x7f3aec021070 2024-09-18T01:47:10.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.052+0000 7f3af2be3640 1 -- 172.21.15.146:0/753418588 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f3ae4043070 con 0x7f3aec021070 2024-09-18T01:47:10.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.052+0000 7f3af2be3640 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a324ea2a80 con 0x55a324ea0060 2024-09-18T01:47:10.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.052+0000 7f3af33e4640 1 -- 172.21.15.146:0/753418588 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3aec057040 con 0x55a324ea0060 2024-09-18T01:47:10.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.053+0000 7f3af33e4640 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a324ea2a80 con 0x55a324ea0060 2024-09-18T01:47:10.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.053+0000 7f3af33e4640 1 -- 172.21.15.146:0/753418588 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3aec057040 con 0x55a324ea0060 2024-09-18T01:47:10.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.053+0000 7f3af33e4640 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a324ea2a80 con 0x7f3ae4027030 2024-09-18T01:47:10.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.053+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ae8051070 con 0x7f3ae4027030 2024-09-18T01:47:10.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.053+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a324ea2a80 con 0x55a324ea0060 2024-09-18T01:47:10.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.053+0000 7f3af33e4640 1 -- 172.21.15.146:0/753418588 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3aec057040 con 0x55a324ea0060 2024-09-18T01:47:10.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.053+0000 7f3af33e4640 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a324ea2a80 con 0x55a324ea0060 2024-09-18T01:47:10.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.053+0000 7f3af33e4640 1 -- 172.21.15.146:0/753418588 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3aec057040 con 0x55a324ea0060 2024-09-18T01:47:10.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.053+0000 7f3af33e4640 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a324ea2a80 con 0x55a324e99df0 2024-09-18T01:47:10.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.054+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ae8051070 con 0x55a324e99df0 2024-09-18T01:47:10.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.054+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a324ea2a80 con 0x55a324e99df0 2024-09-18T01:47:10.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.054+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v33'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3ae8051070 con 0x55a324e99df0 2024-09-18T01:47:10.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.054+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a324ea2a80 con 0x7f3ae4027030 2024-09-18T01:47:10.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.054+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ae8051070 con 0x7f3ae4027030 2024-09-18T01:47:10.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.054+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a324ea2a80 con 0x55a324ea0060 2024-09-18T01:47:10.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.054+0000 7f3af33e4640 1 -- 172.21.15.146:0/753418588 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3aec057040 con 0x55a324ea0060 2024-09-18T01:47:10.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.054+0000 7f3af33e4640 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a324ea2a80 con 0x7f3aec021070 2024-09-18T01:47:10.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.055+0000 7f3af2be3640 1 -- 172.21.15.146:0/753418588 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ae4043070 con 0x7f3aec021070 2024-09-18T01:47:10.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.055+0000 7f3af2be3640 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a324ea2a80 con 0x55a324e99df0 2024-09-18T01:47:10.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.055+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ae8051070 con 0x55a324e99df0 2024-09-18T01:47:10.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.055+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a324ea2a80 con 0x7f3ae4027030 2024-09-18T01:47:10.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.055+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ae8051070 con 0x7f3ae4027030 2024-09-18T01:47:10.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.055+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a324ea2a80 con 0x55a324ea0060 2024-09-18T01:47:10.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.055+0000 7f3af33e4640 1 -- 172.21.15.146:0/753418588 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3aec057040 con 0x55a324ea0060 2024-09-18T01:47:10.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.055+0000 7f3af33e4640 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a324ea2a80 con 0x7f3ae4027030 2024-09-18T01:47:10.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.056+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ae8051070 con 0x7f3ae4027030 2024-09-18T01:47:10.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.056+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a324ea2a80 con 0x7f3aec021070 2024-09-18T01:47:10.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.056+0000 7f3af2be3640 1 -- 172.21.15.146:0/753418588 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ae4043070 con 0x7f3aec021070 2024-09-18T01:47:10.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.056+0000 7f3af2be3640 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a324ea2a80 con 0x55a324ea0060 2024-09-18T01:47:10.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.056+0000 7f3af33e4640 1 -- 172.21.15.146:0/753418588 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3aec057040 con 0x55a324ea0060 2024-09-18T01:47:10.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.056+0000 7f3af33e4640 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a324ea2a80 con 0x7f3ae4027030 2024-09-18T01:47:10.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.056+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ae8051070 con 0x7f3ae4027030 2024-09-18T01:47:10.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.056+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a324ea2a80 con 0x55a324e99df0 2024-09-18T01:47:10.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.057+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v33'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3ae8051070 con 0x55a324e99df0 2024-09-18T01:47:10.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.057+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a324ea2a80 con 0x7f3aec021070 2024-09-18T01:47:10.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.057+0000 7f3af2be3640 1 -- 172.21.15.146:0/753418588 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ae4043070 con 0x7f3aec021070 2024-09-18T01:47:10.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.057+0000 7f3af6f26800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:47:10.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.057+0000 7f3af6f26800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:47:10.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.057+0000 7f3af6f26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:47:10.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.057+0000 7f3af6f26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:47:10.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.057+0000 7f3af6f26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:47:10.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.057+0000 7f3af6f26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:47:10.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.057+0000 7f3af6f26800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.057+0000 7f3af6f26800 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a324e9ec40 con 0x55a324e99df0 2024-09-18T01:47:10.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.057+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3ae8051070 con 0x55a324e99df0 2024-09-18T01:47:10.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.057+0000 7f3af6f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:10.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.057+0000 7f3af6f26800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.057+0000 7f3af6f26800 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a324e9f4e0 con 0x55a324e99df0 2024-09-18T01:47:10.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.057+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3ae8051070 con 0x55a324e99df0 2024-09-18T01:47:10.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.057+0000 7f3af6f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:47:10.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.057+0000 7f3af6f26800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.057+0000 7f3af6f26800 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a324ea2f00 con 0x7f3aec021070 2024-09-18T01:47:10.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.057+0000 7f3af2be3640 1 -- 172.21.15.146:0/753418588 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3ae4043070 con 0x7f3aec021070 2024-09-18T01:47:10.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.058+0000 7f3af6f26800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:47:10.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.058+0000 7f3af6f26800 20 zone default found 2024-09-18T01:47:10.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.058+0000 7f3af6f26800 4 Realm: () 2024-09-18T01:47:10.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.058+0000 7f3af6f26800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:47:10.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.058+0000 7f3af6f26800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:47:10.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.058+0000 7f3af6f26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:47:10.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.058+0000 7f3af6f26800 20 zonegroup default 2024-09-18T01:47:10.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.058+0000 7f3af6f26800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.058+0000 7f3af6f26800 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a324ea3750 con 0x7f3ae4027030 2024-09-18T01:47:10.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.058+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3ae8051070 con 0x7f3ae4027030 2024-09-18T01:47:10.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.058+0000 7f3af6f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:10.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.058+0000 7f3af6f26800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.058+0000 7f3af6f26800 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a324ea5130 con 0x55a324ea0060 2024-09-18T01:47:10.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.058+0000 7f3af33e4640 1 -- 172.21.15.146:0/753418588 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3aec057040 con 0x55a324ea0060 2024-09-18T01:47:10.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.058+0000 7f3af6f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:10.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.058+0000 7f3af6f26800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.058+0000 7f3af6f26800 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a324ea55b0 con 0x55a324ea0060 2024-09-18T01:47:10.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.058+0000 7f3af33e4640 1 -- 172.21.15.146:0/753418588 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3aec057040 con 0x55a324ea0060 2024-09-18T01:47:10.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.058+0000 7f3af6f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:10.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.058+0000 7f3af6f26800 20 started sync module instance, tier type = 2024-09-18T01:47:10.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.058+0000 7f3af6f26800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:47:10.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.058+0000 7f3af6f26800 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a324ea4570 con 0x7f3aec021070 2024-09-18T01:47:10.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.059+0000 7f3af2be3640 1 -- 172.21.15.146:0/753418588 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v33'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ae4043070 con 0x7f3aec021070 2024-09-18T01:47:10.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.059+0000 7f3af6f26800 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94159187361984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a324ea5a10 con 0x7f3aec021070 2024-09-18T01:47:10.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.059+0000 7f3af6f26800 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a324ea6260 con 0x55a324e99df0 2024-09-18T01:47:10.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.060+0000 7f3af2be3640 1 -- 172.21.15.146:0/753418588 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94159187361984] v33'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ae4043070 con 0x7f3aec021070 2024-09-18T01:47:10.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.061+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v33'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ae8051070 con 0x55a324e99df0 2024-09-18T01:47:10.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.061+0000 7f3af6f26800 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94159187369392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a324ea6680 con 0x55a324e99df0 2024-09-18T01:47:10.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.061+0000 7f3af6f26800 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a324ea6ed0 con 0x55a324ea0060 2024-09-18T01:47:10.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.062+0000 7f3af33e4640 1 -- 172.21.15.146:0/753418588 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v33'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3aec057040 con 0x55a324ea0060 2024-09-18T01:47:10.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.062+0000 7f3af6f26800 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94159187372160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a324ea7770 con 0x55a324ea0060 2024-09-18T01:47:10.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.062+0000 7f3af6f26800 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a324ea7fc0 con 0x7f3aec021070 2024-09-18T01:47:10.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.062+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94159187369392] v33'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ae8051070 con 0x55a324e99df0 2024-09-18T01:47:10.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.063+0000 7f3af33e4640 1 -- 172.21.15.146:0/753418588 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94159187372160] v33'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3aec057040 con 0x55a324ea0060 2024-09-18T01:47:10.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.063+0000 7f3af2be3640 1 -- 172.21.15.146:0/753418588 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v33'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ae4043070 con 0x7f3aec021070 2024-09-18T01:47:10.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.063+0000 7f3af6f26800 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94159187374784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a324ea7b90 con 0x7f3aec021070 2024-09-18T01:47:10.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.063+0000 7f3af6f26800 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a324ea8420 con 0x55a324e99df0 2024-09-18T01:47:10.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.064+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v33'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ae8051070 con 0x55a324e99df0 2024-09-18T01:47:10.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.064+0000 7f3af6f26800 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94159187377040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a324ea8050 con 0x55a324e99df0 2024-09-18T01:47:10.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.064+0000 7f3af6f26800 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a324ea9410 con 0x7f3ae4027030 2024-09-18T01:47:10.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.064+0000 7f3af2be3640 1 -- 172.21.15.146:0/753418588 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94159187374784] v33'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ae4043070 con 0x7f3aec021070 2024-09-18T01:47:10.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.065+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v33'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ae8051070 con 0x7f3ae4027030 2024-09-18T01:47:10.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.065+0000 7f3af6f26800 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94159187381984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a324ea93d0 con 0x7f3ae4027030 2024-09-18T01:47:10.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.065+0000 7f3af6f26800 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a324ea9e20 con 0x7f3ae4027030 2024-09-18T01:47:10.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.065+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94159187377040] v33'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ae8051070 con 0x55a324e99df0 2024-09-18T01:47:10.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.066+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94159187381984] v33'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ae8051070 con 0x7f3ae4027030 2024-09-18T01:47:10.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.066+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v33'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ae8051070 con 0x7f3ae4027030 2024-09-18T01:47:10.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.066+0000 7f3af6f26800 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94159187375840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a324ea9970 con 0x7f3ae4027030 2024-09-18T01:47:10.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.066+0000 7f3af6f26800 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a324eaa6c0 con 0x7f3ae4027030 2024-09-18T01:47:10.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.067+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94159187375840] v33'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ae8051070 con 0x7f3ae4027030 2024-09-18T01:47:10.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.067+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v33'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ae8051070 con 0x7f3ae4027030 2024-09-18T01:47:10.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.067+0000 7f3af6f26800 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94159187380240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a324ea9970 con 0x7f3ae4027030 2024-09-18T01:47:10.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.067+0000 7f3af6f26800 20 add_watcher() i=0 2024-09-18T01:47:10.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.067+0000 7f3af6f26800 20 add_watcher() i=1 2024-09-18T01:47:10.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.067+0000 7f3af6f26800 20 add_watcher() i=2 2024-09-18T01:47:10.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.067+0000 7f3af6f26800 20 add_watcher() i=3 2024-09-18T01:47:10.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.067+0000 7f3af6f26800 20 add_watcher() i=4 2024-09-18T01:47:10.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.067+0000 7f3af6f26800 20 add_watcher() i=5 2024-09-18T01:47:10.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.067+0000 7f3af6f26800 20 add_watcher() i=6 2024-09-18T01:47:10.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.068+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94159187380240] v33'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ae8051070 con 0x7f3ae4027030 2024-09-18T01:47:10.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.068+0000 7f3af6f26800 20 add_watcher() i=7 2024-09-18T01:47:10.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.068+0000 7f3af6f26800 2 all 8 watchers are set, enabling cache 2024-09-18T01:47:10.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.068+0000 7f3af6f26800 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a324ead6f0 con 0x55a324e99df0 2024-09-18T01:47:10.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.069+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3ae8051070 con 0x55a324e99df0 2024-09-18T01:47:10.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.069+0000 7f3af6f26800 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94159187386896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a324eaab90 con 0x55a324e99df0 2024-09-18T01:47:10.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.070+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94159187386896] v33'247 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3ae8051070 con 0x55a324e99df0 2024-09-18T01:47:10.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.070+0000 7f39a97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:47:10.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.070+0000 7f3af6f26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:47:10.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.070+0000 7f3af6f26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:47:10.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.070+0000 7f3af6f26800 5 note: GC not initialized 2024-09-18T01:47:10.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.070+0000 7f3923fff640 20 reqs_thread_entry: start 2024-09-18T01:47:10.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.070+0000 7f3af6f26800 20 init_complete bucket index max shards: 11 2024-09-18T01:47:10.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.070+0000 7f3af6f26800 20 Filter name: none 2024-09-18T01:47:10.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.071+0000 7f3921ffb640 20 reqs_thread_entry: start 2024-09-18T01:47:10.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.071+0000 7f3af6f26800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-18T01:47:10.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.071+0000 7f3af6f26800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.071+0000 7f3af6f26800 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a324ee0a20 con 0x7f3ae4027030 2024-09-18T01:47:10.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.071+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7f3ae8051070 con 0x7f3ae4027030 2024-09-18T01:47:10.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.071+0000 7f3af6f26800 20 rados_obj.operate() r=0 bl.length=473 2024-09-18T01:47:10.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.071+0000 7f3af6f26800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-18T01:47:10.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.071+0000 7f3af6f26800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:47:10.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.071+0000 7f3af6f26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:47:10.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.071+0000 7f3af6f26800 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a324ee73f0 con 0x7f3ae4027030 2024-09-18T01:47:10.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.072+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v33'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f3ae8051070 con 0x7f3ae4027030 2024-09-18T01:47:10.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.072+0000 7f3af6f26800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T01:47:10.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.072+0000 7f3af6f26800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:47:10.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.072+0000 7f3af6f26800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-18T01:47:10.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.072+0000 7f3af6f26800 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94159187635632 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a324ee2a30 con 0x55a324e99df0 2024-09-18T01:47:10.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.073+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== watch-notify(notify (1) cookie 94159187377040 notify 141733920793 ret 0) ==== 678+0+0 (crc 0 0 0) 0x55a324c2de00 con 0x55a324e99df0 2024-09-18T01:47:10.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.073+0000 7f39d67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920793 cookie 94159187377040 notifier 4845 bl.length()=636 2024-09-18T01:47:10.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.073+0000 7f39d67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T01:47:10.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.073+0000 7f39d67fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:47:10.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.073+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(64 notify.4 [notify cookie 94159187635632 out=8b] v0'0 uv243 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3ae8051070 con 0x55a324e99df0 2024-09-18T01:47:10.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.073+0000 7f39d67fc640 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f39b8003ea0 con 0x55a324e99df0 2024-09-18T01:47:10.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.073+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ae8051070 con 0x55a324e99df0 2024-09-18T01:47:10.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.073+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== watch-notify(notify_complete (2) cookie 94159187635632 notify 141733920793 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f3ae806c730 con 0x55a324e99df0 2024-09-18T01:47:10.088 INFO:teuthology.orchestra.run.smithi146.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-18T01:47:09.882428Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:47:09.882414Z","tags":[],"group_ids":[]} 2024-09-18T01:47:10.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.074+0000 7f39a97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:47:10.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.074+0000 7f3af6f26800 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94159187386896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a324ede740 con 0x55a324e99df0 2024-09-18T01:47:10.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.075+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94159187386896] v33'248 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3ae8051070 con 0x55a324e99df0 2024-09-18T01:47:10.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.075+0000 7f3af6f26800 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94159187361984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a324ede740 con 0x7f3aec021070 2024-09-18T01:47:10.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.076+0000 7f3af2be3640 1 -- 172.21.15.146:0/753418588 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94159187361984] v33'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ae4043070 con 0x7f3aec021070 2024-09-18T01:47:10.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.076+0000 7f3af6f26800 20 remove_watcher() i=0 2024-09-18T01:47:10.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.076+0000 7f3af6f26800 2 removed watcher, disabling cache 2024-09-18T01:47:10.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.076+0000 7f3af6f26800 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94159187369392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a324ede740 con 0x55a324e99df0 2024-09-18T01:47:10.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.077+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94159187369392] v33'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ae8051070 con 0x55a324e99df0 2024-09-18T01:47:10.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.077+0000 7f3af6f26800 20 remove_watcher() i=1 2024-09-18T01:47:10.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.077+0000 7f3af6f26800 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94159187372160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a324ede740 con 0x55a324ea0060 2024-09-18T01:47:10.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.078+0000 7f3af33e4640 1 -- 172.21.15.146:0/753418588 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94159187372160] v33'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3aec057040 con 0x55a324ea0060 2024-09-18T01:47:10.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.078+0000 7f3af6f26800 20 remove_watcher() i=2 2024-09-18T01:47:10.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.078+0000 7f3af6f26800 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94159187374784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a324ede740 con 0x7f3aec021070 2024-09-18T01:47:10.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.079+0000 7f3af2be3640 1 -- 172.21.15.146:0/753418588 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94159187374784] v33'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ae4043070 con 0x7f3aec021070 2024-09-18T01:47:10.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.079+0000 7f3af6f26800 20 remove_watcher() i=3 2024-09-18T01:47:10.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.079+0000 7f3af6f26800 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94159187377040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a324ede740 con 0x55a324e99df0 2024-09-18T01:47:10.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.080+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 <== osd.1 v2:172.21.15.146:6808/3930274777 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94159187377040] v33'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ae8051070 con 0x55a324e99df0 2024-09-18T01:47:10.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.080+0000 7f3af6f26800 20 remove_watcher() i=4 2024-09-18T01:47:10.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.080+0000 7f3af6f26800 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94159187381984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a324ede740 con 0x7f3ae4027030 2024-09-18T01:47:10.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.081+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94159187381984] v33'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ae8051070 con 0x7f3ae4027030 2024-09-18T01:47:10.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.081+0000 7f3af6f26800 20 remove_watcher() i=5 2024-09-18T01:47:10.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.081+0000 7f3af6f26800 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94159187375840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a324ede740 con 0x7f3ae4027030 2024-09-18T01:47:10.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.082+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94159187375840] v33'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ae8051070 con 0x7f3ae4027030 2024-09-18T01:47:10.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.082+0000 7f3af6f26800 20 remove_watcher() i=6 2024-09-18T01:47:10.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.082+0000 7f3af6f26800 1 -- 172.21.15.146:0/753418588 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94159187380240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a324ede740 con 0x7f3ae4027030 2024-09-18T01:47:10.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.083+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94159187380240] v33'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ae8051070 con 0x7f3ae4027030 2024-09-18T01:47:10.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.083+0000 7f3af6f26800 20 remove_watcher() i=7 2024-09-18T01:47:10.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.083+0000 7f3af6f26800 1 -- 172.21.15.146:0/753418588 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f3ae4027030 msgr2=0x7f3ae40123c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.083+0000 7f3af6f26800 1 --2- 172.21.15.146:0/753418588 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f3ae4027030 0x7f3ae40123c0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.083+0000 7f3af6f26800 1 -- 172.21.15.146:0/753418588 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a324e99df0 msgr2=0x55a324e9c2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.083+0000 7f3af6f26800 1 --2- 172.21.15.146:0/753418588 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a324e99df0 0x55a324e9c2b0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.083+0000 7f3af6f26800 1 -- 172.21.15.146:0/753418588 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f3aec021070 msgr2=0x7f3aec043120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.083+0000 7f3af6f26800 1 --2- 172.21.15.146:0/753418588 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f3aec021070 0x7f3aec043120 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.083+0000 7f3af6f26800 1 -- 172.21.15.146:0/753418588 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55a324ea0060 msgr2=0x55a324ea2450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.083+0000 7f3af6f26800 1 --2- 172.21.15.146:0/753418588 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55a324ea0060 0x55a324ea2450 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.084+0000 7f3af6f26800 1 -- 172.21.15.146:0/753418588 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f39bc036b90 msgr2=0x7f39bc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.084+0000 7f3af6f26800 1 --2- 172.21.15.146:0/753418588 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f39bc036b90 0x7f39bc039050 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4011e60 tx=0x7f3ae4043000 comp rx=0 tx=0).stop 2024-09-18T01:47:10.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.084+0000 7f3af6f26800 1 -- 172.21.15.146:0/753418588 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a324e87050 msgr2=0x55a324e8e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.084+0000 7f3af6f26800 1 --2- 172.21.15.146:0/753418588 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a324e87050 0x55a324e8e380 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f3aec014800 tx=0x7f3aec04c8e0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.084+0000 7f3af23e2640 1 -- 172.21.15.146:0/753418588 reap_dead start 2024-09-18T01:47:10.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.084+0000 7f3af6f26800 1 -- 172.21.15.146:0/753418588 shutdown_connections 2024-09-18T01:47:10.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.084+0000 7f3af6f26800 1 --2- 172.21.15.146:0/753418588 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a324e87050 0x55a324e8e380 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.084+0000 7f3af6f26800 1 -- 172.21.15.146:0/753418588 >> 172.21.15.146:0/753418588 conn(0x55a324e833b0 msgr2=0x55a324e81480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:10.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.084+0000 7f3af6f26800 1 -- 172.21.15.146:0/753418588 shutdown_connections 2024-09-18T01:47:10.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.084+0000 7f3af6f26800 1 -- 172.21.15.146:0/753418588 wait complete. 2024-09-18T01:47:10.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.084+0000 7f3af6f26800 1 -- 172.21.15.146:0/4114478972 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f39cc036b40 msgr2=0x7f39cc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.084+0000 7f3af6f26800 1 --2- 172.21.15.146:0/4114478972 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f39cc036b40 0x7f39cc039000 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4026570 tx=0x7f3ae404ae10 comp rx=0 tx=0).stop 2024-09-18T01:47:10.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.084+0000 7f3af6f26800 1 -- 172.21.15.146:0/4114478972 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a324e7a340 msgr2=0x55a324e7a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.084+0000 7f3af6f26800 1 --2- 172.21.15.146:0/4114478972 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a324e7a340 0x55a324e7a760 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x55a324d66500 tx=0x7f3aec00ef30 comp rx=0 tx=0).stop 2024-09-18T01:47:10.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.084+0000 7f3af6f26800 1 -- 172.21.15.146:0/4114478972 shutdown_connections 2024-09-18T01:47:10.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.084+0000 7f3af6f26800 1 --2- 172.21.15.146:0/4114478972 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f39cc036b40 0x7f39cc039000 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.084+0000 7f3af6f26800 1 --2- 172.21.15.146:0/4114478972 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a324e7a340 0x55a324e7a760 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.084+0000 7f3af6f26800 1 -- 172.21.15.146:0/4114478972 >> 172.21.15.146:0/4114478972 conn(0x55a324e6f2d0 msgr2=0x55a324e71e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:10.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.084+0000 7f3af6f26800 1 -- 172.21.15.146:0/4114478972 shutdown_connections 2024-09-18T01:47:10.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.084+0000 7f3af6f26800 1 -- 172.21.15.146:0/4114478972 wait complete. 2024-09-18T01:47:10.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.084+0000 7f3af6f26800 1 -- 172.21.15.146:0/2952044158 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a324d6a900 msgr2=0x55a324e666c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.084+0000 7f3af6f26800 1 --2- 172.21.15.146:0/2952044158 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a324d6a900 0x55a324e666c0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.084+0000 7f3af6f26800 1 -- 172.21.15.146:0/2952044158 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55a324e69bb0 msgr2=0x55a324e6bfa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.084+0000 7f3af6f26800 1 --2- 172.21.15.146:0/2952044158 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55a324e69bb0 0x55a324e6bfa0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.085+0000 7f3af6f26800 1 -- 172.21.15.146:0/2952044158 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f39d8036b90 msgr2=0x7f39d8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.085+0000 7f3af6f26800 1 --2- 172.21.15.146:0/2952044158 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f39d8036b90 0x7f39d8039050 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3ae8057000 tx=0x7f3ae8052000 comp rx=0 tx=0).stop 2024-09-18T01:47:10.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.085+0000 7f3af6f26800 1 -- 172.21.15.146:0/2952044158 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a324cda650 msgr2=0x55a324d66b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.085+0000 7f3af6f26800 1 --2- 172.21.15.146:0/2952044158 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a324cda650 0x55a324d66b10 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4001b10 tx=0x7f3ae4000f40 comp rx=0 tx=0).stop 2024-09-18T01:47:10.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.085+0000 7f3af6f26800 1 -- 172.21.15.146:0/2952044158 shutdown_connections 2024-09-18T01:47:10.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.085+0000 7f3af6f26800 1 --2- 172.21.15.146:0/2952044158 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55a324e69bb0 0x55a324e6bfa0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.085+0000 7f3af6f26800 1 --2- 172.21.15.146:0/2952044158 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55a324d6a900 0x55a324e666c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.085+0000 7f3af6f26800 1 --2- 172.21.15.146:0/2952044158 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f39d8036b90 0x7f39d8039050 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.085+0000 7f3af6f26800 1 --2- 172.21.15.146:0/2952044158 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55a324cda650 0x55a324d66b10 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.085+0000 7f3af6f26800 1 -- 172.21.15.146:0/2952044158 >> 172.21.15.146:0/2952044158 conn(0x55a324d60db0 msgr2=0x55a324e4fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:10.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.085+0000 7f3af6f26800 1 -- 172.21.15.146:0/2952044158 shutdown_connections 2024-09-18T01:47:10.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.085+0000 7f3af6f26800 1 -- 172.21.15.146:0/2952044158 wait complete. 2024-09-18T01:47:10.099 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T01:47:09.882428Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:47:09.882414Z', 'tags': [], 'group_ids': []} 2024-09-18T01:47:10.100 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T01:47:09.882428Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:47:09.882414Z', 'tags': [], 'group_ids': []} 2024-09-18T01:47:10.100 ERROR:root:0 2024-09-18T01:47:10.100 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-09-18T01:47:10.100 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-09-18T01:47:10.100 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid system_user --display-name 'System User' --access-key system_akey --secret system_skey --caps user-info-without-keys=read --system 2024-09-18T01:47:10.153 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:47:10.153 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:47:10.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.153+0000 7f99b9a15800 1 Processor -- start 2024-09-18T01:47:10.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.153+0000 7f99b9a15800 1 -- start start 2024-09-18T01:47:10.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.154+0000 7f99b9a15800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x5626a34e3950 0x5626a34e5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.154+0000 7f99b9a15800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5626a339fb30 con 0x5626a34df510 2024-09-18T01:47:10.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.154+0000 7f99b9a15800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x5626a3381360 con 0x5626a34e3950 2024-09-18T01:47:10.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.154+0000 7f99ac99b640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x5626a34e3950 0x5626a34e5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.154+0000 7f99b519c640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x5626a34df510 0x5626a34df910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:53066/0 (socket says 172.21.15.146:53066) 2024-09-18T01:47:10.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.154+0000 7f99b519c640 1 -- 172.21.15.146:0/3292084282 learned_addr learned my addr 172.21.15.146:0/3292084282 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:47:10.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.154+0000 7f99ac99b640 1 --2- 172.21.15.146:0/3292084282 >> v2:172.21.15.129:3300/0 conn(0x5626a34e3950 0x5626a34e5d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37364/0 (socket says 172.21.15.146:37364) 2024-09-18T01:47:10.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.154+0000 7f99ac99b640 1 -- 172.21.15.146:0/3292084282 >> v1:172.21.15.129:6789/0 conn(0x5626a34df510 legacy=0x5626a34df910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.154+0000 7f99b499b640 1 -- 172.21.15.146:0/3292084282 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2328732484 0 0) 0x5626a339fb30 con 0x5626a34df510 2024-09-18T01:47:10.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.154+0000 7f99ac99b640 1 -- 172.21.15.146:0/3292084282 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626a33a7e00 con 0x5626a34e3950 2024-09-18T01:47:10.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.156+0000 7f99ac99b640 1 --2- 172.21.15.146:0/3292084282 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5626a34e3950 0x5626a34e5d40 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f99a000a470 tx=0x7f99a0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b980905ce90c1d5a server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.156+0000 7f99b499b640 1 -- 172.21.15.146:0/3292084282 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99a0053570 con 0x5626a34e3950 2024-09-18T01:47:10.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.156+0000 7f99b499b640 1 -- 172.21.15.146:0/3292084282 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99a0058070 con 0x5626a34e3950 2024-09-18T01:47:10.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.156+0000 7f99b499b640 1 -- 172.21.15.146:0/3292084282 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99a0053880 con 0x5626a34e3950 2024-09-18T01:47:10.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.156+0000 7f99b9a15800 1 -- 172.21.15.146:0/3292084282 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5626a34e3950 msgr2=0x5626a34e5d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.156+0000 7f99b9a15800 1 --2- 172.21.15.146:0/3292084282 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5626a34e3950 0x5626a34e5d40 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f99a000a470 tx=0x7f99a0045a20 comp rx=0 tx=0).stop 2024-09-18T01:47:10.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.157+0000 7f99b9a15800 1 -- 172.21.15.146:0/3292084282 shutdown_connections 2024-09-18T01:47:10.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.157+0000 7f99b9a15800 1 --2- 172.21.15.146:0/3292084282 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5626a34e3950 0x5626a34e5d40 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.157+0000 7f99b9a15800 1 -- 172.21.15.146:0/3292084282 >> 172.21.15.146:0/3292084282 conn(0x5626a34dade0 msgr2=0x5626a34dd200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:10.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.157+0000 7f99b9a15800 1 -- 172.21.15.146:0/3292084282 shutdown_connections 2024-09-18T01:47:10.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.157+0000 7f99b9a15800 1 -- 172.21.15.146:0/3292084282 wait complete. 2024-09-18T01:47:10.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.170+0000 7f99b9a15800 1 Processor -- start 2024-09-18T01:47:10.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.170+0000 7f99b9a15800 1 -- start start 2024-09-18T01:47:10.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.170+0000 7f99b9a15800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5626a34df510 0x5626a35cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.171+0000 7f99b9a15800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5626a342c450 con 0x5626a34df510 2024-09-18T01:47:10.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.171+0000 7f99b519c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5626a34df510 0x5626a35cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.171+0000 7f99b519c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5626a34df510 0x5626a35cf6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37372/0 (socket says 172.21.15.146:37372) 2024-09-18T01:47:10.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.171+0000 7f99b519c640 1 -- 172.21.15.146:0/2849707930 learned_addr learned my addr 172.21.15.146:0/2849707930 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:10.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.171+0000 7f99b519c640 1 -- 172.21.15.146:0/2849707930 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626a3379bc0 con 0x5626a34df510 2024-09-18T01:47:10.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.171+0000 7f99b519c640 1 --2- 172.21.15.146:0/2849707930 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5626a34df510 0x5626a35cf6b0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f99a800b240 tx=0x7f99a800b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e4b63ecf5eddc4b server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.171+0000 7f98a3606640 1 -- 172.21.15.146:0/2849707930 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99a8008070 con 0x5626a34df510 2024-09-18T01:47:10.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.171+0000 7f98a3606640 1 -- 172.21.15.146:0/2849707930 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99a800d500 con 0x5626a34df510 2024-09-18T01:47:10.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.171+0000 7f98a3606640 1 -- 172.21.15.146:0/2849707930 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99a800d860 con 0x5626a34df510 2024-09-18T01:47:10.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.172+0000 7f99b9a15800 1 -- 172.21.15.146:0/2849707930 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5626a34df510 msgr2=0x5626a35cf6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.172+0000 7f99b9a15800 1 --2- 172.21.15.146:0/2849707930 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5626a34df510 0x5626a35cf6b0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f99a800b240 tx=0x7f99a800b700 comp rx=0 tx=0).stop 2024-09-18T01:47:10.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.172+0000 7f99b9a15800 1 -- 172.21.15.146:0/2849707930 shutdown_connections 2024-09-18T01:47:10.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.172+0000 7f99b9a15800 1 --2- 172.21.15.146:0/2849707930 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5626a34df510 0x5626a35cf6b0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.172+0000 7f99b9a15800 1 -- 172.21.15.146:0/2849707930 >> 172.21.15.146:0/2849707930 conn(0x5626a34dade0 msgr2=0x5626a35cdb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:10.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.172+0000 7f99b9a15800 1 -- 172.21.15.146:0/2849707930 shutdown_connections 2024-09-18T01:47:10.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.172+0000 7f99b9a15800 1 -- 172.21.15.146:0/2849707930 wait complete. 2024-09-18T01:47:10.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.172+0000 7f99b9a15800 1 Processor -- start 2024-09-18T01:47:10.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.173+0000 7f99b9a15800 1 -- start start 2024-09-18T01:47:10.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.173+0000 7f99b9a15800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5626a34df510 0x5626a35cb450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.173+0000 7f99b9a15800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5626a34e6580 con 0x5626a34df510 2024-09-18T01:47:10.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.173+0000 7f99b519c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5626a34df510 0x5626a35cb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.173+0000 7f99b519c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5626a34df510 0x5626a35cb450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37386/0 (socket says 172.21.15.146:37386) 2024-09-18T01:47:10.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.173+0000 7f99b519c640 1 -- 172.21.15.146:0/2262026081 learned_addr learned my addr 172.21.15.146:0/2262026081 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:10.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.173+0000 7f99b519c640 1 -- 172.21.15.146:0/2262026081 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626a338dfe0 con 0x5626a34df510 2024-09-18T01:47:10.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.173+0000 7f99b519c640 1 --2- 172.21.15.146:0/2262026081 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5626a34df510 0x5626a35cb450 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x5626a35d0510 tx=0x7f99a8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.173+0000 7f98a1e03640 1 -- 172.21.15.146:0/2262026081 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99a8019870 con 0x5626a34df510 2024-09-18T01:47:10.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.174+0000 7f98a1e03640 1 -- 172.21.15.146:0/2262026081 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99a8019a10 con 0x5626a34df510 2024-09-18T01:47:10.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.174+0000 7f98a1e03640 1 -- 172.21.15.146:0/2262026081 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99a8019d30 con 0x5626a34df510 2024-09-18T01:47:10.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.174+0000 7f99b9a15800 1 -- 172.21.15.146:0/2262026081 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5626a35c9b40 con 0x5626a34df510 2024-09-18T01:47:10.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.174+0000 7f99b9a15800 1 -- 172.21.15.146:0/2262026081 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626a35ca060 con 0x5626a34df510 2024-09-18T01:47:10.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.174+0000 7f98a1e03640 1 -- 172.21.15.146:0/2262026081 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f99a8017040 con 0x5626a34df510 2024-09-18T01:47:10.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.175+0000 7f98a1e03640 1 --2- 172.21.15.146:0/2262026081 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f989c036b90 0x7f989c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.175+0000 7f98a1e03640 1 -- 172.21.15.146:0/2262026081 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f99a8015020 con 0x5626a34df510 2024-09-18T01:47:10.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.175+0000 7f99ac99b640 1 --2- 172.21.15.146:0/2262026081 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f989c036b90 0x7f989c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.175+0000 7f99b9a15800 1 --2- 172.21.15.146:0/2262026081 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5626a34e3950 0x5626a35e04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.175+0000 7f99b9a15800 1 -- 172.21.15.146:0/2262026081 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626a35e0a20 con 0x5626a34e3950 2024-09-18T01:47:10.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.175+0000 7f99b599d640 1 --2- 172.21.15.146:0/2262026081 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5626a34e3950 0x5626a35e04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.175+0000 7f99ac99b640 1 --2- 172.21.15.146:0/2262026081 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f989c036b90 0x7f989c039050 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f99a0057000 tx=0x7f99a0052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.175+0000 7f99b599d640 1 --2- 172.21.15.146:0/2262026081 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5626a34e3950 0x5626a35e04e0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.175+0000 7f99b599d640 1 -- 172.21.15.146:0/2262026081 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f99b000a4a0 con 0x5626a34e3950 2024-09-18T01:47:10.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.176+0000 7f99b9a15800 1 -- 172.21.15.146:0/2262026081 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626a35e1270 con 0x5626a34e3950 2024-09-18T01:47:10.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.176+0000 7f99b599d640 1 -- 172.21.15.146:0/2262026081 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f99b000a4a0 con 0x5626a34e3950 2024-09-18T01:47:10.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.176+0000 7f99b9a15800 1 -- 172.21.15.146:0/2262026081 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626a35e2620 con 0x5626a34e3950 2024-09-18T01:47:10.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.176+0000 7f99b599d640 1 -- 172.21.15.146:0/2262026081 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f99b000a4a0 con 0x5626a34e3950 2024-09-18T01:47:10.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.176+0000 7f99b9a15800 1 -- 172.21.15.146:0/2262026081 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626a35e1ac0 con 0x5626a34e3950 2024-09-18T01:47:10.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.176+0000 7f99b599d640 1 -- 172.21.15.146:0/2262026081 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f99b000a4a0 con 0x5626a34e3950 2024-09-18T01:47:10.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.176+0000 7f99b9a15800 1 --2- 172.21.15.146:0/2262026081 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5626a35e3a40 0x5626a35e5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.176+0000 7f99b9a15800 1 -- 172.21.15.146:0/2262026081 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626a35e6480 con 0x5626a35e3a40 2024-09-18T01:47:10.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.177+0000 7f99b519c640 1 --2- 172.21.15.146:0/2262026081 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5626a35e3a40 0x5626a35e5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.177+0000 7f99b519c640 1 --2- 172.21.15.146:0/2262026081 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5626a35e3a40 0x5626a35e5e30 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.177+0000 7f99b519c640 1 -- 172.21.15.146:0/2262026081 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f99a802d070 con 0x5626a35e3a40 2024-09-18T01:47:10.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.177+0000 7f99b9a15800 1 Processor -- start 2024-09-18T01:47:10.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.178+0000 7f99b9a15800 1 -- start start 2024-09-18T01:47:10.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.178+0000 7f99b9a15800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5626a35f4210 0x5626a35f4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.178+0000 7f99b9a15800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5626a35cb990 con 0x5626a35f4210 2024-09-18T01:47:10.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.178+0000 7f99b599d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5626a35f4210 0x5626a35f4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.178+0000 7f99b599d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5626a35f4210 0x5626a35f4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37402/0 (socket says 172.21.15.146:37402) 2024-09-18T01:47:10.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.178+0000 7f99b599d640 1 -- 172.21.15.146:0/3083603520 learned_addr learned my addr 172.21.15.146:0/3083603520 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:10.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.178+0000 7f99b599d640 1 -- 172.21.15.146:0/3083603520 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626a35f4b70 con 0x5626a35f4210 2024-09-18T01:47:10.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.179+0000 7f99b599d640 1 --2- 172.21.15.146:0/3083603520 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5626a35f4210 0x5626a35f4630 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x5626a35cb190 tx=0x7f99b00178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.179+0000 7f989affd640 1 -- 172.21.15.146:0/3083603520 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99b0013440 con 0x5626a35f4210 2024-09-18T01:47:10.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.179+0000 7f989affd640 1 -- 172.21.15.146:0/3083603520 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99b00135e0 con 0x5626a35f4210 2024-09-18T01:47:10.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.179+0000 7f99b9a15800 1 -- 172.21.15.146:0/3083603520 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5626a35f4e00 con 0x5626a35f4210 2024-09-18T01:47:10.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.179+0000 7f989affd640 1 -- 172.21.15.146:0/3083603520 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99b00138c0 con 0x5626a35f4210 2024-09-18T01:47:10.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.179+0000 7f99b9a15800 1 -- 172.21.15.146:0/3083603520 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626a35f7ae0 con 0x5626a35f4210 2024-09-18T01:47:10.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.179+0000 7f989affd640 1 -- 172.21.15.146:0/3083603520 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f99b0011040 con 0x5626a35f4210 2024-09-18T01:47:10.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.180+0000 7f989affd640 1 --2- 172.21.15.146:0/3083603520 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9890036b40 0x7f9890039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.180+0000 7f989affd640 1 -- 172.21.15.146:0/3083603520 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f99b001d070 con 0x5626a35f4210 2024-09-18T01:47:10.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.180+0000 7f99b519c640 1 --2- 172.21.15.146:0/3083603520 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9890036b40 0x7f9890039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.180+0000 7f99b9a15800 1 Processor -- start 2024-09-18T01:47:10.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.180+0000 7f99b519c640 1 --2- 172.21.15.146:0/3083603520 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9890036b40 0x7f9890039000 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f99a8001630 tx=0x7f99a804b640 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.180+0000 7f99b9a15800 1 -- start start 2024-09-18T01:47:10.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.180+0000 7f99b9a15800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5626a3600f00 0x5626a3601300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.180+0000 7f99b9a15800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5626a337b580 con 0x5626a3600f00 2024-09-18T01:47:10.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.180+0000 7f99b599d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5626a3600f00 0x5626a3601300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.180+0000 7f99b599d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5626a3600f00 0x5626a3601300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37414/0 (socket says 172.21.15.146:37414) 2024-09-18T01:47:10.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.180+0000 7f99b599d640 1 -- 172.21.15.146:0/1589412653 learned_addr learned my addr 172.21.15.146:0/1589412653 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:10.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.181+0000 7f99b599d640 1 -- 172.21.15.146:0/1589412653 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626a36018d0 con 0x5626a3600f00 2024-09-18T01:47:10.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.181+0000 7f99b599d640 1 --2- 172.21.15.146:0/1589412653 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5626a3600f00 0x5626a3601300 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f99b004c8f0 tx=0x7f99b004cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9c82ad9e1cd60e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.181+0000 7f9898ff9640 1 -- 172.21.15.146:0/1589412653 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99b0012cc0 con 0x5626a3600f00 2024-09-18T01:47:10.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.181+0000 7f9898ff9640 1 -- 172.21.15.146:0/1589412653 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99b004b250 con 0x5626a3600f00 2024-09-18T01:47:10.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.181+0000 7f9898ff9640 1 -- 172.21.15.146:0/1589412653 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99b0012e60 con 0x5626a3600f00 2024-09-18T01:47:10.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.181+0000 7f99b9a15800 1 -- 172.21.15.146:0/1589412653 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5626a3600f00 msgr2=0x5626a3601300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.181+0000 7f99b9a15800 1 --2- 172.21.15.146:0/1589412653 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5626a3600f00 0x5626a3601300 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f99b004c8f0 tx=0x7f99b004cbc0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.181+0000 7f99b9a15800 1 -- 172.21.15.146:0/1589412653 shutdown_connections 2024-09-18T01:47:10.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.181+0000 7f99b9a15800 1 --2- 172.21.15.146:0/1589412653 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5626a3600f00 0x5626a3601300 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.181+0000 7f99b9a15800 1 -- 172.21.15.146:0/1589412653 >> 172.21.15.146:0/1589412653 conn(0x5626a35fd260 msgr2=0x5626a35fb360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:10.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.182+0000 7f99b9a15800 1 -- 172.21.15.146:0/1589412653 shutdown_connections 2024-09-18T01:47:10.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.182+0000 7f99b9a15800 1 -- 172.21.15.146:0/1589412653 wait complete. 2024-09-18T01:47:10.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.182+0000 7f99b9a15800 1 Processor -- start 2024-09-18T01:47:10.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.182+0000 7f99b9a15800 1 -- start start 2024-09-18T01:47:10.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.182+0000 7f99b9a15800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5626a3600f00 0x5626a3608210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.182+0000 7f99b9a15800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5626a3601dc0 con 0x5626a3600f00 2024-09-18T01:47:10.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.182+0000 7f99b599d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5626a3600f00 0x5626a3608210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.182+0000 7f99b599d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5626a3600f00 0x5626a3608210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37422/0 (socket says 172.21.15.146:37422) 2024-09-18T01:47:10.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.182+0000 7f99b599d640 1 -- 172.21.15.146:0/2705221460 learned_addr learned my addr 172.21.15.146:0/2705221460 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:10.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.182+0000 7f99b599d640 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626a3608750 con 0x5626a3600f00 2024-09-18T01:47:10.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.183+0000 7f99b599d640 1 --2- 172.21.15.146:0/2705221460 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5626a3600f00 0x5626a3608210 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f99b004c8f0 tx=0x7f99b004c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.183+0000 7f9886ffd640 1 -- 172.21.15.146:0/2705221460 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99b0046040 con 0x5626a3600f00 2024-09-18T01:47:10.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.183+0000 7f9886ffd640 1 -- 172.21.15.146:0/2705221460 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99b0041050 con 0x5626a3600f00 2024-09-18T01:47:10.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.183+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5626a36089e0 con 0x5626a3600f00 2024-09-18T01:47:10.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.183+0000 7f9886ffd640 1 -- 172.21.15.146:0/2705221460 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99b0013c70 con 0x5626a3600f00 2024-09-18T01:47:10.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.183+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626a360b690 con 0x5626a3600f00 2024-09-18T01:47:10.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.183+0000 7f9886ffd640 1 -- 172.21.15.146:0/2705221460 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f99b002aa60 con 0x5626a3600f00 2024-09-18T01:47:10.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.184+0000 7f9886ffd640 1 --2- 172.21.15.146:0/2705221460 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9880036b40 0x7f9880039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.184+0000 7f9886ffd640 1 -- 172.21.15.146:0/2705221460 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f99b0034070 con 0x5626a3600f00 2024-09-18T01:47:10.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.184+0000 7f99b519c640 1 --2- 172.21.15.146:0/2705221460 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9880036b40 0x7f9880039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.184+0000 7f99b519c640 1 --2- 172.21.15.146:0/2705221460 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9880036b40 0x7f9880039000 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f99a8040fd0 tx=0x7f99a8033000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.184+0000 7f99b9a15800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.184+0000 7f99b9a15800 1 --2- 172.21.15.146:0/2705221460 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5626a3613de0 0x5626a36162a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.184+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626a36169f0 con 0x5626a3613de0 2024-09-18T01:47:10.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.184+0000 7f99ac99b640 1 --2- 172.21.15.146:0/2705221460 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5626a3613de0 0x5626a36162a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.185+0000 7f99ac99b640 1 --2- 172.21.15.146:0/2705221460 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5626a3613de0 0x5626a36162a0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.185+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f99a0051070 con 0x5626a3613de0 2024-09-18T01:47:10.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.185+0000 7f99b9a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:10.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.185+0000 7f99b9a15800 20 realm 2024-09-18T01:47:10.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.185+0000 7f99b9a15800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.185+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626a3616e20 con 0x5626a3613de0 2024-09-18T01:47:10.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.185+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f99a0051070 con 0x5626a3613de0 2024-09-18T01:47:10.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.185+0000 7f99b9a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:10.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.185+0000 7f99b9a15800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:47:10.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.185+0000 7f99b9a15800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.185+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626a36176f0 con 0x5626a3613de0 2024-09-18T01:47:10.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.185+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f99a0051070 con 0x5626a3613de0 2024-09-18T01:47:10.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.185+0000 7f99b9a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:10.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.185+0000 7f99b9a15800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.185+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626a3617a90 con 0x5626a3613de0 2024-09-18T01:47:10.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.186+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f99a0051070 con 0x5626a3613de0 2024-09-18T01:47:10.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.186+0000 7f99b9a15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:47:10.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.186+0000 7f99b9a15800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.186+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626a36182e0 con 0x5626a3613de0 2024-09-18T01:47:10.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.186+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f99a0051070 con 0x5626a3613de0 2024-09-18T01:47:10.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.186+0000 7f99b9a15800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:47:10.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.186+0000 7f99b9a15800 20 searching for the correct realm 2024-09-18T01:47:10.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.186+0000 7f99b9a15800 1 --2- 172.21.15.146:0/2705221460 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5626a361a050 0x5626a361c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.186+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5626a361ca70 con 0x5626a361a050 2024-09-18T01:47:10.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.186+0000 7f99b599d640 1 --2- 172.21.15.146:0/2705221460 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5626a361a050 0x5626a361c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.186+0000 7f99b599d640 1 --2- 172.21.15.146:0/2705221460 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5626a361a050 0x5626a361c440 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.187+0000 7f99b599d640 1 -- 172.21.15.146:0/2705221460 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99b003e020 con 0x5626a361a050 2024-09-18T01:47:10.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.187+0000 7f99b599d640 1 --2- 172.21.15.146:0/2705221460 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f99b00123a0 0x7f99b0014030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.187+0000 7f99b599d640 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5626a361ca70 con 0x7f99b00123a0 2024-09-18T01:47:10.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.187+0000 7f99b519c640 1 --2- 172.21.15.146:0/2705221460 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f99b00123a0 0x7f99b0014030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.187+0000 7f99b519c640 1 --2- 172.21.15.146:0/2705221460 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f99b00123a0 0x7f99b0014030 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.187+0000 7f99b519c640 1 -- 172.21.15.146:0/2705221460 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99a802d070 con 0x7f99b00123a0 2024-09-18T01:47:10.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.187+0000 7f99b519c640 1 --2- 172.21.15.146:0/2705221460 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f99a8018810 0x7f99a803f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.187+0000 7f99b519c640 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5626a361ca70 con 0x7f99a8018810 2024-09-18T01:47:10.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.188+0000 7f99ac99b640 1 --2- 172.21.15.146:0/2705221460 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f99a8018810 0x7f99a803f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.188+0000 7f99ac99b640 1 --2- 172.21.15.146:0/2705221460 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f99a8018810 0x7f99a803f1e0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.188+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99a0051070 con 0x7f99a8018810 2024-09-18T01:47:10.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.188+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5626a361ca70 con 0x5626a3613de0 2024-09-18T01:47:10.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.189+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v33'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f99a0051070 con 0x5626a3613de0 2024-09-18T01:47:10.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.189+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5626a361ca70 con 0x5626a3613de0 2024-09-18T01:47:10.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.189+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99a0051070 con 0x5626a3613de0 2024-09-18T01:47:10.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.189+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5626a361ca70 con 0x7f99a8018810 2024-09-18T01:47:10.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.189+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99a0051070 con 0x7f99a8018810 2024-09-18T01:47:10.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.189+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5626a361ca70 con 0x7f99a8018810 2024-09-18T01:47:10.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.189+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99a0051070 con 0x7f99a8018810 2024-09-18T01:47:10.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.189+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5626a361ca70 con 0x7f99b00123a0 2024-09-18T01:47:10.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.190+0000 7f99b519c640 1 -- 172.21.15.146:0/2705221460 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99a802d070 con 0x7f99b00123a0 2024-09-18T01:47:10.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.190+0000 7f99b519c640 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5626a361ca70 con 0x5626a361a050 2024-09-18T01:47:10.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.190+0000 7f99b599d640 1 -- 172.21.15.146:0/2705221460 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99b003e020 con 0x5626a361a050 2024-09-18T01:47:10.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.190+0000 7f99b599d640 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5626a361ca70 con 0x5626a3613de0 2024-09-18T01:47:10.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.190+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99a0051070 con 0x5626a3613de0 2024-09-18T01:47:10.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.190+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5626a361ca70 con 0x7f99a8018810 2024-09-18T01:47:10.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.190+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99a0051070 con 0x7f99a8018810 2024-09-18T01:47:10.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.190+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5626a361ca70 con 0x5626a3613de0 2024-09-18T01:47:10.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.191+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99a0051070 con 0x5626a3613de0 2024-09-18T01:47:10.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.191+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5626a361ca70 con 0x7f99b00123a0 2024-09-18T01:47:10.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.191+0000 7f99b519c640 1 -- 172.21.15.146:0/2705221460 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f99a802d070 con 0x7f99b00123a0 2024-09-18T01:47:10.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.191+0000 7f99b519c640 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5626a361ca70 con 0x5626a361a050 2024-09-18T01:47:10.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.191+0000 7f99b599d640 1 -- 172.21.15.146:0/2705221460 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99b003e020 con 0x5626a361a050 2024-09-18T01:47:10.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.191+0000 7f99b599d640 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5626a361ca70 con 0x5626a361a050 2024-09-18T01:47:10.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.191+0000 7f99b599d640 1 -- 172.21.15.146:0/2705221460 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99b003e020 con 0x5626a361a050 2024-09-18T01:47:10.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.191+0000 7f99b599d640 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5626a361ca70 con 0x7f99a8018810 2024-09-18T01:47:10.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.192+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99a0051070 con 0x7f99a8018810 2024-09-18T01:47:10.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.192+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5626a361ca70 con 0x5626a361a050 2024-09-18T01:47:10.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.192+0000 7f99b599d640 1 -- 172.21.15.146:0/2705221460 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99b003e020 con 0x5626a361a050 2024-09-18T01:47:10.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.192+0000 7f99b599d640 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5626a361ca70 con 0x5626a361a050 2024-09-18T01:47:10.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.192+0000 7f99b599d640 1 -- 172.21.15.146:0/2705221460 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99b003e020 con 0x5626a361a050 2024-09-18T01:47:10.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.192+0000 7f99b599d640 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5626a361ca70 con 0x5626a3613de0 2024-09-18T01:47:10.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.192+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99a0051070 con 0x5626a3613de0 2024-09-18T01:47:10.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.192+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5626a361ca70 con 0x5626a3613de0 2024-09-18T01:47:10.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.192+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v33'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f99a0051070 con 0x5626a3613de0 2024-09-18T01:47:10.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.192+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5626a361ca70 con 0x7f99a8018810 2024-09-18T01:47:10.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.193+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99a0051070 con 0x7f99a8018810 2024-09-18T01:47:10.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.193+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5626a361ca70 con 0x5626a361a050 2024-09-18T01:47:10.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.193+0000 7f99b599d640 1 -- 172.21.15.146:0/2705221460 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99b003e020 con 0x5626a361a050 2024-09-18T01:47:10.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.193+0000 7f99b599d640 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5626a361ca70 con 0x7f99b00123a0 2024-09-18T01:47:10.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.193+0000 7f99b519c640 1 -- 172.21.15.146:0/2705221460 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99a802d070 con 0x7f99b00123a0 2024-09-18T01:47:10.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.193+0000 7f99b519c640 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5626a361ca70 con 0x5626a3613de0 2024-09-18T01:47:10.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.193+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99a0051070 con 0x5626a3613de0 2024-09-18T01:47:10.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.193+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5626a361ca70 con 0x7f99a8018810 2024-09-18T01:47:10.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.194+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99a0051070 con 0x7f99a8018810 2024-09-18T01:47:10.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.194+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5626a361ca70 con 0x5626a361a050 2024-09-18T01:47:10.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.194+0000 7f99b599d640 1 -- 172.21.15.146:0/2705221460 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99b003e020 con 0x5626a361a050 2024-09-18T01:47:10.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.194+0000 7f99b599d640 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5626a361ca70 con 0x7f99a8018810 2024-09-18T01:47:10.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.194+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99a0051070 con 0x7f99a8018810 2024-09-18T01:47:10.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.194+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5626a361ca70 con 0x7f99b00123a0 2024-09-18T01:47:10.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.194+0000 7f99b519c640 1 -- 172.21.15.146:0/2705221460 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99a802d070 con 0x7f99b00123a0 2024-09-18T01:47:10.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.194+0000 7f99b519c640 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5626a361ca70 con 0x5626a361a050 2024-09-18T01:47:10.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.195+0000 7f99b599d640 1 -- 172.21.15.146:0/2705221460 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99b003e020 con 0x5626a361a050 2024-09-18T01:47:10.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.195+0000 7f99b599d640 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5626a361ca70 con 0x7f99a8018810 2024-09-18T01:47:10.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.195+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99a0051070 con 0x7f99a8018810 2024-09-18T01:47:10.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.195+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5626a361ca70 con 0x5626a3613de0 2024-09-18T01:47:10.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.195+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v33'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f99a0051070 con 0x5626a3613de0 2024-09-18T01:47:10.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.195+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5626a361ca70 con 0x7f99b00123a0 2024-09-18T01:47:10.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.196+0000 7f99b519c640 1 -- 172.21.15.146:0/2705221460 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99a802d070 con 0x7f99b00123a0 2024-09-18T01:47:10.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.196+0000 7f99b9a15800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:47:10.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.196+0000 7f99b9a15800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:47:10.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.196+0000 7f99b9a15800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:47:10.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.196+0000 7f99b9a15800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:47:10.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.196+0000 7f99b9a15800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:47:10.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.196+0000 7f99b9a15800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:47:10.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.196+0000 7f99b9a15800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.196+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626a3618c60 con 0x5626a3613de0 2024-09-18T01:47:10.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.196+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f99a0051070 con 0x5626a3613de0 2024-09-18T01:47:10.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.196+0000 7f99b9a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:10.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.196+0000 7f99b9a15800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.196+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626a3619500 con 0x5626a3613de0 2024-09-18T01:47:10.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.196+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f99a0051070 con 0x5626a3613de0 2024-09-18T01:47:10.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.196+0000 7f99b9a15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:47:10.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.196+0000 7f99b9a15800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.196+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626a361cef0 con 0x7f99b00123a0 2024-09-18T01:47:10.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.196+0000 7f99b519c640 1 -- 172.21.15.146:0/2705221460 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f99a802d070 con 0x7f99b00123a0 2024-09-18T01:47:10.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.196+0000 7f99b9a15800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:47:10.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.196+0000 7f99b9a15800 20 zone default found 2024-09-18T01:47:10.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.196+0000 7f99b9a15800 4 Realm: () 2024-09-18T01:47:10.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.196+0000 7f99b9a15800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:47:10.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.196+0000 7f99b9a15800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:47:10.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.196+0000 7f99b9a15800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:47:10.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.196+0000 7f99b9a15800 20 zonegroup default 2024-09-18T01:47:10.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.196+0000 7f99b9a15800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.196+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626a361d740 con 0x7f99a8018810 2024-09-18T01:47:10.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.197+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f99a0051070 con 0x7f99a8018810 2024-09-18T01:47:10.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.197+0000 7f99b9a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:10.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.197+0000 7f99b9a15800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.197+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626a361f120 con 0x5626a361a050 2024-09-18T01:47:10.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.197+0000 7f99b599d640 1 -- 172.21.15.146:0/2705221460 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f99b003e020 con 0x5626a361a050 2024-09-18T01:47:10.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.197+0000 7f99b9a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:10.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.197+0000 7f99b9a15800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.197+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626a361f600 con 0x5626a361a050 2024-09-18T01:47:10.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.197+0000 7f99b599d640 1 -- 172.21.15.146:0/2705221460 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f99b003e020 con 0x5626a361a050 2024-09-18T01:47:10.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.197+0000 7f99b9a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:10.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.197+0000 7f99b9a15800 20 started sync module instance, tier type = 2024-09-18T01:47:10.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.197+0000 7f99b9a15800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:47:10.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.197+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626a361e5b0 con 0x7f99b00123a0 2024-09-18T01:47:10.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.198+0000 7f99b519c640 1 -- 172.21.15.146:0/2705221460 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v33'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99a802d070 con 0x7f99b00123a0 2024-09-18T01:47:10.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.198+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94723949848992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626a361e210 con 0x7f99b00123a0 2024-09-18T01:47:10.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.199+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626a3620530 con 0x5626a3613de0 2024-09-18T01:47:10.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.200+0000 7f99b519c640 1 -- 172.21.15.146:0/2705221460 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94723949848992] v33'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99a802d070 con 0x7f99b00123a0 2024-09-18T01:47:10.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.200+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v33'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99a0051070 con 0x5626a3613de0 2024-09-18T01:47:10.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.200+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94723949854848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626a3620950 con 0x5626a3613de0 2024-09-18T01:47:10.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.200+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626a3621310 con 0x5626a361a050 2024-09-18T01:47:10.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.201+0000 7f99b599d640 1 -- 172.21.15.146:0/2705221460 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v33'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99b003e020 con 0x5626a361a050 2024-09-18T01:47:10.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.201+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94723949858400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626a3621770 con 0x5626a361a050 2024-09-18T01:47:10.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.201+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626a3622290 con 0x7f99b00123a0 2024-09-18T01:47:10.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.201+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94723949854848] v33'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99a0051070 con 0x5626a3613de0 2024-09-18T01:47:10.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.202+0000 7f99b519c640 1 -- 172.21.15.146:0/2705221460 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v33'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99a802d070 con 0x7f99b00123a0 2024-09-18T01:47:10.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.202+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94723949862240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626a3622680 con 0x7f99b00123a0 2024-09-18T01:47:10.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.202+0000 7f99b599d640 1 -- 172.21.15.146:0/2705221460 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94723949858400] v33'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99b003e020 con 0x5626a361a050 2024-09-18T01:47:10.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.202+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626a3622ed0 con 0x5626a3613de0 2024-09-18T01:47:10.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.203+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v33'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99a0051070 con 0x5626a3613de0 2024-09-18T01:47:10.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.203+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94723949865504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626a3623390 con 0x5626a3613de0 2024-09-18T01:47:10.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.203+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626a3623eb0 con 0x7f99a8018810 2024-09-18T01:47:10.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.204+0000 7f99b519c640 1 -- 172.21.15.146:0/2705221460 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94723949862240] v33'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99a802d070 con 0x7f99b00123a0 2024-09-18T01:47:10.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.204+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v33'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99a0051070 con 0x7f99a8018810 2024-09-18T01:47:10.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.204+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94723949869440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626a3623e70 con 0x7f99a8018810 2024-09-18T01:47:10.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.204+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626a36248c0 con 0x7f99a8018810 2024-09-18T01:47:10.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.205+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94723949865504] v33'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99a0051070 con 0x5626a3613de0 2024-09-18T01:47:10.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.205+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(56 notify.6 [create] v33'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99a0051070 con 0x7f99a8018810 2024-09-18T01:47:10.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.205+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94723949866560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626a36248c0 con 0x7f99a8018810 2024-09-18T01:47:10.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.205+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626a3625280 con 0x7f99a8018810 2024-09-18T01:47:10.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.206+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94723949869440] v33'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99a0051070 con 0x7f99a8018810 2024-09-18T01:47:10.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.206+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(58 notify.7 [create] v33'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99a0051070 con 0x7f99a8018810 2024-09-18T01:47:10.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.206+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94723949866560] v33'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99a0051070 con 0x7f99a8018810 2024-09-18T01:47:10.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.206+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94723949855904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626a3624dd0 con 0x7f99a8018810 2024-09-18T01:47:10.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.206+0000 7f99b9a15800 20 add_watcher() i=0 2024-09-18T01:47:10.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.206+0000 7f99b9a15800 20 add_watcher() i=1 2024-09-18T01:47:10.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.206+0000 7f99b9a15800 20 add_watcher() i=2 2024-09-18T01:47:10.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.206+0000 7f99b9a15800 20 add_watcher() i=3 2024-09-18T01:47:10.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.206+0000 7f99b9a15800 20 add_watcher() i=4 2024-09-18T01:47:10.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.206+0000 7f99b9a15800 20 add_watcher() i=5 2024-09-18T01:47:10.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.206+0000 7f99b9a15800 20 add_watcher() i=6 2024-09-18T01:47:10.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.209+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94723949855904] v33'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99a0051070 con 0x7f99a8018810 2024-09-18T01:47:10.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.209+0000 7f99b9a15800 20 add_watcher() i=7 2024-09-18T01:47:10.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.209+0000 7f99b9a15800 2 all 8 watchers are set, enabling cache 2024-09-18T01:47:10.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.209+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626a36282b0 con 0x5626a3613de0 2024-09-18T01:47:10.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.210+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f99a0051070 con 0x5626a3613de0 2024-09-18T01:47:10.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.210+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94723949874640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626a36256a0 con 0x5626a3613de0 2024-09-18T01:47:10.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.211+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94723949874640] v33'249 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f99a0051070 con 0x5626a3613de0 2024-09-18T01:47:10.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.211+0000 7f986b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:47:10.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.211+0000 7f99b9a15800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:47:10.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.211+0000 7f99b9a15800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:47:10.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.211+0000 7f99b9a15800 5 note: GC not initialized 2024-09-18T01:47:10.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.211+0000 7f986a7e4640 20 reqs_thread_entry: start 2024-09-18T01:47:10.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.211+0000 7f99b9a15800 20 init_complete bucket index max shards: 11 2024-09-18T01:47:10.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.211+0000 7f99b9a15800 20 Filter name: none 2024-09-18T01:47:10.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.212+0000 7f97dbfff640 20 reqs_thread_entry: start 2024-09-18T01:47:10.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.212+0000 7f99b9a15800 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-09-18T01:47:10.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.212+0000 7f99b9a15800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.212+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:62 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626a365b440 con 0x7f99a8018810 2024-09-18T01:47:10.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.212+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(62 system_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 239+0+0 (crc 0 0 0) 0x7f99a0051070 con 0x7f99a8018810 2024-09-18T01:47:10.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.212+0000 7f99b9a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:10.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.212+0000 7f99b9a15800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x0 2024-09-18T01:47:10.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.212+0000 7f99b9a15800 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-18T01:47:10.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.212+0000 7f99b9a15800 10 cache get: name=default.rgw.meta+users.keys+system_akey : miss 2024-09-18T01:47:10.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.212+0000 7f99b9a15800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.212+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:63 8.0 8:01223cbf:users.keys::system_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626a3659aa0 con 0x5626a361a050 2024-09-18T01:47:10.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.212+0000 7f99b599d640 1 -- 172.21.15.146:0/2705221460 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(63 system_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7f99b003e020 con 0x5626a361a050 2024-09-18T01:47:10.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.212+0000 7f99b9a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:10.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.212+0000 7f99b9a15800 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x0 2024-09-18T01:47:10.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.212+0000 7f99b9a15800 10 adding default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-18T01:47:10.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.212+0000 7f99b9a15800 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-09-18T01:47:10.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.212+0000 7f99b9a15800 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-09-18T01:47:10.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.212+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:64 8.1e 8:78ce4db0:users.uid::system_user:head [delete,create,call version.set in=58b,writefull 0~349 in=349b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626a365a340 con 0x7f99a8018810 2024-09-18T01:47:10.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.213+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(64 system_user [delete,create,call,writefull 0~349] v33'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7f99a0051070 con 0x7f99a8018810 2024-09-18T01:47:10.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.213+0000 7f99b9a15800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-09-18T01:47:10.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.213+0000 7f99b9a15800 10 moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-18T01:47:10.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.213+0000 7f99b9a15800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-09-18T01:47:10.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.213+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94723950091920 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626a365eee0 con 0x7f99b00123a0 2024-09-18T01:47:10.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.214+0000 7f99b519c640 1 -- 172.21.15.146:0/2705221460 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== watch-notify(notify (1) cookie 94723949848992 notify 141733920801 ret 0) ==== 575+0+0 (crc 0 0 0) 0x5626a35ca060 con 0x7f99b00123a0 2024-09-18T01:47:10.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.214+0000 7f9898ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920801 cookie 94723949848992 notifier 4852 bl.length()=533 2024-09-18T01:47:10.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.214+0000 7f9898ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-09-18T01:47:10.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.214+0000 7f9898ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-18T01:47:10.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.214+0000 7f99b519c640 1 -- 172.21.15.146:0/2705221460 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(65 notify.0 [notify cookie 94723950091920 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f99a802d070 con 0x7f99b00123a0 2024-09-18T01:47:10.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.214+0000 7f9898ff9640 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f9878003ea0 con 0x7f99b00123a0 2024-09-18T01:47:10.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.214+0000 7f99b519c640 1 -- 172.21.15.146:0/2705221460 <== osd.2 v2:172.21.15.146:6800/3820039304 14 ==== osd_op_reply(66 notify.0 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99a802d070 con 0x7f99b00123a0 2024-09-18T01:47:10.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.214+0000 7f99b519c640 1 -- 172.21.15.146:0/2705221460 <== osd.2 v2:172.21.15.146:6800/3820039304 15 ==== watch-notify(notify_complete (2) cookie 94723950091920 notify 141733920801 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5626a35c9b40 con 0x7f99b00123a0 2024-09-18T01:47:10.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.214+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:67 8.0 8:01223cbf:users.keys::system_akey:head [delete,create,writefull 0~15 in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626a3659e90 con 0x5626a361a050 2024-09-18T01:47:10.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.215+0000 7f99b599d640 1 -- 172.21.15.146:0/2705221460 <== osd.3 v2:172.21.15.146:6809/4106661138 15 ==== osd_op_reply(67 system_akey [delete,create,writefull 0~15] v33'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f99b003e020 con 0x5626a361a050 2024-09-18T01:47:10.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.215+0000 7f99b9a15800 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-09-18T01:47:10.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.215+0000 7f99b9a15800 10 moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-18T01:47:10.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.215+0000 7f99b9a15800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-09-18T01:47:10.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.215+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify cookie 94723950091920 in=188b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5626a365eee0 con 0x5626a3613de0 2024-09-18T01:47:10.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.216+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== watch-notify(notify (1) cookie 94723949854848 notify 141733920794 ret 0) ==== 218+0+0 (crc 0 0 0) 0x5626a365a6e0 con 0x5626a3613de0 2024-09-18T01:47:10.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.216+0000 7f9898ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920794 cookie 94723949854848 notifier 4852 bl.length()=176 2024-09-18T01:47:10.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.216+0000 7f9898ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-09-18T01:47:10.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.216+0000 7f9898ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-18T01:47:10.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.216+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(68 notify.1 [notify cookie 94723950091920 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f99a0051070 con 0x5626a3613de0 2024-09-18T01:47:10.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.216+0000 7f9898ff9640 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f9878003ea0 con 0x5626a3613de0 2024-09-18T01:47:10.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.216+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== watch-notify(notify_complete (2) cookie 94723950091920 notify 141733920794 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5626a365ae90 con 0x5626a3613de0 2024-09-18T01:47:10.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.216+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(69 notify.1 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99a0051070 con 0x5626a3613de0 2024-09-18T01:47:10.228 INFO:teuthology.orchestra.run.smithi146.stdout:{"user_id":"system_user","display_name":"System User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"system_user","access_key":"system_akey","secret_key":"system_skey","active":true,"create_date":"2024-09-18T01:47:10.213157Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","system":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:47:10.213147Z","tags":[],"group_ids":[]} 2024-09-18T01:47:10.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.217+0000 7f986b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:47:10.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.217+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94723949874640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626a36591a0 con 0x5626a3613de0 2024-09-18T01:47:10.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.218+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94723949874640] v33'250 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f99a0051070 con 0x5626a3613de0 2024-09-18T01:47:10.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.218+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94723949848992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626a36591a0 con 0x7f99b00123a0 2024-09-18T01:47:10.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.219+0000 7f99b519c640 1 -- 172.21.15.146:0/2705221460 <== osd.2 v2:172.21.15.146:6800/3820039304 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94723949848992] v33'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99a802d070 con 0x7f99b00123a0 2024-09-18T01:47:10.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.219+0000 7f99b9a15800 20 remove_watcher() i=0 2024-09-18T01:47:10.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.219+0000 7f99b9a15800 2 removed watcher, disabling cache 2024-09-18T01:47:10.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.219+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94723949854848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626a36591a0 con 0x5626a3613de0 2024-09-18T01:47:10.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.220+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94723949854848] v33'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99a0087040 con 0x5626a3613de0 2024-09-18T01:47:10.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.220+0000 7f99b9a15800 20 remove_watcher() i=1 2024-09-18T01:47:10.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.220+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94723949858400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626a36591a0 con 0x5626a361a050 2024-09-18T01:47:10.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.221+0000 7f99b599d640 1 -- 172.21.15.146:0/2705221460 <== osd.3 v2:172.21.15.146:6809/4106661138 16 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94723949858400] v33'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99b003e020 con 0x5626a361a050 2024-09-18T01:47:10.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.221+0000 7f99b9a15800 20 remove_watcher() i=2 2024-09-18T01:47:10.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.221+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94723949862240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626a36591a0 con 0x7f99b00123a0 2024-09-18T01:47:10.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.222+0000 7f99b519c640 1 -- 172.21.15.146:0/2705221460 <== osd.2 v2:172.21.15.146:6800/3820039304 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94723949862240] v33'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99a802d070 con 0x7f99b00123a0 2024-09-18T01:47:10.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.222+0000 7f99b9a15800 20 remove_watcher() i=3 2024-09-18T01:47:10.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.222+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94723949865504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626a36591a0 con 0x5626a3613de0 2024-09-18T01:47:10.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.223+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 <== osd.1 v2:172.21.15.146:6808/3930274777 28 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94723949865504] v33'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99a0087040 con 0x5626a3613de0 2024-09-18T01:47:10.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.223+0000 7f99b9a15800 20 remove_watcher() i=4 2024-09-18T01:47:10.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.223+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94723949869440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626a36591a0 con 0x7f99a8018810 2024-09-18T01:47:10.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.224+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94723949869440] v33'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99a0087040 con 0x7f99a8018810 2024-09-18T01:47:10.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.224+0000 7f99b9a15800 20 remove_watcher() i=5 2024-09-18T01:47:10.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.224+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94723949866560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626a36591a0 con 0x7f99a8018810 2024-09-18T01:47:10.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.225+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94723949866560] v33'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99a0087040 con 0x7f99a8018810 2024-09-18T01:47:10.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.225+0000 7f99b9a15800 20 remove_watcher() i=6 2024-09-18T01:47:10.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.225+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94723949855904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5626a36591a0 con 0x7f99a8018810 2024-09-18T01:47:10.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.226+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94723949855904] v33'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99a0087040 con 0x7f99a8018810 2024-09-18T01:47:10.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.226+0000 7f99b9a15800 20 remove_watcher() i=7 2024-09-18T01:47:10.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.227+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f99a8018810 msgr2=0x7f99a803f1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.227+0000 7f99b9a15800 1 --2- 172.21.15.146:0/2705221460 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f99a8018810 0x7f99a803f1e0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.227+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5626a3613de0 msgr2=0x5626a36162a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.227+0000 7f99b9a15800 1 --2- 172.21.15.146:0/2705221460 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5626a3613de0 0x5626a36162a0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.227+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f99b00123a0 msgr2=0x7f99b0014030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.227+0000 7f99b9a15800 1 --2- 172.21.15.146:0/2705221460 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f99b00123a0 0x7f99b0014030 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.227+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5626a361a050 msgr2=0x5626a361c440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.227+0000 7f99b9a15800 1 --2- 172.21.15.146:0/2705221460 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5626a361a050 0x5626a361c440 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.227+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9880036b40 msgr2=0x7f9880039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.227+0000 7f99b9a15800 1 --2- 172.21.15.146:0/2705221460 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9880036b40 0x7f9880039000 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f99a8040fd0 tx=0x7f99a8033000 comp rx=0 tx=0).stop 2024-09-18T01:47:10.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.227+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5626a3600f00 msgr2=0x5626a3608210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.227+0000 7f99ac99b640 1 -- 172.21.15.146:0/2705221460 reap_dead start 2024-09-18T01:47:10.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.227+0000 7f99b9a15800 1 --2- 172.21.15.146:0/2705221460 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5626a3600f00 0x5626a3608210 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f99b004c8f0 tx=0x7f99b004c880 comp rx=0 tx=0).stop 2024-09-18T01:47:10.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.227+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 shutdown_connections 2024-09-18T01:47:10.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.227+0000 7f99b9a15800 1 --2- 172.21.15.146:0/2705221460 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5626a3600f00 0x5626a3608210 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.227+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 >> 172.21.15.146:0/2705221460 conn(0x5626a35fd260 msgr2=0x5626a35fb330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:10.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.227+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 shutdown_connections 2024-09-18T01:47:10.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.227+0000 7f99b9a15800 1 -- 172.21.15.146:0/2705221460 wait complete. 2024-09-18T01:47:10.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.227+0000 7f99b9a15800 1 -- 172.21.15.146:0/3083603520 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9890036b40 msgr2=0x7f9890039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.227+0000 7f99b9a15800 1 --2- 172.21.15.146:0/3083603520 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9890036b40 0x7f9890039000 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f99a8001630 tx=0x7f99a804b640 comp rx=0 tx=0).stop 2024-09-18T01:47:10.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.227+0000 7f99b9a15800 1 -- 172.21.15.146:0/3083603520 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5626a35f4210 msgr2=0x5626a35f4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.227+0000 7f99b9a15800 1 --2- 172.21.15.146:0/3083603520 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5626a35f4210 0x5626a35f4630 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x5626a35cb190 tx=0x7f99b00178e0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.227+0000 7f99b9a15800 1 -- 172.21.15.146:0/3083603520 shutdown_connections 2024-09-18T01:47:10.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.227+0000 7f99b9a15800 1 --2- 172.21.15.146:0/3083603520 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9890036b40 0x7f9890039000 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.227+0000 7f99b9a15800 1 --2- 172.21.15.146:0/3083603520 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5626a35f4210 0x5626a35f4630 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.227+0000 7f99b9a15800 1 -- 172.21.15.146:0/3083603520 >> 172.21.15.146:0/3083603520 conn(0x5626a35e91a0 msgr2=0x5626a35ebd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:10.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.227+0000 7f99b9a15800 1 -- 172.21.15.146:0/3083603520 shutdown_connections 2024-09-18T01:47:10.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.227+0000 7f99b9a15800 1 -- 172.21.15.146:0/3083603520 wait complete. 2024-09-18T01:47:10.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.228+0000 7f99b9a15800 1 -- 172.21.15.146:0/2262026081 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5626a34e3950 msgr2=0x5626a35e04e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.228+0000 7f99b9a15800 1 --2- 172.21.15.146:0/2262026081 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5626a34e3950 0x5626a35e04e0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.228+0000 7f99b9a15800 1 -- 172.21.15.146:0/2262026081 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5626a35e3a40 msgr2=0x5626a35e5e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.228+0000 7f99b9a15800 1 --2- 172.21.15.146:0/2262026081 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5626a35e3a40 0x5626a35e5e30 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.228+0000 7f99b9a15800 1 -- 172.21.15.146:0/2262026081 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f989c036b90 msgr2=0x7f989c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.228+0000 7f99b9a15800 1 --2- 172.21.15.146:0/2262026081 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f989c036b90 0x7f989c039050 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f99a0057000 tx=0x7f99a0052000 comp rx=0 tx=0).stop 2024-09-18T01:47:10.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.228+0000 7f99b9a15800 1 -- 172.21.15.146:0/2262026081 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5626a34df510 msgr2=0x5626a35cb450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.228+0000 7f99b9a15800 1 --2- 172.21.15.146:0/2262026081 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5626a34df510 0x5626a35cb450 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x5626a35d0510 tx=0x7f99a8000ed0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.228+0000 7f99b9a15800 1 -- 172.21.15.146:0/2262026081 shutdown_connections 2024-09-18T01:47:10.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.228+0000 7f99b9a15800 1 --2- 172.21.15.146:0/2262026081 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5626a35e3a40 0x5626a35e5e30 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.228+0000 7f99b9a15800 1 --2- 172.21.15.146:0/2262026081 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5626a34e3950 0x5626a35e04e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.228+0000 7f99b9a15800 1 --2- 172.21.15.146:0/2262026081 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f989c036b90 0x7f989c039050 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.228+0000 7f99b9a15800 1 --2- 172.21.15.146:0/2262026081 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5626a34df510 0x5626a35cb450 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.228+0000 7f99b9a15800 1 -- 172.21.15.146:0/2262026081 >> 172.21.15.146:0/2262026081 conn(0x5626a34dade0 msgr2=0x5626a35cdb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:10.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.228+0000 7f99b9a15800 1 -- 172.21.15.146:0/2262026081 shutdown_connections 2024-09-18T01:47:10.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.228+0000 7f99b9a15800 1 -- 172.21.15.146:0/2262026081 wait complete. 2024-09-18T01:47:10.241 DEBUG:tasks.util.rgw: json result: {'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-09-18T01:47:10.213157Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:47:10.213147Z', 'tags': [], 'group_ids': []} 2024-09-18T01:47:10.241 ERROR:root:{'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-09-18T01:47:10.213157Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:47:10.213147Z', 'tags': [], 'group_ids': []} 2024-09-18T01:47:10.241 ERROR:root:0 2024-09-18T01:47:10.242 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-18T01:47:10.246 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T01:47:10.246 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'system_user'] 2024-09-18T01:47:10.246 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'system_user'] 2024-09-18T01:47:10.247 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid system_user 2024-09-18T01:47:10.291 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:47:10.291 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:47:10.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.291+0000 7f005be0e800 1 Processor -- start 2024-09-18T01:47:10.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.291+0000 7f005be0e800 1 -- start start 2024-09-18T01:47:10.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.291+0000 7f005be0e800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x561b8f93e5f0 0x561b8f9cf690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.291+0000 7f005be0e800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561b8f889b30 con 0x561b8f9cfbd0 2024-09-18T01:47:10.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.291+0000 7f005be0e800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x561b8f86b360 con 0x561b8f93e5f0 2024-09-18T01:47:10.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.292+0000 7f005751a640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x561b8f93e5f0 0x561b8f9cf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.292+0000 7f005751a640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x561b8f93e5f0 0x561b8f9cf690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37432/0 (socket says 172.21.15.146:37432) 2024-09-18T01:47:10.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.292+0000 7f0056d19640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x561b8f9cfbd0 0x561b8f9d1fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:53080/0 (socket says 172.21.15.146:53080) 2024-09-18T01:47:10.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.292+0000 7f005751a640 1 -- 172.21.15.146:0/792600543 learned_addr learned my addr 172.21.15.146:0/792600543 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:10.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.292+0000 7f005751a640 1 -- 172.21.15.146:0/792600543 >> v1:172.21.15.129:6789/0 conn(0x561b8f9cfbd0 legacy=0x561b8f9d1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.292+0000 7f005751a640 1 -- 172.21.15.146:0/792600543 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b8f891e00 con 0x561b8f93e5f0 2024-09-18T01:47:10.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.294+0000 7f005751a640 1 --2- 172.21.15.146:0/792600543 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561b8f93e5f0 0x561b8f9cf690 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f004800a520 tx=0x7f0048045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=562ff573f478ae89 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.294+0000 7f0056518640 1 -- 172.21.15.146:0/792600543 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0048055070 con 0x561b8f93e5f0 2024-09-18T01:47:10.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.294+0000 7f0056518640 1 -- 172.21.15.146:0/792600543 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00480515b0 con 0x561b8f93e5f0 2024-09-18T01:47:10.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.294+0000 7f0056518640 1 -- 172.21.15.146:0/792600543 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00480518d0 con 0x561b8f93e5f0 2024-09-18T01:47:10.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.294+0000 7f005be0e800 1 -- 172.21.15.146:0/792600543 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561b8f93e5f0 msgr2=0x561b8f9cf690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.294+0000 7f005be0e800 1 --2- 172.21.15.146:0/792600543 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561b8f93e5f0 0x561b8f9cf690 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f004800a520 tx=0x7f0048045ba0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.294+0000 7f005be0e800 1 -- 172.21.15.146:0/792600543 shutdown_connections 2024-09-18T01:47:10.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.294+0000 7f005be0e800 1 --2- 172.21.15.146:0/792600543 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561b8f93e5f0 0x561b8f9cf690 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.294+0000 7f005be0e800 1 -- 172.21.15.146:0/792600543 >> 172.21.15.146:0/792600543 conn(0x561b8f9c4de0 msgr2=0x561b8f9c7200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:10.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.294+0000 7f005be0e800 1 -- 172.21.15.146:0/792600543 shutdown_connections 2024-09-18T01:47:10.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.294+0000 7f005be0e800 1 -- 172.21.15.146:0/792600543 wait complete. 2024-09-18T01:47:10.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.309+0000 7f005be0e800 1 Processor -- start 2024-09-18T01:47:10.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.309+0000 7f005be0e800 1 -- start start 2024-09-18T01:47:10.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.309+0000 7f005be0e800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561b8f93e5f0 0x561b8fabba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.309+0000 7f005be0e800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x561b8f916330 con 0x561b8f93e5f0 2024-09-18T01:47:10.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.310+0000 7f005751a640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561b8f93e5f0 0x561b8fabba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.310+0000 7f005751a640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561b8f93e5f0 0x561b8fabba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37434/0 (socket says 172.21.15.146:37434) 2024-09-18T01:47:10.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.310+0000 7f005751a640 1 -- 172.21.15.146:0/2907295034 learned_addr learned my addr 172.21.15.146:0/2907295034 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:10.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.310+0000 7f005751a640 1 -- 172.21.15.146:0/2907295034 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b8f863bc0 con 0x561b8f93e5f0 2024-09-18T01:47:10.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.310+0000 7f005751a640 1 --2- 172.21.15.146:0/2907295034 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561b8f93e5f0 0x561b8fabba70 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f0048025da0 tx=0x7f0048051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68215b6eab6fac7f server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.310+0000 7eff4560a640 1 -- 172.21.15.146:0/2907295034 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0048051950 con 0x561b8f93e5f0 2024-09-18T01:47:10.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.310+0000 7eff4560a640 1 -- 172.21.15.146:0/2907295034 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0048051af0 con 0x561b8f93e5f0 2024-09-18T01:47:10.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.310+0000 7eff4560a640 1 -- 172.21.15.146:0/2907295034 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0048051dd0 con 0x561b8f93e5f0 2024-09-18T01:47:10.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.311+0000 7f005be0e800 1 -- 172.21.15.146:0/2907295034 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561b8f93e5f0 msgr2=0x561b8fabba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.311+0000 7f005be0e800 1 --2- 172.21.15.146:0/2907295034 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561b8f93e5f0 0x561b8fabba70 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f0048025da0 tx=0x7f0048051000 comp rx=0 tx=0).stop 2024-09-18T01:47:10.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.311+0000 7f005be0e800 1 -- 172.21.15.146:0/2907295034 shutdown_connections 2024-09-18T01:47:10.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.311+0000 7f005be0e800 1 --2- 172.21.15.146:0/2907295034 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561b8f93e5f0 0x561b8fabba70 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.311+0000 7f005be0e800 1 -- 172.21.15.146:0/2907295034 >> 172.21.15.146:0/2907295034 conn(0x561b8f9c4de0 msgr2=0x561b8fab7430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:10.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.311+0000 7f005be0e800 1 -- 172.21.15.146:0/2907295034 shutdown_connections 2024-09-18T01:47:10.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.311+0000 7f005be0e800 1 -- 172.21.15.146:0/2907295034 wait complete. 2024-09-18T01:47:10.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.311+0000 7f005be0e800 1 Processor -- start 2024-09-18T01:47:10.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.312+0000 7f005be0e800 1 -- start start 2024-09-18T01:47:10.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.312+0000 7f005be0e800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561b8f93e5f0 0x561b8fac3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.312+0000 7f005be0e800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x561b8f9d3980 con 0x561b8f93e5f0 2024-09-18T01:47:10.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.312+0000 7f005751a640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561b8f93e5f0 0x561b8fac3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.312+0000 7f005751a640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561b8f93e5f0 0x561b8fac3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37438/0 (socket says 172.21.15.146:37438) 2024-09-18T01:47:10.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.312+0000 7f005751a640 1 -- 172.21.15.146:0/3371402314 learned_addr learned my addr 172.21.15.146:0/3371402314 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:10.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.312+0000 7f005751a640 1 -- 172.21.15.146:0/3371402314 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b8f877fe0 con 0x561b8f93e5f0 2024-09-18T01:47:10.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.312+0000 7f005751a640 1 --2- 172.21.15.146:0/3371402314 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561b8f93e5f0 0x561b8fac3340 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f0048067040 tx=0x7f0048002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.312+0000 7eff43e07640 1 -- 172.21.15.146:0/3371402314 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0048073070 con 0x561b8f93e5f0 2024-09-18T01:47:10.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.312+0000 7eff43e07640 1 -- 172.21.15.146:0/3371402314 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f004805a450 con 0x561b8f93e5f0 2024-09-18T01:47:10.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.312+0000 7f005be0e800 1 -- 172.21.15.146:0/3371402314 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561b8fac3880 con 0x561b8f93e5f0 2024-09-18T01:47:10.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.312+0000 7eff43e07640 1 -- 172.21.15.146:0/3371402314 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f004805a730 con 0x561b8f93e5f0 2024-09-18T01:47:10.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.313+0000 7f005be0e800 1 -- 172.21.15.146:0/3371402314 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b8fac3e00 con 0x561b8f93e5f0 2024-09-18T01:47:10.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.313+0000 7eff43e07640 1 -- 172.21.15.146:0/3371402314 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0048076070 con 0x561b8f93e5f0 2024-09-18T01:47:10.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.313+0000 7eff43e07640 1 --2- 172.21.15.146:0/3371402314 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7eff3c036b90 0x7eff3c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.313+0000 7eff43e07640 1 -- 172.21.15.146:0/3371402314 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f0048062070 con 0x561b8f93e5f0 2024-09-18T01:47:10.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.314+0000 7f0056d19640 1 --2- 172.21.15.146:0/3371402314 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7eff3c036b90 0x7eff3c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.314+0000 7f005be0e800 1 --2- 172.21.15.146:0/3371402314 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x561b8f9cfbd0 0x561b8faca410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.314+0000 7f005be0e800 1 -- 172.21.15.146:0/3371402314 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561b8facaa80 con 0x561b8f9cfbd0 2024-09-18T01:47:10.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.314+0000 7f0057d1b640 1 --2- 172.21.15.146:0/3371402314 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x561b8f9cfbd0 0x561b8faca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.314+0000 7f0056d19640 1 --2- 172.21.15.146:0/3371402314 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7eff3c036b90 0x7eff3c039050 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f004c000f60 tx=0x7f004c001370 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.314+0000 7f0057d1b640 1 --2- 172.21.15.146:0/3371402314 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x561b8f9cfbd0 0x561b8faca410 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.314+0000 7f0057d1b640 1 -- 172.21.15.146:0/3371402314 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f005000a4a0 con 0x561b8f9cfbd0 2024-09-18T01:47:10.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.314+0000 7f005be0e800 1 -- 172.21.15.146:0/3371402314 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561b8fac7960 con 0x561b8f9cfbd0 2024-09-18T01:47:10.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.315+0000 7f0057d1b640 1 -- 172.21.15.146:0/3371402314 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f005000a4a0 con 0x561b8f9cfbd0 2024-09-18T01:47:10.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.315+0000 7f005be0e800 1 -- 172.21.15.146:0/3371402314 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561b8facc8a0 con 0x561b8f9cfbd0 2024-09-18T01:47:10.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.315+0000 7f0057d1b640 1 -- 172.21.15.146:0/3371402314 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f005000a4a0 con 0x561b8f9cfbd0 2024-09-18T01:47:10.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.315+0000 7f005be0e800 1 -- 172.21.15.146:0/3371402314 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561b8facb9e0 con 0x561b8f9cfbd0 2024-09-18T01:47:10.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.315+0000 7f0057d1b640 1 -- 172.21.15.146:0/3371402314 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f005000a4a0 con 0x561b8f9cfbd0 2024-09-18T01:47:10.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.315+0000 7f005be0e800 1 --2- 172.21.15.146:0/3371402314 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x561b8facc480 0x561b8facfce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.315+0000 7f005be0e800 1 -- 172.21.15.146:0/3371402314 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561b8fad0470 con 0x561b8facc480 2024-09-18T01:47:10.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.315+0000 7f005751a640 1 --2- 172.21.15.146:0/3371402314 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x561b8facc480 0x561b8facfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.315+0000 7f005751a640 1 --2- 172.21.15.146:0/3371402314 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x561b8facc480 0x561b8facfce0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.316+0000 7f005751a640 1 -- 172.21.15.146:0/3371402314 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0048075030 con 0x561b8facc480 2024-09-18T01:47:10.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.316+0000 7f005be0e800 1 Processor -- start 2024-09-18T01:47:10.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.316+0000 7f005be0e800 1 -- start start 2024-09-18T01:47:10.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.316+0000 7f005be0e800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561b8fade200 0x561b8fade620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.316+0000 7f005be0e800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x561b8f865580 con 0x561b8fade200 2024-09-18T01:47:10.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.316+0000 7f0057d1b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561b8fade200 0x561b8fade620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.316+0000 7f0057d1b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561b8fade200 0x561b8fade620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37442/0 (socket says 172.21.15.146:37442) 2024-09-18T01:47:10.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.316+0000 7f0057d1b640 1 -- 172.21.15.146:0/1399701325 learned_addr learned my addr 172.21.15.146:0/1399701325 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:10.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.317+0000 7f0057d1b640 1 -- 172.21.15.146:0/1399701325 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b8fadeb60 con 0x561b8fade200 2024-09-18T01:47:10.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.317+0000 7f0057d1b640 1 --2- 172.21.15.146:0/1399701325 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561b8fade200 0x561b8fade620 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x561b8facae80 tx=0x7f00500178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.317+0000 7eff41602640 1 -- 172.21.15.146:0/1399701325 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0050013440 con 0x561b8fade200 2024-09-18T01:47:10.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.317+0000 7eff41602640 1 -- 172.21.15.146:0/1399701325 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00500135e0 con 0x561b8fade200 2024-09-18T01:47:10.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.317+0000 7eff41602640 1 -- 172.21.15.146:0/1399701325 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00500138c0 con 0x561b8fade200 2024-09-18T01:47:10.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.317+0000 7f005be0e800 1 -- 172.21.15.146:0/1399701325 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561b8fadedf0 con 0x561b8fade200 2024-09-18T01:47:10.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.317+0000 7f005be0e800 1 -- 172.21.15.146:0/1399701325 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b8fae1ad0 con 0x561b8fade200 2024-09-18T01:47:10.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.318+0000 7eff41602640 1 -- 172.21.15.146:0/1399701325 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0050011040 con 0x561b8fade200 2024-09-18T01:47:10.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.318+0000 7eff41602640 1 --2- 172.21.15.146:0/1399701325 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7eff30036b90 0x7eff30039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.318+0000 7eff41602640 1 -- 172.21.15.146:0/1399701325 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f005001d070 con 0x561b8fade200 2024-09-18T01:47:10.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.318+0000 7f005751a640 1 --2- 172.21.15.146:0/1399701325 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7eff30036b90 0x7eff30039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.318+0000 7f005be0e800 1 Processor -- start 2024-09-18T01:47:10.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.318+0000 7f005be0e800 1 -- start start 2024-09-18T01:47:10.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.318+0000 7f005751a640 1 --2- 172.21.15.146:0/1399701325 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7eff30036b90 0x7eff30039050 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f00480505a0 tx=0x7f0048064c80 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.318+0000 7f005be0e800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561b8faeae10 0x561b8faeb210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.319+0000 7f005be0e800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x561b8fabc160 con 0x561b8faeae10 2024-09-18T01:47:10.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.319+0000 7f0057d1b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561b8faeae10 0x561b8faeb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.319+0000 7f0057d1b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561b8faeae10 0x561b8faeb210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37450/0 (socket says 172.21.15.146:37450) 2024-09-18T01:47:10.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.319+0000 7f0057d1b640 1 -- 172.21.15.146:0/3931120710 learned_addr learned my addr 172.21.15.146:0/3931120710 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:10.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.319+0000 7f0057d1b640 1 -- 172.21.15.146:0/3931120710 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b8faeb750 con 0x561b8faeae10 2024-09-18T01:47:10.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.319+0000 7f0057d1b640 1 --2- 172.21.15.146:0/3931120710 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561b8faeae10 0x561b8faeb210 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f005004c890 tx=0x7f005004c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=431d97618b05f220 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.319+0000 7eff3affd640 1 -- 172.21.15.146:0/3931120710 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0050045070 con 0x561b8faeae10 2024-09-18T01:47:10.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.319+0000 7eff3affd640 1 -- 172.21.15.146:0/3931120710 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0050012df0 con 0x561b8faeae10 2024-09-18T01:47:10.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.319+0000 7eff3affd640 1 -- 172.21.15.146:0/3931120710 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0050021bc0 con 0x561b8faeae10 2024-09-18T01:47:10.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.320+0000 7f005be0e800 1 -- 172.21.15.146:0/3931120710 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561b8faeae10 msgr2=0x561b8faeb210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.320+0000 7f005be0e800 1 --2- 172.21.15.146:0/3931120710 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561b8faeae10 0x561b8faeb210 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f005004c890 tx=0x7f005004c9d0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.320+0000 7f005be0e800 1 -- 172.21.15.146:0/3931120710 shutdown_connections 2024-09-18T01:47:10.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.320+0000 7f005be0e800 1 --2- 172.21.15.146:0/3931120710 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561b8faeae10 0x561b8faeb210 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.320+0000 7f005be0e800 1 -- 172.21.15.146:0/3931120710 >> 172.21.15.146:0/3931120710 conn(0x561b8fae71c0 msgr2=0x561b8fae52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:10.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.320+0000 7f005be0e800 1 -- 172.21.15.146:0/3931120710 shutdown_connections 2024-09-18T01:47:10.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.320+0000 7f005be0e800 1 -- 172.21.15.146:0/3931120710 wait complete. 2024-09-18T01:47:10.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.320+0000 7f005be0e800 1 Processor -- start 2024-09-18T01:47:10.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.320+0000 7f005be0e800 1 -- start start 2024-09-18T01:47:10.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.320+0000 7f005be0e800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561b8faeae10 0x561b8faf2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.320+0000 7f005be0e800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x561b8faebdf0 con 0x561b8faeae10 2024-09-18T01:47:10.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.320+0000 7f0057d1b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561b8faeae10 0x561b8faf2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.320+0000 7f0057d1b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561b8faeae10 0x561b8faf2310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37466/0 (socket says 172.21.15.146:37466) 2024-09-18T01:47:10.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.320+0000 7f0057d1b640 1 -- 172.21.15.146:0/2958975901 learned_addr learned my addr 172.21.15.146:0/2958975901 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:10.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.321+0000 7f0057d1b640 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b8faf2850 con 0x561b8faeae10 2024-09-18T01:47:10.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.321+0000 7f0057d1b640 1 --2- 172.21.15.146:0/2958975901 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561b8faeae10 0x561b8faf2310 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f0050001df0 tx=0x7f005004c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.321+0000 7eff397fa640 1 -- 172.21.15.146:0/2958975901 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f005003a070 con 0x561b8faeae10 2024-09-18T01:47:10.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.321+0000 7eff397fa640 1 -- 172.21.15.146:0/2958975901 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0050001540 con 0x561b8faeae10 2024-09-18T01:47:10.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.321+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561b8faf2ae0 con 0x561b8faeae10 2024-09-18T01:47:10.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.321+0000 7eff397fa640 1 -- 172.21.15.146:0/2958975901 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0050045040 con 0x561b8faeae10 2024-09-18T01:47:10.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.321+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b8faf5790 con 0x561b8faeae10 2024-09-18T01:47:10.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.322+0000 7eff397fa640 1 -- 172.21.15.146:0/2958975901 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f005003d070 con 0x561b8faeae10 2024-09-18T01:47:10.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.322+0000 7eff397fa640 1 --2- 172.21.15.146:0/2958975901 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7eff20036aa0 0x7eff20038f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.322+0000 7eff397fa640 1 -- 172.21.15.146:0/2958975901 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f005000e040 con 0x561b8faeae10 2024-09-18T01:47:10.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.322+0000 7f005751a640 1 --2- 172.21.15.146:0/2958975901 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7eff20036aa0 0x7eff20038f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.322+0000 7f005751a640 1 --2- 172.21.15.146:0/2958975901 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7eff20036aa0 0x7eff20038f60 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0048005a60 tx=0x7f0048087000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.322+0000 7f005be0e800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.323+0000 7f005be0e800 1 --2- 172.21.15.146:0/2958975901 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x561b8fafe030 0x561b8fb004f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.323+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb00c40 con 0x561b8fafe030 2024-09-18T01:47:10.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.323+0000 7f0056d19640 1 --2- 172.21.15.146:0/2958975901 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x561b8fafe030 0x561b8fb004f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.323+0000 7f0056d19640 1 --2- 172.21.15.146:0/2958975901 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x561b8fafe030 0x561b8fb004f0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.323+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f004c00f610 con 0x561b8fafe030 2024-09-18T01:47:10.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.323+0000 7f005be0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:10.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.323+0000 7f005be0e800 20 realm 2024-09-18T01:47:10.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.323+0000 7f005be0e800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.323+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561b8fafd480 con 0x561b8fafe030 2024-09-18T01:47:10.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.323+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f004c00f610 con 0x561b8fafe030 2024-09-18T01:47:10.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.323+0000 7f005be0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:10.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.323+0000 7f005be0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:47:10.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.323+0000 7f005be0e800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.323+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb01730 con 0x561b8fafe030 2024-09-18T01:47:10.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.324+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f004c00f610 con 0x561b8fafe030 2024-09-18T01:47:10.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.324+0000 7f005be0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:10.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.324+0000 7f005be0e800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.324+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb02000 con 0x561b8fafe030 2024-09-18T01:47:10.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.324+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f004c00f610 con 0x561b8fafe030 2024-09-18T01:47:10.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.324+0000 7f005be0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:47:10.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.324+0000 7f005be0e800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.324+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb023a0 con 0x561b8fafe030 2024-09-18T01:47:10.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.324+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f004c00f610 con 0x561b8fafe030 2024-09-18T01:47:10.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.324+0000 7f005be0e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:47:10.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.324+0000 7f005be0e800 20 searching for the correct realm 2024-09-18T01:47:10.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.324+0000 7f005be0e800 1 --2- 172.21.15.146:0/2958975901 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x561b8fb04280 0x561b8fb066b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.324+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb06d80 con 0x561b8fb04280 2024-09-18T01:47:10.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.324+0000 7f0057d1b640 1 --2- 172.21.15.146:0/2958975901 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x561b8fb04280 0x561b8fb066b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.325+0000 7f0057d1b640 1 --2- 172.21.15.146:0/2958975901 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x561b8fb04280 0x561b8fb066b0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.325+0000 7f0057d1b640 1 -- 172.21.15.146:0/2958975901 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f005003c030 con 0x561b8fb04280 2024-09-18T01:47:10.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.325+0000 7f0057d1b640 1 --2- 172.21.15.146:0/2958975901 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f005003f060 0x7f005002b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.325+0000 7f0057d1b640 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb06d80 con 0x7f005003f060 2024-09-18T01:47:10.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.325+0000 7f005751a640 1 --2- 172.21.15.146:0/2958975901 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f005003f060 0x7f005002b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.325+0000 7f005751a640 1 --2- 172.21.15.146:0/2958975901 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f005003f060 0x7f005002b600 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.325+0000 7f005751a640 1 -- 172.21.15.146:0/2958975901 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0048097070 con 0x7f005003f060 2024-09-18T01:47:10.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.325+0000 7f005751a640 1 --2- 172.21.15.146:0/2958975901 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f00480a9040 0x7f004806f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.325+0000 7f005751a640 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb06d80 con 0x7f00480a9040 2024-09-18T01:47:10.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.326+0000 7f0056d19640 1 --2- 172.21.15.146:0/2958975901 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f00480a9040 0x7f004806f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.326+0000 7f0056d19640 1 --2- 172.21.15.146:0/2958975901 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f00480a9040 0x7f004806f900 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.326+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f004c00f610 con 0x7f00480a9040 2024-09-18T01:47:10.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.326+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb06d80 con 0x561b8fafe030 2024-09-18T01:47:10.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.327+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v33'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f004c00f610 con 0x561b8fafe030 2024-09-18T01:47:10.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.327+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb06d80 con 0x561b8fafe030 2024-09-18T01:47:10.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.327+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f004c00f610 con 0x561b8fafe030 2024-09-18T01:47:10.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.327+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb06d80 con 0x7f00480a9040 2024-09-18T01:47:10.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.327+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f004c00f610 con 0x7f00480a9040 2024-09-18T01:47:10.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.327+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb06d80 con 0x7f00480a9040 2024-09-18T01:47:10.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.327+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f004c00f610 con 0x7f00480a9040 2024-09-18T01:47:10.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.327+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb06d80 con 0x7f005003f060 2024-09-18T01:47:10.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.328+0000 7f005751a640 1 -- 172.21.15.146:0/2958975901 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0048097070 con 0x7f005003f060 2024-09-18T01:47:10.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.328+0000 7f005751a640 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb06d80 con 0x561b8fb04280 2024-09-18T01:47:10.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.328+0000 7f0057d1b640 1 -- 172.21.15.146:0/2958975901 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f005003c030 con 0x561b8fb04280 2024-09-18T01:47:10.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.328+0000 7f0057d1b640 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb06d80 con 0x561b8fafe030 2024-09-18T01:47:10.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.328+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f004c00f610 con 0x561b8fafe030 2024-09-18T01:47:10.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.328+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb06d80 con 0x7f00480a9040 2024-09-18T01:47:10.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.328+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f004c00f610 con 0x7f00480a9040 2024-09-18T01:47:10.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.328+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb06d80 con 0x561b8fafe030 2024-09-18T01:47:10.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.329+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f004c00f610 con 0x561b8fafe030 2024-09-18T01:47:10.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.329+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb06d80 con 0x7f005003f060 2024-09-18T01:47:10.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.329+0000 7f005751a640 1 -- 172.21.15.146:0/2958975901 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f0048097070 con 0x7f005003f060 2024-09-18T01:47:10.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.329+0000 7f005751a640 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb06d80 con 0x561b8fb04280 2024-09-18T01:47:10.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.329+0000 7f0057d1b640 1 -- 172.21.15.146:0/2958975901 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f005003c030 con 0x561b8fb04280 2024-09-18T01:47:10.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.329+0000 7f0057d1b640 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb06d80 con 0x561b8fb04280 2024-09-18T01:47:10.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.329+0000 7f0057d1b640 1 -- 172.21.15.146:0/2958975901 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f005003c030 con 0x561b8fb04280 2024-09-18T01:47:10.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.329+0000 7f0057d1b640 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb06d80 con 0x7f00480a9040 2024-09-18T01:47:10.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.330+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f004c00f610 con 0x7f00480a9040 2024-09-18T01:47:10.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.330+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb06d80 con 0x561b8fb04280 2024-09-18T01:47:10.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.330+0000 7f0057d1b640 1 -- 172.21.15.146:0/2958975901 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f005003c030 con 0x561b8fb04280 2024-09-18T01:47:10.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.330+0000 7f0057d1b640 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb06d80 con 0x561b8fb04280 2024-09-18T01:47:10.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.330+0000 7f0057d1b640 1 -- 172.21.15.146:0/2958975901 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f005003c030 con 0x561b8fb04280 2024-09-18T01:47:10.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.330+0000 7f0057d1b640 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb06d80 con 0x561b8fafe030 2024-09-18T01:47:10.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.330+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f004c00f610 con 0x561b8fafe030 2024-09-18T01:47:10.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.330+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb06d80 con 0x561b8fafe030 2024-09-18T01:47:10.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.330+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v33'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f004c00f610 con 0x561b8fafe030 2024-09-18T01:47:10.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.330+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb06d80 con 0x7f00480a9040 2024-09-18T01:47:10.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.331+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f004c00f610 con 0x7f00480a9040 2024-09-18T01:47:10.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.331+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb06d80 con 0x561b8fb04280 2024-09-18T01:47:10.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.331+0000 7f0057d1b640 1 -- 172.21.15.146:0/2958975901 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f005003c030 con 0x561b8fb04280 2024-09-18T01:47:10.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.331+0000 7f0057d1b640 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb06d80 con 0x7f005003f060 2024-09-18T01:47:10.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.331+0000 7f005751a640 1 -- 172.21.15.146:0/2958975901 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0048097070 con 0x7f005003f060 2024-09-18T01:47:10.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.331+0000 7f005751a640 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb06d80 con 0x561b8fafe030 2024-09-18T01:47:10.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.331+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f004c00f610 con 0x561b8fafe030 2024-09-18T01:47:10.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.331+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb06d80 con 0x7f00480a9040 2024-09-18T01:47:10.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.332+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f004c00f610 con 0x7f00480a9040 2024-09-18T01:47:10.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.332+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb06d80 con 0x561b8fb04280 2024-09-18T01:47:10.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.332+0000 7f0057d1b640 1 -- 172.21.15.146:0/2958975901 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f005003c030 con 0x561b8fb04280 2024-09-18T01:47:10.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.332+0000 7f0057d1b640 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb06d80 con 0x7f00480a9040 2024-09-18T01:47:10.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.332+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f004c00f610 con 0x7f00480a9040 2024-09-18T01:47:10.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.332+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb06d80 con 0x7f005003f060 2024-09-18T01:47:10.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.333+0000 7f005751a640 1 -- 172.21.15.146:0/2958975901 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0048097070 con 0x7f005003f060 2024-09-18T01:47:10.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.333+0000 7f005751a640 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb06d80 con 0x561b8fb04280 2024-09-18T01:47:10.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.333+0000 7f0057d1b640 1 -- 172.21.15.146:0/2958975901 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f005003c030 con 0x561b8fb04280 2024-09-18T01:47:10.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.333+0000 7f0057d1b640 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb06d80 con 0x7f00480a9040 2024-09-18T01:47:10.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.333+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f004c00f610 con 0x7f00480a9040 2024-09-18T01:47:10.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.333+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb06d80 con 0x561b8fafe030 2024-09-18T01:47:10.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.333+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v33'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f004c00f610 con 0x561b8fafe030 2024-09-18T01:47:10.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.333+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb06d80 con 0x7f005003f060 2024-09-18T01:47:10.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.334+0000 7f005751a640 1 -- 172.21.15.146:0/2958975901 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0048097070 con 0x7f005003f060 2024-09-18T01:47:10.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.334+0000 7f005be0e800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:47:10.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.334+0000 7f005be0e800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:47:10.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.334+0000 7f005be0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:47:10.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.334+0000 7f005be0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:47:10.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.334+0000 7f005be0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:47:10.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.334+0000 7f005be0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:47:10.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.334+0000 7f005be0e800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.334+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb02cf0 con 0x561b8fafe030 2024-09-18T01:47:10.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.334+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f004c00f610 con 0x561b8fafe030 2024-09-18T01:47:10.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.334+0000 7f005be0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:10.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.334+0000 7f005be0e800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.334+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb03590 con 0x561b8fafe030 2024-09-18T01:47:10.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.334+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f004c00f610 con 0x561b8fafe030 2024-09-18T01:47:10.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.334+0000 7f005be0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:47:10.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.334+0000 7f005be0e800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.334+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb07200 con 0x7f005003f060 2024-09-18T01:47:10.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.334+0000 7f005751a640 1 -- 172.21.15.146:0/2958975901 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0048097070 con 0x7f005003f060 2024-09-18T01:47:10.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.334+0000 7f005be0e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:47:10.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.334+0000 7f005be0e800 20 zone default found 2024-09-18T01:47:10.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.334+0000 7f005be0e800 4 Realm: () 2024-09-18T01:47:10.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.334+0000 7f005be0e800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:47:10.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.334+0000 7f005be0e800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:47:10.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.334+0000 7f005be0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:47:10.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.334+0000 7f005be0e800 20 zonegroup default 2024-09-18T01:47:10.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.334+0000 7f005be0e800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.334+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb07a50 con 0x7f00480a9040 2024-09-18T01:47:10.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.335+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f004c00f610 con 0x7f00480a9040 2024-09-18T01:47:10.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.335+0000 7f005be0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:10.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.335+0000 7f005be0e800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.335+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb09430 con 0x561b8fb04280 2024-09-18T01:47:10.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.335+0000 7f0057d1b640 1 -- 172.21.15.146:0/2958975901 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f005003c030 con 0x561b8fb04280 2024-09-18T01:47:10.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.335+0000 7f005be0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:10.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.335+0000 7f005be0e800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.335+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb09890 con 0x561b8fb04280 2024-09-18T01:47:10.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.335+0000 7f0057d1b640 1 -- 172.21.15.146:0/2958975901 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f005003c030 con 0x561b8fb04280 2024-09-18T01:47:10.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.335+0000 7f005be0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:10.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.335+0000 7f005be0e800 20 started sync module instance, tier type = 2024-09-18T01:47:10.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.335+0000 7f005be0e800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:47:10.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.335+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb088c0 con 0x7f005003f060 2024-09-18T01:47:10.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.336+0000 7f005751a640 1 -- 172.21.15.146:0/2958975901 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v33'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0048097070 con 0x7f005003f060 2024-09-18T01:47:10.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.336+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94676374817968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb08520 con 0x7f005003f060 2024-09-18T01:47:10.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.336+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb0a7c0 con 0x561b8fafe030 2024-09-18T01:47:10.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.337+0000 7f005751a640 1 -- 172.21.15.146:0/2958975901 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94676374817968] v33'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0048097070 con 0x7f005003f060 2024-09-18T01:47:10.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.337+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v33'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f004c00f610 con 0x561b8fafe030 2024-09-18T01:47:10.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.337+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94676374823696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb0abe0 con 0x561b8fafe030 2024-09-18T01:47:10.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.337+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb0b5a0 con 0x561b8fb04280 2024-09-18T01:47:10.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.338+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94676374823696] v33'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f004c00f610 con 0x561b8fafe030 2024-09-18T01:47:10.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.339+0000 7f0057d1b640 1 -- 172.21.15.146:0/2958975901 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v33'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f005003c030 con 0x561b8fb04280 2024-09-18T01:47:10.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.339+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94676374824752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb0ab50 con 0x561b8fb04280 2024-09-18T01:47:10.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.339+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb0c460 con 0x7f005003f060 2024-09-18T01:47:10.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.340+0000 7f0057d1b640 1 -- 172.21.15.146:0/2958975901 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94676374824752] v33'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f005003c030 con 0x561b8fb04280 2024-09-18T01:47:10.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.340+0000 7f005751a640 1 -- 172.21.15.146:0/2958975901 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v33'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0048097070 con 0x7f005003f060 2024-09-18T01:47:10.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.340+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94676374831024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb0c800 con 0x7f005003f060 2024-09-18T01:47:10.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.340+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb0d250 con 0x561b8fafe030 2024-09-18T01:47:10.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.341+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v33'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f004c00f610 con 0x561b8fafe030 2024-09-18T01:47:10.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.341+0000 7f005751a640 1 -- 172.21.15.146:0/2958975901 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94676374831024] v33'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0048097070 con 0x7f005003f060 2024-09-18T01:47:10.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.341+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94676374834496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb0daf0 con 0x561b8fafe030 2024-09-18T01:47:10.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.341+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb0b990 con 0x7f00480a9040 2024-09-18T01:47:10.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.342+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94676374834496] v33'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f004c00f610 con 0x561b8fafe030 2024-09-18T01:47:10.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.342+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v33'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f004c00f610 con 0x7f00480a9040 2024-09-18T01:47:10.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.342+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94676374836720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb0da10 con 0x7f00480a9040 2024-09-18T01:47:10.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.342+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb0ea80 con 0x7f00480a9040 2024-09-18T01:47:10.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.343+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94676374836720] v33'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f004c00f610 con 0x7f00480a9040 2024-09-18T01:47:10.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.343+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v33'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f004c00f610 con 0x7f00480a9040 2024-09-18T01:47:10.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.343+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94676374839520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb0e9b0 con 0x7f00480a9040 2024-09-18T01:47:10.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.343+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb0f440 con 0x7f00480a9040 2024-09-18T01:47:10.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.344+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94676374839520] v33'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f004c00f610 con 0x7f00480a9040 2024-09-18T01:47:10.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.345+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v33'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f004c00f610 con 0x7f00480a9040 2024-09-18T01:47:10.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.345+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94676374843152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb0e9b0 con 0x7f00480a9040 2024-09-18T01:47:10.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.345+0000 7f005be0e800 20 add_watcher() i=0 2024-09-18T01:47:10.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.345+0000 7f005be0e800 20 add_watcher() i=1 2024-09-18T01:47:10.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.345+0000 7f005be0e800 20 add_watcher() i=2 2024-09-18T01:47:10.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.345+0000 7f005be0e800 20 add_watcher() i=3 2024-09-18T01:47:10.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.345+0000 7f005be0e800 20 add_watcher() i=4 2024-09-18T01:47:10.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.345+0000 7f005be0e800 20 add_watcher() i=5 2024-09-18T01:47:10.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.345+0000 7f005be0e800 20 add_watcher() i=6 2024-09-18T01:47:10.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.345+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94676374843152] v33'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f004c00f610 con 0x7f00480a9040 2024-09-18T01:47:10.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.346+0000 7f005be0e800 20 add_watcher() i=7 2024-09-18T01:47:10.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.346+0000 7f005be0e800 2 all 8 watchers are set, enabling cache 2024-09-18T01:47:10.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.346+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb12860 con 0x561b8fafe030 2024-09-18T01:47:10.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.346+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f004c00f610 con 0x561b8fafe030 2024-09-18T01:47:10.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.346+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94676374841040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb0fd60 con 0x561b8fafe030 2024-09-18T01:47:10.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.347+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94676374841040] v33'251 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f004c00f610 con 0x561b8fafe030 2024-09-18T01:47:10.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.347+0000 7eff0dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:47:10.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.347+0000 7f005be0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:47:10.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.347+0000 7f005be0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:47:10.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.347+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb12680 con 0x561b8fafe030 2024-09-18T01:47:10.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.348+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'60 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f004c00f610 con 0x561b8fafe030 2024-09-18T01:47:10.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.348+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb1b9f0 con 0x7f00480a9040 2024-09-18T01:47:10.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.349+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f004c00f610 con 0x7f00480a9040 2024-09-18T01:47:10.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.349+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb1be10 con 0x561b8fb04280 2024-09-18T01:47:10.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.350+0000 7f0057d1b640 1 -- 172.21.15.146:0/2958975901 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f005003c030 con 0x561b8fb04280 2024-09-18T01:47:10.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.350+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb1bdf0 con 0x561b8fafe030 2024-09-18T01:47:10.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.351+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'252 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f004c00f610 con 0x561b8fafe030 2024-09-18T01:47:10.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.351+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb1bec0 con 0x7f005003f060 2024-09-18T01:47:10.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.352+0000 7f005751a640 1 -- 172.21.15.146:0/2958975901 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'83 uv57 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0048097070 con 0x7f005003f060 2024-09-18T01:47:10.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.352+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb1c5d0 con 0x561b8fb04280 2024-09-18T01:47:10.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.353+0000 7f0057d1b640 1 -- 172.21.15.146:0/2958975901 <== osd.3 v2:172.21.15.146:6809/4106661138 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'68 uv50 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f005003c030 con 0x561b8fb04280 2024-09-18T01:47:10.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.353+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb1c660 con 0x561b8fafe030 2024-09-18T01:47:10.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.354+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f004c00f610 con 0x561b8fafe030 2024-09-18T01:47:10.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.354+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb1c6f0 con 0x7f00480a9040 2024-09-18T01:47:10.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.355+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'57 uv40 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f004c00f610 con 0x7f00480a9040 2024-09-18T01:47:10.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.355+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb1c6f0 con 0x7f005003f060 2024-09-18T01:47:10.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.356+0000 7f005751a640 1 -- 172.21.15.146:0/2958975901 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0048097070 con 0x7f005003f060 2024-09-18T01:47:10.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.356+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb1c780 con 0x561b8fb04280 2024-09-18T01:47:10.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.357+0000 7f0057d1b640 1 -- 172.21.15.146:0/2958975901 <== osd.3 v2:172.21.15.146:6809/4106661138 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f005003c030 con 0x561b8fb04280 2024-09-18T01:47:10.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.357+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb1c810 con 0x7f005003f060 2024-09-18T01:47:10.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.358+0000 7f005751a640 1 -- 172.21.15.146:0/2958975901 <== osd.2 v2:172.21.15.146:6800/3820039304 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'84 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0048097070 con 0x7f005003f060 2024-09-18T01:47:10.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.358+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb1ce60 con 0x7f00480a9040 2024-09-18T01:47:10.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.359+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'35 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f004c00f610 con 0x7f00480a9040 2024-09-18T01:47:10.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.359+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb1ce60 con 0x7f005003f060 2024-09-18T01:47:10.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.360+0000 7f005751a640 1 -- 172.21.15.146:0/2958975901 <== osd.2 v2:172.21.15.146:6800/3820039304 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0048097070 con 0x7f005003f060 2024-09-18T01:47:10.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.360+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb1ce60 con 0x7f00480a9040 2024-09-18T01:47:10.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.362+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'69 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f004c00f610 con 0x7f00480a9040 2024-09-18T01:47:10.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.362+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb1ce60 con 0x561b8fafe030 2024-09-18T01:47:10.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.363+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'253 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f004c00f610 con 0x561b8fafe030 2024-09-18T01:47:10.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.363+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb1ce60 con 0x561b8fb04280 2024-09-18T01:47:10.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.364+0000 7f0057d1b640 1 -- 172.21.15.146:0/2958975901 <== osd.3 v2:172.21.15.146:6809/4106661138 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'78 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f005003c030 con 0x561b8fb04280 2024-09-18T01:47:10.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.364+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb1cef0 con 0x7f005003f060 2024-09-18T01:47:10.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.365+0000 7f005751a640 1 -- 172.21.15.146:0/2958975901 <== osd.2 v2:172.21.15.146:6800/3820039304 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'85 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0048097070 con 0x7f005003f060 2024-09-18T01:47:10.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.365+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb1cf80 con 0x561b8fb04280 2024-09-18T01:47:10.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.366+0000 7f0057d1b640 1 -- 172.21.15.146:0/2958975901 <== osd.3 v2:172.21.15.146:6809/4106661138 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'42 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f005003c030 con 0x561b8fb04280 2024-09-18T01:47:10.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.366+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb1d010 con 0x561b8fafe030 2024-09-18T01:47:10.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.367+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f004c00f610 con 0x561b8fafe030 2024-09-18T01:47:10.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.367+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb1d010 con 0x561b8fafe030 2024-09-18T01:47:10.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.368+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'254 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f004c00f610 con 0x561b8fafe030 2024-09-18T01:47:10.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.368+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb1d010 con 0x561b8fb04280 2024-09-18T01:47:10.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.369+0000 7f0057d1b640 1 -- 172.21.15.146:0/2958975901 <== osd.3 v2:172.21.15.146:6809/4106661138 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'79 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f005003c030 con 0x561b8fb04280 2024-09-18T01:47:10.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.369+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb1d010 con 0x7f005003f060 2024-09-18T01:47:10.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.370+0000 7f005751a640 1 -- 172.21.15.146:0/2958975901 <== osd.2 v2:172.21.15.146:6800/3820039304 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'45 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0048097070 con 0x7f005003f060 2024-09-18T01:47:10.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.370+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb1d010 con 0x561b8fb04280 2024-09-18T01:47:10.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.371+0000 7f0057d1b640 1 -- 172.21.15.146:0/2958975901 <== osd.3 v2:172.21.15.146:6809/4106661138 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f005003c030 con 0x561b8fb04280 2024-09-18T01:47:10.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.371+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb1d010 con 0x561b8fb04280 2024-09-18T01:47:10.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.372+0000 7f0057d1b640 1 -- 172.21.15.146:0/2958975901 <== osd.3 v2:172.21.15.146:6809/4106661138 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'47 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f005003c030 con 0x561b8fb04280 2024-09-18T01:47:10.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.372+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb1d010 con 0x561b8fb04280 2024-09-18T01:47:10.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.373+0000 7f0057d1b640 1 -- 172.21.15.146:0/2958975901 <== osd.3 v2:172.21.15.146:6809/4106661138 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f005003c030 con 0x561b8fb04280 2024-09-18T01:47:10.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.373+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb1d010 con 0x561b8fb04280 2024-09-18T01:47:10.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.374+0000 7f0057d1b640 1 -- 172.21.15.146:0/2958975901 <== osd.3 v2:172.21.15.146:6809/4106661138 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'69 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f005003c030 con 0x561b8fb04280 2024-09-18T01:47:10.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.374+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb1d010 con 0x7f00480a9040 2024-09-18T01:47:10.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.375+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'39 uv30 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f004c00f610 con 0x7f00480a9040 2024-09-18T01:47:10.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.375+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb1d010 con 0x561b8fb04280 2024-09-18T01:47:10.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.376+0000 7f0057d1b640 1 -- 172.21.15.146:0/2958975901 <== osd.3 v2:172.21.15.146:6809/4106661138 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'42 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f005003c030 con 0x561b8fb04280 2024-09-18T01:47:10.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.376+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb1d010 con 0x7f00480a9040 2024-09-18T01:47:10.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.377+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.0 v2:172.21.15.129:6800/1759265424 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'58 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f004c00f610 con 0x7f00480a9040 2024-09-18T01:47:10.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.377+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb1d010 con 0x561b8fb04280 2024-09-18T01:47:10.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.378+0000 7f0057d1b640 1 -- 172.21.15.146:0/2958975901 <== osd.3 v2:172.21.15.146:6809/4106661138 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'80 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f005003c030 con 0x561b8fb04280 2024-09-18T01:47:10.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.378+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb1d010 con 0x7f00480a9040 2024-09-18T01:47:10.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.379+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.0 v2:172.21.15.129:6800/1759265424 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'70 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f004c00f610 con 0x7f00480a9040 2024-09-18T01:47:10.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.379+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb1d030 con 0x7f005003f060 2024-09-18T01:47:10.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.380+0000 7f005751a640 1 -- 172.21.15.146:0/2958975901 <== osd.2 v2:172.21.15.146:6800/3820039304 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0048097070 con 0x7f005003f060 2024-09-18T01:47:10.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.380+0000 7eff0cfe1640 20 reqs_thread_entry: start 2024-09-18T01:47:10.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.380+0000 7f005be0e800 20 init_complete bucket index max shards: 11 2024-09-18T01:47:10.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.380+0000 7f005be0e800 20 Filter name: none 2024-09-18T01:47:10.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.380+0000 7efe867fc640 20 reqs_thread_entry: start 2024-09-18T01:47:10.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.380+0000 7f005be0e800 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-09-18T01:47:10.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.380+0000 7f005be0e800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.380+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:94 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb48070 con 0x7f00480a9040 2024-09-18T01:47:10.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.381+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.0 v2:172.21.15.129:6800/1759265424 24 ==== osd_op_reply(94 system_user [call out=48b,read 0~349 out=349b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 239+0+472 (crc 0 0 0) 0x7f004c00f610 con 0x7f00480a9040 2024-09-18T01:47:10.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.381+0000 7f005be0e800 20 rados_obj.operate() r=0 bl.length=349 2024-09-18T01:47:10.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.381+0000 7f005be0e800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x13 2024-09-18T01:47:10.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.381+0000 7f005be0e800 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-18T01:47:10.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.381+0000 7f005be0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:47:10.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.381+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:95 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb4a930 con 0x7f00480a9040 2024-09-18T01:47:10.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.381+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.0 v2:172.21.15.129:6800/1759265424 25 ==== osd_op_reply(95 system_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7f004c00f610 con 0x7f00480a9040 2024-09-18T01:47:10.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.381+0000 7f005be0e800 10 removing key index: system_akey 2024-09-18T01:47:10.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.381+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:96 8.0 8:01223cbf:users.keys::system_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb48060 con 0x561b8fb04280 2024-09-18T01:47:10.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.382+0000 7f0057d1b640 1 -- 172.21.15.146:0/2958975901 <== osd.3 v2:172.21.15.146:6809/4106661138 26 ==== osd_op_reply(96 system_akey [delete] v33'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f005003c030 con 0x561b8fb04280 2024-09-18T01:47:10.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.382+0000 7f005be0e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-09-18T01:47:10.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.382+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [notify cookie 94676375082144 in=173b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb4afe0 con 0x561b8fafe030 2024-09-18T01:47:10.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.382+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.1 v2:172.21.15.146:6808/3930274777 28 ==== watch-notify(notify (1) cookie 94676374823696 notify 141733920795 ret 0) ==== 203+0+0 (crc 0 0 0) 0x561b8fb1c490 con 0x561b8fafe030 2024-09-18T01:47:10.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.382+0000 7eff3affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920795 cookie 94676374823696 notifier 4859 bl.length()=161 2024-09-18T01:47:10.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.382+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.1 v2:172.21.15.146:6808/3930274777 29 ==== osd_op_reply(97 notify.1 [notify cookie 94676375082144 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f004c00f610 con 0x561b8fafe030 2024-09-18T01:47:10.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.383+0000 7eff3affd640 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7eff1c003d60 con 0x561b8fafe030 2024-09-18T01:47:10.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.383+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.1 v2:172.21.15.146:6808/3930274777 30 ==== osd_op_reply(98 notify.1 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f004c00f610 con 0x561b8fafe030 2024-09-18T01:47:10.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.383+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.1 v2:172.21.15.146:6808/3930274777 31 ==== watch-notify(notify_complete (2) cookie 94676375082144 notify 141733920795 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561b8fb12640 con 0x561b8fafe030 2024-09-18T01:47:10.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.383+0000 7f005be0e800 10 removing email index: 2024-09-18T01:47:10.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.383+0000 7f005be0e800 10 removing user buckets index 2024-09-18T01:47:10.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.383+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:99 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb4aee0 con 0x7f00480a9040 2024-09-18T01:47:10.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.384+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.0 v2:172.21.15.129:6800/1759265424 26 ==== osd_op_reply(99 system_user.buckets [delete] v33'2 uv1 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7f004c00f610 con 0x7f00480a9040 2024-09-18T01:47:10.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.384+0000 7f005be0e800 10 removing user index: system_user 2024-09-18T01:47:10.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.384+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:100 8.1e 8:78ce4db0:users.uid::system_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb4ade0 con 0x7f00480a9040 2024-09-18T01:47:10.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.385+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.0 v2:172.21.15.129:6800/1759265424 27 ==== osd_op_reply(100 system_user [call,call,delete] v33'3 uv3 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f004c00f610 con 0x7f00480a9040 2024-09-18T01:47:10.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.385+0000 7f005be0e800 10 removing default.rgw.meta+users.uid+system_user from cache 2024-09-18T01:47:10.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.385+0000 7f005be0e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-09-18T01:47:10.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.385+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94676375087232 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb49420 con 0x7f005003f060 2024-09-18T01:47:10.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.385+0000 7f005751a640 1 -- 172.21.15.146:0/2958975901 <== osd.2 v2:172.21.15.146:6800/3820039304 19 ==== watch-notify(notify (1) cookie 94676374817968 notify 141733920802 ret 0) ==== 202+0+0 (crc 0 0 0) 0x561b8fb1b9f0 con 0x7f005003f060 2024-09-18T01:47:10.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.385+0000 7eff3affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920802 cookie 94676374817968 notifier 4859 bl.length()=160 2024-09-18T01:47:10.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.385+0000 7f005751a640 1 -- 172.21.15.146:0/2958975901 <== osd.2 v2:172.21.15.146:6800/3820039304 20 ==== osd_op_reply(101 notify.0 [notify cookie 94676375087232 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0048097070 con 0x7f005003f060 2024-09-18T01:47:10.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.385+0000 7eff3affd640 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7eff1c003d60 con 0x7f005003f060 2024-09-18T01:47:10.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.386+0000 7f005751a640 1 -- 172.21.15.146:0/2958975901 <== osd.2 v2:172.21.15.146:6800/3820039304 21 ==== osd_op_reply(102 notify.0 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0048097070 con 0x7f005003f060 2024-09-18T01:47:10.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.386+0000 7f005751a640 1 -- 172.21.15.146:0/2958975901 <== osd.2 v2:172.21.15.146:6800/3820039304 22 ==== watch-notify(notify_complete (2) cookie 94676375087232 notify 141733920802 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561b8fb12810 con 0x7f005003f060 2024-09-18T01:47:10.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.387+0000 7eff0dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:47:10.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.387+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94676374841040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb1aa30 con 0x561b8fafe030 2024-09-18T01:47:10.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.388+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.1 v2:172.21.15.146:6808/3930274777 32 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94676374841040] v33'255 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f004c00f610 con 0x561b8fafe030 2024-09-18T01:47:10.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.388+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94676374817968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb0e6a0 con 0x7f005003f060 2024-09-18T01:47:10.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.388+0000 7f005751a640 1 -- 172.21.15.146:0/2958975901 <== osd.2 v2:172.21.15.146:6800/3820039304 23 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94676374817968] v33'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0048097070 con 0x7f005003f060 2024-09-18T01:47:10.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.389+0000 7f005be0e800 20 remove_watcher() i=0 2024-09-18T01:47:10.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.389+0000 7f005be0e800 2 removed watcher, disabling cache 2024-09-18T01:47:10.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.389+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94676374823696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb08cb0 con 0x561b8fafe030 2024-09-18T01:47:10.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.390+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.1 v2:172.21.15.146:6808/3930274777 33 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94676374823696] v33'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f004c00f610 con 0x561b8fafe030 2024-09-18T01:47:10.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.390+0000 7f005be0e800 20 remove_watcher() i=1 2024-09-18T01:47:10.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.390+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94676374824752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb08cb0 con 0x561b8fb04280 2024-09-18T01:47:10.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.391+0000 7f0057d1b640 1 -- 172.21.15.146:0/2958975901 <== osd.3 v2:172.21.15.146:6809/4106661138 27 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94676374824752] v33'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f005003c030 con 0x561b8fb04280 2024-09-18T01:47:10.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.391+0000 7f005be0e800 20 remove_watcher() i=2 2024-09-18T01:47:10.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.391+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94676374831024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb08cb0 con 0x7f005003f060 2024-09-18T01:47:10.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.392+0000 7f005751a640 1 -- 172.21.15.146:0/2958975901 <== osd.2 v2:172.21.15.146:6800/3820039304 24 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94676374831024] v33'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0048097070 con 0x7f005003f060 2024-09-18T01:47:10.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.392+0000 7f005be0e800 20 remove_watcher() i=3 2024-09-18T01:47:10.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.392+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94676374834496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb08cb0 con 0x561b8fafe030 2024-09-18T01:47:10.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.393+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.1 v2:172.21.15.146:6808/3930274777 34 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94676374834496] v33'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f004c00f610 con 0x561b8fafe030 2024-09-18T01:47:10.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.393+0000 7f005be0e800 20 remove_watcher() i=4 2024-09-18T01:47:10.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.393+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94676374836720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb08cb0 con 0x7f00480a9040 2024-09-18T01:47:10.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.394+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.0 v2:172.21.15.129:6800/1759265424 28 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94676374836720] v33'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f004c00f610 con 0x7f00480a9040 2024-09-18T01:47:10.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.394+0000 7f005be0e800 20 remove_watcher() i=5 2024-09-18T01:47:10.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.394+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94676374839520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb0d5f0 con 0x7f00480a9040 2024-09-18T01:47:10.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.395+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.0 v2:172.21.15.129:6800/1759265424 29 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94676374839520] v33'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f004c00f610 con 0x7f00480a9040 2024-09-18T01:47:10.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.395+0000 7f005be0e800 20 remove_watcher() i=6 2024-09-18T01:47:10.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.395+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94676374843152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561b8fb08cb0 con 0x7f00480a9040 2024-09-18T01:47:10.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.396+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 <== osd.0 v2:172.21.15.129:6800/1759265424 30 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94676374843152] v33'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f004c00f610 con 0x7f00480a9040 2024-09-18T01:47:10.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.396+0000 7f005be0e800 20 remove_watcher() i=7 2024-09-18T01:47:10.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.396+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f00480a9040 msgr2=0x7f004806f900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.396+0000 7f005be0e800 1 --2- 172.21.15.146:0/2958975901 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f00480a9040 0x7f004806f900 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.396+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x561b8fafe030 msgr2=0x561b8fb004f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.396+0000 7f005be0e800 1 --2- 172.21.15.146:0/2958975901 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x561b8fafe030 0x561b8fb004f0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.396+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f005003f060 msgr2=0x7f005002b600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.396+0000 7f005be0e800 1 --2- 172.21.15.146:0/2958975901 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f005003f060 0x7f005002b600 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.396+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x561b8fb04280 msgr2=0x561b8fb066b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.396+0000 7f005be0e800 1 --2- 172.21.15.146:0/2958975901 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x561b8fb04280 0x561b8fb066b0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.396+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7eff20036aa0 msgr2=0x7eff20038f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.396+0000 7f005be0e800 1 --2- 172.21.15.146:0/2958975901 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7eff20036aa0 0x7eff20038f60 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0048005a60 tx=0x7f0048087000 comp rx=0 tx=0).stop 2024-09-18T01:47:10.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.396+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561b8faeae10 msgr2=0x561b8faf2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.396+0000 7f0056d19640 1 -- 172.21.15.146:0/2958975901 reap_dead start 2024-09-18T01:47:10.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.396+0000 7f005be0e800 1 --2- 172.21.15.146:0/2958975901 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561b8faeae10 0x561b8faf2310 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f0050001df0 tx=0x7f005004c820 comp rx=0 tx=0).stop 2024-09-18T01:47:10.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.396+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 shutdown_connections 2024-09-18T01:47:10.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.396+0000 7f005be0e800 1 --2- 172.21.15.146:0/2958975901 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561b8faeae10 0x561b8faf2310 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.396+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 >> 172.21.15.146:0/2958975901 conn(0x561b8fae71c0 msgr2=0x561b8fae5290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:10.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.396+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 shutdown_connections 2024-09-18T01:47:10.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.396+0000 7f005be0e800 1 -- 172.21.15.146:0/2958975901 wait complete. 2024-09-18T01:47:10.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.397+0000 7f005be0e800 1 -- 172.21.15.146:0/1399701325 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7eff30036b90 msgr2=0x7eff30039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.397+0000 7f005be0e800 1 --2- 172.21.15.146:0/1399701325 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7eff30036b90 0x7eff30039050 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f00480505a0 tx=0x7f0048064c80 comp rx=0 tx=0).stop 2024-09-18T01:47:10.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.397+0000 7f005be0e800 1 -- 172.21.15.146:0/1399701325 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561b8fade200 msgr2=0x561b8fade620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.397+0000 7f005be0e800 1 --2- 172.21.15.146:0/1399701325 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561b8fade200 0x561b8fade620 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x561b8facae80 tx=0x7f00500178e0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.397+0000 7f005be0e800 1 -- 172.21.15.146:0/1399701325 shutdown_connections 2024-09-18T01:47:10.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.397+0000 7f005be0e800 1 --2- 172.21.15.146:0/1399701325 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7eff30036b90 0x7eff30039050 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.397+0000 7f005be0e800 1 --2- 172.21.15.146:0/1399701325 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561b8fade200 0x561b8fade620 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.397+0000 7f005be0e800 1 -- 172.21.15.146:0/1399701325 >> 172.21.15.146:0/1399701325 conn(0x561b8fad3190 msgr2=0x561b8fad5d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:10.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.397+0000 7f005be0e800 1 -- 172.21.15.146:0/1399701325 shutdown_connections 2024-09-18T01:47:10.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.397+0000 7f005be0e800 1 -- 172.21.15.146:0/1399701325 wait complete. 2024-09-18T01:47:10.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.397+0000 7f005be0e800 1 -- 172.21.15.146:0/3371402314 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x561b8f9cfbd0 msgr2=0x561b8faca410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.397+0000 7f005be0e800 1 --2- 172.21.15.146:0/3371402314 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x561b8f9cfbd0 0x561b8faca410 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.397+0000 7f005be0e800 1 -- 172.21.15.146:0/3371402314 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x561b8facc480 msgr2=0x561b8facfce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.397+0000 7f005be0e800 1 --2- 172.21.15.146:0/3371402314 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x561b8facc480 0x561b8facfce0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.397+0000 7f005be0e800 1 -- 172.21.15.146:0/3371402314 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7eff3c036b90 msgr2=0x7eff3c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.397+0000 7f005be0e800 1 --2- 172.21.15.146:0/3371402314 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7eff3c036b90 0x7eff3c039050 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f004c000f60 tx=0x7f004c001370 comp rx=0 tx=0).stop 2024-09-18T01:47:10.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.397+0000 7f005be0e800 1 -- 172.21.15.146:0/3371402314 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561b8f93e5f0 msgr2=0x561b8fac3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.397+0000 7f005be0e800 1 --2- 172.21.15.146:0/3371402314 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561b8f93e5f0 0x561b8fac3340 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f0048067040 tx=0x7f0048002fb0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.397+0000 7f005be0e800 1 -- 172.21.15.146:0/3371402314 shutdown_connections 2024-09-18T01:47:10.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.397+0000 7f005be0e800 1 --2- 172.21.15.146:0/3371402314 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x561b8facc480 0x561b8facfce0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.397+0000 7f005be0e800 1 --2- 172.21.15.146:0/3371402314 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x561b8f9cfbd0 0x561b8faca410 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.397+0000 7f005be0e800 1 --2- 172.21.15.146:0/3371402314 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7eff3c036b90 0x7eff3c039050 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.397+0000 7f005be0e800 1 --2- 172.21.15.146:0/3371402314 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x561b8f93e5f0 0x561b8fac3340 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.397+0000 7f005be0e800 1 -- 172.21.15.146:0/3371402314 >> 172.21.15.146:0/3371402314 conn(0x561b8f9c4de0 msgr2=0x561b8fab5ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:10.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.397+0000 7f005be0e800 1 -- 172.21.15.146:0/3371402314 shutdown_connections 2024-09-18T01:47:10.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.397+0000 7f005be0e800 1 -- 172.21.15.146:0/3371402314 wait complete. 2024-09-18T01:47:10.406 ERROR:root:None 2024-09-18T01:47:10.407 ERROR:root:0 2024-09-18T01:47:10.407 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-09-18T01:47:10.407 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-09-18T01:47:10.407 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid a_user --display-name 'True Admin User' --access-key true_admin_akey --secret true_admin_skey --caps user-info-without-keys=read --admin 2024-09-18T01:47:10.461 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:47:10.461 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:47:10.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.461+0000 7f5bf0810800 1 Processor -- start 2024-09-18T01:47:10.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.461+0000 7f5bf0810800 1 -- start start 2024-09-18T01:47:10.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.461+0000 7f5bf0810800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55715e533510 0x55715e533910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.461+0000 7f5bf0810800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55715e3f3b30 con 0x55715e533e50 2024-09-18T01:47:10.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.461+0000 7f5bf0810800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x55715e3d5360 con 0x55715e533510 2024-09-18T01:47:10.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.461+0000 7f5bebfc6640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55715e533510 0x55715e533910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.461+0000 7f5bebfc6640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55715e533510 0x55715e533910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37482/0 (socket says 172.21.15.146:37482) 2024-09-18T01:47:10.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.461+0000 7f5bebfc6640 1 -- 172.21.15.146:0/2635247479 learned_addr learned my addr 172.21.15.146:0/2635247479 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:10.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.462+0000 7f5bebfc6640 1 -- 172.21.15.146:0/2635247479 >> v1:172.21.15.129:6789/0 conn(0x55715e533e50 legacy=0x55715e5389d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.462+0000 7f5beafc4640 1 -- 172.21.15.146:0/2635247479 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4293026621 0 0) 0x55715e3f3b30 con 0x55715e533e50 2024-09-18T01:47:10.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.462+0000 7f5bebfc6640 1 -- 172.21.15.146:0/2635247479 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55715e3fbe00 con 0x55715e533510 2024-09-18T01:47:10.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.463+0000 7f5bebfc6640 1 --2- 172.21.15.146:0/2635247479 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55715e533510 0x55715e533910 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc00a520 tx=0x7f5bdc045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30d303e317fcfdff server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.463+0000 7f5beafc4640 1 -- 172.21.15.146:0/2635247479 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bdc055070 con 0x55715e533510 2024-09-18T01:47:10.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.463+0000 7f5beafc4640 1 -- 172.21.15.146:0/2635247479 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bdc0515b0 con 0x55715e533510 2024-09-18T01:47:10.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.463+0000 7f5beafc4640 1 -- 172.21.15.146:0/2635247479 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bdc0518d0 con 0x55715e533510 2024-09-18T01:47:10.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.464+0000 7f5bf0810800 1 -- 172.21.15.146:0/2635247479 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55715e533510 msgr2=0x55715e533910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.464+0000 7f5bf0810800 1 --2- 172.21.15.146:0/2635247479 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55715e533510 0x55715e533910 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc00a520 tx=0x7f5bdc045ba0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.464+0000 7f5bf0810800 1 -- 172.21.15.146:0/2635247479 shutdown_connections 2024-09-18T01:47:10.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.464+0000 7f5bf0810800 1 --2- 172.21.15.146:0/2635247479 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55715e533510 0x55715e533910 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.464+0000 7f5bf0810800 1 -- 172.21.15.146:0/2635247479 >> 172.21.15.146:0/2635247479 conn(0x55715e52ede0 msgr2=0x55715e531200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:10.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.464+0000 7f5bf0810800 1 -- 172.21.15.146:0/2635247479 shutdown_connections 2024-09-18T01:47:10.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.464+0000 7f5bf0810800 1 -- 172.21.15.146:0/2635247479 wait complete. 2024-09-18T01:47:10.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.478+0000 7f5bf0810800 1 Processor -- start 2024-09-18T01:47:10.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.478+0000 7f5bf0810800 1 -- start start 2024-09-18T01:47:10.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.478+0000 7f5bf0810800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55715e533510 0x55715e6236d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.478+0000 7f5bf0810800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55715e480450 con 0x55715e533510 2024-09-18T01:47:10.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.478+0000 7f5bebfc6640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55715e533510 0x55715e6236d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.479+0000 7f5bebfc6640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55715e533510 0x55715e6236d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37494/0 (socket says 172.21.15.146:37494) 2024-09-18T01:47:10.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.479+0000 7f5bebfc6640 1 -- 172.21.15.146:0/786365987 learned_addr learned my addr 172.21.15.146:0/786365987 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:10.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.479+0000 7f5bebfc6640 1 -- 172.21.15.146:0/786365987 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55715e3cdbc0 con 0x55715e533510 2024-09-18T01:47:10.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.479+0000 7f5bebfc6640 1 --2- 172.21.15.146:0/786365987 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55715e533510 0x55715e6236d0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc025da0 tx=0x7f5bdc051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2833f850b717a54e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.479+0000 7f5ad9e0b640 1 -- 172.21.15.146:0/786365987 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bdc051ac0 con 0x55715e533510 2024-09-18T01:47:10.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.479+0000 7f5ad9e0b640 1 -- 172.21.15.146:0/786365987 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bdc051c60 con 0x55715e533510 2024-09-18T01:47:10.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.479+0000 7f5ad9e0b640 1 -- 172.21.15.146:0/786365987 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bdc066460 con 0x55715e533510 2024-09-18T01:47:10.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.480+0000 7f5bf0810800 1 -- 172.21.15.146:0/786365987 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55715e533510 msgr2=0x55715e6236d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.480+0000 7f5bf0810800 1 --2- 172.21.15.146:0/786365987 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55715e533510 0x55715e6236d0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc025da0 tx=0x7f5bdc051000 comp rx=0 tx=0).stop 2024-09-18T01:47:10.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.480+0000 7f5bf0810800 1 -- 172.21.15.146:0/786365987 shutdown_connections 2024-09-18T01:47:10.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.480+0000 7f5bf0810800 1 --2- 172.21.15.146:0/786365987 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55715e533510 0x55715e6236d0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.480+0000 7f5bf0810800 1 -- 172.21.15.146:0/786365987 >> 172.21.15.146:0/786365987 conn(0x55715e52ede0 msgr2=0x55715e621b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:10.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.480+0000 7f5bf0810800 1 -- 172.21.15.146:0/786365987 shutdown_connections 2024-09-18T01:47:10.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.480+0000 7f5bf0810800 1 -- 172.21.15.146:0/786365987 wait complete. 2024-09-18T01:47:10.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.480+0000 7f5bf0810800 1 Processor -- start 2024-09-18T01:47:10.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.480+0000 7f5bf0810800 1 -- start start 2024-09-18T01:47:10.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.480+0000 7f5bf0810800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55715e533510 0x55715e62b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.480+0000 7f5bf0810800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55715e53a530 con 0x55715e533510 2024-09-18T01:47:10.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.481+0000 7f5bebfc6640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55715e533510 0x55715e62b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.481+0000 7f5bebfc6640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55715e533510 0x55715e62b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37502/0 (socket says 172.21.15.146:37502) 2024-09-18T01:47:10.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.481+0000 7f5bebfc6640 1 -- 172.21.15.146:0/2464196951 learned_addr learned my addr 172.21.15.146:0/2464196951 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:10.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.481+0000 7f5bebfc6640 1 -- 172.21.15.146:0/2464196951 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55715e3e1fe0 con 0x55715e533510 2024-09-18T01:47:10.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.481+0000 7f5bebfc6640 1 --2- 172.21.15.146:0/2464196951 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55715e533510 0x55715e62b030 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc0460a0 tx=0x7f5bdc003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.481+0000 7f5ad3fff640 1 -- 172.21.15.146:0/2464196951 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bdc066650 con 0x55715e533510 2024-09-18T01:47:10.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.481+0000 7f5ad3fff640 1 -- 172.21.15.146:0/2464196951 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bdc066810 con 0x55715e533510 2024-09-18T01:47:10.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.481+0000 7f5bf0810800 1 -- 172.21.15.146:0/2464196951 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55715e62b570 con 0x55715e533510 2024-09-18T01:47:10.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.481+0000 7f5ad3fff640 1 -- 172.21.15.146:0/2464196951 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bdc066b30 con 0x55715e533510 2024-09-18T01:47:10.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.481+0000 7f5bf0810800 1 -- 172.21.15.146:0/2464196951 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55715e62ba90 con 0x55715e533510 2024-09-18T01:47:10.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.482+0000 7f5ad3fff640 1 -- 172.21.15.146:0/2464196951 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5bdc079060 con 0x55715e533510 2024-09-18T01:47:10.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.482+0000 7f5ad3fff640 1 --2- 172.21.15.146:0/2464196951 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f5ad4036b90 0x7f5ad4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.482+0000 7f5ad3fff640 1 -- 172.21.15.146:0/2464196951 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f5bdc062070 con 0x55715e533510 2024-09-18T01:47:10.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.482+0000 7f5beb7c5640 1 --2- 172.21.15.146:0/2464196951 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f5ad4036b90 0x7f5ad4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.482+0000 7f5bf0810800 1 --2- 172.21.15.146:0/2464196951 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55715e533e50 0x55715e6320a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.482+0000 7f5bf0810800 1 -- 172.21.15.146:0/2464196951 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55715e632670 con 0x55715e533e50 2024-09-18T01:47:10.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.482+0000 7f5bec7c7640 1 --2- 172.21.15.146:0/2464196951 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55715e533e50 0x55715e6320a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.483+0000 7f5beb7c5640 1 --2- 172.21.15.146:0/2464196951 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f5ad4036b90 0x7f5ad4039050 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5be0000f60 tx=0x7f5be00013f0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.483+0000 7f5bec7c7640 1 --2- 172.21.15.146:0/2464196951 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55715e533e50 0x55715e6320a0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.483+0000 7f5bec7c7640 1 -- 172.21.15.146:0/2464196951 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5be400a4a0 con 0x55715e533e50 2024-09-18T01:47:10.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.483+0000 7f5bf0810800 1 -- 172.21.15.146:0/2464196951 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55715e62f630 con 0x55715e533e50 2024-09-18T01:47:10.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.483+0000 7f5bec7c7640 1 -- 172.21.15.146:0/2464196951 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5be400a4a0 con 0x55715e533e50 2024-09-18T01:47:10.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.483+0000 7f5bf0810800 1 -- 172.21.15.146:0/2464196951 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55715e634490 con 0x55715e533e50 2024-09-18T01:47:10.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.484+0000 7f5bec7c7640 1 -- 172.21.15.146:0/2464196951 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5be400a4a0 con 0x55715e533e50 2024-09-18T01:47:10.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.484+0000 7f5bf0810800 1 -- 172.21.15.146:0/2464196951 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55715e6335d0 con 0x55715e533e50 2024-09-18T01:47:10.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.484+0000 7f5bec7c7640 1 -- 172.21.15.146:0/2464196951 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5be400a4a0 con 0x55715e533e50 2024-09-18T01:47:10.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.484+0000 7f5bf0810800 1 --2- 172.21.15.146:0/2464196951 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55715e6340a0 0x55715e6378d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.484+0000 7f5bf0810800 1 -- 172.21.15.146:0/2464196951 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55715e638060 con 0x55715e6340a0 2024-09-18T01:47:10.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.484+0000 7f5bebfc6640 1 --2- 172.21.15.146:0/2464196951 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55715e6340a0 0x55715e6378d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.484+0000 7f5bebfc6640 1 --2- 172.21.15.146:0/2464196951 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55715e6340a0 0x55715e6378d0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.485+0000 7f5bebfc6640 1 -- 172.21.15.146:0/2464196951 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5bdc057030 con 0x55715e6340a0 2024-09-18T01:47:10.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.485+0000 7f5bf0810800 1 Processor -- start 2024-09-18T01:47:10.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.485+0000 7f5bf0810800 1 -- start start 2024-09-18T01:47:10.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.485+0000 7f5bf0810800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55715e645df0 0x55715e646210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.485+0000 7f5bf0810800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55715e3cf580 con 0x55715e645df0 2024-09-18T01:47:10.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.485+0000 7f5bec7c7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55715e645df0 0x55715e646210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.485+0000 7f5bec7c7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55715e645df0 0x55715e646210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37504/0 (socket says 172.21.15.146:37504) 2024-09-18T01:47:10.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.485+0000 7f5bec7c7640 1 -- 172.21.15.146:0/3915155290 learned_addr learned my addr 172.21.15.146:0/3915155290 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:10.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.486+0000 7f5bec7c7640 1 -- 172.21.15.146:0/3915155290 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55715e646750 con 0x55715e645df0 2024-09-18T01:47:10.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.486+0000 7f5bec7c7640 1 --2- 172.21.15.146:0/3915155290 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55715e645df0 0x55715e646210 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x55715e632a70 tx=0x7f5be40178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.486+0000 7f5ad17fa640 1 -- 172.21.15.146:0/3915155290 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5be4013440 con 0x55715e645df0 2024-09-18T01:47:10.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.486+0000 7f5ad17fa640 1 -- 172.21.15.146:0/3915155290 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5be40135e0 con 0x55715e645df0 2024-09-18T01:47:10.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.486+0000 7f5ad17fa640 1 -- 172.21.15.146:0/3915155290 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5be40138c0 con 0x55715e645df0 2024-09-18T01:47:10.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.486+0000 7f5bf0810800 1 -- 172.21.15.146:0/3915155290 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55715e6469e0 con 0x55715e645df0 2024-09-18T01:47:10.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.486+0000 7f5bf0810800 1 -- 172.21.15.146:0/3915155290 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55715e6496c0 con 0x55715e645df0 2024-09-18T01:47:10.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.487+0000 7f5ad17fa640 1 -- 172.21.15.146:0/3915155290 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5be4011040 con 0x55715e645df0 2024-09-18T01:47:10.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.487+0000 7f5ad17fa640 1 --2- 172.21.15.146:0/3915155290 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f5ac4036b90 0x7f5ac4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.487+0000 7f5ad17fa640 1 -- 172.21.15.146:0/3915155290 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f5be401d070 con 0x55715e645df0 2024-09-18T01:47:10.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.487+0000 7f5bebfc6640 1 --2- 172.21.15.146:0/3915155290 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f5ac4036b90 0x7f5ac4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.487+0000 7f5bf0810800 1 Processor -- start 2024-09-18T01:47:10.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.487+0000 7f5bf0810800 1 -- start start 2024-09-18T01:47:10.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.487+0000 7f5bebfc6640 1 --2- 172.21.15.146:0/3915155290 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f5ac4036b90 0x7f5ac4039050 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc08e700 tx=0x7f5bdc08e5d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.487+0000 7f5bf0810800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55715e652a70 0x55715e652e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.487+0000 7f5bf0810800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55715e623dc0 con 0x55715e652a70 2024-09-18T01:47:10.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.488+0000 7f5bec7c7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55715e652a70 0x55715e652e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.488+0000 7f5bec7c7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55715e652a70 0x55715e652e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37512/0 (socket says 172.21.15.146:37512) 2024-09-18T01:47:10.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.488+0000 7f5bec7c7640 1 -- 172.21.15.146:0/1740335394 learned_addr learned my addr 172.21.15.146:0/1740335394 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:10.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.488+0000 7f5bec7c7640 1 -- 172.21.15.146:0/1740335394 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55715e653440 con 0x55715e652a70 2024-09-18T01:47:10.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.488+0000 7f5bec7c7640 1 --2- 172.21.15.146:0/1740335394 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55715e652a70 0x55715e652e70 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f5be404c890 tx=0x7f5be404c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72efa32ad9c5e992 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.488+0000 7f5acaffd640 1 -- 172.21.15.146:0/1740335394 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5be4045070 con 0x55715e652a70 2024-09-18T01:47:10.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.488+0000 7f5acaffd640 1 -- 172.21.15.146:0/1740335394 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5be4012df0 con 0x55715e652a70 2024-09-18T01:47:10.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.488+0000 7f5acaffd640 1 -- 172.21.15.146:0/1740335394 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5be4021b80 con 0x55715e652a70 2024-09-18T01:47:10.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.489+0000 7f5bf0810800 1 -- 172.21.15.146:0/1740335394 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55715e652a70 msgr2=0x55715e652e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.489+0000 7f5bf0810800 1 --2- 172.21.15.146:0/1740335394 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55715e652a70 0x55715e652e70 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f5be404c890 tx=0x7f5be404c9d0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.489+0000 7f5bf0810800 1 -- 172.21.15.146:0/1740335394 shutdown_connections 2024-09-18T01:47:10.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.489+0000 7f5bf0810800 1 --2- 172.21.15.146:0/1740335394 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55715e652a70 0x55715e652e70 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.489+0000 7f5bf0810800 1 -- 172.21.15.146:0/1740335394 >> 172.21.15.146:0/1740335394 conn(0x55715e64edd0 msgr2=0x55715e64ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:10.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.489+0000 7f5bf0810800 1 -- 172.21.15.146:0/1740335394 shutdown_connections 2024-09-18T01:47:10.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.489+0000 7f5bf0810800 1 -- 172.21.15.146:0/1740335394 wait complete. 2024-09-18T01:47:10.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.489+0000 7f5bf0810800 1 Processor -- start 2024-09-18T01:47:10.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.489+0000 7f5bf0810800 1 -- start start 2024-09-18T01:47:10.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.489+0000 7f5bf0810800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55715e652a70 0x55715e659ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.489+0000 7f5bf0810800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55715e653ab0 con 0x55715e652a70 2024-09-18T01:47:10.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.489+0000 7f5bec7c7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55715e652a70 0x55715e659ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.489+0000 7f5bec7c7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55715e652a70 0x55715e659ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37524/0 (socket says 172.21.15.146:37524) 2024-09-18T01:47:10.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.489+0000 7f5bec7c7640 1 -- 172.21.15.146:0/2862087801 learned_addr learned my addr 172.21.15.146:0/2862087801 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:10.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.490+0000 7f5bec7c7640 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55715e65a420 con 0x55715e652a70 2024-09-18T01:47:10.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.490+0000 7f5bec7c7640 1 --2- 172.21.15.146:0/2862087801 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55715e652a70 0x55715e659ee0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f5be404ca10 tx=0x7f5be404c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.490+0000 7f5ac97fa640 1 -- 172.21.15.146:0/2862087801 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5be403a070 con 0x55715e652a70 2024-09-18T01:47:10.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.490+0000 7f5ac97fa640 1 -- 172.21.15.146:0/2862087801 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5be4001540 con 0x55715e652a70 2024-09-18T01:47:10.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.490+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55715e65a6b0 con 0x55715e652a70 2024-09-18T01:47:10.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.490+0000 7f5ac97fa640 1 -- 172.21.15.146:0/2862087801 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5be4045040 con 0x55715e652a70 2024-09-18T01:47:10.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.490+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55715e65d360 con 0x55715e652a70 2024-09-18T01:47:10.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.491+0000 7f5ac97fa640 1 -- 172.21.15.146:0/2862087801 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5be403d070 con 0x55715e652a70 2024-09-18T01:47:10.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.491+0000 7f5ac97fa640 1 --2- 172.21.15.146:0/2862087801 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f5ab4036af0 0x7f5ab4038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.491+0000 7f5ac97fa640 1 -- 172.21.15.146:0/2862087801 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f5be400e040 con 0x55715e652a70 2024-09-18T01:47:10.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.491+0000 7f5bebfc6640 1 --2- 172.21.15.146:0/2862087801 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f5ab4036af0 0x7f5ab4038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.491+0000 7f5bebfc6640 1 --2- 172.21.15.146:0/2862087801 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f5ab4036af0 0x7f5ab4038fb0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc051830 tx=0x7f5bdc08a000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.492+0000 7f5bf0810800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.492+0000 7f5bf0810800 1 --2- 172.21.15.146:0/2862087801 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55715e665ba0 0x55715e668060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.492+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55715e6687b0 con 0x55715e665ba0 2024-09-18T01:47:10.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.492+0000 7f5beb7c5640 1 --2- 172.21.15.146:0/2862087801 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55715e665ba0 0x55715e668060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.492+0000 7f5beb7c5640 1 --2- 172.21.15.146:0/2862087801 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55715e665ba0 0x55715e668060 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.492+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5be0010510 con 0x55715e665ba0 2024-09-18T01:47:10.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.492+0000 7f5bf0810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:10.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.492+0000 7f5bf0810800 20 realm 2024-09-18T01:47:10.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.492+0000 7f5bf0810800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.492+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55715e664ff0 con 0x55715e665ba0 2024-09-18T01:47:10.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.493+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5be0010510 con 0x55715e665ba0 2024-09-18T01:47:10.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.493+0000 7f5bf0810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:10.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.493+0000 7f5bf0810800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:47:10.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.493+0000 7f5bf0810800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.493+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55715e6692a0 con 0x55715e665ba0 2024-09-18T01:47:10.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.493+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5be0010510 con 0x55715e665ba0 2024-09-18T01:47:10.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.493+0000 7f5bf0810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:10.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.493+0000 7f5bf0810800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.493+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55715e669b70 con 0x55715e665ba0 2024-09-18T01:47:10.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.493+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5be0010510 con 0x55715e665ba0 2024-09-18T01:47:10.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.493+0000 7f5bf0810800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:47:10.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.493+0000 7f5bf0810800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.493+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55715e669f10 con 0x55715e665ba0 2024-09-18T01:47:10.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.493+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5be0010510 con 0x55715e665ba0 2024-09-18T01:47:10.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.493+0000 7f5bf0810800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:47:10.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.493+0000 7f5bf0810800 20 searching for the correct realm 2024-09-18T01:47:10.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.493+0000 7f5bf0810800 1 --2- 172.21.15.146:0/2862087801 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55715e66bdf0 0x55715e66e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.493+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55715e66e8f0 con 0x55715e66bdf0 2024-09-18T01:47:10.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.494+0000 7f5bec7c7640 1 --2- 172.21.15.146:0/2862087801 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55715e66bdf0 0x55715e66e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.494+0000 7f5bec7c7640 1 --2- 172.21.15.146:0/2862087801 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55715e66bdf0 0x55715e66e220 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.494+0000 7f5bec7c7640 1 -- 172.21.15.146:0/2862087801 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5be403c030 con 0x55715e66bdf0 2024-09-18T01:47:10.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.494+0000 7f5bec7c7640 1 --2- 172.21.15.146:0/2862087801 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f5be403f060 0x7f5be4013a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.494+0000 7f5bec7c7640 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55715e66e8f0 con 0x7f5be403f060 2024-09-18T01:47:10.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.494+0000 7f5bebfc6640 1 --2- 172.21.15.146:0/2862087801 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f5be403f060 0x7f5be4013a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.494+0000 7f5bebfc6640 1 --2- 172.21.15.146:0/2862087801 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f5be403f060 0x7f5be4013a60 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.495+0000 7f5bebfc6640 1 -- 172.21.15.146:0/2862087801 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bdc057030 con 0x7f5be403f060 2024-09-18T01:47:10.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.495+0000 7f5bebfc6640 1 --2- 172.21.15.146:0/2862087801 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f5bdc09d040 0x7f5bdc050860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.495+0000 7f5bebfc6640 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55715e66e8f0 con 0x7f5bdc09d040 2024-09-18T01:47:10.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.495+0000 7f5beb7c5640 1 --2- 172.21.15.146:0/2862087801 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f5bdc09d040 0x7f5bdc050860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.495+0000 7f5beb7c5640 1 --2- 172.21.15.146:0/2862087801 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f5bdc09d040 0x7f5bdc050860 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.495+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5be0010510 con 0x7f5bdc09d040 2024-09-18T01:47:10.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.495+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55715e66e8f0 con 0x55715e665ba0 2024-09-18T01:47:10.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.496+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v33'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5be0010510 con 0x55715e665ba0 2024-09-18T01:47:10.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.496+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55715e66e8f0 con 0x55715e665ba0 2024-09-18T01:47:10.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.496+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5be002b040 con 0x55715e665ba0 2024-09-18T01:47:10.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.496+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55715e66e8f0 con 0x7f5bdc09d040 2024-09-18T01:47:10.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.496+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5be002b040 con 0x7f5bdc09d040 2024-09-18T01:47:10.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.496+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55715e66e8f0 con 0x7f5bdc09d040 2024-09-18T01:47:10.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.496+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5be002b040 con 0x7f5bdc09d040 2024-09-18T01:47:10.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.496+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55715e66e8f0 con 0x7f5be403f060 2024-09-18T01:47:10.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.497+0000 7f5bebfc6640 1 -- 172.21.15.146:0/2862087801 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bdc057030 con 0x7f5be403f060 2024-09-18T01:47:10.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.497+0000 7f5bebfc6640 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55715e66e8f0 con 0x55715e66bdf0 2024-09-18T01:47:10.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.497+0000 7f5bec7c7640 1 -- 172.21.15.146:0/2862087801 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5be403c030 con 0x55715e66bdf0 2024-09-18T01:47:10.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.497+0000 7f5bec7c7640 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55715e66e8f0 con 0x55715e665ba0 2024-09-18T01:47:10.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.497+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5be002b040 con 0x55715e665ba0 2024-09-18T01:47:10.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.497+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55715e66e8f0 con 0x7f5bdc09d040 2024-09-18T01:47:10.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.497+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5be002b040 con 0x7f5bdc09d040 2024-09-18T01:47:10.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.497+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55715e66e8f0 con 0x55715e665ba0 2024-09-18T01:47:10.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.498+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5be002b040 con 0x55715e665ba0 2024-09-18T01:47:10.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.498+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55715e66e8f0 con 0x7f5be403f060 2024-09-18T01:47:10.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.498+0000 7f5bebfc6640 1 -- 172.21.15.146:0/2862087801 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f5bdc057030 con 0x7f5be403f060 2024-09-18T01:47:10.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.498+0000 7f5bebfc6640 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55715e66e8f0 con 0x55715e66bdf0 2024-09-18T01:47:10.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.498+0000 7f5bec7c7640 1 -- 172.21.15.146:0/2862087801 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5be403c030 con 0x55715e66bdf0 2024-09-18T01:47:10.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.498+0000 7f5bec7c7640 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55715e66e8f0 con 0x55715e66bdf0 2024-09-18T01:47:10.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.498+0000 7f5bec7c7640 1 -- 172.21.15.146:0/2862087801 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5be403c030 con 0x55715e66bdf0 2024-09-18T01:47:10.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.498+0000 7f5bec7c7640 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55715e66e8f0 con 0x7f5bdc09d040 2024-09-18T01:47:10.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.499+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5be002b040 con 0x7f5bdc09d040 2024-09-18T01:47:10.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.499+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55715e66e8f0 con 0x55715e66bdf0 2024-09-18T01:47:10.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.499+0000 7f5bec7c7640 1 -- 172.21.15.146:0/2862087801 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5be403c030 con 0x55715e66bdf0 2024-09-18T01:47:10.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.499+0000 7f5bec7c7640 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55715e66e8f0 con 0x55715e66bdf0 2024-09-18T01:47:10.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.499+0000 7f5bec7c7640 1 -- 172.21.15.146:0/2862087801 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5be403c030 con 0x55715e66bdf0 2024-09-18T01:47:10.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.499+0000 7f5bec7c7640 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55715e66e8f0 con 0x55715e665ba0 2024-09-18T01:47:10.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.499+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5be002b040 con 0x55715e665ba0 2024-09-18T01:47:10.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.499+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55715e66e8f0 con 0x55715e665ba0 2024-09-18T01:47:10.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.499+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v33'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5be002b040 con 0x55715e665ba0 2024-09-18T01:47:10.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.499+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55715e66e8f0 con 0x7f5bdc09d040 2024-09-18T01:47:10.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.500+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5be002b040 con 0x7f5bdc09d040 2024-09-18T01:47:10.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.500+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55715e66e8f0 con 0x55715e66bdf0 2024-09-18T01:47:10.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.500+0000 7f5bec7c7640 1 -- 172.21.15.146:0/2862087801 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5be403c030 con 0x55715e66bdf0 2024-09-18T01:47:10.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.500+0000 7f5bec7c7640 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55715e66e8f0 con 0x7f5be403f060 2024-09-18T01:47:10.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.500+0000 7f5bebfc6640 1 -- 172.21.15.146:0/2862087801 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bdc057030 con 0x7f5be403f060 2024-09-18T01:47:10.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.500+0000 7f5bebfc6640 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55715e66e8f0 con 0x55715e665ba0 2024-09-18T01:47:10.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.500+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5be002b040 con 0x55715e665ba0 2024-09-18T01:47:10.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.500+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55715e66e8f0 con 0x7f5bdc09d040 2024-09-18T01:47:10.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.501+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5be003b040 con 0x7f5bdc09d040 2024-09-18T01:47:10.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.501+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55715e66e8f0 con 0x55715e66bdf0 2024-09-18T01:47:10.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.501+0000 7f5bec7c7640 1 -- 172.21.15.146:0/2862087801 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5be403c030 con 0x55715e66bdf0 2024-09-18T01:47:10.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.501+0000 7f5bec7c7640 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55715e66e8f0 con 0x7f5bdc09d040 2024-09-18T01:47:10.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.501+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5be003b040 con 0x7f5bdc09d040 2024-09-18T01:47:10.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.501+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55715e66e8f0 con 0x7f5be403f060 2024-09-18T01:47:10.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.501+0000 7f5bebfc6640 1 -- 172.21.15.146:0/2862087801 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bdc057030 con 0x7f5be403f060 2024-09-18T01:47:10.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.501+0000 7f5bebfc6640 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55715e66e8f0 con 0x55715e66bdf0 2024-09-18T01:47:10.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.502+0000 7f5bec7c7640 1 -- 172.21.15.146:0/2862087801 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5be403c030 con 0x55715e66bdf0 2024-09-18T01:47:10.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.502+0000 7f5bec7c7640 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55715e66e8f0 con 0x7f5bdc09d040 2024-09-18T01:47:10.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.502+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5be003b040 con 0x7f5bdc09d040 2024-09-18T01:47:10.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.502+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55715e66e8f0 con 0x55715e665ba0 2024-09-18T01:47:10.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.502+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v33'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5be003b040 con 0x55715e665ba0 2024-09-18T01:47:10.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.502+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55715e66e8f0 con 0x7f5be403f060 2024-09-18T01:47:10.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.502+0000 7f5bebfc6640 1 -- 172.21.15.146:0/2862087801 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bdc057030 con 0x7f5be403f060 2024-09-18T01:47:10.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.502+0000 7f5bf0810800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:47:10.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.502+0000 7f5bf0810800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:47:10.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.502+0000 7f5bf0810800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:47:10.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.502+0000 7f5bf0810800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:47:10.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.502+0000 7f5bf0810800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:47:10.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.502+0000 7f5bf0810800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:47:10.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.502+0000 7f5bf0810800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.503+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55715e66a8c0 con 0x55715e665ba0 2024-09-18T01:47:10.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.503+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5be003b040 con 0x55715e665ba0 2024-09-18T01:47:10.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.503+0000 7f5bf0810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:10.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.503+0000 7f5bf0810800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.503+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55715e66b160 con 0x55715e665ba0 2024-09-18T01:47:10.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.503+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5be003b040 con 0x55715e665ba0 2024-09-18T01:47:10.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.503+0000 7f5bf0810800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:47:10.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.503+0000 7f5bf0810800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.503+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55715e66b160 con 0x7f5be403f060 2024-09-18T01:47:10.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.503+0000 7f5bebfc6640 1 -- 172.21.15.146:0/2862087801 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5bdc057030 con 0x7f5be403f060 2024-09-18T01:47:10.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.503+0000 7f5bf0810800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:47:10.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.503+0000 7f5bf0810800 20 zone default found 2024-09-18T01:47:10.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.503+0000 7f5bf0810800 4 Realm: () 2024-09-18T01:47:10.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.503+0000 7f5bf0810800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:47:10.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.503+0000 7f5bf0810800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:47:10.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.503+0000 7f5bf0810800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:47:10.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.503+0000 7f5bf0810800 20 zonegroup default 2024-09-18T01:47:10.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.503+0000 7f5bf0810800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.503+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55715e66f220 con 0x7f5bdc09d040 2024-09-18T01:47:10.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.504+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5be003b040 con 0x7f5bdc09d040 2024-09-18T01:47:10.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.504+0000 7f5bf0810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:10.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.504+0000 7f5bf0810800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.504+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55715e670c30 con 0x55715e66bdf0 2024-09-18T01:47:10.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.504+0000 7f5bec7c7640 1 -- 172.21.15.146:0/2862087801 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5be403c030 con 0x55715e66bdf0 2024-09-18T01:47:10.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.504+0000 7f5bf0810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:10.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.504+0000 7f5bf0810800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.504+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55715e671130 con 0x55715e66bdf0 2024-09-18T01:47:10.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.504+0000 7f5bec7c7640 1 -- 172.21.15.146:0/2862087801 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5be403c030 con 0x55715e66bdf0 2024-09-18T01:47:10.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.504+0000 7f5bf0810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:10.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.504+0000 7f5bf0810800 20 started sync module instance, tier type = 2024-09-18T01:47:10.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.504+0000 7f5bf0810800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:47:10.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.504+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55715e670090 con 0x7f5be403f060 2024-09-18T01:47:10.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.505+0000 7f5bebfc6640 1 -- 172.21.15.146:0/2862087801 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v33'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bdc057030 con 0x7f5be403f060 2024-09-18T01:47:10.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.505+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93945403475072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55715e66fcf0 con 0x7f5be403f060 2024-09-18T01:47:10.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.505+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55715e672060 con 0x55715e665ba0 2024-09-18T01:47:10.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.506+0000 7f5bebfc6640 1 -- 172.21.15.146:0/2862087801 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93945403475072] v33'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bdc057030 con 0x7f5be403f060 2024-09-18T01:47:10.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.506+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v33'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5be003b040 con 0x55715e665ba0 2024-09-18T01:47:10.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.506+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93945403481008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55715e672480 con 0x55715e665ba0 2024-09-18T01:47:10.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.506+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55715e672e40 con 0x55715e66bdf0 2024-09-18T01:47:10.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.507+0000 7f5bec7c7640 1 -- 172.21.15.146:0/2862087801 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v33'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5be403c030 con 0x55715e66bdf0 2024-09-18T01:47:10.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.507+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93945403484560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55715e6736e0 con 0x55715e66bdf0 2024-09-18T01:47:10.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.507+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55715e6741e0 con 0x7f5be403f060 2024-09-18T01:47:10.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.508+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93945403481008] v33'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5be003b040 con 0x55715e665ba0 2024-09-18T01:47:10.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.508+0000 7f5bec7c7640 1 -- 172.21.15.146:0/2862087801 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93945403484560] v33'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5be403c030 con 0x55715e66bdf0 2024-09-18T01:47:10.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.509+0000 7f5bebfc6640 1 -- 172.21.15.146:0/2862087801 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v33'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bdc057030 con 0x7f5be403f060 2024-09-18T01:47:10.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.509+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93945403482064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55715e6736e0 con 0x7f5be403f060 2024-09-18T01:47:10.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.509+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55715e674a80 con 0x55715e665ba0 2024-09-18T01:47:10.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.510+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v33'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5be003b040 con 0x55715e665ba0 2024-09-18T01:47:10.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.510+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93945403492304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55715e675350 con 0x55715e665ba0 2024-09-18T01:47:10.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.510+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55715e675df0 con 0x7f5bdc09d040 2024-09-18T01:47:10.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.510+0000 7f5bebfc6640 1 -- 172.21.15.146:0/2862087801 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93945403482064] v33'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bdc057030 con 0x7f5be403f060 2024-09-18T01:47:10.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.511+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v33'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5be003b040 con 0x7f5bdc09d040 2024-09-18T01:47:10.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.511+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93945403496672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55715e675db0 con 0x7f5bdc09d040 2024-09-18T01:47:10.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.511+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93945403492304] v33'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5be003b040 con 0x55715e665ba0 2024-09-18T01:47:10.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.511+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55715e676600 con 0x7f5bdc09d040 2024-09-18T01:47:10.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.512+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93945403496672] v33'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5be003b040 con 0x7f5bdc09d040 2024-09-18T01:47:10.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.512+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v33'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5be003b040 con 0x7f5bdc09d040 2024-09-18T01:47:10.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.512+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93945403486768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55715e676260 con 0x7f5bdc09d040 2024-09-18T01:47:10.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.512+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55715e676c60 con 0x7f5bdc09d040 2024-09-18T01:47:10.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.513+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93945403486768] v33'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5be003b040 con 0x7f5bdc09d040 2024-09-18T01:47:10.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.514+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v33'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5be003b040 con 0x7f5bdc09d040 2024-09-18T01:47:10.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.515+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93945403497904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55715e676c20 con 0x7f5bdc09d040 2024-09-18T01:47:10.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.515+0000 7f5bf0810800 20 add_watcher() i=0 2024-09-18T01:47:10.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.515+0000 7f5bf0810800 20 add_watcher() i=1 2024-09-18T01:47:10.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.515+0000 7f5bf0810800 20 add_watcher() i=2 2024-09-18T01:47:10.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.515+0000 7f5bf0810800 20 add_watcher() i=3 2024-09-18T01:47:10.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.515+0000 7f5bf0810800 20 add_watcher() i=4 2024-09-18T01:47:10.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.515+0000 7f5bf0810800 20 add_watcher() i=5 2024-09-18T01:47:10.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.515+0000 7f5bf0810800 20 add_watcher() i=6 2024-09-18T01:47:10.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.515+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93945403497904] v33'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5be003b040 con 0x7f5bdc09d040 2024-09-18T01:47:10.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.516+0000 7f5bf0810800 20 add_watcher() i=7 2024-09-18T01:47:10.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.516+0000 7f5bf0810800 2 all 8 watchers are set, enabling cache 2024-09-18T01:47:10.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.516+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55715e67a080 con 0x55715e665ba0 2024-09-18T01:47:10.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.516+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5be003b040 con 0x55715e665ba0 2024-09-18T01:47:10.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.516+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93945403500864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55715e677570 con 0x55715e665ba0 2024-09-18T01:47:10.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.517+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93945403500864] v33'256 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5be003b040 con 0x55715e665ba0 2024-09-18T01:47:10.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.517+0000 7f5aa1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:47:10.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.517+0000 7f5bf0810800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:47:10.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.517+0000 7f5bf0810800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:47:10.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.517+0000 7f5bf0810800 5 note: GC not initialized 2024-09-18T01:47:10.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.518+0000 7f5aa0fe1640 20 reqs_thread_entry: start 2024-09-18T01:47:10.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.518+0000 7f5bf0810800 20 init_complete bucket index max shards: 11 2024-09-18T01:47:10.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.518+0000 7f5bf0810800 20 Filter name: none 2024-09-18T01:47:10.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.518+0000 7f5a1a7fc640 20 reqs_thread_entry: start 2024-09-18T01:47:10.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.518+0000 7f5bf0810800 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-09-18T01:47:10.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.518+0000 7f5bf0810800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.518+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:62 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55715e6ad520 con 0x55715e66bdf0 2024-09-18T01:47:10.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.518+0000 7f5bec7c7640 1 -- 172.21.15.146:0/2862087801 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(62 a_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 234+0+0 (crc 0 0 0) 0x7f5be403c030 con 0x55715e66bdf0 2024-09-18T01:47:10.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.518+0000 7f5bf0810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:10.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.518+0000 7f5bf0810800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x0 2024-09-18T01:47:10.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.518+0000 7f5bf0810800 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-18T01:47:10.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.518+0000 7f5bf0810800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : miss 2024-09-18T01:47:10.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.518+0000 7f5bf0810800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.518+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:63 8.15 8:afe09604:users.keys::true_admin_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55715e6abb60 con 0x55715e66bdf0 2024-09-18T01:47:10.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.519+0000 7f5bec7c7640 1 -- 172.21.15.146:0/2862087801 <== osd.3 v2:172.21.15.146:6809/4106661138 15 ==== osd_op_reply(63 true_admin_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 201+0+0 (crc 0 0 0) 0x7f5be403c030 con 0x55715e66bdf0 2024-09-18T01:47:10.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.519+0000 7f5bf0810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:10.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.519+0000 7f5bf0810800 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x0 2024-09-18T01:47:10.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.519+0000 7f5bf0810800 10 adding default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-18T01:47:10.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.519+0000 7f5bf0810800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-09-18T01:47:10.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.519+0000 7f5bf0810800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-09-18T01:47:10.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.519+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:64 8.14 8:2efb937b:users.uid::a_user:head [delete,create,call version.set in=58b,writefull 0~363 in=363b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55715e6ac400 con 0x55715e66bdf0 2024-09-18T01:47:10.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.520+0000 7f5bec7c7640 1 -- 172.21.15.146:0/2862087801 <== osd.3 v2:172.21.15.146:6809/4106661138 16 ==== osd_op_reply(64 a_user [delete,create,call,writefull 0~363] v33'1 uv1 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7f5be403c030 con 0x55715e66bdf0 2024-09-18T01:47:10.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.520+0000 7f5bf0810800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-09-18T01:47:10.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.520+0000 7f5bf0810800 10 moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-18T01:47:10.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.520+0000 7f5bf0810800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-09-18T01:47:10.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.520+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:65 7.15 7:a93a5511:::notify.2:head [notify cookie 93945403719504 in=554b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55715e6b0b10 con 0x55715e66bdf0 2024-09-18T01:47:10.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.520+0000 7f5bec7c7640 1 -- 172.21.15.146:0/2862087801 <== osd.3 v2:172.21.15.146:6809/4106661138 17 ==== watch-notify(notify (1) cookie 93945403484560 notify 141733920777 ret 0) ==== 584+0+0 (crc 0 0 0) 0x55715e6acf70 con 0x55715e66bdf0 2024-09-18T01:47:10.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.520+0000 7f5acaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920777 cookie 93945403484560 notifier 4866 bl.length()=542 2024-09-18T01:47:10.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.520+0000 7f5acaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-09-18T01:47:10.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.520+0000 7f5acaffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-18T01:47:10.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.520+0000 7f5acaffd640 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f5ab0003ea0 con 0x55715e66bdf0 2024-09-18T01:47:10.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.520+0000 7f5bec7c7640 1 -- 172.21.15.146:0/2862087801 <== osd.3 v2:172.21.15.146:6809/4106661138 18 ==== osd_op_reply(65 notify.2 [notify cookie 93945403719504 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5be403c030 con 0x55715e66bdf0 2024-09-18T01:47:10.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.520+0000 7f5bec7c7640 1 -- 172.21.15.146:0/2862087801 <== osd.3 v2:172.21.15.146:6809/4106661138 19 ==== osd_op_reply(66 notify.2 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5be403c030 con 0x55715e66bdf0 2024-09-18T01:47:10.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.520+0000 7f5bec7c7640 1 -- 172.21.15.146:0/2862087801 <== osd.3 v2:172.21.15.146:6809/4106661138 20 ==== watch-notify(notify_complete (2) cookie 93945403719504 notify 141733920777 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55715e65a6b0 con 0x55715e66bdf0 2024-09-18T01:47:10.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.520+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:67 8.15 8:afe09604:users.keys::true_admin_akey:head [delete,create,writefull 0~10 in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55715e6abf00 con 0x55715e66bdf0 2024-09-18T01:47:10.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.521+0000 7f5bec7c7640 1 -- 172.21.15.146:0/2862087801 <== osd.3 v2:172.21.15.146:6809/4106661138 21 ==== osd_op_reply(67 true_admin_akey [delete,create,writefull 0~10] v33'3 uv3 ondisk = 0) ==== 243+0+0 (crc 0 0 0) 0x7f5be403c030 con 0x55715e66bdf0 2024-09-18T01:47:10.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.521+0000 7f5bf0810800 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-09-18T01:47:10.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.521+0000 7f5bf0810800 10 moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-18T01:47:10.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.521+0000 7f5bf0810800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-09-18T01:47:10.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.521+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 93945403719424 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55715e6b0f40 con 0x7f5bdc09d040 2024-09-18T01:47:10.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.522+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== watch-notify(notify (1) cookie 93945403496672 notify 141733920812 ret 0) ==== 217+0+0 (crc 0 0 0) 0x7f5be00036d0 con 0x7f5bdc09d040 2024-09-18T01:47:10.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.522+0000 7f5aca7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920812 cookie 93945403496672 notifier 4866 bl.length()=175 2024-09-18T01:47:10.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.522+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(68 notify.5 [notify cookie 93945403719424 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5be003b040 con 0x7f5bdc09d040 2024-09-18T01:47:10.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.522+0000 7f5aca7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-09-18T01:47:10.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.522+0000 7f5aca7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-18T01:47:10.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.522+0000 7f5aca7fc640 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f5a20003400 con 0x7f5bdc09d040 2024-09-18T01:47:10.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.522+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5be003b040 con 0x7f5bdc09d040 2024-09-18T01:47:10.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.522+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== watch-notify(notify_complete (2) cookie 93945403719424 notify 141733920812 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f5be0003970 con 0x7f5bdc09d040 2024-09-18T01:47:10.542 INFO:teuthology.orchestra.run.smithi146.stdout:{"user_id":"a_user","display_name":"True Admin User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"a_user","access_key":"true_admin_akey","secret_key":"true_admin_skey","active":true,"create_date":"2024-09-18T01:47:10.519533Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","admin":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:47:10.519517Z","tags":[],"group_ids":[]} 2024-09-18T01:47:10.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.523+0000 7f5aa1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:47:10.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.523+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93945403500864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55715e6ab240 con 0x55715e665ba0 2024-09-18T01:47:10.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.524+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93945403500864] v33'257 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5be003b040 con 0x55715e665ba0 2024-09-18T01:47:10.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.524+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93945403475072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55715e6ac520 con 0x7f5be403f060 2024-09-18T01:47:10.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.525+0000 7f5bebfc6640 1 -- 172.21.15.146:0/2862087801 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93945403475072] v33'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bdc057030 con 0x7f5be403f060 2024-09-18T01:47:10.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.525+0000 7f5bf0810800 20 remove_watcher() i=0 2024-09-18T01:47:10.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.525+0000 7f5bf0810800 2 removed watcher, disabling cache 2024-09-18T01:47:10.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.525+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93945403481008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55715e6ab240 con 0x55715e665ba0 2024-09-18T01:47:10.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.526+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93945403481008] v33'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5be003b040 con 0x55715e665ba0 2024-09-18T01:47:10.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.526+0000 7f5bf0810800 20 remove_watcher() i=1 2024-09-18T01:47:10.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.526+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93945403484560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55715e6ab240 con 0x55715e66bdf0 2024-09-18T01:47:10.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.527+0000 7f5bec7c7640 1 -- 172.21.15.146:0/2862087801 <== osd.3 v2:172.21.15.146:6809/4106661138 22 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93945403484560] v33'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5be403c030 con 0x55715e66bdf0 2024-09-18T01:47:10.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.527+0000 7f5bf0810800 20 remove_watcher() i=2 2024-09-18T01:47:10.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.527+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93945403482064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55715e6ab240 con 0x7f5be403f060 2024-09-18T01:47:10.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.528+0000 7f5bebfc6640 1 -- 172.21.15.146:0/2862087801 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93945403482064] v33'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bdc057030 con 0x7f5be403f060 2024-09-18T01:47:10.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.528+0000 7f5bf0810800 20 remove_watcher() i=3 2024-09-18T01:47:10.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.528+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93945403492304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55715e6ab240 con 0x55715e665ba0 2024-09-18T01:47:10.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.529+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93945403492304] v33'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5be003b040 con 0x55715e665ba0 2024-09-18T01:47:10.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.529+0000 7f5bf0810800 20 remove_watcher() i=4 2024-09-18T01:47:10.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.529+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93945403496672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55715e6ab240 con 0x7f5bdc09d040 2024-09-18T01:47:10.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.530+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93945403496672] v33'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5be003b040 con 0x7f5bdc09d040 2024-09-18T01:47:10.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.530+0000 7f5bf0810800 20 remove_watcher() i=5 2024-09-18T01:47:10.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.530+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93945403486768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55715e6ab240 con 0x7f5bdc09d040 2024-09-18T01:47:10.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.531+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 <== osd.0 v2:172.21.15.129:6800/1759265424 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93945403486768] v33'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5be003b040 con 0x7f5bdc09d040 2024-09-18T01:47:10.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.531+0000 7f5bf0810800 20 remove_watcher() i=6 2024-09-18T01:47:10.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.531+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93945403497904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55715e6ab240 con 0x7f5bdc09d040 2024-09-18T01:47:10.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.532+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 <== osd.0 v2:172.21.15.129:6800/1759265424 23 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93945403497904] v33'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5be003b040 con 0x7f5bdc09d040 2024-09-18T01:47:10.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.532+0000 7f5bf0810800 20 remove_watcher() i=7 2024-09-18T01:47:10.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.533+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f5bdc09d040 msgr2=0x7f5bdc050860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.533+0000 7f5bf0810800 1 --2- 172.21.15.146:0/2862087801 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f5bdc09d040 0x7f5bdc050860 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.533+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55715e665ba0 msgr2=0x55715e668060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.533+0000 7f5bf0810800 1 --2- 172.21.15.146:0/2862087801 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55715e665ba0 0x55715e668060 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.533+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f5be403f060 msgr2=0x7f5be4013a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.533+0000 7f5bf0810800 1 --2- 172.21.15.146:0/2862087801 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f5be403f060 0x7f5be4013a60 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.533+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55715e66bdf0 msgr2=0x55715e66e220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.533+0000 7f5bf0810800 1 --2- 172.21.15.146:0/2862087801 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55715e66bdf0 0x55715e66e220 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.533+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f5ab4036af0 msgr2=0x7f5ab4038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.533+0000 7f5bf0810800 1 --2- 172.21.15.146:0/2862087801 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f5ab4036af0 0x7f5ab4038fb0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc051830 tx=0x7f5bdc08a000 comp rx=0 tx=0).stop 2024-09-18T01:47:10.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.533+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55715e652a70 msgr2=0x55715e659ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.533+0000 7f5beb7c5640 1 -- 172.21.15.146:0/2862087801 reap_dead start 2024-09-18T01:47:10.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.533+0000 7f5bf0810800 1 --2- 172.21.15.146:0/2862087801 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55715e652a70 0x55715e659ee0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f5be404ca10 tx=0x7f5be404c820 comp rx=0 tx=0).stop 2024-09-18T01:47:10.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.533+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 shutdown_connections 2024-09-18T01:47:10.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.533+0000 7f5bf0810800 1 --2- 172.21.15.146:0/2862087801 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55715e652a70 0x55715e659ee0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.533+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 >> 172.21.15.146:0/2862087801 conn(0x55715e64edd0 msgr2=0x55715e64cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:10.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.533+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 shutdown_connections 2024-09-18T01:47:10.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.533+0000 7f5bf0810800 1 -- 172.21.15.146:0/2862087801 wait complete. 2024-09-18T01:47:10.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.533+0000 7f5bf0810800 1 -- 172.21.15.146:0/3915155290 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f5ac4036b90 msgr2=0x7f5ac4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.533+0000 7f5bf0810800 1 --2- 172.21.15.146:0/3915155290 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f5ac4036b90 0x7f5ac4039050 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc08e700 tx=0x7f5bdc08e5d0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.533+0000 7f5bf0810800 1 -- 172.21.15.146:0/3915155290 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55715e645df0 msgr2=0x55715e646210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.533+0000 7f5bf0810800 1 --2- 172.21.15.146:0/3915155290 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55715e645df0 0x55715e646210 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x55715e632a70 tx=0x7f5be40178e0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.533+0000 7f5bf0810800 1 -- 172.21.15.146:0/3915155290 shutdown_connections 2024-09-18T01:47:10.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.533+0000 7f5bf0810800 1 --2- 172.21.15.146:0/3915155290 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f5ac4036b90 0x7f5ac4039050 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.533+0000 7f5bf0810800 1 --2- 172.21.15.146:0/3915155290 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55715e645df0 0x55715e646210 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.533+0000 7f5bf0810800 1 -- 172.21.15.146:0/3915155290 >> 172.21.15.146:0/3915155290 conn(0x55715e63ad80 msgr2=0x55715e63d900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:10.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.533+0000 7f5bf0810800 1 -- 172.21.15.146:0/3915155290 shutdown_connections 2024-09-18T01:47:10.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.533+0000 7f5bf0810800 1 -- 172.21.15.146:0/3915155290 wait complete. 2024-09-18T01:47:10.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.534+0000 7f5bf0810800 1 -- 172.21.15.146:0/2464196951 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55715e533e50 msgr2=0x55715e6320a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.534+0000 7f5bf0810800 1 --2- 172.21.15.146:0/2464196951 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55715e533e50 0x55715e6320a0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.534+0000 7f5bf0810800 1 -- 172.21.15.146:0/2464196951 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55715e6340a0 msgr2=0x55715e6378d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.534+0000 7f5bf0810800 1 --2- 172.21.15.146:0/2464196951 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55715e6340a0 0x55715e6378d0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.534+0000 7f5bf0810800 1 -- 172.21.15.146:0/2464196951 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f5ad4036b90 msgr2=0x7f5ad4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.534+0000 7f5bf0810800 1 --2- 172.21.15.146:0/2464196951 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f5ad4036b90 0x7f5ad4039050 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5be0000f60 tx=0x7f5be00013f0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.534+0000 7f5bf0810800 1 -- 172.21.15.146:0/2464196951 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55715e533510 msgr2=0x55715e62b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.534+0000 7f5bf0810800 1 --2- 172.21.15.146:0/2464196951 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55715e533510 0x55715e62b030 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc0460a0 tx=0x7f5bdc003020 comp rx=0 tx=0).stop 2024-09-18T01:47:10.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.534+0000 7f5bf0810800 1 -- 172.21.15.146:0/2464196951 shutdown_connections 2024-09-18T01:47:10.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.534+0000 7f5bf0810800 1 --2- 172.21.15.146:0/2464196951 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55715e6340a0 0x55715e6378d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.534+0000 7f5bf0810800 1 --2- 172.21.15.146:0/2464196951 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55715e533e50 0x55715e6320a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.534+0000 7f5bf0810800 1 --2- 172.21.15.146:0/2464196951 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f5ad4036b90 0x7f5ad4039050 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.534+0000 7f5bf0810800 1 --2- 172.21.15.146:0/2464196951 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55715e533510 0x55715e62b030 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.534+0000 7f5bf0810800 1 -- 172.21.15.146:0/2464196951 >> 172.21.15.146:0/2464196951 conn(0x55715e52ede0 msgr2=0x55715e621b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:10.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.534+0000 7f5bf0810800 1 -- 172.21.15.146:0/2464196951 shutdown_connections 2024-09-18T01:47:10.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.534+0000 7f5bf0810800 1 -- 172.21.15.146:0/2464196951 wait complete. 2024-09-18T01:47:10.560 DEBUG:tasks.util.rgw: json result: {'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-09-18T01:47:10.519533Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:47:10.519517Z', 'tags': [], 'group_ids': []} 2024-09-18T01:47:10.560 ERROR:root:{'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-09-18T01:47:10.519533Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:47:10.519517Z', 'tags': [], 'group_ids': []} 2024-09-18T01:47:10.560 ERROR:root:0 2024-09-18T01:47:10.561 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-18T01:47:10.565 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T01:47:10.566 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'a_user'] 2024-09-18T01:47:10.566 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'a_user'] 2024-09-18T01:47:10.566 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid a_user 2024-09-18T01:47:10.610 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:47:10.610 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:47:10.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.610+0000 7f9198a13800 1 Processor -- start 2024-09-18T01:47:10.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.610+0000 7f9198a13800 1 -- start start 2024-09-18T01:47:10.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.610+0000 7f9198a13800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x563829cd1900 0x563829cd3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.610+0000 7f9198a13800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563829b8cb30 con 0x563829c40df0 2024-09-18T01:47:10.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.610+0000 7f9198a13800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x563829b6e360 con 0x563829cd1900 2024-09-18T01:47:10.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.611+0000 7f918b943640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x563829cd1900 0x563829cd3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.611+0000 7f9194144640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x563829c40df0 0x563829cd01e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:53104/0 (socket says 172.21.15.146:53104) 2024-09-18T01:47:10.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.611+0000 7f9194144640 1 -- 172.21.15.146:0/1373475042 learned_addr learned my addr 172.21.15.146:0/1373475042 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:47:10.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.611+0000 7f918b943640 1 -- 172.21.15.146:0/1373475042 >> v1:172.21.15.129:6789/0 conn(0x563829c40df0 legacy=0x563829cd01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.611+0000 7f9193943640 1 -- 172.21.15.146:0/1373475042 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4088750376 0 0) 0x563829b8cb30 con 0x563829c40df0 2024-09-18T01:47:10.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.611+0000 7f918b943640 1 -- 172.21.15.146:0/1373475042 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563829b94e00 con 0x563829cd1900 2024-09-18T01:47:10.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.613+0000 7f918b943640 1 --2- 172.21.15.146:0/1373475042 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563829cd1900 0x563829cd3cf0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f917c00a470 tx=0x7f917c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8464744d2c8f589a server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.613+0000 7f9193943640 1 -- 172.21.15.146:0/1373475042 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f917c053570 con 0x563829cd1900 2024-09-18T01:47:10.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.613+0000 7f9193943640 1 -- 172.21.15.146:0/1373475042 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f917c058070 con 0x563829cd1900 2024-09-18T01:47:10.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.613+0000 7f9193943640 1 -- 172.21.15.146:0/1373475042 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f917c053880 con 0x563829cd1900 2024-09-18T01:47:10.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.613+0000 7f9198a13800 1 -- 172.21.15.146:0/1373475042 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563829cd1900 msgr2=0x563829cd3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.613+0000 7f9198a13800 1 --2- 172.21.15.146:0/1373475042 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563829cd1900 0x563829cd3cf0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f917c00a470 tx=0x7f917c045a20 comp rx=0 tx=0).stop 2024-09-18T01:47:10.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.613+0000 7f9198a13800 1 -- 172.21.15.146:0/1373475042 shutdown_connections 2024-09-18T01:47:10.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.613+0000 7f9198a13800 1 --2- 172.21.15.146:0/1373475042 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563829cd1900 0x563829cd3cf0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.613+0000 7f9198a13800 1 -- 172.21.15.146:0/1373475042 >> 172.21.15.146:0/1373475042 conn(0x563829cc7df0 msgr2=0x563829cca210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:10.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.613+0000 7f9198a13800 1 -- 172.21.15.146:0/1373475042 shutdown_connections 2024-09-18T01:47:10.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.613+0000 7f9198a13800 1 -- 172.21.15.146:0/1373475042 wait complete. 2024-09-18T01:47:10.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.627+0000 7f9198a13800 1 Processor -- start 2024-09-18T01:47:10.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.627+0000 7f9198a13800 1 -- start start 2024-09-18T01:47:10.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.627+0000 7f9198a13800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563829c40df0 0x563829ccdb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.627+0000 7f9198a13800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x563829c19330 con 0x563829c40df0 2024-09-18T01:47:10.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.627+0000 7f9194144640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563829c40df0 0x563829ccdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.628+0000 7f9194144640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563829c40df0 0x563829ccdb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37548/0 (socket says 172.21.15.146:37548) 2024-09-18T01:47:10.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.628+0000 7f9194144640 1 -- 172.21.15.146:0/3992644955 learned_addr learned my addr 172.21.15.146:0/3992644955 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:10.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.628+0000 7f9194144640 1 -- 172.21.15.146:0/3992644955 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563829b66bc0 con 0x563829c40df0 2024-09-18T01:47:10.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.628+0000 7f9194144640 1 --2- 172.21.15.146:0/3992644955 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563829c40df0 0x563829ccdb10 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f918400b240 tx=0x7f918400b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86e3cf1190d22577 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.628+0000 7f908260c640 1 -- 172.21.15.146:0/3992644955 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9184008070 con 0x563829c40df0 2024-09-18T01:47:10.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.628+0000 7f908260c640 1 -- 172.21.15.146:0/3992644955 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f918400d500 con 0x563829c40df0 2024-09-18T01:47:10.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.628+0000 7f908260c640 1 -- 172.21.15.146:0/3992644955 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f918400d860 con 0x563829c40df0 2024-09-18T01:47:10.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.629+0000 7f9198a13800 1 -- 172.21.15.146:0/3992644955 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563829c40df0 msgr2=0x563829ccdb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.629+0000 7f9198a13800 1 --2- 172.21.15.146:0/3992644955 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563829c40df0 0x563829ccdb10 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f918400b240 tx=0x7f918400b700 comp rx=0 tx=0).stop 2024-09-18T01:47:10.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.629+0000 7f9198a13800 1 -- 172.21.15.146:0/3992644955 shutdown_connections 2024-09-18T01:47:10.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.629+0000 7f9198a13800 1 --2- 172.21.15.146:0/3992644955 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563829c40df0 0x563829ccdb10 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.629+0000 7f9198a13800 1 -- 172.21.15.146:0/3992644955 >> 172.21.15.146:0/3992644955 conn(0x563829cc7df0 msgr2=0x563829db8010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:10.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.629+0000 7f9198a13800 1 -- 172.21.15.146:0/3992644955 shutdown_connections 2024-09-18T01:47:10.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.629+0000 7f9198a13800 1 -- 172.21.15.146:0/3992644955 wait complete. 2024-09-18T01:47:10.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.629+0000 7f9198a13800 1 Processor -- start 2024-09-18T01:47:10.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.629+0000 7f9198a13800 1 -- start start 2024-09-18T01:47:10.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.629+0000 7f9198a13800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563829c40df0 0x563829dc6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.629+0000 7f9198a13800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x563829cd45f0 con 0x563829c40df0 2024-09-18T01:47:10.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.629+0000 7f9194144640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563829c40df0 0x563829dc6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.629+0000 7f9194144640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563829c40df0 0x563829dc6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37550/0 (socket says 172.21.15.146:37550) 2024-09-18T01:47:10.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.630+0000 7f9194144640 1 -- 172.21.15.146:0/254925418 learned_addr learned my addr 172.21.15.146:0/254925418 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:10.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.630+0000 7f9194144640 1 -- 172.21.15.146:0/254925418 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563829b7afe0 con 0x563829c40df0 2024-09-18T01:47:10.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.630+0000 7f9194144640 1 --2- 172.21.15.146:0/254925418 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563829c40df0 0x563829dc6290 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x563829ccd210 tx=0x7f9184000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.630+0000 7f9080e09640 1 -- 172.21.15.146:0/254925418 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9184019870 con 0x563829c40df0 2024-09-18T01:47:10.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.630+0000 7f9080e09640 1 -- 172.21.15.146:0/254925418 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9184019a10 con 0x563829c40df0 2024-09-18T01:47:10.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.630+0000 7f9198a13800 1 -- 172.21.15.146:0/254925418 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563829dc67d0 con 0x563829c40df0 2024-09-18T01:47:10.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.630+0000 7f9080e09640 1 -- 172.21.15.146:0/254925418 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9184019d30 con 0x563829c40df0 2024-09-18T01:47:10.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.630+0000 7f9198a13800 1 -- 172.21.15.146:0/254925418 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563829dc6cf0 con 0x563829c40df0 2024-09-18T01:47:10.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.631+0000 7f9080e09640 1 -- 172.21.15.146:0/254925418 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9184017040 con 0x563829c40df0 2024-09-18T01:47:10.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.631+0000 7f9080e09640 1 --2- 172.21.15.146:0/254925418 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f907c036b40 0x7f907c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.631+0000 7f9080e09640 1 -- 172.21.15.146:0/254925418 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f9184015020 con 0x563829c40df0 2024-09-18T01:47:10.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.631+0000 7f918b943640 1 --2- 172.21.15.146:0/254925418 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f907c036b40 0x7f907c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.631+0000 7f9198a13800 1 --2- 172.21.15.146:0/254925418 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x563829cd1900 0x563829dcd300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.631+0000 7f9198a13800 1 -- 172.21.15.146:0/254925418 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563829dcd840 con 0x563829cd1900 2024-09-18T01:47:10.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.631+0000 7f9194945640 1 --2- 172.21.15.146:0/254925418 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x563829cd1900 0x563829dcd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.632+0000 7f918b943640 1 --2- 172.21.15.146:0/254925418 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f907c036b40 0x7f907c039000 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f917c057000 tx=0x7f917c052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.632+0000 7f9194945640 1 --2- 172.21.15.146:0/254925418 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x563829cd1900 0x563829dcd300 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.632+0000 7f9194945640 1 -- 172.21.15.146:0/254925418 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f918c00a4a0 con 0x563829cd1900 2024-09-18T01:47:10.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.632+0000 7f9198a13800 1 -- 172.21.15.146:0/254925418 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563829dca8d0 con 0x563829cd1900 2024-09-18T01:47:10.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.632+0000 7f9194945640 1 -- 172.21.15.146:0/254925418 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f918c00a4a0 con 0x563829cd1900 2024-09-18T01:47:10.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.632+0000 7f9198a13800 1 -- 172.21.15.146:0/254925418 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563829dcf640 con 0x563829cd1900 2024-09-18T01:47:10.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.633+0000 7f9194945640 1 -- 172.21.15.146:0/254925418 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f918c00a4a0 con 0x563829cd1900 2024-09-18T01:47:10.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.633+0000 7f9198a13800 1 -- 172.21.15.146:0/254925418 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563829dce780 con 0x563829cd1900 2024-09-18T01:47:10.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.633+0000 7f9194945640 1 -- 172.21.15.146:0/254925418 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f918c00a4a0 con 0x563829cd1900 2024-09-18T01:47:10.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.633+0000 7f9198a13800 1 --2- 172.21.15.146:0/254925418 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x563829dcf250 0x563829dd2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.633+0000 7f9198a13800 1 -- 172.21.15.146:0/254925418 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563829dd3220 con 0x563829dcf250 2024-09-18T01:47:10.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.633+0000 7f9194144640 1 --2- 172.21.15.146:0/254925418 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x563829dcf250 0x563829dd2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.633+0000 7f9194144640 1 --2- 172.21.15.146:0/254925418 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x563829dcf250 0x563829dd2a90 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.633+0000 7f9194144640 1 -- 172.21.15.146:0/254925418 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f918402d070 con 0x563829dcf250 2024-09-18T01:47:10.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.634+0000 7f9198a13800 1 Processor -- start 2024-09-18T01:47:10.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.634+0000 7f9198a13800 1 -- start start 2024-09-18T01:47:10.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.634+0000 7f9198a13800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563829de0fb0 0x563829de13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.634+0000 7f9198a13800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x563829b68580 con 0x563829de0fb0 2024-09-18T01:47:10.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.634+0000 7f9194945640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563829de0fb0 0x563829de13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.634+0000 7f9194945640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563829de0fb0 0x563829de13d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37566/0 (socket says 172.21.15.146:37566) 2024-09-18T01:47:10.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.634+0000 7f9194945640 1 -- 172.21.15.146:0/2297725028 learned_addr learned my addr 172.21.15.146:0/2297725028 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:10.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.634+0000 7f9194945640 1 -- 172.21.15.146:0/2297725028 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563829de1910 con 0x563829de0fb0 2024-09-18T01:47:10.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.635+0000 7f9194945640 1 --2- 172.21.15.146:0/2297725028 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563829de0fb0 0x563829de13d0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x563829dcdc00 tx=0x7f918c0178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.635+0000 7f9079ffb640 1 -- 172.21.15.146:0/2297725028 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f918c013440 con 0x563829de0fb0 2024-09-18T01:47:10.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.635+0000 7f9079ffb640 1 -- 172.21.15.146:0/2297725028 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f918c0135e0 con 0x563829de0fb0 2024-09-18T01:47:10.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.635+0000 7f9198a13800 1 -- 172.21.15.146:0/2297725028 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563829de1ba0 con 0x563829de0fb0 2024-09-18T01:47:10.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.635+0000 7f9079ffb640 1 -- 172.21.15.146:0/2297725028 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f918c0138c0 con 0x563829de0fb0 2024-09-18T01:47:10.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.635+0000 7f9198a13800 1 -- 172.21.15.146:0/2297725028 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563829de4880 con 0x563829de0fb0 2024-09-18T01:47:10.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.635+0000 7f9079ffb640 1 -- 172.21.15.146:0/2297725028 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f918c011040 con 0x563829de0fb0 2024-09-18T01:47:10.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.636+0000 7f9079ffb640 1 --2- 172.21.15.146:0/2297725028 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f906c036b90 0x7f906c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.636+0000 7f9079ffb640 1 -- 172.21.15.146:0/2297725028 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f918c01d070 con 0x563829de0fb0 2024-09-18T01:47:10.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.636+0000 7f9194144640 1 --2- 172.21.15.146:0/2297725028 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f906c036b90 0x7f906c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.636+0000 7f9198a13800 1 Processor -- start 2024-09-18T01:47:10.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.636+0000 7f9198a13800 1 -- start start 2024-09-18T01:47:10.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.636+0000 7f9194144640 1 --2- 172.21.15.146:0/2297725028 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f906c036b90 0x7f906c039050 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f918400ffd0 tx=0x7f918404b670 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.636+0000 7f9198a13800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563829dedbe0 0x563829dedfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.636+0000 7f9198a13800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x563829ccc1e0 con 0x563829dedbe0 2024-09-18T01:47:10.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.636+0000 7f9194945640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563829dedbe0 0x563829dedfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.636+0000 7f9194945640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563829dedbe0 0x563829dedfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37582/0 (socket says 172.21.15.146:37582) 2024-09-18T01:47:10.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.636+0000 7f9194945640 1 -- 172.21.15.146:0/1687649857 learned_addr learned my addr 172.21.15.146:0/1687649857 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:10.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.637+0000 7f9194945640 1 -- 172.21.15.146:0/1687649857 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563829dee520 con 0x563829dedbe0 2024-09-18T01:47:10.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.637+0000 7f9194945640 1 --2- 172.21.15.146:0/1687649857 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563829dedbe0 0x563829dedfe0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f918c04c890 tx=0x7f918c0127a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b733287a229fa30 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.637+0000 7f90737fe640 1 -- 172.21.15.146:0/1687649857 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f918c045070 con 0x563829dedbe0 2024-09-18T01:47:10.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.637+0000 7f90737fe640 1 -- 172.21.15.146:0/1687649857 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f918c04e0d0 con 0x563829dedbe0 2024-09-18T01:47:10.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.637+0000 7f90737fe640 1 -- 172.21.15.146:0/1687649857 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f918c021a50 con 0x563829dedbe0 2024-09-18T01:47:10.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.637+0000 7f9198a13800 1 -- 172.21.15.146:0/1687649857 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563829dedbe0 msgr2=0x563829dedfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.637+0000 7f9198a13800 1 --2- 172.21.15.146:0/1687649857 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563829dedbe0 0x563829dedfe0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f918c04c890 tx=0x7f918c0127a0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.637+0000 7f9198a13800 1 -- 172.21.15.146:0/1687649857 shutdown_connections 2024-09-18T01:47:10.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.637+0000 7f9198a13800 1 --2- 172.21.15.146:0/1687649857 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563829dedbe0 0x563829dedfe0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.637+0000 7f9198a13800 1 -- 172.21.15.146:0/1687649857 >> 172.21.15.146:0/1687649857 conn(0x563829de9f90 msgr2=0x563829de8090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:10.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.637+0000 7f9198a13800 1 -- 172.21.15.146:0/1687649857 shutdown_connections 2024-09-18T01:47:10.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.637+0000 7f9198a13800 1 -- 172.21.15.146:0/1687649857 wait complete. 2024-09-18T01:47:10.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.638+0000 7f9198a13800 1 Processor -- start 2024-09-18T01:47:10.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.638+0000 7f9198a13800 1 -- start start 2024-09-18T01:47:10.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.638+0000 7f9198a13800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563829dedbe0 0x563829df5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.638+0000 7f9198a13800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x563829deebc0 con 0x563829dedbe0 2024-09-18T01:47:10.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.638+0000 7f9194945640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563829dedbe0 0x563829df5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.638+0000 7f9194945640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563829dedbe0 0x563829df5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37594/0 (socket says 172.21.15.146:37594) 2024-09-18T01:47:10.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.638+0000 7f9194945640 1 -- 172.21.15.146:0/2422399274 learned_addr learned my addr 172.21.15.146:0/2422399274 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:10.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.638+0000 7f9194945640 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563829df55c0 con 0x563829dedbe0 2024-09-18T01:47:10.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.639+0000 7f9194945640 1 --2- 172.21.15.146:0/2422399274 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563829dedbe0 0x563829df5080 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f918c0127e0 tx=0x7f918c04c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.639+0000 7f9071ffb640 1 -- 172.21.15.146:0/2422399274 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f918c03a070 con 0x563829dedbe0 2024-09-18T01:47:10.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.639+0000 7f9071ffb640 1 -- 172.21.15.146:0/2422399274 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f918c013a60 con 0x563829dedbe0 2024-09-18T01:47:10.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.639+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563829df5850 con 0x563829dedbe0 2024-09-18T01:47:10.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.639+0000 7f9071ffb640 1 -- 172.21.15.146:0/2422399274 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f918c045040 con 0x563829dedbe0 2024-09-18T01:47:10.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.639+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563829df8500 con 0x563829dedbe0 2024-09-18T01:47:10.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.639+0000 7f9071ffb640 1 -- 172.21.15.146:0/2422399274 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f918c03d070 con 0x563829dedbe0 2024-09-18T01:47:10.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.640+0000 7f9071ffb640 1 --2- 172.21.15.146:0/2422399274 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9064036b40 0x7f9064039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.640+0000 7f9071ffb640 1 -- 172.21.15.146:0/2422399274 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f918c032070 con 0x563829dedbe0 2024-09-18T01:47:10.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.640+0000 7f9194144640 1 --2- 172.21.15.146:0/2422399274 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9064036b40 0x7f9064039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.640+0000 7f9194144640 1 --2- 172.21.15.146:0/2422399274 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9064036b40 0x7f9064039000 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f918404b7a0 tx=0x7f9184033000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.640+0000 7f9198a13800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.640+0000 7f9198a13800 1 --2- 172.21.15.146:0/2422399274 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x563829e00d40 0x563829e03200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.640+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563829e03950 con 0x563829e00d40 2024-09-18T01:47:10.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.640+0000 7f918b943640 1 --2- 172.21.15.146:0/2422399274 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x563829e00d40 0x563829e03200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.641+0000 7f918b943640 1 --2- 172.21.15.146:0/2422399274 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x563829e00d40 0x563829e03200 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.641+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f917c051070 con 0x563829e00d40 2024-09-18T01:47:10.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.641+0000 7f9198a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:10.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.641+0000 7f9198a13800 20 realm 2024-09-18T01:47:10.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.641+0000 7f9198a13800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.641+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563829e03d80 con 0x563829e00d40 2024-09-18T01:47:10.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.641+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f917c051070 con 0x563829e00d40 2024-09-18T01:47:10.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.641+0000 7f9198a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:10.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.641+0000 7f9198a13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:47:10.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.641+0000 7f9198a13800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.641+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563829e04650 con 0x563829e00d40 2024-09-18T01:47:10.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.641+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f917c051070 con 0x563829e00d40 2024-09-18T01:47:10.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.641+0000 7f9198a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:10.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.641+0000 7f9198a13800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.641+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563829e049f0 con 0x563829e00d40 2024-09-18T01:47:10.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.642+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f917c051070 con 0x563829e00d40 2024-09-18T01:47:10.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.642+0000 7f9198a13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:47:10.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.642+0000 7f9198a13800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.642+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563829e05240 con 0x563829e00d40 2024-09-18T01:47:10.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.642+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f917c051070 con 0x563829e00d40 2024-09-18T01:47:10.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.642+0000 7f9198a13800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:47:10.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.642+0000 7f9198a13800 20 searching for the correct realm 2024-09-18T01:47:10.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.642+0000 7f9198a13800 1 --2- 172.21.15.146:0/2422399274 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x563829e06fb0 0x563829e093a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.642+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563829e099d0 con 0x563829e06fb0 2024-09-18T01:47:10.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.642+0000 7f9194945640 1 --2- 172.21.15.146:0/2422399274 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x563829e06fb0 0x563829e093a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.642+0000 7f9194945640 1 --2- 172.21.15.146:0/2422399274 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x563829e06fb0 0x563829e093a0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.643+0000 7f9194945640 1 -- 172.21.15.146:0/2422399274 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f918c03c030 con 0x563829e06fb0 2024-09-18T01:47:10.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.643+0000 7f9194945640 1 --2- 172.21.15.146:0/2422399274 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f918c03f060 0x7f918c022a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.643+0000 7f9194945640 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563829e099d0 con 0x7f918c03f060 2024-09-18T01:47:10.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.643+0000 7f9194144640 1 --2- 172.21.15.146:0/2422399274 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f918c03f060 0x7f918c022a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.643+0000 7f9194144640 1 --2- 172.21.15.146:0/2422399274 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f918c03f060 0x7f918c022a90 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.643+0000 7f9194144640 1 -- 172.21.15.146:0/2422399274 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9184044d70 con 0x7f918c03f060 2024-09-18T01:47:10.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.643+0000 7f9194144640 1 --2- 172.21.15.146:0/2422399274 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f91840187f0 0x7f918401c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.643+0000 7f9194144640 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563829e099d0 con 0x7f91840187f0 2024-09-18T01:47:10.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.643+0000 7f918b943640 1 --2- 172.21.15.146:0/2422399274 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f91840187f0 0x7f918401c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.644+0000 7f918b943640 1 --2- 172.21.15.146:0/2422399274 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f91840187f0 0x7f918401c610 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.644+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f917c051070 con 0x7f91840187f0 2024-09-18T01:47:10.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.644+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563829e099d0 con 0x563829e00d40 2024-09-18T01:47:10.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.644+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v33'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f917c051070 con 0x563829e00d40 2024-09-18T01:47:10.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.644+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563829e099d0 con 0x563829e00d40 2024-09-18T01:47:10.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.644+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f917c051070 con 0x563829e00d40 2024-09-18T01:47:10.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.644+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563829e099d0 con 0x7f91840187f0 2024-09-18T01:47:10.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.645+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f917c051070 con 0x7f91840187f0 2024-09-18T01:47:10.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.645+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563829e099d0 con 0x7f91840187f0 2024-09-18T01:47:10.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.645+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f917c051070 con 0x7f91840187f0 2024-09-18T01:47:10.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.645+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563829e099d0 con 0x7f918c03f060 2024-09-18T01:47:10.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.645+0000 7f9194144640 1 -- 172.21.15.146:0/2422399274 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9184044d70 con 0x7f918c03f060 2024-09-18T01:47:10.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.645+0000 7f9194144640 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563829e099d0 con 0x563829e06fb0 2024-09-18T01:47:10.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.646+0000 7f9194945640 1 -- 172.21.15.146:0/2422399274 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f918c03c030 con 0x563829e06fb0 2024-09-18T01:47:10.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.646+0000 7f9194945640 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563829e099d0 con 0x563829e00d40 2024-09-18T01:47:10.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.646+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f917c051070 con 0x563829e00d40 2024-09-18T01:47:10.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.646+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563829e099d0 con 0x7f91840187f0 2024-09-18T01:47:10.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.646+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f917c051070 con 0x7f91840187f0 2024-09-18T01:47:10.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.646+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563829e099d0 con 0x563829e00d40 2024-09-18T01:47:10.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.646+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f917c051070 con 0x563829e00d40 2024-09-18T01:47:10.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.646+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563829e099d0 con 0x7f918c03f060 2024-09-18T01:47:10.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.646+0000 7f9194144640 1 -- 172.21.15.146:0/2422399274 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f9184044d70 con 0x7f918c03f060 2024-09-18T01:47:10.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.646+0000 7f9194144640 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f918405a0a0 con 0x563829e06fb0 2024-09-18T01:47:10.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.647+0000 7f9194945640 1 -- 172.21.15.146:0/2422399274 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f918c03c030 con 0x563829e06fb0 2024-09-18T01:47:10.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.647+0000 7f9194945640 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f918405a0a0 con 0x563829e06fb0 2024-09-18T01:47:10.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.647+0000 7f9194945640 1 -- 172.21.15.146:0/2422399274 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f918c03c030 con 0x563829e06fb0 2024-09-18T01:47:10.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.647+0000 7f9194945640 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f918405a0a0 con 0x7f91840187f0 2024-09-18T01:47:10.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.647+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f917c051070 con 0x7f91840187f0 2024-09-18T01:47:10.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.647+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f918405a0a0 con 0x563829e06fb0 2024-09-18T01:47:10.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.647+0000 7f9194945640 1 -- 172.21.15.146:0/2422399274 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f918c03c030 con 0x563829e06fb0 2024-09-18T01:47:10.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.647+0000 7f9194945640 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f918405a0a0 con 0x563829e06fb0 2024-09-18T01:47:10.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.648+0000 7f9194945640 1 -- 172.21.15.146:0/2422399274 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f918c03c030 con 0x563829e06fb0 2024-09-18T01:47:10.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.648+0000 7f9194945640 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f918405a0a0 con 0x563829e00d40 2024-09-18T01:47:10.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.648+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f917c051070 con 0x563829e00d40 2024-09-18T01:47:10.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.648+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f918405a0a0 con 0x563829e00d40 2024-09-18T01:47:10.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.648+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v33'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f917c051070 con 0x563829e00d40 2024-09-18T01:47:10.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.648+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f918405a0a0 con 0x7f91840187f0 2024-09-18T01:47:10.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.648+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f917c051070 con 0x7f91840187f0 2024-09-18T01:47:10.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.648+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f918405a0a0 con 0x563829e06fb0 2024-09-18T01:47:10.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.649+0000 7f9194945640 1 -- 172.21.15.146:0/2422399274 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f918c03c030 con 0x563829e06fb0 2024-09-18T01:47:10.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.649+0000 7f9194945640 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f918405a0a0 con 0x7f918c03f060 2024-09-18T01:47:10.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.649+0000 7f9194144640 1 -- 172.21.15.146:0/2422399274 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9184044d70 con 0x7f918c03f060 2024-09-18T01:47:10.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.649+0000 7f9194144640 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f918405a0a0 con 0x563829e00d40 2024-09-18T01:47:10.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.649+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f917c051070 con 0x563829e00d40 2024-09-18T01:47:10.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.649+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f918405a0a0 con 0x7f91840187f0 2024-09-18T01:47:10.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.649+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f917c051070 con 0x7f91840187f0 2024-09-18T01:47:10.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.649+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f918405a0a0 con 0x563829e06fb0 2024-09-18T01:47:10.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.650+0000 7f9194945640 1 -- 172.21.15.146:0/2422399274 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f918c03c030 con 0x563829e06fb0 2024-09-18T01:47:10.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.650+0000 7f9194945640 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f918405a0a0 con 0x7f91840187f0 2024-09-18T01:47:10.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.650+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f917c051070 con 0x7f91840187f0 2024-09-18T01:47:10.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.650+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f918405a0a0 con 0x7f918c03f060 2024-09-18T01:47:10.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.650+0000 7f9194144640 1 -- 172.21.15.146:0/2422399274 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9184044d70 con 0x7f918c03f060 2024-09-18T01:47:10.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.650+0000 7f9194144640 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f918405a0a0 con 0x563829e06fb0 2024-09-18T01:47:10.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.650+0000 7f9194945640 1 -- 172.21.15.146:0/2422399274 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f918c03c030 con 0x563829e06fb0 2024-09-18T01:47:10.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.650+0000 7f9194945640 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f918405a0a0 con 0x7f91840187f0 2024-09-18T01:47:10.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.651+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f917c051070 con 0x7f91840187f0 2024-09-18T01:47:10.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.651+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f918405a0a0 con 0x563829e00d40 2024-09-18T01:47:10.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.651+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v33'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f917c051070 con 0x563829e00d40 2024-09-18T01:47:10.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.651+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f918405a0a0 con 0x7f918c03f060 2024-09-18T01:47:10.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.651+0000 7f9194144640 1 -- 172.21.15.146:0/2422399274 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9184044d70 con 0x7f918c03f060 2024-09-18T01:47:10.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.651+0000 7f9198a13800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:47:10.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.651+0000 7f9198a13800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:47:10.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.651+0000 7f9198a13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:47:10.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.651+0000 7f9198a13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:47:10.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.651+0000 7f9198a13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:47:10.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.651+0000 7f9198a13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:47:10.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.651+0000 7f9198a13800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.651+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563829e05bf0 con 0x563829e00d40 2024-09-18T01:47:10.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.651+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f917c051070 con 0x563829e00d40 2024-09-18T01:47:10.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.651+0000 7f9198a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:10.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.651+0000 7f9198a13800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.651+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563829e06490 con 0x563829e00d40 2024-09-18T01:47:10.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.652+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f917c051070 con 0x563829e00d40 2024-09-18T01:47:10.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.652+0000 7f9198a13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:47:10.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.652+0000 7f9198a13800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.652+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563829e09e50 con 0x7f918c03f060 2024-09-18T01:47:10.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.652+0000 7f9194144640 1 -- 172.21.15.146:0/2422399274 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9184044d70 con 0x7f918c03f060 2024-09-18T01:47:10.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.652+0000 7f9198a13800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:47:10.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.652+0000 7f9198a13800 20 zone default found 2024-09-18T01:47:10.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.652+0000 7f9198a13800 4 Realm: () 2024-09-18T01:47:10.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.652+0000 7f9198a13800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:47:10.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.652+0000 7f9198a13800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:47:10.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.652+0000 7f9198a13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:47:10.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.652+0000 7f9198a13800 20 zonegroup default 2024-09-18T01:47:10.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.652+0000 7f9198a13800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.652+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563829e0a6a0 con 0x7f91840187f0 2024-09-18T01:47:10.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.652+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f917c051070 con 0x7f91840187f0 2024-09-18T01:47:10.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.652+0000 7f9198a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:10.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.652+0000 7f9198a13800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.652+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563829e0c080 con 0x563829e06fb0 2024-09-18T01:47:10.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.652+0000 7f9194945640 1 -- 172.21.15.146:0/2422399274 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f918c03c030 con 0x563829e06fb0 2024-09-18T01:47:10.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.652+0000 7f9198a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:10.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.652+0000 7f9198a13800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.652+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563829e0c570 con 0x563829e06fb0 2024-09-18T01:47:10.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.653+0000 7f9194945640 1 -- 172.21.15.146:0/2422399274 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f918c03c030 con 0x563829e06fb0 2024-09-18T01:47:10.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.653+0000 7f9198a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:10.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.653+0000 7f9198a13800 20 started sync module instance, tier type = 2024-09-18T01:47:10.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.653+0000 7f9198a13800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:47:10.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.653+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e0b510 con 0x7f918c03f060 2024-09-18T01:47:10.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.654+0000 7f9194144640 1 -- 172.21.15.146:0/2422399274 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v33'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9184044d70 con 0x7f918c03f060 2024-09-18T01:47:10.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.654+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94799220750592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e0ce80 con 0x7f918c03f060 2024-09-18T01:47:10.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.654+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e0d6d0 con 0x563829e00d40 2024-09-18T01:47:10.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.655+0000 7f9194144640 1 -- 172.21.15.146:0/2422399274 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94799220750592] v33'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9184044d70 con 0x7f918c03f060 2024-09-18T01:47:10.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.655+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v33'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f917c051070 con 0x563829e00d40 2024-09-18T01:47:10.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.655+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94799220754896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e0d6d0 con 0x563829e00d40 2024-09-18T01:47:10.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.655+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e0e1c0 con 0x563829e06fb0 2024-09-18T01:47:10.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.656+0000 7f9194945640 1 -- 172.21.15.146:0/2422399274 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v33'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f918c03c030 con 0x563829e06fb0 2024-09-18T01:47:10.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.656+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94799220759696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e0e1c0 con 0x563829e06fb0 2024-09-18T01:47:10.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.656+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e0f1c0 con 0x7f918c03f060 2024-09-18T01:47:10.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.656+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94799220754896] v33'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f917c051070 con 0x563829e00d40 2024-09-18T01:47:10.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.657+0000 7f9194144640 1 -- 172.21.15.146:0/2422399274 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v33'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9184044d70 con 0x7f918c03f060 2024-09-18T01:47:10.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.657+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94799220763824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e0f5b0 con 0x7f918c03f060 2024-09-18T01:47:10.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.657+0000 7f9194945640 1 -- 172.21.15.146:0/2422399274 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94799220759696] v33'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f918c03c030 con 0x563829e06fb0 2024-09-18T01:47:10.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.657+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e0e5f0 con 0x563829e00d40 2024-09-18T01:47:10.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.658+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v33'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f917c051070 con 0x563829e00d40 2024-09-18T01:47:10.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.658+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94799220767472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e0e5f0 con 0x563829e00d40 2024-09-18T01:47:10.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.658+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e10a40 con 0x7f91840187f0 2024-09-18T01:47:10.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.658+0000 7f9194144640 1 -- 172.21.15.146:0/2422399274 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94799220763824] v33'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9184044d70 con 0x7f918c03f060 2024-09-18T01:47:10.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.659+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94799220767472] v33'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f917c051070 con 0x563829e00d40 2024-09-18T01:47:10.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.659+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v33'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f917c051070 con 0x7f91840187f0 2024-09-18T01:47:10.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.659+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94799220768528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e10a00 con 0x7f91840187f0 2024-09-18T01:47:10.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.659+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e112e0 con 0x7f91840187f0 2024-09-18T01:47:10.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.660+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94799220768528] v33'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f917c051070 con 0x7f91840187f0 2024-09-18T01:47:10.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.661+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v33'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f917c051070 con 0x7f91840187f0 2024-09-18T01:47:10.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.661+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94799220770096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e10a00 con 0x7f91840187f0 2024-09-18T01:47:10.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.661+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e11900 con 0x7f91840187f0 2024-09-18T01:47:10.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.661+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94799220770096] v33'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f917c051070 con 0x7f91840187f0 2024-09-18T01:47:10.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.662+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v33'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f917c051070 con 0x7f91840187f0 2024-09-18T01:47:10.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.662+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94799220772320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e11900 con 0x7f91840187f0 2024-09-18T01:47:10.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.662+0000 7f9198a13800 20 add_watcher() i=0 2024-09-18T01:47:10.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.662+0000 7f9198a13800 20 add_watcher() i=1 2024-09-18T01:47:10.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.662+0000 7f9198a13800 20 add_watcher() i=2 2024-09-18T01:47:10.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.662+0000 7f9198a13800 20 add_watcher() i=3 2024-09-18T01:47:10.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.662+0000 7f9198a13800 20 add_watcher() i=4 2024-09-18T01:47:10.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.662+0000 7f9198a13800 20 add_watcher() i=5 2024-09-18T01:47:10.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.662+0000 7f9198a13800 20 add_watcher() i=6 2024-09-18T01:47:10.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.662+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94799220772320] v33'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f917c051070 con 0x7f91840187f0 2024-09-18T01:47:10.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.662+0000 7f9198a13800 20 add_watcher() i=7 2024-09-18T01:47:10.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.662+0000 7f9198a13800 2 all 8 watchers are set, enabling cache 2024-09-18T01:47:10.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.663+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563829e14d00 con 0x563829e00d40 2024-09-18T01:47:10.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.663+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f917c051070 con 0x563829e00d40 2024-09-18T01:47:10.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.663+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94799220774432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e12220 con 0x563829e00d40 2024-09-18T01:47:10.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.664+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94799220774432] v33'258 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f917c051070 con 0x563829e00d40 2024-09-18T01:47:10.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.664+0000 7f904a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:47:10.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.664+0000 7f9198a13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:47:10.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.664+0000 7f9198a13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:47:10.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.664+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e14b10 con 0x563829e00d40 2024-09-18T01:47:10.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.665+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'61 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f917c051070 con 0x563829e00d40 2024-09-18T01:47:10.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.665+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e1de50 con 0x7f91840187f0 2024-09-18T01:47:10.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.666+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f917c051070 con 0x7f91840187f0 2024-09-18T01:47:10.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.666+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e1e3c0 con 0x563829e06fb0 2024-09-18T01:47:10.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.667+0000 7f9194945640 1 -- 172.21.15.146:0/2422399274 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f918c03c030 con 0x563829e06fb0 2024-09-18T01:47:10.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.667+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e1e3c0 con 0x563829e00d40 2024-09-18T01:47:10.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.668+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'259 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f917c051070 con 0x563829e00d40 2024-09-18T01:47:10.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.668+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e1e930 con 0x7f918c03f060 2024-09-18T01:47:10.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.669+0000 7f9194144640 1 -- 172.21.15.146:0/2422399274 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'86 uv57 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9184044d70 con 0x7f918c03f060 2024-09-18T01:47:10.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.669+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e1ede0 con 0x563829e06fb0 2024-09-18T01:47:10.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.670+0000 7f9194945640 1 -- 172.21.15.146:0/2422399274 <== osd.3 v2:172.21.15.146:6809/4106661138 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'70 uv50 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f918c03c030 con 0x563829e06fb0 2024-09-18T01:47:10.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.670+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e1ede0 con 0x563829e00d40 2024-09-18T01:47:10.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.672+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f917c051070 con 0x563829e00d40 2024-09-18T01:47:10.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.672+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e1d510 con 0x7f91840187f0 2024-09-18T01:47:10.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.673+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'59 uv40 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f917c051070 con 0x7f91840187f0 2024-09-18T01:47:10.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.673+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e1d510 con 0x7f918c03f060 2024-09-18T01:47:10.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.674+0000 7f9194144640 1 -- 172.21.15.146:0/2422399274 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9184044d70 con 0x7f918c03f060 2024-09-18T01:47:10.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.674+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e1d510 con 0x563829e06fb0 2024-09-18T01:47:10.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.675+0000 7f9194945640 1 -- 172.21.15.146:0/2422399274 <== osd.3 v2:172.21.15.146:6809/4106661138 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f918c03c030 con 0x563829e06fb0 2024-09-18T01:47:10.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.675+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e1d510 con 0x7f918c03f060 2024-09-18T01:47:10.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.676+0000 7f9194144640 1 -- 172.21.15.146:0/2422399274 <== osd.2 v2:172.21.15.146:6800/3820039304 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'87 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9184044d70 con 0x7f918c03f060 2024-09-18T01:47:10.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.676+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e1cfc0 con 0x7f91840187f0 2024-09-18T01:47:10.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.677+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'36 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f917c051070 con 0x7f91840187f0 2024-09-18T01:47:10.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.677+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e1f7c0 con 0x7f918c03f060 2024-09-18T01:47:10.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.678+0000 7f9194144640 1 -- 172.21.15.146:0/2422399274 <== osd.2 v2:172.21.15.146:6800/3820039304 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9184044d70 con 0x7f918c03f060 2024-09-18T01:47:10.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.678+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e1f7c0 con 0x7f91840187f0 2024-09-18T01:47:10.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.679+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'71 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f917c051070 con 0x7f91840187f0 2024-09-18T01:47:10.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.679+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e1f7c0 con 0x563829e00d40 2024-09-18T01:47:10.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.680+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'260 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f917c051070 con 0x563829e00d40 2024-09-18T01:47:10.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.680+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e1f7c0 con 0x563829e06fb0 2024-09-18T01:47:10.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.681+0000 7f9194945640 1 -- 172.21.15.146:0/2422399274 <== osd.3 v2:172.21.15.146:6809/4106661138 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'81 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f918c03c030 con 0x563829e06fb0 2024-09-18T01:47:10.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.681+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e1f7c0 con 0x7f918c03f060 2024-09-18T01:47:10.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.682+0000 7f9194144640 1 -- 172.21.15.146:0/2422399274 <== osd.2 v2:172.21.15.146:6800/3820039304 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'88 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9184044d70 con 0x7f918c03f060 2024-09-18T01:47:10.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.682+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e1f7c0 con 0x563829e06fb0 2024-09-18T01:47:10.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.683+0000 7f9194945640 1 -- 172.21.15.146:0/2422399274 <== osd.3 v2:172.21.15.146:6809/4106661138 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'43 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f918c03c030 con 0x563829e06fb0 2024-09-18T01:47:10.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.683+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e1f7c0 con 0x563829e00d40 2024-09-18T01:47:10.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.684+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f917c051070 con 0x563829e00d40 2024-09-18T01:47:10.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.684+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e1f7c0 con 0x563829e00d40 2024-09-18T01:47:10.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.685+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'261 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f917c051070 con 0x563829e00d40 2024-09-18T01:47:10.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.685+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e1f7c0 con 0x563829e06fb0 2024-09-18T01:47:10.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.686+0000 7f9194945640 1 -- 172.21.15.146:0/2422399274 <== osd.3 v2:172.21.15.146:6809/4106661138 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'82 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f918c03c030 con 0x563829e06fb0 2024-09-18T01:47:10.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.686+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e1f7c0 con 0x7f918c03f060 2024-09-18T01:47:10.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.687+0000 7f9194144640 1 -- 172.21.15.146:0/2422399274 <== osd.2 v2:172.21.15.146:6800/3820039304 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'46 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9184044d70 con 0x7f918c03f060 2024-09-18T01:47:10.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.687+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e1f7c0 con 0x563829e06fb0 2024-09-18T01:47:10.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.688+0000 7f9194945640 1 -- 172.21.15.146:0/2422399274 <== osd.3 v2:172.21.15.146:6809/4106661138 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f918c03c030 con 0x563829e06fb0 2024-09-18T01:47:10.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.688+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e1f7c0 con 0x563829e06fb0 2024-09-18T01:47:10.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.689+0000 7f9194945640 1 -- 172.21.15.146:0/2422399274 <== osd.3 v2:172.21.15.146:6809/4106661138 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'48 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f918c03c030 con 0x563829e06fb0 2024-09-18T01:47:10.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.689+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e1f7c0 con 0x563829e06fb0 2024-09-18T01:47:10.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.690+0000 7f9194945640 1 -- 172.21.15.146:0/2422399274 <== osd.3 v2:172.21.15.146:6809/4106661138 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f918c03c030 con 0x563829e06fb0 2024-09-18T01:47:10.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.690+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e1f7c0 con 0x563829e06fb0 2024-09-18T01:47:10.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.691+0000 7f9194945640 1 -- 172.21.15.146:0/2422399274 <== osd.3 v2:172.21.15.146:6809/4106661138 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'71 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f918c03c030 con 0x563829e06fb0 2024-09-18T01:47:10.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.691+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e1f7c0 con 0x7f91840187f0 2024-09-18T01:47:10.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.692+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'40 uv30 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f917c051070 con 0x7f91840187f0 2024-09-18T01:47:10.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.692+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e1f7c0 con 0x563829e06fb0 2024-09-18T01:47:10.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.693+0000 7f9194945640 1 -- 172.21.15.146:0/2422399274 <== osd.3 v2:172.21.15.146:6809/4106661138 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'43 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f918c03c030 con 0x563829e06fb0 2024-09-18T01:47:10.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.693+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e1f7c0 con 0x7f91840187f0 2024-09-18T01:47:10.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.694+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.0 v2:172.21.15.129:6800/1759265424 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'60 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f917c051070 con 0x7f91840187f0 2024-09-18T01:47:10.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.694+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e1f7c0 con 0x563829e06fb0 2024-09-18T01:47:10.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.695+0000 7f9194945640 1 -- 172.21.15.146:0/2422399274 <== osd.3 v2:172.21.15.146:6809/4106661138 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'83 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f918c03c030 con 0x563829e06fb0 2024-09-18T01:47:10.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.695+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e1f7c0 con 0x7f91840187f0 2024-09-18T01:47:10.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.696+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.0 v2:172.21.15.129:6800/1759265424 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'72 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f917c051070 con 0x7f91840187f0 2024-09-18T01:47:10.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.696+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e1f7c0 con 0x7f918c03f060 2024-09-18T01:47:10.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.697+0000 7f9194144640 1 -- 172.21.15.146:0/2422399274 <== osd.2 v2:172.21.15.146:6800/3820039304 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9184044d70 con 0x7f918c03f060 2024-09-18T01:47:10.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.698+0000 7f90497e2640 20 reqs_thread_entry: start 2024-09-18T01:47:10.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.698+0000 7f9198a13800 20 init_complete bucket index max shards: 11 2024-09-18T01:47:10.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.698+0000 7f9198a13800 20 Filter name: none 2024-09-18T01:47:10.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.698+0000 7f8fbaffd640 20 reqs_thread_entry: start 2024-09-18T01:47:10.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.698+0000 7f9198a13800 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-09-18T01:47:10.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.698+0000 7f9198a13800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.698+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:94 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563829e4a230 con 0x563829e06fb0 2024-09-18T01:47:10.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.699+0000 7f9194945640 1 -- 172.21.15.146:0/2422399274 <== osd.3 v2:172.21.15.146:6809/4106661138 26 ==== osd_op_reply(94 a_user [call out=48b,read 0~363 out=363b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 234+0+486 (crc 0 0 0) 0x7f918c03c030 con 0x563829e06fb0 2024-09-18T01:47:10.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.699+0000 7f9198a13800 20 rados_obj.operate() r=0 bl.length=363 2024-09-18T01:47:10.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.699+0000 7f9198a13800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x13 2024-09-18T01:47:10.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.699+0000 7f9198a13800 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-18T01:47:10.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.699+0000 7f9198a13800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:47:10.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.699+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:95 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563829e4ccc0 con 0x563829e06fb0 2024-09-18T01:47:10.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.699+0000 7f9194945640 1 -- 172.21.15.146:0/2422399274 <== osd.3 v2:172.21.15.146:6809/4106661138 27 ==== osd_op_reply(95 a_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7f918c03c030 con 0x563829e06fb0 2024-09-18T01:47:10.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.699+0000 7f9198a13800 10 removing key index: true_admin_akey 2024-09-18T01:47:10.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.699+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:96 8.15 8:afe09604:users.keys::true_admin_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e4aca0 con 0x563829e06fb0 2024-09-18T01:47:10.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.700+0000 7f9194945640 1 -- 172.21.15.146:0/2422399274 <== osd.3 v2:172.21.15.146:6809/4106661138 28 ==== osd_op_reply(96 true_admin_akey [delete] v33'4 uv4 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f918c03c030 con 0x563829e06fb0 2024-09-18T01:47:10.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.700+0000 7f9198a13800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-09-18T01:47:10.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.700+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:97 7.3 7:c609908c:::notify.5:head [notify cookie 94799221012400 in=177b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563829e4d150 con 0x7f91840187f0 2024-09-18T01:47:10.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.701+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.0 v2:172.21.15.129:6800/1759265424 24 ==== watch-notify(notify (1) cookie 94799220768528 notify 141733920813 ret 0) ==== 207+0+0 (crc 0 0 0) 0x563829e1de50 con 0x7f91840187f0 2024-09-18T01:47:10.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.701+0000 7f90737fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920813 cookie 94799220768528 notifier 4873 bl.length()=165 2024-09-18T01:47:10.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.701+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.0 v2:172.21.15.129:6800/1759265424 25 ==== osd_op_reply(97 notify.5 [notify cookie 94799221012400 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f917c051070 con 0x7f91840187f0 2024-09-18T01:47:10.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.701+0000 7f90737fe640 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f9058003d60 con 0x7f91840187f0 2024-09-18T01:47:10.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.701+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.0 v2:172.21.15.129:6800/1759265424 26 ==== osd_op_reply(98 notify.5 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f917c051070 con 0x7f91840187f0 2024-09-18T01:47:10.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.701+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.0 v2:172.21.15.129:6800/1759265424 27 ==== watch-notify(notify_complete (2) cookie 94799221012400 notify 141733920813 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563829df8500 con 0x7f91840187f0 2024-09-18T01:47:10.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.701+0000 7f9198a13800 10 removing email index: 2024-09-18T01:47:10.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.701+0000 7f9198a13800 10 removing user buckets index 2024-09-18T01:47:10.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.701+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:99 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e4d0d0 con 0x563829e06fb0 2024-09-18T01:47:10.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.702+0000 7f9194945640 1 -- 172.21.15.146:0/2422399274 <== osd.3 v2:172.21.15.146:6809/4106661138 29 ==== osd_op_reply(99 a_user.buckets [delete] v33'1 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7f918c03c030 con 0x563829e06fb0 2024-09-18T01:47:10.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.702+0000 7f9198a13800 10 removing user index: a_user 2024-09-18T01:47:10.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.702+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:100 8.14 8:2efb937b:users.uid::a_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e4cc70 con 0x563829e06fb0 2024-09-18T01:47:10.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.703+0000 7f9194945640 1 -- 172.21.15.146:0/2422399274 <== osd.3 v2:172.21.15.146:6809/4106661138 30 ==== osd_op_reply(100 a_user [call,call,delete] v33'2 uv2 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f918c03c030 con 0x563829e06fb0 2024-09-18T01:47:10.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.703+0000 7f9198a13800 10 removing default.rgw.meta+users.uid+a_user from cache 2024-09-18T01:47:10.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.703+0000 7f9198a13800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-09-18T01:47:10.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.703+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [notify cookie 94799221008288 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563829e4c080 con 0x563829e06fb0 2024-09-18T01:47:10.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.703+0000 7f9194945640 1 -- 172.21.15.146:0/2422399274 <== osd.3 v2:172.21.15.146:6809/4106661138 31 ==== watch-notify(notify (1) cookie 94799220759696 notify 141733920778 ret 0) ==== 197+0+0 (crc 0 0 0) 0x563829e1e590 con 0x563829e06fb0 2024-09-18T01:47:10.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.703+0000 7f90737fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920778 cookie 94799220759696 notifier 4873 bl.length()=155 2024-09-18T01:47:10.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.703+0000 7f9194945640 1 -- 172.21.15.146:0/2422399274 <== osd.3 v2:172.21.15.146:6809/4106661138 32 ==== osd_op_reply(101 notify.2 [notify cookie 94799221008288 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f918c03c030 con 0x563829e06fb0 2024-09-18T01:47:10.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.703+0000 7f90737fe640 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:102 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f9058003d60 con 0x563829e06fb0 2024-09-18T01:47:10.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.703+0000 7f9194945640 1 -- 172.21.15.146:0/2422399274 <== osd.3 v2:172.21.15.146:6809/4106661138 33 ==== watch-notify(notify_complete (2) cookie 94799221008288 notify 141733920778 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563829df5850 con 0x563829e06fb0 2024-09-18T01:47:10.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.703+0000 7f9194945640 1 -- 172.21.15.146:0/2422399274 <== osd.3 v2:172.21.15.146:6809/4106661138 34 ==== osd_op_reply(102 notify.2 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f918c03c030 con 0x563829e06fb0 2024-09-18T01:47:10.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.704+0000 7f904a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:47:10.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.704+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94799220774432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e48b80 con 0x563829e00d40 2024-09-18T01:47:10.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.705+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.1 v2:172.21.15.146:6808/3930274777 28 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94799220774432] v33'262 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f917c051070 con 0x563829e00d40 2024-09-18T01:47:10.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.705+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94799220750592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e115f0 con 0x7f918c03f060 2024-09-18T01:47:10.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.706+0000 7f9194144640 1 -- 172.21.15.146:0/2422399274 <== osd.2 v2:172.21.15.146:6800/3820039304 19 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94799220750592] v33'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9184044d70 con 0x7f918c03f060 2024-09-18T01:47:10.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.706+0000 7f9198a13800 20 remove_watcher() i=0 2024-09-18T01:47:10.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.706+0000 7f9198a13800 2 removed watcher, disabling cache 2024-09-18T01:47:10.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.706+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94799220754896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e0b900 con 0x563829e00d40 2024-09-18T01:47:10.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.707+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.1 v2:172.21.15.146:6808/3930274777 29 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94799220754896] v33'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f917c051070 con 0x563829e00d40 2024-09-18T01:47:10.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.707+0000 7f9198a13800 20 remove_watcher() i=1 2024-09-18T01:47:10.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.707+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94799220759696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e0b900 con 0x563829e06fb0 2024-09-18T01:47:10.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.708+0000 7f9194945640 1 -- 172.21.15.146:0/2422399274 <== osd.3 v2:172.21.15.146:6809/4106661138 35 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94799220759696] v33'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f918c03c030 con 0x563829e06fb0 2024-09-18T01:47:10.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.708+0000 7f9198a13800 20 remove_watcher() i=2 2024-09-18T01:47:10.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.708+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94799220763824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e0b900 con 0x7f918c03f060 2024-09-18T01:47:10.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.709+0000 7f9194144640 1 -- 172.21.15.146:0/2422399274 <== osd.2 v2:172.21.15.146:6800/3820039304 20 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94799220763824] v33'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9184044d70 con 0x7f918c03f060 2024-09-18T01:47:10.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.709+0000 7f9198a13800 20 remove_watcher() i=3 2024-09-18T01:47:10.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.709+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94799220767472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e0b900 con 0x563829e00d40 2024-09-18T01:47:10.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.711+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.1 v2:172.21.15.146:6808/3930274777 30 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94799220767472] v33'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f917c051070 con 0x563829e00d40 2024-09-18T01:47:10.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.711+0000 7f9198a13800 20 remove_watcher() i=4 2024-09-18T01:47:10.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.711+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94799220768528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e0faf0 con 0x7f91840187f0 2024-09-18T01:47:10.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.712+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.0 v2:172.21.15.129:6800/1759265424 28 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94799220768528] v33'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f917c051070 con 0x7f91840187f0 2024-09-18T01:47:10.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.712+0000 7f9198a13800 20 remove_watcher() i=5 2024-09-18T01:47:10.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.712+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94799220770096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e0b900 con 0x7f91840187f0 2024-09-18T01:47:10.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.713+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.0 v2:172.21.15.129:6800/1759265424 29 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94799220770096] v33'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f917c051070 con 0x7f91840187f0 2024-09-18T01:47:10.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.713+0000 7f9198a13800 20 remove_watcher() i=6 2024-09-18T01:47:10.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.713+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94799220772320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563829e0b900 con 0x7f91840187f0 2024-09-18T01:47:10.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.714+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 <== osd.0 v2:172.21.15.129:6800/1759265424 30 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94799220772320] v33'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f917c051070 con 0x7f91840187f0 2024-09-18T01:47:10.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.714+0000 7f9198a13800 20 remove_watcher() i=7 2024-09-18T01:47:10.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.714+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f91840187f0 msgr2=0x7f918401c610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.714+0000 7f9198a13800 1 --2- 172.21.15.146:0/2422399274 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f91840187f0 0x7f918401c610 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.714+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x563829e00d40 msgr2=0x563829e03200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.714+0000 7f9198a13800 1 --2- 172.21.15.146:0/2422399274 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x563829e00d40 0x563829e03200 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.714+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f918c03f060 msgr2=0x7f918c022a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.714+0000 7f9198a13800 1 --2- 172.21.15.146:0/2422399274 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f918c03f060 0x7f918c022a90 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.714+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x563829e06fb0 msgr2=0x563829e093a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.714+0000 7f9198a13800 1 --2- 172.21.15.146:0/2422399274 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x563829e06fb0 0x563829e093a0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.714+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9064036b40 msgr2=0x7f9064039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.714+0000 7f9198a13800 1 --2- 172.21.15.146:0/2422399274 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9064036b40 0x7f9064039000 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f918404b7a0 tx=0x7f9184033000 comp rx=0 tx=0).stop 2024-09-18T01:47:10.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.714+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563829dedbe0 msgr2=0x563829df5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.714+0000 7f918b943640 1 -- 172.21.15.146:0/2422399274 reap_dead start 2024-09-18T01:47:10.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.714+0000 7f9198a13800 1 --2- 172.21.15.146:0/2422399274 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563829dedbe0 0x563829df5080 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f918c0127e0 tx=0x7f918c04c820 comp rx=0 tx=0).stop 2024-09-18T01:47:10.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.714+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 shutdown_connections 2024-09-18T01:47:10.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.714+0000 7f9198a13800 1 --2- 172.21.15.146:0/2422399274 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563829dedbe0 0x563829df5080 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.714+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 >> 172.21.15.146:0/2422399274 conn(0x563829de9f90 msgr2=0x563829de8060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:10.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.714+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 shutdown_connections 2024-09-18T01:47:10.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.714+0000 7f9198a13800 1 -- 172.21.15.146:0/2422399274 wait complete. 2024-09-18T01:47:10.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.715+0000 7f9198a13800 1 -- 172.21.15.146:0/2297725028 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f906c036b90 msgr2=0x7f906c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.715+0000 7f9198a13800 1 --2- 172.21.15.146:0/2297725028 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f906c036b90 0x7f906c039050 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f918400ffd0 tx=0x7f918404b670 comp rx=0 tx=0).stop 2024-09-18T01:47:10.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.715+0000 7f9198a13800 1 -- 172.21.15.146:0/2297725028 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563829de0fb0 msgr2=0x563829de13d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.715+0000 7f9198a13800 1 --2- 172.21.15.146:0/2297725028 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563829de0fb0 0x563829de13d0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x563829dcdc00 tx=0x7f918c0178e0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.715+0000 7f9198a13800 1 -- 172.21.15.146:0/2297725028 shutdown_connections 2024-09-18T01:47:10.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.715+0000 7f9198a13800 1 --2- 172.21.15.146:0/2297725028 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f906c036b90 0x7f906c039050 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.715+0000 7f9198a13800 1 --2- 172.21.15.146:0/2297725028 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563829de0fb0 0x563829de13d0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.715+0000 7f9198a13800 1 -- 172.21.15.146:0/2297725028 >> 172.21.15.146:0/2297725028 conn(0x563829dd5f40 msgr2=0x563829dd8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:10.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.715+0000 7f9198a13800 1 -- 172.21.15.146:0/2297725028 shutdown_connections 2024-09-18T01:47:10.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.715+0000 7f9198a13800 1 -- 172.21.15.146:0/2297725028 wait complete. 2024-09-18T01:47:10.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.715+0000 7f9198a13800 1 -- 172.21.15.146:0/254925418 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x563829cd1900 msgr2=0x563829dcd300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.715+0000 7f9198a13800 1 --2- 172.21.15.146:0/254925418 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x563829cd1900 0x563829dcd300 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.715+0000 7f9198a13800 1 -- 172.21.15.146:0/254925418 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x563829dcf250 msgr2=0x563829dd2a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.715+0000 7f9198a13800 1 --2- 172.21.15.146:0/254925418 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x563829dcf250 0x563829dd2a90 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.715+0000 7f9198a13800 1 -- 172.21.15.146:0/254925418 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f907c036b40 msgr2=0x7f907c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.715+0000 7f9198a13800 1 --2- 172.21.15.146:0/254925418 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f907c036b40 0x7f907c039000 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f917c057000 tx=0x7f917c052000 comp rx=0 tx=0).stop 2024-09-18T01:47:10.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.715+0000 7f9198a13800 1 -- 172.21.15.146:0/254925418 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563829c40df0 msgr2=0x563829dc6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.715+0000 7f9198a13800 1 --2- 172.21.15.146:0/254925418 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563829c40df0 0x563829dc6290 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x563829ccd210 tx=0x7f9184000ed0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.715+0000 7f9198a13800 1 -- 172.21.15.146:0/254925418 shutdown_connections 2024-09-18T01:47:10.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.715+0000 7f9198a13800 1 --2- 172.21.15.146:0/254925418 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x563829dcf250 0x563829dd2a90 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.715+0000 7f9198a13800 1 --2- 172.21.15.146:0/254925418 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x563829cd1900 0x563829dcd300 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.715+0000 7f9198a13800 1 --2- 172.21.15.146:0/254925418 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f907c036b40 0x7f907c039000 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.715+0000 7f9198a13800 1 --2- 172.21.15.146:0/254925418 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563829c40df0 0x563829dc6290 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.715+0000 7f9198a13800 1 -- 172.21.15.146:0/254925418 >> 172.21.15.146:0/254925418 conn(0x563829cc7df0 msgr2=0x563829db7be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:10.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.715+0000 7f9198a13800 1 -- 172.21.15.146:0/254925418 shutdown_connections 2024-09-18T01:47:10.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.715+0000 7f9198a13800 1 -- 172.21.15.146:0/254925418 wait complete. 2024-09-18T01:47:10.729 ERROR:root:None 2024-09-18T01:47:10.729 ERROR:root:0 2024-09-18T01:47:10.729 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-09-18T01:47:10.729 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-09-18T01:47:10.729 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=read 2024-09-18T01:47:10.775 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:47:10.776 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:47:10.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.775+0000 7f3065939800 1 Processor -- start 2024-09-18T01:47:10.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.775+0000 7f3065939800 1 -- start start 2024-09-18T01:47:10.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.776+0000 7f3065939800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55808eb1f4c0 0x55808ebb3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.776+0000 7f3065939800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55808ea69b30 con 0x55808eb205d0 2024-09-18T01:47:10.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.776+0000 7f3065939800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x55808ea4b360 con 0x55808eb1f4c0 2024-09-18T01:47:10.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.776+0000 7f3060dd0640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55808eb1f4c0 0x55808ebb3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.776+0000 7f30615d1640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x55808eb205d0 0x55808eb1edb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:53108/0 (socket says 172.21.15.146:53108) 2024-09-18T01:47:10.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.776+0000 7f3060dd0640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55808eb1f4c0 0x55808ebb3690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37602/0 (socket says 172.21.15.146:37602) 2024-09-18T01:47:10.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.776+0000 7f30615d1640 1 -- 172.21.15.146:0/875159897 learned_addr learned my addr 172.21.15.146:0/875159897 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:47:10.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.776+0000 7f3060dd0640 1 -- 172.21.15.146:0/875159897 >> v1:172.21.15.129:6789/0 conn(0x55808eb205d0 legacy=0x55808eb1edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.776+0000 7f3060dd0640 1 -- 172.21.15.146:0/875159897 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55808ea71e00 con 0x55808eb1f4c0 2024-09-18T01:47:10.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.778+0000 7f3060dd0640 1 --2- 172.21.15.146:0/875159897 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55808eb1f4c0 0x55808ebb3690 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f305800a470 tx=0x7f3058045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=740964d159501854 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.778+0000 7f3053fff640 1 -- 172.21.15.146:0/875159897 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3058053570 con 0x55808eb1f4c0 2024-09-18T01:47:10.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.778+0000 7f3053fff640 1 -- 172.21.15.146:0/875159897 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3058058070 con 0x55808eb1f4c0 2024-09-18T01:47:10.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.778+0000 7f3053fff640 1 -- 172.21.15.146:0/875159897 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3058053880 con 0x55808eb1f4c0 2024-09-18T01:47:10.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.779+0000 7f3065939800 1 -- 172.21.15.146:0/875159897 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55808eb1f4c0 msgr2=0x55808ebb3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.779+0000 7f3065939800 1 --2- 172.21.15.146:0/875159897 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55808eb1f4c0 0x55808ebb3690 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f305800a470 tx=0x7f3058045a20 comp rx=0 tx=0).stop 2024-09-18T01:47:10.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.779+0000 7f3065939800 1 -- 172.21.15.146:0/875159897 shutdown_connections 2024-09-18T01:47:10.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.779+0000 7f3065939800 1 --2- 172.21.15.146:0/875159897 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55808eb1f4c0 0x55808ebb3690 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.779+0000 7f3065939800 1 -- 172.21.15.146:0/875159897 >> 172.21.15.146:0/875159897 conn(0x55808eba5fe0 msgr2=0x55808eba8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:10.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.779+0000 7f3065939800 1 -- 172.21.15.146:0/875159897 shutdown_connections 2024-09-18T01:47:10.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.779+0000 7f3065939800 1 -- 172.21.15.146:0/875159897 wait complete. 2024-09-18T01:47:10.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.792+0000 7f3065939800 1 Processor -- start 2024-09-18T01:47:10.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.793+0000 7f3065939800 1 -- start start 2024-09-18T01:47:10.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.793+0000 7f3065939800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55808eb1f4c0 0x55808ec9bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.793+0000 7f3065939800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55808eaf6360 con 0x55808eb1f4c0 2024-09-18T01:47:10.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.793+0000 7f30615d1640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55808eb1f4c0 0x55808ec9bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.793+0000 7f30615d1640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55808eb1f4c0 0x55808ec9bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37608/0 (socket says 172.21.15.146:37608) 2024-09-18T01:47:10.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.793+0000 7f30615d1640 1 -- 172.21.15.146:0/931248663 learned_addr learned my addr 172.21.15.146:0/931248663 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:10.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.793+0000 7f30615d1640 1 -- 172.21.15.146:0/931248663 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55808ea43bc0 con 0x55808eb1f4c0 2024-09-18T01:47:10.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.793+0000 7f30615d1640 1 --2- 172.21.15.146:0/931248663 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55808eb1f4c0 0x55808ec9bae0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f3054001e10 tx=0x7f305400b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6719ded00a808a20 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.794+0000 7f2f4f606640 1 -- 172.21.15.146:0/931248663 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3054012020 con 0x55808eb1f4c0 2024-09-18T01:47:10.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.794+0000 7f2f4f606640 1 -- 172.21.15.146:0/931248663 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f305400e5a0 con 0x55808eb1f4c0 2024-09-18T01:47:10.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.794+0000 7f2f4f606640 1 -- 172.21.15.146:0/931248663 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f305400e8e0 con 0x55808eb1f4c0 2024-09-18T01:47:10.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.794+0000 7f3065939800 1 -- 172.21.15.146:0/931248663 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55808eb1f4c0 msgr2=0x55808ec9bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.794+0000 7f3065939800 1 --2- 172.21.15.146:0/931248663 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55808eb1f4c0 0x55808ec9bae0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f3054001e10 tx=0x7f305400b780 comp rx=0 tx=0).stop 2024-09-18T01:47:10.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.794+0000 7f3065939800 1 -- 172.21.15.146:0/931248663 shutdown_connections 2024-09-18T01:47:10.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.794+0000 7f3065939800 1 --2- 172.21.15.146:0/931248663 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55808eb1f4c0 0x55808ec9bae0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.794+0000 7f3065939800 1 -- 172.21.15.146:0/931248663 >> 172.21.15.146:0/931248663 conn(0x55808eba5fe0 msgr2=0x55808ec974a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:10.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.794+0000 7f3065939800 1 -- 172.21.15.146:0/931248663 shutdown_connections 2024-09-18T01:47:10.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.794+0000 7f3065939800 1 -- 172.21.15.146:0/931248663 wait complete. 2024-09-18T01:47:10.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.795+0000 7f3065939800 1 Processor -- start 2024-09-18T01:47:10.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.795+0000 7f3065939800 1 -- start start 2024-09-18T01:47:10.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.795+0000 7f3065939800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55808eb1f4c0 0x55808eca34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.795+0000 7f3065939800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55808eb1fbb0 con 0x55808eb1f4c0 2024-09-18T01:47:10.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.795+0000 7f30615d1640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55808eb1f4c0 0x55808eca34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.795+0000 7f30615d1640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55808eb1f4c0 0x55808eca34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37622/0 (socket says 172.21.15.146:37622) 2024-09-18T01:47:10.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.795+0000 7f30615d1640 1 -- 172.21.15.146:0/3255965287 learned_addr learned my addr 172.21.15.146:0/3255965287 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:10.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.795+0000 7f30615d1640 1 -- 172.21.15.146:0/3255965287 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55808ea57fe0 con 0x55808eb1f4c0 2024-09-18T01:47:10.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.795+0000 7f30615d1640 1 --2- 172.21.15.146:0/3255965287 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55808eb1f4c0 0x55808eca34c0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f305400b7c0 tx=0x7f3054000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.796+0000 7f2f4de03640 1 -- 172.21.15.146:0/3255965287 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3054012030 con 0x55808eb1f4c0 2024-09-18T01:47:10.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.796+0000 7f2f4de03640 1 -- 172.21.15.146:0/3255965287 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3054001470 con 0x55808eb1f4c0 2024-09-18T01:47:10.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.796+0000 7f2f4de03640 1 -- 172.21.15.146:0/3255965287 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f305401a8d0 con 0x55808eb1f4c0 2024-09-18T01:47:10.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.796+0000 7f3065939800 1 -- 172.21.15.146:0/3255965287 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55808eca3a00 con 0x55808eb1f4c0 2024-09-18T01:47:10.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.796+0000 7f3065939800 1 -- 172.21.15.146:0/3255965287 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55808eca3f20 con 0x55808eb1f4c0 2024-09-18T01:47:10.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.797+0000 7f2f4de03640 1 -- 172.21.15.146:0/3255965287 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3054015020 con 0x55808eb1f4c0 2024-09-18T01:47:10.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.797+0000 7f2f4de03640 1 --2- 172.21.15.146:0/3255965287 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2f48036b90 0x7f2f48039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.797+0000 7f2f4de03640 1 -- 172.21.15.146:0/3255965287 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f3054020030 con 0x55808eb1f4c0 2024-09-18T01:47:10.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.797+0000 7f3060dd0640 1 --2- 172.21.15.146:0/3255965287 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2f48036b90 0x7f2f48039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.797+0000 7f3065939800 1 --2- 172.21.15.146:0/3255965287 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55808eb205d0 0x55808ecaa530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.797+0000 7f3065939800 1 -- 172.21.15.146:0/3255965287 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55808ecaaa70 con 0x55808eb205d0 2024-09-18T01:47:10.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.797+0000 7f3061dd2640 1 --2- 172.21.15.146:0/3255965287 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55808eb205d0 0x55808ecaa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.797+0000 7f3060dd0640 1 --2- 172.21.15.146:0/3255965287 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2f48036b90 0x7f2f48039050 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3058057000 tx=0x7f3058052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.797+0000 7f3061dd2640 1 --2- 172.21.15.146:0/3255965287 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55808eb205d0 0x55808ecaa530 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.798+0000 7f3061dd2640 1 -- 172.21.15.146:0/3255965287 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f305c00a4a0 con 0x55808eb205d0 2024-09-18T01:47:10.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.798+0000 7f3065939800 1 -- 172.21.15.146:0/3255965287 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55808eca7b00 con 0x55808eb205d0 2024-09-18T01:47:10.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.798+0000 7f3061dd2640 1 -- 172.21.15.146:0/3255965287 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f305c00a4a0 con 0x55808eb205d0 2024-09-18T01:47:10.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.798+0000 7f3065939800 1 -- 172.21.15.146:0/3255965287 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55808ecac8b0 con 0x55808eb205d0 2024-09-18T01:47:10.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.798+0000 7f3061dd2640 1 -- 172.21.15.146:0/3255965287 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f305c00a4a0 con 0x55808eb205d0 2024-09-18T01:47:10.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.798+0000 7f3065939800 1 -- 172.21.15.146:0/3255965287 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55808ecab9f0 con 0x55808eb205d0 2024-09-18T01:47:10.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.799+0000 7f3061dd2640 1 -- 172.21.15.146:0/3255965287 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f305c00a4a0 con 0x55808eb205d0 2024-09-18T01:47:10.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.799+0000 7f3065939800 1 --2- 172.21.15.146:0/3255965287 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55808ecac4c0 0x55808ecafd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.799+0000 7f3065939800 1 -- 172.21.15.146:0/3255965287 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55808ecb04d0 con 0x55808ecac4c0 2024-09-18T01:47:10.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.799+0000 7f30615d1640 1 --2- 172.21.15.146:0/3255965287 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55808ecac4c0 0x55808ecafd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.799+0000 7f30615d1640 1 --2- 172.21.15.146:0/3255965287 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55808ecac4c0 0x55808ecafd40 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.799+0000 7f30615d1640 1 -- 172.21.15.146:0/3255965287 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f305402dcf0 con 0x55808ecac4c0 2024-09-18T01:47:10.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.800+0000 7f3065939800 1 Processor -- start 2024-09-18T01:47:10.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.800+0000 7f3065939800 1 -- start start 2024-09-18T01:47:10.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.800+0000 7f3065939800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55808ecbe240 0x55808ecbe660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.800+0000 7f3065939800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55808ea45580 con 0x55808ecbe240 2024-09-18T01:47:10.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.800+0000 7f3061dd2640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55808ecbe240 0x55808ecbe660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.800+0000 7f3061dd2640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55808ecbe240 0x55808ecbe660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37626/0 (socket says 172.21.15.146:37626) 2024-09-18T01:47:10.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.800+0000 7f3061dd2640 1 -- 172.21.15.146:0/442052857 learned_addr learned my addr 172.21.15.146:0/442052857 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:10.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.800+0000 7f3061dd2640 1 -- 172.21.15.146:0/442052857 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55808ecbeba0 con 0x55808ecbe240 2024-09-18T01:47:10.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.800+0000 7f3061dd2640 1 --2- 172.21.15.146:0/442052857 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55808ecbe240 0x55808ecbe660 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x55808ecaae70 tx=0x7f305c0178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.801+0000 7f2f46ffd640 1 -- 172.21.15.146:0/442052857 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f305c013440 con 0x55808ecbe240 2024-09-18T01:47:10.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.801+0000 7f2f46ffd640 1 -- 172.21.15.146:0/442052857 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f305c0135e0 con 0x55808ecbe240 2024-09-18T01:47:10.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.801+0000 7f2f46ffd640 1 -- 172.21.15.146:0/442052857 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f305c0138c0 con 0x55808ecbe240 2024-09-18T01:47:10.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.801+0000 7f3065939800 1 -- 172.21.15.146:0/442052857 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55808ecbee30 con 0x55808ecbe240 2024-09-18T01:47:10.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.801+0000 7f3065939800 1 -- 172.21.15.146:0/442052857 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55808ecc1b10 con 0x55808ecbe240 2024-09-18T01:47:10.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.801+0000 7f2f46ffd640 1 -- 172.21.15.146:0/442052857 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f305c011040 con 0x55808ecbe240 2024-09-18T01:47:10.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.801+0000 7f2f46ffd640 1 --2- 172.21.15.146:0/442052857 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2f3c036b90 0x7f2f3c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.802+0000 7f2f46ffd640 1 -- 172.21.15.146:0/442052857 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f305c01d070 con 0x55808ecbe240 2024-09-18T01:47:10.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.802+0000 7f30615d1640 1 --2- 172.21.15.146:0/442052857 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2f3c036b90 0x7f2f3c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.802+0000 7f3065939800 1 Processor -- start 2024-09-18T01:47:10.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.802+0000 7f30615d1640 1 --2- 172.21.15.146:0/442052857 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2f3c036b90 0x7f2f3c039050 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f305401a6f0 tx=0x7f305404b030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.802+0000 7f3065939800 1 -- start start 2024-09-18T01:47:10.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.802+0000 7f3065939800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55808eccae50 0x55808eccb250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.802+0000 7f3065939800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55808ec9c290 con 0x55808eccae50 2024-09-18T01:47:10.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.802+0000 7f3061dd2640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55808eccae50 0x55808eccb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.802+0000 7f3061dd2640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55808eccae50 0x55808eccb250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37630/0 (socket says 172.21.15.146:37630) 2024-09-18T01:47:10.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.802+0000 7f3061dd2640 1 -- 172.21.15.146:0/1374973762 learned_addr learned my addr 172.21.15.146:0/1374973762 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:10.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.802+0000 7f3061dd2640 1 -- 172.21.15.146:0/1374973762 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55808eccb820 con 0x55808eccae50 2024-09-18T01:47:10.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.803+0000 7f3061dd2640 1 --2- 172.21.15.146:0/1374973762 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55808eccae50 0x55808eccb250 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f305c04c910 tx=0x7f305c02b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c10d12fcfe824aa5 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.803+0000 7f2f44ff9640 1 -- 172.21.15.146:0/1374973762 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f305c02be10 con 0x55808eccae50 2024-09-18T01:47:10.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.803+0000 7f2f44ff9640 1 -- 172.21.15.146:0/1374973762 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f305c021a50 con 0x55808eccae50 2024-09-18T01:47:10.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.803+0000 7f2f44ff9640 1 -- 172.21.15.146:0/1374973762 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f305c04e0d0 con 0x55808eccae50 2024-09-18T01:47:10.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.803+0000 7f3065939800 1 -- 172.21.15.146:0/1374973762 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55808eccae50 msgr2=0x55808eccb250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.803+0000 7f3065939800 1 --2- 172.21.15.146:0/1374973762 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55808eccae50 0x55808eccb250 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f305c04c910 tx=0x7f305c02b9d0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.803+0000 7f3065939800 1 -- 172.21.15.146:0/1374973762 shutdown_connections 2024-09-18T01:47:10.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.803+0000 7f3065939800 1 --2- 172.21.15.146:0/1374973762 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55808eccae50 0x55808eccb250 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.803+0000 7f3065939800 1 -- 172.21.15.146:0/1374973762 >> 172.21.15.146:0/1374973762 conn(0x55808ecc71f0 msgr2=0x55808ecc52f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:10.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.803+0000 7f3065939800 1 -- 172.21.15.146:0/1374973762 shutdown_connections 2024-09-18T01:47:10.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.803+0000 7f3065939800 1 -- 172.21.15.146:0/1374973762 wait complete. 2024-09-18T01:47:10.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.804+0000 7f3065939800 1 Processor -- start 2024-09-18T01:47:10.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.804+0000 7f3065939800 1 -- start start 2024-09-18T01:47:10.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.804+0000 7f3065939800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55808eccae50 0x55808ecd22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.804+0000 7f3065939800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55808eccbe40 con 0x55808eccae50 2024-09-18T01:47:10.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.804+0000 7f3061dd2640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55808eccae50 0x55808ecd22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.804+0000 7f3061dd2640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55808eccae50 0x55808ecd22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37640/0 (socket says 172.21.15.146:37640) 2024-09-18T01:47:10.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.804+0000 7f3061dd2640 1 -- 172.21.15.146:0/4106192750 learned_addr learned my addr 172.21.15.146:0/4106192750 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:10.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.804+0000 7f3061dd2640 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55808ecd2810 con 0x55808eccae50 2024-09-18T01:47:10.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.804+0000 7f3061dd2640 1 --2- 172.21.15.146:0/4106192750 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55808eccae50 0x55808ecd22d0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f305c02ba10 tx=0x7f305c04c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.804+0000 7f2f32ffd640 1 -- 172.21.15.146:0/4106192750 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f305c02be10 con 0x55808eccae50 2024-09-18T01:47:10.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.804+0000 7f2f32ffd640 1 -- 172.21.15.146:0/4106192750 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f305c04b500 con 0x55808eccae50 2024-09-18T01:47:10.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.804+0000 7f3065939800 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55808ecd2aa0 con 0x55808eccae50 2024-09-18T01:47:10.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.804+0000 7f2f32ffd640 1 -- 172.21.15.146:0/4106192750 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f305c012df0 con 0x55808eccae50 2024-09-18T01:47:10.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.805+0000 7f3065939800 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55808ecd5750 con 0x55808eccae50 2024-09-18T01:47:10.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.805+0000 7f2f32ffd640 1 -- 172.21.15.146:0/4106192750 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f305c013a60 con 0x55808eccae50 2024-09-18T01:47:10.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.805+0000 7f2f32ffd640 1 --2- 172.21.15.146:0/4106192750 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2f2c036b40 0x7f2f2c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.805+0000 7f2f32ffd640 1 -- 172.21.15.146:0/4106192750 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f305c046050 con 0x55808eccae50 2024-09-18T01:47:10.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.805+0000 7f30615d1640 1 --2- 172.21.15.146:0/4106192750 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2f2c036b40 0x7f2f2c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.806+0000 7f30615d1640 1 --2- 172.21.15.146:0/4106192750 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2f2c036b40 0x7f2f2c039000 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f30540446c0 tx=0x7f3054037000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.806+0000 7f3065939800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.806+0000 7f3065939800 1 --2- 172.21.15.146:0/4106192750 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55808ecdddc0 0x55808ece0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.806+0000 7f3065939800 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55808ece09d0 con 0x55808ecdddc0 2024-09-18T01:47:10.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.806+0000 7f3060dd0640 1 --2- 172.21.15.146:0/4106192750 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55808ecdddc0 0x55808ece0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.806+0000 7f3060dd0640 1 --2- 172.21.15.146:0/4106192750 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55808ecdddc0 0x55808ece0280 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.807+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3058051070 con 0x55808ecdddc0 2024-09-18T01:47:10.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.807+0000 7f3065939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:10.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.807+0000 7f3065939800 20 realm 2024-09-18T01:47:10.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.807+0000 7f3065939800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.807+0000 7f3065939800 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55808ece0e00 con 0x55808ecdddc0 2024-09-18T01:47:10.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.807+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3058051070 con 0x55808ecdddc0 2024-09-18T01:47:10.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.807+0000 7f3065939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:10.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.807+0000 7f3065939800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:47:10.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.807+0000 7f3065939800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.807+0000 7f3065939800 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55808ece16d0 con 0x55808ecdddc0 2024-09-18T01:47:10.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.807+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3058051070 con 0x55808ecdddc0 2024-09-18T01:47:10.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.807+0000 7f3065939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:10.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.807+0000 7f3065939800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.807+0000 7f3065939800 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55808ece1a70 con 0x55808ecdddc0 2024-09-18T01:47:10.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.807+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3058051070 con 0x55808ecdddc0 2024-09-18T01:47:10.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.807+0000 7f3065939800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:47:10.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.807+0000 7f3065939800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.807+0000 7f3065939800 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55808ece22c0 con 0x55808ecdddc0 2024-09-18T01:47:10.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.808+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3058051070 con 0x55808ecdddc0 2024-09-18T01:47:10.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.808+0000 7f3065939800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:47:10.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.808+0000 7f3065939800 20 searching for the correct realm 2024-09-18T01:47:10.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.808+0000 7f3065939800 1 --2- 172.21.15.146:0/4106192750 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55808ece4030 0x55808ece6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.808+0000 7f3065939800 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55808ece6a50 con 0x55808ece4030 2024-09-18T01:47:10.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.808+0000 7f3061dd2640 1 --2- 172.21.15.146:0/4106192750 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55808ece4030 0x55808ece6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.808+0000 7f3061dd2640 1 --2- 172.21.15.146:0/4106192750 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55808ece4030 0x55808ece6420 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.808+0000 7f3061dd2640 1 -- 172.21.15.146:0/4106192750 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f305c03f020 con 0x55808ece4030 2024-09-18T01:47:10.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.808+0000 7f3061dd2640 1 --2- 172.21.15.146:0/4106192750 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f305c05b040 0x7f305c0383b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.808+0000 7f3061dd2640 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55808ece6a50 con 0x7f305c05b040 2024-09-18T01:47:10.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.808+0000 7f30615d1640 1 --2- 172.21.15.146:0/4106192750 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f305c05b040 0x7f305c0383b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.809+0000 7f30615d1640 1 --2- 172.21.15.146:0/4106192750 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f305c05b040 0x7f305c0383b0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.809+0000 7f30615d1640 1 -- 172.21.15.146:0/4106192750 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f305402dcf0 con 0x7f305c05b040 2024-09-18T01:47:10.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.809+0000 7f30615d1640 1 --2- 172.21.15.146:0/4106192750 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f3054017050 0x7f30540405b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.809+0000 7f30615d1640 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55808ece6a50 con 0x7f3054017050 2024-09-18T01:47:10.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.809+0000 7f3060dd0640 1 --2- 172.21.15.146:0/4106192750 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f3054017050 0x7f30540405b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.809+0000 7f3060dd0640 1 --2- 172.21.15.146:0/4106192750 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f3054017050 0x7f30540405b0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.810+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3058051070 con 0x7f3054017050 2024-09-18T01:47:10.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.810+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55808ece6a50 con 0x55808ecdddc0 2024-09-18T01:47:10.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.810+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v33'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3058051070 con 0x55808ecdddc0 2024-09-18T01:47:10.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.810+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55808ece6a50 con 0x55808ecdddc0 2024-09-18T01:47:10.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.810+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3058051070 con 0x55808ecdddc0 2024-09-18T01:47:10.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.810+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55808ece6a50 con 0x7f3054017050 2024-09-18T01:47:10.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.810+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3058051070 con 0x7f3054017050 2024-09-18T01:47:10.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.810+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55808ece6a50 con 0x7f3054017050 2024-09-18T01:47:10.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.811+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3058051070 con 0x7f3054017050 2024-09-18T01:47:10.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.811+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55808ece6a50 con 0x7f305c05b040 2024-09-18T01:47:10.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.811+0000 7f30615d1640 1 -- 172.21.15.146:0/4106192750 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f305402dcf0 con 0x7f305c05b040 2024-09-18T01:47:10.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.811+0000 7f30615d1640 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55808ece6a50 con 0x55808ece4030 2024-09-18T01:47:10.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.811+0000 7f3061dd2640 1 -- 172.21.15.146:0/4106192750 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f305c03f020 con 0x55808ece4030 2024-09-18T01:47:10.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.811+0000 7f3061dd2640 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55808ece6a50 con 0x55808ecdddc0 2024-09-18T01:47:10.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.811+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3058051070 con 0x55808ecdddc0 2024-09-18T01:47:10.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.811+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55808ece6a50 con 0x7f3054017050 2024-09-18T01:47:10.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.811+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3058051070 con 0x7f3054017050 2024-09-18T01:47:10.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.811+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55808ece6a50 con 0x55808ecdddc0 2024-09-18T01:47:10.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.812+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3058051070 con 0x55808ecdddc0 2024-09-18T01:47:10.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.812+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55808ece6a50 con 0x7f305c05b040 2024-09-18T01:47:10.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.812+0000 7f30615d1640 1 -- 172.21.15.146:0/4106192750 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f305402dcf0 con 0x7f305c05b040 2024-09-18T01:47:10.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.812+0000 7f30615d1640 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55808ece6a50 con 0x55808ece4030 2024-09-18T01:47:10.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.812+0000 7f3061dd2640 1 -- 172.21.15.146:0/4106192750 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f305c03f020 con 0x55808ece4030 2024-09-18T01:47:10.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.812+0000 7f3061dd2640 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55808ece6a50 con 0x55808ece4030 2024-09-18T01:47:10.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.812+0000 7f3061dd2640 1 -- 172.21.15.146:0/4106192750 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f305c03f020 con 0x55808ece4030 2024-09-18T01:47:10.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.812+0000 7f3061dd2640 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55808ece6a50 con 0x7f3054017050 2024-09-18T01:47:10.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.813+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3058051070 con 0x7f3054017050 2024-09-18T01:47:10.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.813+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55808ece6a50 con 0x55808ece4030 2024-09-18T01:47:10.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.813+0000 7f3061dd2640 1 -- 172.21.15.146:0/4106192750 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f305c03f020 con 0x55808ece4030 2024-09-18T01:47:10.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.813+0000 7f3061dd2640 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55808ece6a50 con 0x55808ece4030 2024-09-18T01:47:10.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.813+0000 7f3061dd2640 1 -- 172.21.15.146:0/4106192750 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f305c068040 con 0x55808ece4030 2024-09-18T01:47:10.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.813+0000 7f3061dd2640 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55808ece6a50 con 0x55808ecdddc0 2024-09-18T01:47:10.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.813+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3058051070 con 0x55808ecdddc0 2024-09-18T01:47:10.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.813+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55808ece6a50 con 0x55808ecdddc0 2024-09-18T01:47:10.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.814+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v33'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3058051070 con 0x55808ecdddc0 2024-09-18T01:47:10.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.814+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55808ece6a50 con 0x7f3054017050 2024-09-18T01:47:10.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.814+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3058051070 con 0x7f3054017050 2024-09-18T01:47:10.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.814+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55808ece6a50 con 0x55808ece4030 2024-09-18T01:47:10.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.814+0000 7f3061dd2640 1 -- 172.21.15.146:0/4106192750 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f305c068040 con 0x55808ece4030 2024-09-18T01:47:10.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.814+0000 7f3061dd2640 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55808ece6a50 con 0x7f305c05b040 2024-09-18T01:47:10.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.814+0000 7f30615d1640 1 -- 172.21.15.146:0/4106192750 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f305402dcf0 con 0x7f305c05b040 2024-09-18T01:47:10.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.814+0000 7f30615d1640 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55808ece6a50 con 0x55808ecdddc0 2024-09-18T01:47:10.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.814+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3058051070 con 0x55808ecdddc0 2024-09-18T01:47:10.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.815+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55808ece6a50 con 0x7f3054017050 2024-09-18T01:47:10.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.815+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3058051070 con 0x7f3054017050 2024-09-18T01:47:10.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.815+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55808ece6a50 con 0x55808ece4030 2024-09-18T01:47:10.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.815+0000 7f3061dd2640 1 -- 172.21.15.146:0/4106192750 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f305c068040 con 0x55808ece4030 2024-09-18T01:47:10.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.815+0000 7f3061dd2640 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55808ece6a50 con 0x7f3054017050 2024-09-18T01:47:10.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.815+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3058051070 con 0x7f3054017050 2024-09-18T01:47:10.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.815+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55808ece6a50 con 0x7f305c05b040 2024-09-18T01:47:10.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.816+0000 7f30615d1640 1 -- 172.21.15.146:0/4106192750 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f305402dcf0 con 0x7f305c05b040 2024-09-18T01:47:10.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.816+0000 7f30615d1640 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55808ece6a50 con 0x55808ece4030 2024-09-18T01:47:10.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.816+0000 7f3061dd2640 1 -- 172.21.15.146:0/4106192750 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f305c068040 con 0x55808ece4030 2024-09-18T01:47:10.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.816+0000 7f3061dd2640 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55808ece6a50 con 0x7f3054017050 2024-09-18T01:47:10.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.816+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3058051070 con 0x7f3054017050 2024-09-18T01:47:10.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.816+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55808ece6a50 con 0x55808ecdddc0 2024-09-18T01:47:10.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.816+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v33'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3058051070 con 0x55808ecdddc0 2024-09-18T01:47:10.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.816+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55808ece6a50 con 0x7f305c05b040 2024-09-18T01:47:10.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.816+0000 7f30615d1640 1 -- 172.21.15.146:0/4106192750 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f305402dcf0 con 0x7f305c05b040 2024-09-18T01:47:10.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.816+0000 7f3065939800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:47:10.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.816+0000 7f3065939800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:47:10.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.816+0000 7f3065939800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:47:10.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.816+0000 7f3065939800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:47:10.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.816+0000 7f3065939800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:47:10.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.816+0000 7f3065939800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:47:10.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.816+0000 7f3065939800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.816+0000 7f3065939800 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55808ece2c70 con 0x55808ecdddc0 2024-09-18T01:47:10.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.817+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3058051070 con 0x55808ecdddc0 2024-09-18T01:47:10.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.817+0000 7f3065939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:10.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.817+0000 7f3065939800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.817+0000 7f3065939800 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55808ece3510 con 0x55808ecdddc0 2024-09-18T01:47:10.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.817+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3058051070 con 0x55808ecdddc0 2024-09-18T01:47:10.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.817+0000 7f3065939800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:47:10.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.817+0000 7f3065939800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.817+0000 7f3065939800 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55808ece6ed0 con 0x7f305c05b040 2024-09-18T01:47:10.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.817+0000 7f30615d1640 1 -- 172.21.15.146:0/4106192750 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f305402dcf0 con 0x7f305c05b040 2024-09-18T01:47:10.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.817+0000 7f3065939800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:47:10.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.817+0000 7f3065939800 20 zone default found 2024-09-18T01:47:10.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.817+0000 7f3065939800 4 Realm: () 2024-09-18T01:47:10.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.817+0000 7f3065939800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:47:10.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.817+0000 7f3065939800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:47:10.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.817+0000 7f3065939800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:47:10.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.817+0000 7f3065939800 20 zonegroup default 2024-09-18T01:47:10.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.817+0000 7f3065939800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.817+0000 7f3065939800 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55808ece7720 con 0x7f3054017050 2024-09-18T01:47:10.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.818+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3058051070 con 0x7f3054017050 2024-09-18T01:47:10.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.818+0000 7f3065939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:10.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.818+0000 7f3065939800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.818+0000 7f3065939800 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55808ece9100 con 0x55808ece4030 2024-09-18T01:47:10.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.818+0000 7f3061dd2640 1 -- 172.21.15.146:0/4106192750 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f305c068040 con 0x55808ece4030 2024-09-18T01:47:10.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.818+0000 7f3065939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:10.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.818+0000 7f3065939800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.818+0000 7f3065939800 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55808ece9610 con 0x55808ece4030 2024-09-18T01:47:10.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.818+0000 7f3061dd2640 1 -- 172.21.15.146:0/4106192750 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f305c068040 con 0x55808ece4030 2024-09-18T01:47:10.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.818+0000 7f3065939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:10.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.818+0000 7f3065939800 20 started sync module instance, tier type = 2024-09-18T01:47:10.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.818+0000 7f3065939800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:47:10.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.818+0000 7f3065939800 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55808ece8590 con 0x7f305c05b040 2024-09-18T01:47:10.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.819+0000 7f30615d1640 1 -- 172.21.15.146:0/4106192750 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v33'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f305402dcf0 con 0x7f305c05b040 2024-09-18T01:47:10.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.819+0000 7f3065939800 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94010640075136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55808ece9f20 con 0x7f305c05b040 2024-09-18T01:47:10.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.819+0000 7f3065939800 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55808ecea770 con 0x55808ecdddc0 2024-09-18T01:47:10.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.820+0000 7f30615d1640 1 -- 172.21.15.146:0/4106192750 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94010640075136] v33'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f305402dcf0 con 0x7f305c05b040 2024-09-18T01:47:10.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.820+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v33'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3058051070 con 0x55808ecdddc0 2024-09-18T01:47:10.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.820+0000 7f3065939800 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94010640079472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55808ecea770 con 0x55808ecdddc0 2024-09-18T01:47:10.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.820+0000 7f3065939800 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55808eceb290 con 0x55808ece4030 2024-09-18T01:47:10.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.822+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94010640079472] v33'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3058051070 con 0x55808ecdddc0 2024-09-18T01:47:10.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.822+0000 7f3061dd2640 1 -- 172.21.15.146:0/4106192750 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v33'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f305c068040 con 0x55808ece4030 2024-09-18T01:47:10.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.822+0000 7f3065939800 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94010640081600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55808ecea6e0 con 0x55808ece4030 2024-09-18T01:47:10.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.822+0000 7f3065939800 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55808ecec150 con 0x7f305c05b040 2024-09-18T01:47:10.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.823+0000 7f30615d1640 1 -- 172.21.15.146:0/4106192750 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v33'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f305402dcf0 con 0x7f305c05b040 2024-09-18T01:47:10.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.823+0000 7f3065939800 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94010640088224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55808ecec9a0 con 0x7f305c05b040 2024-09-18T01:47:10.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.823+0000 7f3065939800 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55808eced420 con 0x55808ecdddc0 2024-09-18T01:47:10.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.823+0000 7f3061dd2640 1 -- 172.21.15.146:0/4106192750 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94010640081600] v33'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f305c068040 con 0x55808ece4030 2024-09-18T01:47:10.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.824+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v33'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3058051070 con 0x55808ecdddc0 2024-09-18T01:47:10.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.824+0000 7f3065939800 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94010640092944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55808eced810 con 0x55808ecdddc0 2024-09-18T01:47:10.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.824+0000 7f3065939800 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55808ecee250 con 0x7f3054017050 2024-09-18T01:47:10.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.824+0000 7f30615d1640 1 -- 172.21.15.146:0/4106192750 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94010640088224] v33'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f305402dcf0 con 0x7f305c05b040 2024-09-18T01:47:10.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.825+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94010640092944] v33'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3058051070 con 0x55808ecdddc0 2024-09-18T01:47:10.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.825+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v33'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3058051070 con 0x7f3054017050 2024-09-18T01:47:10.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.825+0000 7f3065939800 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94010640086656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55808ecee210 con 0x7f3054017050 2024-09-18T01:47:10.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.825+0000 7f3065939800 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55808eceeaf0 con 0x7f3054017050 2024-09-18T01:47:10.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.826+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94010640086656] v33'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3058051070 con 0x7f3054017050 2024-09-18T01:47:10.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.826+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v33'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3058051070 con 0x7f3054017050 2024-09-18T01:47:10.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.826+0000 7f3065939800 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94010640096544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55808ecee210 con 0x7f3054017050 2024-09-18T01:47:10.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.826+0000 7f3065939800 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55808ecef110 con 0x7f3054017050 2024-09-18T01:47:10.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.827+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(58 notify.7 [create] v33'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3058051070 con 0x7f3054017050 2024-09-18T01:47:10.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.827+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94010640096544] v33'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3058051070 con 0x7f3054017050 2024-09-18T01:47:10.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.827+0000 7f3065939800 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94010640100448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55808ecef080 con 0x7f3054017050 2024-09-18T01:47:10.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.827+0000 7f3065939800 20 add_watcher() i=0 2024-09-18T01:47:10.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.827+0000 7f3065939800 20 add_watcher() i=1 2024-09-18T01:47:10.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.827+0000 7f3065939800 20 add_watcher() i=2 2024-09-18T01:47:10.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.827+0000 7f3065939800 20 add_watcher() i=3 2024-09-18T01:47:10.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.827+0000 7f3065939800 20 add_watcher() i=4 2024-09-18T01:47:10.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.827+0000 7f3065939800 20 add_watcher() i=5 2024-09-18T01:47:10.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.827+0000 7f3065939800 20 add_watcher() i=6 2024-09-18T01:47:10.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.828+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94010640100448] v33'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3058051070 con 0x7f3054017050 2024-09-18T01:47:10.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.828+0000 7f3065939800 20 add_watcher() i=7 2024-09-18T01:47:10.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.828+0000 7f3065939800 2 all 8 watchers are set, enabling cache 2024-09-18T01:47:10.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.828+0000 7f3065939800 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55808ecf24e0 con 0x55808ecdddc0 2024-09-18T01:47:10.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.828+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3058051070 con 0x55808ecdddc0 2024-09-18T01:47:10.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.828+0000 7f3065939800 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94010640098800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55808ecef990 con 0x55808ecdddc0 2024-09-18T01:47:10.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.829+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94010640098800] v33'263 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3058051070 con 0x55808ecdddc0 2024-09-18T01:47:10.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.829+0000 7f2f177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:47:10.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.829+0000 7f3065939800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:47:10.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.829+0000 7f3065939800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:47:10.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.830+0000 7f3065939800 5 note: GC not initialized 2024-09-18T01:47:10.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.830+0000 7f2f167e4640 20 reqs_thread_entry: start 2024-09-18T01:47:10.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.830+0000 7f3065939800 20 init_complete bucket index max shards: 11 2024-09-18T01:47:10.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.830+0000 7f3065939800 20 Filter name: none 2024-09-18T01:47:10.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.830+0000 7f2e87fff640 20 reqs_thread_entry: start 2024-09-18T01:47:10.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.830+0000 7f3065939800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-18T01:47:10.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.830+0000 7f3065939800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.830+0000 7f3065939800 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55808ed258d0 con 0x7f3054017050 2024-09-18T01:47:10.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.831+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f3058051070 con 0x7f3054017050 2024-09-18T01:47:10.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.831+0000 7f3065939800 20 rados_obj.operate() r=0 bl.length=460 2024-09-18T01:47:10.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.831+0000 7f3065939800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-18T01:47:10.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.831+0000 7f3065939800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:47:10.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.831+0000 7f3065939800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:47:10.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.831+0000 7f3065939800 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55808ed2bfb0 con 0x7f3054017050 2024-09-18T01:47:10.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.832+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v33'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f3058051070 con 0x7f3054017050 2024-09-18T01:47:10.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.832+0000 7f3065939800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T01:47:10.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.832+0000 7f3065939800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:47:10.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.832+0000 7f3065939800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-18T01:47:10.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.832+0000 7f3065939800 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94010640349552 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55808ed275f0 con 0x55808ecdddc0 2024-09-18T01:47:10.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.832+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== watch-notify(notify (1) cookie 94010640092944 notify 141733920796 ret 0) ==== 708+0+0 (crc 0 0 0) 0x55808ea71e00 con 0x55808ecdddc0 2024-09-18T01:47:10.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.832+0000 7f2f44ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920796 cookie 94010640092944 notifier 4880 bl.length()=666 2024-09-18T01:47:10.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.832+0000 7f2f44ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T01:47:10.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.832+0000 7f2f44ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:47:10.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.832+0000 7f2f44ff9640 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f2f24003ea0 con 0x55808ecdddc0 2024-09-18T01:47:10.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.832+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(64 notify.4 [notify cookie 94010640349552 out=8b] v0'0 uv258 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3058051070 con 0x55808ecdddc0 2024-09-18T01:47:10.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.833+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== watch-notify(notify_complete (2) cookie 94010640349552 notify 141733920796 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f305805f420 con 0x55808ecdddc0 2024-09-18T01:47:10.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.833+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3058051070 con 0x55808ecdddc0 2024-09-18T01:47:10.854 INFO:teuthology.orchestra.run.smithi146.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-18T01:47:09.882428Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"read"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:47:09.882414Z","tags":[],"group_ids":[]} 2024-09-18T01:47:10.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.833+0000 7f2f177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:47:10.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.833+0000 7f3065939800 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94010640098800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55808ed235f0 con 0x55808ecdddc0 2024-09-18T01:47:10.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.834+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94010640098800] v33'264 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3058051070 con 0x55808ecdddc0 2024-09-18T01:47:10.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.834+0000 7f3065939800 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94010640075136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55808ed235f0 con 0x7f305c05b040 2024-09-18T01:47:10.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.835+0000 7f30615d1640 1 -- 172.21.15.146:0/4106192750 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94010640075136] v33'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f305402dcf0 con 0x7f305c05b040 2024-09-18T01:47:10.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.836+0000 7f3065939800 20 remove_watcher() i=0 2024-09-18T01:47:10.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.836+0000 7f3065939800 2 removed watcher, disabling cache 2024-09-18T01:47:10.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.836+0000 7f3065939800 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94010640079472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55808ed235f0 con 0x55808ecdddc0 2024-09-18T01:47:10.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.837+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94010640079472] v33'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3058051070 con 0x55808ecdddc0 2024-09-18T01:47:10.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.837+0000 7f3065939800 20 remove_watcher() i=1 2024-09-18T01:47:10.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.837+0000 7f3065939800 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94010640081600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55808ed235f0 con 0x55808ece4030 2024-09-18T01:47:10.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.838+0000 7f3061dd2640 1 -- 172.21.15.146:0/4106192750 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94010640081600] v33'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f305c068040 con 0x55808ece4030 2024-09-18T01:47:10.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.838+0000 7f3065939800 20 remove_watcher() i=2 2024-09-18T01:47:10.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.838+0000 7f3065939800 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94010640088224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55808ed235f0 con 0x7f305c05b040 2024-09-18T01:47:10.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.839+0000 7f30615d1640 1 -- 172.21.15.146:0/4106192750 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94010640088224] v33'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f305402dcf0 con 0x7f305c05b040 2024-09-18T01:47:10.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.839+0000 7f3065939800 20 remove_watcher() i=3 2024-09-18T01:47:10.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.839+0000 7f3065939800 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94010640092944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55808ed235f0 con 0x55808ecdddc0 2024-09-18T01:47:10.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.840+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 <== osd.1 v2:172.21.15.146:6808/3930274777 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94010640092944] v33'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3058051070 con 0x55808ecdddc0 2024-09-18T01:47:10.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.840+0000 7f3065939800 20 remove_watcher() i=4 2024-09-18T01:47:10.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.840+0000 7f3065939800 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94010640086656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55808ed235f0 con 0x7f3054017050 2024-09-18T01:47:10.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.841+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94010640086656] v33'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3058051070 con 0x7f3054017050 2024-09-18T01:47:10.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.841+0000 7f3065939800 20 remove_watcher() i=5 2024-09-18T01:47:10.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.841+0000 7f3065939800 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94010640096544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55808ed235f0 con 0x7f3054017050 2024-09-18T01:47:10.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.842+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94010640096544] v33'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3058051070 con 0x7f3054017050 2024-09-18T01:47:10.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.842+0000 7f3065939800 20 remove_watcher() i=6 2024-09-18T01:47:10.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.842+0000 7f3065939800 1 -- 172.21.15.146:0/4106192750 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94010640100448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55808ed235f0 con 0x7f3054017050 2024-09-18T01:47:10.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.843+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94010640100448] v33'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3058051070 con 0x7f3054017050 2024-09-18T01:47:10.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.843+0000 7f3065939800 20 remove_watcher() i=7 2024-09-18T01:47:10.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.843+0000 7f3065939800 1 -- 172.21.15.146:0/4106192750 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f3054017050 msgr2=0x7f30540405b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.843+0000 7f3065939800 1 --2- 172.21.15.146:0/4106192750 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f3054017050 0x7f30540405b0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.843+0000 7f3065939800 1 -- 172.21.15.146:0/4106192750 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55808ecdddc0 msgr2=0x55808ece0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.843+0000 7f3065939800 1 --2- 172.21.15.146:0/4106192750 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55808ecdddc0 0x55808ece0280 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.843+0000 7f3065939800 1 -- 172.21.15.146:0/4106192750 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f305c05b040 msgr2=0x7f305c0383b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.843+0000 7f3065939800 1 --2- 172.21.15.146:0/4106192750 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f305c05b040 0x7f305c0383b0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.843+0000 7f3065939800 1 -- 172.21.15.146:0/4106192750 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55808ece4030 msgr2=0x55808ece6420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.843+0000 7f3065939800 1 --2- 172.21.15.146:0/4106192750 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55808ece4030 0x55808ece6420 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.843+0000 7f3065939800 1 -- 172.21.15.146:0/4106192750 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2f2c036b40 msgr2=0x7f2f2c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.843+0000 7f3065939800 1 --2- 172.21.15.146:0/4106192750 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2f2c036b40 0x7f2f2c039000 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f30540446c0 tx=0x7f3054037000 comp rx=0 tx=0).stop 2024-09-18T01:47:10.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.843+0000 7f3065939800 1 -- 172.21.15.146:0/4106192750 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55808eccae50 msgr2=0x55808ecd22d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.843+0000 7f3060dd0640 1 -- 172.21.15.146:0/4106192750 reap_dead start 2024-09-18T01:47:10.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.843+0000 7f3065939800 1 --2- 172.21.15.146:0/4106192750 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55808eccae50 0x55808ecd22d0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f305c02ba10 tx=0x7f305c04c870 comp rx=0 tx=0).stop 2024-09-18T01:47:10.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.843+0000 7f3065939800 1 -- 172.21.15.146:0/4106192750 shutdown_connections 2024-09-18T01:47:10.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.843+0000 7f3065939800 1 --2- 172.21.15.146:0/4106192750 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55808eccae50 0x55808ecd22d0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.843+0000 7f3065939800 1 -- 172.21.15.146:0/4106192750 >> 172.21.15.146:0/4106192750 conn(0x55808ecc71f0 msgr2=0x55808ecc52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:10.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.843+0000 7f3065939800 1 -- 172.21.15.146:0/4106192750 shutdown_connections 2024-09-18T01:47:10.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.843+0000 7f3065939800 1 -- 172.21.15.146:0/4106192750 wait complete. 2024-09-18T01:47:10.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.844+0000 7f3065939800 1 -- 172.21.15.146:0/442052857 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2f3c036b90 msgr2=0x7f2f3c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.844+0000 7f3065939800 1 --2- 172.21.15.146:0/442052857 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2f3c036b90 0x7f2f3c039050 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f305401a6f0 tx=0x7f305404b030 comp rx=0 tx=0).stop 2024-09-18T01:47:10.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.844+0000 7f3065939800 1 -- 172.21.15.146:0/442052857 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55808ecbe240 msgr2=0x55808ecbe660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.844+0000 7f3065939800 1 --2- 172.21.15.146:0/442052857 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55808ecbe240 0x55808ecbe660 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x55808ecaae70 tx=0x7f305c0178e0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.844+0000 7f3065939800 1 -- 172.21.15.146:0/442052857 shutdown_connections 2024-09-18T01:47:10.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.844+0000 7f3065939800 1 --2- 172.21.15.146:0/442052857 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2f3c036b90 0x7f2f3c039050 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.844+0000 7f3065939800 1 --2- 172.21.15.146:0/442052857 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55808ecbe240 0x55808ecbe660 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.844+0000 7f3065939800 1 -- 172.21.15.146:0/442052857 >> 172.21.15.146:0/442052857 conn(0x55808ecb31d0 msgr2=0x55808ecb5d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:10.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.844+0000 7f3065939800 1 -- 172.21.15.146:0/442052857 shutdown_connections 2024-09-18T01:47:10.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.844+0000 7f3065939800 1 -- 172.21.15.146:0/442052857 wait complete. 2024-09-18T01:47:10.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.844+0000 7f3065939800 1 -- 172.21.15.146:0/3255965287 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55808eb205d0 msgr2=0x55808ecaa530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.844+0000 7f3065939800 1 --2- 172.21.15.146:0/3255965287 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55808eb205d0 0x55808ecaa530 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.844+0000 7f3065939800 1 -- 172.21.15.146:0/3255965287 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55808ecac4c0 msgr2=0x55808ecafd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.844+0000 7f3065939800 1 --2- 172.21.15.146:0/3255965287 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55808ecac4c0 0x55808ecafd40 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.844+0000 7f3065939800 1 -- 172.21.15.146:0/3255965287 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2f48036b90 msgr2=0x7f2f48039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.844+0000 7f3065939800 1 --2- 172.21.15.146:0/3255965287 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2f48036b90 0x7f2f48039050 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3058057000 tx=0x7f3058052000 comp rx=0 tx=0).stop 2024-09-18T01:47:10.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.844+0000 7f3065939800 1 -- 172.21.15.146:0/3255965287 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55808eb1f4c0 msgr2=0x55808eca34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.844+0000 7f3065939800 1 --2- 172.21.15.146:0/3255965287 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55808eb1f4c0 0x55808eca34c0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f305400b7c0 tx=0x7f3054000ed0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.844+0000 7f3065939800 1 -- 172.21.15.146:0/3255965287 shutdown_connections 2024-09-18T01:47:10.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.844+0000 7f3065939800 1 --2- 172.21.15.146:0/3255965287 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55808ecac4c0 0x55808ecafd40 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.844+0000 7f3065939800 1 --2- 172.21.15.146:0/3255965287 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55808eb205d0 0x55808ecaa530 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.844+0000 7f3065939800 1 --2- 172.21.15.146:0/3255965287 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f2f48036b90 0x7f2f48039050 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.844+0000 7f3065939800 1 --2- 172.21.15.146:0/3255965287 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55808eb1f4c0 0x55808eca34c0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.844+0000 7f3065939800 1 -- 172.21.15.146:0/3255965287 >> 172.21.15.146:0/3255965287 conn(0x55808eba5fe0 msgr2=0x55808ec95d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:10.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.844+0000 7f3065939800 1 -- 172.21.15.146:0/3255965287 shutdown_connections 2024-09-18T01:47:10.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.844+0000 7f3065939800 1 -- 172.21.15.146:0/3255965287 wait complete. 2024-09-18T01:47:10.866 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T01:47:09.882428Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:47:09.882414Z', 'tags': [], 'group_ids': []} 2024-09-18T01:47:10.866 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T01:47:09.882428Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:47:09.882414Z', 'tags': [], 'group_ids': []} 2024-09-18T01:47:10.866 ERROR:root:0 2024-09-18T01:47:10.866 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-18T01:47:10.870 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T01:47:10.870 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-09-18T01:47:10.871 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-09-18T01:47:10.871 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'user-info-without-keys=*' 2024-09-18T01:47:10.917 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:47:10.917 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:47:10.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.917+0000 7ff3841af800 1 Processor -- start 2024-09-18T01:47:10.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.917+0000 7ff3841af800 1 -- start start 2024-09-18T01:47:10.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.917+0000 7ff3841af800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x5562f8297900 0x5562f8299cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.917+0000 7ff3841af800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5562f8152b30 con 0x5562f8207650 2024-09-18T01:47:10.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.917+0000 7ff3841af800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x5562f8134360 con 0x5562f8297900 2024-09-18T01:47:10.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.918+0000 7ff37bfff640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x5562f8297900 0x5562f8299cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.918+0000 7ff381ca3640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x5562f8207650 0x5562f82961e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:53120/0 (socket says 172.21.15.146:53120) 2024-09-18T01:47:10.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.918+0000 7ff37bfff640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x5562f8297900 0x5562f8299cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37644/0 (socket says 172.21.15.146:37644) 2024-09-18T01:47:10.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.918+0000 7ff381ca3640 1 -- 172.21.15.146:0/2535879366 learned_addr learned my addr 172.21.15.146:0/2535879366 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:47:10.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.918+0000 7ff37bfff640 1 -- 172.21.15.146:0/2535879366 >> v1:172.21.15.129:6789/0 conn(0x5562f8207650 legacy=0x5562f82961e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.918+0000 7ff37bfff640 1 -- 172.21.15.146:0/2535879366 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562f815ae00 con 0x5562f8297900 2024-09-18T01:47:10.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.918+0000 7ff3814a2640 1 -- 172.21.15.146:0/2535879366 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1277883081 0 0) 0x5562f8152b30 con 0x5562f8207650 2024-09-18T01:47:10.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.920+0000 7ff37bfff640 1 --2- 172.21.15.146:0/2535879366 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562f8297900 0x5562f8299cf0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7ff36c00a470 tx=0x7ff36c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90c1fa4d1b29dfb server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.920+0000 7ff3814a2640 1 -- 172.21.15.146:0/2535879366 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff36c053570 con 0x5562f8297900 2024-09-18T01:47:10.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.920+0000 7ff3814a2640 1 -- 172.21.15.146:0/2535879366 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff36c058070 con 0x5562f8297900 2024-09-18T01:47:10.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.920+0000 7ff3814a2640 1 -- 172.21.15.146:0/2535879366 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff36c053880 con 0x5562f8297900 2024-09-18T01:47:10.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.920+0000 7ff3841af800 1 -- 172.21.15.146:0/2535879366 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562f8297900 msgr2=0x5562f8299cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.920+0000 7ff3841af800 1 --2- 172.21.15.146:0/2535879366 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562f8297900 0x5562f8299cf0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7ff36c00a470 tx=0x7ff36c045a20 comp rx=0 tx=0).stop 2024-09-18T01:47:10.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.920+0000 7ff3841af800 1 -- 172.21.15.146:0/2535879366 shutdown_connections 2024-09-18T01:47:10.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.920+0000 7ff3841af800 1 --2- 172.21.15.146:0/2535879366 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562f8297900 0x5562f8299cf0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.920+0000 7ff3841af800 1 -- 172.21.15.146:0/2535879366 >> 172.21.15.146:0/2535879366 conn(0x5562f828ddb0 msgr2=0x5562f82901d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:10.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.920+0000 7ff3841af800 1 -- 172.21.15.146:0/2535879366 shutdown_connections 2024-09-18T01:47:10.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.920+0000 7ff3841af800 1 -- 172.21.15.146:0/2535879366 wait complete. 2024-09-18T01:47:10.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.934+0000 7ff3841af800 1 Processor -- start 2024-09-18T01:47:10.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.934+0000 7ff3841af800 1 -- start start 2024-09-18T01:47:10.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.934+0000 7ff3841af800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562f8207650 0x5562f8382680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.934+0000 7ff3841af800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5562f81df360 con 0x5562f8207650 2024-09-18T01:47:10.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.935+0000 7ff381ca3640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562f8207650 0x5562f8382680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.935+0000 7ff381ca3640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562f8207650 0x5562f8382680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37654/0 (socket says 172.21.15.146:37654) 2024-09-18T01:47:10.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.935+0000 7ff381ca3640 1 -- 172.21.15.146:0/2324668325 learned_addr learned my addr 172.21.15.146:0/2324668325 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:10.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.935+0000 7ff381ca3640 1 -- 172.21.15.146:0/2324668325 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562f812cbc0 con 0x5562f8207650 2024-09-18T01:47:10.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.935+0000 7ff381ca3640 1 --2- 172.21.15.146:0/2324668325 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562f8207650 0x5562f8382680 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7ff37400b240 tx=0x7ff37400b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60cf82d52bf07c1e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.935+0000 7ff26fe07640 1 -- 172.21.15.146:0/2324668325 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff374008070 con 0x5562f8207650 2024-09-18T01:47:10.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.935+0000 7ff26fe07640 1 -- 172.21.15.146:0/2324668325 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff37400d500 con 0x5562f8207650 2024-09-18T01:47:10.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.935+0000 7ff26fe07640 1 -- 172.21.15.146:0/2324668325 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff37400d860 con 0x5562f8207650 2024-09-18T01:47:10.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.936+0000 7ff3841af800 1 -- 172.21.15.146:0/2324668325 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562f8207650 msgr2=0x5562f8382680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.936+0000 7ff3841af800 1 --2- 172.21.15.146:0/2324668325 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562f8207650 0x5562f8382680 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7ff37400b240 tx=0x7ff37400b700 comp rx=0 tx=0).stop 2024-09-18T01:47:10.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.936+0000 7ff3841af800 1 -- 172.21.15.146:0/2324668325 shutdown_connections 2024-09-18T01:47:10.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.936+0000 7ff3841af800 1 --2- 172.21.15.146:0/2324668325 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562f8207650 0x5562f8382680 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.936+0000 7ff3841af800 1 -- 172.21.15.146:0/2324668325 >> 172.21.15.146:0/2324668325 conn(0x5562f828ddb0 msgr2=0x5562f837e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:10.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.936+0000 7ff3841af800 1 -- 172.21.15.146:0/2324668325 shutdown_connections 2024-09-18T01:47:10.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.936+0000 7ff3841af800 1 -- 172.21.15.146:0/2324668325 wait complete. 2024-09-18T01:47:10.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.936+0000 7ff3841af800 1 Processor -- start 2024-09-18T01:47:10.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.936+0000 7ff3841af800 1 -- start start 2024-09-18T01:47:10.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.936+0000 7ff3841af800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562f8207650 0x5562f838a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.936+0000 7ff3841af800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5562f829a620 con 0x5562f8207650 2024-09-18T01:47:10.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.937+0000 7ff381ca3640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562f8207650 0x5562f838a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.937+0000 7ff381ca3640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562f8207650 0x5562f838a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37656/0 (socket says 172.21.15.146:37656) 2024-09-18T01:47:10.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.937+0000 7ff381ca3640 1 -- 172.21.15.146:0/423059805 learned_addr learned my addr 172.21.15.146:0/423059805 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:10.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.937+0000 7ff381ca3640 1 -- 172.21.15.146:0/423059805 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562f8140fe0 con 0x5562f8207650 2024-09-18T01:47:10.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.937+0000 7ff381ca3640 1 --2- 172.21.15.146:0/423059805 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562f8207650 0x5562f838a110 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x5562f83834e0 tx=0x7ff374000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.937+0000 7ff26e604640 1 -- 172.21.15.146:0/423059805 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff374019870 con 0x5562f8207650 2024-09-18T01:47:10.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.937+0000 7ff26e604640 1 -- 172.21.15.146:0/423059805 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff374019a10 con 0x5562f8207650 2024-09-18T01:47:10.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.937+0000 7ff3841af800 1 -- 172.21.15.146:0/423059805 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5562f838a650 con 0x5562f8207650 2024-09-18T01:47:10.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.937+0000 7ff26e604640 1 -- 172.21.15.146:0/423059805 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff374019d30 con 0x5562f8207650 2024-09-18T01:47:10.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.937+0000 7ff3841af800 1 -- 172.21.15.146:0/423059805 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562f838ab70 con 0x5562f8207650 2024-09-18T01:47:10.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.938+0000 7ff26e604640 1 -- 172.21.15.146:0/423059805 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff374017040 con 0x5562f8207650 2024-09-18T01:47:10.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.938+0000 7ff26e604640 1 --2- 172.21.15.146:0/423059805 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff268036b90 0x7ff268039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.938+0000 7ff26e604640 1 -- 172.21.15.146:0/423059805 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7ff374015020 con 0x5562f8207650 2024-09-18T01:47:10.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.938+0000 7ff37bfff640 1 --2- 172.21.15.146:0/423059805 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff268036b90 0x7ff268039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.939+0000 7ff3841af800 1 --2- 172.21.15.146:0/423059805 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5562f8297900 0x5562f8391180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.939+0000 7ff3841af800 1 -- 172.21.15.146:0/423059805 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5562f8391700 con 0x5562f8297900 2024-09-18T01:47:10.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.939+0000 7ff3824a4640 1 --2- 172.21.15.146:0/423059805 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5562f8297900 0x5562f8391180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.939+0000 7ff37bfff640 1 --2- 172.21.15.146:0/423059805 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff268036b90 0x7ff268039050 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff36c057000 tx=0x7ff36c052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.939+0000 7ff3824a4640 1 --2- 172.21.15.146:0/423059805 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5562f8297900 0x5562f8391180 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.939+0000 7ff3824a4640 1 -- 172.21.15.146:0/423059805 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff37c00a4a0 con 0x5562f8297900 2024-09-18T01:47:10.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.939+0000 7ff3841af800 1 -- 172.21.15.146:0/423059805 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5562f838e750 con 0x5562f8297900 2024-09-18T01:47:10.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.940+0000 7ff3824a4640 1 -- 172.21.15.146:0/423059805 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff37c00a4a0 con 0x5562f8297900 2024-09-18T01:47:10.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.940+0000 7ff3841af800 1 -- 172.21.15.146:0/423059805 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5562f8393520 con 0x5562f8297900 2024-09-18T01:47:10.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.940+0000 7ff3824a4640 1 -- 172.21.15.146:0/423059805 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff37c00a4a0 con 0x5562f8297900 2024-09-18T01:47:10.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.940+0000 7ff3841af800 1 -- 172.21.15.146:0/423059805 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5562f8392750 con 0x5562f8297900 2024-09-18T01:47:10.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.940+0000 7ff3824a4640 1 -- 172.21.15.146:0/423059805 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff37c00a4a0 con 0x5562f8297900 2024-09-18T01:47:10.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.940+0000 7ff3841af800 1 --2- 172.21.15.146:0/423059805 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5562f83948d0 0x5562f8396cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.940+0000 7ff3841af800 1 -- 172.21.15.146:0/423059805 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5562f8397200 con 0x5562f83948d0 2024-09-18T01:47:10.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.940+0000 7ff381ca3640 1 --2- 172.21.15.146:0/423059805 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5562f83948d0 0x5562f8396cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.941+0000 7ff381ca3640 1 --2- 172.21.15.146:0/423059805 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5562f83948d0 0x5562f8396cc0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.941+0000 7ff381ca3640 1 -- 172.21.15.146:0/423059805 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff37402d070 con 0x5562f83948d0 2024-09-18T01:47:10.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.941+0000 7ff3841af800 1 Processor -- start 2024-09-18T01:47:10.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.941+0000 7ff3841af800 1 -- start start 2024-09-18T01:47:10.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.941+0000 7ff3841af800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562f8293bb0 0x5562f8292200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.941+0000 7ff3841af800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5562f812e580 con 0x5562f8293bb0 2024-09-18T01:47:10.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.942+0000 7ff3824a4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562f8293bb0 0x5562f8292200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.942+0000 7ff3824a4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562f8293bb0 0x5562f8292200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37664/0 (socket says 172.21.15.146:37664) 2024-09-18T01:47:10.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.942+0000 7ff3824a4640 1 -- 172.21.15.146:0/4093414850 learned_addr learned my addr 172.21.15.146:0/4093414850 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:10.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.942+0000 7ff3824a4640 1 -- 172.21.15.146:0/4093414850 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562f8293fd0 con 0x5562f8293bb0 2024-09-18T01:47:10.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.942+0000 7ff3824a4640 1 --2- 172.21.15.146:0/4093414850 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562f8293bb0 0x5562f8292200 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x5562f838b510 tx=0x7ff37c0178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.942+0000 7ff2677fe640 1 -- 172.21.15.146:0/4093414850 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff37c013440 con 0x5562f8293bb0 2024-09-18T01:47:10.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.942+0000 7ff2677fe640 1 -- 172.21.15.146:0/4093414850 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff37c0135e0 con 0x5562f8293bb0 2024-09-18T01:47:10.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.942+0000 7ff3841af800 1 -- 172.21.15.146:0/4093414850 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5562f8292800 con 0x5562f8293bb0 2024-09-18T01:47:10.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.942+0000 7ff2677fe640 1 -- 172.21.15.146:0/4093414850 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff37c0138c0 con 0x5562f8293bb0 2024-09-18T01:47:10.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.942+0000 7ff3841af800 1 -- 172.21.15.146:0/4093414850 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562f8292d00 con 0x5562f8293bb0 2024-09-18T01:47:10.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.943+0000 7ff2677fe640 1 -- 172.21.15.146:0/4093414850 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff37c011040 con 0x5562f8293bb0 2024-09-18T01:47:10.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.943+0000 7ff2677fe640 1 --2- 172.21.15.146:0/4093414850 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff25c036b90 0x7ff25c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.943+0000 7ff2677fe640 1 -- 172.21.15.146:0/4093414850 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7ff37c01d070 con 0x5562f8293bb0 2024-09-18T01:47:10.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.943+0000 7ff381ca3640 1 --2- 172.21.15.146:0/4093414850 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff25c036b90 0x7ff25c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.943+0000 7ff3841af800 1 Processor -- start 2024-09-18T01:47:10.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.943+0000 7ff3841af800 1 -- start start 2024-09-18T01:47:10.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.943+0000 7ff381ca3640 1 --2- 172.21.15.146:0/4093414850 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff25c036b90 0x7ff25c039050 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ff374001630 tx=0x7ff37404b640 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.944+0000 7ff3841af800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562f83b3d30 0x5562f83b4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.944+0000 7ff3841af800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5562f8382e30 con 0x5562f83b3d30 2024-09-18T01:47:10.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.944+0000 7ff3824a4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562f83b3d30 0x5562f83b4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.944+0000 7ff3824a4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562f83b3d30 0x5562f83b4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37674/0 (socket says 172.21.15.146:37674) 2024-09-18T01:47:10.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.944+0000 7ff3824a4640 1 -- 172.21.15.146:0/1327461327 learned_addr learned my addr 172.21.15.146:0/1327461327 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:10.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.944+0000 7ff3824a4640 1 -- 172.21.15.146:0/1327461327 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562f83b4700 con 0x5562f83b3d30 2024-09-18T01:47:10.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.944+0000 7ff3824a4640 1 --2- 172.21.15.146:0/1327461327 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562f83b3d30 0x5562f83b4130 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7ff37c04c8c0 tx=0x7ff37c001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0c7793b6cb5e458 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.944+0000 7ff2657fa640 1 -- 172.21.15.146:0/1327461327 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff37c027040 con 0x5562f83b3d30 2024-09-18T01:47:10.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.944+0000 7ff2657fa640 1 -- 172.21.15.146:0/1327461327 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff37c012cc0 con 0x5562f83b3d30 2024-09-18T01:47:10.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.944+0000 7ff2657fa640 1 -- 172.21.15.146:0/1327461327 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff37c04b250 con 0x5562f83b3d30 2024-09-18T01:47:10.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.945+0000 7ff3841af800 1 -- 172.21.15.146:0/1327461327 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562f83b3d30 msgr2=0x5562f83b4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.945+0000 7ff3841af800 1 --2- 172.21.15.146:0/1327461327 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562f83b3d30 0x5562f83b4130 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7ff37c04c8c0 tx=0x7ff37c001940 comp rx=0 tx=0).stop 2024-09-18T01:47:10.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.945+0000 7ff3841af800 1 -- 172.21.15.146:0/1327461327 shutdown_connections 2024-09-18T01:47:10.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.945+0000 7ff3841af800 1 --2- 172.21.15.146:0/1327461327 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562f83b3d30 0x5562f83b4130 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.945+0000 7ff3841af800 1 -- 172.21.15.146:0/1327461327 >> 172.21.15.146:0/1327461327 conn(0x5562f83b0090 msgr2=0x5562f83ae190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:10.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.945+0000 7ff3841af800 1 -- 172.21.15.146:0/1327461327 shutdown_connections 2024-09-18T01:47:10.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.945+0000 7ff3841af800 1 -- 172.21.15.146:0/1327461327 wait complete. 2024-09-18T01:47:10.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.945+0000 7ff3841af800 1 Processor -- start 2024-09-18T01:47:10.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.945+0000 7ff3841af800 1 -- start start 2024-09-18T01:47:10.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.945+0000 7ff3841af800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562f83b3d30 0x5562f83bb200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.945+0000 7ff3841af800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5562f83b4d70 con 0x5562f83b3d30 2024-09-18T01:47:10.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.945+0000 7ff3824a4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562f83b3d30 0x5562f83bb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.945+0000 7ff3824a4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562f83b3d30 0x5562f83bb200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37680/0 (socket says 172.21.15.146:37680) 2024-09-18T01:47:10.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.945+0000 7ff3824a4640 1 -- 172.21.15.146:0/286105251 learned_addr learned my addr 172.21.15.146:0/286105251 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:10.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.946+0000 7ff3824a4640 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562f83bb740 con 0x5562f83b3d30 2024-09-18T01:47:10.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.946+0000 7ff3824a4640 1 --2- 172.21.15.146:0/286105251 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562f83b3d30 0x5562f83bb200 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7ff37c001df0 tx=0x7ff37c04c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.946+0000 7ff2537fe640 1 -- 172.21.15.146:0/286105251 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff37c027070 con 0x5562f83b3d30 2024-09-18T01:47:10.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.946+0000 7ff2537fe640 1 -- 172.21.15.146:0/286105251 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff37c0015f0 con 0x5562f83b3d30 2024-09-18T01:47:10.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.946+0000 7ff3841af800 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5562f83bb9d0 con 0x5562f83b3d30 2024-09-18T01:47:10.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.946+0000 7ff2537fe640 1 -- 172.21.15.146:0/286105251 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff37c02aa60 con 0x5562f83b3d30 2024-09-18T01:47:10.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.946+0000 7ff3841af800 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562f83be680 con 0x5562f83b3d30 2024-09-18T01:47:10.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.947+0000 7ff2537fe640 1 -- 172.21.15.146:0/286105251 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff37c02ac00 con 0x5562f83b3d30 2024-09-18T01:47:10.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.947+0000 7ff2537fe640 1 --2- 172.21.15.146:0/286105251 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff24c036b40 0x7ff24c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.947+0000 7ff2537fe640 1 -- 172.21.15.146:0/286105251 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7ff37c033070 con 0x5562f83b3d30 2024-09-18T01:47:10.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.947+0000 7ff381ca3640 1 --2- 172.21.15.146:0/286105251 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff24c036b40 0x7ff24c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.947+0000 7ff381ca3640 1 --2- 172.21.15.146:0/286105251 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff24c036b40 0x7ff24c039000 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff37400bc50 tx=0x7ff374033000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.948+0000 7ff3841af800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.948+0000 7ff3841af800 1 --2- 172.21.15.146:0/286105251 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5562f83c6ef0 0x5562f83c93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.948+0000 7ff3841af800 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5562f83c9b00 con 0x5562f83c6ef0 2024-09-18T01:47:10.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.948+0000 7ff37bfff640 1 --2- 172.21.15.146:0/286105251 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5562f83c6ef0 0x5562f83c93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.948+0000 7ff37bfff640 1 --2- 172.21.15.146:0/286105251 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5562f83c6ef0 0x5562f83c93b0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.948+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff36c051070 con 0x5562f83c6ef0 2024-09-18T01:47:10.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.948+0000 7ff3841af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:10.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.948+0000 7ff3841af800 20 realm 2024-09-18T01:47:10.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.948+0000 7ff3841af800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.948+0000 7ff3841af800 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5562f83c9f30 con 0x5562f83c6ef0 2024-09-18T01:47:10.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.949+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff36c051070 con 0x5562f83c6ef0 2024-09-18T01:47:10.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.949+0000 7ff3841af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:10.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.949+0000 7ff3841af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:47:10.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.949+0000 7ff3841af800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.949+0000 7ff3841af800 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5562f83ca800 con 0x5562f83c6ef0 2024-09-18T01:47:10.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.949+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff36c051070 con 0x5562f83c6ef0 2024-09-18T01:47:10.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.949+0000 7ff3841af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:10.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.949+0000 7ff3841af800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.949+0000 7ff3841af800 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5562f83caba0 con 0x5562f83c6ef0 2024-09-18T01:47:10.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.949+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff36c051070 con 0x5562f83c6ef0 2024-09-18T01:47:10.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.949+0000 7ff3841af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:47:10.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.949+0000 7ff3841af800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.949+0000 7ff3841af800 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5562f83cb3f0 con 0x5562f83c6ef0 2024-09-18T01:47:10.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.949+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff36c051070 con 0x5562f83c6ef0 2024-09-18T01:47:10.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.949+0000 7ff3841af800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:47:10.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.949+0000 7ff3841af800 20 searching for the correct realm 2024-09-18T01:47:10.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.949+0000 7ff3841af800 1 --2- 172.21.15.146:0/286105251 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5562f83cd160 0x5562f83cf550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.949+0000 7ff3841af800 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5562f83cfb80 con 0x5562f83cd160 2024-09-18T01:47:10.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.950+0000 7ff3824a4640 1 --2- 172.21.15.146:0/286105251 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5562f83cd160 0x5562f83cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.950+0000 7ff3824a4640 1 --2- 172.21.15.146:0/286105251 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5562f83cd160 0x5562f83cf550 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.950+0000 7ff3824a4640 1 -- 172.21.15.146:0/286105251 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff37c057040 con 0x5562f83cd160 2024-09-18T01:47:10.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.950+0000 7ff3824a4640 1 --2- 172.21.15.146:0/286105251 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7ff37c0123a0 0x7ff37c036580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.950+0000 7ff3824a4640 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5562f83cfb80 con 0x7ff37c0123a0 2024-09-18T01:47:10.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.950+0000 7ff381ca3640 1 --2- 172.21.15.146:0/286105251 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7ff37c0123a0 0x7ff37c036580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.950+0000 7ff381ca3640 1 --2- 172.21.15.146:0/286105251 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7ff37c0123a0 0x7ff37c036580 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.951+0000 7ff381ca3640 1 -- 172.21.15.146:0/286105251 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff37402d070 con 0x7ff37c0123a0 2024-09-18T01:47:10.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.951+0000 7ff381ca3640 1 --2- 172.21.15.146:0/286105251 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7ff374018810 0x7ff37403f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:10.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.951+0000 7ff381ca3640 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5562f83cfb80 con 0x7ff374018810 2024-09-18T01:47:10.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.951+0000 7ff37bfff640 1 --2- 172.21.15.146:0/286105251 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7ff374018810 0x7ff37403f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:10.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.951+0000 7ff37bfff640 1 --2- 172.21.15.146:0/286105251 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7ff374018810 0x7ff37403f1e0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:10.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.951+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff36c051070 con 0x7ff374018810 2024-09-18T01:47:10.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.951+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5562f83cfb80 con 0x5562f83c6ef0 2024-09-18T01:47:10.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.952+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v33'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff36c051070 con 0x5562f83c6ef0 2024-09-18T01:47:10.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.952+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5562f83cfb80 con 0x5562f83c6ef0 2024-09-18T01:47:10.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.952+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff36c051070 con 0x5562f83c6ef0 2024-09-18T01:47:10.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.952+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5562f83cfb80 con 0x7ff374018810 2024-09-18T01:47:10.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.952+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff36c051070 con 0x7ff374018810 2024-09-18T01:47:10.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.952+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5562f83cfb80 con 0x7ff374018810 2024-09-18T01:47:10.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.952+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff36c051070 con 0x7ff374018810 2024-09-18T01:47:10.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.952+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5562f83cfb80 con 0x7ff37c0123a0 2024-09-18T01:47:10.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.953+0000 7ff381ca3640 1 -- 172.21.15.146:0/286105251 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff37402d070 con 0x7ff37c0123a0 2024-09-18T01:47:10.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.953+0000 7ff381ca3640 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5562f83cfb80 con 0x5562f83cd160 2024-09-18T01:47:10.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.953+0000 7ff3824a4640 1 -- 172.21.15.146:0/286105251 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff37c057040 con 0x5562f83cd160 2024-09-18T01:47:10.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.953+0000 7ff3824a4640 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5562f83cfb80 con 0x5562f83c6ef0 2024-09-18T01:47:10.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.953+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff36c051070 con 0x5562f83c6ef0 2024-09-18T01:47:10.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.953+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5562f83cfb80 con 0x7ff374018810 2024-09-18T01:47:10.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.953+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff36c051070 con 0x7ff374018810 2024-09-18T01:47:10.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.953+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5562f83cfb80 con 0x5562f83c6ef0 2024-09-18T01:47:10.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.953+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff36c051070 con 0x5562f83c6ef0 2024-09-18T01:47:10.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.954+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5562f83cfb80 con 0x7ff37c0123a0 2024-09-18T01:47:10.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.954+0000 7ff381ca3640 1 -- 172.21.15.146:0/286105251 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7ff37402d070 con 0x7ff37c0123a0 2024-09-18T01:47:10.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.954+0000 7ff381ca3640 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7ff37405a0a0 con 0x5562f83cd160 2024-09-18T01:47:10.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.954+0000 7ff3824a4640 1 -- 172.21.15.146:0/286105251 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff37c057040 con 0x5562f83cd160 2024-09-18T01:47:10.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.954+0000 7ff3824a4640 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7ff37405a0a0 con 0x5562f83cd160 2024-09-18T01:47:10.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.954+0000 7ff3824a4640 1 -- 172.21.15.146:0/286105251 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff37c057040 con 0x5562f83cd160 2024-09-18T01:47:10.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.954+0000 7ff3824a4640 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7ff37405a0a0 con 0x7ff374018810 2024-09-18T01:47:10.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.954+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff36c051070 con 0x7ff374018810 2024-09-18T01:47:10.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.954+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7ff37405a0a0 con 0x5562f83cd160 2024-09-18T01:47:10.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.955+0000 7ff3824a4640 1 -- 172.21.15.146:0/286105251 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff37c057040 con 0x5562f83cd160 2024-09-18T01:47:10.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.955+0000 7ff3824a4640 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7ff37405a0a0 con 0x5562f83cd160 2024-09-18T01:47:10.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.955+0000 7ff3824a4640 1 -- 172.21.15.146:0/286105251 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff37c057040 con 0x5562f83cd160 2024-09-18T01:47:10.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.955+0000 7ff3824a4640 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7ff37405a0a0 con 0x5562f83c6ef0 2024-09-18T01:47:10.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.955+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff36c051070 con 0x5562f83c6ef0 2024-09-18T01:47:10.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.955+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7ff37405a0a0 con 0x5562f83c6ef0 2024-09-18T01:47:10.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.955+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v33'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff36c051070 con 0x5562f83c6ef0 2024-09-18T01:47:10.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.955+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7ff37405a0a0 con 0x7ff374018810 2024-09-18T01:47:10.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.956+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff36c051070 con 0x7ff374018810 2024-09-18T01:47:10.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.956+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7ff37405a0a0 con 0x5562f83cd160 2024-09-18T01:47:10.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.956+0000 7ff3824a4640 1 -- 172.21.15.146:0/286105251 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff37c057040 con 0x5562f83cd160 2024-09-18T01:47:10.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.956+0000 7ff3824a4640 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7ff37405a0a0 con 0x7ff37c0123a0 2024-09-18T01:47:10.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.956+0000 7ff381ca3640 1 -- 172.21.15.146:0/286105251 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff37402d070 con 0x7ff37c0123a0 2024-09-18T01:47:10.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.956+0000 7ff381ca3640 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7ff37405a0a0 con 0x5562f83c6ef0 2024-09-18T01:47:10.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.956+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff36c051070 con 0x5562f83c6ef0 2024-09-18T01:47:10.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.956+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7ff37405a0a0 con 0x7ff374018810 2024-09-18T01:47:10.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.957+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff36c051070 con 0x7ff374018810 2024-09-18T01:47:10.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.957+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7ff37405a0a0 con 0x5562f83cd160 2024-09-18T01:47:10.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.957+0000 7ff3824a4640 1 -- 172.21.15.146:0/286105251 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff37c057040 con 0x5562f83cd160 2024-09-18T01:47:10.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.957+0000 7ff3824a4640 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7ff37405a0a0 con 0x7ff374018810 2024-09-18T01:47:10.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.957+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff36c051070 con 0x7ff374018810 2024-09-18T01:47:10.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.957+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7ff37405a0a0 con 0x7ff37c0123a0 2024-09-18T01:47:10.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.957+0000 7ff381ca3640 1 -- 172.21.15.146:0/286105251 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff37402d070 con 0x7ff37c0123a0 2024-09-18T01:47:10.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.957+0000 7ff381ca3640 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7ff37405a0a0 con 0x5562f83cd160 2024-09-18T01:47:10.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.958+0000 7ff3824a4640 1 -- 172.21.15.146:0/286105251 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff37c057040 con 0x5562f83cd160 2024-09-18T01:47:10.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.958+0000 7ff3824a4640 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7ff37405a0a0 con 0x7ff374018810 2024-09-18T01:47:10.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.958+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff36c051070 con 0x7ff374018810 2024-09-18T01:47:10.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.958+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7ff37405a0a0 con 0x5562f83c6ef0 2024-09-18T01:47:10.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.958+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v33'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff36c051070 con 0x5562f83c6ef0 2024-09-18T01:47:10.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.958+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7ff37405a0a0 con 0x7ff37c0123a0 2024-09-18T01:47:10.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.958+0000 7ff381ca3640 1 -- 172.21.15.146:0/286105251 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff37402d070 con 0x7ff37c0123a0 2024-09-18T01:47:10.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.958+0000 7ff3841af800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:47:10.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.958+0000 7ff3841af800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:47:10.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.958+0000 7ff3841af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:47:10.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.958+0000 7ff3841af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:47:10.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.958+0000 7ff3841af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:47:10.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.958+0000 7ff3841af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:47:10.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.958+0000 7ff3841af800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.958+0000 7ff3841af800 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5562f83cbd70 con 0x5562f83c6ef0 2024-09-18T01:47:10.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.959+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff36c051070 con 0x5562f83c6ef0 2024-09-18T01:47:10.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.959+0000 7ff3841af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:10.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.959+0000 7ff3841af800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.959+0000 7ff3841af800 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5562f83cc610 con 0x5562f83c6ef0 2024-09-18T01:47:10.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.959+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff36c051070 con 0x5562f83c6ef0 2024-09-18T01:47:10.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.959+0000 7ff3841af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:47:10.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.959+0000 7ff3841af800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.959+0000 7ff3841af800 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5562f83d0000 con 0x7ff37c0123a0 2024-09-18T01:47:10.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.959+0000 7ff381ca3640 1 -- 172.21.15.146:0/286105251 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff37402d070 con 0x7ff37c0123a0 2024-09-18T01:47:10.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.959+0000 7ff3841af800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:47:10.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.959+0000 7ff3841af800 20 zone default found 2024-09-18T01:47:10.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.959+0000 7ff3841af800 4 Realm: () 2024-09-18T01:47:10.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.959+0000 7ff3841af800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:47:10.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.959+0000 7ff3841af800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:47:10.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.959+0000 7ff3841af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:47:10.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.959+0000 7ff3841af800 20 zonegroup default 2024-09-18T01:47:10.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.959+0000 7ff3841af800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.959+0000 7ff3841af800 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5562f83d0850 con 0x7ff374018810 2024-09-18T01:47:10.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.960+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff36c051070 con 0x7ff374018810 2024-09-18T01:47:10.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.960+0000 7ff3841af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:10.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.960+0000 7ff3841af800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.960+0000 7ff3841af800 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5562f83d2230 con 0x5562f83cd160 2024-09-18T01:47:10.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.960+0000 7ff3824a4640 1 -- 172.21.15.146:0/286105251 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff37c057040 con 0x5562f83cd160 2024-09-18T01:47:10.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.960+0000 7ff3841af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:10.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.960+0000 7ff3841af800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.960+0000 7ff3841af800 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5562f83d2710 con 0x5562f83cd160 2024-09-18T01:47:10.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.960+0000 7ff3824a4640 1 -- 172.21.15.146:0/286105251 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff37c057040 con 0x5562f83cd160 2024-09-18T01:47:10.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.960+0000 7ff3841af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:10.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.960+0000 7ff3841af800 20 started sync module instance, tier type = 2024-09-18T01:47:10.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.960+0000 7ff3841af800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:47:10.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.960+0000 7ff3841af800 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562f83d16c0 con 0x7ff37c0123a0 2024-09-18T01:47:10.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.961+0000 7ff381ca3640 1 -- 172.21.15.146:0/286105251 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v33'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff37402d070 con 0x7ff37c0123a0 2024-09-18T01:47:10.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.961+0000 7ff3841af800 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93883559910064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562f83d1320 con 0x7ff37c0123a0 2024-09-18T01:47:10.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.961+0000 7ff3841af800 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562f83d3530 con 0x5562f83c6ef0 2024-09-18T01:47:10.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.962+0000 7ff381ca3640 1 -- 172.21.15.146:0/286105251 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93883559910064] v33'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff37402d070 con 0x7ff37c0123a0 2024-09-18T01:47:10.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.962+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v33'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff36c051070 con 0x5562f83c6ef0 2024-09-18T01:47:10.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.962+0000 7ff3841af800 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93883559914352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562f83d3950 con 0x5562f83c6ef0 2024-09-18T01:47:10.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.962+0000 7ff3841af800 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562f83d4370 con 0x5562f83cd160 2024-09-18T01:47:10.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.964+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93883559914352] v33'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff36c051070 con 0x5562f83c6ef0 2024-09-18T01:47:10.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.964+0000 7ff3824a4640 1 -- 172.21.15.146:0/286105251 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v33'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff37c057040 con 0x5562f83cd160 2024-09-18T01:47:10.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.964+0000 7ff3841af800 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93883559919200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562f83d4330 con 0x5562f83cd160 2024-09-18T01:47:10.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.964+0000 7ff3841af800 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562f83d4e20 con 0x7ff37c0123a0 2024-09-18T01:47:10.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.965+0000 7ff3824a4640 1 -- 172.21.15.146:0/286105251 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93883559919200] v33'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff37c057040 con 0x5562f83cd160 2024-09-18T01:47:10.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.966+0000 7ff381ca3640 1 -- 172.21.15.146:0/286105251 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v33'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff37402d070 con 0x7ff37c0123a0 2024-09-18T01:47:10.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.966+0000 7ff3841af800 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93883559921968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562f83d5210 con 0x7ff37c0123a0 2024-09-18T01:47:10.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.966+0000 7ff3841af800 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562f83d5c50 con 0x5562f83c6ef0 2024-09-18T01:47:10.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.966+0000 7ff381ca3640 1 -- 172.21.15.146:0/286105251 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93883559921968] v33'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff37402d070 con 0x7ff37c0123a0 2024-09-18T01:47:10.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.967+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v33'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff36c051070 con 0x5562f83c6ef0 2024-09-18T01:47:10.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.967+0000 7ff3841af800 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93883559925536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562f83d5c10 con 0x5562f83c6ef0 2024-09-18T01:47:10.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.967+0000 7ff3841af800 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562f83d6700 con 0x7ff374018810 2024-09-18T01:47:10.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.968+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v33'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff36c051070 con 0x7ff374018810 2024-09-18T01:47:10.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.968+0000 7ff3841af800 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93883559928336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562f83d6700 con 0x7ff374018810 2024-09-18T01:47:10.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.968+0000 7ff3841af800 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562f83d7620 con 0x7ff374018810 2024-09-18T01:47:10.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.968+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93883559925536] v33'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff36c051070 con 0x5562f83c6ef0 2024-09-18T01:47:10.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.969+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93883559928336] v33'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff36c051070 con 0x7ff374018810 2024-09-18T01:47:10.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.969+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v33'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff36c051070 con 0x7ff374018810 2024-09-18T01:47:10.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.969+0000 7ff3841af800 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93883559932176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562f83d7620 con 0x7ff374018810 2024-09-18T01:47:10.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.970+0000 7ff3841af800 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562f83d7a80 con 0x7ff374018810 2024-09-18T01:47:10.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.970+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93883559932176] v33'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff36c051070 con 0x7ff374018810 2024-09-18T01:47:10.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.971+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v33'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff36c051070 con 0x7ff374018810 2024-09-18T01:47:10.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.971+0000 7ff3841af800 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93883559930528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562f83d79f0 con 0x7ff374018810 2024-09-18T01:47:10.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.971+0000 7ff3841af800 20 add_watcher() i=0 2024-09-18T01:47:10.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.971+0000 7ff3841af800 20 add_watcher() i=1 2024-09-18T01:47:10.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.971+0000 7ff3841af800 20 add_watcher() i=2 2024-09-18T01:47:10.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.971+0000 7ff3841af800 20 add_watcher() i=3 2024-09-18T01:47:10.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.971+0000 7ff3841af800 20 add_watcher() i=4 2024-09-18T01:47:10.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.971+0000 7ff3841af800 20 add_watcher() i=5 2024-09-18T01:47:10.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.971+0000 7ff3841af800 20 add_watcher() i=6 2024-09-18T01:47:10.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.972+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93883559930528] v33'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff36c051070 con 0x7ff374018810 2024-09-18T01:47:10.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.972+0000 7ff3841af800 20 add_watcher() i=7 2024-09-18T01:47:10.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.972+0000 7ff3841af800 2 all 8 watchers are set, enabling cache 2024-09-18T01:47:10.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.972+0000 7ff3841af800 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5562f83daee0 con 0x5562f83c6ef0 2024-09-18T01:47:10.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.972+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff36c051070 con 0x5562f83c6ef0 2024-09-18T01:47:10.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.972+0000 7ff3841af800 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93883559915408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562f83d8390 con 0x5562f83c6ef0 2024-09-18T01:47:10.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.973+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93883559915408] v33'265 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff36c051070 con 0x5562f83c6ef0 2024-09-18T01:47:10.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.974+0000 7ff22b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:47:10.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.974+0000 7ff3841af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:47:10.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.974+0000 7ff3841af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:47:10.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.974+0000 7ff3841af800 5 note: GC not initialized 2024-09-18T01:47:10.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.974+0000 7ff22a7fc640 20 reqs_thread_entry: start 2024-09-18T01:47:10.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.974+0000 7ff3841af800 20 init_complete bucket index max shards: 11 2024-09-18T01:47:10.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.974+0000 7ff3841af800 20 Filter name: none 2024-09-18T01:47:10.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.974+0000 7ff1a3fff640 20 reqs_thread_entry: start 2024-09-18T01:47:10.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.974+0000 7ff3841af800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-18T01:47:10.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.974+0000 7ff3841af800 20 rados->read ofs=0 len=0 2024-09-18T01:47:10.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.974+0000 7ff3841af800 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5562f840e1f0 con 0x7ff374018810 2024-09-18T01:47:10.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.975+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7ff36c051070 con 0x7ff374018810 2024-09-18T01:47:10.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.975+0000 7ff3841af800 20 rados_obj.operate() r=0 bl.length=490 2024-09-18T01:47:10.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.975+0000 7ff3841af800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-18T01:47:10.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.975+0000 7ff3841af800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:47:10.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.975+0000 7ff3841af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:47:10.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.975+0000 7ff3841af800 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562f8414a20 con 0x7ff374018810 2024-09-18T01:47:10.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.976+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v33'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7ff36c051070 con 0x7ff374018810 2024-09-18T01:47:10.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.976+0000 7ff3841af800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T01:47:10.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.976+0000 7ff3841af800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:47:10.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.976+0000 7ff3841af800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-18T01:47:10.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.976+0000 7ff3841af800 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93883560182752 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5562f8410040 con 0x5562f83c6ef0 2024-09-18T01:47:10.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.976+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== watch-notify(notify (1) cookie 93883559925536 notify 141733920797 ret 0) ==== 708+0+0 (crc 0 0 0) 0x5562f815ae00 con 0x5562f83c6ef0 2024-09-18T01:47:10.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.976+0000 7ff2657fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920797 cookie 93883559925536 notifier 4887 bl.length()=666 2024-09-18T01:47:10.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.976+0000 7ff2657fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T01:47:10.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.976+0000 7ff2657fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:47:10.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.976+0000 7ff2657fa640 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7ff244003ea0 con 0x5562f83c6ef0 2024-09-18T01:47:10.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.977+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(64 notify.4 [notify cookie 93883560182752 out=8b] v0'0 uv261 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff36c087040 con 0x5562f83c6ef0 2024-09-18T01:47:10.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.977+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff36c087040 con 0x5562f83c6ef0 2024-09-18T01:47:10.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.977+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== watch-notify(notify_complete (2) cookie 93883560182752 notify 141733920797 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7ff36c072910 con 0x5562f83c6ef0 2024-09-18T01:47:10.991 INFO:teuthology.orchestra.run.smithi146.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-18T01:47:09.882428Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:47:09.882414Z","tags":[],"group_ids":[]} 2024-09-18T01:47:10.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.978+0000 7ff22b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:47:10.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.978+0000 7ff3841af800 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93883559915408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562f840bf10 con 0x5562f83c6ef0 2024-09-18T01:47:10.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.979+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93883559915408] v33'266 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff36c087040 con 0x5562f83c6ef0 2024-09-18T01:47:10.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.979+0000 7ff3841af800 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93883559910064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562f840bf10 con 0x7ff37c0123a0 2024-09-18T01:47:10.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.980+0000 7ff381ca3640 1 -- 172.21.15.146:0/286105251 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93883559910064] v33'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff37402d070 con 0x7ff37c0123a0 2024-09-18T01:47:10.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.980+0000 7ff3841af800 20 remove_watcher() i=0 2024-09-18T01:47:10.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.980+0000 7ff3841af800 2 removed watcher, disabling cache 2024-09-18T01:47:10.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.980+0000 7ff3841af800 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93883559914352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562f840bf10 con 0x5562f83c6ef0 2024-09-18T01:47:10.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.981+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93883559914352] v33'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff36c087040 con 0x5562f83c6ef0 2024-09-18T01:47:10.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.981+0000 7ff3841af800 20 remove_watcher() i=1 2024-09-18T01:47:10.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.981+0000 7ff3841af800 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93883559919200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562f840bf10 con 0x5562f83cd160 2024-09-18T01:47:10.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.982+0000 7ff3824a4640 1 -- 172.21.15.146:0/286105251 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93883559919200] v33'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff37c057040 con 0x5562f83cd160 2024-09-18T01:47:10.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.982+0000 7ff3841af800 20 remove_watcher() i=2 2024-09-18T01:47:10.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.982+0000 7ff3841af800 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93883559921968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562f840bf10 con 0x7ff37c0123a0 2024-09-18T01:47:10.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.983+0000 7ff381ca3640 1 -- 172.21.15.146:0/286105251 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93883559921968] v33'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff37402d070 con 0x7ff37c0123a0 2024-09-18T01:47:10.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.983+0000 7ff3841af800 20 remove_watcher() i=3 2024-09-18T01:47:10.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.983+0000 7ff3841af800 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93883559925536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562f840bf10 con 0x5562f83c6ef0 2024-09-18T01:47:10.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.984+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 <== osd.1 v2:172.21.15.146:6808/3930274777 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93883559925536] v33'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff36c087040 con 0x5562f83c6ef0 2024-09-18T01:47:10.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.984+0000 7ff3841af800 20 remove_watcher() i=4 2024-09-18T01:47:10.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.984+0000 7ff3841af800 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93883559928336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562f840bf10 con 0x7ff374018810 2024-09-18T01:47:10.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.985+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93883559928336] v33'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff36c087040 con 0x7ff374018810 2024-09-18T01:47:10.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.985+0000 7ff3841af800 20 remove_watcher() i=5 2024-09-18T01:47:10.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.985+0000 7ff3841af800 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93883559932176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562f840bf10 con 0x7ff374018810 2024-09-18T01:47:10.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.986+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93883559932176] v33'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff36c087040 con 0x7ff374018810 2024-09-18T01:47:10.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.986+0000 7ff3841af800 20 remove_watcher() i=6 2024-09-18T01:47:10.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.986+0000 7ff3841af800 1 -- 172.21.15.146:0/286105251 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93883559930528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562f840bf10 con 0x7ff374018810 2024-09-18T01:47:10.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.987+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93883559930528] v33'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff36c087040 con 0x7ff374018810 2024-09-18T01:47:10.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.987+0000 7ff3841af800 20 remove_watcher() i=7 2024-09-18T01:47:10.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.987+0000 7ff3841af800 1 -- 172.21.15.146:0/286105251 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7ff374018810 msgr2=0x7ff37403f1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.987+0000 7ff3841af800 1 --2- 172.21.15.146:0/286105251 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7ff374018810 0x7ff37403f1e0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.987+0000 7ff3841af800 1 -- 172.21.15.146:0/286105251 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5562f83c6ef0 msgr2=0x5562f83c93b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.987+0000 7ff3841af800 1 --2- 172.21.15.146:0/286105251 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5562f83c6ef0 0x5562f83c93b0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.987+0000 7ff3841af800 1 -- 172.21.15.146:0/286105251 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7ff37c0123a0 msgr2=0x7ff37c036580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.987+0000 7ff3841af800 1 --2- 172.21.15.146:0/286105251 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7ff37c0123a0 0x7ff37c036580 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.987+0000 7ff3841af800 1 -- 172.21.15.146:0/286105251 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5562f83cd160 msgr2=0x5562f83cf550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:10.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.987+0000 7ff3841af800 1 --2- 172.21.15.146:0/286105251 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5562f83cd160 0x5562f83cf550 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:10.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.988+0000 7ff3841af800 1 -- 172.21.15.146:0/286105251 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff24c036b40 msgr2=0x7ff24c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.988+0000 7ff3841af800 1 --2- 172.21.15.146:0/286105251 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff24c036b40 0x7ff24c039000 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff37400bc50 tx=0x7ff374033000 comp rx=0 tx=0).stop 2024-09-18T01:47:11.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.988+0000 7ff3841af800 1 -- 172.21.15.146:0/286105251 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562f83b3d30 msgr2=0x5562f83bb200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.988+0000 7ff37bfff640 1 -- 172.21.15.146:0/286105251 reap_dead start 2024-09-18T01:47:11.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.988+0000 7ff3841af800 1 --2- 172.21.15.146:0/286105251 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562f83b3d30 0x5562f83bb200 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7ff37c001df0 tx=0x7ff37c04c820 comp rx=0 tx=0).stop 2024-09-18T01:47:11.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.988+0000 7ff3841af800 1 -- 172.21.15.146:0/286105251 shutdown_connections 2024-09-18T01:47:11.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.988+0000 7ff3841af800 1 --2- 172.21.15.146:0/286105251 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562f83b3d30 0x5562f83bb200 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.988+0000 7ff3841af800 1 -- 172.21.15.146:0/286105251 >> 172.21.15.146:0/286105251 conn(0x5562f83b0090 msgr2=0x5562f83ae160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:11.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.988+0000 7ff3841af800 1 -- 172.21.15.146:0/286105251 shutdown_connections 2024-09-18T01:47:11.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.988+0000 7ff3841af800 1 -- 172.21.15.146:0/286105251 wait complete. 2024-09-18T01:47:11.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.988+0000 7ff3841af800 1 -- 172.21.15.146:0/4093414850 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff25c036b90 msgr2=0x7ff25c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.988+0000 7ff3841af800 1 --2- 172.21.15.146:0/4093414850 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff25c036b90 0x7ff25c039050 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ff374001630 tx=0x7ff37404b640 comp rx=0 tx=0).stop 2024-09-18T01:47:11.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.988+0000 7ff3841af800 1 -- 172.21.15.146:0/4093414850 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562f8293bb0 msgr2=0x5562f8292200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.988+0000 7ff3841af800 1 --2- 172.21.15.146:0/4093414850 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562f8293bb0 0x5562f8292200 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x5562f838b510 tx=0x7ff37c0178e0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.988+0000 7ff3841af800 1 -- 172.21.15.146:0/4093414850 shutdown_connections 2024-09-18T01:47:11.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.988+0000 7ff3841af800 1 --2- 172.21.15.146:0/4093414850 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff25c036b90 0x7ff25c039050 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.988+0000 7ff3841af800 1 --2- 172.21.15.146:0/4093414850 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562f8293bb0 0x5562f8292200 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.988+0000 7ff3841af800 1 -- 172.21.15.146:0/4093414850 >> 172.21.15.146:0/4093414850 conn(0x5562f8399e10 msgr2=0x5562f839c990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:11.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.988+0000 7ff3841af800 1 -- 172.21.15.146:0/4093414850 shutdown_connections 2024-09-18T01:47:11.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.988+0000 7ff3841af800 1 -- 172.21.15.146:0/4093414850 wait complete. 2024-09-18T01:47:11.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.988+0000 7ff3841af800 1 -- 172.21.15.146:0/423059805 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5562f8297900 msgr2=0x5562f8391180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.988+0000 7ff3841af800 1 --2- 172.21.15.146:0/423059805 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5562f8297900 0x5562f8391180 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.988+0000 7ff3841af800 1 -- 172.21.15.146:0/423059805 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5562f83948d0 msgr2=0x5562f8396cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.988+0000 7ff3841af800 1 --2- 172.21.15.146:0/423059805 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5562f83948d0 0x5562f8396cc0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.989+0000 7ff3841af800 1 -- 172.21.15.146:0/423059805 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff268036b90 msgr2=0x7ff268039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.989+0000 7ff3841af800 1 --2- 172.21.15.146:0/423059805 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff268036b90 0x7ff268039050 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff36c057000 tx=0x7ff36c052000 comp rx=0 tx=0).stop 2024-09-18T01:47:11.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.989+0000 7ff3841af800 1 -- 172.21.15.146:0/423059805 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562f8207650 msgr2=0x5562f838a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.989+0000 7ff3841af800 1 --2- 172.21.15.146:0/423059805 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562f8207650 0x5562f838a110 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x5562f83834e0 tx=0x7ff374000ed0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.989+0000 7ff3841af800 1 -- 172.21.15.146:0/423059805 shutdown_connections 2024-09-18T01:47:11.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.989+0000 7ff3841af800 1 --2- 172.21.15.146:0/423059805 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5562f83948d0 0x5562f8396cc0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.989+0000 7ff3841af800 1 --2- 172.21.15.146:0/423059805 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5562f8297900 0x5562f8391180 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.989+0000 7ff3841af800 1 --2- 172.21.15.146:0/423059805 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff268036b90 0x7ff268039050 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.989+0000 7ff3841af800 1 --2- 172.21.15.146:0/423059805 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562f8207650 0x5562f838a110 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.989+0000 7ff3841af800 1 -- 172.21.15.146:0/423059805 >> 172.21.15.146:0/423059805 conn(0x5562f828ddb0 msgr2=0x5562f837c950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:11.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.989+0000 7ff3841af800 1 -- 172.21.15.146:0/423059805 shutdown_connections 2024-09-18T01:47:11.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:10.989+0000 7ff3841af800 1 -- 172.21.15.146:0/423059805 wait complete. 2024-09-18T01:47:11.003 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T01:47:09.882428Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:47:09.882414Z', 'tags': [], 'group_ids': []} 2024-09-18T01:47:11.003 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T01:47:09.882428Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:47:09.882414Z', 'tags': [], 'group_ids': []} 2024-09-18T01:47:11.003 ERROR:root:0 2024-09-18T01:47:11.004 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-18T01:47:11.008 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T01:47:11.009 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-18T01:47:11.009 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-18T01:47:11.009 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-18T01:47:11.055 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:47:11.055 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:47:11.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.055+0000 7f72ac120800 1 Processor -- start 2024-09-18T01:47:11.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.055+0000 7f72ac120800 1 -- start start 2024-09-18T01:47:11.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.056+0000 7f72ac120800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x5576b3859900 0x5576b385bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.056+0000 7f72ac120800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5576b3714b30 con 0x5576b37c9650 2024-09-18T01:47:11.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.056+0000 7f72ac120800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x5576b36f6360 con 0x5576b3859900 2024-09-18T01:47:11.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.056+0000 7f72a75b7640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x5576b3859900 0x5576b385bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.056+0000 7f72a75b7640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x5576b3859900 0x5576b385bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37688/0 (socket says 172.21.15.146:37688) 2024-09-18T01:47:11.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.056+0000 7f72a7db8640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x5576b37c9650 0x5576b38581e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:53124/0 (socket says 172.21.15.146:53124) 2024-09-18T01:47:11.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.056+0000 7f72a75b7640 1 -- 172.21.15.146:0/364540812 learned_addr learned my addr 172.21.15.146:0/364540812 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:11.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.056+0000 7f72a75b7640 1 -- 172.21.15.146:0/364540812 >> v1:172.21.15.129:6789/0 conn(0x5576b37c9650 legacy=0x5576b38581e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.056+0000 7f72a6db6640 1 -- 172.21.15.146:0/364540812 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 343293521 0 0) 0x5576b3714b30 con 0x5576b37c9650 2024-09-18T01:47:11.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.056+0000 7f72a75b7640 1 -- 172.21.15.146:0/364540812 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576b371ce00 con 0x5576b3859900 2024-09-18T01:47:11.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.058+0000 7f72a75b7640 1 --2- 172.21.15.146:0/364540812 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5576b3859900 0x5576b385bcf0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f729c00a520 tx=0x7f729c045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aab9ee1c7ea52cf server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.058+0000 7f72a6db6640 1 -- 172.21.15.146:0/364540812 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f729c055070 con 0x5576b3859900 2024-09-18T01:47:11.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.058+0000 7f72a6db6640 1 -- 172.21.15.146:0/364540812 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f729c0515b0 con 0x5576b3859900 2024-09-18T01:47:11.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.058+0000 7f72a6db6640 1 -- 172.21.15.146:0/364540812 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f729c0518d0 con 0x5576b3859900 2024-09-18T01:47:11.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.059+0000 7f72ac120800 1 -- 172.21.15.146:0/364540812 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5576b3859900 msgr2=0x5576b385bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.059+0000 7f72ac120800 1 --2- 172.21.15.146:0/364540812 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5576b3859900 0x5576b385bcf0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f729c00a520 tx=0x7f729c045ba0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.059+0000 7f72ac120800 1 -- 172.21.15.146:0/364540812 shutdown_connections 2024-09-18T01:47:11.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.059+0000 7f72ac120800 1 --2- 172.21.15.146:0/364540812 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5576b3859900 0x5576b385bcf0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.059+0000 7f72ac120800 1 -- 172.21.15.146:0/364540812 >> 172.21.15.146:0/364540812 conn(0x5576b384fdb0 msgr2=0x5576b38521d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:11.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.059+0000 7f72ac120800 1 -- 172.21.15.146:0/364540812 shutdown_connections 2024-09-18T01:47:11.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.059+0000 7f72ac120800 1 -- 172.21.15.146:0/364540812 wait complete. 2024-09-18T01:47:11.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.072+0000 7f72ac120800 1 Processor -- start 2024-09-18T01:47:11.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.072+0000 7f72ac120800 1 -- start start 2024-09-18T01:47:11.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.072+0000 7f72ac120800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5576b37c9650 0x5576b3855b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.072+0000 7f72ac120800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5576b37a1360 con 0x5576b37c9650 2024-09-18T01:47:11.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.073+0000 7f72a7db8640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5576b37c9650 0x5576b3855b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.073+0000 7f72a7db8640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5576b37c9650 0x5576b3855b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37696/0 (socket says 172.21.15.146:37696) 2024-09-18T01:47:11.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.073+0000 7f72a7db8640 1 -- 172.21.15.146:0/415083664 learned_addr learned my addr 172.21.15.146:0/415083664 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:11.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.073+0000 7f72a7db8640 1 -- 172.21.15.146:0/415083664 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576b36eebc0 con 0x5576b37c9650 2024-09-18T01:47:11.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.073+0000 7f72a7db8640 1 --2- 172.21.15.146:0/415083664 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5576b37c9650 0x5576b3855b10 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f7298001660 tx=0x7f7298001b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4be896ce766897a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.073+0000 7f7195e0b640 1 -- 172.21.15.146:0/415083664 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7298003450 con 0x5576b37c9650 2024-09-18T01:47:11.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.073+0000 7f7195e0b640 1 -- 172.21.15.146:0/415083664 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7298003610 con 0x5576b37c9650 2024-09-18T01:47:11.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.073+0000 7f7195e0b640 1 -- 172.21.15.146:0/415083664 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72980039b0 con 0x5576b37c9650 2024-09-18T01:47:11.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.074+0000 7f72ac120800 1 -- 172.21.15.146:0/415083664 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5576b37c9650 msgr2=0x5576b3855b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.074+0000 7f72ac120800 1 --2- 172.21.15.146:0/415083664 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5576b37c9650 0x5576b3855b10 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f7298001660 tx=0x7f7298001b20 comp rx=0 tx=0).stop 2024-09-18T01:47:11.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.074+0000 7f72ac120800 1 -- 172.21.15.146:0/415083664 shutdown_connections 2024-09-18T01:47:11.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.074+0000 7f72ac120800 1 --2- 172.21.15.146:0/415083664 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5576b37c9650 0x5576b3855b10 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.074+0000 7f72ac120800 1 -- 172.21.15.146:0/415083664 >> 172.21.15.146:0/415083664 conn(0x5576b384fdb0 msgr2=0x5576b3940040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:11.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.074+0000 7f72ac120800 1 -- 172.21.15.146:0/415083664 shutdown_connections 2024-09-18T01:47:11.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.074+0000 7f72ac120800 1 -- 172.21.15.146:0/415083664 wait complete. 2024-09-18T01:47:11.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.074+0000 7f72ac120800 1 Processor -- start 2024-09-18T01:47:11.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.074+0000 7f72ac120800 1 -- start start 2024-09-18T01:47:11.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.075+0000 7f72ac120800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5576b37c9650 0x5576b394e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.075+0000 7f72ac120800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5576b385c620 con 0x5576b37c9650 2024-09-18T01:47:11.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.075+0000 7f72a7db8640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5576b37c9650 0x5576b394e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.075+0000 7f72a7db8640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5576b37c9650 0x5576b394e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37700/0 (socket says 172.21.15.146:37700) 2024-09-18T01:47:11.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.075+0000 7f72a7db8640 1 -- 172.21.15.146:0/302758656 learned_addr learned my addr 172.21.15.146:0/302758656 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:11.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.075+0000 7f72a7db8640 1 -- 172.21.15.146:0/302758656 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576b3702fe0 con 0x5576b37c9650 2024-09-18T01:47:11.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.075+0000 7f72a7db8640 1 --2- 172.21.15.146:0/302758656 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5576b37c9650 0x5576b394e2b0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x5576b3855210 tx=0x7f7298001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.075+0000 7f718ffff640 1 -- 172.21.15.146:0/302758656 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7298025070 con 0x5576b37c9650 2024-09-18T01:47:11.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.075+0000 7f718ffff640 1 -- 172.21.15.146:0/302758656 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7298019040 con 0x5576b37c9650 2024-09-18T01:47:11.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.075+0000 7f72ac120800 1 -- 172.21.15.146:0/302758656 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5576b394e7f0 con 0x5576b37c9650 2024-09-18T01:47:11.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.075+0000 7f718ffff640 1 -- 172.21.15.146:0/302758656 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7298013950 con 0x5576b37c9650 2024-09-18T01:47:11.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.075+0000 7f72ac120800 1 -- 172.21.15.146:0/302758656 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576b394ed70 con 0x5576b37c9650 2024-09-18T01:47:11.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.076+0000 7f718ffff640 1 -- 172.21.15.146:0/302758656 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7298010070 con 0x5576b37c9650 2024-09-18T01:47:11.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.076+0000 7f718ffff640 1 --2- 172.21.15.146:0/302758656 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7190036b90 0x7f7190039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.076+0000 7f718ffff640 1 -- 172.21.15.146:0/302758656 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f729804c160 con 0x5576b37c9650 2024-09-18T01:47:11.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.076+0000 7f72a75b7640 1 --2- 172.21.15.146:0/302758656 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7190036b90 0x7f7190039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.077+0000 7f72ac120800 1 --2- 172.21.15.146:0/302758656 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5576b3859900 0x5576b3955320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.077+0000 7f72ac120800 1 -- 172.21.15.146:0/302758656 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5576b39558a0 con 0x5576b3859900 2024-09-18T01:47:11.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.077+0000 7f72a85b9640 1 --2- 172.21.15.146:0/302758656 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5576b3859900 0x5576b3955320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.077+0000 7f72a75b7640 1 --2- 172.21.15.146:0/302758656 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7190036b90 0x7f7190039050 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f729c057000 tx=0x7f729c052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.077+0000 7f72a85b9640 1 --2- 172.21.15.146:0/302758656 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5576b3859900 0x5576b3955320 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.077+0000 7f72a85b9640 1 -- 172.21.15.146:0/302758656 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72a00083e0 con 0x5576b3859900 2024-09-18T01:47:11.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.077+0000 7f72ac120800 1 -- 172.21.15.146:0/302758656 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5576b39528d0 con 0x5576b3859900 2024-09-18T01:47:11.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.078+0000 7f72a85b9640 1 -- 172.21.15.146:0/302758656 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f72a00083e0 con 0x5576b3859900 2024-09-18T01:47:11.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.078+0000 7f72ac120800 1 -- 172.21.15.146:0/302758656 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5576b39576c0 con 0x5576b3859900 2024-09-18T01:47:11.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.078+0000 7f72a85b9640 1 -- 172.21.15.146:0/302758656 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f72a00083e0 con 0x5576b3859900 2024-09-18T01:47:11.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.078+0000 7f72ac120800 1 -- 172.21.15.146:0/302758656 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5576b39568f0 con 0x5576b3859900 2024-09-18T01:47:11.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.078+0000 7f72a85b9640 1 -- 172.21.15.146:0/302758656 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f72a00083e0 con 0x5576b3859900 2024-09-18T01:47:11.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.078+0000 7f72ac120800 1 --2- 172.21.15.146:0/302758656 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5576b3958a70 0x5576b395ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.078+0000 7f72ac120800 1 -- 172.21.15.146:0/302758656 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5576b395b3a0 con 0x5576b3958a70 2024-09-18T01:47:11.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.078+0000 7f72a7db8640 1 --2- 172.21.15.146:0/302758656 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5576b3958a70 0x5576b395ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.079+0000 7f72a7db8640 1 --2- 172.21.15.146:0/302758656 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5576b3958a70 0x5576b395ae60 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.079+0000 7f72a7db8640 1 -- 172.21.15.146:0/302758656 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f729800f030 con 0x5576b3958a70 2024-09-18T01:47:11.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.079+0000 7f72ac120800 1 Processor -- start 2024-09-18T01:47:11.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.079+0000 7f72ac120800 1 -- start start 2024-09-18T01:47:11.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.079+0000 7f72ac120800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5576b3969050 0x5576b3969470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.079+0000 7f72ac120800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5576b36f0580 con 0x5576b3969050 2024-09-18T01:47:11.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.080+0000 7f72a85b9640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5576b3969050 0x5576b3969470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.080+0000 7f72a85b9640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5576b3969050 0x5576b3969470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37714/0 (socket says 172.21.15.146:37714) 2024-09-18T01:47:11.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.080+0000 7f72a85b9640 1 -- 172.21.15.146:0/2071969831 learned_addr learned my addr 172.21.15.146:0/2071969831 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:11.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.080+0000 7f72a85b9640 1 -- 172.21.15.146:0/2071969831 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576b39699b0 con 0x5576b3969050 2024-09-18T01:47:11.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.080+0000 7f72a85b9640 1 --2- 172.21.15.146:0/2071969831 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5576b3969050 0x5576b3969470 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x5576b394f360 tx=0x7f72a000ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.080+0000 7f718d7fa640 1 -- 172.21.15.146:0/2071969831 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72a001c070 con 0x5576b3969050 2024-09-18T01:47:11.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.080+0000 7f718d7fa640 1 -- 172.21.15.146:0/2071969831 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72a0018410 con 0x5576b3969050 2024-09-18T01:47:11.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.080+0000 7f72ac120800 1 -- 172.21.15.146:0/2071969831 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5576b3969c40 con 0x5576b3969050 2024-09-18T01:47:11.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.080+0000 7f718d7fa640 1 -- 172.21.15.146:0/2071969831 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72a0018730 con 0x5576b3969050 2024-09-18T01:47:11.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.080+0000 7f72ac120800 1 -- 172.21.15.146:0/2071969831 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576b396c920 con 0x5576b3969050 2024-09-18T01:47:11.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.081+0000 7f718d7fa640 1 -- 172.21.15.146:0/2071969831 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f72a001f070 con 0x5576b3969050 2024-09-18T01:47:11.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.081+0000 7f718d7fa640 1 --2- 172.21.15.146:0/2071969831 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7180036b90 0x7f7180039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.081+0000 7f718d7fa640 1 -- 172.21.15.146:0/2071969831 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f72a004e600 con 0x5576b3969050 2024-09-18T01:47:11.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.081+0000 7f72a7db8640 1 --2- 172.21.15.146:0/2071969831 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7180036b90 0x7f7180039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.081+0000 7f72ac120800 1 Processor -- start 2024-09-18T01:47:11.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.081+0000 7f72a7db8640 1 --2- 172.21.15.146:0/2071969831 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7180036b90 0x7f7180039050 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f729804a500 tx=0x7f7298040040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.081+0000 7f72ac120800 1 -- start start 2024-09-18T01:47:11.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.082+0000 7f72ac120800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5576b3975d00 0x5576b3976100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.082+0000 7f72ac120800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5576b3854180 con 0x5576b3975d00 2024-09-18T01:47:11.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.082+0000 7f72a85b9640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5576b3975d00 0x5576b3976100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.082+0000 7f72a85b9640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5576b3975d00 0x5576b3976100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37724/0 (socket says 172.21.15.146:37724) 2024-09-18T01:47:11.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.082+0000 7f72a85b9640 1 -- 172.21.15.146:0/2523487267 learned_addr learned my addr 172.21.15.146:0/2523487267 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:11.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.082+0000 7f72a85b9640 1 -- 172.21.15.146:0/2523487267 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576b3976640 con 0x5576b3975d00 2024-09-18T01:47:11.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.082+0000 7f72a85b9640 1 --2- 172.21.15.146:0/2523487267 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5576b3975d00 0x5576b3976100 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f72a004c8e0 tx=0x7f72a004cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69e714df5c7c1bfb server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.082+0000 7f7186ffd640 1 -- 172.21.15.146:0/2523487267 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72a0045070 con 0x5576b3975d00 2024-09-18T01:47:11.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.082+0000 7f7186ffd640 1 -- 172.21.15.146:0/2523487267 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72a004b250 con 0x5576b3975d00 2024-09-18T01:47:11.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.082+0000 7f7186ffd640 1 -- 172.21.15.146:0/2523487267 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72a004e070 con 0x5576b3975d00 2024-09-18T01:47:11.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.083+0000 7f72ac120800 1 -- 172.21.15.146:0/2523487267 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5576b3975d00 msgr2=0x5576b3976100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.083+0000 7f72ac120800 1 --2- 172.21.15.146:0/2523487267 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5576b3975d00 0x5576b3976100 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f72a004c8e0 tx=0x7f72a004cb90 comp rx=0 tx=0).stop 2024-09-18T01:47:11.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.083+0000 7f72ac120800 1 -- 172.21.15.146:0/2523487267 shutdown_connections 2024-09-18T01:47:11.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.083+0000 7f72ac120800 1 --2- 172.21.15.146:0/2523487267 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5576b3975d00 0x5576b3976100 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.083+0000 7f72ac120800 1 -- 172.21.15.146:0/2523487267 >> 172.21.15.146:0/2523487267 conn(0x5576b39720b0 msgr2=0x5576b39701b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:11.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.083+0000 7f72ac120800 1 -- 172.21.15.146:0/2523487267 shutdown_connections 2024-09-18T01:47:11.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.083+0000 7f72ac120800 1 -- 172.21.15.146:0/2523487267 wait complete. 2024-09-18T01:47:11.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.083+0000 7f72ac120800 1 Processor -- start 2024-09-18T01:47:11.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.083+0000 7f72ac120800 1 -- start start 2024-09-18T01:47:11.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.083+0000 7f72ac120800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5576b3975d00 0x5576b397d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.083+0000 7f72ac120800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5576b3976ce0 con 0x5576b3975d00 2024-09-18T01:47:11.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.083+0000 7f72a85b9640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5576b3975d00 0x5576b397d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.083+0000 7f72a85b9640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5576b3975d00 0x5576b397d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37738/0 (socket says 172.21.15.146:37738) 2024-09-18T01:47:11.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.083+0000 7f72a85b9640 1 -- 172.21.15.146:0/2367641547 learned_addr learned my addr 172.21.15.146:0/2367641547 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:11.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.084+0000 7f72a85b9640 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576b397d740 con 0x5576b3975d00 2024-09-18T01:47:11.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.084+0000 7f72a85b9640 1 --2- 172.21.15.146:0/2367641547 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5576b3975d00 0x5576b397d200 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f72a004cbd0 tx=0x7f72a004c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.084+0000 7f71857fa640 1 -- 172.21.15.146:0/2367641547 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72a0045050 con 0x5576b3975d00 2024-09-18T01:47:11.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.084+0000 7f71857fa640 1 -- 172.21.15.146:0/2367641547 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72a00163a0 con 0x5576b3975d00 2024-09-18T01:47:11.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.084+0000 7f72ac120800 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5576b397d9d0 con 0x5576b3975d00 2024-09-18T01:47:11.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.084+0000 7f71857fa640 1 -- 172.21.15.146:0/2367641547 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72a0014980 con 0x5576b3975d00 2024-09-18T01:47:11.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.084+0000 7f72ac120800 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576b3980680 con 0x5576b3975d00 2024-09-18T01:47:11.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.085+0000 7f71857fa640 1 -- 172.21.15.146:0/2367641547 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f72a0016680 con 0x5576b3975d00 2024-09-18T01:47:11.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.085+0000 7f71857fa640 1 --2- 172.21.15.146:0/2367641547 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7170036b40 0x7f7170039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.085+0000 7f71857fa640 1 -- 172.21.15.146:0/2367641547 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f72a0001040 con 0x5576b3975d00 2024-09-18T01:47:11.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.085+0000 7f72a7db8640 1 --2- 172.21.15.146:0/2367641547 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7170036b40 0x7f7170039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.085+0000 7f72a7db8640 1 --2- 172.21.15.146:0/2367641547 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7170036b40 0x7f7170039000 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7298002070 tx=0x7f7298031000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.086+0000 7f72ac120800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.086+0000 7f72ac120800 1 --2- 172.21.15.146:0/2367641547 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5576b3988cf0 0x5576b398b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.086+0000 7f72ac120800 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5576b398b900 con 0x5576b3988cf0 2024-09-18T01:47:11.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.086+0000 7f72a75b7640 1 --2- 172.21.15.146:0/2367641547 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5576b3988cf0 0x5576b398b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.086+0000 7f72a75b7640 1 --2- 172.21.15.146:0/2367641547 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5576b3988cf0 0x5576b398b1b0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.086+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f729c057030 con 0x5576b3988cf0 2024-09-18T01:47:11.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.086+0000 7f72ac120800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:11.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.086+0000 7f72ac120800 20 realm 2024-09-18T01:47:11.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.086+0000 7f72ac120800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.086+0000 7f72ac120800 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5576b398bd30 con 0x5576b3988cf0 2024-09-18T01:47:11.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.087+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f729c057030 con 0x5576b3988cf0 2024-09-18T01:47:11.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.087+0000 7f72ac120800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:11.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.087+0000 7f72ac120800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:47:11.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.087+0000 7f72ac120800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.087+0000 7f72ac120800 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5576b398c600 con 0x5576b3988cf0 2024-09-18T01:47:11.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.087+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f729c057030 con 0x5576b3988cf0 2024-09-18T01:47:11.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.087+0000 7f72ac120800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:11.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.087+0000 7f72ac120800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.087+0000 7f72ac120800 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5576b398c9a0 con 0x5576b3988cf0 2024-09-18T01:47:11.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.087+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f729c057030 con 0x5576b3988cf0 2024-09-18T01:47:11.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.087+0000 7f72ac120800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:47:11.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.087+0000 7f72ac120800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.087+0000 7f72ac120800 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5576b398d1f0 con 0x5576b3988cf0 2024-09-18T01:47:11.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.087+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f729c057030 con 0x5576b3988cf0 2024-09-18T01:47:11.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.087+0000 7f72ac120800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:47:11.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.088+0000 7f72ac120800 20 searching for the correct realm 2024-09-18T01:47:11.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.088+0000 7f72ac120800 1 --2- 172.21.15.146:0/2367641547 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5576b398ef60 0x5576b3991350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.088+0000 7f72ac120800 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5576b3991980 con 0x5576b398ef60 2024-09-18T01:47:11.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.088+0000 7f72a85b9640 1 --2- 172.21.15.146:0/2367641547 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5576b398ef60 0x5576b3991350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.088+0000 7f72a85b9640 1 --2- 172.21.15.146:0/2367641547 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5576b398ef60 0x5576b3991350 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.088+0000 7f72a85b9640 1 -- 172.21.15.146:0/2367641547 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a0028070 con 0x5576b398ef60 2024-09-18T01:47:11.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.088+0000 7f72a85b9640 1 --2- 172.21.15.146:0/2367641547 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f72a0021070 0x7f72a00079f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.088+0000 7f72a85b9640 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5576b3991980 con 0x7f72a0021070 2024-09-18T01:47:11.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.088+0000 7f72a7db8640 1 --2- 172.21.15.146:0/2367641547 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f72a0021070 0x7f72a00079f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.089+0000 7f72a7db8640 1 --2- 172.21.15.146:0/2367641547 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f72a0021070 0x7f72a00079f0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.089+0000 7f72a7db8640 1 -- 172.21.15.146:0/2367641547 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729803d070 con 0x7f72a0021070 2024-09-18T01:47:11.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.089+0000 7f72a7db8640 1 --2- 172.21.15.146:0/2367641547 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f72980123c0 0x7f729801d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.089+0000 7f72a7db8640 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5576b3991980 con 0x7f72980123c0 2024-09-18T01:47:11.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.089+0000 7f72a75b7640 1 --2- 172.21.15.146:0/2367641547 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f72980123c0 0x7f729801d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.089+0000 7f72a75b7640 1 --2- 172.21.15.146:0/2367641547 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f72980123c0 0x7f729801d380 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.090+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729c057030 con 0x7f72980123c0 2024-09-18T01:47:11.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.090+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5576b3991980 con 0x5576b3988cf0 2024-09-18T01:47:11.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.090+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v33'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f729c057030 con 0x5576b3988cf0 2024-09-18T01:47:11.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.090+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5576b3991980 con 0x5576b3988cf0 2024-09-18T01:47:11.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.090+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729c057030 con 0x5576b3988cf0 2024-09-18T01:47:11.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.090+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5576b3991980 con 0x7f72980123c0 2024-09-18T01:47:11.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.090+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729c057030 con 0x7f72980123c0 2024-09-18T01:47:11.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.090+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5576b3991980 con 0x7f72980123c0 2024-09-18T01:47:11.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.091+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729c057030 con 0x7f72980123c0 2024-09-18T01:47:11.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.091+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5576b3991980 con 0x7f72a0021070 2024-09-18T01:47:11.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.091+0000 7f72a7db8640 1 -- 172.21.15.146:0/2367641547 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729803d070 con 0x7f72a0021070 2024-09-18T01:47:11.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.091+0000 7f72a7db8640 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5576b3991980 con 0x5576b398ef60 2024-09-18T01:47:11.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.091+0000 7f72a85b9640 1 -- 172.21.15.146:0/2367641547 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a0028070 con 0x5576b398ef60 2024-09-18T01:47:11.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.091+0000 7f72a85b9640 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5576b3991980 con 0x5576b3988cf0 2024-09-18T01:47:11.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.091+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729c057030 con 0x5576b3988cf0 2024-09-18T01:47:11.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.091+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5576b3991980 con 0x7f72980123c0 2024-09-18T01:47:11.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.092+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729c057030 con 0x7f72980123c0 2024-09-18T01:47:11.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.092+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5576b3991980 con 0x5576b3988cf0 2024-09-18T01:47:11.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.092+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729c057030 con 0x5576b3988cf0 2024-09-18T01:47:11.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.092+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5576b3991980 con 0x7f72a0021070 2024-09-18T01:47:11.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.092+0000 7f72a7db8640 1 -- 172.21.15.146:0/2367641547 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f729803d070 con 0x7f72a0021070 2024-09-18T01:47:11.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.092+0000 7f72a7db8640 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5576b3991980 con 0x5576b398ef60 2024-09-18T01:47:11.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.092+0000 7f72a85b9640 1 -- 172.21.15.146:0/2367641547 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a0028070 con 0x5576b398ef60 2024-09-18T01:47:11.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.092+0000 7f72a85b9640 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5576b3991980 con 0x5576b398ef60 2024-09-18T01:47:11.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.093+0000 7f72a85b9640 1 -- 172.21.15.146:0/2367641547 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a0028070 con 0x5576b398ef60 2024-09-18T01:47:11.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.093+0000 7f72a85b9640 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5576b3991980 con 0x7f72980123c0 2024-09-18T01:47:11.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.093+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729c057030 con 0x7f72980123c0 2024-09-18T01:47:11.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.093+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5576b3991980 con 0x5576b398ef60 2024-09-18T01:47:11.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.093+0000 7f72a85b9640 1 -- 172.21.15.146:0/2367641547 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a0028070 con 0x5576b398ef60 2024-09-18T01:47:11.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.093+0000 7f72a85b9640 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5576b3991980 con 0x5576b398ef60 2024-09-18T01:47:11.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.093+0000 7f72a85b9640 1 -- 172.21.15.146:0/2367641547 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a0028070 con 0x5576b398ef60 2024-09-18T01:47:11.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.093+0000 7f72a85b9640 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5576b3991980 con 0x5576b3988cf0 2024-09-18T01:47:11.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.093+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729c057030 con 0x5576b3988cf0 2024-09-18T01:47:11.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.093+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5576b3991980 con 0x5576b3988cf0 2024-09-18T01:47:11.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.094+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v33'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f729c057030 con 0x5576b3988cf0 2024-09-18T01:47:11.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.094+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5576b3991980 con 0x7f72980123c0 2024-09-18T01:47:11.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.094+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729c057030 con 0x7f72980123c0 2024-09-18T01:47:11.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.094+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5576b3991980 con 0x5576b398ef60 2024-09-18T01:47:11.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.094+0000 7f72a85b9640 1 -- 172.21.15.146:0/2367641547 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a0028070 con 0x5576b398ef60 2024-09-18T01:47:11.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.094+0000 7f72a85b9640 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5576b3991980 con 0x7f72a0021070 2024-09-18T01:47:11.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.094+0000 7f72a7db8640 1 -- 172.21.15.146:0/2367641547 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729803d070 con 0x7f72a0021070 2024-09-18T01:47:11.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.094+0000 7f72a7db8640 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5576b3991980 con 0x5576b3988cf0 2024-09-18T01:47:11.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.095+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729c057030 con 0x5576b3988cf0 2024-09-18T01:47:11.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.095+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5576b3991980 con 0x7f72980123c0 2024-09-18T01:47:11.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.095+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729c057030 con 0x7f72980123c0 2024-09-18T01:47:11.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.095+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5576b3991980 con 0x5576b398ef60 2024-09-18T01:47:11.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.095+0000 7f72a85b9640 1 -- 172.21.15.146:0/2367641547 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a0028070 con 0x5576b398ef60 2024-09-18T01:47:11.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.095+0000 7f72a85b9640 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5576b3991980 con 0x7f72980123c0 2024-09-18T01:47:11.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.095+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729c057030 con 0x7f72980123c0 2024-09-18T01:47:11.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.095+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5576b3991980 con 0x7f72a0021070 2024-09-18T01:47:11.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.096+0000 7f72a7db8640 1 -- 172.21.15.146:0/2367641547 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729803d070 con 0x7f72a0021070 2024-09-18T01:47:11.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.096+0000 7f72a7db8640 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5576b3991980 con 0x5576b398ef60 2024-09-18T01:47:11.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.096+0000 7f72a85b9640 1 -- 172.21.15.146:0/2367641547 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a0028070 con 0x5576b398ef60 2024-09-18T01:47:11.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.096+0000 7f72a85b9640 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5576b3991980 con 0x7f72980123c0 2024-09-18T01:47:11.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.096+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729c057030 con 0x7f72980123c0 2024-09-18T01:47:11.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.096+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5576b3991980 con 0x5576b3988cf0 2024-09-18T01:47:11.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.096+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v33'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f729c057030 con 0x5576b3988cf0 2024-09-18T01:47:11.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.096+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5576b3991980 con 0x7f72a0021070 2024-09-18T01:47:11.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.097+0000 7f72a7db8640 1 -- 172.21.15.146:0/2367641547 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729803d070 con 0x7f72a0021070 2024-09-18T01:47:11.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.097+0000 7f72ac120800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:47:11.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.097+0000 7f72ac120800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:47:11.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.097+0000 7f72ac120800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:47:11.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.097+0000 7f72ac120800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:47:11.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.097+0000 7f72ac120800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:47:11.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.097+0000 7f72ac120800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:47:11.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.097+0000 7f72ac120800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.097+0000 7f72ac120800 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5576b398dba0 con 0x5576b3988cf0 2024-09-18T01:47:11.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.097+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f729c057030 con 0x5576b3988cf0 2024-09-18T01:47:11.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.097+0000 7f72ac120800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:11.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.097+0000 7f72ac120800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.097+0000 7f72ac120800 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5576b398e440 con 0x5576b3988cf0 2024-09-18T01:47:11.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.097+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f729c057030 con 0x5576b3988cf0 2024-09-18T01:47:11.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.097+0000 7f72ac120800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:47:11.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.097+0000 7f72ac120800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.097+0000 7f72ac120800 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5576b3991e00 con 0x7f72a0021070 2024-09-18T01:47:11.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.097+0000 7f72a7db8640 1 -- 172.21.15.146:0/2367641547 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f729803d070 con 0x7f72a0021070 2024-09-18T01:47:11.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.097+0000 7f72ac120800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:47:11.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.097+0000 7f72ac120800 20 zone default found 2024-09-18T01:47:11.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.097+0000 7f72ac120800 4 Realm: () 2024-09-18T01:47:11.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.097+0000 7f72ac120800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:47:11.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.097+0000 7f72ac120800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:47:11.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.097+0000 7f72ac120800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:47:11.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.097+0000 7f72ac120800 20 zonegroup default 2024-09-18T01:47:11.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.097+0000 7f72ac120800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.097+0000 7f72ac120800 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5576b3992650 con 0x7f72980123c0 2024-09-18T01:47:11.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.098+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f729c057030 con 0x7f72980123c0 2024-09-18T01:47:11.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.098+0000 7f72ac120800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:11.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.098+0000 7f72ac120800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.098+0000 7f72ac120800 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5576b3994030 con 0x5576b398ef60 2024-09-18T01:47:11.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.098+0000 7f72a85b9640 1 -- 172.21.15.146:0/2367641547 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f72a0028070 con 0x5576b398ef60 2024-09-18T01:47:11.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.098+0000 7f72ac120800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:11.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.098+0000 7f72ac120800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.098+0000 7f72ac120800 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5576b39944b0 con 0x5576b398ef60 2024-09-18T01:47:11.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.098+0000 7f72a85b9640 1 -- 172.21.15.146:0/2367641547 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f72a0028070 con 0x5576b398ef60 2024-09-18T01:47:11.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.098+0000 7f72ac120800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:11.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.098+0000 7f72ac120800 20 started sync module instance, tier type = 2024-09-18T01:47:11.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.098+0000 7f72ac120800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:47:11.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.098+0000 7f72ac120800 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5576b39934c0 con 0x7f72a0021070 2024-09-18T01:47:11.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.099+0000 7f72a7db8640 1 -- 172.21.15.146:0/2367641547 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v33'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729803d070 con 0x7f72a0021070 2024-09-18T01:47:11.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.099+0000 7f72ac120800 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93968307665072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5576b3993120 con 0x7f72a0021070 2024-09-18T01:47:11.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.099+0000 7f72ac120800 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5576b39953e0 con 0x5576b3988cf0 2024-09-18T01:47:11.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.100+0000 7f72a7db8640 1 -- 172.21.15.146:0/2367641547 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93968307665072] v33'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729803d070 con 0x7f72a0021070 2024-09-18T01:47:11.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.101+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v33'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729c057030 con 0x5576b3988cf0 2024-09-18T01:47:11.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.101+0000 7f72ac120800 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93968307670832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5576b3995800 con 0x5576b3988cf0 2024-09-18T01:47:11.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.101+0000 7f72ac120800 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5576b39961c0 con 0x5576b398ef60 2024-09-18T01:47:11.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.101+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93968307670832] v33'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729c057030 con 0x5576b3988cf0 2024-09-18T01:47:11.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.102+0000 7f72a85b9640 1 -- 172.21.15.146:0/2367641547 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v33'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72a0028070 con 0x5576b398ef60 2024-09-18T01:47:11.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.102+0000 7f72ac120800 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93968307672368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5576b39961c0 con 0x5576b398ef60 2024-09-18T01:47:11.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.102+0000 7f72ac120800 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5576b3996bc0 con 0x7f72a0021070 2024-09-18T01:47:11.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.103+0000 7f72a7db8640 1 -- 172.21.15.146:0/2367641547 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v33'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729803d070 con 0x7f72a0021070 2024-09-18T01:47:11.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.103+0000 7f72ac120800 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93968307676880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5576b3997460 con 0x7f72a0021070 2024-09-18T01:47:11.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.103+0000 7f72ac120800 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5576b3997f40 con 0x5576b3988cf0 2024-09-18T01:47:11.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.103+0000 7f72a85b9640 1 -- 172.21.15.146:0/2367641547 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93968307672368] v33'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72a0028070 con 0x5576b398ef60 2024-09-18T01:47:11.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.104+0000 7f72a7db8640 1 -- 172.21.15.146:0/2367641547 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93968307676880] v33'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729803d070 con 0x7f72a0021070 2024-09-18T01:47:11.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.104+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v33'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729c057030 con 0x5576b3988cf0 2024-09-18T01:47:11.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.104+0000 7f72ac120800 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93968307674384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5576b3996fb0 con 0x5576b3988cf0 2024-09-18T01:47:11.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.104+0000 7f72ac120800 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5576b3997450 con 0x7f72980123c0 2024-09-18T01:47:11.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.105+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93968307674384] v33'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729c057030 con 0x5576b3988cf0 2024-09-18T01:47:11.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.105+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v33'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729c057030 con 0x7f72980123c0 2024-09-18T01:47:11.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.105+0000 7f72ac120800 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93968307681872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5576b3998860 con 0x7f72980123c0 2024-09-18T01:47:11.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.105+0000 7f72ac120800 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5576b3999220 con 0x7f72980123c0 2024-09-18T01:47:11.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.106+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93968307681872] v33'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729c057030 con 0x7f72980123c0 2024-09-18T01:47:11.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.106+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v33'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729c057030 con 0x7f72980123c0 2024-09-18T01:47:11.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.106+0000 7f72ac120800 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93968307684112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5576b3999220 con 0x7f72980123c0 2024-09-18T01:47:11.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.106+0000 7f72ac120800 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5576b3999be0 con 0x7f72980123c0 2024-09-18T01:47:11.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.107+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93968307684112] v33'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729c057030 con 0x7f72980123c0 2024-09-18T01:47:11.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.107+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v33'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729c057030 con 0x7f72980123c0 2024-09-18T01:47:11.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.107+0000 7f72ac120800 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93968307686768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5576b3999dc0 con 0x7f72980123c0 2024-09-18T01:47:11.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.107+0000 7f72ac120800 20 add_watcher() i=0 2024-09-18T01:47:11.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.107+0000 7f72ac120800 20 add_watcher() i=1 2024-09-18T01:47:11.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.107+0000 7f72ac120800 20 add_watcher() i=2 2024-09-18T01:47:11.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.107+0000 7f72ac120800 20 add_watcher() i=3 2024-09-18T01:47:11.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.107+0000 7f72ac120800 20 add_watcher() i=4 2024-09-18T01:47:11.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.107+0000 7f72ac120800 20 add_watcher() i=5 2024-09-18T01:47:11.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.107+0000 7f72ac120800 20 add_watcher() i=6 2024-09-18T01:47:11.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.108+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93968307686768] v33'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729c057030 con 0x7f72980123c0 2024-09-18T01:47:11.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.108+0000 7f72ac120800 20 add_watcher() i=7 2024-09-18T01:47:11.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.108+0000 7f72ac120800 2 all 8 watchers are set, enabling cache 2024-09-18T01:47:11.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.108+0000 7f72ac120800 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5576b399cf60 con 0x5576b3988cf0 2024-09-18T01:47:11.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.109+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f729c057030 con 0x5576b3988cf0 2024-09-18T01:47:11.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.109+0000 7f72ac120800 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93968307702064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5576b3999d00 con 0x5576b3988cf0 2024-09-18T01:47:11.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.110+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93968307702064] v33'267 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f729c057030 con 0x5576b3988cf0 2024-09-18T01:47:11.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.110+0000 7f715dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:47:11.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.110+0000 7f72ac120800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:47:11.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.110+0000 7f72ac120800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:47:11.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.110+0000 7f72ac120800 5 note: GC not initialized 2024-09-18T01:47:11.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.110+0000 7f715cfe1640 20 reqs_thread_entry: start 2024-09-18T01:47:11.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.110+0000 7f72ac120800 20 init_complete bucket index max shards: 11 2024-09-18T01:47:11.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.110+0000 7f72ac120800 20 Filter name: none 2024-09-18T01:47:11.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.110+0000 7f70d67fc640 20 reqs_thread_entry: start 2024-09-18T01:47:11.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.110+0000 7f72ac120800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-18T01:47:11.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.110+0000 7f72ac120800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.110+0000 7f72ac120800 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5576b39d03b0 con 0x7f72980123c0 2024-09-18T01:47:11.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.111+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f729c057030 con 0x7f72980123c0 2024-09-18T01:47:11.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.111+0000 7f72ac120800 20 rados_obj.operate() r=0 bl.length=490 2024-09-18T01:47:11.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.111+0000 7f72ac120800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-18T01:47:11.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.111+0000 7f72ac120800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:47:11.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.111+0000 7f72ac120800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:47:11.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.111+0000 7f72ac120800 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~503 in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5576b39d6b30 con 0x7f72980123c0 2024-09-18T01:47:11.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.112+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~503] v33'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f729c057030 con 0x7f72980123c0 2024-09-18T01:47:11.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.112+0000 7f72ac120800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T01:47:11.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.112+0000 7f72ac120800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:47:11.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.112+0000 7f72ac120800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-18T01:47:11.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.112+0000 7f72ac120800 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93968307938544 in=691b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5576b39d2170 con 0x5576b3988cf0 2024-09-18T01:47:11.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.112+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== watch-notify(notify (1) cookie 93968307674384 notify 141733920798 ret 0) ==== 721+0+0 (crc 0 0 0) 0x7f729c076040 con 0x5576b3988cf0 2024-09-18T01:47:11.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.112+0000 7f7186ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920798 cookie 93968307674384 notifier 4894 bl.length()=679 2024-09-18T01:47:11.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.112+0000 7f7186ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T01:47:11.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.112+0000 7f7186ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:47:11.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.113+0000 7f7186ffd640 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f716c003ea0 con 0x5576b3988cf0 2024-09-18T01:47:11.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.113+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(64 notify.4 [notify cookie 93968307938544 out=8b] v0'0 uv264 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f729c057030 con 0x5576b3988cf0 2024-09-18T01:47:11.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.113+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729c057030 con 0x5576b3988cf0 2024-09-18T01:47:11.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.113+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== watch-notify(notify_complete (2) cookie 93968307938544 notify 141733920798 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5576b371ce00 con 0x5576b3988cf0 2024-09-18T01:47:11.133 INFO:teuthology.orchestra.run.smithi146.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-18T01:47:09.882428Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:47:09.882414Z","tags":[],"group_ids":[]} 2024-09-18T01:47:11.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.114+0000 7f715dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:47:11.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.114+0000 7f72ac120800 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93968307702064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5576b39ce0f0 con 0x5576b3988cf0 2024-09-18T01:47:11.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.115+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93968307702064] v33'268 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f729c057030 con 0x5576b3988cf0 2024-09-18T01:47:11.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.115+0000 7f72ac120800 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93968307665072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5576b39ce0f0 con 0x7f72a0021070 2024-09-18T01:47:11.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.116+0000 7f72a7db8640 1 -- 172.21.15.146:0/2367641547 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93968307665072] v33'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729803d070 con 0x7f72a0021070 2024-09-18T01:47:11.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.116+0000 7f72ac120800 20 remove_watcher() i=0 2024-09-18T01:47:11.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.116+0000 7f72ac120800 2 removed watcher, disabling cache 2024-09-18T01:47:11.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.116+0000 7f72ac120800 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93968307670832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5576b39ce0f0 con 0x5576b3988cf0 2024-09-18T01:47:11.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.117+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93968307670832] v33'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729c081040 con 0x5576b3988cf0 2024-09-18T01:47:11.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.117+0000 7f72ac120800 20 remove_watcher() i=1 2024-09-18T01:47:11.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.117+0000 7f72ac120800 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93968307672368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5576b39ce0f0 con 0x5576b398ef60 2024-09-18T01:47:11.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.118+0000 7f72a85b9640 1 -- 172.21.15.146:0/2367641547 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93968307672368] v33'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72a0028070 con 0x5576b398ef60 2024-09-18T01:47:11.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.118+0000 7f72ac120800 20 remove_watcher() i=2 2024-09-18T01:47:11.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.118+0000 7f72ac120800 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93968307676880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5576b39ce0f0 con 0x7f72a0021070 2024-09-18T01:47:11.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.119+0000 7f72a7db8640 1 -- 172.21.15.146:0/2367641547 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93968307676880] v33'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729803d070 con 0x7f72a0021070 2024-09-18T01:47:11.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.119+0000 7f72ac120800 20 remove_watcher() i=3 2024-09-18T01:47:11.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.119+0000 7f72ac120800 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93968307674384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5576b39ce0f0 con 0x5576b3988cf0 2024-09-18T01:47:11.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.120+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 <== osd.1 v2:172.21.15.146:6808/3930274777 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93968307674384] v33'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729c081040 con 0x5576b3988cf0 2024-09-18T01:47:11.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.120+0000 7f72ac120800 20 remove_watcher() i=4 2024-09-18T01:47:11.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.120+0000 7f72ac120800 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93968307681872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5576b39ce0f0 con 0x7f72980123c0 2024-09-18T01:47:11.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.121+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93968307681872] v33'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729c081040 con 0x7f72980123c0 2024-09-18T01:47:11.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.121+0000 7f72ac120800 20 remove_watcher() i=5 2024-09-18T01:47:11.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.121+0000 7f72ac120800 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93968307684112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5576b39ce0f0 con 0x7f72980123c0 2024-09-18T01:47:11.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.122+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93968307684112] v33'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729c081040 con 0x7f72980123c0 2024-09-18T01:47:11.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.122+0000 7f72ac120800 20 remove_watcher() i=6 2024-09-18T01:47:11.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.122+0000 7f72ac120800 1 -- 172.21.15.146:0/2367641547 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93968307686768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5576b39ce0f0 con 0x7f72980123c0 2024-09-18T01:47:11.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.123+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93968307686768] v33'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729c081040 con 0x7f72980123c0 2024-09-18T01:47:11.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.123+0000 7f72ac120800 20 remove_watcher() i=7 2024-09-18T01:47:11.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.123+0000 7f72ac120800 1 -- 172.21.15.146:0/2367641547 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f72980123c0 msgr2=0x7f729801d380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.123+0000 7f72ac120800 1 --2- 172.21.15.146:0/2367641547 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f72980123c0 0x7f729801d380 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.123+0000 7f72ac120800 1 -- 172.21.15.146:0/2367641547 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5576b3988cf0 msgr2=0x5576b398b1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.123+0000 7f72ac120800 1 --2- 172.21.15.146:0/2367641547 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5576b3988cf0 0x5576b398b1b0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.123+0000 7f72ac120800 1 -- 172.21.15.146:0/2367641547 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f72a0021070 msgr2=0x7f72a00079f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.123+0000 7f72ac120800 1 --2- 172.21.15.146:0/2367641547 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f72a0021070 0x7f72a00079f0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.123+0000 7f72ac120800 1 -- 172.21.15.146:0/2367641547 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5576b398ef60 msgr2=0x5576b3991350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.123+0000 7f72ac120800 1 --2- 172.21.15.146:0/2367641547 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5576b398ef60 0x5576b3991350 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.124+0000 7f72ac120800 1 -- 172.21.15.146:0/2367641547 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7170036b40 msgr2=0x7f7170039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.124+0000 7f72ac120800 1 --2- 172.21.15.146:0/2367641547 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7170036b40 0x7f7170039000 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7298002070 tx=0x7f7298031000 comp rx=0 tx=0).stop 2024-09-18T01:47:11.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.124+0000 7f72ac120800 1 -- 172.21.15.146:0/2367641547 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5576b3975d00 msgr2=0x5576b397d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.124+0000 7f72ac120800 1 --2- 172.21.15.146:0/2367641547 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5576b3975d00 0x5576b397d200 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f72a004cbd0 tx=0x7f72a004c870 comp rx=0 tx=0).stop 2024-09-18T01:47:11.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.124+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 reap_dead start 2024-09-18T01:47:11.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.124+0000 7f72a75b7640 1 -- 172.21.15.146:0/2367641547 reap_dead start 2024-09-18T01:47:11.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.124+0000 7f72ac120800 1 -- 172.21.15.146:0/2367641547 shutdown_connections 2024-09-18T01:47:11.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.124+0000 7f72ac120800 1 -- 172.21.15.146:0/2367641547 >> 172.21.15.146:0/2367641547 conn(0x5576b39720b0 msgr2=0x5576b3970180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:11.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.124+0000 7f72ac120800 1 -- 172.21.15.146:0/2367641547 shutdown_connections 2024-09-18T01:47:11.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.124+0000 7f72ac120800 1 -- 172.21.15.146:0/2367641547 wait complete. 2024-09-18T01:47:11.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.124+0000 7f72ac120800 1 -- 172.21.15.146:0/2071969831 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7180036b90 msgr2=0x7f7180039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.124+0000 7f72ac120800 1 --2- 172.21.15.146:0/2071969831 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7180036b90 0x7f7180039050 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f729804a500 tx=0x7f7298040040 comp rx=0 tx=0).stop 2024-09-18T01:47:11.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.124+0000 7f72ac120800 1 -- 172.21.15.146:0/2071969831 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5576b3969050 msgr2=0x5576b3969470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.124+0000 7f72ac120800 1 --2- 172.21.15.146:0/2071969831 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5576b3969050 0x5576b3969470 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x5576b394f360 tx=0x7f72a000ef30 comp rx=0 tx=0).stop 2024-09-18T01:47:11.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.124+0000 7f72ac120800 1 -- 172.21.15.146:0/2071969831 shutdown_connections 2024-09-18T01:47:11.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.124+0000 7f72ac120800 1 --2- 172.21.15.146:0/2071969831 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7180036b90 0x7f7180039050 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.124+0000 7f72ac120800 1 --2- 172.21.15.146:0/2071969831 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5576b3969050 0x5576b3969470 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.124+0000 7f72ac120800 1 -- 172.21.15.146:0/2071969831 >> 172.21.15.146:0/2071969831 conn(0x5576b395dfe0 msgr2=0x5576b3960b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:11.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.124+0000 7f72ac120800 1 -- 172.21.15.146:0/2071969831 shutdown_connections 2024-09-18T01:47:11.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.124+0000 7f72ac120800 1 -- 172.21.15.146:0/2071969831 wait complete. 2024-09-18T01:47:11.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.124+0000 7f72ac120800 1 -- 172.21.15.146:0/302758656 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5576b3859900 msgr2=0x5576b3955320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.124+0000 7f72ac120800 1 --2- 172.21.15.146:0/302758656 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5576b3859900 0x5576b3955320 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.124+0000 7f72ac120800 1 -- 172.21.15.146:0/302758656 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5576b3958a70 msgr2=0x5576b395ae60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.124+0000 7f72ac120800 1 --2- 172.21.15.146:0/302758656 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5576b3958a70 0x5576b395ae60 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.124+0000 7f72ac120800 1 -- 172.21.15.146:0/302758656 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7190036b90 msgr2=0x7f7190039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.124+0000 7f72ac120800 1 --2- 172.21.15.146:0/302758656 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7190036b90 0x7f7190039050 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f729c057000 tx=0x7f729c052000 comp rx=0 tx=0).stop 2024-09-18T01:47:11.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.125+0000 7f72ac120800 1 -- 172.21.15.146:0/302758656 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5576b37c9650 msgr2=0x5576b394e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.125+0000 7f72ac120800 1 --2- 172.21.15.146:0/302758656 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5576b37c9650 0x5576b394e2b0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x5576b3855210 tx=0x7f7298001250 comp rx=0 tx=0).stop 2024-09-18T01:47:11.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.125+0000 7f72ac120800 1 -- 172.21.15.146:0/302758656 shutdown_connections 2024-09-18T01:47:11.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.125+0000 7f72ac120800 1 --2- 172.21.15.146:0/302758656 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5576b3958a70 0x5576b395ae60 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.125+0000 7f72ac120800 1 --2- 172.21.15.146:0/302758656 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5576b3859900 0x5576b3955320 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.125+0000 7f72ac120800 1 --2- 172.21.15.146:0/302758656 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f7190036b90 0x7f7190039050 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.125+0000 7f72ac120800 1 --2- 172.21.15.146:0/302758656 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5576b37c9650 0x5576b394e2b0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.125+0000 7f72ac120800 1 -- 172.21.15.146:0/302758656 >> 172.21.15.146:0/302758656 conn(0x5576b384fdb0 msgr2=0x5576b393fc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:11.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.125+0000 7f72ac120800 1 -- 172.21.15.146:0/302758656 shutdown_connections 2024-09-18T01:47:11.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.125+0000 7f72ac120800 1 -- 172.21.15.146:0/302758656 wait complete. 2024-09-18T01:47:11.146 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T01:47:09.882428Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:47:09.882414Z', 'tags': [], 'group_ids': []} 2024-09-18T01:47:11.146 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T01:47:09.882428Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:47:09.882414Z', 'tags': [], 'group_ids': []} 2024-09-18T01:47:11.146 ERROR:root:0 2024-09-18T01:47:11.146 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-18T01:47:11.151 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T01:47:11.151 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-09-18T01:47:11.151 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-09-18T01:47:11.151 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write; user-info-without-keys=*' 2024-09-18T01:47:11.198 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:47:11.198 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:47:11.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.198+0000 7fd23c319800 1 Processor -- start 2024-09-18T01:47:11.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.198+0000 7fd23c319800 1 -- start start 2024-09-18T01:47:11.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.198+0000 7fd23c319800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x5639453d4650 0x5639454631e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.198+0000 7fd23c319800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56394531fb30 con 0x563945463720 2024-09-18T01:47:11.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.198+0000 7fd23c319800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x563945301360 con 0x5639453d4650 2024-09-18T01:47:11.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.198+0000 7fd239e0d640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x5639453d4650 0x5639454631e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.198+0000 7fd23960c640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x563945463720 0x563945465b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:53126/0 (socket says 172.21.15.146:53126) 2024-09-18T01:47:11.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.198+0000 7fd23960c640 1 -- 172.21.15.146:0/1949634295 learned_addr learned my addr 172.21.15.146:0/1949634295 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:47:11.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.199+0000 7fd239e0d640 1 -- 172.21.15.146:0/1949634295 >> v1:172.21.15.129:6789/0 conn(0x563945463720 legacy=0x563945465b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.199+0000 7fd238e0b640 1 -- 172.21.15.146:0/1949634295 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1479960668 0 0) 0x56394531fb30 con 0x563945463720 2024-09-18T01:47:11.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.199+0000 7fd239e0d640 1 -- 172.21.15.146:0/1949634295 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563945327e00 con 0x5639453d4650 2024-09-18T01:47:11.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.200+0000 7fd239e0d640 1 --2- 172.21.15.146:0/1949634295 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5639453d4650 0x5639454631e0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fd22c00a470 tx=0x7fd22c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f6121188604208a server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.200+0000 7fd238e0b640 1 -- 172.21.15.146:0/1949634295 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd22c053570 con 0x5639453d4650 2024-09-18T01:47:11.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.200+0000 7fd238e0b640 1 -- 172.21.15.146:0/1949634295 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd22c058070 con 0x5639453d4650 2024-09-18T01:47:11.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.201+0000 7fd238e0b640 1 -- 172.21.15.146:0/1949634295 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd22c053880 con 0x5639453d4650 2024-09-18T01:47:11.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.201+0000 7fd23c319800 1 -- 172.21.15.146:0/1949634295 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5639453d4650 msgr2=0x5639454631e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.201+0000 7fd23c319800 1 --2- 172.21.15.146:0/1949634295 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5639453d4650 0x5639454631e0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fd22c00a470 tx=0x7fd22c045a20 comp rx=0 tx=0).stop 2024-09-18T01:47:11.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.201+0000 7fd23c319800 1 -- 172.21.15.146:0/1949634295 shutdown_connections 2024-09-18T01:47:11.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.201+0000 7fd23c319800 1 --2- 172.21.15.146:0/1949634295 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5639453d4650 0x5639454631e0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.201+0000 7fd23c319800 1 -- 172.21.15.146:0/1949634295 >> 172.21.15.146:0/1949634295 conn(0x56394545adb0 msgr2=0x56394545d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:11.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.201+0000 7fd23c319800 1 -- 172.21.15.146:0/1949634295 shutdown_connections 2024-09-18T01:47:11.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.201+0000 7fd23c319800 1 -- 172.21.15.146:0/1949634295 wait complete. 2024-09-18T01:47:11.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.215+0000 7fd23c319800 1 Processor -- start 2024-09-18T01:47:11.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.215+0000 7fd23c319800 1 -- start start 2024-09-18T01:47:11.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.215+0000 7fd23c319800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5639453d4650 0x56394554f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.215+0000 7fd23c319800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5639453ac360 con 0x5639453d4650 2024-09-18T01:47:11.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.215+0000 7fd239e0d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5639453d4650 0x56394554f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.215+0000 7fd239e0d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5639453d4650 0x56394554f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37758/0 (socket says 172.21.15.146:37758) 2024-09-18T01:47:11.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.215+0000 7fd239e0d640 1 -- 172.21.15.146:0/123452286 learned_addr learned my addr 172.21.15.146:0/123452286 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:11.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.216+0000 7fd239e0d640 1 -- 172.21.15.146:0/123452286 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639452f9bc0 con 0x5639453d4650 2024-09-18T01:47:11.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.216+0000 7fd239e0d640 1 --2- 172.21.15.146:0/123452286 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5639453d4650 0x56394554f6b0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fd22c045f50 tx=0x7fd22c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fd16cbd3d3084b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.216+0000 7fd127e07640 1 -- 172.21.15.146:0/123452286 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd22c053c20 con 0x5639453d4650 2024-09-18T01:47:11.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.216+0000 7fd127e07640 1 -- 172.21.15.146:0/123452286 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd22c063030 con 0x5639453d4650 2024-09-18T01:47:11.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.216+0000 7fd127e07640 1 -- 172.21.15.146:0/123452286 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd22c053440 con 0x5639453d4650 2024-09-18T01:47:11.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.217+0000 7fd23c319800 1 -- 172.21.15.146:0/123452286 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5639453d4650 msgr2=0x56394554f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.217+0000 7fd23c319800 1 --2- 172.21.15.146:0/123452286 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5639453d4650 0x56394554f6b0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fd22c045f50 tx=0x7fd22c051000 comp rx=0 tx=0).stop 2024-09-18T01:47:11.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.217+0000 7fd23c319800 1 -- 172.21.15.146:0/123452286 shutdown_connections 2024-09-18T01:47:11.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.217+0000 7fd23c319800 1 --2- 172.21.15.146:0/123452286 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5639453d4650 0x56394554f6b0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.217+0000 7fd23c319800 1 -- 172.21.15.146:0/123452286 >> 172.21.15.146:0/123452286 conn(0x56394545adb0 msgr2=0x56394554b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:11.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.217+0000 7fd23c319800 1 -- 172.21.15.146:0/123452286 shutdown_connections 2024-09-18T01:47:11.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.217+0000 7fd23c319800 1 -- 172.21.15.146:0/123452286 wait complete. 2024-09-18T01:47:11.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.217+0000 7fd23c319800 1 Processor -- start 2024-09-18T01:47:11.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.217+0000 7fd23c319800 1 -- start start 2024-09-18T01:47:11.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.217+0000 7fd23c319800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5639453d4650 0x563945557010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.217+0000 7fd23c319800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x563945467620 con 0x5639453d4650 2024-09-18T01:47:11.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.217+0000 7fd239e0d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5639453d4650 0x563945557010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.218+0000 7fd239e0d640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5639453d4650 0x563945557010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37764/0 (socket says 172.21.15.146:37764) 2024-09-18T01:47:11.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.218+0000 7fd239e0d640 1 -- 172.21.15.146:0/360419892 learned_addr learned my addr 172.21.15.146:0/360419892 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:11.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.218+0000 7fd239e0d640 1 -- 172.21.15.146:0/360419892 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56394530dfe0 con 0x5639453d4650 2024-09-18T01:47:11.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.218+0000 7fd239e0d640 1 --2- 172.21.15.146:0/360419892 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5639453d4650 0x563945557010 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fd22c045f20 tx=0x7fd22c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.218+0000 7fd126604640 1 -- 172.21.15.146:0/360419892 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd22c053570 con 0x5639453d4650 2024-09-18T01:47:11.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.218+0000 7fd126604640 1 -- 172.21.15.146:0/360419892 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd22c053710 con 0x5639453d4650 2024-09-18T01:47:11.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.218+0000 7fd23c319800 1 -- 172.21.15.146:0/360419892 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563945557550 con 0x5639453d4650 2024-09-18T01:47:11.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.218+0000 7fd126604640 1 -- 172.21.15.146:0/360419892 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd22c068420 con 0x5639453d4650 2024-09-18T01:47:11.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.218+0000 7fd23c319800 1 -- 172.21.15.146:0/360419892 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639455579f0 con 0x5639453d4650 2024-09-18T01:47:11.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.219+0000 7fd126604640 1 -- 172.21.15.146:0/360419892 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd22c068610 con 0x5639453d4650 2024-09-18T01:47:11.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.219+0000 7fd126604640 1 --2- 172.21.15.146:0/360419892 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd120036b40 0x7fd120039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.219+0000 7fd126604640 1 -- 172.21.15.146:0/360419892 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7fd22c070070 con 0x5639453d4650 2024-09-18T01:47:11.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.219+0000 7fd23960c640 1 --2- 172.21.15.146:0/360419892 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd120036b40 0x7fd120039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.219+0000 7fd23c319800 1 --2- 172.21.15.146:0/360419892 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x563945463720 0x56394555e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.219+0000 7fd23c319800 1 -- 172.21.15.146:0/360419892 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56394555e5c0 con 0x563945463720 2024-09-18T01:47:11.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.219+0000 7fd23a60e640 1 --2- 172.21.15.146:0/360419892 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x563945463720 0x56394555e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.220+0000 7fd23960c640 1 --2- 172.21.15.146:0/360419892 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd120036b40 0x7fd120039000 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fd230000c00 tx=0x7fd2300013b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.220+0000 7fd23a60e640 1 --2- 172.21.15.146:0/360419892 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x563945463720 0x56394555e080 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.220+0000 7fd23a60e640 1 -- 172.21.15.146:0/360419892 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd23400a4a0 con 0x563945463720 2024-09-18T01:47:11.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.220+0000 7fd23c319800 1 -- 172.21.15.146:0/360419892 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56394555b5e0 con 0x563945463720 2024-09-18T01:47:11.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.220+0000 7fd23a60e640 1 -- 172.21.15.146:0/360419892 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd23400a4a0 con 0x563945463720 2024-09-18T01:47:11.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.220+0000 7fd23c319800 1 -- 172.21.15.146:0/360419892 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563945560320 con 0x563945463720 2024-09-18T01:47:11.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.221+0000 7fd23a60e640 1 -- 172.21.15.146:0/360419892 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd23400a4a0 con 0x563945463720 2024-09-18T01:47:11.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.221+0000 7fd23c319800 1 -- 172.21.15.146:0/360419892 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56394555f3a0 con 0x563945463720 2024-09-18T01:47:11.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.221+0000 7fd23a60e640 1 -- 172.21.15.146:0/360419892 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd23400a4a0 con 0x563945463720 2024-09-18T01:47:11.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.221+0000 7fd23c319800 1 --2- 172.21.15.146:0/360419892 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x56394555fe40 0x5639455636e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.221+0000 7fd23c319800 1 -- 172.21.15.146:0/360419892 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563945563e20 con 0x56394555fe40 2024-09-18T01:47:11.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.221+0000 7fd239e0d640 1 --2- 172.21.15.146:0/360419892 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x56394555fe40 0x5639455636e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.221+0000 7fd239e0d640 1 --2- 172.21.15.146:0/360419892 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x56394555fe40 0x5639455636e0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.222+0000 7fd239e0d640 1 -- 172.21.15.146:0/360419892 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd22c051070 con 0x56394555fe40 2024-09-18T01:47:11.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.222+0000 7fd23c319800 1 Processor -- start 2024-09-18T01:47:11.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.222+0000 7fd23c319800 1 -- start start 2024-09-18T01:47:11.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.222+0000 7fd23c319800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563945571bd0 0x563945571ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.222+0000 7fd23c319800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5639452fb580 con 0x563945571bd0 2024-09-18T01:47:11.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.222+0000 7fd23a60e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563945571bd0 0x563945571ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.222+0000 7fd23a60e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563945571bd0 0x563945571ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37780/0 (socket says 172.21.15.146:37780) 2024-09-18T01:47:11.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.222+0000 7fd23a60e640 1 -- 172.21.15.146:0/233964982 learned_addr learned my addr 172.21.15.146:0/233964982 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:11.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.223+0000 7fd23a60e640 1 -- 172.21.15.146:0/233964982 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563945572530 con 0x563945571bd0 2024-09-18T01:47:11.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.223+0000 7fd23a60e640 1 --2- 172.21.15.146:0/233964982 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563945571bd0 0x563945571ff0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x563945557db0 tx=0x7fd2340178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.223+0000 7fd11f7fe640 1 -- 172.21.15.146:0/233964982 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd234013440 con 0x563945571bd0 2024-09-18T01:47:11.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.223+0000 7fd11f7fe640 1 -- 172.21.15.146:0/233964982 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2340135e0 con 0x563945571bd0 2024-09-18T01:47:11.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.223+0000 7fd23c319800 1 -- 172.21.15.146:0/233964982 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5639455727c0 con 0x563945571bd0 2024-09-18T01:47:11.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.223+0000 7fd11f7fe640 1 -- 172.21.15.146:0/233964982 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2340138c0 con 0x563945571bd0 2024-09-18T01:47:11.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.223+0000 7fd23c319800 1 -- 172.21.15.146:0/233964982 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639455754a0 con 0x563945571bd0 2024-09-18T01:47:11.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.224+0000 7fd11f7fe640 1 -- 172.21.15.146:0/233964982 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd234011040 con 0x563945571bd0 2024-09-18T01:47:11.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.224+0000 7fd11f7fe640 1 --2- 172.21.15.146:0/233964982 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd114036b90 0x7fd114039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.224+0000 7fd11f7fe640 1 -- 172.21.15.146:0/233964982 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7fd23401d070 con 0x563945571bd0 2024-09-18T01:47:11.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.224+0000 7fd239e0d640 1 --2- 172.21.15.146:0/233964982 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd114036b90 0x7fd114039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.224+0000 7fd23c319800 1 Processor -- start 2024-09-18T01:47:11.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.224+0000 7fd23c319800 1 -- start start 2024-09-18T01:47:11.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.224+0000 7fd239e0d640 1 --2- 172.21.15.146:0/233964982 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd114036b90 0x7fd114039050 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x56394555f740 tx=0x7fd22c08f0e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.224+0000 7fd23c319800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56394557e820 0x56394557ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.224+0000 7fd23c319800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x56394554fe00 con 0x56394557e820 2024-09-18T01:47:11.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.225+0000 7fd23a60e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56394557e820 0x56394557ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.225+0000 7fd23a60e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56394557e820 0x56394557ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37788/0 (socket says 172.21.15.146:37788) 2024-09-18T01:47:11.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.225+0000 7fd23a60e640 1 -- 172.21.15.146:0/1827207579 learned_addr learned my addr 172.21.15.146:0/1827207579 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:11.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.225+0000 7fd23a60e640 1 -- 172.21.15.146:0/1827207579 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56394557f1f0 con 0x56394557e820 2024-09-18T01:47:11.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.225+0000 7fd23a60e640 1 --2- 172.21.15.146:0/1827207579 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56394557e820 0x56394557ec20 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fd23404c860 tx=0x7fd23404cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11aa935ce4b783a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.225+0000 7fd11d7fa640 1 -- 172.21.15.146:0/1827207579 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd234012c90 con 0x56394557e820 2024-09-18T01:47:11.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.225+0000 7fd11d7fa640 1 -- 172.21.15.146:0/1827207579 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd234012e30 con 0x56394557e820 2024-09-18T01:47:11.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.225+0000 7fd11d7fa640 1 -- 172.21.15.146:0/1827207579 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2340124d0 con 0x56394557e820 2024-09-18T01:47:11.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.225+0000 7fd23c319800 1 -- 172.21.15.146:0/1827207579 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56394557e820 msgr2=0x56394557ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.225+0000 7fd23c319800 1 --2- 172.21.15.146:0/1827207579 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56394557e820 0x56394557ec20 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fd23404c860 tx=0x7fd23404cb10 comp rx=0 tx=0).stop 2024-09-18T01:47:11.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.225+0000 7fd23c319800 1 -- 172.21.15.146:0/1827207579 shutdown_connections 2024-09-18T01:47:11.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.225+0000 7fd23c319800 1 --2- 172.21.15.146:0/1827207579 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56394557e820 0x56394557ec20 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.225+0000 7fd23c319800 1 -- 172.21.15.146:0/1827207579 >> 172.21.15.146:0/1827207579 conn(0x56394557abd0 msgr2=0x563945578cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:11.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.226+0000 7fd23c319800 1 -- 172.21.15.146:0/1827207579 shutdown_connections 2024-09-18T01:47:11.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.226+0000 7fd23c319800 1 -- 172.21.15.146:0/1827207579 wait complete. 2024-09-18T01:47:11.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.226+0000 7fd23c319800 1 Processor -- start 2024-09-18T01:47:11.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.226+0000 7fd23c319800 1 -- start start 2024-09-18T01:47:11.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.226+0000 7fd23c319800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56394557e820 0x563945585d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.226+0000 7fd23c319800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x56394557f7c0 con 0x56394557e820 2024-09-18T01:47:11.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.226+0000 7fd23a60e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56394557e820 0x563945585d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.226+0000 7fd23a60e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56394557e820 0x563945585d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37798/0 (socket says 172.21.15.146:37798) 2024-09-18T01:47:11.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.226+0000 7fd23a60e640 1 -- 172.21.15.146:0/4013705179 learned_addr learned my addr 172.21.15.146:0/4013705179 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:11.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.226+0000 7fd23a60e640 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563945586250 con 0x56394557e820 2024-09-18T01:47:11.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.227+0000 7fd23a60e640 1 --2- 172.21.15.146:0/4013705179 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56394557e820 0x563945585d10 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fd234015fd0 tx=0x7fd23404c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.227+0000 7fd10b7fe640 1 -- 172.21.15.146:0/4013705179 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd234012c90 con 0x56394557e820 2024-09-18T01:47:11.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.227+0000 7fd10b7fe640 1 -- 172.21.15.146:0/4013705179 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd234001520 con 0x56394557e820 2024-09-18T01:47:11.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.227+0000 7fd23c319800 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5639455864e0 con 0x56394557e820 2024-09-18T01:47:11.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.227+0000 7fd10b7fe640 1 -- 172.21.15.146:0/4013705179 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd23404b4d0 con 0x56394557e820 2024-09-18T01:47:11.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.227+0000 7fd23c319800 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563945589190 con 0x56394557e820 2024-09-18T01:47:11.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.228+0000 7fd10b7fe640 1 -- 172.21.15.146:0/4013705179 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd234013b90 con 0x56394557e820 2024-09-18T01:47:11.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.228+0000 7fd10b7fe640 1 --2- 172.21.15.146:0/4013705179 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd104036b40 0x7fd104039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.228+0000 7fd10b7fe640 1 -- 172.21.15.146:0/4013705179 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7fd23400e040 con 0x56394557e820 2024-09-18T01:47:11.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.228+0000 7fd239e0d640 1 --2- 172.21.15.146:0/4013705179 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd104036b40 0x7fd104039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.228+0000 7fd239e0d640 1 --2- 172.21.15.146:0/4013705179 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd104036b40 0x7fd104039000 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd22c000c00 tx=0x7fd22c089000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.229+0000 7fd23c319800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.229+0000 7fd23c319800 1 --2- 172.21.15.146:0/4013705179 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x563945591960 0x563945593e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.229+0000 7fd23c319800 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563945594570 con 0x563945591960 2024-09-18T01:47:11.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.229+0000 7fd23960c640 1 --2- 172.21.15.146:0/4013705179 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x563945591960 0x563945593e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.229+0000 7fd23960c640 1 --2- 172.21.15.146:0/4013705179 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x563945591960 0x563945593e20 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.229+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd23000f5f0 con 0x563945591960 2024-09-18T01:47:11.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.229+0000 7fd23c319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:11.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.229+0000 7fd23c319800 20 realm 2024-09-18T01:47:11.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.229+0000 7fd23c319800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.229+0000 7fd23c319800 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563945590db0 con 0x563945591960 2024-09-18T01:47:11.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.229+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd23000f5f0 con 0x563945591960 2024-09-18T01:47:11.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.229+0000 7fd23c319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:11.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.229+0000 7fd23c319800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:47:11.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.230+0000 7fd23c319800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.230+0000 7fd23c319800 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563945595060 con 0x563945591960 2024-09-18T01:47:11.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.230+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd23000f5f0 con 0x563945591960 2024-09-18T01:47:11.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.230+0000 7fd23c319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:11.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.230+0000 7fd23c319800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.230+0000 7fd23c319800 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563945595930 con 0x563945591960 2024-09-18T01:47:11.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.230+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd23000f5f0 con 0x563945591960 2024-09-18T01:47:11.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.230+0000 7fd23c319800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:47:11.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.230+0000 7fd23c319800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.230+0000 7fd23c319800 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563945595cd0 con 0x563945591960 2024-09-18T01:47:11.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.230+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd23000f5f0 con 0x563945591960 2024-09-18T01:47:11.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.230+0000 7fd23c319800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:47:11.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.230+0000 7fd23c319800 20 searching for the correct realm 2024-09-18T01:47:11.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.230+0000 7fd23c319800 1 --2- 172.21.15.146:0/4013705179 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x563945597c00 0x56394559a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.230+0000 7fd23c319800 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56394559a6e0 con 0x563945597c00 2024-09-18T01:47:11.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.231+0000 7fd23a60e640 1 --2- 172.21.15.146:0/4013705179 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x563945597c00 0x56394559a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.231+0000 7fd23a60e640 1 --2- 172.21.15.146:0/4013705179 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x563945597c00 0x56394559a010 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.231+0000 7fd23a60e640 1 -- 172.21.15.146:0/4013705179 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd234035070 con 0x563945597c00 2024-09-18T01:47:11.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.231+0000 7fd23a60e640 1 --2- 172.21.15.146:0/4013705179 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fd2340300d0 0x7fd234002ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.231+0000 7fd23a60e640 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56394559a6e0 con 0x7fd2340300d0 2024-09-18T01:47:11.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.231+0000 7fd239e0d640 1 --2- 172.21.15.146:0/4013705179 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fd2340300d0 0x7fd234002ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.231+0000 7fd239e0d640 1 --2- 172.21.15.146:0/4013705179 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fd2340300d0 0x7fd234002ad0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.232+0000 7fd239e0d640 1 -- 172.21.15.146:0/4013705179 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd22c08a040 con 0x7fd2340300d0 2024-09-18T01:47:11.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.232+0000 7fd239e0d640 1 --2- 172.21.15.146:0/4013705179 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fd22c090c20 0x7fd22c073750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.232+0000 7fd239e0d640 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56394559a6e0 con 0x7fd22c090c20 2024-09-18T01:47:11.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.232+0000 7fd23960c640 1 --2- 172.21.15.146:0/4013705179 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fd22c090c20 0x7fd22c073750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.232+0000 7fd23960c640 1 --2- 172.21.15.146:0/4013705179 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fd22c090c20 0x7fd22c073750 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.232+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23000f5f0 con 0x7fd22c090c20 2024-09-18T01:47:11.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.233+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56394559a6e0 con 0x563945591960 2024-09-18T01:47:11.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.233+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v33'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd23000f5f0 con 0x563945591960 2024-09-18T01:47:11.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.233+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56394559a6e0 con 0x563945591960 2024-09-18T01:47:11.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.233+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23000f5f0 con 0x563945591960 2024-09-18T01:47:11.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.233+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56394559a6e0 con 0x7fd22c090c20 2024-09-18T01:47:11.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.233+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23000f5f0 con 0x7fd22c090c20 2024-09-18T01:47:11.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.233+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56394559a6e0 con 0x7fd22c090c20 2024-09-18T01:47:11.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.233+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23000f5f0 con 0x7fd22c090c20 2024-09-18T01:47:11.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.233+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56394559a6e0 con 0x7fd2340300d0 2024-09-18T01:47:11.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.234+0000 7fd239e0d640 1 -- 172.21.15.146:0/4013705179 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd22c08a040 con 0x7fd2340300d0 2024-09-18T01:47:11.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.234+0000 7fd239e0d640 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56394559a6e0 con 0x563945597c00 2024-09-18T01:47:11.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.234+0000 7fd23a60e640 1 -- 172.21.15.146:0/4013705179 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23405e040 con 0x563945597c00 2024-09-18T01:47:11.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.234+0000 7fd23a60e640 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56394559a6e0 con 0x563945591960 2024-09-18T01:47:11.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.234+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23000f5f0 con 0x563945591960 2024-09-18T01:47:11.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.234+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56394559a6e0 con 0x7fd22c090c20 2024-09-18T01:47:11.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.234+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23000f5f0 con 0x7fd22c090c20 2024-09-18T01:47:11.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.235+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56394559a6e0 con 0x563945591960 2024-09-18T01:47:11.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.235+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23000f5f0 con 0x563945591960 2024-09-18T01:47:11.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.235+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56394559a6e0 con 0x7fd2340300d0 2024-09-18T01:47:11.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.235+0000 7fd239e0d640 1 -- 172.21.15.146:0/4013705179 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fd22c08a040 con 0x7fd2340300d0 2024-09-18T01:47:11.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.235+0000 7fd239e0d640 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56394559a6e0 con 0x563945597c00 2024-09-18T01:47:11.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.235+0000 7fd23a60e640 1 -- 172.21.15.146:0/4013705179 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23405e040 con 0x563945597c00 2024-09-18T01:47:11.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.235+0000 7fd23a60e640 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56394559a6e0 con 0x563945597c00 2024-09-18T01:47:11.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.235+0000 7fd23a60e640 1 -- 172.21.15.146:0/4013705179 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23405e040 con 0x563945597c00 2024-09-18T01:47:11.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.235+0000 7fd23a60e640 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56394559a6e0 con 0x7fd22c090c20 2024-09-18T01:47:11.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.236+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23000f5f0 con 0x7fd22c090c20 2024-09-18T01:47:11.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.236+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56394559a6e0 con 0x563945597c00 2024-09-18T01:47:11.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.236+0000 7fd23a60e640 1 -- 172.21.15.146:0/4013705179 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23405e040 con 0x563945597c00 2024-09-18T01:47:11.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.236+0000 7fd23a60e640 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56394559a6e0 con 0x563945597c00 2024-09-18T01:47:11.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.236+0000 7fd23a60e640 1 -- 172.21.15.146:0/4013705179 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23405e040 con 0x563945597c00 2024-09-18T01:47:11.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.236+0000 7fd23a60e640 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56394559a6e0 con 0x563945591960 2024-09-18T01:47:11.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.236+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23000f5f0 con 0x563945591960 2024-09-18T01:47:11.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.236+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56394559a6e0 con 0x563945591960 2024-09-18T01:47:11.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.237+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v33'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd23000f5f0 con 0x563945591960 2024-09-18T01:47:11.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.237+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56394559a6e0 con 0x7fd22c090c20 2024-09-18T01:47:11.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.237+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23000f5f0 con 0x7fd22c090c20 2024-09-18T01:47:11.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.237+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56394559a6e0 con 0x563945597c00 2024-09-18T01:47:11.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.237+0000 7fd23a60e640 1 -- 172.21.15.146:0/4013705179 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23405e040 con 0x563945597c00 2024-09-18T01:47:11.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.237+0000 7fd23a60e640 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56394559a6e0 con 0x7fd2340300d0 2024-09-18T01:47:11.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.237+0000 7fd239e0d640 1 -- 172.21.15.146:0/4013705179 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd22c08a040 con 0x7fd2340300d0 2024-09-18T01:47:11.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.237+0000 7fd239e0d640 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56394559a6e0 con 0x563945591960 2024-09-18T01:47:11.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.238+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23000f5f0 con 0x563945591960 2024-09-18T01:47:11.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.238+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56394559a6e0 con 0x7fd22c090c20 2024-09-18T01:47:11.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.238+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23003b040 con 0x7fd22c090c20 2024-09-18T01:47:11.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.238+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56394559a6e0 con 0x563945597c00 2024-09-18T01:47:11.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.238+0000 7fd23a60e640 1 -- 172.21.15.146:0/4013705179 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23405e040 con 0x563945597c00 2024-09-18T01:47:11.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.238+0000 7fd23a60e640 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56394559a6e0 con 0x7fd22c090c20 2024-09-18T01:47:11.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.238+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23003b040 con 0x7fd22c090c20 2024-09-18T01:47:11.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.238+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56394559a6e0 con 0x7fd2340300d0 2024-09-18T01:47:11.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.239+0000 7fd239e0d640 1 -- 172.21.15.146:0/4013705179 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd22c08a040 con 0x7fd2340300d0 2024-09-18T01:47:11.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.239+0000 7fd239e0d640 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56394559a6e0 con 0x563945597c00 2024-09-18T01:47:11.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.239+0000 7fd23a60e640 1 -- 172.21.15.146:0/4013705179 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23405e040 con 0x563945597c00 2024-09-18T01:47:11.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.239+0000 7fd23a60e640 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56394559a6e0 con 0x7fd22c090c20 2024-09-18T01:47:11.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.239+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd23003b040 con 0x7fd22c090c20 2024-09-18T01:47:11.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.239+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56394559a6e0 con 0x563945591960 2024-09-18T01:47:11.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.239+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v33'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd23003b040 con 0x563945591960 2024-09-18T01:47:11.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.239+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56394559a6e0 con 0x7fd2340300d0 2024-09-18T01:47:11.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.240+0000 7fd239e0d640 1 -- 172.21.15.146:0/4013705179 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd22c08a040 con 0x7fd2340300d0 2024-09-18T01:47:11.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.240+0000 7fd23c319800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:47:11.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.240+0000 7fd23c319800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:47:11.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.240+0000 7fd23c319800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:47:11.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.240+0000 7fd23c319800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:47:11.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.240+0000 7fd23c319800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:47:11.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.240+0000 7fd23c319800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:47:11.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.240+0000 7fd23c319800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.240+0000 7fd23c319800 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5639455966a0 con 0x563945591960 2024-09-18T01:47:11.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.240+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd23003b040 con 0x563945591960 2024-09-18T01:47:11.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.240+0000 7fd23c319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:11.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.240+0000 7fd23c319800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.240+0000 7fd23c319800 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563945596f40 con 0x563945591960 2024-09-18T01:47:11.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.240+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd23003b040 con 0x563945591960 2024-09-18T01:47:11.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.240+0000 7fd23c319800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:47:11.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.240+0000 7fd23c319800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.240+0000 7fd23c319800 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563945596f40 con 0x7fd2340300d0 2024-09-18T01:47:11.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.241+0000 7fd239e0d640 1 -- 172.21.15.146:0/4013705179 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd22c08a040 con 0x7fd2340300d0 2024-09-18T01:47:11.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.241+0000 7fd23c319800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:47:11.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.241+0000 7fd23c319800 20 zone default found 2024-09-18T01:47:11.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.241+0000 7fd23c319800 4 Realm: () 2024-09-18T01:47:11.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.241+0000 7fd23c319800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:47:11.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.241+0000 7fd23c319800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:47:11.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.241+0000 7fd23c319800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:47:11.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.241+0000 7fd23c319800 20 zonegroup default 2024-09-18T01:47:11.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.241+0000 7fd23c319800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.241+0000 7fd23c319800 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56394559b010 con 0x7fd22c090c20 2024-09-18T01:47:11.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.241+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd23003b040 con 0x7fd22c090c20 2024-09-18T01:47:11.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.241+0000 7fd23c319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:11.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.241+0000 7fd23c319800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.241+0000 7fd23c319800 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56394559c9f0 con 0x563945597c00 2024-09-18T01:47:11.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.241+0000 7fd23a60e640 1 -- 172.21.15.146:0/4013705179 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd23405e040 con 0x563945597c00 2024-09-18T01:47:11.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.241+0000 7fd23c319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:11.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.241+0000 7fd23c319800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.241+0000 7fd23c319800 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56394559cea0 con 0x563945597c00 2024-09-18T01:47:11.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.241+0000 7fd23a60e640 1 -- 172.21.15.146:0/4013705179 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd23405e040 con 0x563945597c00 2024-09-18T01:47:11.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.241+0000 7fd23c319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:11.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.241+0000 7fd23c319800 20 started sync module instance, tier type = 2024-09-18T01:47:11.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.241+0000 7fd23c319800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:47:11.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.241+0000 7fd23c319800 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56394559be80 con 0x7fd2340300d0 2024-09-18T01:47:11.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.243+0000 7fd239e0d640 1 -- 172.21.15.146:0/4013705179 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v33'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd22c08a040 con 0x7fd2340300d0 2024-09-18T01:47:11.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.243+0000 7fd23c319800 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94803976634992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56394559bae0 con 0x7fd2340300d0 2024-09-18T01:47:11.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.243+0000 7fd23c319800 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56394559ddd0 con 0x563945591960 2024-09-18T01:47:11.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.244+0000 7fd239e0d640 1 -- 172.21.15.146:0/4013705179 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94803976634992] v33'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd22c08a040 con 0x7fd2340300d0 2024-09-18T01:47:11.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.244+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v33'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd23003b040 con 0x563945591960 2024-09-18T01:47:11.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.244+0000 7fd23c319800 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94803976639232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56394559ddd0 con 0x563945591960 2024-09-18T01:47:11.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.244+0000 7fd23c319800 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56394559e7d0 con 0x563945597c00 2024-09-18T01:47:11.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.245+0000 7fd23a60e640 1 -- 172.21.15.146:0/4013705179 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v33'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd23405e040 con 0x563945597c00 2024-09-18T01:47:11.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.245+0000 7fd23c319800 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94803976643296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56394559f070 con 0x563945597c00 2024-09-18T01:47:11.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.245+0000 7fd23c319800 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56394559fb50 con 0x7fd2340300d0 2024-09-18T01:47:11.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.245+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94803976639232] v33'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd23003b040 con 0x563945591960 2024-09-18T01:47:11.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.246+0000 7fd23a60e640 1 -- 172.21.15.146:0/4013705179 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94803976643296] v33'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd23405e040 con 0x563945597c00 2024-09-18T01:47:11.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.246+0000 7fd239e0d640 1 -- 172.21.15.146:0/4013705179 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v33'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd22c08a040 con 0x7fd2340300d0 2024-09-18T01:47:11.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.246+0000 7fd23c319800 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94803976648288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56394559ebc0 con 0x7fd2340300d0 2024-09-18T01:47:11.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.246+0000 7fd23c319800 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5639455a03f0 con 0x563945591960 2024-09-18T01:47:11.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.247+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v33'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd23003b040 con 0x563945591960 2024-09-18T01:47:11.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.247+0000 7fd23c319800 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94803976650560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5639455a0810 con 0x563945591960 2024-09-18T01:47:11.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.247+0000 7fd23c319800 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5639455a1060 con 0x7fd22c090c20 2024-09-18T01:47:11.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.247+0000 7fd239e0d640 1 -- 172.21.15.146:0/4013705179 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94803976648288] v33'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd22c08a040 con 0x7fd2340300d0 2024-09-18T01:47:11.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.248+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94803976650560] v33'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd23003b040 con 0x563945591960 2024-09-18T01:47:11.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.248+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v33'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd23003b040 con 0x7fd22c090c20 2024-09-18T01:47:11.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.248+0000 7fd23c319800 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94803976651616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5639455a0c30 con 0x7fd22c090c20 2024-09-18T01:47:11.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.248+0000 7fd23c319800 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5639455a14c0 con 0x7fd22c090c20 2024-09-18T01:47:11.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.249+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94803976651616] v33'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd23003b040 con 0x7fd22c090c20 2024-09-18T01:47:11.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.249+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v33'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd23003b040 con 0x7fd22c090c20 2024-09-18T01:47:11.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.249+0000 7fd23c319800 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94803976652672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5639455a1050 con 0x7fd22c090c20 2024-09-18T01:47:11.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.249+0000 7fd23c319800 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5639455a1ed0 con 0x7fd22c090c20 2024-09-18T01:47:11.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.250+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94803976652672] v33'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd23003b040 con 0x7fd22c090c20 2024-09-18T01:47:11.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.250+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v33'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd23003b040 con 0x7fd22c090c20 2024-09-18T01:47:11.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.251+0000 7fd23c319800 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94803976654000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5639455a1ed0 con 0x7fd22c090c20 2024-09-18T01:47:11.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.251+0000 7fd23c319800 20 add_watcher() i=0 2024-09-18T01:47:11.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.251+0000 7fd23c319800 20 add_watcher() i=1 2024-09-18T01:47:11.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.251+0000 7fd23c319800 20 add_watcher() i=2 2024-09-18T01:47:11.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.251+0000 7fd23c319800 20 add_watcher() i=3 2024-09-18T01:47:11.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.251+0000 7fd23c319800 20 add_watcher() i=4 2024-09-18T01:47:11.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.251+0000 7fd23c319800 20 add_watcher() i=5 2024-09-18T01:47:11.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.251+0000 7fd23c319800 20 add_watcher() i=6 2024-09-18T01:47:11.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.251+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94803976654000] v33'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd23003b040 con 0x7fd22c090c20 2024-09-18T01:47:11.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.251+0000 7fd23c319800 20 add_watcher() i=7 2024-09-18T01:47:11.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.251+0000 7fd23c319800 2 all 8 watchers are set, enabling cache 2024-09-18T01:47:11.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.251+0000 7fd23c319800 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5639455a5200 con 0x563945591960 2024-09-18T01:47:11.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.252+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd23003b040 con 0x563945591960 2024-09-18T01:47:11.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.252+0000 7fd23c319800 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94803976670256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5639455a2040 con 0x563945591960 2024-09-18T01:47:11.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.253+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94803976670256] v33'269 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd23003b040 con 0x563945591960 2024-09-18T01:47:11.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.253+0000 7fd0eb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:47:11.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.253+0000 7fd23c319800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:47:11.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.253+0000 7fd23c319800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:47:11.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.253+0000 7fd23c319800 5 note: GC not initialized 2024-09-18T01:47:11.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.253+0000 7fd0ea7fc640 20 reqs_thread_entry: start 2024-09-18T01:47:11.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.253+0000 7fd23c319800 20 init_complete bucket index max shards: 11 2024-09-18T01:47:11.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.253+0000 7fd23c319800 20 Filter name: none 2024-09-18T01:47:11.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.254+0000 7fd05bfff640 20 reqs_thread_entry: start 2024-09-18T01:47:11.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.254+0000 7fd23c319800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-18T01:47:11.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.254+0000 7fd23c319800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.254+0000 7fd23c319800 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5639455d8790 con 0x7fd22c090c20 2024-09-18T01:47:11.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.254+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(62 ada [call out=48b,read 0~503 out=503b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+626 (crc 0 0 0) 0x7fd23003b040 con 0x7fd22c090c20 2024-09-18T01:47:11.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.254+0000 7fd23c319800 20 rados_obj.operate() r=0 bl.length=503 2024-09-18T01:47:11.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.254+0000 7fd23c319800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-18T01:47:11.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.254+0000 7fd23c319800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:47:11.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.254+0000 7fd23c319800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:47:11.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.254+0000 7fd23c319800 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5639455df230 con 0x7fd22c090c20 2024-09-18T01:47:11.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.255+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v33'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fd23003b040 con 0x7fd22c090c20 2024-09-18T01:47:11.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.255+0000 7fd23c319800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T01:47:11.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.255+0000 7fd23c319800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:47:11.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.255+0000 7fd23c319800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-18T01:47:11.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.255+0000 7fd23c319800 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94803976907760 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5639455da870 con 0x563945591960 2024-09-18T01:47:11.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.256+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== watch-notify(notify (1) cookie 94803976650560 notify 141733920799 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7fd230018040 con 0x563945591960 2024-09-18T01:47:11.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.256+0000 7fd11d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920799 cookie 94803976650560 notifier 4901 bl.length()=636 2024-09-18T01:47:11.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.256+0000 7fd11d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T01:47:11.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.256+0000 7fd11d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:47:11.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.256+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(64 notify.4 [notify cookie 94803976907760 out=8b] v0'0 uv267 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd23003b040 con 0x563945591960 2024-09-18T01:47:11.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.256+0000 7fd11d7fa640 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fd0fc003ea0 con 0x563945591960 2024-09-18T01:47:11.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.256+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== watch-notify(notify_complete (2) cookie 94803976907760 notify 141733920799 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fd230004a80 con 0x563945591960 2024-09-18T01:47:11.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.256+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd23003b040 con 0x563945591960 2024-09-18T01:47:11.273 INFO:teuthology.orchestra.run.smithi146.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-18T01:47:09.882428Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:47:09.882414Z","tags":[],"group_ids":[]} 2024-09-18T01:47:11.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.257+0000 7fd0eb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:47:11.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.257+0000 7fd23c319800 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94803976670256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5639455d64a0 con 0x563945591960 2024-09-18T01:47:11.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.258+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94803976670256] v33'270 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd23003b040 con 0x563945591960 2024-09-18T01:47:11.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.258+0000 7fd23c319800 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94803976634992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5639455d64a0 con 0x7fd2340300d0 2024-09-18T01:47:11.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.259+0000 7fd239e0d640 1 -- 172.21.15.146:0/4013705179 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94803976634992] v33'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd22c08a040 con 0x7fd2340300d0 2024-09-18T01:47:11.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.259+0000 7fd23c319800 20 remove_watcher() i=0 2024-09-18T01:47:11.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.259+0000 7fd23c319800 2 removed watcher, disabling cache 2024-09-18T01:47:11.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.259+0000 7fd23c319800 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94803976639232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5639455d64a0 con 0x563945591960 2024-09-18T01:47:11.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.260+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94803976639232] v33'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd23003b040 con 0x563945591960 2024-09-18T01:47:11.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.260+0000 7fd23c319800 20 remove_watcher() i=1 2024-09-18T01:47:11.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.260+0000 7fd23c319800 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94803976643296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5639455d64a0 con 0x563945597c00 2024-09-18T01:47:11.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.262+0000 7fd23a60e640 1 -- 172.21.15.146:0/4013705179 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94803976643296] v33'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd23405e040 con 0x563945597c00 2024-09-18T01:47:11.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.262+0000 7fd23c319800 20 remove_watcher() i=2 2024-09-18T01:47:11.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.262+0000 7fd23c319800 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94803976648288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5639455d64a0 con 0x7fd2340300d0 2024-09-18T01:47:11.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.263+0000 7fd239e0d640 1 -- 172.21.15.146:0/4013705179 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94803976648288] v33'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd22c08a040 con 0x7fd2340300d0 2024-09-18T01:47:11.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.263+0000 7fd23c319800 20 remove_watcher() i=3 2024-09-18T01:47:11.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.263+0000 7fd23c319800 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94803976650560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5639455d64a0 con 0x563945591960 2024-09-18T01:47:11.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.264+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 <== osd.1 v2:172.21.15.146:6808/3930274777 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94803976650560] v33'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd23003b040 con 0x563945591960 2024-09-18T01:47:11.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.264+0000 7fd23c319800 20 remove_watcher() i=4 2024-09-18T01:47:11.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.264+0000 7fd23c319800 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94803976651616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5639455d64a0 con 0x7fd22c090c20 2024-09-18T01:47:11.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.265+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94803976651616] v33'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd23003b040 con 0x7fd22c090c20 2024-09-18T01:47:11.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.265+0000 7fd23c319800 20 remove_watcher() i=5 2024-09-18T01:47:11.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.265+0000 7fd23c319800 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94803976652672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5639455d64a0 con 0x7fd22c090c20 2024-09-18T01:47:11.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.266+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94803976652672] v33'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd23003b040 con 0x7fd22c090c20 2024-09-18T01:47:11.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.266+0000 7fd23c319800 20 remove_watcher() i=6 2024-09-18T01:47:11.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.266+0000 7fd23c319800 1 -- 172.21.15.146:0/4013705179 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94803976654000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5639455d64a0 con 0x7fd22c090c20 2024-09-18T01:47:11.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.267+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94803976654000] v33'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd23003b040 con 0x7fd22c090c20 2024-09-18T01:47:11.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.267+0000 7fd23c319800 20 remove_watcher() i=7 2024-09-18T01:47:11.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.267+0000 7fd23c319800 1 -- 172.21.15.146:0/4013705179 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fd22c090c20 msgr2=0x7fd22c073750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.267+0000 7fd23c319800 1 --2- 172.21.15.146:0/4013705179 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fd22c090c20 0x7fd22c073750 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.267+0000 7fd23c319800 1 -- 172.21.15.146:0/4013705179 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x563945591960 msgr2=0x563945593e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.267+0000 7fd23c319800 1 --2- 172.21.15.146:0/4013705179 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x563945591960 0x563945593e20 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.267+0000 7fd23c319800 1 -- 172.21.15.146:0/4013705179 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fd2340300d0 msgr2=0x7fd234002ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.267+0000 7fd23c319800 1 --2- 172.21.15.146:0/4013705179 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fd2340300d0 0x7fd234002ad0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.267+0000 7fd23c319800 1 -- 172.21.15.146:0/4013705179 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x563945597c00 msgr2=0x56394559a010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.267+0000 7fd23c319800 1 --2- 172.21.15.146:0/4013705179 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x563945597c00 0x56394559a010 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.267+0000 7fd23c319800 1 -- 172.21.15.146:0/4013705179 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd104036b40 msgr2=0x7fd104039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.267+0000 7fd23c319800 1 --2- 172.21.15.146:0/4013705179 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd104036b40 0x7fd104039000 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd22c000c00 tx=0x7fd22c089000 comp rx=0 tx=0).stop 2024-09-18T01:47:11.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.267+0000 7fd23c319800 1 -- 172.21.15.146:0/4013705179 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56394557e820 msgr2=0x563945585d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.267+0000 7fd23c319800 1 --2- 172.21.15.146:0/4013705179 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56394557e820 0x563945585d10 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fd234015fd0 tx=0x7fd23404c7f0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.267+0000 7fd23960c640 1 -- 172.21.15.146:0/4013705179 reap_dead start 2024-09-18T01:47:11.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.267+0000 7fd23c319800 1 -- 172.21.15.146:0/4013705179 shutdown_connections 2024-09-18T01:47:11.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.267+0000 7fd23c319800 1 --2- 172.21.15.146:0/4013705179 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56394557e820 0x563945585d10 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.267+0000 7fd23c319800 1 -- 172.21.15.146:0/4013705179 >> 172.21.15.146:0/4013705179 conn(0x56394557abd0 msgr2=0x56394557ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:11.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.267+0000 7fd23c319800 1 -- 172.21.15.146:0/4013705179 shutdown_connections 2024-09-18T01:47:11.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.267+0000 7fd23c319800 1 -- 172.21.15.146:0/4013705179 wait complete. 2024-09-18T01:47:11.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.267+0000 7fd23c319800 1 -- 172.21.15.146:0/233964982 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd114036b90 msgr2=0x7fd114039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.267+0000 7fd23c319800 1 --2- 172.21.15.146:0/233964982 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd114036b90 0x7fd114039050 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x56394555f740 tx=0x7fd22c08f0e0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.267+0000 7fd23c319800 1 -- 172.21.15.146:0/233964982 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563945571bd0 msgr2=0x563945571ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.267+0000 7fd23c319800 1 --2- 172.21.15.146:0/233964982 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563945571bd0 0x563945571ff0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x563945557db0 tx=0x7fd2340178e0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.268+0000 7fd23c319800 1 -- 172.21.15.146:0/233964982 shutdown_connections 2024-09-18T01:47:11.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.268+0000 7fd23c319800 1 --2- 172.21.15.146:0/233964982 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd114036b90 0x7fd114039050 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.268+0000 7fd23c319800 1 --2- 172.21.15.146:0/233964982 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563945571bd0 0x563945571ff0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.268+0000 7fd23c319800 1 -- 172.21.15.146:0/233964982 >> 172.21.15.146:0/233964982 conn(0x563945566b60 msgr2=0x5639455696e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:11.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.268+0000 7fd23c319800 1 -- 172.21.15.146:0/233964982 shutdown_connections 2024-09-18T01:47:11.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.268+0000 7fd23c319800 1 -- 172.21.15.146:0/233964982 wait complete. 2024-09-18T01:47:11.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.268+0000 7fd23c319800 1 -- 172.21.15.146:0/360419892 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x563945463720 msgr2=0x56394555e080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.268+0000 7fd23c319800 1 --2- 172.21.15.146:0/360419892 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x563945463720 0x56394555e080 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.268+0000 7fd23c319800 1 -- 172.21.15.146:0/360419892 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x56394555fe40 msgr2=0x5639455636e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.268+0000 7fd23c319800 1 --2- 172.21.15.146:0/360419892 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x56394555fe40 0x5639455636e0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.268+0000 7fd23c319800 1 -- 172.21.15.146:0/360419892 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd120036b40 msgr2=0x7fd120039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.268+0000 7fd23c319800 1 --2- 172.21.15.146:0/360419892 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd120036b40 0x7fd120039000 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fd230000c00 tx=0x7fd2300013b0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.268+0000 7fd23c319800 1 -- 172.21.15.146:0/360419892 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5639453d4650 msgr2=0x563945557010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.268+0000 7fd23c319800 1 --2- 172.21.15.146:0/360419892 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5639453d4650 0x563945557010 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fd22c045f20 tx=0x7fd22c002fb0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.268+0000 7fd23c319800 1 -- 172.21.15.146:0/360419892 shutdown_connections 2024-09-18T01:47:11.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.268+0000 7fd23c319800 1 --2- 172.21.15.146:0/360419892 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x56394555fe40 0x5639455636e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.268+0000 7fd23c319800 1 --2- 172.21.15.146:0/360419892 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x563945463720 0x56394555e080 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.268+0000 7fd23c319800 1 --2- 172.21.15.146:0/360419892 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd120036b40 0x7fd120039000 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.268+0000 7fd23c319800 1 --2- 172.21.15.146:0/360419892 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5639453d4650 0x563945557010 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.268+0000 7fd23c319800 1 -- 172.21.15.146:0/360419892 >> 172.21.15.146:0/360419892 conn(0x56394545adb0 msgr2=0x563945549920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:11.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.268+0000 7fd23c319800 1 -- 172.21.15.146:0/360419892 shutdown_connections 2024-09-18T01:47:11.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.268+0000 7fd23c319800 1 -- 172.21.15.146:0/360419892 wait complete. 2024-09-18T01:47:11.284 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T01:47:09.882428Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:47:09.882414Z', 'tags': [], 'group_ids': []} 2024-09-18T01:47:11.284 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T01:47:09.882428Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:47:09.882414Z', 'tags': [], 'group_ids': []} 2024-09-18T01:47:11.285 ERROR:root:0 2024-09-18T01:47:11.285 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-18T01:47:11.285 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-18T01:47:11.285 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=write 2024-09-18T01:47:11.330 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:47:11.331 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:47:11.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.331+0000 7f6115d3a800 1 Processor -- start 2024-09-18T01:47:11.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.331+0000 7f6115d3a800 1 -- start start 2024-09-18T01:47:11.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.331+0000 7f6115d3a800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55f20aba3960 0x55f20aba3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.331+0000 7f6115d3a800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f20aa64b30 con 0x55f20aba42a0 2024-09-18T01:47:11.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.331+0000 7f6115d3a800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x55f20aa46360 con 0x55f20aba3960 2024-09-18T01:47:11.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.331+0000 7f6111a8b640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55f20aba3960 0x55f20aba3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.331+0000 7f610bfff640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x55f20aba42a0 0x55f20abaaaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:53130/0 (socket says 172.21.15.146:53130) 2024-09-18T01:47:11.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.331+0000 7f610bfff640 1 -- 172.21.15.146:0/1396530219 learned_addr learned my addr 172.21.15.146:0/1396530219 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:47:11.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.331+0000 7f6111a8b640 1 -- 172.21.15.146:0/1396530219 >> v1:172.21.15.129:6789/0 conn(0x55f20aba42a0 legacy=0x55f20abaaaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.332+0000 7f611128a640 1 -- 172.21.15.146:0/1396530219 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1643721071 0 0) 0x55f20aa64b30 con 0x55f20aba42a0 2024-09-18T01:47:11.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.332+0000 7f6111a8b640 1 -- 172.21.15.146:0/1396530219 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f20aa6ce00 con 0x55f20aba3960 2024-09-18T01:47:11.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.333+0000 7f6111a8b640 1 --2- 172.21.15.146:0/1396530219 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f20aba3960 0x55f20aba3d60 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f610400a470 tx=0x7f6104045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7adac5717647ed92 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.333+0000 7f611128a640 1 -- 172.21.15.146:0/1396530219 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6104053570 con 0x55f20aba3960 2024-09-18T01:47:11.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.333+0000 7f611128a640 1 -- 172.21.15.146:0/1396530219 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6104058070 con 0x55f20aba3960 2024-09-18T01:47:11.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.333+0000 7f611128a640 1 -- 172.21.15.146:0/1396530219 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6104053880 con 0x55f20aba3960 2024-09-18T01:47:11.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.334+0000 7f6115d3a800 1 -- 172.21.15.146:0/1396530219 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f20aba3960 msgr2=0x55f20aba3d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.334+0000 7f6115d3a800 1 --2- 172.21.15.146:0/1396530219 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f20aba3960 0x55f20aba3d60 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f610400a470 tx=0x7f6104045a20 comp rx=0 tx=0).stop 2024-09-18T01:47:11.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.334+0000 7f6115d3a800 1 -- 172.21.15.146:0/1396530219 shutdown_connections 2024-09-18T01:47:11.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.334+0000 7f6115d3a800 1 --2- 172.21.15.146:0/1396530219 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f20aba3960 0x55f20aba3d60 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.334+0000 7f6115d3a800 1 -- 172.21.15.146:0/1396530219 >> 172.21.15.146:0/1396530219 conn(0x55f20ab9f550 msgr2=0x55f20aba1970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:11.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.334+0000 7f6115d3a800 1 -- 172.21.15.146:0/1396530219 shutdown_connections 2024-09-18T01:47:11.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.334+0000 7f6115d3a800 1 -- 172.21.15.146:0/1396530219 wait complete. 2024-09-18T01:47:11.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.348+0000 7f6115d3a800 1 Processor -- start 2024-09-18T01:47:11.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.348+0000 7f6115d3a800 1 -- start start 2024-09-18T01:47:11.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.348+0000 7f6115d3a800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f20aba3960 0x55f20ac94720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.348+0000 7f6115d3a800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55f20aaf1360 con 0x55f20aba3960 2024-09-18T01:47:11.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.348+0000 7f6111a8b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f20aba3960 0x55f20ac94720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.348+0000 7f6111a8b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f20aba3960 0x55f20ac94720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37804/0 (socket says 172.21.15.146:37804) 2024-09-18T01:47:11.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.348+0000 7f6111a8b640 1 -- 172.21.15.146:0/3753228289 learned_addr learned my addr 172.21.15.146:0/3753228289 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:11.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.348+0000 7f6111a8b640 1 -- 172.21.15.146:0/3753228289 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f20aa3ebc0 con 0x55f20aba3960 2024-09-18T01:47:11.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.349+0000 7f6111a8b640 1 --2- 172.21.15.146:0/3753228289 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f20aba3960 0x55f20ac94720 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f6104005870 tx=0x7f6104051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2ad7a09eb9b295c server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.349+0000 7f5fffe07640 1 -- 172.21.15.146:0/3753228289 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f610405c580 con 0x55f20aba3960 2024-09-18T01:47:11.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.349+0000 7f5fffe07640 1 -- 172.21.15.146:0/3753228289 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6104063030 con 0x55f20aba3960 2024-09-18T01:47:11.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.349+0000 7f5fffe07640 1 -- 172.21.15.146:0/3753228289 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f610405c850 con 0x55f20aba3960 2024-09-18T01:47:11.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.349+0000 7f6115d3a800 1 -- 172.21.15.146:0/3753228289 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f20aba3960 msgr2=0x55f20ac94720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.349+0000 7f6115d3a800 1 --2- 172.21.15.146:0/3753228289 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f20aba3960 0x55f20ac94720 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f6104005870 tx=0x7f6104051000 comp rx=0 tx=0).stop 2024-09-18T01:47:11.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.349+0000 7f6115d3a800 1 -- 172.21.15.146:0/3753228289 shutdown_connections 2024-09-18T01:47:11.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.349+0000 7f6115d3a800 1 --2- 172.21.15.146:0/3753228289 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f20aba3960 0x55f20ac94720 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.350+0000 7f6115d3a800 1 -- 172.21.15.146:0/3753228289 >> 172.21.15.146:0/3753228289 conn(0x55f20ab9f550 msgr2=0x55f20ac900e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:11.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.350+0000 7f6115d3a800 1 -- 172.21.15.146:0/3753228289 shutdown_connections 2024-09-18T01:47:11.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.350+0000 7f6115d3a800 1 -- 172.21.15.146:0/3753228289 wait complete. 2024-09-18T01:47:11.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.350+0000 7f6115d3a800 1 Processor -- start 2024-09-18T01:47:11.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.350+0000 7f6115d3a800 1 -- start start 2024-09-18T01:47:11.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.350+0000 7f6115d3a800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f20aba3960 0x55f20ac9c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.350+0000 7f6115d3a800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55f20abac600 con 0x55f20aba3960 2024-09-18T01:47:11.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.350+0000 7f6111a8b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f20aba3960 0x55f20ac9c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.350+0000 7f6111a8b640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f20aba3960 0x55f20ac9c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37820/0 (socket says 172.21.15.146:37820) 2024-09-18T01:47:11.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.350+0000 7f6111a8b640 1 -- 172.21.15.146:0/1152158715 learned_addr learned my addr 172.21.15.146:0/1152158715 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:11.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.351+0000 7f6111a8b640 1 -- 172.21.15.146:0/1152158715 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f20aa52fe0 con 0x55f20aba3960 2024-09-18T01:47:11.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.351+0000 7f6111a8b640 1 --2- 172.21.15.146:0/1152158715 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f20aba3960 0x55f20ac9c010 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f6104045f50 tx=0x7f6104002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.351+0000 7f5ffe604640 1 -- 172.21.15.146:0/1152158715 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6104078070 con 0x55f20aba3960 2024-09-18T01:47:11.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.351+0000 7f5ffe604640 1 -- 172.21.15.146:0/1152158715 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6104054a70 con 0x55f20aba3960 2024-09-18T01:47:11.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.351+0000 7f6115d3a800 1 -- 172.21.15.146:0/1152158715 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f20ac9c550 con 0x55f20aba3960 2024-09-18T01:47:11.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.351+0000 7f5ffe604640 1 -- 172.21.15.146:0/1152158715 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6104054d50 con 0x55f20aba3960 2024-09-18T01:47:11.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.351+0000 7f6115d3a800 1 -- 172.21.15.146:0/1152158715 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f20ac9cad0 con 0x55f20aba3960 2024-09-18T01:47:11.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.352+0000 7f5ffe604640 1 -- 172.21.15.146:0/1152158715 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f610407b070 con 0x55f20aba3960 2024-09-18T01:47:11.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.352+0000 7f5ffe604640 1 --2- 172.21.15.146:0/1152158715 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f5ff8036b90 0x7f5ff8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.352+0000 7f5ffe604640 1 -- 172.21.15.146:0/1152158715 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f6104070070 con 0x55f20aba3960 2024-09-18T01:47:11.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.352+0000 7f610bfff640 1 --2- 172.21.15.146:0/1152158715 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f5ff8036b90 0x7f5ff8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.352+0000 7f6115d3a800 1 --2- 172.21.15.146:0/1152158715 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55f20aba42a0 0x55f20aca3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.352+0000 7f6115d3a800 1 -- 172.21.15.146:0/1152158715 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f20aca3610 con 0x55f20aba42a0 2024-09-18T01:47:11.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.352+0000 7f611228c640 1 --2- 172.21.15.146:0/1152158715 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55f20aba42a0 0x55f20aca3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.352+0000 7f610bfff640 1 --2- 172.21.15.146:0/1152158715 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f5ff8036b90 0x7f5ff8039050 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f60fc000c00 tx=0x7f60fc0013b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.352+0000 7f611228c640 1 --2- 172.21.15.146:0/1152158715 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55f20aba42a0 0x55f20aca3080 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.353+0000 7f611228c640 1 -- 172.21.15.146:0/1152158715 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f610c00a4a0 con 0x55f20aba42a0 2024-09-18T01:47:11.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.353+0000 7f6115d3a800 1 -- 172.21.15.146:0/1152158715 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f20aca0630 con 0x55f20aba42a0 2024-09-18T01:47:11.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.353+0000 7f611228c640 1 -- 172.21.15.146:0/1152158715 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f610c00a4a0 con 0x55f20aba42a0 2024-09-18T01:47:11.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.353+0000 7f6115d3a800 1 -- 172.21.15.146:0/1152158715 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f20aca5430 con 0x55f20aba42a0 2024-09-18T01:47:11.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.353+0000 7f611228c640 1 -- 172.21.15.146:0/1152158715 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f610c00a4a0 con 0x55f20aba42a0 2024-09-18T01:47:11.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.353+0000 7f6115d3a800 1 -- 172.21.15.146:0/1152158715 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f20aca4660 con 0x55f20aba42a0 2024-09-18T01:47:11.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.354+0000 7f611228c640 1 -- 172.21.15.146:0/1152158715 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f610c00a4a0 con 0x55f20aba42a0 2024-09-18T01:47:11.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.354+0000 7f6115d3a800 1 --2- 172.21.15.146:0/1152158715 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55f20aca67e0 0x55f20aca8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.354+0000 7f6115d3a800 1 -- 172.21.15.146:0/1152158715 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f20aca9110 con 0x55f20aca67e0 2024-09-18T01:47:11.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.354+0000 7f6111a8b640 1 --2- 172.21.15.146:0/1152158715 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55f20aca67e0 0x55f20aca8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.354+0000 7f6111a8b640 1 --2- 172.21.15.146:0/1152158715 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55f20aca67e0 0x55f20aca8bd0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.354+0000 7f6111a8b640 1 -- 172.21.15.146:0/1152158715 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f610407a030 con 0x55f20aca67e0 2024-09-18T01:47:11.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.355+0000 7f6115d3a800 1 Processor -- start 2024-09-18T01:47:11.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.355+0000 7f6115d3a800 1 -- start start 2024-09-18T01:47:11.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.355+0000 7f6115d3a800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f20acb6d90 0x55f20acb71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.355+0000 7f6115d3a800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55f20aa40580 con 0x55f20acb6d90 2024-09-18T01:47:11.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.355+0000 7f611228c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f20acb6d90 0x55f20acb71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.355+0000 7f611228c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f20acb6d90 0x55f20acb71b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37826/0 (socket says 172.21.15.146:37826) 2024-09-18T01:47:11.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.355+0000 7f611228c640 1 -- 172.21.15.146:0/2841620042 learned_addr learned my addr 172.21.15.146:0/2841620042 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:11.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.355+0000 7f611228c640 1 -- 172.21.15.146:0/2841620042 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f20acb76f0 con 0x55f20acb6d90 2024-09-18T01:47:11.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.355+0000 7f611228c640 1 --2- 172.21.15.146:0/2841620042 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f20acb6d90 0x55f20acb71b0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x55f20ac9cf30 tx=0x7f610c0178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.356+0000 7f5ff77fe640 1 -- 172.21.15.146:0/2841620042 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f610c013440 con 0x55f20acb6d90 2024-09-18T01:47:11.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.356+0000 7f5ff77fe640 1 -- 172.21.15.146:0/2841620042 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f610c0135e0 con 0x55f20acb6d90 2024-09-18T01:47:11.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.356+0000 7f6115d3a800 1 -- 172.21.15.146:0/2841620042 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f20acb7980 con 0x55f20acb6d90 2024-09-18T01:47:11.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.356+0000 7f5ff77fe640 1 -- 172.21.15.146:0/2841620042 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f610c0138c0 con 0x55f20acb6d90 2024-09-18T01:47:11.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.356+0000 7f6115d3a800 1 -- 172.21.15.146:0/2841620042 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f20acba660 con 0x55f20acb6d90 2024-09-18T01:47:11.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.356+0000 7f5ff77fe640 1 -- 172.21.15.146:0/2841620042 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f610c011040 con 0x55f20acb6d90 2024-09-18T01:47:11.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.356+0000 7f5ff77fe640 1 --2- 172.21.15.146:0/2841620042 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f5fec036b90 0x7f5fec039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.357+0000 7f5ff77fe640 1 -- 172.21.15.146:0/2841620042 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f610c01d070 con 0x55f20acb6d90 2024-09-18T01:47:11.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.357+0000 7f6111a8b640 1 --2- 172.21.15.146:0/2841620042 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f5fec036b90 0x7f5fec039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.357+0000 7f6115d3a800 1 Processor -- start 2024-09-18T01:47:11.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.357+0000 7f6115d3a800 1 -- start start 2024-09-18T01:47:11.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.357+0000 7f6111a8b640 1 --2- 172.21.15.146:0/2841620042 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f5fec036b90 0x7f5fec039050 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f610407c730 tx=0x7f6104054f70 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.357+0000 7f6115d3a800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f20acc3a30 0x55f20acc3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.357+0000 7f6115d3a800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55f20ac94e70 con 0x55f20acc3a30 2024-09-18T01:47:11.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.357+0000 7f611228c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f20acc3a30 0x55f20acc3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.357+0000 7f611228c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f20acc3a30 0x55f20acc3e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37830/0 (socket says 172.21.15.146:37830) 2024-09-18T01:47:11.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.357+0000 7f611228c640 1 -- 172.21.15.146:0/1202341119 learned_addr learned my addr 172.21.15.146:0/1202341119 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:11.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.357+0000 7f611228c640 1 -- 172.21.15.146:0/1202341119 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f20acc4400 con 0x55f20acc3a30 2024-09-18T01:47:11.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.358+0000 7f611228c640 1 --2- 172.21.15.146:0/1202341119 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f20acc3a30 0x55f20acc3e30 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f610c04c8c0 tx=0x7f610c001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9e2523ecb857332 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.358+0000 7f5ff57fa640 1 -- 172.21.15.146:0/1202341119 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f610c027040 con 0x55f20acc3a30 2024-09-18T01:47:11.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.358+0000 7f5ff57fa640 1 -- 172.21.15.146:0/1202341119 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f610c012cc0 con 0x55f20acc3a30 2024-09-18T01:47:11.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.358+0000 7f5ff57fa640 1 -- 172.21.15.146:0/1202341119 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f610c04b250 con 0x55f20acc3a30 2024-09-18T01:47:11.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.358+0000 7f6115d3a800 1 -- 172.21.15.146:0/1202341119 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f20acc3a30 msgr2=0x55f20acc3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.358+0000 7f6115d3a800 1 --2- 172.21.15.146:0/1202341119 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f20acc3a30 0x55f20acc3e30 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f610c04c8c0 tx=0x7f610c001940 comp rx=0 tx=0).stop 2024-09-18T01:47:11.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.358+0000 7f6115d3a800 1 -- 172.21.15.146:0/1202341119 shutdown_connections 2024-09-18T01:47:11.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.358+0000 7f6115d3a800 1 --2- 172.21.15.146:0/1202341119 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f20acc3a30 0x55f20acc3e30 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.358+0000 7f6115d3a800 1 -- 172.21.15.146:0/1202341119 >> 172.21.15.146:0/1202341119 conn(0x55f20acbfd90 msgr2=0x55f20acbde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:11.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.358+0000 7f6115d3a800 1 -- 172.21.15.146:0/1202341119 shutdown_connections 2024-09-18T01:47:11.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.358+0000 7f6115d3a800 1 -- 172.21.15.146:0/1202341119 wait complete. 2024-09-18T01:47:11.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.358+0000 7f6115d3a800 1 Processor -- start 2024-09-18T01:47:11.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.359+0000 7f6115d3a800 1 -- start start 2024-09-18T01:47:11.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.359+0000 7f6115d3a800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f20acc3a30 0x55f20accaea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.359+0000 7f6115d3a800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55f20acc4a70 con 0x55f20acc3a30 2024-09-18T01:47:11.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.359+0000 7f611228c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f20acc3a30 0x55f20accaea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.359+0000 7f611228c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f20acc3a30 0x55f20accaea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37832/0 (socket says 172.21.15.146:37832) 2024-09-18T01:47:11.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.359+0000 7f611228c640 1 -- 172.21.15.146:0/429674508 learned_addr learned my addr 172.21.15.146:0/429674508 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:11.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.359+0000 7f611228c640 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f20accb3e0 con 0x55f20acc3a30 2024-09-18T01:47:11.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.359+0000 7f611228c640 1 --2- 172.21.15.146:0/429674508 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f20acc3a30 0x55f20accaea0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f610c04b7b0 tx=0x7f610c04c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.359+0000 7f5fe37fe640 1 -- 172.21.15.146:0/429674508 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f610c027070 con 0x55f20acc3a30 2024-09-18T01:47:11.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.359+0000 7f5fe37fe640 1 -- 172.21.15.146:0/429674508 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f610c001610 con 0x55f20acc3a30 2024-09-18T01:47:11.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.359+0000 7f6115d3a800 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f20accb670 con 0x55f20acc3a30 2024-09-18T01:47:11.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.359+0000 7f5fe37fe640 1 -- 172.21.15.146:0/429674508 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f610c02aa60 con 0x55f20acc3a30 2024-09-18T01:47:11.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.359+0000 7f6115d3a800 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f20acce320 con 0x55f20acc3a30 2024-09-18T01:47:11.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.360+0000 7f5fe37fe640 1 -- 172.21.15.146:0/429674508 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f610c02ad10 con 0x55f20acc3a30 2024-09-18T01:47:11.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.360+0000 7f5fe37fe640 1 --2- 172.21.15.146:0/429674508 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f5fdc036b40 0x7f5fdc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.360+0000 7f5fe37fe640 1 -- 172.21.15.146:0/429674508 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f610c033070 con 0x55f20acc3a30 2024-09-18T01:47:11.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.360+0000 7f6111a8b640 1 --2- 172.21.15.146:0/429674508 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f5fdc036b40 0x7f5fdc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.361+0000 7f6111a8b640 1 --2- 172.21.15.146:0/429674508 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f5fdc036b40 0x7f5fdc039000 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6104045a60 tx=0x7f6104084000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.361+0000 7f6115d3a800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.361+0000 7f6115d3a800 1 --2- 172.21.15.146:0/429674508 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55f20acd6b00 0x55f20acd8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.361+0000 7f6115d3a800 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f20acd9710 con 0x55f20acd6b00 2024-09-18T01:47:11.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.361+0000 7f610bfff640 1 --2- 172.21.15.146:0/429674508 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55f20acd6b00 0x55f20acd8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.361+0000 7f610bfff640 1 --2- 172.21.15.146:0/429674508 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55f20acd6b00 0x55f20acd8fc0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.362+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f60fc00f5f0 con 0x55f20acd6b00 2024-09-18T01:47:11.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.362+0000 7f6115d3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:11.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.362+0000 7f6115d3a800 20 realm 2024-09-18T01:47:11.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.362+0000 7f6115d3a800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.362+0000 7f6115d3a800 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f20acd5f50 con 0x55f20acd6b00 2024-09-18T01:47:11.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.362+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f60fc00f5f0 con 0x55f20acd6b00 2024-09-18T01:47:11.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.362+0000 7f6115d3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:11.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.362+0000 7f6115d3a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:47:11.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.362+0000 7f6115d3a800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.362+0000 7f6115d3a800 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f20acda200 con 0x55f20acd6b00 2024-09-18T01:47:11.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.362+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f60fc00f5f0 con 0x55f20acd6b00 2024-09-18T01:47:11.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.362+0000 7f6115d3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:11.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.362+0000 7f6115d3a800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.362+0000 7f6115d3a800 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f20acdaad0 con 0x55f20acd6b00 2024-09-18T01:47:11.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.362+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f60fc00f5f0 con 0x55f20acd6b00 2024-09-18T01:47:11.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.362+0000 7f6115d3a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:47:11.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.362+0000 7f6115d3a800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.362+0000 7f6115d3a800 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f20acdae70 con 0x55f20acd6b00 2024-09-18T01:47:11.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.363+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f60fc00f5f0 con 0x55f20acd6b00 2024-09-18T01:47:11.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.363+0000 7f6115d3a800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:47:11.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.363+0000 7f6115d3a800 20 searching for the correct realm 2024-09-18T01:47:11.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.363+0000 7f6115d3a800 1 --2- 172.21.15.146:0/429674508 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55f20acdcda0 0x55f20acdf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.363+0000 7f6115d3a800 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f20acdf880 con 0x55f20acdcda0 2024-09-18T01:47:11.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.363+0000 7f611228c640 1 --2- 172.21.15.146:0/429674508 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55f20acdcda0 0x55f20acdf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.363+0000 7f611228c640 1 --2- 172.21.15.146:0/429674508 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55f20acdcda0 0x55f20acdf1b0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.363+0000 7f611228c640 1 -- 172.21.15.146:0/429674508 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f610c057040 con 0x55f20acdcda0 2024-09-18T01:47:11.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.363+0000 7f611228c640 1 --2- 172.21.15.146:0/429674508 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f610c0123a0 0x7f610c036580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.363+0000 7f611228c640 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f20acdf880 con 0x7f610c0123a0 2024-09-18T01:47:11.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.363+0000 7f6111a8b640 1 --2- 172.21.15.146:0/429674508 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f610c0123a0 0x7f610c036580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.364+0000 7f6111a8b640 1 --2- 172.21.15.146:0/429674508 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f610c0123a0 0x7f610c036580 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.364+0000 7f6111a8b640 1 -- 172.21.15.146:0/429674508 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f610408b050 con 0x7f610c0123a0 2024-09-18T01:47:11.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.364+0000 7f6111a8b640 1 --2- 172.21.15.146:0/429674508 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f610407d060 0x7f61040908a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.364+0000 7f6111a8b640 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f20acdf880 con 0x7f610407d060 2024-09-18T01:47:11.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.364+0000 7f610bfff640 1 --2- 172.21.15.146:0/429674508 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f610407d060 0x7f61040908a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.365+0000 7f610bfff640 1 --2- 172.21.15.146:0/429674508 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f610407d060 0x7f61040908a0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.365+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60fc00f5f0 con 0x7f610407d060 2024-09-18T01:47:11.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.365+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f20acdf880 con 0x55f20acd6b00 2024-09-18T01:47:11.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.365+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v33'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f60fc00f5f0 con 0x55f20acd6b00 2024-09-18T01:47:11.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.365+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f20acdf880 con 0x55f20acd6b00 2024-09-18T01:47:11.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.365+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60fc00f5f0 con 0x55f20acd6b00 2024-09-18T01:47:11.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.365+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f20acdf880 con 0x7f610407d060 2024-09-18T01:47:11.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.366+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60fc00f5f0 con 0x7f610407d060 2024-09-18T01:47:11.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.366+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f20acdf880 con 0x7f610407d060 2024-09-18T01:47:11.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.366+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60fc00f5f0 con 0x7f610407d060 2024-09-18T01:47:11.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.366+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f20acdf880 con 0x7f610c0123a0 2024-09-18T01:47:11.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.366+0000 7f6111a8b640 1 -- 172.21.15.146:0/429674508 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f610408b050 con 0x7f610c0123a0 2024-09-18T01:47:11.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.366+0000 7f6111a8b640 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f20acdf880 con 0x55f20acdcda0 2024-09-18T01:47:11.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.366+0000 7f611228c640 1 -- 172.21.15.146:0/429674508 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f610c057040 con 0x55f20acdcda0 2024-09-18T01:47:11.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.366+0000 7f611228c640 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f20acdf880 con 0x55f20acd6b00 2024-09-18T01:47:11.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.366+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60fc00f5f0 con 0x55f20acd6b00 2024-09-18T01:47:11.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.366+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f20acdf880 con 0x7f610407d060 2024-09-18T01:47:11.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.367+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60fc00f5f0 con 0x7f610407d060 2024-09-18T01:47:11.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.367+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f20acdf880 con 0x55f20acd6b00 2024-09-18T01:47:11.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.367+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60fc00f5f0 con 0x55f20acd6b00 2024-09-18T01:47:11.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.367+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f20acdf880 con 0x7f610c0123a0 2024-09-18T01:47:11.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.367+0000 7f6111a8b640 1 -- 172.21.15.146:0/429674508 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f610408b050 con 0x7f610c0123a0 2024-09-18T01:47:11.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.367+0000 7f6111a8b640 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f20acdf880 con 0x55f20acdcda0 2024-09-18T01:47:11.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.367+0000 7f611228c640 1 -- 172.21.15.146:0/429674508 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f610c057040 con 0x55f20acdcda0 2024-09-18T01:47:11.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.367+0000 7f611228c640 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f20acdf880 con 0x55f20acdcda0 2024-09-18T01:47:11.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.368+0000 7f611228c640 1 -- 172.21.15.146:0/429674508 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f610c057040 con 0x55f20acdcda0 2024-09-18T01:47:11.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.368+0000 7f611228c640 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f20acdf880 con 0x7f610407d060 2024-09-18T01:47:11.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.368+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60fc00f5f0 con 0x7f610407d060 2024-09-18T01:47:11.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.368+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f20acdf880 con 0x55f20acdcda0 2024-09-18T01:47:11.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.368+0000 7f611228c640 1 -- 172.21.15.146:0/429674508 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f610c057040 con 0x55f20acdcda0 2024-09-18T01:47:11.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.368+0000 7f611228c640 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f20acdf880 con 0x55f20acdcda0 2024-09-18T01:47:11.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.368+0000 7f611228c640 1 -- 172.21.15.146:0/429674508 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f610c057040 con 0x55f20acdcda0 2024-09-18T01:47:11.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.368+0000 7f611228c640 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f20acdf880 con 0x55f20acd6b00 2024-09-18T01:47:11.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.369+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60fc00f5f0 con 0x55f20acd6b00 2024-09-18T01:47:11.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.369+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f20acdf880 con 0x55f20acd6b00 2024-09-18T01:47:11.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.369+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v33'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f60fc00f5f0 con 0x55f20acd6b00 2024-09-18T01:47:11.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.369+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f20acdf880 con 0x7f610407d060 2024-09-18T01:47:11.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.369+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60fc00f5f0 con 0x7f610407d060 2024-09-18T01:47:11.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.369+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f20acdf880 con 0x55f20acdcda0 2024-09-18T01:47:11.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.369+0000 7f611228c640 1 -- 172.21.15.146:0/429674508 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f610c057040 con 0x55f20acdcda0 2024-09-18T01:47:11.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.369+0000 7f611228c640 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f20acdf880 con 0x7f610c0123a0 2024-09-18T01:47:11.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.370+0000 7f6111a8b640 1 -- 172.21.15.146:0/429674508 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f610408b050 con 0x7f610c0123a0 2024-09-18T01:47:11.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.370+0000 7f6111a8b640 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f20acdf880 con 0x55f20acd6b00 2024-09-18T01:47:11.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.370+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60fc00f5f0 con 0x55f20acd6b00 2024-09-18T01:47:11.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.370+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f20acdf880 con 0x7f610407d060 2024-09-18T01:47:11.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.370+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60fc03b040 con 0x7f610407d060 2024-09-18T01:47:11.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.370+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f20acdf880 con 0x55f20acdcda0 2024-09-18T01:47:11.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.370+0000 7f611228c640 1 -- 172.21.15.146:0/429674508 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f610c057040 con 0x55f20acdcda0 2024-09-18T01:47:11.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.370+0000 7f611228c640 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f20acdf880 con 0x7f610407d060 2024-09-18T01:47:11.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.371+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60fc03b040 con 0x7f610407d060 2024-09-18T01:47:11.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.371+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f20acdf880 con 0x7f610c0123a0 2024-09-18T01:47:11.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.371+0000 7f6111a8b640 1 -- 172.21.15.146:0/429674508 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f610408b050 con 0x7f610c0123a0 2024-09-18T01:47:11.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.371+0000 7f6111a8b640 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f20acdf880 con 0x55f20acdcda0 2024-09-18T01:47:11.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.371+0000 7f611228c640 1 -- 172.21.15.146:0/429674508 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f610c057040 con 0x55f20acdcda0 2024-09-18T01:47:11.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.371+0000 7f611228c640 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f20acdf880 con 0x7f610407d060 2024-09-18T01:47:11.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.371+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60fc03b040 con 0x7f610407d060 2024-09-18T01:47:11.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.371+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f20acdf880 con 0x55f20acd6b00 2024-09-18T01:47:11.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.372+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v33'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f60fc03b040 con 0x55f20acd6b00 2024-09-18T01:47:11.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.372+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f20acdf880 con 0x7f610c0123a0 2024-09-18T01:47:11.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.372+0000 7f6111a8b640 1 -- 172.21.15.146:0/429674508 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f610408b050 con 0x7f610c0123a0 2024-09-18T01:47:11.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.372+0000 7f6115d3a800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:47:11.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.372+0000 7f6115d3a800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:47:11.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.372+0000 7f6115d3a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:47:11.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.372+0000 7f6115d3a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:47:11.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.372+0000 7f6115d3a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:47:11.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.372+0000 7f6115d3a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:47:11.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.372+0000 7f6115d3a800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.372+0000 7f6115d3a800 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f20acdb840 con 0x55f20acd6b00 2024-09-18T01:47:11.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.372+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f60fc03b040 con 0x55f20acd6b00 2024-09-18T01:47:11.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.372+0000 7f6115d3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:11.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.372+0000 7f6115d3a800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.372+0000 7f6115d3a800 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f20acdc0e0 con 0x55f20acd6b00 2024-09-18T01:47:11.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.372+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f60fc03b040 con 0x55f20acd6b00 2024-09-18T01:47:11.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.372+0000 7f6115d3a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:47:11.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.372+0000 7f6115d3a800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.372+0000 7f6115d3a800 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f20acdc0e0 con 0x7f610c0123a0 2024-09-18T01:47:11.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.373+0000 7f6111a8b640 1 -- 172.21.15.146:0/429674508 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f610408b050 con 0x7f610c0123a0 2024-09-18T01:47:11.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.373+0000 7f6115d3a800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:47:11.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.373+0000 7f6115d3a800 20 zone default found 2024-09-18T01:47:11.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.373+0000 7f6115d3a800 4 Realm: () 2024-09-18T01:47:11.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.373+0000 7f6115d3a800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:47:11.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.373+0000 7f6115d3a800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:47:11.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.373+0000 7f6115d3a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:47:11.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.373+0000 7f6115d3a800 20 zonegroup default 2024-09-18T01:47:11.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.373+0000 7f6115d3a800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.373+0000 7f6115d3a800 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f20ace01b0 con 0x7f610407d060 2024-09-18T01:47:11.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.373+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f60fc03b040 con 0x7f610407d060 2024-09-18T01:47:11.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.373+0000 7f6115d3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:11.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.373+0000 7f6115d3a800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.373+0000 7f6115d3a800 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f20ace1b90 con 0x55f20acdcda0 2024-09-18T01:47:11.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.373+0000 7f611228c640 1 -- 172.21.15.146:0/429674508 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f610c057040 con 0x55f20acdcda0 2024-09-18T01:47:11.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.373+0000 7f6115d3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:11.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.373+0000 7f6115d3a800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.373+0000 7f6115d3a800 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f20ace2030 con 0x55f20acdcda0 2024-09-18T01:47:11.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.373+0000 7f611228c640 1 -- 172.21.15.146:0/429674508 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f610c057040 con 0x55f20acdcda0 2024-09-18T01:47:11.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.373+0000 7f6115d3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:11.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.373+0000 7f6115d3a800 20 started sync module instance, tier type = 2024-09-18T01:47:11.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.373+0000 7f6115d3a800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:47:11.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.374+0000 7f6115d3a800 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f20ace1020 con 0x7f610c0123a0 2024-09-18T01:47:11.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.375+0000 7f6111a8b640 1 -- 172.21.15.146:0/429674508 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v33'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f610408b050 con 0x7f610c0123a0 2024-09-18T01:47:11.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.375+0000 7f6115d3a800 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94498051724304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f20ace0c80 con 0x7f610c0123a0 2024-09-18T01:47:11.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.375+0000 7f6115d3a800 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f20ace2f60 con 0x55f20acd6b00 2024-09-18T01:47:11.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.376+0000 7f6111a8b640 1 -- 172.21.15.146:0/429674508 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94498051724304] v33'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f610408b050 con 0x7f610c0123a0 2024-09-18T01:47:11.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.376+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v33'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60fc03b040 con 0x55f20acd6b00 2024-09-18T01:47:11.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.376+0000 7f6115d3a800 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94498051730096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f20ace3380 con 0x55f20acd6b00 2024-09-18T01:47:11.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.376+0000 7f6115d3a800 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f20ace3d40 con 0x55f20acdcda0 2024-09-18T01:47:11.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.377+0000 7f611228c640 1 -- 172.21.15.146:0/429674508 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v33'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f610c057040 con 0x55f20acdcda0 2024-09-18T01:47:11.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.377+0000 7f6115d3a800 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94498051733648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f20ace3cf0 con 0x55f20acdcda0 2024-09-18T01:47:11.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.377+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94498051730096] v33'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60fc03b040 con 0x55f20acd6b00 2024-09-18T01:47:11.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.377+0000 7f6115d3a800 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f20ace4d10 con 0x7f610c0123a0 2024-09-18T01:47:11.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.378+0000 7f611228c640 1 -- 172.21.15.146:0/429674508 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94498051733648] v33'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f610c057040 con 0x55f20acdcda0 2024-09-18T01:47:11.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.378+0000 7f6111a8b640 1 -- 172.21.15.146:0/429674508 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v33'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f610408b050 con 0x7f610c0123a0 2024-09-18T01:47:11.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.378+0000 7f6115d3a800 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94498051735856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f20ace2ed0 con 0x7f610c0123a0 2024-09-18T01:47:11.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.378+0000 7f6115d3a800 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f20ace55f0 con 0x55f20acd6b00 2024-09-18T01:47:11.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.379+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v33'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60fc03b040 con 0x55f20acd6b00 2024-09-18T01:47:11.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.379+0000 7f6115d3a800 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94498051739904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f20ace55a0 con 0x55f20acd6b00 2024-09-18T01:47:11.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.379+0000 7f6115d3a800 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f20ace6570 con 0x7f610407d060 2024-09-18T01:47:11.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.380+0000 7f6111a8b640 1 -- 172.21.15.146:0/429674508 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94498051735856] v33'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f610408b050 con 0x7f610c0123a0 2024-09-18T01:47:11.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.380+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v33'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60fc03b040 con 0x7f610407d060 2024-09-18T01:47:11.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.380+0000 7f6115d3a800 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94498051743840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f20ace6530 con 0x7f610407d060 2024-09-18T01:47:11.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.380+0000 7f6115d3a800 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f20ace6fb0 con 0x7f610407d060 2024-09-18T01:47:11.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.380+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94498051739904] v33'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60fc03b040 con 0x55f20acd6b00 2024-09-18T01:47:11.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.381+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94498051743840] v33'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60fc03b040 con 0x7f610407d060 2024-09-18T01:47:11.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.382+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v33'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60fc03b040 con 0x7f610407d060 2024-09-18T01:47:11.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.382+0000 7f6115d3a800 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94498051737600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f20ace6b00 con 0x7f610407d060 2024-09-18T01:47:11.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.382+0000 7f6115d3a800 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f20ace74c0 con 0x7f610407d060 2024-09-18T01:47:11.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.382+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94498051737600] v33'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60fc03b040 con 0x7f610407d060 2024-09-18T01:47:11.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.383+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v33'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60fc03b040 con 0x7f610407d060 2024-09-18T01:47:11.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.383+0000 7f6115d3a800 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94498051742176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f20ace74c0 con 0x7f610407d060 2024-09-18T01:47:11.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.383+0000 7f6115d3a800 20 add_watcher() i=0 2024-09-18T01:47:11.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.383+0000 7f6115d3a800 20 add_watcher() i=1 2024-09-18T01:47:11.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.383+0000 7f6115d3a800 20 add_watcher() i=2 2024-09-18T01:47:11.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.383+0000 7f6115d3a800 20 add_watcher() i=3 2024-09-18T01:47:11.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.383+0000 7f6115d3a800 20 add_watcher() i=4 2024-09-18T01:47:11.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.383+0000 7f6115d3a800 20 add_watcher() i=5 2024-09-18T01:47:11.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.383+0000 7f6115d3a800 20 add_watcher() i=6 2024-09-18T01:47:11.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.383+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94498051742176] v33'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60fc03b040 con 0x7f610407d060 2024-09-18T01:47:11.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.383+0000 7f6115d3a800 20 add_watcher() i=7 2024-09-18T01:47:11.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.384+0000 7f6115d3a800 2 all 8 watchers are set, enabling cache 2024-09-18T01:47:11.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.384+0000 7f6115d3a800 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f20acea7b0 con 0x55f20acd6b00 2024-09-18T01:47:11.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.384+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f60fc03b040 con 0x55f20acd6b00 2024-09-18T01:47:11.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.384+0000 7f6115d3a800 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94498051748224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f20ace7a50 con 0x55f20acd6b00 2024-09-18T01:47:11.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.385+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94498051748224] v33'271 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f60fc03b040 con 0x55f20acd6b00 2024-09-18T01:47:11.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.385+0000 7f5fc3fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:47:11.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.385+0000 7f6115d3a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:47:11.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.385+0000 7f6115d3a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:47:11.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.385+0000 7f6115d3a800 5 note: GC not initialized 2024-09-18T01:47:11.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.385+0000 7f5fc2ffd640 20 reqs_thread_entry: start 2024-09-18T01:47:11.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.385+0000 7f6115d3a800 20 init_complete bucket index max shards: 11 2024-09-18T01:47:11.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.386+0000 7f6115d3a800 20 Filter name: none 2024-09-18T01:47:11.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.386+0000 7f5fc0ff9640 20 reqs_thread_entry: start 2024-09-18T01:47:11.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.386+0000 7f6115d3a800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-18T01:47:11.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.386+0000 7f6115d3a800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.386+0000 7f6115d3a800 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f20ad1dc70 con 0x7f610407d060 2024-09-18T01:47:11.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.389+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f60fc03b040 con 0x7f610407d060 2024-09-18T01:47:11.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.389+0000 7f6115d3a800 20 rados_obj.operate() r=0 bl.length=460 2024-09-18T01:47:11.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.389+0000 7f6115d3a800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-18T01:47:11.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.389+0000 7f6115d3a800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:47:11.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.389+0000 7f6115d3a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:47:11.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.389+0000 7f6115d3a800 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f20ad24330 con 0x7f610407d060 2024-09-18T01:47:11.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.391+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v33'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f60fc03b040 con 0x7f610407d060 2024-09-18T01:47:11.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.391+0000 7f6115d3a800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T01:47:11.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.391+0000 7f6115d3a800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:47:11.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.391+0000 7f6115d3a800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-18T01:47:11.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.391+0000 7f6115d3a800 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94498051996912 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f20ad1f990 con 0x55f20acd6b00 2024-09-18T01:47:11.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.391+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== watch-notify(notify (1) cookie 94498051739904 notify 141733920800 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7f60fc018040 con 0x55f20acd6b00 2024-09-18T01:47:11.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.391+0000 7f5ff57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920800 cookie 94498051739904 notifier 4908 bl.length()=666 2024-09-18T01:47:11.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.391+0000 7f5ff57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T01:47:11.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.391+0000 7f5ff57fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:47:11.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.391+0000 7f5ff57fa640 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f5fd4003ea0 con 0x55f20acd6b00 2024-09-18T01:47:11.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.391+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(64 notify.4 [notify cookie 94498051996912 out=8b] v0'0 uv270 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f60fc03b040 con 0x55f20acd6b00 2024-09-18T01:47:11.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.392+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== watch-notify(notify_complete (2) cookie 94498051996912 notify 141733920800 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f60fc004dd0 con 0x55f20acd6b00 2024-09-18T01:47:11.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.392+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60fc03b040 con 0x55f20acd6b00 2024-09-18T01:47:11.406 INFO:teuthology.orchestra.run.smithi146.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-18T01:47:09.882428Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"write"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:47:09.882414Z","tags":[],"group_ids":[]} 2024-09-18T01:47:11.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.393+0000 7f5fc3fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:47:11.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.393+0000 7f6115d3a800 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94498051748224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f20ad1b9f0 con 0x55f20acd6b00 2024-09-18T01:47:11.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.394+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94498051748224] v33'272 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f60fc03b040 con 0x55f20acd6b00 2024-09-18T01:47:11.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.394+0000 7f6115d3a800 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94498051724304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f20ad1b9f0 con 0x7f610c0123a0 2024-09-18T01:47:11.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.395+0000 7f6111a8b640 1 -- 172.21.15.146:0/429674508 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94498051724304] v33'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f610408b050 con 0x7f610c0123a0 2024-09-18T01:47:11.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.395+0000 7f6115d3a800 20 remove_watcher() i=0 2024-09-18T01:47:11.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.395+0000 7f6115d3a800 2 removed watcher, disabling cache 2024-09-18T01:47:11.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.395+0000 7f6115d3a800 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94498051730096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f20ad1b9f0 con 0x55f20acd6b00 2024-09-18T01:47:11.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.396+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94498051730096] v33'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60fc03b040 con 0x55f20acd6b00 2024-09-18T01:47:11.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.396+0000 7f6115d3a800 20 remove_watcher() i=1 2024-09-18T01:47:11.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.396+0000 7f6115d3a800 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94498051733648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f20ad1b9f0 con 0x55f20acdcda0 2024-09-18T01:47:11.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.397+0000 7f611228c640 1 -- 172.21.15.146:0/429674508 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94498051733648] v33'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f610c057040 con 0x55f20acdcda0 2024-09-18T01:47:11.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.397+0000 7f6115d3a800 20 remove_watcher() i=2 2024-09-18T01:47:11.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.397+0000 7f6115d3a800 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94498051735856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f20ad1b9f0 con 0x7f610c0123a0 2024-09-18T01:47:11.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.398+0000 7f6111a8b640 1 -- 172.21.15.146:0/429674508 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94498051735856] v33'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f610408b050 con 0x7f610c0123a0 2024-09-18T01:47:11.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.398+0000 7f6115d3a800 20 remove_watcher() i=3 2024-09-18T01:47:11.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.398+0000 7f6115d3a800 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94498051739904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f20ad1b9f0 con 0x55f20acd6b00 2024-09-18T01:47:11.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.399+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 <== osd.1 v2:172.21.15.146:6808/3930274777 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94498051739904] v33'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60fc03b040 con 0x55f20acd6b00 2024-09-18T01:47:11.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.399+0000 7f6115d3a800 20 remove_watcher() i=4 2024-09-18T01:47:11.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.399+0000 7f6115d3a800 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94498051743840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f20ad1b9f0 con 0x7f610407d060 2024-09-18T01:47:11.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.400+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94498051743840] v33'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60fc03b040 con 0x7f610407d060 2024-09-18T01:47:11.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.400+0000 7f6115d3a800 20 remove_watcher() i=5 2024-09-18T01:47:11.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.400+0000 7f6115d3a800 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94498051737600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f20ad1b9f0 con 0x7f610407d060 2024-09-18T01:47:11.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.401+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94498051737600] v33'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60fc03b040 con 0x7f610407d060 2024-09-18T01:47:11.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.401+0000 7f6115d3a800 20 remove_watcher() i=6 2024-09-18T01:47:11.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.401+0000 7f6115d3a800 1 -- 172.21.15.146:0/429674508 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94498051742176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f20ad1b9f0 con 0x7f610407d060 2024-09-18T01:47:11.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.402+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94498051742176] v33'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60fc03b040 con 0x7f610407d060 2024-09-18T01:47:11.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.402+0000 7f6115d3a800 20 remove_watcher() i=7 2024-09-18T01:47:11.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.402+0000 7f6115d3a800 1 -- 172.21.15.146:0/429674508 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f610407d060 msgr2=0x7f61040908a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.402+0000 7f6115d3a800 1 --2- 172.21.15.146:0/429674508 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f610407d060 0x7f61040908a0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.402+0000 7f6115d3a800 1 -- 172.21.15.146:0/429674508 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55f20acd6b00 msgr2=0x55f20acd8fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.402+0000 7f6115d3a800 1 --2- 172.21.15.146:0/429674508 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55f20acd6b00 0x55f20acd8fc0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.402+0000 7f6115d3a800 1 -- 172.21.15.146:0/429674508 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f610c0123a0 msgr2=0x7f610c036580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.402+0000 7f6115d3a800 1 --2- 172.21.15.146:0/429674508 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f610c0123a0 0x7f610c036580 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.402+0000 7f6115d3a800 1 -- 172.21.15.146:0/429674508 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55f20acdcda0 msgr2=0x55f20acdf1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.402+0000 7f6115d3a800 1 --2- 172.21.15.146:0/429674508 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55f20acdcda0 0x55f20acdf1b0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.402+0000 7f6115d3a800 1 -- 172.21.15.146:0/429674508 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f5fdc036b40 msgr2=0x7f5fdc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.402+0000 7f6115d3a800 1 --2- 172.21.15.146:0/429674508 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f5fdc036b40 0x7f5fdc039000 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6104045a60 tx=0x7f6104084000 comp rx=0 tx=0).stop 2024-09-18T01:47:11.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.402+0000 7f6115d3a800 1 -- 172.21.15.146:0/429674508 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f20acc3a30 msgr2=0x55f20accaea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.402+0000 7f6115d3a800 1 --2- 172.21.15.146:0/429674508 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f20acc3a30 0x55f20accaea0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f610c04b7b0 tx=0x7f610c04c820 comp rx=0 tx=0).stop 2024-09-18T01:47:11.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.402+0000 7f610bfff640 1 -- 172.21.15.146:0/429674508 reap_dead start 2024-09-18T01:47:11.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.402+0000 7f6115d3a800 1 -- 172.21.15.146:0/429674508 shutdown_connections 2024-09-18T01:47:11.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.402+0000 7f6115d3a800 1 --2- 172.21.15.146:0/429674508 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f20acc3a30 0x55f20accaea0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.402+0000 7f6115d3a800 1 -- 172.21.15.146:0/429674508 >> 172.21.15.146:0/429674508 conn(0x55f20acbfd90 msgr2=0x55f20acbde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:11.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.402+0000 7f6115d3a800 1 -- 172.21.15.146:0/429674508 shutdown_connections 2024-09-18T01:47:11.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.402+0000 7f6115d3a800 1 -- 172.21.15.146:0/429674508 wait complete. 2024-09-18T01:47:11.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.402+0000 7f6115d3a800 1 -- 172.21.15.146:0/2841620042 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f5fec036b90 msgr2=0x7f5fec039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.402+0000 7f6115d3a800 1 --2- 172.21.15.146:0/2841620042 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f5fec036b90 0x7f5fec039050 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f610407c730 tx=0x7f6104054f70 comp rx=0 tx=0).stop 2024-09-18T01:47:11.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.402+0000 7f6115d3a800 1 -- 172.21.15.146:0/2841620042 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f20acb6d90 msgr2=0x55f20acb71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.402+0000 7f6115d3a800 1 --2- 172.21.15.146:0/2841620042 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f20acb6d90 0x55f20acb71b0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x55f20ac9cf30 tx=0x7f610c0178e0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.403+0000 7f6115d3a800 1 -- 172.21.15.146:0/2841620042 shutdown_connections 2024-09-18T01:47:11.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.403+0000 7f6115d3a800 1 --2- 172.21.15.146:0/2841620042 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f5fec036b90 0x7f5fec039050 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.403+0000 7f6115d3a800 1 --2- 172.21.15.146:0/2841620042 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f20acb6d90 0x55f20acb71b0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.403+0000 7f6115d3a800 1 -- 172.21.15.146:0/2841620042 >> 172.21.15.146:0/2841620042 conn(0x55f20acabd20 msgr2=0x55f20acae8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:11.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.403+0000 7f6115d3a800 1 -- 172.21.15.146:0/2841620042 shutdown_connections 2024-09-18T01:47:11.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.403+0000 7f6115d3a800 1 -- 172.21.15.146:0/2841620042 wait complete. 2024-09-18T01:47:11.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.403+0000 7f6115d3a800 1 -- 172.21.15.146:0/1152158715 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55f20aba42a0 msgr2=0x55f20aca3080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.403+0000 7f6115d3a800 1 --2- 172.21.15.146:0/1152158715 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55f20aba42a0 0x55f20aca3080 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.403+0000 7f6115d3a800 1 -- 172.21.15.146:0/1152158715 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55f20aca67e0 msgr2=0x55f20aca8bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.403+0000 7f6115d3a800 1 --2- 172.21.15.146:0/1152158715 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55f20aca67e0 0x55f20aca8bd0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.403+0000 7f6115d3a800 1 -- 172.21.15.146:0/1152158715 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f5ff8036b90 msgr2=0x7f5ff8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.403+0000 7f6115d3a800 1 --2- 172.21.15.146:0/1152158715 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f5ff8036b90 0x7f5ff8039050 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f60fc000c00 tx=0x7f60fc0013b0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.403+0000 7f6115d3a800 1 -- 172.21.15.146:0/1152158715 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f20aba3960 msgr2=0x55f20ac9c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.403+0000 7f6115d3a800 1 --2- 172.21.15.146:0/1152158715 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f20aba3960 0x55f20ac9c010 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f6104045f50 tx=0x7f6104002fb0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.403+0000 7f6115d3a800 1 -- 172.21.15.146:0/1152158715 shutdown_connections 2024-09-18T01:47:11.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.403+0000 7f6115d3a800 1 --2- 172.21.15.146:0/1152158715 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55f20aca67e0 0x55f20aca8bd0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.403+0000 7f6115d3a800 1 --2- 172.21.15.146:0/1152158715 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55f20aba42a0 0x55f20aca3080 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.403+0000 7f6115d3a800 1 --2- 172.21.15.146:0/1152158715 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f5ff8036b90 0x7f5ff8039050 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.403+0000 7f6115d3a800 1 --2- 172.21.15.146:0/1152158715 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55f20aba3960 0x55f20ac9c010 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.403+0000 7f6115d3a800 1 -- 172.21.15.146:0/1152158715 >> 172.21.15.146:0/1152158715 conn(0x55f20ab9f550 msgr2=0x55f20ac8e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:11.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.403+0000 7f6115d3a800 1 -- 172.21.15.146:0/1152158715 shutdown_connections 2024-09-18T01:47:11.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.403+0000 7f6115d3a800 1 -- 172.21.15.146:0/1152158715 wait complete. 2024-09-18T01:47:11.418 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T01:47:09.882428Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:47:09.882414Z', 'tags': [], 'group_ids': []} 2024-09-18T01:47:11.418 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T01:47:09.882428Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:47:09.882414Z', 'tags': [], 'group_ids': []} 2024-09-18T01:47:11.419 ERROR:root:0 2024-09-18T01:47:11.419 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-18T01:47:11.423 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'AccessDenied', 'Message': '', 'RequestId': 'tx00000e2cd07ca7a449acf-0066ea311f-4236-default', 'HostId': '4236-default-default'} 2024-09-18T01:47:11.423 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-18T01:47:11.423 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-18T01:47:11.423 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps user-info-without-keys=write 2024-09-18T01:47:11.470 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:47:11.470 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:47:11.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.470+0000 7fc063e0f800 1 Processor -- start 2024-09-18T01:47:11.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.470+0000 7fc063e0f800 1 -- start start 2024-09-18T01:47:11.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.470+0000 7fc063e0f800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55ab13ce3920 0x55ab13ce5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.470+0000 7fc063e0f800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ab13b9fb30 con 0x55ab13cdf4e0 2024-09-18T01:47:11.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.470+0000 7fc063e0f800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x55ab13b81360 con 0x55ab13ce3920 2024-09-18T01:47:11.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.470+0000 7fc05ece6640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55ab13ce3920 0x55ab13ce5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.470+0000 7fc05ece6640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x55ab13ce3920 0x55ab13ce5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37844/0 (socket says 172.21.15.146:37844) 2024-09-18T01:47:11.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.470+0000 7fc05ece6640 1 -- 172.21.15.146:0/2862780693 learned_addr learned my addr 172.21.15.146:0/2862780693 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:11.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.470+0000 7fc05f4e7640 1 --1- 172.21.15.146:0/2862780693 >> v1:172.21.15.129:6789/0 conn(0x55ab13cdf4e0 0x55ab13cdf8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:53140/0 (socket says 172.21.15.146:53140) 2024-09-18T01:47:11.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.470+0000 7fc05ece6640 1 -- 172.21.15.146:0/2862780693 >> v1:172.21.15.129:6789/0 conn(0x55ab13cdf4e0 legacy=0x55ab13cdf8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.470+0000 7fc05ece6640 1 -- 172.21.15.146:0/2862780693 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab13ba7e00 con 0x55ab13ce3920 2024-09-18T01:47:11.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.470+0000 7fc05e4e5640 1 -- 172.21.15.146:0/2862780693 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 847144741 0 0) 0x55ab13b9fb30 con 0x55ab13cdf4e0 2024-09-18T01:47:11.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.472+0000 7fc05ece6640 1 --2- 172.21.15.146:0/2862780693 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ab13ce3920 0x55ab13ce5d10 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fc05400a520 tx=0x7fc054045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba4cac3b164ec657 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.472+0000 7fc05e4e5640 1 -- 172.21.15.146:0/2862780693 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc054055070 con 0x55ab13ce3920 2024-09-18T01:47:11.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.472+0000 7fc05e4e5640 1 -- 172.21.15.146:0/2862780693 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0540515b0 con 0x55ab13ce3920 2024-09-18T01:47:11.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.472+0000 7fc05e4e5640 1 -- 172.21.15.146:0/2862780693 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0540518d0 con 0x55ab13ce3920 2024-09-18T01:47:11.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.473+0000 7fc063e0f800 1 -- 172.21.15.146:0/2862780693 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ab13ce3920 msgr2=0x55ab13ce5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.473+0000 7fc063e0f800 1 --2- 172.21.15.146:0/2862780693 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ab13ce3920 0x55ab13ce5d10 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fc05400a520 tx=0x7fc054045ba0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.473+0000 7fc063e0f800 1 -- 172.21.15.146:0/2862780693 shutdown_connections 2024-09-18T01:47:11.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.473+0000 7fc063e0f800 1 --2- 172.21.15.146:0/2862780693 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ab13ce3920 0x55ab13ce5d10 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.473+0000 7fc063e0f800 1 -- 172.21.15.146:0/2862780693 >> 172.21.15.146:0/2862780693 conn(0x55ab13cdadd0 msgr2=0x55ab13cdd1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:11.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.473+0000 7fc063e0f800 1 -- 172.21.15.146:0/2862780693 shutdown_connections 2024-09-18T01:47:11.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.473+0000 7fc063e0f800 1 -- 172.21.15.146:0/2862780693 wait complete. 2024-09-18T01:47:11.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.487+0000 7fc063e0f800 1 Processor -- start 2024-09-18T01:47:11.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.487+0000 7fc063e0f800 1 -- start start 2024-09-18T01:47:11.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.487+0000 7fc063e0f800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ab13cdf4e0 0x55ab13dd18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.487+0000 7fc063e0f800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55ab13c2c360 con 0x55ab13cdf4e0 2024-09-18T01:47:11.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.487+0000 7fc05f4e7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ab13cdf4e0 0x55ab13dd18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.487+0000 7fc05f4e7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ab13cdf4e0 0x55ab13dd18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37850/0 (socket says 172.21.15.146:37850) 2024-09-18T01:47:11.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.487+0000 7fc05f4e7640 1 -- 172.21.15.146:0/852067532 learned_addr learned my addr 172.21.15.146:0/852067532 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:11.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.487+0000 7fc05f4e7640 1 -- 172.21.15.146:0/852067532 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab13b79bc0 con 0x55ab13cdf4e0 2024-09-18T01:47:11.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.487+0000 7fc05f4e7640 1 --2- 172.21.15.146:0/852067532 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ab13cdf4e0 0x55ab13dd18a0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fc05000b240 tx=0x7fc05000b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab16454dd9e9af3b server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.488+0000 7fbf4d60a640 1 -- 172.21.15.146:0/852067532 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc050008070 con 0x55ab13cdf4e0 2024-09-18T01:47:11.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.488+0000 7fbf4d60a640 1 -- 172.21.15.146:0/852067532 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc05000d500 con 0x55ab13cdf4e0 2024-09-18T01:47:11.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.488+0000 7fbf4d60a640 1 -- 172.21.15.146:0/852067532 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc05000d860 con 0x55ab13cdf4e0 2024-09-18T01:47:11.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.488+0000 7fc063e0f800 1 -- 172.21.15.146:0/852067532 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ab13cdf4e0 msgr2=0x55ab13dd18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.488+0000 7fc063e0f800 1 --2- 172.21.15.146:0/852067532 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ab13cdf4e0 0x55ab13dd18a0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fc05000b240 tx=0x7fc05000b700 comp rx=0 tx=0).stop 2024-09-18T01:47:11.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.488+0000 7fc063e0f800 1 -- 172.21.15.146:0/852067532 shutdown_connections 2024-09-18T01:47:11.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.488+0000 7fc063e0f800 1 --2- 172.21.15.146:0/852067532 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ab13cdf4e0 0x55ab13dd18a0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.488+0000 7fc063e0f800 1 -- 172.21.15.146:0/852067532 >> 172.21.15.146:0/852067532 conn(0x55ab13cdadd0 msgr2=0x55ab13dc8e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:11.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.488+0000 7fc063e0f800 1 -- 172.21.15.146:0/852067532 shutdown_connections 2024-09-18T01:47:11.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.488+0000 7fc063e0f800 1 -- 172.21.15.146:0/852067532 wait complete. 2024-09-18T01:47:11.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.489+0000 7fc063e0f800 1 Processor -- start 2024-09-18T01:47:11.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.489+0000 7fc063e0f800 1 -- start start 2024-09-18T01:47:11.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.489+0000 7fc063e0f800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ab13cdf4e0 0x55ab13dd9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.489+0000 7fc063e0f800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55ab13ce6550 con 0x55ab13cdf4e0 2024-09-18T01:47:11.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.489+0000 7fc05f4e7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ab13cdf4e0 0x55ab13dd9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.489+0000 7fc05f4e7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ab13cdf4e0 0x55ab13dd9320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37858/0 (socket says 172.21.15.146:37858) 2024-09-18T01:47:11.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.489+0000 7fc05f4e7640 1 -- 172.21.15.146:0/3730454504 learned_addr learned my addr 172.21.15.146:0/3730454504 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:11.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.489+0000 7fc05f4e7640 1 -- 172.21.15.146:0/3730454504 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab13b8dfe0 con 0x55ab13cdf4e0 2024-09-18T01:47:11.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.490+0000 7fc05f4e7640 1 --2- 172.21.15.146:0/3730454504 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ab13cdf4e0 0x55ab13dd9320 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x55ab13dd2700 tx=0x7fc050000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.490+0000 7fbf4be07640 1 -- 172.21.15.146:0/3730454504 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc050019870 con 0x55ab13cdf4e0 2024-09-18T01:47:11.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.490+0000 7fbf4be07640 1 -- 172.21.15.146:0/3730454504 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc050019a10 con 0x55ab13cdf4e0 2024-09-18T01:47:11.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.490+0000 7fc063e0f800 1 -- 172.21.15.146:0/3730454504 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ab13dd9860 con 0x55ab13cdf4e0 2024-09-18T01:47:11.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.490+0000 7fbf4be07640 1 -- 172.21.15.146:0/3730454504 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc050019d30 con 0x55ab13cdf4e0 2024-09-18T01:47:11.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.490+0000 7fc063e0f800 1 -- 172.21.15.146:0/3730454504 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab13dd9d80 con 0x55ab13cdf4e0 2024-09-18T01:47:11.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.490+0000 7fbf4be07640 1 -- 172.21.15.146:0/3730454504 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc050017040 con 0x55ab13cdf4e0 2024-09-18T01:47:11.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.491+0000 7fbf4be07640 1 --2- 172.21.15.146:0/3730454504 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fbf44036b90 0x7fbf44039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.491+0000 7fbf4be07640 1 -- 172.21.15.146:0/3730454504 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7fc050015020 con 0x55ab13cdf4e0 2024-09-18T01:47:11.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.491+0000 7fc05ece6640 1 --2- 172.21.15.146:0/3730454504 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fbf44036b90 0x7fbf44039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.491+0000 7fc063e0f800 1 --2- 172.21.15.146:0/3730454504 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55ab13ce3920 0x55ab13de0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.491+0000 7fc063e0f800 1 -- 172.21.15.146:0/3730454504 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ab13de0910 con 0x55ab13ce3920 2024-09-18T01:47:11.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.491+0000 7fc05fce8640 1 --2- 172.21.15.146:0/3730454504 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55ab13ce3920 0x55ab13de0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.491+0000 7fc05ece6640 1 --2- 172.21.15.146:0/3730454504 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fbf44036b90 0x7fbf44039050 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc054057000 tx=0x7fc054052000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.491+0000 7fc05fce8640 1 --2- 172.21.15.146:0/3730454504 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55ab13ce3920 0x55ab13de0390 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.492+0000 7fc05fce8640 1 -- 172.21.15.146:0/3730454504 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc05800a4a0 con 0x55ab13ce3920 2024-09-18T01:47:11.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.492+0000 7fc063e0f800 1 -- 172.21.15.146:0/3730454504 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ab13ddd960 con 0x55ab13ce3920 2024-09-18T01:47:11.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.492+0000 7fc05fce8640 1 -- 172.21.15.146:0/3730454504 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc05800a4a0 con 0x55ab13ce3920 2024-09-18T01:47:11.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.492+0000 7fc063e0f800 1 -- 172.21.15.146:0/3730454504 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ab13de2730 con 0x55ab13ce3920 2024-09-18T01:47:11.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.492+0000 7fc05fce8640 1 -- 172.21.15.146:0/3730454504 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc05800a4a0 con 0x55ab13ce3920 2024-09-18T01:47:11.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.492+0000 7fc063e0f800 1 -- 172.21.15.146:0/3730454504 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ab13de1870 con 0x55ab13ce3920 2024-09-18T01:47:11.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.492+0000 7fc05fce8640 1 -- 172.21.15.146:0/3730454504 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc05800a4a0 con 0x55ab13ce3920 2024-09-18T01:47:11.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.492+0000 7fc063e0f800 1 --2- 172.21.15.146:0/3730454504 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55ab13de2340 0x55ab13de5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.492+0000 7fc063e0f800 1 -- 172.21.15.146:0/3730454504 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ab13de6310 con 0x55ab13de2340 2024-09-18T01:47:11.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.493+0000 7fc05f4e7640 1 --2- 172.21.15.146:0/3730454504 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55ab13de2340 0x55ab13de5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.493+0000 7fc05f4e7640 1 --2- 172.21.15.146:0/3730454504 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55ab13de2340 0x55ab13de5b80 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.493+0000 7fc05f4e7640 1 -- 172.21.15.146:0/3730454504 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc05002d070 con 0x55ab13de2340 2024-09-18T01:47:11.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.493+0000 7fc063e0f800 1 Processor -- start 2024-09-18T01:47:11.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.493+0000 7fc063e0f800 1 -- start start 2024-09-18T01:47:11.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.494+0000 7fc063e0f800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ab13df40a0 0x55ab13df44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.494+0000 7fc063e0f800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55ab13b7b580 con 0x55ab13df40a0 2024-09-18T01:47:11.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.494+0000 7fc05fce8640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ab13df40a0 0x55ab13df44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.494+0000 7fc05fce8640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ab13df40a0 0x55ab13df44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37872/0 (socket says 172.21.15.146:37872) 2024-09-18T01:47:11.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.494+0000 7fc05fce8640 1 -- 172.21.15.146:0/2350964252 learned_addr learned my addr 172.21.15.146:0/2350964252 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:11.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.494+0000 7fc05fce8640 1 -- 172.21.15.146:0/2350964252 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab13df4a00 con 0x55ab13df40a0 2024-09-18T01:47:11.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.494+0000 7fc05fce8640 1 --2- 172.21.15.146:0/2350964252 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ab13df40a0 0x55ab13df44c0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x55ab13de0cf0 tx=0x7fc0580178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.494+0000 7fbf49602640 1 -- 172.21.15.146:0/2350964252 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc058013440 con 0x55ab13df40a0 2024-09-18T01:47:11.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.494+0000 7fbf49602640 1 -- 172.21.15.146:0/2350964252 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0580135e0 con 0x55ab13df40a0 2024-09-18T01:47:11.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.494+0000 7fc063e0f800 1 -- 172.21.15.146:0/2350964252 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ab13df4c90 con 0x55ab13df40a0 2024-09-18T01:47:11.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.494+0000 7fbf49602640 1 -- 172.21.15.146:0/2350964252 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0580138c0 con 0x55ab13df40a0 2024-09-18T01:47:11.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.494+0000 7fc063e0f800 1 -- 172.21.15.146:0/2350964252 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab13df7970 con 0x55ab13df40a0 2024-09-18T01:47:11.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.495+0000 7fbf49602640 1 -- 172.21.15.146:0/2350964252 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc058011040 con 0x55ab13df40a0 2024-09-18T01:47:11.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.495+0000 7fbf49602640 1 --2- 172.21.15.146:0/2350964252 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fbf38036b90 0x7fbf38039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.495+0000 7fbf49602640 1 -- 172.21.15.146:0/2350964252 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7fc05801d070 con 0x55ab13df40a0 2024-09-18T01:47:11.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.495+0000 7fc05f4e7640 1 --2- 172.21.15.146:0/2350964252 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fbf38036b90 0x7fbf38039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.496+0000 7fc063e0f800 1 Processor -- start 2024-09-18T01:47:11.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.496+0000 7fc05f4e7640 1 --2- 172.21.15.146:0/2350964252 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fbf38036b90 0x7fbf38039050 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc050001630 tx=0x7fc05004b640 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.496+0000 7fc063e0f800 1 -- start start 2024-09-18T01:47:11.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.496+0000 7fc063e0f800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ab13e00d70 0x55ab13e01170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.496+0000 7fc063e0f800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55ab13dd2050 con 0x55ab13e00d70 2024-09-18T01:47:11.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.496+0000 7fc05fce8640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ab13e00d70 0x55ab13e01170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.496+0000 7fc05fce8640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ab13e00d70 0x55ab13e01170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37888/0 (socket says 172.21.15.146:37888) 2024-09-18T01:47:11.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.496+0000 7fc05fce8640 1 -- 172.21.15.146:0/1171263510 learned_addr learned my addr 172.21.15.146:0/1171263510 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:11.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.496+0000 7fc05fce8640 1 -- 172.21.15.146:0/1171263510 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab13e01740 con 0x55ab13e00d70 2024-09-18T01:47:11.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.496+0000 7fc05fce8640 1 --2- 172.21.15.146:0/1171263510 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ab13e00d70 0x55ab13e01170 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fc05804c860 tx=0x7fc058001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e8d0c21a1fc5fd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.497+0000 7fbf42ffd640 1 -- 172.21.15.146:0/1171263510 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc058012c90 con 0x55ab13e00d70 2024-09-18T01:47:11.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.497+0000 7fbf42ffd640 1 -- 172.21.15.146:0/1171263510 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc058012e30 con 0x55ab13e00d70 2024-09-18T01:47:11.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.497+0000 7fbf42ffd640 1 -- 172.21.15.146:0/1171263510 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0580123a0 con 0x55ab13e00d70 2024-09-18T01:47:11.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.497+0000 7fc063e0f800 1 -- 172.21.15.146:0/1171263510 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ab13e00d70 msgr2=0x55ab13e01170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.497+0000 7fc063e0f800 1 --2- 172.21.15.146:0/1171263510 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ab13e00d70 0x55ab13e01170 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fc05804c860 tx=0x7fc058001ab0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.497+0000 7fc063e0f800 1 -- 172.21.15.146:0/1171263510 shutdown_connections 2024-09-18T01:47:11.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.497+0000 7fc063e0f800 1 --2- 172.21.15.146:0/1171263510 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ab13e00d70 0x55ab13e01170 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.497+0000 7fc063e0f800 1 -- 172.21.15.146:0/1171263510 >> 172.21.15.146:0/1171263510 conn(0x55ab13dfd0d0 msgr2=0x55ab13dfb1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:11.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.497+0000 7fc063e0f800 1 -- 172.21.15.146:0/1171263510 shutdown_connections 2024-09-18T01:47:11.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.497+0000 7fc063e0f800 1 -- 172.21.15.146:0/1171263510 wait complete. 2024-09-18T01:47:11.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.497+0000 7fc063e0f800 1 Processor -- start 2024-09-18T01:47:11.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.497+0000 7fc063e0f800 1 -- start start 2024-09-18T01:47:11.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.497+0000 7fc063e0f800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ab13e00d70 0x55ab13e08190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.497+0000 7fc063e0f800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55ab13e01c90 con 0x55ab13e00d70 2024-09-18T01:47:11.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.498+0000 7fc05fce8640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ab13e00d70 0x55ab13e08190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.498+0000 7fc05fce8640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ab13e00d70 0x55ab13e08190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37894/0 (socket says 172.21.15.146:37894) 2024-09-18T01:47:11.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.498+0000 7fc05fce8640 1 -- 172.21.15.146:0/1105429427 learned_addr learned my addr 172.21.15.146:0/1105429427 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:11.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.498+0000 7fc05fce8640 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab13e086d0 con 0x55ab13e00d70 2024-09-18T01:47:11.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.498+0000 7fc05fce8640 1 --2- 172.21.15.146:0/1105429427 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ab13e00d70 0x55ab13e08190 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fc05804c860 tx=0x7fc05804c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.498+0000 7fbf417fa640 1 -- 172.21.15.146:0/1105429427 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc05804b240 con 0x55ab13e00d70 2024-09-18T01:47:11.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.498+0000 7fbf417fa640 1 -- 172.21.15.146:0/1105429427 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc05804b3e0 con 0x55ab13e00d70 2024-09-18T01:47:11.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.498+0000 7fc063e0f800 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ab13e08960 con 0x55ab13e00d70 2024-09-18T01:47:11.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.498+0000 7fbf417fa640 1 -- 172.21.15.146:0/1105429427 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc058013a60 con 0x55ab13e00d70 2024-09-18T01:47:11.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.498+0000 7fc063e0f800 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab13e0b610 con 0x55ab13e00d70 2024-09-18T01:47:11.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.499+0000 7fbf417fa640 1 -- 172.21.15.146:0/1105429427 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc058013c00 con 0x55ab13e00d70 2024-09-18T01:47:11.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.499+0000 7fbf417fa640 1 --2- 172.21.15.146:0/1105429427 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fbf28036b40 0x7fbf28039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.499+0000 7fbf417fa640 1 -- 172.21.15.146:0/1105429427 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7fc058033030 con 0x55ab13e00d70 2024-09-18T01:47:11.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.499+0000 7fc05f4e7640 1 --2- 172.21.15.146:0/1105429427 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fbf28036b40 0x7fbf28039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.500+0000 7fc05f4e7640 1 --2- 172.21.15.146:0/1105429427 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fbf28036b40 0x7fbf28039000 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc05000bc50 tx=0x7fc050033000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.500+0000 7fc063e0f800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.500+0000 7fc063e0f800 1 --2- 172.21.15.146:0/1105429427 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55ab13e13cc0 0x55ab13e16180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.500+0000 7fc063e0f800 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ab13e168d0 con 0x55ab13e13cc0 2024-09-18T01:47:11.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.500+0000 7fc05ece6640 1 --2- 172.21.15.146:0/1105429427 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55ab13e13cc0 0x55ab13e16180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.500+0000 7fc05ece6640 1 --2- 172.21.15.146:0/1105429427 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55ab13e13cc0 0x55ab13e16180 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.500+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc054057030 con 0x55ab13e13cc0 2024-09-18T01:47:11.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.501+0000 7fc063e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:11.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.501+0000 7fc063e0f800 20 realm 2024-09-18T01:47:11.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.501+0000 7fc063e0f800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.501+0000 7fc063e0f800 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ab13e16d00 con 0x55ab13e13cc0 2024-09-18T01:47:11.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.501+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc054057030 con 0x55ab13e13cc0 2024-09-18T01:47:11.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.501+0000 7fc063e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:11.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.501+0000 7fc063e0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:47:11.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.501+0000 7fc063e0f800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.501+0000 7fc063e0f800 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ab13e175d0 con 0x55ab13e13cc0 2024-09-18T01:47:11.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.501+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc054057030 con 0x55ab13e13cc0 2024-09-18T01:47:11.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.501+0000 7fc063e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:11.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.501+0000 7fc063e0f800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.501+0000 7fc063e0f800 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ab13e17970 con 0x55ab13e13cc0 2024-09-18T01:47:11.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.501+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc054057030 con 0x55ab13e13cc0 2024-09-18T01:47:11.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.501+0000 7fc063e0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:47:11.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.501+0000 7fc063e0f800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.501+0000 7fc063e0f800 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ab13e181c0 con 0x55ab13e13cc0 2024-09-18T01:47:11.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.501+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc054057030 con 0x55ab13e13cc0 2024-09-18T01:47:11.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.501+0000 7fc063e0f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:47:11.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.501+0000 7fc063e0f800 20 searching for the correct realm 2024-09-18T01:47:11.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.502+0000 7fc063e0f800 1 --2- 172.21.15.146:0/1105429427 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55ab13e19f30 0x55ab13e1c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.502+0000 7fc063e0f800 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ab13e1c950 con 0x55ab13e19f30 2024-09-18T01:47:11.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.502+0000 7fc05fce8640 1 --2- 172.21.15.146:0/1105429427 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55ab13e19f30 0x55ab13e1c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.502+0000 7fc05fce8640 1 --2- 172.21.15.146:0/1105429427 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55ab13e19f30 0x55ab13e1c320 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.502+0000 7fc05fce8640 1 -- 172.21.15.146:0/1105429427 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc058029070 con 0x55ab13e19f30 2024-09-18T01:47:11.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.502+0000 7fc05fce8640 1 --2- 172.21.15.146:0/1105429427 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fc058022420 0x7fc05802c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.502+0000 7fc05fce8640 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ab13e1c950 con 0x7fc058022420 2024-09-18T01:47:11.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.502+0000 7fc05f4e7640 1 --2- 172.21.15.146:0/1105429427 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fc058022420 0x7fc05802c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.503+0000 7fc05f4e7640 1 --2- 172.21.15.146:0/1105429427 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fc058022420 0x7fc05802c960 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.503+0000 7fc05f4e7640 1 -- 172.21.15.146:0/1105429427 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc05002d070 con 0x7fc058022420 2024-09-18T01:47:11.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.503+0000 7fc05f4e7640 1 --2- 172.21.15.146:0/1105429427 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fc050018810 0x7fc05003f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.503+0000 7fc05f4e7640 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ab13e1c950 con 0x7fc050018810 2024-09-18T01:47:11.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.503+0000 7fc05ece6640 1 --2- 172.21.15.146:0/1105429427 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fc050018810 0x7fc05003f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.504+0000 7fc05ece6640 1 --2- 172.21.15.146:0/1105429427 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fc050018810 0x7fc05003f1e0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.504+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc054057030 con 0x7fc050018810 2024-09-18T01:47:11.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.504+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ab13e1c950 con 0x55ab13e13cc0 2024-09-18T01:47:11.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.504+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v33'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc054057030 con 0x55ab13e13cc0 2024-09-18T01:47:11.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.504+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ab13e1c950 con 0x55ab13e13cc0 2024-09-18T01:47:11.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.504+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc054057030 con 0x55ab13e13cc0 2024-09-18T01:47:11.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.504+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ab13e1c950 con 0x7fc050018810 2024-09-18T01:47:11.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.504+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc054057030 con 0x7fc050018810 2024-09-18T01:47:11.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.504+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ab13e1c950 con 0x7fc050018810 2024-09-18T01:47:11.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.505+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc054057030 con 0x7fc050018810 2024-09-18T01:47:11.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.505+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ab13e1c950 con 0x7fc058022420 2024-09-18T01:47:11.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.505+0000 7fc05f4e7640 1 -- 172.21.15.146:0/1105429427 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc05002d070 con 0x7fc058022420 2024-09-18T01:47:11.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.505+0000 7fc05f4e7640 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ab13e1c950 con 0x55ab13e19f30 2024-09-18T01:47:11.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.505+0000 7fc05fce8640 1 -- 172.21.15.146:0/1105429427 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc058029070 con 0x55ab13e19f30 2024-09-18T01:47:11.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.505+0000 7fc05fce8640 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ab13e1c950 con 0x55ab13e13cc0 2024-09-18T01:47:11.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.505+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc054057030 con 0x55ab13e13cc0 2024-09-18T01:47:11.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.505+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ab13e1c950 con 0x7fc050018810 2024-09-18T01:47:11.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.506+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc054057030 con 0x7fc050018810 2024-09-18T01:47:11.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.506+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ab13e1c950 con 0x55ab13e13cc0 2024-09-18T01:47:11.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.506+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc054057030 con 0x55ab13e13cc0 2024-09-18T01:47:11.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.506+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ab13e1c950 con 0x7fc058022420 2024-09-18T01:47:11.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.506+0000 7fc05f4e7640 1 -- 172.21.15.146:0/1105429427 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fc05002d070 con 0x7fc058022420 2024-09-18T01:47:11.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.506+0000 7fc05f4e7640 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fc05005a0a0 con 0x55ab13e19f30 2024-09-18T01:47:11.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.506+0000 7fc05fce8640 1 -- 172.21.15.146:0/1105429427 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc058029070 con 0x55ab13e19f30 2024-09-18T01:47:11.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.506+0000 7fc05fce8640 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fc05005a0a0 con 0x55ab13e19f30 2024-09-18T01:47:11.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.506+0000 7fc05fce8640 1 -- 172.21.15.146:0/1105429427 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc058029070 con 0x55ab13e19f30 2024-09-18T01:47:11.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.506+0000 7fc05fce8640 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fc05005a0a0 con 0x7fc050018810 2024-09-18T01:47:11.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.507+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc054057030 con 0x7fc050018810 2024-09-18T01:47:11.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.507+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fc05005a0a0 con 0x55ab13e19f30 2024-09-18T01:47:11.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.507+0000 7fc05fce8640 1 -- 172.21.15.146:0/1105429427 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc058029070 con 0x55ab13e19f30 2024-09-18T01:47:11.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.507+0000 7fc05fce8640 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fc05005a0a0 con 0x55ab13e19f30 2024-09-18T01:47:11.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.507+0000 7fc05fce8640 1 -- 172.21.15.146:0/1105429427 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc058029070 con 0x55ab13e19f30 2024-09-18T01:47:11.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.507+0000 7fc05fce8640 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fc05005a0a0 con 0x55ab13e13cc0 2024-09-18T01:47:11.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.507+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc054057030 con 0x55ab13e13cc0 2024-09-18T01:47:11.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.507+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fc05005a0a0 con 0x55ab13e13cc0 2024-09-18T01:47:11.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.508+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v33'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc054057030 con 0x55ab13e13cc0 2024-09-18T01:47:11.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.508+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fc05005a0a0 con 0x7fc050018810 2024-09-18T01:47:11.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.508+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc054057030 con 0x7fc050018810 2024-09-18T01:47:11.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.508+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fc05005a0a0 con 0x55ab13e19f30 2024-09-18T01:47:11.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.508+0000 7fc05fce8640 1 -- 172.21.15.146:0/1105429427 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc058029070 con 0x55ab13e19f30 2024-09-18T01:47:11.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.508+0000 7fc05fce8640 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fc05005a0a0 con 0x7fc058022420 2024-09-18T01:47:11.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.508+0000 7fc05f4e7640 1 -- 172.21.15.146:0/1105429427 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc05002d070 con 0x7fc058022420 2024-09-18T01:47:11.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.508+0000 7fc05f4e7640 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fc05005a0a0 con 0x55ab13e13cc0 2024-09-18T01:47:11.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.509+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc054057030 con 0x55ab13e13cc0 2024-09-18T01:47:11.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.509+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fc05005a0a0 con 0x7fc050018810 2024-09-18T01:47:11.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.509+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc054057030 con 0x7fc050018810 2024-09-18T01:47:11.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.509+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fc05005a0a0 con 0x55ab13e19f30 2024-09-18T01:47:11.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.509+0000 7fc05fce8640 1 -- 172.21.15.146:0/1105429427 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc058029070 con 0x55ab13e19f30 2024-09-18T01:47:11.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.509+0000 7fc05fce8640 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fc05005a0a0 con 0x7fc050018810 2024-09-18T01:47:11.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.509+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc054057030 con 0x7fc050018810 2024-09-18T01:47:11.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.509+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fc05005a0a0 con 0x7fc058022420 2024-09-18T01:47:11.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.510+0000 7fc05f4e7640 1 -- 172.21.15.146:0/1105429427 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc05002d070 con 0x7fc058022420 2024-09-18T01:47:11.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.510+0000 7fc05f4e7640 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fc05005a0a0 con 0x55ab13e19f30 2024-09-18T01:47:11.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.510+0000 7fc05fce8640 1 -- 172.21.15.146:0/1105429427 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc058029070 con 0x55ab13e19f30 2024-09-18T01:47:11.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.510+0000 7fc05fce8640 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fc05005a0a0 con 0x7fc050018810 2024-09-18T01:47:11.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.510+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc054057030 con 0x7fc050018810 2024-09-18T01:47:11.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.510+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fc05005a0a0 con 0x55ab13e13cc0 2024-09-18T01:47:11.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.510+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v33'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc054057030 con 0x55ab13e13cc0 2024-09-18T01:47:11.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.510+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fc05005a0a0 con 0x7fc058022420 2024-09-18T01:47:11.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.511+0000 7fc05f4e7640 1 -- 172.21.15.146:0/1105429427 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc05002d070 con 0x7fc058022420 2024-09-18T01:47:11.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.511+0000 7fc063e0f800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:47:11.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.511+0000 7fc063e0f800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:47:11.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.511+0000 7fc063e0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:47:11.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.511+0000 7fc063e0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:47:11.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.511+0000 7fc063e0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:47:11.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.511+0000 7fc063e0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:47:11.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.511+0000 7fc063e0f800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.511+0000 7fc063e0f800 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ab13e18b40 con 0x55ab13e13cc0 2024-09-18T01:47:11.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.511+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc054057030 con 0x55ab13e13cc0 2024-09-18T01:47:11.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.511+0000 7fc063e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:11.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.511+0000 7fc063e0f800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.511+0000 7fc063e0f800 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ab13e193e0 con 0x55ab13e13cc0 2024-09-18T01:47:11.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.511+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc054057030 con 0x55ab13e13cc0 2024-09-18T01:47:11.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.511+0000 7fc063e0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:47:11.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.511+0000 7fc063e0f800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.511+0000 7fc063e0f800 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ab13e1cdd0 con 0x7fc058022420 2024-09-18T01:47:11.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.511+0000 7fc05f4e7640 1 -- 172.21.15.146:0/1105429427 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc05002d070 con 0x7fc058022420 2024-09-18T01:47:11.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.511+0000 7fc063e0f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:47:11.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.511+0000 7fc063e0f800 20 zone default found 2024-09-18T01:47:11.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.511+0000 7fc063e0f800 4 Realm: () 2024-09-18T01:47:11.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.511+0000 7fc063e0f800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:47:11.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.511+0000 7fc063e0f800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:47:11.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.511+0000 7fc063e0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:47:11.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.511+0000 7fc063e0f800 20 zonegroup default 2024-09-18T01:47:11.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.511+0000 7fc063e0f800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.511+0000 7fc063e0f800 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ab13e1d620 con 0x7fc050018810 2024-09-18T01:47:11.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.512+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc054057030 con 0x7fc050018810 2024-09-18T01:47:11.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.512+0000 7fc063e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:11.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.512+0000 7fc063e0f800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.512+0000 7fc063e0f800 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ab13e1f000 con 0x55ab13e19f30 2024-09-18T01:47:11.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.512+0000 7fc05fce8640 1 -- 172.21.15.146:0/1105429427 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc058029070 con 0x55ab13e19f30 2024-09-18T01:47:11.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.512+0000 7fc063e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:11.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.512+0000 7fc063e0f800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.512+0000 7fc063e0f800 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ab13e1f480 con 0x55ab13e19f30 2024-09-18T01:47:11.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.512+0000 7fc05fce8640 1 -- 172.21.15.146:0/1105429427 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc058029070 con 0x55ab13e19f30 2024-09-18T01:47:11.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.512+0000 7fc063e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:11.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.512+0000 7fc063e0f800 20 started sync module instance, tier type = 2024-09-18T01:47:11.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.512+0000 7fc063e0f800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:47:11.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.512+0000 7fc063e0f800 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ab13e1e490 con 0x7fc058022420 2024-09-18T01:47:11.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.513+0000 7fc05f4e7640 1 -- 172.21.15.146:0/1105429427 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v33'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc05002d070 con 0x7fc058022420 2024-09-18T01:47:11.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.513+0000 7fc063e0f800 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94193261340800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ab13e1fd90 con 0x7fc058022420 2024-09-18T01:47:11.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.513+0000 7fc063e0f800 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ab13e205e0 con 0x55ab13e13cc0 2024-09-18T01:47:11.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.514+0000 7fc05f4e7640 1 -- 172.21.15.146:0/1105429427 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94193261340800] v33'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc05002d070 con 0x7fc058022420 2024-09-18T01:47:11.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.515+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v33'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc054057030 con 0x55ab13e13cc0 2024-09-18T01:47:11.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.515+0000 7fc063e0f800 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94193261344992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ab13e205e0 con 0x55ab13e13cc0 2024-09-18T01:47:11.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.515+0000 7fc063e0f800 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ab13e21100 con 0x55ab13e19f30 2024-09-18T01:47:11.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.516+0000 7fc05fce8640 1 -- 172.21.15.146:0/1105429427 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v33'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc058029070 con 0x55ab13e19f30 2024-09-18T01:47:11.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.516+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94193261344992] v33'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc054057030 con 0x55ab13e13cc0 2024-09-18T01:47:11.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.516+0000 7fc063e0f800 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94193261349840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ab13e219a0 con 0x55ab13e19f30 2024-09-18T01:47:11.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.516+0000 7fc063e0f800 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ab13e20130 con 0x7fc058022420 2024-09-18T01:47:11.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.517+0000 7fc05f4e7640 1 -- 172.21.15.146:0/1105429427 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v33'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc05002d070 con 0x7fc058022420 2024-09-18T01:47:11.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.517+0000 7fc05fce8640 1 -- 172.21.15.146:0/1105429427 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94193261349840] v33'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc058029070 con 0x55ab13e19f30 2024-09-18T01:47:11.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.517+0000 7fc063e0f800 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94193261352176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ab13e22410 con 0x7fc058022420 2024-09-18T01:47:11.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.517+0000 7fc063e0f800 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ab13e22dd0 con 0x55ab13e13cc0 2024-09-18T01:47:11.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.518+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v33'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc054057030 con 0x55ab13e13cc0 2024-09-18T01:47:11.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.518+0000 7fc063e0f800 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94193261357344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ab13e22da0 con 0x55ab13e13cc0 2024-09-18T01:47:11.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.518+0000 7fc063e0f800 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ab13e23dc0 con 0x7fc050018810 2024-09-18T01:47:11.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.518+0000 7fc05f4e7640 1 -- 172.21.15.146:0/1105429427 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94193261352176] v33'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc05002d070 con 0x7fc058022420 2024-09-18T01:47:11.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.519+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v33'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc054057030 con 0x7fc050018810 2024-09-18T01:47:11.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.519+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94193261357344] v33'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc054057030 con 0x55ab13e13cc0 2024-09-18T01:47:11.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.519+0000 7fc063e0f800 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94193261361296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ab13e23d80 con 0x7fc050018810 2024-09-18T01:47:11.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.519+0000 7fc063e0f800 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ab13e231c0 con 0x7fc050018810 2024-09-18T01:47:11.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.520+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94193261361296] v33'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc054057030 con 0x7fc050018810 2024-09-18T01:47:11.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.520+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v33'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc054057030 con 0x7fc050018810 2024-09-18T01:47:11.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.520+0000 7fc063e0f800 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94193261354848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ab13e24320 con 0x7fc050018810 2024-09-18T01:47:11.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.520+0000 7fc063e0f800 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ab13e24bf0 con 0x7fc050018810 2024-09-18T01:47:11.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.521+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94193261354848] v33'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc054057030 con 0x7fc050018810 2024-09-18T01:47:11.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.521+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v33'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc054057030 con 0x7fc050018810 2024-09-18T01:47:11.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.521+0000 7fc063e0f800 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94193261359552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ab13e24dd0 con 0x7fc050018810 2024-09-18T01:47:11.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.521+0000 7fc063e0f800 20 add_watcher() i=0 2024-09-18T01:47:11.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.521+0000 7fc063e0f800 20 add_watcher() i=1 2024-09-18T01:47:11.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.521+0000 7fc063e0f800 20 add_watcher() i=2 2024-09-18T01:47:11.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.521+0000 7fc063e0f800 20 add_watcher() i=3 2024-09-18T01:47:11.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.521+0000 7fc063e0f800 20 add_watcher() i=4 2024-09-18T01:47:11.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.521+0000 7fc063e0f800 20 add_watcher() i=5 2024-09-18T01:47:11.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.521+0000 7fc063e0f800 20 add_watcher() i=6 2024-09-18T01:47:11.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.522+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94193261359552] v33'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc054057030 con 0x7fc050018810 2024-09-18T01:47:11.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.522+0000 7fc063e0f800 20 add_watcher() i=7 2024-09-18T01:47:11.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.522+0000 7fc063e0f800 2 all 8 watchers are set, enabling cache 2024-09-18T01:47:11.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.522+0000 7fc063e0f800 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ab13e281a0 con 0x55ab13e13cc0 2024-09-18T01:47:11.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.522+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc054057030 con 0x55ab13e13cc0 2024-09-18T01:47:11.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.522+0000 7fc063e0f800 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94193261366464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ab13e25590 con 0x55ab13e13cc0 2024-09-18T01:47:11.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.523+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94193261366464] v33'273 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc054057030 con 0x55ab13e13cc0 2024-09-18T01:47:11.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.524+0000 7fbf15fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:47:11.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.524+0000 7fc063e0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:47:11.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.524+0000 7fc063e0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:47:11.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.524+0000 7fc063e0f800 5 note: GC not initialized 2024-09-18T01:47:11.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.524+0000 7fbf14fe1640 20 reqs_thread_entry: start 2024-09-18T01:47:11.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.524+0000 7fc063e0f800 20 init_complete bucket index max shards: 11 2024-09-18T01:47:11.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.524+0000 7fc063e0f800 20 Filter name: none 2024-09-18T01:47:11.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.524+0000 7fbe8e7fc640 20 reqs_thread_entry: start 2024-09-18T01:47:11.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.524+0000 7fc063e0f800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-18T01:47:11.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.524+0000 7fc063e0f800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.524+0000 7fc063e0f800 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ab13e5b380 con 0x7fc050018810 2024-09-18T01:47:11.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.528+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7fc054057030 con 0x7fc050018810 2024-09-18T01:47:11.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.528+0000 7fc063e0f800 20 rados_obj.operate() r=0 bl.length=490 2024-09-18T01:47:11.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.528+0000 7fc063e0f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-18T01:47:11.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.528+0000 7fc063e0f800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:47:11.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.528+0000 7fc063e0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:47:11.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.528+0000 7fc063e0f800 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ab13e61b60 con 0x7fc050018810 2024-09-18T01:47:11.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.530+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v33'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fc054057030 con 0x7fc050018810 2024-09-18T01:47:11.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.530+0000 7fc063e0f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T01:47:11.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.530+0000 7fc063e0f800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:47:11.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.530+0000 7fc063e0f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-18T01:47:11.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.530+0000 7fc063e0f800 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94193261614368 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ab13e5d180 con 0x55ab13e13cc0 2024-09-18T01:47:11.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.530+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== watch-notify(notify (1) cookie 94193261357344 notify 141733920801 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7fc054076040 con 0x55ab13e13cc0 2024-09-18T01:47:11.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.530+0000 7fbf42ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920801 cookie 94193261357344 notifier 4915 bl.length()=636 2024-09-18T01:47:11.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.530+0000 7fbf42ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T01:47:11.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.530+0000 7fbf42ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:47:11.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.530+0000 7fbf42ffd640 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fbf24003ea0 con 0x55ab13e13cc0 2024-09-18T01:47:11.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.530+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(64 notify.4 [notify cookie 94193261614368 out=8b] v0'0 uv273 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc054057030 con 0x55ab13e13cc0 2024-09-18T01:47:11.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.530+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc054057030 con 0x55ab13e13cc0 2024-09-18T01:47:11.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.531+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== watch-notify(notify_complete (2) cookie 94193261614368 notify 141733920801 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ab13ba7e00 con 0x55ab13e13cc0 2024-09-18T01:47:11.553 INFO:teuthology.orchestra.run.smithi146.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-18T01:47:09.882428Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:47:09.882414Z","tags":[],"group_ids":[]} 2024-09-18T01:47:11.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.531+0000 7fbf15fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:47:11.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.531+0000 7fc063e0f800 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94193261366464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ab13e590a0 con 0x55ab13e13cc0 2024-09-18T01:47:11.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.532+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94193261366464] v33'274 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc054057030 con 0x55ab13e13cc0 2024-09-18T01:47:11.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.532+0000 7fc063e0f800 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94193261340800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ab13e590a0 con 0x7fc058022420 2024-09-18T01:47:11.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.533+0000 7fc05f4e7640 1 -- 172.21.15.146:0/1105429427 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94193261340800] v33'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc05002d070 con 0x7fc058022420 2024-09-18T01:47:11.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.533+0000 7fc063e0f800 20 remove_watcher() i=0 2024-09-18T01:47:11.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.533+0000 7fc063e0f800 2 removed watcher, disabling cache 2024-09-18T01:47:11.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.533+0000 7fc063e0f800 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94193261344992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ab13e590a0 con 0x55ab13e13cc0 2024-09-18T01:47:11.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.535+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94193261344992] v33'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc054057030 con 0x55ab13e13cc0 2024-09-18T01:47:11.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.535+0000 7fc063e0f800 20 remove_watcher() i=1 2024-09-18T01:47:11.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.535+0000 7fc063e0f800 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94193261349840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ab13e590a0 con 0x55ab13e19f30 2024-09-18T01:47:11.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.536+0000 7fc05fce8640 1 -- 172.21.15.146:0/1105429427 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94193261349840] v33'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc058029070 con 0x55ab13e19f30 2024-09-18T01:47:11.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.536+0000 7fc063e0f800 20 remove_watcher() i=2 2024-09-18T01:47:11.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.536+0000 7fc063e0f800 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94193261352176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ab13e590a0 con 0x7fc058022420 2024-09-18T01:47:11.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.536+0000 7fc05f4e7640 1 -- 172.21.15.146:0/1105429427 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94193261352176] v33'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc05002d070 con 0x7fc058022420 2024-09-18T01:47:11.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.537+0000 7fc063e0f800 20 remove_watcher() i=3 2024-09-18T01:47:11.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.537+0000 7fc063e0f800 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94193261357344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ab13e590a0 con 0x55ab13e13cc0 2024-09-18T01:47:11.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.538+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 <== osd.1 v2:172.21.15.146:6808/3930274777 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94193261357344] v33'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc054057030 con 0x55ab13e13cc0 2024-09-18T01:47:11.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.538+0000 7fc063e0f800 20 remove_watcher() i=4 2024-09-18T01:47:11.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.538+0000 7fc063e0f800 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94193261361296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ab13e590a0 con 0x7fc050018810 2024-09-18T01:47:11.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.539+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94193261361296] v33'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc054057030 con 0x7fc050018810 2024-09-18T01:47:11.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.539+0000 7fc063e0f800 20 remove_watcher() i=5 2024-09-18T01:47:11.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.539+0000 7fc063e0f800 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94193261354848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ab13e590a0 con 0x7fc050018810 2024-09-18T01:47:11.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.540+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94193261354848] v33'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc054057030 con 0x7fc050018810 2024-09-18T01:47:11.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.540+0000 7fc063e0f800 20 remove_watcher() i=6 2024-09-18T01:47:11.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.540+0000 7fc063e0f800 1 -- 172.21.15.146:0/1105429427 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94193261359552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ab13e590a0 con 0x7fc050018810 2024-09-18T01:47:11.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.541+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94193261359552] v33'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc054057030 con 0x7fc050018810 2024-09-18T01:47:11.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.541+0000 7fc063e0f800 20 remove_watcher() i=7 2024-09-18T01:47:11.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.541+0000 7fc063e0f800 1 -- 172.21.15.146:0/1105429427 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fc050018810 msgr2=0x7fc05003f1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.541+0000 7fc063e0f800 1 --2- 172.21.15.146:0/1105429427 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fc050018810 0x7fc05003f1e0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.541+0000 7fc063e0f800 1 -- 172.21.15.146:0/1105429427 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55ab13e13cc0 msgr2=0x55ab13e16180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.541+0000 7fc063e0f800 1 --2- 172.21.15.146:0/1105429427 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55ab13e13cc0 0x55ab13e16180 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.541+0000 7fc063e0f800 1 -- 172.21.15.146:0/1105429427 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fc058022420 msgr2=0x7fc05802c960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.541+0000 7fc063e0f800 1 --2- 172.21.15.146:0/1105429427 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fc058022420 0x7fc05802c960 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.541+0000 7fc063e0f800 1 -- 172.21.15.146:0/1105429427 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55ab13e19f30 msgr2=0x55ab13e1c320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.541+0000 7fc063e0f800 1 --2- 172.21.15.146:0/1105429427 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55ab13e19f30 0x55ab13e1c320 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.541+0000 7fc063e0f800 1 -- 172.21.15.146:0/1105429427 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fbf28036b40 msgr2=0x7fbf28039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.541+0000 7fc063e0f800 1 --2- 172.21.15.146:0/1105429427 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fbf28036b40 0x7fbf28039000 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc05000bc50 tx=0x7fc050033000 comp rx=0 tx=0).stop 2024-09-18T01:47:11.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.541+0000 7fc063e0f800 1 -- 172.21.15.146:0/1105429427 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ab13e00d70 msgr2=0x55ab13e08190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.541+0000 7fc063e0f800 1 --2- 172.21.15.146:0/1105429427 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ab13e00d70 0x55ab13e08190 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fc05804c860 tx=0x7fc05804c7f0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.541+0000 7fc05ece6640 1 -- 172.21.15.146:0/1105429427 reap_dead start 2024-09-18T01:47:11.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.541+0000 7fc063e0f800 1 -- 172.21.15.146:0/1105429427 shutdown_connections 2024-09-18T01:47:11.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.541+0000 7fc063e0f800 1 --2- 172.21.15.146:0/1105429427 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ab13e00d70 0x55ab13e08190 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.541+0000 7fc063e0f800 1 -- 172.21.15.146:0/1105429427 >> 172.21.15.146:0/1105429427 conn(0x55ab13dfd0d0 msgr2=0x55ab13dfb1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:11.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.541+0000 7fc063e0f800 1 -- 172.21.15.146:0/1105429427 shutdown_connections 2024-09-18T01:47:11.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.541+0000 7fc063e0f800 1 -- 172.21.15.146:0/1105429427 wait complete. 2024-09-18T01:47:11.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.541+0000 7fc063e0f800 1 -- 172.21.15.146:0/2350964252 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fbf38036b90 msgr2=0x7fbf38039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.541+0000 7fc063e0f800 1 --2- 172.21.15.146:0/2350964252 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fbf38036b90 0x7fbf38039050 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc050001630 tx=0x7fc05004b640 comp rx=0 tx=0).stop 2024-09-18T01:47:11.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.541+0000 7fc063e0f800 1 -- 172.21.15.146:0/2350964252 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ab13df40a0 msgr2=0x55ab13df44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.541+0000 7fc063e0f800 1 --2- 172.21.15.146:0/2350964252 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ab13df40a0 0x55ab13df44c0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x55ab13de0cf0 tx=0x7fc0580178e0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.541+0000 7fc063e0f800 1 -- 172.21.15.146:0/2350964252 shutdown_connections 2024-09-18T01:47:11.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.541+0000 7fc063e0f800 1 --2- 172.21.15.146:0/2350964252 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fbf38036b90 0x7fbf38039050 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.541+0000 7fc063e0f800 1 --2- 172.21.15.146:0/2350964252 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ab13df40a0 0x55ab13df44c0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.541+0000 7fc063e0f800 1 -- 172.21.15.146:0/2350964252 >> 172.21.15.146:0/2350964252 conn(0x55ab13de9030 msgr2=0x55ab13debbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:11.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.541+0000 7fc063e0f800 1 -- 172.21.15.146:0/2350964252 shutdown_connections 2024-09-18T01:47:11.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.541+0000 7fc063e0f800 1 -- 172.21.15.146:0/2350964252 wait complete. 2024-09-18T01:47:11.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.542+0000 7fc063e0f800 1 -- 172.21.15.146:0/3730454504 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55ab13ce3920 msgr2=0x55ab13de0390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.542+0000 7fc063e0f800 1 --2- 172.21.15.146:0/3730454504 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55ab13ce3920 0x55ab13de0390 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.542+0000 7fc063e0f800 1 -- 172.21.15.146:0/3730454504 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55ab13de2340 msgr2=0x55ab13de5b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.542+0000 7fc063e0f800 1 --2- 172.21.15.146:0/3730454504 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55ab13de2340 0x55ab13de5b80 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.542+0000 7fc063e0f800 1 -- 172.21.15.146:0/3730454504 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fbf44036b90 msgr2=0x7fbf44039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.542+0000 7fc063e0f800 1 --2- 172.21.15.146:0/3730454504 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fbf44036b90 0x7fbf44039050 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc054057000 tx=0x7fc054052000 comp rx=0 tx=0).stop 2024-09-18T01:47:11.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.542+0000 7fc063e0f800 1 -- 172.21.15.146:0/3730454504 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ab13cdf4e0 msgr2=0x55ab13dd9320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.542+0000 7fc063e0f800 1 --2- 172.21.15.146:0/3730454504 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ab13cdf4e0 0x55ab13dd9320 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x55ab13dd2700 tx=0x7fc050000ed0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.542+0000 7fc063e0f800 1 -- 172.21.15.146:0/3730454504 shutdown_connections 2024-09-18T01:47:11.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.542+0000 7fc063e0f800 1 --2- 172.21.15.146:0/3730454504 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x55ab13de2340 0x55ab13de5b80 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.542+0000 7fc063e0f800 1 --2- 172.21.15.146:0/3730454504 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x55ab13ce3920 0x55ab13de0390 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.542+0000 7fc063e0f800 1 --2- 172.21.15.146:0/3730454504 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fbf44036b90 0x7fbf44039050 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.542+0000 7fc063e0f800 1 --2- 172.21.15.146:0/3730454504 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x55ab13cdf4e0 0x55ab13dd9320 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.542+0000 7fc063e0f800 1 -- 172.21.15.146:0/3730454504 >> 172.21.15.146:0/3730454504 conn(0x55ab13cdadd0 msgr2=0x55ab13dc77a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:11.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.542+0000 7fc063e0f800 1 -- 172.21.15.146:0/3730454504 shutdown_connections 2024-09-18T01:47:11.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.542+0000 7fc063e0f800 1 -- 172.21.15.146:0/3730454504 wait complete. 2024-09-18T01:47:11.564 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T01:47:09.882428Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:47:09.882414Z', 'tags': [], 'group_ids': []} 2024-09-18T01:47:11.564 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T01:47:09.882428Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:47:09.882414Z', 'tags': [], 'group_ids': []} 2024-09-18T01:47:11.565 ERROR:root:0 2024-09-18T01:47:11.565 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-18T01:47:11.565 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-18T01:47:11.565 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-18T01:47:11.611 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:47:11.612 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:47:11.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.611+0000 7fb51100f800 1 Processor -- start 2024-09-18T01:47:11.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.611+0000 7fb51100f800 1 -- start start 2024-09-18T01:47:11.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.612+0000 7fb51100f800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x5560ef691610 0x5560ef722620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.612+0000 7fb51100f800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5560ef5dcb30 con 0x5560ef722b60 2024-09-18T01:47:11.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.612+0000 7fb51100f800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x5560ef5be360 con 0x5560ef691610 2024-09-18T01:47:11.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.612+0000 7fb50c6ee640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x5560ef691610 0x5560ef722620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.612+0000 7fb50beed640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x5560ef722b60 0x5560ef724f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:53148/0 (socket says 172.21.15.146:53148) 2024-09-18T01:47:11.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.612+0000 7fb50c6ee640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x5560ef691610 0x5560ef722620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37896/0 (socket says 172.21.15.146:37896) 2024-09-18T01:47:11.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.612+0000 7fb50beed640 1 -- 172.21.15.146:0/967002149 learned_addr learned my addr 172.21.15.146:0/967002149 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:47:11.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.612+0000 7fb50c6ee640 1 -- 172.21.15.146:0/967002149 >> v1:172.21.15.129:6789/0 conn(0x5560ef722b60 legacy=0x5560ef724f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.612+0000 7fb50b6ec640 1 -- 172.21.15.146:0/967002149 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1270382437 0 0) 0x5560ef5dcb30 con 0x5560ef722b60 2024-09-18T01:47:11.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.612+0000 7fb50c6ee640 1 -- 172.21.15.146:0/967002149 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560ef5e4e00 con 0x5560ef691610 2024-09-18T01:47:11.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.614+0000 7fb50c6ee640 1 --2- 172.21.15.146:0/967002149 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5560ef691610 0x5560ef722620 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc00a470 tx=0x7fb4fc045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df8b936f0ace2286 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.614+0000 7fb50b6ec640 1 -- 172.21.15.146:0/967002149 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4fc053570 con 0x5560ef691610 2024-09-18T01:47:11.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.614+0000 7fb50b6ec640 1 -- 172.21.15.146:0/967002149 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4fc058070 con 0x5560ef691610 2024-09-18T01:47:11.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.614+0000 7fb50b6ec640 1 -- 172.21.15.146:0/967002149 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4fc053880 con 0x5560ef691610 2024-09-18T01:47:11.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.615+0000 7fb51100f800 1 -- 172.21.15.146:0/967002149 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5560ef691610 msgr2=0x5560ef722620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.615+0000 7fb51100f800 1 --2- 172.21.15.146:0/967002149 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5560ef691610 0x5560ef722620 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc00a470 tx=0x7fb4fc045a20 comp rx=0 tx=0).stop 2024-09-18T01:47:11.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.615+0000 7fb51100f800 1 -- 172.21.15.146:0/967002149 shutdown_connections 2024-09-18T01:47:11.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.615+0000 7fb51100f800 1 --2- 172.21.15.146:0/967002149 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5560ef691610 0x5560ef722620 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.615+0000 7fb51100f800 1 -- 172.21.15.146:0/967002149 >> 172.21.15.146:0/967002149 conn(0x5560ef717db0 msgr2=0x5560ef71a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:11.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.615+0000 7fb51100f800 1 -- 172.21.15.146:0/967002149 shutdown_connections 2024-09-18T01:47:11.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.615+0000 7fb51100f800 1 -- 172.21.15.146:0/967002149 wait complete. 2024-09-18T01:47:11.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.628+0000 7fb51100f800 1 Processor -- start 2024-09-18T01:47:11.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.628+0000 7fb51100f800 1 -- start start 2024-09-18T01:47:11.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.629+0000 7fb51100f800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5560ef691610 0x5560ef80e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.629+0000 7fb51100f800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5560ef669360 con 0x5560ef691610 2024-09-18T01:47:11.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.629+0000 7fb50c6ee640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5560ef691610 0x5560ef80e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.629+0000 7fb50c6ee640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5560ef691610 0x5560ef80e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37908/0 (socket says 172.21.15.146:37908) 2024-09-18T01:47:11.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.629+0000 7fb50c6ee640 1 -- 172.21.15.146:0/1150117814 learned_addr learned my addr 172.21.15.146:0/1150117814 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:11.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.629+0000 7fb50c6ee640 1 -- 172.21.15.146:0/1150117814 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560ef5b6bc0 con 0x5560ef691610 2024-09-18T01:47:11.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.629+0000 7fb50c6ee640 1 --2- 172.21.15.146:0/1150117814 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5560ef691610 0x5560ef80e8e0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc005870 tx=0x7fb4fc051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6a3ae4ccd8535ea server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.630+0000 7fb3fa60c640 1 -- 172.21.15.146:0/1150117814 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4fc05c580 con 0x5560ef691610 2024-09-18T01:47:11.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.630+0000 7fb3fa60c640 1 -- 172.21.15.146:0/1150117814 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4fc063030 con 0x5560ef691610 2024-09-18T01:47:11.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.630+0000 7fb3fa60c640 1 -- 172.21.15.146:0/1150117814 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4fc05c850 con 0x5560ef691610 2024-09-18T01:47:11.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.630+0000 7fb51100f800 1 -- 172.21.15.146:0/1150117814 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5560ef691610 msgr2=0x5560ef80e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.630+0000 7fb51100f800 1 --2- 172.21.15.146:0/1150117814 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5560ef691610 0x5560ef80e8e0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc005870 tx=0x7fb4fc051000 comp rx=0 tx=0).stop 2024-09-18T01:47:11.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.630+0000 7fb51100f800 1 -- 172.21.15.146:0/1150117814 shutdown_connections 2024-09-18T01:47:11.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.630+0000 7fb51100f800 1 --2- 172.21.15.146:0/1150117814 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5560ef691610 0x5560ef80e8e0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.630+0000 7fb51100f800 1 -- 172.21.15.146:0/1150117814 >> 172.21.15.146:0/1150117814 conn(0x5560ef717db0 msgr2=0x5560ef80a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:11.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.630+0000 7fb51100f800 1 -- 172.21.15.146:0/1150117814 shutdown_connections 2024-09-18T01:47:11.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.630+0000 7fb51100f800 1 -- 172.21.15.146:0/1150117814 wait complete. 2024-09-18T01:47:11.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.631+0000 7fb51100f800 1 Processor -- start 2024-09-18T01:47:11.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.631+0000 7fb51100f800 1 -- start start 2024-09-18T01:47:11.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.631+0000 7fb51100f800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5560ef691610 0x5560ef8161e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.631+0000 7fb51100f800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5560ef726910 con 0x5560ef691610 2024-09-18T01:47:11.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.631+0000 7fb50c6ee640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5560ef691610 0x5560ef8161e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.631+0000 7fb50c6ee640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5560ef691610 0x5560ef8161e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37916/0 (socket says 172.21.15.146:37916) 2024-09-18T01:47:11.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.631+0000 7fb50c6ee640 1 -- 172.21.15.146:0/4028862643 learned_addr learned my addr 172.21.15.146:0/4028862643 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:11.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.631+0000 7fb50c6ee640 1 -- 172.21.15.146:0/4028862643 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560ef5cafe0 con 0x5560ef691610 2024-09-18T01:47:11.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.632+0000 7fb50c6ee640 1 --2- 172.21.15.146:0/4028862643 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5560ef691610 0x5560ef8161e0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc045f50 tx=0x7fb4fc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.632+0000 7fb3f8e09640 1 -- 172.21.15.146:0/4028862643 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4fc078070 con 0x5560ef691610 2024-09-18T01:47:11.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.632+0000 7fb3f8e09640 1 -- 172.21.15.146:0/4028862643 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4fc054a70 con 0x5560ef691610 2024-09-18T01:47:11.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.632+0000 7fb51100f800 1 -- 172.21.15.146:0/4028862643 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5560ef816720 con 0x5560ef691610 2024-09-18T01:47:11.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.632+0000 7fb3f8e09640 1 -- 172.21.15.146:0/4028862643 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4fc054d50 con 0x5560ef691610 2024-09-18T01:47:11.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.632+0000 7fb51100f800 1 -- 172.21.15.146:0/4028862643 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560ef816ca0 con 0x5560ef691610 2024-09-18T01:47:11.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.633+0000 7fb3f8e09640 1 -- 172.21.15.146:0/4028862643 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb4fc07b070 con 0x5560ef691610 2024-09-18T01:47:11.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.633+0000 7fb3f8e09640 1 --2- 172.21.15.146:0/4028862643 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb3f4036b40 0x7fb3f4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.633+0000 7fb3f8e09640 1 -- 172.21.15.146:0/4028862643 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7fb4fc070070 con 0x5560ef691610 2024-09-18T01:47:11.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.633+0000 7fb50beed640 1 --2- 172.21.15.146:0/4028862643 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb3f4036b40 0x7fb3f4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.633+0000 7fb51100f800 1 --2- 172.21.15.146:0/4028862643 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5560ef722b60 0x5560ef81d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.633+0000 7fb51100f800 1 -- 172.21.15.146:0/4028862643 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5560ef81d820 con 0x5560ef722b60 2024-09-18T01:47:11.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.633+0000 7fb50ceef640 1 --2- 172.21.15.146:0/4028862643 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5560ef722b60 0x5560ef81d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.633+0000 7fb50beed640 1 --2- 172.21.15.146:0/4028862643 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb3f4036b40 0x7fb3f4039000 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb500000c00 tx=0x7fb5000013b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.633+0000 7fb50ceef640 1 --2- 172.21.15.146:0/4028862643 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5560ef722b60 0x5560ef81d250 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.634+0000 7fb50ceef640 1 -- 172.21.15.146:0/4028862643 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb50400a4a0 con 0x5560ef722b60 2024-09-18T01:47:11.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.634+0000 7fb51100f800 1 -- 172.21.15.146:0/4028862643 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5560ef81a800 con 0x5560ef722b60 2024-09-18T01:47:11.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.634+0000 7fb50ceef640 1 -- 172.21.15.146:0/4028862643 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb50400a4a0 con 0x5560ef722b60 2024-09-18T01:47:11.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.634+0000 7fb51100f800 1 -- 172.21.15.146:0/4028862643 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5560ef81f640 con 0x5560ef722b60 2024-09-18T01:47:11.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.634+0000 7fb50ceef640 1 -- 172.21.15.146:0/4028862643 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb50400a4a0 con 0x5560ef722b60 2024-09-18T01:47:11.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.634+0000 7fb51100f800 1 -- 172.21.15.146:0/4028862643 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5560ef81e870 con 0x5560ef722b60 2024-09-18T01:47:11.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.634+0000 7fb50ceef640 1 -- 172.21.15.146:0/4028862643 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb50400a4a0 con 0x5560ef722b60 2024-09-18T01:47:11.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.635+0000 7fb51100f800 1 --2- 172.21.15.146:0/4028862643 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5560ef8209f0 0x5560ef822de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.635+0000 7fb51100f800 1 -- 172.21.15.146:0/4028862643 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5560ef823320 con 0x5560ef8209f0 2024-09-18T01:47:11.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.635+0000 7fb50c6ee640 1 --2- 172.21.15.146:0/4028862643 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5560ef8209f0 0x5560ef822de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.635+0000 7fb50c6ee640 1 --2- 172.21.15.146:0/4028862643 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5560ef8209f0 0x5560ef822de0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.635+0000 7fb50c6ee640 1 -- 172.21.15.146:0/4028862643 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb4fc07a030 con 0x5560ef8209f0 2024-09-18T01:47:11.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.635+0000 7fb51100f800 1 Processor -- start 2024-09-18T01:47:11.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.636+0000 7fb51100f800 1 -- start start 2024-09-18T01:47:11.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.636+0000 7fb51100f800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5560ef830fa0 0x5560ef8313c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.636+0000 7fb51100f800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5560ef5b8580 con 0x5560ef830fa0 2024-09-18T01:47:11.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.636+0000 7fb50ceef640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5560ef830fa0 0x5560ef8313c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.636+0000 7fb50ceef640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5560ef830fa0 0x5560ef8313c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37926/0 (socket says 172.21.15.146:37926) 2024-09-18T01:47:11.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.636+0000 7fb50ceef640 1 -- 172.21.15.146:0/904363017 learned_addr learned my addr 172.21.15.146:0/904363017 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:11.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.636+0000 7fb50ceef640 1 -- 172.21.15.146:0/904363017 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560ef831900 con 0x5560ef830fa0 2024-09-18T01:47:11.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.636+0000 7fb50ceef640 1 --2- 172.21.15.146:0/904363017 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5560ef830fa0 0x5560ef8313c0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x5560ef817400 tx=0x7fb5040178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.636+0000 7fb3f1ffb640 1 -- 172.21.15.146:0/904363017 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb504013440 con 0x5560ef830fa0 2024-09-18T01:47:11.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.636+0000 7fb3f1ffb640 1 -- 172.21.15.146:0/904363017 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5040135e0 con 0x5560ef830fa0 2024-09-18T01:47:11.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.636+0000 7fb51100f800 1 -- 172.21.15.146:0/904363017 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5560ef831b90 con 0x5560ef830fa0 2024-09-18T01:47:11.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.637+0000 7fb3f1ffb640 1 -- 172.21.15.146:0/904363017 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5040138c0 con 0x5560ef830fa0 2024-09-18T01:47:11.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.637+0000 7fb51100f800 1 -- 172.21.15.146:0/904363017 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560ef834870 con 0x5560ef830fa0 2024-09-18T01:47:11.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.637+0000 7fb3f1ffb640 1 -- 172.21.15.146:0/904363017 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb504011040 con 0x5560ef830fa0 2024-09-18T01:47:11.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.637+0000 7fb3f1ffb640 1 --2- 172.21.15.146:0/904363017 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb3e4036b90 0x7fb3e4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.637+0000 7fb3f1ffb640 1 -- 172.21.15.146:0/904363017 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7fb50401d070 con 0x5560ef830fa0 2024-09-18T01:47:11.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.637+0000 7fb50c6ee640 1 --2- 172.21.15.146:0/904363017 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb3e4036b90 0x7fb3e4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.638+0000 7fb51100f800 1 Processor -- start 2024-09-18T01:47:11.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.638+0000 7fb51100f800 1 -- start start 2024-09-18T01:47:11.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.638+0000 7fb50c6ee640 1 --2- 172.21.15.146:0/904363017 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb3e4036b90 0x7fb3e4039050 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x5560ef81f5a0 tx=0x7fb4fc054f70 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.638+0000 7fb51100f800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5560ef83dc10 0x5560ef83e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.638+0000 7fb51100f800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5560ef80f030 con 0x5560ef83dc10 2024-09-18T01:47:11.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.638+0000 7fb50ceef640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5560ef83dc10 0x5560ef83e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.638+0000 7fb50ceef640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5560ef83dc10 0x5560ef83e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37940/0 (socket says 172.21.15.146:37940) 2024-09-18T01:47:11.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.638+0000 7fb50ceef640 1 -- 172.21.15.146:0/2995128025 learned_addr learned my addr 172.21.15.146:0/2995128025 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:11.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.638+0000 7fb50ceef640 1 -- 172.21.15.146:0/2995128025 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560ef83e5e0 con 0x5560ef83dc10 2024-09-18T01:47:11.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.639+0000 7fb50ceef640 1 --2- 172.21.15.146:0/2995128025 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5560ef83dc10 0x5560ef83e010 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fb50404c8c0 tx=0x7fb504001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21179d5da65afac5 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.639+0000 7fb3eb7fe640 1 -- 172.21.15.146:0/2995128025 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb504027040 con 0x5560ef83dc10 2024-09-18T01:47:11.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.639+0000 7fb3eb7fe640 1 -- 172.21.15.146:0/2995128025 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb50404e0d0 con 0x5560ef83dc10 2024-09-18T01:47:11.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.639+0000 7fb3eb7fe640 1 -- 172.21.15.146:0/2995128025 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb50404b250 con 0x5560ef83dc10 2024-09-18T01:47:11.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.639+0000 7fb51100f800 1 -- 172.21.15.146:0/2995128025 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5560ef83dc10 msgr2=0x5560ef83e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.639+0000 7fb51100f800 1 --2- 172.21.15.146:0/2995128025 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5560ef83dc10 0x5560ef83e010 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fb50404c8c0 tx=0x7fb504001940 comp rx=0 tx=0).stop 2024-09-18T01:47:11.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.639+0000 7fb51100f800 1 -- 172.21.15.146:0/2995128025 shutdown_connections 2024-09-18T01:47:11.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.639+0000 7fb51100f800 1 --2- 172.21.15.146:0/2995128025 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5560ef83dc10 0x5560ef83e010 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.639+0000 7fb51100f800 1 -- 172.21.15.146:0/2995128025 >> 172.21.15.146:0/2995128025 conn(0x5560ef839fc0 msgr2=0x5560ef8380c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:11.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.639+0000 7fb51100f800 1 -- 172.21.15.146:0/2995128025 shutdown_connections 2024-09-18T01:47:11.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.639+0000 7fb51100f800 1 -- 172.21.15.146:0/2995128025 wait complete. 2024-09-18T01:47:11.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.639+0000 7fb51100f800 1 Processor -- start 2024-09-18T01:47:11.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.640+0000 7fb51100f800 1 -- start start 2024-09-18T01:47:11.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.640+0000 7fb51100f800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5560ef83dc10 0x5560ef845100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.640+0000 7fb51100f800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5560ef83ebb0 con 0x5560ef83dc10 2024-09-18T01:47:11.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.640+0000 7fb50ceef640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5560ef83dc10 0x5560ef845100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.640+0000 7fb50ceef640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5560ef83dc10 0x5560ef845100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37946/0 (socket says 172.21.15.146:37946) 2024-09-18T01:47:11.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.640+0000 7fb50ceef640 1 -- 172.21.15.146:0/549355054 learned_addr learned my addr 172.21.15.146:0/549355054 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:11.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.640+0000 7fb50ceef640 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560ef845640 con 0x5560ef83dc10 2024-09-18T01:47:11.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.640+0000 7fb50ceef640 1 --2- 172.21.15.146:0/549355054 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5560ef83dc10 0x5560ef845100 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fb504001df0 tx=0x7fb50404c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.640+0000 7fb3e9ffb640 1 -- 172.21.15.146:0/549355054 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb504027050 con 0x5560ef83dc10 2024-09-18T01:47:11.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.640+0000 7fb3e9ffb640 1 -- 172.21.15.146:0/549355054 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb50402aa60 con 0x5560ef83dc10 2024-09-18T01:47:11.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.640+0000 7fb51100f800 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5560ef8458d0 con 0x5560ef83dc10 2024-09-18T01:47:11.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.640+0000 7fb3e9ffb640 1 -- 172.21.15.146:0/549355054 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb50402ad40 con 0x5560ef83dc10 2024-09-18T01:47:11.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.641+0000 7fb51100f800 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560ef848580 con 0x5560ef83dc10 2024-09-18T01:47:11.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.641+0000 7fb3e9ffb640 1 -- 172.21.15.146:0/549355054 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb504021a50 con 0x5560ef83dc10 2024-09-18T01:47:11.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.641+0000 7fb3e9ffb640 1 --2- 172.21.15.146:0/549355054 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb3dc036b90 0x7fb3dc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.641+0000 7fb3e9ffb640 1 -- 172.21.15.146:0/549355054 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7fb504034030 con 0x5560ef83dc10 2024-09-18T01:47:11.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.641+0000 7fb50c6ee640 1 --2- 172.21.15.146:0/549355054 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb3dc036b90 0x7fb3dc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.642+0000 7fb50c6ee640 1 --2- 172.21.15.146:0/549355054 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb3dc036b90 0x7fb3dc039050 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc054800 tx=0x7fb4fc094000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.642+0000 7fb51100f800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.642+0000 7fb51100f800 1 --2- 172.21.15.146:0/549355054 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5560ef850da0 0x5560ef853260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.642+0000 7fb51100f800 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5560ef8539b0 con 0x5560ef850da0 2024-09-18T01:47:11.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.642+0000 7fb50beed640 1 --2- 172.21.15.146:0/549355054 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5560ef850da0 0x5560ef853260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.643+0000 7fb50beed640 1 --2- 172.21.15.146:0/549355054 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5560ef850da0 0x5560ef853260 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.643+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb50000f5f0 con 0x5560ef850da0 2024-09-18T01:47:11.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.643+0000 7fb51100f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:11.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.643+0000 7fb51100f800 20 realm 2024-09-18T01:47:11.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.643+0000 7fb51100f800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.643+0000 7fb51100f800 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5560ef8501f0 con 0x5560ef850da0 2024-09-18T01:47:11.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.643+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb50000f5f0 con 0x5560ef850da0 2024-09-18T01:47:11.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.643+0000 7fb51100f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:11.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.643+0000 7fb51100f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:47:11.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.643+0000 7fb51100f800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.643+0000 7fb51100f800 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5560ef8544a0 con 0x5560ef850da0 2024-09-18T01:47:11.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.643+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb50000f5f0 con 0x5560ef850da0 2024-09-18T01:47:11.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.643+0000 7fb51100f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:11.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.643+0000 7fb51100f800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.643+0000 7fb51100f800 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5560ef854d70 con 0x5560ef850da0 2024-09-18T01:47:11.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.643+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb50000f5f0 con 0x5560ef850da0 2024-09-18T01:47:11.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.643+0000 7fb51100f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:47:11.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.643+0000 7fb51100f800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.643+0000 7fb51100f800 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5560ef855110 con 0x5560ef850da0 2024-09-18T01:47:11.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.644+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb50000f5f0 con 0x5560ef850da0 2024-09-18T01:47:11.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.644+0000 7fb51100f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:47:11.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.644+0000 7fb51100f800 20 searching for the correct realm 2024-09-18T01:47:11.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.644+0000 7fb51100f800 1 --2- 172.21.15.146:0/549355054 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5560ef857040 0x5560ef859450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.644+0000 7fb51100f800 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5560ef859b20 con 0x5560ef857040 2024-09-18T01:47:11.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.644+0000 7fb50ceef640 1 --2- 172.21.15.146:0/549355054 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5560ef857040 0x5560ef859450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.644+0000 7fb50ceef640 1 --2- 172.21.15.146:0/549355054 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5560ef857040 0x5560ef859450 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.644+0000 7fb50ceef640 1 -- 172.21.15.146:0/549355054 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb504029070 con 0x5560ef857040 2024-09-18T01:47:11.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.644+0000 7fb50ceef640 1 --2- 172.21.15.146:0/549355054 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fb5040123a0 0x7fb50404bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.644+0000 7fb50ceef640 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5560ef859b20 con 0x7fb5040123a0 2024-09-18T01:47:11.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.644+0000 7fb50c6ee640 1 --2- 172.21.15.146:0/549355054 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fb5040123a0 0x7fb50404bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.645+0000 7fb50c6ee640 1 --2- 172.21.15.146:0/549355054 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fb5040123a0 0x7fb50404bfb0 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.645+0000 7fb50c6ee640 1 -- 172.21.15.146:0/549355054 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4fc09a040 con 0x7fb5040123a0 2024-09-18T01:47:11.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.645+0000 7fb50c6ee640 1 --2- 172.21.15.146:0/549355054 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fb4fc07d060 0x7fb4fc0900b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.645+0000 7fb50c6ee640 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb4fc0a9040 con 0x7fb4fc07d060 2024-09-18T01:47:11.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.645+0000 7fb50beed640 1 --2- 172.21.15.146:0/549355054 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fb4fc07d060 0x7fb4fc0900b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.646+0000 7fb50beed640 1 --2- 172.21.15.146:0/549355054 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fb4fc07d060 0x7fb4fc0900b0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.646+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb50000f5f0 con 0x7fb4fc07d060 2024-09-18T01:47:11.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.646+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb4fc0a9040 con 0x5560ef850da0 2024-09-18T01:47:11.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.646+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v33'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb50000f5f0 con 0x5560ef850da0 2024-09-18T01:47:11.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.646+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb4fc0a9040 con 0x5560ef850da0 2024-09-18T01:47:11.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.646+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb50000f5f0 con 0x5560ef850da0 2024-09-18T01:47:11.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.646+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb4fc0a9040 con 0x7fb4fc07d060 2024-09-18T01:47:11.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.647+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb50000f5f0 con 0x7fb4fc07d060 2024-09-18T01:47:11.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.647+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb4fc0a9040 con 0x7fb4fc07d060 2024-09-18T01:47:11.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.647+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb50000f5f0 con 0x7fb4fc07d060 2024-09-18T01:47:11.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.647+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb4fc0a9040 con 0x7fb5040123a0 2024-09-18T01:47:11.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.647+0000 7fb50c6ee640 1 -- 172.21.15.146:0/549355054 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4fc09a040 con 0x7fb5040123a0 2024-09-18T01:47:11.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.647+0000 7fb50c6ee640 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb4fc0a9040 con 0x5560ef857040 2024-09-18T01:47:11.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.647+0000 7fb50ceef640 1 -- 172.21.15.146:0/549355054 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb50405d040 con 0x5560ef857040 2024-09-18T01:47:11.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.647+0000 7fb50ceef640 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb4fc0a9040 con 0x5560ef850da0 2024-09-18T01:47:11.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.647+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb50000f5f0 con 0x5560ef850da0 2024-09-18T01:47:11.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.647+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb4fc0a9040 con 0x7fb4fc07d060 2024-09-18T01:47:11.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.648+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb50000f5f0 con 0x7fb4fc07d060 2024-09-18T01:47:11.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.648+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb4fc0a9040 con 0x5560ef850da0 2024-09-18T01:47:11.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.648+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb50000f5f0 con 0x5560ef850da0 2024-09-18T01:47:11.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.648+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb4fc0a9040 con 0x7fb5040123a0 2024-09-18T01:47:11.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.648+0000 7fb50c6ee640 1 -- 172.21.15.146:0/549355054 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fb4fc09a040 con 0x7fb5040123a0 2024-09-18T01:47:11.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.648+0000 7fb50c6ee640 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb4fc0a9040 con 0x5560ef857040 2024-09-18T01:47:11.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.648+0000 7fb50ceef640 1 -- 172.21.15.146:0/549355054 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb50405d040 con 0x5560ef857040 2024-09-18T01:47:11.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.648+0000 7fb50ceef640 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb4fc0a9040 con 0x5560ef857040 2024-09-18T01:47:11.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.649+0000 7fb50ceef640 1 -- 172.21.15.146:0/549355054 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb50405d040 con 0x5560ef857040 2024-09-18T01:47:11.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.649+0000 7fb50ceef640 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb4fc0a9040 con 0x7fb4fc07d060 2024-09-18T01:47:11.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.649+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb50000f5f0 con 0x7fb4fc07d060 2024-09-18T01:47:11.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.649+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb4fc0a9040 con 0x5560ef857040 2024-09-18T01:47:11.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.649+0000 7fb50ceef640 1 -- 172.21.15.146:0/549355054 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb50405d040 con 0x5560ef857040 2024-09-18T01:47:11.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.649+0000 7fb50ceef640 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb4fc0a9040 con 0x5560ef857040 2024-09-18T01:47:11.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.649+0000 7fb50ceef640 1 -- 172.21.15.146:0/549355054 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb50405d040 con 0x5560ef857040 2024-09-18T01:47:11.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.649+0000 7fb50ceef640 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb4fc0a9040 con 0x5560ef850da0 2024-09-18T01:47:11.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.650+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb50000f5f0 con 0x5560ef850da0 2024-09-18T01:47:11.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.650+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb4fc0a9040 con 0x5560ef850da0 2024-09-18T01:47:11.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.650+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v33'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb50000f5f0 con 0x5560ef850da0 2024-09-18T01:47:11.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.650+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb4fc0a9040 con 0x7fb4fc07d060 2024-09-18T01:47:11.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.650+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb50000f5f0 con 0x7fb4fc07d060 2024-09-18T01:47:11.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.650+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb4fc0a9040 con 0x5560ef857040 2024-09-18T01:47:11.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.650+0000 7fb50ceef640 1 -- 172.21.15.146:0/549355054 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb50405d040 con 0x5560ef857040 2024-09-18T01:47:11.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.650+0000 7fb50ceef640 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb4fc0a9040 con 0x7fb5040123a0 2024-09-18T01:47:11.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.651+0000 7fb50c6ee640 1 -- 172.21.15.146:0/549355054 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4fc09a040 con 0x7fb5040123a0 2024-09-18T01:47:11.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.651+0000 7fb50c6ee640 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb4fc0a9040 con 0x5560ef850da0 2024-09-18T01:47:11.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.651+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb50000f5f0 con 0x5560ef850da0 2024-09-18T01:47:11.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.651+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb4fc0a9040 con 0x7fb4fc07d060 2024-09-18T01:47:11.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.651+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb50003b040 con 0x7fb4fc07d060 2024-09-18T01:47:11.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.651+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb4fc0a9040 con 0x5560ef857040 2024-09-18T01:47:11.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.651+0000 7fb50ceef640 1 -- 172.21.15.146:0/549355054 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb50405d040 con 0x5560ef857040 2024-09-18T01:47:11.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.651+0000 7fb50ceef640 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb4fc0a9040 con 0x7fb4fc07d060 2024-09-18T01:47:11.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.652+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb50003b040 con 0x7fb4fc07d060 2024-09-18T01:47:11.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.652+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb4fc0a9040 con 0x7fb5040123a0 2024-09-18T01:47:11.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.652+0000 7fb50c6ee640 1 -- 172.21.15.146:0/549355054 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4fc09a040 con 0x7fb5040123a0 2024-09-18T01:47:11.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.652+0000 7fb50c6ee640 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb4fc0a9040 con 0x5560ef857040 2024-09-18T01:47:11.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.652+0000 7fb50ceef640 1 -- 172.21.15.146:0/549355054 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb50405d040 con 0x5560ef857040 2024-09-18T01:47:11.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.652+0000 7fb50ceef640 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb4fc0a9040 con 0x7fb4fc07d060 2024-09-18T01:47:11.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.652+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb50003b040 con 0x7fb4fc07d060 2024-09-18T01:47:11.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.652+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb4fc0a9040 con 0x5560ef850da0 2024-09-18T01:47:11.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.653+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v33'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb50003b040 con 0x5560ef850da0 2024-09-18T01:47:11.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.653+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb4fc0a9040 con 0x7fb5040123a0 2024-09-18T01:47:11.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.653+0000 7fb50c6ee640 1 -- 172.21.15.146:0/549355054 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4fc0b2040 con 0x7fb5040123a0 2024-09-18T01:47:11.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.653+0000 7fb51100f800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:47:11.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.653+0000 7fb51100f800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:47:11.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.653+0000 7fb51100f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:47:11.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.653+0000 7fb51100f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:47:11.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.653+0000 7fb51100f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:47:11.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.653+0000 7fb51100f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:47:11.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.653+0000 7fb51100f800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.653+0000 7fb51100f800 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5560ef855ae0 con 0x5560ef850da0 2024-09-18T01:47:11.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.653+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb50003b040 con 0x5560ef850da0 2024-09-18T01:47:11.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.653+0000 7fb51100f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:11.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.653+0000 7fb51100f800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.653+0000 7fb51100f800 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5560ef856380 con 0x5560ef850da0 2024-09-18T01:47:11.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.653+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb50003b040 con 0x5560ef850da0 2024-09-18T01:47:11.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.653+0000 7fb51100f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:47:11.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.653+0000 7fb51100f800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.653+0000 7fb51100f800 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5560ef856380 con 0x7fb5040123a0 2024-09-18T01:47:11.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.654+0000 7fb50c6ee640 1 -- 172.21.15.146:0/549355054 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb4fc0b2040 con 0x7fb5040123a0 2024-09-18T01:47:11.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.654+0000 7fb51100f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:47:11.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.654+0000 7fb51100f800 20 zone default found 2024-09-18T01:47:11.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.654+0000 7fb51100f800 4 Realm: () 2024-09-18T01:47:11.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.654+0000 7fb51100f800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:47:11.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.654+0000 7fb51100f800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:47:11.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.654+0000 7fb51100f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:47:11.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.654+0000 7fb51100f800 20 zonegroup default 2024-09-18T01:47:11.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.654+0000 7fb51100f800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.654+0000 7fb51100f800 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5560ef85a450 con 0x7fb4fc07d060 2024-09-18T01:47:11.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.654+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb50003b040 con 0x7fb4fc07d060 2024-09-18T01:47:11.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.654+0000 7fb51100f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:11.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.654+0000 7fb51100f800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.654+0000 7fb51100f800 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5560ef85be30 con 0x5560ef857040 2024-09-18T01:47:11.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.654+0000 7fb50ceef640 1 -- 172.21.15.146:0/549355054 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb50405d040 con 0x5560ef857040 2024-09-18T01:47:11.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.654+0000 7fb51100f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:11.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.654+0000 7fb51100f800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.654+0000 7fb51100f800 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5560ef85c2f0 con 0x5560ef857040 2024-09-18T01:47:11.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.654+0000 7fb50ceef640 1 -- 172.21.15.146:0/549355054 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb50405d040 con 0x5560ef857040 2024-09-18T01:47:11.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.654+0000 7fb51100f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:11.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.654+0000 7fb51100f800 20 started sync module instance, tier type = 2024-09-18T01:47:11.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.654+0000 7fb51100f800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:47:11.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.654+0000 7fb51100f800 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5560ef85b2c0 con 0x7fb5040123a0 2024-09-18T01:47:11.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.655+0000 7fb50c6ee640 1 -- 172.21.15.146:0/549355054 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v33'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4fc0b2040 con 0x7fb5040123a0 2024-09-18T01:47:11.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.655+0000 7fb51100f800 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93874823739056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5560ef85cc00 con 0x7fb5040123a0 2024-09-18T01:47:11.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.655+0000 7fb51100f800 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5560ef85d450 con 0x5560ef850da0 2024-09-18T01:47:11.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.656+0000 7fb50c6ee640 1 -- 172.21.15.146:0/549355054 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93874823739056] v33'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4fc0b2040 con 0x7fb5040123a0 2024-09-18T01:47:11.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.657+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v33'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb50003b040 con 0x5560ef850da0 2024-09-18T01:47:11.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.657+0000 7fb51100f800 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93874823743312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5560ef85d450 con 0x5560ef850da0 2024-09-18T01:47:11.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.657+0000 7fb51100f800 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5560ef85df70 con 0x5560ef857040 2024-09-18T01:47:11.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.658+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93874823743312] v33'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb50003b040 con 0x5560ef850da0 2024-09-18T01:47:11.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.659+0000 7fb50ceef640 1 -- 172.21.15.146:0/549355054 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v33'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb50405d040 con 0x5560ef857040 2024-09-18T01:47:11.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.659+0000 7fb51100f800 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93874823745440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5560ef85d3c0 con 0x5560ef857040 2024-09-18T01:47:11.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.659+0000 7fb51100f800 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5560ef85ee30 con 0x7fb5040123a0 2024-09-18T01:47:11.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.660+0000 7fb50ceef640 1 -- 172.21.15.146:0/549355054 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93874823745440] v33'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb50405d040 con 0x5560ef857040 2024-09-18T01:47:11.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.660+0000 7fb50c6ee640 1 -- 172.21.15.146:0/549355054 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v33'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4fc0b2040 con 0x7fb5040123a0 2024-09-18T01:47:11.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.660+0000 7fb51100f800 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93874823750496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5560ef85ee30 con 0x7fb5040123a0 2024-09-18T01:47:11.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.660+0000 7fb51100f800 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5560ef85f830 con 0x5560ef850da0 2024-09-18T01:47:11.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.661+0000 7fb50c6ee640 1 -- 172.21.15.146:0/549355054 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93874823750496] v33'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4fc0b2040 con 0x7fb5040123a0 2024-09-18T01:47:11.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.661+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v33'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb50003b040 con 0x5560ef850da0 2024-09-18T01:47:11.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.661+0000 7fb51100f800 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93874823754560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5560ef85ee30 con 0x5560ef850da0 2024-09-18T01:47:11.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.661+0000 7fb51100f800 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5560ef8602c0 con 0x7fb4fc07d060 2024-09-18T01:47:11.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.662+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93874823754560] v33'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb50003b040 con 0x5560ef850da0 2024-09-18T01:47:11.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.662+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v33'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb50003b040 con 0x7fb4fc07d060 2024-09-18T01:47:11.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.662+0000 7fb51100f800 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93874823757200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5560ef85ee30 con 0x7fb4fc07d060 2024-09-18T01:47:11.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.662+0000 7fb51100f800 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5560ef860cd0 con 0x7fb4fc07d060 2024-09-18T01:47:11.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.663+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93874823757200] v33'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb50003b040 con 0x7fb4fc07d060 2024-09-18T01:47:11.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.664+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v33'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb50003b040 con 0x7fb4fc07d060 2024-09-18T01:47:11.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.664+0000 7fb51100f800 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93874823752064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5560ef860eb0 con 0x7fb4fc07d060 2024-09-18T01:47:11.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.664+0000 7fb51100f800 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5560ef861700 con 0x7fb4fc07d060 2024-09-18T01:47:11.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.665+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93874823752064] v33'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb50003b040 con 0x7fb4fc07d060 2024-09-18T01:47:11.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.665+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v33'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb50003b040 con 0x7fb4fc07d060 2024-09-18T01:47:11.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.665+0000 7fb51100f800 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93874823760656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5560ef861500 con 0x7fb4fc07d060 2024-09-18T01:47:11.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.665+0000 7fb51100f800 20 add_watcher() i=0 2024-09-18T01:47:11.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.665+0000 7fb51100f800 20 add_watcher() i=1 2024-09-18T01:47:11.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.665+0000 7fb51100f800 20 add_watcher() i=2 2024-09-18T01:47:11.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.665+0000 7fb51100f800 20 add_watcher() i=3 2024-09-18T01:47:11.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.665+0000 7fb51100f800 20 add_watcher() i=4 2024-09-18T01:47:11.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.665+0000 7fb51100f800 20 add_watcher() i=5 2024-09-18T01:47:11.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.665+0000 7fb51100f800 20 add_watcher() i=6 2024-09-18T01:47:11.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.666+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93874823760656] v33'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb50003b040 con 0x7fb4fc07d060 2024-09-18T01:47:11.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.666+0000 7fb51100f800 20 add_watcher() i=7 2024-09-18T01:47:11.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.666+0000 7fb51100f800 2 all 8 watchers are set, enabling cache 2024-09-18T01:47:11.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.666+0000 7fb51100f800 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5560ef864a40 con 0x5560ef850da0 2024-09-18T01:47:11.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.666+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb50003b040 con 0x5560ef850da0 2024-09-18T01:47:11.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.666+0000 7fb51100f800 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93874823761840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5560ef861f30 con 0x5560ef850da0 2024-09-18T01:47:11.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.667+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93874823761840] v33'275 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb50003b040 con 0x5560ef850da0 2024-09-18T01:47:11.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.667+0000 7fb3c27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:47:11.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.667+0000 7fb51100f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:47:11.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.667+0000 7fb51100f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:47:11.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.667+0000 7fb51100f800 5 note: GC not initialized 2024-09-18T01:47:11.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.668+0000 7fb3c17e2640 20 reqs_thread_entry: start 2024-09-18T01:47:11.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.668+0000 7fb51100f800 20 init_complete bucket index max shards: 11 2024-09-18T01:47:11.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.668+0000 7fb51100f800 20 Filter name: none 2024-09-18T01:47:11.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.668+0000 7fb332ffd640 20 reqs_thread_entry: start 2024-09-18T01:47:11.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.668+0000 7fb51100f800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-18T01:47:11.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.668+0000 7fb51100f800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.668+0000 7fb51100f800 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5560ef897ec0 con 0x7fb4fc07d060 2024-09-18T01:47:11.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.668+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7fb50003b040 con 0x7fb4fc07d060 2024-09-18T01:47:11.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.669+0000 7fb51100f800 20 rados_obj.operate() r=0 bl.length=460 2024-09-18T01:47:11.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.669+0000 7fb51100f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-18T01:47:11.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.669+0000 7fb51100f800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:47:11.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.669+0000 7fb51100f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:47:11.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.669+0000 7fb51100f800 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5560ef89e550 con 0x7fb4fc07d060 2024-09-18T01:47:11.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.670+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v33'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fb50003b040 con 0x7fb4fc07d060 2024-09-18T01:47:11.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.670+0000 7fb51100f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T01:47:11.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.670+0000 7fb51100f800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:47:11.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.670+0000 7fb51100f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-18T01:47:11.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.670+0000 7fb51100f800 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93874824011536 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5560ef899bb0 con 0x5560ef850da0 2024-09-18T01:47:11.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.670+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== watch-notify(notify (1) cookie 93874823754560 notify 141733920802 ret 0) ==== 691+0+0 (crc 0 0 0) 0x7fb500018040 con 0x5560ef850da0 2024-09-18T01:47:11.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.670+0000 7fb3eb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920802 cookie 93874823754560 notifier 4922 bl.length()=649 2024-09-18T01:47:11.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.670+0000 7fb3eb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T01:47:11.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.670+0000 7fb3eb7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:47:11.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.670+0000 7fb3eb7fe640 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fb3d0003ea0 con 0x5560ef850da0 2024-09-18T01:47:11.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.670+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(64 notify.4 [notify cookie 93874824011536 out=8b] v0'0 uv276 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb50003b040 con 0x5560ef850da0 2024-09-18T01:47:11.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.671+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb50003b040 con 0x5560ef850da0 2024-09-18T01:47:11.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.671+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== watch-notify(notify_complete (2) cookie 93874824011536 notify 141733920802 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fb500004aa0 con 0x5560ef850da0 2024-09-18T01:47:11.688 INFO:teuthology.orchestra.run.smithi146.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-18T01:47:09.882428Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:47:09.882414Z","tags":[],"group_ids":[]} 2024-09-18T01:47:11.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.671+0000 7fb3c27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:47:11.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.671+0000 7fb51100f800 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93874823761840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5560ef89a370 con 0x5560ef850da0 2024-09-18T01:47:11.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.672+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93874823761840] v33'276 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb50003b040 con 0x5560ef850da0 2024-09-18T01:47:11.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.673+0000 7fb51100f800 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93874823739056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5560ef89a370 con 0x7fb5040123a0 2024-09-18T01:47:11.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.674+0000 7fb50c6ee640 1 -- 172.21.15.146:0/549355054 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93874823739056] v33'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4fc0b2040 con 0x7fb5040123a0 2024-09-18T01:47:11.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.674+0000 7fb51100f800 20 remove_watcher() i=0 2024-09-18T01:47:11.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.674+0000 7fb51100f800 2 removed watcher, disabling cache 2024-09-18T01:47:11.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.674+0000 7fb51100f800 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93874823743312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5560ef89a370 con 0x5560ef850da0 2024-09-18T01:47:11.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.675+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93874823743312] v33'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb50003b040 con 0x5560ef850da0 2024-09-18T01:47:11.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.675+0000 7fb51100f800 20 remove_watcher() i=1 2024-09-18T01:47:11.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.675+0000 7fb51100f800 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93874823745440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5560ef89a370 con 0x5560ef857040 2024-09-18T01:47:11.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.676+0000 7fb50ceef640 1 -- 172.21.15.146:0/549355054 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93874823745440] v33'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb50405d040 con 0x5560ef857040 2024-09-18T01:47:11.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.676+0000 7fb51100f800 20 remove_watcher() i=2 2024-09-18T01:47:11.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.676+0000 7fb51100f800 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93874823750496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5560ef89a370 con 0x7fb5040123a0 2024-09-18T01:47:11.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.677+0000 7fb50c6ee640 1 -- 172.21.15.146:0/549355054 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93874823750496] v33'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4fc0b2040 con 0x7fb5040123a0 2024-09-18T01:47:11.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.677+0000 7fb51100f800 20 remove_watcher() i=3 2024-09-18T01:47:11.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.677+0000 7fb51100f800 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93874823754560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5560ef895be0 con 0x5560ef850da0 2024-09-18T01:47:11.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.678+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 <== osd.1 v2:172.21.15.146:6808/3930274777 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93874823754560] v33'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb50003b040 con 0x5560ef850da0 2024-09-18T01:47:11.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.678+0000 7fb51100f800 20 remove_watcher() i=4 2024-09-18T01:47:11.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.678+0000 7fb51100f800 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93874823757200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5560ef895be0 con 0x7fb4fc07d060 2024-09-18T01:47:11.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.679+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93874823757200] v33'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb50003b040 con 0x7fb4fc07d060 2024-09-18T01:47:11.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.679+0000 7fb51100f800 20 remove_watcher() i=5 2024-09-18T01:47:11.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.679+0000 7fb51100f800 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93874823752064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5560ef895be0 con 0x7fb4fc07d060 2024-09-18T01:47:11.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.680+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93874823752064] v33'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb50003b040 con 0x7fb4fc07d060 2024-09-18T01:47:11.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.680+0000 7fb51100f800 20 remove_watcher() i=6 2024-09-18T01:47:11.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.680+0000 7fb51100f800 1 -- 172.21.15.146:0/549355054 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93874823760656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5560ef895be0 con 0x7fb4fc07d060 2024-09-18T01:47:11.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.681+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93874823760656] v33'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb50003b040 con 0x7fb4fc07d060 2024-09-18T01:47:11.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.681+0000 7fb51100f800 20 remove_watcher() i=7 2024-09-18T01:47:11.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.681+0000 7fb51100f800 1 -- 172.21.15.146:0/549355054 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fb4fc07d060 msgr2=0x7fb4fc0900b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.681+0000 7fb51100f800 1 --2- 172.21.15.146:0/549355054 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7fb4fc07d060 0x7fb4fc0900b0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.681+0000 7fb51100f800 1 -- 172.21.15.146:0/549355054 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5560ef850da0 msgr2=0x5560ef853260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.681+0000 7fb51100f800 1 --2- 172.21.15.146:0/549355054 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5560ef850da0 0x5560ef853260 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.681+0000 7fb51100f800 1 -- 172.21.15.146:0/549355054 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fb5040123a0 msgr2=0x7fb50404bfb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.681+0000 7fb51100f800 1 --2- 172.21.15.146:0/549355054 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fb5040123a0 0x7fb50404bfb0 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.681+0000 7fb51100f800 1 -- 172.21.15.146:0/549355054 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5560ef857040 msgr2=0x5560ef859450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.681+0000 7fb51100f800 1 --2- 172.21.15.146:0/549355054 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x5560ef857040 0x5560ef859450 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.681+0000 7fb51100f800 1 -- 172.21.15.146:0/549355054 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb3dc036b90 msgr2=0x7fb3dc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.681+0000 7fb51100f800 1 --2- 172.21.15.146:0/549355054 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb3dc036b90 0x7fb3dc039050 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc054800 tx=0x7fb4fc094000 comp rx=0 tx=0).stop 2024-09-18T01:47:11.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.681+0000 7fb51100f800 1 -- 172.21.15.146:0/549355054 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5560ef83dc10 msgr2=0x5560ef845100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.681+0000 7fb51100f800 1 --2- 172.21.15.146:0/549355054 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5560ef83dc10 0x5560ef845100 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fb504001df0 tx=0x7fb50404c820 comp rx=0 tx=0).stop 2024-09-18T01:47:11.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.681+0000 7fb50beed640 1 -- 172.21.15.146:0/549355054 reap_dead start 2024-09-18T01:47:11.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.682+0000 7fb51100f800 1 -- 172.21.15.146:0/549355054 shutdown_connections 2024-09-18T01:47:11.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.682+0000 7fb51100f800 1 --2- 172.21.15.146:0/549355054 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5560ef83dc10 0x5560ef845100 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.682+0000 7fb51100f800 1 -- 172.21.15.146:0/549355054 >> 172.21.15.146:0/549355054 conn(0x5560ef839fc0 msgr2=0x5560ef83f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:11.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.682+0000 7fb51100f800 1 -- 172.21.15.146:0/549355054 shutdown_connections 2024-09-18T01:47:11.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.682+0000 7fb51100f800 1 -- 172.21.15.146:0/549355054 wait complete. 2024-09-18T01:47:11.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.682+0000 7fb51100f800 1 -- 172.21.15.146:0/904363017 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb3e4036b90 msgr2=0x7fb3e4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.682+0000 7fb51100f800 1 --2- 172.21.15.146:0/904363017 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb3e4036b90 0x7fb3e4039050 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x5560ef81f5a0 tx=0x7fb4fc054f70 comp rx=0 tx=0).stop 2024-09-18T01:47:11.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.682+0000 7fb51100f800 1 -- 172.21.15.146:0/904363017 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5560ef830fa0 msgr2=0x5560ef8313c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.682+0000 7fb51100f800 1 --2- 172.21.15.146:0/904363017 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5560ef830fa0 0x5560ef8313c0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x5560ef817400 tx=0x7fb5040178e0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.682+0000 7fb51100f800 1 -- 172.21.15.146:0/904363017 shutdown_connections 2024-09-18T01:47:11.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.682+0000 7fb51100f800 1 --2- 172.21.15.146:0/904363017 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb3e4036b90 0x7fb3e4039050 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.682+0000 7fb51100f800 1 --2- 172.21.15.146:0/904363017 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5560ef830fa0 0x5560ef8313c0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.682+0000 7fb51100f800 1 -- 172.21.15.146:0/904363017 >> 172.21.15.146:0/904363017 conn(0x5560ef825f30 msgr2=0x5560ef828ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:11.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.682+0000 7fb51100f800 1 -- 172.21.15.146:0/904363017 shutdown_connections 2024-09-18T01:47:11.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.682+0000 7fb51100f800 1 -- 172.21.15.146:0/904363017 wait complete. 2024-09-18T01:47:11.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.682+0000 7fb51100f800 1 -- 172.21.15.146:0/4028862643 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5560ef722b60 msgr2=0x5560ef81d250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.682+0000 7fb51100f800 1 --2- 172.21.15.146:0/4028862643 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5560ef722b60 0x5560ef81d250 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.682+0000 7fb51100f800 1 -- 172.21.15.146:0/4028862643 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5560ef8209f0 msgr2=0x5560ef822de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.682+0000 7fb51100f800 1 --2- 172.21.15.146:0/4028862643 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5560ef8209f0 0x5560ef822de0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.682+0000 7fb51100f800 1 -- 172.21.15.146:0/4028862643 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb3f4036b40 msgr2=0x7fb3f4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.682+0000 7fb51100f800 1 --2- 172.21.15.146:0/4028862643 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb3f4036b40 0x7fb3f4039000 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb500000c00 tx=0x7fb5000013b0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.682+0000 7fb51100f800 1 -- 172.21.15.146:0/4028862643 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5560ef691610 msgr2=0x5560ef8161e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.682+0000 7fb51100f800 1 --2- 172.21.15.146:0/4028862643 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5560ef691610 0x5560ef8161e0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc045f50 tx=0x7fb4fc002fb0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.682+0000 7fb51100f800 1 -- 172.21.15.146:0/4028862643 shutdown_connections 2024-09-18T01:47:11.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.683+0000 7fb51100f800 1 --2- 172.21.15.146:0/4028862643 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x5560ef8209f0 0x5560ef822de0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.683+0000 7fb51100f800 1 --2- 172.21.15.146:0/4028862643 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x5560ef722b60 0x5560ef81d250 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.683+0000 7fb51100f800 1 --2- 172.21.15.146:0/4028862643 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb3f4036b40 0x7fb3f4039000 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.683+0000 7fb51100f800 1 --2- 172.21.15.146:0/4028862643 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5560ef691610 0x5560ef8161e0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.683+0000 7fb51100f800 1 -- 172.21.15.146:0/4028862643 >> 172.21.15.146:0/4028862643 conn(0x5560ef717db0 msgr2=0x5560ef808b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:11.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.683+0000 7fb51100f800 1 -- 172.21.15.146:0/4028862643 shutdown_connections 2024-09-18T01:47:11.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.683+0000 7fb51100f800 1 -- 172.21.15.146:0/4028862643 wait complete. 2024-09-18T01:47:11.703 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T01:47:09.882428Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:47:09.882414Z', 'tags': [], 'group_ids': []} 2024-09-18T01:47:11.703 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T01:47:09.882428Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:47:09.882414Z', 'tags': [], 'group_ids': []} 2024-09-18T01:47:11.703 ERROR:root:0 2024-09-18T01:47:11.703 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-18T01:47:11.703 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-18T01:47:11.703 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-18T01:47:11.749 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:47:11.750 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:47:11.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.750+0000 7f4aa2f26800 1 Processor -- start 2024-09-18T01:47:11.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.750+0000 7f4aa2f26800 1 -- start start 2024-09-18T01:47:11.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.750+0000 7f4aa2f26800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x562135d584e0 0x562135d588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.750+0000 7f4aa2f26800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562135c18b30 con 0x562135d58e20 2024-09-18T01:47:11.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.750+0000 7f4aa2f26800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x562135bfa360 con 0x562135d584e0 2024-09-18T01:47:11.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.750+0000 7f4a9eb13640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x562135d584e0 0x562135d588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.750+0000 7f4a96312640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x562135d58e20 0x562135d5d9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:53164/0 (socket says 172.21.15.146:53164) 2024-09-18T01:47:11.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.750+0000 7f4a96312640 1 -- 172.21.15.146:0/1116818975 learned_addr learned my addr 172.21.15.146:0/1116818975 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:47:11.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.751+0000 7f4a9eb13640 1 -- 172.21.15.146:0/1116818975 >> v1:172.21.15.129:6789/0 conn(0x562135d58e20 legacy=0x562135d5d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.751+0000 7f4a9eb13640 1 -- 172.21.15.146:0/1116818975 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562135c20e00 con 0x562135d584e0 2024-09-18T01:47:11.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.751+0000 7f4a9e312640 1 -- 172.21.15.146:0/1116818975 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1551455470 0 0) 0x562135c18b30 con 0x562135d58e20 2024-09-18T01:47:11.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.752+0000 7f4a9eb13640 1 --2- 172.21.15.146:0/1116818975 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562135d584e0 0x562135d588e0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f4a9000a470 tx=0x7f4a90045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e169ba3642f60ee server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.752+0000 7f4a9e312640 1 -- 172.21.15.146:0/1116818975 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a90053570 con 0x562135d584e0 2024-09-18T01:47:11.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.752+0000 7f4a9e312640 1 -- 172.21.15.146:0/1116818975 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a90058070 con 0x562135d584e0 2024-09-18T01:47:11.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.752+0000 7f4a9e312640 1 -- 172.21.15.146:0/1116818975 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a90053880 con 0x562135d584e0 2024-09-18T01:47:11.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.753+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1116818975 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562135d584e0 msgr2=0x562135d588e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.753+0000 7f4aa2f26800 1 --2- 172.21.15.146:0/1116818975 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562135d584e0 0x562135d588e0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f4a9000a470 tx=0x7f4a90045a20 comp rx=0 tx=0).stop 2024-09-18T01:47:11.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.753+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1116818975 shutdown_connections 2024-09-18T01:47:11.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.753+0000 7f4aa2f26800 1 --2- 172.21.15.146:0/1116818975 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562135d584e0 0x562135d588e0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.753+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1116818975 >> 172.21.15.146:0/1116818975 conn(0x562135d53db0 msgr2=0x562135d561d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:11.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.753+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1116818975 shutdown_connections 2024-09-18T01:47:11.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.753+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1116818975 wait complete. 2024-09-18T01:47:11.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.767+0000 7f4aa2f26800 1 Processor -- start 2024-09-18T01:47:11.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.767+0000 7f4aa2f26800 1 -- start start 2024-09-18T01:47:11.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.767+0000 7f4aa2f26800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562135d584e0 0x562135e475a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.767+0000 7f4aa2f26800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x562135ca5360 con 0x562135d584e0 2024-09-18T01:47:11.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.768+0000 7f4a9eb13640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562135d584e0 0x562135e475a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.768+0000 7f4a9eb13640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562135d584e0 0x562135e475a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37962/0 (socket says 172.21.15.146:37962) 2024-09-18T01:47:11.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.768+0000 7f4a9eb13640 1 -- 172.21.15.146:0/1444329018 learned_addr learned my addr 172.21.15.146:0/1444329018 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:11.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.768+0000 7f4a9eb13640 1 -- 172.21.15.146:0/1444329018 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562135bf2bc0 con 0x562135d584e0 2024-09-18T01:47:11.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.768+0000 7f4a9eb13640 1 --2- 172.21.15.146:0/1444329018 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562135d584e0 0x562135e475a0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f4a90045f50 tx=0x7f4a90051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e833ccef20db4a67 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.768+0000 7f498ce09640 1 -- 172.21.15.146:0/1444329018 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a90053c20 con 0x562135d584e0 2024-09-18T01:47:11.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.768+0000 7f498ce09640 1 -- 172.21.15.146:0/1444329018 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a90063030 con 0x562135d584e0 2024-09-18T01:47:11.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.768+0000 7f498ce09640 1 -- 172.21.15.146:0/1444329018 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a90053440 con 0x562135d584e0 2024-09-18T01:47:11.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.769+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1444329018 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562135d584e0 msgr2=0x562135e475a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.769+0000 7f4aa2f26800 1 --2- 172.21.15.146:0/1444329018 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562135d584e0 0x562135e475a0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f4a90045f50 tx=0x7f4a90051000 comp rx=0 tx=0).stop 2024-09-18T01:47:11.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.769+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1444329018 shutdown_connections 2024-09-18T01:47:11.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.769+0000 7f4aa2f26800 1 --2- 172.21.15.146:0/1444329018 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562135d584e0 0x562135e475a0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.769+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1444329018 >> 172.21.15.146:0/1444329018 conn(0x562135d53db0 msgr2=0x562135e42f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:11.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.769+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1444329018 shutdown_connections 2024-09-18T01:47:11.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.769+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1444329018 wait complete. 2024-09-18T01:47:11.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.769+0000 7f4aa2f26800 1 Processor -- start 2024-09-18T01:47:11.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.769+0000 7f4aa2f26800 1 -- start start 2024-09-18T01:47:11.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.770+0000 7f4aa2f26800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562135d584e0 0x562135ccd600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.770+0000 7f4aa2f26800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x562135d5f500 con 0x562135d584e0 2024-09-18T01:47:11.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.770+0000 7f4a9eb13640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562135d584e0 0x562135ccd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.770+0000 7f4a9eb13640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562135d584e0 0x562135ccd600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37978/0 (socket says 172.21.15.146:37978) 2024-09-18T01:47:11.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.770+0000 7f4a9eb13640 1 -- 172.21.15.146:0/3516478290 learned_addr learned my addr 172.21.15.146:0/3516478290 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:11.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.770+0000 7f4a9eb13640 1 -- 172.21.15.146:0/3516478290 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562135c06fe0 con 0x562135d584e0 2024-09-18T01:47:11.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.770+0000 7f4a9eb13640 1 --2- 172.21.15.146:0/3516478290 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562135d584e0 0x562135ccd600 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f4a90045f20 tx=0x7f4a90002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.771+0000 7f498b606640 1 -- 172.21.15.146:0/3516478290 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a90053570 con 0x562135d584e0 2024-09-18T01:47:11.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.771+0000 7f498b606640 1 -- 172.21.15.146:0/3516478290 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a90053710 con 0x562135d584e0 2024-09-18T01:47:11.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.771+0000 7f4aa2f26800 1 -- 172.21.15.146:0/3516478290 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562135e52c70 con 0x562135d584e0 2024-09-18T01:47:11.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.771+0000 7f498b606640 1 -- 172.21.15.146:0/3516478290 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a90068420 con 0x562135d584e0 2024-09-18T01:47:11.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.771+0000 7f4aa2f26800 1 -- 172.21.15.146:0/3516478290 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562135e53110 con 0x562135d584e0 2024-09-18T01:47:11.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.771+0000 7f498b606640 1 -- 172.21.15.146:0/3516478290 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4a900685c0 con 0x562135d584e0 2024-09-18T01:47:11.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.772+0000 7f498b606640 1 --2- 172.21.15.146:0/3516478290 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f4984036b90 0x7f4984039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.772+0000 7f498b606640 1 -- 172.21.15.146:0/3516478290 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f4a90070070 con 0x562135d584e0 2024-09-18T01:47:11.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.772+0000 7f4a96312640 1 --2- 172.21.15.146:0/3516478290 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f4984036b90 0x7f4984039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.772+0000 7f4aa2f26800 1 --2- 172.21.15.146:0/3516478290 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x562135d58e20 0x562135e56f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.772+0000 7f4aa2f26800 1 -- 172.21.15.146:0/3516478290 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562135e575b0 con 0x562135d58e20 2024-09-18T01:47:11.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.772+0000 7f4a9f314640 1 --2- 172.21.15.146:0/3516478290 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x562135d58e20 0x562135e56f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.772+0000 7f4a96312640 1 --2- 172.21.15.146:0/3516478290 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f4984036b90 0x7f4984039050 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4a88000c00 tx=0x7f4a880013b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.772+0000 7f4a9f314640 1 --2- 172.21.15.146:0/3516478290 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x562135d58e20 0x562135e56f90 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.772+0000 7f4a9f314640 1 -- 172.21.15.146:0/3516478290 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4a9800a4a0 con 0x562135d58e20 2024-09-18T01:47:11.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.772+0000 7f4aa2f26800 1 -- 172.21.15.146:0/3516478290 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562135e54520 con 0x562135d58e20 2024-09-18T01:47:11.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.773+0000 7f4a9f314640 1 -- 172.21.15.146:0/3516478290 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4a9800a4a0 con 0x562135d58e20 2024-09-18T01:47:11.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.773+0000 7f4aa2f26800 1 -- 172.21.15.146:0/3516478290 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562135e593b0 con 0x562135d58e20 2024-09-18T01:47:11.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.773+0000 7f4a9f314640 1 -- 172.21.15.146:0/3516478290 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4a9800a4a0 con 0x562135d58e20 2024-09-18T01:47:11.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.773+0000 7f4aa2f26800 1 -- 172.21.15.146:0/3516478290 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562135e58430 con 0x562135d58e20 2024-09-18T01:47:11.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.773+0000 7f4a9f314640 1 -- 172.21.15.146:0/3516478290 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4a9800a4a0 con 0x562135d58e20 2024-09-18T01:47:11.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.773+0000 7f4aa2f26800 1 --2- 172.21.15.146:0/3516478290 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x562135e58ed0 0x562135e5c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.773+0000 7f4aa2f26800 1 -- 172.21.15.146:0/3516478290 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562135e5ceb0 con 0x562135e58ed0 2024-09-18T01:47:11.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.773+0000 7f4a9eb13640 1 --2- 172.21.15.146:0/3516478290 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x562135e58ed0 0x562135e5c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.774+0000 7f4a9eb13640 1 --2- 172.21.15.146:0/3516478290 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x562135e58ed0 0x562135e5c770 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.774+0000 7f4a9eb13640 1 -- 172.21.15.146:0/3516478290 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4a90051070 con 0x562135e58ed0 2024-09-18T01:47:11.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.774+0000 7f4aa2f26800 1 Processor -- start 2024-09-18T01:47:11.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.774+0000 7f4aa2f26800 1 -- start start 2024-09-18T01:47:11.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.774+0000 7f4aa2f26800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562135e6ac40 0x562135e6b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.774+0000 7f4aa2f26800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x562135bf4580 con 0x562135e6ac40 2024-09-18T01:47:11.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.775+0000 7f4a9f314640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562135e6ac40 0x562135e6b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.775+0000 7f4a9f314640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562135e6ac40 0x562135e6b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37980/0 (socket says 172.21.15.146:37980) 2024-09-18T01:47:11.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.775+0000 7f4a9f314640 1 -- 172.21.15.146:0/1709566303 learned_addr learned my addr 172.21.15.146:0/1709566303 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:11.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.775+0000 7f4a9f314640 1 -- 172.21.15.146:0/1709566303 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562135e6b5a0 con 0x562135e6ac40 2024-09-18T01:47:11.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.775+0000 7f4a9f314640 1 --2- 172.21.15.146:0/1709566303 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562135e6ac40 0x562135e6b060 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x562135e57990 tx=0x7f4a980178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.775+0000 7f4988e01640 1 -- 172.21.15.146:0/1709566303 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a98013440 con 0x562135e6ac40 2024-09-18T01:47:11.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.775+0000 7f4988e01640 1 -- 172.21.15.146:0/1709566303 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a980135e0 con 0x562135e6ac40 2024-09-18T01:47:11.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.775+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1709566303 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562135e6b830 con 0x562135e6ac40 2024-09-18T01:47:11.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.776+0000 7f4988e01640 1 -- 172.21.15.146:0/1709566303 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a980138c0 con 0x562135e6ac40 2024-09-18T01:47:11.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.776+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1709566303 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562135e6e510 con 0x562135e6ac40 2024-09-18T01:47:11.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.776+0000 7f4988e01640 1 -- 172.21.15.146:0/1709566303 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4a98011040 con 0x562135e6ac40 2024-09-18T01:47:11.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.776+0000 7f4988e01640 1 --2- 172.21.15.146:0/1709566303 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f4978036b90 0x7f4978039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.776+0000 7f4988e01640 1 -- 172.21.15.146:0/1709566303 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f4a9801d070 con 0x562135e6ac40 2024-09-18T01:47:11.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.777+0000 7f4a9eb13640 1 --2- 172.21.15.146:0/1709566303 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f4978036b90 0x7f4978039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.777+0000 7f4aa2f26800 1 Processor -- start 2024-09-18T01:47:11.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.777+0000 7f4aa2f26800 1 -- start start 2024-09-18T01:47:11.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.777+0000 7f4a9eb13640 1 --2- 172.21.15.146:0/1709566303 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f4978036b90 0x7f4978039050 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x562135e587d0 tx=0x7f4a9005e840 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.777+0000 7f4aa2f26800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562135e4fea0 0x562135e502a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.777+0000 7f4aa2f26800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x562135e47cf0 con 0x562135e4fea0 2024-09-18T01:47:11.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.777+0000 7f4a9f314640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562135e4fea0 0x562135e502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.777+0000 7f4a9f314640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562135e4fea0 0x562135e502a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37990/0 (socket says 172.21.15.146:37990) 2024-09-18T01:47:11.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.777+0000 7f4a9f314640 1 -- 172.21.15.146:0/1462170409 learned_addr learned my addr 172.21.15.146:0/1462170409 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:11.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.777+0000 7f4a9f314640 1 -- 172.21.15.146:0/1462170409 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562135e50870 con 0x562135e4fea0 2024-09-18T01:47:11.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.778+0000 7f4a9f314640 1 --2- 172.21.15.146:0/1462170409 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562135e4fea0 0x562135e502a0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f4a9804c890 tx=0x7f4a9804c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3a91ad4f79f860c server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.778+0000 7f49827fc640 1 -- 172.21.15.146:0/1462170409 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a98045070 con 0x562135e4fea0 2024-09-18T01:47:11.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.778+0000 7f49827fc640 1 -- 172.21.15.146:0/1462170409 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a98012df0 con 0x562135e4fea0 2024-09-18T01:47:11.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.778+0000 7f49827fc640 1 -- 172.21.15.146:0/1462170409 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a98021b80 con 0x562135e4fea0 2024-09-18T01:47:11.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.778+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1462170409 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562135e4fea0 msgr2=0x562135e502a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.778+0000 7f4aa2f26800 1 --2- 172.21.15.146:0/1462170409 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562135e4fea0 0x562135e502a0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f4a9804c890 tx=0x7f4a9804c9d0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.778+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1462170409 shutdown_connections 2024-09-18T01:47:11.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.778+0000 7f4aa2f26800 1 --2- 172.21.15.146:0/1462170409 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562135e4fea0 0x562135e502a0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.778+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1462170409 >> 172.21.15.146:0/1462170409 conn(0x562135e73c40 msgr2=0x562135e71d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:11.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.778+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1462170409 shutdown_connections 2024-09-18T01:47:11.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.778+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1462170409 wait complete. 2024-09-18T01:47:11.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.778+0000 7f4aa2f26800 1 Processor -- start 2024-09-18T01:47:11.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.779+0000 7f4aa2f26800 1 -- start start 2024-09-18T01:47:11.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.779+0000 7f4aa2f26800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562135e4fea0 0x562135e80fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.779+0000 7f4aa2f26800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x562135e4ebd0 con 0x562135e4fea0 2024-09-18T01:47:11.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.779+0000 7f4a9f314640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562135e4fea0 0x562135e80fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.779+0000 7f4a9f314640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562135e4fea0 0x562135e80fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:37998/0 (socket says 172.21.15.146:37998) 2024-09-18T01:47:11.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.779+0000 7f4a9f314640 1 -- 172.21.15.146:0/1924111715 learned_addr learned my addr 172.21.15.146:0/1924111715 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:47:11.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.779+0000 7f4a9f314640 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562135e814e0 con 0x562135e4fea0 2024-09-18T01:47:11.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.779+0000 7f4a9f314640 1 --2- 172.21.15.146:0/1924111715 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562135e4fea0 0x562135e80fa0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f4a9804ca10 tx=0x7f4a9804c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.779+0000 7f4980ff9640 1 -- 172.21.15.146:0/1924111715 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a9803a070 con 0x562135e4fea0 2024-09-18T01:47:11.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.779+0000 7f4980ff9640 1 -- 172.21.15.146:0/1924111715 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a98001540 con 0x562135e4fea0 2024-09-18T01:47:11.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.779+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562135e81770 con 0x562135e4fea0 2024-09-18T01:47:11.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.779+0000 7f4980ff9640 1 -- 172.21.15.146:0/1924111715 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a98045040 con 0x562135e4fea0 2024-09-18T01:47:11.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.779+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562135e84420 con 0x562135e4fea0 2024-09-18T01:47:11.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.780+0000 7f4980ff9640 1 -- 172.21.15.146:0/1924111715 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4a9803d070 con 0x562135e4fea0 2024-09-18T01:47:11.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.780+0000 7f4980ff9640 1 --2- 172.21.15.146:0/1924111715 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f4968036af0 0x7f4968038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.780+0000 7f4980ff9640 1 -- 172.21.15.146:0/1924111715 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f4a9800e040 con 0x562135e4fea0 2024-09-18T01:47:11.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.780+0000 7f4a9eb13640 1 --2- 172.21.15.146:0/1924111715 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f4968036af0 0x7f4968038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.781+0000 7f4a9eb13640 1 --2- 172.21.15.146:0/1924111715 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f4968036af0 0x7f4968038fb0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f4a9000a330 tx=0x7f4a9008b000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.781+0000 7f4aa2f26800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.781+0000 7f4aa2f26800 1 --2- 172.21.15.146:0/1924111715 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x562135e8cc50 0x562135e8f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.781+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562135e8f860 con 0x562135e8cc50 2024-09-18T01:47:11.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.781+0000 7f4a96312640 1 --2- 172.21.15.146:0/1924111715 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x562135e8cc50 0x562135e8f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.781+0000 7f4a96312640 1 --2- 172.21.15.146:0/1924111715 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x562135e8cc50 0x562135e8f110 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.782+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4a8800f5f0 con 0x562135e8cc50 2024-09-18T01:47:11.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.782+0000 7f4aa2f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:11.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.782+0000 7f4aa2f26800 20 realm 2024-09-18T01:47:11.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.782+0000 7f4aa2f26800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.782+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562135e8c0a0 con 0x562135e8cc50 2024-09-18T01:47:11.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.782+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4a8800f5f0 con 0x562135e8cc50 2024-09-18T01:47:11.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.782+0000 7f4aa2f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:11.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.782+0000 7f4aa2f26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:47:11.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.782+0000 7f4aa2f26800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.782+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562135e90350 con 0x562135e8cc50 2024-09-18T01:47:11.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.782+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4a8800f5f0 con 0x562135e8cc50 2024-09-18T01:47:11.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.782+0000 7f4aa2f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:11.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.782+0000 7f4aa2f26800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.782+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562135e90c20 con 0x562135e8cc50 2024-09-18T01:47:11.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.782+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4a8800f5f0 con 0x562135e8cc50 2024-09-18T01:47:11.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.782+0000 7f4aa2f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:47:11.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.782+0000 7f4aa2f26800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.782+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562135e90fc0 con 0x562135e8cc50 2024-09-18T01:47:11.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.783+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4a8800f5f0 con 0x562135e8cc50 2024-09-18T01:47:11.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.783+0000 7f4aa2f26800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:47:11.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.783+0000 7f4aa2f26800 20 searching for the correct realm 2024-09-18T01:47:11.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.783+0000 7f4aa2f26800 1 --2- 172.21.15.146:0/1924111715 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x562135e92ef0 0x562135e95300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.783+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562135e959d0 con 0x562135e92ef0 2024-09-18T01:47:11.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.783+0000 7f4a9f314640 1 --2- 172.21.15.146:0/1924111715 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x562135e92ef0 0x562135e95300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.783+0000 7f4a9f314640 1 --2- 172.21.15.146:0/1924111715 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x562135e92ef0 0x562135e95300 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.783+0000 7f4a9f314640 1 -- 172.21.15.146:0/1924111715 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a9803c030 con 0x562135e92ef0 2024-09-18T01:47:11.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.783+0000 7f4a9f314640 1 --2- 172.21.15.146:0/1924111715 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f4a9803f060 0x7f4a98022420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.783+0000 7f4a9f314640 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562135e959d0 con 0x7f4a9803f060 2024-09-18T01:47:11.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.783+0000 7f4a9eb13640 1 --2- 172.21.15.146:0/1924111715 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f4a9803f060 0x7f4a98022420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.784+0000 7f4a9eb13640 1 --2- 172.21.15.146:0/1924111715 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f4a9803f060 0x7f4a98022420 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.784+0000 7f4a9eb13640 1 -- 172.21.15.146:0/1924111715 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a900a6040 con 0x7f4a9803f060 2024-09-18T01:47:11.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.784+0000 7f4a9eb13640 1 --2- 172.21.15.146:0/1924111715 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f4a9005f040 0x7f4a90090200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:47:11.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.784+0000 7f4a9eb13640 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562135e959d0 con 0x7f4a9005f040 2024-09-18T01:47:11.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.784+0000 7f4a96312640 1 --2- 172.21.15.146:0/1924111715 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f4a9005f040 0x7f4a90090200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:47:11.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.785+0000 7f4a96312640 1 --2- 172.21.15.146:0/1924111715 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f4a9005f040 0x7f4a90090200 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:47:11.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.785+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a8800f5f0 con 0x7f4a9005f040 2024-09-18T01:47:11.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.785+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562135e959d0 con 0x562135e8cc50 2024-09-18T01:47:11.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.785+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v33'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4a8800f5f0 con 0x562135e8cc50 2024-09-18T01:47:11.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.785+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562135e959d0 con 0x562135e8cc50 2024-09-18T01:47:11.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.785+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a8800f5f0 con 0x562135e8cc50 2024-09-18T01:47:11.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.785+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562135e959d0 con 0x7f4a9005f040 2024-09-18T01:47:11.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.785+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a8800f5f0 con 0x7f4a9005f040 2024-09-18T01:47:11.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.785+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562135e959d0 con 0x7f4a9005f040 2024-09-18T01:47:11.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.786+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a8800f5f0 con 0x7f4a9005f040 2024-09-18T01:47:11.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.786+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562135e959d0 con 0x7f4a9803f060 2024-09-18T01:47:11.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.786+0000 7f4a9eb13640 1 -- 172.21.15.146:0/1924111715 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a900a6040 con 0x7f4a9803f060 2024-09-18T01:47:11.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.786+0000 7f4a9eb13640 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562135e959d0 con 0x562135e92ef0 2024-09-18T01:47:11.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.786+0000 7f4a9f314640 1 -- 172.21.15.146:0/1924111715 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a9803c030 con 0x562135e92ef0 2024-09-18T01:47:11.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.786+0000 7f4a9f314640 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562135e959d0 con 0x562135e8cc50 2024-09-18T01:47:11.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.786+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a8800f5f0 con 0x562135e8cc50 2024-09-18T01:47:11.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.786+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562135e959d0 con 0x7f4a9005f040 2024-09-18T01:47:11.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.787+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a8800f5f0 con 0x7f4a9005f040 2024-09-18T01:47:11.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.787+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562135e959d0 con 0x562135e8cc50 2024-09-18T01:47:11.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.787+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a8800f5f0 con 0x562135e8cc50 2024-09-18T01:47:11.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.787+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562135e959d0 con 0x7f4a9803f060 2024-09-18T01:47:11.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.787+0000 7f4a9eb13640 1 -- 172.21.15.146:0/1924111715 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f4a900a6040 con 0x7f4a9803f060 2024-09-18T01:47:11.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.787+0000 7f4a9eb13640 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562135e959d0 con 0x562135e92ef0 2024-09-18T01:47:11.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.787+0000 7f4a9f314640 1 -- 172.21.15.146:0/1924111715 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a9803c030 con 0x562135e92ef0 2024-09-18T01:47:11.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.787+0000 7f4a9f314640 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562135e959d0 con 0x562135e92ef0 2024-09-18T01:47:11.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.788+0000 7f4a9f314640 1 -- 172.21.15.146:0/1924111715 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a9803c030 con 0x562135e92ef0 2024-09-18T01:47:11.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.788+0000 7f4a9f314640 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562135e959d0 con 0x7f4a9005f040 2024-09-18T01:47:11.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.788+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a8800f5f0 con 0x7f4a9005f040 2024-09-18T01:47:11.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.788+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562135e959d0 con 0x562135e92ef0 2024-09-18T01:47:11.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.788+0000 7f4a9f314640 1 -- 172.21.15.146:0/1924111715 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a9803c030 con 0x562135e92ef0 2024-09-18T01:47:11.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.788+0000 7f4a9f314640 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562135e959d0 con 0x562135e92ef0 2024-09-18T01:47:11.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.788+0000 7f4a9f314640 1 -- 172.21.15.146:0/1924111715 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a9803c030 con 0x562135e92ef0 2024-09-18T01:47:11.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.788+0000 7f4a9f314640 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562135e959d0 con 0x562135e8cc50 2024-09-18T01:47:11.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.789+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a8800f5f0 con 0x562135e8cc50 2024-09-18T01:47:11.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.789+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562135e959d0 con 0x562135e8cc50 2024-09-18T01:47:11.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.789+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v33'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4a8800f5f0 con 0x562135e8cc50 2024-09-18T01:47:11.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.789+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562135e959d0 con 0x7f4a9005f040 2024-09-18T01:47:11.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.789+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a8800f5f0 con 0x7f4a9005f040 2024-09-18T01:47:11.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.789+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562135e959d0 con 0x562135e92ef0 2024-09-18T01:47:11.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.789+0000 7f4a9f314640 1 -- 172.21.15.146:0/1924111715 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a9803c030 con 0x562135e92ef0 2024-09-18T01:47:11.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.789+0000 7f4a9f314640 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562135e959d0 con 0x7f4a9803f060 2024-09-18T01:47:11.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.790+0000 7f4a9eb13640 1 -- 172.21.15.146:0/1924111715 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a900a6040 con 0x7f4a9803f060 2024-09-18T01:47:11.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.790+0000 7f4a9eb13640 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562135e959d0 con 0x562135e8cc50 2024-09-18T01:47:11.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.790+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a8800f5f0 con 0x562135e8cc50 2024-09-18T01:47:11.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.790+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562135e959d0 con 0x7f4a9005f040 2024-09-18T01:47:11.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.790+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a8803b040 con 0x7f4a9005f040 2024-09-18T01:47:11.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.790+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562135e959d0 con 0x562135e92ef0 2024-09-18T01:47:11.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.790+0000 7f4a9f314640 1 -- 172.21.15.146:0/1924111715 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a9803c030 con 0x562135e92ef0 2024-09-18T01:47:11.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.790+0000 7f4a9f314640 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562135e959d0 con 0x7f4a9005f040 2024-09-18T01:47:11.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.791+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a8803b040 con 0x7f4a9005f040 2024-09-18T01:47:11.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.791+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562135e959d0 con 0x7f4a9803f060 2024-09-18T01:47:11.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.791+0000 7f4a9eb13640 1 -- 172.21.15.146:0/1924111715 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a900a6040 con 0x7f4a9803f060 2024-09-18T01:47:11.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.791+0000 7f4a9eb13640 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562135e959d0 con 0x562135e92ef0 2024-09-18T01:47:11.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.791+0000 7f4a9f314640 1 -- 172.21.15.146:0/1924111715 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a9803c030 con 0x562135e92ef0 2024-09-18T01:47:11.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.791+0000 7f4a9f314640 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562135e959d0 con 0x7f4a9005f040 2024-09-18T01:47:11.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.792+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a8803b040 con 0x7f4a9005f040 2024-09-18T01:47:11.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.792+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562135e959d0 con 0x562135e8cc50 2024-09-18T01:47:11.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.792+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v33'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4a8803b040 con 0x562135e8cc50 2024-09-18T01:47:11.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.792+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562135e959d0 con 0x7f4a9803f060 2024-09-18T01:47:11.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.792+0000 7f4a9eb13640 1 -- 172.21.15.146:0/1924111715 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a900a6040 con 0x7f4a9803f060 2024-09-18T01:47:11.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.792+0000 7f4aa2f26800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:47:11.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.792+0000 7f4aa2f26800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:47:11.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.792+0000 7f4aa2f26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:47:11.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.792+0000 7f4aa2f26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:47:11.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.792+0000 7f4aa2f26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:47:11.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.792+0000 7f4aa2f26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:47:11.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.792+0000 7f4aa2f26800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.792+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562135e91960 con 0x562135e8cc50 2024-09-18T01:47:11.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.792+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4a8803b040 con 0x562135e8cc50 2024-09-18T01:47:11.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.792+0000 7f4aa2f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:11.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.792+0000 7f4aa2f26800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.792+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562135e92200 con 0x562135e8cc50 2024-09-18T01:47:11.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.792+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4a8803b040 con 0x562135e8cc50 2024-09-18T01:47:11.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.792+0000 7f4aa2f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:47:11.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.792+0000 7f4aa2f26800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.792+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562135e92200 con 0x7f4a9803f060 2024-09-18T01:47:11.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.793+0000 7f4a9eb13640 1 -- 172.21.15.146:0/1924111715 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4a900a6040 con 0x7f4a9803f060 2024-09-18T01:47:11.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.793+0000 7f4aa2f26800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:47:11.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.793+0000 7f4aa2f26800 20 zone default found 2024-09-18T01:47:11.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.793+0000 7f4aa2f26800 4 Realm: () 2024-09-18T01:47:11.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.793+0000 7f4aa2f26800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:47:11.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.793+0000 7f4aa2f26800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:47:11.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.793+0000 7f4aa2f26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:47:11.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.793+0000 7f4aa2f26800 20 zonegroup default 2024-09-18T01:47:11.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.793+0000 7f4aa2f26800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.793+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562135e91e50 con 0x7f4a9005f040 2024-09-18T01:47:11.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.793+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4a8803b040 con 0x7f4a9005f040 2024-09-18T01:47:11.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.793+0000 7f4aa2f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:11.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.793+0000 7f4aa2f26800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.793+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562135e98230 con 0x562135e92ef0 2024-09-18T01:47:11.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.793+0000 7f4a9f314640 1 -- 172.21.15.146:0/1924111715 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4a9803c030 con 0x562135e92ef0 2024-09-18T01:47:11.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.793+0000 7f4aa2f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:11.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.793+0000 7f4aa2f26800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.793+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562135e985d0 con 0x562135e92ef0 2024-09-18T01:47:11.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.794+0000 7f4a9f314640 1 -- 172.21.15.146:0/1924111715 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4a9803c030 con 0x562135e92ef0 2024-09-18T01:47:11.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.794+0000 7f4aa2f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:47:11.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.794+0000 7f4aa2f26800 20 started sync module instance, tier type = 2024-09-18T01:47:11.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.794+0000 7f4aa2f26800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:47:11.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.794+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562135e976c0 con 0x7f4a9803f060 2024-09-18T01:47:11.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.795+0000 7f4a9eb13640 1 -- 172.21.15.146:0/1924111715 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v33'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a900a6040 con 0x7f4a9803f060 2024-09-18T01:47:11.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.795+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94700638403296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562135e98e20 con 0x7f4a9803f060 2024-09-18T01:47:11.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.795+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562135e99670 con 0x562135e8cc50 2024-09-18T01:47:11.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.796+0000 7f4a9eb13640 1 -- 172.21.15.146:0/1924111715 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94700638403296] v33'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a900a6040 con 0x7f4a9803f060 2024-09-18T01:47:11.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.796+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v33'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a8803b040 con 0x562135e8cc50 2024-09-18T01:47:11.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.796+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94700638407024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562135e996d0 con 0x562135e8cc50 2024-09-18T01:47:11.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.796+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562135e9a1e0 con 0x562135e92ef0 2024-09-18T01:47:11.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.797+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94700638407024] v33'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a8803b040 con 0x562135e8cc50 2024-09-18T01:47:11.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.797+0000 7f4a9f314640 1 -- 172.21.15.146:0/1924111715 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v33'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a9803c030 con 0x562135e92ef0 2024-09-18T01:47:11.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.797+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94700638411920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562135e9a5d0 con 0x562135e92ef0 2024-09-18T01:47:11.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.797+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562135e9b010 con 0x7f4a9803f060 2024-09-18T01:47:11.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.798+0000 7f4a9f314640 1 -- 172.21.15.146:0/1924111715 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94700638411920] v33'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a9803c030 con 0x562135e92ef0 2024-09-18T01:47:11.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.798+0000 7f4a9eb13640 1 -- 172.21.15.146:0/1924111715 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v33'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a900a6040 con 0x7f4a9803f060 2024-09-18T01:47:11.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.798+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94700638415584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562135e9afd0 con 0x7f4a9803f060 2024-09-18T01:47:11.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.798+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562135e9baa0 con 0x562135e8cc50 2024-09-18T01:47:11.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.799+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v33'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a8803b040 con 0x562135e8cc50 2024-09-18T01:47:11.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.799+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94700638418384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562135e9baa0 con 0x562135e8cc50 2024-09-18T01:47:11.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.799+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562135e9ca80 con 0x7f4a9005f040 2024-09-18T01:47:11.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.799+0000 7f4a9eb13640 1 -- 172.21.15.146:0/1924111715 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94700638415584] v33'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a900a6040 con 0x7f4a9803f060 2024-09-18T01:47:11.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.800+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94700638418384] v33'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a8803b040 con 0x562135e8cc50 2024-09-18T01:47:11.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.800+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v33'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a8803b040 con 0x7f4a9005f040 2024-09-18T01:47:11.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.800+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94700638422416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562135e9ca80 con 0x7f4a9005f040 2024-09-18T01:47:11.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.801+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562135e9ceb0 con 0x7f4a9005f040 2024-09-18T01:47:11.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.801+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94700638422416] v33'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a8803b040 con 0x7f4a9005f040 2024-09-18T01:47:11.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.802+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v33'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a8803b040 con 0x7f4a9005f040 2024-09-18T01:47:11.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.802+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94700638420544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562135e9ce70 con 0x7f4a9005f040 2024-09-18T01:47:11.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.802+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562135e9d8b0 con 0x7f4a9005f040 2024-09-18T01:47:11.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.803+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94700638420544] v33'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a8803b040 con 0x7f4a9005f040 2024-09-18T01:47:11.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.803+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v33'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a8803b040 con 0x7f4a9005f040 2024-09-18T01:47:11.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.803+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94700638425984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562135e9d870 con 0x7f4a9005f040 2024-09-18T01:47:11.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.803+0000 7f4aa2f26800 20 add_watcher() i=0 2024-09-18T01:47:11.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.803+0000 7f4aa2f26800 20 add_watcher() i=1 2024-09-18T01:47:11.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.803+0000 7f4aa2f26800 20 add_watcher() i=2 2024-09-18T01:47:11.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.803+0000 7f4aa2f26800 20 add_watcher() i=3 2024-09-18T01:47:11.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.803+0000 7f4aa2f26800 20 add_watcher() i=4 2024-09-18T01:47:11.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.803+0000 7f4aa2f26800 20 add_watcher() i=5 2024-09-18T01:47:11.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.803+0000 7f4aa2f26800 20 add_watcher() i=6 2024-09-18T01:47:11.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.804+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94700638425984] v33'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a8803b040 con 0x7f4a9005f040 2024-09-18T01:47:11.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.804+0000 7f4aa2f26800 20 add_watcher() i=7 2024-09-18T01:47:11.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.804+0000 7f4aa2f26800 2 all 8 watchers are set, enabling cache 2024-09-18T01:47:11.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.804+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562135ea0cd0 con 0x562135e8cc50 2024-09-18T01:47:11.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.804+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4a8803b040 con 0x562135e8cc50 2024-09-18T01:47:11.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.804+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94700638409152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562135e9e1f0 con 0x562135e8cc50 2024-09-18T01:47:11.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.805+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94700638409152] v33'277 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4a8803b040 con 0x562135e8cc50 2024-09-18T01:47:11.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.805+0000 7f49557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:47:11.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.805+0000 7f4aa2f26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:47:11.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.805+0000 7f4aa2f26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:47:11.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.805+0000 7f4aa2f26800 5 note: GC not initialized 2024-09-18T01:47:11.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.806+0000 7f48cffff640 20 reqs_thread_entry: start 2024-09-18T01:47:11.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.806+0000 7f4aa2f26800 20 init_complete bucket index max shards: 11 2024-09-18T01:47:11.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.806+0000 7f4aa2f26800 20 Filter name: none 2024-09-18T01:47:11.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.806+0000 7f48cdffb640 20 reqs_thread_entry: start 2024-09-18T01:47:11.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.806+0000 7f4aa2f26800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-18T01:47:11.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.806+0000 7f4aa2f26800 20 rados->read ofs=0 len=0 2024-09-18T01:47:11.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.806+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562135ed41e0 con 0x7f4a9005f040 2024-09-18T01:47:11.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.807+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7f4a8803b040 con 0x7f4a9005f040 2024-09-18T01:47:11.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.807+0000 7f4aa2f26800 20 rados_obj.operate() r=0 bl.length=473 2024-09-18T01:47:11.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.807+0000 7f4aa2f26800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-18T01:47:11.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.807+0000 7f4aa2f26800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:47:11.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.807+0000 7f4aa2f26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-18T01:47:11.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.807+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562135edab90 con 0x7f4a9005f040 2024-09-18T01:47:11.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.808+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v33'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f4a8803b040 con 0x7f4a9005f040 2024-09-18T01:47:11.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.808+0000 7f4aa2f26800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T01:47:11.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.808+0000 7f4aa2f26800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:47:11.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.808+0000 7f4aa2f26800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-18T01:47:11.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.808+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94700638676304 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562135ed61f0 con 0x562135e8cc50 2024-09-18T01:47:11.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.808+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== watch-notify(notify (1) cookie 94700638418384 notify 141733920803 ret 0) ==== 691+0+0 (crc 0 0 0) 0x7f4a88018040 con 0x562135e8cc50 2024-09-18T01:47:11.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.808+0000 7f49827fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920803 cookie 94700638418384 notifier 4929 bl.length()=649 2024-09-18T01:47:11.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.808+0000 7f49827fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-18T01:47:11.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.808+0000 7f49827fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-18T01:47:11.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.808+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(64 notify.4 [notify cookie 94700638676304 out=8b] v0'0 uv279 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4a8801f020 con 0x562135e8cc50 2024-09-18T01:47:11.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.808+0000 7f49827fc640 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f4964003ea0 con 0x562135e8cc50 2024-09-18T01:47:11.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.808+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a8801f020 con 0x562135e8cc50 2024-09-18T01:47:11.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.809+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== watch-notify(notify_complete (2) cookie 94700638676304 notify 141733920803 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f4a88004aa0 con 0x562135e8cc50 2024-09-18T01:47:11.844 INFO:teuthology.orchestra.run.smithi146.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-18T01:47:09.882428Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-18T01:47:09.882414Z","tags":[],"group_ids":[]} 2024-09-18T01:47:11.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.809+0000 7f49557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:47:11.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.809+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94700638409152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562135ed69b0 con 0x562135e8cc50 2024-09-18T01:47:11.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.810+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94700638409152] v33'278 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4a8801f020 con 0x562135e8cc50 2024-09-18T01:47:11.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.810+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94700638403296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562135ed69b0 con 0x7f4a9803f060 2024-09-18T01:47:11.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.811+0000 7f4a9eb13640 1 -- 172.21.15.146:0/1924111715 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94700638403296] v33'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a900a6040 con 0x7f4a9803f060 2024-09-18T01:47:11.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.811+0000 7f4aa2f26800 20 remove_watcher() i=0 2024-09-18T01:47:11.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.811+0000 7f4aa2f26800 2 removed watcher, disabling cache 2024-09-18T01:47:11.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.811+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94700638407024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562135ed69b0 con 0x562135e8cc50 2024-09-18T01:47:11.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.812+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94700638407024] v33'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a8801f020 con 0x562135e8cc50 2024-09-18T01:47:11.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.812+0000 7f4aa2f26800 20 remove_watcher() i=1 2024-09-18T01:47:11.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.812+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94700638411920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562135ed69b0 con 0x562135e92ef0 2024-09-18T01:47:11.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.814+0000 7f4a9f314640 1 -- 172.21.15.146:0/1924111715 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94700638411920] v33'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a9803c030 con 0x562135e92ef0 2024-09-18T01:47:11.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.814+0000 7f4aa2f26800 20 remove_watcher() i=2 2024-09-18T01:47:11.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.814+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94700638415584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562135ed69b0 con 0x7f4a9803f060 2024-09-18T01:47:11.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.815+0000 7f4a9eb13640 1 -- 172.21.15.146:0/1924111715 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94700638415584] v33'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a900a6040 con 0x7f4a9803f060 2024-09-18T01:47:11.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.815+0000 7f4aa2f26800 20 remove_watcher() i=3 2024-09-18T01:47:11.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.815+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94700638418384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562135ed69b0 con 0x562135e8cc50 2024-09-18T01:47:11.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.816+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 <== osd.1 v2:172.21.15.146:6808/3930274777 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94700638418384] v33'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a8801f020 con 0x562135e8cc50 2024-09-18T01:47:11.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.816+0000 7f4aa2f26800 20 remove_watcher() i=4 2024-09-18T01:47:11.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.816+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94700638422416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562135ed69b0 con 0x7f4a9005f040 2024-09-18T01:47:11.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.817+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94700638422416] v33'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a8801f020 con 0x7f4a9005f040 2024-09-18T01:47:11.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.817+0000 7f4aa2f26800 20 remove_watcher() i=5 2024-09-18T01:47:11.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.817+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94700638420544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562135ed69b0 con 0x7f4a9005f040 2024-09-18T01:47:11.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.818+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94700638420544] v33'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a8801f020 con 0x7f4a9005f040 2024-09-18T01:47:11.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.818+0000 7f4aa2f26800 20 remove_watcher() i=6 2024-09-18T01:47:11.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.818+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1924111715 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94700638425984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562135ed1f00 con 0x7f4a9005f040 2024-09-18T01:47:11.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.819+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94700638425984] v33'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a8801f020 con 0x7f4a9005f040 2024-09-18T01:47:11.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.819+0000 7f4aa2f26800 20 remove_watcher() i=7 2024-09-18T01:47:11.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.819+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1924111715 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f4a9005f040 msgr2=0x7f4a90090200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.819+0000 7f4aa2f26800 1 --2- 172.21.15.146:0/1924111715 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f4a9005f040 0x7f4a90090200 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.819+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1924111715 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x562135e8cc50 msgr2=0x562135e8f110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.819+0000 7f4aa2f26800 1 --2- 172.21.15.146:0/1924111715 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x562135e8cc50 0x562135e8f110 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.819+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1924111715 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f4a9803f060 msgr2=0x7f4a98022420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.819+0000 7f4aa2f26800 1 --2- 172.21.15.146:0/1924111715 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f4a9803f060 0x7f4a98022420 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.819+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1924111715 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x562135e92ef0 msgr2=0x562135e95300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.819+0000 7f4aa2f26800 1 --2- 172.21.15.146:0/1924111715 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x562135e92ef0 0x562135e95300 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.819+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1924111715 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f4968036af0 msgr2=0x7f4968038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.819+0000 7f4aa2f26800 1 --2- 172.21.15.146:0/1924111715 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f4968036af0 0x7f4968038fb0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f4a9000a330 tx=0x7f4a9008b000 comp rx=0 tx=0).stop 2024-09-18T01:47:11.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.819+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1924111715 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562135e4fea0 msgr2=0x562135e80fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.819+0000 7f4a96312640 1 -- 172.21.15.146:0/1924111715 reap_dead start 2024-09-18T01:47:11.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.819+0000 7f4aa2f26800 1 --2- 172.21.15.146:0/1924111715 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562135e4fea0 0x562135e80fa0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f4a9804ca10 tx=0x7f4a9804c820 comp rx=0 tx=0).stop 2024-09-18T01:47:11.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.819+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1924111715 shutdown_connections 2024-09-18T01:47:11.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.819+0000 7f4aa2f26800 1 --2- 172.21.15.146:0/1924111715 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562135e4fea0 0x562135e80fa0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.819+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1924111715 >> 172.21.15.146:0/1924111715 conn(0x562135e73c40 msgr2=0x562135e71d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:11.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.819+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1924111715 shutdown_connections 2024-09-18T01:47:11.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.819+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1924111715 wait complete. 2024-09-18T01:47:11.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.820+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1709566303 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f4978036b90 msgr2=0x7f4978039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.820+0000 7f4aa2f26800 1 --2- 172.21.15.146:0/1709566303 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f4978036b90 0x7f4978039050 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x562135e587d0 tx=0x7f4a9005e840 comp rx=0 tx=0).stop 2024-09-18T01:47:11.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.820+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1709566303 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562135e6ac40 msgr2=0x562135e6b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.820+0000 7f4aa2f26800 1 --2- 172.21.15.146:0/1709566303 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562135e6ac40 0x562135e6b060 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x562135e57990 tx=0x7f4a980178e0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.820+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1709566303 shutdown_connections 2024-09-18T01:47:11.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.820+0000 7f4aa2f26800 1 --2- 172.21.15.146:0/1709566303 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f4978036b90 0x7f4978039050 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.820+0000 7f4aa2f26800 1 --2- 172.21.15.146:0/1709566303 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562135e6ac40 0x562135e6b060 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.820+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1709566303 >> 172.21.15.146:0/1709566303 conn(0x562135e5fbd0 msgr2=0x562135e62750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:11.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.820+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1709566303 shutdown_connections 2024-09-18T01:47:11.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.820+0000 7f4aa2f26800 1 -- 172.21.15.146:0/1709566303 wait complete. 2024-09-18T01:47:11.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.820+0000 7f4aa2f26800 1 -- 172.21.15.146:0/3516478290 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x562135d58e20 msgr2=0x562135e56f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.820+0000 7f4aa2f26800 1 --2- 172.21.15.146:0/3516478290 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x562135d58e20 0x562135e56f90 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.820+0000 7f4aa2f26800 1 -- 172.21.15.146:0/3516478290 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x562135e58ed0 msgr2=0x562135e5c770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.820+0000 7f4aa2f26800 1 --2- 172.21.15.146:0/3516478290 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x562135e58ed0 0x562135e5c770 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.820+0000 7f4aa2f26800 1 -- 172.21.15.146:0/3516478290 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f4984036b90 msgr2=0x7f4984039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.820+0000 7f4aa2f26800 1 --2- 172.21.15.146:0/3516478290 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f4984036b90 0x7f4984039050 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4a88000c00 tx=0x7f4a880013b0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.820+0000 7f4aa2f26800 1 -- 172.21.15.146:0/3516478290 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562135d584e0 msgr2=0x562135ccd600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:47:11.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.820+0000 7f4aa2f26800 1 --2- 172.21.15.146:0/3516478290 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562135d584e0 0x562135ccd600 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f4a90045f20 tx=0x7f4a90002fb0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.820+0000 7f4aa2f26800 1 -- 172.21.15.146:0/3516478290 shutdown_connections 2024-09-18T01:47:11.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.820+0000 7f4aa2f26800 1 --2- 172.21.15.146:0/3516478290 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x562135e58ed0 0x562135e5c770 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.820+0000 7f4aa2f26800 1 --2- 172.21.15.146:0/3516478290 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x562135d58e20 0x562135e56f90 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.820+0000 7f4aa2f26800 1 --2- 172.21.15.146:0/3516478290 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f4984036b90 0x7f4984039050 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.820+0000 7f4aa2f26800 1 --2- 172.21.15.146:0/3516478290 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x562135d584e0 0x562135ccd600 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:47:11.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.820+0000 7f4aa2f26800 1 -- 172.21.15.146:0/3516478290 >> 172.21.15.146:0/3516478290 conn(0x562135d53db0 msgr2=0x562135e41870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:47:11.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.820+0000 7f4aa2f26800 1 -- 172.21.15.146:0/3516478290 shutdown_connections 2024-09-18T01:47:11.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:47:11.820+0000 7f4aa2f26800 1 -- 172.21.15.146:0/3516478290 wait complete. 2024-09-18T01:47:11.856 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T01:47:09.882428Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:47:09.882414Z', 'tags': [], 'group_ids': []} 2024-09-18T01:47:11.856 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-18T01:47:09.882428Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-18T01:47:09.882414Z', 'tags': [], 'group_ids': []} 2024-09-18T01:47:11.856 ERROR:root:0 2024-09-18T01:47:11.856 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-18T01:47:11.863 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T01:47:11.863 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-18T01:47:11.867 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T01:47:11.867 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-18T01:47:11.873 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T01:47:11.873 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-18T01:47:11.879 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T01:47:11.880 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'create'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'} 2024-09-18T01:47:11.887 INFO:tasks.radosgw_admin_rest: json result: [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}] 2024-09-18T01:47:11.888 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-18T01:47:11.891 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T01:47:11.891 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ'} 2024-09-18T01:47:11.898 INFO:tasks.radosgw_admin_rest: empty result 2024-09-18T01:47:11.898 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-18T01:47:11.901 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T01:47:11.902 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo1', 'secret-key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'key-type': 'swift'} 2024-09-18T01:47:11.909 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}] 2024-09-18T01:47:11.909 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-18T01:47:11.913 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T01:47:11.913 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo2', 'secret-key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'key-type': 'swift'} 2024-09-18T01:47:11.920 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}] 2024-09-18T01:47:11.921 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-18T01:47:11.924 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T01:47:11.924 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'subuser': 'foo:foo1', 'key-type': 'swift'} 2024-09-18T01:47:11.932 INFO:tasks.radosgw_admin_rest: empty result 2024-09-18T01:47:11.932 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-18T01:47:11.935 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T01:47:11.936 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo1'} 2024-09-18T01:47:11.941 INFO:tasks.radosgw_admin_rest: empty result 2024-09-18T01:47:11.941 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-18T01:47:11.945 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T01:47:11.945 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo2', 'key-type': 'swift', '{purge-keys': True} 2024-09-18T01:47:11.951 INFO:tasks.radosgw_admin_rest: empty result 2024-09-18T01:47:11.952 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-18T01:47:11.955 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T01:47:11.955 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-18T01:47:11.959 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-18T01:47:11.960 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-18T01:47:11.964 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-18T01:47:11.975 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-18T01:47:11.979 INFO:tasks.radosgw_admin_rest: json result: ['myfoo'] 2024-09-18T01:47:11.979 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-18T01:47:11.984 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '069822df-7f2c-4cd0-aee2-64a07ebf49c5', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.11', 'marker': '8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-18T01:47:11.970711Z', 'creation_time': '2024-09-18T01:47:11.967687Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-18T01:47:11.984 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-18T01:47:11.989 INFO:tasks.radosgw_admin_rest: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '069822df-7f2c-4cd0-aee2-64a07ebf49c5', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.11', 'marker': '8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-18T01:47:11.970711Z', 'creation_time': '2024-09-18T01:47:11.967687Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-09-18T01:47:11.993 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-18T01:47:11.997 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '069822df-7f2c-4cd0-aee2-64a07ebf49c5', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.11', 'marker': '8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-18T01:47:11.970711Z', 'creation_time': '2024-09-18T01:47:11.967687Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-18T01:47:11.998 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'doesnotexist'} 2024-09-18T01:47:12.002 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchBucket', 'Message': '', 'RequestId': 'tx000008167d0c507d97839-0066ea3120-4236-default', 'HostId': '4236-default-default'} 2024-09-18T01:47:12.007 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'unlink'] {'uid': 'foo', 'bucket': 'myfoo'} 2024-09-18T01:47:12.013 INFO:tasks.radosgw_admin_rest: empty result 2024-09-18T01:47:12.014 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'fud', 'display-name': 'Fud', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'max-buckets': '1'} 2024-09-18T01:47:12.022 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T01:47:12.069 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'fud', 'bucket': 'myfoo', 'bucket-id': '8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.11'} 2024-09-18T01:47:12.081 INFO:tasks.radosgw_admin_rest: empty result 2024-09-18T01:47:12.083 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'foo', 'bucket': 'myfoo', 'bucket-id': '8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.11'} 2024-09-18T01:47:12.093 INFO:tasks.radosgw_admin_rest: empty result 2024-09-18T01:47:12.093 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'fud'} 2024-09-18T01:47:12.101 INFO:tasks.radosgw_admin_rest: empty result 2024-09-18T01:47:12.111 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['object', 'rm'] {'bucket': 'myfoo', 'object': 'four'} 2024-09-18T01:47:12.119 INFO:tasks.radosgw_admin_rest: empty result 2024-09-18T01:47:12.119 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-18T01:47:12.125 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '069822df-7f2c-4cd0-aee2-64a07ebf49c5', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.11', 'marker': '8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-18T01:47:12.088661Z', 'creation_time': '2024-09-18T01:47:11.967687Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-18T01:48:12.178 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'categories': 'delete_obj'} 2024-09-18T01:48:12.197 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'anonymous', 'categories': []}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'bar', 'categories': []}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'bud', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}, {'bucket': 'useless-bucket', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'fud', 'categories': []}, {'bucket': 'myfoo7', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'fud', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'bar', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'bud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}}, {'user': 'fud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}]} 2024-09-18T01:48:12.198 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] None 2024-09-18T01:48:12.213 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'fud', 'categories': [{'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 0, 'ops': 1, 'successful_ops': 0}]}, {'bucket': 'myfoo7', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 8, 'ops': 2, 'successful_ops': 2}}, {'user': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 16, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10}}, {'user': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 8, 'ops': 2, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 242, 'bytes_received': 8, 'ops': 5, 'successful_ops': 4}}]} 2024-09-18T01:48:12.213 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-18T01:48:12.218 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10}}]} 2024-09-18T01:48:12.218 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'create_bucket'} 2024-09-18T01:48:12.222 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'useless-bucket', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}}]} 2024-09-18T01:48:12.223 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'put_obj'} 2024-09-18T01:48:12.227 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}}]} 2024-09-18T01:48:12.227 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_obj'} 2024-09-18T01:48:12.231 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}, {'bucket': 'useless-bucket', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}}]} 2024-09-18T01:48:12.231 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_bucket'} 2024-09-18T01:48:12.235 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': []}, {'bucket': 'useless-bucket', 'time': '2024-09-18T01:00:00.000000Z', 'epoch': 1726621200, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}]} 2024-09-18T01:48:12.235 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'trim'] {'uid': 'foo'} 2024-09-18T01:48:12.242 INFO:tasks.radosgw_admin_rest: empty result 2024-09-18T01:48:12.242 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-18T01:48:12.248 INFO:tasks.radosgw_admin_rest: json result: {'entries': [], 'summary': []} 2024-09-18T01:48:12.249 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-18T01:48:12.257 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T01:48:12.261 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-18T01:48:12.269 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T01:48:12.526 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-18T01:48:12.530 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx00000288c347977620482-0066ea315c-4236-default', 'HostId': '4236-default-default'} 2024-09-18T01:48:12.634 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-18T01:48:12.638 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [], 'grant_map': [{'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-18T01:48:12.642 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-18T01:48:12.646 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [{'group': 1, 'acl': 1}], 'grant_map': [{'id': '', 'grant': {'type': {'type': 2}, 'group': 1, 'permission': {'flags': 1}}}, {'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-18T01:48:12.765 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'rm'] {'bucket': 'myfoo', 'purge-objects': True} 2024-09-18T01:48:12.809 INFO:tasks.radosgw_admin_rest: empty result 2024-09-18T01:48:12.809 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'add'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-18T01:48:12.816 INFO:tasks.radosgw_admin_rest: json result: [{'type': 'usage', 'perm': 'read'}] 2024-09-18T01:48:12.816 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'rm'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-18T01:48:12.822 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-18T01:48:12.832 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-18T01:48:12.836 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx00000a2c206515553fa8c-0066ea315c-4236-default', 'HostId': '4236-default-default'} 2024-09-18T01:48:12.857 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo', 'purge-data': True} 2024-09-18T01:48:12.890 INFO:tasks.radosgw_admin_rest: empty result 2024-09-18T01:48:12.890 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-18T01:48:12.895 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx00000340ae45b1e014bfb-0066ea315c-4236-default', 'HostId': '4236-default-default'} 2024-09-18T01:48:12.895 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['info', ''] None 2024-09-18T01:48:12.900 INFO:tasks.radosgw_admin_rest: json result: {'info': {'storage_backends': [{'name': 'rados', 'cluster_id': '5634e4ff-a0cf-4689-882d-342647f6e34c'}]}} 2024-09-18T01:48:12.900 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'ratelimit_user', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '1000'} 2024-09-18T01:48:12.911 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'ratelimit_user', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'ratelimit_user', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-18T01:48:12.912 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-18T01:48:12.916 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-18T01:48:12.917 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring'} 2024-09-18T01:48:12.921 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx0000043f6be52e8b887a7-0066ea315c-4236-default', 'HostId': '4236-default-default'} 2024-09-18T01:48:12.921 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user'} 2024-09-18T01:48:12.925 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx0000059701c94b909e468-0066ea315c-4236-default', 'HostId': '4236-default-default'} 2024-09-18T01:48:12.941 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-18T01:48:12.945 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-18T01:48:12.945 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring'} 2024-09-18T01:48:12.948 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000be39ac677fe79cba-0066ea315c-4236-default', 'HostId': '4236-default-default'} 2024-09-18T01:48:12.949 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket'} 2024-09-18T01:48:12.952 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000d9e45da1d7f066d1-0066ea315c-4236-default', 'HostId': '4236-default-default'} 2024-09-18T01:48:12.952 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'global': 'true'} 2024-09-18T01:48:12.956 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'anonymous_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-18T01:48:12.956 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring', 'enabled': 'true'} 2024-09-18T01:48:12.959 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000c2a206c72c5122a7-0066ea315c-4236-default', 'HostId': '4236-default-default'} 2024-09-18T01:48:12.960 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user'} 2024-09-18T01:48:12.963 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000e3117aa814d5279c-0066ea315c-4236-default', 'HostId': '4236-default-default'} 2024-09-18T01:48:12.963 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring', 'enabled': 'true'} 2024-09-18T01:48:12.967 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000eab680403c659563-0066ea315c-4236-default', 'HostId': '4236-default-default'} 2024-09-18T01:48:12.967 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'enabled': 'true'} 2024-09-18T01:48:12.970 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000b7be0705da88e365-0066ea315c-4236-default', 'HostId': '4236-default-default'} 2024-09-18T01:48:12.971 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user', 'enabled': 'true', 'max-read-bytes': '2'} 2024-09-18T01:48:12.980 INFO:tasks.radosgw_admin_rest: empty result 2024-09-18T01:48:12.980 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-18T01:48:12.983 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 2, 'max_write_bytes': 0, 'enabled': True}} 2024-09-18T01:48:12.984 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket', 'enabled': 'true', 'max-write-bytes': '2'} 2024-09-18T01:48:12.989 INFO:tasks.radosgw_admin_rest: empty result 2024-09-18T01:48:12.989 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-18T01:48:12.992 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 2, 'enabled': True}} 2024-09-18T01:48:12.992 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'global': 'true', 'enabled': 'true'} 2024-09-18T01:48:12.998 INFO:tasks.radosgw_admin_rest: empty result 2024-09-18T01:48:13.002 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-18T01:48:13.014 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-18T01:48:13.015 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T01:48:13.015 INFO:tasks.rgw.client.0.smithi146.stdout:2024-09-18T01:48:13.015+0000 7f19c48ed640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 36140) UID: 0 2024-09-18T01:48:13.016 INFO:tasks.rgw.client.0.smithi146.stdout:2024-09-18T01:48:13.015+0000 7f19c814d880 -1 shutting down 2024-09-18T01:48:19.117 INFO:tasks.rgw.client.0:Stopped 2024-09-18T01:48:19.118 DEBUG:teuthology.orchestra.run.smithi146:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-18T01:48:19.137 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f /etc/ceph/vault-root-token 2024-09-18T01:48:19.209 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-18T01:48:19.277 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-18T01:48:19.277 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-18T01:48:19.277 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-18T01:48:19.364 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setuser ceph since I am not root 2024-09-18T01:48:19.365 INFO:teuthology.orchestra.run.smithi146.stderr:ignoring --setgroup ceph since I am not root 2024-09-18T01:48:19.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.365+0000 7f043a926800 1 Processor -- start 2024-09-18T01:48:19.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.365+0000 7f043a926800 1 -- start start 2024-09-18T01:48:19.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.365+0000 7f043a926800 1 --2- >> v2:172.21.15.129:3300/0 conn(0x5562171776b0 0x5562172061d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:19.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.365+0000 7f043a926800 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5562170c2b30 con 0x556217206710 2024-09-18T01:48:19.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.365+0000 7f043a926800 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x5562170a4360 con 0x5562171776b0 2024-09-18T01:48:19.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.365+0000 7f04365e3640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x5562171776b0 0x5562172061d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:19.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.365+0000 7f042ffff640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x556217206710 0x556217208b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.146:36780/0 (socket says 172.21.15.146:36780) 2024-09-18T01:48:19.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.365+0000 7f042ffff640 1 -- 172.21.15.146:0/1127854200 learned_addr learned my addr 172.21.15.146:0/1127854200 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-18T01:48:19.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.366+0000 7f04365e3640 1 -- 172.21.15.146:0/1127854200 >> v1:172.21.15.129:6789/0 conn(0x556217206710 legacy=0x556217208b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:19.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.366+0000 7f04365e3640 1 -- 172.21.15.146:0/1127854200 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562170cae00 con 0x5562171776b0 2024-09-18T01:48:19.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.368+0000 7f04365e3640 1 --2- 172.21.15.146:0/1127854200 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562171776b0 0x5562172061d0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f042800a470 tx=0x7f0428045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e2e9a6e9281dee3 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:19.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.368+0000 7f0435de2640 1 -- 172.21.15.146:0/1127854200 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0428053570 con 0x5562171776b0 2024-09-18T01:48:19.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.368+0000 7f0435de2640 1 -- 172.21.15.146:0/1127854200 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0428058070 con 0x5562171776b0 2024-09-18T01:48:19.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.368+0000 7f0435de2640 1 -- 172.21.15.146:0/1127854200 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0428053880 con 0x5562171776b0 2024-09-18T01:48:19.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.368+0000 7f043a926800 1 -- 172.21.15.146:0/1127854200 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562171776b0 msgr2=0x5562172061d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:19.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.368+0000 7f043a926800 1 --2- 172.21.15.146:0/1127854200 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562171776b0 0x5562172061d0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f042800a470 tx=0x7f0428045a20 comp rx=0 tx=0).stop 2024-09-18T01:48:19.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.368+0000 7f043a926800 1 -- 172.21.15.146:0/1127854200 shutdown_connections 2024-09-18T01:48:19.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.368+0000 7f043a926800 1 --2- 172.21.15.146:0/1127854200 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562171776b0 0x5562172061d0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:19.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.368+0000 7f043a926800 1 -- 172.21.15.146:0/1127854200 >> 172.21.15.146:0/1127854200 conn(0x5562171fdde0 msgr2=0x556217200200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:48:19.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.368+0000 7f043a926800 1 -- 172.21.15.146:0/1127854200 shutdown_connections 2024-09-18T01:48:19.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.368+0000 7f043a926800 1 -- 172.21.15.146:0/1127854200 wait complete. 2024-09-18T01:48:19.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.383+0000 7f043a926800 1 Processor -- start 2024-09-18T01:48:19.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.383+0000 7f043a926800 1 -- start start 2024-09-18T01:48:19.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.384+0000 7f043a926800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562171776b0 0x5562172f28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:19.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.384+0000 7f043a926800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55621714f330 con 0x5562171776b0 2024-09-18T01:48:19.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.384+0000 7f04365e3640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562171776b0 0x5562172f28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:19.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.384+0000 7f04365e3640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562171776b0 0x5562172f28c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:40004/0 (socket says 172.21.15.146:40004) 2024-09-18T01:48:19.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.384+0000 7f04365e3640 1 -- 172.21.15.146:0/815127985 learned_addr learned my addr 172.21.15.146:0/815127985 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:48:19.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.384+0000 7f04365e3640 1 -- 172.21.15.146:0/815127985 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55621709cbc0 con 0x5562171776b0 2024-09-18T01:48:19.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.384+0000 7f04365e3640 1 --2- 172.21.15.146:0/815127985 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562171776b0 0x5562172f28c0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f0428025c20 tx=0x7f0428051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb3fd4c46a576f46 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:19.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.385+0000 7f0324608640 1 -- 172.21.15.146:0/815127985 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f042805c580 con 0x5562171776b0 2024-09-18T01:48:19.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.385+0000 7f0324608640 1 -- 172.21.15.146:0/815127985 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0428063030 con 0x5562171776b0 2024-09-18T01:48:19.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.385+0000 7f0324608640 1 -- 172.21.15.146:0/815127985 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f042805c850 con 0x5562171776b0 2024-09-18T01:48:19.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.385+0000 7f043a926800 1 -- 172.21.15.146:0/815127985 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562171776b0 msgr2=0x5562172f28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:19.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.385+0000 7f043a926800 1 --2- 172.21.15.146:0/815127985 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562171776b0 0x5562172f28c0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f0428025c20 tx=0x7f0428051000 comp rx=0 tx=0).stop 2024-09-18T01:48:19.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.385+0000 7f043a926800 1 -- 172.21.15.146:0/815127985 shutdown_connections 2024-09-18T01:48:19.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.385+0000 7f043a926800 1 --2- 172.21.15.146:0/815127985 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562171776b0 0x5562172f28c0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:19.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.385+0000 7f043a926800 1 -- 172.21.15.146:0/815127985 >> 172.21.15.146:0/815127985 conn(0x5562171fdde0 msgr2=0x5562172ee280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:48:19.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.385+0000 7f043a926800 1 -- 172.21.15.146:0/815127985 shutdown_connections 2024-09-18T01:48:19.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.385+0000 7f043a926800 1 -- 172.21.15.146:0/815127985 wait complete. 2024-09-18T01:48:19.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.386+0000 7f043a926800 1 Processor -- start 2024-09-18T01:48:19.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.386+0000 7f043a926800 1 -- start start 2024-09-18T01:48:19.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.386+0000 7f043a926800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562171776b0 0x556217203ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:19.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.386+0000 7f043a926800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55621720a680 con 0x5562171776b0 2024-09-18T01:48:19.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.386+0000 7f04365e3640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562171776b0 0x556217203ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:19.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.386+0000 7f04365e3640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562171776b0 0x556217203ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:40018/0 (socket says 172.21.15.146:40018) 2024-09-18T01:48:19.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.386+0000 7f04365e3640 1 -- 172.21.15.146:0/2057475310 learned_addr learned my addr 172.21.15.146:0/2057475310 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:48:19.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.387+0000 7f04365e3640 1 -- 172.21.15.146:0/2057475310 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562170b0fe0 con 0x5562171776b0 2024-09-18T01:48:19.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.387+0000 7f04365e3640 1 --2- 172.21.15.146:0/2057475310 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562171776b0 0x556217203ae0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x5562172f3720 tx=0x7f0428002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:19.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.387+0000 7f0322e05640 1 -- 172.21.15.146:0/2057475310 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0428054af0 con 0x5562171776b0 2024-09-18T01:48:19.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.387+0000 7f0322e05640 1 -- 172.21.15.146:0/2057475310 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0428054c90 con 0x5562171776b0 2024-09-18T01:48:19.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.387+0000 7f0322e05640 1 -- 172.21.15.146:0/2057475310 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0428068420 con 0x5562171776b0 2024-09-18T01:48:19.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.387+0000 7f043a926800 1 -- 172.21.15.146:0/2057475310 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5562172021d0 con 0x5562171776b0 2024-09-18T01:48:19.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.387+0000 7f043a926800 1 -- 172.21.15.146:0/2057475310 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562172026f0 con 0x5562171776b0 2024-09-18T01:48:19.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.388+0000 7f0322e05640 1 -- 172.21.15.146:0/2057475310 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f04280685c0 con 0x5562171776b0 2024-09-18T01:48:19.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.388+0000 7f0322e05640 1 --2- 172.21.15.146:0/2057475310 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f031c036b40 0x7f031c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:19.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.388+0000 7f0322e05640 1 -- 172.21.15.146:0/2057475310 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f0428070030 con 0x5562171776b0 2024-09-18T01:48:19.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.388+0000 7f042ffff640 1 --2- 172.21.15.146:0/2057475310 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f031c036b40 0x7f031c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:19.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.388+0000 7f043a926800 1 --2- 172.21.15.146:0/2057475310 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x556217206710 0x556217303610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:19.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.388+0000 7f043a926800 1 -- 172.21.15.146:0/2057475310 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217303b50 con 0x556217206710 2024-09-18T01:48:19.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.388+0000 7f0436de4640 1 --2- 172.21.15.146:0/2057475310 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x556217206710 0x556217303610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:19.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.389+0000 7f042ffff640 1 --2- 172.21.15.146:0/2057475310 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f031c036b40 0x7f031c039000 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x556217177050 tx=0x7f04200012f0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:19.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.389+0000 7f0436de4640 1 --2- 172.21.15.146:0/2057475310 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x556217206710 0x556217303610 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:19.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.389+0000 7f0436de4640 1 -- 172.21.15.146:0/2057475310 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f043000a4a0 con 0x556217206710 2024-09-18T01:48:19.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.389+0000 7f043a926800 1 -- 172.21.15.146:0/2057475310 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217303f30 con 0x556217206710 2024-09-18T01:48:19.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.390+0000 7f0436de4640 1 -- 172.21.15.146:0/2057475310 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f043000a4a0 con 0x556217206710 2024-09-18T01:48:19.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.390+0000 7f043a926800 1 -- 172.21.15.146:0/2057475310 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217305800 con 0x556217206710 2024-09-18T01:48:19.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.390+0000 7f0436de4640 1 -- 172.21.15.146:0/2057475310 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f043000a4a0 con 0x556217206710 2024-09-18T01:48:19.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.390+0000 7f043a926800 1 -- 172.21.15.146:0/2057475310 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217304a30 con 0x556217206710 2024-09-18T01:48:19.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.390+0000 7f0436de4640 1 -- 172.21.15.146:0/2057475310 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f043000a4a0 con 0x556217206710 2024-09-18T01:48:19.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.390+0000 7f043a926800 1 --2- 172.21.15.146:0/2057475310 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x556217306bb0 0x556217308fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:19.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.390+0000 7f043a926800 1 -- 172.21.15.146:0/2057475310 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:5 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5562173094e0 con 0x556217306bb0 2024-09-18T01:48:19.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.390+0000 7f04365e3640 1 --2- 172.21.15.146:0/2057475310 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x556217306bb0 0x556217308fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:19.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.391+0000 7f04365e3640 1 --2- 172.21.15.146:0/2057475310 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x556217306bb0 0x556217308fa0 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:19.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.391+0000 7f04365e3640 1 -- 172.21.15.146:0/2057475310 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(5 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0428051070 con 0x556217306bb0 2024-09-18T01:48:19.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.391+0000 7f043a926800 1 Processor -- start 2024-09-18T01:48:19.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.391+0000 7f043a926800 1 -- start start 2024-09-18T01:48:19.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.391+0000 7f043a926800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556217317180 0x5562173175a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:19.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.391+0000 7f043a926800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x55621709e580 con 0x556217317180 2024-09-18T01:48:19.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.392+0000 7f0436de4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556217317180 0x5562173175a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:19.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.392+0000 7f0436de4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556217317180 0x5562173175a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:40028/0 (socket says 172.21.15.146:40028) 2024-09-18T01:48:19.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.392+0000 7f0436de4640 1 -- 172.21.15.146:0/2693073136 learned_addr learned my addr 172.21.15.146:0/2693073136 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:48:19.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.392+0000 7f0436de4640 1 -- 172.21.15.146:0/2693073136 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556217317ae0 con 0x556217317180 2024-09-18T01:48:19.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.393+0000 7f0436de4640 1 --2- 172.21.15.146:0/2693073136 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556217317180 0x5562173175a0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x5562172032f0 tx=0x7f04300178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:19.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.393+0000 7f031bfff640 1 -- 172.21.15.146:0/2693073136 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0430013440 con 0x556217317180 2024-09-18T01:48:19.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.393+0000 7f031bfff640 1 -- 172.21.15.146:0/2693073136 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04300135e0 con 0x556217317180 2024-09-18T01:48:19.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.393+0000 7f043a926800 1 -- 172.21.15.146:0/2693073136 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556217317d70 con 0x556217317180 2024-09-18T01:48:19.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.393+0000 7f031bfff640 1 -- 172.21.15.146:0/2693073136 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04300138c0 con 0x556217317180 2024-09-18T01:48:19.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.393+0000 7f043a926800 1 -- 172.21.15.146:0/2693073136 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55621731aa50 con 0x556217317180 2024-09-18T01:48:19.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.394+0000 7f031bfff640 1 -- 172.21.15.146:0/2693073136 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0430011040 con 0x556217317180 2024-09-18T01:48:19.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.394+0000 7f031bfff640 1 --2- 172.21.15.146:0/2693073136 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0310036b40 0x7f0310039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:19.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.394+0000 7f031bfff640 1 -- 172.21.15.146:0/2693073136 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f043001d070 con 0x556217317180 2024-09-18T01:48:19.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.394+0000 7f04365e3640 1 --2- 172.21.15.146:0/2693073136 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0310036b40 0x7f0310039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:19.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.394+0000 7f043a926800 1 Processor -- start 2024-09-18T01:48:19.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.394+0000 7f043a926800 1 -- start start 2024-09-18T01:48:19.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.394+0000 7f04365e3640 1 --2- 172.21.15.146:0/2693073136 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0310036b40 0x7f0310039000 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f042808f240 tx=0x7f04280747a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:19.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.394+0000 7f043a926800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556217323e20 0x556217324200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:19.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.394+0000 7f043a926800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x5562172f3010 con 0x556217323e20 2024-09-18T01:48:19.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.395+0000 7f0436de4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556217323e20 0x556217324200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:19.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.395+0000 7f0436de4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556217323e20 0x556217324200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:40036/0 (socket says 172.21.15.146:40036) 2024-09-18T01:48:19.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.395+0000 7f0436de4640 1 -- 172.21.15.146:0/1610854571 learned_addr learned my addr 172.21.15.146:0/1610854571 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:48:19.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.395+0000 7f0436de4640 1 -- 172.21.15.146:0/1610854571 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556217324740 con 0x556217323e20 2024-09-18T01:48:19.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.395+0000 7f0436de4640 1 --2- 172.21.15.146:0/1610854571 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556217323e20 0x556217324200 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f043004c8f0 tx=0x7f0430001f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a3268509df56001 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:19.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.395+0000 7f0319ffb640 1 -- 172.21.15.146:0/1610854571 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f043004e110 con 0x556217323e20 2024-09-18T01:48:19.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.395+0000 7f0319ffb640 1 -- 172.21.15.146:0/1610854571 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f043004e2b0 con 0x556217323e20 2024-09-18T01:48:19.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.395+0000 7f0319ffb640 1 -- 172.21.15.146:0/1610854571 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f043004b250 con 0x556217323e20 2024-09-18T01:48:19.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.396+0000 7f043a926800 1 -- 172.21.15.146:0/1610854571 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556217323e20 msgr2=0x556217324200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:19.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.396+0000 7f043a926800 1 --2- 172.21.15.146:0/1610854571 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556217323e20 0x556217324200 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f043004c8f0 tx=0x7f0430001f60 comp rx=0 tx=0).stop 2024-09-18T01:48:19.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.396+0000 7f043a926800 1 -- 172.21.15.146:0/1610854571 shutdown_connections 2024-09-18T01:48:19.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.396+0000 7f043a926800 1 --2- 172.21.15.146:0/1610854571 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556217323e20 0x556217324200 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:19.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.396+0000 7f043a926800 1 -- 172.21.15.146:0/1610854571 >> 172.21.15.146:0/1610854571 conn(0x5562173201d0 msgr2=0x55621731e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:48:19.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.396+0000 7f043a926800 1 -- 172.21.15.146:0/1610854571 shutdown_connections 2024-09-18T01:48:19.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.396+0000 7f043a926800 1 -- 172.21.15.146:0/1610854571 wait complete. 2024-09-18T01:48:19.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.396+0000 7f043a926800 1 Processor -- start 2024-09-18T01:48:19.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.396+0000 7f043a926800 1 -- start start 2024-09-18T01:48:19.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.396+0000 7f043a926800 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556217323e20 0x55621732b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:19.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.396+0000 7f043a926800 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x556217324e00 con 0x556217323e20 2024-09-18T01:48:19.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.397+0000 7f0436de4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556217323e20 0x55621732b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:19.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.397+0000 7f0436de4640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556217323e20 0x55621732b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.146:40044/0 (socket says 172.21.15.146:40044) 2024-09-18T01:48:19.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.397+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 learned_addr learned my addr 172.21.15.146:0/3475887804 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-18T01:48:19.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.397+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55621732b7e0 con 0x556217323e20 2024-09-18T01:48:19.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.397+0000 7f0436de4640 1 --2- 172.21.15.146:0/3475887804 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556217323e20 0x55621732b2a0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f043004c8f0 tx=0x7f043004c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:19.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.397+0000 7f0307fff640 1 -- 172.21.15.146:0/3475887804 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0430046040 con 0x556217323e20 2024-09-18T01:48:19.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.397+0000 7f0307fff640 1 -- 172.21.15.146:0/3475887804 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0430041050 con 0x556217323e20 2024-09-18T01:48:19.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.397+0000 7f0307fff640 1 -- 172.21.15.146:0/3475887804 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f043004e110 con 0x556217323e20 2024-09-18T01:48:19.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.397+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55621732ba70 con 0x556217323e20 2024-09-18T01:48:19.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.397+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55621732e720 con 0x556217323e20 2024-09-18T01:48:19.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.398+0000 7f0307fff640 1 -- 172.21.15.146:0/3475887804 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f043004ca30 con 0x556217323e20 2024-09-18T01:48:19.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.398+0000 7f0307fff640 1 --2- 172.21.15.146:0/3475887804 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0300036b40 0x7f0300039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:19.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.398+0000 7f0307fff640 1 -- 172.21.15.146:0/3475887804 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f0430034070 con 0x556217323e20 2024-09-18T01:48:19.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.398+0000 7f04365e3640 1 --2- 172.21.15.146:0/3475887804 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0300036b40 0x7f0300039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:19.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.399+0000 7f04365e3640 1 --2- 172.21.15.146:0/3475887804 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0300036b40 0x7f0300039000 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f04280095b0 tx=0x7f042808b000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:19.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.399+0000 7f043a926800 20 rados->read ofs=0 len=0 2024-09-18T01:48:19.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.399+0000 7f043a926800 1 --2- 172.21.15.146:0/3475887804 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x556217336f60 0x556217339420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:19.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.399+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217339b70 con 0x556217336f60 2024-09-18T01:48:19.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.399+0000 7f042ffff640 1 --2- 172.21.15.146:0/3475887804 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x556217336f60 0x556217339420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:19.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.399+0000 7f042ffff640 1 --2- 172.21.15.146:0/3475887804 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x556217336f60 0x556217339420 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:19.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.400+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0420009050 con 0x556217336f60 2024-09-18T01:48:19.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.400+0000 7f043a926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:48:19.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.400+0000 7f043a926800 20 realm 2024-09-18T01:48:19.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.400+0000 7f043a926800 20 rados->read ofs=0 len=0 2024-09-18T01:48:19.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.400+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5562173363b0 con 0x556217336f60 2024-09-18T01:48:19.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.400+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0420009050 con 0x556217336f60 2024-09-18T01:48:19.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.400+0000 7f043a926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:48:19.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.400+0000 7f043a926800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-18T01:48:19.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.400+0000 7f043a926800 20 rados->read ofs=0 len=0 2024-09-18T01:48:19.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.400+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55621733a640 con 0x556217336f60 2024-09-18T01:48:19.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.400+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0420009050 con 0x556217336f60 2024-09-18T01:48:19.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.400+0000 7f043a926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:48:19.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.400+0000 7f043a926800 20 rados->read ofs=0 len=0 2024-09-18T01:48:19.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.400+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55621733af10 con 0x556217336f60 2024-09-18T01:48:19.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.400+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0420009050 con 0x556217336f60 2024-09-18T01:48:19.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.400+0000 7f043a926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:48:19.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.400+0000 7f043a926800 20 rados->read ofs=0 len=0 2024-09-18T01:48:19.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.400+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:5 5.18 5:1ea7cc79:::zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55621733b2b0 con 0x556217336f60 2024-09-18T01:48:19.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.401+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 5 ==== osd_op_reply(5 zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0420009050 con 0x556217336f60 2024-09-18T01:48:19.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.401+0000 7f043a926800 20 rados_obj.operate() r=0 bl.length=993 2024-09-18T01:48:19.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.401+0000 7f043a926800 20 searching for the correct realm 2024-09-18T01:48:19.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.401+0000 7f043a926800 1 --2- 172.21.15.146:0/3475887804 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55621733d190 0x55621733f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:19.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.401+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55621733fc30 con 0x55621733d190 2024-09-18T01:48:19.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.401+0000 7f0436de4640 1 --2- 172.21.15.146:0/3475887804 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55621733d190 0x55621733f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:19.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.401+0000 7f0436de4640 1 --2- 172.21.15.146:0/3475887804 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55621733d190 0x55621733f580 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:19.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.401+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.401+0000 7f0436de4640 1 --2- 172.21.15.146:0/3475887804 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f043005b040 0x7f0430052940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:19.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.401+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55621733fc30 con 0x7f043005b040 2024-09-18T01:48:19.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.402+0000 7f04365e3640 1 --2- 172.21.15.146:0/3475887804 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f043005b040 0x7f0430052940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:19.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.402+0000 7f04365e3640 1 --2- 172.21.15.146:0/3475887804 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f043005b040 0x7f0430052940 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:19.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.402+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.402+0000 7f04365e3640 1 --2- 172.21.15.146:0/3475887804 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f042805c070 0x7f0428090330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:19.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.402+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55621733fc30 con 0x7f042805c070 2024-09-18T01:48:19.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.402+0000 7f042ffff640 1 --2- 172.21.15.146:0/3475887804 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f042805c070 0x7f0428090330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:19.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.403+0000 7f042ffff640 1 --2- 172.21.15.146:0/3475887804 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f042805c070 0x7f0428090330 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:19.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.403+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0420009050 con 0x7f042805c070 2024-09-18T01:48:19.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.403+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55621733fc30 con 0x556217336f60 2024-09-18T01:48:19.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.403+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=107b] v33'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0420009050 con 0x556217336f60 2024-09-18T01:48:19.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.403+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55621733fc30 con 0x556217336f60 2024-09-18T01:48:19.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.404+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.404+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55621733fc30 con 0x7f042805c070 2024-09-18T01:48:19.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.404+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.404+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55621733fc30 con 0x7f042805c070 2024-09-18T01:48:19.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.404+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.404+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55621733fc30 con 0x7f043005b040 2024-09-18T01:48:19.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.405+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.405+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55621733fc30 con 0x55621733d190 2024-09-18T01:48:19.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.405+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.405+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55621733fc30 con 0x556217336f60 2024-09-18T01:48:19.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.405+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.405+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55621733fc30 con 0x7f042805c070 2024-09-18T01:48:19.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.405+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.405+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55621733fc30 con 0x556217336f60 2024-09-18T01:48:19.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.405+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.405+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55621733fc30 con 0x7f043005b040 2024-09-18T01:48:19.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.406+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.406+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55621733fc30 con 0x55621733d190 2024-09-18T01:48:19.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.406+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.406+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55621733fc30 con 0x55621733d190 2024-09-18T01:48:19.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.406+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.406+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55621733fc30 con 0x7f042805c070 2024-09-18T01:48:19.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.406+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.406+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55621733fc30 con 0x55621733d190 2024-09-18T01:48:19.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.407+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.407+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55621733fc30 con 0x55621733d190 2024-09-18T01:48:19.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.407+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.407+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55621733fc30 con 0x556217336f60 2024-09-18T01:48:19.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.407+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.407+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55621733fc30 con 0x556217336f60 2024-09-18T01:48:19.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.407+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v33'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.407+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55621733fc30 con 0x7f042805c070 2024-09-18T01:48:19.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.408+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.408+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55621733fc30 con 0x55621733d190 2024-09-18T01:48:19.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.408+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.408+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55621733fc30 con 0x7f043005b040 2024-09-18T01:48:19.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.408+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.408+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55621733fc30 con 0x556217336f60 2024-09-18T01:48:19.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.408+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.408+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55621733fc30 con 0x7f042805c070 2024-09-18T01:48:19.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.409+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=82b] v33'1 uv1 ondisk = 1) ==== 144+0+82 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.409+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55621733fc30 con 0x55621733d190 2024-09-18T01:48:19.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.409+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.409+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55621733fc30 con 0x7f042805c070 2024-09-18T01:48:19.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.409+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.409+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55621733fc30 con 0x7f043005b040 2024-09-18T01:48:19.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.410+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.410+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55621733fc30 con 0x55621733d190 2024-09-18T01:48:19.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.410+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.410+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55621733fc30 con 0x7f042805c070 2024-09-18T01:48:19.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.410+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.410+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55621733fc30 con 0x556217336f60 2024-09-18T01:48:19.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.410+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v33'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.410+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55621733fc30 con 0x7f043005b040 2024-09-18T01:48:19.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.411+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.411+0000 7f043a926800 20 RGWRados::pool_iterate: got zone_info.8ac01ed4-7422-45e2-b799-bf55088fb4fc 2024-09-18T01:48:19.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.411+0000 7f043a926800 20 RGWRados::pool_iterate: got zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 2024-09-18T01:48:19.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.411+0000 7f043a926800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-18T01:48:19.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.411+0000 7f043a926800 20 RGWRados::pool_iterate: got default.zone. 2024-09-18T01:48:19.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.411+0000 7f043a926800 20 RGWRados::pool_iterate: got period_config.default 2024-09-18T01:48:19.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.411+0000 7f043a926800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-18T01:48:19.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.411+0000 7f043a926800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-18T01:48:19.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.411+0000 7f043a926800 20 rados->read ofs=0 len=0 2024-09-18T01:48:19.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.411+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55621733bc30 con 0x556217336f60 2024-09-18T01:48:19.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.411+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.411+0000 7f043a926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:48:19.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.411+0000 7f043a926800 20 rados->read ofs=0 len=0 2024-09-18T01:48:19.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.411+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55621733c4d0 con 0x556217336f60 2024-09-18T01:48:19.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.411+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.411+0000 7f043a926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-18T01:48:19.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.411+0000 7f043a926800 20 rados->read ofs=0 len=0 2024-09-18T01:48:19.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.411+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:40 5.6 5:64025266:::zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5562173400b0 con 0x7f043005b040 2024-09-18T01:48:19.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.411+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 7 ==== osd_op_reply(40 zonegroup_info.069822df-7f2c-4cd0-aee2-64a07ebf49c5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.411+0000 7f043a926800 20 rados_obj.operate() r=0 bl.length=436 2024-09-18T01:48:19.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.411+0000 7f043a926800 20 zone default found 2024-09-18T01:48:19.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.411+0000 7f043a926800 4 Realm: () 2024-09-18T01:48:19.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.411+0000 7f043a926800 4 ZoneGroup: default (069822df-7f2c-4cd0-aee2-64a07ebf49c5) 2024-09-18T01:48:19.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.411+0000 7f043a926800 4 Zone: default (8ac01ed4-7422-45e2-b799-bf55088fb4fc) 2024-09-18T01:48:19.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.411+0000 7f043a926800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-18T01:48:19.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.411+0000 7f043a926800 20 zonegroup default 2024-09-18T01:48:19.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.411+0000 7f043a926800 20 rados->read ofs=0 len=0 2024-09-18T01:48:19.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.411+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217340900 con 0x7f042805c070 2024-09-18T01:48:19.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.412+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 10 ==== osd_op_reply(41 period_config.default [read 0~187 out=187b] v0'0 uv1 ondisk = 0) ==== 165+0+187 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.412+0000 7f043a926800 20 rados_obj.operate() r=0 bl.length=187 2024-09-18T01:48:19.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.412+0000 7f043a926800 20 rados->read ofs=0 len=0 2024-09-18T01:48:19.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.412+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5562173423a0 con 0x55621733d190 2024-09-18T01:48:19.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.412+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.413+0000 7f043a926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:48:19.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.413+0000 7f043a926800 20 rados->read ofs=0 len=0 2024-09-18T01:48:19.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.413+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217342840 con 0x55621733d190 2024-09-18T01:48:19.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.413+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.413+0000 7f043a926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-18T01:48:19.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.413+0000 7f043a926800 20 started sync module instance, tier type = 2024-09-18T01:48:19.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.413+0000 7f043a926800 20 started zone id=8ac01ed4-7422-45e2-b799-bf55088fb4fc (name=default) with tier type = 2024-09-18T01:48:19.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.413+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217341770 con 0x7f043005b040 2024-09-18T01:48:19.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.414+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 8 ==== osd_op_reply(44 notify.0 [create] v33'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.414+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93879784446816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217341f80 con 0x7f043005b040 2024-09-18T01:48:19.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.414+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217343770 con 0x556217336f60 2024-09-18T01:48:19.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.415+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93879784446816] v33'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.415+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 16 ==== osd_op_reply(46 notify.1 [create] v33'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.415+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93879784452800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217343b90 con 0x556217336f60 2024-09-18T01:48:19.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.415+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217344460 con 0x55621733d190 2024-09-18T01:48:19.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.417+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93879784452800] v33'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.417+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 12 ==== osd_op_reply(48 notify.2 [create] v33'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.417+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93879784453856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217343fb0 con 0x55621733d190 2024-09-18T01:48:19.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.417+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217344f60 con 0x7f043005b040 2024-09-18T01:48:19.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.418+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93879784453856] v33'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.418+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 10 ==== osd_op_reply(50 notify.3 [create] v33'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.418+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93879784454912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217343f20 con 0x7f043005b040 2024-09-18T01:48:19.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.418+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217345e20 con 0x556217336f60 2024-09-18T01:48:19.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.419+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93879784454912] v33'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.419+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 18 ==== osd_op_reply(52 notify.4 [create] v33'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.419+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93879784461136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217345e20 con 0x556217336f60 2024-09-18T01:48:19.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.419+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562173467e0 con 0x7f042805c070 2024-09-18T01:48:19.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.420+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93879784461136] v33'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.421+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 11 ==== osd_op_reply(54 notify.5 [create] v33'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.421+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93879784465680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217345e20 con 0x7f042805c070 2024-09-18T01:48:19.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.421+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217347220 con 0x7f042805c070 2024-09-18T01:48:19.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.422+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93879784465680] v33'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.422+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 13 ==== osd_op_reply(56 notify.6 [create] v33'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.422+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93879784462704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217347220 con 0x7f042805c070 2024-09-18T01:48:19.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.422+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217347c20 con 0x7f042805c070 2024-09-18T01:48:19.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.423+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93879784462704] v33'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.423+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 15 ==== osd_op_reply(58 notify.7 [create] v33'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.423+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93879784470320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217347e00 con 0x7f042805c070 2024-09-18T01:48:19.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.423+0000 7f043a926800 20 add_watcher() i=0 2024-09-18T01:48:19.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.423+0000 7f043a926800 20 add_watcher() i=1 2024-09-18T01:48:19.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.423+0000 7f043a926800 20 add_watcher() i=2 2024-09-18T01:48:19.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.423+0000 7f043a926800 20 add_watcher() i=3 2024-09-18T01:48:19.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.423+0000 7f043a926800 20 add_watcher() i=4 2024-09-18T01:48:19.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.423+0000 7f043a926800 20 add_watcher() i=5 2024-09-18T01:48:19.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.423+0000 7f043a926800 20 add_watcher() i=6 2024-09-18T01:48:19.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.424+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93879784470320] v33'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.424+0000 7f043a926800 20 add_watcher() i=7 2024-09-18T01:48:19.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.424+0000 7f043a926800 2 all 8 watchers are set, enabling cache 2024-09-18T01:48:19.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.424+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55621734b1d0 con 0x556217336f60 2024-09-18T01:48:19.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.424+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.424+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93879784471792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562173485c0 con 0x556217336f60 2024-09-18T01:48:19.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.425+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93879784471792] v33'280 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.425+0000 7f02ecfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:48:19.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.426+0000 7f043a926800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-18T01:48:19.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.426+0000 7f043a926800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-18T01:48:19.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.426+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562173539e0 con 0x556217336f60 2024-09-18T01:48:19.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.427+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'62 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.427+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217354030 con 0x7f042805c070 2024-09-18T01:48:19.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.428+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.428+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217354490 con 0x55621733d190 2024-09-18T01:48:19.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.429+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.429+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217354480 con 0x556217336f60 2024-09-18T01:48:19.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.430+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'281 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.430+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217354a10 con 0x7f043005b040 2024-09-18T01:48:19.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.431+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'89 uv57 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.431+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217354e70 con 0x55621733d190 2024-09-18T01:48:19.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.432+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'73 uv72 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.432+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217354f00 con 0x556217336f60 2024-09-18T01:48:19.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.434+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.434+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217354f90 con 0x7f042805c070 2024-09-18T01:48:19.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.435+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'61 uv40 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.435+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217355070 con 0x7f043005b040 2024-09-18T01:48:19.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.436+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.436+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217355560 con 0x55621733d190 2024-09-18T01:48:19.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.437+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.437+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217355560 con 0x7f043005b040 2024-09-18T01:48:19.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.438+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'90 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.438+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217355560 con 0x7f042805c070 2024-09-18T01:48:19.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.439+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'41 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.439+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217355560 con 0x7f043005b040 2024-09-18T01:48:19.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.440+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.440+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217355560 con 0x7f042805c070 2024-09-18T01:48:19.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.441+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'74 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.441+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217355560 con 0x556217336f60 2024-09-18T01:48:19.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.442+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'282 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.442+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217355560 con 0x55621733d190 2024-09-18T01:48:19.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.443+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'84 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.443+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217355560 con 0x7f043005b040 2024-09-18T01:48:19.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.444+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'91 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.444+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217355560 con 0x55621733d190 2024-09-18T01:48:19.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.445+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'44 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.445+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217355560 con 0x556217336f60 2024-09-18T01:48:19.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.447+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'40 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.447+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217355560 con 0x556217336f60 2024-09-18T01:48:19.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.448+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'283 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.448+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217355560 con 0x55621733d190 2024-09-18T01:48:19.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.449+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'85 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.449+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217355560 con 0x7f043005b040 2024-09-18T01:48:19.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.450+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'47 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.450+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217355560 con 0x55621733d190 2024-09-18T01:48:19.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.451+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.451+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217355560 con 0x55621733d190 2024-09-18T01:48:19.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.452+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'50 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.452+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217355560 con 0x55621733d190 2024-09-18T01:48:19.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.453+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'34 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.453+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217355560 con 0x55621733d190 2024-09-18T01:48:19.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.454+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'74 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.454+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217355560 con 0x7f042805c070 2024-09-18T01:48:19.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.455+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'41 uv30 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.455+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217355560 con 0x55621733d190 2024-09-18T01:48:19.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.456+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'45 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.456+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217355560 con 0x7f042805c070 2024-09-18T01:48:19.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.457+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'62 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.457+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217355560 con 0x55621733d190 2024-09-18T01:48:19.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.458+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'86 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.458+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217355560 con 0x7f042805c070 2024-09-18T01:48:19.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.459+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'75 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.459+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217355560 con 0x7f043005b040 2024-09-18T01:48:19.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.460+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'38 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.460+0000 7f02677fe640 20 reqs_thread_entry: start 2024-09-18T01:48:19.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.460+0000 7f043a926800 20 init_complete bucket index max shards: 11 2024-09-18T01:48:19.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.461+0000 7f043a926800 20 Filter name: none 2024-09-18T01:48:19.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.461+0000 7f02657fa640 20 reqs_thread_entry: start 2024-09-18T01:48:19.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.461+0000 7f043a926800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-18T01:48:19.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.461+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:94 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55621734fc00 con 0x7f042805c070 2024-09-18T01:48:19.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.462+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 24 ==== osd_op_reply(94 gc.30 [call] v33'76 uv76 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.462+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:95 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55621734fc00 con 0x7f042805c070 2024-09-18T01:48:19.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.462+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 25 ==== osd_op_reply(95 gc.30 [call out=15b] v0'0 uv76 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.462+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.462+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:96 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55621734fc00 con 0x7f042805c070 2024-09-18T01:48:19.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.463+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 26 ==== osd_op_reply(96 gc.30 [call out=24b] v0'0 uv76 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.463+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:97 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55621734fc00 con 0x7f042805c070 2024-09-18T01:48:19.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.463+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 27 ==== osd_op_reply(97 gc.30 [call out=15b] v0'0 uv76 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.463+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:48:19.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.463+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:98 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55621734fc00 con 0x7f042805c070 2024-09-18T01:48:19.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.463+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 28 ==== osd_op_reply(98 gc.30 [call out=15b] v0'0 uv76 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.463+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.463+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:99 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55621734fc00 con 0x7f042805c070 2024-09-18T01:48:19.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.464+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 29 ==== osd_op_reply(99 gc.30 [call] v33'77 uv77 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.464+0000 7f043a926800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-18T01:48:19.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.464+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:100 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55621734fc00 con 0x7f043005b040 2024-09-18T01:48:19.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.465+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 19 ==== osd_op_reply(100 gc.31 [call] v33'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.465+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:101 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55621734fc00 con 0x7f043005b040 2024-09-18T01:48:19.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.465+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 20 ==== osd_op_reply(101 gc.31 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.465+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.465+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:102 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55621734fc00 con 0x7f043005b040 2024-09-18T01:48:19.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.466+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 21 ==== osd_op_reply(102 gc.31 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.466+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:103 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55621734fc00 con 0x7f043005b040 2024-09-18T01:48:19.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.466+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 22 ==== osd_op_reply(103 gc.31 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.466+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:48:19.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.466+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:104 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55621734fc00 con 0x7f043005b040 2024-09-18T01:48:19.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.466+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 23 ==== osd_op_reply(104 gc.31 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.466+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.466+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:105 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55621734fc00 con 0x7f043005b040 2024-09-18T01:48:19.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.467+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 24 ==== osd_op_reply(105 gc.31 [call] v33'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.467+0000 7f043a926800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-18T01:48:19.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.467+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:106 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55621734fc00 con 0x556217336f60 2024-09-18T01:48:19.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.468+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 28 ==== osd_op_reply(106 gc.0 [call] v33'63 uv63 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.468+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:107 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55621734fc00 con 0x556217336f60 2024-09-18T01:48:19.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.469+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 29 ==== osd_op_reply(107 gc.0 [call out=15b] v0'0 uv63 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.469+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.469+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:108 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55621734fc00 con 0x556217336f60 2024-09-18T01:48:19.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.469+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 30 ==== osd_op_reply(108 gc.0 [call out=24b] v0'0 uv63 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.469+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:109 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55621734fc00 con 0x556217336f60 2024-09-18T01:48:19.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.469+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 31 ==== osd_op_reply(109 gc.0 [call out=15b] v0'0 uv63 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.469+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:48:19.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.469+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:110 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55621734fc00 con 0x556217336f60 2024-09-18T01:48:19.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.469+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 32 ==== osd_op_reply(110 gc.0 [call out=15b] v0'0 uv63 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.469+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.469+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:111 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55621734fc00 con 0x556217336f60 2024-09-18T01:48:19.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.471+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 33 ==== osd_op_reply(111 gc.0 [call] v33'64 uv64 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.471+0000 7f043a926800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-18T01:48:19.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.471+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:112 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55621734fc00 con 0x7f042805c070 2024-09-18T01:48:19.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.472+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 30 ==== osd_op_reply(112 gc.1 [call] v33'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.472+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:113 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55621734fc00 con 0x7f042805c070 2024-09-18T01:48:19.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.472+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 31 ==== osd_op_reply(113 gc.1 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.472+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.472+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:114 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55621734fc00 con 0x7f042805c070 2024-09-18T01:48:19.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.473+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 32 ==== osd_op_reply(114 gc.1 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.473+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:115 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55621734fc00 con 0x7f042805c070 2024-09-18T01:48:19.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.473+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 33 ==== osd_op_reply(115 gc.1 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.473+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:48:19.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.473+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:116 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55621734fc00 con 0x7f042805c070 2024-09-18T01:48:19.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.473+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 34 ==== osd_op_reply(116 gc.1 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.473+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.473+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:117 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55621734fc00 con 0x7f042805c070 2024-09-18T01:48:19.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.474+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 35 ==== osd_op_reply(117 gc.1 [call] v33'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.474+0000 7f043a926800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-18T01:48:19.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.474+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:118 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55621734fc00 con 0x55621733d190 2024-09-18T01:48:19.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.475+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 26 ==== osd_op_reply(118 gc.2 [call] v33'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.475+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:119 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55621734fc00 con 0x55621733d190 2024-09-18T01:48:19.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.475+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 27 ==== osd_op_reply(119 gc.2 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.475+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.475+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:120 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55621734fc00 con 0x55621733d190 2024-09-18T01:48:19.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.476+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 28 ==== osd_op_reply(120 gc.2 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.476+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:121 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55621734fc00 con 0x55621733d190 2024-09-18T01:48:19.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.476+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 29 ==== osd_op_reply(121 gc.2 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.476+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:48:19.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.476+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:122 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55621734fc00 con 0x55621733d190 2024-09-18T01:48:19.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.476+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 30 ==== osd_op_reply(122 gc.2 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.476+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.476+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:123 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55621734fc00 con 0x55621733d190 2024-09-18T01:48:19.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.477+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 31 ==== osd_op_reply(123 gc.2 [call] v33'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.477+0000 7f043a926800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-18T01:48:19.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.477+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:124 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55621734fc00 con 0x556217336f60 2024-09-18T01:48:19.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.478+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 34 ==== osd_op_reply(124 gc.3 [call] v33'284 uv284 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.478+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:125 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55621734fc00 con 0x556217336f60 2024-09-18T01:48:19.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.478+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 35 ==== osd_op_reply(125 gc.3 [call out=15b] v0'0 uv284 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.478+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.478+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:126 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55621734fc00 con 0x556217336f60 2024-09-18T01:48:19.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.479+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 36 ==== osd_op_reply(126 gc.3 [call out=24b] v0'0 uv284 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.479+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:127 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55621734fc00 con 0x556217336f60 2024-09-18T01:48:19.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.479+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 37 ==== osd_op_reply(127 gc.3 [call out=15b] v0'0 uv284 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.479+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:48:19.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.479+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:128 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55621734fc00 con 0x556217336f60 2024-09-18T01:48:19.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.479+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 38 ==== osd_op_reply(128 gc.3 [call out=15b] v0'0 uv284 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.479+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.479+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:129 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55621734fc00 con 0x556217336f60 2024-09-18T01:48:19.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.480+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 39 ==== osd_op_reply(129 gc.3 [call] v33'285 uv285 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.480+0000 7f043a926800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-18T01:48:19.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.480+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:130 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55621734fc00 con 0x7f043005b040 2024-09-18T01:48:19.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.481+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 25 ==== osd_op_reply(130 gc.4 [call] v33'92 uv92 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.481+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:131 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55621734fc00 con 0x7f043005b040 2024-09-18T01:48:19.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.482+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 26 ==== osd_op_reply(131 gc.4 [call out=15b] v0'0 uv92 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.482+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.482+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:132 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55621734fc00 con 0x7f043005b040 2024-09-18T01:48:19.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.482+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 27 ==== osd_op_reply(132 gc.4 [call out=24b] v0'0 uv92 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.482+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:133 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55621734fc00 con 0x7f043005b040 2024-09-18T01:48:19.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.482+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 28 ==== osd_op_reply(133 gc.4 [call out=15b] v0'0 uv92 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.482+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:48:19.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.482+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:134 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55621734fc00 con 0x7f043005b040 2024-09-18T01:48:19.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.482+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 29 ==== osd_op_reply(134 gc.4 [call out=15b] v0'0 uv92 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.482+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.483+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:135 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55621734fc00 con 0x7f043005b040 2024-09-18T01:48:19.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.484+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 30 ==== osd_op_reply(135 gc.4 [call] v33'93 uv93 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.484+0000 7f043a926800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-18T01:48:19.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.484+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:136 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55621734fc00 con 0x55621733d190 2024-09-18T01:48:19.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.484+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 32 ==== osd_op_reply(136 gc.5 [call] v33'75 uv75 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.485+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:137 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55621734fc00 con 0x55621733d190 2024-09-18T01:48:19.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.485+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 33 ==== osd_op_reply(137 gc.5 [call out=15b] v0'0 uv75 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.485+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.485+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:138 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55621734fc00 con 0x55621733d190 2024-09-18T01:48:19.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.485+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 34 ==== osd_op_reply(138 gc.5 [call out=24b] v0'0 uv75 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.485+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:139 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55621734fc00 con 0x55621733d190 2024-09-18T01:48:19.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.485+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 35 ==== osd_op_reply(139 gc.5 [call out=15b] v0'0 uv75 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.485+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:48:19.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.485+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:140 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55621734fc00 con 0x55621733d190 2024-09-18T01:48:19.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.486+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 36 ==== osd_op_reply(140 gc.5 [call out=1715b] v0'0 uv75 ondisk = 0) ==== 148+0+1715 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.486+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-18T01:48:19.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.486+0000 7f043a926800 20 garbage collection: RGWGC::process iterating over entry tag='8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.3592379339314501299', time=2024-09-18T01:48:27.523103+0000, chain.objs.size()=7 2024-09-18T01:48:19.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.486+0000 7f043a926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.11__shadow_.YLsiBjreBY0BpQtiBQVlQuDGftTalx4_1 2024-09-18T01:48:19.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.486+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:141 3.26s0 3:664b4acc:::8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.11__shadow_.YLsiBjreBY0BpQtiBQVlQuDGftTalx4_1:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55621737fb00 con 0x7f043005b040 2024-09-18T01:48:19.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.486+0000 7f043a926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.11__shadow_.YLsiBjreBY0BpQtiBQVlQuDGftTalx4_2 2024-09-18T01:48:19.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.486+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:142 3.13s0 3:c8df2ca5:::8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.11__shadow_.YLsiBjreBY0BpQtiBQVlQuDGftTalx4_2:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217384940 con 0x55621733d190 2024-09-18T01:48:19.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.486+0000 7f043a926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.11__shadow_.YLsiBjreBY0BpQtiBQVlQuDGftTalx4_3 2024-09-18T01:48:19.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.486+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:143 3.8s0 3:124c4e51:::8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.11__shadow_.YLsiBjreBY0BpQtiBQVlQuDGftTalx4_3:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562173872c0 con 0x55621733d190 2024-09-18T01:48:19.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.486+0000 7f043a926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.11__shadow_.YLsiBjreBY0BpQtiBQVlQuDGftTalx4_4 2024-09-18T01:48:19.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.486+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:144 3.1bs0 3:d922077e:::8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.11__shadow_.YLsiBjreBY0BpQtiBQVlQuDGftTalx4_4:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217389bf0 con 0x55621733d190 2024-09-18T01:48:19.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.486+0000 7f043a926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.11__shadow_.YLsiBjreBY0BpQtiBQVlQuDGftTalx4_5 2024-09-18T01:48:19.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.486+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:145 3.as0 3:519a20e3:::8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.11__shadow_.YLsiBjreBY0BpQtiBQVlQuDGftTalx4_5:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562173872c0 con 0x55621733d190 2024-09-18T01:48:19.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.486+0000 7f043a926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.11__shadow_.YLsiBjreBY0BpQtiBQVlQuDGftTalx4_6 2024-09-18T01:48:19.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.486+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:146 3.30s0 3:0c2c4fa3:::8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.11__shadow_.YLsiBjreBY0BpQtiBQVlQuDGftTalx4_6:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217389bf0 con 0x55621733d190 2024-09-18T01:48:19.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.486+0000 7f043a926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.11__shadow_.YLsiBjreBY0BpQtiBQVlQuDGftTalx4_7 2024-09-18T01:48:19.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.486+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:147 3.as0 3:508c5a49:::8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.11__shadow_.YLsiBjreBY0BpQtiBQVlQuDGftTalx4_7:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217391150 con 0x55621733d190 2024-09-18T01:48:19.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.488+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 37 ==== osd_op_reply(142 8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.11__shadow_.YLsiBjreBY0BpQtiBQVlQuDGftTalx4_2 [call] v33'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.489+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 31 ==== osd_op_reply(141 8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.11__shadow_.YLsiBjreBY0BpQtiBQVlQuDGftTalx4_1 [call] v33'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.490+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 38 ==== osd_op_reply(143 8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.11__shadow_.YLsiBjreBY0BpQtiBQVlQuDGftTalx4_3 [call] v33'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.490+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 39 ==== osd_op_reply(145 8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.11__shadow_.YLsiBjreBY0BpQtiBQVlQuDGftTalx4_5 [call] v33'3 uv3 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.490+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 40 ==== osd_op_reply(144 8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.11__shadow_.YLsiBjreBY0BpQtiBQVlQuDGftTalx4_4 [call] v33'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.490+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 41 ==== osd_op_reply(146 8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.11__shadow_.YLsiBjreBY0BpQtiBQVlQuDGftTalx4_6 [call] v33'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.490+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 42 ==== osd_op_reply(147 8ac01ed4-7422-45e2-b799-bf55088fb4fc.4236.11__shadow_.YLsiBjreBY0BpQtiBQVlQuDGftTalx4_7 [call] v33'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.490+0000 7f043a926800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-18T01:48:19.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.490+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:148 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55621737f530 con 0x55621733d190 2024-09-18T01:48:19.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.494+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 43 ==== osd_op_reply(148 gc.5 [call] v33'76 uv76 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.494+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:149 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55621737f530 con 0x55621733d190 2024-09-18T01:48:19.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.497+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 44 ==== osd_op_reply(149 gc.5 [call] v33'77 uv77 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.497+0000 7f043a926800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-18T01:48:19.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.497+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:150 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55621737f530 con 0x556217336f60 2024-09-18T01:48:19.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.498+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 40 ==== osd_op_reply(150 gc.6 [call] v33'40 uv40 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.498+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:151 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55621737f530 con 0x556217336f60 2024-09-18T01:48:19.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.499+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 41 ==== osd_op_reply(151 gc.6 [call out=15b] v0'0 uv40 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.499+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.499+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:152 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55621737f530 con 0x556217336f60 2024-09-18T01:48:19.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.499+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 42 ==== osd_op_reply(152 gc.6 [call out=24b] v0'0 uv40 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.499+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:153 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55621737f530 con 0x556217336f60 2024-09-18T01:48:19.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.499+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 43 ==== osd_op_reply(153 gc.6 [call out=15b] v0'0 uv40 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.499+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:48:19.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.499+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:154 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55621737f530 con 0x556217336f60 2024-09-18T01:48:19.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.499+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 44 ==== osd_op_reply(154 gc.6 [call out=15b] v0'0 uv40 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.499+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.499+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:155 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55621737f530 con 0x556217336f60 2024-09-18T01:48:19.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.500+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 45 ==== osd_op_reply(155 gc.6 [call] v33'41 uv41 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.500+0000 7f043a926800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-18T01:48:19.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.500+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:156 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55621737f530 con 0x7f042805c070 2024-09-18T01:48:19.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.501+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 36 ==== osd_op_reply(156 gc.7 [call] v33'63 uv63 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.501+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:157 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55621737f530 con 0x7f042805c070 2024-09-18T01:48:19.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.502+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 37 ==== osd_op_reply(157 gc.7 [call out=15b] v0'0 uv63 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.502+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.502+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:158 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55621737f530 con 0x7f042805c070 2024-09-18T01:48:19.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.502+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 38 ==== osd_op_reply(158 gc.7 [call out=24b] v0'0 uv63 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.502+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:159 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55621737f530 con 0x7f042805c070 2024-09-18T01:48:19.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.502+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 39 ==== osd_op_reply(159 gc.7 [call out=15b] v0'0 uv63 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.502+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:48:19.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.502+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:160 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217386d00 con 0x7f042805c070 2024-09-18T01:48:19.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.503+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 40 ==== osd_op_reply(160 gc.7 [call out=15b] v0'0 uv63 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.503+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.503+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:161 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217386d00 con 0x7f042805c070 2024-09-18T01:48:19.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.504+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 41 ==== osd_op_reply(161 gc.7 [call] v33'64 uv64 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.504+0000 7f043a926800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-18T01:48:19.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.504+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:162 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217386d00 con 0x7f043005b040 2024-09-18T01:48:19.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.505+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 32 ==== osd_op_reply(162 gc.8 [call] v33'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.505+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:163 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217386d00 con 0x7f043005b040 2024-09-18T01:48:19.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.505+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 33 ==== osd_op_reply(163 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.505+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.505+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:164 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217385cf0 con 0x7f043005b040 2024-09-18T01:48:19.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.505+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 34 ==== osd_op_reply(164 gc.8 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.505+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:165 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217386d00 con 0x7f043005b040 2024-09-18T01:48:19.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.506+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 35 ==== osd_op_reply(165 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.506+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:48:19.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.506+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:166 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217386d00 con 0x7f043005b040 2024-09-18T01:48:19.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.506+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 36 ==== osd_op_reply(166 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.506+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.506+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:167 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217386d00 con 0x7f043005b040 2024-09-18T01:48:19.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.507+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 37 ==== osd_op_reply(167 gc.8 [call] v33'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.507+0000 7f043a926800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-18T01:48:19.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.507+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:168 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217386d00 con 0x55621733d190 2024-09-18T01:48:19.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.508+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 45 ==== osd_op_reply(168 gc.9 [call] v33'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.508+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:169 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217386d00 con 0x55621733d190 2024-09-18T01:48:19.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.508+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 46 ==== osd_op_reply(169 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.508+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.508+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:170 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217385cf0 con 0x55621733d190 2024-09-18T01:48:19.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.508+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 47 ==== osd_op_reply(170 gc.9 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.508+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:171 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217386d00 con 0x55621733d190 2024-09-18T01:48:19.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.508+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 48 ==== osd_op_reply(171 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.508+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:48:19.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.508+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:172 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217386d00 con 0x55621733d190 2024-09-18T01:48:19.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.509+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 49 ==== osd_op_reply(172 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.509+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.509+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:173 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x55621733d190 2024-09-18T01:48:19.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.510+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 50 ==== osd_op_reply(173 gc.9 [call] v33'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.510+0000 7f043a926800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-18T01:48:19.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.510+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:174 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562173870e0 con 0x7f043005b040 2024-09-18T01:48:19.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.511+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 38 ==== osd_op_reply(174 gc.10 [call] v33'94 uv94 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.511+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:175 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x7f043005b040 2024-09-18T01:48:19.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.511+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 39 ==== osd_op_reply(175 gc.10 [call out=15b] v0'0 uv94 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.511+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.511+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:176 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217385c90 con 0x7f043005b040 2024-09-18T01:48:19.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.511+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 40 ==== osd_op_reply(176 gc.10 [call out=24b] v0'0 uv94 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.511+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:177 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x7f043005b040 2024-09-18T01:48:19.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.511+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 41 ==== osd_op_reply(177 gc.10 [call out=15b] v0'0 uv94 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.511+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:48:19.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.511+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:178 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x7f043005b040 2024-09-18T01:48:19.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.512+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 42 ==== osd_op_reply(178 gc.10 [call out=15b] v0'0 uv94 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.512+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.512+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:179 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x7f043005b040 2024-09-18T01:48:19.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.513+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 43 ==== osd_op_reply(179 gc.10 [call] v33'95 uv95 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.513+0000 7f043a926800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-18T01:48:19.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.513+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:180 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x7f042805c070 2024-09-18T01:48:19.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.514+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 42 ==== osd_op_reply(180 gc.11 [call] v33'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.514+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:181 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x7f042805c070 2024-09-18T01:48:19.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.514+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 43 ==== osd_op_reply(181 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.514+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.514+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:182 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217385c90 con 0x7f042805c070 2024-09-18T01:48:19.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.515+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 44 ==== osd_op_reply(182 gc.11 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.515+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:183 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x7f042805c070 2024-09-18T01:48:19.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.515+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 45 ==== osd_op_reply(183 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.515+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:48:19.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.515+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:184 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x7f042805c070 2024-09-18T01:48:19.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.515+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 46 ==== osd_op_reply(184 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.515+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.515+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:185 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x7f042805c070 2024-09-18T01:48:19.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.517+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 47 ==== osd_op_reply(185 gc.11 [call] v33'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.517+0000 7f043a926800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-18T01:48:19.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.517+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:186 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x7f043005b040 2024-09-18T01:48:19.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.518+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 44 ==== osd_op_reply(186 gc.12 [call] v33'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.518+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:187 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x7f043005b040 2024-09-18T01:48:19.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.518+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 45 ==== osd_op_reply(187 gc.12 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.518+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.518+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:188 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217385c90 con 0x7f043005b040 2024-09-18T01:48:19.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.518+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 46 ==== osd_op_reply(188 gc.12 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.518+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:189 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x7f043005b040 2024-09-18T01:48:19.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.519+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 47 ==== osd_op_reply(189 gc.12 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.519+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:48:19.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.519+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:190 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x7f043005b040 2024-09-18T01:48:19.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.519+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 48 ==== osd_op_reply(190 gc.12 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.519+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.519+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:191 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x7f043005b040 2024-09-18T01:48:19.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.520+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 49 ==== osd_op_reply(191 gc.12 [call] v33'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.520+0000 7f043a926800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-18T01:48:19.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.520+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:192 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x7f042805c070 2024-09-18T01:48:19.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.521+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 48 ==== osd_op_reply(192 gc.13 [call] v33'78 uv78 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.521+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:193 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x7f042805c070 2024-09-18T01:48:19.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.521+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 49 ==== osd_op_reply(193 gc.13 [call out=15b] v0'0 uv78 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.521+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.521+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:194 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217385c90 con 0x7f042805c070 2024-09-18T01:48:19.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.521+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 50 ==== osd_op_reply(194 gc.13 [call out=24b] v0'0 uv78 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.521+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:195 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x7f042805c070 2024-09-18T01:48:19.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.522+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 51 ==== osd_op_reply(195 gc.13 [call out=15b] v0'0 uv78 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.522+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:48:19.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.522+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:196 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x7f042805c070 2024-09-18T01:48:19.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.522+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 52 ==== osd_op_reply(196 gc.13 [call out=15b] v0'0 uv78 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.522+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.522+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:197 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x7f042805c070 2024-09-18T01:48:19.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.523+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 53 ==== osd_op_reply(197 gc.13 [call] v33'79 uv79 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.523+0000 7f043a926800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-18T01:48:19.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.523+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:198 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x556217336f60 2024-09-18T01:48:19.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.524+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 46 ==== osd_op_reply(198 gc.14 [call] v33'286 uv286 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.524+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:199 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x556217336f60 2024-09-18T01:48:19.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.524+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 47 ==== osd_op_reply(199 gc.14 [call out=15b] v0'0 uv286 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.524+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.524+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:200 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217385c90 con 0x556217336f60 2024-09-18T01:48:19.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.525+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 48 ==== osd_op_reply(200 gc.14 [call out=24b] v0'0 uv286 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.525+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:201 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x556217336f60 2024-09-18T01:48:19.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.525+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 49 ==== osd_op_reply(201 gc.14 [call out=15b] v0'0 uv286 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.525+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:48:19.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.525+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:202 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x556217336f60 2024-09-18T01:48:19.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.525+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 50 ==== osd_op_reply(202 gc.14 [call out=15b] v0'0 uv286 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.525+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.525+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:203 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x556217336f60 2024-09-18T01:48:19.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.526+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 51 ==== osd_op_reply(203 gc.14 [call] v33'287 uv287 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.526+0000 7f043a926800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-18T01:48:19.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.526+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:204 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x55621733d190 2024-09-18T01:48:19.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.527+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 51 ==== osd_op_reply(204 gc.15 [call] v33'87 uv87 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.527+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:205 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x55621733d190 2024-09-18T01:48:19.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.528+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 52 ==== osd_op_reply(205 gc.15 [call out=15b] v0'0 uv87 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.528+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.528+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:206 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217385c90 con 0x55621733d190 2024-09-18T01:48:19.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.528+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 53 ==== osd_op_reply(206 gc.15 [call out=24b] v0'0 uv87 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.528+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:207 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x55621733d190 2024-09-18T01:48:19.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.528+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 54 ==== osd_op_reply(207 gc.15 [call out=15b] v0'0 uv87 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.528+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:48:19.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.528+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:208 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x55621733d190 2024-09-18T01:48:19.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.528+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 55 ==== osd_op_reply(208 gc.15 [call out=15b] v0'0 uv87 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.528+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.528+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:209 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x55621733d190 2024-09-18T01:48:19.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.530+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 56 ==== osd_op_reply(209 gc.15 [call] v33'88 uv88 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.530+0000 7f043a926800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-18T01:48:19.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.530+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:210 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x7f043005b040 2024-09-18T01:48:19.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.531+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 50 ==== osd_op_reply(210 gc.16 [call] v33'96 uv96 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.531+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:211 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x7f043005b040 2024-09-18T01:48:19.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.531+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 51 ==== osd_op_reply(211 gc.16 [call out=15b] v0'0 uv96 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.531+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.531+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:212 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217385c90 con 0x7f043005b040 2024-09-18T01:48:19.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.531+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 52 ==== osd_op_reply(212 gc.16 [call out=24b] v0'0 uv96 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.531+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:213 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x7f043005b040 2024-09-18T01:48:19.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.531+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 53 ==== osd_op_reply(213 gc.16 [call out=15b] v0'0 uv96 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.531+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:48:19.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.531+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:214 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x7f043005b040 2024-09-18T01:48:19.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.532+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 54 ==== osd_op_reply(214 gc.16 [call out=15b] v0'0 uv96 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.532+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.532+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:215 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x7f043005b040 2024-09-18T01:48:19.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.533+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 55 ==== osd_op_reply(215 gc.16 [call] v33'97 uv97 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.533+0000 7f043a926800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-18T01:48:19.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.533+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:216 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x55621733d190 2024-09-18T01:48:19.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.533+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 57 ==== osd_op_reply(216 gc.17 [call] v33'45 uv45 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.533+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:217 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x55621733d190 2024-09-18T01:48:19.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.534+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 58 ==== osd_op_reply(217 gc.17 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.534+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.534+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:218 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217385c90 con 0x55621733d190 2024-09-18T01:48:19.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.534+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 59 ==== osd_op_reply(218 gc.17 [call out=24b] v0'0 uv45 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.534+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:219 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217385c90 con 0x55621733d190 2024-09-18T01:48:19.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.534+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 60 ==== osd_op_reply(219 gc.17 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.534+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:48:19.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.534+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:220 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217385c90 con 0x55621733d190 2024-09-18T01:48:19.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.534+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 61 ==== osd_op_reply(220 gc.17 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.534+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.534+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:221 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x55621733d190 2024-09-18T01:48:19.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.535+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 62 ==== osd_op_reply(221 gc.17 [call] v33'46 uv46 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.535+0000 7f043a926800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-18T01:48:19.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.535+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:222 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x556217336f60 2024-09-18T01:48:19.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.537+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 52 ==== osd_op_reply(222 gc.18 [call] v33'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.537+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:223 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x556217336f60 2024-09-18T01:48:19.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.537+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 53 ==== osd_op_reply(223 gc.18 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.537+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.537+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:224 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217385c90 con 0x556217336f60 2024-09-18T01:48:19.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.537+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 54 ==== osd_op_reply(224 gc.18 [call out=24b] v0'0 uv41 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.537+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:225 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x556217336f60 2024-09-18T01:48:19.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.538+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 55 ==== osd_op_reply(225 gc.18 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.538+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:48:19.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.538+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:226 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x556217336f60 2024-09-18T01:48:19.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.538+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 56 ==== osd_op_reply(226 gc.18 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.538+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.538+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:227 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x556217336f60 2024-09-18T01:48:19.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.539+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 57 ==== osd_op_reply(227 gc.18 [call] v33'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.539+0000 7f043a926800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-18T01:48:19.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.539+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:228 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x556217336f60 2024-09-18T01:48:19.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.540+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 58 ==== osd_op_reply(228 gc.19 [call] v33'288 uv288 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.540+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:229 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x556217336f60 2024-09-18T01:48:19.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.540+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 59 ==== osd_op_reply(229 gc.19 [call out=15b] v0'0 uv288 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.540+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.540+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:230 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217385c90 con 0x556217336f60 2024-09-18T01:48:19.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.540+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 60 ==== osd_op_reply(230 gc.19 [call out=24b] v0'0 uv288 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.540+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:231 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x556217336f60 2024-09-18T01:48:19.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.540+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 61 ==== osd_op_reply(231 gc.19 [call out=15b] v0'0 uv288 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.541+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:48:19.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.541+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:232 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x556217336f60 2024-09-18T01:48:19.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.541+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 62 ==== osd_op_reply(232 gc.19 [call out=15b] v0'0 uv288 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.541+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.541+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:233 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x556217336f60 2024-09-18T01:48:19.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.542+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 63 ==== osd_op_reply(233 gc.19 [call] v33'289 uv289 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.542+0000 7f043a926800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-18T01:48:19.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.542+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:234 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x55621733d190 2024-09-18T01:48:19.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.543+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 63 ==== osd_op_reply(234 gc.20 [call] v33'89 uv89 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.543+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:235 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x55621733d190 2024-09-18T01:48:19.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.543+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 64 ==== osd_op_reply(235 gc.20 [call out=15b] v0'0 uv89 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.543+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.543+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:236 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217385c90 con 0x55621733d190 2024-09-18T01:48:19.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.543+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 65 ==== osd_op_reply(236 gc.20 [call out=24b] v0'0 uv89 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.543+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:237 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217385c90 con 0x55621733d190 2024-09-18T01:48:19.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.544+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 66 ==== osd_op_reply(237 gc.20 [call out=15b] v0'0 uv89 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.544+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:48:19.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.544+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:238 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217385c90 con 0x55621733d190 2024-09-18T01:48:19.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.544+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 67 ==== osd_op_reply(238 gc.20 [call out=15b] v0'0 uv89 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.544+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.544+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:239 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x55621733d190 2024-09-18T01:48:19.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.545+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 68 ==== osd_op_reply(239 gc.20 [call] v33'90 uv90 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.545+0000 7f043a926800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-18T01:48:19.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.545+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:240 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x7f043005b040 2024-09-18T01:48:19.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.546+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 56 ==== osd_op_reply(240 gc.21 [call] v33'48 uv48 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.546+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:241 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x7f043005b040 2024-09-18T01:48:19.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.546+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 57 ==== osd_op_reply(241 gc.21 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.546+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.546+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:242 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217385c90 con 0x7f043005b040 2024-09-18T01:48:19.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.547+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 58 ==== osd_op_reply(242 gc.21 [call out=24b] v0'0 uv48 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.547+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:243 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x7f043005b040 2024-09-18T01:48:19.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.547+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 59 ==== osd_op_reply(243 gc.21 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.547+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:48:19.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.547+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:244 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x7f043005b040 2024-09-18T01:48:19.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.547+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 60 ==== osd_op_reply(244 gc.21 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.547+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.547+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:245 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x7f043005b040 2024-09-18T01:48:19.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.548+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 61 ==== osd_op_reply(245 gc.21 [call] v33'49 uv49 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.548+0000 7f043a926800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-18T01:48:19.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.548+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:246 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x55621733d190 2024-09-18T01:48:19.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.549+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 69 ==== osd_op_reply(246 gc.22 [call] v33'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.549+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:247 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x55621733d190 2024-09-18T01:48:19.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.549+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 70 ==== osd_op_reply(247 gc.22 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.549+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.549+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:248 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217385c90 con 0x55621733d190 2024-09-18T01:48:19.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.549+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 71 ==== osd_op_reply(248 gc.22 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.549+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:249 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x55621733d190 2024-09-18T01:48:19.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.550+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 72 ==== osd_op_reply(249 gc.22 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.550+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:48:19.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.550+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:250 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x55621733d190 2024-09-18T01:48:19.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.550+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 73 ==== osd_op_reply(250 gc.22 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.550+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.550+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:251 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x55621733d190 2024-09-18T01:48:19.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.551+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 74 ==== osd_op_reply(251 gc.22 [call] v33'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.551+0000 7f043a926800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-18T01:48:19.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.551+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:252 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x55621733d190 2024-09-18T01:48:19.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.552+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 75 ==== osd_op_reply(252 gc.23 [call] v33'51 uv51 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.552+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:253 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x55621733d190 2024-09-18T01:48:19.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.552+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 76 ==== osd_op_reply(253 gc.23 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.552+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.552+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:254 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217385c90 con 0x55621733d190 2024-09-18T01:48:19.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.552+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 77 ==== osd_op_reply(254 gc.23 [call out=24b] v0'0 uv51 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.552+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:255 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217385c90 con 0x55621733d190 2024-09-18T01:48:19.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.552+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 78 ==== osd_op_reply(255 gc.23 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.552+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:48:19.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.552+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:256 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217385c90 con 0x55621733d190 2024-09-18T01:48:19.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.553+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 79 ==== osd_op_reply(256 gc.23 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.553+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.553+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:257 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x55621733d190 2024-09-18T01:48:19.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.554+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 80 ==== osd_op_reply(257 gc.23 [call] v33'52 uv52 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.554+0000 7f043a926800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-18T01:48:19.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.554+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:258 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x55621733d190 2024-09-18T01:48:19.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.555+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 81 ==== osd_op_reply(258 gc.24 [call] v33'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.555+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:259 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x55621733d190 2024-09-18T01:48:19.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.555+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 82 ==== osd_op_reply(259 gc.24 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.555+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.555+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:260 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217385c90 con 0x55621733d190 2024-09-18T01:48:19.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.555+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 83 ==== osd_op_reply(260 gc.24 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.555+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:261 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217385c90 con 0x55621733d190 2024-09-18T01:48:19.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.555+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 84 ==== osd_op_reply(261 gc.24 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.555+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:48:19.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.555+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:262 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217385c90 con 0x55621733d190 2024-09-18T01:48:19.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.555+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 85 ==== osd_op_reply(262 gc.24 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.555+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.555+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:263 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x55621733d190 2024-09-18T01:48:19.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.556+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 86 ==== osd_op_reply(263 gc.24 [call] v33'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.556+0000 7f043a926800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-18T01:48:19.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.556+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:264 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x55621733d190 2024-09-18T01:48:19.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.557+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 87 ==== osd_op_reply(264 gc.25 [call] v33'78 uv78 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.557+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:265 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x55621733d190 2024-09-18T01:48:19.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.557+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 88 ==== osd_op_reply(265 gc.25 [call out=15b] v0'0 uv78 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.558+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.558+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:266 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217385c90 con 0x55621733d190 2024-09-18T01:48:19.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.558+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 89 ==== osd_op_reply(266 gc.25 [call out=24b] v0'0 uv78 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.558+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:267 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217385c90 con 0x55621733d190 2024-09-18T01:48:19.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.558+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 90 ==== osd_op_reply(267 gc.25 [call out=15b] v0'0 uv78 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.558+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:48:19.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.558+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:268 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217385c90 con 0x55621733d190 2024-09-18T01:48:19.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.558+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 91 ==== osd_op_reply(268 gc.25 [call out=15b] v0'0 uv78 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.558+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.558+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:269 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x55621733d190 2024-09-18T01:48:19.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.559+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 92 ==== osd_op_reply(269 gc.25 [call] v33'79 uv79 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.559+0000 7f043a926800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-18T01:48:19.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.559+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:270 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x7f042805c070 2024-09-18T01:48:19.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.560+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 54 ==== osd_op_reply(270 gc.26 [call] v33'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.560+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:271 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x7f042805c070 2024-09-18T01:48:19.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.561+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 55 ==== osd_op_reply(271 gc.26 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.561+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.561+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:272 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217385c90 con 0x7f042805c070 2024-09-18T01:48:19.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.561+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 56 ==== osd_op_reply(272 gc.26 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.561+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:273 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x7f042805c070 2024-09-18T01:48:19.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.561+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 57 ==== osd_op_reply(273 gc.26 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.561+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:48:19.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.561+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:274 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x7f042805c070 2024-09-18T01:48:19.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.561+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 58 ==== osd_op_reply(274 gc.26 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.561+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.561+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:275 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x7f042805c070 2024-09-18T01:48:19.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.562+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 59 ==== osd_op_reply(275 gc.26 [call] v33'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.562+0000 7f043a926800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-18T01:48:19.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.562+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:276 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x55621733d190 2024-09-18T01:48:19.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.563+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 93 ==== osd_op_reply(276 gc.27 [call] v33'46 uv46 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.563+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:277 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x55621733d190 2024-09-18T01:48:19.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.564+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 94 ==== osd_op_reply(277 gc.27 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.564+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.564+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:278 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217385c90 con 0x55621733d190 2024-09-18T01:48:19.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.564+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 95 ==== osd_op_reply(278 gc.27 [call out=24b] v0'0 uv46 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.564+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:279 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217385c90 con 0x55621733d190 2024-09-18T01:48:19.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.564+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 96 ==== osd_op_reply(279 gc.27 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.564+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:48:19.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.564+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:280 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217385c90 con 0x55621733d190 2024-09-18T01:48:19.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.565+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 97 ==== osd_op_reply(280 gc.27 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.565+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.565+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:281 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x55621733d190 2024-09-18T01:48:19.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.565+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 98 ==== osd_op_reply(281 gc.27 [call] v33'47 uv47 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.565+0000 7f043a926800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-18T01:48:19.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.565+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:282 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x7f042805c070 2024-09-18T01:48:19.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.567+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 60 ==== osd_op_reply(282 gc.28 [call] v33'65 uv65 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.567+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:283 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x7f042805c070 2024-09-18T01:48:19.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.567+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 61 ==== osd_op_reply(283 gc.28 [call out=15b] v0'0 uv65 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.567+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.567+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:284 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217385c90 con 0x7f042805c070 2024-09-18T01:48:19.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.567+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 62 ==== osd_op_reply(284 gc.28 [call out=24b] v0'0 uv65 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.567+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:285 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x7f042805c070 2024-09-18T01:48:19.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.568+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 63 ==== osd_op_reply(285 gc.28 [call out=15b] v0'0 uv65 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.568+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:48:19.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.568+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:286 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x7f042805c070 2024-09-18T01:48:19.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.568+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 64 ==== osd_op_reply(286 gc.28 [call out=15b] v0'0 uv65 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.568+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.568+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:287 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x7f042805c070 2024-09-18T01:48:19.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.569+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 65 ==== osd_op_reply(287 gc.28 [call] v33'66 uv66 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.569+0000 7f043a926800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-18T01:48:19.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.569+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:288 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x55621733d190 2024-09-18T01:48:19.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.570+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 99 ==== osd_op_reply(288 gc.29 [call] v33'91 uv91 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.570+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:289 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x55621733d190 2024-09-18T01:48:19.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.570+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 100 ==== osd_op_reply(289 gc.29 [call out=15b] v0'0 uv91 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.570+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.570+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:290 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217385c90 con 0x55621733d190 2024-09-18T01:48:19.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.570+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 101 ==== osd_op_reply(290 gc.29 [call out=24b] v0'0 uv91 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.570+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:291 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x55621733d190 2024-09-18T01:48:19.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.571+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 102 ==== osd_op_reply(291 gc.29 [call out=15b] v0'0 uv91 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.571+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-18T01:48:19.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.571+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:292 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x55621733d190 2024-09-18T01:48:19.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.571+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 103 ==== osd_op_reply(292 gc.29 [call out=15b] v0'0 uv91 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.571+0000 7f043a926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-18T01:48:19.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.571+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:293 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217386ca0 con 0x55621733d190 2024-09-18T01:48:19.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.572+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 104 ==== osd_op_reply(293 gc.29 [call] v33'92 uv92 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.573+0000 7f02ecfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-18T01:48:19.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.573+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93879784471792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55621737ed30 con 0x556217336f60 2024-09-18T01:48:19.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.574+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 64 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 93879784471792] v33'290 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.574+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93879784446816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217347cf0 con 0x7f043005b040 2024-09-18T01:48:19.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.575+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 62 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 93879784446816] v33'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.575+0000 7f043a926800 20 remove_watcher() i=0 2024-09-18T01:48:19.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.575+0000 7f043a926800 2 removed watcher, disabling cache 2024-09-18T01:48:19.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.575+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93879784452800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217347cf0 con 0x556217336f60 2024-09-18T01:48:19.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.576+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 65 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 93879784452800] v33'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.577+0000 7f043a926800 20 remove_watcher() i=1 2024-09-18T01:48:19.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.577+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93879784453856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5562173432c0 con 0x55621733d190 2024-09-18T01:48:19.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.578+0000 7f0436de4640 1 -- 172.21.15.146:0/3475887804 <== osd.3 v2:172.21.15.146:6809/4106661138 105 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 93879784453856] v33'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f043003e020 con 0x55621733d190 2024-09-18T01:48:19.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.578+0000 7f043a926800 20 remove_watcher() i=2 2024-09-18T01:48:19.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.578+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93879784454912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217347cf0 con 0x7f043005b040 2024-09-18T01:48:19.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.579+0000 7f04365e3640 1 -- 172.21.15.146:0/3475887804 <== osd.2 v2:172.21.15.146:6800/3820039304 63 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 93879784454912] v33'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0428051070 con 0x7f043005b040 2024-09-18T01:48:19.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.579+0000 7f043a926800 20 remove_watcher() i=3 2024-09-18T01:48:19.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.579+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93879784461136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217347cf0 con 0x556217336f60 2024-09-18T01:48:19.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.580+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.1 v2:172.21.15.146:6808/3930274777 66 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 93879784461136] v33'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f042002a040 con 0x556217336f60 2024-09-18T01:48:19.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.580+0000 7f043a926800 20 remove_watcher() i=4 2024-09-18T01:48:19.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.580+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93879784465680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217345350 con 0x7f042805c070 2024-09-18T01:48:19.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.581+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 66 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 93879784465680] v33'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.581+0000 7f043a926800 20 remove_watcher() i=5 2024-09-18T01:48:19.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.581+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93879784462704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217347cf0 con 0x7f042805c070 2024-09-18T01:48:19.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.582+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 67 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 93879784462704] v33'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.582+0000 7f043a926800 20 remove_watcher() i=6 2024-09-18T01:48:19.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.582+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93879784470320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556217351520 con 0x7f042805c070 2024-09-18T01:48:19.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.583+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 <== osd.0 v2:172.21.15.129:6800/1759265424 68 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 93879784470320] v33'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f042002a040 con 0x7f042805c070 2024-09-18T01:48:19.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.583+0000 7f043a926800 20 remove_watcher() i=7 2024-09-18T01:48:19.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.583+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f042805c070 msgr2=0x7f0428090330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:19.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.583+0000 7f043a926800 1 --2- 172.21.15.146:0/3475887804 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7f042805c070 0x7f0428090330 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:19.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.583+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x556217336f60 msgr2=0x556217339420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:19.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.583+0000 7f043a926800 1 --2- 172.21.15.146:0/3475887804 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x556217336f60 0x556217339420 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:19.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.583+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f043005b040 msgr2=0x7f0430052940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:19.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.583+0000 7f043a926800 1 --2- 172.21.15.146:0/3475887804 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7f043005b040 0x7f0430052940 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:19.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.583+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55621733d190 msgr2=0x55621733f580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:19.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.583+0000 7f043a926800 1 --2- 172.21.15.146:0/3475887804 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x55621733d190 0x55621733f580 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:19.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.583+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0300036b40 msgr2=0x7f0300039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:19.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.583+0000 7f043a926800 1 --2- 172.21.15.146:0/3475887804 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0300036b40 0x7f0300039000 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f04280095b0 tx=0x7f042808b000 comp rx=0 tx=0).stop 2024-09-18T01:48:19.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.583+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556217323e20 msgr2=0x55621732b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:19.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.583+0000 7f043a926800 1 --2- 172.21.15.146:0/3475887804 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556217323e20 0x55621732b2a0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f043004c8f0 tx=0x7f043004c880 comp rx=0 tx=0).stop 2024-09-18T01:48:19.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.584+0000 7f042ffff640 1 -- 172.21.15.146:0/3475887804 reap_dead start 2024-09-18T01:48:19.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.584+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 shutdown_connections 2024-09-18T01:48:19.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.584+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 >> 172.21.15.146:0/3475887804 conn(0x5562173201d0 msgr2=0x556217325560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:48:19.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.584+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 shutdown_connections 2024-09-18T01:48:19.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.584+0000 7f043a926800 1 -- 172.21.15.146:0/3475887804 wait complete. 2024-09-18T01:48:19.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.584+0000 7f043a926800 1 -- 172.21.15.146:0/2693073136 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0310036b40 msgr2=0x7f0310039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:19.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.584+0000 7f043a926800 1 --2- 172.21.15.146:0/2693073136 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0310036b40 0x7f0310039000 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f042808f240 tx=0x7f04280747a0 comp rx=0 tx=0).stop 2024-09-18T01:48:19.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.584+0000 7f043a926800 1 -- 172.21.15.146:0/2693073136 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556217317180 msgr2=0x5562173175a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:19.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.584+0000 7f043a926800 1 --2- 172.21.15.146:0/2693073136 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556217317180 0x5562173175a0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x5562172032f0 tx=0x7f04300178e0 comp rx=0 tx=0).stop 2024-09-18T01:48:19.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.584+0000 7f043a926800 1 -- 172.21.15.146:0/2693073136 shutdown_connections 2024-09-18T01:48:19.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.584+0000 7f043a926800 1 --2- 172.21.15.146:0/2693073136 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f0310036b40 0x7f0310039000 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:19.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.584+0000 7f043a926800 1 --2- 172.21.15.146:0/2693073136 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x556217317180 0x5562173175a0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:19.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.584+0000 7f043a926800 1 -- 172.21.15.146:0/2693073136 >> 172.21.15.146:0/2693073136 conn(0x55621730c110 msgr2=0x55621730ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:48:19.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.584+0000 7f043a926800 1 -- 172.21.15.146:0/2693073136 shutdown_connections 2024-09-18T01:48:19.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.584+0000 7f043a926800 1 -- 172.21.15.146:0/2693073136 wait complete. 2024-09-18T01:48:19.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.584+0000 7f043a926800 1 -- 172.21.15.146:0/2057475310 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x556217206710 msgr2=0x556217303610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:19.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.584+0000 7f043a926800 1 --2- 172.21.15.146:0/2057475310 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x556217206710 0x556217303610 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:19.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.584+0000 7f043a926800 1 -- 172.21.15.146:0/2057475310 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x556217306bb0 msgr2=0x556217308fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:19.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.584+0000 7f043a926800 1 --2- 172.21.15.146:0/2057475310 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x556217306bb0 0x556217308fa0 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:19.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.584+0000 7f043a926800 1 -- 172.21.15.146:0/2057475310 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f031c036b40 msgr2=0x7f031c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:19.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.584+0000 7f043a926800 1 --2- 172.21.15.146:0/2057475310 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f031c036b40 0x7f031c039000 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x556217177050 tx=0x7f04200012f0 comp rx=0 tx=0).stop 2024-09-18T01:48:19.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.584+0000 7f043a926800 1 -- 172.21.15.146:0/2057475310 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562171776b0 msgr2=0x556217203ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:19.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.584+0000 7f043a926800 1 --2- 172.21.15.146:0/2057475310 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562171776b0 0x556217203ae0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x5562172f3720 tx=0x7f0428002fb0 comp rx=0 tx=0).stop 2024-09-18T01:48:19.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.585+0000 7f043a926800 1 -- 172.21.15.146:0/2057475310 shutdown_connections 2024-09-18T01:48:19.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.585+0000 7f043a926800 1 --2- 172.21.15.146:0/2057475310 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x556217306bb0 0x556217308fa0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:19.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.585+0000 7f043a926800 1 --2- 172.21.15.146:0/2057475310 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x556217206710 0x556217303610 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:19.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.585+0000 7f043a926800 1 --2- 172.21.15.146:0/2057475310 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f031c036b40 0x7f031c039000 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:19.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.585+0000 7f043a926800 1 --2- 172.21.15.146:0/2057475310 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5562171776b0 0x556217203ae0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:19.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.585+0000 7f043a926800 1 -- 172.21.15.146:0/2057475310 >> 172.21.15.146:0/2057475310 conn(0x5562171fdde0 msgr2=0x5562172ecaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:48:19.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.585+0000 7f043a926800 1 -- 172.21.15.146:0/2057475310 shutdown_connections 2024-09-18T01:48:19.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-18T01:48:19.585+0000 7f043a926800 1 -- 172.21.15.146:0/2057475310 wait complete. 2024-09-18T01:48:19.594 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-18T01:48:19.608 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-18T01:48:19.608 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T01:48:19.709 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:19.708+0000 7fb91359e640 1 Processor -- start 2024-09-18T01:48:19.709 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:19.708+0000 7fb91359e640 1 -- start start 2024-09-18T01:48:19.710 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:19.709+0000 7fb91359e640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fb914094fe0 0x7fb914095410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:19.710 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:19.709+0000 7fb91359e640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb914075280 con 0x7fb914074ea0 2024-09-18T01:48:19.710 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:19.709+0000 7fb91359e640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x7fb914096bc0 con 0x7fb914094fe0 2024-09-18T01:48:19.711 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:19.709+0000 7fb911d9b640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fb914094fe0 0x7fb914095410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:19.711 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:19.709+0000 7fb91259c640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fb914074ea0 0x7fb9140948d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:38596/0 (socket says 172.21.15.129:38596) 2024-09-18T01:48:19.711 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:19.709+0000 7fb91259c640 1 -- 172.21.15.129:0/1784764352 learned_addr learned my addr 172.21.15.129:0/1784764352 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-09-18T01:48:19.711 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:19.709+0000 7fb911d9b640 1 -- 172.21.15.129:0/1784764352 >> v1:172.21.15.129:6789/0 conn(0x7fb914074ea0 legacy=0x7fb9140948d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:19.711 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:19.709+0000 7fb911d9b640 1 -- 172.21.15.129:0/1784764352 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb914093f60 con 0x7fb914094fe0 2024-09-18T01:48:19.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:19.710+0000 7fb911d9b640 1 --2- 172.21.15.129:0/1784764352 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb914094fe0 0x7fb914095410 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fb908009720 tx=0x7fb90802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8184ddb4edddc412 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:19.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:19.710+0000 7fb91159a640 1 -- 172.21.15.129:0/1784764352 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb908037070 con 0x7fb914094fe0 2024-09-18T01:48:19.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:19.710+0000 7fb91159a640 1 -- 172.21.15.129:0/1784764352 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb90802ad90 con 0x7fb914094fe0 2024-09-18T01:48:19.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:19.710+0000 7fb91159a640 1 -- 172.21.15.129:0/1784764352 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb908032590 con 0x7fb914094fe0 2024-09-18T01:48:19.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:19.710+0000 7fb91359e640 1 -- 172.21.15.129:0/1784764352 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb914094fe0 msgr2=0x7fb914095410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:19.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:19.710+0000 7fb91359e640 1 --2- 172.21.15.129:0/1784764352 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb914094fe0 0x7fb914095410 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fb908009720 tx=0x7fb90802a110 comp rx=0 tx=0).stop 2024-09-18T01:48:19.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:19.710+0000 7fb91359e640 1 -- 172.21.15.129:0/1784764352 shutdown_connections 2024-09-18T01:48:19.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:19.710+0000 7fb91359e640 1 --2- 172.21.15.129:0/1784764352 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb914094fe0 0x7fb914095410 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:19.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:19.710+0000 7fb91359e640 1 -- 172.21.15.129:0/1784764352 >> 172.21.15.129:0/1784764352 conn(0x7fb91409d320 msgr2=0x7fb91409d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:48:19.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:19.711+0000 7fb91359e640 1 -- 172.21.15.129:0/1784764352 shutdown_connections 2024-09-18T01:48:19.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:19.711+0000 7fb91359e640 1 -- 172.21.15.129:0/1784764352 wait complete. 2024-09-18T01:48:19.714 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:19.711+0000 7fb91359e640 1 Processor -- start 2024-09-18T01:48:19.715 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:19.711+0000 7fb91359e640 1 -- start start 2024-09-18T01:48:19.715 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:19.712+0000 7fb91359e640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb914074ea0 0x7fb914132a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:19.715 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:19.712+0000 7fb91359e640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fb9141340c0 con 0x7fb914074ea0 2024-09-18T01:48:19.715 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:19.712+0000 7fb91259c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb914074ea0 0x7fb914132a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:19.715 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:19.712+0000 7fb91259c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb914074ea0 0x7fb914132a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:58752/0 (socket says 172.21.15.129:58752) 2024-09-18T01:48:19.715 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:19.712+0000 7fb91259c640 1 -- 172.21.15.129:0/1983225106 learned_addr learned my addr 172.21.15.129:0/1983225106 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-18T01:48:19.715 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:19.712+0000 7fb91259c640 1 -- 172.21.15.129:0/1983225106 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb914124bb0 con 0x7fb914074ea0 2024-09-18T01:48:19.715 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:19.712+0000 7fb91259c640 1 --2- 172.21.15.129:0/1983225106 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb914074ea0 0x7fb914132a30 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fb90400c4a0 tx=0x7fb90400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:19.715 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:19.712+0000 7fb902ffd640 1 -- 172.21.15.129:0/1983225106 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb904017070 con 0x7fb914074ea0 2024-09-18T01:48:19.715 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:19.712+0000 7fb902ffd640 1 -- 172.21.15.129:0/1983225106 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb904005c10 con 0x7fb914074ea0 2024-09-18T01:48:19.715 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:19.712+0000 7fb91359e640 1 -- 172.21.15.129:0/1983225106 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb914125840 con 0x7fb914074ea0 2024-09-18T01:48:19.715 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:19.712+0000 7fb902ffd640 1 -- 172.21.15.129:0/1983225106 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb904007070 con 0x7fb914074ea0 2024-09-18T01:48:19.715 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:19.713+0000 7fb91359e640 1 -- 172.21.15.129:0/1983225106 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb914132f70 con 0x7fb914074ea0 2024-09-18T01:48:19.716 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:19.713+0000 7fb902ffd640 1 -- 172.21.15.129:0/1983225106 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb90401a070 con 0x7fb914074ea0 2024-09-18T01:48:19.716 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:19.713+0000 7fb91359e640 1 -- 172.21.15.129:0/1983225106 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb914095410 con 0x7fb914074ea0 2024-09-18T01:48:19.716 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:19.714+0000 7fb902ffd640 1 --2- 172.21.15.129:0/1983225106 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb8f40382a0 0x7fb8f403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:19.716 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:19.714+0000 7fb902ffd640 1 -- 172.21.15.129:0/1983225106 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7fb90404afe0 con 0x7fb914074ea0 2024-09-18T01:48:19.716 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:19.714+0000 7fb911d9b640 1 --2- 172.21.15.129:0/1983225106 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb8f40382a0 0x7fb8f403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:19.716 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:19.714+0000 7fb911d9b640 1 --2- 172.21.15.129:0/1983225106 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb8f40382a0 0x7fb8f403a760 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb908034000 tx=0x7fb90802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:19.719 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:19.718+0000 7fb902ffd640 1 -- 172.21.15.129:0/1983225106 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb90401b3b0 con 0x7fb914074ea0 2024-09-18T01:48:19.883 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:19.882+0000 7fb91359e640 1 -- 172.21.15.129:0/1983225106 --> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb914124710 con 0x7fb8f40382a0 2024-09-18T01:48:19.899 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:19.898+0000 7fb902ffd640 1 -- 172.21.15.129:0/1983225106 <== mgr.4099 v2:172.21.15.146:6824/168968651 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665891 (secure 0 0 0) 0x7fb908032710 con 0x7fb8f40382a0 2024-09-18T01:48:19.907 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:48:19.913 INFO:teuthology.orchestra.run.smithi129.stderr:dumped all 2024-09-18T01:48:19.915 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:19.903+0000 7fb91359e640 1 -- 172.21.15.129:0/1983225106 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb8f40382a0 msgr2=0x7fb8f403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:19.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:19.903+0000 7fb91359e640 1 --2- 172.21.15.129:0/1983225106 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb8f40382a0 0x7fb8f403a760 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb908034000 tx=0x7fb90802e000 comp rx=0 tx=0).stop 2024-09-18T01:48:19.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:19.903+0000 7fb91359e640 1 -- 172.21.15.129:0/1983225106 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb914074ea0 msgr2=0x7fb914132a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:19.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:19.903+0000 7fb91359e640 1 --2- 172.21.15.129:0/1983225106 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb914074ea0 0x7fb914132a30 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fb90400c4a0 tx=0x7fb90400c960 comp rx=0 tx=0).stop 2024-09-18T01:48:19.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:19.903+0000 7fb91359e640 1 -- 172.21.15.129:0/1983225106 shutdown_connections 2024-09-18T01:48:19.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:19.903+0000 7fb91359e640 1 --2- 172.21.15.129:0/1983225106 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fb8f40382a0 0x7fb8f403a760 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:19.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:19.903+0000 7fb91359e640 1 --2- 172.21.15.129:0/1983225106 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb914074ea0 0x7fb914132a30 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:19.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:19.903+0000 7fb91359e640 1 -- 172.21.15.129:0/1983225106 >> 172.21.15.129:0/1983225106 conn(0x7fb91409d320 msgr2=0x7fb91406d540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:48:19.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:19.903+0000 7fb91359e640 1 -- 172.21.15.129:0/1983225106 shutdown_connections 2024-09-18T01:48:19.916 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:19.903+0000 7fb91359e640 1 -- 172.21.15.129:0/1983225106 wait complete. 2024-09-18T01:48:19.917 INFO:teuthology.orchestra.run.smithi129.stdout:{"pg_ready":true,"pg_map":{"version":136,"stamp":"2024-09-18T01:48:18.240747+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26410519,"num_objects":261,"num_object_clones":0,"num_object_copies":529,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":261,"num_whiteouts":0,"num_read":5150,"num_read_kb":4698,"num_write":2298,"num_write_kb":61374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4674,"ondisk_log_size":4674,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":186236,"kb_used_data":40700,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377301124,"statfs":{"total":386547056640,"available":386356350976,"internally_reserved":0,"allocated":41676800,"data_stored":40497544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":148956951},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25809398,"num_objects":9,"num_object_clones":0,"num_object_copies":25,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":455,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003333"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.333746+0000","last_change":"2024-09-18T01:45:04.287665+0000","last_active":"2024-09-18T01:45:41.333746+0000","last_peered":"2024-09-18T01:45:41.333746+0000","last_clean":"2024-09-18T01:45:41.333746+0000","last_became_active":"2024-09-18T01:45:04.287322+0000","last_became_peered":"2024-09-18T01:45:04.287322+0000","last_unstale":"2024-09-18T01:45:41.333746+0000","last_undegraded":"2024-09-18T01:45:41.333746+0000","last_fullsized":"2024-09-18T01:45:41.333746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:31:48.524360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"33'8","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.871310+0000","last_change":"2024-09-18T01:45:06.296427+0000","last_active":"2024-09-18T01:48:12.871310+0000","last_peered":"2024-09-18T01:48:12.871310+0000","last_clean":"2024-09-18T01:48:12.871310+0000","last_became_active":"2024-09-18T01:45:06.295819+0000","last_became_peered":"2024-09-18T01:45:06.295819+0000","last_unstale":"2024-09-18T01:48:12.871310+0000","last_undegraded":"2024-09-18T01:48:12.871310+0000","last_fullsized":"2024-09-18T01:48:12.871310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:38:33.477420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.148239+0000","last_change":"2024-09-18T01:45:04.280965+0000","last_active":"2024-09-18T01:47:12.148239+0000","last_peered":"2024-09-18T01:47:12.148239+0000","last_clean":"2024-09-18T01:47:12.148239+0000","last_became_active":"2024-09-18T01:45:04.280591+0000","last_became_peered":"2024-09-18T01:45:04.280591+0000","last_unstale":"2024-09-18T01:47:12.148239+0000","last_undegraded":"2024-09-18T01:47:12.148239+0000","last_fullsized":"2024-09-18T01:47:12.148239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:43:03.344288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"33'12","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.880318+0000","last_change":"2024-09-18T01:45:06.282040+0000","last_active":"2024-09-18T01:48:12.880318+0000","last_peered":"2024-09-18T01:48:12.880318+0000","last_clean":"2024-09-18T01:48:12.880318+0000","last_became_active":"2024-09-18T01:45:06.281659+0000","last_became_peered":"2024-09-18T01:45:06.281659+0000","last_unstale":"2024-09-18T01:48:12.880318+0000","last_undegraded":"2024-09-18T01:48:12.880318+0000","last_fullsized":"2024-09-18T01:48:12.880318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:40:04.666289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"33'5","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.119006+0000","last_change":"2024-09-18T01:45:04.287682+0000","last_active":"2024-09-18T01:47:12.119006+0000","last_peered":"2024-09-18T01:47:12.119006+0000","last_clean":"2024-09-18T01:47:12.119006+0000","last_became_active":"2024-09-18T01:45:04.286007+0000","last_became_peered":"2024-09-18T01:45:04.286007+0000","last_unstale":"2024-09-18T01:47:12.119006+0000","last_undegraded":"2024-09-18T01:47:12.119006+0000","last_fullsized":"2024-09-18T01:47:12.119006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:45:57.765789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"33'18","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:09.011236+0000","last_change":"2024-09-18T01:45:06.285754+0000","last_active":"2024-09-18T01:47:09.011236+0000","last_peered":"2024-09-18T01:47:09.011236+0000","last_clean":"2024-09-18T01:47:09.011236+0000","last_became_active":"2024-09-18T01:45:06.285378+0000","last_became_peered":"2024-09-18T01:45:06.285378+0000","last_unstale":"2024-09-18T01:47:09.011236+0000","last_undegraded":"2024-09-18T01:47:09.011236+0000","last_fullsized":"2024-09-18T01:47:09.011236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:03:10.550215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":40,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.332258+0000","last_change":"2024-09-18T01:45:04.298111+0000","last_active":"2024-09-18T01:45:41.332258+0000","last_peered":"2024-09-18T01:45:41.332258+0000","last_clean":"2024-09-18T01:45:41.332258+0000","last_became_active":"2024-09-18T01:45:04.297791+0000","last_became_peered":"2024-09-18T01:45:04.297791+0000","last_unstale":"2024-09-18T01:45:41.332258+0000","last_undegraded":"2024-09-18T01:45:41.332258+0000","last_fullsized":"2024-09-18T01:45:41.332258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:56:17.978705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"33'6","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.931884+0000","last_change":"2024-09-18T01:45:06.281604+0000","last_active":"2024-09-18T01:48:12.931884+0000","last_peered":"2024-09-18T01:48:12.931884+0000","last_clean":"2024-09-18T01:48:12.931884+0000","last_became_active":"2024-09-18T01:45:06.280779+0000","last_became_peered":"2024-09-18T01:45:06.280779+0000","last_unstale":"2024-09-18T01:48:12.931884+0000","last_undegraded":"2024-09-18T01:48:12.931884+0000","last_fullsized":"2024-09-18T01:48:12.931884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:30:51.321533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.336661+0000","last_change":"2024-09-18T01:45:04.280905+0000","last_active":"2024-09-18T01:45:41.336661+0000","last_peered":"2024-09-18T01:45:41.336661+0000","last_clean":"2024-09-18T01:45:41.336661+0000","last_became_active":"2024-09-18T01:45:04.280582+0000","last_became_peered":"2024-09-18T01:45:04.280582+0000","last_unstale":"2024-09-18T01:45:41.336661+0000","last_undegraded":"2024-09-18T01:45:41.336661+0000","last_fullsized":"2024-09-18T01:45:41.336661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:31:58.114526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'12","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.162513+0000","last_change":"2024-09-18T01:45:06.289323+0000","last_active":"2024-09-18T01:47:12.162513+0000","last_peered":"2024-09-18T01:47:12.162513+0000","last_clean":"2024-09-18T01:47:12.162513+0000","last_became_active":"2024-09-18T01:45:06.289036+0000","last_became_peered":"2024-09-18T01:45:06.289036+0000","last_unstale":"2024-09-18T01:47:12.162513+0000","last_undegraded":"2024-09-18T01:47:12.162513+0000","last_fullsized":"2024-09-18T01:47:12.162513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:10:29.661303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.331520+0000","last_change":"2024-09-18T01:45:04.286820+0000","last_active":"2024-09-18T01:45:41.331520+0000","last_peered":"2024-09-18T01:45:41.331520+0000","last_clean":"2024-09-18T01:45:41.331520+0000","last_became_active":"2024-09-18T01:45:04.286509+0000","last_became_peered":"2024-09-18T01:45:04.286509+0000","last_unstale":"2024-09-18T01:45:41.331520+0000","last_undegraded":"2024-09-18T01:45:41.331520+0000","last_fullsized":"2024-09-18T01:45:41.331520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:49:22.831669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:46:28.368317+0000","last_change":"2024-09-18T01:45:06.288010+0000","last_active":"2024-09-18T01:46:28.368317+0000","last_peered":"2024-09-18T01:46:28.368317+0000","last_clean":"2024-09-18T01:46:28.368317+0000","last_became_active":"2024-09-18T01:45:06.287110+0000","last_became_peered":"2024-09-18T01:45:06.287110+0000","last_unstale":"2024-09-18T01:46:28.368317+0000","last_undegraded":"2024-09-18T01:46:28.368317+0000","last_fullsized":"2024-09-18T01:46:28.368317+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:15:07.650151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.774639+0000","last_change":"2024-09-18T01:45:04.293823+0000","last_active":"2024-09-18T01:48:12.774639+0000","last_peered":"2024-09-18T01:48:12.774639+0000","last_clean":"2024-09-18T01:48:12.774639+0000","last_became_active":"2024-09-18T01:45:04.289290+0000","last_became_peered":"2024-09-18T01:45:04.289290+0000","last_unstale":"2024-09-18T01:48:12.774639+0000","last_undegraded":"2024-09-18T01:48:12.774639+0000","last_fullsized":"2024-09-18T01:48:12.774639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:38:46.320555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'13","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.848762+0000","last_change":"2024-09-18T01:45:06.295725+0000","last_active":"2024-09-18T01:48:12.848762+0000","last_peered":"2024-09-18T01:48:12.848762+0000","last_clean":"2024-09-18T01:48:12.848762+0000","last_became_active":"2024-09-18T01:45:06.295429+0000","last_became_peered":"2024-09-18T01:45:06.295429+0000","last_unstale":"2024-09-18T01:48:12.848762+0000","last_undegraded":"2024-09-18T01:48:12.848762+0000","last_fullsized":"2024-09-18T01:48:12.848762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:48:17.261741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337598+0000","last_change":"2024-09-18T01:45:04.273877+0000","last_active":"2024-09-18T01:45:41.337598+0000","last_peered":"2024-09-18T01:45:41.337598+0000","last_clean":"2024-09-18T01:45:41.337598+0000","last_became_active":"2024-09-18T01:45:04.273328+0000","last_became_peered":"2024-09-18T01:45:04.273328+0000","last_unstale":"2024-09-18T01:45:41.337598+0000","last_undegraded":"2024-09-18T01:45:41.337598+0000","last_fullsized":"2024-09-18T01:45:41.337598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:18:35.916205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'9","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.660161+0000","last_change":"2024-09-18T01:45:06.285251+0000","last_active":"2024-09-18T01:48:12.660161+0000","last_peered":"2024-09-18T01:48:12.660161+0000","last_clean":"2024-09-18T01:48:12.660161+0000","last_became_active":"2024-09-18T01:45:06.284994+0000","last_became_peered":"2024-09-18T01:45:06.284994+0000","last_unstale":"2024-09-18T01:48:12.660161+0000","last_undegraded":"2024-09-18T01:48:12.660161+0000","last_fullsized":"2024-09-18T01:48:12.660161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:37:02.533275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.171347+0000","last_change":"2024-09-18T01:45:06.286775+0000","last_active":"2024-09-18T01:47:12.171347+0000","last_peered":"2024-09-18T01:47:12.171347+0000","last_clean":"2024-09-18T01:47:12.171347+0000","last_became_active":"2024-09-18T01:45:06.286524+0000","last_became_peered":"2024-09-18T01:45:06.286524+0000","last_unstale":"2024-09-18T01:47:12.171347+0000","last_undegraded":"2024-09-18T01:47:12.171347+0000","last_fullsized":"2024-09-18T01:47:12.171347+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:22:27.593735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338138+0000","last_change":"2024-09-18T01:45:04.298742+0000","last_active":"2024-09-18T01:45:41.338138+0000","last_peered":"2024-09-18T01:45:41.338138+0000","last_clean":"2024-09-18T01:45:41.338138+0000","last_became_active":"2024-09-18T01:45:04.298399+0000","last_became_peered":"2024-09-18T01:45:04.298399+0000","last_unstale":"2024-09-18T01:45:41.338138+0000","last_undegraded":"2024-09-18T01:45:41.338138+0000","last_fullsized":"2024-09-18T01:45:41.338138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:56:17.978705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"33'10","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.171009+0000","last_change":"2024-09-18T01:45:06.294964+0000","last_active":"2024-09-18T01:47:12.171009+0000","last_peered":"2024-09-18T01:47:12.171009+0000","last_clean":"2024-09-18T01:47:12.171009+0000","last_became_active":"2024-09-18T01:45:06.294670+0000","last_became_peered":"2024-09-18T01:45:06.294670+0000","last_unstale":"2024-09-18T01:47:12.171009+0000","last_undegraded":"2024-09-18T01:47:12.171009+0000","last_fullsized":"2024-09-18T01:47:12.171009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:12:27.107318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.334046+0000","last_change":"2024-09-18T01:45:04.286914+0000","last_active":"2024-09-18T01:45:41.334046+0000","last_peered":"2024-09-18T01:45:41.334046+0000","last_clean":"2024-09-18T01:45:41.334046+0000","last_became_active":"2024-09-18T01:45:04.286465+0000","last_became_peered":"2024-09-18T01:45:04.286465+0000","last_unstale":"2024-09-18T01:45:41.334046+0000","last_undegraded":"2024-09-18T01:45:41.334046+0000","last_fullsized":"2024-09-18T01:45:41.334046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:18:35.916205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'3","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:27.217076+0000","last_change":"2024-09-18T01:45:06.294374+0000","last_active":"2024-09-18T01:47:27.217076+0000","last_peered":"2024-09-18T01:47:27.217076+0000","last_clean":"2024-09-18T01:47:27.217076+0000","last_became_active":"2024-09-18T01:45:06.294118+0000","last_became_peered":"2024-09-18T01:45:06.294118+0000","last_unstale":"2024-09-18T01:47:27.217076+0000","last_undegraded":"2024-09-18T01:47:27.217076+0000","last_fullsized":"2024-09-18T01:47:27.217076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:55:38.246732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338586+0000","last_change":"2024-09-18T01:45:04.294733+0000","last_active":"2024-09-18T01:45:41.338586+0000","last_peered":"2024-09-18T01:45:41.338586+0000","last_clean":"2024-09-18T01:45:41.338586+0000","last_became_active":"2024-09-18T01:45:04.294327+0000","last_became_peered":"2024-09-18T01:45:04.294327+0000","last_unstale":"2024-09-18T01:45:41.338586+0000","last_undegraded":"2024-09-18T01:45:41.338586+0000","last_fullsized":"2024-09-18T01:45:41.338586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:18:35.916205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'4","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.171117+0000","last_change":"2024-09-18T01:45:06.285844+0000","last_active":"2024-09-18T01:47:12.171117+0000","last_peered":"2024-09-18T01:47:12.171117+0000","last_clean":"2024-09-18T01:47:12.171117+0000","last_became_active":"2024-09-18T01:45:06.285429+0000","last_became_peered":"2024-09-18T01:45:06.285429+0000","last_unstale":"2024-09-18T01:47:12.171117+0000","last_undegraded":"2024-09-18T01:47:12.171117+0000","last_fullsized":"2024-09-18T01:47:12.171117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:33:43.173746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.336963+0000","last_change":"2024-09-18T01:45:04.299057+0000","last_active":"2024-09-18T01:45:41.336963+0000","last_peered":"2024-09-18T01:45:41.336963+0000","last_clean":"2024-09-18T01:45:41.336963+0000","last_became_active":"2024-09-18T01:45:04.298601+0000","last_became_peered":"2024-09-18T01:45:04.298601+0000","last_unstale":"2024-09-18T01:45:41.336963+0000","last_undegraded":"2024-09-18T01:45:41.336963+0000","last_fullsized":"2024-09-18T01:45:41.336963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:31:48.524360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'10","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.558700+0000","last_change":"2024-09-18T01:45:06.286133+0000","last_active":"2024-09-18T01:48:12.558700+0000","last_peered":"2024-09-18T01:48:12.558700+0000","last_clean":"2024-09-18T01:48:12.558700+0000","last_became_active":"2024-09-18T01:45:06.285228+0000","last_became_peered":"2024-09-18T01:45:06.285228+0000","last_unstale":"2024-09-18T01:48:12.558700+0000","last_undegraded":"2024-09-18T01:48:12.558700+0000","last_fullsized":"2024-09-18T01:48:12.558700+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:03:57.671184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:46.110785+0000","last_change":"2024-09-18T01:45:04.281502+0000","last_active":"2024-09-18T01:45:46.110785+0000","last_peered":"2024-09-18T01:45:46.110785+0000","last_clean":"2024-09-18T01:45:46.110785+0000","last_became_active":"2024-09-18T01:45:04.281118+0000","last_became_peered":"2024-09-18T01:45:04.281118+0000","last_unstale":"2024-09-18T01:45:46.110785+0000","last_undegraded":"2024-09-18T01:45:46.110785+0000","last_fullsized":"2024-09-18T01:45:46.110785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:42:11.703254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"33'16","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.793630+0000","last_change":"2024-09-18T01:45:06.284548+0000","last_active":"2024-09-18T01:48:12.793630+0000","last_peered":"2024-09-18T01:48:12.793630+0000","last_clean":"2024-09-18T01:48:12.793630+0000","last_became_active":"2024-09-18T01:45:06.284237+0000","last_became_peered":"2024-09-18T01:45:06.284237+0000","last_unstale":"2024-09-18T01:48:12.793630+0000","last_undegraded":"2024-09-18T01:48:12.793630+0000","last_fullsized":"2024-09-18T01:48:12.793630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:04:56.154083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":48,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338330+0000","last_change":"2024-09-18T01:45:04.285185+0000","last_active":"2024-09-18T01:45:41.338330+0000","last_peered":"2024-09-18T01:45:41.338330+0000","last_clean":"2024-09-18T01:45:41.338330+0000","last_became_active":"2024-09-18T01:45:04.284148+0000","last_became_peered":"2024-09-18T01:45:04.284148+0000","last_unstale":"2024-09-18T01:45:41.338330+0000","last_undegraded":"2024-09-18T01:45:41.338330+0000","last_fullsized":"2024-09-18T01:45:41.338330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:09:41.307844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'35","reported_seq":99,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.821349+0000","last_change":"2024-09-18T01:45:14.323024+0000","last_active":"2024-09-18T01:48:12.821349+0000","last_peered":"2024-09-18T01:48:12.821349+0000","last_clean":"2024-09-18T01:48:12.821349+0000","last_became_active":"2024-09-18T01:45:14.322729+0000","last_became_peered":"2024-09-18T01:45:14.322729+0000","last_unstale":"2024-09-18T01:48:12.821349+0000","last_undegraded":"2024-09-18T01:48:12.821349+0000","last_fullsized":"2024-09-18T01:48:12.821349+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:40:38.654675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'10","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.559925+0000","last_change":"2024-09-18T01:45:06.281639+0000","last_active":"2024-09-18T01:48:12.559925+0000","last_peered":"2024-09-18T01:48:12.559925+0000","last_clean":"2024-09-18T01:48:12.559925+0000","last_became_active":"2024-09-18T01:45:06.281361+0000","last_became_peered":"2024-09-18T01:45:06.281361+0000","last_unstale":"2024-09-18T01:48:12.559925+0000","last_undegraded":"2024-09-18T01:48:12.559925+0000","last_fullsized":"2024-09-18T01:48:12.559925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:48:25.542869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"33'1","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:27.217105+0000","last_change":"2024-09-18T01:45:04.285350+0000","last_active":"2024-09-18T01:47:27.217105+0000","last_peered":"2024-09-18T01:47:27.217105+0000","last_clean":"2024-09-18T01:47:27.217105+0000","last_became_active":"2024-09-18T01:45:04.285008+0000","last_became_peered":"2024-09-18T01:45:04.285008+0000","last_unstale":"2024-09-18T01:47:27.217105+0000","last_undegraded":"2024-09-18T01:47:27.217105+0000","last_fullsized":"2024-09-18T01:47:27.217105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:37:00.525779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.340987+0000","last_change":"2024-09-18T01:45:08.296627+0000","last_active":"2024-09-18T01:45:41.340987+0000","last_peered":"2024-09-18T01:45:41.340987+0000","last_clean":"2024-09-18T01:45:41.340987+0000","last_became_active":"2024-09-18T01:45:08.296241+0000","last_became_peered":"2024-09-18T01:45:08.296241+0000","last_unstale":"2024-09-18T01:45:41.340987+0000","last_undegraded":"2024-09-18T01:45:41.340987+0000","last_fullsized":"2024-09-18T01:45:41.340987+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:01:25.419937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'43","reported_seq":97,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:10.683922+0000","last_change":"2024-09-18T01:45:10.306140+0000","last_active":"2024-09-18T01:47:10.683922+0000","last_peered":"2024-09-18T01:47:10.683922+0000","last_clean":"2024-09-18T01:47:10.683922+0000","last_became_active":"2024-09-18T01:45:10.305713+0000","last_became_peered":"2024-09-18T01:45:10.305713+0000","last_unstale":"2024-09-18T01:47:10.683922+0000","last_undegraded":"2024-09-18T01:47:10.683922+0000","last_fullsized":"2024-09-18T01:47:10.683922+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:42:14.941344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337936+0000","last_change":"2024-09-18T01:45:12.313546+0000","last_active":"2024-09-18T01:45:41.337936+0000","last_peered":"2024-09-18T01:45:41.337936+0000","last_clean":"2024-09-18T01:45:41.337936+0000","last_became_active":"2024-09-18T01:45:12.313276+0000","last_became_peered":"2024-09-18T01:45:12.313276+0000","last_unstale":"2024-09-18T01:45:41.337936+0000","last_undegraded":"2024-09-18T01:45:41.337936+0000","last_fullsized":"2024-09-18T01:45:41.337936+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:22:43.654693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'7","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:46:28.375354+0000","last_change":"2024-09-18T01:45:14.318360+0000","last_active":"2024-09-18T01:46:28.375354+0000","last_peered":"2024-09-18T01:46:28.375354+0000","last_clean":"2024-09-18T01:46:28.375354+0000","last_became_active":"2024-09-18T01:45:14.318093+0000","last_became_peered":"2024-09-18T01:45:14.318093+0000","last_unstale":"2024-09-18T01:46:28.375354+0000","last_undegraded":"2024-09-18T01:46:28.375354+0000","last_fullsized":"2024-09-18T01:46:28.375354+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:28:17.630868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"33'13","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.879659+0000","last_change":"2024-09-18T01:45:41.348633+0000","last_active":"2024-09-18T01:48:12.879659+0000","last_peered":"2024-09-18T01:48:12.879659+0000","last_clean":"2024-09-18T01:48:12.879659+0000","last_became_active":"2024-09-18T01:45:41.338243+0000","last_became_peered":"2024-09-18T01:45:41.338243+0000","last_unstale":"2024-09-18T01:48:12.879659+0000","last_undegraded":"2024-09-18T01:48:12.879659+0000","last_fullsized":"2024-09-18T01:48:12.879659+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:42:23.528238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":13,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:44.958482+0000","last_change":"2024-09-18T01:45:04.293264+0000","last_active":"2024-09-18T01:45:44.958482+0000","last_peered":"2024-09-18T01:45:44.958482+0000","last_clean":"2024-09-18T01:45:44.958482+0000","last_became_active":"2024-09-18T01:45:04.292853+0000","last_became_peered":"2024-09-18T01:45:04.292853+0000","last_unstale":"2024-09-18T01:45:44.958482+0000","last_undegraded":"2024-09-18T01:45:44.958482+0000","last_fullsized":"2024-09-18T01:45:44.958482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:19:39.056474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338261+0000","last_change":"2024-09-18T01:45:08.288697+0000","last_active":"2024-09-18T01:45:41.338261+0000","last_peered":"2024-09-18T01:45:41.338261+0000","last_clean":"2024-09-18T01:45:41.338261+0000","last_became_active":"2024-09-18T01:45:08.288390+0000","last_became_peered":"2024-09-18T01:45:08.288390+0000","last_unstale":"2024-09-18T01:45:41.338261+0000","last_undegraded":"2024-09-18T01:45:41.338261+0000","last_fullsized":"2024-09-18T01:45:41.338261+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:45:19.311056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"31'12","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337413+0000","last_change":"2024-09-18T01:45:10.303251+0000","last_active":"2024-09-18T01:45:41.337413+0000","last_peered":"2024-09-18T01:45:41.337413+0000","last_clean":"2024-09-18T01:45:41.337413+0000","last_became_active":"2024-09-18T01:45:10.302957+0000","last_became_peered":"2024-09-18T01:45:10.302957+0000","last_unstale":"2024-09-18T01:45:41.337413+0000","last_undegraded":"2024-09-18T01:45:41.337413+0000","last_fullsized":"2024-09-18T01:45:41.337413+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:22:48.911652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337811+0000","last_change":"2024-09-18T01:45:12.317743+0000","last_active":"2024-09-18T01:45:41.337811+0000","last_peered":"2024-09-18T01:45:41.337811+0000","last_clean":"2024-09-18T01:45:41.337811+0000","last_became_active":"2024-09-18T01:45:12.317471+0000","last_became_peered":"2024-09-18T01:45:12.317471+0000","last_unstale":"2024-09-18T01:45:41.337811+0000","last_undegraded":"2024-09-18T01:45:41.337811+0000","last_fullsized":"2024-09-18T01:45:41.337811+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:18:50.168373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337317+0000","last_change":"2024-09-18T01:45:14.319762+0000","last_active":"2024-09-18T01:45:41.337317+0000","last_peered":"2024-09-18T01:45:41.337317+0000","last_clean":"2024-09-18T01:45:41.337317+0000","last_became_active":"2024-09-18T01:45:14.319387+0000","last_became_peered":"2024-09-18T01:45:14.319387+0000","last_unstale":"2024-09-18T01:45:41.337317+0000","last_undegraded":"2024-09-18T01:45:41.337317+0000","last_fullsized":"2024-09-18T01:45:41.337317+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:54:12.321781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'10","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.171155+0000","last_change":"2024-09-18T01:45:06.284632+0000","last_active":"2024-09-18T01:47:12.171155+0000","last_peered":"2024-09-18T01:47:12.171155+0000","last_clean":"2024-09-18T01:47:12.171155+0000","last_became_active":"2024-09-18T01:45:06.283815+0000","last_became_peered":"2024-09-18T01:45:06.283815+0000","last_unstale":"2024-09-18T01:47:12.171155+0000","last_undegraded":"2024-09-18T01:47:12.171155+0000","last_fullsized":"2024-09-18T01:47:12.171155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:55:34.371724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.335146+0000","last_change":"2024-09-18T01:45:04.293546+0000","last_active":"2024-09-18T01:45:41.335146+0000","last_peered":"2024-09-18T01:45:41.335146+0000","last_clean":"2024-09-18T01:45:41.335146+0000","last_became_active":"2024-09-18T01:45:04.288040+0000","last_became_peered":"2024-09-18T01:45:04.288040+0000","last_unstale":"2024-09-18T01:45:41.335146+0000","last_undegraded":"2024-09-18T01:45:41.335146+0000","last_fullsized":"2024-09-18T01:45:41.335146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:12:25.099822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.340495+0000","last_change":"2024-09-18T01:45:08.288920+0000","last_active":"2024-09-18T01:45:41.340495+0000","last_peered":"2024-09-18T01:45:41.340495+0000","last_clean":"2024-09-18T01:45:41.340495+0000","last_became_active":"2024-09-18T01:45:08.288667+0000","last_became_peered":"2024-09-18T01:45:08.288667+0000","last_unstale":"2024-09-18T01:45:41.340495+0000","last_undegraded":"2024-09-18T01:45:41.340495+0000","last_fullsized":"2024-09-18T01:45:41.340495+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:58:00.539983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"31'23","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.333260+0000","last_change":"2024-09-18T01:45:10.304260+0000","last_active":"2024-09-18T01:45:41.333260+0000","last_peered":"2024-09-18T01:45:41.333260+0000","last_clean":"2024-09-18T01:45:41.333260+0000","last_became_active":"2024-09-18T01:45:10.304004+0000","last_became_peered":"2024-09-18T01:45:10.304004+0000","last_unstale":"2024-09-18T01:45:41.333260+0000","last_undegraded":"2024-09-18T01:45:41.333260+0000","last_fullsized":"2024-09-18T01:45:41.333260+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:39:04.390442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'282","reported_seq":384,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.988981+0000","last_change":"2024-09-18T01:45:12.317560+0000","last_active":"2024-09-18T01:48:12.988981+0000","last_peered":"2024-09-18T01:48:12.988981+0000","last_clean":"2024-09-18T01:48:12.988981+0000","last_became_active":"2024-09-18T01:45:12.317288+0000","last_became_peered":"2024-09-18T01:45:12.317288+0000","last_unstale":"2024-09-18T01:48:12.988981+0000","last_undegraded":"2024-09-18T01:48:12.988981+0000","last_fullsized":"2024-09-18T01:48:12.988981+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:48:33.500493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.331675+0000","last_change":"2024-09-18T01:45:14.326621+0000","last_active":"2024-09-18T01:45:41.331675+0000","last_peered":"2024-09-18T01:45:41.331675+0000","last_clean":"2024-09-18T01:45:41.331675+0000","last_became_active":"2024-09-18T01:45:14.325843+0000","last_became_peered":"2024-09-18T01:45:14.325843+0000","last_unstale":"2024-09-18T01:45:41.331675+0000","last_undegraded":"2024-09-18T01:45:41.331675+0000","last_fullsized":"2024-09-18T01:45:41.331675+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:49:37.077451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.340482+0000","last_change":"2024-09-18T01:45:06.295671+0000","last_active":"2024-09-18T01:45:41.340482+0000","last_peered":"2024-09-18T01:45:41.340482+0000","last_clean":"2024-09-18T01:45:41.340482+0000","last_became_active":"2024-09-18T01:45:06.295417+0000","last_became_peered":"2024-09-18T01:45:06.295417+0000","last_unstale":"2024-09-18T01:45:41.340482+0000","last_undegraded":"2024-09-18T01:45:41.340482+0000","last_fullsized":"2024-09-18T01:45:41.340482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:20:03.455685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:46.101670+0000","last_change":"2024-09-18T01:45:04.282935+0000","last_active":"2024-09-18T01:45:46.101670+0000","last_peered":"2024-09-18T01:45:46.101670+0000","last_clean":"2024-09-18T01:45:46.101670+0000","last_became_active":"2024-09-18T01:45:04.282500+0000","last_became_peered":"2024-09-18T01:45:04.282500+0000","last_unstale":"2024-09-18T01:45:46.101670+0000","last_undegraded":"2024-09-18T01:45:46.101670+0000","last_fullsized":"2024-09-18T01:45:46.101670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:59:04.808153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338959+0000","last_change":"2024-09-18T01:45:08.296538+0000","last_active":"2024-09-18T01:45:41.338959+0000","last_peered":"2024-09-18T01:45:41.338959+0000","last_clean":"2024-09-18T01:45:41.338959+0000","last_became_active":"2024-09-18T01:45:08.296192+0000","last_became_peered":"2024-09-18T01:45:08.296192+0000","last_unstale":"2024-09-18T01:45:41.338959+0000","last_undegraded":"2024-09-18T01:45:41.338959+0000","last_fullsized":"2024-09-18T01:45:41.338959+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:28:48.199978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'36","reported_seq":84,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:10.678613+0000","last_change":"2024-09-18T01:45:10.305819+0000","last_active":"2024-09-18T01:47:10.678613+0000","last_peered":"2024-09-18T01:47:10.678613+0000","last_clean":"2024-09-18T01:47:10.678613+0000","last_became_active":"2024-09-18T01:45:10.305515+0000","last_became_peered":"2024-09-18T01:45:10.305515+0000","last_unstale":"2024-09-18T01:47:10.678613+0000","last_undegraded":"2024-09-18T01:47:10.678613+0000","last_fullsized":"2024-09-18T01:47:10.678613+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:54:15.247041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'282","reported_seq":400,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.874424+0000","last_change":"2024-09-18T01:45:12.313547+0000","last_active":"2024-09-18T01:48:12.874424+0000","last_peered":"2024-09-18T01:48:12.874424+0000","last_clean":"2024-09-18T01:48:12.874424+0000","last_became_active":"2024-09-18T01:45:12.313219+0000","last_became_peered":"2024-09-18T01:45:12.313219+0000","last_unstale":"2024-09-18T01:48:12.874424+0000","last_undegraded":"2024-09-18T01:48:12.874424+0000","last_fullsized":"2024-09-18T01:48:12.874424+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:18:26.966437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.334693+0000","last_change":"2024-09-18T01:45:06.297804+0000","last_active":"2024-09-18T01:45:41.334693+0000","last_peered":"2024-09-18T01:45:41.334693+0000","last_clean":"2024-09-18T01:45:41.334693+0000","last_became_active":"2024-09-18T01:45:06.297283+0000","last_became_peered":"2024-09-18T01:45:06.297283+0000","last_unstale":"2024-09-18T01:45:41.334693+0000","last_undegraded":"2024-09-18T01:45:41.334693+0000","last_fullsized":"2024-09-18T01:45:41.334693+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:34:09.651529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.333900+0000","last_change":"2024-09-18T01:45:04.289955+0000","last_active":"2024-09-18T01:45:41.333900+0000","last_peered":"2024-09-18T01:45:41.333900+0000","last_clean":"2024-09-18T01:45:41.333900+0000","last_became_active":"2024-09-18T01:45:04.289629+0000","last_became_peered":"2024-09-18T01:45:04.289629+0000","last_unstale":"2024-09-18T01:45:41.333900+0000","last_undegraded":"2024-09-18T01:45:41.333900+0000","last_fullsized":"2024-09-18T01:45:41.333900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:43:03.344288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.333438+0000","last_change":"2024-09-18T01:45:08.294834+0000","last_active":"2024-09-18T01:45:41.333438+0000","last_peered":"2024-09-18T01:45:41.333438+0000","last_clean":"2024-09-18T01:45:41.333438+0000","last_became_active":"2024-09-18T01:45:08.294273+0000","last_became_peered":"2024-09-18T01:45:08.294273+0000","last_unstale":"2024-09-18T01:45:41.333438+0000","last_undegraded":"2024-09-18T01:45:41.333438+0000","last_fullsized":"2024-09-18T01:45:41.333438+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:54:13.237972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'46","reported_seq":99,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:10.687815+0000","last_change":"2024-09-18T01:45:10.298381+0000","last_active":"2024-09-18T01:47:10.687815+0000","last_peered":"2024-09-18T01:47:10.687815+0000","last_clean":"2024-09-18T01:47:10.687815+0000","last_became_active":"2024-09-18T01:45:10.298021+0000","last_became_peered":"2024-09-18T01:45:10.298021+0000","last_unstale":"2024-09-18T01:47:10.687815+0000","last_undegraded":"2024-09-18T01:47:10.687815+0000","last_fullsized":"2024-09-18T01:47:10.687815+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:39:10.135582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338655+0000","last_change":"2024-09-18T01:45:12.314207+0000","last_active":"2024-09-18T01:45:41.338655+0000","last_peered":"2024-09-18T01:45:41.338655+0000","last_clean":"2024-09-18T01:45:41.338655+0000","last_became_active":"2024-09-18T01:45:12.313875+0000","last_became_peered":"2024-09-18T01:45:12.313875+0000","last_unstale":"2024-09-18T01:45:41.338655+0000","last_undegraded":"2024-09-18T01:45:41.338655+0000","last_fullsized":"2024-09-18T01:45:41.338655+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:42:29.558204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'7","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:46:28.376975+0000","last_change":"2024-09-18T01:45:14.322757+0000","last_active":"2024-09-18T01:46:28.376975+0000","last_peered":"2024-09-18T01:46:28.376975+0000","last_clean":"2024-09-18T01:46:28.376975+0000","last_became_active":"2024-09-18T01:45:14.322448+0000","last_became_peered":"2024-09-18T01:45:14.322448+0000","last_unstale":"2024-09-18T01:46:28.376975+0000","last_undegraded":"2024-09-18T01:46:28.376975+0000","last_fullsized":"2024-09-18T01:46:28.376975+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:13:39.692712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":17,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'8","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.649737+0000","last_change":"2024-09-18T01:45:06.292485+0000","last_active":"2024-09-18T01:48:12.649737+0000","last_peered":"2024-09-18T01:48:12.649737+0000","last_clean":"2024-09-18T01:48:12.649737+0000","last_became_active":"2024-09-18T01:45:06.292143+0000","last_became_peered":"2024-09-18T01:45:06.292143+0000","last_unstale":"2024-09-18T01:48:12.649737+0000","last_undegraded":"2024-09-18T01:48:12.649737+0000","last_fullsized":"2024-09-18T01:48:12.649737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:45:59.773285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.333555+0000","last_change":"2024-09-18T01:45:04.293049+0000","last_active":"2024-09-18T01:45:41.333555+0000","last_peered":"2024-09-18T01:45:41.333555+0000","last_clean":"2024-09-18T01:45:41.333555+0000","last_became_active":"2024-09-18T01:45:04.292734+0000","last_became_peered":"2024-09-18T01:45:04.292734+0000","last_unstale":"2024-09-18T01:45:41.333555+0000","last_undegraded":"2024-09-18T01:45:41.333555+0000","last_fullsized":"2024-09-18T01:45:41.333555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:42:11.703254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337869+0000","last_change":"2024-09-18T01:45:08.294254+0000","last_active":"2024-09-18T01:45:41.337869+0000","last_peered":"2024-09-18T01:45:41.337869+0000","last_clean":"2024-09-18T01:45:41.337869+0000","last_became_active":"2024-09-18T01:45:08.294026+0000","last_became_peered":"2024-09-18T01:45:08.294026+0000","last_unstale":"2024-09-18T01:45:41.337869+0000","last_undegraded":"2024-09-18T01:45:41.337869+0000","last_fullsized":"2024-09-18T01:45:41.337869+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:41:44.964492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'36","reported_seq":84,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:10.668222+0000","last_change":"2024-09-18T01:45:10.308697+0000","last_active":"2024-09-18T01:47:10.668222+0000","last_peered":"2024-09-18T01:47:10.668222+0000","last_clean":"2024-09-18T01:47:10.668222+0000","last_became_active":"2024-09-18T01:45:10.307420+0000","last_became_peered":"2024-09-18T01:45:10.307420+0000","last_unstale":"2024-09-18T01:47:10.668222+0000","last_undegraded":"2024-09-18T01:47:10.668222+0000","last_fullsized":"2024-09-18T01:47:10.668222+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:50:42.386927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337545+0000","last_change":"2024-09-18T01:45:12.306113+0000","last_active":"2024-09-18T01:45:41.337545+0000","last_peered":"2024-09-18T01:45:41.337545+0000","last_clean":"2024-09-18T01:45:41.337545+0000","last_became_active":"2024-09-18T01:45:12.305838+0000","last_became_peered":"2024-09-18T01:45:12.305838+0000","last_unstale":"2024-09-18T01:45:41.337545+0000","last_undegraded":"2024-09-18T01:45:41.337545+0000","last_fullsized":"2024-09-18T01:45:41.337545+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:18:50.168373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'3","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:46:22.809927+0000","last_change":"2024-09-18T01:45:14.322540+0000","last_active":"2024-09-18T01:46:22.809927+0000","last_peered":"2024-09-18T01:46:22.809927+0000","last_clean":"2024-09-18T01:46:22.809927+0000","last_became_active":"2024-09-18T01:45:14.322272+0000","last_became_peered":"2024-09-18T01:45:14.322272+0000","last_unstale":"2024-09-18T01:46:22.809927+0000","last_undegraded":"2024-09-18T01:46:22.809927+0000","last_fullsized":"2024-09-18T01:46:22.809927+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:16:32.686304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"33'8","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.561148+0000","last_change":"2024-09-18T01:45:06.284946+0000","last_active":"2024-09-18T01:48:12.561148+0000","last_peered":"2024-09-18T01:48:12.561148+0000","last_clean":"2024-09-18T01:48:12.561148+0000","last_became_active":"2024-09-18T01:45:06.284677+0000","last_became_peered":"2024-09-18T01:45:06.284677+0000","last_unstale":"2024-09-18T01:48:12.561148+0000","last_undegraded":"2024-09-18T01:48:12.561148+0000","last_fullsized":"2024-09-18T01:48:12.561148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:38:48.328050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.341273+0000","last_change":"2024-09-18T01:45:04.287402+0000","last_active":"2024-09-18T01:45:41.341273+0000","last_peered":"2024-09-18T01:45:41.341273+0000","last_clean":"2024-09-18T01:45:41.341273+0000","last_became_active":"2024-09-18T01:45:04.284151+0000","last_became_peered":"2024-09-18T01:45:04.284151+0000","last_unstale":"2024-09-18T01:45:41.341273+0000","last_undegraded":"2024-09-18T01:45:41.341273+0000","last_fullsized":"2024-09-18T01:45:41.341273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:38:31.469925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.340511+0000","last_change":"2024-09-18T01:45:08.289806+0000","last_active":"2024-09-18T01:45:41.340511+0000","last_peered":"2024-09-18T01:45:41.340511+0000","last_clean":"2024-09-18T01:45:41.340511+0000","last_became_active":"2024-09-18T01:45:08.289521+0000","last_became_peered":"2024-09-18T01:45:08.289521+0000","last_unstale":"2024-09-18T01:45:41.340511+0000","last_undegraded":"2024-09-18T01:45:41.340511+0000","last_fullsized":"2024-09-18T01:45:41.340511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:54:13.237972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'49","reported_seq":106,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.175815+0000","last_change":"2024-09-18T01:45:10.307198+0000","last_active":"2024-09-18T01:47:12.175815+0000","last_peered":"2024-09-18T01:47:12.175815+0000","last_clean":"2024-09-18T01:47:12.175815+0000","last_became_active":"2024-09-18T01:45:10.306481+0000","last_became_peered":"2024-09-18T01:45:10.306481+0000","last_unstale":"2024-09-18T01:47:12.175815+0000","last_undegraded":"2024-09-18T01:47:12.175815+0000","last_fullsized":"2024-09-18T01:47:12.175815+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:26:59.982744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'282","reported_seq":347,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.998004+0000","last_change":"2024-09-18T01:45:12.313366+0000","last_active":"2024-09-18T01:48:12.998004+0000","last_peered":"2024-09-18T01:48:12.998004+0000","last_clean":"2024-09-18T01:48:12.998004+0000","last_became_active":"2024-09-18T01:45:12.313065+0000","last_became_peered":"2024-09-18T01:45:12.313065+0000","last_unstale":"2024-09-18T01:48:12.998004+0000","last_undegraded":"2024-09-18T01:48:12.998004+0000","last_fullsized":"2024-09-18T01:48:12.998004+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:22:43.654693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"33'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:09.007672+0000","last_change":"2024-09-18T01:45:14.320158+0000","last_active":"2024-09-18T01:47:09.007672+0000","last_peered":"2024-09-18T01:47:09.007672+0000","last_clean":"2024-09-18T01:47:09.007672+0000","last_became_active":"2024-09-18T01:45:14.319805+0000","last_became_peered":"2024-09-18T01:45:14.319805+0000","last_unstale":"2024-09-18T01:47:09.007672+0000","last_undegraded":"2024-09-18T01:47:09.007672+0000","last_fullsized":"2024-09-18T01:47:09.007672+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:14:33.982138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"33'10","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.846365+0000","last_change":"2024-09-18T01:45:06.282059+0000","last_active":"2024-09-18T01:48:12.846365+0000","last_peered":"2024-09-18T01:48:12.846365+0000","last_clean":"2024-09-18T01:48:12.846365+0000","last_became_active":"2024-09-18T01:45:06.281444+0000","last_became_peered":"2024-09-18T01:45:06.281444+0000","last_unstale":"2024-09-18T01:48:12.846365+0000","last_undegraded":"2024-09-18T01:48:12.846365+0000","last_fullsized":"2024-09-18T01:48:12.846365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:33:43.173746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.336364+0000","last_change":"2024-09-18T01:45:04.289841+0000","last_active":"2024-09-18T01:45:41.336364+0000","last_peered":"2024-09-18T01:45:41.336364+0000","last_clean":"2024-09-18T01:45:41.336364+0000","last_became_active":"2024-09-18T01:45:04.289216+0000","last_became_peered":"2024-09-18T01:45:04.289216+0000","last_unstale":"2024-09-18T01:45:41.336364+0000","last_undegraded":"2024-09-18T01:45:41.336364+0000","last_fullsized":"2024-09-18T01:45:41.336364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:06:46.722311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338235+0000","last_change":"2024-09-18T01:45:08.289975+0000","last_active":"2024-09-18T01:45:41.338235+0000","last_peered":"2024-09-18T01:45:41.338235+0000","last_clean":"2024-09-18T01:45:41.338235+0000","last_became_active":"2024-09-18T01:45:08.289725+0000","last_became_peered":"2024-09-18T01:45:08.289725+0000","last_unstale":"2024-09-18T01:45:41.338235+0000","last_undegraded":"2024-09-18T01:45:41.338235+0000","last_fullsized":"2024-09-18T01:45:41.338235+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:52:13.262244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"33'72","reported_seq":140,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:22.215996+0000","last_change":"2024-09-18T01:45:10.310077+0000","last_active":"2024-09-18T01:47:22.215996+0000","last_peered":"2024-09-18T01:47:22.215996+0000","last_clean":"2024-09-18T01:47:22.215996+0000","last_became_active":"2024-09-18T01:45:10.309360+0000","last_became_peered":"2024-09-18T01:45:10.309360+0000","last_unstale":"2024-09-18T01:47:22.215996+0000","last_undegraded":"2024-09-18T01:47:22.215996+0000","last_fullsized":"2024-09-18T01:47:22.215996+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:01:23.922671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7613,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":75,"num_read_kb":82,"num_write":36,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337356+0000","last_change":"2024-09-18T01:45:12.312912+0000","last_active":"2024-09-18T01:45:41.337356+0000","last_peered":"2024-09-18T01:45:41.337356+0000","last_clean":"2024-09-18T01:45:41.337356+0000","last_became_active":"2024-09-18T01:45:12.312665+0000","last_became_peered":"2024-09-18T01:45:12.312665+0000","last_unstale":"2024-09-18T01:45:41.337356+0000","last_undegraded":"2024-09-18T01:45:41.337356+0000","last_fullsized":"2024-09-18T01:45:41.337356+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:43:30.182833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'18","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.975756+0000","last_change":"2024-09-18T01:45:14.320179+0000","last_active":"2024-09-18T01:48:12.975756+0000","last_peered":"2024-09-18T01:48:12.975756+0000","last_clean":"2024-09-18T01:48:12.975756+0000","last_became_active":"2024-09-18T01:45:14.319638+0000","last_became_peered":"2024-09-18T01:45:14.319638+0000","last_unstale":"2024-09-18T01:48:12.975756+0000","last_undegraded":"2024-09-18T01:48:12.975756+0000","last_fullsized":"2024-09-18T01:48:12.975756+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:22:20.011207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:46:28.552953+0000","last_change":"2024-09-18T01:45:06.290368+0000","last_active":"2024-09-18T01:46:28.552953+0000","last_peered":"2024-09-18T01:46:28.552953+0000","last_clean":"2024-09-18T01:46:28.552953+0000","last_became_active":"2024-09-18T01:45:06.290087+0000","last_became_peered":"2024-09-18T01:45:06.290087+0000","last_unstale":"2024-09-18T01:46:28.552953+0000","last_undegraded":"2024-09-18T01:46:28.552953+0000","last_fullsized":"2024-09-18T01:46:28.552953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:25:24.068245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338514+0000","last_change":"2024-09-18T01:45:04.279319+0000","last_active":"2024-09-18T01:45:41.338514+0000","last_peered":"2024-09-18T01:45:41.338514+0000","last_clean":"2024-09-18T01:45:41.338514+0000","last_became_active":"2024-09-18T01:45:04.278979+0000","last_became_peered":"2024-09-18T01:45:04.278979+0000","last_unstale":"2024-09-18T01:45:41.338514+0000","last_undegraded":"2024-09-18T01:45:41.338514+0000","last_fullsized":"2024-09-18T01:45:41.338514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:21:29.013936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.334526+0000","last_change":"2024-09-18T01:45:08.292446+0000","last_active":"2024-09-18T01:45:41.334526+0000","last_peered":"2024-09-18T01:45:41.334526+0000","last_clean":"2024-09-18T01:45:41.334526+0000","last_became_active":"2024-09-18T01:45:08.292156+0000","last_became_peered":"2024-09-18T01:45:08.292156+0000","last_unstale":"2024-09-18T01:45:41.334526+0000","last_undegraded":"2024-09-18T01:45:41.334526+0000","last_fullsized":"2024-09-18T01:45:41.334526+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:03:59.192175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'38","reported_seq":87,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:10.672505+0000","last_change":"2024-09-18T01:45:10.300769+0000","last_active":"2024-09-18T01:47:10.672505+0000","last_peered":"2024-09-18T01:47:10.672505+0000","last_clean":"2024-09-18T01:47:10.672505+0000","last_became_active":"2024-09-18T01:45:10.300488+0000","last_became_peered":"2024-09-18T01:45:10.300488+0000","last_unstale":"2024-09-18T01:47:10.672505+0000","last_undegraded":"2024-09-18T01:47:10.672505+0000","last_fullsized":"2024-09-18T01:47:10.672505+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:55:38.390166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338499+0000","last_change":"2024-09-18T01:45:12.315977+0000","last_active":"2024-09-18T01:45:41.338499+0000","last_peered":"2024-09-18T01:45:41.338499+0000","last_clean":"2024-09-18T01:45:41.338499+0000","last_became_active":"2024-09-18T01:45:12.315695+0000","last_became_peered":"2024-09-18T01:45:12.315695+0000","last_unstale":"2024-09-18T01:45:41.338499+0000","last_undegraded":"2024-09-18T01:45:41.338499+0000","last_fullsized":"2024-09-18T01:45:41.338499+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:50:11.915634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"33'3","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:17.215042+0000","last_change":"2024-09-18T01:45:14.326486+0000","last_active":"2024-09-18T01:47:17.215042+0000","last_peered":"2024-09-18T01:47:17.215042+0000","last_clean":"2024-09-18T01:47:17.215042+0000","last_became_active":"2024-09-18T01:45:14.326209+0000","last_became_peered":"2024-09-18T01:45:14.326209+0000","last_unstale":"2024-09-18T01:47:17.215042+0000","last_undegraded":"2024-09-18T01:47:17.215042+0000","last_fullsized":"2024-09-18T01:47:17.215042+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:34:51.151050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.650286+0000","last_change":"2024-09-18T01:45:06.287753+0000","last_active":"2024-09-18T01:48:12.650286+0000","last_peered":"2024-09-18T01:48:12.650286+0000","last_clean":"2024-09-18T01:48:12.650286+0000","last_became_active":"2024-09-18T01:45:06.285771+0000","last_became_peered":"2024-09-18T01:45:06.285771+0000","last_unstale":"2024-09-18T01:48:12.650286+0000","last_undegraded":"2024-09-18T01:48:12.650286+0000","last_fullsized":"2024-09-18T01:48:12.650286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:17:37.283863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.488957+0000","last_change":"2024-09-18T01:45:04.287560+0000","last_active":"2024-09-18T01:48:12.488957+0000","last_peered":"2024-09-18T01:48:12.488957+0000","last_clean":"2024-09-18T01:48:12.488957+0000","last_became_active":"2024-09-18T01:45:04.287263+0000","last_became_peered":"2024-09-18T01:45:04.287263+0000","last_unstale":"2024-09-18T01:48:12.488957+0000","last_undegraded":"2024-09-18T01:48:12.488957+0000","last_fullsized":"2024-09-18T01:48:12.488957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:31:33.162869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4834176,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338326+0000","last_change":"2024-09-18T01:45:08.289876+0000","last_active":"2024-09-18T01:45:41.338326+0000","last_peered":"2024-09-18T01:45:41.338326+0000","last_clean":"2024-09-18T01:45:41.338326+0000","last_became_active":"2024-09-18T01:45:08.289604+0000","last_became_peered":"2024-09-18T01:45:08.289604+0000","last_unstale":"2024-09-18T01:45:41.338326+0000","last_undegraded":"2024-09-18T01:45:41.338326+0000","last_fullsized":"2024-09-18T01:45:41.338326+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:31:10.969818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'37","reported_seq":82,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:10.698206+0000","last_change":"2024-09-18T01:45:10.297783+0000","last_active":"2024-09-18T01:47:10.698206+0000","last_peered":"2024-09-18T01:47:10.698206+0000","last_clean":"2024-09-18T01:47:10.698206+0000","last_became_active":"2024-09-18T01:45:10.297511+0000","last_became_peered":"2024-09-18T01:45:10.297511+0000","last_unstale":"2024-09-18T01:47:10.698206+0000","last_undegraded":"2024-09-18T01:47:10.698206+0000","last_fullsized":"2024-09-18T01:47:10.698206+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:31:01.665963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'282","reported_seq":402,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.980142+0000","last_change":"2024-09-18T01:45:12.315306+0000","last_active":"2024-09-18T01:48:12.980142+0000","last_peered":"2024-09-18T01:48:12.980142+0000","last_clean":"2024-09-18T01:48:12.980142+0000","last_became_active":"2024-09-18T01:45:12.314918+0000","last_became_peered":"2024-09-18T01:45:12.314918+0000","last_unstale":"2024-09-18T01:48:12.980142+0000","last_undegraded":"2024-09-18T01:48:12.980142+0000","last_fullsized":"2024-09-18T01:48:12.980142+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:48:31.572835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'12","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:22.214176+0000","last_change":"2024-09-18T01:45:14.319866+0000","last_active":"2024-09-18T01:47:22.214176+0000","last_peered":"2024-09-18T01:47:22.214176+0000","last_clean":"2024-09-18T01:47:22.214176+0000","last_became_active":"2024-09-18T01:45:14.319364+0000","last_became_peered":"2024-09-18T01:45:14.319364+0000","last_unstale":"2024-09-18T01:47:22.214176+0000","last_undegraded":"2024-09-18T01:47:22.214176+0000","last_fullsized":"2024-09-18T01:47:22.214176+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:15:20.848541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.171328+0000","last_change":"2024-09-18T01:45:06.291329+0000","last_active":"2024-09-18T01:47:12.171328+0000","last_peered":"2024-09-18T01:47:12.171328+0000","last_clean":"2024-09-18T01:47:12.171328+0000","last_became_active":"2024-09-18T01:45:06.291023+0000","last_became_peered":"2024-09-18T01:45:06.291023+0000","last_unstale":"2024-09-18T01:47:12.171328+0000","last_undegraded":"2024-09-18T01:47:12.171328+0000","last_fullsized":"2024-09-18T01:47:12.171328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:45:59.773285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:08.999758+0000","last_change":"2024-09-18T01:45:04.294066+0000","last_active":"2024-09-18T01:47:08.999758+0000","last_peered":"2024-09-18T01:47:08.999758+0000","last_clean":"2024-09-18T01:47:08.999758+0000","last_became_active":"2024-09-18T01:45:04.288386+0000","last_became_peered":"2024-09-18T01:45:04.288386+0000","last_unstale":"2024-09-18T01:47:08.999758+0000","last_undegraded":"2024-09-18T01:47:08.999758+0000","last_fullsized":"2024-09-18T01:47:08.999758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:48:15.254246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'3","reported_seq":413,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:11.793360+0000","last_change":"2024-09-18T01:45:08.290260+0000","last_active":"2024-09-18T01:47:11.793360+0000","last_peered":"2024-09-18T01:47:11.793360+0000","last_clean":"2024-09-18T01:47:11.793360+0000","last_became_active":"2024-09-18T01:45:08.289478+0000","last_became_peered":"2024-09-18T01:45:08.289478+0000","last_unstale":"2024-09-18T01:47:11.793360+0000","last_undegraded":"2024-09-18T01:47:11.793360+0000","last_fullsized":"2024-09-18T01:47:11.793360+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:51:28.759649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'11","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:27.217179+0000","last_change":"2024-09-18T01:45:10.307653+0000","last_active":"2024-09-18T01:47:27.217179+0000","last_peered":"2024-09-18T01:47:27.217179+0000","last_clean":"2024-09-18T01:47:27.217179+0000","last_became_active":"2024-09-18T01:45:10.307374+0000","last_became_peered":"2024-09-18T01:45:10.307374+0000","last_unstale":"2024-09-18T01:47:27.217179+0000","last_undegraded":"2024-09-18T01:47:27.217179+0000","last_fullsized":"2024-09-18T01:47:27.217179+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:33:37.464748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'282","reported_seq":464,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.939532+0000","last_change":"2024-09-18T01:45:12.312200+0000","last_active":"2024-09-18T01:48:12.939532+0000","last_peered":"2024-09-18T01:48:12.939532+0000","last_clean":"2024-09-18T01:48:12.939532+0000","last_became_active":"2024-09-18T01:45:12.311929+0000","last_became_peered":"2024-09-18T01:45:12.311929+0000","last_unstale":"2024-09-18T01:48:12.939532+0000","last_undegraded":"2024-09-18T01:48:12.939532+0000","last_fullsized":"2024-09-18T01:48:12.939532+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:13:37.683828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"33'6","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.168494+0000","last_change":"2024-09-18T01:45:14.318697+0000","last_active":"2024-09-18T01:47:12.168494+0000","last_peered":"2024-09-18T01:47:12.168494+0000","last_clean":"2024-09-18T01:47:12.168494+0000","last_became_active":"2024-09-18T01:45:14.318418+0000","last_became_peered":"2024-09-18T01:45:14.318418+0000","last_unstale":"2024-09-18T01:47:12.168494+0000","last_undegraded":"2024-09-18T01:47:12.168494+0000","last_fullsized":"2024-09-18T01:47:12.168494+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:24:51.317832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"31'4","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.339105+0000","last_change":"2024-09-18T01:45:06.297190+0000","last_active":"2024-09-18T01:45:41.339105+0000","last_peered":"2024-09-18T01:45:41.339105+0000","last_clean":"2024-09-18T01:45:41.339105+0000","last_became_active":"2024-09-18T01:45:06.296824+0000","last_became_peered":"2024-09-18T01:45:06.296824+0000","last_unstale":"2024-09-18T01:45:41.339105+0000","last_undegraded":"2024-09-18T01:45:41.339105+0000","last_fullsized":"2024-09-18T01:45:41.339105+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:26:58.808939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"33'3","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.784627+0000","last_change":"2024-09-18T01:45:04.288364+0000","last_active":"2024-09-18T01:48:12.784627+0000","last_peered":"2024-09-18T01:48:12.784627+0000","last_clean":"2024-09-18T01:48:12.784627+0000","last_became_active":"2024-09-18T01:45:04.287961+0000","last_became_peered":"2024-09-18T01:45:04.287961+0000","last_unstale":"2024-09-18T01:48:12.784627+0000","last_undegraded":"2024-09-18T01:48:12.784627+0000","last_fullsized":"2024-09-18T01:48:12.784627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:15:46.315415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338600+0000","last_change":"2024-09-18T01:45:08.294326+0000","last_active":"2024-09-18T01:45:41.338600+0000","last_peered":"2024-09-18T01:45:41.338600+0000","last_clean":"2024-09-18T01:45:41.338600+0000","last_became_active":"2024-09-18T01:45:08.294053+0000","last_became_peered":"2024-09-18T01:45:08.294053+0000","last_unstale":"2024-09-18T01:45:41.338600+0000","last_undegraded":"2024-09-18T01:45:41.338600+0000","last_fullsized":"2024-09-18T01:45:41.338600+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:42:25.537610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'39","reported_seq":85,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:10.684950+0000","last_change":"2024-09-18T01:45:10.300689+0000","last_active":"2024-09-18T01:47:10.684950+0000","last_peered":"2024-09-18T01:47:10.684950+0000","last_clean":"2024-09-18T01:47:10.684950+0000","last_became_active":"2024-09-18T01:45:10.300337+0000","last_became_peered":"2024-09-18T01:45:10.300337+0000","last_unstale":"2024-09-18T01:47:10.684950+0000","last_undegraded":"2024-09-18T01:47:10.684950+0000","last_fullsized":"2024-09-18T01:47:10.684950+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:15:11.668593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.332973+0000","last_change":"2024-09-18T01:45:12.307499+0000","last_active":"2024-09-18T01:45:41.332973+0000","last_peered":"2024-09-18T01:45:41.332973+0000","last_clean":"2024-09-18T01:45:41.332973+0000","last_became_active":"2024-09-18T01:45:12.307210+0000","last_became_peered":"2024-09-18T01:45:12.307210+0000","last_unstale":"2024-09-18T01:45:41.332973+0000","last_undegraded":"2024-09-18T01:45:41.332973+0000","last_fullsized":"2024-09-18T01:45:41.332973+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:15:13.680117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'6","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.909454+0000","last_change":"2024-09-18T01:45:14.315742+0000","last_active":"2024-09-18T01:48:12.909454+0000","last_peered":"2024-09-18T01:48:12.909454+0000","last_clean":"2024-09-18T01:48:12.909454+0000","last_became_active":"2024-09-18T01:45:14.314786+0000","last_became_peered":"2024-09-18T01:45:14.314786+0000","last_unstale":"2024-09-18T01:48:12.909454+0000","last_undegraded":"2024-09-18T01:48:12.909454+0000","last_fullsized":"2024-09-18T01:48:12.909454+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:32:55.619756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.559013+0000","last_change":"2024-09-18T01:45:06.287377+0000","last_active":"2024-09-18T01:48:12.559013+0000","last_peered":"2024-09-18T01:48:12.559013+0000","last_clean":"2024-09-18T01:48:12.559013+0000","last_became_active":"2024-09-18T01:45:06.286138+0000","last_became_peered":"2024-09-18T01:45:06.286138+0000","last_unstale":"2024-09-18T01:48:12.559013+0000","last_undegraded":"2024-09-18T01:48:12.559013+0000","last_fullsized":"2024-09-18T01:48:12.559013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:40:06.654394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":205,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.332689+0000","last_change":"2024-09-18T01:44:49.573399+0000","last_active":"2024-09-18T01:45:41.332689+0000","last_peered":"2024-09-18T01:45:41.332689+0000","last_clean":"2024-09-18T01:45:41.332689+0000","last_became_active":"2024-09-18T01:44:49.572263+0000","last_became_peered":"2024-09-18T01:44:49.572263+0000","last_unstale":"2024-09-18T01:45:41.332689+0000","last_undegraded":"2024-09-18T01:45:41.332689+0000","last_fullsized":"2024-09-18T01:45:41.332689+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:48.210722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:48.210722+0000","last_clean_scrub_stamp":"2024-09-18T01:44:48.210722+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:56:09.389853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.336772+0000","last_change":"2024-09-18T01:44:55.241426+0000","last_active":"2024-09-18T01:45:41.336772+0000","last_peered":"2024-09-18T01:45:41.336772+0000","last_clean":"2024-09-18T01:45:41.336772+0000","last_became_active":"2024-09-18T01:44:53.233974+0000","last_became_peered":"2024-09-18T01:44:53.233974+0000","last_unstale":"2024-09-18T01:45:41.336772+0000","last_undegraded":"2024-09-18T01:45:41.336772+0000","last_fullsized":"2024-09-18T01:45:41.336772+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:12:59.234293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045237700000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:44.957536+0000","last_change":"2024-09-18T01:45:04.289472+0000","last_active":"2024-09-18T01:45:44.957536+0000","last_peered":"2024-09-18T01:45:44.957536+0000","last_clean":"2024-09-18T01:45:44.957536+0000","last_became_active":"2024-09-18T01:45:04.287763+0000","last_became_peered":"2024-09-18T01:45:04.287763+0000","last_unstale":"2024-09-18T01:45:44.957536+0000","last_undegraded":"2024-09-18T01:45:44.957536+0000","last_fullsized":"2024-09-18T01:45:44.957536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:36:04.953932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.336778+0000","last_change":"2024-09-18T01:45:08.288736+0000","last_active":"2024-09-18T01:45:41.336778+0000","last_peered":"2024-09-18T01:45:41.336778+0000","last_clean":"2024-09-18T01:45:41.336778+0000","last_became_active":"2024-09-18T01:45:08.288131+0000","last_became_peered":"2024-09-18T01:45:08.288131+0000","last_unstale":"2024-09-18T01:45:41.336778+0000","last_undegraded":"2024-09-18T01:45:41.336778+0000","last_fullsized":"2024-09-18T01:45:41.336778+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:21:35.087556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'83","reported_seq":158,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:10.696010+0000","last_change":"2024-09-18T01:45:10.305269+0000","last_active":"2024-09-18T01:47:10.696010+0000","last_peered":"2024-09-18T01:47:10.696010+0000","last_clean":"2024-09-18T01:47:10.696010+0000","last_became_active":"2024-09-18T01:45:10.305004+0000","last_became_peered":"2024-09-18T01:45:10.305004+0000","last_unstale":"2024-09-18T01:47:10.696010+0000","last_undegraded":"2024-09-18T01:47:10.696010+0000","last_fullsized":"2024-09-18T01:47:10.696010+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:34:39.601409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.339055+0000","last_change":"2024-09-18T01:45:12.311683+0000","last_active":"2024-09-18T01:45:41.339055+0000","last_peered":"2024-09-18T01:45:41.339055+0000","last_clean":"2024-09-18T01:45:41.339055+0000","last_became_active":"2024-09-18T01:45:12.311337+0000","last_became_peered":"2024-09-18T01:45:12.311337+0000","last_unstale":"2024-09-18T01:45:41.339055+0000","last_undegraded":"2024-09-18T01:45:41.339055+0000","last_fullsized":"2024-09-18T01:45:41.339055+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:36:33.811124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'81","reported_seq":162,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.883680+0000","last_change":"2024-09-18T01:45:14.315079+0000","last_active":"2024-09-18T01:48:12.883680+0000","last_peered":"2024-09-18T01:48:12.883680+0000","last_clean":"2024-09-18T01:48:12.883680+0000","last_became_active":"2024-09-18T01:45:14.314784+0000","last_became_peered":"2024-09-18T01:45:14.314784+0000","last_unstale":"2024-09-18T01:48:12.883680+0000","last_undegraded":"2024-09-18T01:48:12.883680+0000","last_fullsized":"2024-09-18T01:48:12.883680+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:27:35.990001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'4","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:46:28.550502+0000","last_change":"2024-09-18T01:45:41.350104+0000","last_active":"2024-09-18T01:46:28.550502+0000","last_peered":"2024-09-18T01:46:28.550502+0000","last_clean":"2024-09-18T01:46:28.550502+0000","last_became_active":"2024-09-18T01:45:41.338925+0000","last_became_peered":"2024-09-18T01:45:41.338925+0000","last_unstale":"2024-09-18T01:46:28.550502+0000","last_undegraded":"2024-09-18T01:46:28.550502+0000","last_fullsized":"2024-09-18T01:46:28.550502+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:28:46.190605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.333768+0000","last_change":"2024-09-18T01:44:55.242126+0000","last_active":"2024-09-18T01:45:41.333768+0000","last_peered":"2024-09-18T01:45:41.333768+0000","last_clean":"2024-09-18T01:45:41.333768+0000","last_became_active":"2024-09-18T01:44:53.237059+0000","last_became_peered":"2024-09-18T01:44:53.237059+0000","last_unstale":"2024-09-18T01:45:41.333768+0000","last_undegraded":"2024-09-18T01:45:41.333768+0000","last_fullsized":"2024-09-18T01:45:41.333768+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:32:06.823521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011095359999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337449+0000","last_change":"2024-09-18T01:45:04.273879+0000","last_active":"2024-09-18T01:45:41.337449+0000","last_peered":"2024-09-18T01:45:41.337449+0000","last_clean":"2024-09-18T01:45:41.337449+0000","last_became_active":"2024-09-18T01:45:04.273354+0000","last_became_peered":"2024-09-18T01:45:04.273354+0000","last_unstale":"2024-09-18T01:45:41.337449+0000","last_undegraded":"2024-09-18T01:45:41.337449+0000","last_fullsized":"2024-09-18T01:45:41.337449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:31:48.524360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.341234+0000","last_change":"2024-09-18T01:45:08.292027+0000","last_active":"2024-09-18T01:45:41.341234+0000","last_peered":"2024-09-18T01:45:41.341234+0000","last_clean":"2024-09-18T01:45:41.341234+0000","last_became_active":"2024-09-18T01:45:08.291681+0000","last_became_peered":"2024-09-18T01:45:08.291681+0000","last_unstale":"2024-09-18T01:45:41.341234+0000","last_undegraded":"2024-09-18T01:45:41.341234+0000","last_fullsized":"2024-09-18T01:45:41.341234+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:28:11.601390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'279","reported_seq":487,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:08.374407+0000","last_change":"2024-09-18T01:45:10.305791+0000","last_active":"2024-09-18T01:48:08.374407+0000","last_peered":"2024-09-18T01:48:08.374407+0000","last_clean":"2024-09-18T01:48:08.374407+0000","last_became_active":"2024-09-18T01:45:10.305472+0000","last_became_peered":"2024-09-18T01:45:10.305472+0000","last_unstale":"2024-09-18T01:48:08.374407+0000","last_undegraded":"2024-09-18T01:48:08.374407+0000","last_fullsized":"2024-09-18T01:48:08.374407+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:57:05.219798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":366,"num_read_kb":350,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337053+0000","last_change":"2024-09-18T01:45:12.316867+0000","last_active":"2024-09-18T01:45:41.337053+0000","last_peered":"2024-09-18T01:45:41.337053+0000","last_clean":"2024-09-18T01:45:41.337053+0000","last_became_active":"2024-09-18T01:45:12.316110+0000","last_became_peered":"2024-09-18T01:45:12.316110+0000","last_unstale":"2024-09-18T01:45:41.337053+0000","last_undegraded":"2024-09-18T01:45:41.337053+0000","last_fullsized":"2024-09-18T01:45:41.337053+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:17:14.152691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'5","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:46:28.548072+0000","last_change":"2024-09-18T01:45:14.323262+0000","last_active":"2024-09-18T01:46:28.548072+0000","last_peered":"2024-09-18T01:46:28.548072+0000","last_clean":"2024-09-18T01:46:28.548072+0000","last_became_active":"2024-09-18T01:45:14.322986+0000","last_became_peered":"2024-09-18T01:45:14.322986+0000","last_unstale":"2024-09-18T01:46:28.548072+0000","last_undegraded":"2024-09-18T01:46:28.548072+0000","last_fullsized":"2024-09-18T01:46:28.548072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:04:51.734530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'8","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.840339+0000","last_change":"2024-09-18T01:45:06.293300+0000","last_active":"2024-09-18T01:48:12.840339+0000","last_peered":"2024-09-18T01:48:12.840339+0000","last_clean":"2024-09-18T01:48:12.840339+0000","last_became_active":"2024-09-18T01:45:06.292996+0000","last_became_peered":"2024-09-18T01:45:06.292996+0000","last_unstale":"2024-09-18T01:48:12.840339+0000","last_undegraded":"2024-09-18T01:48:12.840339+0000","last_fullsized":"2024-09-18T01:48:12.840339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:06:48.729806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.331452+0000","last_change":"2024-09-18T01:44:55.620700+0000","last_active":"2024-09-18T01:45:41.331452+0000","last_peered":"2024-09-18T01:45:41.331452+0000","last_clean":"2024-09-18T01:45:41.331452+0000","last_became_active":"2024-09-18T01:44:53.237016+0000","last_became_peered":"2024-09-18T01:44:53.237016+0000","last_unstale":"2024-09-18T01:45:41.331452+0000","last_undegraded":"2024-09-18T01:45:41.331452+0000","last_fullsized":"2024-09-18T01:45:41.331452+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:36:02.583348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039942899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.777626+0000","last_change":"2024-09-18T01:45:04.284372+0000","last_active":"2024-09-18T01:48:12.777626+0000","last_peered":"2024-09-18T01:48:12.777626+0000","last_clean":"2024-09-18T01:48:12.777626+0000","last_became_active":"2024-09-18T01:45:04.283999+0000","last_became_peered":"2024-09-18T01:45:04.283999+0000","last_unstale":"2024-09-18T01:48:12.777626+0000","last_undegraded":"2024-09-18T01:48:12.777626+0000","last_fullsized":"2024-09-18T01:48:12.777626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:16:49.444181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"24'2","reported_seq":219,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:11.793649+0000","last_change":"2024-09-18T01:45:08.284516+0000","last_active":"2024-09-18T01:47:11.793649+0000","last_peered":"2024-09-18T01:47:11.793649+0000","last_clean":"2024-09-18T01:47:11.793649+0000","last_became_active":"2024-09-18T01:45:08.284186+0000","last_became_peered":"2024-09-18T01:45:08.284186+0000","last_unstale":"2024-09-18T01:47:11.793649+0000","last_undegraded":"2024-09-18T01:47:11.793649+0000","last_fullsized":"2024-09-18T01:47:11.793649+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:52:16.095961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'17","reported_seq":84,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.882505+0000","last_change":"2024-09-18T01:45:10.296574+0000","last_active":"2024-09-18T01:48:12.882505+0000","last_peered":"2024-09-18T01:48:12.882505+0000","last_clean":"2024-09-18T01:48:12.882505+0000","last_became_active":"2024-09-18T01:45:10.296284+0000","last_became_peered":"2024-09-18T01:45:10.296284+0000","last_unstale":"2024-09-18T01:48:12.882505+0000","last_undegraded":"2024-09-18T01:48:12.882505+0000","last_fullsized":"2024-09-18T01:48:12.882505+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:58:02.549052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.339121+0000","last_change":"2024-09-18T01:45:12.311612+0000","last_active":"2024-09-18T01:45:41.339121+0000","last_peered":"2024-09-18T01:45:41.339121+0000","last_clean":"2024-09-18T01:45:41.339121+0000","last_became_active":"2024-09-18T01:45:12.311266+0000","last_became_peered":"2024-09-18T01:45:12.311266+0000","last_unstale":"2024-09-18T01:45:41.339121+0000","last_undegraded":"2024-09-18T01:45:41.339121+0000","last_fullsized":"2024-09-18T01:45:41.339121+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:33:04.342308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"33'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:45.861093+0000","last_change":"2024-09-18T01:45:14.318619+0000","last_active":"2024-09-18T01:45:45.861093+0000","last_peered":"2024-09-18T01:45:45.861093+0000","last_clean":"2024-09-18T01:45:45.861093+0000","last_became_active":"2024-09-18T01:45:14.318346+0000","last_became_peered":"2024-09-18T01:45:14.318346+0000","last_unstale":"2024-09-18T01:45:45.861093+0000","last_undegraded":"2024-09-18T01:45:45.861093+0000","last_fullsized":"2024-09-18T01:45:45.861093+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:29:28.994596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.871160+0000","last_change":"2024-09-18T01:45:06.282530+0000","last_active":"2024-09-18T01:48:12.871160+0000","last_peered":"2024-09-18T01:48:12.871160+0000","last_clean":"2024-09-18T01:48:12.871160+0000","last_became_active":"2024-09-18T01:45:06.282319+0000","last_became_peered":"2024-09-18T01:45:06.282319+0000","last_unstale":"2024-09-18T01:48:12.871160+0000","last_undegraded":"2024-09-18T01:48:12.871160+0000","last_fullsized":"2024-09-18T01:48:12.871160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:15:48.322910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.335732+0000","last_change":"2024-09-18T01:44:55.242065+0000","last_active":"2024-09-18T01:45:41.335732+0000","last_peered":"2024-09-18T01:45:41.335732+0000","last_clean":"2024-09-18T01:45:41.335732+0000","last_became_active":"2024-09-18T01:44:53.236990+0000","last_became_peered":"2024-09-18T01:44:53.236990+0000","last_unstale":"2024-09-18T01:45:41.335732+0000","last_undegraded":"2024-09-18T01:45:41.335732+0000","last_fullsized":"2024-09-18T01:45:41.335732+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:45:10.092337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001062627,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.332308+0000","last_change":"2024-09-18T01:45:04.293371+0000","last_active":"2024-09-18T01:45:41.332308+0000","last_peered":"2024-09-18T01:45:41.332308+0000","last_clean":"2024-09-18T01:45:41.332308+0000","last_became_active":"2024-09-18T01:45:04.293064+0000","last_became_peered":"2024-09-18T01:45:04.293064+0000","last_unstale":"2024-09-18T01:45:41.332308+0000","last_undegraded":"2024-09-18T01:45:41.332308+0000","last_fullsized":"2024-09-18T01:45:41.332308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:59:04.808153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.339566+0000","last_change":"2024-09-18T01:45:08.292781+0000","last_active":"2024-09-18T01:45:41.339566+0000","last_peered":"2024-09-18T01:45:41.339566+0000","last_clean":"2024-09-18T01:45:41.339566+0000","last_became_active":"2024-09-18T01:45:08.292477+0000","last_became_peered":"2024-09-18T01:45:08.292477+0000","last_unstale":"2024-09-18T01:45:41.339566+0000","last_undegraded":"2024-09-18T01:45:41.339566+0000","last_fullsized":"2024-09-18T01:45:41.339566+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:39:02.381373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'13","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.186836+0000","last_change":"2024-09-18T01:45:10.308357+0000","last_active":"2024-09-18T01:48:12.186836+0000","last_peered":"2024-09-18T01:48:12.186836+0000","last_clean":"2024-09-18T01:48:12.186836+0000","last_became_active":"2024-09-18T01:45:10.308018+0000","last_became_peered":"2024-09-18T01:45:10.308018+0000","last_unstale":"2024-09-18T01:48:12.186836+0000","last_undegraded":"2024-09-18T01:48:12.186836+0000","last_fullsized":"2024-09-18T01:48:12.186836+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:40:04.662960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338954+0000","last_change":"2024-09-18T01:45:12.315614+0000","last_active":"2024-09-18T01:45:41.338954+0000","last_peered":"2024-09-18T01:45:41.338954+0000","last_clean":"2024-09-18T01:45:41.338954+0000","last_became_active":"2024-09-18T01:45:12.315342+0000","last_became_peered":"2024-09-18T01:45:12.315342+0000","last_unstale":"2024-09-18T01:45:41.338954+0000","last_undegraded":"2024-09-18T01:45:41.338954+0000","last_fullsized":"2024-09-18T01:45:41.338954+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:11:58.173898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"33'6","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.842041+0000","last_change":"2024-09-18T01:45:14.323182+0000","last_active":"2024-09-18T01:48:12.842041+0000","last_peered":"2024-09-18T01:48:12.842041+0000","last_clean":"2024-09-18T01:48:12.842041+0000","last_became_active":"2024-09-18T01:45:14.322568+0000","last_became_peered":"2024-09-18T01:45:14.322568+0000","last_unstale":"2024-09-18T01:48:12.842041+0000","last_undegraded":"2024-09-18T01:48:12.842041+0000","last_fullsized":"2024-09-18T01:48:12.842041+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:58:43.947177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'14","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.840650+0000","last_change":"2024-09-18T01:45:06.292050+0000","last_active":"2024-09-18T01:48:12.840650+0000","last_peered":"2024-09-18T01:48:12.840650+0000","last_clean":"2024-09-18T01:48:12.840650+0000","last_became_active":"2024-09-18T01:45:06.291792+0000","last_became_peered":"2024-09-18T01:45:06.291792+0000","last_unstale":"2024-09-18T01:48:12.840650+0000","last_undegraded":"2024-09-18T01:48:12.840650+0000","last_fullsized":"2024-09-18T01:48:12.840650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:57:38.152681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"31'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.332634+0000","last_change":"2024-09-18T01:45:04.291510+0000","last_active":"2024-09-18T01:45:41.332634+0000","last_peered":"2024-09-18T01:45:41.332634+0000","last_clean":"2024-09-18T01:45:41.332634+0000","last_became_active":"2024-09-18T01:45:04.291211+0000","last_became_peered":"2024-09-18T01:45:04.291211+0000","last_unstale":"2024-09-18T01:45:41.332634+0000","last_undegraded":"2024-09-18T01:45:41.332634+0000","last_fullsized":"2024-09-18T01:45:41.332634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:16:49.444181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338599+0000","last_change":"2024-09-18T01:44:55.234985+0000","last_active":"2024-09-18T01:45:41.338599+0000","last_peered":"2024-09-18T01:45:41.338599+0000","last_clean":"2024-09-18T01:45:41.338599+0000","last_became_active":"2024-09-18T01:44:53.234966+0000","last_became_peered":"2024-09-18T01:44:53.234966+0000","last_unstale":"2024-09-18T01:45:41.338599+0000","last_undegraded":"2024-09-18T01:45:41.338599+0000","last_fullsized":"2024-09-18T01:45:41.338599+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:30:53.728764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045990099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"33'1","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:17.213424+0000","last_change":"2024-09-18T01:45:08.286575+0000","last_active":"2024-09-18T01:47:17.213424+0000","last_peered":"2024-09-18T01:47:17.213424+0000","last_clean":"2024-09-18T01:47:17.213424+0000","last_became_active":"2024-09-18T01:45:08.286195+0000","last_became_peered":"2024-09-18T01:45:08.286195+0000","last_unstale":"2024-09-18T01:47:17.213424+0000","last_undegraded":"2024-09-18T01:47:17.213424+0000","last_fullsized":"2024-09-18T01:47:17.213424+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:39:08.126512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'73","reported_seq":144,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.212620+0000","last_change":"2024-09-18T01:45:10.306220+0000","last_active":"2024-09-18T01:47:12.212620+0000","last_peered":"2024-09-18T01:47:12.212620+0000","last_clean":"2024-09-18T01:47:12.212620+0000","last_became_active":"2024-09-18T01:45:10.305948+0000","last_became_peered":"2024-09-18T01:45:10.305948+0000","last_unstale":"2024-09-18T01:47:12.212620+0000","last_undegraded":"2024-09-18T01:47:12.212620+0000","last_fullsized":"2024-09-18T01:47:12.212620+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:03:14.568657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":77,"num_read_kb":63,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.332043+0000","last_change":"2024-09-18T01:45:12.312116+0000","last_active":"2024-09-18T01:45:41.332043+0000","last_peered":"2024-09-18T01:45:41.332043+0000","last_clean":"2024-09-18T01:45:41.332043+0000","last_became_active":"2024-09-18T01:45:12.311862+0000","last_became_peered":"2024-09-18T01:45:12.311862+0000","last_unstale":"2024-09-18T01:45:41.332043+0000","last_undegraded":"2024-09-18T01:45:41.332043+0000","last_fullsized":"2024-09-18T01:45:41.332043+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:17:48.507658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'13","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.101245+0000","last_change":"2024-09-18T01:45:14.311691+0000","last_active":"2024-09-18T01:47:12.101245+0000","last_peered":"2024-09-18T01:47:12.101245+0000","last_clean":"2024-09-18T01:47:12.101245+0000","last_became_active":"2024-09-18T01:45:14.311403+0000","last_became_peered":"2024-09-18T01:45:14.311403+0000","last_unstale":"2024-09-18T01:47:12.101245+0000","last_undegraded":"2024-09-18T01:47:12.101245+0000","last_fullsized":"2024-09-18T01:47:12.101245+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:47:25.981905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.336217+0000","last_change":"2024-09-18T01:45:06.292173+0000","last_active":"2024-09-18T01:45:41.336217+0000","last_peered":"2024-09-18T01:45:41.336217+0000","last_clean":"2024-09-18T01:45:41.336217+0000","last_became_active":"2024-09-18T01:45:06.291845+0000","last_became_peered":"2024-09-18T01:45:06.291845+0000","last_unstale":"2024-09-18T01:45:41.336217+0000","last_undegraded":"2024-09-18T01:45:41.336217+0000","last_fullsized":"2024-09-18T01:45:41.336217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:06:48.729806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.339145+0000","last_change":"2024-09-18T01:45:04.273877+0000","last_active":"2024-09-18T01:45:41.339145+0000","last_peered":"2024-09-18T01:45:41.339145+0000","last_clean":"2024-09-18T01:45:41.339145+0000","last_became_active":"2024-09-18T01:45:04.273385+0000","last_became_peered":"2024-09-18T01:45:04.273385+0000","last_unstale":"2024-09-18T01:45:41.339145+0000","last_undegraded":"2024-09-18T01:45:41.339145+0000","last_fullsized":"2024-09-18T01:45:41.339145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:05:10.699920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.339297+0000","last_change":"2024-09-18T01:44:55.242318+0000","last_active":"2024-09-18T01:45:41.339297+0000","last_peered":"2024-09-18T01:45:41.339297+0000","last_clean":"2024-09-18T01:45:41.339297+0000","last_became_active":"2024-09-18T01:44:53.236927+0000","last_became_peered":"2024-09-18T01:44:53.236927+0000","last_unstale":"2024-09-18T01:45:41.339297+0000","last_undegraded":"2024-09-18T01:45:41.339297+0000","last_fullsized":"2024-09-18T01:45:41.339297+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:52:39.601060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00130324,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337750+0000","last_change":"2024-09-18T01:45:08.296862+0000","last_active":"2024-09-18T01:45:41.337750+0000","last_peered":"2024-09-18T01:45:41.337750+0000","last_clean":"2024-09-18T01:45:41.337750+0000","last_became_active":"2024-09-18T01:45:08.296118+0000","last_became_peered":"2024-09-18T01:45:08.296118+0000","last_unstale":"2024-09-18T01:45:41.337750+0000","last_undegraded":"2024-09-18T01:45:41.337750+0000","last_fullsized":"2024-09-18T01:45:41.337750+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:18:22.945844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"31'20","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.333610+0000","last_change":"2024-09-18T01:45:10.306223+0000","last_active":"2024-09-18T01:45:41.333610+0000","last_peered":"2024-09-18T01:45:41.333610+0000","last_clean":"2024-09-18T01:45:41.333610+0000","last_became_active":"2024-09-18T01:45:10.305932+0000","last_became_peered":"2024-09-18T01:45:10.305932+0000","last_unstale":"2024-09-18T01:45:41.333610+0000","last_undegraded":"2024-09-18T01:45:41.333610+0000","last_fullsized":"2024-09-18T01:45:41.333610+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:02:58.015323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'282","reported_seq":354,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:08.374174+0000","last_change":"2024-09-18T01:45:12.312362+0000","last_active":"2024-09-18T01:48:08.374174+0000","last_peered":"2024-09-18T01:48:08.374174+0000","last_clean":"2024-09-18T01:48:08.374174+0000","last_became_active":"2024-09-18T01:45:12.312117+0000","last_became_peered":"2024-09-18T01:45:12.312117+0000","last_unstale":"2024-09-18T01:48:08.374174+0000","last_undegraded":"2024-09-18T01:48:08.374174+0000","last_fullsized":"2024-09-18T01:48:08.374174+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:31:43.441229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"33'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.829026+0000","last_change":"2024-09-18T01:45:14.322374+0000","last_active":"2024-09-18T01:48:12.829026+0000","last_peered":"2024-09-18T01:48:12.829026+0000","last_clean":"2024-09-18T01:48:12.829026+0000","last_became_active":"2024-09-18T01:45:14.322078+0000","last_became_peered":"2024-09-18T01:45:14.322078+0000","last_unstale":"2024-09-18T01:48:12.829026+0000","last_undegraded":"2024-09-18T01:48:12.829026+0000","last_fullsized":"2024-09-18T01:48:12.829026+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:07:46.272021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.793475+0000","last_change":"2024-09-18T01:45:06.297948+0000","last_active":"2024-09-18T01:48:12.793475+0000","last_peered":"2024-09-18T01:48:12.793475+0000","last_clean":"2024-09-18T01:48:12.793475+0000","last_became_active":"2024-09-18T01:45:06.297660+0000","last_became_peered":"2024-09-18T01:45:06.297660+0000","last_unstale":"2024-09-18T01:48:12.793475+0000","last_undegraded":"2024-09-18T01:48:12.793475+0000","last_fullsized":"2024-09-18T01:48:12.793475+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:37:23.667201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.341134+0000","last_change":"2024-09-18T01:45:04.294211+0000","last_active":"2024-09-18T01:45:41.341134+0000","last_peered":"2024-09-18T01:45:41.341134+0000","last_clean":"2024-09-18T01:45:41.341134+0000","last_became_active":"2024-09-18T01:45:04.288189+0000","last_became_peered":"2024-09-18T01:45:04.288189+0000","last_unstale":"2024-09-18T01:45:41.341134+0000","last_undegraded":"2024-09-18T01:45:41.341134+0000","last_fullsized":"2024-09-18T01:45:41.341134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:20:01.448189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.339254+0000","last_change":"2024-09-18T01:44:55.234985+0000","last_active":"2024-09-18T01:45:41.339254+0000","last_peered":"2024-09-18T01:45:41.339254+0000","last_clean":"2024-09-18T01:45:41.339254+0000","last_became_active":"2024-09-18T01:44:53.236812+0000","last_became_peered":"2024-09-18T01:44:53.236812+0000","last_unstale":"2024-09-18T01:45:41.339254+0000","last_undegraded":"2024-09-18T01:45:41.339254+0000","last_fullsized":"2024-09-18T01:45:41.339254+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:54:16.245255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044136000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.336209+0000","last_change":"2024-09-18T01:45:08.296449+0000","last_active":"2024-09-18T01:45:41.336209+0000","last_peered":"2024-09-18T01:45:41.336209+0000","last_clean":"2024-09-18T01:45:41.336209+0000","last_became_active":"2024-09-18T01:45:08.296102+0000","last_became_peered":"2024-09-18T01:45:08.296102+0000","last_unstale":"2024-09-18T01:45:41.336209+0000","last_undegraded":"2024-09-18T01:45:41.336209+0000","last_fullsized":"2024-09-18T01:45:41.336209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:40:32.625197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"31'16","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338569+0000","last_change":"2024-09-18T01:45:10.309071+0000","last_active":"2024-09-18T01:45:41.338569+0000","last_peered":"2024-09-18T01:45:41.338569+0000","last_clean":"2024-09-18T01:45:41.338569+0000","last_became_active":"2024-09-18T01:45:10.308451+0000","last_became_peered":"2024-09-18T01:45:10.308451+0000","last_unstale":"2024-09-18T01:45:41.338569+0000","last_undegraded":"2024-09-18T01:45:41.338569+0000","last_fullsized":"2024-09-18T01:45:41.338569+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:28:14.753920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'282","reported_seq":428,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.976512+0000","last_change":"2024-09-18T01:45:12.314218+0000","last_active":"2024-09-18T01:48:12.976512+0000","last_peered":"2024-09-18T01:48:12.976512+0000","last_clean":"2024-09-18T01:48:12.976512+0000","last_became_active":"2024-09-18T01:45:12.313885+0000","last_became_peered":"2024-09-18T01:45:12.313885+0000","last_unstale":"2024-09-18T01:48:12.976512+0000","last_undegraded":"2024-09-18T01:48:12.976512+0000","last_fullsized":"2024-09-18T01:48:12.976512+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:29:22.572641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"33'7","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.579430+0000","last_change":"2024-09-18T01:45:14.317559+0000","last_active":"2024-09-18T01:48:12.579430+0000","last_peered":"2024-09-18T01:48:12.579430+0000","last_clean":"2024-09-18T01:48:12.579430+0000","last_became_active":"2024-09-18T01:45:14.317241+0000","last_became_peered":"2024-09-18T01:45:14.317241+0000","last_unstale":"2024-09-18T01:48:12.579430+0000","last_undegraded":"2024-09-18T01:48:12.579430+0000","last_fullsized":"2024-09-18T01:48:12.579430+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:01:31.449415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"33'8","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.652777+0000","last_change":"2024-09-18T01:45:06.285908+0000","last_active":"2024-09-18T01:48:12.652777+0000","last_peered":"2024-09-18T01:48:12.652777+0000","last_clean":"2024-09-18T01:48:12.652777+0000","last_became_active":"2024-09-18T01:45:06.285656+0000","last_became_peered":"2024-09-18T01:45:06.285656+0000","last_unstale":"2024-09-18T01:48:12.652777+0000","last_undegraded":"2024-09-18T01:48:12.652777+0000","last_fullsized":"2024-09-18T01:48:12.652777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:34:31.263060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338445+0000","last_change":"2024-09-18T01:45:04.290881+0000","last_active":"2024-09-18T01:45:41.338445+0000","last_peered":"2024-09-18T01:45:41.338445+0000","last_clean":"2024-09-18T01:45:41.338445+0000","last_became_active":"2024-09-18T01:45:04.290480+0000","last_became_peered":"2024-09-18T01:45:04.290480+0000","last_unstale":"2024-09-18T01:45:41.338445+0000","last_undegraded":"2024-09-18T01:45:41.338445+0000","last_fullsized":"2024-09-18T01:45:41.338445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:43:17.455462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338670+0000","last_change":"2024-09-18T01:44:55.241531+0000","last_active":"2024-09-18T01:45:41.338670+0000","last_peered":"2024-09-18T01:45:41.338670+0000","last_clean":"2024-09-18T01:45:41.338670+0000","last_became_active":"2024-09-18T01:44:53.298677+0000","last_became_peered":"2024-09-18T01:44:53.298677+0000","last_unstale":"2024-09-18T01:45:41.338670+0000","last_undegraded":"2024-09-18T01:45:41.338670+0000","last_fullsized":"2024-09-18T01:45:41.338670+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:07:05.603416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052495500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.334953+0000","last_change":"2024-09-18T01:45:08.292005+0000","last_active":"2024-09-18T01:45:41.334953+0000","last_peered":"2024-09-18T01:45:41.334953+0000","last_clean":"2024-09-18T01:45:41.334953+0000","last_became_active":"2024-09-18T01:45:08.291696+0000","last_became_peered":"2024-09-18T01:45:08.291696+0000","last_unstale":"2024-09-18T01:45:41.334953+0000","last_undegraded":"2024-09-18T01:45:41.334953+0000","last_fullsized":"2024-09-18T01:45:41.334953+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:36:29.790531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'88","reported_seq":166,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:10.682966+0000","last_change":"2024-09-18T01:45:10.304923+0000","last_active":"2024-09-18T01:47:10.682966+0000","last_peered":"2024-09-18T01:47:10.682966+0000","last_clean":"2024-09-18T01:47:10.682966+0000","last_became_active":"2024-09-18T01:45:10.304662+0000","last_became_peered":"2024-09-18T01:45:10.304662+0000","last_unstale":"2024-09-18T01:47:10.682966+0000","last_undegraded":"2024-09-18T01:47:10.682966+0000","last_fullsized":"2024-09-18T01:47:10.682966+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:31:12.978887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":84,"num_read_kb":69,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338335+0000","last_change":"2024-09-18T01:45:12.311741+0000","last_active":"2024-09-18T01:45:41.338335+0000","last_peered":"2024-09-18T01:45:41.338335+0000","last_clean":"2024-09-18T01:45:41.338335+0000","last_became_active":"2024-09-18T01:45:12.311399+0000","last_became_peered":"2024-09-18T01:45:12.311399+0000","last_unstale":"2024-09-18T01:45:41.338335+0000","last_undegraded":"2024-09-18T01:45:41.338335+0000","last_fullsized":"2024-09-18T01:45:41.338335+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:59:11.475143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.334893+0000","last_change":"2024-09-18T01:45:14.315545+0000","last_active":"2024-09-18T01:45:41.334893+0000","last_peered":"2024-09-18T01:45:41.334893+0000","last_clean":"2024-09-18T01:45:41.334893+0000","last_became_active":"2024-09-18T01:45:14.314587+0000","last_became_peered":"2024-09-18T01:45:14.314587+0000","last_unstale":"2024-09-18T01:45:41.334893+0000","last_undegraded":"2024-09-18T01:45:41.334893+0000","last_fullsized":"2024-09-18T01:45:41.334893+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:18:52.177258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"31'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.333069+0000","last_change":"2024-09-18T01:45:14.326309+0000","last_active":"2024-09-18T01:45:41.333069+0000","last_peered":"2024-09-18T01:45:41.333069+0000","last_clean":"2024-09-18T01:45:41.333069+0000","last_became_active":"2024-09-18T01:45:14.326051+0000","last_became_peered":"2024-09-18T01:45:14.326051+0000","last_unstale":"2024-09-18T01:45:41.333069+0000","last_undegraded":"2024-09-18T01:45:41.333069+0000","last_fullsized":"2024-09-18T01:45:41.333069+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:43:32.191718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"33'8","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:46.587783+0000","last_change":"2024-09-18T01:45:06.284230+0000","last_active":"2024-09-18T01:45:46.587783+0000","last_peered":"2024-09-18T01:45:46.587783+0000","last_clean":"2024-09-18T01:45:46.587783+0000","last_became_active":"2024-09-18T01:45:06.283912+0000","last_became_peered":"2024-09-18T01:45:06.283912+0000","last_unstale":"2024-09-18T01:45:46.587783+0000","last_undegraded":"2024-09-18T01:45:46.587783+0000","last_fullsized":"2024-09-18T01:45:46.587783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:38:33.477420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:46.113600+0000","last_change":"2024-09-18T01:45:04.289644+0000","last_active":"2024-09-18T01:45:46.113600+0000","last_peered":"2024-09-18T01:45:46.113600+0000","last_clean":"2024-09-18T01:45:46.113600+0000","last_became_active":"2024-09-18T01:45:04.285647+0000","last_became_peered":"2024-09-18T01:45:04.285647+0000","last_unstale":"2024-09-18T01:45:46.113600+0000","last_undegraded":"2024-09-18T01:45:46.113600+0000","last_fullsized":"2024-09-18T01:45:46.113600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:57:36.145186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.342016+0000","last_change":"2024-09-18T01:45:41.340307+0000","last_active":"2024-09-18T01:45:41.342016+0000","last_peered":"2024-09-18T01:45:41.342016+0000","last_clean":"2024-09-18T01:45:41.342016+0000","last_became_active":"2024-09-18T01:45:41.339936+0000","last_became_peered":"2024-09-18T01:45:41.339936+0000","last_unstale":"2024-09-18T01:45:41.342016+0000","last_undegraded":"2024-09-18T01:45:41.342016+0000","last_fullsized":"2024-09-18T01:45:41.342016+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:14:27.952660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'38","reported_seq":87,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:10.688732+0000","last_change":"2024-09-18T01:45:10.307949+0000","last_active":"2024-09-18T01:47:10.688732+0000","last_peered":"2024-09-18T01:47:10.688732+0000","last_clean":"2024-09-18T01:47:10.688732+0000","last_became_active":"2024-09-18T01:45:10.307670+0000","last_became_peered":"2024-09-18T01:45:10.307670+0000","last_unstale":"2024-09-18T01:47:10.688732+0000","last_undegraded":"2024-09-18T01:47:10.688732+0000","last_fullsized":"2024-09-18T01:47:10.688732+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:17:12.637730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.334780+0000","last_change":"2024-09-18T01:45:12.316684+0000","last_active":"2024-09-18T01:45:41.334780+0000","last_peered":"2024-09-18T01:45:41.334780+0000","last_clean":"2024-09-18T01:45:41.334780+0000","last_became_active":"2024-09-18T01:45:12.316192+0000","last_became_peered":"2024-09-18T01:45:12.316192+0000","last_unstale":"2024-09-18T01:45:41.334780+0000","last_undegraded":"2024-09-18T01:45:41.334780+0000","last_fullsized":"2024-09-18T01:45:41.334780+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:23:24.551896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"33'5","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.656030+0000","last_change":"2024-09-18T01:45:14.312071+0000","last_active":"2024-09-18T01:48:12.656030+0000","last_peered":"2024-09-18T01:48:12.656030+0000","last_clean":"2024-09-18T01:48:12.656030+0000","last_became_active":"2024-09-18T01:45:14.311776+0000","last_became_peered":"2024-09-18T01:45:14.311776+0000","last_unstale":"2024-09-18T01:48:12.656030+0000","last_undegraded":"2024-09-18T01:48:12.656030+0000","last_fullsized":"2024-09-18T01:48:12.656030+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:10:22.245202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'8","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.652796+0000","last_change":"2024-09-18T01:45:06.292121+0000","last_active":"2024-09-18T01:48:12.652796+0000","last_peered":"2024-09-18T01:48:12.652796+0000","last_clean":"2024-09-18T01:48:12.652796+0000","last_became_active":"2024-09-18T01:45:06.291811+0000","last_became_peered":"2024-09-18T01:45:06.291811+0000","last_unstale":"2024-09-18T01:48:12.652796+0000","last_undegraded":"2024-09-18T01:48:12.652796+0000","last_fullsized":"2024-09-18T01:48:12.652796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:00:01.331200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.069642+0000","last_change":"2024-09-18T01:45:04.289933+0000","last_active":"2024-09-18T01:47:12.069642+0000","last_peered":"2024-09-18T01:47:12.069642+0000","last_clean":"2024-09-18T01:47:12.069642+0000","last_became_active":"2024-09-18T01:45:04.289655+0000","last_became_peered":"2024-09-18T01:45:04.289655+0000","last_unstale":"2024-09-18T01:47:12.069642+0000","last_undegraded":"2024-09-18T01:47:12.069642+0000","last_fullsized":"2024-09-18T01:47:12.069642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:35:27.504923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.344737+0000","last_change":"2024-09-18T01:45:41.342483+0000","last_active":"2024-09-18T01:45:41.344737+0000","last_peered":"2024-09-18T01:45:41.344737+0000","last_clean":"2024-09-18T01:45:41.344737+0000","last_became_active":"2024-09-18T01:45:41.342149+0000","last_became_peered":"2024-09-18T01:45:41.342149+0000","last_unstale":"2024-09-18T01:45:41.344737+0000","last_undegraded":"2024-09-18T01:45:41.344737+0000","last_fullsized":"2024-09-18T01:45:41.344737+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:51:13.653922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'5","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.191690+0000","last_change":"2024-09-18T01:45:10.296711+0000","last_active":"2024-09-18T01:48:12.191690+0000","last_peered":"2024-09-18T01:48:12.191690+0000","last_clean":"2024-09-18T01:48:12.191690+0000","last_became_active":"2024-09-18T01:45:10.296387+0000","last_became_peered":"2024-09-18T01:45:10.296387+0000","last_unstale":"2024-09-18T01:48:12.191690+0000","last_undegraded":"2024-09-18T01:48:12.191690+0000","last_fullsized":"2024-09-18T01:48:12.191690+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:30:55.339975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.331863+0000","last_change":"2024-09-18T01:45:12.313429+0000","last_active":"2024-09-18T01:45:41.331863+0000","last_peered":"2024-09-18T01:45:41.331863+0000","last_clean":"2024-09-18T01:45:41.331863+0000","last_became_active":"2024-09-18T01:45:12.313159+0000","last_became_peered":"2024-09-18T01:45:12.313159+0000","last_unstale":"2024-09-18T01:45:41.331863+0000","last_undegraded":"2024-09-18T01:45:41.331863+0000","last_fullsized":"2024-09-18T01:45:41.331863+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:30:57.351499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338764+0000","last_change":"2024-09-18T01:45:14.319376+0000","last_active":"2024-09-18T01:45:41.338764+0000","last_peered":"2024-09-18T01:45:41.338764+0000","last_clean":"2024-09-18T01:45:41.338764+0000","last_became_active":"2024-09-18T01:45:14.319073+0000","last_became_peered":"2024-09-18T01:45:14.319073+0000","last_unstale":"2024-09-18T01:45:41.338764+0000","last_undegraded":"2024-09-18T01:45:41.338764+0000","last_fullsized":"2024-09-18T01:45:41.338764+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:39:57.317811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'5","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:27.214914+0000","last_change":"2024-09-18T01:45:06.276739+0000","last_active":"2024-09-18T01:47:27.214914+0000","last_peered":"2024-09-18T01:47:27.214914+0000","last_clean":"2024-09-18T01:47:27.214914+0000","last_became_active":"2024-09-18T01:45:06.276408+0000","last_became_peered":"2024-09-18T01:45:06.276408+0000","last_unstale":"2024-09-18T01:47:27.214914+0000","last_undegraded":"2024-09-18T01:47:27.214914+0000","last_fullsized":"2024-09-18T01:47:27.214914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:38:33.477420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"33'6","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.787555+0000","last_change":"2024-09-18T01:45:04.287172+0000","last_active":"2024-09-18T01:48:12.787555+0000","last_peered":"2024-09-18T01:48:12.787555+0000","last_clean":"2024-09-18T01:48:12.787555+0000","last_became_active":"2024-09-18T01:45:04.286887+0000","last_became_peered":"2024-09-18T01:45:04.286887+0000","last_unstale":"2024-09-18T01:48:12.787555+0000","last_undegraded":"2024-09-18T01:48:12.787555+0000","last_fullsized":"2024-09-18T01:48:12.787555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:10:25.987284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.331617+0000","last_change":"2024-09-18T01:45:08.291860+0000","last_active":"2024-09-18T01:45:41.331617+0000","last_peered":"2024-09-18T01:45:41.331617+0000","last_clean":"2024-09-18T01:45:41.331617+0000","last_became_active":"2024-09-18T01:45:08.291575+0000","last_became_peered":"2024-09-18T01:45:08.291575+0000","last_unstale":"2024-09-18T01:45:41.331617+0000","last_undegraded":"2024-09-18T01:45:41.331617+0000","last_fullsized":"2024-09-18T01:45:41.331617+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:10:31.670675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'40","reported_seq":99,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.246074+0000","last_change":"2024-09-18T01:45:10.298133+0000","last_active":"2024-09-18T01:48:12.246074+0000","last_peered":"2024-09-18T01:48:12.246074+0000","last_clean":"2024-09-18T01:48:12.246074+0000","last_became_active":"2024-09-18T01:45:10.297904+0000","last_became_peered":"2024-09-18T01:45:10.297904+0000","last_unstale":"2024-09-18T01:48:12.246074+0000","last_undegraded":"2024-09-18T01:48:12.246074+0000","last_fullsized":"2024-09-18T01:48:12.246074+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:17:46.496134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.334632+0000","last_change":"2024-09-18T01:45:12.313485+0000","last_active":"2024-09-18T01:45:41.334632+0000","last_peered":"2024-09-18T01:45:41.334632+0000","last_clean":"2024-09-18T01:45:41.334632+0000","last_became_active":"2024-09-18T01:45:12.313186+0000","last_became_peered":"2024-09-18T01:45:12.313186+0000","last_unstale":"2024-09-18T01:45:41.334632+0000","last_undegraded":"2024-09-18T01:45:41.334632+0000","last_fullsized":"2024-09-18T01:45:41.334632+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:49:35.068566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337050+0000","last_change":"2024-09-18T01:45:14.326931+0000","last_active":"2024-09-18T01:45:41.337050+0000","last_peered":"2024-09-18T01:45:41.337050+0000","last_clean":"2024-09-18T01:45:41.337050+0000","last_became_active":"2024-09-18T01:45:14.326668+0000","last_became_peered":"2024-09-18T01:45:14.326668+0000","last_unstale":"2024-09-18T01:45:41.337050+0000","last_undegraded":"2024-09-18T01:45:41.337050+0000","last_fullsized":"2024-09-18T01:45:41.337050+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:46:10.520315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'18","reported_seq":95,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.800687+0000","last_change":"2024-09-18T01:45:06.297569+0000","last_active":"2024-09-18T01:48:12.800687+0000","last_peered":"2024-09-18T01:48:12.800687+0000","last_clean":"2024-09-18T01:48:12.800687+0000","last_became_active":"2024-09-18T01:45:06.297220+0000","last_became_peered":"2024-09-18T01:45:06.297220+0000","last_unstale":"2024-09-18T01:48:12.800687+0000","last_undegraded":"2024-09-18T01:48:12.800687+0000","last_fullsized":"2024-09-18T01:48:12.800687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:52:37.561237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":76,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337780+0000","last_change":"2024-09-18T01:45:04.283606+0000","last_active":"2024-09-18T01:45:41.337780+0000","last_peered":"2024-09-18T01:45:41.337780+0000","last_clean":"2024-09-18T01:45:41.337780+0000","last_became_active":"2024-09-18T01:45:04.283276+0000","last_became_peered":"2024-09-18T01:45:04.283276+0000","last_unstale":"2024-09-18T01:45:41.337780+0000","last_undegraded":"2024-09-18T01:45:41.337780+0000","last_fullsized":"2024-09-18T01:45:41.337780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:17:00.799400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.335084+0000","last_change":"2024-09-18T01:45:08.291740+0000","last_active":"2024-09-18T01:45:41.335084+0000","last_peered":"2024-09-18T01:45:41.335084+0000","last_clean":"2024-09-18T01:45:41.335084+0000","last_became_active":"2024-09-18T01:45:08.290911+0000","last_became_peered":"2024-09-18T01:45:08.290911+0000","last_unstale":"2024-09-18T01:45:41.335084+0000","last_undegraded":"2024-09-18T01:45:41.335084+0000","last_fullsized":"2024-09-18T01:45:41.335084+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:38:00.913159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'30","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:10.674668+0000","last_change":"2024-09-18T01:45:10.301942+0000","last_active":"2024-09-18T01:47:10.674668+0000","last_peered":"2024-09-18T01:47:10.674668+0000","last_clean":"2024-09-18T01:47:10.674668+0000","last_became_active":"2024-09-18T01:45:10.301622+0000","last_became_peered":"2024-09-18T01:45:10.301622+0000","last_unstale":"2024-09-18T01:47:10.674668+0000","last_undegraded":"2024-09-18T01:47:10.674668+0000","last_fullsized":"2024-09-18T01:47:10.674668+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:45:21.320125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.332022+0000","last_change":"2024-09-18T01:45:12.313357+0000","last_active":"2024-09-18T01:45:41.332022+0000","last_peered":"2024-09-18T01:45:41.332022+0000","last_clean":"2024-09-18T01:45:41.332022+0000","last_became_active":"2024-09-18T01:45:12.313096+0000","last_became_peered":"2024-09-18T01:45:12.313096+0000","last_unstale":"2024-09-18T01:45:41.332022+0000","last_undegraded":"2024-09-18T01:45:41.332022+0000","last_fullsized":"2024-09-18T01:45:41.332022+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:03:16.580180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"33'12","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.871323+0000","last_change":"2024-09-18T01:45:06.282718+0000","last_active":"2024-09-18T01:48:12.871323+0000","last_peered":"2024-09-18T01:48:12.871323+0000","last_clean":"2024-09-18T01:48:12.871323+0000","last_became_active":"2024-09-18T01:45:06.282461+0000","last_became_peered":"2024-09-18T01:45:06.282461+0000","last_unstale":"2024-09-18T01:48:12.871323+0000","last_undegraded":"2024-09-18T01:48:12.871323+0000","last_fullsized":"2024-09-18T01:48:12.871323+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:30:50.253764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"33'8","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.539657+0000","last_change":"2024-09-18T01:45:04.293367+0000","last_active":"2024-09-18T01:48:12.539657+0000","last_peered":"2024-09-18T01:48:12.539657+0000","last_clean":"2024-09-18T01:48:12.539657+0000","last_became_active":"2024-09-18T01:45:04.288082+0000","last_became_peered":"2024-09-18T01:45:04.288082+0000","last_unstale":"2024-09-18T01:48:12.539657+0000","last_undegraded":"2024-09-18T01:48:12.539657+0000","last_fullsized":"2024-09-18T01:48:12.539657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:03:55.175306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":48,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.340356+0000","last_change":"2024-09-18T01:45:08.293027+0000","last_active":"2024-09-18T01:45:41.340356+0000","last_peered":"2024-09-18T01:45:41.340356+0000","last_clean":"2024-09-18T01:45:41.340356+0000","last_became_active":"2024-09-18T01:45:08.292739+0000","last_became_peered":"2024-09-18T01:45:08.292739+0000","last_unstale":"2024-09-18T01:45:41.340356+0000","last_undegraded":"2024-09-18T01:45:41.340356+0000","last_fullsized":"2024-09-18T01:45:41.340356+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:30:59.656894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'60","reported_seq":122,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:10.694810+0000","last_change":"2024-09-18T01:45:10.296746+0000","last_active":"2024-09-18T01:47:10.694810+0000","last_peered":"2024-09-18T01:47:10.694810+0000","last_clean":"2024-09-18T01:47:10.694810+0000","last_became_active":"2024-09-18T01:45:10.296396+0000","last_became_peered":"2024-09-18T01:45:10.296396+0000","last_unstale":"2024-09-18T01:47:10.694810+0000","last_undegraded":"2024-09-18T01:47:10.694810+0000","last_fullsized":"2024-09-18T01:47:10.694810+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:49:47.265044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":58,"num_read_kb":48,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.332138+0000","last_change":"2024-09-18T01:45:12.307915+0000","last_active":"2024-09-18T01:45:41.332138+0000","last_peered":"2024-09-18T01:45:41.332138+0000","last_clean":"2024-09-18T01:45:41.332138+0000","last_became_active":"2024-09-18T01:45:12.307279+0000","last_became_peered":"2024-09-18T01:45:12.307279+0000","last_unstale":"2024-09-18T01:45:41.332138+0000","last_undegraded":"2024-09-18T01:45:41.332138+0000","last_fullsized":"2024-09-18T01:45:41.332138+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:49:49.276568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'22","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.098129+0000","last_change":"2024-09-18T01:45:14.320125+0000","last_active":"2024-09-18T01:47:12.098129+0000","last_peered":"2024-09-18T01:47:12.098129+0000","last_clean":"2024-09-18T01:47:12.098129+0000","last_became_active":"2024-09-18T01:45:14.319540+0000","last_became_peered":"2024-09-18T01:45:14.319540+0000","last_unstale":"2024-09-18T01:47:12.098129+0000","last_undegraded":"2024-09-18T01:47:12.098129+0000","last_fullsized":"2024-09-18T01:47:12.098129+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:14:53.955796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":65,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'18","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.801087+0000","last_change":"2024-09-18T01:45:06.293374+0000","last_active":"2024-09-18T01:48:12.801087+0000","last_peered":"2024-09-18T01:48:12.801087+0000","last_clean":"2024-09-18T01:48:12.801087+0000","last_became_active":"2024-09-18T01:45:06.293053+0000","last_became_peered":"2024-09-18T01:45:06.293053+0000","last_unstale":"2024-09-18T01:48:12.801087+0000","last_undegraded":"2024-09-18T01:48:12.801087+0000","last_fullsized":"2024-09-18T01:48:12.801087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:55:38.246732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":45,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.333300+0000","last_change":"2024-09-18T01:45:04.292562+0000","last_active":"2024-09-18T01:45:41.333300+0000","last_peered":"2024-09-18T01:45:41.333300+0000","last_clean":"2024-09-18T01:45:41.333300+0000","last_became_active":"2024-09-18T01:45:04.292082+0000","last_became_peered":"2024-09-18T01:45:04.292082+0000","last_unstale":"2024-09-18T01:45:41.333300+0000","last_undegraded":"2024-09-18T01:45:41.333300+0000","last_fullsized":"2024-09-18T01:45:41.333300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:08:58.229173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.333652+0000","last_change":"2024-09-18T01:45:08.287312+0000","last_active":"2024-09-18T01:45:41.333652+0000","last_peered":"2024-09-18T01:45:41.333652+0000","last_clean":"2024-09-18T01:45:41.333652+0000","last_became_active":"2024-09-18T01:45:08.286609+0000","last_became_peered":"2024-09-18T01:45:08.286609+0000","last_unstale":"2024-09-18T01:45:41.333652+0000","last_undegraded":"2024-09-18T01:45:41.333652+0000","last_fullsized":"2024-09-18T01:45:41.333652+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:04:58.163455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'36","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:10.675587+0000","last_change":"2024-09-18T01:45:10.309790+0000","last_active":"2024-09-18T01:47:10.675587+0000","last_peered":"2024-09-18T01:47:10.675587+0000","last_clean":"2024-09-18T01:47:10.675587+0000","last_became_active":"2024-09-18T01:45:10.309360+0000","last_became_peered":"2024-09-18T01:45:10.309360+0000","last_unstale":"2024-09-18T01:47:10.675587+0000","last_undegraded":"2024-09-18T01:47:10.675587+0000","last_fullsized":"2024-09-18T01:47:10.675587+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:47:11.016927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.334583+0000","last_change":"2024-09-18T01:45:12.314763+0000","last_active":"2024-09-18T01:45:41.334583+0000","last_peered":"2024-09-18T01:45:41.334583+0000","last_clean":"2024-09-18T01:45:41.334583+0000","last_became_active":"2024-09-18T01:45:12.314499+0000","last_became_peered":"2024-09-18T01:45:12.314499+0000","last_unstale":"2024-09-18T01:45:41.334583+0000","last_undegraded":"2024-09-18T01:45:41.334583+0000","last_fullsized":"2024-09-18T01:45:41.334583+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:43:30.182833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"33'2","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:46.123289+0000","last_change":"2024-09-18T01:45:14.326163+0000","last_active":"2024-09-18T01:45:46.123289+0000","last_peered":"2024-09-18T01:45:46.123289+0000","last_clean":"2024-09-18T01:45:46.123289+0000","last_became_active":"2024-09-18T01:45:14.325421+0000","last_became_peered":"2024-09-18T01:45:14.325421+0000","last_unstale":"2024-09-18T01:45:46.123289+0000","last_undegraded":"2024-09-18T01:45:46.123289+0000","last_fullsized":"2024-09-18T01:45:46.123289+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:46:44.031146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'8","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.559304+0000","last_change":"2024-09-18T01:45:06.287633+0000","last_active":"2024-09-18T01:48:12.559304+0000","last_peered":"2024-09-18T01:48:12.559304+0000","last_clean":"2024-09-18T01:48:12.559304+0000","last_became_active":"2024-09-18T01:45:06.286153+0000","last_became_peered":"2024-09-18T01:45:06.286153+0000","last_unstale":"2024-09-18T01:48:12.559304+0000","last_undegraded":"2024-09-18T01:48:12.559304+0000","last_fullsized":"2024-09-18T01:48:12.559304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:49:16.994650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.334776+0000","last_change":"2024-09-18T01:45:04.295250+0000","last_active":"2024-09-18T01:45:41.334776+0000","last_peered":"2024-09-18T01:45:41.334776+0000","last_clean":"2024-09-18T01:45:41.334776+0000","last_became_active":"2024-09-18T01:45:04.294537+0000","last_became_peered":"2024-09-18T01:45:04.294537+0000","last_unstale":"2024-09-18T01:45:41.334776+0000","last_undegraded":"2024-09-18T01:45:41.334776+0000","last_fullsized":"2024-09-18T01:45:41.334776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:18:39.513085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.332516+0000","last_change":"2024-09-18T01:45:08.287053+0000","last_active":"2024-09-18T01:45:41.332516+0000","last_peered":"2024-09-18T01:45:41.332516+0000","last_clean":"2024-09-18T01:45:41.332516+0000","last_became_active":"2024-09-18T01:45:08.286466+0000","last_became_peered":"2024-09-18T01:45:08.286466+0000","last_unstale":"2024-09-18T01:45:41.332516+0000","last_undegraded":"2024-09-18T01:45:41.332516+0000","last_fullsized":"2024-09-18T01:45:41.332516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:15:50.332283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'40","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:10.692621+0000","last_change":"2024-09-18T01:45:10.304141+0000","last_active":"2024-09-18T01:47:10.692621+0000","last_peered":"2024-09-18T01:47:10.692621+0000","last_clean":"2024-09-18T01:47:10.692621+0000","last_became_active":"2024-09-18T01:45:10.303911+0000","last_became_peered":"2024-09-18T01:45:10.303911+0000","last_unstale":"2024-09-18T01:47:10.692621+0000","last_undegraded":"2024-09-18T01:47:10.692621+0000","last_fullsized":"2024-09-18T01:47:10.692621+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:48:29.561311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338997+0000","last_change":"2024-09-18T01:45:12.313469+0000","last_active":"2024-09-18T01:45:41.338997+0000","last_peered":"2024-09-18T01:45:41.338997+0000","last_clean":"2024-09-18T01:45:41.338997+0000","last_became_active":"2024-09-18T01:45:12.313180+0000","last_became_peered":"2024-09-18T01:45:12.313180+0000","last_unstale":"2024-09-18T01:45:41.338997+0000","last_undegraded":"2024-09-18T01:45:41.338997+0000","last_fullsized":"2024-09-18T01:45:41.338997+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:38:04.933752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"33'3","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.166889+0000","last_change":"2024-09-18T01:45:14.326771+0000","last_active":"2024-09-18T01:47:12.166889+0000","last_peered":"2024-09-18T01:47:12.166889+0000","last_clean":"2024-09-18T01:47:12.166889+0000","last_became_active":"2024-09-18T01:45:14.326452+0000","last_became_peered":"2024-09-18T01:45:14.326452+0000","last_unstale":"2024-09-18T01:47:12.166889+0000","last_undegraded":"2024-09-18T01:47:12.166889+0000","last_fullsized":"2024-09-18T01:47:12.166889+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:23:19.339622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:46.588667+0000","last_change":"2024-09-18T01:45:06.282527+0000","last_active":"2024-09-18T01:45:46.588667+0000","last_peered":"2024-09-18T01:45:46.588667+0000","last_clean":"2024-09-18T01:45:46.588667+0000","last_became_active":"2024-09-18T01:45:06.281987+0000","last_became_peered":"2024-09-18T01:45:06.281987+0000","last_unstale":"2024-09-18T01:45:46.588667+0000","last_undegraded":"2024-09-18T01:45:46.588667+0000","last_fullsized":"2024-09-18T01:45:46.588667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:03:57.182802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"33'1","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:37.219069+0000","last_change":"2024-09-18T01:45:04.290235+0000","last_active":"2024-09-18T01:47:37.219069+0000","last_peered":"2024-09-18T01:47:37.219069+0000","last_clean":"2024-09-18T01:47:37.219069+0000","last_became_active":"2024-09-18T01:45:04.289909+0000","last_became_peered":"2024-09-18T01:45:04.289909+0000","last_unstale":"2024-09-18T01:47:37.219069+0000","last_undegraded":"2024-09-18T01:47:37.219069+0000","last_fullsized":"2024-09-18T01:47:37.219069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:03:55.663688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.347523+0000","last_change":"2024-09-18T01:45:41.342634+0000","last_active":"2024-09-18T01:45:41.347523+0000","last_peered":"2024-09-18T01:45:41.347523+0000","last_clean":"2024-09-18T01:45:41.347523+0000","last_became_active":"2024-09-18T01:45:41.342280+0000","last_became_peered":"2024-09-18T01:45:41.342280+0000","last_unstale":"2024-09-18T01:45:41.347523+0000","last_undegraded":"2024-09-18T01:45:41.347523+0000","last_fullsized":"2024-09-18T01:45:41.347523+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:22:13.981729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'16","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338687+0000","last_change":"2024-09-18T01:45:10.308886+0000","last_active":"2024-09-18T01:45:41.338687+0000","last_peered":"2024-09-18T01:45:41.338687+0000","last_clean":"2024-09-18T01:45:41.338687+0000","last_became_active":"2024-09-18T01:45:10.308524+0000","last_became_peered":"2024-09-18T01:45:10.308524+0000","last_unstale":"2024-09-18T01:45:41.338687+0000","last_undegraded":"2024-09-18T01:45:41.338687+0000","last_fullsized":"2024-09-18T01:45:41.338687+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:27:57.717568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'282","reported_seq":416,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.876028+0000","last_change":"2024-09-18T01:45:12.307543+0000","last_active":"2024-09-18T01:48:12.876028+0000","last_peered":"2024-09-18T01:48:12.876028+0000","last_clean":"2024-09-18T01:48:12.876028+0000","last_became_active":"2024-09-18T01:45:12.307186+0000","last_became_peered":"2024-09-18T01:45:12.307186+0000","last_unstale":"2024-09-18T01:48:12.876028+0000","last_undegraded":"2024-09-18T01:48:12.876028+0000","last_fullsized":"2024-09-18T01:48:12.876028+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:03:00.026847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"33'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.937244+0000","last_change":"2024-09-18T01:45:14.326301+0000","last_active":"2024-09-18T01:48:12.937244+0000","last_peered":"2024-09-18T01:48:12.937244+0000","last_clean":"2024-09-18T01:48:12.937244+0000","last_became_active":"2024-09-18T01:45:14.326018+0000","last_became_peered":"2024-09-18T01:45:14.326018+0000","last_unstale":"2024-09-18T01:48:12.937244+0000","last_undegraded":"2024-09-18T01:48:12.937244+0000","last_fullsized":"2024-09-18T01:48:12.937244+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:39:58.669383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"33'8","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.559623+0000","last_change":"2024-09-18T01:45:06.282281+0000","last_active":"2024-09-18T01:48:12.559623+0000","last_peered":"2024-09-18T01:48:12.559623+0000","last_clean":"2024-09-18T01:48:12.559623+0000","last_became_active":"2024-09-18T01:45:06.281798+0000","last_became_peered":"2024-09-18T01:45:06.281798+0000","last_unstale":"2024-09-18T01:48:12.559623+0000","last_undegraded":"2024-09-18T01:48:12.559623+0000","last_fullsized":"2024-09-18T01:48:12.559623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:08:07.525907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.336989+0000","last_change":"2024-09-18T01:45:04.293329+0000","last_active":"2024-09-18T01:45:41.336989+0000","last_peered":"2024-09-18T01:45:41.336989+0000","last_clean":"2024-09-18T01:45:41.336989+0000","last_became_active":"2024-09-18T01:45:04.293009+0000","last_became_peered":"2024-09-18T01:45:04.293009+0000","last_unstale":"2024-09-18T01:45:41.336989+0000","last_undegraded":"2024-09-18T01:45:41.336989+0000","last_fullsized":"2024-09-18T01:45:41.336989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:10:25.987284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.335416+0000","last_change":"2024-09-18T01:45:08.288626+0000","last_active":"2024-09-18T01:45:41.335416+0000","last_peered":"2024-09-18T01:45:41.335416+0000","last_clean":"2024-09-18T01:45:41.335416+0000","last_became_active":"2024-09-18T01:45:08.287884+0000","last_became_peered":"2024-09-18T01:45:08.287884+0000","last_unstale":"2024-09-18T01:45:41.335416+0000","last_undegraded":"2024-09-18T01:45:41.335416+0000","last_fullsized":"2024-09-18T01:45:41.335416+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:22:29.603107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'61","reported_seq":130,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:10.666172+0000","last_change":"2024-09-18T01:45:10.301367+0000","last_active":"2024-09-18T01:47:10.666172+0000","last_peered":"2024-09-18T01:47:10.666172+0000","last_clean":"2024-09-18T01:47:10.666172+0000","last_became_active":"2024-09-18T01:45:10.301087+0000","last_became_peered":"2024-09-18T01:45:10.301087+0000","last_unstale":"2024-09-18T01:47:10.666172+0000","last_undegraded":"2024-09-18T01:47:10.666172+0000","last_fullsized":"2024-09-18T01:47:10.666172+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:48:29.561311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":74,"num_read_kb":61,"num_write":42,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337222+0000","last_change":"2024-09-18T01:45:12.312300+0000","last_active":"2024-09-18T01:45:41.337222+0000","last_peered":"2024-09-18T01:45:41.337222+0000","last_clean":"2024-09-18T01:45:41.337222+0000","last_became_active":"2024-09-18T01:45:12.312055+0000","last_became_peered":"2024-09-18T01:45:12.312055+0000","last_unstale":"2024-09-18T01:45:41.337222+0000","last_undegraded":"2024-09-18T01:45:41.337222+0000","last_fullsized":"2024-09-18T01:45:41.337222+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:13:37.683828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"33'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:46.589606+0000","last_change":"2024-09-18T01:45:14.323228+0000","last_active":"2024-09-18T01:45:46.589606+0000","last_peered":"2024-09-18T01:45:46.589606+0000","last_clean":"2024-09-18T01:45:46.589606+0000","last_became_active":"2024-09-18T01:45:14.322945+0000","last_became_peered":"2024-09-18T01:45:14.322945+0000","last_unstale":"2024-09-18T01:45:46.589606+0000","last_undegraded":"2024-09-18T01:45:46.589606+0000","last_fullsized":"2024-09-18T01:45:46.589606+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:02:58.012154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'6","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.650017+0000","last_change":"2024-09-18T01:45:06.282529+0000","last_active":"2024-09-18T01:48:12.650017+0000","last_peered":"2024-09-18T01:48:12.650017+0000","last_clean":"2024-09-18T01:48:12.650017+0000","last_became_active":"2024-09-18T01:45:06.281480+0000","last_became_peered":"2024-09-18T01:45:06.281480+0000","last_unstale":"2024-09-18T01:48:12.650017+0000","last_undegraded":"2024-09-18T01:48:12.650017+0000","last_fullsized":"2024-09-18T01:48:12.650017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:12:27.107318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:44.959625+0000","last_change":"2024-09-18T01:45:04.291296+0000","last_active":"2024-09-18T01:45:44.959625+0000","last_peered":"2024-09-18T01:45:44.959625+0000","last_clean":"2024-09-18T01:45:44.959625+0000","last_became_active":"2024-09-18T01:45:04.290901+0000","last_became_peered":"2024-09-18T01:45:04.290901+0000","last_unstale":"2024-09-18T01:45:44.959625+0000","last_undegraded":"2024-09-18T01:45:44.959625+0000","last_fullsized":"2024-09-18T01:45:44.959625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:34:29.255564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.334766+0000","last_change":"2024-09-18T01:45:08.286897+0000","last_active":"2024-09-18T01:45:41.334766+0000","last_peered":"2024-09-18T01:45:41.334766+0000","last_clean":"2024-09-18T01:45:41.334766+0000","last_became_active":"2024-09-18T01:45:08.286502+0000","last_became_peered":"2024-09-18T01:45:08.286502+0000","last_unstale":"2024-09-18T01:45:41.334766+0000","last_undegraded":"2024-09-18T01:45:41.334766+0000","last_fullsized":"2024-09-18T01:45:41.334766+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:44:50.713773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'36","reported_seq":84,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:10.667256+0000","last_change":"2024-09-18T01:45:10.306297+0000","last_active":"2024-09-18T01:47:10.667256+0000","last_peered":"2024-09-18T01:47:10.667256+0000","last_clean":"2024-09-18T01:47:10.667256+0000","last_became_active":"2024-09-18T01:45:10.306076+0000","last_became_peered":"2024-09-18T01:45:10.306076+0000","last_unstale":"2024-09-18T01:47:10.667256+0000","last_undegraded":"2024-09-18T01:47:10.667256+0000","last_fullsized":"2024-09-18T01:47:10.667256+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:52:41.579679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.333314+0000","last_change":"2024-09-18T01:45:12.316303+0000","last_active":"2024-09-18T01:45:41.333314+0000","last_peered":"2024-09-18T01:45:41.333314+0000","last_clean":"2024-09-18T01:45:41.333314+0000","last_became_active":"2024-09-18T01:45:12.316022+0000","last_became_peered":"2024-09-18T01:45:12.316022+0000","last_unstale":"2024-09-18T01:45:41.333314+0000","last_undegraded":"2024-09-18T01:45:41.333314+0000","last_fullsized":"2024-09-18T01:45:41.333314+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:08:15.127495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337877+0000","last_change":"2024-09-18T01:45:14.325515+0000","last_active":"2024-09-18T01:45:41.337877+0000","last_peered":"2024-09-18T01:45:41.337877+0000","last_clean":"2024-09-18T01:45:41.337877+0000","last_became_active":"2024-09-18T01:45:14.325208+0000","last_became_peered":"2024-09-18T01:45:14.325208+0000","last_unstale":"2024-09-18T01:45:41.337877+0000","last_undegraded":"2024-09-18T01:45:41.337877+0000","last_fullsized":"2024-09-18T01:45:41.337877+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:55:28.461066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'26","reported_seq":94,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.871206+0000","last_change":"2024-09-18T01:45:06.283428+0000","last_active":"2024-09-18T01:48:12.871206+0000","last_peered":"2024-09-18T01:48:12.871206+0000","last_clean":"2024-09-18T01:48:12.871206+0000","last_became_active":"2024-09-18T01:45:06.283174+0000","last_became_peered":"2024-09-18T01:45:06.283174+0000","last_unstale":"2024-09-18T01:48:12.871206+0000","last_undegraded":"2024-09-18T01:48:12.871206+0000","last_fullsized":"2024-09-18T01:48:12.871206+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:17:42.477692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":84,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.339404+0000","last_change":"2024-09-18T01:45:04.273552+0000","last_active":"2024-09-18T01:45:41.339404+0000","last_peered":"2024-09-18T01:45:41.339404+0000","last_clean":"2024-09-18T01:45:41.339404+0000","last_became_active":"2024-09-18T01:45:04.273128+0000","last_became_peered":"2024-09-18T01:45:04.273128+0000","last_unstale":"2024-09-18T01:45:41.339404+0000","last_undegraded":"2024-09-18T01:45:41.339404+0000","last_fullsized":"2024-09-18T01:45:41.339404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:35:27.504923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"33'4","reported_seq":226,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:11.783605+0000","last_change":"2024-09-18T01:45:08.294864+0000","last_active":"2024-09-18T01:47:11.783605+0000","last_peered":"2024-09-18T01:47:11.783605+0000","last_clean":"2024-09-18T01:47:11.783605+0000","last_became_active":"2024-09-18T01:45:08.294338+0000","last_became_peered":"2024-09-18T01:45:08.294338+0000","last_unstale":"2024-09-18T01:47:11.783605+0000","last_undegraded":"2024-09-18T01:47:11.783605+0000","last_fullsized":"2024-09-18T01:47:11.783605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:30:59.656894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'33","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:42.219946+0000","last_change":"2024-09-18T01:45:10.308965+0000","last_active":"2024-09-18T01:47:42.219946+0000","last_peered":"2024-09-18T01:47:42.219946+0000","last_clean":"2024-09-18T01:47:42.219946+0000","last_became_active":"2024-09-18T01:45:10.308336+0000","last_became_peered":"2024-09-18T01:45:10.308336+0000","last_unstale":"2024-09-18T01:47:42.219946+0000","last_undegraded":"2024-09-18T01:47:42.219946+0000","last_fullsized":"2024-09-18T01:47:42.219946+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:18:53.742596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":27,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.335626+0000","last_change":"2024-09-18T01:45:12.313122+0000","last_active":"2024-09-18T01:45:41.335626+0000","last_peered":"2024-09-18T01:45:41.335626+0000","last_clean":"2024-09-18T01:45:41.335626+0000","last_became_active":"2024-09-18T01:45:12.312794+0000","last_became_peered":"2024-09-18T01:45:12.312794+0000","last_unstale":"2024-09-18T01:45:41.335626+0000","last_undegraded":"2024-09-18T01:45:41.335626+0000","last_fullsized":"2024-09-18T01:45:41.335626+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:20:31.256442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"33'10","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.266530+0000","last_change":"2024-09-18T01:45:14.325782+0000","last_active":"2024-09-18T01:48:12.266530+0000","last_peered":"2024-09-18T01:48:12.266530+0000","last_clean":"2024-09-18T01:48:12.266530+0000","last_became_active":"2024-09-18T01:45:14.325464+0000","last_became_peered":"2024-09-18T01:45:14.325464+0000","last_unstale":"2024-09-18T01:48:12.266530+0000","last_undegraded":"2024-09-18T01:48:12.266530+0000","last_fullsized":"2024-09-18T01:48:12.266530+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:16:17.590314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'8","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.871148+0000","last_change":"2024-09-18T01:45:06.283599+0000","last_active":"2024-09-18T01:48:12.871148+0000","last_peered":"2024-09-18T01:48:12.871148+0000","last_clean":"2024-09-18T01:48:12.871148+0000","last_became_active":"2024-09-18T01:45:06.283071+0000","last_became_peered":"2024-09-18T01:45:06.283071+0000","last_unstale":"2024-09-18T01:48:12.871148+0000","last_undegraded":"2024-09-18T01:48:12.871148+0000","last_fullsized":"2024-09-18T01:48:12.871148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:32:00.122022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.781181+0000","last_change":"2024-09-18T01:45:04.298035+0000","last_active":"2024-09-18T01:48:12.781181+0000","last_peered":"2024-09-18T01:48:12.781181+0000","last_clean":"2024-09-18T01:48:12.781181+0000","last_became_active":"2024-09-18T01:45:04.297716+0000","last_became_peered":"2024-09-18T01:45:04.297716+0000","last_unstale":"2024-09-18T01:48:12.781181+0000","last_undegraded":"2024-09-18T01:48:12.781181+0000","last_fullsized":"2024-09-18T01:48:12.781181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:19:39.056474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:09.379986+0000","last_change":"2024-09-18T01:45:08.294474+0000","last_active":"2024-09-18T01:47:09.379986+0000","last_peered":"2024-09-18T01:47:09.379986+0000","last_clean":"2024-09-18T01:47:09.379986+0000","last_became_active":"2024-09-18T01:45:08.294160+0000","last_became_peered":"2024-09-18T01:45:08.294160+0000","last_unstale":"2024-09-18T01:47:09.379986+0000","last_undegraded":"2024-09-18T01:47:09.379986+0000","last_fullsized":"2024-09-18T01:47:09.379986+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:58:00.539983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'44","reported_seq":100,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.192510+0000","last_change":"2024-09-18T01:45:10.308624+0000","last_active":"2024-09-18T01:48:12.192510+0000","last_peered":"2024-09-18T01:48:12.192510+0000","last_clean":"2024-09-18T01:48:12.192510+0000","last_became_active":"2024-09-18T01:45:10.308302+0000","last_became_peered":"2024-09-18T01:45:10.308302+0000","last_unstale":"2024-09-18T01:48:12.192510+0000","last_undegraded":"2024-09-18T01:48:12.192510+0000","last_fullsized":"2024-09-18T01:48:12.192510+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:00:38.863397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":52,"num_read_kb":46,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338107+0000","last_change":"2024-09-18T01:45:12.305985+0000","last_active":"2024-09-18T01:45:41.338107+0000","last_peered":"2024-09-18T01:45:41.338107+0000","last_clean":"2024-09-18T01:45:41.338107+0000","last_became_active":"2024-09-18T01:45:12.305742+0000","last_became_peered":"2024-09-18T01:45:12.305742+0000","last_unstale":"2024-09-18T01:45:41.338107+0000","last_undegraded":"2024-09-18T01:45:41.338107+0000","last_fullsized":"2024-09-18T01:45:41.338107+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:31:43.441229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"33'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:10.703620+0000","last_change":"2024-09-18T01:45:14.325723+0000","last_active":"2024-09-18T01:47:10.703620+0000","last_peered":"2024-09-18T01:47:10.703620+0000","last_clean":"2024-09-18T01:47:10.703620+0000","last_became_active":"2024-09-18T01:45:14.325368+0000","last_became_peered":"2024-09-18T01:45:14.325368+0000","last_unstale":"2024-09-18T01:47:10.703620+0000","last_undegraded":"2024-09-18T01:47:10.703620+0000","last_fullsized":"2024-09-18T01:47:10.703620+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:29:32.472538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"33'8","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.929324+0000","last_change":"2024-09-18T01:45:41.342690+0000","last_active":"2024-09-18T01:48:12.929324+0000","last_peered":"2024-09-18T01:48:12.929324+0000","last_clean":"2024-09-18T01:48:12.929324+0000","last_became_active":"2024-09-18T01:45:41.342336+0000","last_became_peered":"2024-09-18T01:45:41.342336+0000","last_unstale":"2024-09-18T01:48:12.929324+0000","last_undegraded":"2024-09-18T01:48:12.929324+0000","last_fullsized":"2024-09-18T01:48:12.929324+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:26:55.964302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.006982+0000","last_change":"2024-09-18T01:45:04.285604+0000","last_active":"2024-09-18T01:47:12.006982+0000","last_peered":"2024-09-18T01:47:12.006982+0000","last_clean":"2024-09-18T01:47:12.006982+0000","last_became_active":"2024-09-18T01:45:04.284969+0000","last_became_peered":"2024-09-18T01:45:04.284969+0000","last_unstale":"2024-09-18T01:47:12.006982+0000","last_undegraded":"2024-09-18T01:47:12.006982+0000","last_fullsized":"2024-09-18T01:47:12.006982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:43:17.455462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'11","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.800655+0000","last_change":"2024-09-18T01:45:06.285979+0000","last_active":"2024-09-18T01:48:12.800655+0000","last_peered":"2024-09-18T01:48:12.800655+0000","last_clean":"2024-09-18T01:48:12.800655+0000","last_became_active":"2024-09-18T01:45:06.285500+0000","last_became_peered":"2024-09-18T01:45:06.285500+0000","last_unstale":"2024-09-18T01:48:12.800655+0000","last_undegraded":"2024-09-18T01:48:12.800655+0000","last_fullsized":"2024-09-18T01:48:12.800655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:25:24.068245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337324+0000","last_change":"2024-09-18T01:45:04.280448+0000","last_active":"2024-09-18T01:45:41.337324+0000","last_peered":"2024-09-18T01:45:41.337324+0000","last_clean":"2024-09-18T01:45:41.337324+0000","last_became_active":"2024-09-18T01:45:04.280147+0000","last_became_peered":"2024-09-18T01:45:04.280147+0000","last_unstale":"2024-09-18T01:45:41.337324+0000","last_undegraded":"2024-09-18T01:45:41.337324+0000","last_fullsized":"2024-09-18T01:45:41.337324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:08:58.229173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.840013+0000","last_change":"2024-09-18T01:45:06.278954+0000","last_active":"2024-09-18T01:48:12.840013+0000","last_peered":"2024-09-18T01:48:12.840013+0000","last_clean":"2024-09-18T01:48:12.840013+0000","last_became_active":"2024-09-18T01:45:06.278684+0000","last_became_peered":"2024-09-18T01:45:06.278684+0000","last_unstale":"2024-09-18T01:48:12.840013+0000","last_undegraded":"2024-09-18T01:48:12.840013+0000","last_fullsized":"2024-09-18T01:48:12.840013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:02:53.996881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.335905+0000","last_change":"2024-09-18T01:45:04.283274+0000","last_active":"2024-09-18T01:45:41.335905+0000","last_peered":"2024-09-18T01:45:41.335905+0000","last_clean":"2024-09-18T01:45:41.335905+0000","last_became_active":"2024-09-18T01:45:04.281920+0000","last_became_peered":"2024-09-18T01:45:04.281920+0000","last_unstale":"2024-09-18T01:45:41.335905+0000","last_undegraded":"2024-09-18T01:45:41.335905+0000","last_fullsized":"2024-09-18T01:45:41.335905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:33:35.587070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"33'6","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:46.587865+0000","last_change":"2024-09-18T01:45:06.282298+0000","last_active":"2024-09-18T01:45:46.587865+0000","last_peered":"2024-09-18T01:45:46.587865+0000","last_clean":"2024-09-18T01:45:46.587865+0000","last_became_active":"2024-09-18T01:45:06.281998+0000","last_became_peered":"2024-09-18T01:45:06.281998+0000","last_unstale":"2024-09-18T01:45:46.587865+0000","last_undegraded":"2024-09-18T01:45:46.587865+0000","last_fullsized":"2024-09-18T01:45:46.587865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:57:38.152681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:44.957231+0000","last_change":"2024-09-18T01:45:04.280466+0000","last_active":"2024-09-18T01:45:44.957231+0000","last_peered":"2024-09-18T01:45:44.957231+0000","last_clean":"2024-09-18T01:45:44.957231+0000","last_became_active":"2024-09-18T01:45:04.280066+0000","last_became_peered":"2024-09-18T01:45:04.280066+0000","last_unstale":"2024-09-18T01:45:44.957231+0000","last_undegraded":"2024-09-18T01:45:44.957231+0000","last_fullsized":"2024-09-18T01:45:44.957231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:10:25.987284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.173427+0000","last_change":"2024-09-18T01:45:06.285899+0000","last_active":"2024-09-18T01:47:12.173427+0000","last_peered":"2024-09-18T01:47:12.173427+0000","last_clean":"2024-09-18T01:47:12.173427+0000","last_became_active":"2024-09-18T01:45:06.285054+0000","last_became_peered":"2024-09-18T01:45:06.285054+0000","last_unstale":"2024-09-18T01:47:12.173427+0000","last_undegraded":"2024-09-18T01:47:12.173427+0000","last_fullsized":"2024-09-18T01:47:12.173427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:48:17.261741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.339308+0000","last_change":"2024-09-18T01:45:04.281591+0000","last_active":"2024-09-18T01:45:41.339308+0000","last_peered":"2024-09-18T01:45:41.339308+0000","last_clean":"2024-09-18T01:45:41.339308+0000","last_became_active":"2024-09-18T01:45:04.281146+0000","last_became_peered":"2024-09-18T01:45:04.281146+0000","last_unstale":"2024-09-18T01:45:41.339308+0000","last_undegraded":"2024-09-18T01:45:41.339308+0000","last_fullsized":"2024-09-18T01:45:41.339308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:51:35.728759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:09.011065+0000","last_change":"2024-09-18T01:45:06.292733+0000","last_active":"2024-09-18T01:47:09.011065+0000","last_peered":"2024-09-18T01:47:09.011065+0000","last_clean":"2024-09-18T01:47:09.011065+0000","last_became_active":"2024-09-18T01:45:06.292490+0000","last_became_peered":"2024-09-18T01:45:06.292490+0000","last_unstale":"2024-09-18T01:47:09.011065+0000","last_undegraded":"2024-09-18T01:47:09.011065+0000","last_fullsized":"2024-09-18T01:47:09.011065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:03:57.182802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337752+0000","last_change":"2024-09-18T01:45:04.294522+0000","last_active":"2024-09-18T01:45:41.337752+0000","last_peered":"2024-09-18T01:45:41.337752+0000","last_clean":"2024-09-18T01:45:41.337752+0000","last_became_active":"2024-09-18T01:45:04.293767+0000","last_became_peered":"2024-09-18T01:45:04.293767+0000","last_unstale":"2024-09-18T01:45:41.337752+0000","last_undegraded":"2024-09-18T01:45:41.337752+0000","last_fullsized":"2024-09-18T01:45:41.337752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:16:49.444181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"33'10","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:46.125920+0000","last_change":"2024-09-18T01:45:06.293722+0000","last_active":"2024-09-18T01:45:46.125920+0000","last_peered":"2024-09-18T01:45:46.125920+0000","last_clean":"2024-09-18T01:45:46.125920+0000","last_became_active":"2024-09-18T01:45:06.293369+0000","last_became_peered":"2024-09-18T01:45:06.293369+0000","last_unstale":"2024-09-18T01:45:46.125920+0000","last_undegraded":"2024-09-18T01:45:46.125920+0000","last_fullsized":"2024-09-18T01:45:46.125920+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:12:27.107318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"33'1","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:17.215141+0000","last_change":"2024-09-18T01:45:04.292372+0000","last_active":"2024-09-18T01:47:17.215141+0000","last_peered":"2024-09-18T01:47:17.215141+0000","last_clean":"2024-09-18T01:47:17.215141+0000","last_became_active":"2024-09-18T01:45:04.292056+0000","last_became_peered":"2024-09-18T01:45:04.292056+0000","last_unstale":"2024-09-18T01:47:17.215141+0000","last_undegraded":"2024-09-18T01:47:17.215141+0000","last_fullsized":"2024-09-18T01:47:17.215141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:08:58.229173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'8","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.558399+0000","last_change":"2024-09-18T01:45:06.296391+0000","last_active":"2024-09-18T01:48:12.558399+0000","last_peered":"2024-09-18T01:48:12.558399+0000","last_clean":"2024-09-18T01:48:12.558399+0000","last_became_active":"2024-09-18T01:45:06.295055+0000","last_became_peered":"2024-09-18T01:45:06.295055+0000","last_unstale":"2024-09-18T01:48:12.558399+0000","last_undegraded":"2024-09-18T01:48:12.558399+0000","last_fullsized":"2024-09-18T01:48:12.558399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:48:17.261741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.339526+0000","last_change":"2024-09-18T01:45:04.284398+0000","last_active":"2024-09-18T01:45:41.339526+0000","last_peered":"2024-09-18T01:45:41.339526+0000","last_clean":"2024-09-18T01:45:41.339526+0000","last_became_active":"2024-09-18T01:45:04.283959+0000","last_became_peered":"2024-09-18T01:45:04.283959+0000","last_unstale":"2024-09-18T01:45:41.339526+0000","last_undegraded":"2024-09-18T01:45:41.339526+0000","last_fullsized":"2024-09-18T01:45:41.339526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:34:13.707906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"33'4","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.840864+0000","last_change":"2024-09-18T01:45:06.295541+0000","last_active":"2024-09-18T01:48:12.840864+0000","last_peered":"2024-09-18T01:48:12.840864+0000","last_clean":"2024-09-18T01:48:12.840864+0000","last_became_active":"2024-09-18T01:45:06.295270+0000","last_became_peered":"2024-09-18T01:45:06.295270+0000","last_unstale":"2024-09-18T01:48:12.840864+0000","last_undegraded":"2024-09-18T01:48:12.840864+0000","last_fullsized":"2024-09-18T01:48:12.840864+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:29:37.540404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.334195+0000","last_change":"2024-09-18T01:45:04.280658+0000","last_active":"2024-09-18T01:45:41.334195+0000","last_peered":"2024-09-18T01:45:41.334195+0000","last_clean":"2024-09-18T01:45:41.334195+0000","last_became_active":"2024-09-18T01:45:04.278951+0000","last_became_peered":"2024-09-18T01:45:04.278951+0000","last_unstale":"2024-09-18T01:45:41.334195+0000","last_undegraded":"2024-09-18T01:45:41.334195+0000","last_fullsized":"2024-09-18T01:45:41.334195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:55:36.239236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.793558+0000","last_change":"2024-09-18T01:45:06.285555+0000","last_active":"2024-09-18T01:48:12.793558+0000","last_peered":"2024-09-18T01:48:12.793558+0000","last_clean":"2024-09-18T01:48:12.793558+0000","last_became_active":"2024-09-18T01:45:06.285272+0000","last_became_peered":"2024-09-18T01:45:06.285272+0000","last_unstale":"2024-09-18T01:48:12.793558+0000","last_undegraded":"2024-09-18T01:48:12.793558+0000","last_fullsized":"2024-09-18T01:48:12.793558+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:22:44.893210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337596+0000","last_change":"2024-09-18T01:45:04.281621+0000","last_active":"2024-09-18T01:45:41.337596+0000","last_peered":"2024-09-18T01:45:41.337596+0000","last_clean":"2024-09-18T01:45:41.337596+0000","last_became_active":"2024-09-18T01:45:04.281197+0000","last_became_peered":"2024-09-18T01:45:04.281197+0000","last_unstale":"2024-09-18T01:45:41.337596+0000","last_undegraded":"2024-09-18T01:45:41.337596+0000","last_fullsized":"2024-09-18T01:45:41.337596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:59:04.808153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"33'4","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:45.518377+0000","last_change":"2024-09-18T01:45:06.285297+0000","last_active":"2024-09-18T01:45:45.518377+0000","last_peered":"2024-09-18T01:45:45.518377+0000","last_clean":"2024-09-18T01:45:45.518377+0000","last_became_active":"2024-09-18T01:45:06.284989+0000","last_became_peered":"2024-09-18T01:45:06.284989+0000","last_unstale":"2024-09-18T01:45:45.518377+0000","last_undegraded":"2024-09-18T01:45:45.518377+0000","last_fullsized":"2024-09-18T01:45:45.518377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:45:59.773285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.335010+0000","last_change":"2024-09-18T01:45:04.295486+0000","last_active":"2024-09-18T01:45:41.335010+0000","last_peered":"2024-09-18T01:45:41.335010+0000","last_clean":"2024-09-18T01:45:41.335010+0000","last_became_active":"2024-09-18T01:45:04.294125+0000","last_became_peered":"2024-09-18T01:45:04.294125+0000","last_unstale":"2024-09-18T01:45:41.335010+0000","last_undegraded":"2024-09-18T01:45:41.335010+0000","last_fullsized":"2024-09-18T01:45:41.335010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:40:12.946584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"33'10","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.840269+0000","last_change":"2024-09-18T01:45:06.279731+0000","last_active":"2024-09-18T01:48:12.840269+0000","last_peered":"2024-09-18T01:48:12.840269+0000","last_clean":"2024-09-18T01:48:12.840269+0000","last_became_active":"2024-09-18T01:45:06.279373+0000","last_became_peered":"2024-09-18T01:45:06.279373+0000","last_unstale":"2024-09-18T01:48:12.840269+0000","last_undegraded":"2024-09-18T01:48:12.840269+0000","last_fullsized":"2024-09-18T01:48:12.840269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:15:48.322910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.519021+0000","last_change":"2024-09-18T01:45:04.291798+0000","last_active":"2024-09-18T01:48:12.519021+0000","last_peered":"2024-09-18T01:48:12.519021+0000","last_clean":"2024-09-18T01:48:12.519021+0000","last_became_active":"2024-09-18T01:45:04.291442+0000","last_became_peered":"2024-09-18T01:45:04.291442+0000","last_unstale":"2024-09-18T01:48:12.519021+0000","last_undegraded":"2024-09-18T01:48:12.519021+0000","last_fullsized":"2024-09-18T01:48:12.519021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:49:22.831669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'6","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:46:28.553120+0000","last_change":"2024-09-18T01:45:06.292853+0000","last_active":"2024-09-18T01:46:28.553120+0000","last_peered":"2024-09-18T01:46:28.553120+0000","last_clean":"2024-09-18T01:46:28.553120+0000","last_became_active":"2024-09-18T01:45:06.292425+0000","last_became_peered":"2024-09-18T01:45:06.292425+0000","last_unstale":"2024-09-18T01:46:28.553120+0000","last_undegraded":"2024-09-18T01:46:28.553120+0000","last_fullsized":"2024-09-18T01:46:28.553120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:20:03.455685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.336514+0000","last_change":"2024-09-18T01:45:04.289922+0000","last_active":"2024-09-18T01:45:41.336514+0000","last_peered":"2024-09-18T01:45:41.336514+0000","last_clean":"2024-09-18T01:45:41.336514+0000","last_became_active":"2024-09-18T01:45:04.289365+0000","last_became_peered":"2024-09-18T01:45:04.289365+0000","last_unstale":"2024-09-18T01:45:41.336514+0000","last_undegraded":"2024-09-18T01:45:41.336514+0000","last_fullsized":"2024-09-18T01:45:41.336514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:59:59.323704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.335795+0000","last_change":"2024-09-18T01:45:06.293694+0000","last_active":"2024-09-18T01:45:41.335795+0000","last_peered":"2024-09-18T01:45:41.335795+0000","last_clean":"2024-09-18T01:45:41.335795+0000","last_became_active":"2024-09-18T01:45:06.293403+0000","last_became_peered":"2024-09-18T01:45:06.293403+0000","last_unstale":"2024-09-18T01:45:41.335795+0000","last_undegraded":"2024-09-18T01:45:41.335795+0000","last_fullsized":"2024-09-18T01:45:41.335795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:44:48.704400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.341176+0000","last_change":"2024-09-18T01:45:04.278234+0000","last_active":"2024-09-18T01:45:41.341176+0000","last_peered":"2024-09-18T01:45:41.341176+0000","last_clean":"2024-09-18T01:45:41.341176+0000","last_became_active":"2024-09-18T01:45:04.277907+0000","last_became_peered":"2024-09-18T01:45:04.277907+0000","last_unstale":"2024-09-18T01:45:41.341176+0000","last_undegraded":"2024-09-18T01:45:41.341176+0000","last_fullsized":"2024-09-18T01:45:41.341176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:08:05.518412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'3","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:22.216025+0000","last_change":"2024-09-18T01:45:06.293343+0000","last_active":"2024-09-18T01:47:22.216025+0000","last_peered":"2024-09-18T01:47:22.216025+0000","last_clean":"2024-09-18T01:47:22.216025+0000","last_became_active":"2024-09-18T01:45:06.293036+0000","last_became_peered":"2024-09-18T01:45:06.293036+0000","last_unstale":"2024-09-18T01:47:22.216025+0000","last_undegraded":"2024-09-18T01:47:22.216025+0000","last_fullsized":"2024-09-18T01:47:22.216025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:09:07.849480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.334001+0000","last_change":"2024-09-18T01:45:04.287307+0000","last_active":"2024-09-18T01:45:41.334001+0000","last_peered":"2024-09-18T01:45:41.334001+0000","last_clean":"2024-09-18T01:45:41.334001+0000","last_became_active":"2024-09-18T01:45:04.286591+0000","last_became_peered":"2024-09-18T01:45:04.286591+0000","last_unstale":"2024-09-18T01:45:41.334001+0000","last_undegraded":"2024-09-18T01:45:41.334001+0000","last_fullsized":"2024-09-18T01:45:41.334001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:40:12.946584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.871486+0000","last_change":"2024-09-18T01:45:06.295984+0000","last_active":"2024-09-18T01:48:12.871486+0000","last_peered":"2024-09-18T01:48:12.871486+0000","last_clean":"2024-09-18T01:48:12.871486+0000","last_became_active":"2024-09-18T01:45:06.294911+0000","last_became_peered":"2024-09-18T01:45:06.294911+0000","last_unstale":"2024-09-18T01:48:12.871486+0000","last_undegraded":"2024-09-18T01:48:12.871486+0000","last_fullsized":"2024-09-18T01:48:12.871486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:33:43.173746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.866201+0000","last_change":"2024-09-18T01:45:04.287888+0000","last_active":"2024-09-18T01:48:12.866201+0000","last_peered":"2024-09-18T01:48:12.866201+0000","last_clean":"2024-09-18T01:48:12.866201+0000","last_became_active":"2024-09-18T01:45:04.285719+0000","last_became_peered":"2024-09-18T01:45:04.285719+0000","last_unstale":"2024-09-18T01:48:12.866201+0000","last_undegraded":"2024-09-18T01:48:12.866201+0000","last_fullsized":"2024-09-18T01:48:12.866201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:33:41.166250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"33'1","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:27.216951+0000","last_change":"2024-09-18T01:45:04.280417+0000","last_active":"2024-09-18T01:47:27.216951+0000","last_peered":"2024-09-18T01:47:27.216951+0000","last_clean":"2024-09-18T01:47:27.216951+0000","last_became_active":"2024-09-18T01:45:04.278266+0000","last_became_peered":"2024-09-18T01:45:04.278266+0000","last_unstale":"2024-09-18T01:47:27.216951+0000","last_undegraded":"2024-09-18T01:47:27.216951+0000","last_fullsized":"2024-09-18T01:47:27.216951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:25:22.060750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"33'10","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:46:28.553059+0000","last_change":"2024-09-18T01:45:06.292390+0000","last_active":"2024-09-18T01:46:28.553059+0000","last_peered":"2024-09-18T01:46:28.553059+0000","last_clean":"2024-09-18T01:46:28.553059+0000","last_became_active":"2024-09-18T01:45:06.292127+0000","last_became_peered":"2024-09-18T01:45:06.292127+0000","last_unstale":"2024-09-18T01:46:28.553059+0000","last_undegraded":"2024-09-18T01:46:28.553059+0000","last_fullsized":"2024-09-18T01:46:28.553059+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:00:01.331200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337686+0000","last_change":"2024-09-18T01:45:04.273996+0000","last_active":"2024-09-18T01:45:41.337686+0000","last_peered":"2024-09-18T01:45:41.337686+0000","last_clean":"2024-09-18T01:45:41.337686+0000","last_became_active":"2024-09-18T01:45:04.273575+0000","last_became_peered":"2024-09-18T01:45:04.273575+0000","last_unstale":"2024-09-18T01:45:41.337686+0000","last_undegraded":"2024-09-18T01:45:41.337686+0000","last_fullsized":"2024-09-18T01:45:41.337686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:40:12.946584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'6","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.871024+0000","last_change":"2024-09-18T01:45:06.292393+0000","last_active":"2024-09-18T01:48:12.871024+0000","last_peered":"2024-09-18T01:48:12.871024+0000","last_clean":"2024-09-18T01:48:12.871024+0000","last_became_active":"2024-09-18T01:45:06.292037+0000","last_became_peered":"2024-09-18T01:45:06.292037+0000","last_unstale":"2024-09-18T01:48:12.871024+0000","last_undegraded":"2024-09-18T01:48:12.871024+0000","last_fullsized":"2024-09-18T01:48:12.871024+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:52:14.086589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11095,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1690,"num_read_kb":1447,"num_write":723,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1470,"ondisk_log_size":1470,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1590,"num_read_kb":1480,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38719488,"data_stored":38719488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705709,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48420,"kb_used_data":13076,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323420,"statfs":{"total":96636764160,"available":96587182080,"internally_reserved":0,"allocated":13389824,"data_stored":13058476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705709,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46560,"kb_used_data":11216,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94325280,"statfs":{"total":96636764160,"available":96589086720,"internally_reserved":0,"allocated":11485184,"data_stored":11223138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705709,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46908,"kb_used_data":11564,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94324932,"statfs":{"total":96636764160,"available":96588730368,"internally_reserved":0,"allocated":11841536,"data_stored":11549746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705709,"num_pgs":150,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44348,"kb_used_data":4844,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94327492,"statfs":{"total":96636764160,"available":96591351808,"internally_reserved":0,"allocated":4960256,"data_stored":4666184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4517888,"data_stored":4517888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10809344,"data_stored":10809344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12906496,"data_stored":12906496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T01:48:19.927 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T01:48:20.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.051+0000 7fd98f52c640 1 Processor -- start 2024-09-18T01:48:20.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.052+0000 7fd98f52c640 1 -- start start 2024-09-18T01:48:20.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.052+0000 7fd98f52c640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fd98812e940 0x7fd988130d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:20.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.052+0000 7fd98f52c640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd98806eba0 con 0x7fd98806eda0 2024-09-18T01:48:20.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.052+0000 7fd98f52c640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x7fd98806d2f0 con 0x7fd98812e940 2024-09-18T01:48:20.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.052+0000 7fd98cac7640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fd98812e940 0x7fd988130d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:20.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.052+0000 7fd98d2c8640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fd98806eda0 0x7fd98806f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:38598/0 (socket says 172.21.15.129:38598) 2024-09-18T01:48:20.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.052+0000 7fd98d2c8640 1 -- 172.21.15.129:0/3688605863 learned_addr learned my addr 172.21.15.129:0/3688605863 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-09-18T01:48:20.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.053+0000 7fd98cac7640 1 -- 172.21.15.129:0/3688605863 >> v1:172.21.15.129:6789/0 conn(0x7fd98806eda0 legacy=0x7fd98806f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:20.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.053+0000 7fd98cac7640 1 -- 172.21.15.129:0/3688605863 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd988070d50 con 0x7fd98812e940 2024-09-18T01:48:20.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.053+0000 7fd97bfff640 1 -- 172.21.15.129:0/3688605863 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2527272635 0 0) 0x7fd98806eba0 con 0x7fd98806eda0 2024-09-18T01:48:20.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.053+0000 7fd98cac7640 1 --2- 172.21.15.129:0/3688605863 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd98812e940 0x7fd988130d30 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fd984009720 tx=0x7fd98402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15a745d25b153e36 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:20.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.053+0000 7fd97bfff640 1 -- 172.21.15.129:0/3688605863 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd984037070 con 0x7fd98812e940 2024-09-18T01:48:20.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.053+0000 7fd97bfff640 1 -- 172.21.15.129:0/3688605863 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd98402ae20 con 0x7fd98812e940 2024-09-18T01:48:20.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.053+0000 7fd97bfff640 1 -- 172.21.15.129:0/3688605863 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd984032590 con 0x7fd98812e940 2024-09-18T01:48:20.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.054+0000 7fd98f52c640 1 -- 172.21.15.129:0/3688605863 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd98812e940 msgr2=0x7fd988130d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:20.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.054+0000 7fd98f52c640 1 --2- 172.21.15.129:0/3688605863 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd98812e940 0x7fd988130d30 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fd984009720 tx=0x7fd98402a1a0 comp rx=0 tx=0).stop 2024-09-18T01:48:20.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.054+0000 7fd98f52c640 1 -- 172.21.15.129:0/3688605863 shutdown_connections 2024-09-18T01:48:20.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.054+0000 7fd98f52c640 1 --2- 172.21.15.129:0/3688605863 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd98812e940 0x7fd988130d30 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:20.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.054+0000 7fd98f52c640 1 -- 172.21.15.129:0/3688605863 >> 172.21.15.129:0/3688605863 conn(0x7fd98809a890 msgr2=0x7fd98809aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:48:20.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.054+0000 7fd98f52c640 1 -- 172.21.15.129:0/3688605863 shutdown_connections 2024-09-18T01:48:20.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.054+0000 7fd98f52c640 1 -- 172.21.15.129:0/3688605863 wait complete. 2024-09-18T01:48:20.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.055+0000 7fd98f52c640 1 Processor -- start 2024-09-18T01:48:20.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.055+0000 7fd98f52c640 1 -- start start 2024-09-18T01:48:20.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.055+0000 7fd98f52c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd98806eda0 0x7fd9881293b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:20.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.055+0000 7fd98f52c640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fd98806fcd0 con 0x7fd98806eda0 2024-09-18T01:48:20.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.055+0000 7fd98d2c8640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd98806eda0 0x7fd9881293b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:20.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.055+0000 7fd98d2c8640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd98806eda0 0x7fd9881293b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:58770/0 (socket says 172.21.15.129:58770) 2024-09-18T01:48:20.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.055+0000 7fd98d2c8640 1 -- 172.21.15.129:0/2006906411 learned_addr learned my addr 172.21.15.129:0/2006906411 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-18T01:48:20.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.055+0000 7fd98d2c8640 1 -- 172.21.15.129:0/2006906411 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd988125d80 con 0x7fd98806eda0 2024-09-18T01:48:20.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.056+0000 7fd98d2c8640 1 --2- 172.21.15.129:0/2006906411 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd98806eda0 0x7fd9881293b0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fd97c00c420 tx=0x7fd97c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:20.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.056+0000 7fd979ffb640 1 -- 172.21.15.129:0/2006906411 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd97c018070 con 0x7fd98806eda0 2024-09-18T01:48:20.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.056+0000 7fd979ffb640 1 -- 172.21.15.129:0/2006906411 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd97c0074d0 con 0x7fd98806eda0 2024-09-18T01:48:20.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.056+0000 7fd979ffb640 1 -- 172.21.15.129:0/2006906411 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd97c004950 con 0x7fd98806eda0 2024-09-18T01:48:20.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.056+0000 7fd98f52c640 1 -- 172.21.15.129:0/2006906411 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9881258c0 con 0x7fd98806eda0 2024-09-18T01:48:20.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.056+0000 7fd98f52c640 1 -- 172.21.15.129:0/2006906411 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd98812bc00 con 0x7fd98806eda0 2024-09-18T01:48:20.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.057+0000 7fd979ffb640 1 -- 172.21.15.129:0/2006906411 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd97c01b070 con 0x7fd98806eda0 2024-09-18T01:48:20.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.057+0000 7fd979ffb640 1 --2- 172.21.15.129:0/2006906411 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd96c0382a0 0x7fd96c03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:20.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.057+0000 7fd979ffb640 1 -- 172.21.15.129:0/2006906411 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7fd97c04b0a0 con 0x7fd98806eda0 2024-09-18T01:48:20.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.057+0000 7fd98f52c640 1 -- 172.21.15.129:0/2006906411 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd98806f180 con 0x7fd98806eda0 2024-09-18T01:48:20.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.057+0000 7fd98cac7640 1 --2- 172.21.15.129:0/2006906411 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd96c0382a0 0x7fd96c03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:20.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.057+0000 7fd98cac7640 1 --2- 172.21.15.129:0/2006906411 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd96c0382a0 0x7fd96c03a760 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd984034000 tx=0x7fd98402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:20.062 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.062+0000 7fd979ffb640 1 -- 172.21.15.129:0/2006906411 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd988125d80 con 0x7fd98806eda0 2024-09-18T01:48:20.223 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.222+0000 7fd98f52c640 1 -- 172.21.15.129:0/2006906411 --> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd98806bba0 con 0x7fd96c0382a0 2024-09-18T01:48:20.239 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.238+0000 7fd979ffb640 1 -- 172.21.15.129:0/2006906411 <== mgr.4099 v2:172.21.15.146:6824/168968651 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665891 (secure 0 0 0) 0x7fd98806bba0 con 0x7fd96c0382a0 2024-09-18T01:48:20.246 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:48:20.251 INFO:teuthology.orchestra.run.smithi129.stderr:dumped all 2024-09-18T01:48:20.253 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.243+0000 7fd98f52c640 1 -- 172.21.15.129:0/2006906411 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd96c0382a0 msgr2=0x7fd96c03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:20.253 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.243+0000 7fd98f52c640 1 --2- 172.21.15.129:0/2006906411 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd96c0382a0 0x7fd96c03a760 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd984034000 tx=0x7fd98402e000 comp rx=0 tx=0).stop 2024-09-18T01:48:20.253 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.243+0000 7fd98f52c640 1 -- 172.21.15.129:0/2006906411 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd98806eda0 msgr2=0x7fd9881293b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:20.253 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.243+0000 7fd98f52c640 1 --2- 172.21.15.129:0/2006906411 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd98806eda0 0x7fd9881293b0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fd97c00c420 tx=0x7fd97c00c8e0 comp rx=0 tx=0).stop 2024-09-18T01:48:20.253 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.243+0000 7fd98f52c640 1 -- 172.21.15.129:0/2006906411 shutdown_connections 2024-09-18T01:48:20.253 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.243+0000 7fd98f52c640 1 --2- 172.21.15.129:0/2006906411 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fd96c0382a0 0x7fd96c03a760 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:20.253 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.243+0000 7fd98f52c640 1 --2- 172.21.15.129:0/2006906411 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd98806eda0 0x7fd9881293b0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:20.254 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.243+0000 7fd98f52c640 1 -- 172.21.15.129:0/2006906411 >> 172.21.15.129:0/2006906411 conn(0x7fd98809a890 msgr2=0x7fd98812ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:48:20.254 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.243+0000 7fd98f52c640 1 -- 172.21.15.129:0/2006906411 shutdown_connections 2024-09-18T01:48:20.254 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.243+0000 7fd98f52c640 1 -- 172.21.15.129:0/2006906411 wait complete. 2024-09-18T01:48:20.255 INFO:teuthology.orchestra.run.smithi129.stdout:{"pg_ready":true,"pg_map":{"version":136,"stamp":"2024-09-18T01:48:18.240747+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26410519,"num_objects":261,"num_object_clones":0,"num_object_copies":529,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":261,"num_whiteouts":0,"num_read":5150,"num_read_kb":4698,"num_write":2298,"num_write_kb":61374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4674,"ondisk_log_size":4674,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":186236,"kb_used_data":40700,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377301124,"statfs":{"total":386547056640,"available":386356350976,"internally_reserved":0,"allocated":41676800,"data_stored":40497544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":148956951},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25809398,"num_objects":9,"num_object_clones":0,"num_object_copies":25,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":455,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003333"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.333746+0000","last_change":"2024-09-18T01:45:04.287665+0000","last_active":"2024-09-18T01:45:41.333746+0000","last_peered":"2024-09-18T01:45:41.333746+0000","last_clean":"2024-09-18T01:45:41.333746+0000","last_became_active":"2024-09-18T01:45:04.287322+0000","last_became_peered":"2024-09-18T01:45:04.287322+0000","last_unstale":"2024-09-18T01:45:41.333746+0000","last_undegraded":"2024-09-18T01:45:41.333746+0000","last_fullsized":"2024-09-18T01:45:41.333746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:31:48.524360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"33'8","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.871310+0000","last_change":"2024-09-18T01:45:06.296427+0000","last_active":"2024-09-18T01:48:12.871310+0000","last_peered":"2024-09-18T01:48:12.871310+0000","last_clean":"2024-09-18T01:48:12.871310+0000","last_became_active":"2024-09-18T01:45:06.295819+0000","last_became_peered":"2024-09-18T01:45:06.295819+0000","last_unstale":"2024-09-18T01:48:12.871310+0000","last_undegraded":"2024-09-18T01:48:12.871310+0000","last_fullsized":"2024-09-18T01:48:12.871310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:38:33.477420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.148239+0000","last_change":"2024-09-18T01:45:04.280965+0000","last_active":"2024-09-18T01:47:12.148239+0000","last_peered":"2024-09-18T01:47:12.148239+0000","last_clean":"2024-09-18T01:47:12.148239+0000","last_became_active":"2024-09-18T01:45:04.280591+0000","last_became_peered":"2024-09-18T01:45:04.280591+0000","last_unstale":"2024-09-18T01:47:12.148239+0000","last_undegraded":"2024-09-18T01:47:12.148239+0000","last_fullsized":"2024-09-18T01:47:12.148239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:43:03.344288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"33'12","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.880318+0000","last_change":"2024-09-18T01:45:06.282040+0000","last_active":"2024-09-18T01:48:12.880318+0000","last_peered":"2024-09-18T01:48:12.880318+0000","last_clean":"2024-09-18T01:48:12.880318+0000","last_became_active":"2024-09-18T01:45:06.281659+0000","last_became_peered":"2024-09-18T01:45:06.281659+0000","last_unstale":"2024-09-18T01:48:12.880318+0000","last_undegraded":"2024-09-18T01:48:12.880318+0000","last_fullsized":"2024-09-18T01:48:12.880318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:40:04.666289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"33'5","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.119006+0000","last_change":"2024-09-18T01:45:04.287682+0000","last_active":"2024-09-18T01:47:12.119006+0000","last_peered":"2024-09-18T01:47:12.119006+0000","last_clean":"2024-09-18T01:47:12.119006+0000","last_became_active":"2024-09-18T01:45:04.286007+0000","last_became_peered":"2024-09-18T01:45:04.286007+0000","last_unstale":"2024-09-18T01:47:12.119006+0000","last_undegraded":"2024-09-18T01:47:12.119006+0000","last_fullsized":"2024-09-18T01:47:12.119006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:45:57.765789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"33'18","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:09.011236+0000","last_change":"2024-09-18T01:45:06.285754+0000","last_active":"2024-09-18T01:47:09.011236+0000","last_peered":"2024-09-18T01:47:09.011236+0000","last_clean":"2024-09-18T01:47:09.011236+0000","last_became_active":"2024-09-18T01:45:06.285378+0000","last_became_peered":"2024-09-18T01:45:06.285378+0000","last_unstale":"2024-09-18T01:47:09.011236+0000","last_undegraded":"2024-09-18T01:47:09.011236+0000","last_fullsized":"2024-09-18T01:47:09.011236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:03:10.550215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":40,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.332258+0000","last_change":"2024-09-18T01:45:04.298111+0000","last_active":"2024-09-18T01:45:41.332258+0000","last_peered":"2024-09-18T01:45:41.332258+0000","last_clean":"2024-09-18T01:45:41.332258+0000","last_became_active":"2024-09-18T01:45:04.297791+0000","last_became_peered":"2024-09-18T01:45:04.297791+0000","last_unstale":"2024-09-18T01:45:41.332258+0000","last_undegraded":"2024-09-18T01:45:41.332258+0000","last_fullsized":"2024-09-18T01:45:41.332258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:56:17.978705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"33'6","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.931884+0000","last_change":"2024-09-18T01:45:06.281604+0000","last_active":"2024-09-18T01:48:12.931884+0000","last_peered":"2024-09-18T01:48:12.931884+0000","last_clean":"2024-09-18T01:48:12.931884+0000","last_became_active":"2024-09-18T01:45:06.280779+0000","last_became_peered":"2024-09-18T01:45:06.280779+0000","last_unstale":"2024-09-18T01:48:12.931884+0000","last_undegraded":"2024-09-18T01:48:12.931884+0000","last_fullsized":"2024-09-18T01:48:12.931884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:30:51.321533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.336661+0000","last_change":"2024-09-18T01:45:04.280905+0000","last_active":"2024-09-18T01:45:41.336661+0000","last_peered":"2024-09-18T01:45:41.336661+0000","last_clean":"2024-09-18T01:45:41.336661+0000","last_became_active":"2024-09-18T01:45:04.280582+0000","last_became_peered":"2024-09-18T01:45:04.280582+0000","last_unstale":"2024-09-18T01:45:41.336661+0000","last_undegraded":"2024-09-18T01:45:41.336661+0000","last_fullsized":"2024-09-18T01:45:41.336661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:31:58.114526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'12","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.162513+0000","last_change":"2024-09-18T01:45:06.289323+0000","last_active":"2024-09-18T01:47:12.162513+0000","last_peered":"2024-09-18T01:47:12.162513+0000","last_clean":"2024-09-18T01:47:12.162513+0000","last_became_active":"2024-09-18T01:45:06.289036+0000","last_became_peered":"2024-09-18T01:45:06.289036+0000","last_unstale":"2024-09-18T01:47:12.162513+0000","last_undegraded":"2024-09-18T01:47:12.162513+0000","last_fullsized":"2024-09-18T01:47:12.162513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:10:29.661303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.331520+0000","last_change":"2024-09-18T01:45:04.286820+0000","last_active":"2024-09-18T01:45:41.331520+0000","last_peered":"2024-09-18T01:45:41.331520+0000","last_clean":"2024-09-18T01:45:41.331520+0000","last_became_active":"2024-09-18T01:45:04.286509+0000","last_became_peered":"2024-09-18T01:45:04.286509+0000","last_unstale":"2024-09-18T01:45:41.331520+0000","last_undegraded":"2024-09-18T01:45:41.331520+0000","last_fullsized":"2024-09-18T01:45:41.331520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:49:22.831669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:46:28.368317+0000","last_change":"2024-09-18T01:45:06.288010+0000","last_active":"2024-09-18T01:46:28.368317+0000","last_peered":"2024-09-18T01:46:28.368317+0000","last_clean":"2024-09-18T01:46:28.368317+0000","last_became_active":"2024-09-18T01:45:06.287110+0000","last_became_peered":"2024-09-18T01:45:06.287110+0000","last_unstale":"2024-09-18T01:46:28.368317+0000","last_undegraded":"2024-09-18T01:46:28.368317+0000","last_fullsized":"2024-09-18T01:46:28.368317+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:15:07.650151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.774639+0000","last_change":"2024-09-18T01:45:04.293823+0000","last_active":"2024-09-18T01:48:12.774639+0000","last_peered":"2024-09-18T01:48:12.774639+0000","last_clean":"2024-09-18T01:48:12.774639+0000","last_became_active":"2024-09-18T01:45:04.289290+0000","last_became_peered":"2024-09-18T01:45:04.289290+0000","last_unstale":"2024-09-18T01:48:12.774639+0000","last_undegraded":"2024-09-18T01:48:12.774639+0000","last_fullsized":"2024-09-18T01:48:12.774639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:38:46.320555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'13","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.848762+0000","last_change":"2024-09-18T01:45:06.295725+0000","last_active":"2024-09-18T01:48:12.848762+0000","last_peered":"2024-09-18T01:48:12.848762+0000","last_clean":"2024-09-18T01:48:12.848762+0000","last_became_active":"2024-09-18T01:45:06.295429+0000","last_became_peered":"2024-09-18T01:45:06.295429+0000","last_unstale":"2024-09-18T01:48:12.848762+0000","last_undegraded":"2024-09-18T01:48:12.848762+0000","last_fullsized":"2024-09-18T01:48:12.848762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:48:17.261741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337598+0000","last_change":"2024-09-18T01:45:04.273877+0000","last_active":"2024-09-18T01:45:41.337598+0000","last_peered":"2024-09-18T01:45:41.337598+0000","last_clean":"2024-09-18T01:45:41.337598+0000","last_became_active":"2024-09-18T01:45:04.273328+0000","last_became_peered":"2024-09-18T01:45:04.273328+0000","last_unstale":"2024-09-18T01:45:41.337598+0000","last_undegraded":"2024-09-18T01:45:41.337598+0000","last_fullsized":"2024-09-18T01:45:41.337598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:18:35.916205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'9","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.660161+0000","last_change":"2024-09-18T01:45:06.285251+0000","last_active":"2024-09-18T01:48:12.660161+0000","last_peered":"2024-09-18T01:48:12.660161+0000","last_clean":"2024-09-18T01:48:12.660161+0000","last_became_active":"2024-09-18T01:45:06.284994+0000","last_became_peered":"2024-09-18T01:45:06.284994+0000","last_unstale":"2024-09-18T01:48:12.660161+0000","last_undegraded":"2024-09-18T01:48:12.660161+0000","last_fullsized":"2024-09-18T01:48:12.660161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:37:02.533275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.171347+0000","last_change":"2024-09-18T01:45:06.286775+0000","last_active":"2024-09-18T01:47:12.171347+0000","last_peered":"2024-09-18T01:47:12.171347+0000","last_clean":"2024-09-18T01:47:12.171347+0000","last_became_active":"2024-09-18T01:45:06.286524+0000","last_became_peered":"2024-09-18T01:45:06.286524+0000","last_unstale":"2024-09-18T01:47:12.171347+0000","last_undegraded":"2024-09-18T01:47:12.171347+0000","last_fullsized":"2024-09-18T01:47:12.171347+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:22:27.593735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338138+0000","last_change":"2024-09-18T01:45:04.298742+0000","last_active":"2024-09-18T01:45:41.338138+0000","last_peered":"2024-09-18T01:45:41.338138+0000","last_clean":"2024-09-18T01:45:41.338138+0000","last_became_active":"2024-09-18T01:45:04.298399+0000","last_became_peered":"2024-09-18T01:45:04.298399+0000","last_unstale":"2024-09-18T01:45:41.338138+0000","last_undegraded":"2024-09-18T01:45:41.338138+0000","last_fullsized":"2024-09-18T01:45:41.338138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:56:17.978705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"33'10","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.171009+0000","last_change":"2024-09-18T01:45:06.294964+0000","last_active":"2024-09-18T01:47:12.171009+0000","last_peered":"2024-09-18T01:47:12.171009+0000","last_clean":"2024-09-18T01:47:12.171009+0000","last_became_active":"2024-09-18T01:45:06.294670+0000","last_became_peered":"2024-09-18T01:45:06.294670+0000","last_unstale":"2024-09-18T01:47:12.171009+0000","last_undegraded":"2024-09-18T01:47:12.171009+0000","last_fullsized":"2024-09-18T01:47:12.171009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:12:27.107318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.334046+0000","last_change":"2024-09-18T01:45:04.286914+0000","last_active":"2024-09-18T01:45:41.334046+0000","last_peered":"2024-09-18T01:45:41.334046+0000","last_clean":"2024-09-18T01:45:41.334046+0000","last_became_active":"2024-09-18T01:45:04.286465+0000","last_became_peered":"2024-09-18T01:45:04.286465+0000","last_unstale":"2024-09-18T01:45:41.334046+0000","last_undegraded":"2024-09-18T01:45:41.334046+0000","last_fullsized":"2024-09-18T01:45:41.334046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:18:35.916205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'3","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:27.217076+0000","last_change":"2024-09-18T01:45:06.294374+0000","last_active":"2024-09-18T01:47:27.217076+0000","last_peered":"2024-09-18T01:47:27.217076+0000","last_clean":"2024-09-18T01:47:27.217076+0000","last_became_active":"2024-09-18T01:45:06.294118+0000","last_became_peered":"2024-09-18T01:45:06.294118+0000","last_unstale":"2024-09-18T01:47:27.217076+0000","last_undegraded":"2024-09-18T01:47:27.217076+0000","last_fullsized":"2024-09-18T01:47:27.217076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:55:38.246732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338586+0000","last_change":"2024-09-18T01:45:04.294733+0000","last_active":"2024-09-18T01:45:41.338586+0000","last_peered":"2024-09-18T01:45:41.338586+0000","last_clean":"2024-09-18T01:45:41.338586+0000","last_became_active":"2024-09-18T01:45:04.294327+0000","last_became_peered":"2024-09-18T01:45:04.294327+0000","last_unstale":"2024-09-18T01:45:41.338586+0000","last_undegraded":"2024-09-18T01:45:41.338586+0000","last_fullsized":"2024-09-18T01:45:41.338586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:18:35.916205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'4","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.171117+0000","last_change":"2024-09-18T01:45:06.285844+0000","last_active":"2024-09-18T01:47:12.171117+0000","last_peered":"2024-09-18T01:47:12.171117+0000","last_clean":"2024-09-18T01:47:12.171117+0000","last_became_active":"2024-09-18T01:45:06.285429+0000","last_became_peered":"2024-09-18T01:45:06.285429+0000","last_unstale":"2024-09-18T01:47:12.171117+0000","last_undegraded":"2024-09-18T01:47:12.171117+0000","last_fullsized":"2024-09-18T01:47:12.171117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:33:43.173746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.336963+0000","last_change":"2024-09-18T01:45:04.299057+0000","last_active":"2024-09-18T01:45:41.336963+0000","last_peered":"2024-09-18T01:45:41.336963+0000","last_clean":"2024-09-18T01:45:41.336963+0000","last_became_active":"2024-09-18T01:45:04.298601+0000","last_became_peered":"2024-09-18T01:45:04.298601+0000","last_unstale":"2024-09-18T01:45:41.336963+0000","last_undegraded":"2024-09-18T01:45:41.336963+0000","last_fullsized":"2024-09-18T01:45:41.336963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:31:48.524360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'10","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.558700+0000","last_change":"2024-09-18T01:45:06.286133+0000","last_active":"2024-09-18T01:48:12.558700+0000","last_peered":"2024-09-18T01:48:12.558700+0000","last_clean":"2024-09-18T01:48:12.558700+0000","last_became_active":"2024-09-18T01:45:06.285228+0000","last_became_peered":"2024-09-18T01:45:06.285228+0000","last_unstale":"2024-09-18T01:48:12.558700+0000","last_undegraded":"2024-09-18T01:48:12.558700+0000","last_fullsized":"2024-09-18T01:48:12.558700+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:03:57.671184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:46.110785+0000","last_change":"2024-09-18T01:45:04.281502+0000","last_active":"2024-09-18T01:45:46.110785+0000","last_peered":"2024-09-18T01:45:46.110785+0000","last_clean":"2024-09-18T01:45:46.110785+0000","last_became_active":"2024-09-18T01:45:04.281118+0000","last_became_peered":"2024-09-18T01:45:04.281118+0000","last_unstale":"2024-09-18T01:45:46.110785+0000","last_undegraded":"2024-09-18T01:45:46.110785+0000","last_fullsized":"2024-09-18T01:45:46.110785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:42:11.703254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"33'16","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.793630+0000","last_change":"2024-09-18T01:45:06.284548+0000","last_active":"2024-09-18T01:48:12.793630+0000","last_peered":"2024-09-18T01:48:12.793630+0000","last_clean":"2024-09-18T01:48:12.793630+0000","last_became_active":"2024-09-18T01:45:06.284237+0000","last_became_peered":"2024-09-18T01:45:06.284237+0000","last_unstale":"2024-09-18T01:48:12.793630+0000","last_undegraded":"2024-09-18T01:48:12.793630+0000","last_fullsized":"2024-09-18T01:48:12.793630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:04:56.154083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":48,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338330+0000","last_change":"2024-09-18T01:45:04.285185+0000","last_active":"2024-09-18T01:45:41.338330+0000","last_peered":"2024-09-18T01:45:41.338330+0000","last_clean":"2024-09-18T01:45:41.338330+0000","last_became_active":"2024-09-18T01:45:04.284148+0000","last_became_peered":"2024-09-18T01:45:04.284148+0000","last_unstale":"2024-09-18T01:45:41.338330+0000","last_undegraded":"2024-09-18T01:45:41.338330+0000","last_fullsized":"2024-09-18T01:45:41.338330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:09:41.307844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'35","reported_seq":99,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.821349+0000","last_change":"2024-09-18T01:45:14.323024+0000","last_active":"2024-09-18T01:48:12.821349+0000","last_peered":"2024-09-18T01:48:12.821349+0000","last_clean":"2024-09-18T01:48:12.821349+0000","last_became_active":"2024-09-18T01:45:14.322729+0000","last_became_peered":"2024-09-18T01:45:14.322729+0000","last_unstale":"2024-09-18T01:48:12.821349+0000","last_undegraded":"2024-09-18T01:48:12.821349+0000","last_fullsized":"2024-09-18T01:48:12.821349+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:40:38.654675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'10","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.559925+0000","last_change":"2024-09-18T01:45:06.281639+0000","last_active":"2024-09-18T01:48:12.559925+0000","last_peered":"2024-09-18T01:48:12.559925+0000","last_clean":"2024-09-18T01:48:12.559925+0000","last_became_active":"2024-09-18T01:45:06.281361+0000","last_became_peered":"2024-09-18T01:45:06.281361+0000","last_unstale":"2024-09-18T01:48:12.559925+0000","last_undegraded":"2024-09-18T01:48:12.559925+0000","last_fullsized":"2024-09-18T01:48:12.559925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:48:25.542869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"33'1","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:27.217105+0000","last_change":"2024-09-18T01:45:04.285350+0000","last_active":"2024-09-18T01:47:27.217105+0000","last_peered":"2024-09-18T01:47:27.217105+0000","last_clean":"2024-09-18T01:47:27.217105+0000","last_became_active":"2024-09-18T01:45:04.285008+0000","last_became_peered":"2024-09-18T01:45:04.285008+0000","last_unstale":"2024-09-18T01:47:27.217105+0000","last_undegraded":"2024-09-18T01:47:27.217105+0000","last_fullsized":"2024-09-18T01:47:27.217105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:37:00.525779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.340987+0000","last_change":"2024-09-18T01:45:08.296627+0000","last_active":"2024-09-18T01:45:41.340987+0000","last_peered":"2024-09-18T01:45:41.340987+0000","last_clean":"2024-09-18T01:45:41.340987+0000","last_became_active":"2024-09-18T01:45:08.296241+0000","last_became_peered":"2024-09-18T01:45:08.296241+0000","last_unstale":"2024-09-18T01:45:41.340987+0000","last_undegraded":"2024-09-18T01:45:41.340987+0000","last_fullsized":"2024-09-18T01:45:41.340987+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:01:25.419937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'43","reported_seq":97,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:10.683922+0000","last_change":"2024-09-18T01:45:10.306140+0000","last_active":"2024-09-18T01:47:10.683922+0000","last_peered":"2024-09-18T01:47:10.683922+0000","last_clean":"2024-09-18T01:47:10.683922+0000","last_became_active":"2024-09-18T01:45:10.305713+0000","last_became_peered":"2024-09-18T01:45:10.305713+0000","last_unstale":"2024-09-18T01:47:10.683922+0000","last_undegraded":"2024-09-18T01:47:10.683922+0000","last_fullsized":"2024-09-18T01:47:10.683922+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:42:14.941344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337936+0000","last_change":"2024-09-18T01:45:12.313546+0000","last_active":"2024-09-18T01:45:41.337936+0000","last_peered":"2024-09-18T01:45:41.337936+0000","last_clean":"2024-09-18T01:45:41.337936+0000","last_became_active":"2024-09-18T01:45:12.313276+0000","last_became_peered":"2024-09-18T01:45:12.313276+0000","last_unstale":"2024-09-18T01:45:41.337936+0000","last_undegraded":"2024-09-18T01:45:41.337936+0000","last_fullsized":"2024-09-18T01:45:41.337936+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:22:43.654693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'7","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:46:28.375354+0000","last_change":"2024-09-18T01:45:14.318360+0000","last_active":"2024-09-18T01:46:28.375354+0000","last_peered":"2024-09-18T01:46:28.375354+0000","last_clean":"2024-09-18T01:46:28.375354+0000","last_became_active":"2024-09-18T01:45:14.318093+0000","last_became_peered":"2024-09-18T01:45:14.318093+0000","last_unstale":"2024-09-18T01:46:28.375354+0000","last_undegraded":"2024-09-18T01:46:28.375354+0000","last_fullsized":"2024-09-18T01:46:28.375354+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:28:17.630868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"33'13","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.879659+0000","last_change":"2024-09-18T01:45:41.348633+0000","last_active":"2024-09-18T01:48:12.879659+0000","last_peered":"2024-09-18T01:48:12.879659+0000","last_clean":"2024-09-18T01:48:12.879659+0000","last_became_active":"2024-09-18T01:45:41.338243+0000","last_became_peered":"2024-09-18T01:45:41.338243+0000","last_unstale":"2024-09-18T01:48:12.879659+0000","last_undegraded":"2024-09-18T01:48:12.879659+0000","last_fullsized":"2024-09-18T01:48:12.879659+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:42:23.528238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":13,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:44.958482+0000","last_change":"2024-09-18T01:45:04.293264+0000","last_active":"2024-09-18T01:45:44.958482+0000","last_peered":"2024-09-18T01:45:44.958482+0000","last_clean":"2024-09-18T01:45:44.958482+0000","last_became_active":"2024-09-18T01:45:04.292853+0000","last_became_peered":"2024-09-18T01:45:04.292853+0000","last_unstale":"2024-09-18T01:45:44.958482+0000","last_undegraded":"2024-09-18T01:45:44.958482+0000","last_fullsized":"2024-09-18T01:45:44.958482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:19:39.056474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338261+0000","last_change":"2024-09-18T01:45:08.288697+0000","last_active":"2024-09-18T01:45:41.338261+0000","last_peered":"2024-09-18T01:45:41.338261+0000","last_clean":"2024-09-18T01:45:41.338261+0000","last_became_active":"2024-09-18T01:45:08.288390+0000","last_became_peered":"2024-09-18T01:45:08.288390+0000","last_unstale":"2024-09-18T01:45:41.338261+0000","last_undegraded":"2024-09-18T01:45:41.338261+0000","last_fullsized":"2024-09-18T01:45:41.338261+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:45:19.311056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"31'12","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337413+0000","last_change":"2024-09-18T01:45:10.303251+0000","last_active":"2024-09-18T01:45:41.337413+0000","last_peered":"2024-09-18T01:45:41.337413+0000","last_clean":"2024-09-18T01:45:41.337413+0000","last_became_active":"2024-09-18T01:45:10.302957+0000","last_became_peered":"2024-09-18T01:45:10.302957+0000","last_unstale":"2024-09-18T01:45:41.337413+0000","last_undegraded":"2024-09-18T01:45:41.337413+0000","last_fullsized":"2024-09-18T01:45:41.337413+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:22:48.911652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337811+0000","last_change":"2024-09-18T01:45:12.317743+0000","last_active":"2024-09-18T01:45:41.337811+0000","last_peered":"2024-09-18T01:45:41.337811+0000","last_clean":"2024-09-18T01:45:41.337811+0000","last_became_active":"2024-09-18T01:45:12.317471+0000","last_became_peered":"2024-09-18T01:45:12.317471+0000","last_unstale":"2024-09-18T01:45:41.337811+0000","last_undegraded":"2024-09-18T01:45:41.337811+0000","last_fullsized":"2024-09-18T01:45:41.337811+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:18:50.168373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337317+0000","last_change":"2024-09-18T01:45:14.319762+0000","last_active":"2024-09-18T01:45:41.337317+0000","last_peered":"2024-09-18T01:45:41.337317+0000","last_clean":"2024-09-18T01:45:41.337317+0000","last_became_active":"2024-09-18T01:45:14.319387+0000","last_became_peered":"2024-09-18T01:45:14.319387+0000","last_unstale":"2024-09-18T01:45:41.337317+0000","last_undegraded":"2024-09-18T01:45:41.337317+0000","last_fullsized":"2024-09-18T01:45:41.337317+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:54:12.321781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'10","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.171155+0000","last_change":"2024-09-18T01:45:06.284632+0000","last_active":"2024-09-18T01:47:12.171155+0000","last_peered":"2024-09-18T01:47:12.171155+0000","last_clean":"2024-09-18T01:47:12.171155+0000","last_became_active":"2024-09-18T01:45:06.283815+0000","last_became_peered":"2024-09-18T01:45:06.283815+0000","last_unstale":"2024-09-18T01:47:12.171155+0000","last_undegraded":"2024-09-18T01:47:12.171155+0000","last_fullsized":"2024-09-18T01:47:12.171155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:55:34.371724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.335146+0000","last_change":"2024-09-18T01:45:04.293546+0000","last_active":"2024-09-18T01:45:41.335146+0000","last_peered":"2024-09-18T01:45:41.335146+0000","last_clean":"2024-09-18T01:45:41.335146+0000","last_became_active":"2024-09-18T01:45:04.288040+0000","last_became_peered":"2024-09-18T01:45:04.288040+0000","last_unstale":"2024-09-18T01:45:41.335146+0000","last_undegraded":"2024-09-18T01:45:41.335146+0000","last_fullsized":"2024-09-18T01:45:41.335146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:12:25.099822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.340495+0000","last_change":"2024-09-18T01:45:08.288920+0000","last_active":"2024-09-18T01:45:41.340495+0000","last_peered":"2024-09-18T01:45:41.340495+0000","last_clean":"2024-09-18T01:45:41.340495+0000","last_became_active":"2024-09-18T01:45:08.288667+0000","last_became_peered":"2024-09-18T01:45:08.288667+0000","last_unstale":"2024-09-18T01:45:41.340495+0000","last_undegraded":"2024-09-18T01:45:41.340495+0000","last_fullsized":"2024-09-18T01:45:41.340495+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:58:00.539983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"31'23","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.333260+0000","last_change":"2024-09-18T01:45:10.304260+0000","last_active":"2024-09-18T01:45:41.333260+0000","last_peered":"2024-09-18T01:45:41.333260+0000","last_clean":"2024-09-18T01:45:41.333260+0000","last_became_active":"2024-09-18T01:45:10.304004+0000","last_became_peered":"2024-09-18T01:45:10.304004+0000","last_unstale":"2024-09-18T01:45:41.333260+0000","last_undegraded":"2024-09-18T01:45:41.333260+0000","last_fullsized":"2024-09-18T01:45:41.333260+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:39:04.390442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'282","reported_seq":384,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.988981+0000","last_change":"2024-09-18T01:45:12.317560+0000","last_active":"2024-09-18T01:48:12.988981+0000","last_peered":"2024-09-18T01:48:12.988981+0000","last_clean":"2024-09-18T01:48:12.988981+0000","last_became_active":"2024-09-18T01:45:12.317288+0000","last_became_peered":"2024-09-18T01:45:12.317288+0000","last_unstale":"2024-09-18T01:48:12.988981+0000","last_undegraded":"2024-09-18T01:48:12.988981+0000","last_fullsized":"2024-09-18T01:48:12.988981+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:48:33.500493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.331675+0000","last_change":"2024-09-18T01:45:14.326621+0000","last_active":"2024-09-18T01:45:41.331675+0000","last_peered":"2024-09-18T01:45:41.331675+0000","last_clean":"2024-09-18T01:45:41.331675+0000","last_became_active":"2024-09-18T01:45:14.325843+0000","last_became_peered":"2024-09-18T01:45:14.325843+0000","last_unstale":"2024-09-18T01:45:41.331675+0000","last_undegraded":"2024-09-18T01:45:41.331675+0000","last_fullsized":"2024-09-18T01:45:41.331675+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:49:37.077451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.340482+0000","last_change":"2024-09-18T01:45:06.295671+0000","last_active":"2024-09-18T01:45:41.340482+0000","last_peered":"2024-09-18T01:45:41.340482+0000","last_clean":"2024-09-18T01:45:41.340482+0000","last_became_active":"2024-09-18T01:45:06.295417+0000","last_became_peered":"2024-09-18T01:45:06.295417+0000","last_unstale":"2024-09-18T01:45:41.340482+0000","last_undegraded":"2024-09-18T01:45:41.340482+0000","last_fullsized":"2024-09-18T01:45:41.340482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:20:03.455685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:46.101670+0000","last_change":"2024-09-18T01:45:04.282935+0000","last_active":"2024-09-18T01:45:46.101670+0000","last_peered":"2024-09-18T01:45:46.101670+0000","last_clean":"2024-09-18T01:45:46.101670+0000","last_became_active":"2024-09-18T01:45:04.282500+0000","last_became_peered":"2024-09-18T01:45:04.282500+0000","last_unstale":"2024-09-18T01:45:46.101670+0000","last_undegraded":"2024-09-18T01:45:46.101670+0000","last_fullsized":"2024-09-18T01:45:46.101670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:59:04.808153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338959+0000","last_change":"2024-09-18T01:45:08.296538+0000","last_active":"2024-09-18T01:45:41.338959+0000","last_peered":"2024-09-18T01:45:41.338959+0000","last_clean":"2024-09-18T01:45:41.338959+0000","last_became_active":"2024-09-18T01:45:08.296192+0000","last_became_peered":"2024-09-18T01:45:08.296192+0000","last_unstale":"2024-09-18T01:45:41.338959+0000","last_undegraded":"2024-09-18T01:45:41.338959+0000","last_fullsized":"2024-09-18T01:45:41.338959+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:28:48.199978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'36","reported_seq":84,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:10.678613+0000","last_change":"2024-09-18T01:45:10.305819+0000","last_active":"2024-09-18T01:47:10.678613+0000","last_peered":"2024-09-18T01:47:10.678613+0000","last_clean":"2024-09-18T01:47:10.678613+0000","last_became_active":"2024-09-18T01:45:10.305515+0000","last_became_peered":"2024-09-18T01:45:10.305515+0000","last_unstale":"2024-09-18T01:47:10.678613+0000","last_undegraded":"2024-09-18T01:47:10.678613+0000","last_fullsized":"2024-09-18T01:47:10.678613+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:54:15.247041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'282","reported_seq":400,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.874424+0000","last_change":"2024-09-18T01:45:12.313547+0000","last_active":"2024-09-18T01:48:12.874424+0000","last_peered":"2024-09-18T01:48:12.874424+0000","last_clean":"2024-09-18T01:48:12.874424+0000","last_became_active":"2024-09-18T01:45:12.313219+0000","last_became_peered":"2024-09-18T01:45:12.313219+0000","last_unstale":"2024-09-18T01:48:12.874424+0000","last_undegraded":"2024-09-18T01:48:12.874424+0000","last_fullsized":"2024-09-18T01:48:12.874424+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:18:26.966437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.334693+0000","last_change":"2024-09-18T01:45:06.297804+0000","last_active":"2024-09-18T01:45:41.334693+0000","last_peered":"2024-09-18T01:45:41.334693+0000","last_clean":"2024-09-18T01:45:41.334693+0000","last_became_active":"2024-09-18T01:45:06.297283+0000","last_became_peered":"2024-09-18T01:45:06.297283+0000","last_unstale":"2024-09-18T01:45:41.334693+0000","last_undegraded":"2024-09-18T01:45:41.334693+0000","last_fullsized":"2024-09-18T01:45:41.334693+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:34:09.651529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.333900+0000","last_change":"2024-09-18T01:45:04.289955+0000","last_active":"2024-09-18T01:45:41.333900+0000","last_peered":"2024-09-18T01:45:41.333900+0000","last_clean":"2024-09-18T01:45:41.333900+0000","last_became_active":"2024-09-18T01:45:04.289629+0000","last_became_peered":"2024-09-18T01:45:04.289629+0000","last_unstale":"2024-09-18T01:45:41.333900+0000","last_undegraded":"2024-09-18T01:45:41.333900+0000","last_fullsized":"2024-09-18T01:45:41.333900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:43:03.344288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.333438+0000","last_change":"2024-09-18T01:45:08.294834+0000","last_active":"2024-09-18T01:45:41.333438+0000","last_peered":"2024-09-18T01:45:41.333438+0000","last_clean":"2024-09-18T01:45:41.333438+0000","last_became_active":"2024-09-18T01:45:08.294273+0000","last_became_peered":"2024-09-18T01:45:08.294273+0000","last_unstale":"2024-09-18T01:45:41.333438+0000","last_undegraded":"2024-09-18T01:45:41.333438+0000","last_fullsized":"2024-09-18T01:45:41.333438+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:54:13.237972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'46","reported_seq":99,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:10.687815+0000","last_change":"2024-09-18T01:45:10.298381+0000","last_active":"2024-09-18T01:47:10.687815+0000","last_peered":"2024-09-18T01:47:10.687815+0000","last_clean":"2024-09-18T01:47:10.687815+0000","last_became_active":"2024-09-18T01:45:10.298021+0000","last_became_peered":"2024-09-18T01:45:10.298021+0000","last_unstale":"2024-09-18T01:47:10.687815+0000","last_undegraded":"2024-09-18T01:47:10.687815+0000","last_fullsized":"2024-09-18T01:47:10.687815+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:39:10.135582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338655+0000","last_change":"2024-09-18T01:45:12.314207+0000","last_active":"2024-09-18T01:45:41.338655+0000","last_peered":"2024-09-18T01:45:41.338655+0000","last_clean":"2024-09-18T01:45:41.338655+0000","last_became_active":"2024-09-18T01:45:12.313875+0000","last_became_peered":"2024-09-18T01:45:12.313875+0000","last_unstale":"2024-09-18T01:45:41.338655+0000","last_undegraded":"2024-09-18T01:45:41.338655+0000","last_fullsized":"2024-09-18T01:45:41.338655+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:42:29.558204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'7","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:46:28.376975+0000","last_change":"2024-09-18T01:45:14.322757+0000","last_active":"2024-09-18T01:46:28.376975+0000","last_peered":"2024-09-18T01:46:28.376975+0000","last_clean":"2024-09-18T01:46:28.376975+0000","last_became_active":"2024-09-18T01:45:14.322448+0000","last_became_peered":"2024-09-18T01:45:14.322448+0000","last_unstale":"2024-09-18T01:46:28.376975+0000","last_undegraded":"2024-09-18T01:46:28.376975+0000","last_fullsized":"2024-09-18T01:46:28.376975+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:13:39.692712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":17,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'8","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.649737+0000","last_change":"2024-09-18T01:45:06.292485+0000","last_active":"2024-09-18T01:48:12.649737+0000","last_peered":"2024-09-18T01:48:12.649737+0000","last_clean":"2024-09-18T01:48:12.649737+0000","last_became_active":"2024-09-18T01:45:06.292143+0000","last_became_peered":"2024-09-18T01:45:06.292143+0000","last_unstale":"2024-09-18T01:48:12.649737+0000","last_undegraded":"2024-09-18T01:48:12.649737+0000","last_fullsized":"2024-09-18T01:48:12.649737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:45:59.773285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.333555+0000","last_change":"2024-09-18T01:45:04.293049+0000","last_active":"2024-09-18T01:45:41.333555+0000","last_peered":"2024-09-18T01:45:41.333555+0000","last_clean":"2024-09-18T01:45:41.333555+0000","last_became_active":"2024-09-18T01:45:04.292734+0000","last_became_peered":"2024-09-18T01:45:04.292734+0000","last_unstale":"2024-09-18T01:45:41.333555+0000","last_undegraded":"2024-09-18T01:45:41.333555+0000","last_fullsized":"2024-09-18T01:45:41.333555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:42:11.703254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337869+0000","last_change":"2024-09-18T01:45:08.294254+0000","last_active":"2024-09-18T01:45:41.337869+0000","last_peered":"2024-09-18T01:45:41.337869+0000","last_clean":"2024-09-18T01:45:41.337869+0000","last_became_active":"2024-09-18T01:45:08.294026+0000","last_became_peered":"2024-09-18T01:45:08.294026+0000","last_unstale":"2024-09-18T01:45:41.337869+0000","last_undegraded":"2024-09-18T01:45:41.337869+0000","last_fullsized":"2024-09-18T01:45:41.337869+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:41:44.964492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'36","reported_seq":84,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:10.668222+0000","last_change":"2024-09-18T01:45:10.308697+0000","last_active":"2024-09-18T01:47:10.668222+0000","last_peered":"2024-09-18T01:47:10.668222+0000","last_clean":"2024-09-18T01:47:10.668222+0000","last_became_active":"2024-09-18T01:45:10.307420+0000","last_became_peered":"2024-09-18T01:45:10.307420+0000","last_unstale":"2024-09-18T01:47:10.668222+0000","last_undegraded":"2024-09-18T01:47:10.668222+0000","last_fullsized":"2024-09-18T01:47:10.668222+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:50:42.386927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337545+0000","last_change":"2024-09-18T01:45:12.306113+0000","last_active":"2024-09-18T01:45:41.337545+0000","last_peered":"2024-09-18T01:45:41.337545+0000","last_clean":"2024-09-18T01:45:41.337545+0000","last_became_active":"2024-09-18T01:45:12.305838+0000","last_became_peered":"2024-09-18T01:45:12.305838+0000","last_unstale":"2024-09-18T01:45:41.337545+0000","last_undegraded":"2024-09-18T01:45:41.337545+0000","last_fullsized":"2024-09-18T01:45:41.337545+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:18:50.168373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'3","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:46:22.809927+0000","last_change":"2024-09-18T01:45:14.322540+0000","last_active":"2024-09-18T01:46:22.809927+0000","last_peered":"2024-09-18T01:46:22.809927+0000","last_clean":"2024-09-18T01:46:22.809927+0000","last_became_active":"2024-09-18T01:45:14.322272+0000","last_became_peered":"2024-09-18T01:45:14.322272+0000","last_unstale":"2024-09-18T01:46:22.809927+0000","last_undegraded":"2024-09-18T01:46:22.809927+0000","last_fullsized":"2024-09-18T01:46:22.809927+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:16:32.686304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"33'8","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.561148+0000","last_change":"2024-09-18T01:45:06.284946+0000","last_active":"2024-09-18T01:48:12.561148+0000","last_peered":"2024-09-18T01:48:12.561148+0000","last_clean":"2024-09-18T01:48:12.561148+0000","last_became_active":"2024-09-18T01:45:06.284677+0000","last_became_peered":"2024-09-18T01:45:06.284677+0000","last_unstale":"2024-09-18T01:48:12.561148+0000","last_undegraded":"2024-09-18T01:48:12.561148+0000","last_fullsized":"2024-09-18T01:48:12.561148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:38:48.328050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.341273+0000","last_change":"2024-09-18T01:45:04.287402+0000","last_active":"2024-09-18T01:45:41.341273+0000","last_peered":"2024-09-18T01:45:41.341273+0000","last_clean":"2024-09-18T01:45:41.341273+0000","last_became_active":"2024-09-18T01:45:04.284151+0000","last_became_peered":"2024-09-18T01:45:04.284151+0000","last_unstale":"2024-09-18T01:45:41.341273+0000","last_undegraded":"2024-09-18T01:45:41.341273+0000","last_fullsized":"2024-09-18T01:45:41.341273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:38:31.469925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.340511+0000","last_change":"2024-09-18T01:45:08.289806+0000","last_active":"2024-09-18T01:45:41.340511+0000","last_peered":"2024-09-18T01:45:41.340511+0000","last_clean":"2024-09-18T01:45:41.340511+0000","last_became_active":"2024-09-18T01:45:08.289521+0000","last_became_peered":"2024-09-18T01:45:08.289521+0000","last_unstale":"2024-09-18T01:45:41.340511+0000","last_undegraded":"2024-09-18T01:45:41.340511+0000","last_fullsized":"2024-09-18T01:45:41.340511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:54:13.237972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'49","reported_seq":106,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.175815+0000","last_change":"2024-09-18T01:45:10.307198+0000","last_active":"2024-09-18T01:47:12.175815+0000","last_peered":"2024-09-18T01:47:12.175815+0000","last_clean":"2024-09-18T01:47:12.175815+0000","last_became_active":"2024-09-18T01:45:10.306481+0000","last_became_peered":"2024-09-18T01:45:10.306481+0000","last_unstale":"2024-09-18T01:47:12.175815+0000","last_undegraded":"2024-09-18T01:47:12.175815+0000","last_fullsized":"2024-09-18T01:47:12.175815+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:26:59.982744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'282","reported_seq":347,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.998004+0000","last_change":"2024-09-18T01:45:12.313366+0000","last_active":"2024-09-18T01:48:12.998004+0000","last_peered":"2024-09-18T01:48:12.998004+0000","last_clean":"2024-09-18T01:48:12.998004+0000","last_became_active":"2024-09-18T01:45:12.313065+0000","last_became_peered":"2024-09-18T01:45:12.313065+0000","last_unstale":"2024-09-18T01:48:12.998004+0000","last_undegraded":"2024-09-18T01:48:12.998004+0000","last_fullsized":"2024-09-18T01:48:12.998004+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:22:43.654693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"33'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:09.007672+0000","last_change":"2024-09-18T01:45:14.320158+0000","last_active":"2024-09-18T01:47:09.007672+0000","last_peered":"2024-09-18T01:47:09.007672+0000","last_clean":"2024-09-18T01:47:09.007672+0000","last_became_active":"2024-09-18T01:45:14.319805+0000","last_became_peered":"2024-09-18T01:45:14.319805+0000","last_unstale":"2024-09-18T01:47:09.007672+0000","last_undegraded":"2024-09-18T01:47:09.007672+0000","last_fullsized":"2024-09-18T01:47:09.007672+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:14:33.982138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"33'10","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.846365+0000","last_change":"2024-09-18T01:45:06.282059+0000","last_active":"2024-09-18T01:48:12.846365+0000","last_peered":"2024-09-18T01:48:12.846365+0000","last_clean":"2024-09-18T01:48:12.846365+0000","last_became_active":"2024-09-18T01:45:06.281444+0000","last_became_peered":"2024-09-18T01:45:06.281444+0000","last_unstale":"2024-09-18T01:48:12.846365+0000","last_undegraded":"2024-09-18T01:48:12.846365+0000","last_fullsized":"2024-09-18T01:48:12.846365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:33:43.173746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.336364+0000","last_change":"2024-09-18T01:45:04.289841+0000","last_active":"2024-09-18T01:45:41.336364+0000","last_peered":"2024-09-18T01:45:41.336364+0000","last_clean":"2024-09-18T01:45:41.336364+0000","last_became_active":"2024-09-18T01:45:04.289216+0000","last_became_peered":"2024-09-18T01:45:04.289216+0000","last_unstale":"2024-09-18T01:45:41.336364+0000","last_undegraded":"2024-09-18T01:45:41.336364+0000","last_fullsized":"2024-09-18T01:45:41.336364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:06:46.722311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338235+0000","last_change":"2024-09-18T01:45:08.289975+0000","last_active":"2024-09-18T01:45:41.338235+0000","last_peered":"2024-09-18T01:45:41.338235+0000","last_clean":"2024-09-18T01:45:41.338235+0000","last_became_active":"2024-09-18T01:45:08.289725+0000","last_became_peered":"2024-09-18T01:45:08.289725+0000","last_unstale":"2024-09-18T01:45:41.338235+0000","last_undegraded":"2024-09-18T01:45:41.338235+0000","last_fullsized":"2024-09-18T01:45:41.338235+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:52:13.262244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"33'72","reported_seq":140,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:22.215996+0000","last_change":"2024-09-18T01:45:10.310077+0000","last_active":"2024-09-18T01:47:22.215996+0000","last_peered":"2024-09-18T01:47:22.215996+0000","last_clean":"2024-09-18T01:47:22.215996+0000","last_became_active":"2024-09-18T01:45:10.309360+0000","last_became_peered":"2024-09-18T01:45:10.309360+0000","last_unstale":"2024-09-18T01:47:22.215996+0000","last_undegraded":"2024-09-18T01:47:22.215996+0000","last_fullsized":"2024-09-18T01:47:22.215996+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:01:23.922671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7613,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":75,"num_read_kb":82,"num_write":36,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337356+0000","last_change":"2024-09-18T01:45:12.312912+0000","last_active":"2024-09-18T01:45:41.337356+0000","last_peered":"2024-09-18T01:45:41.337356+0000","last_clean":"2024-09-18T01:45:41.337356+0000","last_became_active":"2024-09-18T01:45:12.312665+0000","last_became_peered":"2024-09-18T01:45:12.312665+0000","last_unstale":"2024-09-18T01:45:41.337356+0000","last_undegraded":"2024-09-18T01:45:41.337356+0000","last_fullsized":"2024-09-18T01:45:41.337356+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:43:30.182833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'18","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.975756+0000","last_change":"2024-09-18T01:45:14.320179+0000","last_active":"2024-09-18T01:48:12.975756+0000","last_peered":"2024-09-18T01:48:12.975756+0000","last_clean":"2024-09-18T01:48:12.975756+0000","last_became_active":"2024-09-18T01:45:14.319638+0000","last_became_peered":"2024-09-18T01:45:14.319638+0000","last_unstale":"2024-09-18T01:48:12.975756+0000","last_undegraded":"2024-09-18T01:48:12.975756+0000","last_fullsized":"2024-09-18T01:48:12.975756+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:22:20.011207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:46:28.552953+0000","last_change":"2024-09-18T01:45:06.290368+0000","last_active":"2024-09-18T01:46:28.552953+0000","last_peered":"2024-09-18T01:46:28.552953+0000","last_clean":"2024-09-18T01:46:28.552953+0000","last_became_active":"2024-09-18T01:45:06.290087+0000","last_became_peered":"2024-09-18T01:45:06.290087+0000","last_unstale":"2024-09-18T01:46:28.552953+0000","last_undegraded":"2024-09-18T01:46:28.552953+0000","last_fullsized":"2024-09-18T01:46:28.552953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:25:24.068245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338514+0000","last_change":"2024-09-18T01:45:04.279319+0000","last_active":"2024-09-18T01:45:41.338514+0000","last_peered":"2024-09-18T01:45:41.338514+0000","last_clean":"2024-09-18T01:45:41.338514+0000","last_became_active":"2024-09-18T01:45:04.278979+0000","last_became_peered":"2024-09-18T01:45:04.278979+0000","last_unstale":"2024-09-18T01:45:41.338514+0000","last_undegraded":"2024-09-18T01:45:41.338514+0000","last_fullsized":"2024-09-18T01:45:41.338514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:21:29.013936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.334526+0000","last_change":"2024-09-18T01:45:08.292446+0000","last_active":"2024-09-18T01:45:41.334526+0000","last_peered":"2024-09-18T01:45:41.334526+0000","last_clean":"2024-09-18T01:45:41.334526+0000","last_became_active":"2024-09-18T01:45:08.292156+0000","last_became_peered":"2024-09-18T01:45:08.292156+0000","last_unstale":"2024-09-18T01:45:41.334526+0000","last_undegraded":"2024-09-18T01:45:41.334526+0000","last_fullsized":"2024-09-18T01:45:41.334526+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:03:59.192175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'38","reported_seq":87,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:10.672505+0000","last_change":"2024-09-18T01:45:10.300769+0000","last_active":"2024-09-18T01:47:10.672505+0000","last_peered":"2024-09-18T01:47:10.672505+0000","last_clean":"2024-09-18T01:47:10.672505+0000","last_became_active":"2024-09-18T01:45:10.300488+0000","last_became_peered":"2024-09-18T01:45:10.300488+0000","last_unstale":"2024-09-18T01:47:10.672505+0000","last_undegraded":"2024-09-18T01:47:10.672505+0000","last_fullsized":"2024-09-18T01:47:10.672505+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:55:38.390166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338499+0000","last_change":"2024-09-18T01:45:12.315977+0000","last_active":"2024-09-18T01:45:41.338499+0000","last_peered":"2024-09-18T01:45:41.338499+0000","last_clean":"2024-09-18T01:45:41.338499+0000","last_became_active":"2024-09-18T01:45:12.315695+0000","last_became_peered":"2024-09-18T01:45:12.315695+0000","last_unstale":"2024-09-18T01:45:41.338499+0000","last_undegraded":"2024-09-18T01:45:41.338499+0000","last_fullsized":"2024-09-18T01:45:41.338499+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:50:11.915634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"33'3","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:17.215042+0000","last_change":"2024-09-18T01:45:14.326486+0000","last_active":"2024-09-18T01:47:17.215042+0000","last_peered":"2024-09-18T01:47:17.215042+0000","last_clean":"2024-09-18T01:47:17.215042+0000","last_became_active":"2024-09-18T01:45:14.326209+0000","last_became_peered":"2024-09-18T01:45:14.326209+0000","last_unstale":"2024-09-18T01:47:17.215042+0000","last_undegraded":"2024-09-18T01:47:17.215042+0000","last_fullsized":"2024-09-18T01:47:17.215042+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:34:51.151050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.650286+0000","last_change":"2024-09-18T01:45:06.287753+0000","last_active":"2024-09-18T01:48:12.650286+0000","last_peered":"2024-09-18T01:48:12.650286+0000","last_clean":"2024-09-18T01:48:12.650286+0000","last_became_active":"2024-09-18T01:45:06.285771+0000","last_became_peered":"2024-09-18T01:45:06.285771+0000","last_unstale":"2024-09-18T01:48:12.650286+0000","last_undegraded":"2024-09-18T01:48:12.650286+0000","last_fullsized":"2024-09-18T01:48:12.650286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:17:37.283863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.488957+0000","last_change":"2024-09-18T01:45:04.287560+0000","last_active":"2024-09-18T01:48:12.488957+0000","last_peered":"2024-09-18T01:48:12.488957+0000","last_clean":"2024-09-18T01:48:12.488957+0000","last_became_active":"2024-09-18T01:45:04.287263+0000","last_became_peered":"2024-09-18T01:45:04.287263+0000","last_unstale":"2024-09-18T01:48:12.488957+0000","last_undegraded":"2024-09-18T01:48:12.488957+0000","last_fullsized":"2024-09-18T01:48:12.488957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:31:33.162869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4834176,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338326+0000","last_change":"2024-09-18T01:45:08.289876+0000","last_active":"2024-09-18T01:45:41.338326+0000","last_peered":"2024-09-18T01:45:41.338326+0000","last_clean":"2024-09-18T01:45:41.338326+0000","last_became_active":"2024-09-18T01:45:08.289604+0000","last_became_peered":"2024-09-18T01:45:08.289604+0000","last_unstale":"2024-09-18T01:45:41.338326+0000","last_undegraded":"2024-09-18T01:45:41.338326+0000","last_fullsized":"2024-09-18T01:45:41.338326+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:31:10.969818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'37","reported_seq":82,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:10.698206+0000","last_change":"2024-09-18T01:45:10.297783+0000","last_active":"2024-09-18T01:47:10.698206+0000","last_peered":"2024-09-18T01:47:10.698206+0000","last_clean":"2024-09-18T01:47:10.698206+0000","last_became_active":"2024-09-18T01:45:10.297511+0000","last_became_peered":"2024-09-18T01:45:10.297511+0000","last_unstale":"2024-09-18T01:47:10.698206+0000","last_undegraded":"2024-09-18T01:47:10.698206+0000","last_fullsized":"2024-09-18T01:47:10.698206+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:31:01.665963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'282","reported_seq":402,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.980142+0000","last_change":"2024-09-18T01:45:12.315306+0000","last_active":"2024-09-18T01:48:12.980142+0000","last_peered":"2024-09-18T01:48:12.980142+0000","last_clean":"2024-09-18T01:48:12.980142+0000","last_became_active":"2024-09-18T01:45:12.314918+0000","last_became_peered":"2024-09-18T01:45:12.314918+0000","last_unstale":"2024-09-18T01:48:12.980142+0000","last_undegraded":"2024-09-18T01:48:12.980142+0000","last_fullsized":"2024-09-18T01:48:12.980142+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:48:31.572835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'12","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:22.214176+0000","last_change":"2024-09-18T01:45:14.319866+0000","last_active":"2024-09-18T01:47:22.214176+0000","last_peered":"2024-09-18T01:47:22.214176+0000","last_clean":"2024-09-18T01:47:22.214176+0000","last_became_active":"2024-09-18T01:45:14.319364+0000","last_became_peered":"2024-09-18T01:45:14.319364+0000","last_unstale":"2024-09-18T01:47:22.214176+0000","last_undegraded":"2024-09-18T01:47:22.214176+0000","last_fullsized":"2024-09-18T01:47:22.214176+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:15:20.848541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.171328+0000","last_change":"2024-09-18T01:45:06.291329+0000","last_active":"2024-09-18T01:47:12.171328+0000","last_peered":"2024-09-18T01:47:12.171328+0000","last_clean":"2024-09-18T01:47:12.171328+0000","last_became_active":"2024-09-18T01:45:06.291023+0000","last_became_peered":"2024-09-18T01:45:06.291023+0000","last_unstale":"2024-09-18T01:47:12.171328+0000","last_undegraded":"2024-09-18T01:47:12.171328+0000","last_fullsized":"2024-09-18T01:47:12.171328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:45:59.773285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:08.999758+0000","last_change":"2024-09-18T01:45:04.294066+0000","last_active":"2024-09-18T01:47:08.999758+0000","last_peered":"2024-09-18T01:47:08.999758+0000","last_clean":"2024-09-18T01:47:08.999758+0000","last_became_active":"2024-09-18T01:45:04.288386+0000","last_became_peered":"2024-09-18T01:45:04.288386+0000","last_unstale":"2024-09-18T01:47:08.999758+0000","last_undegraded":"2024-09-18T01:47:08.999758+0000","last_fullsized":"2024-09-18T01:47:08.999758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:48:15.254246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'3","reported_seq":413,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:11.793360+0000","last_change":"2024-09-18T01:45:08.290260+0000","last_active":"2024-09-18T01:47:11.793360+0000","last_peered":"2024-09-18T01:47:11.793360+0000","last_clean":"2024-09-18T01:47:11.793360+0000","last_became_active":"2024-09-18T01:45:08.289478+0000","last_became_peered":"2024-09-18T01:45:08.289478+0000","last_unstale":"2024-09-18T01:47:11.793360+0000","last_undegraded":"2024-09-18T01:47:11.793360+0000","last_fullsized":"2024-09-18T01:47:11.793360+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:51:28.759649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'11","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:27.217179+0000","last_change":"2024-09-18T01:45:10.307653+0000","last_active":"2024-09-18T01:47:27.217179+0000","last_peered":"2024-09-18T01:47:27.217179+0000","last_clean":"2024-09-18T01:47:27.217179+0000","last_became_active":"2024-09-18T01:45:10.307374+0000","last_became_peered":"2024-09-18T01:45:10.307374+0000","last_unstale":"2024-09-18T01:47:27.217179+0000","last_undegraded":"2024-09-18T01:47:27.217179+0000","last_fullsized":"2024-09-18T01:47:27.217179+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:33:37.464748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'282","reported_seq":464,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.939532+0000","last_change":"2024-09-18T01:45:12.312200+0000","last_active":"2024-09-18T01:48:12.939532+0000","last_peered":"2024-09-18T01:48:12.939532+0000","last_clean":"2024-09-18T01:48:12.939532+0000","last_became_active":"2024-09-18T01:45:12.311929+0000","last_became_peered":"2024-09-18T01:45:12.311929+0000","last_unstale":"2024-09-18T01:48:12.939532+0000","last_undegraded":"2024-09-18T01:48:12.939532+0000","last_fullsized":"2024-09-18T01:48:12.939532+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:13:37.683828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"33'6","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.168494+0000","last_change":"2024-09-18T01:45:14.318697+0000","last_active":"2024-09-18T01:47:12.168494+0000","last_peered":"2024-09-18T01:47:12.168494+0000","last_clean":"2024-09-18T01:47:12.168494+0000","last_became_active":"2024-09-18T01:45:14.318418+0000","last_became_peered":"2024-09-18T01:45:14.318418+0000","last_unstale":"2024-09-18T01:47:12.168494+0000","last_undegraded":"2024-09-18T01:47:12.168494+0000","last_fullsized":"2024-09-18T01:47:12.168494+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:24:51.317832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"31'4","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.339105+0000","last_change":"2024-09-18T01:45:06.297190+0000","last_active":"2024-09-18T01:45:41.339105+0000","last_peered":"2024-09-18T01:45:41.339105+0000","last_clean":"2024-09-18T01:45:41.339105+0000","last_became_active":"2024-09-18T01:45:06.296824+0000","last_became_peered":"2024-09-18T01:45:06.296824+0000","last_unstale":"2024-09-18T01:45:41.339105+0000","last_undegraded":"2024-09-18T01:45:41.339105+0000","last_fullsized":"2024-09-18T01:45:41.339105+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:26:58.808939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"33'3","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.784627+0000","last_change":"2024-09-18T01:45:04.288364+0000","last_active":"2024-09-18T01:48:12.784627+0000","last_peered":"2024-09-18T01:48:12.784627+0000","last_clean":"2024-09-18T01:48:12.784627+0000","last_became_active":"2024-09-18T01:45:04.287961+0000","last_became_peered":"2024-09-18T01:45:04.287961+0000","last_unstale":"2024-09-18T01:48:12.784627+0000","last_undegraded":"2024-09-18T01:48:12.784627+0000","last_fullsized":"2024-09-18T01:48:12.784627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:15:46.315415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338600+0000","last_change":"2024-09-18T01:45:08.294326+0000","last_active":"2024-09-18T01:45:41.338600+0000","last_peered":"2024-09-18T01:45:41.338600+0000","last_clean":"2024-09-18T01:45:41.338600+0000","last_became_active":"2024-09-18T01:45:08.294053+0000","last_became_peered":"2024-09-18T01:45:08.294053+0000","last_unstale":"2024-09-18T01:45:41.338600+0000","last_undegraded":"2024-09-18T01:45:41.338600+0000","last_fullsized":"2024-09-18T01:45:41.338600+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:42:25.537610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'39","reported_seq":85,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:10.684950+0000","last_change":"2024-09-18T01:45:10.300689+0000","last_active":"2024-09-18T01:47:10.684950+0000","last_peered":"2024-09-18T01:47:10.684950+0000","last_clean":"2024-09-18T01:47:10.684950+0000","last_became_active":"2024-09-18T01:45:10.300337+0000","last_became_peered":"2024-09-18T01:45:10.300337+0000","last_unstale":"2024-09-18T01:47:10.684950+0000","last_undegraded":"2024-09-18T01:47:10.684950+0000","last_fullsized":"2024-09-18T01:47:10.684950+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:15:11.668593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.332973+0000","last_change":"2024-09-18T01:45:12.307499+0000","last_active":"2024-09-18T01:45:41.332973+0000","last_peered":"2024-09-18T01:45:41.332973+0000","last_clean":"2024-09-18T01:45:41.332973+0000","last_became_active":"2024-09-18T01:45:12.307210+0000","last_became_peered":"2024-09-18T01:45:12.307210+0000","last_unstale":"2024-09-18T01:45:41.332973+0000","last_undegraded":"2024-09-18T01:45:41.332973+0000","last_fullsized":"2024-09-18T01:45:41.332973+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:15:13.680117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'6","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.909454+0000","last_change":"2024-09-18T01:45:14.315742+0000","last_active":"2024-09-18T01:48:12.909454+0000","last_peered":"2024-09-18T01:48:12.909454+0000","last_clean":"2024-09-18T01:48:12.909454+0000","last_became_active":"2024-09-18T01:45:14.314786+0000","last_became_peered":"2024-09-18T01:45:14.314786+0000","last_unstale":"2024-09-18T01:48:12.909454+0000","last_undegraded":"2024-09-18T01:48:12.909454+0000","last_fullsized":"2024-09-18T01:48:12.909454+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:32:55.619756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.559013+0000","last_change":"2024-09-18T01:45:06.287377+0000","last_active":"2024-09-18T01:48:12.559013+0000","last_peered":"2024-09-18T01:48:12.559013+0000","last_clean":"2024-09-18T01:48:12.559013+0000","last_became_active":"2024-09-18T01:45:06.286138+0000","last_became_peered":"2024-09-18T01:45:06.286138+0000","last_unstale":"2024-09-18T01:48:12.559013+0000","last_undegraded":"2024-09-18T01:48:12.559013+0000","last_fullsized":"2024-09-18T01:48:12.559013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:40:06.654394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":205,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.332689+0000","last_change":"2024-09-18T01:44:49.573399+0000","last_active":"2024-09-18T01:45:41.332689+0000","last_peered":"2024-09-18T01:45:41.332689+0000","last_clean":"2024-09-18T01:45:41.332689+0000","last_became_active":"2024-09-18T01:44:49.572263+0000","last_became_peered":"2024-09-18T01:44:49.572263+0000","last_unstale":"2024-09-18T01:45:41.332689+0000","last_undegraded":"2024-09-18T01:45:41.332689+0000","last_fullsized":"2024-09-18T01:45:41.332689+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:48.210722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:48.210722+0000","last_clean_scrub_stamp":"2024-09-18T01:44:48.210722+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:56:09.389853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.336772+0000","last_change":"2024-09-18T01:44:55.241426+0000","last_active":"2024-09-18T01:45:41.336772+0000","last_peered":"2024-09-18T01:45:41.336772+0000","last_clean":"2024-09-18T01:45:41.336772+0000","last_became_active":"2024-09-18T01:44:53.233974+0000","last_became_peered":"2024-09-18T01:44:53.233974+0000","last_unstale":"2024-09-18T01:45:41.336772+0000","last_undegraded":"2024-09-18T01:45:41.336772+0000","last_fullsized":"2024-09-18T01:45:41.336772+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:12:59.234293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045237700000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:44.957536+0000","last_change":"2024-09-18T01:45:04.289472+0000","last_active":"2024-09-18T01:45:44.957536+0000","last_peered":"2024-09-18T01:45:44.957536+0000","last_clean":"2024-09-18T01:45:44.957536+0000","last_became_active":"2024-09-18T01:45:04.287763+0000","last_became_peered":"2024-09-18T01:45:04.287763+0000","last_unstale":"2024-09-18T01:45:44.957536+0000","last_undegraded":"2024-09-18T01:45:44.957536+0000","last_fullsized":"2024-09-18T01:45:44.957536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:36:04.953932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.336778+0000","last_change":"2024-09-18T01:45:08.288736+0000","last_active":"2024-09-18T01:45:41.336778+0000","last_peered":"2024-09-18T01:45:41.336778+0000","last_clean":"2024-09-18T01:45:41.336778+0000","last_became_active":"2024-09-18T01:45:08.288131+0000","last_became_peered":"2024-09-18T01:45:08.288131+0000","last_unstale":"2024-09-18T01:45:41.336778+0000","last_undegraded":"2024-09-18T01:45:41.336778+0000","last_fullsized":"2024-09-18T01:45:41.336778+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:21:35.087556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'83","reported_seq":158,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:10.696010+0000","last_change":"2024-09-18T01:45:10.305269+0000","last_active":"2024-09-18T01:47:10.696010+0000","last_peered":"2024-09-18T01:47:10.696010+0000","last_clean":"2024-09-18T01:47:10.696010+0000","last_became_active":"2024-09-18T01:45:10.305004+0000","last_became_peered":"2024-09-18T01:45:10.305004+0000","last_unstale":"2024-09-18T01:47:10.696010+0000","last_undegraded":"2024-09-18T01:47:10.696010+0000","last_fullsized":"2024-09-18T01:47:10.696010+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:34:39.601409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.339055+0000","last_change":"2024-09-18T01:45:12.311683+0000","last_active":"2024-09-18T01:45:41.339055+0000","last_peered":"2024-09-18T01:45:41.339055+0000","last_clean":"2024-09-18T01:45:41.339055+0000","last_became_active":"2024-09-18T01:45:12.311337+0000","last_became_peered":"2024-09-18T01:45:12.311337+0000","last_unstale":"2024-09-18T01:45:41.339055+0000","last_undegraded":"2024-09-18T01:45:41.339055+0000","last_fullsized":"2024-09-18T01:45:41.339055+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:36:33.811124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'81","reported_seq":162,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.883680+0000","last_change":"2024-09-18T01:45:14.315079+0000","last_active":"2024-09-18T01:48:12.883680+0000","last_peered":"2024-09-18T01:48:12.883680+0000","last_clean":"2024-09-18T01:48:12.883680+0000","last_became_active":"2024-09-18T01:45:14.314784+0000","last_became_peered":"2024-09-18T01:45:14.314784+0000","last_unstale":"2024-09-18T01:48:12.883680+0000","last_undegraded":"2024-09-18T01:48:12.883680+0000","last_fullsized":"2024-09-18T01:48:12.883680+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:27:35.990001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'4","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:46:28.550502+0000","last_change":"2024-09-18T01:45:41.350104+0000","last_active":"2024-09-18T01:46:28.550502+0000","last_peered":"2024-09-18T01:46:28.550502+0000","last_clean":"2024-09-18T01:46:28.550502+0000","last_became_active":"2024-09-18T01:45:41.338925+0000","last_became_peered":"2024-09-18T01:45:41.338925+0000","last_unstale":"2024-09-18T01:46:28.550502+0000","last_undegraded":"2024-09-18T01:46:28.550502+0000","last_fullsized":"2024-09-18T01:46:28.550502+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:28:46.190605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.333768+0000","last_change":"2024-09-18T01:44:55.242126+0000","last_active":"2024-09-18T01:45:41.333768+0000","last_peered":"2024-09-18T01:45:41.333768+0000","last_clean":"2024-09-18T01:45:41.333768+0000","last_became_active":"2024-09-18T01:44:53.237059+0000","last_became_peered":"2024-09-18T01:44:53.237059+0000","last_unstale":"2024-09-18T01:45:41.333768+0000","last_undegraded":"2024-09-18T01:45:41.333768+0000","last_fullsized":"2024-09-18T01:45:41.333768+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:32:06.823521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011095359999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337449+0000","last_change":"2024-09-18T01:45:04.273879+0000","last_active":"2024-09-18T01:45:41.337449+0000","last_peered":"2024-09-18T01:45:41.337449+0000","last_clean":"2024-09-18T01:45:41.337449+0000","last_became_active":"2024-09-18T01:45:04.273354+0000","last_became_peered":"2024-09-18T01:45:04.273354+0000","last_unstale":"2024-09-18T01:45:41.337449+0000","last_undegraded":"2024-09-18T01:45:41.337449+0000","last_fullsized":"2024-09-18T01:45:41.337449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:31:48.524360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.341234+0000","last_change":"2024-09-18T01:45:08.292027+0000","last_active":"2024-09-18T01:45:41.341234+0000","last_peered":"2024-09-18T01:45:41.341234+0000","last_clean":"2024-09-18T01:45:41.341234+0000","last_became_active":"2024-09-18T01:45:08.291681+0000","last_became_peered":"2024-09-18T01:45:08.291681+0000","last_unstale":"2024-09-18T01:45:41.341234+0000","last_undegraded":"2024-09-18T01:45:41.341234+0000","last_fullsized":"2024-09-18T01:45:41.341234+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:28:11.601390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'279","reported_seq":487,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:08.374407+0000","last_change":"2024-09-18T01:45:10.305791+0000","last_active":"2024-09-18T01:48:08.374407+0000","last_peered":"2024-09-18T01:48:08.374407+0000","last_clean":"2024-09-18T01:48:08.374407+0000","last_became_active":"2024-09-18T01:45:10.305472+0000","last_became_peered":"2024-09-18T01:45:10.305472+0000","last_unstale":"2024-09-18T01:48:08.374407+0000","last_undegraded":"2024-09-18T01:48:08.374407+0000","last_fullsized":"2024-09-18T01:48:08.374407+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:57:05.219798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":366,"num_read_kb":350,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337053+0000","last_change":"2024-09-18T01:45:12.316867+0000","last_active":"2024-09-18T01:45:41.337053+0000","last_peered":"2024-09-18T01:45:41.337053+0000","last_clean":"2024-09-18T01:45:41.337053+0000","last_became_active":"2024-09-18T01:45:12.316110+0000","last_became_peered":"2024-09-18T01:45:12.316110+0000","last_unstale":"2024-09-18T01:45:41.337053+0000","last_undegraded":"2024-09-18T01:45:41.337053+0000","last_fullsized":"2024-09-18T01:45:41.337053+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:17:14.152691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'5","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:46:28.548072+0000","last_change":"2024-09-18T01:45:14.323262+0000","last_active":"2024-09-18T01:46:28.548072+0000","last_peered":"2024-09-18T01:46:28.548072+0000","last_clean":"2024-09-18T01:46:28.548072+0000","last_became_active":"2024-09-18T01:45:14.322986+0000","last_became_peered":"2024-09-18T01:45:14.322986+0000","last_unstale":"2024-09-18T01:46:28.548072+0000","last_undegraded":"2024-09-18T01:46:28.548072+0000","last_fullsized":"2024-09-18T01:46:28.548072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:04:51.734530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'8","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.840339+0000","last_change":"2024-09-18T01:45:06.293300+0000","last_active":"2024-09-18T01:48:12.840339+0000","last_peered":"2024-09-18T01:48:12.840339+0000","last_clean":"2024-09-18T01:48:12.840339+0000","last_became_active":"2024-09-18T01:45:06.292996+0000","last_became_peered":"2024-09-18T01:45:06.292996+0000","last_unstale":"2024-09-18T01:48:12.840339+0000","last_undegraded":"2024-09-18T01:48:12.840339+0000","last_fullsized":"2024-09-18T01:48:12.840339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:06:48.729806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.331452+0000","last_change":"2024-09-18T01:44:55.620700+0000","last_active":"2024-09-18T01:45:41.331452+0000","last_peered":"2024-09-18T01:45:41.331452+0000","last_clean":"2024-09-18T01:45:41.331452+0000","last_became_active":"2024-09-18T01:44:53.237016+0000","last_became_peered":"2024-09-18T01:44:53.237016+0000","last_unstale":"2024-09-18T01:45:41.331452+0000","last_undegraded":"2024-09-18T01:45:41.331452+0000","last_fullsized":"2024-09-18T01:45:41.331452+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:36:02.583348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039942899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.777626+0000","last_change":"2024-09-18T01:45:04.284372+0000","last_active":"2024-09-18T01:48:12.777626+0000","last_peered":"2024-09-18T01:48:12.777626+0000","last_clean":"2024-09-18T01:48:12.777626+0000","last_became_active":"2024-09-18T01:45:04.283999+0000","last_became_peered":"2024-09-18T01:45:04.283999+0000","last_unstale":"2024-09-18T01:48:12.777626+0000","last_undegraded":"2024-09-18T01:48:12.777626+0000","last_fullsized":"2024-09-18T01:48:12.777626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:16:49.444181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"24'2","reported_seq":219,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:11.793649+0000","last_change":"2024-09-18T01:45:08.284516+0000","last_active":"2024-09-18T01:47:11.793649+0000","last_peered":"2024-09-18T01:47:11.793649+0000","last_clean":"2024-09-18T01:47:11.793649+0000","last_became_active":"2024-09-18T01:45:08.284186+0000","last_became_peered":"2024-09-18T01:45:08.284186+0000","last_unstale":"2024-09-18T01:47:11.793649+0000","last_undegraded":"2024-09-18T01:47:11.793649+0000","last_fullsized":"2024-09-18T01:47:11.793649+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:52:16.095961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'17","reported_seq":84,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.882505+0000","last_change":"2024-09-18T01:45:10.296574+0000","last_active":"2024-09-18T01:48:12.882505+0000","last_peered":"2024-09-18T01:48:12.882505+0000","last_clean":"2024-09-18T01:48:12.882505+0000","last_became_active":"2024-09-18T01:45:10.296284+0000","last_became_peered":"2024-09-18T01:45:10.296284+0000","last_unstale":"2024-09-18T01:48:12.882505+0000","last_undegraded":"2024-09-18T01:48:12.882505+0000","last_fullsized":"2024-09-18T01:48:12.882505+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:58:02.549052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.339121+0000","last_change":"2024-09-18T01:45:12.311612+0000","last_active":"2024-09-18T01:45:41.339121+0000","last_peered":"2024-09-18T01:45:41.339121+0000","last_clean":"2024-09-18T01:45:41.339121+0000","last_became_active":"2024-09-18T01:45:12.311266+0000","last_became_peered":"2024-09-18T01:45:12.311266+0000","last_unstale":"2024-09-18T01:45:41.339121+0000","last_undegraded":"2024-09-18T01:45:41.339121+0000","last_fullsized":"2024-09-18T01:45:41.339121+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:33:04.342308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"33'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:45.861093+0000","last_change":"2024-09-18T01:45:14.318619+0000","last_active":"2024-09-18T01:45:45.861093+0000","last_peered":"2024-09-18T01:45:45.861093+0000","last_clean":"2024-09-18T01:45:45.861093+0000","last_became_active":"2024-09-18T01:45:14.318346+0000","last_became_peered":"2024-09-18T01:45:14.318346+0000","last_unstale":"2024-09-18T01:45:45.861093+0000","last_undegraded":"2024-09-18T01:45:45.861093+0000","last_fullsized":"2024-09-18T01:45:45.861093+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:29:28.994596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.871160+0000","last_change":"2024-09-18T01:45:06.282530+0000","last_active":"2024-09-18T01:48:12.871160+0000","last_peered":"2024-09-18T01:48:12.871160+0000","last_clean":"2024-09-18T01:48:12.871160+0000","last_became_active":"2024-09-18T01:45:06.282319+0000","last_became_peered":"2024-09-18T01:45:06.282319+0000","last_unstale":"2024-09-18T01:48:12.871160+0000","last_undegraded":"2024-09-18T01:48:12.871160+0000","last_fullsized":"2024-09-18T01:48:12.871160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:15:48.322910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.335732+0000","last_change":"2024-09-18T01:44:55.242065+0000","last_active":"2024-09-18T01:45:41.335732+0000","last_peered":"2024-09-18T01:45:41.335732+0000","last_clean":"2024-09-18T01:45:41.335732+0000","last_became_active":"2024-09-18T01:44:53.236990+0000","last_became_peered":"2024-09-18T01:44:53.236990+0000","last_unstale":"2024-09-18T01:45:41.335732+0000","last_undegraded":"2024-09-18T01:45:41.335732+0000","last_fullsized":"2024-09-18T01:45:41.335732+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:45:10.092337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001062627,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.332308+0000","last_change":"2024-09-18T01:45:04.293371+0000","last_active":"2024-09-18T01:45:41.332308+0000","last_peered":"2024-09-18T01:45:41.332308+0000","last_clean":"2024-09-18T01:45:41.332308+0000","last_became_active":"2024-09-18T01:45:04.293064+0000","last_became_peered":"2024-09-18T01:45:04.293064+0000","last_unstale":"2024-09-18T01:45:41.332308+0000","last_undegraded":"2024-09-18T01:45:41.332308+0000","last_fullsized":"2024-09-18T01:45:41.332308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:59:04.808153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.339566+0000","last_change":"2024-09-18T01:45:08.292781+0000","last_active":"2024-09-18T01:45:41.339566+0000","last_peered":"2024-09-18T01:45:41.339566+0000","last_clean":"2024-09-18T01:45:41.339566+0000","last_became_active":"2024-09-18T01:45:08.292477+0000","last_became_peered":"2024-09-18T01:45:08.292477+0000","last_unstale":"2024-09-18T01:45:41.339566+0000","last_undegraded":"2024-09-18T01:45:41.339566+0000","last_fullsized":"2024-09-18T01:45:41.339566+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:39:02.381373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'13","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.186836+0000","last_change":"2024-09-18T01:45:10.308357+0000","last_active":"2024-09-18T01:48:12.186836+0000","last_peered":"2024-09-18T01:48:12.186836+0000","last_clean":"2024-09-18T01:48:12.186836+0000","last_became_active":"2024-09-18T01:45:10.308018+0000","last_became_peered":"2024-09-18T01:45:10.308018+0000","last_unstale":"2024-09-18T01:48:12.186836+0000","last_undegraded":"2024-09-18T01:48:12.186836+0000","last_fullsized":"2024-09-18T01:48:12.186836+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:40:04.662960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338954+0000","last_change":"2024-09-18T01:45:12.315614+0000","last_active":"2024-09-18T01:45:41.338954+0000","last_peered":"2024-09-18T01:45:41.338954+0000","last_clean":"2024-09-18T01:45:41.338954+0000","last_became_active":"2024-09-18T01:45:12.315342+0000","last_became_peered":"2024-09-18T01:45:12.315342+0000","last_unstale":"2024-09-18T01:45:41.338954+0000","last_undegraded":"2024-09-18T01:45:41.338954+0000","last_fullsized":"2024-09-18T01:45:41.338954+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:11:58.173898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"33'6","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.842041+0000","last_change":"2024-09-18T01:45:14.323182+0000","last_active":"2024-09-18T01:48:12.842041+0000","last_peered":"2024-09-18T01:48:12.842041+0000","last_clean":"2024-09-18T01:48:12.842041+0000","last_became_active":"2024-09-18T01:45:14.322568+0000","last_became_peered":"2024-09-18T01:45:14.322568+0000","last_unstale":"2024-09-18T01:48:12.842041+0000","last_undegraded":"2024-09-18T01:48:12.842041+0000","last_fullsized":"2024-09-18T01:48:12.842041+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:58:43.947177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'14","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.840650+0000","last_change":"2024-09-18T01:45:06.292050+0000","last_active":"2024-09-18T01:48:12.840650+0000","last_peered":"2024-09-18T01:48:12.840650+0000","last_clean":"2024-09-18T01:48:12.840650+0000","last_became_active":"2024-09-18T01:45:06.291792+0000","last_became_peered":"2024-09-18T01:45:06.291792+0000","last_unstale":"2024-09-18T01:48:12.840650+0000","last_undegraded":"2024-09-18T01:48:12.840650+0000","last_fullsized":"2024-09-18T01:48:12.840650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:57:38.152681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"31'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.332634+0000","last_change":"2024-09-18T01:45:04.291510+0000","last_active":"2024-09-18T01:45:41.332634+0000","last_peered":"2024-09-18T01:45:41.332634+0000","last_clean":"2024-09-18T01:45:41.332634+0000","last_became_active":"2024-09-18T01:45:04.291211+0000","last_became_peered":"2024-09-18T01:45:04.291211+0000","last_unstale":"2024-09-18T01:45:41.332634+0000","last_undegraded":"2024-09-18T01:45:41.332634+0000","last_fullsized":"2024-09-18T01:45:41.332634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:16:49.444181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338599+0000","last_change":"2024-09-18T01:44:55.234985+0000","last_active":"2024-09-18T01:45:41.338599+0000","last_peered":"2024-09-18T01:45:41.338599+0000","last_clean":"2024-09-18T01:45:41.338599+0000","last_became_active":"2024-09-18T01:44:53.234966+0000","last_became_peered":"2024-09-18T01:44:53.234966+0000","last_unstale":"2024-09-18T01:45:41.338599+0000","last_undegraded":"2024-09-18T01:45:41.338599+0000","last_fullsized":"2024-09-18T01:45:41.338599+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:30:53.728764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045990099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"33'1","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:17.213424+0000","last_change":"2024-09-18T01:45:08.286575+0000","last_active":"2024-09-18T01:47:17.213424+0000","last_peered":"2024-09-18T01:47:17.213424+0000","last_clean":"2024-09-18T01:47:17.213424+0000","last_became_active":"2024-09-18T01:45:08.286195+0000","last_became_peered":"2024-09-18T01:45:08.286195+0000","last_unstale":"2024-09-18T01:47:17.213424+0000","last_undegraded":"2024-09-18T01:47:17.213424+0000","last_fullsized":"2024-09-18T01:47:17.213424+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:39:08.126512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'73","reported_seq":144,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.212620+0000","last_change":"2024-09-18T01:45:10.306220+0000","last_active":"2024-09-18T01:47:12.212620+0000","last_peered":"2024-09-18T01:47:12.212620+0000","last_clean":"2024-09-18T01:47:12.212620+0000","last_became_active":"2024-09-18T01:45:10.305948+0000","last_became_peered":"2024-09-18T01:45:10.305948+0000","last_unstale":"2024-09-18T01:47:12.212620+0000","last_undegraded":"2024-09-18T01:47:12.212620+0000","last_fullsized":"2024-09-18T01:47:12.212620+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:03:14.568657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":77,"num_read_kb":63,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.332043+0000","last_change":"2024-09-18T01:45:12.312116+0000","last_active":"2024-09-18T01:45:41.332043+0000","last_peered":"2024-09-18T01:45:41.332043+0000","last_clean":"2024-09-18T01:45:41.332043+0000","last_became_active":"2024-09-18T01:45:12.311862+0000","last_became_peered":"2024-09-18T01:45:12.311862+0000","last_unstale":"2024-09-18T01:45:41.332043+0000","last_undegraded":"2024-09-18T01:45:41.332043+0000","last_fullsized":"2024-09-18T01:45:41.332043+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:17:48.507658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'13","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.101245+0000","last_change":"2024-09-18T01:45:14.311691+0000","last_active":"2024-09-18T01:47:12.101245+0000","last_peered":"2024-09-18T01:47:12.101245+0000","last_clean":"2024-09-18T01:47:12.101245+0000","last_became_active":"2024-09-18T01:45:14.311403+0000","last_became_peered":"2024-09-18T01:45:14.311403+0000","last_unstale":"2024-09-18T01:47:12.101245+0000","last_undegraded":"2024-09-18T01:47:12.101245+0000","last_fullsized":"2024-09-18T01:47:12.101245+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:47:25.981905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.336217+0000","last_change":"2024-09-18T01:45:06.292173+0000","last_active":"2024-09-18T01:45:41.336217+0000","last_peered":"2024-09-18T01:45:41.336217+0000","last_clean":"2024-09-18T01:45:41.336217+0000","last_became_active":"2024-09-18T01:45:06.291845+0000","last_became_peered":"2024-09-18T01:45:06.291845+0000","last_unstale":"2024-09-18T01:45:41.336217+0000","last_undegraded":"2024-09-18T01:45:41.336217+0000","last_fullsized":"2024-09-18T01:45:41.336217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:06:48.729806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.339145+0000","last_change":"2024-09-18T01:45:04.273877+0000","last_active":"2024-09-18T01:45:41.339145+0000","last_peered":"2024-09-18T01:45:41.339145+0000","last_clean":"2024-09-18T01:45:41.339145+0000","last_became_active":"2024-09-18T01:45:04.273385+0000","last_became_peered":"2024-09-18T01:45:04.273385+0000","last_unstale":"2024-09-18T01:45:41.339145+0000","last_undegraded":"2024-09-18T01:45:41.339145+0000","last_fullsized":"2024-09-18T01:45:41.339145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:05:10.699920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.339297+0000","last_change":"2024-09-18T01:44:55.242318+0000","last_active":"2024-09-18T01:45:41.339297+0000","last_peered":"2024-09-18T01:45:41.339297+0000","last_clean":"2024-09-18T01:45:41.339297+0000","last_became_active":"2024-09-18T01:44:53.236927+0000","last_became_peered":"2024-09-18T01:44:53.236927+0000","last_unstale":"2024-09-18T01:45:41.339297+0000","last_undegraded":"2024-09-18T01:45:41.339297+0000","last_fullsized":"2024-09-18T01:45:41.339297+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:52:39.601060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00130324,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337750+0000","last_change":"2024-09-18T01:45:08.296862+0000","last_active":"2024-09-18T01:45:41.337750+0000","last_peered":"2024-09-18T01:45:41.337750+0000","last_clean":"2024-09-18T01:45:41.337750+0000","last_became_active":"2024-09-18T01:45:08.296118+0000","last_became_peered":"2024-09-18T01:45:08.296118+0000","last_unstale":"2024-09-18T01:45:41.337750+0000","last_undegraded":"2024-09-18T01:45:41.337750+0000","last_fullsized":"2024-09-18T01:45:41.337750+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:18:22.945844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"31'20","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.333610+0000","last_change":"2024-09-18T01:45:10.306223+0000","last_active":"2024-09-18T01:45:41.333610+0000","last_peered":"2024-09-18T01:45:41.333610+0000","last_clean":"2024-09-18T01:45:41.333610+0000","last_became_active":"2024-09-18T01:45:10.305932+0000","last_became_peered":"2024-09-18T01:45:10.305932+0000","last_unstale":"2024-09-18T01:45:41.333610+0000","last_undegraded":"2024-09-18T01:45:41.333610+0000","last_fullsized":"2024-09-18T01:45:41.333610+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:02:58.015323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'282","reported_seq":354,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:08.374174+0000","last_change":"2024-09-18T01:45:12.312362+0000","last_active":"2024-09-18T01:48:08.374174+0000","last_peered":"2024-09-18T01:48:08.374174+0000","last_clean":"2024-09-18T01:48:08.374174+0000","last_became_active":"2024-09-18T01:45:12.312117+0000","last_became_peered":"2024-09-18T01:45:12.312117+0000","last_unstale":"2024-09-18T01:48:08.374174+0000","last_undegraded":"2024-09-18T01:48:08.374174+0000","last_fullsized":"2024-09-18T01:48:08.374174+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:31:43.441229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"33'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.829026+0000","last_change":"2024-09-18T01:45:14.322374+0000","last_active":"2024-09-18T01:48:12.829026+0000","last_peered":"2024-09-18T01:48:12.829026+0000","last_clean":"2024-09-18T01:48:12.829026+0000","last_became_active":"2024-09-18T01:45:14.322078+0000","last_became_peered":"2024-09-18T01:45:14.322078+0000","last_unstale":"2024-09-18T01:48:12.829026+0000","last_undegraded":"2024-09-18T01:48:12.829026+0000","last_fullsized":"2024-09-18T01:48:12.829026+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:07:46.272021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.793475+0000","last_change":"2024-09-18T01:45:06.297948+0000","last_active":"2024-09-18T01:48:12.793475+0000","last_peered":"2024-09-18T01:48:12.793475+0000","last_clean":"2024-09-18T01:48:12.793475+0000","last_became_active":"2024-09-18T01:45:06.297660+0000","last_became_peered":"2024-09-18T01:45:06.297660+0000","last_unstale":"2024-09-18T01:48:12.793475+0000","last_undegraded":"2024-09-18T01:48:12.793475+0000","last_fullsized":"2024-09-18T01:48:12.793475+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:37:23.667201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.341134+0000","last_change":"2024-09-18T01:45:04.294211+0000","last_active":"2024-09-18T01:45:41.341134+0000","last_peered":"2024-09-18T01:45:41.341134+0000","last_clean":"2024-09-18T01:45:41.341134+0000","last_became_active":"2024-09-18T01:45:04.288189+0000","last_became_peered":"2024-09-18T01:45:04.288189+0000","last_unstale":"2024-09-18T01:45:41.341134+0000","last_undegraded":"2024-09-18T01:45:41.341134+0000","last_fullsized":"2024-09-18T01:45:41.341134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:20:01.448189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.339254+0000","last_change":"2024-09-18T01:44:55.234985+0000","last_active":"2024-09-18T01:45:41.339254+0000","last_peered":"2024-09-18T01:45:41.339254+0000","last_clean":"2024-09-18T01:45:41.339254+0000","last_became_active":"2024-09-18T01:44:53.236812+0000","last_became_peered":"2024-09-18T01:44:53.236812+0000","last_unstale":"2024-09-18T01:45:41.339254+0000","last_undegraded":"2024-09-18T01:45:41.339254+0000","last_fullsized":"2024-09-18T01:45:41.339254+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:54:16.245255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044136000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.336209+0000","last_change":"2024-09-18T01:45:08.296449+0000","last_active":"2024-09-18T01:45:41.336209+0000","last_peered":"2024-09-18T01:45:41.336209+0000","last_clean":"2024-09-18T01:45:41.336209+0000","last_became_active":"2024-09-18T01:45:08.296102+0000","last_became_peered":"2024-09-18T01:45:08.296102+0000","last_unstale":"2024-09-18T01:45:41.336209+0000","last_undegraded":"2024-09-18T01:45:41.336209+0000","last_fullsized":"2024-09-18T01:45:41.336209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:40:32.625197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"31'16","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338569+0000","last_change":"2024-09-18T01:45:10.309071+0000","last_active":"2024-09-18T01:45:41.338569+0000","last_peered":"2024-09-18T01:45:41.338569+0000","last_clean":"2024-09-18T01:45:41.338569+0000","last_became_active":"2024-09-18T01:45:10.308451+0000","last_became_peered":"2024-09-18T01:45:10.308451+0000","last_unstale":"2024-09-18T01:45:41.338569+0000","last_undegraded":"2024-09-18T01:45:41.338569+0000","last_fullsized":"2024-09-18T01:45:41.338569+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:28:14.753920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'282","reported_seq":428,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.976512+0000","last_change":"2024-09-18T01:45:12.314218+0000","last_active":"2024-09-18T01:48:12.976512+0000","last_peered":"2024-09-18T01:48:12.976512+0000","last_clean":"2024-09-18T01:48:12.976512+0000","last_became_active":"2024-09-18T01:45:12.313885+0000","last_became_peered":"2024-09-18T01:45:12.313885+0000","last_unstale":"2024-09-18T01:48:12.976512+0000","last_undegraded":"2024-09-18T01:48:12.976512+0000","last_fullsized":"2024-09-18T01:48:12.976512+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:29:22.572641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"33'7","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.579430+0000","last_change":"2024-09-18T01:45:14.317559+0000","last_active":"2024-09-18T01:48:12.579430+0000","last_peered":"2024-09-18T01:48:12.579430+0000","last_clean":"2024-09-18T01:48:12.579430+0000","last_became_active":"2024-09-18T01:45:14.317241+0000","last_became_peered":"2024-09-18T01:45:14.317241+0000","last_unstale":"2024-09-18T01:48:12.579430+0000","last_undegraded":"2024-09-18T01:48:12.579430+0000","last_fullsized":"2024-09-18T01:48:12.579430+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:01:31.449415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"33'8","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.652777+0000","last_change":"2024-09-18T01:45:06.285908+0000","last_active":"2024-09-18T01:48:12.652777+0000","last_peered":"2024-09-18T01:48:12.652777+0000","last_clean":"2024-09-18T01:48:12.652777+0000","last_became_active":"2024-09-18T01:45:06.285656+0000","last_became_peered":"2024-09-18T01:45:06.285656+0000","last_unstale":"2024-09-18T01:48:12.652777+0000","last_undegraded":"2024-09-18T01:48:12.652777+0000","last_fullsized":"2024-09-18T01:48:12.652777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:34:31.263060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338445+0000","last_change":"2024-09-18T01:45:04.290881+0000","last_active":"2024-09-18T01:45:41.338445+0000","last_peered":"2024-09-18T01:45:41.338445+0000","last_clean":"2024-09-18T01:45:41.338445+0000","last_became_active":"2024-09-18T01:45:04.290480+0000","last_became_peered":"2024-09-18T01:45:04.290480+0000","last_unstale":"2024-09-18T01:45:41.338445+0000","last_undegraded":"2024-09-18T01:45:41.338445+0000","last_fullsized":"2024-09-18T01:45:41.338445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:43:17.455462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338670+0000","last_change":"2024-09-18T01:44:55.241531+0000","last_active":"2024-09-18T01:45:41.338670+0000","last_peered":"2024-09-18T01:45:41.338670+0000","last_clean":"2024-09-18T01:45:41.338670+0000","last_became_active":"2024-09-18T01:44:53.298677+0000","last_became_peered":"2024-09-18T01:44:53.298677+0000","last_unstale":"2024-09-18T01:45:41.338670+0000","last_undegraded":"2024-09-18T01:45:41.338670+0000","last_fullsized":"2024-09-18T01:45:41.338670+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:07:05.603416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052495500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.334953+0000","last_change":"2024-09-18T01:45:08.292005+0000","last_active":"2024-09-18T01:45:41.334953+0000","last_peered":"2024-09-18T01:45:41.334953+0000","last_clean":"2024-09-18T01:45:41.334953+0000","last_became_active":"2024-09-18T01:45:08.291696+0000","last_became_peered":"2024-09-18T01:45:08.291696+0000","last_unstale":"2024-09-18T01:45:41.334953+0000","last_undegraded":"2024-09-18T01:45:41.334953+0000","last_fullsized":"2024-09-18T01:45:41.334953+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:36:29.790531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'88","reported_seq":166,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:10.682966+0000","last_change":"2024-09-18T01:45:10.304923+0000","last_active":"2024-09-18T01:47:10.682966+0000","last_peered":"2024-09-18T01:47:10.682966+0000","last_clean":"2024-09-18T01:47:10.682966+0000","last_became_active":"2024-09-18T01:45:10.304662+0000","last_became_peered":"2024-09-18T01:45:10.304662+0000","last_unstale":"2024-09-18T01:47:10.682966+0000","last_undegraded":"2024-09-18T01:47:10.682966+0000","last_fullsized":"2024-09-18T01:47:10.682966+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:31:12.978887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":84,"num_read_kb":69,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338335+0000","last_change":"2024-09-18T01:45:12.311741+0000","last_active":"2024-09-18T01:45:41.338335+0000","last_peered":"2024-09-18T01:45:41.338335+0000","last_clean":"2024-09-18T01:45:41.338335+0000","last_became_active":"2024-09-18T01:45:12.311399+0000","last_became_peered":"2024-09-18T01:45:12.311399+0000","last_unstale":"2024-09-18T01:45:41.338335+0000","last_undegraded":"2024-09-18T01:45:41.338335+0000","last_fullsized":"2024-09-18T01:45:41.338335+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:59:11.475143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.334893+0000","last_change":"2024-09-18T01:45:14.315545+0000","last_active":"2024-09-18T01:45:41.334893+0000","last_peered":"2024-09-18T01:45:41.334893+0000","last_clean":"2024-09-18T01:45:41.334893+0000","last_became_active":"2024-09-18T01:45:14.314587+0000","last_became_peered":"2024-09-18T01:45:14.314587+0000","last_unstale":"2024-09-18T01:45:41.334893+0000","last_undegraded":"2024-09-18T01:45:41.334893+0000","last_fullsized":"2024-09-18T01:45:41.334893+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:18:52.177258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"31'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.333069+0000","last_change":"2024-09-18T01:45:14.326309+0000","last_active":"2024-09-18T01:45:41.333069+0000","last_peered":"2024-09-18T01:45:41.333069+0000","last_clean":"2024-09-18T01:45:41.333069+0000","last_became_active":"2024-09-18T01:45:14.326051+0000","last_became_peered":"2024-09-18T01:45:14.326051+0000","last_unstale":"2024-09-18T01:45:41.333069+0000","last_undegraded":"2024-09-18T01:45:41.333069+0000","last_fullsized":"2024-09-18T01:45:41.333069+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:43:32.191718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"33'8","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:46.587783+0000","last_change":"2024-09-18T01:45:06.284230+0000","last_active":"2024-09-18T01:45:46.587783+0000","last_peered":"2024-09-18T01:45:46.587783+0000","last_clean":"2024-09-18T01:45:46.587783+0000","last_became_active":"2024-09-18T01:45:06.283912+0000","last_became_peered":"2024-09-18T01:45:06.283912+0000","last_unstale":"2024-09-18T01:45:46.587783+0000","last_undegraded":"2024-09-18T01:45:46.587783+0000","last_fullsized":"2024-09-18T01:45:46.587783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:38:33.477420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:46.113600+0000","last_change":"2024-09-18T01:45:04.289644+0000","last_active":"2024-09-18T01:45:46.113600+0000","last_peered":"2024-09-18T01:45:46.113600+0000","last_clean":"2024-09-18T01:45:46.113600+0000","last_became_active":"2024-09-18T01:45:04.285647+0000","last_became_peered":"2024-09-18T01:45:04.285647+0000","last_unstale":"2024-09-18T01:45:46.113600+0000","last_undegraded":"2024-09-18T01:45:46.113600+0000","last_fullsized":"2024-09-18T01:45:46.113600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:57:36.145186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.342016+0000","last_change":"2024-09-18T01:45:41.340307+0000","last_active":"2024-09-18T01:45:41.342016+0000","last_peered":"2024-09-18T01:45:41.342016+0000","last_clean":"2024-09-18T01:45:41.342016+0000","last_became_active":"2024-09-18T01:45:41.339936+0000","last_became_peered":"2024-09-18T01:45:41.339936+0000","last_unstale":"2024-09-18T01:45:41.342016+0000","last_undegraded":"2024-09-18T01:45:41.342016+0000","last_fullsized":"2024-09-18T01:45:41.342016+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:14:27.952660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'38","reported_seq":87,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:10.688732+0000","last_change":"2024-09-18T01:45:10.307949+0000","last_active":"2024-09-18T01:47:10.688732+0000","last_peered":"2024-09-18T01:47:10.688732+0000","last_clean":"2024-09-18T01:47:10.688732+0000","last_became_active":"2024-09-18T01:45:10.307670+0000","last_became_peered":"2024-09-18T01:45:10.307670+0000","last_unstale":"2024-09-18T01:47:10.688732+0000","last_undegraded":"2024-09-18T01:47:10.688732+0000","last_fullsized":"2024-09-18T01:47:10.688732+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:17:12.637730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.334780+0000","last_change":"2024-09-18T01:45:12.316684+0000","last_active":"2024-09-18T01:45:41.334780+0000","last_peered":"2024-09-18T01:45:41.334780+0000","last_clean":"2024-09-18T01:45:41.334780+0000","last_became_active":"2024-09-18T01:45:12.316192+0000","last_became_peered":"2024-09-18T01:45:12.316192+0000","last_unstale":"2024-09-18T01:45:41.334780+0000","last_undegraded":"2024-09-18T01:45:41.334780+0000","last_fullsized":"2024-09-18T01:45:41.334780+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:23:24.551896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"33'5","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.656030+0000","last_change":"2024-09-18T01:45:14.312071+0000","last_active":"2024-09-18T01:48:12.656030+0000","last_peered":"2024-09-18T01:48:12.656030+0000","last_clean":"2024-09-18T01:48:12.656030+0000","last_became_active":"2024-09-18T01:45:14.311776+0000","last_became_peered":"2024-09-18T01:45:14.311776+0000","last_unstale":"2024-09-18T01:48:12.656030+0000","last_undegraded":"2024-09-18T01:48:12.656030+0000","last_fullsized":"2024-09-18T01:48:12.656030+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:10:22.245202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'8","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.652796+0000","last_change":"2024-09-18T01:45:06.292121+0000","last_active":"2024-09-18T01:48:12.652796+0000","last_peered":"2024-09-18T01:48:12.652796+0000","last_clean":"2024-09-18T01:48:12.652796+0000","last_became_active":"2024-09-18T01:45:06.291811+0000","last_became_peered":"2024-09-18T01:45:06.291811+0000","last_unstale":"2024-09-18T01:48:12.652796+0000","last_undegraded":"2024-09-18T01:48:12.652796+0000","last_fullsized":"2024-09-18T01:48:12.652796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:00:01.331200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.069642+0000","last_change":"2024-09-18T01:45:04.289933+0000","last_active":"2024-09-18T01:47:12.069642+0000","last_peered":"2024-09-18T01:47:12.069642+0000","last_clean":"2024-09-18T01:47:12.069642+0000","last_became_active":"2024-09-18T01:45:04.289655+0000","last_became_peered":"2024-09-18T01:45:04.289655+0000","last_unstale":"2024-09-18T01:47:12.069642+0000","last_undegraded":"2024-09-18T01:47:12.069642+0000","last_fullsized":"2024-09-18T01:47:12.069642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:35:27.504923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.344737+0000","last_change":"2024-09-18T01:45:41.342483+0000","last_active":"2024-09-18T01:45:41.344737+0000","last_peered":"2024-09-18T01:45:41.344737+0000","last_clean":"2024-09-18T01:45:41.344737+0000","last_became_active":"2024-09-18T01:45:41.342149+0000","last_became_peered":"2024-09-18T01:45:41.342149+0000","last_unstale":"2024-09-18T01:45:41.344737+0000","last_undegraded":"2024-09-18T01:45:41.344737+0000","last_fullsized":"2024-09-18T01:45:41.344737+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:51:13.653922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'5","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.191690+0000","last_change":"2024-09-18T01:45:10.296711+0000","last_active":"2024-09-18T01:48:12.191690+0000","last_peered":"2024-09-18T01:48:12.191690+0000","last_clean":"2024-09-18T01:48:12.191690+0000","last_became_active":"2024-09-18T01:45:10.296387+0000","last_became_peered":"2024-09-18T01:45:10.296387+0000","last_unstale":"2024-09-18T01:48:12.191690+0000","last_undegraded":"2024-09-18T01:48:12.191690+0000","last_fullsized":"2024-09-18T01:48:12.191690+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:30:55.339975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.331863+0000","last_change":"2024-09-18T01:45:12.313429+0000","last_active":"2024-09-18T01:45:41.331863+0000","last_peered":"2024-09-18T01:45:41.331863+0000","last_clean":"2024-09-18T01:45:41.331863+0000","last_became_active":"2024-09-18T01:45:12.313159+0000","last_became_peered":"2024-09-18T01:45:12.313159+0000","last_unstale":"2024-09-18T01:45:41.331863+0000","last_undegraded":"2024-09-18T01:45:41.331863+0000","last_fullsized":"2024-09-18T01:45:41.331863+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:30:57.351499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338764+0000","last_change":"2024-09-18T01:45:14.319376+0000","last_active":"2024-09-18T01:45:41.338764+0000","last_peered":"2024-09-18T01:45:41.338764+0000","last_clean":"2024-09-18T01:45:41.338764+0000","last_became_active":"2024-09-18T01:45:14.319073+0000","last_became_peered":"2024-09-18T01:45:14.319073+0000","last_unstale":"2024-09-18T01:45:41.338764+0000","last_undegraded":"2024-09-18T01:45:41.338764+0000","last_fullsized":"2024-09-18T01:45:41.338764+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:39:57.317811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'5","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:27.214914+0000","last_change":"2024-09-18T01:45:06.276739+0000","last_active":"2024-09-18T01:47:27.214914+0000","last_peered":"2024-09-18T01:47:27.214914+0000","last_clean":"2024-09-18T01:47:27.214914+0000","last_became_active":"2024-09-18T01:45:06.276408+0000","last_became_peered":"2024-09-18T01:45:06.276408+0000","last_unstale":"2024-09-18T01:47:27.214914+0000","last_undegraded":"2024-09-18T01:47:27.214914+0000","last_fullsized":"2024-09-18T01:47:27.214914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:38:33.477420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"33'6","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.787555+0000","last_change":"2024-09-18T01:45:04.287172+0000","last_active":"2024-09-18T01:48:12.787555+0000","last_peered":"2024-09-18T01:48:12.787555+0000","last_clean":"2024-09-18T01:48:12.787555+0000","last_became_active":"2024-09-18T01:45:04.286887+0000","last_became_peered":"2024-09-18T01:45:04.286887+0000","last_unstale":"2024-09-18T01:48:12.787555+0000","last_undegraded":"2024-09-18T01:48:12.787555+0000","last_fullsized":"2024-09-18T01:48:12.787555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:10:25.987284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.331617+0000","last_change":"2024-09-18T01:45:08.291860+0000","last_active":"2024-09-18T01:45:41.331617+0000","last_peered":"2024-09-18T01:45:41.331617+0000","last_clean":"2024-09-18T01:45:41.331617+0000","last_became_active":"2024-09-18T01:45:08.291575+0000","last_became_peered":"2024-09-18T01:45:08.291575+0000","last_unstale":"2024-09-18T01:45:41.331617+0000","last_undegraded":"2024-09-18T01:45:41.331617+0000","last_fullsized":"2024-09-18T01:45:41.331617+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:10:31.670675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'40","reported_seq":99,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.246074+0000","last_change":"2024-09-18T01:45:10.298133+0000","last_active":"2024-09-18T01:48:12.246074+0000","last_peered":"2024-09-18T01:48:12.246074+0000","last_clean":"2024-09-18T01:48:12.246074+0000","last_became_active":"2024-09-18T01:45:10.297904+0000","last_became_peered":"2024-09-18T01:45:10.297904+0000","last_unstale":"2024-09-18T01:48:12.246074+0000","last_undegraded":"2024-09-18T01:48:12.246074+0000","last_fullsized":"2024-09-18T01:48:12.246074+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:17:46.496134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.334632+0000","last_change":"2024-09-18T01:45:12.313485+0000","last_active":"2024-09-18T01:45:41.334632+0000","last_peered":"2024-09-18T01:45:41.334632+0000","last_clean":"2024-09-18T01:45:41.334632+0000","last_became_active":"2024-09-18T01:45:12.313186+0000","last_became_peered":"2024-09-18T01:45:12.313186+0000","last_unstale":"2024-09-18T01:45:41.334632+0000","last_undegraded":"2024-09-18T01:45:41.334632+0000","last_fullsized":"2024-09-18T01:45:41.334632+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:49:35.068566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337050+0000","last_change":"2024-09-18T01:45:14.326931+0000","last_active":"2024-09-18T01:45:41.337050+0000","last_peered":"2024-09-18T01:45:41.337050+0000","last_clean":"2024-09-18T01:45:41.337050+0000","last_became_active":"2024-09-18T01:45:14.326668+0000","last_became_peered":"2024-09-18T01:45:14.326668+0000","last_unstale":"2024-09-18T01:45:41.337050+0000","last_undegraded":"2024-09-18T01:45:41.337050+0000","last_fullsized":"2024-09-18T01:45:41.337050+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:46:10.520315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'18","reported_seq":95,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.800687+0000","last_change":"2024-09-18T01:45:06.297569+0000","last_active":"2024-09-18T01:48:12.800687+0000","last_peered":"2024-09-18T01:48:12.800687+0000","last_clean":"2024-09-18T01:48:12.800687+0000","last_became_active":"2024-09-18T01:45:06.297220+0000","last_became_peered":"2024-09-18T01:45:06.297220+0000","last_unstale":"2024-09-18T01:48:12.800687+0000","last_undegraded":"2024-09-18T01:48:12.800687+0000","last_fullsized":"2024-09-18T01:48:12.800687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:52:37.561237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":76,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337780+0000","last_change":"2024-09-18T01:45:04.283606+0000","last_active":"2024-09-18T01:45:41.337780+0000","last_peered":"2024-09-18T01:45:41.337780+0000","last_clean":"2024-09-18T01:45:41.337780+0000","last_became_active":"2024-09-18T01:45:04.283276+0000","last_became_peered":"2024-09-18T01:45:04.283276+0000","last_unstale":"2024-09-18T01:45:41.337780+0000","last_undegraded":"2024-09-18T01:45:41.337780+0000","last_fullsized":"2024-09-18T01:45:41.337780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:17:00.799400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.335084+0000","last_change":"2024-09-18T01:45:08.291740+0000","last_active":"2024-09-18T01:45:41.335084+0000","last_peered":"2024-09-18T01:45:41.335084+0000","last_clean":"2024-09-18T01:45:41.335084+0000","last_became_active":"2024-09-18T01:45:08.290911+0000","last_became_peered":"2024-09-18T01:45:08.290911+0000","last_unstale":"2024-09-18T01:45:41.335084+0000","last_undegraded":"2024-09-18T01:45:41.335084+0000","last_fullsized":"2024-09-18T01:45:41.335084+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:38:00.913159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'30","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:10.674668+0000","last_change":"2024-09-18T01:45:10.301942+0000","last_active":"2024-09-18T01:47:10.674668+0000","last_peered":"2024-09-18T01:47:10.674668+0000","last_clean":"2024-09-18T01:47:10.674668+0000","last_became_active":"2024-09-18T01:45:10.301622+0000","last_became_peered":"2024-09-18T01:45:10.301622+0000","last_unstale":"2024-09-18T01:47:10.674668+0000","last_undegraded":"2024-09-18T01:47:10.674668+0000","last_fullsized":"2024-09-18T01:47:10.674668+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:45:21.320125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.332022+0000","last_change":"2024-09-18T01:45:12.313357+0000","last_active":"2024-09-18T01:45:41.332022+0000","last_peered":"2024-09-18T01:45:41.332022+0000","last_clean":"2024-09-18T01:45:41.332022+0000","last_became_active":"2024-09-18T01:45:12.313096+0000","last_became_peered":"2024-09-18T01:45:12.313096+0000","last_unstale":"2024-09-18T01:45:41.332022+0000","last_undegraded":"2024-09-18T01:45:41.332022+0000","last_fullsized":"2024-09-18T01:45:41.332022+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:03:16.580180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"33'12","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.871323+0000","last_change":"2024-09-18T01:45:06.282718+0000","last_active":"2024-09-18T01:48:12.871323+0000","last_peered":"2024-09-18T01:48:12.871323+0000","last_clean":"2024-09-18T01:48:12.871323+0000","last_became_active":"2024-09-18T01:45:06.282461+0000","last_became_peered":"2024-09-18T01:45:06.282461+0000","last_unstale":"2024-09-18T01:48:12.871323+0000","last_undegraded":"2024-09-18T01:48:12.871323+0000","last_fullsized":"2024-09-18T01:48:12.871323+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:30:50.253764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"33'8","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.539657+0000","last_change":"2024-09-18T01:45:04.293367+0000","last_active":"2024-09-18T01:48:12.539657+0000","last_peered":"2024-09-18T01:48:12.539657+0000","last_clean":"2024-09-18T01:48:12.539657+0000","last_became_active":"2024-09-18T01:45:04.288082+0000","last_became_peered":"2024-09-18T01:45:04.288082+0000","last_unstale":"2024-09-18T01:48:12.539657+0000","last_undegraded":"2024-09-18T01:48:12.539657+0000","last_fullsized":"2024-09-18T01:48:12.539657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:03:55.175306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":48,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.340356+0000","last_change":"2024-09-18T01:45:08.293027+0000","last_active":"2024-09-18T01:45:41.340356+0000","last_peered":"2024-09-18T01:45:41.340356+0000","last_clean":"2024-09-18T01:45:41.340356+0000","last_became_active":"2024-09-18T01:45:08.292739+0000","last_became_peered":"2024-09-18T01:45:08.292739+0000","last_unstale":"2024-09-18T01:45:41.340356+0000","last_undegraded":"2024-09-18T01:45:41.340356+0000","last_fullsized":"2024-09-18T01:45:41.340356+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:30:59.656894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'60","reported_seq":122,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:10.694810+0000","last_change":"2024-09-18T01:45:10.296746+0000","last_active":"2024-09-18T01:47:10.694810+0000","last_peered":"2024-09-18T01:47:10.694810+0000","last_clean":"2024-09-18T01:47:10.694810+0000","last_became_active":"2024-09-18T01:45:10.296396+0000","last_became_peered":"2024-09-18T01:45:10.296396+0000","last_unstale":"2024-09-18T01:47:10.694810+0000","last_undegraded":"2024-09-18T01:47:10.694810+0000","last_fullsized":"2024-09-18T01:47:10.694810+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:49:47.265044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":58,"num_read_kb":48,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.332138+0000","last_change":"2024-09-18T01:45:12.307915+0000","last_active":"2024-09-18T01:45:41.332138+0000","last_peered":"2024-09-18T01:45:41.332138+0000","last_clean":"2024-09-18T01:45:41.332138+0000","last_became_active":"2024-09-18T01:45:12.307279+0000","last_became_peered":"2024-09-18T01:45:12.307279+0000","last_unstale":"2024-09-18T01:45:41.332138+0000","last_undegraded":"2024-09-18T01:45:41.332138+0000","last_fullsized":"2024-09-18T01:45:41.332138+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:49:49.276568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'22","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.098129+0000","last_change":"2024-09-18T01:45:14.320125+0000","last_active":"2024-09-18T01:47:12.098129+0000","last_peered":"2024-09-18T01:47:12.098129+0000","last_clean":"2024-09-18T01:47:12.098129+0000","last_became_active":"2024-09-18T01:45:14.319540+0000","last_became_peered":"2024-09-18T01:45:14.319540+0000","last_unstale":"2024-09-18T01:47:12.098129+0000","last_undegraded":"2024-09-18T01:47:12.098129+0000","last_fullsized":"2024-09-18T01:47:12.098129+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:14:53.955796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":65,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'18","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.801087+0000","last_change":"2024-09-18T01:45:06.293374+0000","last_active":"2024-09-18T01:48:12.801087+0000","last_peered":"2024-09-18T01:48:12.801087+0000","last_clean":"2024-09-18T01:48:12.801087+0000","last_became_active":"2024-09-18T01:45:06.293053+0000","last_became_peered":"2024-09-18T01:45:06.293053+0000","last_unstale":"2024-09-18T01:48:12.801087+0000","last_undegraded":"2024-09-18T01:48:12.801087+0000","last_fullsized":"2024-09-18T01:48:12.801087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:55:38.246732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":45,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.333300+0000","last_change":"2024-09-18T01:45:04.292562+0000","last_active":"2024-09-18T01:45:41.333300+0000","last_peered":"2024-09-18T01:45:41.333300+0000","last_clean":"2024-09-18T01:45:41.333300+0000","last_became_active":"2024-09-18T01:45:04.292082+0000","last_became_peered":"2024-09-18T01:45:04.292082+0000","last_unstale":"2024-09-18T01:45:41.333300+0000","last_undegraded":"2024-09-18T01:45:41.333300+0000","last_fullsized":"2024-09-18T01:45:41.333300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:08:58.229173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.333652+0000","last_change":"2024-09-18T01:45:08.287312+0000","last_active":"2024-09-18T01:45:41.333652+0000","last_peered":"2024-09-18T01:45:41.333652+0000","last_clean":"2024-09-18T01:45:41.333652+0000","last_became_active":"2024-09-18T01:45:08.286609+0000","last_became_peered":"2024-09-18T01:45:08.286609+0000","last_unstale":"2024-09-18T01:45:41.333652+0000","last_undegraded":"2024-09-18T01:45:41.333652+0000","last_fullsized":"2024-09-18T01:45:41.333652+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:04:58.163455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'36","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:10.675587+0000","last_change":"2024-09-18T01:45:10.309790+0000","last_active":"2024-09-18T01:47:10.675587+0000","last_peered":"2024-09-18T01:47:10.675587+0000","last_clean":"2024-09-18T01:47:10.675587+0000","last_became_active":"2024-09-18T01:45:10.309360+0000","last_became_peered":"2024-09-18T01:45:10.309360+0000","last_unstale":"2024-09-18T01:47:10.675587+0000","last_undegraded":"2024-09-18T01:47:10.675587+0000","last_fullsized":"2024-09-18T01:47:10.675587+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:47:11.016927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.334583+0000","last_change":"2024-09-18T01:45:12.314763+0000","last_active":"2024-09-18T01:45:41.334583+0000","last_peered":"2024-09-18T01:45:41.334583+0000","last_clean":"2024-09-18T01:45:41.334583+0000","last_became_active":"2024-09-18T01:45:12.314499+0000","last_became_peered":"2024-09-18T01:45:12.314499+0000","last_unstale":"2024-09-18T01:45:41.334583+0000","last_undegraded":"2024-09-18T01:45:41.334583+0000","last_fullsized":"2024-09-18T01:45:41.334583+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:43:30.182833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"33'2","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:46.123289+0000","last_change":"2024-09-18T01:45:14.326163+0000","last_active":"2024-09-18T01:45:46.123289+0000","last_peered":"2024-09-18T01:45:46.123289+0000","last_clean":"2024-09-18T01:45:46.123289+0000","last_became_active":"2024-09-18T01:45:14.325421+0000","last_became_peered":"2024-09-18T01:45:14.325421+0000","last_unstale":"2024-09-18T01:45:46.123289+0000","last_undegraded":"2024-09-18T01:45:46.123289+0000","last_fullsized":"2024-09-18T01:45:46.123289+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:46:44.031146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'8","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.559304+0000","last_change":"2024-09-18T01:45:06.287633+0000","last_active":"2024-09-18T01:48:12.559304+0000","last_peered":"2024-09-18T01:48:12.559304+0000","last_clean":"2024-09-18T01:48:12.559304+0000","last_became_active":"2024-09-18T01:45:06.286153+0000","last_became_peered":"2024-09-18T01:45:06.286153+0000","last_unstale":"2024-09-18T01:48:12.559304+0000","last_undegraded":"2024-09-18T01:48:12.559304+0000","last_fullsized":"2024-09-18T01:48:12.559304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:49:16.994650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.334776+0000","last_change":"2024-09-18T01:45:04.295250+0000","last_active":"2024-09-18T01:45:41.334776+0000","last_peered":"2024-09-18T01:45:41.334776+0000","last_clean":"2024-09-18T01:45:41.334776+0000","last_became_active":"2024-09-18T01:45:04.294537+0000","last_became_peered":"2024-09-18T01:45:04.294537+0000","last_unstale":"2024-09-18T01:45:41.334776+0000","last_undegraded":"2024-09-18T01:45:41.334776+0000","last_fullsized":"2024-09-18T01:45:41.334776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:18:39.513085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.332516+0000","last_change":"2024-09-18T01:45:08.287053+0000","last_active":"2024-09-18T01:45:41.332516+0000","last_peered":"2024-09-18T01:45:41.332516+0000","last_clean":"2024-09-18T01:45:41.332516+0000","last_became_active":"2024-09-18T01:45:08.286466+0000","last_became_peered":"2024-09-18T01:45:08.286466+0000","last_unstale":"2024-09-18T01:45:41.332516+0000","last_undegraded":"2024-09-18T01:45:41.332516+0000","last_fullsized":"2024-09-18T01:45:41.332516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:15:50.332283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'40","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:10.692621+0000","last_change":"2024-09-18T01:45:10.304141+0000","last_active":"2024-09-18T01:47:10.692621+0000","last_peered":"2024-09-18T01:47:10.692621+0000","last_clean":"2024-09-18T01:47:10.692621+0000","last_became_active":"2024-09-18T01:45:10.303911+0000","last_became_peered":"2024-09-18T01:45:10.303911+0000","last_unstale":"2024-09-18T01:47:10.692621+0000","last_undegraded":"2024-09-18T01:47:10.692621+0000","last_fullsized":"2024-09-18T01:47:10.692621+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:48:29.561311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338997+0000","last_change":"2024-09-18T01:45:12.313469+0000","last_active":"2024-09-18T01:45:41.338997+0000","last_peered":"2024-09-18T01:45:41.338997+0000","last_clean":"2024-09-18T01:45:41.338997+0000","last_became_active":"2024-09-18T01:45:12.313180+0000","last_became_peered":"2024-09-18T01:45:12.313180+0000","last_unstale":"2024-09-18T01:45:41.338997+0000","last_undegraded":"2024-09-18T01:45:41.338997+0000","last_fullsized":"2024-09-18T01:45:41.338997+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:38:04.933752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"33'3","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.166889+0000","last_change":"2024-09-18T01:45:14.326771+0000","last_active":"2024-09-18T01:47:12.166889+0000","last_peered":"2024-09-18T01:47:12.166889+0000","last_clean":"2024-09-18T01:47:12.166889+0000","last_became_active":"2024-09-18T01:45:14.326452+0000","last_became_peered":"2024-09-18T01:45:14.326452+0000","last_unstale":"2024-09-18T01:47:12.166889+0000","last_undegraded":"2024-09-18T01:47:12.166889+0000","last_fullsized":"2024-09-18T01:47:12.166889+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:23:19.339622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:46.588667+0000","last_change":"2024-09-18T01:45:06.282527+0000","last_active":"2024-09-18T01:45:46.588667+0000","last_peered":"2024-09-18T01:45:46.588667+0000","last_clean":"2024-09-18T01:45:46.588667+0000","last_became_active":"2024-09-18T01:45:06.281987+0000","last_became_peered":"2024-09-18T01:45:06.281987+0000","last_unstale":"2024-09-18T01:45:46.588667+0000","last_undegraded":"2024-09-18T01:45:46.588667+0000","last_fullsized":"2024-09-18T01:45:46.588667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:03:57.182802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"33'1","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:37.219069+0000","last_change":"2024-09-18T01:45:04.290235+0000","last_active":"2024-09-18T01:47:37.219069+0000","last_peered":"2024-09-18T01:47:37.219069+0000","last_clean":"2024-09-18T01:47:37.219069+0000","last_became_active":"2024-09-18T01:45:04.289909+0000","last_became_peered":"2024-09-18T01:45:04.289909+0000","last_unstale":"2024-09-18T01:47:37.219069+0000","last_undegraded":"2024-09-18T01:47:37.219069+0000","last_fullsized":"2024-09-18T01:47:37.219069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:03:55.663688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.347523+0000","last_change":"2024-09-18T01:45:41.342634+0000","last_active":"2024-09-18T01:45:41.347523+0000","last_peered":"2024-09-18T01:45:41.347523+0000","last_clean":"2024-09-18T01:45:41.347523+0000","last_became_active":"2024-09-18T01:45:41.342280+0000","last_became_peered":"2024-09-18T01:45:41.342280+0000","last_unstale":"2024-09-18T01:45:41.347523+0000","last_undegraded":"2024-09-18T01:45:41.347523+0000","last_fullsized":"2024-09-18T01:45:41.347523+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:22:13.981729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'16","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338687+0000","last_change":"2024-09-18T01:45:10.308886+0000","last_active":"2024-09-18T01:45:41.338687+0000","last_peered":"2024-09-18T01:45:41.338687+0000","last_clean":"2024-09-18T01:45:41.338687+0000","last_became_active":"2024-09-18T01:45:10.308524+0000","last_became_peered":"2024-09-18T01:45:10.308524+0000","last_unstale":"2024-09-18T01:45:41.338687+0000","last_undegraded":"2024-09-18T01:45:41.338687+0000","last_fullsized":"2024-09-18T01:45:41.338687+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:27:57.717568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'282","reported_seq":416,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.876028+0000","last_change":"2024-09-18T01:45:12.307543+0000","last_active":"2024-09-18T01:48:12.876028+0000","last_peered":"2024-09-18T01:48:12.876028+0000","last_clean":"2024-09-18T01:48:12.876028+0000","last_became_active":"2024-09-18T01:45:12.307186+0000","last_became_peered":"2024-09-18T01:45:12.307186+0000","last_unstale":"2024-09-18T01:48:12.876028+0000","last_undegraded":"2024-09-18T01:48:12.876028+0000","last_fullsized":"2024-09-18T01:48:12.876028+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:03:00.026847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"33'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.937244+0000","last_change":"2024-09-18T01:45:14.326301+0000","last_active":"2024-09-18T01:48:12.937244+0000","last_peered":"2024-09-18T01:48:12.937244+0000","last_clean":"2024-09-18T01:48:12.937244+0000","last_became_active":"2024-09-18T01:45:14.326018+0000","last_became_peered":"2024-09-18T01:45:14.326018+0000","last_unstale":"2024-09-18T01:48:12.937244+0000","last_undegraded":"2024-09-18T01:48:12.937244+0000","last_fullsized":"2024-09-18T01:48:12.937244+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:39:58.669383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"33'8","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.559623+0000","last_change":"2024-09-18T01:45:06.282281+0000","last_active":"2024-09-18T01:48:12.559623+0000","last_peered":"2024-09-18T01:48:12.559623+0000","last_clean":"2024-09-18T01:48:12.559623+0000","last_became_active":"2024-09-18T01:45:06.281798+0000","last_became_peered":"2024-09-18T01:45:06.281798+0000","last_unstale":"2024-09-18T01:48:12.559623+0000","last_undegraded":"2024-09-18T01:48:12.559623+0000","last_fullsized":"2024-09-18T01:48:12.559623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:08:07.525907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.336989+0000","last_change":"2024-09-18T01:45:04.293329+0000","last_active":"2024-09-18T01:45:41.336989+0000","last_peered":"2024-09-18T01:45:41.336989+0000","last_clean":"2024-09-18T01:45:41.336989+0000","last_became_active":"2024-09-18T01:45:04.293009+0000","last_became_peered":"2024-09-18T01:45:04.293009+0000","last_unstale":"2024-09-18T01:45:41.336989+0000","last_undegraded":"2024-09-18T01:45:41.336989+0000","last_fullsized":"2024-09-18T01:45:41.336989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:10:25.987284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.335416+0000","last_change":"2024-09-18T01:45:08.288626+0000","last_active":"2024-09-18T01:45:41.335416+0000","last_peered":"2024-09-18T01:45:41.335416+0000","last_clean":"2024-09-18T01:45:41.335416+0000","last_became_active":"2024-09-18T01:45:08.287884+0000","last_became_peered":"2024-09-18T01:45:08.287884+0000","last_unstale":"2024-09-18T01:45:41.335416+0000","last_undegraded":"2024-09-18T01:45:41.335416+0000","last_fullsized":"2024-09-18T01:45:41.335416+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:22:29.603107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'61","reported_seq":130,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:10.666172+0000","last_change":"2024-09-18T01:45:10.301367+0000","last_active":"2024-09-18T01:47:10.666172+0000","last_peered":"2024-09-18T01:47:10.666172+0000","last_clean":"2024-09-18T01:47:10.666172+0000","last_became_active":"2024-09-18T01:45:10.301087+0000","last_became_peered":"2024-09-18T01:45:10.301087+0000","last_unstale":"2024-09-18T01:47:10.666172+0000","last_undegraded":"2024-09-18T01:47:10.666172+0000","last_fullsized":"2024-09-18T01:47:10.666172+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:48:29.561311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":74,"num_read_kb":61,"num_write":42,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337222+0000","last_change":"2024-09-18T01:45:12.312300+0000","last_active":"2024-09-18T01:45:41.337222+0000","last_peered":"2024-09-18T01:45:41.337222+0000","last_clean":"2024-09-18T01:45:41.337222+0000","last_became_active":"2024-09-18T01:45:12.312055+0000","last_became_peered":"2024-09-18T01:45:12.312055+0000","last_unstale":"2024-09-18T01:45:41.337222+0000","last_undegraded":"2024-09-18T01:45:41.337222+0000","last_fullsized":"2024-09-18T01:45:41.337222+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:13:37.683828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"33'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:46.589606+0000","last_change":"2024-09-18T01:45:14.323228+0000","last_active":"2024-09-18T01:45:46.589606+0000","last_peered":"2024-09-18T01:45:46.589606+0000","last_clean":"2024-09-18T01:45:46.589606+0000","last_became_active":"2024-09-18T01:45:14.322945+0000","last_became_peered":"2024-09-18T01:45:14.322945+0000","last_unstale":"2024-09-18T01:45:46.589606+0000","last_undegraded":"2024-09-18T01:45:46.589606+0000","last_fullsized":"2024-09-18T01:45:46.589606+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:02:58.012154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'6","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.650017+0000","last_change":"2024-09-18T01:45:06.282529+0000","last_active":"2024-09-18T01:48:12.650017+0000","last_peered":"2024-09-18T01:48:12.650017+0000","last_clean":"2024-09-18T01:48:12.650017+0000","last_became_active":"2024-09-18T01:45:06.281480+0000","last_became_peered":"2024-09-18T01:45:06.281480+0000","last_unstale":"2024-09-18T01:48:12.650017+0000","last_undegraded":"2024-09-18T01:48:12.650017+0000","last_fullsized":"2024-09-18T01:48:12.650017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:12:27.107318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:44.959625+0000","last_change":"2024-09-18T01:45:04.291296+0000","last_active":"2024-09-18T01:45:44.959625+0000","last_peered":"2024-09-18T01:45:44.959625+0000","last_clean":"2024-09-18T01:45:44.959625+0000","last_became_active":"2024-09-18T01:45:04.290901+0000","last_became_peered":"2024-09-18T01:45:04.290901+0000","last_unstale":"2024-09-18T01:45:44.959625+0000","last_undegraded":"2024-09-18T01:45:44.959625+0000","last_fullsized":"2024-09-18T01:45:44.959625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:34:29.255564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.334766+0000","last_change":"2024-09-18T01:45:08.286897+0000","last_active":"2024-09-18T01:45:41.334766+0000","last_peered":"2024-09-18T01:45:41.334766+0000","last_clean":"2024-09-18T01:45:41.334766+0000","last_became_active":"2024-09-18T01:45:08.286502+0000","last_became_peered":"2024-09-18T01:45:08.286502+0000","last_unstale":"2024-09-18T01:45:41.334766+0000","last_undegraded":"2024-09-18T01:45:41.334766+0000","last_fullsized":"2024-09-18T01:45:41.334766+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:44:50.713773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'36","reported_seq":84,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:10.667256+0000","last_change":"2024-09-18T01:45:10.306297+0000","last_active":"2024-09-18T01:47:10.667256+0000","last_peered":"2024-09-18T01:47:10.667256+0000","last_clean":"2024-09-18T01:47:10.667256+0000","last_became_active":"2024-09-18T01:45:10.306076+0000","last_became_peered":"2024-09-18T01:45:10.306076+0000","last_unstale":"2024-09-18T01:47:10.667256+0000","last_undegraded":"2024-09-18T01:47:10.667256+0000","last_fullsized":"2024-09-18T01:47:10.667256+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:52:41.579679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.333314+0000","last_change":"2024-09-18T01:45:12.316303+0000","last_active":"2024-09-18T01:45:41.333314+0000","last_peered":"2024-09-18T01:45:41.333314+0000","last_clean":"2024-09-18T01:45:41.333314+0000","last_became_active":"2024-09-18T01:45:12.316022+0000","last_became_peered":"2024-09-18T01:45:12.316022+0000","last_unstale":"2024-09-18T01:45:41.333314+0000","last_undegraded":"2024-09-18T01:45:41.333314+0000","last_fullsized":"2024-09-18T01:45:41.333314+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:08:15.127495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337877+0000","last_change":"2024-09-18T01:45:14.325515+0000","last_active":"2024-09-18T01:45:41.337877+0000","last_peered":"2024-09-18T01:45:41.337877+0000","last_clean":"2024-09-18T01:45:41.337877+0000","last_became_active":"2024-09-18T01:45:14.325208+0000","last_became_peered":"2024-09-18T01:45:14.325208+0000","last_unstale":"2024-09-18T01:45:41.337877+0000","last_undegraded":"2024-09-18T01:45:41.337877+0000","last_fullsized":"2024-09-18T01:45:41.337877+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:55:28.461066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'26","reported_seq":94,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.871206+0000","last_change":"2024-09-18T01:45:06.283428+0000","last_active":"2024-09-18T01:48:12.871206+0000","last_peered":"2024-09-18T01:48:12.871206+0000","last_clean":"2024-09-18T01:48:12.871206+0000","last_became_active":"2024-09-18T01:45:06.283174+0000","last_became_peered":"2024-09-18T01:45:06.283174+0000","last_unstale":"2024-09-18T01:48:12.871206+0000","last_undegraded":"2024-09-18T01:48:12.871206+0000","last_fullsized":"2024-09-18T01:48:12.871206+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:17:42.477692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":84,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.339404+0000","last_change":"2024-09-18T01:45:04.273552+0000","last_active":"2024-09-18T01:45:41.339404+0000","last_peered":"2024-09-18T01:45:41.339404+0000","last_clean":"2024-09-18T01:45:41.339404+0000","last_became_active":"2024-09-18T01:45:04.273128+0000","last_became_peered":"2024-09-18T01:45:04.273128+0000","last_unstale":"2024-09-18T01:45:41.339404+0000","last_undegraded":"2024-09-18T01:45:41.339404+0000","last_fullsized":"2024-09-18T01:45:41.339404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:35:27.504923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"33'4","reported_seq":226,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:11.783605+0000","last_change":"2024-09-18T01:45:08.294864+0000","last_active":"2024-09-18T01:47:11.783605+0000","last_peered":"2024-09-18T01:47:11.783605+0000","last_clean":"2024-09-18T01:47:11.783605+0000","last_became_active":"2024-09-18T01:45:08.294338+0000","last_became_peered":"2024-09-18T01:45:08.294338+0000","last_unstale":"2024-09-18T01:47:11.783605+0000","last_undegraded":"2024-09-18T01:47:11.783605+0000","last_fullsized":"2024-09-18T01:47:11.783605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:30:59.656894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'33","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:42.219946+0000","last_change":"2024-09-18T01:45:10.308965+0000","last_active":"2024-09-18T01:47:42.219946+0000","last_peered":"2024-09-18T01:47:42.219946+0000","last_clean":"2024-09-18T01:47:42.219946+0000","last_became_active":"2024-09-18T01:45:10.308336+0000","last_became_peered":"2024-09-18T01:45:10.308336+0000","last_unstale":"2024-09-18T01:47:42.219946+0000","last_undegraded":"2024-09-18T01:47:42.219946+0000","last_fullsized":"2024-09-18T01:47:42.219946+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:18:53.742596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":27,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.335626+0000","last_change":"2024-09-18T01:45:12.313122+0000","last_active":"2024-09-18T01:45:41.335626+0000","last_peered":"2024-09-18T01:45:41.335626+0000","last_clean":"2024-09-18T01:45:41.335626+0000","last_became_active":"2024-09-18T01:45:12.312794+0000","last_became_peered":"2024-09-18T01:45:12.312794+0000","last_unstale":"2024-09-18T01:45:41.335626+0000","last_undegraded":"2024-09-18T01:45:41.335626+0000","last_fullsized":"2024-09-18T01:45:41.335626+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:20:31.256442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"33'10","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.266530+0000","last_change":"2024-09-18T01:45:14.325782+0000","last_active":"2024-09-18T01:48:12.266530+0000","last_peered":"2024-09-18T01:48:12.266530+0000","last_clean":"2024-09-18T01:48:12.266530+0000","last_became_active":"2024-09-18T01:45:14.325464+0000","last_became_peered":"2024-09-18T01:45:14.325464+0000","last_unstale":"2024-09-18T01:48:12.266530+0000","last_undegraded":"2024-09-18T01:48:12.266530+0000","last_fullsized":"2024-09-18T01:48:12.266530+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:16:17.590314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'8","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.871148+0000","last_change":"2024-09-18T01:45:06.283599+0000","last_active":"2024-09-18T01:48:12.871148+0000","last_peered":"2024-09-18T01:48:12.871148+0000","last_clean":"2024-09-18T01:48:12.871148+0000","last_became_active":"2024-09-18T01:45:06.283071+0000","last_became_peered":"2024-09-18T01:45:06.283071+0000","last_unstale":"2024-09-18T01:48:12.871148+0000","last_undegraded":"2024-09-18T01:48:12.871148+0000","last_fullsized":"2024-09-18T01:48:12.871148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:32:00.122022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.781181+0000","last_change":"2024-09-18T01:45:04.298035+0000","last_active":"2024-09-18T01:48:12.781181+0000","last_peered":"2024-09-18T01:48:12.781181+0000","last_clean":"2024-09-18T01:48:12.781181+0000","last_became_active":"2024-09-18T01:45:04.297716+0000","last_became_peered":"2024-09-18T01:45:04.297716+0000","last_unstale":"2024-09-18T01:48:12.781181+0000","last_undegraded":"2024-09-18T01:48:12.781181+0000","last_fullsized":"2024-09-18T01:48:12.781181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:19:39.056474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:09.379986+0000","last_change":"2024-09-18T01:45:08.294474+0000","last_active":"2024-09-18T01:47:09.379986+0000","last_peered":"2024-09-18T01:47:09.379986+0000","last_clean":"2024-09-18T01:47:09.379986+0000","last_became_active":"2024-09-18T01:45:08.294160+0000","last_became_peered":"2024-09-18T01:45:08.294160+0000","last_unstale":"2024-09-18T01:47:09.379986+0000","last_undegraded":"2024-09-18T01:47:09.379986+0000","last_fullsized":"2024-09-18T01:47:09.379986+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:58:00.539983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'44","reported_seq":100,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.192510+0000","last_change":"2024-09-18T01:45:10.308624+0000","last_active":"2024-09-18T01:48:12.192510+0000","last_peered":"2024-09-18T01:48:12.192510+0000","last_clean":"2024-09-18T01:48:12.192510+0000","last_became_active":"2024-09-18T01:45:10.308302+0000","last_became_peered":"2024-09-18T01:45:10.308302+0000","last_unstale":"2024-09-18T01:48:12.192510+0000","last_undegraded":"2024-09-18T01:48:12.192510+0000","last_fullsized":"2024-09-18T01:48:12.192510+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:00:38.863397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":52,"num_read_kb":46,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338107+0000","last_change":"2024-09-18T01:45:12.305985+0000","last_active":"2024-09-18T01:45:41.338107+0000","last_peered":"2024-09-18T01:45:41.338107+0000","last_clean":"2024-09-18T01:45:41.338107+0000","last_became_active":"2024-09-18T01:45:12.305742+0000","last_became_peered":"2024-09-18T01:45:12.305742+0000","last_unstale":"2024-09-18T01:45:41.338107+0000","last_undegraded":"2024-09-18T01:45:41.338107+0000","last_fullsized":"2024-09-18T01:45:41.338107+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:31:43.441229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"33'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:10.703620+0000","last_change":"2024-09-18T01:45:14.325723+0000","last_active":"2024-09-18T01:47:10.703620+0000","last_peered":"2024-09-18T01:47:10.703620+0000","last_clean":"2024-09-18T01:47:10.703620+0000","last_became_active":"2024-09-18T01:45:14.325368+0000","last_became_peered":"2024-09-18T01:45:14.325368+0000","last_unstale":"2024-09-18T01:47:10.703620+0000","last_undegraded":"2024-09-18T01:47:10.703620+0000","last_fullsized":"2024-09-18T01:47:10.703620+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:29:32.472538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"33'8","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.929324+0000","last_change":"2024-09-18T01:45:41.342690+0000","last_active":"2024-09-18T01:48:12.929324+0000","last_peered":"2024-09-18T01:48:12.929324+0000","last_clean":"2024-09-18T01:48:12.929324+0000","last_became_active":"2024-09-18T01:45:41.342336+0000","last_became_peered":"2024-09-18T01:45:41.342336+0000","last_unstale":"2024-09-18T01:48:12.929324+0000","last_undegraded":"2024-09-18T01:48:12.929324+0000","last_fullsized":"2024-09-18T01:48:12.929324+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:26:55.964302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.006982+0000","last_change":"2024-09-18T01:45:04.285604+0000","last_active":"2024-09-18T01:47:12.006982+0000","last_peered":"2024-09-18T01:47:12.006982+0000","last_clean":"2024-09-18T01:47:12.006982+0000","last_became_active":"2024-09-18T01:45:04.284969+0000","last_became_peered":"2024-09-18T01:45:04.284969+0000","last_unstale":"2024-09-18T01:47:12.006982+0000","last_undegraded":"2024-09-18T01:47:12.006982+0000","last_fullsized":"2024-09-18T01:47:12.006982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:43:17.455462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'11","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.800655+0000","last_change":"2024-09-18T01:45:06.285979+0000","last_active":"2024-09-18T01:48:12.800655+0000","last_peered":"2024-09-18T01:48:12.800655+0000","last_clean":"2024-09-18T01:48:12.800655+0000","last_became_active":"2024-09-18T01:45:06.285500+0000","last_became_peered":"2024-09-18T01:45:06.285500+0000","last_unstale":"2024-09-18T01:48:12.800655+0000","last_undegraded":"2024-09-18T01:48:12.800655+0000","last_fullsized":"2024-09-18T01:48:12.800655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:25:24.068245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337324+0000","last_change":"2024-09-18T01:45:04.280448+0000","last_active":"2024-09-18T01:45:41.337324+0000","last_peered":"2024-09-18T01:45:41.337324+0000","last_clean":"2024-09-18T01:45:41.337324+0000","last_became_active":"2024-09-18T01:45:04.280147+0000","last_became_peered":"2024-09-18T01:45:04.280147+0000","last_unstale":"2024-09-18T01:45:41.337324+0000","last_undegraded":"2024-09-18T01:45:41.337324+0000","last_fullsized":"2024-09-18T01:45:41.337324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:08:58.229173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.840013+0000","last_change":"2024-09-18T01:45:06.278954+0000","last_active":"2024-09-18T01:48:12.840013+0000","last_peered":"2024-09-18T01:48:12.840013+0000","last_clean":"2024-09-18T01:48:12.840013+0000","last_became_active":"2024-09-18T01:45:06.278684+0000","last_became_peered":"2024-09-18T01:45:06.278684+0000","last_unstale":"2024-09-18T01:48:12.840013+0000","last_undegraded":"2024-09-18T01:48:12.840013+0000","last_fullsized":"2024-09-18T01:48:12.840013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:02:53.996881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.335905+0000","last_change":"2024-09-18T01:45:04.283274+0000","last_active":"2024-09-18T01:45:41.335905+0000","last_peered":"2024-09-18T01:45:41.335905+0000","last_clean":"2024-09-18T01:45:41.335905+0000","last_became_active":"2024-09-18T01:45:04.281920+0000","last_became_peered":"2024-09-18T01:45:04.281920+0000","last_unstale":"2024-09-18T01:45:41.335905+0000","last_undegraded":"2024-09-18T01:45:41.335905+0000","last_fullsized":"2024-09-18T01:45:41.335905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:33:35.587070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"33'6","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:46.587865+0000","last_change":"2024-09-18T01:45:06.282298+0000","last_active":"2024-09-18T01:45:46.587865+0000","last_peered":"2024-09-18T01:45:46.587865+0000","last_clean":"2024-09-18T01:45:46.587865+0000","last_became_active":"2024-09-18T01:45:06.281998+0000","last_became_peered":"2024-09-18T01:45:06.281998+0000","last_unstale":"2024-09-18T01:45:46.587865+0000","last_undegraded":"2024-09-18T01:45:46.587865+0000","last_fullsized":"2024-09-18T01:45:46.587865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:57:38.152681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:44.957231+0000","last_change":"2024-09-18T01:45:04.280466+0000","last_active":"2024-09-18T01:45:44.957231+0000","last_peered":"2024-09-18T01:45:44.957231+0000","last_clean":"2024-09-18T01:45:44.957231+0000","last_became_active":"2024-09-18T01:45:04.280066+0000","last_became_peered":"2024-09-18T01:45:04.280066+0000","last_unstale":"2024-09-18T01:45:44.957231+0000","last_undegraded":"2024-09-18T01:45:44.957231+0000","last_fullsized":"2024-09-18T01:45:44.957231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:10:25.987284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.173427+0000","last_change":"2024-09-18T01:45:06.285899+0000","last_active":"2024-09-18T01:47:12.173427+0000","last_peered":"2024-09-18T01:47:12.173427+0000","last_clean":"2024-09-18T01:47:12.173427+0000","last_became_active":"2024-09-18T01:45:06.285054+0000","last_became_peered":"2024-09-18T01:45:06.285054+0000","last_unstale":"2024-09-18T01:47:12.173427+0000","last_undegraded":"2024-09-18T01:47:12.173427+0000","last_fullsized":"2024-09-18T01:47:12.173427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:48:17.261741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.339308+0000","last_change":"2024-09-18T01:45:04.281591+0000","last_active":"2024-09-18T01:45:41.339308+0000","last_peered":"2024-09-18T01:45:41.339308+0000","last_clean":"2024-09-18T01:45:41.339308+0000","last_became_active":"2024-09-18T01:45:04.281146+0000","last_became_peered":"2024-09-18T01:45:04.281146+0000","last_unstale":"2024-09-18T01:45:41.339308+0000","last_undegraded":"2024-09-18T01:45:41.339308+0000","last_fullsized":"2024-09-18T01:45:41.339308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:51:35.728759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:09.011065+0000","last_change":"2024-09-18T01:45:06.292733+0000","last_active":"2024-09-18T01:47:09.011065+0000","last_peered":"2024-09-18T01:47:09.011065+0000","last_clean":"2024-09-18T01:47:09.011065+0000","last_became_active":"2024-09-18T01:45:06.292490+0000","last_became_peered":"2024-09-18T01:45:06.292490+0000","last_unstale":"2024-09-18T01:47:09.011065+0000","last_undegraded":"2024-09-18T01:47:09.011065+0000","last_fullsized":"2024-09-18T01:47:09.011065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:03:57.182802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337752+0000","last_change":"2024-09-18T01:45:04.294522+0000","last_active":"2024-09-18T01:45:41.337752+0000","last_peered":"2024-09-18T01:45:41.337752+0000","last_clean":"2024-09-18T01:45:41.337752+0000","last_became_active":"2024-09-18T01:45:04.293767+0000","last_became_peered":"2024-09-18T01:45:04.293767+0000","last_unstale":"2024-09-18T01:45:41.337752+0000","last_undegraded":"2024-09-18T01:45:41.337752+0000","last_fullsized":"2024-09-18T01:45:41.337752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:16:49.444181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"33'10","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:46.125920+0000","last_change":"2024-09-18T01:45:06.293722+0000","last_active":"2024-09-18T01:45:46.125920+0000","last_peered":"2024-09-18T01:45:46.125920+0000","last_clean":"2024-09-18T01:45:46.125920+0000","last_became_active":"2024-09-18T01:45:06.293369+0000","last_became_peered":"2024-09-18T01:45:06.293369+0000","last_unstale":"2024-09-18T01:45:46.125920+0000","last_undegraded":"2024-09-18T01:45:46.125920+0000","last_fullsized":"2024-09-18T01:45:46.125920+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:12:27.107318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"33'1","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:17.215141+0000","last_change":"2024-09-18T01:45:04.292372+0000","last_active":"2024-09-18T01:47:17.215141+0000","last_peered":"2024-09-18T01:47:17.215141+0000","last_clean":"2024-09-18T01:47:17.215141+0000","last_became_active":"2024-09-18T01:45:04.292056+0000","last_became_peered":"2024-09-18T01:45:04.292056+0000","last_unstale":"2024-09-18T01:47:17.215141+0000","last_undegraded":"2024-09-18T01:47:17.215141+0000","last_fullsized":"2024-09-18T01:47:17.215141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:08:58.229173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'8","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.558399+0000","last_change":"2024-09-18T01:45:06.296391+0000","last_active":"2024-09-18T01:48:12.558399+0000","last_peered":"2024-09-18T01:48:12.558399+0000","last_clean":"2024-09-18T01:48:12.558399+0000","last_became_active":"2024-09-18T01:45:06.295055+0000","last_became_peered":"2024-09-18T01:45:06.295055+0000","last_unstale":"2024-09-18T01:48:12.558399+0000","last_undegraded":"2024-09-18T01:48:12.558399+0000","last_fullsized":"2024-09-18T01:48:12.558399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:48:17.261741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.339526+0000","last_change":"2024-09-18T01:45:04.284398+0000","last_active":"2024-09-18T01:45:41.339526+0000","last_peered":"2024-09-18T01:45:41.339526+0000","last_clean":"2024-09-18T01:45:41.339526+0000","last_became_active":"2024-09-18T01:45:04.283959+0000","last_became_peered":"2024-09-18T01:45:04.283959+0000","last_unstale":"2024-09-18T01:45:41.339526+0000","last_undegraded":"2024-09-18T01:45:41.339526+0000","last_fullsized":"2024-09-18T01:45:41.339526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:34:13.707906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"33'4","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.840864+0000","last_change":"2024-09-18T01:45:06.295541+0000","last_active":"2024-09-18T01:48:12.840864+0000","last_peered":"2024-09-18T01:48:12.840864+0000","last_clean":"2024-09-18T01:48:12.840864+0000","last_became_active":"2024-09-18T01:45:06.295270+0000","last_became_peered":"2024-09-18T01:45:06.295270+0000","last_unstale":"2024-09-18T01:48:12.840864+0000","last_undegraded":"2024-09-18T01:48:12.840864+0000","last_fullsized":"2024-09-18T01:48:12.840864+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:29:37.540404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.334195+0000","last_change":"2024-09-18T01:45:04.280658+0000","last_active":"2024-09-18T01:45:41.334195+0000","last_peered":"2024-09-18T01:45:41.334195+0000","last_clean":"2024-09-18T01:45:41.334195+0000","last_became_active":"2024-09-18T01:45:04.278951+0000","last_became_peered":"2024-09-18T01:45:04.278951+0000","last_unstale":"2024-09-18T01:45:41.334195+0000","last_undegraded":"2024-09-18T01:45:41.334195+0000","last_fullsized":"2024-09-18T01:45:41.334195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:55:36.239236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.793558+0000","last_change":"2024-09-18T01:45:06.285555+0000","last_active":"2024-09-18T01:48:12.793558+0000","last_peered":"2024-09-18T01:48:12.793558+0000","last_clean":"2024-09-18T01:48:12.793558+0000","last_became_active":"2024-09-18T01:45:06.285272+0000","last_became_peered":"2024-09-18T01:45:06.285272+0000","last_unstale":"2024-09-18T01:48:12.793558+0000","last_undegraded":"2024-09-18T01:48:12.793558+0000","last_fullsized":"2024-09-18T01:48:12.793558+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:22:44.893210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337596+0000","last_change":"2024-09-18T01:45:04.281621+0000","last_active":"2024-09-18T01:45:41.337596+0000","last_peered":"2024-09-18T01:45:41.337596+0000","last_clean":"2024-09-18T01:45:41.337596+0000","last_became_active":"2024-09-18T01:45:04.281197+0000","last_became_peered":"2024-09-18T01:45:04.281197+0000","last_unstale":"2024-09-18T01:45:41.337596+0000","last_undegraded":"2024-09-18T01:45:41.337596+0000","last_fullsized":"2024-09-18T01:45:41.337596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:59:04.808153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"33'4","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:45.518377+0000","last_change":"2024-09-18T01:45:06.285297+0000","last_active":"2024-09-18T01:45:45.518377+0000","last_peered":"2024-09-18T01:45:45.518377+0000","last_clean":"2024-09-18T01:45:45.518377+0000","last_became_active":"2024-09-18T01:45:06.284989+0000","last_became_peered":"2024-09-18T01:45:06.284989+0000","last_unstale":"2024-09-18T01:45:45.518377+0000","last_undegraded":"2024-09-18T01:45:45.518377+0000","last_fullsized":"2024-09-18T01:45:45.518377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:45:59.773285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.335010+0000","last_change":"2024-09-18T01:45:04.295486+0000","last_active":"2024-09-18T01:45:41.335010+0000","last_peered":"2024-09-18T01:45:41.335010+0000","last_clean":"2024-09-18T01:45:41.335010+0000","last_became_active":"2024-09-18T01:45:04.294125+0000","last_became_peered":"2024-09-18T01:45:04.294125+0000","last_unstale":"2024-09-18T01:45:41.335010+0000","last_undegraded":"2024-09-18T01:45:41.335010+0000","last_fullsized":"2024-09-18T01:45:41.335010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:40:12.946584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"33'10","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.840269+0000","last_change":"2024-09-18T01:45:06.279731+0000","last_active":"2024-09-18T01:48:12.840269+0000","last_peered":"2024-09-18T01:48:12.840269+0000","last_clean":"2024-09-18T01:48:12.840269+0000","last_became_active":"2024-09-18T01:45:06.279373+0000","last_became_peered":"2024-09-18T01:45:06.279373+0000","last_unstale":"2024-09-18T01:48:12.840269+0000","last_undegraded":"2024-09-18T01:48:12.840269+0000","last_fullsized":"2024-09-18T01:48:12.840269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:15:48.322910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.519021+0000","last_change":"2024-09-18T01:45:04.291798+0000","last_active":"2024-09-18T01:48:12.519021+0000","last_peered":"2024-09-18T01:48:12.519021+0000","last_clean":"2024-09-18T01:48:12.519021+0000","last_became_active":"2024-09-18T01:45:04.291442+0000","last_became_peered":"2024-09-18T01:45:04.291442+0000","last_unstale":"2024-09-18T01:48:12.519021+0000","last_undegraded":"2024-09-18T01:48:12.519021+0000","last_fullsized":"2024-09-18T01:48:12.519021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:49:22.831669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'6","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:46:28.553120+0000","last_change":"2024-09-18T01:45:06.292853+0000","last_active":"2024-09-18T01:46:28.553120+0000","last_peered":"2024-09-18T01:46:28.553120+0000","last_clean":"2024-09-18T01:46:28.553120+0000","last_became_active":"2024-09-18T01:45:06.292425+0000","last_became_peered":"2024-09-18T01:45:06.292425+0000","last_unstale":"2024-09-18T01:46:28.553120+0000","last_undegraded":"2024-09-18T01:46:28.553120+0000","last_fullsized":"2024-09-18T01:46:28.553120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:20:03.455685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.336514+0000","last_change":"2024-09-18T01:45:04.289922+0000","last_active":"2024-09-18T01:45:41.336514+0000","last_peered":"2024-09-18T01:45:41.336514+0000","last_clean":"2024-09-18T01:45:41.336514+0000","last_became_active":"2024-09-18T01:45:04.289365+0000","last_became_peered":"2024-09-18T01:45:04.289365+0000","last_unstale":"2024-09-18T01:45:41.336514+0000","last_undegraded":"2024-09-18T01:45:41.336514+0000","last_fullsized":"2024-09-18T01:45:41.336514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:59:59.323704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.335795+0000","last_change":"2024-09-18T01:45:06.293694+0000","last_active":"2024-09-18T01:45:41.335795+0000","last_peered":"2024-09-18T01:45:41.335795+0000","last_clean":"2024-09-18T01:45:41.335795+0000","last_became_active":"2024-09-18T01:45:06.293403+0000","last_became_peered":"2024-09-18T01:45:06.293403+0000","last_unstale":"2024-09-18T01:45:41.335795+0000","last_undegraded":"2024-09-18T01:45:41.335795+0000","last_fullsized":"2024-09-18T01:45:41.335795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:44:48.704400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.341176+0000","last_change":"2024-09-18T01:45:04.278234+0000","last_active":"2024-09-18T01:45:41.341176+0000","last_peered":"2024-09-18T01:45:41.341176+0000","last_clean":"2024-09-18T01:45:41.341176+0000","last_became_active":"2024-09-18T01:45:04.277907+0000","last_became_peered":"2024-09-18T01:45:04.277907+0000","last_unstale":"2024-09-18T01:45:41.341176+0000","last_undegraded":"2024-09-18T01:45:41.341176+0000","last_fullsized":"2024-09-18T01:45:41.341176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:08:05.518412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'3","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:22.216025+0000","last_change":"2024-09-18T01:45:06.293343+0000","last_active":"2024-09-18T01:47:22.216025+0000","last_peered":"2024-09-18T01:47:22.216025+0000","last_clean":"2024-09-18T01:47:22.216025+0000","last_became_active":"2024-09-18T01:45:06.293036+0000","last_became_peered":"2024-09-18T01:45:06.293036+0000","last_unstale":"2024-09-18T01:47:22.216025+0000","last_undegraded":"2024-09-18T01:47:22.216025+0000","last_fullsized":"2024-09-18T01:47:22.216025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:09:07.849480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.334001+0000","last_change":"2024-09-18T01:45:04.287307+0000","last_active":"2024-09-18T01:45:41.334001+0000","last_peered":"2024-09-18T01:45:41.334001+0000","last_clean":"2024-09-18T01:45:41.334001+0000","last_became_active":"2024-09-18T01:45:04.286591+0000","last_became_peered":"2024-09-18T01:45:04.286591+0000","last_unstale":"2024-09-18T01:45:41.334001+0000","last_undegraded":"2024-09-18T01:45:41.334001+0000","last_fullsized":"2024-09-18T01:45:41.334001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:40:12.946584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.871486+0000","last_change":"2024-09-18T01:45:06.295984+0000","last_active":"2024-09-18T01:48:12.871486+0000","last_peered":"2024-09-18T01:48:12.871486+0000","last_clean":"2024-09-18T01:48:12.871486+0000","last_became_active":"2024-09-18T01:45:06.294911+0000","last_became_peered":"2024-09-18T01:45:06.294911+0000","last_unstale":"2024-09-18T01:48:12.871486+0000","last_undegraded":"2024-09-18T01:48:12.871486+0000","last_fullsized":"2024-09-18T01:48:12.871486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:33:43.173746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.866201+0000","last_change":"2024-09-18T01:45:04.287888+0000","last_active":"2024-09-18T01:48:12.866201+0000","last_peered":"2024-09-18T01:48:12.866201+0000","last_clean":"2024-09-18T01:48:12.866201+0000","last_became_active":"2024-09-18T01:45:04.285719+0000","last_became_peered":"2024-09-18T01:45:04.285719+0000","last_unstale":"2024-09-18T01:48:12.866201+0000","last_undegraded":"2024-09-18T01:48:12.866201+0000","last_fullsized":"2024-09-18T01:48:12.866201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:33:41.166250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"33'1","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:27.216951+0000","last_change":"2024-09-18T01:45:04.280417+0000","last_active":"2024-09-18T01:47:27.216951+0000","last_peered":"2024-09-18T01:47:27.216951+0000","last_clean":"2024-09-18T01:47:27.216951+0000","last_became_active":"2024-09-18T01:45:04.278266+0000","last_became_peered":"2024-09-18T01:45:04.278266+0000","last_unstale":"2024-09-18T01:47:27.216951+0000","last_undegraded":"2024-09-18T01:47:27.216951+0000","last_fullsized":"2024-09-18T01:47:27.216951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:25:22.060750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"33'10","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:46:28.553059+0000","last_change":"2024-09-18T01:45:06.292390+0000","last_active":"2024-09-18T01:46:28.553059+0000","last_peered":"2024-09-18T01:46:28.553059+0000","last_clean":"2024-09-18T01:46:28.553059+0000","last_became_active":"2024-09-18T01:45:06.292127+0000","last_became_peered":"2024-09-18T01:45:06.292127+0000","last_unstale":"2024-09-18T01:46:28.553059+0000","last_undegraded":"2024-09-18T01:46:28.553059+0000","last_fullsized":"2024-09-18T01:46:28.553059+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:00:01.331200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337686+0000","last_change":"2024-09-18T01:45:04.273996+0000","last_active":"2024-09-18T01:45:41.337686+0000","last_peered":"2024-09-18T01:45:41.337686+0000","last_clean":"2024-09-18T01:45:41.337686+0000","last_became_active":"2024-09-18T01:45:04.273575+0000","last_became_peered":"2024-09-18T01:45:04.273575+0000","last_unstale":"2024-09-18T01:45:41.337686+0000","last_undegraded":"2024-09-18T01:45:41.337686+0000","last_fullsized":"2024-09-18T01:45:41.337686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:40:12.946584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'6","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.871024+0000","last_change":"2024-09-18T01:45:06.292393+0000","last_active":"2024-09-18T01:48:12.871024+0000","last_peered":"2024-09-18T01:48:12.871024+0000","last_clean":"2024-09-18T01:48:12.871024+0000","last_became_active":"2024-09-18T01:45:06.292037+0000","last_became_peered":"2024-09-18T01:45:06.292037+0000","last_unstale":"2024-09-18T01:48:12.871024+0000","last_undegraded":"2024-09-18T01:48:12.871024+0000","last_fullsized":"2024-09-18T01:48:12.871024+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:52:14.086589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11095,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1690,"num_read_kb":1447,"num_write":723,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1470,"ondisk_log_size":1470,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1590,"num_read_kb":1480,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38719488,"data_stored":38719488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705709,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48420,"kb_used_data":13076,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323420,"statfs":{"total":96636764160,"available":96587182080,"internally_reserved":0,"allocated":13389824,"data_stored":13058476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705709,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46560,"kb_used_data":11216,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94325280,"statfs":{"total":96636764160,"available":96589086720,"internally_reserved":0,"allocated":11485184,"data_stored":11223138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705709,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46908,"kb_used_data":11564,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94324932,"statfs":{"total":96636764160,"available":96588730368,"internally_reserved":0,"allocated":11841536,"data_stored":11549746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705709,"num_pgs":150,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44348,"kb_used_data":4844,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94327492,"statfs":{"total":96636764160,"available":96591351808,"internally_reserved":0,"allocated":4960256,"data_stored":4666184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4517888,"data_stored":4517888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10809344,"data_stored":10809344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12906496,"data_stored":12906496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T01:48:20.264 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-18T01:48:20.264 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T01:48:20.392 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.391+0000 7f09fcd9f640 1 Processor -- start 2024-09-18T01:48:20.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.391+0000 7f09fcd9f640 1 -- start start 2024-09-18T01:48:20.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.391+0000 7f09fcd9f640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f09f8074ea0 0x7f09f80948d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:20.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.391+0000 7f09fcd9f640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09f8075280 con 0x7f09f8094e10 2024-09-18T01:48:20.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.391+0000 7f09fcd9f640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x7f09f8096bc0 con 0x7f09f8074ea0 2024-09-18T01:48:20.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.391+0000 7f09f77fe640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f09f8074ea0 0x7f09f80948d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:20.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.391+0000 7f09f6ffd640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f09f8094e10 0x7f09f8095240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:38606/0 (socket says 172.21.15.129:38606) 2024-09-18T01:48:20.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.391+0000 7f09f6ffd640 1 -- 172.21.15.129:0/1383288502 learned_addr learned my addr 172.21.15.129:0/1383288502 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-09-18T01:48:20.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.391+0000 7f09f77fe640 1 -- 172.21.15.129:0/1383288502 >> v1:172.21.15.129:6789/0 conn(0x7f09f8094e10 legacy=0x7f09f8095240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:20.393 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.392+0000 7f09f77fe640 1 -- 172.21.15.129:0/1383288502 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09f8093f60 con 0x7f09f8074ea0 2024-09-18T01:48:20.394 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.392+0000 7f09f77fe640 1 --2- 172.21.15.129:0/1383288502 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f09f8074ea0 0x7f09f80948d0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f09e8009720 tx=0x7f09e802a010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d24cb9030cdd6c12 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:20.394 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.392+0000 7f09f67fc640 1 -- 172.21.15.129:0/1383288502 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09e8037070 con 0x7f09f8074ea0 2024-09-18T01:48:20.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.392+0000 7f09f67fc640 1 -- 172.21.15.129:0/1383288502 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09e802abd0 con 0x7f09f8074ea0 2024-09-18T01:48:20.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.392+0000 7f09f67fc640 1 -- 172.21.15.129:0/1383288502 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09e8032440 con 0x7f09f8074ea0 2024-09-18T01:48:20.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.393+0000 7f09fcd9f640 1 -- 172.21.15.129:0/1383288502 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f09f8074ea0 msgr2=0x7f09f80948d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:20.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.393+0000 7f09fcd9f640 1 --2- 172.21.15.129:0/1383288502 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f09f8074ea0 0x7f09f80948d0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f09e8009720 tx=0x7f09e802a010 comp rx=0 tx=0).stop 2024-09-18T01:48:20.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.393+0000 7f09fcd9f640 1 -- 172.21.15.129:0/1383288502 shutdown_connections 2024-09-18T01:48:20.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.393+0000 7f09fcd9f640 1 --2- 172.21.15.129:0/1383288502 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f09f8074ea0 0x7f09f80948d0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:20.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.393+0000 7f09fcd9f640 1 -- 172.21.15.129:0/1383288502 >> 172.21.15.129:0/1383288502 conn(0x7f09f809d320 msgr2=0x7f09f809d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:48:20.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.393+0000 7f09fcd9f640 1 -- 172.21.15.129:0/1383288502 shutdown_connections 2024-09-18T01:48:20.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.393+0000 7f09fcd9f640 1 -- 172.21.15.129:0/1383288502 wait complete. 2024-09-18T01:48:20.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.394+0000 7f09fcd9f640 1 Processor -- start 2024-09-18T01:48:20.397 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.394+0000 7f09fcd9f640 1 -- start start 2024-09-18T01:48:20.397 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.394+0000 7f09fcd9f640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f09f8074ea0 0x7f09f8132b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:20.397 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.394+0000 7f09fcd9f640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f09f81340c0 con 0x7f09f8074ea0 2024-09-18T01:48:20.397 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.394+0000 7f09f77fe640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f09f8074ea0 0x7f09f8132b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:20.397 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.394+0000 7f09f77fe640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f09f8074ea0 0x7f09f8132b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:58776/0 (socket says 172.21.15.129:58776) 2024-09-18T01:48:20.397 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.394+0000 7f09f77fe640 1 -- 172.21.15.129:0/4242523381 learned_addr learned my addr 172.21.15.129:0/4242523381 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-18T01:48:20.397 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.395+0000 7f09f77fe640 1 -- 172.21.15.129:0/4242523381 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09f8125930 con 0x7f09f8074ea0 2024-09-18T01:48:20.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.395+0000 7f09f77fe640 1 --2- 172.21.15.129:0/4242523381 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f09f8074ea0 0x7f09f8132b90 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f09e8009720 tx=0x7f09e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:20.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.395+0000 7f09dffff640 1 -- 172.21.15.129:0/4242523381 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09e8037040 con 0x7f09f8074ea0 2024-09-18T01:48:20.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.395+0000 7f09dffff640 1 -- 172.21.15.129:0/4242523381 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09e8004160 con 0x7f09f8074ea0 2024-09-18T01:48:20.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.395+0000 7f09dffff640 1 -- 172.21.15.129:0/4242523381 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09e8004440 con 0x7f09f8074ea0 2024-09-18T01:48:20.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.395+0000 7f09fcd9f640 1 -- 172.21.15.129:0/4242523381 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09f8125bc0 con 0x7f09f8074ea0 2024-09-18T01:48:20.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.395+0000 7f09fcd9f640 1 -- 172.21.15.129:0/4242523381 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09f81332b0 con 0x7f09f8074ea0 2024-09-18T01:48:20.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.396+0000 7f09dffff640 1 -- 172.21.15.129:0/4242523381 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f09e803a070 con 0x7f09f8074ea0 2024-09-18T01:48:20.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.396+0000 7f09dffff640 1 --2- 172.21.15.129:0/4242523381 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f09e40382a0 0x7f09e403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:20.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.396+0000 7f09fcd9f640 1 -- 172.21.15.129:0/4242523381 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09f80948d0 con 0x7f09f8074ea0 2024-09-18T01:48:20.398 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.396+0000 7f09dffff640 1 -- 172.21.15.129:0/4242523381 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f09e806c3a0 con 0x7f09f8074ea0 2024-09-18T01:48:20.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.396+0000 7f09f6ffd640 1 --2- 172.21.15.129:0/4242523381 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f09e40382a0 0x7f09e403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:20.399 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.397+0000 7f09f6ffd640 1 --2- 172.21.15.129:0/4242523381 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f09e40382a0 0x7f09e403a760 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f09ec007fd0 tx=0x7f09ec007ac0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:20.401 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.401+0000 7f09dffff640 1 -- 172.21.15.129:0/4242523381 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f09e8041020 con 0x7f09f8074ea0 2024-09-18T01:48:20.562 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.561+0000 7f09fcd9f640 1 -- 172.21.15.129:0/4242523381 --> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f09f8125470 con 0x7f09e40382a0 2024-09-18T01:48:20.578 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.577+0000 7f09dffff640 1 -- 172.21.15.129:0/4242523381 <== mgr.4099 v2:172.21.15.146:6824/168968651 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665891 (secure 0 0 0) 0x7f09f8125470 con 0x7f09e40382a0 2024-09-18T01:48:20.585 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:48:20.590 INFO:teuthology.orchestra.run.smithi129.stderr:dumped all 2024-09-18T01:48:20.592 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.582+0000 7f09fcd9f640 1 -- 172.21.15.129:0/4242523381 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f09e40382a0 msgr2=0x7f09e403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:20.592 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.582+0000 7f09fcd9f640 1 --2- 172.21.15.129:0/4242523381 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f09e40382a0 0x7f09e403a760 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f09ec007fd0 tx=0x7f09ec007ac0 comp rx=0 tx=0).stop 2024-09-18T01:48:20.593 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.582+0000 7f09fcd9f640 1 -- 172.21.15.129:0/4242523381 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f09f8074ea0 msgr2=0x7f09f8132b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:20.593 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.582+0000 7f09fcd9f640 1 --2- 172.21.15.129:0/4242523381 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f09f8074ea0 0x7f09f8132b90 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f09e8009720 tx=0x7f09e80046c0 comp rx=0 tx=0).stop 2024-09-18T01:48:20.593 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.582+0000 7f09fcd9f640 1 -- 172.21.15.129:0/4242523381 shutdown_connections 2024-09-18T01:48:20.593 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.582+0000 7f09fcd9f640 1 --2- 172.21.15.129:0/4242523381 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f09e40382a0 0x7f09e403a760 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:20.593 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.582+0000 7f09fcd9f640 1 --2- 172.21.15.129:0/4242523381 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f09f8074ea0 0x7f09f8132b90 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:20.593 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.582+0000 7f09fcd9f640 1 -- 172.21.15.129:0/4242523381 >> 172.21.15.129:0/4242523381 conn(0x7f09f809d320 msgr2=0x7f09f806d540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:48:20.593 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.582+0000 7f09fcd9f640 1 -- 172.21.15.129:0/4242523381 shutdown_connections 2024-09-18T01:48:20.593 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.582+0000 7f09fcd9f640 1 -- 172.21.15.129:0/4242523381 wait complete. 2024-09-18T01:48:20.594 INFO:teuthology.orchestra.run.smithi129.stdout:{"pg_ready":true,"pg_map":{"version":137,"stamp":"2024-09-18T01:48:20.241785+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26410519,"num_objects":261,"num_object_clones":0,"num_object_copies":529,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":261,"num_whiteouts":0,"num_read":5150,"num_read_kb":4698,"num_write":2298,"num_write_kb":61374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4674,"ondisk_log_size":4674,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":186236,"kb_used_data":40700,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377301124,"statfs":{"total":386547056640,"available":386356350976,"internally_reserved":0,"allocated":41676800,"data_stored":40497544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":148956951},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25809398,"num_objects":9,"num_object_clones":0,"num_object_copies":25,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":455,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003839"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.333746+0000","last_change":"2024-09-18T01:45:04.287665+0000","last_active":"2024-09-18T01:45:41.333746+0000","last_peered":"2024-09-18T01:45:41.333746+0000","last_clean":"2024-09-18T01:45:41.333746+0000","last_became_active":"2024-09-18T01:45:04.287322+0000","last_became_peered":"2024-09-18T01:45:04.287322+0000","last_unstale":"2024-09-18T01:45:41.333746+0000","last_undegraded":"2024-09-18T01:45:41.333746+0000","last_fullsized":"2024-09-18T01:45:41.333746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:31:48.524360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"33'8","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.871310+0000","last_change":"2024-09-18T01:45:06.296427+0000","last_active":"2024-09-18T01:48:12.871310+0000","last_peered":"2024-09-18T01:48:12.871310+0000","last_clean":"2024-09-18T01:48:12.871310+0000","last_became_active":"2024-09-18T01:45:06.295819+0000","last_became_peered":"2024-09-18T01:45:06.295819+0000","last_unstale":"2024-09-18T01:48:12.871310+0000","last_undegraded":"2024-09-18T01:48:12.871310+0000","last_fullsized":"2024-09-18T01:48:12.871310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:38:33.477420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.148239+0000","last_change":"2024-09-18T01:45:04.280965+0000","last_active":"2024-09-18T01:47:12.148239+0000","last_peered":"2024-09-18T01:47:12.148239+0000","last_clean":"2024-09-18T01:47:12.148239+0000","last_became_active":"2024-09-18T01:45:04.280591+0000","last_became_peered":"2024-09-18T01:45:04.280591+0000","last_unstale":"2024-09-18T01:47:12.148239+0000","last_undegraded":"2024-09-18T01:47:12.148239+0000","last_fullsized":"2024-09-18T01:47:12.148239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:43:03.344288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"33'12","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.880318+0000","last_change":"2024-09-18T01:45:06.282040+0000","last_active":"2024-09-18T01:48:12.880318+0000","last_peered":"2024-09-18T01:48:12.880318+0000","last_clean":"2024-09-18T01:48:12.880318+0000","last_became_active":"2024-09-18T01:45:06.281659+0000","last_became_peered":"2024-09-18T01:45:06.281659+0000","last_unstale":"2024-09-18T01:48:12.880318+0000","last_undegraded":"2024-09-18T01:48:12.880318+0000","last_fullsized":"2024-09-18T01:48:12.880318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:40:04.666289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"33'5","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.119006+0000","last_change":"2024-09-18T01:45:04.287682+0000","last_active":"2024-09-18T01:47:12.119006+0000","last_peered":"2024-09-18T01:47:12.119006+0000","last_clean":"2024-09-18T01:47:12.119006+0000","last_became_active":"2024-09-18T01:45:04.286007+0000","last_became_peered":"2024-09-18T01:45:04.286007+0000","last_unstale":"2024-09-18T01:47:12.119006+0000","last_undegraded":"2024-09-18T01:47:12.119006+0000","last_fullsized":"2024-09-18T01:47:12.119006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:45:57.765789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"33'18","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:09.011236+0000","last_change":"2024-09-18T01:45:06.285754+0000","last_active":"2024-09-18T01:47:09.011236+0000","last_peered":"2024-09-18T01:47:09.011236+0000","last_clean":"2024-09-18T01:47:09.011236+0000","last_became_active":"2024-09-18T01:45:06.285378+0000","last_became_peered":"2024-09-18T01:45:06.285378+0000","last_unstale":"2024-09-18T01:47:09.011236+0000","last_undegraded":"2024-09-18T01:47:09.011236+0000","last_fullsized":"2024-09-18T01:47:09.011236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:03:10.550215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":40,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.332258+0000","last_change":"2024-09-18T01:45:04.298111+0000","last_active":"2024-09-18T01:45:41.332258+0000","last_peered":"2024-09-18T01:45:41.332258+0000","last_clean":"2024-09-18T01:45:41.332258+0000","last_became_active":"2024-09-18T01:45:04.297791+0000","last_became_peered":"2024-09-18T01:45:04.297791+0000","last_unstale":"2024-09-18T01:45:41.332258+0000","last_undegraded":"2024-09-18T01:45:41.332258+0000","last_fullsized":"2024-09-18T01:45:41.332258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:56:17.978705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"33'6","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.931884+0000","last_change":"2024-09-18T01:45:06.281604+0000","last_active":"2024-09-18T01:48:12.931884+0000","last_peered":"2024-09-18T01:48:12.931884+0000","last_clean":"2024-09-18T01:48:12.931884+0000","last_became_active":"2024-09-18T01:45:06.280779+0000","last_became_peered":"2024-09-18T01:45:06.280779+0000","last_unstale":"2024-09-18T01:48:12.931884+0000","last_undegraded":"2024-09-18T01:48:12.931884+0000","last_fullsized":"2024-09-18T01:48:12.931884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:30:51.321533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.336661+0000","last_change":"2024-09-18T01:45:04.280905+0000","last_active":"2024-09-18T01:45:41.336661+0000","last_peered":"2024-09-18T01:45:41.336661+0000","last_clean":"2024-09-18T01:45:41.336661+0000","last_became_active":"2024-09-18T01:45:04.280582+0000","last_became_peered":"2024-09-18T01:45:04.280582+0000","last_unstale":"2024-09-18T01:45:41.336661+0000","last_undegraded":"2024-09-18T01:45:41.336661+0000","last_fullsized":"2024-09-18T01:45:41.336661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:31:58.114526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'12","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.162513+0000","last_change":"2024-09-18T01:45:06.289323+0000","last_active":"2024-09-18T01:47:12.162513+0000","last_peered":"2024-09-18T01:47:12.162513+0000","last_clean":"2024-09-18T01:47:12.162513+0000","last_became_active":"2024-09-18T01:45:06.289036+0000","last_became_peered":"2024-09-18T01:45:06.289036+0000","last_unstale":"2024-09-18T01:47:12.162513+0000","last_undegraded":"2024-09-18T01:47:12.162513+0000","last_fullsized":"2024-09-18T01:47:12.162513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:10:29.661303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.331520+0000","last_change":"2024-09-18T01:45:04.286820+0000","last_active":"2024-09-18T01:45:41.331520+0000","last_peered":"2024-09-18T01:45:41.331520+0000","last_clean":"2024-09-18T01:45:41.331520+0000","last_became_active":"2024-09-18T01:45:04.286509+0000","last_became_peered":"2024-09-18T01:45:04.286509+0000","last_unstale":"2024-09-18T01:45:41.331520+0000","last_undegraded":"2024-09-18T01:45:41.331520+0000","last_fullsized":"2024-09-18T01:45:41.331520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:49:22.831669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:46:28.368317+0000","last_change":"2024-09-18T01:45:06.288010+0000","last_active":"2024-09-18T01:46:28.368317+0000","last_peered":"2024-09-18T01:46:28.368317+0000","last_clean":"2024-09-18T01:46:28.368317+0000","last_became_active":"2024-09-18T01:45:06.287110+0000","last_became_peered":"2024-09-18T01:45:06.287110+0000","last_unstale":"2024-09-18T01:46:28.368317+0000","last_undegraded":"2024-09-18T01:46:28.368317+0000","last_fullsized":"2024-09-18T01:46:28.368317+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:15:07.650151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.774639+0000","last_change":"2024-09-18T01:45:04.293823+0000","last_active":"2024-09-18T01:48:12.774639+0000","last_peered":"2024-09-18T01:48:12.774639+0000","last_clean":"2024-09-18T01:48:12.774639+0000","last_became_active":"2024-09-18T01:45:04.289290+0000","last_became_peered":"2024-09-18T01:45:04.289290+0000","last_unstale":"2024-09-18T01:48:12.774639+0000","last_undegraded":"2024-09-18T01:48:12.774639+0000","last_fullsized":"2024-09-18T01:48:12.774639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:38:46.320555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'13","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.848762+0000","last_change":"2024-09-18T01:45:06.295725+0000","last_active":"2024-09-18T01:48:12.848762+0000","last_peered":"2024-09-18T01:48:12.848762+0000","last_clean":"2024-09-18T01:48:12.848762+0000","last_became_active":"2024-09-18T01:45:06.295429+0000","last_became_peered":"2024-09-18T01:45:06.295429+0000","last_unstale":"2024-09-18T01:48:12.848762+0000","last_undegraded":"2024-09-18T01:48:12.848762+0000","last_fullsized":"2024-09-18T01:48:12.848762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:48:17.261741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337598+0000","last_change":"2024-09-18T01:45:04.273877+0000","last_active":"2024-09-18T01:45:41.337598+0000","last_peered":"2024-09-18T01:45:41.337598+0000","last_clean":"2024-09-18T01:45:41.337598+0000","last_became_active":"2024-09-18T01:45:04.273328+0000","last_became_peered":"2024-09-18T01:45:04.273328+0000","last_unstale":"2024-09-18T01:45:41.337598+0000","last_undegraded":"2024-09-18T01:45:41.337598+0000","last_fullsized":"2024-09-18T01:45:41.337598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:18:35.916205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'9","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.660161+0000","last_change":"2024-09-18T01:45:06.285251+0000","last_active":"2024-09-18T01:48:12.660161+0000","last_peered":"2024-09-18T01:48:12.660161+0000","last_clean":"2024-09-18T01:48:12.660161+0000","last_became_active":"2024-09-18T01:45:06.284994+0000","last_became_peered":"2024-09-18T01:45:06.284994+0000","last_unstale":"2024-09-18T01:48:12.660161+0000","last_undegraded":"2024-09-18T01:48:12.660161+0000","last_fullsized":"2024-09-18T01:48:12.660161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:37:02.533275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.171347+0000","last_change":"2024-09-18T01:45:06.286775+0000","last_active":"2024-09-18T01:47:12.171347+0000","last_peered":"2024-09-18T01:47:12.171347+0000","last_clean":"2024-09-18T01:47:12.171347+0000","last_became_active":"2024-09-18T01:45:06.286524+0000","last_became_peered":"2024-09-18T01:45:06.286524+0000","last_unstale":"2024-09-18T01:47:12.171347+0000","last_undegraded":"2024-09-18T01:47:12.171347+0000","last_fullsized":"2024-09-18T01:47:12.171347+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:22:27.593735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338138+0000","last_change":"2024-09-18T01:45:04.298742+0000","last_active":"2024-09-18T01:45:41.338138+0000","last_peered":"2024-09-18T01:45:41.338138+0000","last_clean":"2024-09-18T01:45:41.338138+0000","last_became_active":"2024-09-18T01:45:04.298399+0000","last_became_peered":"2024-09-18T01:45:04.298399+0000","last_unstale":"2024-09-18T01:45:41.338138+0000","last_undegraded":"2024-09-18T01:45:41.338138+0000","last_fullsized":"2024-09-18T01:45:41.338138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:56:17.978705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"33'10","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.171009+0000","last_change":"2024-09-18T01:45:06.294964+0000","last_active":"2024-09-18T01:47:12.171009+0000","last_peered":"2024-09-18T01:47:12.171009+0000","last_clean":"2024-09-18T01:47:12.171009+0000","last_became_active":"2024-09-18T01:45:06.294670+0000","last_became_peered":"2024-09-18T01:45:06.294670+0000","last_unstale":"2024-09-18T01:47:12.171009+0000","last_undegraded":"2024-09-18T01:47:12.171009+0000","last_fullsized":"2024-09-18T01:47:12.171009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:12:27.107318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.334046+0000","last_change":"2024-09-18T01:45:04.286914+0000","last_active":"2024-09-18T01:45:41.334046+0000","last_peered":"2024-09-18T01:45:41.334046+0000","last_clean":"2024-09-18T01:45:41.334046+0000","last_became_active":"2024-09-18T01:45:04.286465+0000","last_became_peered":"2024-09-18T01:45:04.286465+0000","last_unstale":"2024-09-18T01:45:41.334046+0000","last_undegraded":"2024-09-18T01:45:41.334046+0000","last_fullsized":"2024-09-18T01:45:41.334046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:18:35.916205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'3","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:27.217076+0000","last_change":"2024-09-18T01:45:06.294374+0000","last_active":"2024-09-18T01:47:27.217076+0000","last_peered":"2024-09-18T01:47:27.217076+0000","last_clean":"2024-09-18T01:47:27.217076+0000","last_became_active":"2024-09-18T01:45:06.294118+0000","last_became_peered":"2024-09-18T01:45:06.294118+0000","last_unstale":"2024-09-18T01:47:27.217076+0000","last_undegraded":"2024-09-18T01:47:27.217076+0000","last_fullsized":"2024-09-18T01:47:27.217076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:55:38.246732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338586+0000","last_change":"2024-09-18T01:45:04.294733+0000","last_active":"2024-09-18T01:45:41.338586+0000","last_peered":"2024-09-18T01:45:41.338586+0000","last_clean":"2024-09-18T01:45:41.338586+0000","last_became_active":"2024-09-18T01:45:04.294327+0000","last_became_peered":"2024-09-18T01:45:04.294327+0000","last_unstale":"2024-09-18T01:45:41.338586+0000","last_undegraded":"2024-09-18T01:45:41.338586+0000","last_fullsized":"2024-09-18T01:45:41.338586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:18:35.916205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'4","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.171117+0000","last_change":"2024-09-18T01:45:06.285844+0000","last_active":"2024-09-18T01:47:12.171117+0000","last_peered":"2024-09-18T01:47:12.171117+0000","last_clean":"2024-09-18T01:47:12.171117+0000","last_became_active":"2024-09-18T01:45:06.285429+0000","last_became_peered":"2024-09-18T01:45:06.285429+0000","last_unstale":"2024-09-18T01:47:12.171117+0000","last_undegraded":"2024-09-18T01:47:12.171117+0000","last_fullsized":"2024-09-18T01:47:12.171117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:33:43.173746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.336963+0000","last_change":"2024-09-18T01:45:04.299057+0000","last_active":"2024-09-18T01:45:41.336963+0000","last_peered":"2024-09-18T01:45:41.336963+0000","last_clean":"2024-09-18T01:45:41.336963+0000","last_became_active":"2024-09-18T01:45:04.298601+0000","last_became_peered":"2024-09-18T01:45:04.298601+0000","last_unstale":"2024-09-18T01:45:41.336963+0000","last_undegraded":"2024-09-18T01:45:41.336963+0000","last_fullsized":"2024-09-18T01:45:41.336963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:31:48.524360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'10","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.558700+0000","last_change":"2024-09-18T01:45:06.286133+0000","last_active":"2024-09-18T01:48:12.558700+0000","last_peered":"2024-09-18T01:48:12.558700+0000","last_clean":"2024-09-18T01:48:12.558700+0000","last_became_active":"2024-09-18T01:45:06.285228+0000","last_became_peered":"2024-09-18T01:45:06.285228+0000","last_unstale":"2024-09-18T01:48:12.558700+0000","last_undegraded":"2024-09-18T01:48:12.558700+0000","last_fullsized":"2024-09-18T01:48:12.558700+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:03:57.671184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:46.110785+0000","last_change":"2024-09-18T01:45:04.281502+0000","last_active":"2024-09-18T01:45:46.110785+0000","last_peered":"2024-09-18T01:45:46.110785+0000","last_clean":"2024-09-18T01:45:46.110785+0000","last_became_active":"2024-09-18T01:45:04.281118+0000","last_became_peered":"2024-09-18T01:45:04.281118+0000","last_unstale":"2024-09-18T01:45:46.110785+0000","last_undegraded":"2024-09-18T01:45:46.110785+0000","last_fullsized":"2024-09-18T01:45:46.110785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:42:11.703254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"33'16","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.793630+0000","last_change":"2024-09-18T01:45:06.284548+0000","last_active":"2024-09-18T01:48:12.793630+0000","last_peered":"2024-09-18T01:48:12.793630+0000","last_clean":"2024-09-18T01:48:12.793630+0000","last_became_active":"2024-09-18T01:45:06.284237+0000","last_became_peered":"2024-09-18T01:45:06.284237+0000","last_unstale":"2024-09-18T01:48:12.793630+0000","last_undegraded":"2024-09-18T01:48:12.793630+0000","last_fullsized":"2024-09-18T01:48:12.793630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:04:56.154083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":48,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338330+0000","last_change":"2024-09-18T01:45:04.285185+0000","last_active":"2024-09-18T01:45:41.338330+0000","last_peered":"2024-09-18T01:45:41.338330+0000","last_clean":"2024-09-18T01:45:41.338330+0000","last_became_active":"2024-09-18T01:45:04.284148+0000","last_became_peered":"2024-09-18T01:45:04.284148+0000","last_unstale":"2024-09-18T01:45:41.338330+0000","last_undegraded":"2024-09-18T01:45:41.338330+0000","last_fullsized":"2024-09-18T01:45:41.338330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:09:41.307844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'35","reported_seq":99,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.821349+0000","last_change":"2024-09-18T01:45:14.323024+0000","last_active":"2024-09-18T01:48:12.821349+0000","last_peered":"2024-09-18T01:48:12.821349+0000","last_clean":"2024-09-18T01:48:12.821349+0000","last_became_active":"2024-09-18T01:45:14.322729+0000","last_became_peered":"2024-09-18T01:45:14.322729+0000","last_unstale":"2024-09-18T01:48:12.821349+0000","last_undegraded":"2024-09-18T01:48:12.821349+0000","last_fullsized":"2024-09-18T01:48:12.821349+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:40:38.654675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'10","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.559925+0000","last_change":"2024-09-18T01:45:06.281639+0000","last_active":"2024-09-18T01:48:12.559925+0000","last_peered":"2024-09-18T01:48:12.559925+0000","last_clean":"2024-09-18T01:48:12.559925+0000","last_became_active":"2024-09-18T01:45:06.281361+0000","last_became_peered":"2024-09-18T01:45:06.281361+0000","last_unstale":"2024-09-18T01:48:12.559925+0000","last_undegraded":"2024-09-18T01:48:12.559925+0000","last_fullsized":"2024-09-18T01:48:12.559925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:48:25.542869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"33'1","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:27.217105+0000","last_change":"2024-09-18T01:45:04.285350+0000","last_active":"2024-09-18T01:47:27.217105+0000","last_peered":"2024-09-18T01:47:27.217105+0000","last_clean":"2024-09-18T01:47:27.217105+0000","last_became_active":"2024-09-18T01:45:04.285008+0000","last_became_peered":"2024-09-18T01:45:04.285008+0000","last_unstale":"2024-09-18T01:47:27.217105+0000","last_undegraded":"2024-09-18T01:47:27.217105+0000","last_fullsized":"2024-09-18T01:47:27.217105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:37:00.525779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.340987+0000","last_change":"2024-09-18T01:45:08.296627+0000","last_active":"2024-09-18T01:45:41.340987+0000","last_peered":"2024-09-18T01:45:41.340987+0000","last_clean":"2024-09-18T01:45:41.340987+0000","last_became_active":"2024-09-18T01:45:08.296241+0000","last_became_peered":"2024-09-18T01:45:08.296241+0000","last_unstale":"2024-09-18T01:45:41.340987+0000","last_undegraded":"2024-09-18T01:45:41.340987+0000","last_fullsized":"2024-09-18T01:45:41.340987+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:01:25.419937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'43","reported_seq":97,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:10.683922+0000","last_change":"2024-09-18T01:45:10.306140+0000","last_active":"2024-09-18T01:47:10.683922+0000","last_peered":"2024-09-18T01:47:10.683922+0000","last_clean":"2024-09-18T01:47:10.683922+0000","last_became_active":"2024-09-18T01:45:10.305713+0000","last_became_peered":"2024-09-18T01:45:10.305713+0000","last_unstale":"2024-09-18T01:47:10.683922+0000","last_undegraded":"2024-09-18T01:47:10.683922+0000","last_fullsized":"2024-09-18T01:47:10.683922+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:42:14.941344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337936+0000","last_change":"2024-09-18T01:45:12.313546+0000","last_active":"2024-09-18T01:45:41.337936+0000","last_peered":"2024-09-18T01:45:41.337936+0000","last_clean":"2024-09-18T01:45:41.337936+0000","last_became_active":"2024-09-18T01:45:12.313276+0000","last_became_peered":"2024-09-18T01:45:12.313276+0000","last_unstale":"2024-09-18T01:45:41.337936+0000","last_undegraded":"2024-09-18T01:45:41.337936+0000","last_fullsized":"2024-09-18T01:45:41.337936+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:22:43.654693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'7","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:46:28.375354+0000","last_change":"2024-09-18T01:45:14.318360+0000","last_active":"2024-09-18T01:46:28.375354+0000","last_peered":"2024-09-18T01:46:28.375354+0000","last_clean":"2024-09-18T01:46:28.375354+0000","last_became_active":"2024-09-18T01:45:14.318093+0000","last_became_peered":"2024-09-18T01:45:14.318093+0000","last_unstale":"2024-09-18T01:46:28.375354+0000","last_undegraded":"2024-09-18T01:46:28.375354+0000","last_fullsized":"2024-09-18T01:46:28.375354+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:28:17.630868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"33'13","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.879659+0000","last_change":"2024-09-18T01:45:41.348633+0000","last_active":"2024-09-18T01:48:12.879659+0000","last_peered":"2024-09-18T01:48:12.879659+0000","last_clean":"2024-09-18T01:48:12.879659+0000","last_became_active":"2024-09-18T01:45:41.338243+0000","last_became_peered":"2024-09-18T01:45:41.338243+0000","last_unstale":"2024-09-18T01:48:12.879659+0000","last_undegraded":"2024-09-18T01:48:12.879659+0000","last_fullsized":"2024-09-18T01:48:12.879659+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:42:23.528238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":13,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:44.958482+0000","last_change":"2024-09-18T01:45:04.293264+0000","last_active":"2024-09-18T01:45:44.958482+0000","last_peered":"2024-09-18T01:45:44.958482+0000","last_clean":"2024-09-18T01:45:44.958482+0000","last_became_active":"2024-09-18T01:45:04.292853+0000","last_became_peered":"2024-09-18T01:45:04.292853+0000","last_unstale":"2024-09-18T01:45:44.958482+0000","last_undegraded":"2024-09-18T01:45:44.958482+0000","last_fullsized":"2024-09-18T01:45:44.958482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:19:39.056474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338261+0000","last_change":"2024-09-18T01:45:08.288697+0000","last_active":"2024-09-18T01:45:41.338261+0000","last_peered":"2024-09-18T01:45:41.338261+0000","last_clean":"2024-09-18T01:45:41.338261+0000","last_became_active":"2024-09-18T01:45:08.288390+0000","last_became_peered":"2024-09-18T01:45:08.288390+0000","last_unstale":"2024-09-18T01:45:41.338261+0000","last_undegraded":"2024-09-18T01:45:41.338261+0000","last_fullsized":"2024-09-18T01:45:41.338261+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:45:19.311056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"31'12","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337413+0000","last_change":"2024-09-18T01:45:10.303251+0000","last_active":"2024-09-18T01:45:41.337413+0000","last_peered":"2024-09-18T01:45:41.337413+0000","last_clean":"2024-09-18T01:45:41.337413+0000","last_became_active":"2024-09-18T01:45:10.302957+0000","last_became_peered":"2024-09-18T01:45:10.302957+0000","last_unstale":"2024-09-18T01:45:41.337413+0000","last_undegraded":"2024-09-18T01:45:41.337413+0000","last_fullsized":"2024-09-18T01:45:41.337413+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:22:48.911652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337811+0000","last_change":"2024-09-18T01:45:12.317743+0000","last_active":"2024-09-18T01:45:41.337811+0000","last_peered":"2024-09-18T01:45:41.337811+0000","last_clean":"2024-09-18T01:45:41.337811+0000","last_became_active":"2024-09-18T01:45:12.317471+0000","last_became_peered":"2024-09-18T01:45:12.317471+0000","last_unstale":"2024-09-18T01:45:41.337811+0000","last_undegraded":"2024-09-18T01:45:41.337811+0000","last_fullsized":"2024-09-18T01:45:41.337811+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:18:50.168373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337317+0000","last_change":"2024-09-18T01:45:14.319762+0000","last_active":"2024-09-18T01:45:41.337317+0000","last_peered":"2024-09-18T01:45:41.337317+0000","last_clean":"2024-09-18T01:45:41.337317+0000","last_became_active":"2024-09-18T01:45:14.319387+0000","last_became_peered":"2024-09-18T01:45:14.319387+0000","last_unstale":"2024-09-18T01:45:41.337317+0000","last_undegraded":"2024-09-18T01:45:41.337317+0000","last_fullsized":"2024-09-18T01:45:41.337317+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:54:12.321781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'10","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.171155+0000","last_change":"2024-09-18T01:45:06.284632+0000","last_active":"2024-09-18T01:47:12.171155+0000","last_peered":"2024-09-18T01:47:12.171155+0000","last_clean":"2024-09-18T01:47:12.171155+0000","last_became_active":"2024-09-18T01:45:06.283815+0000","last_became_peered":"2024-09-18T01:45:06.283815+0000","last_unstale":"2024-09-18T01:47:12.171155+0000","last_undegraded":"2024-09-18T01:47:12.171155+0000","last_fullsized":"2024-09-18T01:47:12.171155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:55:34.371724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.335146+0000","last_change":"2024-09-18T01:45:04.293546+0000","last_active":"2024-09-18T01:45:41.335146+0000","last_peered":"2024-09-18T01:45:41.335146+0000","last_clean":"2024-09-18T01:45:41.335146+0000","last_became_active":"2024-09-18T01:45:04.288040+0000","last_became_peered":"2024-09-18T01:45:04.288040+0000","last_unstale":"2024-09-18T01:45:41.335146+0000","last_undegraded":"2024-09-18T01:45:41.335146+0000","last_fullsized":"2024-09-18T01:45:41.335146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:12:25.099822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.340495+0000","last_change":"2024-09-18T01:45:08.288920+0000","last_active":"2024-09-18T01:45:41.340495+0000","last_peered":"2024-09-18T01:45:41.340495+0000","last_clean":"2024-09-18T01:45:41.340495+0000","last_became_active":"2024-09-18T01:45:08.288667+0000","last_became_peered":"2024-09-18T01:45:08.288667+0000","last_unstale":"2024-09-18T01:45:41.340495+0000","last_undegraded":"2024-09-18T01:45:41.340495+0000","last_fullsized":"2024-09-18T01:45:41.340495+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:58:00.539983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"31'23","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.333260+0000","last_change":"2024-09-18T01:45:10.304260+0000","last_active":"2024-09-18T01:45:41.333260+0000","last_peered":"2024-09-18T01:45:41.333260+0000","last_clean":"2024-09-18T01:45:41.333260+0000","last_became_active":"2024-09-18T01:45:10.304004+0000","last_became_peered":"2024-09-18T01:45:10.304004+0000","last_unstale":"2024-09-18T01:45:41.333260+0000","last_undegraded":"2024-09-18T01:45:41.333260+0000","last_fullsized":"2024-09-18T01:45:41.333260+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:39:04.390442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'282","reported_seq":384,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.988981+0000","last_change":"2024-09-18T01:45:12.317560+0000","last_active":"2024-09-18T01:48:12.988981+0000","last_peered":"2024-09-18T01:48:12.988981+0000","last_clean":"2024-09-18T01:48:12.988981+0000","last_became_active":"2024-09-18T01:45:12.317288+0000","last_became_peered":"2024-09-18T01:45:12.317288+0000","last_unstale":"2024-09-18T01:48:12.988981+0000","last_undegraded":"2024-09-18T01:48:12.988981+0000","last_fullsized":"2024-09-18T01:48:12.988981+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:48:33.500493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.331675+0000","last_change":"2024-09-18T01:45:14.326621+0000","last_active":"2024-09-18T01:45:41.331675+0000","last_peered":"2024-09-18T01:45:41.331675+0000","last_clean":"2024-09-18T01:45:41.331675+0000","last_became_active":"2024-09-18T01:45:14.325843+0000","last_became_peered":"2024-09-18T01:45:14.325843+0000","last_unstale":"2024-09-18T01:45:41.331675+0000","last_undegraded":"2024-09-18T01:45:41.331675+0000","last_fullsized":"2024-09-18T01:45:41.331675+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:49:37.077451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.340482+0000","last_change":"2024-09-18T01:45:06.295671+0000","last_active":"2024-09-18T01:45:41.340482+0000","last_peered":"2024-09-18T01:45:41.340482+0000","last_clean":"2024-09-18T01:45:41.340482+0000","last_became_active":"2024-09-18T01:45:06.295417+0000","last_became_peered":"2024-09-18T01:45:06.295417+0000","last_unstale":"2024-09-18T01:45:41.340482+0000","last_undegraded":"2024-09-18T01:45:41.340482+0000","last_fullsized":"2024-09-18T01:45:41.340482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:20:03.455685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:46.101670+0000","last_change":"2024-09-18T01:45:04.282935+0000","last_active":"2024-09-18T01:45:46.101670+0000","last_peered":"2024-09-18T01:45:46.101670+0000","last_clean":"2024-09-18T01:45:46.101670+0000","last_became_active":"2024-09-18T01:45:04.282500+0000","last_became_peered":"2024-09-18T01:45:04.282500+0000","last_unstale":"2024-09-18T01:45:46.101670+0000","last_undegraded":"2024-09-18T01:45:46.101670+0000","last_fullsized":"2024-09-18T01:45:46.101670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:59:04.808153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338959+0000","last_change":"2024-09-18T01:45:08.296538+0000","last_active":"2024-09-18T01:45:41.338959+0000","last_peered":"2024-09-18T01:45:41.338959+0000","last_clean":"2024-09-18T01:45:41.338959+0000","last_became_active":"2024-09-18T01:45:08.296192+0000","last_became_peered":"2024-09-18T01:45:08.296192+0000","last_unstale":"2024-09-18T01:45:41.338959+0000","last_undegraded":"2024-09-18T01:45:41.338959+0000","last_fullsized":"2024-09-18T01:45:41.338959+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:28:48.199978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'36","reported_seq":84,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:10.678613+0000","last_change":"2024-09-18T01:45:10.305819+0000","last_active":"2024-09-18T01:47:10.678613+0000","last_peered":"2024-09-18T01:47:10.678613+0000","last_clean":"2024-09-18T01:47:10.678613+0000","last_became_active":"2024-09-18T01:45:10.305515+0000","last_became_peered":"2024-09-18T01:45:10.305515+0000","last_unstale":"2024-09-18T01:47:10.678613+0000","last_undegraded":"2024-09-18T01:47:10.678613+0000","last_fullsized":"2024-09-18T01:47:10.678613+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:54:15.247041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'282","reported_seq":400,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.874424+0000","last_change":"2024-09-18T01:45:12.313547+0000","last_active":"2024-09-18T01:48:12.874424+0000","last_peered":"2024-09-18T01:48:12.874424+0000","last_clean":"2024-09-18T01:48:12.874424+0000","last_became_active":"2024-09-18T01:45:12.313219+0000","last_became_peered":"2024-09-18T01:45:12.313219+0000","last_unstale":"2024-09-18T01:48:12.874424+0000","last_undegraded":"2024-09-18T01:48:12.874424+0000","last_fullsized":"2024-09-18T01:48:12.874424+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:18:26.966437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.334693+0000","last_change":"2024-09-18T01:45:06.297804+0000","last_active":"2024-09-18T01:45:41.334693+0000","last_peered":"2024-09-18T01:45:41.334693+0000","last_clean":"2024-09-18T01:45:41.334693+0000","last_became_active":"2024-09-18T01:45:06.297283+0000","last_became_peered":"2024-09-18T01:45:06.297283+0000","last_unstale":"2024-09-18T01:45:41.334693+0000","last_undegraded":"2024-09-18T01:45:41.334693+0000","last_fullsized":"2024-09-18T01:45:41.334693+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:34:09.651529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.333900+0000","last_change":"2024-09-18T01:45:04.289955+0000","last_active":"2024-09-18T01:45:41.333900+0000","last_peered":"2024-09-18T01:45:41.333900+0000","last_clean":"2024-09-18T01:45:41.333900+0000","last_became_active":"2024-09-18T01:45:04.289629+0000","last_became_peered":"2024-09-18T01:45:04.289629+0000","last_unstale":"2024-09-18T01:45:41.333900+0000","last_undegraded":"2024-09-18T01:45:41.333900+0000","last_fullsized":"2024-09-18T01:45:41.333900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:43:03.344288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.333438+0000","last_change":"2024-09-18T01:45:08.294834+0000","last_active":"2024-09-18T01:45:41.333438+0000","last_peered":"2024-09-18T01:45:41.333438+0000","last_clean":"2024-09-18T01:45:41.333438+0000","last_became_active":"2024-09-18T01:45:08.294273+0000","last_became_peered":"2024-09-18T01:45:08.294273+0000","last_unstale":"2024-09-18T01:45:41.333438+0000","last_undegraded":"2024-09-18T01:45:41.333438+0000","last_fullsized":"2024-09-18T01:45:41.333438+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:54:13.237972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'46","reported_seq":99,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:10.687815+0000","last_change":"2024-09-18T01:45:10.298381+0000","last_active":"2024-09-18T01:47:10.687815+0000","last_peered":"2024-09-18T01:47:10.687815+0000","last_clean":"2024-09-18T01:47:10.687815+0000","last_became_active":"2024-09-18T01:45:10.298021+0000","last_became_peered":"2024-09-18T01:45:10.298021+0000","last_unstale":"2024-09-18T01:47:10.687815+0000","last_undegraded":"2024-09-18T01:47:10.687815+0000","last_fullsized":"2024-09-18T01:47:10.687815+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:39:10.135582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338655+0000","last_change":"2024-09-18T01:45:12.314207+0000","last_active":"2024-09-18T01:45:41.338655+0000","last_peered":"2024-09-18T01:45:41.338655+0000","last_clean":"2024-09-18T01:45:41.338655+0000","last_became_active":"2024-09-18T01:45:12.313875+0000","last_became_peered":"2024-09-18T01:45:12.313875+0000","last_unstale":"2024-09-18T01:45:41.338655+0000","last_undegraded":"2024-09-18T01:45:41.338655+0000","last_fullsized":"2024-09-18T01:45:41.338655+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:42:29.558204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'7","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:46:28.376975+0000","last_change":"2024-09-18T01:45:14.322757+0000","last_active":"2024-09-18T01:46:28.376975+0000","last_peered":"2024-09-18T01:46:28.376975+0000","last_clean":"2024-09-18T01:46:28.376975+0000","last_became_active":"2024-09-18T01:45:14.322448+0000","last_became_peered":"2024-09-18T01:45:14.322448+0000","last_unstale":"2024-09-18T01:46:28.376975+0000","last_undegraded":"2024-09-18T01:46:28.376975+0000","last_fullsized":"2024-09-18T01:46:28.376975+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:13:39.692712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":17,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'8","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.649737+0000","last_change":"2024-09-18T01:45:06.292485+0000","last_active":"2024-09-18T01:48:12.649737+0000","last_peered":"2024-09-18T01:48:12.649737+0000","last_clean":"2024-09-18T01:48:12.649737+0000","last_became_active":"2024-09-18T01:45:06.292143+0000","last_became_peered":"2024-09-18T01:45:06.292143+0000","last_unstale":"2024-09-18T01:48:12.649737+0000","last_undegraded":"2024-09-18T01:48:12.649737+0000","last_fullsized":"2024-09-18T01:48:12.649737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:45:59.773285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.333555+0000","last_change":"2024-09-18T01:45:04.293049+0000","last_active":"2024-09-18T01:45:41.333555+0000","last_peered":"2024-09-18T01:45:41.333555+0000","last_clean":"2024-09-18T01:45:41.333555+0000","last_became_active":"2024-09-18T01:45:04.292734+0000","last_became_peered":"2024-09-18T01:45:04.292734+0000","last_unstale":"2024-09-18T01:45:41.333555+0000","last_undegraded":"2024-09-18T01:45:41.333555+0000","last_fullsized":"2024-09-18T01:45:41.333555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:42:11.703254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337869+0000","last_change":"2024-09-18T01:45:08.294254+0000","last_active":"2024-09-18T01:45:41.337869+0000","last_peered":"2024-09-18T01:45:41.337869+0000","last_clean":"2024-09-18T01:45:41.337869+0000","last_became_active":"2024-09-18T01:45:08.294026+0000","last_became_peered":"2024-09-18T01:45:08.294026+0000","last_unstale":"2024-09-18T01:45:41.337869+0000","last_undegraded":"2024-09-18T01:45:41.337869+0000","last_fullsized":"2024-09-18T01:45:41.337869+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:41:44.964492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'36","reported_seq":84,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:10.668222+0000","last_change":"2024-09-18T01:45:10.308697+0000","last_active":"2024-09-18T01:47:10.668222+0000","last_peered":"2024-09-18T01:47:10.668222+0000","last_clean":"2024-09-18T01:47:10.668222+0000","last_became_active":"2024-09-18T01:45:10.307420+0000","last_became_peered":"2024-09-18T01:45:10.307420+0000","last_unstale":"2024-09-18T01:47:10.668222+0000","last_undegraded":"2024-09-18T01:47:10.668222+0000","last_fullsized":"2024-09-18T01:47:10.668222+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:50:42.386927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337545+0000","last_change":"2024-09-18T01:45:12.306113+0000","last_active":"2024-09-18T01:45:41.337545+0000","last_peered":"2024-09-18T01:45:41.337545+0000","last_clean":"2024-09-18T01:45:41.337545+0000","last_became_active":"2024-09-18T01:45:12.305838+0000","last_became_peered":"2024-09-18T01:45:12.305838+0000","last_unstale":"2024-09-18T01:45:41.337545+0000","last_undegraded":"2024-09-18T01:45:41.337545+0000","last_fullsized":"2024-09-18T01:45:41.337545+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:18:50.168373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'3","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:46:22.809927+0000","last_change":"2024-09-18T01:45:14.322540+0000","last_active":"2024-09-18T01:46:22.809927+0000","last_peered":"2024-09-18T01:46:22.809927+0000","last_clean":"2024-09-18T01:46:22.809927+0000","last_became_active":"2024-09-18T01:45:14.322272+0000","last_became_peered":"2024-09-18T01:45:14.322272+0000","last_unstale":"2024-09-18T01:46:22.809927+0000","last_undegraded":"2024-09-18T01:46:22.809927+0000","last_fullsized":"2024-09-18T01:46:22.809927+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:16:32.686304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"33'8","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.561148+0000","last_change":"2024-09-18T01:45:06.284946+0000","last_active":"2024-09-18T01:48:12.561148+0000","last_peered":"2024-09-18T01:48:12.561148+0000","last_clean":"2024-09-18T01:48:12.561148+0000","last_became_active":"2024-09-18T01:45:06.284677+0000","last_became_peered":"2024-09-18T01:45:06.284677+0000","last_unstale":"2024-09-18T01:48:12.561148+0000","last_undegraded":"2024-09-18T01:48:12.561148+0000","last_fullsized":"2024-09-18T01:48:12.561148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:38:48.328050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.341273+0000","last_change":"2024-09-18T01:45:04.287402+0000","last_active":"2024-09-18T01:45:41.341273+0000","last_peered":"2024-09-18T01:45:41.341273+0000","last_clean":"2024-09-18T01:45:41.341273+0000","last_became_active":"2024-09-18T01:45:04.284151+0000","last_became_peered":"2024-09-18T01:45:04.284151+0000","last_unstale":"2024-09-18T01:45:41.341273+0000","last_undegraded":"2024-09-18T01:45:41.341273+0000","last_fullsized":"2024-09-18T01:45:41.341273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:38:31.469925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.340511+0000","last_change":"2024-09-18T01:45:08.289806+0000","last_active":"2024-09-18T01:45:41.340511+0000","last_peered":"2024-09-18T01:45:41.340511+0000","last_clean":"2024-09-18T01:45:41.340511+0000","last_became_active":"2024-09-18T01:45:08.289521+0000","last_became_peered":"2024-09-18T01:45:08.289521+0000","last_unstale":"2024-09-18T01:45:41.340511+0000","last_undegraded":"2024-09-18T01:45:41.340511+0000","last_fullsized":"2024-09-18T01:45:41.340511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:54:13.237972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'49","reported_seq":106,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.175815+0000","last_change":"2024-09-18T01:45:10.307198+0000","last_active":"2024-09-18T01:47:12.175815+0000","last_peered":"2024-09-18T01:47:12.175815+0000","last_clean":"2024-09-18T01:47:12.175815+0000","last_became_active":"2024-09-18T01:45:10.306481+0000","last_became_peered":"2024-09-18T01:45:10.306481+0000","last_unstale":"2024-09-18T01:47:12.175815+0000","last_undegraded":"2024-09-18T01:47:12.175815+0000","last_fullsized":"2024-09-18T01:47:12.175815+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:26:59.982744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'282","reported_seq":347,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.998004+0000","last_change":"2024-09-18T01:45:12.313366+0000","last_active":"2024-09-18T01:48:12.998004+0000","last_peered":"2024-09-18T01:48:12.998004+0000","last_clean":"2024-09-18T01:48:12.998004+0000","last_became_active":"2024-09-18T01:45:12.313065+0000","last_became_peered":"2024-09-18T01:45:12.313065+0000","last_unstale":"2024-09-18T01:48:12.998004+0000","last_undegraded":"2024-09-18T01:48:12.998004+0000","last_fullsized":"2024-09-18T01:48:12.998004+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:22:43.654693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"33'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:09.007672+0000","last_change":"2024-09-18T01:45:14.320158+0000","last_active":"2024-09-18T01:47:09.007672+0000","last_peered":"2024-09-18T01:47:09.007672+0000","last_clean":"2024-09-18T01:47:09.007672+0000","last_became_active":"2024-09-18T01:45:14.319805+0000","last_became_peered":"2024-09-18T01:45:14.319805+0000","last_unstale":"2024-09-18T01:47:09.007672+0000","last_undegraded":"2024-09-18T01:47:09.007672+0000","last_fullsized":"2024-09-18T01:47:09.007672+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:14:33.982138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"33'10","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.846365+0000","last_change":"2024-09-18T01:45:06.282059+0000","last_active":"2024-09-18T01:48:12.846365+0000","last_peered":"2024-09-18T01:48:12.846365+0000","last_clean":"2024-09-18T01:48:12.846365+0000","last_became_active":"2024-09-18T01:45:06.281444+0000","last_became_peered":"2024-09-18T01:45:06.281444+0000","last_unstale":"2024-09-18T01:48:12.846365+0000","last_undegraded":"2024-09-18T01:48:12.846365+0000","last_fullsized":"2024-09-18T01:48:12.846365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:33:43.173746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.336364+0000","last_change":"2024-09-18T01:45:04.289841+0000","last_active":"2024-09-18T01:45:41.336364+0000","last_peered":"2024-09-18T01:45:41.336364+0000","last_clean":"2024-09-18T01:45:41.336364+0000","last_became_active":"2024-09-18T01:45:04.289216+0000","last_became_peered":"2024-09-18T01:45:04.289216+0000","last_unstale":"2024-09-18T01:45:41.336364+0000","last_undegraded":"2024-09-18T01:45:41.336364+0000","last_fullsized":"2024-09-18T01:45:41.336364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:06:46.722311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338235+0000","last_change":"2024-09-18T01:45:08.289975+0000","last_active":"2024-09-18T01:45:41.338235+0000","last_peered":"2024-09-18T01:45:41.338235+0000","last_clean":"2024-09-18T01:45:41.338235+0000","last_became_active":"2024-09-18T01:45:08.289725+0000","last_became_peered":"2024-09-18T01:45:08.289725+0000","last_unstale":"2024-09-18T01:45:41.338235+0000","last_undegraded":"2024-09-18T01:45:41.338235+0000","last_fullsized":"2024-09-18T01:45:41.338235+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:52:13.262244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"33'72","reported_seq":140,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:22.215996+0000","last_change":"2024-09-18T01:45:10.310077+0000","last_active":"2024-09-18T01:47:22.215996+0000","last_peered":"2024-09-18T01:47:22.215996+0000","last_clean":"2024-09-18T01:47:22.215996+0000","last_became_active":"2024-09-18T01:45:10.309360+0000","last_became_peered":"2024-09-18T01:45:10.309360+0000","last_unstale":"2024-09-18T01:47:22.215996+0000","last_undegraded":"2024-09-18T01:47:22.215996+0000","last_fullsized":"2024-09-18T01:47:22.215996+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:01:23.922671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7613,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":75,"num_read_kb":82,"num_write":36,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337356+0000","last_change":"2024-09-18T01:45:12.312912+0000","last_active":"2024-09-18T01:45:41.337356+0000","last_peered":"2024-09-18T01:45:41.337356+0000","last_clean":"2024-09-18T01:45:41.337356+0000","last_became_active":"2024-09-18T01:45:12.312665+0000","last_became_peered":"2024-09-18T01:45:12.312665+0000","last_unstale":"2024-09-18T01:45:41.337356+0000","last_undegraded":"2024-09-18T01:45:41.337356+0000","last_fullsized":"2024-09-18T01:45:41.337356+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:43:30.182833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'18","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.975756+0000","last_change":"2024-09-18T01:45:14.320179+0000","last_active":"2024-09-18T01:48:12.975756+0000","last_peered":"2024-09-18T01:48:12.975756+0000","last_clean":"2024-09-18T01:48:12.975756+0000","last_became_active":"2024-09-18T01:45:14.319638+0000","last_became_peered":"2024-09-18T01:45:14.319638+0000","last_unstale":"2024-09-18T01:48:12.975756+0000","last_undegraded":"2024-09-18T01:48:12.975756+0000","last_fullsized":"2024-09-18T01:48:12.975756+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:22:20.011207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:46:28.552953+0000","last_change":"2024-09-18T01:45:06.290368+0000","last_active":"2024-09-18T01:46:28.552953+0000","last_peered":"2024-09-18T01:46:28.552953+0000","last_clean":"2024-09-18T01:46:28.552953+0000","last_became_active":"2024-09-18T01:45:06.290087+0000","last_became_peered":"2024-09-18T01:45:06.290087+0000","last_unstale":"2024-09-18T01:46:28.552953+0000","last_undegraded":"2024-09-18T01:46:28.552953+0000","last_fullsized":"2024-09-18T01:46:28.552953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:25:24.068245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338514+0000","last_change":"2024-09-18T01:45:04.279319+0000","last_active":"2024-09-18T01:45:41.338514+0000","last_peered":"2024-09-18T01:45:41.338514+0000","last_clean":"2024-09-18T01:45:41.338514+0000","last_became_active":"2024-09-18T01:45:04.278979+0000","last_became_peered":"2024-09-18T01:45:04.278979+0000","last_unstale":"2024-09-18T01:45:41.338514+0000","last_undegraded":"2024-09-18T01:45:41.338514+0000","last_fullsized":"2024-09-18T01:45:41.338514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:21:29.013936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.334526+0000","last_change":"2024-09-18T01:45:08.292446+0000","last_active":"2024-09-18T01:45:41.334526+0000","last_peered":"2024-09-18T01:45:41.334526+0000","last_clean":"2024-09-18T01:45:41.334526+0000","last_became_active":"2024-09-18T01:45:08.292156+0000","last_became_peered":"2024-09-18T01:45:08.292156+0000","last_unstale":"2024-09-18T01:45:41.334526+0000","last_undegraded":"2024-09-18T01:45:41.334526+0000","last_fullsized":"2024-09-18T01:45:41.334526+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:03:59.192175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'38","reported_seq":87,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:10.672505+0000","last_change":"2024-09-18T01:45:10.300769+0000","last_active":"2024-09-18T01:47:10.672505+0000","last_peered":"2024-09-18T01:47:10.672505+0000","last_clean":"2024-09-18T01:47:10.672505+0000","last_became_active":"2024-09-18T01:45:10.300488+0000","last_became_peered":"2024-09-18T01:45:10.300488+0000","last_unstale":"2024-09-18T01:47:10.672505+0000","last_undegraded":"2024-09-18T01:47:10.672505+0000","last_fullsized":"2024-09-18T01:47:10.672505+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:55:38.390166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338499+0000","last_change":"2024-09-18T01:45:12.315977+0000","last_active":"2024-09-18T01:45:41.338499+0000","last_peered":"2024-09-18T01:45:41.338499+0000","last_clean":"2024-09-18T01:45:41.338499+0000","last_became_active":"2024-09-18T01:45:12.315695+0000","last_became_peered":"2024-09-18T01:45:12.315695+0000","last_unstale":"2024-09-18T01:45:41.338499+0000","last_undegraded":"2024-09-18T01:45:41.338499+0000","last_fullsized":"2024-09-18T01:45:41.338499+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:50:11.915634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"33'3","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:17.215042+0000","last_change":"2024-09-18T01:45:14.326486+0000","last_active":"2024-09-18T01:47:17.215042+0000","last_peered":"2024-09-18T01:47:17.215042+0000","last_clean":"2024-09-18T01:47:17.215042+0000","last_became_active":"2024-09-18T01:45:14.326209+0000","last_became_peered":"2024-09-18T01:45:14.326209+0000","last_unstale":"2024-09-18T01:47:17.215042+0000","last_undegraded":"2024-09-18T01:47:17.215042+0000","last_fullsized":"2024-09-18T01:47:17.215042+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:34:51.151050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.650286+0000","last_change":"2024-09-18T01:45:06.287753+0000","last_active":"2024-09-18T01:48:12.650286+0000","last_peered":"2024-09-18T01:48:12.650286+0000","last_clean":"2024-09-18T01:48:12.650286+0000","last_became_active":"2024-09-18T01:45:06.285771+0000","last_became_peered":"2024-09-18T01:45:06.285771+0000","last_unstale":"2024-09-18T01:48:12.650286+0000","last_undegraded":"2024-09-18T01:48:12.650286+0000","last_fullsized":"2024-09-18T01:48:12.650286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:17:37.283863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.488957+0000","last_change":"2024-09-18T01:45:04.287560+0000","last_active":"2024-09-18T01:48:12.488957+0000","last_peered":"2024-09-18T01:48:12.488957+0000","last_clean":"2024-09-18T01:48:12.488957+0000","last_became_active":"2024-09-18T01:45:04.287263+0000","last_became_peered":"2024-09-18T01:45:04.287263+0000","last_unstale":"2024-09-18T01:48:12.488957+0000","last_undegraded":"2024-09-18T01:48:12.488957+0000","last_fullsized":"2024-09-18T01:48:12.488957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:31:33.162869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4834176,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338326+0000","last_change":"2024-09-18T01:45:08.289876+0000","last_active":"2024-09-18T01:45:41.338326+0000","last_peered":"2024-09-18T01:45:41.338326+0000","last_clean":"2024-09-18T01:45:41.338326+0000","last_became_active":"2024-09-18T01:45:08.289604+0000","last_became_peered":"2024-09-18T01:45:08.289604+0000","last_unstale":"2024-09-18T01:45:41.338326+0000","last_undegraded":"2024-09-18T01:45:41.338326+0000","last_fullsized":"2024-09-18T01:45:41.338326+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:31:10.969818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'37","reported_seq":82,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:10.698206+0000","last_change":"2024-09-18T01:45:10.297783+0000","last_active":"2024-09-18T01:47:10.698206+0000","last_peered":"2024-09-18T01:47:10.698206+0000","last_clean":"2024-09-18T01:47:10.698206+0000","last_became_active":"2024-09-18T01:45:10.297511+0000","last_became_peered":"2024-09-18T01:45:10.297511+0000","last_unstale":"2024-09-18T01:47:10.698206+0000","last_undegraded":"2024-09-18T01:47:10.698206+0000","last_fullsized":"2024-09-18T01:47:10.698206+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:31:01.665963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'282","reported_seq":402,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.980142+0000","last_change":"2024-09-18T01:45:12.315306+0000","last_active":"2024-09-18T01:48:12.980142+0000","last_peered":"2024-09-18T01:48:12.980142+0000","last_clean":"2024-09-18T01:48:12.980142+0000","last_became_active":"2024-09-18T01:45:12.314918+0000","last_became_peered":"2024-09-18T01:45:12.314918+0000","last_unstale":"2024-09-18T01:48:12.980142+0000","last_undegraded":"2024-09-18T01:48:12.980142+0000","last_fullsized":"2024-09-18T01:48:12.980142+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:48:31.572835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'12","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:22.214176+0000","last_change":"2024-09-18T01:45:14.319866+0000","last_active":"2024-09-18T01:47:22.214176+0000","last_peered":"2024-09-18T01:47:22.214176+0000","last_clean":"2024-09-18T01:47:22.214176+0000","last_became_active":"2024-09-18T01:45:14.319364+0000","last_became_peered":"2024-09-18T01:45:14.319364+0000","last_unstale":"2024-09-18T01:47:22.214176+0000","last_undegraded":"2024-09-18T01:47:22.214176+0000","last_fullsized":"2024-09-18T01:47:22.214176+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:15:20.848541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.171328+0000","last_change":"2024-09-18T01:45:06.291329+0000","last_active":"2024-09-18T01:47:12.171328+0000","last_peered":"2024-09-18T01:47:12.171328+0000","last_clean":"2024-09-18T01:47:12.171328+0000","last_became_active":"2024-09-18T01:45:06.291023+0000","last_became_peered":"2024-09-18T01:45:06.291023+0000","last_unstale":"2024-09-18T01:47:12.171328+0000","last_undegraded":"2024-09-18T01:47:12.171328+0000","last_fullsized":"2024-09-18T01:47:12.171328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:45:59.773285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:08.999758+0000","last_change":"2024-09-18T01:45:04.294066+0000","last_active":"2024-09-18T01:47:08.999758+0000","last_peered":"2024-09-18T01:47:08.999758+0000","last_clean":"2024-09-18T01:47:08.999758+0000","last_became_active":"2024-09-18T01:45:04.288386+0000","last_became_peered":"2024-09-18T01:45:04.288386+0000","last_unstale":"2024-09-18T01:47:08.999758+0000","last_undegraded":"2024-09-18T01:47:08.999758+0000","last_fullsized":"2024-09-18T01:47:08.999758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:48:15.254246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'3","reported_seq":413,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:11.793360+0000","last_change":"2024-09-18T01:45:08.290260+0000","last_active":"2024-09-18T01:47:11.793360+0000","last_peered":"2024-09-18T01:47:11.793360+0000","last_clean":"2024-09-18T01:47:11.793360+0000","last_became_active":"2024-09-18T01:45:08.289478+0000","last_became_peered":"2024-09-18T01:45:08.289478+0000","last_unstale":"2024-09-18T01:47:11.793360+0000","last_undegraded":"2024-09-18T01:47:11.793360+0000","last_fullsized":"2024-09-18T01:47:11.793360+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:51:28.759649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'11","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:27.217179+0000","last_change":"2024-09-18T01:45:10.307653+0000","last_active":"2024-09-18T01:47:27.217179+0000","last_peered":"2024-09-18T01:47:27.217179+0000","last_clean":"2024-09-18T01:47:27.217179+0000","last_became_active":"2024-09-18T01:45:10.307374+0000","last_became_peered":"2024-09-18T01:45:10.307374+0000","last_unstale":"2024-09-18T01:47:27.217179+0000","last_undegraded":"2024-09-18T01:47:27.217179+0000","last_fullsized":"2024-09-18T01:47:27.217179+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:33:37.464748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'282","reported_seq":464,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.939532+0000","last_change":"2024-09-18T01:45:12.312200+0000","last_active":"2024-09-18T01:48:12.939532+0000","last_peered":"2024-09-18T01:48:12.939532+0000","last_clean":"2024-09-18T01:48:12.939532+0000","last_became_active":"2024-09-18T01:45:12.311929+0000","last_became_peered":"2024-09-18T01:45:12.311929+0000","last_unstale":"2024-09-18T01:48:12.939532+0000","last_undegraded":"2024-09-18T01:48:12.939532+0000","last_fullsized":"2024-09-18T01:48:12.939532+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:13:37.683828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"33'6","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.168494+0000","last_change":"2024-09-18T01:45:14.318697+0000","last_active":"2024-09-18T01:47:12.168494+0000","last_peered":"2024-09-18T01:47:12.168494+0000","last_clean":"2024-09-18T01:47:12.168494+0000","last_became_active":"2024-09-18T01:45:14.318418+0000","last_became_peered":"2024-09-18T01:45:14.318418+0000","last_unstale":"2024-09-18T01:47:12.168494+0000","last_undegraded":"2024-09-18T01:47:12.168494+0000","last_fullsized":"2024-09-18T01:47:12.168494+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:24:51.317832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"31'4","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.339105+0000","last_change":"2024-09-18T01:45:06.297190+0000","last_active":"2024-09-18T01:45:41.339105+0000","last_peered":"2024-09-18T01:45:41.339105+0000","last_clean":"2024-09-18T01:45:41.339105+0000","last_became_active":"2024-09-18T01:45:06.296824+0000","last_became_peered":"2024-09-18T01:45:06.296824+0000","last_unstale":"2024-09-18T01:45:41.339105+0000","last_undegraded":"2024-09-18T01:45:41.339105+0000","last_fullsized":"2024-09-18T01:45:41.339105+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:26:58.808939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"33'3","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.784627+0000","last_change":"2024-09-18T01:45:04.288364+0000","last_active":"2024-09-18T01:48:12.784627+0000","last_peered":"2024-09-18T01:48:12.784627+0000","last_clean":"2024-09-18T01:48:12.784627+0000","last_became_active":"2024-09-18T01:45:04.287961+0000","last_became_peered":"2024-09-18T01:45:04.287961+0000","last_unstale":"2024-09-18T01:48:12.784627+0000","last_undegraded":"2024-09-18T01:48:12.784627+0000","last_fullsized":"2024-09-18T01:48:12.784627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:15:46.315415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338600+0000","last_change":"2024-09-18T01:45:08.294326+0000","last_active":"2024-09-18T01:45:41.338600+0000","last_peered":"2024-09-18T01:45:41.338600+0000","last_clean":"2024-09-18T01:45:41.338600+0000","last_became_active":"2024-09-18T01:45:08.294053+0000","last_became_peered":"2024-09-18T01:45:08.294053+0000","last_unstale":"2024-09-18T01:45:41.338600+0000","last_undegraded":"2024-09-18T01:45:41.338600+0000","last_fullsized":"2024-09-18T01:45:41.338600+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:42:25.537610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'39","reported_seq":85,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:10.684950+0000","last_change":"2024-09-18T01:45:10.300689+0000","last_active":"2024-09-18T01:47:10.684950+0000","last_peered":"2024-09-18T01:47:10.684950+0000","last_clean":"2024-09-18T01:47:10.684950+0000","last_became_active":"2024-09-18T01:45:10.300337+0000","last_became_peered":"2024-09-18T01:45:10.300337+0000","last_unstale":"2024-09-18T01:47:10.684950+0000","last_undegraded":"2024-09-18T01:47:10.684950+0000","last_fullsized":"2024-09-18T01:47:10.684950+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:15:11.668593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.332973+0000","last_change":"2024-09-18T01:45:12.307499+0000","last_active":"2024-09-18T01:45:41.332973+0000","last_peered":"2024-09-18T01:45:41.332973+0000","last_clean":"2024-09-18T01:45:41.332973+0000","last_became_active":"2024-09-18T01:45:12.307210+0000","last_became_peered":"2024-09-18T01:45:12.307210+0000","last_unstale":"2024-09-18T01:45:41.332973+0000","last_undegraded":"2024-09-18T01:45:41.332973+0000","last_fullsized":"2024-09-18T01:45:41.332973+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:15:13.680117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'6","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.909454+0000","last_change":"2024-09-18T01:45:14.315742+0000","last_active":"2024-09-18T01:48:12.909454+0000","last_peered":"2024-09-18T01:48:12.909454+0000","last_clean":"2024-09-18T01:48:12.909454+0000","last_became_active":"2024-09-18T01:45:14.314786+0000","last_became_peered":"2024-09-18T01:45:14.314786+0000","last_unstale":"2024-09-18T01:48:12.909454+0000","last_undegraded":"2024-09-18T01:48:12.909454+0000","last_fullsized":"2024-09-18T01:48:12.909454+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:32:55.619756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.559013+0000","last_change":"2024-09-18T01:45:06.287377+0000","last_active":"2024-09-18T01:48:12.559013+0000","last_peered":"2024-09-18T01:48:12.559013+0000","last_clean":"2024-09-18T01:48:12.559013+0000","last_became_active":"2024-09-18T01:45:06.286138+0000","last_became_peered":"2024-09-18T01:45:06.286138+0000","last_unstale":"2024-09-18T01:48:12.559013+0000","last_undegraded":"2024-09-18T01:48:12.559013+0000","last_fullsized":"2024-09-18T01:48:12.559013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:40:06.654394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":205,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.332689+0000","last_change":"2024-09-18T01:44:49.573399+0000","last_active":"2024-09-18T01:45:41.332689+0000","last_peered":"2024-09-18T01:45:41.332689+0000","last_clean":"2024-09-18T01:45:41.332689+0000","last_became_active":"2024-09-18T01:44:49.572263+0000","last_became_peered":"2024-09-18T01:44:49.572263+0000","last_unstale":"2024-09-18T01:45:41.332689+0000","last_undegraded":"2024-09-18T01:45:41.332689+0000","last_fullsized":"2024-09-18T01:45:41.332689+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:48.210722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:48.210722+0000","last_clean_scrub_stamp":"2024-09-18T01:44:48.210722+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:56:09.389853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.336772+0000","last_change":"2024-09-18T01:44:55.241426+0000","last_active":"2024-09-18T01:45:41.336772+0000","last_peered":"2024-09-18T01:45:41.336772+0000","last_clean":"2024-09-18T01:45:41.336772+0000","last_became_active":"2024-09-18T01:44:53.233974+0000","last_became_peered":"2024-09-18T01:44:53.233974+0000","last_unstale":"2024-09-18T01:45:41.336772+0000","last_undegraded":"2024-09-18T01:45:41.336772+0000","last_fullsized":"2024-09-18T01:45:41.336772+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:12:59.234293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045237700000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:44.957536+0000","last_change":"2024-09-18T01:45:04.289472+0000","last_active":"2024-09-18T01:45:44.957536+0000","last_peered":"2024-09-18T01:45:44.957536+0000","last_clean":"2024-09-18T01:45:44.957536+0000","last_became_active":"2024-09-18T01:45:04.287763+0000","last_became_peered":"2024-09-18T01:45:04.287763+0000","last_unstale":"2024-09-18T01:45:44.957536+0000","last_undegraded":"2024-09-18T01:45:44.957536+0000","last_fullsized":"2024-09-18T01:45:44.957536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:36:04.953932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.336778+0000","last_change":"2024-09-18T01:45:08.288736+0000","last_active":"2024-09-18T01:45:41.336778+0000","last_peered":"2024-09-18T01:45:41.336778+0000","last_clean":"2024-09-18T01:45:41.336778+0000","last_became_active":"2024-09-18T01:45:08.288131+0000","last_became_peered":"2024-09-18T01:45:08.288131+0000","last_unstale":"2024-09-18T01:45:41.336778+0000","last_undegraded":"2024-09-18T01:45:41.336778+0000","last_fullsized":"2024-09-18T01:45:41.336778+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:21:35.087556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'83","reported_seq":158,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:10.696010+0000","last_change":"2024-09-18T01:45:10.305269+0000","last_active":"2024-09-18T01:47:10.696010+0000","last_peered":"2024-09-18T01:47:10.696010+0000","last_clean":"2024-09-18T01:47:10.696010+0000","last_became_active":"2024-09-18T01:45:10.305004+0000","last_became_peered":"2024-09-18T01:45:10.305004+0000","last_unstale":"2024-09-18T01:47:10.696010+0000","last_undegraded":"2024-09-18T01:47:10.696010+0000","last_fullsized":"2024-09-18T01:47:10.696010+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:34:39.601409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.339055+0000","last_change":"2024-09-18T01:45:12.311683+0000","last_active":"2024-09-18T01:45:41.339055+0000","last_peered":"2024-09-18T01:45:41.339055+0000","last_clean":"2024-09-18T01:45:41.339055+0000","last_became_active":"2024-09-18T01:45:12.311337+0000","last_became_peered":"2024-09-18T01:45:12.311337+0000","last_unstale":"2024-09-18T01:45:41.339055+0000","last_undegraded":"2024-09-18T01:45:41.339055+0000","last_fullsized":"2024-09-18T01:45:41.339055+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:36:33.811124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'81","reported_seq":162,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.883680+0000","last_change":"2024-09-18T01:45:14.315079+0000","last_active":"2024-09-18T01:48:12.883680+0000","last_peered":"2024-09-18T01:48:12.883680+0000","last_clean":"2024-09-18T01:48:12.883680+0000","last_became_active":"2024-09-18T01:45:14.314784+0000","last_became_peered":"2024-09-18T01:45:14.314784+0000","last_unstale":"2024-09-18T01:48:12.883680+0000","last_undegraded":"2024-09-18T01:48:12.883680+0000","last_fullsized":"2024-09-18T01:48:12.883680+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:27:35.990001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'4","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:46:28.550502+0000","last_change":"2024-09-18T01:45:41.350104+0000","last_active":"2024-09-18T01:46:28.550502+0000","last_peered":"2024-09-18T01:46:28.550502+0000","last_clean":"2024-09-18T01:46:28.550502+0000","last_became_active":"2024-09-18T01:45:41.338925+0000","last_became_peered":"2024-09-18T01:45:41.338925+0000","last_unstale":"2024-09-18T01:46:28.550502+0000","last_undegraded":"2024-09-18T01:46:28.550502+0000","last_fullsized":"2024-09-18T01:46:28.550502+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:28:46.190605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.333768+0000","last_change":"2024-09-18T01:44:55.242126+0000","last_active":"2024-09-18T01:45:41.333768+0000","last_peered":"2024-09-18T01:45:41.333768+0000","last_clean":"2024-09-18T01:45:41.333768+0000","last_became_active":"2024-09-18T01:44:53.237059+0000","last_became_peered":"2024-09-18T01:44:53.237059+0000","last_unstale":"2024-09-18T01:45:41.333768+0000","last_undegraded":"2024-09-18T01:45:41.333768+0000","last_fullsized":"2024-09-18T01:45:41.333768+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:32:06.823521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011095359999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337449+0000","last_change":"2024-09-18T01:45:04.273879+0000","last_active":"2024-09-18T01:45:41.337449+0000","last_peered":"2024-09-18T01:45:41.337449+0000","last_clean":"2024-09-18T01:45:41.337449+0000","last_became_active":"2024-09-18T01:45:04.273354+0000","last_became_peered":"2024-09-18T01:45:04.273354+0000","last_unstale":"2024-09-18T01:45:41.337449+0000","last_undegraded":"2024-09-18T01:45:41.337449+0000","last_fullsized":"2024-09-18T01:45:41.337449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:31:48.524360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.341234+0000","last_change":"2024-09-18T01:45:08.292027+0000","last_active":"2024-09-18T01:45:41.341234+0000","last_peered":"2024-09-18T01:45:41.341234+0000","last_clean":"2024-09-18T01:45:41.341234+0000","last_became_active":"2024-09-18T01:45:08.291681+0000","last_became_peered":"2024-09-18T01:45:08.291681+0000","last_unstale":"2024-09-18T01:45:41.341234+0000","last_undegraded":"2024-09-18T01:45:41.341234+0000","last_fullsized":"2024-09-18T01:45:41.341234+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:28:11.601390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'279","reported_seq":487,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:08.374407+0000","last_change":"2024-09-18T01:45:10.305791+0000","last_active":"2024-09-18T01:48:08.374407+0000","last_peered":"2024-09-18T01:48:08.374407+0000","last_clean":"2024-09-18T01:48:08.374407+0000","last_became_active":"2024-09-18T01:45:10.305472+0000","last_became_peered":"2024-09-18T01:45:10.305472+0000","last_unstale":"2024-09-18T01:48:08.374407+0000","last_undegraded":"2024-09-18T01:48:08.374407+0000","last_fullsized":"2024-09-18T01:48:08.374407+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:57:05.219798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":366,"num_read_kb":350,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337053+0000","last_change":"2024-09-18T01:45:12.316867+0000","last_active":"2024-09-18T01:45:41.337053+0000","last_peered":"2024-09-18T01:45:41.337053+0000","last_clean":"2024-09-18T01:45:41.337053+0000","last_became_active":"2024-09-18T01:45:12.316110+0000","last_became_peered":"2024-09-18T01:45:12.316110+0000","last_unstale":"2024-09-18T01:45:41.337053+0000","last_undegraded":"2024-09-18T01:45:41.337053+0000","last_fullsized":"2024-09-18T01:45:41.337053+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:17:14.152691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'5","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:46:28.548072+0000","last_change":"2024-09-18T01:45:14.323262+0000","last_active":"2024-09-18T01:46:28.548072+0000","last_peered":"2024-09-18T01:46:28.548072+0000","last_clean":"2024-09-18T01:46:28.548072+0000","last_became_active":"2024-09-18T01:45:14.322986+0000","last_became_peered":"2024-09-18T01:45:14.322986+0000","last_unstale":"2024-09-18T01:46:28.548072+0000","last_undegraded":"2024-09-18T01:46:28.548072+0000","last_fullsized":"2024-09-18T01:46:28.548072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:04:51.734530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'8","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.840339+0000","last_change":"2024-09-18T01:45:06.293300+0000","last_active":"2024-09-18T01:48:12.840339+0000","last_peered":"2024-09-18T01:48:12.840339+0000","last_clean":"2024-09-18T01:48:12.840339+0000","last_became_active":"2024-09-18T01:45:06.292996+0000","last_became_peered":"2024-09-18T01:45:06.292996+0000","last_unstale":"2024-09-18T01:48:12.840339+0000","last_undegraded":"2024-09-18T01:48:12.840339+0000","last_fullsized":"2024-09-18T01:48:12.840339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:06:48.729806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.331452+0000","last_change":"2024-09-18T01:44:55.620700+0000","last_active":"2024-09-18T01:45:41.331452+0000","last_peered":"2024-09-18T01:45:41.331452+0000","last_clean":"2024-09-18T01:45:41.331452+0000","last_became_active":"2024-09-18T01:44:53.237016+0000","last_became_peered":"2024-09-18T01:44:53.237016+0000","last_unstale":"2024-09-18T01:45:41.331452+0000","last_undegraded":"2024-09-18T01:45:41.331452+0000","last_fullsized":"2024-09-18T01:45:41.331452+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:36:02.583348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039942899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.777626+0000","last_change":"2024-09-18T01:45:04.284372+0000","last_active":"2024-09-18T01:48:12.777626+0000","last_peered":"2024-09-18T01:48:12.777626+0000","last_clean":"2024-09-18T01:48:12.777626+0000","last_became_active":"2024-09-18T01:45:04.283999+0000","last_became_peered":"2024-09-18T01:45:04.283999+0000","last_unstale":"2024-09-18T01:48:12.777626+0000","last_undegraded":"2024-09-18T01:48:12.777626+0000","last_fullsized":"2024-09-18T01:48:12.777626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:16:49.444181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"24'2","reported_seq":219,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:11.793649+0000","last_change":"2024-09-18T01:45:08.284516+0000","last_active":"2024-09-18T01:47:11.793649+0000","last_peered":"2024-09-18T01:47:11.793649+0000","last_clean":"2024-09-18T01:47:11.793649+0000","last_became_active":"2024-09-18T01:45:08.284186+0000","last_became_peered":"2024-09-18T01:45:08.284186+0000","last_unstale":"2024-09-18T01:47:11.793649+0000","last_undegraded":"2024-09-18T01:47:11.793649+0000","last_fullsized":"2024-09-18T01:47:11.793649+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:52:16.095961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'17","reported_seq":84,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.882505+0000","last_change":"2024-09-18T01:45:10.296574+0000","last_active":"2024-09-18T01:48:12.882505+0000","last_peered":"2024-09-18T01:48:12.882505+0000","last_clean":"2024-09-18T01:48:12.882505+0000","last_became_active":"2024-09-18T01:45:10.296284+0000","last_became_peered":"2024-09-18T01:45:10.296284+0000","last_unstale":"2024-09-18T01:48:12.882505+0000","last_undegraded":"2024-09-18T01:48:12.882505+0000","last_fullsized":"2024-09-18T01:48:12.882505+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:58:02.549052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.339121+0000","last_change":"2024-09-18T01:45:12.311612+0000","last_active":"2024-09-18T01:45:41.339121+0000","last_peered":"2024-09-18T01:45:41.339121+0000","last_clean":"2024-09-18T01:45:41.339121+0000","last_became_active":"2024-09-18T01:45:12.311266+0000","last_became_peered":"2024-09-18T01:45:12.311266+0000","last_unstale":"2024-09-18T01:45:41.339121+0000","last_undegraded":"2024-09-18T01:45:41.339121+0000","last_fullsized":"2024-09-18T01:45:41.339121+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:33:04.342308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"33'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:45.861093+0000","last_change":"2024-09-18T01:45:14.318619+0000","last_active":"2024-09-18T01:45:45.861093+0000","last_peered":"2024-09-18T01:45:45.861093+0000","last_clean":"2024-09-18T01:45:45.861093+0000","last_became_active":"2024-09-18T01:45:14.318346+0000","last_became_peered":"2024-09-18T01:45:14.318346+0000","last_unstale":"2024-09-18T01:45:45.861093+0000","last_undegraded":"2024-09-18T01:45:45.861093+0000","last_fullsized":"2024-09-18T01:45:45.861093+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:29:28.994596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.871160+0000","last_change":"2024-09-18T01:45:06.282530+0000","last_active":"2024-09-18T01:48:12.871160+0000","last_peered":"2024-09-18T01:48:12.871160+0000","last_clean":"2024-09-18T01:48:12.871160+0000","last_became_active":"2024-09-18T01:45:06.282319+0000","last_became_peered":"2024-09-18T01:45:06.282319+0000","last_unstale":"2024-09-18T01:48:12.871160+0000","last_undegraded":"2024-09-18T01:48:12.871160+0000","last_fullsized":"2024-09-18T01:48:12.871160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:15:48.322910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.335732+0000","last_change":"2024-09-18T01:44:55.242065+0000","last_active":"2024-09-18T01:45:41.335732+0000","last_peered":"2024-09-18T01:45:41.335732+0000","last_clean":"2024-09-18T01:45:41.335732+0000","last_became_active":"2024-09-18T01:44:53.236990+0000","last_became_peered":"2024-09-18T01:44:53.236990+0000","last_unstale":"2024-09-18T01:45:41.335732+0000","last_undegraded":"2024-09-18T01:45:41.335732+0000","last_fullsized":"2024-09-18T01:45:41.335732+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:45:10.092337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001062627,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.332308+0000","last_change":"2024-09-18T01:45:04.293371+0000","last_active":"2024-09-18T01:45:41.332308+0000","last_peered":"2024-09-18T01:45:41.332308+0000","last_clean":"2024-09-18T01:45:41.332308+0000","last_became_active":"2024-09-18T01:45:04.293064+0000","last_became_peered":"2024-09-18T01:45:04.293064+0000","last_unstale":"2024-09-18T01:45:41.332308+0000","last_undegraded":"2024-09-18T01:45:41.332308+0000","last_fullsized":"2024-09-18T01:45:41.332308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:59:04.808153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.339566+0000","last_change":"2024-09-18T01:45:08.292781+0000","last_active":"2024-09-18T01:45:41.339566+0000","last_peered":"2024-09-18T01:45:41.339566+0000","last_clean":"2024-09-18T01:45:41.339566+0000","last_became_active":"2024-09-18T01:45:08.292477+0000","last_became_peered":"2024-09-18T01:45:08.292477+0000","last_unstale":"2024-09-18T01:45:41.339566+0000","last_undegraded":"2024-09-18T01:45:41.339566+0000","last_fullsized":"2024-09-18T01:45:41.339566+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:39:02.381373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'13","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.186836+0000","last_change":"2024-09-18T01:45:10.308357+0000","last_active":"2024-09-18T01:48:12.186836+0000","last_peered":"2024-09-18T01:48:12.186836+0000","last_clean":"2024-09-18T01:48:12.186836+0000","last_became_active":"2024-09-18T01:45:10.308018+0000","last_became_peered":"2024-09-18T01:45:10.308018+0000","last_unstale":"2024-09-18T01:48:12.186836+0000","last_undegraded":"2024-09-18T01:48:12.186836+0000","last_fullsized":"2024-09-18T01:48:12.186836+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:40:04.662960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338954+0000","last_change":"2024-09-18T01:45:12.315614+0000","last_active":"2024-09-18T01:45:41.338954+0000","last_peered":"2024-09-18T01:45:41.338954+0000","last_clean":"2024-09-18T01:45:41.338954+0000","last_became_active":"2024-09-18T01:45:12.315342+0000","last_became_peered":"2024-09-18T01:45:12.315342+0000","last_unstale":"2024-09-18T01:45:41.338954+0000","last_undegraded":"2024-09-18T01:45:41.338954+0000","last_fullsized":"2024-09-18T01:45:41.338954+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:11:58.173898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"33'6","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.842041+0000","last_change":"2024-09-18T01:45:14.323182+0000","last_active":"2024-09-18T01:48:12.842041+0000","last_peered":"2024-09-18T01:48:12.842041+0000","last_clean":"2024-09-18T01:48:12.842041+0000","last_became_active":"2024-09-18T01:45:14.322568+0000","last_became_peered":"2024-09-18T01:45:14.322568+0000","last_unstale":"2024-09-18T01:48:12.842041+0000","last_undegraded":"2024-09-18T01:48:12.842041+0000","last_fullsized":"2024-09-18T01:48:12.842041+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:58:43.947177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'14","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.840650+0000","last_change":"2024-09-18T01:45:06.292050+0000","last_active":"2024-09-18T01:48:12.840650+0000","last_peered":"2024-09-18T01:48:12.840650+0000","last_clean":"2024-09-18T01:48:12.840650+0000","last_became_active":"2024-09-18T01:45:06.291792+0000","last_became_peered":"2024-09-18T01:45:06.291792+0000","last_unstale":"2024-09-18T01:48:12.840650+0000","last_undegraded":"2024-09-18T01:48:12.840650+0000","last_fullsized":"2024-09-18T01:48:12.840650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:57:38.152681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"31'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.332634+0000","last_change":"2024-09-18T01:45:04.291510+0000","last_active":"2024-09-18T01:45:41.332634+0000","last_peered":"2024-09-18T01:45:41.332634+0000","last_clean":"2024-09-18T01:45:41.332634+0000","last_became_active":"2024-09-18T01:45:04.291211+0000","last_became_peered":"2024-09-18T01:45:04.291211+0000","last_unstale":"2024-09-18T01:45:41.332634+0000","last_undegraded":"2024-09-18T01:45:41.332634+0000","last_fullsized":"2024-09-18T01:45:41.332634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:16:49.444181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338599+0000","last_change":"2024-09-18T01:44:55.234985+0000","last_active":"2024-09-18T01:45:41.338599+0000","last_peered":"2024-09-18T01:45:41.338599+0000","last_clean":"2024-09-18T01:45:41.338599+0000","last_became_active":"2024-09-18T01:44:53.234966+0000","last_became_peered":"2024-09-18T01:44:53.234966+0000","last_unstale":"2024-09-18T01:45:41.338599+0000","last_undegraded":"2024-09-18T01:45:41.338599+0000","last_fullsized":"2024-09-18T01:45:41.338599+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:30:53.728764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045990099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"33'1","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:17.213424+0000","last_change":"2024-09-18T01:45:08.286575+0000","last_active":"2024-09-18T01:47:17.213424+0000","last_peered":"2024-09-18T01:47:17.213424+0000","last_clean":"2024-09-18T01:47:17.213424+0000","last_became_active":"2024-09-18T01:45:08.286195+0000","last_became_peered":"2024-09-18T01:45:08.286195+0000","last_unstale":"2024-09-18T01:47:17.213424+0000","last_undegraded":"2024-09-18T01:47:17.213424+0000","last_fullsized":"2024-09-18T01:47:17.213424+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:39:08.126512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'73","reported_seq":144,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.212620+0000","last_change":"2024-09-18T01:45:10.306220+0000","last_active":"2024-09-18T01:47:12.212620+0000","last_peered":"2024-09-18T01:47:12.212620+0000","last_clean":"2024-09-18T01:47:12.212620+0000","last_became_active":"2024-09-18T01:45:10.305948+0000","last_became_peered":"2024-09-18T01:45:10.305948+0000","last_unstale":"2024-09-18T01:47:12.212620+0000","last_undegraded":"2024-09-18T01:47:12.212620+0000","last_fullsized":"2024-09-18T01:47:12.212620+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:03:14.568657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":77,"num_read_kb":63,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.332043+0000","last_change":"2024-09-18T01:45:12.312116+0000","last_active":"2024-09-18T01:45:41.332043+0000","last_peered":"2024-09-18T01:45:41.332043+0000","last_clean":"2024-09-18T01:45:41.332043+0000","last_became_active":"2024-09-18T01:45:12.311862+0000","last_became_peered":"2024-09-18T01:45:12.311862+0000","last_unstale":"2024-09-18T01:45:41.332043+0000","last_undegraded":"2024-09-18T01:45:41.332043+0000","last_fullsized":"2024-09-18T01:45:41.332043+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:17:48.507658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'13","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.101245+0000","last_change":"2024-09-18T01:45:14.311691+0000","last_active":"2024-09-18T01:47:12.101245+0000","last_peered":"2024-09-18T01:47:12.101245+0000","last_clean":"2024-09-18T01:47:12.101245+0000","last_became_active":"2024-09-18T01:45:14.311403+0000","last_became_peered":"2024-09-18T01:45:14.311403+0000","last_unstale":"2024-09-18T01:47:12.101245+0000","last_undegraded":"2024-09-18T01:47:12.101245+0000","last_fullsized":"2024-09-18T01:47:12.101245+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:47:25.981905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.336217+0000","last_change":"2024-09-18T01:45:06.292173+0000","last_active":"2024-09-18T01:45:41.336217+0000","last_peered":"2024-09-18T01:45:41.336217+0000","last_clean":"2024-09-18T01:45:41.336217+0000","last_became_active":"2024-09-18T01:45:06.291845+0000","last_became_peered":"2024-09-18T01:45:06.291845+0000","last_unstale":"2024-09-18T01:45:41.336217+0000","last_undegraded":"2024-09-18T01:45:41.336217+0000","last_fullsized":"2024-09-18T01:45:41.336217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:06:48.729806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.339145+0000","last_change":"2024-09-18T01:45:04.273877+0000","last_active":"2024-09-18T01:45:41.339145+0000","last_peered":"2024-09-18T01:45:41.339145+0000","last_clean":"2024-09-18T01:45:41.339145+0000","last_became_active":"2024-09-18T01:45:04.273385+0000","last_became_peered":"2024-09-18T01:45:04.273385+0000","last_unstale":"2024-09-18T01:45:41.339145+0000","last_undegraded":"2024-09-18T01:45:41.339145+0000","last_fullsized":"2024-09-18T01:45:41.339145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:05:10.699920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.339297+0000","last_change":"2024-09-18T01:44:55.242318+0000","last_active":"2024-09-18T01:45:41.339297+0000","last_peered":"2024-09-18T01:45:41.339297+0000","last_clean":"2024-09-18T01:45:41.339297+0000","last_became_active":"2024-09-18T01:44:53.236927+0000","last_became_peered":"2024-09-18T01:44:53.236927+0000","last_unstale":"2024-09-18T01:45:41.339297+0000","last_undegraded":"2024-09-18T01:45:41.339297+0000","last_fullsized":"2024-09-18T01:45:41.339297+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:52:39.601060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00130324,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337750+0000","last_change":"2024-09-18T01:45:08.296862+0000","last_active":"2024-09-18T01:45:41.337750+0000","last_peered":"2024-09-18T01:45:41.337750+0000","last_clean":"2024-09-18T01:45:41.337750+0000","last_became_active":"2024-09-18T01:45:08.296118+0000","last_became_peered":"2024-09-18T01:45:08.296118+0000","last_unstale":"2024-09-18T01:45:41.337750+0000","last_undegraded":"2024-09-18T01:45:41.337750+0000","last_fullsized":"2024-09-18T01:45:41.337750+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:18:22.945844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"31'20","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.333610+0000","last_change":"2024-09-18T01:45:10.306223+0000","last_active":"2024-09-18T01:45:41.333610+0000","last_peered":"2024-09-18T01:45:41.333610+0000","last_clean":"2024-09-18T01:45:41.333610+0000","last_became_active":"2024-09-18T01:45:10.305932+0000","last_became_peered":"2024-09-18T01:45:10.305932+0000","last_unstale":"2024-09-18T01:45:41.333610+0000","last_undegraded":"2024-09-18T01:45:41.333610+0000","last_fullsized":"2024-09-18T01:45:41.333610+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:02:58.015323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'282","reported_seq":354,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:08.374174+0000","last_change":"2024-09-18T01:45:12.312362+0000","last_active":"2024-09-18T01:48:08.374174+0000","last_peered":"2024-09-18T01:48:08.374174+0000","last_clean":"2024-09-18T01:48:08.374174+0000","last_became_active":"2024-09-18T01:45:12.312117+0000","last_became_peered":"2024-09-18T01:45:12.312117+0000","last_unstale":"2024-09-18T01:48:08.374174+0000","last_undegraded":"2024-09-18T01:48:08.374174+0000","last_fullsized":"2024-09-18T01:48:08.374174+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:31:43.441229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"33'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.829026+0000","last_change":"2024-09-18T01:45:14.322374+0000","last_active":"2024-09-18T01:48:12.829026+0000","last_peered":"2024-09-18T01:48:12.829026+0000","last_clean":"2024-09-18T01:48:12.829026+0000","last_became_active":"2024-09-18T01:45:14.322078+0000","last_became_peered":"2024-09-18T01:45:14.322078+0000","last_unstale":"2024-09-18T01:48:12.829026+0000","last_undegraded":"2024-09-18T01:48:12.829026+0000","last_fullsized":"2024-09-18T01:48:12.829026+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:07:46.272021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.793475+0000","last_change":"2024-09-18T01:45:06.297948+0000","last_active":"2024-09-18T01:48:12.793475+0000","last_peered":"2024-09-18T01:48:12.793475+0000","last_clean":"2024-09-18T01:48:12.793475+0000","last_became_active":"2024-09-18T01:45:06.297660+0000","last_became_peered":"2024-09-18T01:45:06.297660+0000","last_unstale":"2024-09-18T01:48:12.793475+0000","last_undegraded":"2024-09-18T01:48:12.793475+0000","last_fullsized":"2024-09-18T01:48:12.793475+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:37:23.667201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.341134+0000","last_change":"2024-09-18T01:45:04.294211+0000","last_active":"2024-09-18T01:45:41.341134+0000","last_peered":"2024-09-18T01:45:41.341134+0000","last_clean":"2024-09-18T01:45:41.341134+0000","last_became_active":"2024-09-18T01:45:04.288189+0000","last_became_peered":"2024-09-18T01:45:04.288189+0000","last_unstale":"2024-09-18T01:45:41.341134+0000","last_undegraded":"2024-09-18T01:45:41.341134+0000","last_fullsized":"2024-09-18T01:45:41.341134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:20:01.448189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.339254+0000","last_change":"2024-09-18T01:44:55.234985+0000","last_active":"2024-09-18T01:45:41.339254+0000","last_peered":"2024-09-18T01:45:41.339254+0000","last_clean":"2024-09-18T01:45:41.339254+0000","last_became_active":"2024-09-18T01:44:53.236812+0000","last_became_peered":"2024-09-18T01:44:53.236812+0000","last_unstale":"2024-09-18T01:45:41.339254+0000","last_undegraded":"2024-09-18T01:45:41.339254+0000","last_fullsized":"2024-09-18T01:45:41.339254+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:54:16.245255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044136000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.336209+0000","last_change":"2024-09-18T01:45:08.296449+0000","last_active":"2024-09-18T01:45:41.336209+0000","last_peered":"2024-09-18T01:45:41.336209+0000","last_clean":"2024-09-18T01:45:41.336209+0000","last_became_active":"2024-09-18T01:45:08.296102+0000","last_became_peered":"2024-09-18T01:45:08.296102+0000","last_unstale":"2024-09-18T01:45:41.336209+0000","last_undegraded":"2024-09-18T01:45:41.336209+0000","last_fullsized":"2024-09-18T01:45:41.336209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:40:32.625197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"31'16","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338569+0000","last_change":"2024-09-18T01:45:10.309071+0000","last_active":"2024-09-18T01:45:41.338569+0000","last_peered":"2024-09-18T01:45:41.338569+0000","last_clean":"2024-09-18T01:45:41.338569+0000","last_became_active":"2024-09-18T01:45:10.308451+0000","last_became_peered":"2024-09-18T01:45:10.308451+0000","last_unstale":"2024-09-18T01:45:41.338569+0000","last_undegraded":"2024-09-18T01:45:41.338569+0000","last_fullsized":"2024-09-18T01:45:41.338569+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:28:14.753920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'282","reported_seq":428,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.976512+0000","last_change":"2024-09-18T01:45:12.314218+0000","last_active":"2024-09-18T01:48:12.976512+0000","last_peered":"2024-09-18T01:48:12.976512+0000","last_clean":"2024-09-18T01:48:12.976512+0000","last_became_active":"2024-09-18T01:45:12.313885+0000","last_became_peered":"2024-09-18T01:45:12.313885+0000","last_unstale":"2024-09-18T01:48:12.976512+0000","last_undegraded":"2024-09-18T01:48:12.976512+0000","last_fullsized":"2024-09-18T01:48:12.976512+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:29:22.572641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"33'7","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.579430+0000","last_change":"2024-09-18T01:45:14.317559+0000","last_active":"2024-09-18T01:48:12.579430+0000","last_peered":"2024-09-18T01:48:12.579430+0000","last_clean":"2024-09-18T01:48:12.579430+0000","last_became_active":"2024-09-18T01:45:14.317241+0000","last_became_peered":"2024-09-18T01:45:14.317241+0000","last_unstale":"2024-09-18T01:48:12.579430+0000","last_undegraded":"2024-09-18T01:48:12.579430+0000","last_fullsized":"2024-09-18T01:48:12.579430+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:01:31.449415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"33'8","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.652777+0000","last_change":"2024-09-18T01:45:06.285908+0000","last_active":"2024-09-18T01:48:12.652777+0000","last_peered":"2024-09-18T01:48:12.652777+0000","last_clean":"2024-09-18T01:48:12.652777+0000","last_became_active":"2024-09-18T01:45:06.285656+0000","last_became_peered":"2024-09-18T01:45:06.285656+0000","last_unstale":"2024-09-18T01:48:12.652777+0000","last_undegraded":"2024-09-18T01:48:12.652777+0000","last_fullsized":"2024-09-18T01:48:12.652777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:34:31.263060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338445+0000","last_change":"2024-09-18T01:45:04.290881+0000","last_active":"2024-09-18T01:45:41.338445+0000","last_peered":"2024-09-18T01:45:41.338445+0000","last_clean":"2024-09-18T01:45:41.338445+0000","last_became_active":"2024-09-18T01:45:04.290480+0000","last_became_peered":"2024-09-18T01:45:04.290480+0000","last_unstale":"2024-09-18T01:45:41.338445+0000","last_undegraded":"2024-09-18T01:45:41.338445+0000","last_fullsized":"2024-09-18T01:45:41.338445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:43:17.455462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338670+0000","last_change":"2024-09-18T01:44:55.241531+0000","last_active":"2024-09-18T01:45:41.338670+0000","last_peered":"2024-09-18T01:45:41.338670+0000","last_clean":"2024-09-18T01:45:41.338670+0000","last_became_active":"2024-09-18T01:44:53.298677+0000","last_became_peered":"2024-09-18T01:44:53.298677+0000","last_unstale":"2024-09-18T01:45:41.338670+0000","last_undegraded":"2024-09-18T01:45:41.338670+0000","last_fullsized":"2024-09-18T01:45:41.338670+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:07:05.603416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052495500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.334953+0000","last_change":"2024-09-18T01:45:08.292005+0000","last_active":"2024-09-18T01:45:41.334953+0000","last_peered":"2024-09-18T01:45:41.334953+0000","last_clean":"2024-09-18T01:45:41.334953+0000","last_became_active":"2024-09-18T01:45:08.291696+0000","last_became_peered":"2024-09-18T01:45:08.291696+0000","last_unstale":"2024-09-18T01:45:41.334953+0000","last_undegraded":"2024-09-18T01:45:41.334953+0000","last_fullsized":"2024-09-18T01:45:41.334953+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:36:29.790531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'88","reported_seq":166,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:10.682966+0000","last_change":"2024-09-18T01:45:10.304923+0000","last_active":"2024-09-18T01:47:10.682966+0000","last_peered":"2024-09-18T01:47:10.682966+0000","last_clean":"2024-09-18T01:47:10.682966+0000","last_became_active":"2024-09-18T01:45:10.304662+0000","last_became_peered":"2024-09-18T01:45:10.304662+0000","last_unstale":"2024-09-18T01:47:10.682966+0000","last_undegraded":"2024-09-18T01:47:10.682966+0000","last_fullsized":"2024-09-18T01:47:10.682966+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:31:12.978887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":84,"num_read_kb":69,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338335+0000","last_change":"2024-09-18T01:45:12.311741+0000","last_active":"2024-09-18T01:45:41.338335+0000","last_peered":"2024-09-18T01:45:41.338335+0000","last_clean":"2024-09-18T01:45:41.338335+0000","last_became_active":"2024-09-18T01:45:12.311399+0000","last_became_peered":"2024-09-18T01:45:12.311399+0000","last_unstale":"2024-09-18T01:45:41.338335+0000","last_undegraded":"2024-09-18T01:45:41.338335+0000","last_fullsized":"2024-09-18T01:45:41.338335+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:59:11.475143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.334893+0000","last_change":"2024-09-18T01:45:14.315545+0000","last_active":"2024-09-18T01:45:41.334893+0000","last_peered":"2024-09-18T01:45:41.334893+0000","last_clean":"2024-09-18T01:45:41.334893+0000","last_became_active":"2024-09-18T01:45:14.314587+0000","last_became_peered":"2024-09-18T01:45:14.314587+0000","last_unstale":"2024-09-18T01:45:41.334893+0000","last_undegraded":"2024-09-18T01:45:41.334893+0000","last_fullsized":"2024-09-18T01:45:41.334893+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:18:52.177258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"31'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.333069+0000","last_change":"2024-09-18T01:45:14.326309+0000","last_active":"2024-09-18T01:45:41.333069+0000","last_peered":"2024-09-18T01:45:41.333069+0000","last_clean":"2024-09-18T01:45:41.333069+0000","last_became_active":"2024-09-18T01:45:14.326051+0000","last_became_peered":"2024-09-18T01:45:14.326051+0000","last_unstale":"2024-09-18T01:45:41.333069+0000","last_undegraded":"2024-09-18T01:45:41.333069+0000","last_fullsized":"2024-09-18T01:45:41.333069+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:43:32.191718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"33'8","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:46.587783+0000","last_change":"2024-09-18T01:45:06.284230+0000","last_active":"2024-09-18T01:45:46.587783+0000","last_peered":"2024-09-18T01:45:46.587783+0000","last_clean":"2024-09-18T01:45:46.587783+0000","last_became_active":"2024-09-18T01:45:06.283912+0000","last_became_peered":"2024-09-18T01:45:06.283912+0000","last_unstale":"2024-09-18T01:45:46.587783+0000","last_undegraded":"2024-09-18T01:45:46.587783+0000","last_fullsized":"2024-09-18T01:45:46.587783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:38:33.477420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:46.113600+0000","last_change":"2024-09-18T01:45:04.289644+0000","last_active":"2024-09-18T01:45:46.113600+0000","last_peered":"2024-09-18T01:45:46.113600+0000","last_clean":"2024-09-18T01:45:46.113600+0000","last_became_active":"2024-09-18T01:45:04.285647+0000","last_became_peered":"2024-09-18T01:45:04.285647+0000","last_unstale":"2024-09-18T01:45:46.113600+0000","last_undegraded":"2024-09-18T01:45:46.113600+0000","last_fullsized":"2024-09-18T01:45:46.113600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:57:36.145186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.342016+0000","last_change":"2024-09-18T01:45:41.340307+0000","last_active":"2024-09-18T01:45:41.342016+0000","last_peered":"2024-09-18T01:45:41.342016+0000","last_clean":"2024-09-18T01:45:41.342016+0000","last_became_active":"2024-09-18T01:45:41.339936+0000","last_became_peered":"2024-09-18T01:45:41.339936+0000","last_unstale":"2024-09-18T01:45:41.342016+0000","last_undegraded":"2024-09-18T01:45:41.342016+0000","last_fullsized":"2024-09-18T01:45:41.342016+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:14:27.952660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'38","reported_seq":87,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:10.688732+0000","last_change":"2024-09-18T01:45:10.307949+0000","last_active":"2024-09-18T01:47:10.688732+0000","last_peered":"2024-09-18T01:47:10.688732+0000","last_clean":"2024-09-18T01:47:10.688732+0000","last_became_active":"2024-09-18T01:45:10.307670+0000","last_became_peered":"2024-09-18T01:45:10.307670+0000","last_unstale":"2024-09-18T01:47:10.688732+0000","last_undegraded":"2024-09-18T01:47:10.688732+0000","last_fullsized":"2024-09-18T01:47:10.688732+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:17:12.637730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.334780+0000","last_change":"2024-09-18T01:45:12.316684+0000","last_active":"2024-09-18T01:45:41.334780+0000","last_peered":"2024-09-18T01:45:41.334780+0000","last_clean":"2024-09-18T01:45:41.334780+0000","last_became_active":"2024-09-18T01:45:12.316192+0000","last_became_peered":"2024-09-18T01:45:12.316192+0000","last_unstale":"2024-09-18T01:45:41.334780+0000","last_undegraded":"2024-09-18T01:45:41.334780+0000","last_fullsized":"2024-09-18T01:45:41.334780+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:23:24.551896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"33'5","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.656030+0000","last_change":"2024-09-18T01:45:14.312071+0000","last_active":"2024-09-18T01:48:12.656030+0000","last_peered":"2024-09-18T01:48:12.656030+0000","last_clean":"2024-09-18T01:48:12.656030+0000","last_became_active":"2024-09-18T01:45:14.311776+0000","last_became_peered":"2024-09-18T01:45:14.311776+0000","last_unstale":"2024-09-18T01:48:12.656030+0000","last_undegraded":"2024-09-18T01:48:12.656030+0000","last_fullsized":"2024-09-18T01:48:12.656030+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:10:22.245202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'8","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.652796+0000","last_change":"2024-09-18T01:45:06.292121+0000","last_active":"2024-09-18T01:48:12.652796+0000","last_peered":"2024-09-18T01:48:12.652796+0000","last_clean":"2024-09-18T01:48:12.652796+0000","last_became_active":"2024-09-18T01:45:06.291811+0000","last_became_peered":"2024-09-18T01:45:06.291811+0000","last_unstale":"2024-09-18T01:48:12.652796+0000","last_undegraded":"2024-09-18T01:48:12.652796+0000","last_fullsized":"2024-09-18T01:48:12.652796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:00:01.331200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.069642+0000","last_change":"2024-09-18T01:45:04.289933+0000","last_active":"2024-09-18T01:47:12.069642+0000","last_peered":"2024-09-18T01:47:12.069642+0000","last_clean":"2024-09-18T01:47:12.069642+0000","last_became_active":"2024-09-18T01:45:04.289655+0000","last_became_peered":"2024-09-18T01:45:04.289655+0000","last_unstale":"2024-09-18T01:47:12.069642+0000","last_undegraded":"2024-09-18T01:47:12.069642+0000","last_fullsized":"2024-09-18T01:47:12.069642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:35:27.504923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.344737+0000","last_change":"2024-09-18T01:45:41.342483+0000","last_active":"2024-09-18T01:45:41.344737+0000","last_peered":"2024-09-18T01:45:41.344737+0000","last_clean":"2024-09-18T01:45:41.344737+0000","last_became_active":"2024-09-18T01:45:41.342149+0000","last_became_peered":"2024-09-18T01:45:41.342149+0000","last_unstale":"2024-09-18T01:45:41.344737+0000","last_undegraded":"2024-09-18T01:45:41.344737+0000","last_fullsized":"2024-09-18T01:45:41.344737+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:51:13.653922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'5","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.191690+0000","last_change":"2024-09-18T01:45:10.296711+0000","last_active":"2024-09-18T01:48:12.191690+0000","last_peered":"2024-09-18T01:48:12.191690+0000","last_clean":"2024-09-18T01:48:12.191690+0000","last_became_active":"2024-09-18T01:45:10.296387+0000","last_became_peered":"2024-09-18T01:45:10.296387+0000","last_unstale":"2024-09-18T01:48:12.191690+0000","last_undegraded":"2024-09-18T01:48:12.191690+0000","last_fullsized":"2024-09-18T01:48:12.191690+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:30:55.339975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.331863+0000","last_change":"2024-09-18T01:45:12.313429+0000","last_active":"2024-09-18T01:45:41.331863+0000","last_peered":"2024-09-18T01:45:41.331863+0000","last_clean":"2024-09-18T01:45:41.331863+0000","last_became_active":"2024-09-18T01:45:12.313159+0000","last_became_peered":"2024-09-18T01:45:12.313159+0000","last_unstale":"2024-09-18T01:45:41.331863+0000","last_undegraded":"2024-09-18T01:45:41.331863+0000","last_fullsized":"2024-09-18T01:45:41.331863+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:30:57.351499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338764+0000","last_change":"2024-09-18T01:45:14.319376+0000","last_active":"2024-09-18T01:45:41.338764+0000","last_peered":"2024-09-18T01:45:41.338764+0000","last_clean":"2024-09-18T01:45:41.338764+0000","last_became_active":"2024-09-18T01:45:14.319073+0000","last_became_peered":"2024-09-18T01:45:14.319073+0000","last_unstale":"2024-09-18T01:45:41.338764+0000","last_undegraded":"2024-09-18T01:45:41.338764+0000","last_fullsized":"2024-09-18T01:45:41.338764+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:39:57.317811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'5","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:27.214914+0000","last_change":"2024-09-18T01:45:06.276739+0000","last_active":"2024-09-18T01:47:27.214914+0000","last_peered":"2024-09-18T01:47:27.214914+0000","last_clean":"2024-09-18T01:47:27.214914+0000","last_became_active":"2024-09-18T01:45:06.276408+0000","last_became_peered":"2024-09-18T01:45:06.276408+0000","last_unstale":"2024-09-18T01:47:27.214914+0000","last_undegraded":"2024-09-18T01:47:27.214914+0000","last_fullsized":"2024-09-18T01:47:27.214914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:38:33.477420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"33'6","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.787555+0000","last_change":"2024-09-18T01:45:04.287172+0000","last_active":"2024-09-18T01:48:12.787555+0000","last_peered":"2024-09-18T01:48:12.787555+0000","last_clean":"2024-09-18T01:48:12.787555+0000","last_became_active":"2024-09-18T01:45:04.286887+0000","last_became_peered":"2024-09-18T01:45:04.286887+0000","last_unstale":"2024-09-18T01:48:12.787555+0000","last_undegraded":"2024-09-18T01:48:12.787555+0000","last_fullsized":"2024-09-18T01:48:12.787555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:10:25.987284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.331617+0000","last_change":"2024-09-18T01:45:08.291860+0000","last_active":"2024-09-18T01:45:41.331617+0000","last_peered":"2024-09-18T01:45:41.331617+0000","last_clean":"2024-09-18T01:45:41.331617+0000","last_became_active":"2024-09-18T01:45:08.291575+0000","last_became_peered":"2024-09-18T01:45:08.291575+0000","last_unstale":"2024-09-18T01:45:41.331617+0000","last_undegraded":"2024-09-18T01:45:41.331617+0000","last_fullsized":"2024-09-18T01:45:41.331617+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:10:31.670675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'40","reported_seq":99,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.246074+0000","last_change":"2024-09-18T01:45:10.298133+0000","last_active":"2024-09-18T01:48:12.246074+0000","last_peered":"2024-09-18T01:48:12.246074+0000","last_clean":"2024-09-18T01:48:12.246074+0000","last_became_active":"2024-09-18T01:45:10.297904+0000","last_became_peered":"2024-09-18T01:45:10.297904+0000","last_unstale":"2024-09-18T01:48:12.246074+0000","last_undegraded":"2024-09-18T01:48:12.246074+0000","last_fullsized":"2024-09-18T01:48:12.246074+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:17:46.496134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.334632+0000","last_change":"2024-09-18T01:45:12.313485+0000","last_active":"2024-09-18T01:45:41.334632+0000","last_peered":"2024-09-18T01:45:41.334632+0000","last_clean":"2024-09-18T01:45:41.334632+0000","last_became_active":"2024-09-18T01:45:12.313186+0000","last_became_peered":"2024-09-18T01:45:12.313186+0000","last_unstale":"2024-09-18T01:45:41.334632+0000","last_undegraded":"2024-09-18T01:45:41.334632+0000","last_fullsized":"2024-09-18T01:45:41.334632+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:49:35.068566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337050+0000","last_change":"2024-09-18T01:45:14.326931+0000","last_active":"2024-09-18T01:45:41.337050+0000","last_peered":"2024-09-18T01:45:41.337050+0000","last_clean":"2024-09-18T01:45:41.337050+0000","last_became_active":"2024-09-18T01:45:14.326668+0000","last_became_peered":"2024-09-18T01:45:14.326668+0000","last_unstale":"2024-09-18T01:45:41.337050+0000","last_undegraded":"2024-09-18T01:45:41.337050+0000","last_fullsized":"2024-09-18T01:45:41.337050+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:46:10.520315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'18","reported_seq":95,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.800687+0000","last_change":"2024-09-18T01:45:06.297569+0000","last_active":"2024-09-18T01:48:12.800687+0000","last_peered":"2024-09-18T01:48:12.800687+0000","last_clean":"2024-09-18T01:48:12.800687+0000","last_became_active":"2024-09-18T01:45:06.297220+0000","last_became_peered":"2024-09-18T01:45:06.297220+0000","last_unstale":"2024-09-18T01:48:12.800687+0000","last_undegraded":"2024-09-18T01:48:12.800687+0000","last_fullsized":"2024-09-18T01:48:12.800687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:52:37.561237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":76,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337780+0000","last_change":"2024-09-18T01:45:04.283606+0000","last_active":"2024-09-18T01:45:41.337780+0000","last_peered":"2024-09-18T01:45:41.337780+0000","last_clean":"2024-09-18T01:45:41.337780+0000","last_became_active":"2024-09-18T01:45:04.283276+0000","last_became_peered":"2024-09-18T01:45:04.283276+0000","last_unstale":"2024-09-18T01:45:41.337780+0000","last_undegraded":"2024-09-18T01:45:41.337780+0000","last_fullsized":"2024-09-18T01:45:41.337780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:17:00.799400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.335084+0000","last_change":"2024-09-18T01:45:08.291740+0000","last_active":"2024-09-18T01:45:41.335084+0000","last_peered":"2024-09-18T01:45:41.335084+0000","last_clean":"2024-09-18T01:45:41.335084+0000","last_became_active":"2024-09-18T01:45:08.290911+0000","last_became_peered":"2024-09-18T01:45:08.290911+0000","last_unstale":"2024-09-18T01:45:41.335084+0000","last_undegraded":"2024-09-18T01:45:41.335084+0000","last_fullsized":"2024-09-18T01:45:41.335084+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:38:00.913159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'30","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:10.674668+0000","last_change":"2024-09-18T01:45:10.301942+0000","last_active":"2024-09-18T01:47:10.674668+0000","last_peered":"2024-09-18T01:47:10.674668+0000","last_clean":"2024-09-18T01:47:10.674668+0000","last_became_active":"2024-09-18T01:45:10.301622+0000","last_became_peered":"2024-09-18T01:45:10.301622+0000","last_unstale":"2024-09-18T01:47:10.674668+0000","last_undegraded":"2024-09-18T01:47:10.674668+0000","last_fullsized":"2024-09-18T01:47:10.674668+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:45:21.320125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.332022+0000","last_change":"2024-09-18T01:45:12.313357+0000","last_active":"2024-09-18T01:45:41.332022+0000","last_peered":"2024-09-18T01:45:41.332022+0000","last_clean":"2024-09-18T01:45:41.332022+0000","last_became_active":"2024-09-18T01:45:12.313096+0000","last_became_peered":"2024-09-18T01:45:12.313096+0000","last_unstale":"2024-09-18T01:45:41.332022+0000","last_undegraded":"2024-09-18T01:45:41.332022+0000","last_fullsized":"2024-09-18T01:45:41.332022+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:03:16.580180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"33'12","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.871323+0000","last_change":"2024-09-18T01:45:06.282718+0000","last_active":"2024-09-18T01:48:12.871323+0000","last_peered":"2024-09-18T01:48:12.871323+0000","last_clean":"2024-09-18T01:48:12.871323+0000","last_became_active":"2024-09-18T01:45:06.282461+0000","last_became_peered":"2024-09-18T01:45:06.282461+0000","last_unstale":"2024-09-18T01:48:12.871323+0000","last_undegraded":"2024-09-18T01:48:12.871323+0000","last_fullsized":"2024-09-18T01:48:12.871323+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:30:50.253764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"33'8","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.539657+0000","last_change":"2024-09-18T01:45:04.293367+0000","last_active":"2024-09-18T01:48:12.539657+0000","last_peered":"2024-09-18T01:48:12.539657+0000","last_clean":"2024-09-18T01:48:12.539657+0000","last_became_active":"2024-09-18T01:45:04.288082+0000","last_became_peered":"2024-09-18T01:45:04.288082+0000","last_unstale":"2024-09-18T01:48:12.539657+0000","last_undegraded":"2024-09-18T01:48:12.539657+0000","last_fullsized":"2024-09-18T01:48:12.539657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:03:55.175306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":48,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.340356+0000","last_change":"2024-09-18T01:45:08.293027+0000","last_active":"2024-09-18T01:45:41.340356+0000","last_peered":"2024-09-18T01:45:41.340356+0000","last_clean":"2024-09-18T01:45:41.340356+0000","last_became_active":"2024-09-18T01:45:08.292739+0000","last_became_peered":"2024-09-18T01:45:08.292739+0000","last_unstale":"2024-09-18T01:45:41.340356+0000","last_undegraded":"2024-09-18T01:45:41.340356+0000","last_fullsized":"2024-09-18T01:45:41.340356+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:30:59.656894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'60","reported_seq":122,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:10.694810+0000","last_change":"2024-09-18T01:45:10.296746+0000","last_active":"2024-09-18T01:47:10.694810+0000","last_peered":"2024-09-18T01:47:10.694810+0000","last_clean":"2024-09-18T01:47:10.694810+0000","last_became_active":"2024-09-18T01:45:10.296396+0000","last_became_peered":"2024-09-18T01:45:10.296396+0000","last_unstale":"2024-09-18T01:47:10.694810+0000","last_undegraded":"2024-09-18T01:47:10.694810+0000","last_fullsized":"2024-09-18T01:47:10.694810+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:49:47.265044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":58,"num_read_kb":48,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.332138+0000","last_change":"2024-09-18T01:45:12.307915+0000","last_active":"2024-09-18T01:45:41.332138+0000","last_peered":"2024-09-18T01:45:41.332138+0000","last_clean":"2024-09-18T01:45:41.332138+0000","last_became_active":"2024-09-18T01:45:12.307279+0000","last_became_peered":"2024-09-18T01:45:12.307279+0000","last_unstale":"2024-09-18T01:45:41.332138+0000","last_undegraded":"2024-09-18T01:45:41.332138+0000","last_fullsized":"2024-09-18T01:45:41.332138+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:49:49.276568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'22","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.098129+0000","last_change":"2024-09-18T01:45:14.320125+0000","last_active":"2024-09-18T01:47:12.098129+0000","last_peered":"2024-09-18T01:47:12.098129+0000","last_clean":"2024-09-18T01:47:12.098129+0000","last_became_active":"2024-09-18T01:45:14.319540+0000","last_became_peered":"2024-09-18T01:45:14.319540+0000","last_unstale":"2024-09-18T01:47:12.098129+0000","last_undegraded":"2024-09-18T01:47:12.098129+0000","last_fullsized":"2024-09-18T01:47:12.098129+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:14:53.955796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":65,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'18","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.801087+0000","last_change":"2024-09-18T01:45:06.293374+0000","last_active":"2024-09-18T01:48:12.801087+0000","last_peered":"2024-09-18T01:48:12.801087+0000","last_clean":"2024-09-18T01:48:12.801087+0000","last_became_active":"2024-09-18T01:45:06.293053+0000","last_became_peered":"2024-09-18T01:45:06.293053+0000","last_unstale":"2024-09-18T01:48:12.801087+0000","last_undegraded":"2024-09-18T01:48:12.801087+0000","last_fullsized":"2024-09-18T01:48:12.801087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:55:38.246732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":45,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.333300+0000","last_change":"2024-09-18T01:45:04.292562+0000","last_active":"2024-09-18T01:45:41.333300+0000","last_peered":"2024-09-18T01:45:41.333300+0000","last_clean":"2024-09-18T01:45:41.333300+0000","last_became_active":"2024-09-18T01:45:04.292082+0000","last_became_peered":"2024-09-18T01:45:04.292082+0000","last_unstale":"2024-09-18T01:45:41.333300+0000","last_undegraded":"2024-09-18T01:45:41.333300+0000","last_fullsized":"2024-09-18T01:45:41.333300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:08:58.229173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.333652+0000","last_change":"2024-09-18T01:45:08.287312+0000","last_active":"2024-09-18T01:45:41.333652+0000","last_peered":"2024-09-18T01:45:41.333652+0000","last_clean":"2024-09-18T01:45:41.333652+0000","last_became_active":"2024-09-18T01:45:08.286609+0000","last_became_peered":"2024-09-18T01:45:08.286609+0000","last_unstale":"2024-09-18T01:45:41.333652+0000","last_undegraded":"2024-09-18T01:45:41.333652+0000","last_fullsized":"2024-09-18T01:45:41.333652+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:04:58.163455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'36","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:10.675587+0000","last_change":"2024-09-18T01:45:10.309790+0000","last_active":"2024-09-18T01:47:10.675587+0000","last_peered":"2024-09-18T01:47:10.675587+0000","last_clean":"2024-09-18T01:47:10.675587+0000","last_became_active":"2024-09-18T01:45:10.309360+0000","last_became_peered":"2024-09-18T01:45:10.309360+0000","last_unstale":"2024-09-18T01:47:10.675587+0000","last_undegraded":"2024-09-18T01:47:10.675587+0000","last_fullsized":"2024-09-18T01:47:10.675587+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:47:11.016927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.334583+0000","last_change":"2024-09-18T01:45:12.314763+0000","last_active":"2024-09-18T01:45:41.334583+0000","last_peered":"2024-09-18T01:45:41.334583+0000","last_clean":"2024-09-18T01:45:41.334583+0000","last_became_active":"2024-09-18T01:45:12.314499+0000","last_became_peered":"2024-09-18T01:45:12.314499+0000","last_unstale":"2024-09-18T01:45:41.334583+0000","last_undegraded":"2024-09-18T01:45:41.334583+0000","last_fullsized":"2024-09-18T01:45:41.334583+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:43:30.182833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"33'2","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:46.123289+0000","last_change":"2024-09-18T01:45:14.326163+0000","last_active":"2024-09-18T01:45:46.123289+0000","last_peered":"2024-09-18T01:45:46.123289+0000","last_clean":"2024-09-18T01:45:46.123289+0000","last_became_active":"2024-09-18T01:45:14.325421+0000","last_became_peered":"2024-09-18T01:45:14.325421+0000","last_unstale":"2024-09-18T01:45:46.123289+0000","last_undegraded":"2024-09-18T01:45:46.123289+0000","last_fullsized":"2024-09-18T01:45:46.123289+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:46:44.031146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'8","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.559304+0000","last_change":"2024-09-18T01:45:06.287633+0000","last_active":"2024-09-18T01:48:12.559304+0000","last_peered":"2024-09-18T01:48:12.559304+0000","last_clean":"2024-09-18T01:48:12.559304+0000","last_became_active":"2024-09-18T01:45:06.286153+0000","last_became_peered":"2024-09-18T01:45:06.286153+0000","last_unstale":"2024-09-18T01:48:12.559304+0000","last_undegraded":"2024-09-18T01:48:12.559304+0000","last_fullsized":"2024-09-18T01:48:12.559304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:49:16.994650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.334776+0000","last_change":"2024-09-18T01:45:04.295250+0000","last_active":"2024-09-18T01:45:41.334776+0000","last_peered":"2024-09-18T01:45:41.334776+0000","last_clean":"2024-09-18T01:45:41.334776+0000","last_became_active":"2024-09-18T01:45:04.294537+0000","last_became_peered":"2024-09-18T01:45:04.294537+0000","last_unstale":"2024-09-18T01:45:41.334776+0000","last_undegraded":"2024-09-18T01:45:41.334776+0000","last_fullsized":"2024-09-18T01:45:41.334776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:18:39.513085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.332516+0000","last_change":"2024-09-18T01:45:08.287053+0000","last_active":"2024-09-18T01:45:41.332516+0000","last_peered":"2024-09-18T01:45:41.332516+0000","last_clean":"2024-09-18T01:45:41.332516+0000","last_became_active":"2024-09-18T01:45:08.286466+0000","last_became_peered":"2024-09-18T01:45:08.286466+0000","last_unstale":"2024-09-18T01:45:41.332516+0000","last_undegraded":"2024-09-18T01:45:41.332516+0000","last_fullsized":"2024-09-18T01:45:41.332516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:15:50.332283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'40","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:10.692621+0000","last_change":"2024-09-18T01:45:10.304141+0000","last_active":"2024-09-18T01:47:10.692621+0000","last_peered":"2024-09-18T01:47:10.692621+0000","last_clean":"2024-09-18T01:47:10.692621+0000","last_became_active":"2024-09-18T01:45:10.303911+0000","last_became_peered":"2024-09-18T01:45:10.303911+0000","last_unstale":"2024-09-18T01:47:10.692621+0000","last_undegraded":"2024-09-18T01:47:10.692621+0000","last_fullsized":"2024-09-18T01:47:10.692621+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:48:29.561311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338997+0000","last_change":"2024-09-18T01:45:12.313469+0000","last_active":"2024-09-18T01:45:41.338997+0000","last_peered":"2024-09-18T01:45:41.338997+0000","last_clean":"2024-09-18T01:45:41.338997+0000","last_became_active":"2024-09-18T01:45:12.313180+0000","last_became_peered":"2024-09-18T01:45:12.313180+0000","last_unstale":"2024-09-18T01:45:41.338997+0000","last_undegraded":"2024-09-18T01:45:41.338997+0000","last_fullsized":"2024-09-18T01:45:41.338997+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:38:04.933752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"33'3","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.166889+0000","last_change":"2024-09-18T01:45:14.326771+0000","last_active":"2024-09-18T01:47:12.166889+0000","last_peered":"2024-09-18T01:47:12.166889+0000","last_clean":"2024-09-18T01:47:12.166889+0000","last_became_active":"2024-09-18T01:45:14.326452+0000","last_became_peered":"2024-09-18T01:45:14.326452+0000","last_unstale":"2024-09-18T01:47:12.166889+0000","last_undegraded":"2024-09-18T01:47:12.166889+0000","last_fullsized":"2024-09-18T01:47:12.166889+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:23:19.339622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:46.588667+0000","last_change":"2024-09-18T01:45:06.282527+0000","last_active":"2024-09-18T01:45:46.588667+0000","last_peered":"2024-09-18T01:45:46.588667+0000","last_clean":"2024-09-18T01:45:46.588667+0000","last_became_active":"2024-09-18T01:45:06.281987+0000","last_became_peered":"2024-09-18T01:45:06.281987+0000","last_unstale":"2024-09-18T01:45:46.588667+0000","last_undegraded":"2024-09-18T01:45:46.588667+0000","last_fullsized":"2024-09-18T01:45:46.588667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:03:57.182802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"33'1","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:37.219069+0000","last_change":"2024-09-18T01:45:04.290235+0000","last_active":"2024-09-18T01:47:37.219069+0000","last_peered":"2024-09-18T01:47:37.219069+0000","last_clean":"2024-09-18T01:47:37.219069+0000","last_became_active":"2024-09-18T01:45:04.289909+0000","last_became_peered":"2024-09-18T01:45:04.289909+0000","last_unstale":"2024-09-18T01:47:37.219069+0000","last_undegraded":"2024-09-18T01:47:37.219069+0000","last_fullsized":"2024-09-18T01:47:37.219069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:03:55.663688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.347523+0000","last_change":"2024-09-18T01:45:41.342634+0000","last_active":"2024-09-18T01:45:41.347523+0000","last_peered":"2024-09-18T01:45:41.347523+0000","last_clean":"2024-09-18T01:45:41.347523+0000","last_became_active":"2024-09-18T01:45:41.342280+0000","last_became_peered":"2024-09-18T01:45:41.342280+0000","last_unstale":"2024-09-18T01:45:41.347523+0000","last_undegraded":"2024-09-18T01:45:41.347523+0000","last_fullsized":"2024-09-18T01:45:41.347523+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:22:13.981729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'16","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338687+0000","last_change":"2024-09-18T01:45:10.308886+0000","last_active":"2024-09-18T01:45:41.338687+0000","last_peered":"2024-09-18T01:45:41.338687+0000","last_clean":"2024-09-18T01:45:41.338687+0000","last_became_active":"2024-09-18T01:45:10.308524+0000","last_became_peered":"2024-09-18T01:45:10.308524+0000","last_unstale":"2024-09-18T01:45:41.338687+0000","last_undegraded":"2024-09-18T01:45:41.338687+0000","last_fullsized":"2024-09-18T01:45:41.338687+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:27:57.717568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'282","reported_seq":416,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.876028+0000","last_change":"2024-09-18T01:45:12.307543+0000","last_active":"2024-09-18T01:48:12.876028+0000","last_peered":"2024-09-18T01:48:12.876028+0000","last_clean":"2024-09-18T01:48:12.876028+0000","last_became_active":"2024-09-18T01:45:12.307186+0000","last_became_peered":"2024-09-18T01:45:12.307186+0000","last_unstale":"2024-09-18T01:48:12.876028+0000","last_undegraded":"2024-09-18T01:48:12.876028+0000","last_fullsized":"2024-09-18T01:48:12.876028+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:03:00.026847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"33'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.937244+0000","last_change":"2024-09-18T01:45:14.326301+0000","last_active":"2024-09-18T01:48:12.937244+0000","last_peered":"2024-09-18T01:48:12.937244+0000","last_clean":"2024-09-18T01:48:12.937244+0000","last_became_active":"2024-09-18T01:45:14.326018+0000","last_became_peered":"2024-09-18T01:45:14.326018+0000","last_unstale":"2024-09-18T01:48:12.937244+0000","last_undegraded":"2024-09-18T01:48:12.937244+0000","last_fullsized":"2024-09-18T01:48:12.937244+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:39:58.669383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"33'8","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.559623+0000","last_change":"2024-09-18T01:45:06.282281+0000","last_active":"2024-09-18T01:48:12.559623+0000","last_peered":"2024-09-18T01:48:12.559623+0000","last_clean":"2024-09-18T01:48:12.559623+0000","last_became_active":"2024-09-18T01:45:06.281798+0000","last_became_peered":"2024-09-18T01:45:06.281798+0000","last_unstale":"2024-09-18T01:48:12.559623+0000","last_undegraded":"2024-09-18T01:48:12.559623+0000","last_fullsized":"2024-09-18T01:48:12.559623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:08:07.525907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.336989+0000","last_change":"2024-09-18T01:45:04.293329+0000","last_active":"2024-09-18T01:45:41.336989+0000","last_peered":"2024-09-18T01:45:41.336989+0000","last_clean":"2024-09-18T01:45:41.336989+0000","last_became_active":"2024-09-18T01:45:04.293009+0000","last_became_peered":"2024-09-18T01:45:04.293009+0000","last_unstale":"2024-09-18T01:45:41.336989+0000","last_undegraded":"2024-09-18T01:45:41.336989+0000","last_fullsized":"2024-09-18T01:45:41.336989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:10:25.987284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.335416+0000","last_change":"2024-09-18T01:45:08.288626+0000","last_active":"2024-09-18T01:45:41.335416+0000","last_peered":"2024-09-18T01:45:41.335416+0000","last_clean":"2024-09-18T01:45:41.335416+0000","last_became_active":"2024-09-18T01:45:08.287884+0000","last_became_peered":"2024-09-18T01:45:08.287884+0000","last_unstale":"2024-09-18T01:45:41.335416+0000","last_undegraded":"2024-09-18T01:45:41.335416+0000","last_fullsized":"2024-09-18T01:45:41.335416+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:22:29.603107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'61","reported_seq":130,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:10.666172+0000","last_change":"2024-09-18T01:45:10.301367+0000","last_active":"2024-09-18T01:47:10.666172+0000","last_peered":"2024-09-18T01:47:10.666172+0000","last_clean":"2024-09-18T01:47:10.666172+0000","last_became_active":"2024-09-18T01:45:10.301087+0000","last_became_peered":"2024-09-18T01:45:10.301087+0000","last_unstale":"2024-09-18T01:47:10.666172+0000","last_undegraded":"2024-09-18T01:47:10.666172+0000","last_fullsized":"2024-09-18T01:47:10.666172+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:48:29.561311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":74,"num_read_kb":61,"num_write":42,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337222+0000","last_change":"2024-09-18T01:45:12.312300+0000","last_active":"2024-09-18T01:45:41.337222+0000","last_peered":"2024-09-18T01:45:41.337222+0000","last_clean":"2024-09-18T01:45:41.337222+0000","last_became_active":"2024-09-18T01:45:12.312055+0000","last_became_peered":"2024-09-18T01:45:12.312055+0000","last_unstale":"2024-09-18T01:45:41.337222+0000","last_undegraded":"2024-09-18T01:45:41.337222+0000","last_fullsized":"2024-09-18T01:45:41.337222+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:13:37.683828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"33'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:46.589606+0000","last_change":"2024-09-18T01:45:14.323228+0000","last_active":"2024-09-18T01:45:46.589606+0000","last_peered":"2024-09-18T01:45:46.589606+0000","last_clean":"2024-09-18T01:45:46.589606+0000","last_became_active":"2024-09-18T01:45:14.322945+0000","last_became_peered":"2024-09-18T01:45:14.322945+0000","last_unstale":"2024-09-18T01:45:46.589606+0000","last_undegraded":"2024-09-18T01:45:46.589606+0000","last_fullsized":"2024-09-18T01:45:46.589606+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:02:58.012154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'6","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.650017+0000","last_change":"2024-09-18T01:45:06.282529+0000","last_active":"2024-09-18T01:48:12.650017+0000","last_peered":"2024-09-18T01:48:12.650017+0000","last_clean":"2024-09-18T01:48:12.650017+0000","last_became_active":"2024-09-18T01:45:06.281480+0000","last_became_peered":"2024-09-18T01:45:06.281480+0000","last_unstale":"2024-09-18T01:48:12.650017+0000","last_undegraded":"2024-09-18T01:48:12.650017+0000","last_fullsized":"2024-09-18T01:48:12.650017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:12:27.107318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:44.959625+0000","last_change":"2024-09-18T01:45:04.291296+0000","last_active":"2024-09-18T01:45:44.959625+0000","last_peered":"2024-09-18T01:45:44.959625+0000","last_clean":"2024-09-18T01:45:44.959625+0000","last_became_active":"2024-09-18T01:45:04.290901+0000","last_became_peered":"2024-09-18T01:45:04.290901+0000","last_unstale":"2024-09-18T01:45:44.959625+0000","last_undegraded":"2024-09-18T01:45:44.959625+0000","last_fullsized":"2024-09-18T01:45:44.959625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:34:29.255564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.334766+0000","last_change":"2024-09-18T01:45:08.286897+0000","last_active":"2024-09-18T01:45:41.334766+0000","last_peered":"2024-09-18T01:45:41.334766+0000","last_clean":"2024-09-18T01:45:41.334766+0000","last_became_active":"2024-09-18T01:45:08.286502+0000","last_became_peered":"2024-09-18T01:45:08.286502+0000","last_unstale":"2024-09-18T01:45:41.334766+0000","last_undegraded":"2024-09-18T01:45:41.334766+0000","last_fullsized":"2024-09-18T01:45:41.334766+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:44:50.713773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'36","reported_seq":84,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:10.667256+0000","last_change":"2024-09-18T01:45:10.306297+0000","last_active":"2024-09-18T01:47:10.667256+0000","last_peered":"2024-09-18T01:47:10.667256+0000","last_clean":"2024-09-18T01:47:10.667256+0000","last_became_active":"2024-09-18T01:45:10.306076+0000","last_became_peered":"2024-09-18T01:45:10.306076+0000","last_unstale":"2024-09-18T01:47:10.667256+0000","last_undegraded":"2024-09-18T01:47:10.667256+0000","last_fullsized":"2024-09-18T01:47:10.667256+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:52:41.579679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.333314+0000","last_change":"2024-09-18T01:45:12.316303+0000","last_active":"2024-09-18T01:45:41.333314+0000","last_peered":"2024-09-18T01:45:41.333314+0000","last_clean":"2024-09-18T01:45:41.333314+0000","last_became_active":"2024-09-18T01:45:12.316022+0000","last_became_peered":"2024-09-18T01:45:12.316022+0000","last_unstale":"2024-09-18T01:45:41.333314+0000","last_undegraded":"2024-09-18T01:45:41.333314+0000","last_fullsized":"2024-09-18T01:45:41.333314+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:08:15.127495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337877+0000","last_change":"2024-09-18T01:45:14.325515+0000","last_active":"2024-09-18T01:45:41.337877+0000","last_peered":"2024-09-18T01:45:41.337877+0000","last_clean":"2024-09-18T01:45:41.337877+0000","last_became_active":"2024-09-18T01:45:14.325208+0000","last_became_peered":"2024-09-18T01:45:14.325208+0000","last_unstale":"2024-09-18T01:45:41.337877+0000","last_undegraded":"2024-09-18T01:45:41.337877+0000","last_fullsized":"2024-09-18T01:45:41.337877+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:55:28.461066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'26","reported_seq":94,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.871206+0000","last_change":"2024-09-18T01:45:06.283428+0000","last_active":"2024-09-18T01:48:12.871206+0000","last_peered":"2024-09-18T01:48:12.871206+0000","last_clean":"2024-09-18T01:48:12.871206+0000","last_became_active":"2024-09-18T01:45:06.283174+0000","last_became_peered":"2024-09-18T01:45:06.283174+0000","last_unstale":"2024-09-18T01:48:12.871206+0000","last_undegraded":"2024-09-18T01:48:12.871206+0000","last_fullsized":"2024-09-18T01:48:12.871206+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:17:42.477692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":84,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.339404+0000","last_change":"2024-09-18T01:45:04.273552+0000","last_active":"2024-09-18T01:45:41.339404+0000","last_peered":"2024-09-18T01:45:41.339404+0000","last_clean":"2024-09-18T01:45:41.339404+0000","last_became_active":"2024-09-18T01:45:04.273128+0000","last_became_peered":"2024-09-18T01:45:04.273128+0000","last_unstale":"2024-09-18T01:45:41.339404+0000","last_undegraded":"2024-09-18T01:45:41.339404+0000","last_fullsized":"2024-09-18T01:45:41.339404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:35:27.504923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"33'4","reported_seq":226,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:11.783605+0000","last_change":"2024-09-18T01:45:08.294864+0000","last_active":"2024-09-18T01:47:11.783605+0000","last_peered":"2024-09-18T01:47:11.783605+0000","last_clean":"2024-09-18T01:47:11.783605+0000","last_became_active":"2024-09-18T01:45:08.294338+0000","last_became_peered":"2024-09-18T01:45:08.294338+0000","last_unstale":"2024-09-18T01:47:11.783605+0000","last_undegraded":"2024-09-18T01:47:11.783605+0000","last_fullsized":"2024-09-18T01:47:11.783605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:30:59.656894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'33","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:42.219946+0000","last_change":"2024-09-18T01:45:10.308965+0000","last_active":"2024-09-18T01:47:42.219946+0000","last_peered":"2024-09-18T01:47:42.219946+0000","last_clean":"2024-09-18T01:47:42.219946+0000","last_became_active":"2024-09-18T01:45:10.308336+0000","last_became_peered":"2024-09-18T01:45:10.308336+0000","last_unstale":"2024-09-18T01:47:42.219946+0000","last_undegraded":"2024-09-18T01:47:42.219946+0000","last_fullsized":"2024-09-18T01:47:42.219946+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:18:53.742596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":27,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.335626+0000","last_change":"2024-09-18T01:45:12.313122+0000","last_active":"2024-09-18T01:45:41.335626+0000","last_peered":"2024-09-18T01:45:41.335626+0000","last_clean":"2024-09-18T01:45:41.335626+0000","last_became_active":"2024-09-18T01:45:12.312794+0000","last_became_peered":"2024-09-18T01:45:12.312794+0000","last_unstale":"2024-09-18T01:45:41.335626+0000","last_undegraded":"2024-09-18T01:45:41.335626+0000","last_fullsized":"2024-09-18T01:45:41.335626+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:20:31.256442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"33'10","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.266530+0000","last_change":"2024-09-18T01:45:14.325782+0000","last_active":"2024-09-18T01:48:12.266530+0000","last_peered":"2024-09-18T01:48:12.266530+0000","last_clean":"2024-09-18T01:48:12.266530+0000","last_became_active":"2024-09-18T01:45:14.325464+0000","last_became_peered":"2024-09-18T01:45:14.325464+0000","last_unstale":"2024-09-18T01:48:12.266530+0000","last_undegraded":"2024-09-18T01:48:12.266530+0000","last_fullsized":"2024-09-18T01:48:12.266530+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:16:17.590314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'8","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.871148+0000","last_change":"2024-09-18T01:45:06.283599+0000","last_active":"2024-09-18T01:48:12.871148+0000","last_peered":"2024-09-18T01:48:12.871148+0000","last_clean":"2024-09-18T01:48:12.871148+0000","last_became_active":"2024-09-18T01:45:06.283071+0000","last_became_peered":"2024-09-18T01:45:06.283071+0000","last_unstale":"2024-09-18T01:48:12.871148+0000","last_undegraded":"2024-09-18T01:48:12.871148+0000","last_fullsized":"2024-09-18T01:48:12.871148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:32:00.122022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.781181+0000","last_change":"2024-09-18T01:45:04.298035+0000","last_active":"2024-09-18T01:48:12.781181+0000","last_peered":"2024-09-18T01:48:12.781181+0000","last_clean":"2024-09-18T01:48:12.781181+0000","last_became_active":"2024-09-18T01:45:04.297716+0000","last_became_peered":"2024-09-18T01:45:04.297716+0000","last_unstale":"2024-09-18T01:48:12.781181+0000","last_undegraded":"2024-09-18T01:48:12.781181+0000","last_fullsized":"2024-09-18T01:48:12.781181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:19:39.056474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:09.379986+0000","last_change":"2024-09-18T01:45:08.294474+0000","last_active":"2024-09-18T01:47:09.379986+0000","last_peered":"2024-09-18T01:47:09.379986+0000","last_clean":"2024-09-18T01:47:09.379986+0000","last_became_active":"2024-09-18T01:45:08.294160+0000","last_became_peered":"2024-09-18T01:45:08.294160+0000","last_unstale":"2024-09-18T01:47:09.379986+0000","last_undegraded":"2024-09-18T01:47:09.379986+0000","last_fullsized":"2024-09-18T01:47:09.379986+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:58:00.539983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'44","reported_seq":100,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.192510+0000","last_change":"2024-09-18T01:45:10.308624+0000","last_active":"2024-09-18T01:48:12.192510+0000","last_peered":"2024-09-18T01:48:12.192510+0000","last_clean":"2024-09-18T01:48:12.192510+0000","last_became_active":"2024-09-18T01:45:10.308302+0000","last_became_peered":"2024-09-18T01:45:10.308302+0000","last_unstale":"2024-09-18T01:48:12.192510+0000","last_undegraded":"2024-09-18T01:48:12.192510+0000","last_fullsized":"2024-09-18T01:48:12.192510+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:00:38.863397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":52,"num_read_kb":46,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338107+0000","last_change":"2024-09-18T01:45:12.305985+0000","last_active":"2024-09-18T01:45:41.338107+0000","last_peered":"2024-09-18T01:45:41.338107+0000","last_clean":"2024-09-18T01:45:41.338107+0000","last_became_active":"2024-09-18T01:45:12.305742+0000","last_became_peered":"2024-09-18T01:45:12.305742+0000","last_unstale":"2024-09-18T01:45:41.338107+0000","last_undegraded":"2024-09-18T01:45:41.338107+0000","last_fullsized":"2024-09-18T01:45:41.338107+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:31:43.441229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"33'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:10.703620+0000","last_change":"2024-09-18T01:45:14.325723+0000","last_active":"2024-09-18T01:47:10.703620+0000","last_peered":"2024-09-18T01:47:10.703620+0000","last_clean":"2024-09-18T01:47:10.703620+0000","last_became_active":"2024-09-18T01:45:14.325368+0000","last_became_peered":"2024-09-18T01:45:14.325368+0000","last_unstale":"2024-09-18T01:47:10.703620+0000","last_undegraded":"2024-09-18T01:47:10.703620+0000","last_fullsized":"2024-09-18T01:47:10.703620+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:29:32.472538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"33'8","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.929324+0000","last_change":"2024-09-18T01:45:41.342690+0000","last_active":"2024-09-18T01:48:12.929324+0000","last_peered":"2024-09-18T01:48:12.929324+0000","last_clean":"2024-09-18T01:48:12.929324+0000","last_became_active":"2024-09-18T01:45:41.342336+0000","last_became_peered":"2024-09-18T01:45:41.342336+0000","last_unstale":"2024-09-18T01:48:12.929324+0000","last_undegraded":"2024-09-18T01:48:12.929324+0000","last_fullsized":"2024-09-18T01:48:12.929324+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:26:55.964302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.006982+0000","last_change":"2024-09-18T01:45:04.285604+0000","last_active":"2024-09-18T01:47:12.006982+0000","last_peered":"2024-09-18T01:47:12.006982+0000","last_clean":"2024-09-18T01:47:12.006982+0000","last_became_active":"2024-09-18T01:45:04.284969+0000","last_became_peered":"2024-09-18T01:45:04.284969+0000","last_unstale":"2024-09-18T01:47:12.006982+0000","last_undegraded":"2024-09-18T01:47:12.006982+0000","last_fullsized":"2024-09-18T01:47:12.006982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:43:17.455462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'11","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.800655+0000","last_change":"2024-09-18T01:45:06.285979+0000","last_active":"2024-09-18T01:48:12.800655+0000","last_peered":"2024-09-18T01:48:12.800655+0000","last_clean":"2024-09-18T01:48:12.800655+0000","last_became_active":"2024-09-18T01:45:06.285500+0000","last_became_peered":"2024-09-18T01:45:06.285500+0000","last_unstale":"2024-09-18T01:48:12.800655+0000","last_undegraded":"2024-09-18T01:48:12.800655+0000","last_fullsized":"2024-09-18T01:48:12.800655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:25:24.068245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337324+0000","last_change":"2024-09-18T01:45:04.280448+0000","last_active":"2024-09-18T01:45:41.337324+0000","last_peered":"2024-09-18T01:45:41.337324+0000","last_clean":"2024-09-18T01:45:41.337324+0000","last_became_active":"2024-09-18T01:45:04.280147+0000","last_became_peered":"2024-09-18T01:45:04.280147+0000","last_unstale":"2024-09-18T01:45:41.337324+0000","last_undegraded":"2024-09-18T01:45:41.337324+0000","last_fullsized":"2024-09-18T01:45:41.337324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:08:58.229173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.840013+0000","last_change":"2024-09-18T01:45:06.278954+0000","last_active":"2024-09-18T01:48:12.840013+0000","last_peered":"2024-09-18T01:48:12.840013+0000","last_clean":"2024-09-18T01:48:12.840013+0000","last_became_active":"2024-09-18T01:45:06.278684+0000","last_became_peered":"2024-09-18T01:45:06.278684+0000","last_unstale":"2024-09-18T01:48:12.840013+0000","last_undegraded":"2024-09-18T01:48:12.840013+0000","last_fullsized":"2024-09-18T01:48:12.840013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:02:53.996881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.335905+0000","last_change":"2024-09-18T01:45:04.283274+0000","last_active":"2024-09-18T01:45:41.335905+0000","last_peered":"2024-09-18T01:45:41.335905+0000","last_clean":"2024-09-18T01:45:41.335905+0000","last_became_active":"2024-09-18T01:45:04.281920+0000","last_became_peered":"2024-09-18T01:45:04.281920+0000","last_unstale":"2024-09-18T01:45:41.335905+0000","last_undegraded":"2024-09-18T01:45:41.335905+0000","last_fullsized":"2024-09-18T01:45:41.335905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:33:35.587070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"33'6","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:46.587865+0000","last_change":"2024-09-18T01:45:06.282298+0000","last_active":"2024-09-18T01:45:46.587865+0000","last_peered":"2024-09-18T01:45:46.587865+0000","last_clean":"2024-09-18T01:45:46.587865+0000","last_became_active":"2024-09-18T01:45:06.281998+0000","last_became_peered":"2024-09-18T01:45:06.281998+0000","last_unstale":"2024-09-18T01:45:46.587865+0000","last_undegraded":"2024-09-18T01:45:46.587865+0000","last_fullsized":"2024-09-18T01:45:46.587865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:57:38.152681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:44.957231+0000","last_change":"2024-09-18T01:45:04.280466+0000","last_active":"2024-09-18T01:45:44.957231+0000","last_peered":"2024-09-18T01:45:44.957231+0000","last_clean":"2024-09-18T01:45:44.957231+0000","last_became_active":"2024-09-18T01:45:04.280066+0000","last_became_peered":"2024-09-18T01:45:04.280066+0000","last_unstale":"2024-09-18T01:45:44.957231+0000","last_undegraded":"2024-09-18T01:45:44.957231+0000","last_fullsized":"2024-09-18T01:45:44.957231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:10:25.987284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.173427+0000","last_change":"2024-09-18T01:45:06.285899+0000","last_active":"2024-09-18T01:47:12.173427+0000","last_peered":"2024-09-18T01:47:12.173427+0000","last_clean":"2024-09-18T01:47:12.173427+0000","last_became_active":"2024-09-18T01:45:06.285054+0000","last_became_peered":"2024-09-18T01:45:06.285054+0000","last_unstale":"2024-09-18T01:47:12.173427+0000","last_undegraded":"2024-09-18T01:47:12.173427+0000","last_fullsized":"2024-09-18T01:47:12.173427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:48:17.261741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.339308+0000","last_change":"2024-09-18T01:45:04.281591+0000","last_active":"2024-09-18T01:45:41.339308+0000","last_peered":"2024-09-18T01:45:41.339308+0000","last_clean":"2024-09-18T01:45:41.339308+0000","last_became_active":"2024-09-18T01:45:04.281146+0000","last_became_peered":"2024-09-18T01:45:04.281146+0000","last_unstale":"2024-09-18T01:45:41.339308+0000","last_undegraded":"2024-09-18T01:45:41.339308+0000","last_fullsized":"2024-09-18T01:45:41.339308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:51:35.728759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:09.011065+0000","last_change":"2024-09-18T01:45:06.292733+0000","last_active":"2024-09-18T01:47:09.011065+0000","last_peered":"2024-09-18T01:47:09.011065+0000","last_clean":"2024-09-18T01:47:09.011065+0000","last_became_active":"2024-09-18T01:45:06.292490+0000","last_became_peered":"2024-09-18T01:45:06.292490+0000","last_unstale":"2024-09-18T01:47:09.011065+0000","last_undegraded":"2024-09-18T01:47:09.011065+0000","last_fullsized":"2024-09-18T01:47:09.011065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:03:57.182802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337752+0000","last_change":"2024-09-18T01:45:04.294522+0000","last_active":"2024-09-18T01:45:41.337752+0000","last_peered":"2024-09-18T01:45:41.337752+0000","last_clean":"2024-09-18T01:45:41.337752+0000","last_became_active":"2024-09-18T01:45:04.293767+0000","last_became_peered":"2024-09-18T01:45:04.293767+0000","last_unstale":"2024-09-18T01:45:41.337752+0000","last_undegraded":"2024-09-18T01:45:41.337752+0000","last_fullsized":"2024-09-18T01:45:41.337752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:16:49.444181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"33'10","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:46.125920+0000","last_change":"2024-09-18T01:45:06.293722+0000","last_active":"2024-09-18T01:45:46.125920+0000","last_peered":"2024-09-18T01:45:46.125920+0000","last_clean":"2024-09-18T01:45:46.125920+0000","last_became_active":"2024-09-18T01:45:06.293369+0000","last_became_peered":"2024-09-18T01:45:06.293369+0000","last_unstale":"2024-09-18T01:45:46.125920+0000","last_undegraded":"2024-09-18T01:45:46.125920+0000","last_fullsized":"2024-09-18T01:45:46.125920+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:12:27.107318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"33'1","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:17.215141+0000","last_change":"2024-09-18T01:45:04.292372+0000","last_active":"2024-09-18T01:47:17.215141+0000","last_peered":"2024-09-18T01:47:17.215141+0000","last_clean":"2024-09-18T01:47:17.215141+0000","last_became_active":"2024-09-18T01:45:04.292056+0000","last_became_peered":"2024-09-18T01:45:04.292056+0000","last_unstale":"2024-09-18T01:47:17.215141+0000","last_undegraded":"2024-09-18T01:47:17.215141+0000","last_fullsized":"2024-09-18T01:47:17.215141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:08:58.229173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'8","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.558399+0000","last_change":"2024-09-18T01:45:06.296391+0000","last_active":"2024-09-18T01:48:12.558399+0000","last_peered":"2024-09-18T01:48:12.558399+0000","last_clean":"2024-09-18T01:48:12.558399+0000","last_became_active":"2024-09-18T01:45:06.295055+0000","last_became_peered":"2024-09-18T01:45:06.295055+0000","last_unstale":"2024-09-18T01:48:12.558399+0000","last_undegraded":"2024-09-18T01:48:12.558399+0000","last_fullsized":"2024-09-18T01:48:12.558399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:48:17.261741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.339526+0000","last_change":"2024-09-18T01:45:04.284398+0000","last_active":"2024-09-18T01:45:41.339526+0000","last_peered":"2024-09-18T01:45:41.339526+0000","last_clean":"2024-09-18T01:45:41.339526+0000","last_became_active":"2024-09-18T01:45:04.283959+0000","last_became_peered":"2024-09-18T01:45:04.283959+0000","last_unstale":"2024-09-18T01:45:41.339526+0000","last_undegraded":"2024-09-18T01:45:41.339526+0000","last_fullsized":"2024-09-18T01:45:41.339526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:34:13.707906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"33'4","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.840864+0000","last_change":"2024-09-18T01:45:06.295541+0000","last_active":"2024-09-18T01:48:12.840864+0000","last_peered":"2024-09-18T01:48:12.840864+0000","last_clean":"2024-09-18T01:48:12.840864+0000","last_became_active":"2024-09-18T01:45:06.295270+0000","last_became_peered":"2024-09-18T01:45:06.295270+0000","last_unstale":"2024-09-18T01:48:12.840864+0000","last_undegraded":"2024-09-18T01:48:12.840864+0000","last_fullsized":"2024-09-18T01:48:12.840864+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:29:37.540404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.334195+0000","last_change":"2024-09-18T01:45:04.280658+0000","last_active":"2024-09-18T01:45:41.334195+0000","last_peered":"2024-09-18T01:45:41.334195+0000","last_clean":"2024-09-18T01:45:41.334195+0000","last_became_active":"2024-09-18T01:45:04.278951+0000","last_became_peered":"2024-09-18T01:45:04.278951+0000","last_unstale":"2024-09-18T01:45:41.334195+0000","last_undegraded":"2024-09-18T01:45:41.334195+0000","last_fullsized":"2024-09-18T01:45:41.334195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:55:36.239236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.793558+0000","last_change":"2024-09-18T01:45:06.285555+0000","last_active":"2024-09-18T01:48:12.793558+0000","last_peered":"2024-09-18T01:48:12.793558+0000","last_clean":"2024-09-18T01:48:12.793558+0000","last_became_active":"2024-09-18T01:45:06.285272+0000","last_became_peered":"2024-09-18T01:45:06.285272+0000","last_unstale":"2024-09-18T01:48:12.793558+0000","last_undegraded":"2024-09-18T01:48:12.793558+0000","last_fullsized":"2024-09-18T01:48:12.793558+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:22:44.893210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337596+0000","last_change":"2024-09-18T01:45:04.281621+0000","last_active":"2024-09-18T01:45:41.337596+0000","last_peered":"2024-09-18T01:45:41.337596+0000","last_clean":"2024-09-18T01:45:41.337596+0000","last_became_active":"2024-09-18T01:45:04.281197+0000","last_became_peered":"2024-09-18T01:45:04.281197+0000","last_unstale":"2024-09-18T01:45:41.337596+0000","last_undegraded":"2024-09-18T01:45:41.337596+0000","last_fullsized":"2024-09-18T01:45:41.337596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:59:04.808153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"33'4","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:45.518377+0000","last_change":"2024-09-18T01:45:06.285297+0000","last_active":"2024-09-18T01:45:45.518377+0000","last_peered":"2024-09-18T01:45:45.518377+0000","last_clean":"2024-09-18T01:45:45.518377+0000","last_became_active":"2024-09-18T01:45:06.284989+0000","last_became_peered":"2024-09-18T01:45:06.284989+0000","last_unstale":"2024-09-18T01:45:45.518377+0000","last_undegraded":"2024-09-18T01:45:45.518377+0000","last_fullsized":"2024-09-18T01:45:45.518377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:45:59.773285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.335010+0000","last_change":"2024-09-18T01:45:04.295486+0000","last_active":"2024-09-18T01:45:41.335010+0000","last_peered":"2024-09-18T01:45:41.335010+0000","last_clean":"2024-09-18T01:45:41.335010+0000","last_became_active":"2024-09-18T01:45:04.294125+0000","last_became_peered":"2024-09-18T01:45:04.294125+0000","last_unstale":"2024-09-18T01:45:41.335010+0000","last_undegraded":"2024-09-18T01:45:41.335010+0000","last_fullsized":"2024-09-18T01:45:41.335010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:40:12.946584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"33'10","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.840269+0000","last_change":"2024-09-18T01:45:06.279731+0000","last_active":"2024-09-18T01:48:12.840269+0000","last_peered":"2024-09-18T01:48:12.840269+0000","last_clean":"2024-09-18T01:48:12.840269+0000","last_became_active":"2024-09-18T01:45:06.279373+0000","last_became_peered":"2024-09-18T01:45:06.279373+0000","last_unstale":"2024-09-18T01:48:12.840269+0000","last_undegraded":"2024-09-18T01:48:12.840269+0000","last_fullsized":"2024-09-18T01:48:12.840269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:15:48.322910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.519021+0000","last_change":"2024-09-18T01:45:04.291798+0000","last_active":"2024-09-18T01:48:12.519021+0000","last_peered":"2024-09-18T01:48:12.519021+0000","last_clean":"2024-09-18T01:48:12.519021+0000","last_became_active":"2024-09-18T01:45:04.291442+0000","last_became_peered":"2024-09-18T01:45:04.291442+0000","last_unstale":"2024-09-18T01:48:12.519021+0000","last_undegraded":"2024-09-18T01:48:12.519021+0000","last_fullsized":"2024-09-18T01:48:12.519021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:49:22.831669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'6","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:46:28.553120+0000","last_change":"2024-09-18T01:45:06.292853+0000","last_active":"2024-09-18T01:46:28.553120+0000","last_peered":"2024-09-18T01:46:28.553120+0000","last_clean":"2024-09-18T01:46:28.553120+0000","last_became_active":"2024-09-18T01:45:06.292425+0000","last_became_peered":"2024-09-18T01:45:06.292425+0000","last_unstale":"2024-09-18T01:46:28.553120+0000","last_undegraded":"2024-09-18T01:46:28.553120+0000","last_fullsized":"2024-09-18T01:46:28.553120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:20:03.455685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.336514+0000","last_change":"2024-09-18T01:45:04.289922+0000","last_active":"2024-09-18T01:45:41.336514+0000","last_peered":"2024-09-18T01:45:41.336514+0000","last_clean":"2024-09-18T01:45:41.336514+0000","last_became_active":"2024-09-18T01:45:04.289365+0000","last_became_peered":"2024-09-18T01:45:04.289365+0000","last_unstale":"2024-09-18T01:45:41.336514+0000","last_undegraded":"2024-09-18T01:45:41.336514+0000","last_fullsized":"2024-09-18T01:45:41.336514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:59:59.323704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.335795+0000","last_change":"2024-09-18T01:45:06.293694+0000","last_active":"2024-09-18T01:45:41.335795+0000","last_peered":"2024-09-18T01:45:41.335795+0000","last_clean":"2024-09-18T01:45:41.335795+0000","last_became_active":"2024-09-18T01:45:06.293403+0000","last_became_peered":"2024-09-18T01:45:06.293403+0000","last_unstale":"2024-09-18T01:45:41.335795+0000","last_undegraded":"2024-09-18T01:45:41.335795+0000","last_fullsized":"2024-09-18T01:45:41.335795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:44:48.704400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.341176+0000","last_change":"2024-09-18T01:45:04.278234+0000","last_active":"2024-09-18T01:45:41.341176+0000","last_peered":"2024-09-18T01:45:41.341176+0000","last_clean":"2024-09-18T01:45:41.341176+0000","last_became_active":"2024-09-18T01:45:04.277907+0000","last_became_peered":"2024-09-18T01:45:04.277907+0000","last_unstale":"2024-09-18T01:45:41.341176+0000","last_undegraded":"2024-09-18T01:45:41.341176+0000","last_fullsized":"2024-09-18T01:45:41.341176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:08:05.518412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'3","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:22.216025+0000","last_change":"2024-09-18T01:45:06.293343+0000","last_active":"2024-09-18T01:47:22.216025+0000","last_peered":"2024-09-18T01:47:22.216025+0000","last_clean":"2024-09-18T01:47:22.216025+0000","last_became_active":"2024-09-18T01:45:06.293036+0000","last_became_peered":"2024-09-18T01:45:06.293036+0000","last_unstale":"2024-09-18T01:47:22.216025+0000","last_undegraded":"2024-09-18T01:47:22.216025+0000","last_fullsized":"2024-09-18T01:47:22.216025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:09:07.849480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.334001+0000","last_change":"2024-09-18T01:45:04.287307+0000","last_active":"2024-09-18T01:45:41.334001+0000","last_peered":"2024-09-18T01:45:41.334001+0000","last_clean":"2024-09-18T01:45:41.334001+0000","last_became_active":"2024-09-18T01:45:04.286591+0000","last_became_peered":"2024-09-18T01:45:04.286591+0000","last_unstale":"2024-09-18T01:45:41.334001+0000","last_undegraded":"2024-09-18T01:45:41.334001+0000","last_fullsized":"2024-09-18T01:45:41.334001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:40:12.946584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.871486+0000","last_change":"2024-09-18T01:45:06.295984+0000","last_active":"2024-09-18T01:48:12.871486+0000","last_peered":"2024-09-18T01:48:12.871486+0000","last_clean":"2024-09-18T01:48:12.871486+0000","last_became_active":"2024-09-18T01:45:06.294911+0000","last_became_peered":"2024-09-18T01:45:06.294911+0000","last_unstale":"2024-09-18T01:48:12.871486+0000","last_undegraded":"2024-09-18T01:48:12.871486+0000","last_fullsized":"2024-09-18T01:48:12.871486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:33:43.173746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.866201+0000","last_change":"2024-09-18T01:45:04.287888+0000","last_active":"2024-09-18T01:48:12.866201+0000","last_peered":"2024-09-18T01:48:12.866201+0000","last_clean":"2024-09-18T01:48:12.866201+0000","last_became_active":"2024-09-18T01:45:04.285719+0000","last_became_peered":"2024-09-18T01:45:04.285719+0000","last_unstale":"2024-09-18T01:48:12.866201+0000","last_undegraded":"2024-09-18T01:48:12.866201+0000","last_fullsized":"2024-09-18T01:48:12.866201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:33:41.166250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"33'1","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:27.216951+0000","last_change":"2024-09-18T01:45:04.280417+0000","last_active":"2024-09-18T01:47:27.216951+0000","last_peered":"2024-09-18T01:47:27.216951+0000","last_clean":"2024-09-18T01:47:27.216951+0000","last_became_active":"2024-09-18T01:45:04.278266+0000","last_became_peered":"2024-09-18T01:45:04.278266+0000","last_unstale":"2024-09-18T01:47:27.216951+0000","last_undegraded":"2024-09-18T01:47:27.216951+0000","last_fullsized":"2024-09-18T01:47:27.216951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:25:22.060750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"33'10","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:46:28.553059+0000","last_change":"2024-09-18T01:45:06.292390+0000","last_active":"2024-09-18T01:46:28.553059+0000","last_peered":"2024-09-18T01:46:28.553059+0000","last_clean":"2024-09-18T01:46:28.553059+0000","last_became_active":"2024-09-18T01:45:06.292127+0000","last_became_peered":"2024-09-18T01:45:06.292127+0000","last_unstale":"2024-09-18T01:46:28.553059+0000","last_undegraded":"2024-09-18T01:46:28.553059+0000","last_fullsized":"2024-09-18T01:46:28.553059+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:00:01.331200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337686+0000","last_change":"2024-09-18T01:45:04.273996+0000","last_active":"2024-09-18T01:45:41.337686+0000","last_peered":"2024-09-18T01:45:41.337686+0000","last_clean":"2024-09-18T01:45:41.337686+0000","last_became_active":"2024-09-18T01:45:04.273575+0000","last_became_peered":"2024-09-18T01:45:04.273575+0000","last_unstale":"2024-09-18T01:45:41.337686+0000","last_undegraded":"2024-09-18T01:45:41.337686+0000","last_fullsized":"2024-09-18T01:45:41.337686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:40:12.946584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'6","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.871024+0000","last_change":"2024-09-18T01:45:06.292393+0000","last_active":"2024-09-18T01:48:12.871024+0000","last_peered":"2024-09-18T01:48:12.871024+0000","last_clean":"2024-09-18T01:48:12.871024+0000","last_became_active":"2024-09-18T01:45:06.292037+0000","last_became_peered":"2024-09-18T01:45:06.292037+0000","last_unstale":"2024-09-18T01:48:12.871024+0000","last_undegraded":"2024-09-18T01:48:12.871024+0000","last_fullsized":"2024-09-18T01:48:12.871024+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:52:14.086589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11095,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1690,"num_read_kb":1447,"num_write":723,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1470,"ondisk_log_size":1470,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1590,"num_read_kb":1480,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38719488,"data_stored":38719488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705709,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48420,"kb_used_data":13076,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323420,"statfs":{"total":96636764160,"available":96587182080,"internally_reserved":0,"allocated":13389824,"data_stored":13058476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705709,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46560,"kb_used_data":11216,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94325280,"statfs":{"total":96636764160,"available":96589086720,"internally_reserved":0,"allocated":11485184,"data_stored":11223138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705709,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46908,"kb_used_data":11564,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94324932,"statfs":{"total":96636764160,"available":96588730368,"internally_reserved":0,"allocated":11841536,"data_stored":11549746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705709,"num_pgs":150,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44348,"kb_used_data":4844,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94327492,"statfs":{"total":96636764160,"available":96591351808,"internally_reserved":0,"allocated":4960256,"data_stored":4666184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4517888,"data_stored":4517888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10809344,"data_stored":10809344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12906496,"data_stored":12906496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T01:48:20.604 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-18T01:48:20.732 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.730+0000 7f84a1ae6640 1 Processor -- start 2024-09-18T01:48:20.732 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.730+0000 7f84a1ae6640 1 -- start start 2024-09-18T01:48:20.732 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.730+0000 7f84a1ae6640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f849c096630 0x7f849c096a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:20.732 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.730+0000 7f84a1ae6640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f849c0702f0 con 0x7f849c06d910 2024-09-18T01:48:20.732 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.730+0000 7f84a1ae6640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x7f849c06f1f0 con 0x7f849c096630 2024-09-18T01:48:20.732 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.731+0000 7f849b7fe640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f849c096630 0x7f849c096a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:20.733 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.731+0000 7f849affd640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f849c06d910 0x7f849c06dd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:38614/0 (socket says 172.21.15.129:38614) 2024-09-18T01:48:20.733 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.731+0000 7f849affd640 1 -- 172.21.15.129:0/20002563 learned_addr learned my addr 172.21.15.129:0/20002563 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-09-18T01:48:20.733 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.731+0000 7f849b7fe640 1 -- 172.21.15.129:0/20002563 >> v1:172.21.15.129:6789/0 conn(0x7f849c06d910 legacy=0x7f849c06dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:20.733 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.731+0000 7f849a7fc640 1 -- 172.21.15.129:0/20002563 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2761101553 0 0) 0x7f849c0702f0 con 0x7f849c06d910 2024-09-18T01:48:20.733 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.731+0000 7f849b7fe640 1 -- 172.21.15.129:0/20002563 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f849c06fb80 con 0x7f849c096630 2024-09-18T01:48:20.735 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.732+0000 7f849b7fe640 1 --2- 172.21.15.129:0/20002563 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f849c096630 0x7f849c096a10 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f848c009720 tx=0x7f848c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2055cff142718b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:20.736 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.732+0000 7f849a7fc640 1 -- 172.21.15.129:0/20002563 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f848c037070 con 0x7f849c096630 2024-09-18T01:48:20.736 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.732+0000 7f849a7fc640 1 -- 172.21.15.129:0/20002563 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f848c02ad90 con 0x7f849c096630 2024-09-18T01:48:20.736 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.732+0000 7f849a7fc640 1 -- 172.21.15.129:0/20002563 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f848c032590 con 0x7f849c096630 2024-09-18T01:48:20.736 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.732+0000 7f84a1ae6640 1 -- 172.21.15.129:0/20002563 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f849c096630 msgr2=0x7f849c096a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:20.736 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.732+0000 7f84a1ae6640 1 --2- 172.21.15.129:0/20002563 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f849c096630 0x7f849c096a10 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f848c009720 tx=0x7f848c02a110 comp rx=0 tx=0).stop 2024-09-18T01:48:20.736 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.732+0000 7f84a1ae6640 1 -- 172.21.15.129:0/20002563 shutdown_connections 2024-09-18T01:48:20.736 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.732+0000 7f84a1ae6640 1 --2- 172.21.15.129:0/20002563 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f849c096630 0x7f849c096a10 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:20.736 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.732+0000 7f84a1ae6640 1 -- 172.21.15.129:0/20002563 >> 172.21.15.129:0/20002563 conn(0x7f849c09a890 msgr2=0x7f849c09aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:48:20.736 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.732+0000 7f84a1ae6640 1 -- 172.21.15.129:0/20002563 shutdown_connections 2024-09-18T01:48:20.736 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.732+0000 7f84a1ae6640 1 -- 172.21.15.129:0/20002563 wait complete. 2024-09-18T01:48:20.736 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.733+0000 7f84a1ae6640 1 Processor -- start 2024-09-18T01:48:20.736 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.733+0000 7f84a1ae6640 1 -- start start 2024-09-18T01:48:20.736 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.734+0000 7f84a1ae6640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f849c06d910 0x7f849c124b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:20.737 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.734+0000 7f84a1ae6640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f849c06d410 con 0x7f849c06d910 2024-09-18T01:48:20.737 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.734+0000 7f849b7fe640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f849c06d910 0x7f849c124b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:20.737 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.734+0000 7f849b7fe640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f849c06d910 0x7f849c124b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:58794/0 (socket says 172.21.15.129:58794) 2024-09-18T01:48:20.737 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.734+0000 7f849b7fe640 1 -- 172.21.15.129:0/354632021 learned_addr learned my addr 172.21.15.129:0/354632021 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-18T01:48:20.737 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.734+0000 7f849b7fe640 1 -- 172.21.15.129:0/354632021 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f849c1266d0 con 0x7f849c06d910 2024-09-18T01:48:20.737 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.734+0000 7f849b7fe640 1 --2- 172.21.15.129:0/354632021 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f849c06d910 0x7f849c124b50 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f848c009720 tx=0x7f848c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:20.737 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.734+0000 7f8483fff640 1 -- 172.21.15.129:0/354632021 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f848c037050 con 0x7f849c06d910 2024-09-18T01:48:20.737 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.734+0000 7f8483fff640 1 -- 172.21.15.129:0/354632021 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f848c038040 con 0x7f849c06d910 2024-09-18T01:48:20.737 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.734+0000 7f84a1ae6640 1 -- 172.21.15.129:0/354632021 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f849c072ea0 con 0x7f849c06d910 2024-09-18T01:48:20.737 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.734+0000 7f8483fff640 1 -- 172.21.15.129:0/354632021 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f848c0042f0 con 0x7f849c06d910 2024-09-18T01:48:20.737 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.734+0000 7f84a1ae6640 1 -- 172.21.15.129:0/354632021 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f849c1283b0 con 0x7f849c06d910 2024-09-18T01:48:20.738 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.735+0000 7f8483fff640 1 -- 172.21.15.129:0/354632021 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f848c003610 con 0x7f849c06d910 2024-09-18T01:48:20.738 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.735+0000 7f8483fff640 1 --2- 172.21.15.129:0/354632021 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f848803a460 0x7f848803c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:20.738 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.735+0000 7f8483fff640 1 -- 172.21.15.129:0/354632021 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f848c06c660 con 0x7f849c06d910 2024-09-18T01:48:20.738 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.735+0000 7f84a1ae6640 1 -- 172.21.15.129:0/354632021 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f849c0008d0 con 0x7f849c06d910 2024-09-18T01:48:20.738 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.736+0000 7f849affd640 1 --2- 172.21.15.129:0/354632021 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f848803a460 0x7f848803c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:20.738 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.736+0000 7f849affd640 1 --2- 172.21.15.129:0/354632021 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f848803a460 0x7f848803c920 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8490000c00 tx=0x7f8490007910 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:20.741 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.740+0000 7f8483fff640 1 -- 172.21.15.129:0/354632021 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f848c004490 con 0x7f849c06d910 2024-09-18T01:48:20.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.905+0000 7f84a1ae6640 1 -- 172.21.15.129:0/354632021 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f849c074990 con 0x7f849c06d910 2024-09-18T01:48:20.908 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.906+0000 7f8483fff640 1 -- 172.21.15.129:0/354632021 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+21152 (secure 0 0 0) 0x7f848c003e20 con 0x7f849c06d910 2024-09-18T01:48:20.908 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:48:20.908 INFO:teuthology.orchestra.run.smithi129.stdout:{"epoch":33,"fsid":"5634e4ff-a0cf-4689-882d-342647f6e34c","created":"2024-09-18T01:44:36.105421+0000","modified":"2024-09-18T01:45:41.327591+0000","last_up_change":"2024-09-18T01:44:47.044491+0000","last_in_change":"2024-09-18T01:44:37.219405+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-18T01:44:48.210295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-18T01:44:51.744833+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-18T01:45:02.270700+0000","flags":1,"flags_names":"hashpspool","type":3,"size":3,"min_size":2,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-18T01:45:04.588110+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-18T01:45:06.585874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-18T01:45:08.374814+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-18T01:45:10.328440+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-18T01:45:12.397398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19ab8d59-755c-42b6-83df-b3c88496d6da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":1759265424},{"type":"v1","addr":"172.21.15.129:6801","nonce":1759265424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":1759265424},{"type":"v1","addr":"172.21.15.129:6803","nonce":1759265424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":1759265424},{"type":"v1","addr":"172.21.15.129:6807","nonce":1759265424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":1759265424},{"type":"v1","addr":"172.21.15.129:6805","nonce":1759265424}]},"public_addr":"172.21.15.129:6801/1759265424","cluster_addr":"172.21.15.129:6803/1759265424","heartbeat_back_addr":"172.21.15.129:6807/1759265424","heartbeat_front_addr":"172.21.15.129:6805/1759265424","state":["exists","up"]},{"osd":1,"uuid":"4d5949df-a041-424d-a475-2025e490700c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":3930274777},{"type":"v1","addr":"172.21.15.146:6810","nonce":3930274777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":3930274777},{"type":"v1","addr":"172.21.15.146:6814","nonce":3930274777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":3930274777},{"type":"v1","addr":"172.21.15.146:6822","nonce":3930274777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":3930274777},{"type":"v1","addr":"172.21.15.146:6818","nonce":3930274777}]},"public_addr":"172.21.15.146:6810/3930274777","cluster_addr":"172.21.15.146:6814/3930274777","heartbeat_back_addr":"172.21.15.146:6822/3930274777","heartbeat_front_addr":"172.21.15.146:6818/3930274777","state":["exists","up"]},{"osd":2,"uuid":"ff23f4ef-a771-4752-b233-87f7287b6c75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3820039304},{"type":"v1","addr":"172.21.15.146:6801","nonce":3820039304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3820039304},{"type":"v1","addr":"172.21.15.146:6803","nonce":3820039304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3820039304},{"type":"v1","addr":"172.21.15.146:6807","nonce":3820039304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3820039304},{"type":"v1","addr":"172.21.15.146:6805","nonce":3820039304}]},"public_addr":"172.21.15.146:6801/3820039304","cluster_addr":"172.21.15.146:6803/3820039304","heartbeat_back_addr":"172.21.15.146:6807/3820039304","heartbeat_front_addr":"172.21.15.146:6805/3820039304","state":["exists","up"]},{"osd":3,"uuid":"e84370c3-e85d-40c8-bea4-4a6e61cf53d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":4106661138},{"type":"v1","addr":"172.21.15.146:6811","nonce":4106661138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6813","nonce":4106661138},{"type":"v1","addr":"172.21.15.146:6815","nonce":4106661138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6821","nonce":4106661138},{"type":"v1","addr":"172.21.15.146:6823","nonce":4106661138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":4106661138},{"type":"v1","addr":"172.21.15.146:6819","nonce":4106661138}]},"public_addr":"172.21.15.146:6811/4106661138","cluster_addr":"172.21.15.146:6815/4106661138","heartbeat_back_addr":"172.21.15.146:6823/4106661138","heartbeat_front_addr":"172.21.15.146:6819/4106661138","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T01:44:44.239764+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T01:44:44.858663+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T01:44:44.354345+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T01:44:44.723166+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.6","mappings":[{"from":3,"to":2}]},{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.27","mappings":[{"from":3,"to":2}]},{"pgid":"5.12","mappings":[{"from":0,"to":2}]},{"pgid":"5.13","mappings":[{"from":0,"to":2}]},{"pgid":"5.1d","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T01:48:20.910 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.908+0000 7f84a1ae6640 1 -- 172.21.15.129:0/354632021 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f848803a460 msgr2=0x7f848803c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:20.910 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.908+0000 7f84a1ae6640 1 --2- 172.21.15.129:0/354632021 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f848803a460 0x7f848803c920 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8490000c00 tx=0x7f8490007910 comp rx=0 tx=0).stop 2024-09-18T01:48:20.910 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.908+0000 7f84a1ae6640 1 -- 172.21.15.129:0/354632021 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f849c06d910 msgr2=0x7f849c124b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:20.910 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.908+0000 7f84a1ae6640 1 --2- 172.21.15.129:0/354632021 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f849c06d910 0x7f849c124b50 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f848c009720 tx=0x7f848c0046c0 comp rx=0 tx=0).stop 2024-09-18T01:48:20.910 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.909+0000 7f84a1ae6640 1 -- 172.21.15.129:0/354632021 shutdown_connections 2024-09-18T01:48:20.910 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.909+0000 7f84a1ae6640 1 --2- 172.21.15.129:0/354632021 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f848803a460 0x7f848803c920 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:20.910 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.909+0000 7f84a1ae6640 1 --2- 172.21.15.129:0/354632021 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f849c06d910 0x7f849c124b50 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:20.910 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.909+0000 7f84a1ae6640 1 -- 172.21.15.129:0/354632021 >> 172.21.15.129:0/354632021 conn(0x7f849c09a890 msgr2=0x7f849c097390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:48:20.911 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.909+0000 7f84a1ae6640 1 -- 172.21.15.129:0/354632021 shutdown_connections 2024-09-18T01:48:20.911 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:20.909+0000 7f84a1ae6640 1 -- 172.21.15.129:0/354632021 wait complete. 2024-09-18T01:48:21.972 INFO:tasks.ceph:Scrubbing osd.0 2024-09-18T01:48:21.972 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-18T01:48:22.086 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.084+0000 7faf3f253640 1 Processor -- start 2024-09-18T01:48:22.086 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.084+0000 7faf3f253640 1 -- start start 2024-09-18T01:48:22.086 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.084+0000 7faf3f253640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7faf380995d0 0x7faf38099c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:22.086 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.084+0000 7faf3f253640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf38098a60 con 0x7faf3809a1c0 2024-09-18T01:48:22.086 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.084+0000 7faf3f253640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x7faf380992c0 con 0x7faf380995d0 2024-09-18T01:48:22.086 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.085+0000 7faf3cfef640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7faf380995d0 0x7faf38099c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:22.087 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.085+0000 7faf2ffff640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7faf3809a1c0 0x7faf3809be70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:38620/0 (socket says 172.21.15.129:38620) 2024-09-18T01:48:22.087 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.085+0000 7faf2ffff640 1 -- 172.21.15.129:0/1229075056 learned_addr learned my addr 172.21.15.129:0/1229075056 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-09-18T01:48:22.087 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.085+0000 7faf3cfef640 1 -- 172.21.15.129:0/1229075056 >> v1:172.21.15.129:6789/0 conn(0x7faf3809a1c0 legacy=0x7faf3809be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:22.087 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.085+0000 7faf3cfef640 1 -- 172.21.15.129:0/1229075056 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf3809a5d0 con 0x7faf380995d0 2024-09-18T01:48:22.090 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.086+0000 7faf3cfef640 1 --2- 172.21.15.129:0/1229075056 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7faf380995d0 0x7faf38099c80 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7faf34009720 tx=0x7faf3402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfc7e385f938ccc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:22.090 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.086+0000 7faf2f7fe640 1 -- 172.21.15.129:0/1229075056 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf34037070 con 0x7faf380995d0 2024-09-18T01:48:22.090 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.086+0000 7faf2f7fe640 1 -- 172.21.15.129:0/1229075056 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf3402ad90 con 0x7faf380995d0 2024-09-18T01:48:22.090 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.086+0000 7faf2f7fe640 1 -- 172.21.15.129:0/1229075056 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf34032590 con 0x7faf380995d0 2024-09-18T01:48:22.090 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.086+0000 7faf3f253640 1 -- 172.21.15.129:0/1229075056 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7faf380995d0 msgr2=0x7faf38099c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:22.090 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.086+0000 7faf3f253640 1 --2- 172.21.15.129:0/1229075056 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7faf380995d0 0x7faf38099c80 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7faf34009720 tx=0x7faf3402a110 comp rx=0 tx=0).stop 2024-09-18T01:48:22.090 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.086+0000 7faf3f253640 1 -- 172.21.15.129:0/1229075056 shutdown_connections 2024-09-18T01:48:22.090 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.086+0000 7faf3f253640 1 --2- 172.21.15.129:0/1229075056 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7faf380995d0 0x7faf38099c80 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:22.090 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.086+0000 7faf3f253640 1 -- 172.21.15.129:0/1229075056 >> 172.21.15.129:0/1229075056 conn(0x7faf3806d4b0 msgr2=0x7faf3806d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:48:22.090 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.086+0000 7faf3f253640 1 -- 172.21.15.129:0/1229075056 shutdown_connections 2024-09-18T01:48:22.090 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.086+0000 7faf3f253640 1 -- 172.21.15.129:0/1229075056 wait complete. 2024-09-18T01:48:22.091 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.087+0000 7faf3f253640 1 Processor -- start 2024-09-18T01:48:22.091 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.087+0000 7faf3f253640 1 -- start start 2024-09-18T01:48:22.091 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.088+0000 7faf3f253640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7faf380995d0 0x7faf381c3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:22.091 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.088+0000 7faf3f253640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7faf3809c950 con 0x7faf380995d0 2024-09-18T01:48:22.091 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.088+0000 7faf3cfef640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7faf380995d0 0x7faf381c3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:22.091 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.088+0000 7faf3cfef640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7faf380995d0 0x7faf381c3890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:58820/0 (socket says 172.21.15.129:58820) 2024-09-18T01:48:22.091 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.088+0000 7faf3cfef640 1 -- 172.21.15.129:0/3542689641 learned_addr learned my addr 172.21.15.129:0/3542689641 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-18T01:48:22.091 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.088+0000 7faf3cfef640 1 -- 172.21.15.129:0/3542689641 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf381b1ab0 con 0x7faf380995d0 2024-09-18T01:48:22.091 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.088+0000 7faf3cfef640 1 --2- 172.21.15.129:0/3542689641 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7faf380995d0 0x7faf381c3890 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7faf34009840 tx=0x7faf340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:22.091 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.088+0000 7faf2d7fa640 1 -- 172.21.15.129:0/3542689641 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf34041070 con 0x7faf380995d0 2024-09-18T01:48:22.091 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.088+0000 7faf2d7fa640 1 -- 172.21.15.129:0/3542689641 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf3403c460 con 0x7faf380995d0 2024-09-18T01:48:22.091 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.089+0000 7faf3f253640 1 -- 172.21.15.129:0/3542689641 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf381b2390 con 0x7faf380995d0 2024-09-18T01:48:22.092 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.089+0000 7faf2d7fa640 1 -- 172.21.15.129:0/3542689641 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf34037040 con 0x7faf380995d0 2024-09-18T01:48:22.092 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.089+0000 7faf3f253640 1 -- 172.21.15.129:0/3542689641 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf381c3fb0 con 0x7faf380995d0 2024-09-18T01:48:22.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.089+0000 7faf2d7fa640 1 -- 172.21.15.129:0/3542689641 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7faf34044070 con 0x7faf380995d0 2024-09-18T01:48:22.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.089+0000 7faf2d7fa640 1 --2- 172.21.15.129:0/3542689641 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7faf240382d0 0x7faf2403a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:22.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.089+0000 7faf3f253640 1 -- 172.21.15.129:0/3542689641 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faf38099c80 con 0x7faf380995d0 2024-09-18T01:48:22.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.090+0000 7faf2d7fa640 1 -- 172.21.15.129:0/3542689641 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7faf3406c590 con 0x7faf380995d0 2024-09-18T01:48:22.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.090+0000 7faf2d7fa640 1 --2- 172.21.15.129:0/3542689641 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7faf24044630 0x7faf24046ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:22.093 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.090+0000 7faf2d7fa640 1 -- 172.21.15.129:0/3542689641 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faf34007e60 con 0x7faf24044630 2024-09-18T01:48:22.094 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.090+0000 7faf2d7fa640 1 -- 172.21.15.129:0/3542689641 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7faf3404e350 con 0x7faf380995d0 2024-09-18T01:48:22.094 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.090+0000 7faf3d7f0640 1 --2- 172.21.15.129:0/3542689641 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7faf24044630 0x7faf24046ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:22.094 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.090+0000 7faf2ffff640 1 --2- 172.21.15.129:0/3542689641 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7faf240382d0 0x7faf2403a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:22.094 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.090+0000 7faf3d7f0640 1 --2- 172.21.15.129:0/3542689641 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7faf24044630 0x7faf24046ad0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:22.094 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.090+0000 7faf2ffff640 1 --2- 172.21.15.129:0/3542689641 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7faf240382d0 0x7faf2403a790 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7faf28007fd0 tx=0x7faf28007ac0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:22.094 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.091+0000 7faf2d7fa640 1 -- 172.21.15.129:0/3542689641 <== osd.0 v2:172.21.15.129:6800/1759265424 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faf34007e60 con 0x7faf24044630 2024-09-18T01:48:22.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.103+0000 7faf3f253640 1 -- 172.21.15.129:0/3542689641 --> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7faf381b2b40 con 0x7faf24044630 2024-09-18T01:48:22.104 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.103+0000 7faf2d7fa640 1 -- 172.21.15.129:0/3542689641 <== osd.0 v2:172.21.15.129:6800/1759265424 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7faf381b2b40 con 0x7faf24044630 2024-09-18T01:48:22.105 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-09-18T01:48:22.105 INFO:teuthology.orchestra.run.smithi129.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-18T01:48:22.105 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-09-18T01:48:22.106 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.104+0000 7faf3f253640 1 -- 172.21.15.129:0/3542689641 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7faf24044630 msgr2=0x7faf24046ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:22.106 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.104+0000 7faf3f253640 1 --2- 172.21.15.129:0/3542689641 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7faf24044630 0x7faf24046ad0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:22.106 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.104+0000 7faf3f253640 1 -- 172.21.15.129:0/3542689641 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7faf240382d0 msgr2=0x7faf2403a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:22.106 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.104+0000 7faf3f253640 1 --2- 172.21.15.129:0/3542689641 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7faf240382d0 0x7faf2403a790 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7faf28007fd0 tx=0x7faf28007ac0 comp rx=0 tx=0).stop 2024-09-18T01:48:22.106 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.104+0000 7faf3f253640 1 -- 172.21.15.129:0/3542689641 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7faf380995d0 msgr2=0x7faf381c3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:22.106 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.104+0000 7faf3f253640 1 --2- 172.21.15.129:0/3542689641 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7faf380995d0 0x7faf381c3890 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7faf34009840 tx=0x7faf340046c0 comp rx=0 tx=0).stop 2024-09-18T01:48:22.106 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.104+0000 7faf3f253640 1 -- 172.21.15.129:0/3542689641 shutdown_connections 2024-09-18T01:48:22.106 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.104+0000 7faf3f253640 1 --2- 172.21.15.129:0/3542689641 >> [v2:172.21.15.129:6800/1759265424,v1:172.21.15.129:6801/1759265424] conn(0x7faf24044630 0x7faf24046ad0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:22.106 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.104+0000 7faf3f253640 1 --2- 172.21.15.129:0/3542689641 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7faf240382d0 0x7faf2403a790 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:22.106 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.104+0000 7faf3f253640 1 --2- 172.21.15.129:0/3542689641 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7faf380995d0 0x7faf381c3890 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:22.107 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.104+0000 7faf3f253640 1 -- 172.21.15.129:0/3542689641 >> 172.21.15.129:0/3542689641 conn(0x7faf3806d4b0 msgr2=0x7faf3809ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:48:22.107 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.104+0000 7faf3f253640 1 -- 172.21.15.129:0/3542689641 shutdown_connections 2024-09-18T01:48:22.107 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.104+0000 7faf3f253640 1 -- 172.21.15.129:0/3542689641 wait complete. 2024-09-18T01:48:22.115 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-18T01:48:22.214 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.212+0000 7f9fcd952640 1 Processor -- start 2024-09-18T01:48:22.214 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.212+0000 7f9fcd952640 1 -- start start 2024-09-18T01:48:22.214 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.212+0000 7f9fcd952640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f9fc809a100 0x7f9fc8133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:22.214 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.212+0000 7f9fcd952640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fc809d3b0 con 0x7f9fc809bd50 2024-09-18T01:48:22.214 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.212+0000 7f9fcd952640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x7f9fc809c840 con 0x7f9fc809a100 2024-09-18T01:48:22.214 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.213+0000 7f9fbe7fc640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f9fc809a100 0x7f9fc8133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:22.215 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.213+0000 7f9fc6ffd640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f9fc809bd50 0x7f9fc809c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:38630/0 (socket says 172.21.15.129:38630) 2024-09-18T01:48:22.215 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.213+0000 7f9fc6ffd640 1 -- 172.21.15.129:0/3272457655 learned_addr learned my addr 172.21.15.129:0/3272457655 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-09-18T01:48:22.215 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.213+0000 7f9fbe7fc640 1 -- 172.21.15.129:0/3272457655 >> v1:172.21.15.129:6789/0 conn(0x7f9fc809bd50 legacy=0x7f9fc809c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:22.215 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.213+0000 7f9fbe7fc640 1 -- 172.21.15.129:0/3272457655 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fc8098230 con 0x7f9fc809a100 2024-09-18T01:48:22.215 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.213+0000 7f9fc67fc640 1 -- 172.21.15.129:0/3272457655 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2467743367 0 0) 0x7f9fb8001110 con 0x7f9fc809bd50 2024-09-18T01:48:22.217 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.213+0000 7f9fbe7fc640 1 --2- 172.21.15.129:0/3272457655 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9fc809a100 0x7f9fc8133da0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f9fb0009720 tx=0x7f9fb002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=828c0096e0c78074 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:22.217 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.214+0000 7f9fc67fc640 1 -- 172.21.15.129:0/3272457655 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fb0037070 con 0x7f9fc809a100 2024-09-18T01:48:22.217 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.214+0000 7f9fc67fc640 1 -- 172.21.15.129:0/3272457655 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fb002ad90 con 0x7f9fc809a100 2024-09-18T01:48:22.217 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.214+0000 7f9fc67fc640 1 -- 172.21.15.129:0/3272457655 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fb0032590 con 0x7f9fc809a100 2024-09-18T01:48:22.218 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.214+0000 7f9fcd952640 1 -- 172.21.15.129:0/3272457655 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9fc809a100 msgr2=0x7f9fc8133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:22.218 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.214+0000 7f9fcd952640 1 --2- 172.21.15.129:0/3272457655 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9fc809a100 0x7f9fc8133da0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f9fb0009720 tx=0x7f9fb002a110 comp rx=0 tx=0).stop 2024-09-18T01:48:22.218 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.214+0000 7f9fcd952640 1 -- 172.21.15.129:0/3272457655 shutdown_connections 2024-09-18T01:48:22.218 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.214+0000 7f9fcd952640 1 --2- 172.21.15.129:0/3272457655 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9fc809a100 0x7f9fc8133da0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:22.218 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.214+0000 7f9fcd952640 1 -- 172.21.15.129:0/3272457655 >> 172.21.15.129:0/3272457655 conn(0x7f9fc806d4a0 msgr2=0x7f9fc806d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:48:22.218 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.214+0000 7f9fcd952640 1 -- 172.21.15.129:0/3272457655 shutdown_connections 2024-09-18T01:48:22.218 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.214+0000 7f9fcd952640 1 -- 172.21.15.129:0/3272457655 wait complete. 2024-09-18T01:48:22.218 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.215+0000 7f9fcd952640 1 Processor -- start 2024-09-18T01:48:22.218 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.215+0000 7f9fcd952640 1 -- start start 2024-09-18T01:48:22.218 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.216+0000 7f9fcd952640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9fc809a100 0x7f9fc81c3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:22.218 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.216+0000 7f9fcd952640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc8134670 con 0x7f9fc809a100 2024-09-18T01:48:22.218 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.216+0000 7f9fc6ffd640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9fc809a100 0x7f9fc81c3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:22.219 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.216+0000 7f9fc6ffd640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9fc809a100 0x7f9fc81c3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:58846/0 (socket says 172.21.15.129:58846) 2024-09-18T01:48:22.219 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.216+0000 7f9fc6ffd640 1 -- 172.21.15.129:0/3096237746 learned_addr learned my addr 172.21.15.129:0/3096237746 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-18T01:48:22.219 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.216+0000 7f9fc6ffd640 1 -- 172.21.15.129:0/3096237746 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fc8095e90 con 0x7f9fc809a100 2024-09-18T01:48:22.219 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.216+0000 7f9fc6ffd640 1 --2- 172.21.15.129:0/3096237746 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9fc809a100 0x7f9fc81c3990 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f9fb800c700 tx=0x7f9fb800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:22.219 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.216+0000 7f9fc4ff9640 1 -- 172.21.15.129:0/3096237746 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fb8018070 con 0x7f9fc809a100 2024-09-18T01:48:22.219 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.216+0000 7f9fc4ff9640 1 -- 172.21.15.129:0/3096237746 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fb80070d0 con 0x7f9fc809a100 2024-09-18T01:48:22.219 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.216+0000 7f9fcd952640 1 -- 172.21.15.129:0/3096237746 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fc8096d60 con 0x7f9fc809a100 2024-09-18T01:48:22.219 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.216+0000 7f9fc4ff9640 1 -- 172.21.15.129:0/3096237746 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fb80073f0 con 0x7f9fc809a100 2024-09-18T01:48:22.219 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.216+0000 7f9fcd952640 1 -- 172.21.15.129:0/3096237746 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fc81c40b0 con 0x7f9fc809a100 2024-09-18T01:48:22.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.217+0000 7f9fc4ff9640 1 -- 172.21.15.129:0/3096237746 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9fb801b070 con 0x7f9fc809a100 2024-09-18T01:48:22.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.217+0000 7f9fcd952640 1 -- 172.21.15.129:0/3096237746 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fc809d020 con 0x7f9fc809a100 2024-09-18T01:48:22.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.217+0000 7f9fc4ff9640 1 --2- 172.21.15.129:0/3096237746 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9fa8038250 0x7f9fa803a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:22.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.218+0000 7f9fc4ff9640 1 -- 172.21.15.129:0/3096237746 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f9fb804b0f0 con 0x7f9fc809a100 2024-09-18T01:48:22.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.218+0000 7f9fbe7fc640 1 --2- 172.21.15.129:0/3096237746 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9fa8038250 0x7f9fa803a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:22.220 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.218+0000 7f9fbe7fc640 1 --2- 172.21.15.129:0/3096237746 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9fa8038250 0x7f9fa803a710 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f9fb0034000 tx=0x7f9fb002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:22.223 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.222+0000 7f9fc4ff9640 1 -- 172.21.15.129:0/3096237746 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9fc809d3b0 con 0x7f9fc809a100 2024-09-18T01:48:22.390 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.389+0000 7f9fcd952640 1 -- 172.21.15.129:0/3096237746 --> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f9fc8096a50 con 0x7f9fa8038250 2024-09-18T01:48:22.391 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.390+0000 7f9fc4ff9640 1 -- 172.21.15.129:0/3096237746 <== mgr.4099 v2:172.21.15.146:6824/168968651 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f9fc8096a50 con 0x7f9fa8038250 2024-09-18T01:48:22.391 INFO:teuthology.orchestra.run.smithi129.stderr:instructed osd(s) 0 to deep-scrub 2024-09-18T01:48:22.394 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.392+0000 7f9fcd952640 1 -- 172.21.15.129:0/3096237746 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9fa8038250 msgr2=0x7f9fa803a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:22.394 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.392+0000 7f9fcd952640 1 --2- 172.21.15.129:0/3096237746 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9fa8038250 0x7f9fa803a710 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f9fb0034000 tx=0x7f9fb002e000 comp rx=0 tx=0).stop 2024-09-18T01:48:22.394 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.392+0000 7f9fcd952640 1 -- 172.21.15.129:0/3096237746 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9fc809a100 msgr2=0x7f9fc81c3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:22.394 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.392+0000 7f9fcd952640 1 --2- 172.21.15.129:0/3096237746 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9fc809a100 0x7f9fc81c3990 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f9fb800c700 tx=0x7f9fb800cbc0 comp rx=0 tx=0).stop 2024-09-18T01:48:22.394 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.393+0000 7f9fcd952640 1 -- 172.21.15.129:0/3096237746 shutdown_connections 2024-09-18T01:48:22.394 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.393+0000 7f9fcd952640 1 --2- 172.21.15.129:0/3096237746 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9fa8038250 0x7f9fa803a710 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:22.394 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.393+0000 7f9fcd952640 1 --2- 172.21.15.129:0/3096237746 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9fc809a100 0x7f9fc81c3990 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:22.394 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.393+0000 7f9fcd952640 1 -- 172.21.15.129:0/3096237746 >> 172.21.15.129:0/3096237746 conn(0x7f9fc806d4a0 msgr2=0x7f9fc809f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:48:22.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.393+0000 7f9fcd952640 1 -- 172.21.15.129:0/3096237746 shutdown_connections 2024-09-18T01:48:22.395 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.393+0000 7f9fcd952640 1 -- 172.21.15.129:0/3096237746 wait complete. 2024-09-18T01:48:22.404 INFO:tasks.ceph:Scrubbing osd.1 2024-09-18T01:48:22.405 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-18T01:48:22.507 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.505+0000 7f9be16dd640 1 Processor -- start 2024-09-18T01:48:22.507 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.505+0000 7f9be16dd640 1 -- start start 2024-09-18T01:48:22.507 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.506+0000 7f9be16dd640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f9bdc0995d0 0x7f9bdc099c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:22.507 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.506+0000 7f9be16dd640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bdc098a60 con 0x7f9bdc09a1c0 2024-09-18T01:48:22.507 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.506+0000 7f9be16dd640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x7f9bdc0992c0 con 0x7f9bdc0995d0 2024-09-18T01:48:22.508 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.506+0000 7f9bdaffd640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f9bdc0995d0 0x7f9bdc099c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:22.508 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.506+0000 7f9bda7fc640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f9bdc09a1c0 0x7f9bdc09be70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:38638/0 (socket says 172.21.15.129:38638) 2024-09-18T01:48:22.508 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.506+0000 7f9bdaffd640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f9bdc0995d0 0x7f9bdc099c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:58852/0 (socket says 172.21.15.129:58852) 2024-09-18T01:48:22.508 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.506+0000 7f9bda7fc640 1 -- 172.21.15.129:0/4005618499 learned_addr learned my addr 172.21.15.129:0/4005618499 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-09-18T01:48:22.508 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.506+0000 7f9bdaffd640 1 -- 172.21.15.129:0/4005618499 >> v1:172.21.15.129:6789/0 conn(0x7f9bdc09a1c0 legacy=0x7f9bdc09be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:22.508 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.506+0000 7f9bdaffd640 1 -- 172.21.15.129:0/4005618499 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bdc09a5d0 con 0x7f9bdc0995d0 2024-09-18T01:48:22.509 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.507+0000 7f9bdaffd640 1 --2- 172.21.15.129:0/4005618499 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9bdc0995d0 0x7f9bdc099c80 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc009d90 tx=0x7f9bcc02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ba0fda3fe55f40d server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:22.509 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.507+0000 7f9bd9ffb640 1 -- 172.21.15.129:0/4005618499 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bcc007670 con 0x7f9bdc0995d0 2024-09-18T01:48:22.509 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.507+0000 7f9bd9ffb640 1 -- 172.21.15.129:0/4005618499 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bcc007810 con 0x7f9bdc0995d0 2024-09-18T01:48:22.509 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.507+0000 7f9bd9ffb640 1 -- 172.21.15.129:0/4005618499 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bcc007b10 con 0x7f9bdc0995d0 2024-09-18T01:48:22.510 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.507+0000 7f9be16dd640 1 -- 172.21.15.129:0/4005618499 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9bdc0995d0 msgr2=0x7f9bdc099c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:22.510 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.507+0000 7f9be16dd640 1 --2- 172.21.15.129:0/4005618499 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9bdc0995d0 0x7f9bdc099c80 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc009d90 tx=0x7f9bcc02a660 comp rx=0 tx=0).stop 2024-09-18T01:48:22.510 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.507+0000 7f9be16dd640 1 -- 172.21.15.129:0/4005618499 shutdown_connections 2024-09-18T01:48:22.510 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.507+0000 7f9be16dd640 1 --2- 172.21.15.129:0/4005618499 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9bdc0995d0 0x7f9bdc099c80 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:22.510 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.507+0000 7f9be16dd640 1 -- 172.21.15.129:0/4005618499 >> 172.21.15.129:0/4005618499 conn(0x7f9bdc06d4b0 msgr2=0x7f9bdc06d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:48:22.510 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.507+0000 7f9be16dd640 1 -- 172.21.15.129:0/4005618499 shutdown_connections 2024-09-18T01:48:22.510 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.507+0000 7f9be16dd640 1 -- 172.21.15.129:0/4005618499 wait complete. 2024-09-18T01:48:22.510 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.508+0000 7f9be16dd640 1 Processor -- start 2024-09-18T01:48:22.510 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.509+0000 7f9be16dd640 1 -- start start 2024-09-18T01:48:22.512 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.509+0000 7f9be16dd640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9bdc0995d0 0x7f9bdc1c3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:22.512 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.509+0000 7f9be16dd640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f9bdc09c950 con 0x7f9bdc0995d0 2024-09-18T01:48:22.513 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.509+0000 7f9bdaffd640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9bdc0995d0 0x7f9bdc1c3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:22.513 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.509+0000 7f9bdaffd640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9bdc0995d0 0x7f9bdc1c3720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:58860/0 (socket says 172.21.15.129:58860) 2024-09-18T01:48:22.513 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.509+0000 7f9bdaffd640 1 -- 172.21.15.129:0/3668419560 learned_addr learned my addr 172.21.15.129:0/3668419560 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-18T01:48:22.513 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.509+0000 7f9bdaffd640 1 -- 172.21.15.129:0/3668419560 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bdc1b2ba0 con 0x7f9bdc0995d0 2024-09-18T01:48:22.513 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.509+0000 7f9bdaffd640 1 --2- 172.21.15.129:0/3668419560 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9bdc0995d0 0x7f9bdc1c3720 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc009d90 tx=0x7f9bcc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:22.513 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.509+0000 7f9bd37fe640 1 -- 172.21.15.129:0/3668419560 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bcc040070 con 0x7f9bdc0995d0 2024-09-18T01:48:22.513 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.509+0000 7f9bd37fe640 1 -- 172.21.15.129:0/3668419560 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bcc031a90 con 0x7f9bdc0995d0 2024-09-18T01:48:22.513 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.509+0000 7f9bd37fe640 1 -- 172.21.15.129:0/3668419560 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bcc031d70 con 0x7f9bdc0995d0 2024-09-18T01:48:22.513 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.509+0000 7f9be16dd640 1 -- 172.21.15.129:0/3668419560 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bdc1c3c60 con 0x7f9bdc0995d0 2024-09-18T01:48:22.513 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.510+0000 7f9be16dd640 1 -- 172.21.15.129:0/3668419560 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bdc1c4130 con 0x7f9bdc0995d0 2024-09-18T01:48:22.513 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.510+0000 7f9be16dd640 1 -- 172.21.15.129:0/3668419560 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9bdc099c80 con 0x7f9bdc0995d0 2024-09-18T01:48:22.513 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.510+0000 7f9bd37fe640 1 -- 172.21.15.129:0/3668419560 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9bcc039040 con 0x7f9bdc0995d0 2024-09-18T01:48:22.514 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.510+0000 7f9bd37fe640 1 --2- 172.21.15.129:0/3668419560 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9bbc0382a0 0x7f9bbc03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:22.514 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.510+0000 7f9bd37fe640 1 -- 172.21.15.129:0/3668419560 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f9bcc02ae00 con 0x7f9bdc0995d0 2024-09-18T01:48:22.514 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.511+0000 7f9bd37fe640 1 --2- 172.21.15.129:0/3668419560 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x7f9bbc044680 0x7f9bbc046b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:22.514 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.511+0000 7f9bd37fe640 1 -- 172.21.15.129:0/3668419560 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9bcc007810 con 0x7f9bbc044680 2024-09-18T01:48:22.514 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.511+0000 7f9bd37fe640 1 -- 172.21.15.129:0/3668419560 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f9bcc074050 con 0x7f9bdc0995d0 2024-09-18T01:48:22.514 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.511+0000 7f9bda7fc640 1 --2- 172.21.15.129:0/3668419560 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9bbc0382a0 0x7f9bbc03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:22.514 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.511+0000 7f9bdb7fe640 1 --2- 172.21.15.129:0/3668419560 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x7f9bbc044680 0x7f9bbc046b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:22.514 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.511+0000 7f9bda7fc640 1 --2- 172.21.15.129:0/3668419560 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9bbc0382a0 0x7f9bbc03a760 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f9bc4007fd0 tx=0x7f9bc4007ac0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:22.514 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.511+0000 7f9bdb7fe640 1 --2- 172.21.15.129:0/3668419560 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x7f9bbc044680 0x7f9bbc046b20 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:22.515 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.512+0000 7f9bd37fe640 1 -- 172.21.15.129:0/3668419560 <== osd.1 v2:172.21.15.146:6808/3930274777 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9bcc007810 con 0x7f9bbc044680 2024-09-18T01:48:22.525 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.524+0000 7f9be16dd640 1 -- 172.21.15.129:0/3668419560 --> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9bdc1b2970 con 0x7f9bbc044680 2024-09-18T01:48:22.525 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.525+0000 7f9bd37fe640 1 -- 172.21.15.129:0/3668419560 <== osd.1 v2:172.21.15.146:6808/3930274777 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f9bdc1b2970 con 0x7f9bbc044680 2024-09-18T01:48:22.526 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-09-18T01:48:22.526 INFO:teuthology.orchestra.run.smithi129.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-18T01:48:22.526 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-09-18T01:48:22.527 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.525+0000 7f9be16dd640 1 -- 172.21.15.129:0/3668419560 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x7f9bbc044680 msgr2=0x7f9bbc046b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:22.527 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.525+0000 7f9be16dd640 1 --2- 172.21.15.129:0/3668419560 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x7f9bbc044680 0x7f9bbc046b20 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:22.527 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.525+0000 7f9be16dd640 1 -- 172.21.15.129:0/3668419560 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9bbc0382a0 msgr2=0x7f9bbc03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:22.527 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.525+0000 7f9be16dd640 1 --2- 172.21.15.129:0/3668419560 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9bbc0382a0 0x7f9bbc03a760 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f9bc4007fd0 tx=0x7f9bc4007ac0 comp rx=0 tx=0).stop 2024-09-18T01:48:22.527 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.525+0000 7f9be16dd640 1 -- 172.21.15.129:0/3668419560 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9bdc0995d0 msgr2=0x7f9bdc1c3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:22.527 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.525+0000 7f9be16dd640 1 --2- 172.21.15.129:0/3668419560 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9bdc0995d0 0x7f9bdc1c3720 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc009d90 tx=0x7f9bcc004a40 comp rx=0 tx=0).stop 2024-09-18T01:48:22.527 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.525+0000 7f9be16dd640 1 -- 172.21.15.129:0/3668419560 shutdown_connections 2024-09-18T01:48:22.528 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.525+0000 7f9be16dd640 1 --2- 172.21.15.129:0/3668419560 >> [v2:172.21.15.146:6808/3930274777,v1:172.21.15.146:6810/3930274777] conn(0x7f9bbc044680 0x7f9bbc046b20 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:22.528 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.525+0000 7f9be16dd640 1 --2- 172.21.15.129:0/3668419560 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f9bbc0382a0 0x7f9bbc03a760 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:22.528 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.525+0000 7f9be16dd640 1 --2- 172.21.15.129:0/3668419560 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9bdc0995d0 0x7f9bdc1c3720 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:22.528 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.525+0000 7f9be16dd640 1 -- 172.21.15.129:0/3668419560 >> 172.21.15.129:0/3668419560 conn(0x7f9bdc06d4b0 msgr2=0x7f9bdc09ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:48:22.528 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.525+0000 7f9be16dd640 1 -- 172.21.15.129:0/3668419560 shutdown_connections 2024-09-18T01:48:22.528 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.525+0000 7f9be16dd640 1 -- 172.21.15.129:0/3668419560 wait complete. 2024-09-18T01:48:22.536 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-18T01:48:22.636 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.633+0000 7fef18aae640 1 Processor -- start 2024-09-18T01:48:22.636 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.634+0000 7fef18aae640 1 -- start start 2024-09-18T01:48:22.636 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.634+0000 7fef18aae640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fef1406eda0 0x7fef1406f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:22.636 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.634+0000 7fef18aae640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef1406eba0 con 0x7fef1406f6c0 2024-09-18T01:48:22.636 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.634+0000 7fef18aae640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x7fef1406d2f0 con 0x7fef1406eda0 2024-09-18T01:48:22.636 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.634+0000 7fef1259c640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fef1406eda0 0x7fef1406f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:22.636 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.634+0000 7fef11d9b640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fef1406f6c0 0x7fef14121a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:38654/0 (socket says 172.21.15.129:38654) 2024-09-18T01:48:22.636 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.634+0000 7fef1259c640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fef1406eda0 0x7fef1406f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:58866/0 (socket says 172.21.15.129:58866) 2024-09-18T01:48:22.636 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.634+0000 7fef11d9b640 1 -- 172.21.15.129:0/1247790179 learned_addr learned my addr 172.21.15.129:0/1247790179 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-09-18T01:48:22.636 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.634+0000 7fef1259c640 1 -- 172.21.15.129:0/1247790179 >> v1:172.21.15.129:6789/0 conn(0x7fef1406f6c0 legacy=0x7fef14121a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:22.636 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.634+0000 7fef1259c640 1 -- 172.21.15.129:0/1247790179 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef14070d50 con 0x7fef1406eda0 2024-09-18T01:48:22.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.635+0000 7fef1259c640 1 --2- 172.21.15.129:0/1247790179 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fef1406eda0 0x7fef1406f180 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fef0c009720 tx=0x7fef0c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43e6e91cca0a43fc server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:22.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.635+0000 7fef1159a640 1 -- 172.21.15.129:0/1247790179 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef0c037070 con 0x7fef1406eda0 2024-09-18T01:48:22.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.635+0000 7fef1159a640 1 -- 172.21.15.129:0/1247790179 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef0c02ae20 con 0x7fef1406eda0 2024-09-18T01:48:22.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.635+0000 7fef1159a640 1 -- 172.21.15.129:0/1247790179 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef0c032590 con 0x7fef1406eda0 2024-09-18T01:48:22.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.636+0000 7fef18aae640 1 -- 172.21.15.129:0/1247790179 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fef1406eda0 msgr2=0x7fef1406f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:22.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.636+0000 7fef18aae640 1 --2- 172.21.15.129:0/1247790179 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fef1406eda0 0x7fef1406f180 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fef0c009720 tx=0x7fef0c02a1a0 comp rx=0 tx=0).stop 2024-09-18T01:48:22.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.636+0000 7fef18aae640 1 -- 172.21.15.129:0/1247790179 shutdown_connections 2024-09-18T01:48:22.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.636+0000 7fef18aae640 1 --2- 172.21.15.129:0/1247790179 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fef1406eda0 0x7fef1406f180 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:22.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.636+0000 7fef18aae640 1 -- 172.21.15.129:0/1247790179 >> 172.21.15.129:0/1247790179 conn(0x7fef1409a890 msgr2=0x7fef1409aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:48:22.638 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.636+0000 7fef18aae640 1 -- 172.21.15.129:0/1247790179 shutdown_connections 2024-09-18T01:48:22.639 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.636+0000 7fef18aae640 1 -- 172.21.15.129:0/1247790179 wait complete. 2024-09-18T01:48:22.639 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.637+0000 7fef18aae640 1 Processor -- start 2024-09-18T01:48:22.639 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.637+0000 7fef18aae640 1 -- start start 2024-09-18T01:48:22.641 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.637+0000 7fef18aae640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fef1406eda0 0x7fef141c35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:22.641 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.637+0000 7fef18aae640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fef14122160 con 0x7fef1406eda0 2024-09-18T01:48:22.641 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.637+0000 7fef1259c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fef1406eda0 0x7fef141c35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:22.641 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.637+0000 7fef1259c640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fef1406eda0 0x7fef141c35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:58868/0 (socket says 172.21.15.129:58868) 2024-09-18T01:48:22.641 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.637+0000 7fef1259c640 1 -- 172.21.15.129:0/3032727950 learned_addr learned my addr 172.21.15.129:0/3032727950 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-18T01:48:22.641 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.638+0000 7fef1259c640 1 -- 172.21.15.129:0/3032727950 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef14125d80 con 0x7fef1406eda0 2024-09-18T01:48:22.641 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.638+0000 7fef1259c640 1 --2- 172.21.15.129:0/3032727950 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fef1406eda0 0x7fef141c35e0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fef0c02a1e0 tx=0x7fef0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:22.641 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.638+0000 7fef02ffd640 1 -- 172.21.15.129:0/3032727950 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef0c042070 con 0x7fef1406eda0 2024-09-18T01:48:22.641 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.638+0000 7fef02ffd640 1 -- 172.21.15.129:0/3032727950 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef0c03e590 con 0x7fef1406eda0 2024-09-18T01:48:22.641 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.638+0000 7fef18aae640 1 -- 172.21.15.129:0/3032727950 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef14124820 con 0x7fef1406eda0 2024-09-18T01:48:22.641 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.638+0000 7fef02ffd640 1 -- 172.21.15.129:0/3032727950 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef0c037040 con 0x7fef1406eda0 2024-09-18T01:48:22.641 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.638+0000 7fef18aae640 1 -- 172.21.15.129:0/3032727950 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef1408fff0 con 0x7fef1406eda0 2024-09-18T01:48:22.642 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.639+0000 7fef02ffd640 1 -- 172.21.15.129:0/3032727950 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fef0c045070 con 0x7fef1406eda0 2024-09-18T01:48:22.642 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.639+0000 7fef02ffd640 1 --2- 172.21.15.129:0/3032727950 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7feef40382a0 0x7feef403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:22.642 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.639+0000 7fef18aae640 1 -- 172.21.15.129:0/3032727950 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef14090380 con 0x7fef1406eda0 2024-09-18T01:48:22.642 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.639+0000 7fef02ffd640 1 -- 172.21.15.129:0/3032727950 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7fef0c06c600 con 0x7fef1406eda0 2024-09-18T01:48:22.642 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.639+0000 7fef11d9b640 1 --2- 172.21.15.129:0/3032727950 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7feef40382a0 0x7feef403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:22.642 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.640+0000 7fef11d9b640 1 --2- 172.21.15.129:0/3032727950 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7feef40382a0 0x7feef403a760 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fef08002080 tx=0x7fef08001670 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:22.645 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.644+0000 7fef02ffd640 1 -- 172.21.15.129:0/3032727950 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fef0c03e8b0 con 0x7fef1406eda0 2024-09-18T01:48:22.809 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.807+0000 7fef18aae640 1 -- 172.21.15.129:0/3032727950 --> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fef14122670 con 0x7feef40382a0 2024-09-18T01:48:22.810 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.808+0000 7fef02ffd640 1 -- 172.21.15.129:0/3032727950 <== mgr.4099 v2:172.21.15.146:6824/168968651 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fef14122670 con 0x7feef40382a0 2024-09-18T01:48:22.810 INFO:teuthology.orchestra.run.smithi129.stderr:instructed osd(s) 1 to deep-scrub 2024-09-18T01:48:22.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.810+0000 7fef18aae640 1 -- 172.21.15.129:0/3032727950 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7feef40382a0 msgr2=0x7feef403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:22.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.810+0000 7fef18aae640 1 --2- 172.21.15.129:0/3032727950 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7feef40382a0 0x7feef403a760 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fef08002080 tx=0x7fef08001670 comp rx=0 tx=0).stop 2024-09-18T01:48:22.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.810+0000 7fef18aae640 1 -- 172.21.15.129:0/3032727950 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fef1406eda0 msgr2=0x7fef141c35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:22.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.810+0000 7fef18aae640 1 --2- 172.21.15.129:0/3032727950 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fef1406eda0 0x7fef141c35e0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fef0c02a1e0 tx=0x7fef0c0046c0 comp rx=0 tx=0).stop 2024-09-18T01:48:22.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.811+0000 7fef18aae640 1 -- 172.21.15.129:0/3032727950 shutdown_connections 2024-09-18T01:48:22.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.811+0000 7fef18aae640 1 --2- 172.21.15.129:0/3032727950 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7feef40382a0 0x7feef403a760 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:22.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.811+0000 7fef18aae640 1 --2- 172.21.15.129:0/3032727950 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fef1406eda0 0x7fef141c35e0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:22.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.811+0000 7fef18aae640 1 -- 172.21.15.129:0/3032727950 >> 172.21.15.129:0/3032727950 conn(0x7fef1409a890 msgr2=0x7fef141293b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:48:22.812 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.811+0000 7fef18aae640 1 -- 172.21.15.129:0/3032727950 shutdown_connections 2024-09-18T01:48:22.813 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.811+0000 7fef18aae640 1 -- 172.21.15.129:0/3032727950 wait complete. 2024-09-18T01:48:22.822 INFO:tasks.ceph:Scrubbing osd.2 2024-09-18T01:48:22.822 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-18T01:48:22.923 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.922+0000 7fad34103640 1 Processor -- start 2024-09-18T01:48:22.923 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.922+0000 7fad34103640 1 -- start start 2024-09-18T01:48:22.925 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.923+0000 7fad34103640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fad2c06ffc0 0x7fad2c130880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:22.925 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.923+0000 7fad34103640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad2c06ef60 con 0x7fad2c06e470 2024-09-18T01:48:22.925 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.923+0000 7fad34103640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x7fad2c070940 con 0x7fad2c06ffc0 2024-09-18T01:48:22.925 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.923+0000 7fad3169e640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fad2c06ffc0 0x7fad2c130880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:22.925 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.923+0000 7fad31e9f640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fad2c06e470 0x7fad2c06e850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:38664/0 (socket says 172.21.15.129:38664) 2024-09-18T01:48:22.925 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.923+0000 7fad31e9f640 1 -- 172.21.15.129:0/2737233075 learned_addr learned my addr 172.21.15.129:0/2737233075 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-09-18T01:48:22.925 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.923+0000 7fad3169e640 1 -- 172.21.15.129:0/2737233075 >> v1:172.21.15.129:6789/0 conn(0x7fad2c06e470 legacy=0x7fad2c06e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:22.925 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.923+0000 7fad3169e640 1 -- 172.21.15.129:0/2737233075 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad2c098a30 con 0x7fad2c06ffc0 2024-09-18T01:48:22.925 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.924+0000 7fad3169e640 1 --2- 172.21.15.129:0/2737233075 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fad2c06ffc0 0x7fad2c130880 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fad1c009720 tx=0x7fad1c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dab323b8e3136f4c server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:22.925 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.924+0000 7fad30e9d640 1 -- 172.21.15.129:0/2737233075 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad1c037070 con 0x7fad2c06ffc0 2024-09-18T01:48:22.926 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.924+0000 7fad30e9d640 1 -- 172.21.15.129:0/2737233075 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad1c02ad90 con 0x7fad2c06ffc0 2024-09-18T01:48:22.926 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.924+0000 7fad30e9d640 1 -- 172.21.15.129:0/2737233075 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad1c032590 con 0x7fad2c06ffc0 2024-09-18T01:48:22.927 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.924+0000 7fad34103640 1 -- 172.21.15.129:0/2737233075 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fad2c06ffc0 msgr2=0x7fad2c130880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:22.928 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.924+0000 7fad34103640 1 --2- 172.21.15.129:0/2737233075 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fad2c06ffc0 0x7fad2c130880 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fad1c009720 tx=0x7fad1c02a110 comp rx=0 tx=0).stop 2024-09-18T01:48:22.928 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.924+0000 7fad34103640 1 -- 172.21.15.129:0/2737233075 shutdown_connections 2024-09-18T01:48:22.928 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.924+0000 7fad34103640 1 --2- 172.21.15.129:0/2737233075 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fad2c06ffc0 0x7fad2c130880 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:22.928 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.924+0000 7fad34103640 1 -- 172.21.15.129:0/2737233075 >> 172.21.15.129:0/2737233075 conn(0x7fad2c0998b0 msgr2=0x7fad2c099cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:48:22.928 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.924+0000 7fad34103640 1 -- 172.21.15.129:0/2737233075 shutdown_connections 2024-09-18T01:48:22.928 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.924+0000 7fad34103640 1 -- 172.21.15.129:0/2737233075 wait complete. 2024-09-18T01:48:22.928 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.925+0000 7fad34103640 1 Processor -- start 2024-09-18T01:48:22.928 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.925+0000 7fad34103640 1 -- start start 2024-09-18T01:48:22.928 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.926+0000 7fad34103640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fad2c06e470 0x7fad2c12aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:22.928 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.926+0000 7fad34103640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fad2c06d0c0 con 0x7fad2c06e470 2024-09-18T01:48:22.928 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.926+0000 7fad31e9f640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fad2c06e470 0x7fad2c12aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:22.928 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.926+0000 7fad31e9f640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fad2c06e470 0x7fad2c12aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:58878/0 (socket says 172.21.15.129:58878) 2024-09-18T01:48:22.928 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.926+0000 7fad31e9f640 1 -- 172.21.15.129:0/2773390486 learned_addr learned my addr 172.21.15.129:0/2773390486 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-18T01:48:22.929 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.926+0000 7fad31e9f640 1 -- 172.21.15.129:0/2773390486 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad2c08fdc0 con 0x7fad2c06e470 2024-09-18T01:48:22.929 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.926+0000 7fad31e9f640 1 --2- 172.21.15.129:0/2773390486 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fad2c06e470 0x7fad2c12aed0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fad2800c4a0 tx=0x7fad2800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:22.929 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.926+0000 7fad227fc640 1 -- 172.21.15.129:0/2773390486 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad28017070 con 0x7fad2c06e470 2024-09-18T01:48:22.929 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.926+0000 7fad227fc640 1 -- 172.21.15.129:0/2773390486 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad28005c10 con 0x7fad2c06e470 2024-09-18T01:48:22.929 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.926+0000 7fad34103640 1 -- 172.21.15.129:0/2773390486 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad2c125d10 con 0x7fad2c06e470 2024-09-18T01:48:22.929 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.926+0000 7fad227fc640 1 -- 172.21.15.129:0/2773390486 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad28007070 con 0x7fad2c06e470 2024-09-18T01:48:22.929 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.926+0000 7fad34103640 1 -- 172.21.15.129:0/2773390486 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad2c090d30 con 0x7fad2c06e470 2024-09-18T01:48:22.930 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.927+0000 7fad34103640 1 -- 172.21.15.129:0/2773390486 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fad2c06e850 con 0x7fad2c06e470 2024-09-18T01:48:22.930 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.927+0000 7fad227fc640 1 -- 172.21.15.129:0/2773390486 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fad2801a070 con 0x7fad2c06e470 2024-09-18T01:48:22.930 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.927+0000 7fad227fc640 1 --2- 172.21.15.129:0/2773390486 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fad100382a0 0x7fad1003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:22.931 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.927+0000 7fad227fc640 1 -- 172.21.15.129:0/2773390486 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7fad2804afe0 con 0x7fad2c06e470 2024-09-18T01:48:22.931 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.927+0000 7fad227fc640 1 --2- 172.21.15.129:0/2773390486 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fad10044680 0x7fad10046b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:22.931 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.927+0000 7fad227fc640 1 -- 172.21.15.129:0/2773390486 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fad28013e50 con 0x7fad10044680 2024-09-18T01:48:22.931 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.927+0000 7fad227fc640 1 -- 172.21.15.129:0/2773390486 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fad28052050 con 0x7fad2c06e470 2024-09-18T01:48:22.931 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.928+0000 7fad3169e640 1 --2- 172.21.15.129:0/2773390486 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fad100382a0 0x7fad1003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:22.931 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.928+0000 7fad326a0640 1 --2- 172.21.15.129:0/2773390486 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fad10044680 0x7fad10046b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:22.931 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.928+0000 7fad326a0640 1 --2- 172.21.15.129:0/2773390486 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fad10044680 0x7fad10046b20 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:22.931 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.928+0000 7fad3169e640 1 --2- 172.21.15.129:0/2773390486 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fad100382a0 0x7fad1003a760 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fad1c034000 tx=0x7fad1c02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:22.931 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.929+0000 7fad227fc640 1 -- 172.21.15.129:0/2773390486 <== osd.2 v2:172.21.15.146:6800/3820039304 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fad28013e50 con 0x7fad10044680 2024-09-18T01:48:22.942 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.941+0000 7fad34103640 1 -- 172.21.15.129:0/2773390486 --> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fad2c06d240 con 0x7fad10044680 2024-09-18T01:48:22.942 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.942+0000 7fad227fc640 1 -- 172.21.15.129:0/2773390486 <== osd.2 v2:172.21.15.146:6800/3820039304 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fad2c06d240 con 0x7fad10044680 2024-09-18T01:48:22.943 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-09-18T01:48:22.943 INFO:teuthology.orchestra.run.smithi129.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-18T01:48:22.943 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-09-18T01:48:22.944 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.942+0000 7fad34103640 1 -- 172.21.15.129:0/2773390486 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fad10044680 msgr2=0x7fad10046b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:22.944 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.942+0000 7fad34103640 1 --2- 172.21.15.129:0/2773390486 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fad10044680 0x7fad10046b20 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:22.944 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.942+0000 7fad34103640 1 -- 172.21.15.129:0/2773390486 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fad100382a0 msgr2=0x7fad1003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:22.944 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.942+0000 7fad34103640 1 --2- 172.21.15.129:0/2773390486 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fad100382a0 0x7fad1003a760 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fad1c034000 tx=0x7fad1c02e000 comp rx=0 tx=0).stop 2024-09-18T01:48:22.944 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.942+0000 7fad34103640 1 -- 172.21.15.129:0/2773390486 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fad2c06e470 msgr2=0x7fad2c12aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:22.944 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.942+0000 7fad34103640 1 --2- 172.21.15.129:0/2773390486 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fad2c06e470 0x7fad2c12aed0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fad2800c4a0 tx=0x7fad2800c960 comp rx=0 tx=0).stop 2024-09-18T01:48:22.944 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.942+0000 7fad34103640 1 -- 172.21.15.129:0/2773390486 shutdown_connections 2024-09-18T01:48:22.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.942+0000 7fad34103640 1 --2- 172.21.15.129:0/2773390486 >> [v2:172.21.15.146:6800/3820039304,v1:172.21.15.146:6801/3820039304] conn(0x7fad10044680 0x7fad10046b20 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:22.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.942+0000 7fad34103640 1 --2- 172.21.15.129:0/2773390486 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fad100382a0 0x7fad1003a760 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:22.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.942+0000 7fad34103640 1 --2- 172.21.15.129:0/2773390486 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fad2c06e470 0x7fad2c12aed0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:22.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.942+0000 7fad34103640 1 -- 172.21.15.129:0/2773390486 >> 172.21.15.129:0/2773390486 conn(0x7fad2c0998b0 msgr2=0x7fad2c09a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:48:22.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.942+0000 7fad34103640 1 -- 172.21.15.129:0/2773390486 shutdown_connections 2024-09-18T01:48:22.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:22.942+0000 7fad34103640 1 -- 172.21.15.129:0/2773390486 wait complete. 2024-09-18T01:48:22.953 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-18T01:48:23.054 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.053+0000 7f776259f640 1 Processor -- start 2024-09-18T01:48:23.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.053+0000 7f776259f640 1 -- start start 2024-09-18T01:48:23.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.053+0000 7f776259f640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f775c12f9d0 0x7f775c131dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:23.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.053+0000 7f776259f640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f775c071f70 con 0x7f775c12cca0 2024-09-18T01:48:23.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.053+0000 7f776259f640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x7f775c06e350 con 0x7f775c12f9d0 2024-09-18T01:48:23.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.053+0000 7f775b7fe640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f775c12f9d0 0x7f775c131dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:23.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.053+0000 7f775bfff640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f775c12cca0 0x7f775c12d080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:38670/0 (socket says 172.21.15.129:38670) 2024-09-18T01:48:23.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.053+0000 7f775bfff640 1 -- 172.21.15.129:0/3700767679 learned_addr learned my addr 172.21.15.129:0/3700767679 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-09-18T01:48:23.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.053+0000 7f775b7fe640 1 -- 172.21.15.129:0/3700767679 >> v1:172.21.15.129:6789/0 conn(0x7f775c12cca0 legacy=0x7f775c12d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:23.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.053+0000 7f775b7fe640 1 -- 172.21.15.129:0/3700767679 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f775c0715c0 con 0x7f775c12f9d0 2024-09-18T01:48:23.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.054+0000 7f775b7fe640 1 --2- 172.21.15.129:0/3700767679 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f775c12f9d0 0x7f775c131dc0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f7750009720 tx=0x7f775002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a70299479b329dab server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:23.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.054+0000 7f775affd640 1 -- 172.21.15.129:0/3700767679 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7750037070 con 0x7f775c12f9d0 2024-09-18T01:48:23.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.054+0000 7f775affd640 1 -- 172.21.15.129:0/3700767679 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f775002ad90 con 0x7f775c12f9d0 2024-09-18T01:48:23.056 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.054+0000 7f775affd640 1 -- 172.21.15.129:0/3700767679 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7750032590 con 0x7f775c12f9d0 2024-09-18T01:48:23.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.055+0000 7f776259f640 1 -- 172.21.15.129:0/3700767679 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f775c12f9d0 msgr2=0x7f775c131dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:23.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.055+0000 7f776259f640 1 --2- 172.21.15.129:0/3700767679 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f775c12f9d0 0x7f775c131dc0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f7750009720 tx=0x7f775002a110 comp rx=0 tx=0).stop 2024-09-18T01:48:23.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.055+0000 7f776259f640 1 -- 172.21.15.129:0/3700767679 shutdown_connections 2024-09-18T01:48:23.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.055+0000 7f776259f640 1 --2- 172.21.15.129:0/3700767679 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f775c12f9d0 0x7f775c131dc0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:23.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.055+0000 7f776259f640 1 -- 172.21.15.129:0/3700767679 >> 172.21.15.129:0/3700767679 conn(0x7f775c09a890 msgr2=0x7f775c09aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:48:23.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.055+0000 7f776259f640 1 -- 172.21.15.129:0/3700767679 shutdown_connections 2024-09-18T01:48:23.057 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.055+0000 7f776259f640 1 -- 172.21.15.129:0/3700767679 wait complete. 2024-09-18T01:48:23.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.056+0000 7f776259f640 1 Processor -- start 2024-09-18T01:48:23.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.056+0000 7f776259f640 1 -- start start 2024-09-18T01:48:23.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.056+0000 7f776259f640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f775c12cca0 0x7f775c1284c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:23.058 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.056+0000 7f776259f640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f775c12ca50 con 0x7f775c12cca0 2024-09-18T01:48:23.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.056+0000 7f775bfff640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f775c12cca0 0x7f775c1284c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:23.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.056+0000 7f775bfff640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f775c12cca0 0x7f775c1284c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:58898/0 (socket says 172.21.15.129:58898) 2024-09-18T01:48:23.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.056+0000 7f775bfff640 1 -- 172.21.15.129:0/1892546826 learned_addr learned my addr 172.21.15.129:0/1892546826 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-18T01:48:23.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.057+0000 7f775bfff640 1 -- 172.21.15.129:0/1892546826 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f775c06edf0 con 0x7f775c12cca0 2024-09-18T01:48:23.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.057+0000 7f775bfff640 1 --2- 172.21.15.129:0/1892546826 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f775c12cca0 0x7f775c1284c0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f774c00c480 tx=0x7f774c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:23.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.057+0000 7f7758ff9640 1 -- 172.21.15.129:0/1892546826 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f774c017070 con 0x7f775c12cca0 2024-09-18T01:48:23.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.057+0000 7f7758ff9640 1 -- 172.21.15.129:0/1892546826 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f774c005c10 con 0x7f775c12cca0 2024-09-18T01:48:23.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.057+0000 7f7758ff9640 1 -- 172.21.15.129:0/1892546826 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f774c0070d0 con 0x7f775c12cca0 2024-09-18T01:48:23.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.057+0000 7f776259f640 1 -- 172.21.15.129:0/1892546826 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f775c096ca0 con 0x7f775c12cca0 2024-09-18T01:48:23.059 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.057+0000 7f776259f640 1 -- 172.21.15.129:0/1892546826 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f775c0709e0 con 0x7f775c12cca0 2024-09-18T01:48:23.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.058+0000 7f7758ff9640 1 -- 172.21.15.129:0/1892546826 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f774c01a070 con 0x7f775c12cca0 2024-09-18T01:48:23.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.058+0000 7f776259f640 1 -- 172.21.15.129:0/1892546826 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f775c097940 con 0x7f775c12cca0 2024-09-18T01:48:23.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.058+0000 7f7758ff9640 1 --2- 172.21.15.129:0/1892546826 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f77480382a0 0x7f774803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:23.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.058+0000 7f7758ff9640 1 -- 172.21.15.129:0/1892546826 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f774c04afd0 con 0x7f775c12cca0 2024-09-18T01:48:23.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.058+0000 7f775b7fe640 1 --2- 172.21.15.129:0/1892546826 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f77480382a0 0x7f774803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:23.060 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.059+0000 7f775b7fe640 1 --2- 172.21.15.129:0/1892546826 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f77480382a0 0x7f774803a760 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f7750009720 tx=0x7f775002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:23.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.063+0000 7f7758ff9640 1 -- 172.21.15.129:0/1892546826 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f775c097940 con 0x7f775c12cca0 2024-09-18T01:48:23.227 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.226+0000 7f776259f640 1 -- 172.21.15.129:0/1892546826 --> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f775c12d080 con 0x7f77480382a0 2024-09-18T01:48:23.228 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.227+0000 7f7758ff9640 1 -- 172.21.15.129:0/1892546826 <== mgr.4099 v2:172.21.15.146:6824/168968651 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f775c12d080 con 0x7f77480382a0 2024-09-18T01:48:23.229 INFO:teuthology.orchestra.run.smithi129.stderr:instructed osd(s) 2 to deep-scrub 2024-09-18T01:48:23.231 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.229+0000 7f776259f640 1 -- 172.21.15.129:0/1892546826 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f77480382a0 msgr2=0x7f774803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:23.231 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.229+0000 7f776259f640 1 --2- 172.21.15.129:0/1892546826 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f77480382a0 0x7f774803a760 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f7750009720 tx=0x7f775002e000 comp rx=0 tx=0).stop 2024-09-18T01:48:23.231 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.229+0000 7f776259f640 1 -- 172.21.15.129:0/1892546826 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f775c12cca0 msgr2=0x7f775c1284c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:23.231 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.229+0000 7f776259f640 1 --2- 172.21.15.129:0/1892546826 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f775c12cca0 0x7f775c1284c0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f774c00c480 tx=0x7f774c00c940 comp rx=0 tx=0).stop 2024-09-18T01:48:23.231 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.229+0000 7f776259f640 1 -- 172.21.15.129:0/1892546826 shutdown_connections 2024-09-18T01:48:23.231 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.229+0000 7f776259f640 1 --2- 172.21.15.129:0/1892546826 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f77480382a0 0x7f774803a760 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:23.231 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.229+0000 7f776259f640 1 --2- 172.21.15.129:0/1892546826 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f775c12cca0 0x7f775c1284c0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:23.231 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.229+0000 7f776259f640 1 -- 172.21.15.129:0/1892546826 >> 172.21.15.129:0/1892546826 conn(0x7f775c09a890 msgr2=0x7f775c097e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:48:23.232 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.230+0000 7f776259f640 1 -- 172.21.15.129:0/1892546826 shutdown_connections 2024-09-18T01:48:23.232 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.230+0000 7f776259f640 1 -- 172.21.15.129:0/1892546826 wait complete. 2024-09-18T01:48:23.241 INFO:tasks.ceph:Scrubbing osd.3 2024-09-18T01:48:23.242 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-18T01:48:23.345 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.343+0000 7ff133752640 1 Processor -- start 2024-09-18T01:48:23.345 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.343+0000 7ff133752640 1 -- start start 2024-09-18T01:48:23.345 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.343+0000 7ff133752640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7ff12c06d2a0 0x7ff12c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:23.345 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.343+0000 7ff133752640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff12c06e420 con 0x7ff12c06f690 2024-09-18T01:48:23.345 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.343+0000 7ff133752640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x7ff12c070240 con 0x7ff12c06d2a0 2024-09-18T01:48:23.345 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.343+0000 7ff1314ee640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7ff12c06d2a0 0x7ff12c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:23.345 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.343+0000 7ff130ced640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7ff12c06f690 0x7ff12c12ad60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:38678/0 (socket says 172.21.15.129:38678) 2024-09-18T01:48:23.345 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.343+0000 7ff130ced640 1 -- 172.21.15.129:0/3928602706 learned_addr learned my addr 172.21.15.129:0/3928602706 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-09-18T01:48:23.345 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.344+0000 7ff1314ee640 1 -- 172.21.15.129:0/3928602706 >> v1:172.21.15.129:6789/0 conn(0x7ff12c06f690 legacy=0x7ff12c12ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:23.345 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.344+0000 7ff1314ee640 1 -- 172.21.15.129:0/3928602706 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff12c06eb40 con 0x7ff12c06d2a0 2024-09-18T01:48:23.347 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.344+0000 7ff1314ee640 1 --2- 172.21.15.129:0/3928602706 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff12c06d2a0 0x7ff12c06d680 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7ff12800a8c0 tx=0x7ff12802b4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3efbfaf7a6443798 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:23.347 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.344+0000 7ff123fff640 1 -- 172.21.15.129:0/3928602706 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff12800b040 con 0x7ff12c06d2a0 2024-09-18T01:48:23.347 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.344+0000 7ff123fff640 1 -- 172.21.15.129:0/3928602706 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff128030640 con 0x7ff12c06d2a0 2024-09-18T01:48:23.347 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.344+0000 7ff123fff640 1 -- 172.21.15.129:0/3928602706 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff128030940 con 0x7ff12c06d2a0 2024-09-18T01:48:23.347 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.345+0000 7ff133752640 1 -- 172.21.15.129:0/3928602706 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff12c06d2a0 msgr2=0x7ff12c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:23.347 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.345+0000 7ff133752640 1 --2- 172.21.15.129:0/3928602706 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff12c06d2a0 0x7ff12c06d680 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7ff12800a8c0 tx=0x7ff12802b4d0 comp rx=0 tx=0).stop 2024-09-18T01:48:23.347 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.345+0000 7ff133752640 1 -- 172.21.15.129:0/3928602706 shutdown_connections 2024-09-18T01:48:23.347 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.345+0000 7ff133752640 1 --2- 172.21.15.129:0/3928602706 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff12c06d2a0 0x7ff12c06d680 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:23.347 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.345+0000 7ff133752640 1 -- 172.21.15.129:0/3928602706 >> 172.21.15.129:0/3928602706 conn(0x7ff12c0998b0 msgr2=0x7ff12c099cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:48:23.348 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.345+0000 7ff133752640 1 -- 172.21.15.129:0/3928602706 shutdown_connections 2024-09-18T01:48:23.348 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.345+0000 7ff133752640 1 -- 172.21.15.129:0/3928602706 wait complete. 2024-09-18T01:48:23.348 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.346+0000 7ff133752640 1 Processor -- start 2024-09-18T01:48:23.348 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.346+0000 7ff133752640 1 -- start start 2024-09-18T01:48:23.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.346+0000 7ff133752640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff12c06d2a0 0x7ff12c125f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:23.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.346+0000 7ff133752640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7ff12c06df50 con 0x7ff12c06d2a0 2024-09-18T01:48:23.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.346+0000 7ff1314ee640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff12c06d2a0 0x7ff12c125f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:23.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.346+0000 7ff1314ee640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff12c06d2a0 0x7ff12c125f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:58922/0 (socket says 172.21.15.129:58922) 2024-09-18T01:48:23.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.346+0000 7ff1314ee640 1 -- 172.21.15.129:0/2382267106 learned_addr learned my addr 172.21.15.129:0/2382267106 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-18T01:48:23.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.347+0000 7ff1314ee640 1 -- 172.21.15.129:0/2382267106 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff12c127ee0 con 0x7ff12c06d2a0 2024-09-18T01:48:23.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.347+0000 7ff1314ee640 1 --2- 172.21.15.129:0/2382267106 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff12c06d2a0 0x7ff12c125f80 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7ff12800a8c0 tx=0x7ff1280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:23.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.347+0000 7ff121ffb640 1 -- 172.21.15.129:0/2382267106 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff12803f030 con 0x7ff12c06d2a0 2024-09-18T01:48:23.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.347+0000 7ff121ffb640 1 -- 172.21.15.129:0/2382267106 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff128033ad0 con 0x7ff12c06d2a0 2024-09-18T01:48:23.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.347+0000 7ff121ffb640 1 -- 172.21.15.129:0/2382267106 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff128033df0 con 0x7ff12c06d2a0 2024-09-18T01:48:23.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.347+0000 7ff133752640 1 -- 172.21.15.129:0/2382267106 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff12c128470 con 0x7ff12c06d2a0 2024-09-18T01:48:23.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.347+0000 7ff133752640 1 -- 172.21.15.129:0/2382267106 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff12c1264c0 con 0x7ff12c06d2a0 2024-09-18T01:48:23.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.348+0000 7ff133752640 1 -- 172.21.15.129:0/2382267106 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff12c08fc40 con 0x7ff12c06d2a0 2024-09-18T01:48:23.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.348+0000 7ff121ffb640 1 -- 172.21.15.129:0/2382267106 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff128042030 con 0x7ff12c06d2a0 2024-09-18T01:48:23.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.348+0000 7ff121ffb640 1 --2- 172.21.15.129:0/2382267106 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff1100382a0 0x7ff11003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:23.351 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.348+0000 7ff121ffb640 1 -- 172.21.15.129:0/2382267106 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7ff128040070 con 0x7ff12c06d2a0 2024-09-18T01:48:23.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.348+0000 7ff121ffb640 1 --2- 172.21.15.129:0/2382267106 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x7ff110044620 0x7ff110046ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:23.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.348+0000 7ff121ffb640 1 -- 172.21.15.129:0/2382267106 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff128041e80 con 0x7ff110044620 2024-09-18T01:48:23.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.348+0000 7ff121ffb640 1 -- 172.21.15.129:0/2382267106 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7ff128073050 con 0x7ff12c06d2a0 2024-09-18T01:48:23.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.348+0000 7ff130ced640 1 --2- 172.21.15.129:0/2382267106 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff1100382a0 0x7ff11003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:23.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.348+0000 7ff131cef640 1 --2- 172.21.15.129:0/2382267106 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x7ff110044620 0x7ff110046ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:23.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.349+0000 7ff131cef640 1 --2- 172.21.15.129:0/2382267106 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x7ff110044620 0x7ff110046ac0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:23.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.349+0000 7ff130ced640 1 --2- 172.21.15.129:0/2382267106 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff1100382a0 0x7ff11003a760 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff11c005880 tx=0x7ff11c007a80 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:23.352 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.350+0000 7ff121ffb640 1 -- 172.21.15.129:0/2382267106 <== osd.3 v2:172.21.15.146:6809/4106661138 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff128041e80 con 0x7ff110044620 2024-09-18T01:48:23.362 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.362+0000 7ff133752640 1 -- 172.21.15.129:0/2382267106 --> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff12c098b80 con 0x7ff110044620 2024-09-18T01:48:23.363 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.362+0000 7ff121ffb640 1 -- 172.21.15.129:0/2382267106 <== osd.3 v2:172.21.15.146:6809/4106661138 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff12c098b80 con 0x7ff110044620 2024-09-18T01:48:23.363 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-09-18T01:48:23.363 INFO:teuthology.orchestra.run.smithi129.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-18T01:48:23.363 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-09-18T01:48:23.365 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.362+0000 7ff133752640 1 -- 172.21.15.129:0/2382267106 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x7ff110044620 msgr2=0x7ff110046ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:23.365 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.362+0000 7ff133752640 1 --2- 172.21.15.129:0/2382267106 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x7ff110044620 0x7ff110046ac0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:23.365 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.363+0000 7ff133752640 1 -- 172.21.15.129:0/2382267106 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff1100382a0 msgr2=0x7ff11003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:23.365 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.363+0000 7ff133752640 1 --2- 172.21.15.129:0/2382267106 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff1100382a0 0x7ff11003a760 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff11c005880 tx=0x7ff11c007a80 comp rx=0 tx=0).stop 2024-09-18T01:48:23.365 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.363+0000 7ff133752640 1 -- 172.21.15.129:0/2382267106 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff12c06d2a0 msgr2=0x7ff12c125f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:23.365 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.363+0000 7ff133752640 1 --2- 172.21.15.129:0/2382267106 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff12c06d2a0 0x7ff12c125f80 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7ff12800a8c0 tx=0x7ff1280046c0 comp rx=0 tx=0).stop 2024-09-18T01:48:23.365 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.363+0000 7ff133752640 1 -- 172.21.15.129:0/2382267106 shutdown_connections 2024-09-18T01:48:23.365 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.363+0000 7ff133752640 1 --2- 172.21.15.129:0/2382267106 >> [v2:172.21.15.146:6809/4106661138,v1:172.21.15.146:6811/4106661138] conn(0x7ff110044620 0x7ff110046ac0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:23.365 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.363+0000 7ff133752640 1 --2- 172.21.15.129:0/2382267106 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7ff1100382a0 0x7ff11003a760 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:23.365 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.363+0000 7ff133752640 1 --2- 172.21.15.129:0/2382267106 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff12c06d2a0 0x7ff12c125f80 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:23.366 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.363+0000 7ff133752640 1 -- 172.21.15.129:0/2382267106 >> 172.21.15.129:0/2382267106 conn(0x7ff12c0998b0 msgr2=0x7ff12c070550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:48:23.366 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.363+0000 7ff133752640 1 -- 172.21.15.129:0/2382267106 shutdown_connections 2024-09-18T01:48:23.366 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.363+0000 7ff133752640 1 -- 172.21.15.129:0/2382267106 wait complete. 2024-09-18T01:48:23.374 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-18T01:48:23.474 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.472+0000 7fe7930d7640 1 Processor -- start 2024-09-18T01:48:23.474 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.472+0000 7fe7930d7640 1 -- start start 2024-09-18T01:48:23.474 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.472+0000 7fe7930d7640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fe78c12f9d0 0x7fe78c131dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:23.474 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.473+0000 7fe7930d7640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe78c071f70 con 0x7fe78c12cca0 2024-09-18T01:48:23.474 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.473+0000 7fe7930d7640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x7fe78c06e350 con 0x7fe78c12f9d0 2024-09-18T01:48:23.475 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.473+0000 7fe78bfff640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fe78c12f9d0 0x7fe78c131dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:23.475 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.473+0000 7fe790e73640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fe78c12cca0 0x7fe78c12d080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:38682/0 (socket says 172.21.15.129:38682) 2024-09-18T01:48:23.475 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.473+0000 7fe78bfff640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fe78c12f9d0 0x7fe78c131dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:58934/0 (socket says 172.21.15.129:58934) 2024-09-18T01:48:23.475 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.473+0000 7fe790e73640 1 -- 172.21.15.129:0/1497862141 learned_addr learned my addr 172.21.15.129:0/1497862141 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-09-18T01:48:23.475 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.473+0000 7fe78bfff640 1 -- 172.21.15.129:0/1497862141 >> v1:172.21.15.129:6789/0 conn(0x7fe78c12cca0 legacy=0x7fe78c12d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:23.475 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.473+0000 7fe78b7fe640 1 -- 172.21.15.129:0/1497862141 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1222072727 0 0) 0x7fe78c071f70 con 0x7fe78c12cca0 2024-09-18T01:48:23.475 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.473+0000 7fe78bfff640 1 -- 172.21.15.129:0/1497862141 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe78c0715c0 con 0x7fe78c12f9d0 2024-09-18T01:48:23.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.474+0000 7fe78bfff640 1 --2- 172.21.15.129:0/1497862141 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe78c12f9d0 0x7fe78c131dc0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fe780009720 tx=0x7fe78002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fef6c3b2f97d0268 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:23.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.474+0000 7fe78b7fe640 1 -- 172.21.15.129:0/1497862141 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe780037070 con 0x7fe78c12f9d0 2024-09-18T01:48:23.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.474+0000 7fe78b7fe640 1 -- 172.21.15.129:0/1497862141 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe78002ad90 con 0x7fe78c12f9d0 2024-09-18T01:48:23.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.474+0000 7fe78b7fe640 1 -- 172.21.15.129:0/1497862141 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe780032590 con 0x7fe78c12f9d0 2024-09-18T01:48:23.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.474+0000 7fe7930d7640 1 -- 172.21.15.129:0/1497862141 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe78c12f9d0 msgr2=0x7fe78c131dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:23.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.474+0000 7fe7930d7640 1 --2- 172.21.15.129:0/1497862141 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe78c12f9d0 0x7fe78c131dc0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fe780009720 tx=0x7fe78002a110 comp rx=0 tx=0).stop 2024-09-18T01:48:23.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.474+0000 7fe7930d7640 1 -- 172.21.15.129:0/1497862141 shutdown_connections 2024-09-18T01:48:23.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.474+0000 7fe7930d7640 1 --2- 172.21.15.129:0/1497862141 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe78c12f9d0 0x7fe78c131dc0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:23.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.474+0000 7fe7930d7640 1 -- 172.21.15.129:0/1497862141 >> 172.21.15.129:0/1497862141 conn(0x7fe78c09a890 msgr2=0x7fe78c09aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:48:23.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.474+0000 7fe7930d7640 1 -- 172.21.15.129:0/1497862141 shutdown_connections 2024-09-18T01:48:23.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.474+0000 7fe7930d7640 1 -- 172.21.15.129:0/1497862141 wait complete. 2024-09-18T01:48:23.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.475+0000 7fe7930d7640 1 Processor -- start 2024-09-18T01:48:23.479 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.475+0000 7fe7930d7640 1 -- start start 2024-09-18T01:48:23.479 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.476+0000 7fe7930d7640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe78c12cca0 0x7fe78c122110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:23.479 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.476+0000 7fe7930d7640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fe78c12ca50 con 0x7fe78c12cca0 2024-09-18T01:48:23.479 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.476+0000 7fe790e73640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe78c12cca0 0x7fe78c122110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:23.479 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.476+0000 7fe790e73640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe78c12cca0 0x7fe78c122110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:58938/0 (socket says 172.21.15.129:58938) 2024-09-18T01:48:23.479 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.476+0000 7fe790e73640 1 -- 172.21.15.129:0/3062538810 learned_addr learned my addr 172.21.15.129:0/3062538810 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-18T01:48:23.479 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.476+0000 7fe790e73640 1 -- 172.21.15.129:0/3062538810 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe78c129b50 con 0x7fe78c12cca0 2024-09-18T01:48:23.479 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.476+0000 7fe790e73640 1 --2- 172.21.15.129:0/3062538810 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe78c12cca0 0x7fe78c122110 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fe77c00c370 tx=0x7fe77c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:23.479 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.476+0000 7fe7897fa640 1 -- 172.21.15.129:0/3062538810 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe77c007410 con 0x7fe78c12cca0 2024-09-18T01:48:23.479 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.476+0000 7fe7897fa640 1 -- 172.21.15.129:0/3062538810 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe77c0075d0 con 0x7fe78c12cca0 2024-09-18T01:48:23.479 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.476+0000 7fe7897fa640 1 -- 172.21.15.129:0/3062538810 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe77c004950 con 0x7fe78c12cca0 2024-09-18T01:48:23.479 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.476+0000 7fe7930d7640 1 -- 172.21.15.129:0/3062538810 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe78c126db0 con 0x7fe78c12cca0 2024-09-18T01:48:23.479 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.476+0000 7fe7930d7640 1 -- 172.21.15.129:0/3062538810 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe78c123ff0 con 0x7fe78c12cca0 2024-09-18T01:48:23.480 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.477+0000 7fe7897fa640 1 -- 172.21.15.129:0/3062538810 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe77c011070 con 0x7fe78c12cca0 2024-09-18T01:48:23.480 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.477+0000 7fe7930d7640 1 -- 172.21.15.129:0/3062538810 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe78c12e200 con 0x7fe78c12cca0 2024-09-18T01:48:23.481 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.477+0000 7fe7897fa640 1 --2- 172.21.15.129:0/3062538810 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fe7780382a0 0x7fe77803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:23.481 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.477+0000 7fe7897fa640 1 -- 172.21.15.129:0/3062538810 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7fe77c04b8d0 con 0x7fe78c12cca0 2024-09-18T01:48:23.481 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.478+0000 7fe78bfff640 1 --2- 172.21.15.129:0/3062538810 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fe7780382a0 0x7fe77803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:23.481 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.478+0000 7fe78bfff640 1 --2- 172.21.15.129:0/3062538810 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fe7780382a0 0x7fe77803a760 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fe780009720 tx=0x7fe78002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:23.483 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.482+0000 7fe7897fa640 1 -- 172.21.15.129:0/3062538810 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe77c01cbd0 con 0x7fe78c12cca0 2024-09-18T01:48:23.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.648+0000 7fe7930d7640 1 -- 172.21.15.129:0/3062538810 --> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fe78c124410 con 0x7fe7780382a0 2024-09-18T01:48:23.651 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.649+0000 7fe7897fa640 1 -- 172.21.15.129:0/3062538810 <== mgr.4099 v2:172.21.15.146:6824/168968651 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe78c124410 con 0x7fe7780382a0 2024-09-18T01:48:23.651 INFO:teuthology.orchestra.run.smithi129.stderr:instructed osd(s) 3 to deep-scrub 2024-09-18T01:48:23.653 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.651+0000 7fe7930d7640 1 -- 172.21.15.129:0/3062538810 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fe7780382a0 msgr2=0x7fe77803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:23.653 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.651+0000 7fe7930d7640 1 --2- 172.21.15.129:0/3062538810 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fe7780382a0 0x7fe77803a760 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fe780009720 tx=0x7fe78002e000 comp rx=0 tx=0).stop 2024-09-18T01:48:23.653 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.651+0000 7fe7930d7640 1 -- 172.21.15.129:0/3062538810 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe78c12cca0 msgr2=0x7fe78c122110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:23.653 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.651+0000 7fe7930d7640 1 --2- 172.21.15.129:0/3062538810 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe78c12cca0 0x7fe78c122110 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fe77c00c370 tx=0x7fe77c00c830 comp rx=0 tx=0).stop 2024-09-18T01:48:23.654 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.652+0000 7fe7930d7640 1 -- 172.21.15.129:0/3062538810 shutdown_connections 2024-09-18T01:48:23.654 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.652+0000 7fe7930d7640 1 --2- 172.21.15.129:0/3062538810 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fe7780382a0 0x7fe77803a760 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:23.654 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.652+0000 7fe7930d7640 1 --2- 172.21.15.129:0/3062538810 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe78c12cca0 0x7fe78c122110 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:23.654 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.652+0000 7fe7930d7640 1 -- 172.21.15.129:0/3062538810 >> 172.21.15.129:0/3062538810 conn(0x7fe78c09a890 msgr2=0x7fe78c12a440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:48:23.654 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.652+0000 7fe7930d7640 1 -- 172.21.15.129:0/3062538810 shutdown_connections 2024-09-18T01:48:23.654 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.652+0000 7fe7930d7640 1 -- 172.21.15.129:0/3062538810 wait complete. 2024-09-18T01:48:23.663 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T01:48:23.762 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.760+0000 7fdc7e923640 1 Processor -- start 2024-09-18T01:48:23.762 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.760+0000 7fdc7e923640 1 -- start start 2024-09-18T01:48:23.762 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.761+0000 7fdc7e923640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fdc7806eda0 0x7fdc7806f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:23.762 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.761+0000 7fdc7e923640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc7806eba0 con 0x7fdc7806f6c0 2024-09-18T01:48:23.762 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.761+0000 7fdc7e923640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x7fdc7806d2f0 con 0x7fdc7806eda0 2024-09-18T01:48:23.762 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.761+0000 7fdc77fff640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fdc7806eda0 0x7fdc7806f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:23.763 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.761+0000 7fdc777fe640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fdc7806f6c0 0x7fdc78121a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:38684/0 (socket says 172.21.15.129:38684) 2024-09-18T01:48:23.763 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.761+0000 7fdc77fff640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fdc7806eda0 0x7fdc7806f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:58954/0 (socket says 172.21.15.129:58954) 2024-09-18T01:48:23.763 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.761+0000 7fdc777fe640 1 -- 172.21.15.129:0/2324696480 learned_addr learned my addr 172.21.15.129:0/2324696480 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-09-18T01:48:23.763 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.761+0000 7fdc77fff640 1 -- 172.21.15.129:0/2324696480 >> v1:172.21.15.129:6789/0 conn(0x7fdc7806f6c0 legacy=0x7fdc78121a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:23.763 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.761+0000 7fdc77fff640 1 -- 172.21.15.129:0/2324696480 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc78070d50 con 0x7fdc7806eda0 2024-09-18T01:48:23.763 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.761+0000 7fdc76ffd640 1 -- 172.21.15.129:0/2324696480 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2624550898 0 0) 0x7fdc7806eba0 con 0x7fdc7806f6c0 2024-09-18T01:48:23.766 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.762+0000 7fdc77fff640 1 --2- 172.21.15.129:0/2324696480 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdc7806eda0 0x7fdc7806f180 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fdc68009720 tx=0x7fdc6802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=204f51dc6dd1e208 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:23.766 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.762+0000 7fdc76ffd640 1 -- 172.21.15.129:0/2324696480 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc68037070 con 0x7fdc7806eda0 2024-09-18T01:48:23.766 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.762+0000 7fdc76ffd640 1 -- 172.21.15.129:0/2324696480 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc6802ae20 con 0x7fdc7806eda0 2024-09-18T01:48:23.766 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.762+0000 7fdc76ffd640 1 -- 172.21.15.129:0/2324696480 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc68032590 con 0x7fdc7806eda0 2024-09-18T01:48:23.766 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.762+0000 7fdc7e923640 1 -- 172.21.15.129:0/2324696480 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdc7806eda0 msgr2=0x7fdc7806f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:23.766 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.762+0000 7fdc7e923640 1 --2- 172.21.15.129:0/2324696480 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdc7806eda0 0x7fdc7806f180 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fdc68009720 tx=0x7fdc6802a1a0 comp rx=0 tx=0).stop 2024-09-18T01:48:23.766 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.762+0000 7fdc7e923640 1 -- 172.21.15.129:0/2324696480 shutdown_connections 2024-09-18T01:48:23.766 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.762+0000 7fdc7e923640 1 --2- 172.21.15.129:0/2324696480 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdc7806eda0 0x7fdc7806f180 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:23.766 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.762+0000 7fdc7e923640 1 -- 172.21.15.129:0/2324696480 >> 172.21.15.129:0/2324696480 conn(0x7fdc7809a890 msgr2=0x7fdc7809aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:48:23.767 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.762+0000 7fdc7e923640 1 -- 172.21.15.129:0/2324696480 shutdown_connections 2024-09-18T01:48:23.767 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.762+0000 7fdc7e923640 1 -- 172.21.15.129:0/2324696480 wait complete. 2024-09-18T01:48:23.767 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.763+0000 7fdc7e923640 1 Processor -- start 2024-09-18T01:48:23.767 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.763+0000 7fdc7e923640 1 -- start start 2024-09-18T01:48:23.767 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.764+0000 7fdc7e923640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdc7806eda0 0x7fdc7808afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:23.767 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.764+0000 7fdc7e923640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fdc78122160 con 0x7fdc7806eda0 2024-09-18T01:48:23.767 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.764+0000 7fdc77fff640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdc7806eda0 0x7fdc7808afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:23.767 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.764+0000 7fdc77fff640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdc7806eda0 0x7fdc7808afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:58962/0 (socket says 172.21.15.129:58962) 2024-09-18T01:48:23.767 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.764+0000 7fdc77fff640 1 -- 172.21.15.129:0/2716242491 learned_addr learned my addr 172.21.15.129:0/2716242491 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-18T01:48:23.767 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.764+0000 7fdc77fff640 1 -- 172.21.15.129:0/2716242491 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc7808c750 con 0x7fdc7806eda0 2024-09-18T01:48:23.767 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.764+0000 7fdc77fff640 1 --2- 172.21.15.129:0/2716242491 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdc7806eda0 0x7fdc7808afc0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fdc6802a1e0 tx=0x7fdc68004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:23.767 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.764+0000 7fdc74ff9640 1 -- 172.21.15.129:0/2716242491 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc68048070 con 0x7fdc7806eda0 2024-09-18T01:48:23.767 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.764+0000 7fdc74ff9640 1 -- 172.21.15.129:0/2716242491 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc68039730 con 0x7fdc7806eda0 2024-09-18T01:48:23.768 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.764+0000 7fdc7e923640 1 -- 172.21.15.129:0/2716242491 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc78128ac0 con 0x7fdc7806eda0 2024-09-18T01:48:23.768 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.764+0000 7fdc74ff9640 1 -- 172.21.15.129:0/2716242491 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc68037040 con 0x7fdc7806eda0 2024-09-18T01:48:23.768 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.764+0000 7fdc7e923640 1 -- 172.21.15.129:0/2716242491 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc7808d3e0 con 0x7fdc7806eda0 2024-09-18T01:48:23.768 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.765+0000 7fdc74ff9640 1 -- 172.21.15.129:0/2716242491 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fdc6804b070 con 0x7fdc7806eda0 2024-09-18T01:48:23.769 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.765+0000 7fdc7e923640 1 -- 172.21.15.129:0/2716242491 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc7808c2b0 con 0x7fdc7806eda0 2024-09-18T01:48:23.769 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.766+0000 7fdc74ff9640 1 --2- 172.21.15.129:0/2716242491 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fdc640382a0 0x7fdc6403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:23.769 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.766+0000 7fdc74ff9640 1 -- 172.21.15.129:0/2716242491 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7fdc68040050 con 0x7fdc7806eda0 2024-09-18T01:48:23.769 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.766+0000 7fdc777fe640 1 --2- 172.21.15.129:0/2716242491 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fdc640382a0 0x7fdc6403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:23.769 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.766+0000 7fdc777fe640 1 --2- 172.21.15.129:0/2716242491 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fdc640382a0 0x7fdc6403a760 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c000c00 tx=0x7fdc6c007910 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:23.771 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.770+0000 7fdc74ff9640 1 -- 172.21.15.129:0/2716242491 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdc6802ae20 con 0x7fdc7806eda0 2024-09-18T01:48:23.934 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.933+0000 7fdc7e923640 1 -- 172.21.15.129:0/2716242491 --> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdc78122670 con 0x7fdc640382a0 2024-09-18T01:48:23.949 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.948+0000 7fdc74ff9640 1 -- 172.21.15.129:0/2716242491 <== mgr.4099 v2:172.21.15.146:6824/168968651 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665707 (secure 0 0 0) 0x7fdc78122670 con 0x7fdc640382a0 2024-09-18T01:48:23.957 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:48:23.962 INFO:teuthology.orchestra.run.smithi129.stderr:dumped all 2024-09-18T01:48:23.965 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.953+0000 7fdc7e923640 1 -- 172.21.15.129:0/2716242491 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fdc640382a0 msgr2=0x7fdc6403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:23.965 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.953+0000 7fdc7e923640 1 --2- 172.21.15.129:0/2716242491 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fdc640382a0 0x7fdc6403a760 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c000c00 tx=0x7fdc6c007910 comp rx=0 tx=0).stop 2024-09-18T01:48:23.965 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.953+0000 7fdc7e923640 1 -- 172.21.15.129:0/2716242491 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdc7806eda0 msgr2=0x7fdc7808afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:23.965 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.953+0000 7fdc7e923640 1 --2- 172.21.15.129:0/2716242491 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdc7806eda0 0x7fdc7808afc0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fdc6802a1e0 tx=0x7fdc68004730 comp rx=0 tx=0).stop 2024-09-18T01:48:23.965 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.953+0000 7fdc7e923640 1 -- 172.21.15.129:0/2716242491 shutdown_connections 2024-09-18T01:48:23.965 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.953+0000 7fdc7e923640 1 --2- 172.21.15.129:0/2716242491 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fdc640382a0 0x7fdc6403a760 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:23.965 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.953+0000 7fdc7e923640 1 --2- 172.21.15.129:0/2716242491 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdc7806eda0 0x7fdc7808afc0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:23.965 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.953+0000 7fdc7e923640 1 -- 172.21.15.129:0/2716242491 >> 172.21.15.129:0/2716242491 conn(0x7fdc7809a890 msgr2=0x7fdc780981f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:48:23.965 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.954+0000 7fdc7e923640 1 -- 172.21.15.129:0/2716242491 shutdown_connections 2024-09-18T01:48:23.965 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:23.954+0000 7fdc7e923640 1 -- 172.21.15.129:0/2716242491 wait complete. 2024-09-18T01:48:23.966 INFO:teuthology.orchestra.run.smithi129.stdout:{"pg_ready":true,"pg_map":{"version":138,"stamp":"2024-09-18T01:48:22.242201+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":603113,"num_objects":254,"num_object_clones":0,"num_object_copies":508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":254,"num_whiteouts":0,"num_read":5366,"num_read_kb":4915,"num_write":2371,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4804,"ondisk_log_size":4804,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152584,"kb_used_data":2880,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334776,"statfs":{"total":386547056640,"available":386390810624,"internally_reserved":0,"allocated":2949120,"data_stored":1774636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":153216791},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1992,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":713,"num_read_kb":672,"num_write":457,"num_write_kb":29372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003458"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.333746+0000","last_change":"2024-09-18T01:45:04.287665+0000","last_active":"2024-09-18T01:45:41.333746+0000","last_peered":"2024-09-18T01:45:41.333746+0000","last_clean":"2024-09-18T01:45:41.333746+0000","last_became_active":"2024-09-18T01:45:04.287322+0000","last_became_peered":"2024-09-18T01:45:04.287322+0000","last_unstale":"2024-09-18T01:45:41.333746+0000","last_undegraded":"2024-09-18T01:45:41.333746+0000","last_fullsized":"2024-09-18T01:45:41.333746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:31:48.524360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"33'8","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.871310+0000","last_change":"2024-09-18T01:45:06.296427+0000","last_active":"2024-09-18T01:48:12.871310+0000","last_peered":"2024-09-18T01:48:12.871310+0000","last_clean":"2024-09-18T01:48:12.871310+0000","last_became_active":"2024-09-18T01:45:06.295819+0000","last_became_peered":"2024-09-18T01:45:06.295819+0000","last_unstale":"2024-09-18T01:48:12.871310+0000","last_undegraded":"2024-09-18T01:48:12.871310+0000","last_fullsized":"2024-09-18T01:48:12.871310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:38:33.477420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.148239+0000","last_change":"2024-09-18T01:45:04.280965+0000","last_active":"2024-09-18T01:47:12.148239+0000","last_peered":"2024-09-18T01:47:12.148239+0000","last_clean":"2024-09-18T01:47:12.148239+0000","last_became_active":"2024-09-18T01:45:04.280591+0000","last_became_peered":"2024-09-18T01:45:04.280591+0000","last_unstale":"2024-09-18T01:47:12.148239+0000","last_undegraded":"2024-09-18T01:47:12.148239+0000","last_fullsized":"2024-09-18T01:47:12.148239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:43:03.344288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"33'12","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.880318+0000","last_change":"2024-09-18T01:45:06.282040+0000","last_active":"2024-09-18T01:48:12.880318+0000","last_peered":"2024-09-18T01:48:12.880318+0000","last_clean":"2024-09-18T01:48:12.880318+0000","last_became_active":"2024-09-18T01:45:06.281659+0000","last_became_peered":"2024-09-18T01:45:06.281659+0000","last_unstale":"2024-09-18T01:48:12.880318+0000","last_undegraded":"2024-09-18T01:48:12.880318+0000","last_fullsized":"2024-09-18T01:48:12.880318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:40:04.666289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"33'5","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.119006+0000","last_change":"2024-09-18T01:45:04.287682+0000","last_active":"2024-09-18T01:47:12.119006+0000","last_peered":"2024-09-18T01:47:12.119006+0000","last_clean":"2024-09-18T01:47:12.119006+0000","last_became_active":"2024-09-18T01:45:04.286007+0000","last_became_peered":"2024-09-18T01:45:04.286007+0000","last_unstale":"2024-09-18T01:47:12.119006+0000","last_undegraded":"2024-09-18T01:47:12.119006+0000","last_fullsized":"2024-09-18T01:47:12.119006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:45:57.765789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"33'18","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:09.011236+0000","last_change":"2024-09-18T01:45:06.285754+0000","last_active":"2024-09-18T01:47:09.011236+0000","last_peered":"2024-09-18T01:47:09.011236+0000","last_clean":"2024-09-18T01:47:09.011236+0000","last_became_active":"2024-09-18T01:45:06.285378+0000","last_became_peered":"2024-09-18T01:45:06.285378+0000","last_unstale":"2024-09-18T01:47:09.011236+0000","last_undegraded":"2024-09-18T01:47:09.011236+0000","last_fullsized":"2024-09-18T01:47:09.011236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:03:10.550215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":40,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.332258+0000","last_change":"2024-09-18T01:45:04.298111+0000","last_active":"2024-09-18T01:45:41.332258+0000","last_peered":"2024-09-18T01:45:41.332258+0000","last_clean":"2024-09-18T01:45:41.332258+0000","last_became_active":"2024-09-18T01:45:04.297791+0000","last_became_peered":"2024-09-18T01:45:04.297791+0000","last_unstale":"2024-09-18T01:45:41.332258+0000","last_undegraded":"2024-09-18T01:45:41.332258+0000","last_fullsized":"2024-09-18T01:45:41.332258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:56:17.978705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"33'6","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.931884+0000","last_change":"2024-09-18T01:45:06.281604+0000","last_active":"2024-09-18T01:48:12.931884+0000","last_peered":"2024-09-18T01:48:12.931884+0000","last_clean":"2024-09-18T01:48:12.931884+0000","last_became_active":"2024-09-18T01:45:06.280779+0000","last_became_peered":"2024-09-18T01:45:06.280779+0000","last_unstale":"2024-09-18T01:48:12.931884+0000","last_undegraded":"2024-09-18T01:48:12.931884+0000","last_fullsized":"2024-09-18T01:48:12.931884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:30:51.321533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.336661+0000","last_change":"2024-09-18T01:45:04.280905+0000","last_active":"2024-09-18T01:45:41.336661+0000","last_peered":"2024-09-18T01:45:41.336661+0000","last_clean":"2024-09-18T01:45:41.336661+0000","last_became_active":"2024-09-18T01:45:04.280582+0000","last_became_peered":"2024-09-18T01:45:04.280582+0000","last_unstale":"2024-09-18T01:45:41.336661+0000","last_undegraded":"2024-09-18T01:45:41.336661+0000","last_fullsized":"2024-09-18T01:45:41.336661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:31:58.114526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'12","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.162513+0000","last_change":"2024-09-18T01:45:06.289323+0000","last_active":"2024-09-18T01:47:12.162513+0000","last_peered":"2024-09-18T01:47:12.162513+0000","last_clean":"2024-09-18T01:47:12.162513+0000","last_became_active":"2024-09-18T01:45:06.289036+0000","last_became_peered":"2024-09-18T01:45:06.289036+0000","last_unstale":"2024-09-18T01:47:12.162513+0000","last_undegraded":"2024-09-18T01:47:12.162513+0000","last_fullsized":"2024-09-18T01:47:12.162513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:10:29.661303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.331520+0000","last_change":"2024-09-18T01:45:04.286820+0000","last_active":"2024-09-18T01:45:41.331520+0000","last_peered":"2024-09-18T01:45:41.331520+0000","last_clean":"2024-09-18T01:45:41.331520+0000","last_became_active":"2024-09-18T01:45:04.286509+0000","last_became_peered":"2024-09-18T01:45:04.286509+0000","last_unstale":"2024-09-18T01:45:41.331520+0000","last_undegraded":"2024-09-18T01:45:41.331520+0000","last_fullsized":"2024-09-18T01:45:41.331520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:49:22.831669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:46:28.368317+0000","last_change":"2024-09-18T01:45:06.288010+0000","last_active":"2024-09-18T01:46:28.368317+0000","last_peered":"2024-09-18T01:46:28.368317+0000","last_clean":"2024-09-18T01:46:28.368317+0000","last_became_active":"2024-09-18T01:45:06.287110+0000","last_became_peered":"2024-09-18T01:45:06.287110+0000","last_unstale":"2024-09-18T01:46:28.368317+0000","last_undegraded":"2024-09-18T01:46:28.368317+0000","last_fullsized":"2024-09-18T01:46:28.368317+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:15:07.650151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.774639+0000","last_change":"2024-09-18T01:45:04.293823+0000","last_active":"2024-09-18T01:48:12.774639+0000","last_peered":"2024-09-18T01:48:12.774639+0000","last_clean":"2024-09-18T01:48:12.774639+0000","last_became_active":"2024-09-18T01:45:04.289290+0000","last_became_peered":"2024-09-18T01:45:04.289290+0000","last_unstale":"2024-09-18T01:48:12.774639+0000","last_undegraded":"2024-09-18T01:48:12.774639+0000","last_fullsized":"2024-09-18T01:48:12.774639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:38:46.320555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'13","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.848762+0000","last_change":"2024-09-18T01:45:06.295725+0000","last_active":"2024-09-18T01:48:12.848762+0000","last_peered":"2024-09-18T01:48:12.848762+0000","last_clean":"2024-09-18T01:48:12.848762+0000","last_became_active":"2024-09-18T01:45:06.295429+0000","last_became_peered":"2024-09-18T01:45:06.295429+0000","last_unstale":"2024-09-18T01:48:12.848762+0000","last_undegraded":"2024-09-18T01:48:12.848762+0000","last_fullsized":"2024-09-18T01:48:12.848762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:48:17.261741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337598+0000","last_change":"2024-09-18T01:45:04.273877+0000","last_active":"2024-09-18T01:45:41.337598+0000","last_peered":"2024-09-18T01:45:41.337598+0000","last_clean":"2024-09-18T01:45:41.337598+0000","last_became_active":"2024-09-18T01:45:04.273328+0000","last_became_peered":"2024-09-18T01:45:04.273328+0000","last_unstale":"2024-09-18T01:45:41.337598+0000","last_undegraded":"2024-09-18T01:45:41.337598+0000","last_fullsized":"2024-09-18T01:45:41.337598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:18:35.916205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'9","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.660161+0000","last_change":"2024-09-18T01:45:06.285251+0000","last_active":"2024-09-18T01:48:12.660161+0000","last_peered":"2024-09-18T01:48:12.660161+0000","last_clean":"2024-09-18T01:48:12.660161+0000","last_became_active":"2024-09-18T01:45:06.284994+0000","last_became_peered":"2024-09-18T01:45:06.284994+0000","last_unstale":"2024-09-18T01:48:12.660161+0000","last_undegraded":"2024-09-18T01:48:12.660161+0000","last_fullsized":"2024-09-18T01:48:12.660161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:37:02.533275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.171347+0000","last_change":"2024-09-18T01:45:06.286775+0000","last_active":"2024-09-18T01:47:12.171347+0000","last_peered":"2024-09-18T01:47:12.171347+0000","last_clean":"2024-09-18T01:47:12.171347+0000","last_became_active":"2024-09-18T01:45:06.286524+0000","last_became_peered":"2024-09-18T01:45:06.286524+0000","last_unstale":"2024-09-18T01:47:12.171347+0000","last_undegraded":"2024-09-18T01:47:12.171347+0000","last_fullsized":"2024-09-18T01:47:12.171347+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:22:27.593735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338138+0000","last_change":"2024-09-18T01:45:04.298742+0000","last_active":"2024-09-18T01:45:41.338138+0000","last_peered":"2024-09-18T01:45:41.338138+0000","last_clean":"2024-09-18T01:45:41.338138+0000","last_became_active":"2024-09-18T01:45:04.298399+0000","last_became_peered":"2024-09-18T01:45:04.298399+0000","last_unstale":"2024-09-18T01:45:41.338138+0000","last_undegraded":"2024-09-18T01:45:41.338138+0000","last_fullsized":"2024-09-18T01:45:41.338138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:56:17.978705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"33'10","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.171009+0000","last_change":"2024-09-18T01:45:06.294964+0000","last_active":"2024-09-18T01:47:12.171009+0000","last_peered":"2024-09-18T01:47:12.171009+0000","last_clean":"2024-09-18T01:47:12.171009+0000","last_became_active":"2024-09-18T01:45:06.294670+0000","last_became_peered":"2024-09-18T01:45:06.294670+0000","last_unstale":"2024-09-18T01:47:12.171009+0000","last_undegraded":"2024-09-18T01:47:12.171009+0000","last_fullsized":"2024-09-18T01:47:12.171009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:12:27.107318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.334046+0000","last_change":"2024-09-18T01:45:04.286914+0000","last_active":"2024-09-18T01:45:41.334046+0000","last_peered":"2024-09-18T01:45:41.334046+0000","last_clean":"2024-09-18T01:45:41.334046+0000","last_became_active":"2024-09-18T01:45:04.286465+0000","last_became_peered":"2024-09-18T01:45:04.286465+0000","last_unstale":"2024-09-18T01:45:41.334046+0000","last_undegraded":"2024-09-18T01:45:41.334046+0000","last_fullsized":"2024-09-18T01:45:41.334046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:18:35.916205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'3","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:27.217076+0000","last_change":"2024-09-18T01:45:06.294374+0000","last_active":"2024-09-18T01:47:27.217076+0000","last_peered":"2024-09-18T01:47:27.217076+0000","last_clean":"2024-09-18T01:47:27.217076+0000","last_became_active":"2024-09-18T01:45:06.294118+0000","last_became_peered":"2024-09-18T01:45:06.294118+0000","last_unstale":"2024-09-18T01:47:27.217076+0000","last_undegraded":"2024-09-18T01:47:27.217076+0000","last_fullsized":"2024-09-18T01:47:27.217076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:55:38.246732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338586+0000","last_change":"2024-09-18T01:45:04.294733+0000","last_active":"2024-09-18T01:45:41.338586+0000","last_peered":"2024-09-18T01:45:41.338586+0000","last_clean":"2024-09-18T01:45:41.338586+0000","last_became_active":"2024-09-18T01:45:04.294327+0000","last_became_peered":"2024-09-18T01:45:04.294327+0000","last_unstale":"2024-09-18T01:45:41.338586+0000","last_undegraded":"2024-09-18T01:45:41.338586+0000","last_fullsized":"2024-09-18T01:45:41.338586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:18:35.916205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'4","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.171117+0000","last_change":"2024-09-18T01:45:06.285844+0000","last_active":"2024-09-18T01:47:12.171117+0000","last_peered":"2024-09-18T01:47:12.171117+0000","last_clean":"2024-09-18T01:47:12.171117+0000","last_became_active":"2024-09-18T01:45:06.285429+0000","last_became_peered":"2024-09-18T01:45:06.285429+0000","last_unstale":"2024-09-18T01:47:12.171117+0000","last_undegraded":"2024-09-18T01:47:12.171117+0000","last_fullsized":"2024-09-18T01:47:12.171117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:33:43.173746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.336963+0000","last_change":"2024-09-18T01:45:04.299057+0000","last_active":"2024-09-18T01:45:41.336963+0000","last_peered":"2024-09-18T01:45:41.336963+0000","last_clean":"2024-09-18T01:45:41.336963+0000","last_became_active":"2024-09-18T01:45:04.298601+0000","last_became_peered":"2024-09-18T01:45:04.298601+0000","last_unstale":"2024-09-18T01:45:41.336963+0000","last_undegraded":"2024-09-18T01:45:41.336963+0000","last_fullsized":"2024-09-18T01:45:41.336963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:31:48.524360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'10","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.558700+0000","last_change":"2024-09-18T01:45:06.286133+0000","last_active":"2024-09-18T01:48:12.558700+0000","last_peered":"2024-09-18T01:48:12.558700+0000","last_clean":"2024-09-18T01:48:12.558700+0000","last_became_active":"2024-09-18T01:45:06.285228+0000","last_became_peered":"2024-09-18T01:45:06.285228+0000","last_unstale":"2024-09-18T01:48:12.558700+0000","last_undegraded":"2024-09-18T01:48:12.558700+0000","last_fullsized":"2024-09-18T01:48:12.558700+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:03:57.671184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:46.110785+0000","last_change":"2024-09-18T01:45:04.281502+0000","last_active":"2024-09-18T01:45:46.110785+0000","last_peered":"2024-09-18T01:45:46.110785+0000","last_clean":"2024-09-18T01:45:46.110785+0000","last_became_active":"2024-09-18T01:45:04.281118+0000","last_became_peered":"2024-09-18T01:45:04.281118+0000","last_unstale":"2024-09-18T01:45:46.110785+0000","last_undegraded":"2024-09-18T01:45:46.110785+0000","last_fullsized":"2024-09-18T01:45:46.110785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:42:11.703254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"33'16","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.793630+0000","last_change":"2024-09-18T01:45:06.284548+0000","last_active":"2024-09-18T01:48:12.793630+0000","last_peered":"2024-09-18T01:48:12.793630+0000","last_clean":"2024-09-18T01:48:12.793630+0000","last_became_active":"2024-09-18T01:45:06.284237+0000","last_became_peered":"2024-09-18T01:45:06.284237+0000","last_unstale":"2024-09-18T01:48:12.793630+0000","last_undegraded":"2024-09-18T01:48:12.793630+0000","last_fullsized":"2024-09-18T01:48:12.793630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:04:56.154083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":48,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338330+0000","last_change":"2024-09-18T01:45:04.285185+0000","last_active":"2024-09-18T01:45:41.338330+0000","last_peered":"2024-09-18T01:45:41.338330+0000","last_clean":"2024-09-18T01:45:41.338330+0000","last_became_active":"2024-09-18T01:45:04.284148+0000","last_became_peered":"2024-09-18T01:45:04.284148+0000","last_unstale":"2024-09-18T01:45:41.338330+0000","last_undegraded":"2024-09-18T01:45:41.338330+0000","last_fullsized":"2024-09-18T01:45:41.338330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:09:41.307844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'35","reported_seq":99,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.821349+0000","last_change":"2024-09-18T01:45:14.323024+0000","last_active":"2024-09-18T01:48:12.821349+0000","last_peered":"2024-09-18T01:48:12.821349+0000","last_clean":"2024-09-18T01:48:12.821349+0000","last_became_active":"2024-09-18T01:45:14.322729+0000","last_became_peered":"2024-09-18T01:45:14.322729+0000","last_unstale":"2024-09-18T01:48:12.821349+0000","last_undegraded":"2024-09-18T01:48:12.821349+0000","last_fullsized":"2024-09-18T01:48:12.821349+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:40:38.654675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'10","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.559925+0000","last_change":"2024-09-18T01:45:06.281639+0000","last_active":"2024-09-18T01:48:12.559925+0000","last_peered":"2024-09-18T01:48:12.559925+0000","last_clean":"2024-09-18T01:48:12.559925+0000","last_became_active":"2024-09-18T01:45:06.281361+0000","last_became_peered":"2024-09-18T01:45:06.281361+0000","last_unstale":"2024-09-18T01:48:12.559925+0000","last_undegraded":"2024-09-18T01:48:12.559925+0000","last_fullsized":"2024-09-18T01:48:12.559925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:48:25.542869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.454158+0000","last_change":"2024-09-18T01:45:04.285350+0000","last_active":"2024-09-18T01:48:12.454158+0000","last_peered":"2024-09-18T01:48:12.454158+0000","last_clean":"2024-09-18T01:48:12.454158+0000","last_became_active":"2024-09-18T01:45:04.285008+0000","last_became_peered":"2024-09-18T01:45:04.285008+0000","last_unstale":"2024-09-18T01:48:12.454158+0000","last_undegraded":"2024-09-18T01:48:12.454158+0000","last_fullsized":"2024-09-18T01:48:12.454158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:37:00.525779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.340987+0000","last_change":"2024-09-18T01:45:08.296627+0000","last_active":"2024-09-18T01:45:41.340987+0000","last_peered":"2024-09-18T01:45:41.340987+0000","last_clean":"2024-09-18T01:45:41.340987+0000","last_became_active":"2024-09-18T01:45:08.296241+0000","last_became_peered":"2024-09-18T01:45:08.296241+0000","last_unstale":"2024-09-18T01:45:41.340987+0000","last_undegraded":"2024-09-18T01:45:41.340987+0000","last_fullsized":"2024-09-18T01:45:41.340987+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:01:25.419937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'46","reported_seq":104,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.535317+0000","last_change":"2024-09-18T01:45:10.306140+0000","last_active":"2024-09-18T01:48:19.535317+0000","last_peered":"2024-09-18T01:48:19.535317+0000","last_clean":"2024-09-18T01:48:19.535317+0000","last_became_active":"2024-09-18T01:45:10.305713+0000","last_became_peered":"2024-09-18T01:45:10.305713+0000","last_unstale":"2024-09-18T01:48:19.535317+0000","last_undegraded":"2024-09-18T01:48:19.535317+0000","last_fullsized":"2024-09-18T01:48:19.535317+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:42:14.941344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337936+0000","last_change":"2024-09-18T01:45:12.313546+0000","last_active":"2024-09-18T01:45:41.337936+0000","last_peered":"2024-09-18T01:45:41.337936+0000","last_clean":"2024-09-18T01:45:41.337936+0000","last_became_active":"2024-09-18T01:45:12.313276+0000","last_became_peered":"2024-09-18T01:45:12.313276+0000","last_unstale":"2024-09-18T01:45:41.337936+0000","last_undegraded":"2024-09-18T01:45:41.337936+0000","last_fullsized":"2024-09-18T01:45:41.337936+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:22:43.654693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'7","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:46:28.375354+0000","last_change":"2024-09-18T01:45:14.318360+0000","last_active":"2024-09-18T01:46:28.375354+0000","last_peered":"2024-09-18T01:46:28.375354+0000","last_clean":"2024-09-18T01:46:28.375354+0000","last_became_active":"2024-09-18T01:45:14.318093+0000","last_became_peered":"2024-09-18T01:45:14.318093+0000","last_unstale":"2024-09-18T01:46:28.375354+0000","last_undegraded":"2024-09-18T01:46:28.375354+0000","last_fullsized":"2024-09-18T01:46:28.375354+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:28:17.630868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"33'13","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.879659+0000","last_change":"2024-09-18T01:45:41.348633+0000","last_active":"2024-09-18T01:48:12.879659+0000","last_peered":"2024-09-18T01:48:12.879659+0000","last_clean":"2024-09-18T01:48:12.879659+0000","last_became_active":"2024-09-18T01:45:41.338243+0000","last_became_peered":"2024-09-18T01:45:41.338243+0000","last_unstale":"2024-09-18T01:48:12.879659+0000","last_undegraded":"2024-09-18T01:48:12.879659+0000","last_fullsized":"2024-09-18T01:48:12.879659+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:42:23.528238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":13,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:44.958482+0000","last_change":"2024-09-18T01:45:04.293264+0000","last_active":"2024-09-18T01:45:44.958482+0000","last_peered":"2024-09-18T01:45:44.958482+0000","last_clean":"2024-09-18T01:45:44.958482+0000","last_became_active":"2024-09-18T01:45:04.292853+0000","last_became_peered":"2024-09-18T01:45:04.292853+0000","last_unstale":"2024-09-18T01:45:44.958482+0000","last_undegraded":"2024-09-18T01:45:44.958482+0000","last_fullsized":"2024-09-18T01:45:44.958482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:19:39.056474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338261+0000","last_change":"2024-09-18T01:45:08.288697+0000","last_active":"2024-09-18T01:45:41.338261+0000","last_peered":"2024-09-18T01:45:41.338261+0000","last_clean":"2024-09-18T01:45:41.338261+0000","last_became_active":"2024-09-18T01:45:08.288390+0000","last_became_peered":"2024-09-18T01:45:08.288390+0000","last_unstale":"2024-09-18T01:45:41.338261+0000","last_undegraded":"2024-09-18T01:45:41.338261+0000","last_fullsized":"2024-09-18T01:45:41.338261+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:45:19.311056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"31'12","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337413+0000","last_change":"2024-09-18T01:45:10.303251+0000","last_active":"2024-09-18T01:45:41.337413+0000","last_peered":"2024-09-18T01:45:41.337413+0000","last_clean":"2024-09-18T01:45:41.337413+0000","last_became_active":"2024-09-18T01:45:10.302957+0000","last_became_peered":"2024-09-18T01:45:10.302957+0000","last_unstale":"2024-09-18T01:45:41.337413+0000","last_undegraded":"2024-09-18T01:45:41.337413+0000","last_fullsized":"2024-09-18T01:45:41.337413+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:22:48.911652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337811+0000","last_change":"2024-09-18T01:45:12.317743+0000","last_active":"2024-09-18T01:45:41.337811+0000","last_peered":"2024-09-18T01:45:41.337811+0000","last_clean":"2024-09-18T01:45:41.337811+0000","last_became_active":"2024-09-18T01:45:12.317471+0000","last_became_peered":"2024-09-18T01:45:12.317471+0000","last_unstale":"2024-09-18T01:45:41.337811+0000","last_undegraded":"2024-09-18T01:45:41.337811+0000","last_fullsized":"2024-09-18T01:45:41.337811+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:18:50.168373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337317+0000","last_change":"2024-09-18T01:45:14.319762+0000","last_active":"2024-09-18T01:45:41.337317+0000","last_peered":"2024-09-18T01:45:41.337317+0000","last_clean":"2024-09-18T01:45:41.337317+0000","last_became_active":"2024-09-18T01:45:14.319387+0000","last_became_peered":"2024-09-18T01:45:14.319387+0000","last_unstale":"2024-09-18T01:45:41.337317+0000","last_undegraded":"2024-09-18T01:45:41.337317+0000","last_fullsized":"2024-09-18T01:45:41.337317+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:54:12.321781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'10","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.171155+0000","last_change":"2024-09-18T01:45:06.284632+0000","last_active":"2024-09-18T01:47:12.171155+0000","last_peered":"2024-09-18T01:47:12.171155+0000","last_clean":"2024-09-18T01:47:12.171155+0000","last_became_active":"2024-09-18T01:45:06.283815+0000","last_became_peered":"2024-09-18T01:45:06.283815+0000","last_unstale":"2024-09-18T01:47:12.171155+0000","last_undegraded":"2024-09-18T01:47:12.171155+0000","last_fullsized":"2024-09-18T01:47:12.171155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:55:34.371724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.335146+0000","last_change":"2024-09-18T01:45:04.293546+0000","last_active":"2024-09-18T01:45:41.335146+0000","last_peered":"2024-09-18T01:45:41.335146+0000","last_clean":"2024-09-18T01:45:41.335146+0000","last_became_active":"2024-09-18T01:45:04.288040+0000","last_became_peered":"2024-09-18T01:45:04.288040+0000","last_unstale":"2024-09-18T01:45:41.335146+0000","last_undegraded":"2024-09-18T01:45:41.335146+0000","last_fullsized":"2024-09-18T01:45:41.335146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:12:25.099822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.340495+0000","last_change":"2024-09-18T01:45:08.288920+0000","last_active":"2024-09-18T01:45:41.340495+0000","last_peered":"2024-09-18T01:45:41.340495+0000","last_clean":"2024-09-18T01:45:41.340495+0000","last_became_active":"2024-09-18T01:45:08.288667+0000","last_became_peered":"2024-09-18T01:45:08.288667+0000","last_unstale":"2024-09-18T01:45:41.340495+0000","last_undegraded":"2024-09-18T01:45:41.340495+0000","last_fullsized":"2024-09-18T01:45:41.340495+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:58:00.539983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"31'23","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.333260+0000","last_change":"2024-09-18T01:45:10.304260+0000","last_active":"2024-09-18T01:45:41.333260+0000","last_peered":"2024-09-18T01:45:41.333260+0000","last_clean":"2024-09-18T01:45:41.333260+0000","last_became_active":"2024-09-18T01:45:10.304004+0000","last_became_peered":"2024-09-18T01:45:10.304004+0000","last_unstale":"2024-09-18T01:45:41.333260+0000","last_undegraded":"2024-09-18T01:45:41.333260+0000","last_fullsized":"2024-09-18T01:45:41.333260+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:39:04.390442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'285","reported_seq":387,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.418739+0000","last_change":"2024-09-18T01:45:12.317560+0000","last_active":"2024-09-18T01:48:19.418739+0000","last_peered":"2024-09-18T01:48:19.418739+0000","last_clean":"2024-09-18T01:48:19.418739+0000","last_became_active":"2024-09-18T01:45:12.317288+0000","last_became_peered":"2024-09-18T01:45:12.317288+0000","last_unstale":"2024-09-18T01:48:19.418739+0000","last_undegraded":"2024-09-18T01:48:19.418739+0000","last_fullsized":"2024-09-18T01:48:19.418739+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:48:33.500493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.331675+0000","last_change":"2024-09-18T01:45:14.326621+0000","last_active":"2024-09-18T01:45:41.331675+0000","last_peered":"2024-09-18T01:45:41.331675+0000","last_clean":"2024-09-18T01:45:41.331675+0000","last_became_active":"2024-09-18T01:45:14.325843+0000","last_became_peered":"2024-09-18T01:45:14.325843+0000","last_unstale":"2024-09-18T01:45:41.331675+0000","last_undegraded":"2024-09-18T01:45:41.331675+0000","last_fullsized":"2024-09-18T01:45:41.331675+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:49:37.077451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.340482+0000","last_change":"2024-09-18T01:45:06.295671+0000","last_active":"2024-09-18T01:45:41.340482+0000","last_peered":"2024-09-18T01:45:41.340482+0000","last_clean":"2024-09-18T01:45:41.340482+0000","last_became_active":"2024-09-18T01:45:06.295417+0000","last_became_peered":"2024-09-18T01:45:06.295417+0000","last_unstale":"2024-09-18T01:45:41.340482+0000","last_undegraded":"2024-09-18T01:45:41.340482+0000","last_fullsized":"2024-09-18T01:45:41.340482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:20:03.455685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:46.101670+0000","last_change":"2024-09-18T01:45:04.282935+0000","last_active":"2024-09-18T01:45:46.101670+0000","last_peered":"2024-09-18T01:45:46.101670+0000","last_clean":"2024-09-18T01:45:46.101670+0000","last_became_active":"2024-09-18T01:45:04.282500+0000","last_became_peered":"2024-09-18T01:45:04.282500+0000","last_unstale":"2024-09-18T01:45:46.101670+0000","last_undegraded":"2024-09-18T01:45:46.101670+0000","last_fullsized":"2024-09-18T01:45:46.101670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:59:04.808153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338959+0000","last_change":"2024-09-18T01:45:08.296538+0000","last_active":"2024-09-18T01:45:41.338959+0000","last_peered":"2024-09-18T01:45:41.338959+0000","last_clean":"2024-09-18T01:45:41.338959+0000","last_became_active":"2024-09-18T01:45:08.296192+0000","last_became_peered":"2024-09-18T01:45:08.296192+0000","last_unstale":"2024-09-18T01:45:41.338959+0000","last_undegraded":"2024-09-18T01:45:41.338959+0000","last_fullsized":"2024-09-18T01:45:41.338959+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:28:48.199978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'39","reported_seq":91,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.519679+0000","last_change":"2024-09-18T01:45:10.305819+0000","last_active":"2024-09-18T01:48:19.519679+0000","last_peered":"2024-09-18T01:48:19.519679+0000","last_clean":"2024-09-18T01:48:19.519679+0000","last_became_active":"2024-09-18T01:45:10.305515+0000","last_became_peered":"2024-09-18T01:45:10.305515+0000","last_unstale":"2024-09-18T01:48:19.519679+0000","last_undegraded":"2024-09-18T01:48:19.519679+0000","last_fullsized":"2024-09-18T01:48:19.519679+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:54:15.247041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'285","reported_seq":403,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.423772+0000","last_change":"2024-09-18T01:45:12.313547+0000","last_active":"2024-09-18T01:48:19.423772+0000","last_peered":"2024-09-18T01:48:19.423772+0000","last_clean":"2024-09-18T01:48:19.423772+0000","last_became_active":"2024-09-18T01:45:12.313219+0000","last_became_peered":"2024-09-18T01:45:12.313219+0000","last_unstale":"2024-09-18T01:48:19.423772+0000","last_undegraded":"2024-09-18T01:48:19.423772+0000","last_fullsized":"2024-09-18T01:48:19.423772+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:18:26.966437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.334693+0000","last_change":"2024-09-18T01:45:06.297804+0000","last_active":"2024-09-18T01:45:41.334693+0000","last_peered":"2024-09-18T01:45:41.334693+0000","last_clean":"2024-09-18T01:45:41.334693+0000","last_became_active":"2024-09-18T01:45:06.297283+0000","last_became_peered":"2024-09-18T01:45:06.297283+0000","last_unstale":"2024-09-18T01:45:41.334693+0000","last_undegraded":"2024-09-18T01:45:41.334693+0000","last_fullsized":"2024-09-18T01:45:41.334693+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:34:09.651529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.333900+0000","last_change":"2024-09-18T01:45:04.289955+0000","last_active":"2024-09-18T01:45:41.333900+0000","last_peered":"2024-09-18T01:45:41.333900+0000","last_clean":"2024-09-18T01:45:41.333900+0000","last_became_active":"2024-09-18T01:45:04.289629+0000","last_became_peered":"2024-09-18T01:45:04.289629+0000","last_unstale":"2024-09-18T01:45:41.333900+0000","last_undegraded":"2024-09-18T01:45:41.333900+0000","last_fullsized":"2024-09-18T01:45:41.333900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:43:03.344288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.333438+0000","last_change":"2024-09-18T01:45:08.294834+0000","last_active":"2024-09-18T01:45:41.333438+0000","last_peered":"2024-09-18T01:45:41.333438+0000","last_clean":"2024-09-18T01:45:41.333438+0000","last_became_active":"2024-09-18T01:45:08.294273+0000","last_became_peered":"2024-09-18T01:45:08.294273+0000","last_unstale":"2024-09-18T01:45:41.333438+0000","last_undegraded":"2024-09-18T01:45:41.333438+0000","last_fullsized":"2024-09-18T01:45:41.333438+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:54:13.237972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'49","reported_seq":106,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.547952+0000","last_change":"2024-09-18T01:45:10.298381+0000","last_active":"2024-09-18T01:48:19.547952+0000","last_peered":"2024-09-18T01:48:19.547952+0000","last_clean":"2024-09-18T01:48:19.547952+0000","last_became_active":"2024-09-18T01:45:10.298021+0000","last_became_peered":"2024-09-18T01:45:10.298021+0000","last_unstale":"2024-09-18T01:48:19.547952+0000","last_undegraded":"2024-09-18T01:48:19.547952+0000","last_fullsized":"2024-09-18T01:48:19.547952+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:39:10.135582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338655+0000","last_change":"2024-09-18T01:45:12.314207+0000","last_active":"2024-09-18T01:45:41.338655+0000","last_peered":"2024-09-18T01:45:41.338655+0000","last_clean":"2024-09-18T01:45:41.338655+0000","last_became_active":"2024-09-18T01:45:12.313875+0000","last_became_peered":"2024-09-18T01:45:12.313875+0000","last_unstale":"2024-09-18T01:45:41.338655+0000","last_undegraded":"2024-09-18T01:45:41.338655+0000","last_fullsized":"2024-09-18T01:45:41.338655+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:42:29.558204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'7","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:46:28.376975+0000","last_change":"2024-09-18T01:45:14.322757+0000","last_active":"2024-09-18T01:46:28.376975+0000","last_peered":"2024-09-18T01:46:28.376975+0000","last_clean":"2024-09-18T01:46:28.376975+0000","last_became_active":"2024-09-18T01:45:14.322448+0000","last_became_peered":"2024-09-18T01:45:14.322448+0000","last_unstale":"2024-09-18T01:46:28.376975+0000","last_undegraded":"2024-09-18T01:46:28.376975+0000","last_fullsized":"2024-09-18T01:46:28.376975+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:13:39.692712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":17,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'8","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.649737+0000","last_change":"2024-09-18T01:45:06.292485+0000","last_active":"2024-09-18T01:48:12.649737+0000","last_peered":"2024-09-18T01:48:12.649737+0000","last_clean":"2024-09-18T01:48:12.649737+0000","last_became_active":"2024-09-18T01:45:06.292143+0000","last_became_peered":"2024-09-18T01:45:06.292143+0000","last_unstale":"2024-09-18T01:48:12.649737+0000","last_undegraded":"2024-09-18T01:48:12.649737+0000","last_fullsized":"2024-09-18T01:48:12.649737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:45:59.773285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.333555+0000","last_change":"2024-09-18T01:45:04.293049+0000","last_active":"2024-09-18T01:45:41.333555+0000","last_peered":"2024-09-18T01:45:41.333555+0000","last_clean":"2024-09-18T01:45:41.333555+0000","last_became_active":"2024-09-18T01:45:04.292734+0000","last_became_peered":"2024-09-18T01:45:04.292734+0000","last_unstale":"2024-09-18T01:45:41.333555+0000","last_undegraded":"2024-09-18T01:45:41.333555+0000","last_fullsized":"2024-09-18T01:45:41.333555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:42:11.703254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337869+0000","last_change":"2024-09-18T01:45:08.294254+0000","last_active":"2024-09-18T01:45:41.337869+0000","last_peered":"2024-09-18T01:45:41.337869+0000","last_clean":"2024-09-18T01:45:41.337869+0000","last_became_active":"2024-09-18T01:45:08.294026+0000","last_became_peered":"2024-09-18T01:45:08.294026+0000","last_unstale":"2024-09-18T01:45:41.337869+0000","last_undegraded":"2024-09-18T01:45:41.337869+0000","last_fullsized":"2024-09-18T01:45:41.337869+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:41:44.964492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'39","reported_seq":91,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.476895+0000","last_change":"2024-09-18T01:45:10.308697+0000","last_active":"2024-09-18T01:48:19.476895+0000","last_peered":"2024-09-18T01:48:19.476895+0000","last_clean":"2024-09-18T01:48:19.476895+0000","last_became_active":"2024-09-18T01:45:10.307420+0000","last_became_peered":"2024-09-18T01:45:10.307420+0000","last_unstale":"2024-09-18T01:48:19.476895+0000","last_undegraded":"2024-09-18T01:48:19.476895+0000","last_fullsized":"2024-09-18T01:48:19.476895+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:50:42.386927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337545+0000","last_change":"2024-09-18T01:45:12.306113+0000","last_active":"2024-09-18T01:45:41.337545+0000","last_peered":"2024-09-18T01:45:41.337545+0000","last_clean":"2024-09-18T01:45:41.337545+0000","last_became_active":"2024-09-18T01:45:12.305838+0000","last_became_peered":"2024-09-18T01:45:12.305838+0000","last_unstale":"2024-09-18T01:45:41.337545+0000","last_undegraded":"2024-09-18T01:45:41.337545+0000","last_fullsized":"2024-09-18T01:45:41.337545+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:18:50.168373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'3","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:46:22.809927+0000","last_change":"2024-09-18T01:45:14.322540+0000","last_active":"2024-09-18T01:46:22.809927+0000","last_peered":"2024-09-18T01:46:22.809927+0000","last_clean":"2024-09-18T01:46:22.809927+0000","last_became_active":"2024-09-18T01:45:14.322272+0000","last_became_peered":"2024-09-18T01:45:14.322272+0000","last_unstale":"2024-09-18T01:46:22.809927+0000","last_undegraded":"2024-09-18T01:46:22.809927+0000","last_fullsized":"2024-09-18T01:46:22.809927+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:16:32.686304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"33'8","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.561148+0000","last_change":"2024-09-18T01:45:06.284946+0000","last_active":"2024-09-18T01:48:12.561148+0000","last_peered":"2024-09-18T01:48:12.561148+0000","last_clean":"2024-09-18T01:48:12.561148+0000","last_became_active":"2024-09-18T01:45:06.284677+0000","last_became_peered":"2024-09-18T01:45:06.284677+0000","last_unstale":"2024-09-18T01:48:12.561148+0000","last_undegraded":"2024-09-18T01:48:12.561148+0000","last_fullsized":"2024-09-18T01:48:12.561148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:38:48.328050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.341273+0000","last_change":"2024-09-18T01:45:04.287402+0000","last_active":"2024-09-18T01:45:41.341273+0000","last_peered":"2024-09-18T01:45:41.341273+0000","last_clean":"2024-09-18T01:45:41.341273+0000","last_became_active":"2024-09-18T01:45:04.284151+0000","last_became_peered":"2024-09-18T01:45:04.284151+0000","last_unstale":"2024-09-18T01:45:41.341273+0000","last_undegraded":"2024-09-18T01:45:41.341273+0000","last_fullsized":"2024-09-18T01:45:41.341273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:38:31.469925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.340511+0000","last_change":"2024-09-18T01:45:08.289806+0000","last_active":"2024-09-18T01:45:41.340511+0000","last_peered":"2024-09-18T01:45:41.340511+0000","last_clean":"2024-09-18T01:45:41.340511+0000","last_became_active":"2024-09-18T01:45:08.289521+0000","last_became_peered":"2024-09-18T01:45:08.289521+0000","last_unstale":"2024-09-18T01:45:41.340511+0000","last_undegraded":"2024-09-18T01:45:41.340511+0000","last_fullsized":"2024-09-18T01:45:41.340511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:54:13.237972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'52","reported_seq":113,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.553587+0000","last_change":"2024-09-18T01:45:10.307198+0000","last_active":"2024-09-18T01:48:19.553587+0000","last_peered":"2024-09-18T01:48:19.553587+0000","last_clean":"2024-09-18T01:48:19.553587+0000","last_became_active":"2024-09-18T01:45:10.306481+0000","last_became_peered":"2024-09-18T01:45:10.306481+0000","last_unstale":"2024-09-18T01:48:19.553587+0000","last_undegraded":"2024-09-18T01:48:19.553587+0000","last_fullsized":"2024-09-18T01:48:19.553587+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:26:59.982744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'285","reported_seq":350,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.424857+0000","last_change":"2024-09-18T01:45:12.313366+0000","last_active":"2024-09-18T01:48:19.424857+0000","last_peered":"2024-09-18T01:48:19.424857+0000","last_clean":"2024-09-18T01:48:19.424857+0000","last_became_active":"2024-09-18T01:45:12.313065+0000","last_became_peered":"2024-09-18T01:45:12.313065+0000","last_unstale":"2024-09-18T01:48:19.424857+0000","last_undegraded":"2024-09-18T01:48:19.424857+0000","last_fullsized":"2024-09-18T01:48:19.424857+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:22:43.654693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"33'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:09.007672+0000","last_change":"2024-09-18T01:45:14.320158+0000","last_active":"2024-09-18T01:47:09.007672+0000","last_peered":"2024-09-18T01:47:09.007672+0000","last_clean":"2024-09-18T01:47:09.007672+0000","last_became_active":"2024-09-18T01:45:14.319805+0000","last_became_peered":"2024-09-18T01:45:14.319805+0000","last_unstale":"2024-09-18T01:47:09.007672+0000","last_undegraded":"2024-09-18T01:47:09.007672+0000","last_fullsized":"2024-09-18T01:47:09.007672+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:14:33.982138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"33'10","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.846365+0000","last_change":"2024-09-18T01:45:06.282059+0000","last_active":"2024-09-18T01:48:12.846365+0000","last_peered":"2024-09-18T01:48:12.846365+0000","last_clean":"2024-09-18T01:48:12.846365+0000","last_became_active":"2024-09-18T01:45:06.281444+0000","last_became_peered":"2024-09-18T01:45:06.281444+0000","last_unstale":"2024-09-18T01:48:12.846365+0000","last_undegraded":"2024-09-18T01:48:12.846365+0000","last_fullsized":"2024-09-18T01:48:12.846365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:33:43.173746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.336364+0000","last_change":"2024-09-18T01:45:04.289841+0000","last_active":"2024-09-18T01:45:41.336364+0000","last_peered":"2024-09-18T01:45:41.336364+0000","last_clean":"2024-09-18T01:45:41.336364+0000","last_became_active":"2024-09-18T01:45:04.289216+0000","last_became_peered":"2024-09-18T01:45:04.289216+0000","last_unstale":"2024-09-18T01:45:41.336364+0000","last_undegraded":"2024-09-18T01:45:41.336364+0000","last_fullsized":"2024-09-18T01:45:41.336364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:06:46.722311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338235+0000","last_change":"2024-09-18T01:45:08.289975+0000","last_active":"2024-09-18T01:45:41.338235+0000","last_peered":"2024-09-18T01:45:41.338235+0000","last_clean":"2024-09-18T01:45:41.338235+0000","last_became_active":"2024-09-18T01:45:08.289725+0000","last_became_peered":"2024-09-18T01:45:08.289725+0000","last_unstale":"2024-09-18T01:45:41.338235+0000","last_undegraded":"2024-09-18T01:45:41.338235+0000","last_fullsized":"2024-09-18T01:45:41.338235+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:52:13.262244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"33'79","reported_seq":155,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.559139+0000","last_change":"2024-09-18T01:45:10.310077+0000","last_active":"2024-09-18T01:48:19.559139+0000","last_peered":"2024-09-18T01:48:19.559139+0000","last_clean":"2024-09-18T01:48:19.559139+0000","last_became_active":"2024-09-18T01:45:10.309360+0000","last_became_peered":"2024-09-18T01:45:10.309360+0000","last_unstale":"2024-09-18T01:48:19.559139+0000","last_undegraded":"2024-09-18T01:48:19.559139+0000","last_fullsized":"2024-09-18T01:48:19.559139+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:01:23.922671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5903,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":90,"num_read_kb":105,"num_write":42,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337356+0000","last_change":"2024-09-18T01:45:12.312912+0000","last_active":"2024-09-18T01:45:41.337356+0000","last_peered":"2024-09-18T01:45:41.337356+0000","last_clean":"2024-09-18T01:45:41.337356+0000","last_became_active":"2024-09-18T01:45:12.312665+0000","last_became_peered":"2024-09-18T01:45:12.312665+0000","last_unstale":"2024-09-18T01:45:41.337356+0000","last_undegraded":"2024-09-18T01:45:41.337356+0000","last_fullsized":"2024-09-18T01:45:41.337356+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:43:30.182833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'18","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.975756+0000","last_change":"2024-09-18T01:45:14.320179+0000","last_active":"2024-09-18T01:48:12.975756+0000","last_peered":"2024-09-18T01:48:12.975756+0000","last_clean":"2024-09-18T01:48:12.975756+0000","last_became_active":"2024-09-18T01:45:14.319638+0000","last_became_peered":"2024-09-18T01:45:14.319638+0000","last_unstale":"2024-09-18T01:48:12.975756+0000","last_undegraded":"2024-09-18T01:48:12.975756+0000","last_fullsized":"2024-09-18T01:48:12.975756+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:22:20.011207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:46:28.552953+0000","last_change":"2024-09-18T01:45:06.290368+0000","last_active":"2024-09-18T01:46:28.552953+0000","last_peered":"2024-09-18T01:46:28.552953+0000","last_clean":"2024-09-18T01:46:28.552953+0000","last_became_active":"2024-09-18T01:45:06.290087+0000","last_became_peered":"2024-09-18T01:45:06.290087+0000","last_unstale":"2024-09-18T01:46:28.552953+0000","last_undegraded":"2024-09-18T01:46:28.552953+0000","last_fullsized":"2024-09-18T01:46:28.552953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:25:24.068245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338514+0000","last_change":"2024-09-18T01:45:04.279319+0000","last_active":"2024-09-18T01:45:41.338514+0000","last_peered":"2024-09-18T01:45:41.338514+0000","last_clean":"2024-09-18T01:45:41.338514+0000","last_became_active":"2024-09-18T01:45:04.278979+0000","last_became_peered":"2024-09-18T01:45:04.278979+0000","last_unstale":"2024-09-18T01:45:41.338514+0000","last_undegraded":"2024-09-18T01:45:41.338514+0000","last_fullsized":"2024-09-18T01:45:41.338514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:21:29.013936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.334526+0000","last_change":"2024-09-18T01:45:08.292446+0000","last_active":"2024-09-18T01:45:41.334526+0000","last_peered":"2024-09-18T01:45:41.334526+0000","last_clean":"2024-09-18T01:45:41.334526+0000","last_became_active":"2024-09-18T01:45:08.292156+0000","last_became_peered":"2024-09-18T01:45:08.292156+0000","last_unstale":"2024-09-18T01:45:41.334526+0000","last_undegraded":"2024-09-18T01:45:41.334526+0000","last_fullsized":"2024-09-18T01:45:41.334526+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:03:59.192175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'41","reported_seq":94,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.500283+0000","last_change":"2024-09-18T01:45:10.300769+0000","last_active":"2024-09-18T01:48:19.500283+0000","last_peered":"2024-09-18T01:48:19.500283+0000","last_clean":"2024-09-18T01:48:19.500283+0000","last_became_active":"2024-09-18T01:45:10.300488+0000","last_became_peered":"2024-09-18T01:45:10.300488+0000","last_unstale":"2024-09-18T01:48:19.500283+0000","last_undegraded":"2024-09-18T01:48:19.500283+0000","last_fullsized":"2024-09-18T01:48:19.500283+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:55:38.390166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338499+0000","last_change":"2024-09-18T01:45:12.315977+0000","last_active":"2024-09-18T01:45:41.338499+0000","last_peered":"2024-09-18T01:45:41.338499+0000","last_clean":"2024-09-18T01:45:41.338499+0000","last_became_active":"2024-09-18T01:45:12.315695+0000","last_became_peered":"2024-09-18T01:45:12.315695+0000","last_unstale":"2024-09-18T01:45:41.338499+0000","last_undegraded":"2024-09-18T01:45:41.338499+0000","last_fullsized":"2024-09-18T01:45:41.338499+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:50:11.915634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"33'3","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:17.215042+0000","last_change":"2024-09-18T01:45:14.326486+0000","last_active":"2024-09-18T01:47:17.215042+0000","last_peered":"2024-09-18T01:47:17.215042+0000","last_clean":"2024-09-18T01:47:17.215042+0000","last_became_active":"2024-09-18T01:45:14.326209+0000","last_became_peered":"2024-09-18T01:45:14.326209+0000","last_unstale":"2024-09-18T01:47:17.215042+0000","last_undegraded":"2024-09-18T01:47:17.215042+0000","last_fullsized":"2024-09-18T01:47:17.215042+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:34:51.151050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.650286+0000","last_change":"2024-09-18T01:45:06.287753+0000","last_active":"2024-09-18T01:48:12.650286+0000","last_peered":"2024-09-18T01:48:12.650286+0000","last_clean":"2024-09-18T01:48:12.650286+0000","last_became_active":"2024-09-18T01:45:06.285771+0000","last_became_peered":"2024-09-18T01:45:06.285771+0000","last_unstale":"2024-09-18T01:48:12.650286+0000","last_undegraded":"2024-09-18T01:48:12.650286+0000","last_fullsized":"2024-09-18T01:48:12.650286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:17:37.283863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.489494+0000","last_change":"2024-09-18T01:45:04.287560+0000","last_active":"2024-09-18T01:48:19.489494+0000","last_peered":"2024-09-18T01:48:19.489494+0000","last_clean":"2024-09-18T01:48:19.489494+0000","last_became_active":"2024-09-18T01:45:04.287263+0000","last_became_peered":"2024-09-18T01:45:04.287263+0000","last_unstale":"2024-09-18T01:48:19.489494+0000","last_undegraded":"2024-09-18T01:48:19.489494+0000","last_fullsized":"2024-09-18T01:48:19.489494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:31:33.162869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338326+0000","last_change":"2024-09-18T01:45:08.289876+0000","last_active":"2024-09-18T01:45:41.338326+0000","last_peered":"2024-09-18T01:45:41.338326+0000","last_clean":"2024-09-18T01:45:41.338326+0000","last_became_active":"2024-09-18T01:45:08.289604+0000","last_became_peered":"2024-09-18T01:45:08.289604+0000","last_unstale":"2024-09-18T01:45:41.338326+0000","last_undegraded":"2024-09-18T01:45:41.338326+0000","last_fullsized":"2024-09-18T01:45:41.338326+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:31:10.969818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'40","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.467058+0000","last_change":"2024-09-18T01:45:10.297783+0000","last_active":"2024-09-18T01:48:19.467058+0000","last_peered":"2024-09-18T01:48:19.467058+0000","last_clean":"2024-09-18T01:48:19.467058+0000","last_became_active":"2024-09-18T01:45:10.297511+0000","last_became_peered":"2024-09-18T01:45:10.297511+0000","last_unstale":"2024-09-18T01:48:19.467058+0000","last_undegraded":"2024-09-18T01:48:19.467058+0000","last_fullsized":"2024-09-18T01:48:19.467058+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:31:01.665963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'285","reported_seq":405,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.419942+0000","last_change":"2024-09-18T01:45:12.315306+0000","last_active":"2024-09-18T01:48:19.419942+0000","last_peered":"2024-09-18T01:48:19.419942+0000","last_clean":"2024-09-18T01:48:19.419942+0000","last_became_active":"2024-09-18T01:45:12.314918+0000","last_became_peered":"2024-09-18T01:45:12.314918+0000","last_unstale":"2024-09-18T01:48:19.419942+0000","last_undegraded":"2024-09-18T01:48:19.419942+0000","last_fullsized":"2024-09-18T01:48:19.419942+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:48:31.572835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'12","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:22.214176+0000","last_change":"2024-09-18T01:45:14.319866+0000","last_active":"2024-09-18T01:47:22.214176+0000","last_peered":"2024-09-18T01:47:22.214176+0000","last_clean":"2024-09-18T01:47:22.214176+0000","last_became_active":"2024-09-18T01:45:14.319364+0000","last_became_peered":"2024-09-18T01:45:14.319364+0000","last_unstale":"2024-09-18T01:47:22.214176+0000","last_undegraded":"2024-09-18T01:47:22.214176+0000","last_fullsized":"2024-09-18T01:47:22.214176+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:15:20.848541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.171328+0000","last_change":"2024-09-18T01:45:06.291329+0000","last_active":"2024-09-18T01:47:12.171328+0000","last_peered":"2024-09-18T01:47:12.171328+0000","last_clean":"2024-09-18T01:47:12.171328+0000","last_became_active":"2024-09-18T01:45:06.291023+0000","last_became_peered":"2024-09-18T01:45:06.291023+0000","last_unstale":"2024-09-18T01:47:12.171328+0000","last_undegraded":"2024-09-18T01:47:12.171328+0000","last_fullsized":"2024-09-18T01:47:12.171328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:45:59.773285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:08.999758+0000","last_change":"2024-09-18T01:45:04.294066+0000","last_active":"2024-09-18T01:47:08.999758+0000","last_peered":"2024-09-18T01:47:08.999758+0000","last_clean":"2024-09-18T01:47:08.999758+0000","last_became_active":"2024-09-18T01:45:04.288386+0000","last_became_peered":"2024-09-18T01:45:04.288386+0000","last_unstale":"2024-09-18T01:47:08.999758+0000","last_undegraded":"2024-09-18T01:47:08.999758+0000","last_fullsized":"2024-09-18T01:47:08.999758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:48:15.254246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'3","reported_seq":417,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.401352+0000","last_change":"2024-09-18T01:45:08.290260+0000","last_active":"2024-09-18T01:48:19.401352+0000","last_peered":"2024-09-18T01:48:19.401352+0000","last_clean":"2024-09-18T01:48:19.401352+0000","last_became_active":"2024-09-18T01:45:08.289478+0000","last_became_peered":"2024-09-18T01:45:08.289478+0000","last_unstale":"2024-09-18T01:48:19.401352+0000","last_undegraded":"2024-09-18T01:48:19.401352+0000","last_fullsized":"2024-09-18T01:48:19.401352+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:51:28.759649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'11","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:27.217179+0000","last_change":"2024-09-18T01:45:10.307653+0000","last_active":"2024-09-18T01:47:27.217179+0000","last_peered":"2024-09-18T01:47:27.217179+0000","last_clean":"2024-09-18T01:47:27.217179+0000","last_became_active":"2024-09-18T01:45:10.307374+0000","last_became_peered":"2024-09-18T01:45:10.307374+0000","last_unstale":"2024-09-18T01:47:27.217179+0000","last_undegraded":"2024-09-18T01:47:27.217179+0000","last_fullsized":"2024-09-18T01:47:27.217179+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:33:37.464748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'285","reported_seq":467,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.421361+0000","last_change":"2024-09-18T01:45:12.312200+0000","last_active":"2024-09-18T01:48:19.421361+0000","last_peered":"2024-09-18T01:48:19.421361+0000","last_clean":"2024-09-18T01:48:19.421361+0000","last_became_active":"2024-09-18T01:45:12.311929+0000","last_became_peered":"2024-09-18T01:45:12.311929+0000","last_unstale":"2024-09-18T01:48:19.421361+0000","last_undegraded":"2024-09-18T01:48:19.421361+0000","last_fullsized":"2024-09-18T01:48:19.421361+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:13:37.683828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"33'6","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.168494+0000","last_change":"2024-09-18T01:45:14.318697+0000","last_active":"2024-09-18T01:47:12.168494+0000","last_peered":"2024-09-18T01:47:12.168494+0000","last_clean":"2024-09-18T01:47:12.168494+0000","last_became_active":"2024-09-18T01:45:14.318418+0000","last_became_peered":"2024-09-18T01:45:14.318418+0000","last_unstale":"2024-09-18T01:47:12.168494+0000","last_undegraded":"2024-09-18T01:47:12.168494+0000","last_fullsized":"2024-09-18T01:47:12.168494+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:24:51.317832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"31'4","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.339105+0000","last_change":"2024-09-18T01:45:06.297190+0000","last_active":"2024-09-18T01:45:41.339105+0000","last_peered":"2024-09-18T01:45:41.339105+0000","last_clean":"2024-09-18T01:45:41.339105+0000","last_became_active":"2024-09-18T01:45:06.296824+0000","last_became_peered":"2024-09-18T01:45:06.296824+0000","last_unstale":"2024-09-18T01:45:41.339105+0000","last_undegraded":"2024-09-18T01:45:41.339105+0000","last_fullsized":"2024-09-18T01:45:41.339105+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:26:58.808939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.787112+0000","last_change":"2024-09-18T01:45:04.288364+0000","last_active":"2024-09-18T01:48:12.787112+0000","last_peered":"2024-09-18T01:48:12.787112+0000","last_clean":"2024-09-18T01:48:12.787112+0000","last_became_active":"2024-09-18T01:45:04.287961+0000","last_became_peered":"2024-09-18T01:45:04.287961+0000","last_unstale":"2024-09-18T01:48:12.787112+0000","last_undegraded":"2024-09-18T01:48:12.787112+0000","last_fullsized":"2024-09-18T01:48:12.787112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:15:46.315415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338600+0000","last_change":"2024-09-18T01:45:08.294326+0000","last_active":"2024-09-18T01:45:41.338600+0000","last_peered":"2024-09-18T01:45:41.338600+0000","last_clean":"2024-09-18T01:45:41.338600+0000","last_became_active":"2024-09-18T01:45:08.294053+0000","last_became_peered":"2024-09-18T01:45:08.294053+0000","last_unstale":"2024-09-18T01:45:41.338600+0000","last_undegraded":"2024-09-18T01:45:41.338600+0000","last_fullsized":"2024-09-18T01:45:41.338600+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:42:25.537610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'42","reported_seq":92,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.538706+0000","last_change":"2024-09-18T01:45:10.300689+0000","last_active":"2024-09-18T01:48:19.538706+0000","last_peered":"2024-09-18T01:48:19.538706+0000","last_clean":"2024-09-18T01:48:19.538706+0000","last_became_active":"2024-09-18T01:45:10.300337+0000","last_became_peered":"2024-09-18T01:45:10.300337+0000","last_unstale":"2024-09-18T01:48:19.538706+0000","last_undegraded":"2024-09-18T01:48:19.538706+0000","last_fullsized":"2024-09-18T01:48:19.538706+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:15:11.668593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.332973+0000","last_change":"2024-09-18T01:45:12.307499+0000","last_active":"2024-09-18T01:45:41.332973+0000","last_peered":"2024-09-18T01:45:41.332973+0000","last_clean":"2024-09-18T01:45:41.332973+0000","last_became_active":"2024-09-18T01:45:12.307210+0000","last_became_peered":"2024-09-18T01:45:12.307210+0000","last_unstale":"2024-09-18T01:45:41.332973+0000","last_undegraded":"2024-09-18T01:45:41.332973+0000","last_fullsized":"2024-09-18T01:45:41.332973+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:15:13.680117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'6","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.909454+0000","last_change":"2024-09-18T01:45:14.315742+0000","last_active":"2024-09-18T01:48:12.909454+0000","last_peered":"2024-09-18T01:48:12.909454+0000","last_clean":"2024-09-18T01:48:12.909454+0000","last_became_active":"2024-09-18T01:45:14.314786+0000","last_became_peered":"2024-09-18T01:45:14.314786+0000","last_unstale":"2024-09-18T01:48:12.909454+0000","last_undegraded":"2024-09-18T01:48:12.909454+0000","last_fullsized":"2024-09-18T01:48:12.909454+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:32:55.619756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.559013+0000","last_change":"2024-09-18T01:45:06.287377+0000","last_active":"2024-09-18T01:48:12.559013+0000","last_peered":"2024-09-18T01:48:12.559013+0000","last_clean":"2024-09-18T01:48:12.559013+0000","last_became_active":"2024-09-18T01:45:06.286138+0000","last_became_peered":"2024-09-18T01:45:06.286138+0000","last_unstale":"2024-09-18T01:48:12.559013+0000","last_undegraded":"2024-09-18T01:48:12.559013+0000","last_fullsized":"2024-09-18T01:48:12.559013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:40:06.654394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":205,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.332689+0000","last_change":"2024-09-18T01:44:49.573399+0000","last_active":"2024-09-18T01:45:41.332689+0000","last_peered":"2024-09-18T01:45:41.332689+0000","last_clean":"2024-09-18T01:45:41.332689+0000","last_became_active":"2024-09-18T01:44:49.572263+0000","last_became_peered":"2024-09-18T01:44:49.572263+0000","last_unstale":"2024-09-18T01:45:41.332689+0000","last_undegraded":"2024-09-18T01:45:41.332689+0000","last_fullsized":"2024-09-18T01:45:41.332689+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:48.210722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:48.210722+0000","last_clean_scrub_stamp":"2024-09-18T01:44:48.210722+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:56:09.389853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.336772+0000","last_change":"2024-09-18T01:44:55.241426+0000","last_active":"2024-09-18T01:45:41.336772+0000","last_peered":"2024-09-18T01:45:41.336772+0000","last_clean":"2024-09-18T01:45:41.336772+0000","last_became_active":"2024-09-18T01:44:53.233974+0000","last_became_peered":"2024-09-18T01:44:53.233974+0000","last_unstale":"2024-09-18T01:45:41.336772+0000","last_undegraded":"2024-09-18T01:45:41.336772+0000","last_fullsized":"2024-09-18T01:45:41.336772+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:12:59.234293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045237700000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:44.957536+0000","last_change":"2024-09-18T01:45:04.289472+0000","last_active":"2024-09-18T01:45:44.957536+0000","last_peered":"2024-09-18T01:45:44.957536+0000","last_clean":"2024-09-18T01:45:44.957536+0000","last_became_active":"2024-09-18T01:45:04.287763+0000","last_became_peered":"2024-09-18T01:45:04.287763+0000","last_unstale":"2024-09-18T01:45:44.957536+0000","last_undegraded":"2024-09-18T01:45:44.957536+0000","last_fullsized":"2024-09-18T01:45:44.957536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:36:04.953932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.336778+0000","last_change":"2024-09-18T01:45:08.288736+0000","last_active":"2024-09-18T01:45:41.336778+0000","last_peered":"2024-09-18T01:45:41.336778+0000","last_clean":"2024-09-18T01:45:41.336778+0000","last_became_active":"2024-09-18T01:45:08.288131+0000","last_became_peered":"2024-09-18T01:45:08.288131+0000","last_unstale":"2024-09-18T01:45:41.336778+0000","last_undegraded":"2024-09-18T01:45:41.336778+0000","last_fullsized":"2024-09-18T01:45:41.336778+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:21:35.087556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'92","reported_seq":179,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.571916+0000","last_change":"2024-09-18T01:45:10.305269+0000","last_active":"2024-09-18T01:48:19.571916+0000","last_peered":"2024-09-18T01:48:19.571916+0000","last_clean":"2024-09-18T01:48:19.571916+0000","last_became_active":"2024-09-18T01:45:10.305004+0000","last_became_peered":"2024-09-18T01:45:10.305004+0000","last_unstale":"2024-09-18T01:48:19.571916+0000","last_undegraded":"2024-09-18T01:48:19.571916+0000","last_fullsized":"2024-09-18T01:48:19.571916+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:34:39.601409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":81,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.339055+0000","last_change":"2024-09-18T01:45:12.311683+0000","last_active":"2024-09-18T01:45:41.339055+0000","last_peered":"2024-09-18T01:45:41.339055+0000","last_clean":"2024-09-18T01:45:41.339055+0000","last_became_active":"2024-09-18T01:45:12.311337+0000","last_became_peered":"2024-09-18T01:45:12.311337+0000","last_unstale":"2024-09-18T01:45:41.339055+0000","last_undegraded":"2024-09-18T01:45:41.339055+0000","last_fullsized":"2024-09-18T01:45:41.339055+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:36:33.811124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'81","reported_seq":162,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.883680+0000","last_change":"2024-09-18T01:45:14.315079+0000","last_active":"2024-09-18T01:48:12.883680+0000","last_peered":"2024-09-18T01:48:12.883680+0000","last_clean":"2024-09-18T01:48:12.883680+0000","last_became_active":"2024-09-18T01:45:14.314784+0000","last_became_peered":"2024-09-18T01:45:14.314784+0000","last_unstale":"2024-09-18T01:48:12.883680+0000","last_undegraded":"2024-09-18T01:48:12.883680+0000","last_fullsized":"2024-09-18T01:48:12.883680+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:27:35.990001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'4","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:46:28.550502+0000","last_change":"2024-09-18T01:45:41.350104+0000","last_active":"2024-09-18T01:46:28.550502+0000","last_peered":"2024-09-18T01:46:28.550502+0000","last_clean":"2024-09-18T01:46:28.550502+0000","last_became_active":"2024-09-18T01:45:41.338925+0000","last_became_peered":"2024-09-18T01:45:41.338925+0000","last_unstale":"2024-09-18T01:46:28.550502+0000","last_undegraded":"2024-09-18T01:46:28.550502+0000","last_fullsized":"2024-09-18T01:46:28.550502+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:28:46.190605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.333768+0000","last_change":"2024-09-18T01:44:55.242126+0000","last_active":"2024-09-18T01:45:41.333768+0000","last_peered":"2024-09-18T01:45:41.333768+0000","last_clean":"2024-09-18T01:45:41.333768+0000","last_became_active":"2024-09-18T01:44:53.237059+0000","last_became_peered":"2024-09-18T01:44:53.237059+0000","last_unstale":"2024-09-18T01:45:41.333768+0000","last_undegraded":"2024-09-18T01:45:41.333768+0000","last_fullsized":"2024-09-18T01:45:41.333768+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:32:06.823521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011095359999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337449+0000","last_change":"2024-09-18T01:45:04.273879+0000","last_active":"2024-09-18T01:45:41.337449+0000","last_peered":"2024-09-18T01:45:41.337449+0000","last_clean":"2024-09-18T01:45:41.337449+0000","last_became_active":"2024-09-18T01:45:04.273354+0000","last_became_peered":"2024-09-18T01:45:04.273354+0000","last_unstale":"2024-09-18T01:45:41.337449+0000","last_undegraded":"2024-09-18T01:45:41.337449+0000","last_fullsized":"2024-09-18T01:45:41.337449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:31:48.524360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.341234+0000","last_change":"2024-09-18T01:45:08.292027+0000","last_active":"2024-09-18T01:45:41.341234+0000","last_peered":"2024-09-18T01:45:41.341234+0000","last_clean":"2024-09-18T01:45:41.341234+0000","last_became_active":"2024-09-18T01:45:08.291681+0000","last_became_peered":"2024-09-18T01:45:08.291681+0000","last_unstale":"2024-09-18T01:45:41.341234+0000","last_undegraded":"2024-09-18T01:45:41.341234+0000","last_fullsized":"2024-09-18T01:45:41.341234+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:28:11.601390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'290","reported_seq":511,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.542526+0000","last_change":"2024-09-18T01:45:10.305791+0000","last_active":"2024-09-18T01:48:19.542526+0000","last_peered":"2024-09-18T01:48:19.542526+0000","last_clean":"2024-09-18T01:48:19.542526+0000","last_became_active":"2024-09-18T01:45:10.305472+0000","last_became_peered":"2024-09-18T01:45:10.305472+0000","last_unstale":"2024-09-18T01:48:19.542526+0000","last_undegraded":"2024-09-18T01:48:19.542526+0000","last_fullsized":"2024-09-18T01:48:19.542526+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:57:05.219798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":387,"num_read_kb":371,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337053+0000","last_change":"2024-09-18T01:45:12.316867+0000","last_active":"2024-09-18T01:45:41.337053+0000","last_peered":"2024-09-18T01:45:41.337053+0000","last_clean":"2024-09-18T01:45:41.337053+0000","last_became_active":"2024-09-18T01:45:12.316110+0000","last_became_peered":"2024-09-18T01:45:12.316110+0000","last_unstale":"2024-09-18T01:45:41.337053+0000","last_undegraded":"2024-09-18T01:45:41.337053+0000","last_fullsized":"2024-09-18T01:45:41.337053+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:17:14.152691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'5","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:46:28.548072+0000","last_change":"2024-09-18T01:45:14.323262+0000","last_active":"2024-09-18T01:46:28.548072+0000","last_peered":"2024-09-18T01:46:28.548072+0000","last_clean":"2024-09-18T01:46:28.548072+0000","last_became_active":"2024-09-18T01:45:14.322986+0000","last_became_peered":"2024-09-18T01:45:14.322986+0000","last_unstale":"2024-09-18T01:46:28.548072+0000","last_undegraded":"2024-09-18T01:46:28.548072+0000","last_fullsized":"2024-09-18T01:46:28.548072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:04:51.734530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'8","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.840339+0000","last_change":"2024-09-18T01:45:06.293300+0000","last_active":"2024-09-18T01:48:12.840339+0000","last_peered":"2024-09-18T01:48:12.840339+0000","last_clean":"2024-09-18T01:48:12.840339+0000","last_became_active":"2024-09-18T01:45:06.292996+0000","last_became_peered":"2024-09-18T01:45:06.292996+0000","last_unstale":"2024-09-18T01:48:12.840339+0000","last_undegraded":"2024-09-18T01:48:12.840339+0000","last_fullsized":"2024-09-18T01:48:12.840339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:06:48.729806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.331452+0000","last_change":"2024-09-18T01:44:55.620700+0000","last_active":"2024-09-18T01:45:41.331452+0000","last_peered":"2024-09-18T01:45:41.331452+0000","last_clean":"2024-09-18T01:45:41.331452+0000","last_became_active":"2024-09-18T01:44:53.237016+0000","last_became_peered":"2024-09-18T01:44:53.237016+0000","last_unstale":"2024-09-18T01:45:41.331452+0000","last_undegraded":"2024-09-18T01:45:41.331452+0000","last_fullsized":"2024-09-18T01:45:41.331452+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:36:02.583348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039942899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.777626+0000","last_change":"2024-09-18T01:45:04.284372+0000","last_active":"2024-09-18T01:48:12.777626+0000","last_peered":"2024-09-18T01:48:12.777626+0000","last_clean":"2024-09-18T01:48:12.777626+0000","last_became_active":"2024-09-18T01:45:04.283999+0000","last_became_peered":"2024-09-18T01:45:04.283999+0000","last_unstale":"2024-09-18T01:48:12.777626+0000","last_undegraded":"2024-09-18T01:48:12.777626+0000","last_fullsized":"2024-09-18T01:48:12.777626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:16:49.444181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"24'2","reported_seq":221,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.391818+0000","last_change":"2024-09-18T01:45:08.284516+0000","last_active":"2024-09-18T01:48:19.391818+0000","last_peered":"2024-09-18T01:48:19.391818+0000","last_clean":"2024-09-18T01:48:19.391818+0000","last_became_active":"2024-09-18T01:45:08.284186+0000","last_became_peered":"2024-09-18T01:45:08.284186+0000","last_unstale":"2024-09-18T01:48:19.391818+0000","last_undegraded":"2024-09-18T01:48:19.391818+0000","last_fullsized":"2024-09-18T01:48:19.391818+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:52:16.095961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'17","reported_seq":84,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.882505+0000","last_change":"2024-09-18T01:45:10.296574+0000","last_active":"2024-09-18T01:48:12.882505+0000","last_peered":"2024-09-18T01:48:12.882505+0000","last_clean":"2024-09-18T01:48:12.882505+0000","last_became_active":"2024-09-18T01:45:10.296284+0000","last_became_peered":"2024-09-18T01:45:10.296284+0000","last_unstale":"2024-09-18T01:48:12.882505+0000","last_undegraded":"2024-09-18T01:48:12.882505+0000","last_fullsized":"2024-09-18T01:48:12.882505+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:58:02.549052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.339121+0000","last_change":"2024-09-18T01:45:12.311612+0000","last_active":"2024-09-18T01:45:41.339121+0000","last_peered":"2024-09-18T01:45:41.339121+0000","last_clean":"2024-09-18T01:45:41.339121+0000","last_became_active":"2024-09-18T01:45:12.311266+0000","last_became_peered":"2024-09-18T01:45:12.311266+0000","last_unstale":"2024-09-18T01:45:41.339121+0000","last_undegraded":"2024-09-18T01:45:41.339121+0000","last_fullsized":"2024-09-18T01:45:41.339121+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:33:04.342308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"33'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:45.861093+0000","last_change":"2024-09-18T01:45:14.318619+0000","last_active":"2024-09-18T01:45:45.861093+0000","last_peered":"2024-09-18T01:45:45.861093+0000","last_clean":"2024-09-18T01:45:45.861093+0000","last_became_active":"2024-09-18T01:45:14.318346+0000","last_became_peered":"2024-09-18T01:45:14.318346+0000","last_unstale":"2024-09-18T01:45:45.861093+0000","last_undegraded":"2024-09-18T01:45:45.861093+0000","last_fullsized":"2024-09-18T01:45:45.861093+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:29:28.994596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.871160+0000","last_change":"2024-09-18T01:45:06.282530+0000","last_active":"2024-09-18T01:48:12.871160+0000","last_peered":"2024-09-18T01:48:12.871160+0000","last_clean":"2024-09-18T01:48:12.871160+0000","last_became_active":"2024-09-18T01:45:06.282319+0000","last_became_peered":"2024-09-18T01:45:06.282319+0000","last_unstale":"2024-09-18T01:48:12.871160+0000","last_undegraded":"2024-09-18T01:48:12.871160+0000","last_fullsized":"2024-09-18T01:48:12.871160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:15:48.322910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.335732+0000","last_change":"2024-09-18T01:44:55.242065+0000","last_active":"2024-09-18T01:45:41.335732+0000","last_peered":"2024-09-18T01:45:41.335732+0000","last_clean":"2024-09-18T01:45:41.335732+0000","last_became_active":"2024-09-18T01:44:53.236990+0000","last_became_peered":"2024-09-18T01:44:53.236990+0000","last_unstale":"2024-09-18T01:45:41.335732+0000","last_undegraded":"2024-09-18T01:45:41.335732+0000","last_fullsized":"2024-09-18T01:45:41.335732+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:45:10.092337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001062627,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.332308+0000","last_change":"2024-09-18T01:45:04.293371+0000","last_active":"2024-09-18T01:45:41.332308+0000","last_peered":"2024-09-18T01:45:41.332308+0000","last_clean":"2024-09-18T01:45:41.332308+0000","last_became_active":"2024-09-18T01:45:04.293064+0000","last_became_peered":"2024-09-18T01:45:04.293064+0000","last_unstale":"2024-09-18T01:45:41.332308+0000","last_undegraded":"2024-09-18T01:45:41.332308+0000","last_fullsized":"2024-09-18T01:45:41.332308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:59:04.808153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.339566+0000","last_change":"2024-09-18T01:45:08.292781+0000","last_active":"2024-09-18T01:45:41.339566+0000","last_peered":"2024-09-18T01:45:41.339566+0000","last_clean":"2024-09-18T01:45:41.339566+0000","last_became_active":"2024-09-18T01:45:08.292477+0000","last_became_peered":"2024-09-18T01:45:08.292477+0000","last_unstale":"2024-09-18T01:45:41.339566+0000","last_undegraded":"2024-09-18T01:45:41.339566+0000","last_fullsized":"2024-09-18T01:45:41.339566+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:39:02.381373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'13","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.186836+0000","last_change":"2024-09-18T01:45:10.308357+0000","last_active":"2024-09-18T01:48:12.186836+0000","last_peered":"2024-09-18T01:48:12.186836+0000","last_clean":"2024-09-18T01:48:12.186836+0000","last_became_active":"2024-09-18T01:45:10.308018+0000","last_became_peered":"2024-09-18T01:45:10.308018+0000","last_unstale":"2024-09-18T01:48:12.186836+0000","last_undegraded":"2024-09-18T01:48:12.186836+0000","last_fullsized":"2024-09-18T01:48:12.186836+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:40:04.662960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338954+0000","last_change":"2024-09-18T01:45:12.315614+0000","last_active":"2024-09-18T01:45:41.338954+0000","last_peered":"2024-09-18T01:45:41.338954+0000","last_clean":"2024-09-18T01:45:41.338954+0000","last_became_active":"2024-09-18T01:45:12.315342+0000","last_became_peered":"2024-09-18T01:45:12.315342+0000","last_unstale":"2024-09-18T01:45:41.338954+0000","last_undegraded":"2024-09-18T01:45:41.338954+0000","last_fullsized":"2024-09-18T01:45:41.338954+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:11:58.173898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"33'6","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.842041+0000","last_change":"2024-09-18T01:45:14.323182+0000","last_active":"2024-09-18T01:48:12.842041+0000","last_peered":"2024-09-18T01:48:12.842041+0000","last_clean":"2024-09-18T01:48:12.842041+0000","last_became_active":"2024-09-18T01:45:14.322568+0000","last_became_peered":"2024-09-18T01:45:14.322568+0000","last_unstale":"2024-09-18T01:48:12.842041+0000","last_undegraded":"2024-09-18T01:48:12.842041+0000","last_fullsized":"2024-09-18T01:48:12.842041+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:58:43.947177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'14","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.840650+0000","last_change":"2024-09-18T01:45:06.292050+0000","last_active":"2024-09-18T01:48:12.840650+0000","last_peered":"2024-09-18T01:48:12.840650+0000","last_clean":"2024-09-18T01:48:12.840650+0000","last_became_active":"2024-09-18T01:45:06.291792+0000","last_became_peered":"2024-09-18T01:45:06.291792+0000","last_unstale":"2024-09-18T01:48:12.840650+0000","last_undegraded":"2024-09-18T01:48:12.840650+0000","last_fullsized":"2024-09-18T01:48:12.840650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:57:38.152681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"31'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.332634+0000","last_change":"2024-09-18T01:45:04.291510+0000","last_active":"2024-09-18T01:45:41.332634+0000","last_peered":"2024-09-18T01:45:41.332634+0000","last_clean":"2024-09-18T01:45:41.332634+0000","last_became_active":"2024-09-18T01:45:04.291211+0000","last_became_peered":"2024-09-18T01:45:04.291211+0000","last_unstale":"2024-09-18T01:45:41.332634+0000","last_undegraded":"2024-09-18T01:45:41.332634+0000","last_fullsized":"2024-09-18T01:45:41.332634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:16:49.444181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338599+0000","last_change":"2024-09-18T01:44:55.234985+0000","last_active":"2024-09-18T01:45:41.338599+0000","last_peered":"2024-09-18T01:45:41.338599+0000","last_clean":"2024-09-18T01:45:41.338599+0000","last_became_active":"2024-09-18T01:44:53.234966+0000","last_became_peered":"2024-09-18T01:44:53.234966+0000","last_unstale":"2024-09-18T01:45:41.338599+0000","last_undegraded":"2024-09-18T01:45:41.338599+0000","last_fullsized":"2024-09-18T01:45:41.338599+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:30:53.728764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045990099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"33'1","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.997431+0000","last_change":"2024-09-18T01:45:08.286575+0000","last_active":"2024-09-18T01:48:12.997431+0000","last_peered":"2024-09-18T01:48:12.997431+0000","last_clean":"2024-09-18T01:48:12.997431+0000","last_became_active":"2024-09-18T01:45:08.286195+0000","last_became_peered":"2024-09-18T01:45:08.286195+0000","last_unstale":"2024-09-18T01:48:12.997431+0000","last_undegraded":"2024-09-18T01:48:12.997431+0000","last_fullsized":"2024-09-18T01:48:12.997431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:39:08.126512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'79","reported_seq":158,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.522894+0000","last_change":"2024-09-18T01:45:10.306220+0000","last_active":"2024-09-18T01:48:19.522894+0000","last_peered":"2024-09-18T01:48:19.522894+0000","last_clean":"2024-09-18T01:48:19.522894+0000","last_became_active":"2024-09-18T01:45:10.305948+0000","last_became_peered":"2024-09-18T01:45:10.305948+0000","last_unstale":"2024-09-18T01:48:19.522894+0000","last_undegraded":"2024-09-18T01:48:19.522894+0000","last_fullsized":"2024-09-18T01:48:19.522894+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:03:14.568657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":89,"num_read_kb":75,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.332043+0000","last_change":"2024-09-18T01:45:12.312116+0000","last_active":"2024-09-18T01:45:41.332043+0000","last_peered":"2024-09-18T01:45:41.332043+0000","last_clean":"2024-09-18T01:45:41.332043+0000","last_became_active":"2024-09-18T01:45:12.311862+0000","last_became_peered":"2024-09-18T01:45:12.311862+0000","last_unstale":"2024-09-18T01:45:41.332043+0000","last_undegraded":"2024-09-18T01:45:41.332043+0000","last_fullsized":"2024-09-18T01:45:41.332043+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:17:48.507658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'13","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.101245+0000","last_change":"2024-09-18T01:45:14.311691+0000","last_active":"2024-09-18T01:47:12.101245+0000","last_peered":"2024-09-18T01:47:12.101245+0000","last_clean":"2024-09-18T01:47:12.101245+0000","last_became_active":"2024-09-18T01:45:14.311403+0000","last_became_peered":"2024-09-18T01:45:14.311403+0000","last_unstale":"2024-09-18T01:47:12.101245+0000","last_undegraded":"2024-09-18T01:47:12.101245+0000","last_fullsized":"2024-09-18T01:47:12.101245+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:47:25.981905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.336217+0000","last_change":"2024-09-18T01:45:06.292173+0000","last_active":"2024-09-18T01:45:41.336217+0000","last_peered":"2024-09-18T01:45:41.336217+0000","last_clean":"2024-09-18T01:45:41.336217+0000","last_became_active":"2024-09-18T01:45:06.291845+0000","last_became_peered":"2024-09-18T01:45:06.291845+0000","last_unstale":"2024-09-18T01:45:41.336217+0000","last_undegraded":"2024-09-18T01:45:41.336217+0000","last_fullsized":"2024-09-18T01:45:41.336217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:06:48.729806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.339145+0000","last_change":"2024-09-18T01:45:04.273877+0000","last_active":"2024-09-18T01:45:41.339145+0000","last_peered":"2024-09-18T01:45:41.339145+0000","last_clean":"2024-09-18T01:45:41.339145+0000","last_became_active":"2024-09-18T01:45:04.273385+0000","last_became_peered":"2024-09-18T01:45:04.273385+0000","last_unstale":"2024-09-18T01:45:41.339145+0000","last_undegraded":"2024-09-18T01:45:41.339145+0000","last_fullsized":"2024-09-18T01:45:41.339145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:05:10.699920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.339297+0000","last_change":"2024-09-18T01:44:55.242318+0000","last_active":"2024-09-18T01:45:41.339297+0000","last_peered":"2024-09-18T01:45:41.339297+0000","last_clean":"2024-09-18T01:45:41.339297+0000","last_became_active":"2024-09-18T01:44:53.236927+0000","last_became_peered":"2024-09-18T01:44:53.236927+0000","last_unstale":"2024-09-18T01:45:41.339297+0000","last_undegraded":"2024-09-18T01:45:41.339297+0000","last_fullsized":"2024-09-18T01:45:41.339297+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:52:39.601060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00130324,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337750+0000","last_change":"2024-09-18T01:45:08.296862+0000","last_active":"2024-09-18T01:45:41.337750+0000","last_peered":"2024-09-18T01:45:41.337750+0000","last_clean":"2024-09-18T01:45:41.337750+0000","last_became_active":"2024-09-18T01:45:08.296118+0000","last_became_peered":"2024-09-18T01:45:08.296118+0000","last_unstale":"2024-09-18T01:45:41.337750+0000","last_undegraded":"2024-09-18T01:45:41.337750+0000","last_fullsized":"2024-09-18T01:45:41.337750+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:18:22.945844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"31'20","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.333610+0000","last_change":"2024-09-18T01:45:10.306223+0000","last_active":"2024-09-18T01:45:41.333610+0000","last_peered":"2024-09-18T01:45:41.333610+0000","last_clean":"2024-09-18T01:45:41.333610+0000","last_became_active":"2024-09-18T01:45:10.305932+0000","last_became_peered":"2024-09-18T01:45:10.305932+0000","last_unstale":"2024-09-18T01:45:41.333610+0000","last_undegraded":"2024-09-18T01:45:41.333610+0000","last_fullsized":"2024-09-18T01:45:41.333610+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:02:58.015323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'285","reported_seq":357,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.417464+0000","last_change":"2024-09-18T01:45:12.312362+0000","last_active":"2024-09-18T01:48:19.417464+0000","last_peered":"2024-09-18T01:48:19.417464+0000","last_clean":"2024-09-18T01:48:19.417464+0000","last_became_active":"2024-09-18T01:45:12.312117+0000","last_became_peered":"2024-09-18T01:45:12.312117+0000","last_unstale":"2024-09-18T01:48:19.417464+0000","last_undegraded":"2024-09-18T01:48:19.417464+0000","last_fullsized":"2024-09-18T01:48:19.417464+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:31:43.441229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"33'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.829026+0000","last_change":"2024-09-18T01:45:14.322374+0000","last_active":"2024-09-18T01:48:12.829026+0000","last_peered":"2024-09-18T01:48:12.829026+0000","last_clean":"2024-09-18T01:48:12.829026+0000","last_became_active":"2024-09-18T01:45:14.322078+0000","last_became_peered":"2024-09-18T01:45:14.322078+0000","last_unstale":"2024-09-18T01:48:12.829026+0000","last_undegraded":"2024-09-18T01:48:12.829026+0000","last_fullsized":"2024-09-18T01:48:12.829026+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:07:46.272021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.793475+0000","last_change":"2024-09-18T01:45:06.297948+0000","last_active":"2024-09-18T01:48:12.793475+0000","last_peered":"2024-09-18T01:48:12.793475+0000","last_clean":"2024-09-18T01:48:12.793475+0000","last_became_active":"2024-09-18T01:45:06.297660+0000","last_became_peered":"2024-09-18T01:45:06.297660+0000","last_unstale":"2024-09-18T01:48:12.793475+0000","last_undegraded":"2024-09-18T01:48:12.793475+0000","last_fullsized":"2024-09-18T01:48:12.793475+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:37:23.667201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.341134+0000","last_change":"2024-09-18T01:45:04.294211+0000","last_active":"2024-09-18T01:45:41.341134+0000","last_peered":"2024-09-18T01:45:41.341134+0000","last_clean":"2024-09-18T01:45:41.341134+0000","last_became_active":"2024-09-18T01:45:04.288189+0000","last_became_peered":"2024-09-18T01:45:04.288189+0000","last_unstale":"2024-09-18T01:45:41.341134+0000","last_undegraded":"2024-09-18T01:45:41.341134+0000","last_fullsized":"2024-09-18T01:45:41.341134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:20:01.448189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.339254+0000","last_change":"2024-09-18T01:44:55.234985+0000","last_active":"2024-09-18T01:45:41.339254+0000","last_peered":"2024-09-18T01:45:41.339254+0000","last_clean":"2024-09-18T01:45:41.339254+0000","last_became_active":"2024-09-18T01:44:53.236812+0000","last_became_peered":"2024-09-18T01:44:53.236812+0000","last_unstale":"2024-09-18T01:45:41.339254+0000","last_undegraded":"2024-09-18T01:45:41.339254+0000","last_fullsized":"2024-09-18T01:45:41.339254+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:54:16.245255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044136000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.336209+0000","last_change":"2024-09-18T01:45:08.296449+0000","last_active":"2024-09-18T01:45:41.336209+0000","last_peered":"2024-09-18T01:45:41.336209+0000","last_clean":"2024-09-18T01:45:41.336209+0000","last_became_active":"2024-09-18T01:45:08.296102+0000","last_became_peered":"2024-09-18T01:45:08.296102+0000","last_unstale":"2024-09-18T01:45:41.336209+0000","last_undegraded":"2024-09-18T01:45:41.336209+0000","last_fullsized":"2024-09-18T01:45:41.336209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:40:32.625197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"31'16","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338569+0000","last_change":"2024-09-18T01:45:10.309071+0000","last_active":"2024-09-18T01:45:41.338569+0000","last_peered":"2024-09-18T01:45:41.338569+0000","last_clean":"2024-09-18T01:45:41.338569+0000","last_became_active":"2024-09-18T01:45:10.308451+0000","last_became_peered":"2024-09-18T01:45:10.308451+0000","last_unstale":"2024-09-18T01:45:41.338569+0000","last_undegraded":"2024-09-18T01:45:41.338569+0000","last_fullsized":"2024-09-18T01:45:41.338569+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:28:14.753920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'285","reported_seq":431,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.422498+0000","last_change":"2024-09-18T01:45:12.314218+0000","last_active":"2024-09-18T01:48:19.422498+0000","last_peered":"2024-09-18T01:48:19.422498+0000","last_clean":"2024-09-18T01:48:19.422498+0000","last_became_active":"2024-09-18T01:45:12.313885+0000","last_became_peered":"2024-09-18T01:45:12.313885+0000","last_unstale":"2024-09-18T01:48:19.422498+0000","last_undegraded":"2024-09-18T01:48:19.422498+0000","last_fullsized":"2024-09-18T01:48:19.422498+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:29:22.572641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"33'7","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.579430+0000","last_change":"2024-09-18T01:45:14.317559+0000","last_active":"2024-09-18T01:48:12.579430+0000","last_peered":"2024-09-18T01:48:12.579430+0000","last_clean":"2024-09-18T01:48:12.579430+0000","last_became_active":"2024-09-18T01:45:14.317241+0000","last_became_peered":"2024-09-18T01:45:14.317241+0000","last_unstale":"2024-09-18T01:48:12.579430+0000","last_undegraded":"2024-09-18T01:48:12.579430+0000","last_fullsized":"2024-09-18T01:48:12.579430+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:01:31.449415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"33'8","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.652777+0000","last_change":"2024-09-18T01:45:06.285908+0000","last_active":"2024-09-18T01:48:12.652777+0000","last_peered":"2024-09-18T01:48:12.652777+0000","last_clean":"2024-09-18T01:48:12.652777+0000","last_became_active":"2024-09-18T01:45:06.285656+0000","last_became_peered":"2024-09-18T01:45:06.285656+0000","last_unstale":"2024-09-18T01:48:12.652777+0000","last_undegraded":"2024-09-18T01:48:12.652777+0000","last_fullsized":"2024-09-18T01:48:12.652777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:34:31.263060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338445+0000","last_change":"2024-09-18T01:45:04.290881+0000","last_active":"2024-09-18T01:45:41.338445+0000","last_peered":"2024-09-18T01:45:41.338445+0000","last_clean":"2024-09-18T01:45:41.338445+0000","last_became_active":"2024-09-18T01:45:04.290480+0000","last_became_peered":"2024-09-18T01:45:04.290480+0000","last_unstale":"2024-09-18T01:45:41.338445+0000","last_undegraded":"2024-09-18T01:45:41.338445+0000","last_fullsized":"2024-09-18T01:45:41.338445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:43:17.455462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338670+0000","last_change":"2024-09-18T01:44:55.241531+0000","last_active":"2024-09-18T01:45:41.338670+0000","last_peered":"2024-09-18T01:45:41.338670+0000","last_clean":"2024-09-18T01:45:41.338670+0000","last_became_active":"2024-09-18T01:44:53.298677+0000","last_became_peered":"2024-09-18T01:44:53.298677+0000","last_unstale":"2024-09-18T01:45:41.338670+0000","last_undegraded":"2024-09-18T01:45:41.338670+0000","last_fullsized":"2024-09-18T01:45:41.338670+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:07:05.603416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052495500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.334953+0000","last_change":"2024-09-18T01:45:08.292005+0000","last_active":"2024-09-18T01:45:41.334953+0000","last_peered":"2024-09-18T01:45:41.334953+0000","last_clean":"2024-09-18T01:45:41.334953+0000","last_became_active":"2024-09-18T01:45:08.291696+0000","last_became_peered":"2024-09-18T01:45:08.291696+0000","last_unstale":"2024-09-18T01:45:41.334953+0000","last_undegraded":"2024-09-18T01:45:41.334953+0000","last_fullsized":"2024-09-18T01:45:41.334953+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:36:29.790531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'97","reported_seq":187,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.532553+0000","last_change":"2024-09-18T01:45:10.304923+0000","last_active":"2024-09-18T01:48:19.532553+0000","last_peered":"2024-09-18T01:48:19.532553+0000","last_clean":"2024-09-18T01:48:19.532553+0000","last_became_active":"2024-09-18T01:45:10.304662+0000","last_became_peered":"2024-09-18T01:45:10.304662+0000","last_unstale":"2024-09-18T01:48:19.532553+0000","last_undegraded":"2024-09-18T01:48:19.532553+0000","last_fullsized":"2024-09-18T01:48:19.532553+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:31:12.978887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":87,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338335+0000","last_change":"2024-09-18T01:45:12.311741+0000","last_active":"2024-09-18T01:45:41.338335+0000","last_peered":"2024-09-18T01:45:41.338335+0000","last_clean":"2024-09-18T01:45:41.338335+0000","last_became_active":"2024-09-18T01:45:12.311399+0000","last_became_peered":"2024-09-18T01:45:12.311399+0000","last_unstale":"2024-09-18T01:45:41.338335+0000","last_undegraded":"2024-09-18T01:45:41.338335+0000","last_fullsized":"2024-09-18T01:45:41.338335+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:59:11.475143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.334893+0000","last_change":"2024-09-18T01:45:14.315545+0000","last_active":"2024-09-18T01:45:41.334893+0000","last_peered":"2024-09-18T01:45:41.334893+0000","last_clean":"2024-09-18T01:45:41.334893+0000","last_became_active":"2024-09-18T01:45:14.314587+0000","last_became_peered":"2024-09-18T01:45:14.314587+0000","last_unstale":"2024-09-18T01:45:41.334893+0000","last_undegraded":"2024-09-18T01:45:41.334893+0000","last_fullsized":"2024-09-18T01:45:41.334893+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:18:52.177258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"31'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.333069+0000","last_change":"2024-09-18T01:45:14.326309+0000","last_active":"2024-09-18T01:45:41.333069+0000","last_peered":"2024-09-18T01:45:41.333069+0000","last_clean":"2024-09-18T01:45:41.333069+0000","last_became_active":"2024-09-18T01:45:14.326051+0000","last_became_peered":"2024-09-18T01:45:14.326051+0000","last_unstale":"2024-09-18T01:45:41.333069+0000","last_undegraded":"2024-09-18T01:45:41.333069+0000","last_fullsized":"2024-09-18T01:45:41.333069+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:43:32.191718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"33'8","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:46.587783+0000","last_change":"2024-09-18T01:45:06.284230+0000","last_active":"2024-09-18T01:45:46.587783+0000","last_peered":"2024-09-18T01:45:46.587783+0000","last_clean":"2024-09-18T01:45:46.587783+0000","last_became_active":"2024-09-18T01:45:06.283912+0000","last_became_peered":"2024-09-18T01:45:06.283912+0000","last_unstale":"2024-09-18T01:45:46.587783+0000","last_undegraded":"2024-09-18T01:45:46.587783+0000","last_fullsized":"2024-09-18T01:45:46.587783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:38:33.477420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:46.113600+0000","last_change":"2024-09-18T01:45:04.289644+0000","last_active":"2024-09-18T01:45:46.113600+0000","last_peered":"2024-09-18T01:45:46.113600+0000","last_clean":"2024-09-18T01:45:46.113600+0000","last_became_active":"2024-09-18T01:45:04.285647+0000","last_became_peered":"2024-09-18T01:45:04.285647+0000","last_unstale":"2024-09-18T01:45:46.113600+0000","last_undegraded":"2024-09-18T01:45:46.113600+0000","last_fullsized":"2024-09-18T01:45:46.113600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:57:36.145186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.342016+0000","last_change":"2024-09-18T01:45:41.340307+0000","last_active":"2024-09-18T01:45:41.342016+0000","last_peered":"2024-09-18T01:45:41.342016+0000","last_clean":"2024-09-18T01:45:41.342016+0000","last_became_active":"2024-09-18T01:45:41.339936+0000","last_became_peered":"2024-09-18T01:45:41.339936+0000","last_unstale":"2024-09-18T01:45:41.342016+0000","last_undegraded":"2024-09-18T01:45:41.342016+0000","last_fullsized":"2024-09-18T01:45:41.342016+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:14:27.952660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'41","reported_seq":94,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.550804+0000","last_change":"2024-09-18T01:45:10.307949+0000","last_active":"2024-09-18T01:48:19.550804+0000","last_peered":"2024-09-18T01:48:19.550804+0000","last_clean":"2024-09-18T01:48:19.550804+0000","last_became_active":"2024-09-18T01:45:10.307670+0000","last_became_peered":"2024-09-18T01:45:10.307670+0000","last_unstale":"2024-09-18T01:48:19.550804+0000","last_undegraded":"2024-09-18T01:48:19.550804+0000","last_fullsized":"2024-09-18T01:48:19.550804+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:17:12.637730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.334780+0000","last_change":"2024-09-18T01:45:12.316684+0000","last_active":"2024-09-18T01:45:41.334780+0000","last_peered":"2024-09-18T01:45:41.334780+0000","last_clean":"2024-09-18T01:45:41.334780+0000","last_became_active":"2024-09-18T01:45:12.316192+0000","last_became_peered":"2024-09-18T01:45:12.316192+0000","last_unstale":"2024-09-18T01:45:41.334780+0000","last_undegraded":"2024-09-18T01:45:41.334780+0000","last_fullsized":"2024-09-18T01:45:41.334780+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:23:24.551896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"33'5","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.656030+0000","last_change":"2024-09-18T01:45:14.312071+0000","last_active":"2024-09-18T01:48:12.656030+0000","last_peered":"2024-09-18T01:48:12.656030+0000","last_clean":"2024-09-18T01:48:12.656030+0000","last_became_active":"2024-09-18T01:45:14.311776+0000","last_became_peered":"2024-09-18T01:45:14.311776+0000","last_unstale":"2024-09-18T01:48:12.656030+0000","last_undegraded":"2024-09-18T01:48:12.656030+0000","last_fullsized":"2024-09-18T01:48:12.656030+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:10:22.245202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'8","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.652796+0000","last_change":"2024-09-18T01:45:06.292121+0000","last_active":"2024-09-18T01:48:12.652796+0000","last_peered":"2024-09-18T01:48:12.652796+0000","last_clean":"2024-09-18T01:48:12.652796+0000","last_became_active":"2024-09-18T01:45:06.291811+0000","last_became_peered":"2024-09-18T01:45:06.291811+0000","last_unstale":"2024-09-18T01:48:12.652796+0000","last_undegraded":"2024-09-18T01:48:12.652796+0000","last_fullsized":"2024-09-18T01:48:12.652796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:00:01.331200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.069642+0000","last_change":"2024-09-18T01:45:04.289933+0000","last_active":"2024-09-18T01:47:12.069642+0000","last_peered":"2024-09-18T01:47:12.069642+0000","last_clean":"2024-09-18T01:47:12.069642+0000","last_became_active":"2024-09-18T01:45:04.289655+0000","last_became_peered":"2024-09-18T01:45:04.289655+0000","last_unstale":"2024-09-18T01:47:12.069642+0000","last_undegraded":"2024-09-18T01:47:12.069642+0000","last_fullsized":"2024-09-18T01:47:12.069642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:35:27.504923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.344737+0000","last_change":"2024-09-18T01:45:41.342483+0000","last_active":"2024-09-18T01:45:41.344737+0000","last_peered":"2024-09-18T01:45:41.344737+0000","last_clean":"2024-09-18T01:45:41.344737+0000","last_became_active":"2024-09-18T01:45:41.342149+0000","last_became_peered":"2024-09-18T01:45:41.342149+0000","last_unstale":"2024-09-18T01:45:41.344737+0000","last_undegraded":"2024-09-18T01:45:41.344737+0000","last_fullsized":"2024-09-18T01:45:41.344737+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:51:13.653922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'5","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.191690+0000","last_change":"2024-09-18T01:45:10.296711+0000","last_active":"2024-09-18T01:48:12.191690+0000","last_peered":"2024-09-18T01:48:12.191690+0000","last_clean":"2024-09-18T01:48:12.191690+0000","last_became_active":"2024-09-18T01:45:10.296387+0000","last_became_peered":"2024-09-18T01:45:10.296387+0000","last_unstale":"2024-09-18T01:48:12.191690+0000","last_undegraded":"2024-09-18T01:48:12.191690+0000","last_fullsized":"2024-09-18T01:48:12.191690+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:30:55.339975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.331863+0000","last_change":"2024-09-18T01:45:12.313429+0000","last_active":"2024-09-18T01:45:41.331863+0000","last_peered":"2024-09-18T01:45:41.331863+0000","last_clean":"2024-09-18T01:45:41.331863+0000","last_became_active":"2024-09-18T01:45:12.313159+0000","last_became_peered":"2024-09-18T01:45:12.313159+0000","last_unstale":"2024-09-18T01:45:41.331863+0000","last_undegraded":"2024-09-18T01:45:41.331863+0000","last_fullsized":"2024-09-18T01:45:41.331863+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:30:57.351499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338764+0000","last_change":"2024-09-18T01:45:14.319376+0000","last_active":"2024-09-18T01:45:41.338764+0000","last_peered":"2024-09-18T01:45:41.338764+0000","last_clean":"2024-09-18T01:45:41.338764+0000","last_became_active":"2024-09-18T01:45:14.319073+0000","last_became_peered":"2024-09-18T01:45:14.319073+0000","last_unstale":"2024-09-18T01:45:41.338764+0000","last_undegraded":"2024-09-18T01:45:41.338764+0000","last_fullsized":"2024-09-18T01:45:41.338764+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:39:57.317811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'5","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:27.214914+0000","last_change":"2024-09-18T01:45:06.276739+0000","last_active":"2024-09-18T01:47:27.214914+0000","last_peered":"2024-09-18T01:47:27.214914+0000","last_clean":"2024-09-18T01:47:27.214914+0000","last_became_active":"2024-09-18T01:45:06.276408+0000","last_became_peered":"2024-09-18T01:45:06.276408+0000","last_unstale":"2024-09-18T01:47:27.214914+0000","last_undegraded":"2024-09-18T01:47:27.214914+0000","last_fullsized":"2024-09-18T01:47:27.214914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:38:33.477420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"33'6","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.787555+0000","last_change":"2024-09-18T01:45:04.287172+0000","last_active":"2024-09-18T01:48:12.787555+0000","last_peered":"2024-09-18T01:48:12.787555+0000","last_clean":"2024-09-18T01:48:12.787555+0000","last_became_active":"2024-09-18T01:45:04.286887+0000","last_became_peered":"2024-09-18T01:45:04.286887+0000","last_unstale":"2024-09-18T01:48:12.787555+0000","last_undegraded":"2024-09-18T01:48:12.787555+0000","last_fullsized":"2024-09-18T01:48:12.787555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:10:25.987284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.331617+0000","last_change":"2024-09-18T01:45:08.291860+0000","last_active":"2024-09-18T01:45:41.331617+0000","last_peered":"2024-09-18T01:45:41.331617+0000","last_clean":"2024-09-18T01:45:41.331617+0000","last_became_active":"2024-09-18T01:45:08.291575+0000","last_became_peered":"2024-09-18T01:45:08.291575+0000","last_unstale":"2024-09-18T01:45:41.331617+0000","last_undegraded":"2024-09-18T01:45:41.331617+0000","last_fullsized":"2024-09-18T01:45:41.331617+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:10:31.670675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'43","reported_seq":106,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.516264+0000","last_change":"2024-09-18T01:45:10.298133+0000","last_active":"2024-09-18T01:48:19.516264+0000","last_peered":"2024-09-18T01:48:19.516264+0000","last_clean":"2024-09-18T01:48:19.516264+0000","last_became_active":"2024-09-18T01:45:10.297904+0000","last_became_peered":"2024-09-18T01:45:10.297904+0000","last_unstale":"2024-09-18T01:48:19.516264+0000","last_undegraded":"2024-09-18T01:48:19.516264+0000","last_fullsized":"2024-09-18T01:48:19.516264+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:17:46.496134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.334632+0000","last_change":"2024-09-18T01:45:12.313485+0000","last_active":"2024-09-18T01:45:41.334632+0000","last_peered":"2024-09-18T01:45:41.334632+0000","last_clean":"2024-09-18T01:45:41.334632+0000","last_became_active":"2024-09-18T01:45:12.313186+0000","last_became_peered":"2024-09-18T01:45:12.313186+0000","last_unstale":"2024-09-18T01:45:41.334632+0000","last_undegraded":"2024-09-18T01:45:41.334632+0000","last_fullsized":"2024-09-18T01:45:41.334632+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:49:35.068566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337050+0000","last_change":"2024-09-18T01:45:14.326931+0000","last_active":"2024-09-18T01:45:41.337050+0000","last_peered":"2024-09-18T01:45:41.337050+0000","last_clean":"2024-09-18T01:45:41.337050+0000","last_became_active":"2024-09-18T01:45:14.326668+0000","last_became_peered":"2024-09-18T01:45:14.326668+0000","last_unstale":"2024-09-18T01:45:41.337050+0000","last_undegraded":"2024-09-18T01:45:41.337050+0000","last_fullsized":"2024-09-18T01:45:41.337050+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:46:10.520315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'18","reported_seq":95,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.800687+0000","last_change":"2024-09-18T01:45:06.297569+0000","last_active":"2024-09-18T01:48:12.800687+0000","last_peered":"2024-09-18T01:48:12.800687+0000","last_clean":"2024-09-18T01:48:12.800687+0000","last_became_active":"2024-09-18T01:45:06.297220+0000","last_became_peered":"2024-09-18T01:45:06.297220+0000","last_unstale":"2024-09-18T01:48:12.800687+0000","last_undegraded":"2024-09-18T01:48:12.800687+0000","last_fullsized":"2024-09-18T01:48:12.800687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:52:37.561237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":76,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337780+0000","last_change":"2024-09-18T01:45:04.283606+0000","last_active":"2024-09-18T01:45:41.337780+0000","last_peered":"2024-09-18T01:45:41.337780+0000","last_clean":"2024-09-18T01:45:41.337780+0000","last_became_active":"2024-09-18T01:45:04.283276+0000","last_became_peered":"2024-09-18T01:45:04.283276+0000","last_unstale":"2024-09-18T01:45:41.337780+0000","last_undegraded":"2024-09-18T01:45:41.337780+0000","last_fullsized":"2024-09-18T01:45:41.337780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:17:00.799400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.335084+0000","last_change":"2024-09-18T01:45:08.291740+0000","last_active":"2024-09-18T01:45:41.335084+0000","last_peered":"2024-09-18T01:45:41.335084+0000","last_clean":"2024-09-18T01:45:41.335084+0000","last_became_active":"2024-09-18T01:45:08.290911+0000","last_became_peered":"2024-09-18T01:45:08.290911+0000","last_unstale":"2024-09-18T01:45:41.335084+0000","last_undegraded":"2024-09-18T01:45:41.335084+0000","last_fullsized":"2024-09-18T01:45:41.335084+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:38:00.913159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'33","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.506699+0000","last_change":"2024-09-18T01:45:10.301942+0000","last_active":"2024-09-18T01:48:19.506699+0000","last_peered":"2024-09-18T01:48:19.506699+0000","last_clean":"2024-09-18T01:48:19.506699+0000","last_became_active":"2024-09-18T01:45:10.301622+0000","last_became_peered":"2024-09-18T01:45:10.301622+0000","last_unstale":"2024-09-18T01:48:19.506699+0000","last_undegraded":"2024-09-18T01:48:19.506699+0000","last_fullsized":"2024-09-18T01:48:19.506699+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:45:21.320125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.332022+0000","last_change":"2024-09-18T01:45:12.313357+0000","last_active":"2024-09-18T01:45:41.332022+0000","last_peered":"2024-09-18T01:45:41.332022+0000","last_clean":"2024-09-18T01:45:41.332022+0000","last_became_active":"2024-09-18T01:45:12.313096+0000","last_became_peered":"2024-09-18T01:45:12.313096+0000","last_unstale":"2024-09-18T01:45:41.332022+0000","last_undegraded":"2024-09-18T01:45:41.332022+0000","last_fullsized":"2024-09-18T01:45:41.332022+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:03:16.580180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"33'12","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.871323+0000","last_change":"2024-09-18T01:45:06.282718+0000","last_active":"2024-09-18T01:48:12.871323+0000","last_peered":"2024-09-18T01:48:12.871323+0000","last_clean":"2024-09-18T01:48:12.871323+0000","last_became_active":"2024-09-18T01:45:06.282461+0000","last_became_peered":"2024-09-18T01:45:06.282461+0000","last_unstale":"2024-09-18T01:48:12.871323+0000","last_undegraded":"2024-09-18T01:48:12.871323+0000","last_fullsized":"2024-09-18T01:48:12.871323+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:30:50.253764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"33'8","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.539657+0000","last_change":"2024-09-18T01:45:04.293367+0000","last_active":"2024-09-18T01:48:12.539657+0000","last_peered":"2024-09-18T01:48:12.539657+0000","last_clean":"2024-09-18T01:48:12.539657+0000","last_became_active":"2024-09-18T01:45:04.288082+0000","last_became_peered":"2024-09-18T01:45:04.288082+0000","last_unstale":"2024-09-18T01:48:12.539657+0000","last_undegraded":"2024-09-18T01:48:12.539657+0000","last_fullsized":"2024-09-18T01:48:12.539657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:03:55.175306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":48,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.340356+0000","last_change":"2024-09-18T01:45:08.293027+0000","last_active":"2024-09-18T01:45:41.340356+0000","last_peered":"2024-09-18T01:45:41.340356+0000","last_clean":"2024-09-18T01:45:41.340356+0000","last_became_active":"2024-09-18T01:45:08.292739+0000","last_became_peered":"2024-09-18T01:45:08.292739+0000","last_unstale":"2024-09-18T01:45:41.340356+0000","last_undegraded":"2024-09-18T01:45:41.340356+0000","last_fullsized":"2024-09-18T01:45:41.340356+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:30:59.656894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'66","reported_seq":136,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.568821+0000","last_change":"2024-09-18T01:45:10.296746+0000","last_active":"2024-09-18T01:48:19.568821+0000","last_peered":"2024-09-18T01:48:19.568821+0000","last_clean":"2024-09-18T01:48:19.568821+0000","last_became_active":"2024-09-18T01:45:10.296396+0000","last_became_peered":"2024-09-18T01:45:10.296396+0000","last_unstale":"2024-09-18T01:48:19.568821+0000","last_undegraded":"2024-09-18T01:48:19.568821+0000","last_fullsized":"2024-09-18T01:48:19.568821+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:49:47.265044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.332138+0000","last_change":"2024-09-18T01:45:12.307915+0000","last_active":"2024-09-18T01:45:41.332138+0000","last_peered":"2024-09-18T01:45:41.332138+0000","last_clean":"2024-09-18T01:45:41.332138+0000","last_became_active":"2024-09-18T01:45:12.307279+0000","last_became_peered":"2024-09-18T01:45:12.307279+0000","last_unstale":"2024-09-18T01:45:41.332138+0000","last_undegraded":"2024-09-18T01:45:41.332138+0000","last_fullsized":"2024-09-18T01:45:41.332138+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:49:49.276568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'22","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.098129+0000","last_change":"2024-09-18T01:45:14.320125+0000","last_active":"2024-09-18T01:47:12.098129+0000","last_peered":"2024-09-18T01:47:12.098129+0000","last_clean":"2024-09-18T01:47:12.098129+0000","last_became_active":"2024-09-18T01:45:14.319540+0000","last_became_peered":"2024-09-18T01:45:14.319540+0000","last_unstale":"2024-09-18T01:47:12.098129+0000","last_undegraded":"2024-09-18T01:47:12.098129+0000","last_fullsized":"2024-09-18T01:47:12.098129+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:14:53.955796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":65,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'18","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.801087+0000","last_change":"2024-09-18T01:45:06.293374+0000","last_active":"2024-09-18T01:48:12.801087+0000","last_peered":"2024-09-18T01:48:12.801087+0000","last_clean":"2024-09-18T01:48:12.801087+0000","last_became_active":"2024-09-18T01:45:06.293053+0000","last_became_peered":"2024-09-18T01:45:06.293053+0000","last_unstale":"2024-09-18T01:48:12.801087+0000","last_undegraded":"2024-09-18T01:48:12.801087+0000","last_fullsized":"2024-09-18T01:48:12.801087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:55:38.246732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":45,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.333300+0000","last_change":"2024-09-18T01:45:04.292562+0000","last_active":"2024-09-18T01:45:41.333300+0000","last_peered":"2024-09-18T01:45:41.333300+0000","last_clean":"2024-09-18T01:45:41.333300+0000","last_became_active":"2024-09-18T01:45:04.292082+0000","last_became_peered":"2024-09-18T01:45:04.292082+0000","last_unstale":"2024-09-18T01:45:41.333300+0000","last_undegraded":"2024-09-18T01:45:41.333300+0000","last_fullsized":"2024-09-18T01:45:41.333300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:08:58.229173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.333652+0000","last_change":"2024-09-18T01:45:08.287312+0000","last_active":"2024-09-18T01:45:41.333652+0000","last_peered":"2024-09-18T01:45:41.333652+0000","last_clean":"2024-09-18T01:45:41.333652+0000","last_became_active":"2024-09-18T01:45:08.286609+0000","last_became_peered":"2024-09-18T01:45:08.286609+0000","last_unstale":"2024-09-18T01:45:41.333652+0000","last_undegraded":"2024-09-18T01:45:41.333652+0000","last_fullsized":"2024-09-18T01:45:41.333652+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:04:58.163455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'39","reported_seq":88,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.509572+0000","last_change":"2024-09-18T01:45:10.309790+0000","last_active":"2024-09-18T01:48:19.509572+0000","last_peered":"2024-09-18T01:48:19.509572+0000","last_clean":"2024-09-18T01:48:19.509572+0000","last_became_active":"2024-09-18T01:45:10.309360+0000","last_became_peered":"2024-09-18T01:45:10.309360+0000","last_unstale":"2024-09-18T01:48:19.509572+0000","last_undegraded":"2024-09-18T01:48:19.509572+0000","last_fullsized":"2024-09-18T01:48:19.509572+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:47:11.016927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.334583+0000","last_change":"2024-09-18T01:45:12.314763+0000","last_active":"2024-09-18T01:45:41.334583+0000","last_peered":"2024-09-18T01:45:41.334583+0000","last_clean":"2024-09-18T01:45:41.334583+0000","last_became_active":"2024-09-18T01:45:12.314499+0000","last_became_peered":"2024-09-18T01:45:12.314499+0000","last_unstale":"2024-09-18T01:45:41.334583+0000","last_undegraded":"2024-09-18T01:45:41.334583+0000","last_fullsized":"2024-09-18T01:45:41.334583+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:43:30.182833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"33'2","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:46.123289+0000","last_change":"2024-09-18T01:45:14.326163+0000","last_active":"2024-09-18T01:45:46.123289+0000","last_peered":"2024-09-18T01:45:46.123289+0000","last_clean":"2024-09-18T01:45:46.123289+0000","last_became_active":"2024-09-18T01:45:14.325421+0000","last_became_peered":"2024-09-18T01:45:14.325421+0000","last_unstale":"2024-09-18T01:45:46.123289+0000","last_undegraded":"2024-09-18T01:45:46.123289+0000","last_fullsized":"2024-09-18T01:45:46.123289+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:46:44.031146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'8","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.559304+0000","last_change":"2024-09-18T01:45:06.287633+0000","last_active":"2024-09-18T01:48:12.559304+0000","last_peered":"2024-09-18T01:48:12.559304+0000","last_clean":"2024-09-18T01:48:12.559304+0000","last_became_active":"2024-09-18T01:45:06.286153+0000","last_became_peered":"2024-09-18T01:45:06.286153+0000","last_unstale":"2024-09-18T01:48:12.559304+0000","last_undegraded":"2024-09-18T01:48:12.559304+0000","last_fullsized":"2024-09-18T01:48:12.559304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:49:16.994650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.334776+0000","last_change":"2024-09-18T01:45:04.295250+0000","last_active":"2024-09-18T01:45:41.334776+0000","last_peered":"2024-09-18T01:45:41.334776+0000","last_clean":"2024-09-18T01:45:41.334776+0000","last_became_active":"2024-09-18T01:45:04.294537+0000","last_became_peered":"2024-09-18T01:45:04.294537+0000","last_unstale":"2024-09-18T01:45:41.334776+0000","last_undegraded":"2024-09-18T01:45:41.334776+0000","last_fullsized":"2024-09-18T01:45:41.334776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:18:39.513085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.332516+0000","last_change":"2024-09-18T01:45:08.287053+0000","last_active":"2024-09-18T01:45:41.332516+0000","last_peered":"2024-09-18T01:45:41.332516+0000","last_clean":"2024-09-18T01:45:41.332516+0000","last_became_active":"2024-09-18T01:45:08.286466+0000","last_became_peered":"2024-09-18T01:45:08.286466+0000","last_unstale":"2024-09-18T01:45:41.332516+0000","last_undegraded":"2024-09-18T01:45:41.332516+0000","last_fullsized":"2024-09-18T01:45:41.332516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:15:50.332283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'43","reported_seq":96,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.562271+0000","last_change":"2024-09-18T01:45:10.304141+0000","last_active":"2024-09-18T01:48:19.562271+0000","last_peered":"2024-09-18T01:48:19.562271+0000","last_clean":"2024-09-18T01:48:19.562271+0000","last_became_active":"2024-09-18T01:45:10.303911+0000","last_became_peered":"2024-09-18T01:45:10.303911+0000","last_unstale":"2024-09-18T01:48:19.562271+0000","last_undegraded":"2024-09-18T01:48:19.562271+0000","last_fullsized":"2024-09-18T01:48:19.562271+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:48:29.561311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338997+0000","last_change":"2024-09-18T01:45:12.313469+0000","last_active":"2024-09-18T01:45:41.338997+0000","last_peered":"2024-09-18T01:45:41.338997+0000","last_clean":"2024-09-18T01:45:41.338997+0000","last_became_active":"2024-09-18T01:45:12.313180+0000","last_became_peered":"2024-09-18T01:45:12.313180+0000","last_unstale":"2024-09-18T01:45:41.338997+0000","last_undegraded":"2024-09-18T01:45:41.338997+0000","last_fullsized":"2024-09-18T01:45:41.338997+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:38:04.933752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"33'3","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.166889+0000","last_change":"2024-09-18T01:45:14.326771+0000","last_active":"2024-09-18T01:47:12.166889+0000","last_peered":"2024-09-18T01:47:12.166889+0000","last_clean":"2024-09-18T01:47:12.166889+0000","last_became_active":"2024-09-18T01:45:14.326452+0000","last_became_peered":"2024-09-18T01:45:14.326452+0000","last_unstale":"2024-09-18T01:47:12.166889+0000","last_undegraded":"2024-09-18T01:47:12.166889+0000","last_fullsized":"2024-09-18T01:47:12.166889+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:23:19.339622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:46.588667+0000","last_change":"2024-09-18T01:45:06.282527+0000","last_active":"2024-09-18T01:45:46.588667+0000","last_peered":"2024-09-18T01:45:46.588667+0000","last_clean":"2024-09-18T01:45:46.588667+0000","last_became_active":"2024-09-18T01:45:06.281987+0000","last_became_peered":"2024-09-18T01:45:06.281987+0000","last_unstale":"2024-09-18T01:45:46.588667+0000","last_undegraded":"2024-09-18T01:45:46.588667+0000","last_fullsized":"2024-09-18T01:45:46.588667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:03:57.182802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.480175+0000","last_change":"2024-09-18T01:45:04.290235+0000","last_active":"2024-09-18T01:48:12.480175+0000","last_peered":"2024-09-18T01:48:12.480175+0000","last_clean":"2024-09-18T01:48:12.480175+0000","last_became_active":"2024-09-18T01:45:04.289909+0000","last_became_peered":"2024-09-18T01:45:04.289909+0000","last_unstale":"2024-09-18T01:48:12.480175+0000","last_undegraded":"2024-09-18T01:48:12.480175+0000","last_fullsized":"2024-09-18T01:48:12.480175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:03:55.663688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.347523+0000","last_change":"2024-09-18T01:45:41.342634+0000","last_active":"2024-09-18T01:45:41.347523+0000","last_peered":"2024-09-18T01:45:41.347523+0000","last_clean":"2024-09-18T01:45:41.347523+0000","last_became_active":"2024-09-18T01:45:41.342280+0000","last_became_peered":"2024-09-18T01:45:41.342280+0000","last_unstale":"2024-09-18T01:45:41.347523+0000","last_undegraded":"2024-09-18T01:45:41.347523+0000","last_fullsized":"2024-09-18T01:45:41.347523+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:22:13.981729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'16","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338687+0000","last_change":"2024-09-18T01:45:10.308886+0000","last_active":"2024-09-18T01:45:41.338687+0000","last_peered":"2024-09-18T01:45:41.338687+0000","last_clean":"2024-09-18T01:45:41.338687+0000","last_became_active":"2024-09-18T01:45:10.308524+0000","last_became_peered":"2024-09-18T01:45:10.308524+0000","last_unstale":"2024-09-18T01:45:41.338687+0000","last_undegraded":"2024-09-18T01:45:41.338687+0000","last_fullsized":"2024-09-18T01:45:41.338687+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:27:57.717568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'285","reported_seq":419,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.415912+0000","last_change":"2024-09-18T01:45:12.307543+0000","last_active":"2024-09-18T01:48:19.415912+0000","last_peered":"2024-09-18T01:48:19.415912+0000","last_clean":"2024-09-18T01:48:19.415912+0000","last_became_active":"2024-09-18T01:45:12.307186+0000","last_became_peered":"2024-09-18T01:45:12.307186+0000","last_unstale":"2024-09-18T01:48:19.415912+0000","last_undegraded":"2024-09-18T01:48:19.415912+0000","last_fullsized":"2024-09-18T01:48:19.415912+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:03:00.026847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"33'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.937244+0000","last_change":"2024-09-18T01:45:14.326301+0000","last_active":"2024-09-18T01:48:12.937244+0000","last_peered":"2024-09-18T01:48:12.937244+0000","last_clean":"2024-09-18T01:48:12.937244+0000","last_became_active":"2024-09-18T01:45:14.326018+0000","last_became_peered":"2024-09-18T01:45:14.326018+0000","last_unstale":"2024-09-18T01:48:12.937244+0000","last_undegraded":"2024-09-18T01:48:12.937244+0000","last_fullsized":"2024-09-18T01:48:12.937244+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:39:58.669383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"33'8","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.559623+0000","last_change":"2024-09-18T01:45:06.282281+0000","last_active":"2024-09-18T01:48:12.559623+0000","last_peered":"2024-09-18T01:48:12.559623+0000","last_clean":"2024-09-18T01:48:12.559623+0000","last_became_active":"2024-09-18T01:45:06.281798+0000","last_became_peered":"2024-09-18T01:45:06.281798+0000","last_unstale":"2024-09-18T01:48:12.559623+0000","last_undegraded":"2024-09-18T01:48:12.559623+0000","last_fullsized":"2024-09-18T01:48:12.559623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:08:07.525907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.336989+0000","last_change":"2024-09-18T01:45:04.293329+0000","last_active":"2024-09-18T01:45:41.336989+0000","last_peered":"2024-09-18T01:45:41.336989+0000","last_clean":"2024-09-18T01:45:41.336989+0000","last_became_active":"2024-09-18T01:45:04.293009+0000","last_became_peered":"2024-09-18T01:45:04.293009+0000","last_unstale":"2024-09-18T01:45:41.336989+0000","last_undegraded":"2024-09-18T01:45:41.336989+0000","last_fullsized":"2024-09-18T01:45:41.336989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:10:25.987284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.335416+0000","last_change":"2024-09-18T01:45:08.288626+0000","last_active":"2024-09-18T01:45:41.335416+0000","last_peered":"2024-09-18T01:45:41.335416+0000","last_clean":"2024-09-18T01:45:41.335416+0000","last_became_active":"2024-09-18T01:45:08.287884+0000","last_became_peered":"2024-09-18T01:45:08.287884+0000","last_unstale":"2024-09-18T01:45:41.335416+0000","last_undegraded":"2024-09-18T01:45:41.335416+0000","last_fullsized":"2024-09-18T01:45:41.335416+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:22:29.603107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'64","reported_seq":137,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.470320+0000","last_change":"2024-09-18T01:45:10.301367+0000","last_active":"2024-09-18T01:48:19.470320+0000","last_peered":"2024-09-18T01:48:19.470320+0000","last_clean":"2024-09-18T01:48:19.470320+0000","last_became_active":"2024-09-18T01:45:10.301087+0000","last_became_peered":"2024-09-18T01:45:10.301087+0000","last_unstale":"2024-09-18T01:48:19.470320+0000","last_undegraded":"2024-09-18T01:48:19.470320+0000","last_fullsized":"2024-09-18T01:48:19.470320+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:48:29.561311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337222+0000","last_change":"2024-09-18T01:45:12.312300+0000","last_active":"2024-09-18T01:45:41.337222+0000","last_peered":"2024-09-18T01:45:41.337222+0000","last_clean":"2024-09-18T01:45:41.337222+0000","last_became_active":"2024-09-18T01:45:12.312055+0000","last_became_peered":"2024-09-18T01:45:12.312055+0000","last_unstale":"2024-09-18T01:45:41.337222+0000","last_undegraded":"2024-09-18T01:45:41.337222+0000","last_fullsized":"2024-09-18T01:45:41.337222+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:13:37.683828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"33'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:46.589606+0000","last_change":"2024-09-18T01:45:14.323228+0000","last_active":"2024-09-18T01:45:46.589606+0000","last_peered":"2024-09-18T01:45:46.589606+0000","last_clean":"2024-09-18T01:45:46.589606+0000","last_became_active":"2024-09-18T01:45:14.322945+0000","last_became_peered":"2024-09-18T01:45:14.322945+0000","last_unstale":"2024-09-18T01:45:46.589606+0000","last_undegraded":"2024-09-18T01:45:46.589606+0000","last_fullsized":"2024-09-18T01:45:46.589606+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:02:58.012154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'6","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.650017+0000","last_change":"2024-09-18T01:45:06.282529+0000","last_active":"2024-09-18T01:48:12.650017+0000","last_peered":"2024-09-18T01:48:12.650017+0000","last_clean":"2024-09-18T01:48:12.650017+0000","last_became_active":"2024-09-18T01:45:06.281480+0000","last_became_peered":"2024-09-18T01:45:06.281480+0000","last_unstale":"2024-09-18T01:48:12.650017+0000","last_undegraded":"2024-09-18T01:48:12.650017+0000","last_fullsized":"2024-09-18T01:48:12.650017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:12:27.107318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:44.959625+0000","last_change":"2024-09-18T01:45:04.291296+0000","last_active":"2024-09-18T01:45:44.959625+0000","last_peered":"2024-09-18T01:45:44.959625+0000","last_clean":"2024-09-18T01:45:44.959625+0000","last_became_active":"2024-09-18T01:45:04.290901+0000","last_became_peered":"2024-09-18T01:45:04.290901+0000","last_unstale":"2024-09-18T01:45:44.959625+0000","last_undegraded":"2024-09-18T01:45:44.959625+0000","last_fullsized":"2024-09-18T01:45:44.959625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:34:29.255564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.334766+0000","last_change":"2024-09-18T01:45:08.286897+0000","last_active":"2024-09-18T01:45:41.334766+0000","last_peered":"2024-09-18T01:45:41.334766+0000","last_clean":"2024-09-18T01:45:41.334766+0000","last_became_active":"2024-09-18T01:45:08.286502+0000","last_became_peered":"2024-09-18T01:45:08.286502+0000","last_unstale":"2024-09-18T01:45:41.334766+0000","last_undegraded":"2024-09-18T01:45:41.334766+0000","last_fullsized":"2024-09-18T01:45:41.334766+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:44:50.713773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'39","reported_seq":91,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.474052+0000","last_change":"2024-09-18T01:45:10.306297+0000","last_active":"2024-09-18T01:48:19.474052+0000","last_peered":"2024-09-18T01:48:19.474052+0000","last_clean":"2024-09-18T01:48:19.474052+0000","last_became_active":"2024-09-18T01:45:10.306076+0000","last_became_peered":"2024-09-18T01:45:10.306076+0000","last_unstale":"2024-09-18T01:48:19.474052+0000","last_undegraded":"2024-09-18T01:48:19.474052+0000","last_fullsized":"2024-09-18T01:48:19.474052+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:52:41.579679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.333314+0000","last_change":"2024-09-18T01:45:12.316303+0000","last_active":"2024-09-18T01:45:41.333314+0000","last_peered":"2024-09-18T01:45:41.333314+0000","last_clean":"2024-09-18T01:45:41.333314+0000","last_became_active":"2024-09-18T01:45:12.316022+0000","last_became_peered":"2024-09-18T01:45:12.316022+0000","last_unstale":"2024-09-18T01:45:41.333314+0000","last_undegraded":"2024-09-18T01:45:41.333314+0000","last_fullsized":"2024-09-18T01:45:41.333314+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:08:15.127495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337877+0000","last_change":"2024-09-18T01:45:14.325515+0000","last_active":"2024-09-18T01:45:41.337877+0000","last_peered":"2024-09-18T01:45:41.337877+0000","last_clean":"2024-09-18T01:45:41.337877+0000","last_became_active":"2024-09-18T01:45:14.325208+0000","last_became_peered":"2024-09-18T01:45:14.325208+0000","last_unstale":"2024-09-18T01:45:41.337877+0000","last_undegraded":"2024-09-18T01:45:41.337877+0000","last_fullsized":"2024-09-18T01:45:41.337877+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:55:28.461066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'26","reported_seq":94,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.871206+0000","last_change":"2024-09-18T01:45:06.283428+0000","last_active":"2024-09-18T01:48:12.871206+0000","last_peered":"2024-09-18T01:48:12.871206+0000","last_clean":"2024-09-18T01:48:12.871206+0000","last_became_active":"2024-09-18T01:45:06.283174+0000","last_became_peered":"2024-09-18T01:45:06.283174+0000","last_unstale":"2024-09-18T01:48:12.871206+0000","last_undegraded":"2024-09-18T01:48:12.871206+0000","last_fullsized":"2024-09-18T01:48:12.871206+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:17:42.477692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":84,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.339404+0000","last_change":"2024-09-18T01:45:04.273552+0000","last_active":"2024-09-18T01:45:41.339404+0000","last_peered":"2024-09-18T01:45:41.339404+0000","last_clean":"2024-09-18T01:45:41.339404+0000","last_became_active":"2024-09-18T01:45:04.273128+0000","last_became_peered":"2024-09-18T01:45:04.273128+0000","last_unstale":"2024-09-18T01:45:41.339404+0000","last_undegraded":"2024-09-18T01:45:41.339404+0000","last_fullsized":"2024-09-18T01:45:41.339404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:35:27.504923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"33'4","reported_seq":228,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.390846+0000","last_change":"2024-09-18T01:45:08.294864+0000","last_active":"2024-09-18T01:48:19.390846+0000","last_peered":"2024-09-18T01:48:19.390846+0000","last_clean":"2024-09-18T01:48:19.390846+0000","last_became_active":"2024-09-18T01:45:08.294338+0000","last_became_peered":"2024-09-18T01:45:08.294338+0000","last_unstale":"2024-09-18T01:48:19.390846+0000","last_undegraded":"2024-09-18T01:48:19.390846+0000","last_fullsized":"2024-09-18T01:48:19.390846+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:30:59.656894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'36","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.556359+0000","last_change":"2024-09-18T01:45:10.308965+0000","last_active":"2024-09-18T01:48:19.556359+0000","last_peered":"2024-09-18T01:48:19.556359+0000","last_clean":"2024-09-18T01:48:19.556359+0000","last_became_active":"2024-09-18T01:45:10.308336+0000","last_became_peered":"2024-09-18T01:45:10.308336+0000","last_unstale":"2024-09-18T01:48:19.556359+0000","last_undegraded":"2024-09-18T01:48:19.556359+0000","last_fullsized":"2024-09-18T01:48:19.556359+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:18:53.742596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.335626+0000","last_change":"2024-09-18T01:45:12.313122+0000","last_active":"2024-09-18T01:45:41.335626+0000","last_peered":"2024-09-18T01:45:41.335626+0000","last_clean":"2024-09-18T01:45:41.335626+0000","last_became_active":"2024-09-18T01:45:12.312794+0000","last_became_peered":"2024-09-18T01:45:12.312794+0000","last_unstale":"2024-09-18T01:45:41.335626+0000","last_undegraded":"2024-09-18T01:45:41.335626+0000","last_fullsized":"2024-09-18T01:45:41.335626+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:20:31.256442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"33'10","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.266530+0000","last_change":"2024-09-18T01:45:14.325782+0000","last_active":"2024-09-18T01:48:12.266530+0000","last_peered":"2024-09-18T01:48:12.266530+0000","last_clean":"2024-09-18T01:48:12.266530+0000","last_became_active":"2024-09-18T01:45:14.325464+0000","last_became_peered":"2024-09-18T01:45:14.325464+0000","last_unstale":"2024-09-18T01:48:12.266530+0000","last_undegraded":"2024-09-18T01:48:12.266530+0000","last_fullsized":"2024-09-18T01:48:12.266530+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:16:17.590314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'8","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.871148+0000","last_change":"2024-09-18T01:45:06.283599+0000","last_active":"2024-09-18T01:48:12.871148+0000","last_peered":"2024-09-18T01:48:12.871148+0000","last_clean":"2024-09-18T01:48:12.871148+0000","last_became_active":"2024-09-18T01:45:06.283071+0000","last_became_peered":"2024-09-18T01:45:06.283071+0000","last_unstale":"2024-09-18T01:48:12.871148+0000","last_undegraded":"2024-09-18T01:48:12.871148+0000","last_fullsized":"2024-09-18T01:48:12.871148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:32:00.122022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.781181+0000","last_change":"2024-09-18T01:45:04.298035+0000","last_active":"2024-09-18T01:48:12.781181+0000","last_peered":"2024-09-18T01:48:12.781181+0000","last_clean":"2024-09-18T01:48:12.781181+0000","last_became_active":"2024-09-18T01:45:04.297716+0000","last_became_peered":"2024-09-18T01:45:04.297716+0000","last_unstale":"2024-09-18T01:48:12.781181+0000","last_undegraded":"2024-09-18T01:48:12.781181+0000","last_fullsized":"2024-09-18T01:48:12.781181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:19:39.056474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:09.379986+0000","last_change":"2024-09-18T01:45:08.294474+0000","last_active":"2024-09-18T01:47:09.379986+0000","last_peered":"2024-09-18T01:47:09.379986+0000","last_clean":"2024-09-18T01:47:09.379986+0000","last_became_active":"2024-09-18T01:45:08.294160+0000","last_became_peered":"2024-09-18T01:45:08.294160+0000","last_unstale":"2024-09-18T01:47:09.379986+0000","last_undegraded":"2024-09-18T01:47:09.379986+0000","last_fullsized":"2024-09-18T01:47:09.379986+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:58:00.539983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'47","reported_seq":107,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.565438+0000","last_change":"2024-09-18T01:45:10.308624+0000","last_active":"2024-09-18T01:48:19.565438+0000","last_peered":"2024-09-18T01:48:19.565438+0000","last_clean":"2024-09-18T01:48:19.565438+0000","last_became_active":"2024-09-18T01:45:10.308302+0000","last_became_peered":"2024-09-18T01:45:10.308302+0000","last_unstale":"2024-09-18T01:48:19.565438+0000","last_undegraded":"2024-09-18T01:48:19.565438+0000","last_fullsized":"2024-09-18T01:48:19.565438+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:00:38.863397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.338107+0000","last_change":"2024-09-18T01:45:12.305985+0000","last_active":"2024-09-18T01:45:41.338107+0000","last_peered":"2024-09-18T01:45:41.338107+0000","last_clean":"2024-09-18T01:45:41.338107+0000","last_became_active":"2024-09-18T01:45:12.305742+0000","last_became_peered":"2024-09-18T01:45:12.305742+0000","last_unstale":"2024-09-18T01:45:41.338107+0000","last_undegraded":"2024-09-18T01:45:41.338107+0000","last_fullsized":"2024-09-18T01:45:41.338107+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:31:43.441229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"33'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:10.703620+0000","last_change":"2024-09-18T01:45:14.325723+0000","last_active":"2024-09-18T01:47:10.703620+0000","last_peered":"2024-09-18T01:47:10.703620+0000","last_clean":"2024-09-18T01:47:10.703620+0000","last_became_active":"2024-09-18T01:45:14.325368+0000","last_became_peered":"2024-09-18T01:45:14.325368+0000","last_unstale":"2024-09-18T01:47:10.703620+0000","last_undegraded":"2024-09-18T01:47:10.703620+0000","last_fullsized":"2024-09-18T01:47:10.703620+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:29:32.472538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"33'8","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.929324+0000","last_change":"2024-09-18T01:45:41.342690+0000","last_active":"2024-09-18T01:48:12.929324+0000","last_peered":"2024-09-18T01:48:12.929324+0000","last_clean":"2024-09-18T01:48:12.929324+0000","last_became_active":"2024-09-18T01:45:41.342336+0000","last_became_peered":"2024-09-18T01:45:41.342336+0000","last_unstale":"2024-09-18T01:48:12.929324+0000","last_undegraded":"2024-09-18T01:48:12.929324+0000","last_fullsized":"2024-09-18T01:48:12.929324+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:26:55.964302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.006982+0000","last_change":"2024-09-18T01:45:04.285604+0000","last_active":"2024-09-18T01:47:12.006982+0000","last_peered":"2024-09-18T01:47:12.006982+0000","last_clean":"2024-09-18T01:47:12.006982+0000","last_became_active":"2024-09-18T01:45:04.284969+0000","last_became_peered":"2024-09-18T01:45:04.284969+0000","last_unstale":"2024-09-18T01:47:12.006982+0000","last_undegraded":"2024-09-18T01:47:12.006982+0000","last_fullsized":"2024-09-18T01:47:12.006982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:43:17.455462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'11","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.800655+0000","last_change":"2024-09-18T01:45:06.285979+0000","last_active":"2024-09-18T01:48:12.800655+0000","last_peered":"2024-09-18T01:48:12.800655+0000","last_clean":"2024-09-18T01:48:12.800655+0000","last_became_active":"2024-09-18T01:45:06.285500+0000","last_became_peered":"2024-09-18T01:45:06.285500+0000","last_unstale":"2024-09-18T01:48:12.800655+0000","last_undegraded":"2024-09-18T01:48:12.800655+0000","last_fullsized":"2024-09-18T01:48:12.800655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:25:24.068245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337324+0000","last_change":"2024-09-18T01:45:04.280448+0000","last_active":"2024-09-18T01:45:41.337324+0000","last_peered":"2024-09-18T01:45:41.337324+0000","last_clean":"2024-09-18T01:45:41.337324+0000","last_became_active":"2024-09-18T01:45:04.280147+0000","last_became_peered":"2024-09-18T01:45:04.280147+0000","last_unstale":"2024-09-18T01:45:41.337324+0000","last_undegraded":"2024-09-18T01:45:41.337324+0000","last_fullsized":"2024-09-18T01:45:41.337324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:08:58.229173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.840013+0000","last_change":"2024-09-18T01:45:06.278954+0000","last_active":"2024-09-18T01:48:12.840013+0000","last_peered":"2024-09-18T01:48:12.840013+0000","last_clean":"2024-09-18T01:48:12.840013+0000","last_became_active":"2024-09-18T01:45:06.278684+0000","last_became_peered":"2024-09-18T01:45:06.278684+0000","last_unstale":"2024-09-18T01:48:12.840013+0000","last_undegraded":"2024-09-18T01:48:12.840013+0000","last_fullsized":"2024-09-18T01:48:12.840013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:02:53.996881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.335905+0000","last_change":"2024-09-18T01:45:04.283274+0000","last_active":"2024-09-18T01:45:41.335905+0000","last_peered":"2024-09-18T01:45:41.335905+0000","last_clean":"2024-09-18T01:45:41.335905+0000","last_became_active":"2024-09-18T01:45:04.281920+0000","last_became_peered":"2024-09-18T01:45:04.281920+0000","last_unstale":"2024-09-18T01:45:41.335905+0000","last_undegraded":"2024-09-18T01:45:41.335905+0000","last_fullsized":"2024-09-18T01:45:41.335905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:33:35.587070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"33'6","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:46.587865+0000","last_change":"2024-09-18T01:45:06.282298+0000","last_active":"2024-09-18T01:45:46.587865+0000","last_peered":"2024-09-18T01:45:46.587865+0000","last_clean":"2024-09-18T01:45:46.587865+0000","last_became_active":"2024-09-18T01:45:06.281998+0000","last_became_peered":"2024-09-18T01:45:06.281998+0000","last_unstale":"2024-09-18T01:45:46.587865+0000","last_undegraded":"2024-09-18T01:45:46.587865+0000","last_fullsized":"2024-09-18T01:45:46.587865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:57:38.152681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:44.957231+0000","last_change":"2024-09-18T01:45:04.280466+0000","last_active":"2024-09-18T01:45:44.957231+0000","last_peered":"2024-09-18T01:45:44.957231+0000","last_clean":"2024-09-18T01:45:44.957231+0000","last_became_active":"2024-09-18T01:45:04.280066+0000","last_became_peered":"2024-09-18T01:45:04.280066+0000","last_unstale":"2024-09-18T01:45:44.957231+0000","last_undegraded":"2024-09-18T01:45:44.957231+0000","last_fullsized":"2024-09-18T01:45:44.957231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:10:25.987284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.173427+0000","last_change":"2024-09-18T01:45:06.285899+0000","last_active":"2024-09-18T01:47:12.173427+0000","last_peered":"2024-09-18T01:47:12.173427+0000","last_clean":"2024-09-18T01:47:12.173427+0000","last_became_active":"2024-09-18T01:45:06.285054+0000","last_became_peered":"2024-09-18T01:45:06.285054+0000","last_unstale":"2024-09-18T01:47:12.173427+0000","last_undegraded":"2024-09-18T01:47:12.173427+0000","last_fullsized":"2024-09-18T01:47:12.173427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:48:17.261741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.339308+0000","last_change":"2024-09-18T01:45:04.281591+0000","last_active":"2024-09-18T01:45:41.339308+0000","last_peered":"2024-09-18T01:45:41.339308+0000","last_clean":"2024-09-18T01:45:41.339308+0000","last_became_active":"2024-09-18T01:45:04.281146+0000","last_became_peered":"2024-09-18T01:45:04.281146+0000","last_unstale":"2024-09-18T01:45:41.339308+0000","last_undegraded":"2024-09-18T01:45:41.339308+0000","last_fullsized":"2024-09-18T01:45:41.339308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:51:35.728759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:09.011065+0000","last_change":"2024-09-18T01:45:06.292733+0000","last_active":"2024-09-18T01:47:09.011065+0000","last_peered":"2024-09-18T01:47:09.011065+0000","last_clean":"2024-09-18T01:47:09.011065+0000","last_became_active":"2024-09-18T01:45:06.292490+0000","last_became_peered":"2024-09-18T01:45:06.292490+0000","last_unstale":"2024-09-18T01:47:09.011065+0000","last_undegraded":"2024-09-18T01:47:09.011065+0000","last_fullsized":"2024-09-18T01:47:09.011065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:03:57.182802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337752+0000","last_change":"2024-09-18T01:45:04.294522+0000","last_active":"2024-09-18T01:45:41.337752+0000","last_peered":"2024-09-18T01:45:41.337752+0000","last_clean":"2024-09-18T01:45:41.337752+0000","last_became_active":"2024-09-18T01:45:04.293767+0000","last_became_peered":"2024-09-18T01:45:04.293767+0000","last_unstale":"2024-09-18T01:45:41.337752+0000","last_undegraded":"2024-09-18T01:45:41.337752+0000","last_fullsized":"2024-09-18T01:45:41.337752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:16:49.444181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"33'10","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:46.125920+0000","last_change":"2024-09-18T01:45:06.293722+0000","last_active":"2024-09-18T01:45:46.125920+0000","last_peered":"2024-09-18T01:45:46.125920+0000","last_clean":"2024-09-18T01:45:46.125920+0000","last_became_active":"2024-09-18T01:45:06.293369+0000","last_became_peered":"2024-09-18T01:45:06.293369+0000","last_unstale":"2024-09-18T01:45:46.125920+0000","last_undegraded":"2024-09-18T01:45:46.125920+0000","last_fullsized":"2024-09-18T01:45:46.125920+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:12:27.107318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.446582+0000","last_change":"2024-09-18T01:45:04.292372+0000","last_active":"2024-09-18T01:48:12.446582+0000","last_peered":"2024-09-18T01:48:12.446582+0000","last_clean":"2024-09-18T01:48:12.446582+0000","last_became_active":"2024-09-18T01:45:04.292056+0000","last_became_peered":"2024-09-18T01:45:04.292056+0000","last_unstale":"2024-09-18T01:48:12.446582+0000","last_undegraded":"2024-09-18T01:48:12.446582+0000","last_fullsized":"2024-09-18T01:48:12.446582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:08:58.229173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'8","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.558399+0000","last_change":"2024-09-18T01:45:06.296391+0000","last_active":"2024-09-18T01:48:12.558399+0000","last_peered":"2024-09-18T01:48:12.558399+0000","last_clean":"2024-09-18T01:48:12.558399+0000","last_became_active":"2024-09-18T01:45:06.295055+0000","last_became_peered":"2024-09-18T01:45:06.295055+0000","last_unstale":"2024-09-18T01:48:12.558399+0000","last_undegraded":"2024-09-18T01:48:12.558399+0000","last_fullsized":"2024-09-18T01:48:12.558399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:48:17.261741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.339526+0000","last_change":"2024-09-18T01:45:04.284398+0000","last_active":"2024-09-18T01:45:41.339526+0000","last_peered":"2024-09-18T01:45:41.339526+0000","last_clean":"2024-09-18T01:45:41.339526+0000","last_became_active":"2024-09-18T01:45:04.283959+0000","last_became_peered":"2024-09-18T01:45:04.283959+0000","last_unstale":"2024-09-18T01:45:41.339526+0000","last_undegraded":"2024-09-18T01:45:41.339526+0000","last_fullsized":"2024-09-18T01:45:41.339526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:34:13.707906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"33'4","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.840864+0000","last_change":"2024-09-18T01:45:06.295541+0000","last_active":"2024-09-18T01:48:12.840864+0000","last_peered":"2024-09-18T01:48:12.840864+0000","last_clean":"2024-09-18T01:48:12.840864+0000","last_became_active":"2024-09-18T01:45:06.295270+0000","last_became_peered":"2024-09-18T01:45:06.295270+0000","last_unstale":"2024-09-18T01:48:12.840864+0000","last_undegraded":"2024-09-18T01:48:12.840864+0000","last_fullsized":"2024-09-18T01:48:12.840864+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:29:37.540404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.334195+0000","last_change":"2024-09-18T01:45:04.280658+0000","last_active":"2024-09-18T01:45:41.334195+0000","last_peered":"2024-09-18T01:45:41.334195+0000","last_clean":"2024-09-18T01:45:41.334195+0000","last_became_active":"2024-09-18T01:45:04.278951+0000","last_became_peered":"2024-09-18T01:45:04.278951+0000","last_unstale":"2024-09-18T01:45:41.334195+0000","last_undegraded":"2024-09-18T01:45:41.334195+0000","last_fullsized":"2024-09-18T01:45:41.334195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:55:36.239236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.793558+0000","last_change":"2024-09-18T01:45:06.285555+0000","last_active":"2024-09-18T01:48:12.793558+0000","last_peered":"2024-09-18T01:48:12.793558+0000","last_clean":"2024-09-18T01:48:12.793558+0000","last_became_active":"2024-09-18T01:45:06.285272+0000","last_became_peered":"2024-09-18T01:45:06.285272+0000","last_unstale":"2024-09-18T01:48:12.793558+0000","last_undegraded":"2024-09-18T01:48:12.793558+0000","last_fullsized":"2024-09-18T01:48:12.793558+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:22:44.893210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337596+0000","last_change":"2024-09-18T01:45:04.281621+0000","last_active":"2024-09-18T01:45:41.337596+0000","last_peered":"2024-09-18T01:45:41.337596+0000","last_clean":"2024-09-18T01:45:41.337596+0000","last_became_active":"2024-09-18T01:45:04.281197+0000","last_became_peered":"2024-09-18T01:45:04.281197+0000","last_unstale":"2024-09-18T01:45:41.337596+0000","last_undegraded":"2024-09-18T01:45:41.337596+0000","last_fullsized":"2024-09-18T01:45:41.337596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:59:04.808153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"33'4","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:45.518377+0000","last_change":"2024-09-18T01:45:06.285297+0000","last_active":"2024-09-18T01:45:45.518377+0000","last_peered":"2024-09-18T01:45:45.518377+0000","last_clean":"2024-09-18T01:45:45.518377+0000","last_became_active":"2024-09-18T01:45:06.284989+0000","last_became_peered":"2024-09-18T01:45:06.284989+0000","last_unstale":"2024-09-18T01:45:45.518377+0000","last_undegraded":"2024-09-18T01:45:45.518377+0000","last_fullsized":"2024-09-18T01:45:45.518377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:45:59.773285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.335010+0000","last_change":"2024-09-18T01:45:04.295486+0000","last_active":"2024-09-18T01:45:41.335010+0000","last_peered":"2024-09-18T01:45:41.335010+0000","last_clean":"2024-09-18T01:45:41.335010+0000","last_became_active":"2024-09-18T01:45:04.294125+0000","last_became_peered":"2024-09-18T01:45:04.294125+0000","last_unstale":"2024-09-18T01:45:41.335010+0000","last_undegraded":"2024-09-18T01:45:41.335010+0000","last_fullsized":"2024-09-18T01:45:41.335010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:40:12.946584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"33'10","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.840269+0000","last_change":"2024-09-18T01:45:06.279731+0000","last_active":"2024-09-18T01:48:12.840269+0000","last_peered":"2024-09-18T01:48:12.840269+0000","last_clean":"2024-09-18T01:48:12.840269+0000","last_became_active":"2024-09-18T01:45:06.279373+0000","last_became_peered":"2024-09-18T01:45:06.279373+0000","last_unstale":"2024-09-18T01:48:12.840269+0000","last_undegraded":"2024-09-18T01:48:12.840269+0000","last_fullsized":"2024-09-18T01:48:12.840269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:15:48.322910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.519021+0000","last_change":"2024-09-18T01:45:04.291798+0000","last_active":"2024-09-18T01:48:12.519021+0000","last_peered":"2024-09-18T01:48:12.519021+0000","last_clean":"2024-09-18T01:48:12.519021+0000","last_became_active":"2024-09-18T01:45:04.291442+0000","last_became_peered":"2024-09-18T01:45:04.291442+0000","last_unstale":"2024-09-18T01:48:12.519021+0000","last_undegraded":"2024-09-18T01:48:12.519021+0000","last_fullsized":"2024-09-18T01:48:12.519021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:49:22.831669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'6","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:46:28.553120+0000","last_change":"2024-09-18T01:45:06.292853+0000","last_active":"2024-09-18T01:46:28.553120+0000","last_peered":"2024-09-18T01:46:28.553120+0000","last_clean":"2024-09-18T01:46:28.553120+0000","last_became_active":"2024-09-18T01:45:06.292425+0000","last_became_peered":"2024-09-18T01:45:06.292425+0000","last_unstale":"2024-09-18T01:46:28.553120+0000","last_undegraded":"2024-09-18T01:46:28.553120+0000","last_fullsized":"2024-09-18T01:46:28.553120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:20:03.455685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.336514+0000","last_change":"2024-09-18T01:45:04.289922+0000","last_active":"2024-09-18T01:45:41.336514+0000","last_peered":"2024-09-18T01:45:41.336514+0000","last_clean":"2024-09-18T01:45:41.336514+0000","last_became_active":"2024-09-18T01:45:04.289365+0000","last_became_peered":"2024-09-18T01:45:04.289365+0000","last_unstale":"2024-09-18T01:45:41.336514+0000","last_undegraded":"2024-09-18T01:45:41.336514+0000","last_fullsized":"2024-09-18T01:45:41.336514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:59:59.323704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.335795+0000","last_change":"2024-09-18T01:45:06.293694+0000","last_active":"2024-09-18T01:45:41.335795+0000","last_peered":"2024-09-18T01:45:41.335795+0000","last_clean":"2024-09-18T01:45:41.335795+0000","last_became_active":"2024-09-18T01:45:06.293403+0000","last_became_peered":"2024-09-18T01:45:06.293403+0000","last_unstale":"2024-09-18T01:45:41.335795+0000","last_undegraded":"2024-09-18T01:45:41.335795+0000","last_fullsized":"2024-09-18T01:45:41.335795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:44:48.704400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.341176+0000","last_change":"2024-09-18T01:45:04.278234+0000","last_active":"2024-09-18T01:45:41.341176+0000","last_peered":"2024-09-18T01:45:41.341176+0000","last_clean":"2024-09-18T01:45:41.341176+0000","last_became_active":"2024-09-18T01:45:04.277907+0000","last_became_peered":"2024-09-18T01:45:04.277907+0000","last_unstale":"2024-09-18T01:45:41.341176+0000","last_undegraded":"2024-09-18T01:45:41.341176+0000","last_fullsized":"2024-09-18T01:45:41.341176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:08:05.518412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'3","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:22.216025+0000","last_change":"2024-09-18T01:45:06.293343+0000","last_active":"2024-09-18T01:47:22.216025+0000","last_peered":"2024-09-18T01:47:22.216025+0000","last_clean":"2024-09-18T01:47:22.216025+0000","last_became_active":"2024-09-18T01:45:06.293036+0000","last_became_peered":"2024-09-18T01:45:06.293036+0000","last_unstale":"2024-09-18T01:47:22.216025+0000","last_undegraded":"2024-09-18T01:47:22.216025+0000","last_fullsized":"2024-09-18T01:47:22.216025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:09:07.849480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.334001+0000","last_change":"2024-09-18T01:45:04.287307+0000","last_active":"2024-09-18T01:45:41.334001+0000","last_peered":"2024-09-18T01:45:41.334001+0000","last_clean":"2024-09-18T01:45:41.334001+0000","last_became_active":"2024-09-18T01:45:04.286591+0000","last_became_peered":"2024-09-18T01:45:04.286591+0000","last_unstale":"2024-09-18T01:45:41.334001+0000","last_undegraded":"2024-09-18T01:45:41.334001+0000","last_fullsized":"2024-09-18T01:45:41.334001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:40:12.946584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.871486+0000","last_change":"2024-09-18T01:45:06.295984+0000","last_active":"2024-09-18T01:48:12.871486+0000","last_peered":"2024-09-18T01:48:12.871486+0000","last_clean":"2024-09-18T01:48:12.871486+0000","last_became_active":"2024-09-18T01:45:06.294911+0000","last_became_peered":"2024-09-18T01:45:06.294911+0000","last_unstale":"2024-09-18T01:48:12.871486+0000","last_undegraded":"2024-09-18T01:48:12.871486+0000","last_fullsized":"2024-09-18T01:48:12.871486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:33:43.173746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.866201+0000","last_change":"2024-09-18T01:45:04.287888+0000","last_active":"2024-09-18T01:48:12.866201+0000","last_peered":"2024-09-18T01:48:12.866201+0000","last_clean":"2024-09-18T01:48:12.866201+0000","last_became_active":"2024-09-18T01:45:04.285719+0000","last_became_peered":"2024-09-18T01:45:04.285719+0000","last_unstale":"2024-09-18T01:48:12.866201+0000","last_undegraded":"2024-09-18T01:48:12.866201+0000","last_fullsized":"2024-09-18T01:48:12.866201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:33:41.166250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.501440+0000","last_change":"2024-09-18T01:45:04.280417+0000","last_active":"2024-09-18T01:48:12.501440+0000","last_peered":"2024-09-18T01:48:12.501440+0000","last_clean":"2024-09-18T01:48:12.501440+0000","last_became_active":"2024-09-18T01:45:04.278266+0000","last_became_peered":"2024-09-18T01:45:04.278266+0000","last_unstale":"2024-09-18T01:48:12.501440+0000","last_undegraded":"2024-09-18T01:48:12.501440+0000","last_fullsized":"2024-09-18T01:48:12.501440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:25:22.060750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"33'10","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:46:28.553059+0000","last_change":"2024-09-18T01:45:06.292390+0000","last_active":"2024-09-18T01:46:28.553059+0000","last_peered":"2024-09-18T01:46:28.553059+0000","last_clean":"2024-09-18T01:46:28.553059+0000","last_became_active":"2024-09-18T01:45:06.292127+0000","last_became_peered":"2024-09-18T01:45:06.292127+0000","last_unstale":"2024-09-18T01:46:28.553059+0000","last_undegraded":"2024-09-18T01:46:28.553059+0000","last_fullsized":"2024-09-18T01:46:28.553059+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:00:01.331200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:45:41.337686+0000","last_change":"2024-09-18T01:45:04.273996+0000","last_active":"2024-09-18T01:45:41.337686+0000","last_peered":"2024-09-18T01:45:41.337686+0000","last_clean":"2024-09-18T01:45:41.337686+0000","last_became_active":"2024-09-18T01:45:04.273575+0000","last_became_peered":"2024-09-18T01:45:04.273575+0000","last_unstale":"2024-09-18T01:45:41.337686+0000","last_undegraded":"2024-09-18T01:45:41.337686+0000","last_fullsized":"2024-09-18T01:45:41.337686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:40:12.946584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'6","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.871024+0000","last_change":"2024-09-18T01:45:06.292393+0000","last_active":"2024-09-18T01:48:12.871024+0000","last_peered":"2024-09-18T01:48:12.871024+0000","last_clean":"2024-09-18T01:48:12.871024+0000","last_became_active":"2024-09-18T01:45:06.292037+0000","last_became_peered":"2024-09-18T01:45:06.292037+0000","last_unstale":"2024-09-18T01:48:12.871024+0000","last_undegraded":"2024-09-18T01:48:12.871024+0000","last_fullsized":"2024-09-18T01:48:12.871024+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:52:14.086589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":9385,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1888,"num_read_kb":1653,"num_write":789,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1569,"ondisk_log_size":1569,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1590,"num_read_kb":1480,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705710,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39976,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331864,"statfs":{"total":96636764160,"available":96595828736,"internally_reserved":0,"allocated":479232,"data_stored":150270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705710,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36320,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335520,"statfs":{"total":96636764160,"available":96599572480,"internally_reserved":0,"allocated":999424,"data_stored":737378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705710,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36352,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335488,"statfs":{"total":96636764160,"available":96599539712,"internally_reserved":0,"allocated":1028096,"data_stored":738692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705710,"num_pgs":150,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39936,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331904,"statfs":{"total":96636764160,"available":96595869696,"internally_reserved":0,"allocated":442368,"data_stored":148296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T01:48:23.977 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.977 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.977 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.977 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.977 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.978 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.978 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.978 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.978 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.978 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.978 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.978 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.978 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.978 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.978 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.979 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.979 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.979 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.979 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.979 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.979 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.979 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.979 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.979 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.980 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.980 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.980 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.980 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.980 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.980 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.980 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.980 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-18T01:45:07.267106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.980 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-18T01:45:09.276176+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.981 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-18T01:45:11.287699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.981 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.981 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.981 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.981 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-18T01:45:07.267106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.981 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-18T01:45:09.276176+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.981 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-18T01:45:11.287699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.981 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.981 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.982 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.982 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-18T01:45:07.267106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.982 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-18T01:45:09.276176+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.982 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-18T01:45:11.287699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.982 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.982 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.982 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.982 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-18T01:45:07.267106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.982 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-18T01:45:09.276176+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.983 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-18T01:45:11.287699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.983 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.983 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.983 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-18T01:45:07.267106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.983 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-18T01:45:09.276176+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.983 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-18T01:45:11.287699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.983 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.983 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.984 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.984 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-18T01:45:07.267106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.984 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-18T01:45:09.276176+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.984 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-18T01:45:11.287699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.984 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.984 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.985 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.985 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-18T01:45:07.267106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.985 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-18T01:45:09.276176+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.985 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-18T01:45:11.287699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.985 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.985 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.985 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.985 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-18T01:45:07.267106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.986 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-18T01:45:09.276176+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.986 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-18T01:45:11.287699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.986 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.986 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.986 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.986 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-18T01:45:07.267106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.986 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-18T01:45:09.276176+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.987 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-18T01:45:11.287699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.987 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.987 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.987 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.987 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-18T01:45:07.267106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.987 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-18T01:45:09.276176+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.987 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-18T01:45:11.287699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.987 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.988 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.988 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.988 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-18T01:45:07.267106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.988 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-18T01:45:09.276176+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.988 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-18T01:45:11.287699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.988 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.988 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.989 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.989 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-18T01:45:07.267106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.989 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-18T01:45:09.276176+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.989 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-18T01:45:11.287699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.989 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.989 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.989 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-18T01:44:48.210722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=44, tm_sec=48, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.989 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-18T01:44:52.219730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=44, tm_sec=52, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.990 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.990 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-18T01:45:07.267106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.990 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-18T01:45:09.276176+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.990 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-18T01:45:11.287699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.990 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.990 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.990 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-18T01:44:52.219730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=44, tm_sec=52, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.991 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.991 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-18T01:45:07.267106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.991 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-18T01:45:09.276176+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.991 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-18T01:45:11.287699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.991 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.991 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.991 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-18T01:44:52.219730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=44, tm_sec=52, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.992 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.992 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-18T01:45:07.267106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.992 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-18T01:45:09.276176+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.992 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-18T01:45:11.287699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.992 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.992 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.992 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-18T01:44:52.219730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=44, tm_sec=52, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.993 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.993 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-18T01:45:07.267106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.993 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-18T01:45:09.276176+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.993 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-18T01:45:11.287699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.993 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.993 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.993 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.993 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-18T01:44:52.219730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=44, tm_sec=52, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.994 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-18T01:45:07.267106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.994 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-18T01:45:09.276176+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.994 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-18T01:45:11.287699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.994 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.994 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.994 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.995 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-18T01:44:52.219730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=44, tm_sec=52, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.995 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-18T01:45:07.267106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.995 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-18T01:45:09.276176+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.995 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-18T01:45:11.287699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.995 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.995 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.995 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.995 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-18T01:44:52.219730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=44, tm_sec=52, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.996 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-18T01:45:07.267106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.996 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-18T01:45:09.276176+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.996 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-18T01:45:11.287699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.996 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.996 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.996 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.996 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-18T01:44:52.219730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=44, tm_sec=52, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.997 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-18T01:45:07.267106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.997 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-18T01:45:09.276176+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.997 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-18T01:45:11.287699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.997 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.997 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.997 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.997 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.997 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-18T01:45:07.267106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.998 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-18T01:45:09.276176+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.998 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-18T01:45:11.287699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.998 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.998 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.998 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.998 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-18T01:45:07.267106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.998 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-18T01:45:09.276176+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.998 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-18T01:45:11.287699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.998 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.999 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.999 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.999 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-18T01:45:07.267106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.999 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-18T01:45:09.276176+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.999 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-18T01:45:11.287699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.999 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.999 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:23.999 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.000 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-18T01:45:07.267106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.000 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-18T01:45:09.276176+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.000 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-18T01:45:11.287699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.000 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.000 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.000 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-18T01:45:07.267106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.000 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-18T01:45:09.276176+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.000 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-18T01:45:11.287699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.000 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.001 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.001 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.001 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-18T01:45:07.267106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.001 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-18T01:45:09.276176+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.001 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-18T01:45:11.287699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.001 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.001 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.001 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.002 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-18T01:45:07.267106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.002 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-18T01:45:09.276176+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.002 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-18T01:45:11.287699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.002 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.002 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.002 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.002 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-18T01:45:07.267106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.002 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-18T01:45:09.276176+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.002 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-18T01:45:11.287699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.003 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.003 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.003 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.003 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-18T01:45:07.267106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.003 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-18T01:45:09.276176+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.003 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-18T01:45:11.287699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.003 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.003 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.004 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.004 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-18T01:45:07.267106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.004 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-18T01:45:09.276176+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.004 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-18T01:45:11.287699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.004 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.004 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.004 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.004 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-18T01:45:07.267106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.004 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-18T01:45:09.276176+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.004 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-18T01:45:11.287699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.005 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.005 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.005 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.005 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-18T01:45:07.267106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.005 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-18T01:45:09.276176+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.005 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-18T01:45:11.287699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.005 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.005 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.005 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.006 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.006 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.006 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.006 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.006 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.006 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.006 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.006 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.006 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.007 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.007 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.007 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.007 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.007 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.007 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.007 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.007 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.007 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.007 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.007 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.008 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.008 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.008 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.008 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.008 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.008 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.008 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.008 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.008 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.008 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.009 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.009 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.009 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.009 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:24.009 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-18T01:48:44.010 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T01:48:44.122 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:44.121+0000 7fca6faac640 1 Processor -- start 2024-09-18T01:48:44.122 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:44.121+0000 7fca6faac640 1 -- start start 2024-09-18T01:48:44.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:44.121+0000 7fca6faac640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fca6812f9d0 0x7fca68131dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:44.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:44.121+0000 7fca6faac640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca68071f70 con 0x7fca6812cca0 2024-09-18T01:48:44.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:44.121+0000 7fca6faac640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x7fca6806e350 con 0x7fca6812f9d0 2024-09-18T01:48:44.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:44.122+0000 7fca6d047640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fca6812f9d0 0x7fca68131dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:44.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:44.122+0000 7fca6d848640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fca6812cca0 0x7fca6812d080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:36328/0 (socket says 172.21.15.129:36328) 2024-09-18T01:48:44.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:44.122+0000 7fca6d047640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fca6812f9d0 0x7fca68131dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:45608/0 (socket says 172.21.15.129:45608) 2024-09-18T01:48:44.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:44.122+0000 7fca6d848640 1 -- 172.21.15.129:0/364634341 learned_addr learned my addr 172.21.15.129:0/364634341 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-09-18T01:48:44.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:44.122+0000 7fca6d047640 1 -- 172.21.15.129:0/364634341 >> v1:172.21.15.129:6789/0 conn(0x7fca6812cca0 legacy=0x7fca6812d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:44.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:44.122+0000 7fca6d047640 1 -- 172.21.15.129:0/364634341 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca680715c0 con 0x7fca6812f9d0 2024-09-18T01:48:44.125 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:44.122+0000 7fca6d047640 1 --2- 172.21.15.129:0/364634341 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fca6812f9d0 0x7fca68131dc0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fca58009720 tx=0x7fca5802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6de14b880cf2f99 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:44.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:44.123+0000 7fca6c846640 1 -- 172.21.15.129:0/364634341 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca58037070 con 0x7fca6812f9d0 2024-09-18T01:48:44.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:44.123+0000 7fca6c846640 1 -- 172.21.15.129:0/364634341 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca5802ad90 con 0x7fca6812f9d0 2024-09-18T01:48:44.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:44.123+0000 7fca6c846640 1 -- 172.21.15.129:0/364634341 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca58032590 con 0x7fca6812f9d0 2024-09-18T01:48:44.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:44.123+0000 7fca6faac640 1 -- 172.21.15.129:0/364634341 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fca6812f9d0 msgr2=0x7fca68131dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:44.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:44.123+0000 7fca6faac640 1 --2- 172.21.15.129:0/364634341 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fca6812f9d0 0x7fca68131dc0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fca58009720 tx=0x7fca5802a110 comp rx=0 tx=0).stop 2024-09-18T01:48:44.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:44.123+0000 7fca6faac640 1 -- 172.21.15.129:0/364634341 shutdown_connections 2024-09-18T01:48:44.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:44.123+0000 7fca6faac640 1 --2- 172.21.15.129:0/364634341 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fca6812f9d0 0x7fca68131dc0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:44.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:44.123+0000 7fca6faac640 1 -- 172.21.15.129:0/364634341 >> 172.21.15.129:0/364634341 conn(0x7fca6809a890 msgr2=0x7fca6809aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:48:44.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:44.123+0000 7fca6faac640 1 -- 172.21.15.129:0/364634341 shutdown_connections 2024-09-18T01:48:44.126 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:44.123+0000 7fca6faac640 1 -- 172.21.15.129:0/364634341 wait complete. 2024-09-18T01:48:44.129 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:44.124+0000 7fca6faac640 1 Processor -- start 2024-09-18T01:48:44.129 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:44.124+0000 7fca6faac640 1 -- start start 2024-09-18T01:48:44.129 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:44.125+0000 7fca6faac640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fca6812cca0 0x7fca681258b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:44.129 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:44.125+0000 7fca6faac640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fca6812ca50 con 0x7fca6812cca0 2024-09-18T01:48:44.129 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:44.125+0000 7fca6d848640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fca6812cca0 0x7fca681258b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:44.129 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:44.125+0000 7fca6d848640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fca6812cca0 0x7fca681258b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:45624/0 (socket says 172.21.15.129:45624) 2024-09-18T01:48:44.129 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:44.125+0000 7fca6d848640 1 -- 172.21.15.129:0/388794801 learned_addr learned my addr 172.21.15.129:0/388794801 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-18T01:48:44.129 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:44.125+0000 7fca6d848640 1 -- 172.21.15.129:0/388794801 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca68123af0 con 0x7fca6812cca0 2024-09-18T01:48:44.129 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:44.125+0000 7fca6d848640 1 --2- 172.21.15.129:0/388794801 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fca6812cca0 0x7fca681258b0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fca6400c480 tx=0x7fca6400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:44.129 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:44.125+0000 7fca5e7fc640 1 -- 172.21.15.129:0/388794801 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca64017070 con 0x7fca6812cca0 2024-09-18T01:48:44.130 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:44.125+0000 7fca5e7fc640 1 -- 172.21.15.129:0/388794801 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca64005c10 con 0x7fca6812cca0 2024-09-18T01:48:44.130 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:44.125+0000 7fca6faac640 1 -- 172.21.15.129:0/388794801 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca68126db0 con 0x7fca6812cca0 2024-09-18T01:48:44.130 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:44.125+0000 7fca5e7fc640 1 -- 172.21.15.129:0/388794801 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca640070d0 con 0x7fca6812cca0 2024-09-18T01:48:44.130 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:44.125+0000 7fca6faac640 1 -- 172.21.15.129:0/388794801 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca68125df0 con 0x7fca6812cca0 2024-09-18T01:48:44.130 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:44.126+0000 7fca5e7fc640 1 -- 172.21.15.129:0/388794801 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fca6401a070 con 0x7fca6812cca0 2024-09-18T01:48:44.130 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:44.126+0000 7fca6faac640 1 -- 172.21.15.129:0/388794801 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca68073120 con 0x7fca6812cca0 2024-09-18T01:48:44.130 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:44.126+0000 7fca5e7fc640 1 --2- 172.21.15.129:0/388794801 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fca4c0382a0 0x7fca4c03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:48:44.130 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:44.126+0000 7fca5e7fc640 1 -- 172.21.15.129:0/388794801 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7fca6404af70 con 0x7fca6812cca0 2024-09-18T01:48:44.130 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:44.127+0000 7fca6d047640 1 --2- 172.21.15.129:0/388794801 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fca4c0382a0 0x7fca4c03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:48:44.130 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:44.127+0000 7fca6d047640 1 --2- 172.21.15.129:0/388794801 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fca4c0382a0 0x7fca4c03a760 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fca58009720 tx=0x7fca5802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:48:44.132 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:44.131+0000 7fca5e7fc640 1 -- 172.21.15.129:0/388794801 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fca68073120 con 0x7fca6812cca0 2024-09-18T01:48:44.296 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:44.295+0000 7fca6faac640 1 -- 172.21.15.129:0/388794801 --> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fca68124af0 con 0x7fca4c0382a0 2024-09-18T01:48:44.312 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:44.311+0000 7fca5e7fc640 1 -- 172.21.15.129:0/388794801 <== mgr.4099 v2:172.21.15.146:6824/168968651 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+658930 (secure 0 0 0) 0x7fca68124af0 con 0x7fca4c0382a0 2024-09-18T01:48:44.319 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:48:44.325 INFO:teuthology.orchestra.run.smithi129.stderr:dumped all 2024-09-18T01:48:44.326 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:44.316+0000 7fca6faac640 1 -- 172.21.15.129:0/388794801 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fca4c0382a0 msgr2=0x7fca4c03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:44.326 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:44.316+0000 7fca6faac640 1 --2- 172.21.15.129:0/388794801 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fca4c0382a0 0x7fca4c03a760 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fca58009720 tx=0x7fca5802e000 comp rx=0 tx=0).stop 2024-09-18T01:48:44.326 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:44.316+0000 7fca6faac640 1 -- 172.21.15.129:0/388794801 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fca6812cca0 msgr2=0x7fca681258b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:48:44.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:44.316+0000 7fca6faac640 1 --2- 172.21.15.129:0/388794801 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fca6812cca0 0x7fca681258b0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fca6400c480 tx=0x7fca6400c940 comp rx=0 tx=0).stop 2024-09-18T01:48:44.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:44.316+0000 7fca6faac640 1 -- 172.21.15.129:0/388794801 shutdown_connections 2024-09-18T01:48:44.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:44.316+0000 7fca6faac640 1 --2- 172.21.15.129:0/388794801 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fca4c0382a0 0x7fca4c03a760 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:44.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:44.316+0000 7fca6faac640 1 --2- 172.21.15.129:0/388794801 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fca6812cca0 0x7fca681258b0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:48:44.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:44.316+0000 7fca6faac640 1 -- 172.21.15.129:0/388794801 >> 172.21.15.129:0/388794801 conn(0x7fca6809a890 msgr2=0x7fca68097ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:48:44.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:44.316+0000 7fca6faac640 1 -- 172.21.15.129:0/388794801 shutdown_connections 2024-09-18T01:48:44.327 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:48:44.316+0000 7fca6faac640 1 -- 172.21.15.129:0/388794801 wait complete. 2024-09-18T01:48:44.328 INFO:teuthology.orchestra.run.smithi129.stdout:{"pg_ready":true,"pg_map":{"version":149,"stamp":"2024-09-18T01:48:44.249542+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":603113,"num_objects":254,"num_object_clones":0,"num_object_copies":508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":254,"num_whiteouts":0,"num_read":5366,"num_read_kb":4915,"num_write":2371,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1554,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4952,"ondisk_log_size":4952,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":156736,"kb_used_data":2880,"kb_used_omap":6,"kb_used_meta":153785,"kb_avail":377330624,"statfs":{"total":386547056640,"available":386386558976,"internally_reserved":0,"allocated":2949120,"data_stored":1774636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":157476631},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1262,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004254"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.214344+0000","last_change":"2024-09-18T01:45:04.287665+0000","last_active":"2024-09-18T01:47:12.214344+0000","last_peered":"2024-09-18T01:47:12.214344+0000","last_clean":"2024-09-18T01:47:12.214344+0000","last_became_active":"2024-09-18T01:45:04.287322+0000","last_became_peered":"2024-09-18T01:45:04.287322+0000","last_unstale":"2024-09-18T01:47:12.214344+0000","last_undegraded":"2024-09-18T01:47:12.214344+0000","last_fullsized":"2024-09-18T01:47:12.214344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"33'8","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.880341+0000","last_change":"2024-09-18T01:45:06.296427+0000","last_active":"2024-09-18T01:48:12.880341+0000","last_peered":"2024-09-18T01:48:12.880341+0000","last_clean":"2024-09-18T01:48:12.880341+0000","last_became_active":"2024-09-18T01:45:06.295819+0000","last_became_peered":"2024-09-18T01:45:06.295819+0000","last_unstale":"2024-09-18T01:48:12.880341+0000","last_undegraded":"2024-09-18T01:48:12.880341+0000","last_fullsized":"2024-09-18T01:48:12.880341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.212756+0000","last_change":"2024-09-18T01:45:04.280965+0000","last_active":"2024-09-18T01:47:12.212756+0000","last_peered":"2024-09-18T01:47:12.212756+0000","last_clean":"2024-09-18T01:47:12.212756+0000","last_became_active":"2024-09-18T01:45:04.280591+0000","last_became_peered":"2024-09-18T01:45:04.280591+0000","last_unstale":"2024-09-18T01:47:12.212756+0000","last_undegraded":"2024-09-18T01:47:12.212756+0000","last_fullsized":"2024-09-18T01:47:12.212756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"33'12","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.880422+0000","last_change":"2024-09-18T01:45:06.282040+0000","last_active":"2024-09-18T01:48:12.880422+0000","last_peered":"2024-09-18T01:48:12.880422+0000","last_clean":"2024-09-18T01:48:12.880422+0000","last_became_active":"2024-09-18T01:45:06.281659+0000","last_became_peered":"2024-09-18T01:45:06.281659+0000","last_unstale":"2024-09-18T01:48:12.880422+0000","last_undegraded":"2024-09-18T01:48:12.880422+0000","last_fullsized":"2024-09-18T01:48:12.880422+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"33'5","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.214522+0000","last_change":"2024-09-18T01:45:04.287682+0000","last_active":"2024-09-18T01:47:12.214522+0000","last_peered":"2024-09-18T01:47:12.214522+0000","last_clean":"2024-09-18T01:47:12.214522+0000","last_became_active":"2024-09-18T01:45:04.286007+0000","last_became_peered":"2024-09-18T01:45:04.286007+0000","last_unstale":"2024-09-18T01:47:12.214522+0000","last_undegraded":"2024-09-18T01:47:12.214522+0000","last_fullsized":"2024-09-18T01:47:12.214522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"33'18","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:37.219039+0000","last_change":"2024-09-18T01:45:06.285754+0000","last_active":"2024-09-18T01:47:37.219039+0000","last_peered":"2024-09-18T01:47:37.219039+0000","last_clean":"2024-09-18T01:47:37.219039+0000","last_became_active":"2024-09-18T01:45:06.285378+0000","last_became_peered":"2024-09-18T01:45:06.285378+0000","last_unstale":"2024-09-18T01:47:37.219039+0000","last_undegraded":"2024-09-18T01:47:37.219039+0000","last_fullsized":"2024-09-18T01:47:37.219039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":40,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:07.213525+0000","last_change":"2024-09-18T01:45:04.298111+0000","last_active":"2024-09-18T01:47:07.213525+0000","last_peered":"2024-09-18T01:47:07.213525+0000","last_clean":"2024-09-18T01:47:07.213525+0000","last_became_active":"2024-09-18T01:45:04.297791+0000","last_became_peered":"2024-09-18T01:45:04.297791+0000","last_unstale":"2024-09-18T01:47:07.213525+0000","last_undegraded":"2024-09-18T01:47:07.213525+0000","last_fullsized":"2024-09-18T01:47:07.213525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"33'6","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.931986+0000","last_change":"2024-09-18T01:45:06.281604+0000","last_active":"2024-09-18T01:48:12.931986+0000","last_peered":"2024-09-18T01:48:12.931986+0000","last_clean":"2024-09-18T01:48:12.931986+0000","last_became_active":"2024-09-18T01:45:06.280779+0000","last_became_peered":"2024-09-18T01:45:06.280779+0000","last_unstale":"2024-09-18T01:48:12.931986+0000","last_undegraded":"2024-09-18T01:48:12.931986+0000","last_fullsized":"2024-09-18T01:48:12.931986+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:37.219085+0000","last_change":"2024-09-18T01:45:04.280905+0000","last_active":"2024-09-18T01:47:37.219085+0000","last_peered":"2024-09-18T01:47:37.219085+0000","last_clean":"2024-09-18T01:47:37.219085+0000","last_became_active":"2024-09-18T01:45:04.280582+0000","last_became_peered":"2024-09-18T01:45:04.280582+0000","last_unstale":"2024-09-18T01:47:37.219085+0000","last_undegraded":"2024-09-18T01:47:37.219085+0000","last_fullsized":"2024-09-18T01:47:37.219085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'12","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.170769+0000","last_change":"2024-09-18T01:45:06.289323+0000","last_active":"2024-09-18T01:47:12.170769+0000","last_peered":"2024-09-18T01:47:12.170769+0000","last_clean":"2024-09-18T01:47:12.170769+0000","last_became_active":"2024-09-18T01:45:06.289036+0000","last_became_peered":"2024-09-18T01:45:06.289036+0000","last_unstale":"2024-09-18T01:47:12.170769+0000","last_undegraded":"2024-09-18T01:47:12.170769+0000","last_fullsized":"2024-09-18T01:47:12.170769+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:37.219091+0000","last_change":"2024-09-18T01:45:04.286820+0000","last_active":"2024-09-18T01:47:37.219091+0000","last_peered":"2024-09-18T01:47:37.219091+0000","last_clean":"2024-09-18T01:47:37.219091+0000","last_became_active":"2024-09-18T01:45:04.286509+0000","last_became_peered":"2024-09-18T01:45:04.286509+0000","last_unstale":"2024-09-18T01:47:37.219091+0000","last_undegraded":"2024-09-18T01:47:37.219091+0000","last_fullsized":"2024-09-18T01:47:37.219091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:42.024892+0000","last_change":"2024-09-18T01:48:42.024918+0000","last_active":"2024-09-18T01:48:42.024892+0000","last_peered":"2024-09-18T01:48:42.024892+0000","last_clean":"2024-09-18T01:48:42.024892+0000","last_became_active":"2024-09-18T01:45:06.287110+0000","last_became_peered":"2024-09-18T01:45:06.287110+0000","last_unstale":"2024-09-18T01:48:42.024892+0000","last_undegraded":"2024-09-18T01:48:42.024892+0000","last_fullsized":"2024-09-18T01:48:42.024892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:48:42.024803+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:48:42.024803+0000","last_clean_scrub_stamp":"2024-09-18T01:48:42.024803+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:37:11.999864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.777098+0000","last_change":"2024-09-18T01:45:04.293823+0000","last_active":"2024-09-18T01:48:12.777098+0000","last_peered":"2024-09-18T01:48:12.777098+0000","last_clean":"2024-09-18T01:48:12.777098+0000","last_became_active":"2024-09-18T01:45:04.289290+0000","last_became_peered":"2024-09-18T01:45:04.289290+0000","last_unstale":"2024-09-18T01:48:12.777098+0000","last_undegraded":"2024-09-18T01:48:12.777098+0000","last_fullsized":"2024-09-18T01:48:12.777098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'13","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.934660+0000","last_change":"2024-09-18T01:45:06.295725+0000","last_active":"2024-09-18T01:48:12.934660+0000","last_peered":"2024-09-18T01:48:12.934660+0000","last_clean":"2024-09-18T01:48:12.934660+0000","last_became_active":"2024-09-18T01:45:06.295429+0000","last_became_peered":"2024-09-18T01:45:06.295429+0000","last_unstale":"2024-09-18T01:48:12.934660+0000","last_undegraded":"2024-09-18T01:48:12.934660+0000","last_fullsized":"2024-09-18T01:48:12.934660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:37.216316+0000","last_change":"2024-09-18T01:45:04.273877+0000","last_active":"2024-09-18T01:47:37.216316+0000","last_peered":"2024-09-18T01:47:37.216316+0000","last_clean":"2024-09-18T01:47:37.216316+0000","last_became_active":"2024-09-18T01:45:04.273328+0000","last_became_peered":"2024-09-18T01:45:04.273328+0000","last_unstale":"2024-09-18T01:47:37.216316+0000","last_undegraded":"2024-09-18T01:47:37.216316+0000","last_fullsized":"2024-09-18T01:47:37.216316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'9","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.934602+0000","last_change":"2024-09-18T01:45:06.285251+0000","last_active":"2024-09-18T01:48:12.934602+0000","last_peered":"2024-09-18T01:48:12.934602+0000","last_clean":"2024-09-18T01:48:12.934602+0000","last_became_active":"2024-09-18T01:45:06.284994+0000","last_became_peered":"2024-09-18T01:45:06.284994+0000","last_unstale":"2024-09-18T01:48:12.934602+0000","last_undegraded":"2024-09-18T01:48:12.934602+0000","last_fullsized":"2024-09-18T01:48:12.934602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"33'4","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:27.216970+0000","last_change":"2024-09-18T01:45:06.286775+0000","last_active":"2024-09-18T01:47:27.216970+0000","last_peered":"2024-09-18T01:47:27.216970+0000","last_clean":"2024-09-18T01:47:27.216970+0000","last_became_active":"2024-09-18T01:45:06.286524+0000","last_became_peered":"2024-09-18T01:45:06.286524+0000","last_unstale":"2024-09-18T01:47:27.216970+0000","last_undegraded":"2024-09-18T01:47:27.216970+0000","last_fullsized":"2024-09-18T01:47:27.216970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:32.218167+0000","last_change":"2024-09-18T01:45:04.298742+0000","last_active":"2024-09-18T01:47:32.218167+0000","last_peered":"2024-09-18T01:47:32.218167+0000","last_clean":"2024-09-18T01:47:32.218167+0000","last_became_active":"2024-09-18T01:45:04.298399+0000","last_became_peered":"2024-09-18T01:45:04.298399+0000","last_unstale":"2024-09-18T01:47:32.218167+0000","last_undegraded":"2024-09-18T01:47:32.218167+0000","last_fullsized":"2024-09-18T01:47:32.218167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"33'10","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:27.217006+0000","last_change":"2024-09-18T01:45:06.294964+0000","last_active":"2024-09-18T01:47:27.217006+0000","last_peered":"2024-09-18T01:47:27.217006+0000","last_clean":"2024-09-18T01:47:27.217006+0000","last_became_active":"2024-09-18T01:45:06.294670+0000","last_became_peered":"2024-09-18T01:45:06.294670+0000","last_unstale":"2024-09-18T01:47:27.217006+0000","last_undegraded":"2024-09-18T01:47:27.217006+0000","last_fullsized":"2024-09-18T01:47:27.217006+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:32.218167+0000","last_change":"2024-09-18T01:45:04.286914+0000","last_active":"2024-09-18T01:47:32.218167+0000","last_peered":"2024-09-18T01:47:32.218167+0000","last_clean":"2024-09-18T01:47:32.218167+0000","last_became_active":"2024-09-18T01:45:04.286465+0000","last_became_peered":"2024-09-18T01:45:04.286465+0000","last_unstale":"2024-09-18T01:47:32.218167+0000","last_undegraded":"2024-09-18T01:47:32.218167+0000","last_fullsized":"2024-09-18T01:47:32.218167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'3","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.932141+0000","last_change":"2024-09-18T01:45:06.294374+0000","last_active":"2024-09-18T01:48:12.932141+0000","last_peered":"2024-09-18T01:48:12.932141+0000","last_clean":"2024-09-18T01:48:12.932141+0000","last_became_active":"2024-09-18T01:45:06.294118+0000","last_became_peered":"2024-09-18T01:45:06.294118+0000","last_unstale":"2024-09-18T01:48:12.932141+0000","last_undegraded":"2024-09-18T01:48:12.932141+0000","last_fullsized":"2024-09-18T01:48:12.932141+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:32.218073+0000","last_change":"2024-09-18T01:45:04.294733+0000","last_active":"2024-09-18T01:47:32.218073+0000","last_peered":"2024-09-18T01:47:32.218073+0000","last_clean":"2024-09-18T01:47:32.218073+0000","last_became_active":"2024-09-18T01:45:04.294327+0000","last_became_peered":"2024-09-18T01:45:04.294327+0000","last_unstale":"2024-09-18T01:47:32.218073+0000","last_undegraded":"2024-09-18T01:47:32.218073+0000","last_fullsized":"2024-09-18T01:47:32.218073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'4","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:32.215625+0000","last_change":"2024-09-18T01:45:06.285844+0000","last_active":"2024-09-18T01:47:32.215625+0000","last_peered":"2024-09-18T01:47:32.215625+0000","last_clean":"2024-09-18T01:47:32.215625+0000","last_became_active":"2024-09-18T01:45:06.285429+0000","last_became_peered":"2024-09-18T01:45:06.285429+0000","last_unstale":"2024-09-18T01:47:32.215625+0000","last_undegraded":"2024-09-18T01:47:32.215625+0000","last_fullsized":"2024-09-18T01:47:32.215625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:32.218047+0000","last_change":"2024-09-18T01:45:04.299057+0000","last_active":"2024-09-18T01:47:32.218047+0000","last_peered":"2024-09-18T01:47:32.218047+0000","last_clean":"2024-09-18T01:47:32.218047+0000","last_became_active":"2024-09-18T01:45:04.298601+0000","last_became_peered":"2024-09-18T01:45:04.298601+0000","last_unstale":"2024-09-18T01:47:32.218047+0000","last_undegraded":"2024-09-18T01:47:32.218047+0000","last_fullsized":"2024-09-18T01:47:32.218047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'10","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.566754+0000","last_change":"2024-09-18T01:45:06.286133+0000","last_active":"2024-09-18T01:48:12.566754+0000","last_peered":"2024-09-18T01:48:12.566754+0000","last_clean":"2024-09-18T01:48:12.566754+0000","last_became_active":"2024-09-18T01:45:06.285228+0000","last_became_peered":"2024-09-18T01:45:06.285228+0000","last_unstale":"2024-09-18T01:48:12.566754+0000","last_undegraded":"2024-09-18T01:48:12.566754+0000","last_fullsized":"2024-09-18T01:48:12.566754+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:32.215612+0000","last_change":"2024-09-18T01:45:04.281502+0000","last_active":"2024-09-18T01:47:32.215612+0000","last_peered":"2024-09-18T01:47:32.215612+0000","last_clean":"2024-09-18T01:47:32.215612+0000","last_became_active":"2024-09-18T01:45:04.281118+0000","last_became_peered":"2024-09-18T01:45:04.281118+0000","last_unstale":"2024-09-18T01:47:32.215612+0000","last_undegraded":"2024-09-18T01:47:32.215612+0000","last_fullsized":"2024-09-18T01:47:32.215612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"33'16","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.800882+0000","last_change":"2024-09-18T01:45:06.284548+0000","last_active":"2024-09-18T01:48:12.800882+0000","last_peered":"2024-09-18T01:48:12.800882+0000","last_clean":"2024-09-18T01:48:12.800882+0000","last_became_active":"2024-09-18T01:45:06.284237+0000","last_became_peered":"2024-09-18T01:45:06.284237+0000","last_unstale":"2024-09-18T01:48:12.800882+0000","last_undegraded":"2024-09-18T01:48:12.800882+0000","last_fullsized":"2024-09-18T01:48:12.800882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":48,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:27.217055+0000","last_change":"2024-09-18T01:45:04.285185+0000","last_active":"2024-09-18T01:47:27.217055+0000","last_peered":"2024-09-18T01:47:27.217055+0000","last_clean":"2024-09-18T01:47:27.217055+0000","last_became_active":"2024-09-18T01:45:04.284148+0000","last_became_peered":"2024-09-18T01:45:04.284148+0000","last_unstale":"2024-09-18T01:47:27.217055+0000","last_undegraded":"2024-09-18T01:47:27.217055+0000","last_fullsized":"2024-09-18T01:47:27.217055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'35","reported_seq":100,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.889492+0000","last_change":"2024-09-18T01:45:14.323024+0000","last_active":"2024-09-18T01:48:12.889492+0000","last_peered":"2024-09-18T01:48:12.889492+0000","last_clean":"2024-09-18T01:48:12.889492+0000","last_became_active":"2024-09-18T01:45:14.322729+0000","last_became_peered":"2024-09-18T01:45:14.322729+0000","last_unstale":"2024-09-18T01:48:12.889492+0000","last_undegraded":"2024-09-18T01:48:12.889492+0000","last_fullsized":"2024-09-18T01:48:12.889492+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'10","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.567043+0000","last_change":"2024-09-18T01:45:06.281639+0000","last_active":"2024-09-18T01:48:12.567043+0000","last_peered":"2024-09-18T01:48:12.567043+0000","last_clean":"2024-09-18T01:48:12.567043+0000","last_became_active":"2024-09-18T01:45:06.281361+0000","last_became_peered":"2024-09-18T01:45:06.281361+0000","last_unstale":"2024-09-18T01:48:12.567043+0000","last_undegraded":"2024-09-18T01:48:12.567043+0000","last_fullsized":"2024-09-18T01:48:12.567043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.488665+0000","last_change":"2024-09-18T01:45:04.285350+0000","last_active":"2024-09-18T01:48:19.488665+0000","last_peered":"2024-09-18T01:48:19.488665+0000","last_clean":"2024-09-18T01:48:19.488665+0000","last_became_active":"2024-09-18T01:45:04.285008+0000","last_became_peered":"2024-09-18T01:45:04.285008+0000","last_unstale":"2024-09-18T01:48:19.488665+0000","last_undegraded":"2024-09-18T01:48:19.488665+0000","last_fullsized":"2024-09-18T01:48:19.488665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:25.014640+0000","last_change":"2024-09-18T01:48:25.014675+0000","last_active":"2024-09-18T01:48:25.014640+0000","last_peered":"2024-09-18T01:48:25.014640+0000","last_clean":"2024-09-18T01:48:25.014640+0000","last_became_active":"2024-09-18T01:45:08.296241+0000","last_became_peered":"2024-09-18T01:45:08.296241+0000","last_unstale":"2024-09-18T01:48:25.014640+0000","last_undegraded":"2024-09-18T01:48:25.014640+0000","last_fullsized":"2024-09-18T01:48:25.014640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:25.014547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:25.014547+0000","last_clean_scrub_stamp":"2024-09-18T01:48:25.014547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:06:32.938495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'51","reported_seq":118,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:29.025471+0000","last_change":"2024-09-18T01:48:29.025537+0000","last_active":"2024-09-18T01:48:29.025471+0000","last_peered":"2024-09-18T01:48:29.025471+0000","last_clean":"2024-09-18T01:48:29.025471+0000","last_became_active":"2024-09-18T01:45:10.305713+0000","last_became_peered":"2024-09-18T01:45:10.305713+0000","last_unstale":"2024-09-18T01:48:29.025471+0000","last_undegraded":"2024-09-18T01:48:29.025471+0000","last_fullsized":"2024-09-18T01:48:29.025471+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'51","last_scrub_stamp":"2024-09-18T01:48:29.025349+0000","last_deep_scrub":"33'51","last_deep_scrub_stamp":"2024-09-18T01:48:29.025349+0000","last_clean_scrub_stamp":"2024-09-18T01:48:29.025349+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:55:10.299048+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:26.973099+0000","last_change":"2024-09-18T01:48:26.973124+0000","last_active":"2024-09-18T01:48:26.973099+0000","last_peered":"2024-09-18T01:48:26.973099+0000","last_clean":"2024-09-18T01:48:26.973099+0000","last_became_active":"2024-09-18T01:45:12.313276+0000","last_became_peered":"2024-09-18T01:45:12.313276+0000","last_unstale":"2024-09-18T01:48:26.973099+0000","last_undegraded":"2024-09-18T01:48:26.973099+0000","last_fullsized":"2024-09-18T01:48:26.973099+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:26.973012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:26.973012+0000","last_clean_scrub_stamp":"2024-09-18T01:48:26.973012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:54:46.334494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'7","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:42.219933+0000","last_change":"2024-09-18T01:45:14.318360+0000","last_active":"2024-09-18T01:47:42.219933+0000","last_peered":"2024-09-18T01:47:42.219933+0000","last_clean":"2024-09-18T01:47:42.219933+0000","last_became_active":"2024-09-18T01:45:14.318093+0000","last_became_peered":"2024-09-18T01:45:14.318093+0000","last_unstale":"2024-09-18T01:47:42.219933+0000","last_undegraded":"2024-09-18T01:47:42.219933+0000","last_fullsized":"2024-09-18T01:47:42.219933+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"33'13","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.929325+0000","last_change":"2024-09-18T01:45:41.348633+0000","last_active":"2024-09-18T01:48:12.929325+0000","last_peered":"2024-09-18T01:48:12.929325+0000","last_clean":"2024-09-18T01:48:12.929325+0000","last_became_active":"2024-09-18T01:45:41.338243+0000","last_became_peered":"2024-09-18T01:45:41.338243+0000","last_unstale":"2024-09-18T01:48:12.929325+0000","last_undegraded":"2024-09-18T01:48:12.929325+0000","last_fullsized":"2024-09-18T01:48:12.929325+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":13,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:27.216966+0000","last_change":"2024-09-18T01:45:04.293264+0000","last_active":"2024-09-18T01:47:27.216966+0000","last_peered":"2024-09-18T01:47:27.216966+0000","last_clean":"2024-09-18T01:47:27.216966+0000","last_became_active":"2024-09-18T01:45:04.292853+0000","last_became_peered":"2024-09-18T01:45:04.292853+0000","last_unstale":"2024-09-18T01:47:27.216966+0000","last_undegraded":"2024-09-18T01:47:27.216966+0000","last_fullsized":"2024-09-18T01:47:27.216966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:32.215636+0000","last_change":"2024-09-18T01:45:08.288697+0000","last_active":"2024-09-18T01:47:32.215636+0000","last_peered":"2024-09-18T01:47:32.215636+0000","last_clean":"2024-09-18T01:47:32.215636+0000","last_became_active":"2024-09-18T01:45:08.288390+0000","last_became_peered":"2024-09-18T01:45:08.288390+0000","last_unstale":"2024-09-18T01:47:32.215636+0000","last_undegraded":"2024-09-18T01:47:32.215636+0000","last_fullsized":"2024-09-18T01:47:32.215636+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"33'16","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:28.924284+0000","last_change":"2024-09-18T01:48:28.924317+0000","last_active":"2024-09-18T01:48:28.924284+0000","last_peered":"2024-09-18T01:48:28.924284+0000","last_clean":"2024-09-18T01:48:28.924284+0000","last_became_active":"2024-09-18T01:45:10.302957+0000","last_became_peered":"2024-09-18T01:45:10.302957+0000","last_unstale":"2024-09-18T01:48:28.924284+0000","last_undegraded":"2024-09-18T01:48:28.924284+0000","last_fullsized":"2024-09-18T01:48:28.924284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2024-09-18T01:48:28.924202+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2024-09-18T01:48:28.924202+0000","last_clean_scrub_stamp":"2024-09-18T01:48:28.924202+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:40:38.196180+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:34.948777+0000","last_change":"2024-09-18T01:48:34.948803+0000","last_active":"2024-09-18T01:48:34.948777+0000","last_peered":"2024-09-18T01:48:34.948777+0000","last_clean":"2024-09-18T01:48:34.948777+0000","last_became_active":"2024-09-18T01:45:12.317471+0000","last_became_peered":"2024-09-18T01:45:12.317471+0000","last_unstale":"2024-09-18T01:48:34.948777+0000","last_undegraded":"2024-09-18T01:48:34.948777+0000","last_fullsized":"2024-09-18T01:48:34.948777+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:34.948683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:34.948683+0000","last_clean_scrub_stamp":"2024-09-18T01:48:34.948683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:47:33.161713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:47.217975+0000","last_change":"2024-09-18T01:45:14.319762+0000","last_active":"2024-09-18T01:47:47.217975+0000","last_peered":"2024-09-18T01:47:47.217975+0000","last_clean":"2024-09-18T01:47:47.217975+0000","last_became_active":"2024-09-18T01:45:14.319387+0000","last_became_peered":"2024-09-18T01:45:14.319387+0000","last_unstale":"2024-09-18T01:47:47.217975+0000","last_undegraded":"2024-09-18T01:47:47.217975+0000","last_fullsized":"2024-09-18T01:47:47.217975+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'10","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:32.218154+0000","last_change":"2024-09-18T01:45:06.284632+0000","last_active":"2024-09-18T01:47:32.218154+0000","last_peered":"2024-09-18T01:47:32.218154+0000","last_clean":"2024-09-18T01:47:32.218154+0000","last_became_active":"2024-09-18T01:45:06.283815+0000","last_became_peered":"2024-09-18T01:45:06.283815+0000","last_unstale":"2024-09-18T01:47:32.218154+0000","last_undegraded":"2024-09-18T01:47:32.218154+0000","last_fullsized":"2024-09-18T01:47:32.218154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:27.216997+0000","last_change":"2024-09-18T01:45:04.293546+0000","last_active":"2024-09-18T01:47:27.216997+0000","last_peered":"2024-09-18T01:47:27.216997+0000","last_clean":"2024-09-18T01:47:27.216997+0000","last_became_active":"2024-09-18T01:45:04.288040+0000","last_became_peered":"2024-09-18T01:45:04.288040+0000","last_unstale":"2024-09-18T01:47:27.216997+0000","last_undegraded":"2024-09-18T01:47:27.216997+0000","last_fullsized":"2024-09-18T01:47:27.216997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:37.216463+0000","last_change":"2024-09-18T01:45:08.288920+0000","last_active":"2024-09-18T01:47:37.216463+0000","last_peered":"2024-09-18T01:47:37.216463+0000","last_clean":"2024-09-18T01:47:37.216463+0000","last_became_active":"2024-09-18T01:45:08.288667+0000","last_became_peered":"2024-09-18T01:45:08.288667+0000","last_unstale":"2024-09-18T01:47:37.216463+0000","last_undegraded":"2024-09-18T01:47:37.216463+0000","last_fullsized":"2024-09-18T01:47:37.216463+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'30","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:29.796863+0000","last_change":"2024-09-18T01:48:29.796918+0000","last_active":"2024-09-18T01:48:29.796863+0000","last_peered":"2024-09-18T01:48:29.796863+0000","last_clean":"2024-09-18T01:48:29.796863+0000","last_became_active":"2024-09-18T01:45:10.304004+0000","last_became_peered":"2024-09-18T01:45:10.304004+0000","last_unstale":"2024-09-18T01:48:29.796863+0000","last_undegraded":"2024-09-18T01:48:29.796863+0000","last_fullsized":"2024-09-18T01:48:29.796863+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'30","last_scrub_stamp":"2024-09-18T01:48:29.796760+0000","last_deep_scrub":"33'30","last_deep_scrub_stamp":"2024-09-18T01:48:29.796760+0000","last_clean_scrub_stamp":"2024-09-18T01:48:29.796760+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:49:27.020491+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'285","reported_seq":388,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.578547+0000","last_change":"2024-09-18T01:45:12.317560+0000","last_active":"2024-09-18T01:48:19.578547+0000","last_peered":"2024-09-18T01:48:19.578547+0000","last_clean":"2024-09-18T01:48:19.578547+0000","last_became_active":"2024-09-18T01:45:12.317288+0000","last_became_peered":"2024-09-18T01:45:12.317288+0000","last_unstale":"2024-09-18T01:48:19.578547+0000","last_undegraded":"2024-09-18T01:48:19.578547+0000","last_fullsized":"2024-09-18T01:48:19.578547+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:47.220838+0000","last_change":"2024-09-18T01:45:14.326621+0000","last_active":"2024-09-18T01:47:47.220838+0000","last_peered":"2024-09-18T01:47:47.220838+0000","last_clean":"2024-09-18T01:47:47.220838+0000","last_became_active":"2024-09-18T01:45:14.325843+0000","last_became_peered":"2024-09-18T01:45:14.325843+0000","last_unstale":"2024-09-18T01:47:47.220838+0000","last_undegraded":"2024-09-18T01:47:47.220838+0000","last_fullsized":"2024-09-18T01:47:47.220838+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:32.215725+0000","last_change":"2024-09-18T01:45:06.295671+0000","last_active":"2024-09-18T01:47:32.215725+0000","last_peered":"2024-09-18T01:47:32.215725+0000","last_clean":"2024-09-18T01:47:32.215725+0000","last_became_active":"2024-09-18T01:45:06.295417+0000","last_became_peered":"2024-09-18T01:45:06.295417+0000","last_unstale":"2024-09-18T01:47:32.215725+0000","last_undegraded":"2024-09-18T01:47:32.215725+0000","last_fullsized":"2024-09-18T01:47:32.215725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:27.216922+0000","last_change":"2024-09-18T01:45:04.282935+0000","last_active":"2024-09-18T01:47:27.216922+0000","last_peered":"2024-09-18T01:47:27.216922+0000","last_clean":"2024-09-18T01:47:27.216922+0000","last_became_active":"2024-09-18T01:45:04.282500+0000","last_became_peered":"2024-09-18T01:45:04.282500+0000","last_unstale":"2024-09-18T01:47:27.216922+0000","last_undegraded":"2024-09-18T01:47:27.216922+0000","last_fullsized":"2024-09-18T01:47:27.216922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:27.978926+0000","last_change":"2024-09-18T01:48:27.978949+0000","last_active":"2024-09-18T01:48:27.978926+0000","last_peered":"2024-09-18T01:48:27.978926+0000","last_clean":"2024-09-18T01:48:27.978926+0000","last_became_active":"2024-09-18T01:45:08.296192+0000","last_became_peered":"2024-09-18T01:45:08.296192+0000","last_unstale":"2024-09-18T01:48:27.978926+0000","last_undegraded":"2024-09-18T01:48:27.978926+0000","last_fullsized":"2024-09-18T01:48:27.978926+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:27.978844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:27.978844+0000","last_clean_scrub_stamp":"2024-09-18T01:48:27.978844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:53:57.430680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'43","reported_seq":104,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:26.798254+0000","last_change":"2024-09-18T01:48:26.798290+0000","last_active":"2024-09-18T01:48:26.798254+0000","last_peered":"2024-09-18T01:48:26.798254+0000","last_clean":"2024-09-18T01:48:26.798254+0000","last_became_active":"2024-09-18T01:45:10.305515+0000","last_became_peered":"2024-09-18T01:45:10.305515+0000","last_unstale":"2024-09-18T01:48:26.798254+0000","last_undegraded":"2024-09-18T01:48:26.798254+0000","last_fullsized":"2024-09-18T01:48:26.798254+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-09-18T01:48:26.798150+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-09-18T01:48:26.798150+0000","last_clean_scrub_stamp":"2024-09-18T01:48:26.798150+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:49:57.532711+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'285","reported_seq":412,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:41.311359+0000","last_change":"2024-09-18T01:48:41.311390+0000","last_active":"2024-09-18T01:48:41.311359+0000","last_peered":"2024-09-18T01:48:41.311359+0000","last_clean":"2024-09-18T01:48:41.311359+0000","last_became_active":"2024-09-18T01:45:12.313219+0000","last_became_peered":"2024-09-18T01:45:12.313219+0000","last_unstale":"2024-09-18T01:48:41.311359+0000","last_undegraded":"2024-09-18T01:48:41.311359+0000","last_fullsized":"2024-09-18T01:48:41.311359+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-18T01:48:41.311241+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-18T01:48:41.311241+0000","last_clean_scrub_stamp":"2024-09-18T01:48:41.311241+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:53:48.228429+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:38.059825+0000","last_change":"2024-09-18T01:48:38.059865+0000","last_active":"2024-09-18T01:48:38.059825+0000","last_peered":"2024-09-18T01:48:38.059825+0000","last_clean":"2024-09-18T01:48:38.059825+0000","last_became_active":"2024-09-18T01:45:06.297283+0000","last_became_peered":"2024-09-18T01:45:06.297283+0000","last_unstale":"2024-09-18T01:48:38.059825+0000","last_undegraded":"2024-09-18T01:48:38.059825+0000","last_fullsized":"2024-09-18T01:48:38.059825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-18T01:48:38.059683+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-18T01:48:38.059683+0000","last_clean_scrub_stamp":"2024-09-18T01:48:38.059683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:38:43.486124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:22.216134+0000","last_change":"2024-09-18T01:45:04.289955+0000","last_active":"2024-09-18T01:47:22.216134+0000","last_peered":"2024-09-18T01:47:22.216134+0000","last_clean":"2024-09-18T01:47:22.216134+0000","last_became_active":"2024-09-18T01:45:04.289629+0000","last_became_peered":"2024-09-18T01:45:04.289629+0000","last_unstale":"2024-09-18T01:47:22.216134+0000","last_undegraded":"2024-09-18T01:47:22.216134+0000","last_fullsized":"2024-09-18T01:47:22.216134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:35.930454+0000","last_change":"2024-09-18T01:48:35.930488+0000","last_active":"2024-09-18T01:48:35.930454+0000","last_peered":"2024-09-18T01:48:35.930454+0000","last_clean":"2024-09-18T01:48:35.930454+0000","last_became_active":"2024-09-18T01:45:08.294273+0000","last_became_peered":"2024-09-18T01:45:08.294273+0000","last_unstale":"2024-09-18T01:48:35.930454+0000","last_undegraded":"2024-09-18T01:48:35.930454+0000","last_fullsized":"2024-09-18T01:48:35.930454+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:35.930363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:35.930363+0000","last_clean_scrub_stamp":"2024-09-18T01:48:35.930363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:23:07.518807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'58","reported_seq":124,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:33.850412+0000","last_change":"2024-09-18T01:48:33.850466+0000","last_active":"2024-09-18T01:48:33.850412+0000","last_peered":"2024-09-18T01:48:33.850412+0000","last_clean":"2024-09-18T01:48:33.850412+0000","last_became_active":"2024-09-18T01:45:10.298021+0000","last_became_peered":"2024-09-18T01:45:10.298021+0000","last_unstale":"2024-09-18T01:48:33.850412+0000","last_undegraded":"2024-09-18T01:48:33.850412+0000","last_fullsized":"2024-09-18T01:48:33.850412+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'58","last_scrub_stamp":"2024-09-18T01:48:33.850320+0000","last_deep_scrub":"33'58","last_deep_scrub_stamp":"2024-09-18T01:48:33.850320+0000","last_clean_scrub_stamp":"2024-09-18T01:48:33.850320+0000","objects_scrubbed":10,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:47:26.923881+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:27.214945+0000","last_change":"2024-09-18T01:45:12.314207+0000","last_active":"2024-09-18T01:47:27.214945+0000","last_peered":"2024-09-18T01:47:27.214945+0000","last_clean":"2024-09-18T01:47:27.214945+0000","last_became_active":"2024-09-18T01:45:12.313875+0000","last_became_peered":"2024-09-18T01:45:12.313875+0000","last_unstale":"2024-09-18T01:47:27.214945+0000","last_undegraded":"2024-09-18T01:47:27.214945+0000","last_fullsized":"2024-09-18T01:47:27.214945+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'7","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:22.215974+0000","last_change":"2024-09-18T01:45:14.322757+0000","last_active":"2024-09-18T01:47:22.215974+0000","last_peered":"2024-09-18T01:47:22.215974+0000","last_clean":"2024-09-18T01:47:22.215974+0000","last_became_active":"2024-09-18T01:45:14.322448+0000","last_became_peered":"2024-09-18T01:45:14.322448+0000","last_unstale":"2024-09-18T01:47:22.215974+0000","last_undegraded":"2024-09-18T01:47:22.215974+0000","last_fullsized":"2024-09-18T01:47:22.215974+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":17,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'8","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.659827+0000","last_change":"2024-09-18T01:45:06.292485+0000","last_active":"2024-09-18T01:48:12.659827+0000","last_peered":"2024-09-18T01:48:12.659827+0000","last_clean":"2024-09-18T01:48:12.659827+0000","last_became_active":"2024-09-18T01:45:06.292143+0000","last_became_peered":"2024-09-18T01:45:06.292143+0000","last_unstale":"2024-09-18T01:48:12.659827+0000","last_undegraded":"2024-09-18T01:48:12.659827+0000","last_fullsized":"2024-09-18T01:48:12.659827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:22.216054+0000","last_change":"2024-09-18T01:45:04.293049+0000","last_active":"2024-09-18T01:47:22.216054+0000","last_peered":"2024-09-18T01:47:22.216054+0000","last_clean":"2024-09-18T01:47:22.216054+0000","last_became_active":"2024-09-18T01:45:04.292734+0000","last_became_peered":"2024-09-18T01:45:04.292734+0000","last_unstale":"2024-09-18T01:47:22.216054+0000","last_undegraded":"2024-09-18T01:47:22.216054+0000","last_fullsized":"2024-09-18T01:47:22.216054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:38.340690+0000","last_change":"2024-09-18T01:48:38.340714+0000","last_active":"2024-09-18T01:48:38.340690+0000","last_peered":"2024-09-18T01:48:38.340690+0000","last_clean":"2024-09-18T01:48:38.340690+0000","last_became_active":"2024-09-18T01:45:08.294026+0000","last_became_peered":"2024-09-18T01:45:08.294026+0000","last_unstale":"2024-09-18T01:48:38.340690+0000","last_undegraded":"2024-09-18T01:48:38.340690+0000","last_fullsized":"2024-09-18T01:48:38.340690+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:38.340604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:38.340604+0000","last_clean_scrub_stamp":"2024-09-18T01:48:38.340604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:23:55.262120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'39","reported_seq":92,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.477800+0000","last_change":"2024-09-18T01:45:10.308697+0000","last_active":"2024-09-18T01:48:19.477800+0000","last_peered":"2024-09-18T01:48:19.477800+0000","last_clean":"2024-09-18T01:48:19.477800+0000","last_became_active":"2024-09-18T01:45:10.307420+0000","last_became_peered":"2024-09-18T01:45:10.307420+0000","last_unstale":"2024-09-18T01:48:19.477800+0000","last_undegraded":"2024-09-18T01:48:19.477800+0000","last_fullsized":"2024-09-18T01:48:19.477800+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:27.225360+0000","last_change":"2024-09-18T01:48:27.225386+0000","last_active":"2024-09-18T01:48:27.225360+0000","last_peered":"2024-09-18T01:48:27.225360+0000","last_clean":"2024-09-18T01:48:27.225360+0000","last_became_active":"2024-09-18T01:45:12.305838+0000","last_became_peered":"2024-09-18T01:45:12.305838+0000","last_unstale":"2024-09-18T01:48:27.225360+0000","last_undegraded":"2024-09-18T01:48:27.225360+0000","last_fullsized":"2024-09-18T01:48:27.225360+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:27.225273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:27.225273+0000","last_clean_scrub_stamp":"2024-09-18T01:48:27.225273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:40:36.497250+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'3","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:22.216094+0000","last_change":"2024-09-18T01:45:14.322540+0000","last_active":"2024-09-18T01:47:22.216094+0000","last_peered":"2024-09-18T01:47:22.216094+0000","last_clean":"2024-09-18T01:47:22.216094+0000","last_became_active":"2024-09-18T01:45:14.322272+0000","last_became_peered":"2024-09-18T01:45:14.322272+0000","last_unstale":"2024-09-18T01:47:22.216094+0000","last_undegraded":"2024-09-18T01:47:22.216094+0000","last_fullsized":"2024-09-18T01:47:22.216094+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"33'8","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.569498+0000","last_change":"2024-09-18T01:45:06.284946+0000","last_active":"2024-09-18T01:48:12.569498+0000","last_peered":"2024-09-18T01:48:12.569498+0000","last_clean":"2024-09-18T01:48:12.569498+0000","last_became_active":"2024-09-18T01:45:06.284677+0000","last_became_peered":"2024-09-18T01:45:06.284677+0000","last_unstale":"2024-09-18T01:48:12.569498+0000","last_undegraded":"2024-09-18T01:48:12.569498+0000","last_fullsized":"2024-09-18T01:48:12.569498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:22.216180+0000","last_change":"2024-09-18T01:45:04.287402+0000","last_active":"2024-09-18T01:47:22.216180+0000","last_peered":"2024-09-18T01:47:22.216180+0000","last_clean":"2024-09-18T01:47:22.216180+0000","last_became_active":"2024-09-18T01:45:04.284151+0000","last_became_peered":"2024-09-18T01:45:04.284151+0000","last_unstale":"2024-09-18T01:47:22.216180+0000","last_undegraded":"2024-09-18T01:47:22.216180+0000","last_fullsized":"2024-09-18T01:47:22.216180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:27.214977+0000","last_change":"2024-09-18T01:45:08.289806+0000","last_active":"2024-09-18T01:47:27.214977+0000","last_peered":"2024-09-18T01:47:27.214977+0000","last_clean":"2024-09-18T01:47:27.214977+0000","last_became_active":"2024-09-18T01:45:08.289521+0000","last_became_peered":"2024-09-18T01:45:08.289521+0000","last_unstale":"2024-09-18T01:47:27.214977+0000","last_undegraded":"2024-09-18T01:47:27.214977+0000","last_fullsized":"2024-09-18T01:47:27.214977+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'60","reported_seq":130,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:31.041184+0000","last_change":"2024-09-18T01:48:31.041221+0000","last_active":"2024-09-18T01:48:31.041184+0000","last_peered":"2024-09-18T01:48:31.041184+0000","last_clean":"2024-09-18T01:48:31.041184+0000","last_became_active":"2024-09-18T01:45:10.306481+0000","last_became_peered":"2024-09-18T01:45:10.306481+0000","last_unstale":"2024-09-18T01:48:31.041184+0000","last_undegraded":"2024-09-18T01:48:31.041184+0000","last_fullsized":"2024-09-18T01:48:31.041184+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'60","last_scrub_stamp":"2024-09-18T01:48:31.041096+0000","last_deep_scrub":"33'60","last_deep_scrub_stamp":"2024-09-18T01:48:31.041096+0000","last_clean_scrub_stamp":"2024-09-18T01:48:31.041096+0000","objects_scrubbed":9,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:19:08.072740+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'285","reported_seq":359,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:33.295878+0000","last_change":"2024-09-18T01:48:33.295906+0000","last_active":"2024-09-18T01:48:33.295878+0000","last_peered":"2024-09-18T01:48:33.295878+0000","last_clean":"2024-09-18T01:48:33.295878+0000","last_became_active":"2024-09-18T01:45:12.313065+0000","last_became_peered":"2024-09-18T01:45:12.313065+0000","last_unstale":"2024-09-18T01:48:33.295878+0000","last_undegraded":"2024-09-18T01:48:33.295878+0000","last_fullsized":"2024-09-18T01:48:33.295878+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-18T01:48:33.295792+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-18T01:48:33.295792+0000","last_clean_scrub_stamp":"2024-09-18T01:48:33.295792+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:47:31.508822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"33'2","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:27.215024+0000","last_change":"2024-09-18T01:45:14.320158+0000","last_active":"2024-09-18T01:47:27.215024+0000","last_peered":"2024-09-18T01:47:27.215024+0000","last_clean":"2024-09-18T01:47:27.215024+0000","last_became_active":"2024-09-18T01:45:14.319805+0000","last_became_peered":"2024-09-18T01:45:14.319805+0000","last_unstale":"2024-09-18T01:47:27.215024+0000","last_undegraded":"2024-09-18T01:47:27.215024+0000","last_fullsized":"2024-09-18T01:47:27.215024+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"33'10","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.846471+0000","last_change":"2024-09-18T01:45:06.282059+0000","last_active":"2024-09-18T01:48:12.846471+0000","last_peered":"2024-09-18T01:48:12.846471+0000","last_clean":"2024-09-18T01:48:12.846471+0000","last_became_active":"2024-09-18T01:45:06.281444+0000","last_became_peered":"2024-09-18T01:45:06.281444+0000","last_unstale":"2024-09-18T01:48:12.846471+0000","last_undegraded":"2024-09-18T01:48:12.846471+0000","last_fullsized":"2024-09-18T01:48:12.846471+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:22.216103+0000","last_change":"2024-09-18T01:45:04.289841+0000","last_active":"2024-09-18T01:47:22.216103+0000","last_peered":"2024-09-18T01:47:22.216103+0000","last_clean":"2024-09-18T01:47:22.216103+0000","last_became_active":"2024-09-18T01:45:04.289216+0000","last_became_peered":"2024-09-18T01:45:04.289216+0000","last_unstale":"2024-09-18T01:47:22.216103+0000","last_undegraded":"2024-09-18T01:47:22.216103+0000","last_fullsized":"2024-09-18T01:47:22.216103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:22.214227+0000","last_change":"2024-09-18T01:45:08.289975+0000","last_active":"2024-09-18T01:47:22.214227+0000","last_peered":"2024-09-18T01:47:22.214227+0000","last_clean":"2024-09-18T01:47:22.214227+0000","last_became_active":"2024-09-18T01:45:08.289725+0000","last_became_peered":"2024-09-18T01:45:08.289725+0000","last_unstale":"2024-09-18T01:47:22.214227+0000","last_undegraded":"2024-09-18T01:47:22.214227+0000","last_fullsized":"2024-09-18T01:47:22.214227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"33'79","reported_seq":156,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.560082+0000","last_change":"2024-09-18T01:45:10.310077+0000","last_active":"2024-09-18T01:48:19.560082+0000","last_peered":"2024-09-18T01:48:19.560082+0000","last_clean":"2024-09-18T01:48:19.560082+0000","last_became_active":"2024-09-18T01:45:10.309360+0000","last_became_peered":"2024-09-18T01:45:10.309360+0000","last_unstale":"2024-09-18T01:48:19.560082+0000","last_undegraded":"2024-09-18T01:48:19.560082+0000","last_fullsized":"2024-09-18T01:48:19.560082+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5903,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":90,"num_read_kb":105,"num_write":42,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:29.256572+0000","last_change":"2024-09-18T01:48:29.256596+0000","last_active":"2024-09-18T01:48:29.256572+0000","last_peered":"2024-09-18T01:48:29.256572+0000","last_clean":"2024-09-18T01:48:29.256572+0000","last_became_active":"2024-09-18T01:45:12.312665+0000","last_became_peered":"2024-09-18T01:45:12.312665+0000","last_unstale":"2024-09-18T01:48:29.256572+0000","last_undegraded":"2024-09-18T01:48:29.256572+0000","last_fullsized":"2024-09-18T01:48:29.256572+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:29.256466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:29.256466+0000","last_clean_scrub_stamp":"2024-09-18T01:48:29.256466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:07:14.275320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'18","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.979585+0000","last_change":"2024-09-18T01:45:14.320179+0000","last_active":"2024-09-18T01:48:12.979585+0000","last_peered":"2024-09-18T01:48:12.979585+0000","last_clean":"2024-09-18T01:48:12.979585+0000","last_became_active":"2024-09-18T01:45:14.319638+0000","last_became_peered":"2024-09-18T01:45:14.319638+0000","last_unstale":"2024-09-18T01:48:12.979585+0000","last_undegraded":"2024-09-18T01:48:12.979585+0000","last_fullsized":"2024-09-18T01:48:12.979585+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:22.216040+0000","last_change":"2024-09-18T01:45:06.290368+0000","last_active":"2024-09-18T01:47:22.216040+0000","last_peered":"2024-09-18T01:47:22.216040+0000","last_clean":"2024-09-18T01:47:22.216040+0000","last_became_active":"2024-09-18T01:45:06.290087+0000","last_became_peered":"2024-09-18T01:45:06.290087+0000","last_unstale":"2024-09-18T01:47:22.216040+0000","last_undegraded":"2024-09-18T01:47:22.216040+0000","last_fullsized":"2024-09-18T01:47:22.216040+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:22.214246+0000","last_change":"2024-09-18T01:45:04.279319+0000","last_active":"2024-09-18T01:47:22.214246+0000","last_peered":"2024-09-18T01:47:22.214246+0000","last_clean":"2024-09-18T01:47:22.214246+0000","last_became_active":"2024-09-18T01:45:04.278979+0000","last_became_peered":"2024-09-18T01:45:04.278979+0000","last_unstale":"2024-09-18T01:47:22.214246+0000","last_undegraded":"2024-09-18T01:47:22.214246+0000","last_fullsized":"2024-09-18T01:47:22.214246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:36.904915+0000","last_change":"2024-09-18T01:48:36.904948+0000","last_active":"2024-09-18T01:48:36.904915+0000","last_peered":"2024-09-18T01:48:36.904915+0000","last_clean":"2024-09-18T01:48:36.904915+0000","last_became_active":"2024-09-18T01:45:08.292156+0000","last_became_peered":"2024-09-18T01:45:08.292156+0000","last_unstale":"2024-09-18T01:48:36.904915+0000","last_undegraded":"2024-09-18T01:48:36.904915+0000","last_fullsized":"2024-09-18T01:48:36.904915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:36.904811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:36.904811+0000","last_clean_scrub_stamp":"2024-09-18T01:48:36.904811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:16:10.795874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'46","reported_seq":108,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:31.876714+0000","last_change":"2024-09-18T01:48:31.876752+0000","last_active":"2024-09-18T01:48:31.876714+0000","last_peered":"2024-09-18T01:48:31.876714+0000","last_clean":"2024-09-18T01:48:31.876714+0000","last_became_active":"2024-09-18T01:45:10.300488+0000","last_became_peered":"2024-09-18T01:45:10.300488+0000","last_unstale":"2024-09-18T01:48:31.876714+0000","last_undegraded":"2024-09-18T01:48:31.876714+0000","last_fullsized":"2024-09-18T01:48:31.876714+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'46","last_scrub_stamp":"2024-09-18T01:48:31.876630+0000","last_deep_scrub":"33'46","last_deep_scrub_stamp":"2024-09-18T01:48:31.876630+0000","last_clean_scrub_stamp":"2024-09-18T01:48:31.876630+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:14:05.046500+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:27.217287+0000","last_change":"2024-09-18T01:45:12.315977+0000","last_active":"2024-09-18T01:47:27.217287+0000","last_peered":"2024-09-18T01:47:27.217287+0000","last_clean":"2024-09-18T01:47:27.217287+0000","last_became_active":"2024-09-18T01:45:12.315695+0000","last_became_peered":"2024-09-18T01:45:12.315695+0000","last_unstale":"2024-09-18T01:47:27.217287+0000","last_undegraded":"2024-09-18T01:47:27.217287+0000","last_fullsized":"2024-09-18T01:47:27.217287+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"33'3","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.939005+0000","last_change":"2024-09-18T01:45:14.326486+0000","last_active":"2024-09-18T01:48:12.939005+0000","last_peered":"2024-09-18T01:48:12.939005+0000","last_clean":"2024-09-18T01:48:12.939005+0000","last_became_active":"2024-09-18T01:45:14.326209+0000","last_became_peered":"2024-09-18T01:45:14.326209+0000","last_unstale":"2024-09-18T01:48:12.939005+0000","last_undegraded":"2024-09-18T01:48:12.939005+0000","last_fullsized":"2024-09-18T01:48:12.939005+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.660735+0000","last_change":"2024-09-18T01:45:06.287753+0000","last_active":"2024-09-18T01:48:12.660735+0000","last_peered":"2024-09-18T01:48:12.660735+0000","last_clean":"2024-09-18T01:48:12.660735+0000","last_became_active":"2024-09-18T01:45:06.285771+0000","last_became_peered":"2024-09-18T01:45:06.285771+0000","last_unstale":"2024-09-18T01:48:12.660735+0000","last_undegraded":"2024-09-18T01:48:12.660735+0000","last_fullsized":"2024-09-18T01:48:12.660735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.491204+0000","last_change":"2024-09-18T01:45:04.287560+0000","last_active":"2024-09-18T01:48:19.491204+0000","last_peered":"2024-09-18T01:48:19.491204+0000","last_clean":"2024-09-18T01:48:19.491204+0000","last_became_active":"2024-09-18T01:45:04.287263+0000","last_became_peered":"2024-09-18T01:45:04.287263+0000","last_unstale":"2024-09-18T01:48:19.491204+0000","last_undegraded":"2024-09-18T01:48:19.491204+0000","last_fullsized":"2024-09-18T01:48:19.491204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:27.214989+0000","last_change":"2024-09-18T01:45:08.289876+0000","last_active":"2024-09-18T01:47:27.214989+0000","last_peered":"2024-09-18T01:47:27.214989+0000","last_clean":"2024-09-18T01:47:27.214989+0000","last_became_active":"2024-09-18T01:45:08.289604+0000","last_became_peered":"2024-09-18T01:45:08.289604+0000","last_unstale":"2024-09-18T01:47:27.214989+0000","last_undegraded":"2024-09-18T01:47:27.214989+0000","last_fullsized":"2024-09-18T01:47:27.214989+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'46","reported_seq":104,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:32.804739+0000","last_change":"2024-09-18T01:48:32.804773+0000","last_active":"2024-09-18T01:48:32.804739+0000","last_peered":"2024-09-18T01:48:32.804739+0000","last_clean":"2024-09-18T01:48:32.804739+0000","last_became_active":"2024-09-18T01:45:10.297511+0000","last_became_peered":"2024-09-18T01:45:10.297511+0000","last_unstale":"2024-09-18T01:48:32.804739+0000","last_undegraded":"2024-09-18T01:48:32.804739+0000","last_fullsized":"2024-09-18T01:48:32.804739+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'46","last_scrub_stamp":"2024-09-18T01:48:32.804654+0000","last_deep_scrub":"33'46","last_deep_scrub_stamp":"2024-09-18T01:48:32.804654+0000","last_clean_scrub_stamp":"2024-09-18T01:48:32.804654+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:33:34.219867+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'285","reported_seq":414,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:39.926591+0000","last_change":"2024-09-18T01:48:39.926622+0000","last_active":"2024-09-18T01:48:39.926591+0000","last_peered":"2024-09-18T01:48:39.926591+0000","last_clean":"2024-09-18T01:48:39.926591+0000","last_became_active":"2024-09-18T01:45:12.314918+0000","last_became_peered":"2024-09-18T01:45:12.314918+0000","last_unstale":"2024-09-18T01:48:39.926591+0000","last_undegraded":"2024-09-18T01:48:39.926591+0000","last_fullsized":"2024-09-18T01:48:39.926591+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-18T01:48:39.926503+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-18T01:48:39.926503+0000","last_clean_scrub_stamp":"2024-09-18T01:48:39.926503+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:49:29.916648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'12","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.940929+0000","last_change":"2024-09-18T01:45:14.319866+0000","last_active":"2024-09-18T01:48:12.940929+0000","last_peered":"2024-09-18T01:48:12.940929+0000","last_clean":"2024-09-18T01:48:12.940929+0000","last_became_active":"2024-09-18T01:45:14.319364+0000","last_became_peered":"2024-09-18T01:45:14.319364+0000","last_unstale":"2024-09-18T01:48:12.940929+0000","last_undegraded":"2024-09-18T01:48:12.940929+0000","last_fullsized":"2024-09-18T01:48:12.940929+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:22.216078+0000","last_change":"2024-09-18T01:45:06.291329+0000","last_active":"2024-09-18T01:47:22.216078+0000","last_peered":"2024-09-18T01:47:22.216078+0000","last_clean":"2024-09-18T01:47:22.216078+0000","last_became_active":"2024-09-18T01:45:06.291023+0000","last_became_peered":"2024-09-18T01:45:06.291023+0000","last_unstale":"2024-09-18T01:47:22.216078+0000","last_undegraded":"2024-09-18T01:47:22.216078+0000","last_fullsized":"2024-09-18T01:47:22.216078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:17.215165+0000","last_change":"2024-09-18T01:45:04.294066+0000","last_active":"2024-09-18T01:47:17.215165+0000","last_peered":"2024-09-18T01:47:17.215165+0000","last_clean":"2024-09-18T01:47:17.215165+0000","last_became_active":"2024-09-18T01:45:04.288386+0000","last_became_peered":"2024-09-18T01:45:04.288386+0000","last_unstale":"2024-09-18T01:47:17.215165+0000","last_undegraded":"2024-09-18T01:47:17.215165+0000","last_fullsized":"2024-09-18T01:47:17.215165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'5","reported_seq":428,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:37.935954+0000","last_change":"2024-09-18T01:48:37.935983+0000","last_active":"2024-09-18T01:48:37.935954+0000","last_peered":"2024-09-18T01:48:37.935954+0000","last_clean":"2024-09-18T01:48:37.935954+0000","last_became_active":"2024-09-18T01:45:08.289478+0000","last_became_peered":"2024-09-18T01:45:08.289478+0000","last_unstale":"2024-09-18T01:48:37.935954+0000","last_undegraded":"2024-09-18T01:48:37.935954+0000","last_fullsized":"2024-09-18T01:48:37.935954+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-18T01:48:37.935837+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-18T01:48:37.935837+0000","last_clean_scrub_stamp":"2024-09-18T01:48:37.935837+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:10:09.966686+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'16","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:35.107094+0000","last_change":"2024-09-18T01:48:35.107168+0000","last_active":"2024-09-18T01:48:35.107094+0000","last_peered":"2024-09-18T01:48:35.107094+0000","last_clean":"2024-09-18T01:48:35.107094+0000","last_became_active":"2024-09-18T01:45:10.307374+0000","last_became_peered":"2024-09-18T01:45:10.307374+0000","last_unstale":"2024-09-18T01:48:35.107094+0000","last_undegraded":"2024-09-18T01:48:35.107094+0000","last_fullsized":"2024-09-18T01:48:35.107094+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2024-09-18T01:48:35.106992+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2024-09-18T01:48:35.106992+0000","last_clean_scrub_stamp":"2024-09-18T01:48:35.106992+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:54:20.385136+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'285","reported_seq":476,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:25.009751+0000","last_change":"2024-09-18T01:48:25.009780+0000","last_active":"2024-09-18T01:48:25.009751+0000","last_peered":"2024-09-18T01:48:25.009751+0000","last_clean":"2024-09-18T01:48:25.009751+0000","last_became_active":"2024-09-18T01:45:12.311929+0000","last_became_peered":"2024-09-18T01:45:12.311929+0000","last_unstale":"2024-09-18T01:48:25.009751+0000","last_undegraded":"2024-09-18T01:48:25.009751+0000","last_fullsized":"2024-09-18T01:48:25.009751+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-18T01:48:25.009658+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-18T01:48:25.009658+0000","last_clean_scrub_stamp":"2024-09-18T01:48:25.009658+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:37:56.338472+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"33'6","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:22.215865+0000","last_change":"2024-09-18T01:45:14.318697+0000","last_active":"2024-09-18T01:47:22.215865+0000","last_peered":"2024-09-18T01:47:22.215865+0000","last_clean":"2024-09-18T01:47:22.215865+0000","last_became_active":"2024-09-18T01:45:14.318418+0000","last_became_peered":"2024-09-18T01:45:14.318418+0000","last_unstale":"2024-09-18T01:47:22.215865+0000","last_undegraded":"2024-09-18T01:47:22.215865+0000","last_fullsized":"2024-09-18T01:47:22.215865+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"31'4","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:41.845898+0000","last_change":"2024-09-18T01:48:41.845938+0000","last_active":"2024-09-18T01:48:41.845898+0000","last_peered":"2024-09-18T01:48:41.845898+0000","last_clean":"2024-09-18T01:48:41.845898+0000","last_became_active":"2024-09-18T01:45:06.296824+0000","last_became_peered":"2024-09-18T01:45:06.296824+0000","last_unstale":"2024-09-18T01:48:41.845898+0000","last_undegraded":"2024-09-18T01:48:41.845898+0000","last_fullsized":"2024-09-18T01:48:41.845898+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-18T01:48:41.845784+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-18T01:48:41.845784+0000","last_clean_scrub_stamp":"2024-09-18T01:48:41.845784+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:28:20.771801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.489403+0000","last_change":"2024-09-18T01:45:04.288364+0000","last_active":"2024-09-18T01:48:19.489403+0000","last_peered":"2024-09-18T01:48:19.489403+0000","last_clean":"2024-09-18T01:48:19.489403+0000","last_became_active":"2024-09-18T01:45:04.287961+0000","last_became_peered":"2024-09-18T01:45:04.287961+0000","last_unstale":"2024-09-18T01:48:19.489403+0000","last_undegraded":"2024-09-18T01:48:19.489403+0000","last_fullsized":"2024-09-18T01:48:19.489403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:30.056211+0000","last_change":"2024-09-18T01:48:30.056238+0000","last_active":"2024-09-18T01:48:30.056211+0000","last_peered":"2024-09-18T01:48:30.056211+0000","last_clean":"2024-09-18T01:48:30.056211+0000","last_became_active":"2024-09-18T01:45:08.294053+0000","last_became_peered":"2024-09-18T01:45:08.294053+0000","last_unstale":"2024-09-18T01:48:30.056211+0000","last_undegraded":"2024-09-18T01:48:30.056211+0000","last_fullsized":"2024-09-18T01:48:30.056211+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:30.056116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:30.056116+0000","last_clean_scrub_stamp":"2024-09-18T01:48:30.056116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:08:42.773951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'49","reported_seq":108,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:32.916909+0000","last_change":"2024-09-18T01:48:32.916950+0000","last_active":"2024-09-18T01:48:32.916909+0000","last_peered":"2024-09-18T01:48:32.916909+0000","last_clean":"2024-09-18T01:48:32.916909+0000","last_became_active":"2024-09-18T01:45:10.300337+0000","last_became_peered":"2024-09-18T01:45:10.300337+0000","last_unstale":"2024-09-18T01:48:32.916909+0000","last_undegraded":"2024-09-18T01:48:32.916909+0000","last_fullsized":"2024-09-18T01:48:32.916909+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'49","last_scrub_stamp":"2024-09-18T01:48:32.916825+0000","last_deep_scrub":"33'49","last_deep_scrub_stamp":"2024-09-18T01:48:32.916825+0000","last_clean_scrub_stamp":"2024-09-18T01:48:32.916825+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:18:05.044892+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:25.794769+0000","last_change":"2024-09-18T01:48:25.794798+0000","last_active":"2024-09-18T01:48:25.794769+0000","last_peered":"2024-09-18T01:48:25.794769+0000","last_clean":"2024-09-18T01:48:25.794769+0000","last_became_active":"2024-09-18T01:45:12.307210+0000","last_became_peered":"2024-09-18T01:45:12.307210+0000","last_unstale":"2024-09-18T01:48:25.794769+0000","last_undegraded":"2024-09-18T01:48:25.794769+0000","last_fullsized":"2024-09-18T01:48:25.794769+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:25.794656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:25.794656+0000","last_clean_scrub_stamp":"2024-09-18T01:48:25.794656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:43:11.167455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'6","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:38.907928+0000","last_change":"2024-09-18T01:48:38.907977+0000","last_active":"2024-09-18T01:48:38.907928+0000","last_peered":"2024-09-18T01:48:38.907928+0000","last_clean":"2024-09-18T01:48:38.907928+0000","last_became_active":"2024-09-18T01:45:14.314786+0000","last_became_peered":"2024-09-18T01:45:14.314786+0000","last_unstale":"2024-09-18T01:48:38.907928+0000","last_undegraded":"2024-09-18T01:48:38.907928+0000","last_fullsized":"2024-09-18T01:48:38.907928+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-18T01:48:38.907803+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-18T01:48:38.907803+0000","last_clean_scrub_stamp":"2024-09-18T01:48:38.907803+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:42:22.155558+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.566869+0000","last_change":"2024-09-18T01:45:06.287377+0000","last_active":"2024-09-18T01:48:12.566869+0000","last_peered":"2024-09-18T01:48:12.566869+0000","last_clean":"2024-09-18T01:48:12.566869+0000","last_became_active":"2024-09-18T01:45:06.286138+0000","last_became_peered":"2024-09-18T01:45:06.286138+0000","last_unstale":"2024-09-18T01:48:12.566869+0000","last_undegraded":"2024-09-18T01:48:12.566869+0000","last_fullsized":"2024-09-18T01:48:12.566869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":206,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:46:52.211034+0000","last_change":"2024-09-18T01:44:49.573399+0000","last_active":"2024-09-18T01:46:52.211034+0000","last_peered":"2024-09-18T01:46:52.211034+0000","last_clean":"2024-09-18T01:46:52.211034+0000","last_became_active":"2024-09-18T01:44:49.572263+0000","last_became_peered":"2024-09-18T01:44:49.572263+0000","last_unstale":"2024-09-18T01:46:52.211034+0000","last_undegraded":"2024-09-18T01:46:52.211034+0000","last_fullsized":"2024-09-18T01:46:52.211034+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:48.210722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:48.210722+0000","last_clean_scrub_stamp":"2024-09-18T01:44:48.210722+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:02.212893+0000","last_change":"2024-09-18T01:44:55.241426+0000","last_active":"2024-09-18T01:47:02.212893+0000","last_peered":"2024-09-18T01:47:02.212893+0000","last_clean":"2024-09-18T01:47:02.212893+0000","last_became_active":"2024-09-18T01:44:53.233974+0000","last_became_peered":"2024-09-18T01:44:53.233974+0000","last_unstale":"2024-09-18T01:47:02.212893+0000","last_undegraded":"2024-09-18T01:47:02.212893+0000","last_fullsized":"2024-09-18T01:47:02.212893+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045237700000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.214400+0000","last_change":"2024-09-18T01:45:04.289472+0000","last_active":"2024-09-18T01:47:12.214400+0000","last_peered":"2024-09-18T01:47:12.214400+0000","last_clean":"2024-09-18T01:47:12.214400+0000","last_became_active":"2024-09-18T01:45:04.287763+0000","last_became_peered":"2024-09-18T01:45:04.287763+0000","last_unstale":"2024-09-18T01:47:12.214400+0000","last_undegraded":"2024-09-18T01:47:12.214400+0000","last_fullsized":"2024-09-18T01:47:12.214400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:39.901202+0000","last_change":"2024-09-18T01:48:39.901227+0000","last_active":"2024-09-18T01:48:39.901202+0000","last_peered":"2024-09-18T01:48:39.901202+0000","last_clean":"2024-09-18T01:48:39.901202+0000","last_became_active":"2024-09-18T01:45:08.288131+0000","last_became_peered":"2024-09-18T01:45:08.288131+0000","last_unstale":"2024-09-18T01:48:39.901202+0000","last_undegraded":"2024-09-18T01:48:39.901202+0000","last_fullsized":"2024-09-18T01:48:39.901202+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:39.901111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:39.901111+0000","last_clean_scrub_stamp":"2024-09-18T01:48:39.901111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:24:25.271343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'95","reported_seq":191,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:27.011310+0000","last_change":"2024-09-18T01:48:27.011354+0000","last_active":"2024-09-18T01:48:27.011310+0000","last_peered":"2024-09-18T01:48:27.011310+0000","last_clean":"2024-09-18T01:48:27.011310+0000","last_became_active":"2024-09-18T01:45:10.305004+0000","last_became_peered":"2024-09-18T01:45:10.305004+0000","last_unstale":"2024-09-18T01:48:27.011310+0000","last_undegraded":"2024-09-18T01:48:27.011310+0000","last_fullsized":"2024-09-18T01:48:27.011310+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'95","last_scrub_stamp":"2024-09-18T01:48:27.011228+0000","last_deep_scrub":"33'95","last_deep_scrub_stamp":"2024-09-18T01:48:27.011228+0000","last_clean_scrub_stamp":"2024-09-18T01:48:27.011228+0000","objects_scrubbed":6,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:47:24.915172+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":81,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:24.264559+0000","last_change":"2024-09-18T01:48:24.264584+0000","last_active":"2024-09-18T01:48:24.264559+0000","last_peered":"2024-09-18T01:48:24.264559+0000","last_clean":"2024-09-18T01:48:24.264559+0000","last_became_active":"2024-09-18T01:45:12.311337+0000","last_became_peered":"2024-09-18T01:45:12.311337+0000","last_unstale":"2024-09-18T01:48:24.264559+0000","last_undegraded":"2024-09-18T01:48:24.264559+0000","last_fullsized":"2024-09-18T01:48:24.264559+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:24.264452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:24.264452+0000","last_clean_scrub_stamp":"2024-09-18T01:48:24.264452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:54:43.625934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'81","reported_seq":163,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.887973+0000","last_change":"2024-09-18T01:45:14.315079+0000","last_active":"2024-09-18T01:48:12.887973+0000","last_peered":"2024-09-18T01:48:12.887973+0000","last_clean":"2024-09-18T01:48:12.887973+0000","last_became_active":"2024-09-18T01:45:14.314784+0000","last_became_peered":"2024-09-18T01:45:14.314784+0000","last_unstale":"2024-09-18T01:48:12.887973+0000","last_undegraded":"2024-09-18T01:48:12.887973+0000","last_fullsized":"2024-09-18T01:48:12.887973+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'4","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:52.221891+0000","last_change":"2024-09-18T01:45:41.350104+0000","last_active":"2024-09-18T01:47:52.221891+0000","last_peered":"2024-09-18T01:47:52.221891+0000","last_clean":"2024-09-18T01:47:52.221891+0000","last_became_active":"2024-09-18T01:45:41.338925+0000","last_became_peered":"2024-09-18T01:45:41.338925+0000","last_unstale":"2024-09-18T01:47:52.221891+0000","last_undegraded":"2024-09-18T01:47:52.221891+0000","last_fullsized":"2024-09-18T01:47:52.221891+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:46:57.211968+0000","last_change":"2024-09-18T01:44:55.242126+0000","last_active":"2024-09-18T01:46:57.211968+0000","last_peered":"2024-09-18T01:46:57.211968+0000","last_clean":"2024-09-18T01:46:57.211968+0000","last_became_active":"2024-09-18T01:44:53.237059+0000","last_became_peered":"2024-09-18T01:44:53.237059+0000","last_unstale":"2024-09-18T01:46:57.211968+0000","last_undegraded":"2024-09-18T01:46:57.211968+0000","last_fullsized":"2024-09-18T01:46:57.211968+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011095359999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.212643+0000","last_change":"2024-09-18T01:45:04.273879+0000","last_active":"2024-09-18T01:47:12.212643+0000","last_peered":"2024-09-18T01:47:12.212643+0000","last_clean":"2024-09-18T01:47:12.212643+0000","last_became_active":"2024-09-18T01:45:04.273354+0000","last_became_peered":"2024-09-18T01:45:04.273354+0000","last_unstale":"2024-09-18T01:47:12.212643+0000","last_undegraded":"2024-09-18T01:47:12.212643+0000","last_fullsized":"2024-09-18T01:47:12.212643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:32.043568+0000","last_change":"2024-09-18T01:48:32.043612+0000","last_active":"2024-09-18T01:48:32.043568+0000","last_peered":"2024-09-18T01:48:32.043568+0000","last_clean":"2024-09-18T01:48:32.043568+0000","last_became_active":"2024-09-18T01:45:08.291681+0000","last_became_peered":"2024-09-18T01:45:08.291681+0000","last_unstale":"2024-09-18T01:48:32.043568+0000","last_undegraded":"2024-09-18T01:48:32.043568+0000","last_fullsized":"2024-09-18T01:48:32.043568+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:32.043454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:32.043454+0000","last_clean_scrub_stamp":"2024-09-18T01:48:32.043454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:43:29.802788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'297","reported_seq":527,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:27.957007+0000","last_change":"2024-09-18T01:48:27.957047+0000","last_active":"2024-09-18T01:48:27.957007+0000","last_peered":"2024-09-18T01:48:27.957007+0000","last_clean":"2024-09-18T01:48:27.957007+0000","last_became_active":"2024-09-18T01:45:10.305472+0000","last_became_peered":"2024-09-18T01:45:10.305472+0000","last_unstale":"2024-09-18T01:48:27.957007+0000","last_undegraded":"2024-09-18T01:48:27.957007+0000","last_fullsized":"2024-09-18T01:48:27.957007+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'297","last_scrub_stamp":"2024-09-18T01:48:27.956904+0000","last_deep_scrub":"33'297","last_deep_scrub_stamp":"2024-09-18T01:48:27.956904+0000","last_clean_scrub_stamp":"2024-09-18T01:48:27.956904+0000","objects_scrubbed":11,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:56:18.052928+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":387,"num_read_kb":371,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:17.215301+0000","last_change":"2024-09-18T01:45:12.316867+0000","last_active":"2024-09-18T01:47:17.215301+0000","last_peered":"2024-09-18T01:47:17.215301+0000","last_clean":"2024-09-18T01:47:17.215301+0000","last_became_active":"2024-09-18T01:45:12.316110+0000","last_became_peered":"2024-09-18T01:45:12.316110+0000","last_unstale":"2024-09-18T01:47:17.215301+0000","last_undegraded":"2024-09-18T01:47:17.215301+0000","last_fullsized":"2024-09-18T01:47:17.215301+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'5","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:27.217057+0000","last_change":"2024-09-18T01:45:14.323262+0000","last_active":"2024-09-18T01:47:27.217057+0000","last_peered":"2024-09-18T01:47:27.217057+0000","last_clean":"2024-09-18T01:47:27.217057+0000","last_became_active":"2024-09-18T01:45:14.322986+0000","last_became_peered":"2024-09-18T01:45:14.322986+0000","last_unstale":"2024-09-18T01:47:27.217057+0000","last_undegraded":"2024-09-18T01:47:27.217057+0000","last_fullsized":"2024-09-18T01:47:27.217057+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'8","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.846155+0000","last_change":"2024-09-18T01:45:06.293300+0000","last_active":"2024-09-18T01:48:12.846155+0000","last_peered":"2024-09-18T01:48:12.846155+0000","last_clean":"2024-09-18T01:48:12.846155+0000","last_became_active":"2024-09-18T01:45:06.292996+0000","last_became_peered":"2024-09-18T01:45:06.292996+0000","last_unstale":"2024-09-18T01:48:12.846155+0000","last_undegraded":"2024-09-18T01:48:12.846155+0000","last_fullsized":"2024-09-18T01:48:12.846155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:02.212647+0000","last_change":"2024-09-18T01:44:55.620700+0000","last_active":"2024-09-18T01:47:02.212647+0000","last_peered":"2024-09-18T01:47:02.212647+0000","last_clean":"2024-09-18T01:47:02.212647+0000","last_became_active":"2024-09-18T01:44:53.237016+0000","last_became_peered":"2024-09-18T01:44:53.237016+0000","last_unstale":"2024-09-18T01:47:02.212647+0000","last_undegraded":"2024-09-18T01:47:02.212647+0000","last_fullsized":"2024-09-18T01:47:02.212647+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039942899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.780800+0000","last_change":"2024-09-18T01:45:04.284372+0000","last_active":"2024-09-18T01:48:12.780800+0000","last_peered":"2024-09-18T01:48:12.780800+0000","last_clean":"2024-09-18T01:48:12.780800+0000","last_became_active":"2024-09-18T01:45:04.283999+0000","last_became_peered":"2024-09-18T01:45:04.283999+0000","last_unstale":"2024-09-18T01:48:12.780800+0000","last_undegraded":"2024-09-18T01:48:12.780800+0000","last_fullsized":"2024-09-18T01:48:12.780800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"24'2","reported_seq":222,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.412317+0000","last_change":"2024-09-18T01:45:08.284516+0000","last_active":"2024-09-18T01:48:19.412317+0000","last_peered":"2024-09-18T01:48:19.412317+0000","last_clean":"2024-09-18T01:48:19.412317+0000","last_became_active":"2024-09-18T01:45:08.284186+0000","last_became_peered":"2024-09-18T01:45:08.284186+0000","last_unstale":"2024-09-18T01:48:19.412317+0000","last_undegraded":"2024-09-18T01:48:19.412317+0000","last_fullsized":"2024-09-18T01:48:19.412317+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'24","reported_seq":100,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:34.888891+0000","last_change":"2024-09-18T01:48:34.888969+0000","last_active":"2024-09-18T01:48:34.888891+0000","last_peered":"2024-09-18T01:48:34.888891+0000","last_clean":"2024-09-18T01:48:34.888891+0000","last_became_active":"2024-09-18T01:45:10.296284+0000","last_became_peered":"2024-09-18T01:45:10.296284+0000","last_unstale":"2024-09-18T01:48:34.888891+0000","last_undegraded":"2024-09-18T01:48:34.888891+0000","last_fullsized":"2024-09-18T01:48:34.888891+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'24","last_scrub_stamp":"2024-09-18T01:48:34.888775+0000","last_deep_scrub":"33'24","last_deep_scrub_stamp":"2024-09-18T01:48:34.888775+0000","last_clean_scrub_stamp":"2024-09-18T01:48:34.888775+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:24:45.905214+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:26.266579+0000","last_change":"2024-09-18T01:48:26.266603+0000","last_active":"2024-09-18T01:48:26.266579+0000","last_peered":"2024-09-18T01:48:26.266579+0000","last_clean":"2024-09-18T01:48:26.266579+0000","last_became_active":"2024-09-18T01:45:12.311266+0000","last_became_peered":"2024-09-18T01:45:12.311266+0000","last_unstale":"2024-09-18T01:48:26.266579+0000","last_undegraded":"2024-09-18T01:48:26.266579+0000","last_fullsized":"2024-09-18T01:48:26.266579+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:26.266453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:26.266453+0000","last_clean_scrub_stamp":"2024-09-18T01:48:26.266453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:33:31.954590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"33'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:32.218060+0000","last_change":"2024-09-18T01:45:14.318619+0000","last_active":"2024-09-18T01:47:32.218060+0000","last_peered":"2024-09-18T01:47:32.218060+0000","last_clean":"2024-09-18T01:47:32.218060+0000","last_became_active":"2024-09-18T01:45:14.318346+0000","last_became_peered":"2024-09-18T01:45:14.318346+0000","last_unstale":"2024-09-18T01:47:32.218060+0000","last_undegraded":"2024-09-18T01:47:32.218060+0000","last_fullsized":"2024-09-18T01:47:32.218060+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.880462+0000","last_change":"2024-09-18T01:45:06.282530+0000","last_active":"2024-09-18T01:48:12.880462+0000","last_peered":"2024-09-18T01:48:12.880462+0000","last_clean":"2024-09-18T01:48:12.880462+0000","last_became_active":"2024-09-18T01:45:06.282319+0000","last_became_peered":"2024-09-18T01:45:06.282319+0000","last_unstale":"2024-09-18T01:48:12.880462+0000","last_undegraded":"2024-09-18T01:48:12.880462+0000","last_fullsized":"2024-09-18T01:48:12.880462+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:02.212833+0000","last_change":"2024-09-18T01:44:55.242065+0000","last_active":"2024-09-18T01:47:02.212833+0000","last_peered":"2024-09-18T01:47:02.212833+0000","last_clean":"2024-09-18T01:47:02.212833+0000","last_became_active":"2024-09-18T01:44:53.236990+0000","last_became_peered":"2024-09-18T01:44:53.236990+0000","last_unstale":"2024-09-18T01:47:02.212833+0000","last_undegraded":"2024-09-18T01:47:02.212833+0000","last_fullsized":"2024-09-18T01:47:02.212833+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001062627,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.214210+0000","last_change":"2024-09-18T01:45:04.293371+0000","last_active":"2024-09-18T01:47:12.214210+0000","last_peered":"2024-09-18T01:47:12.214210+0000","last_clean":"2024-09-18T01:47:12.214210+0000","last_became_active":"2024-09-18T01:45:04.293064+0000","last_became_peered":"2024-09-18T01:45:04.293064+0000","last_unstale":"2024-09-18T01:47:12.214210+0000","last_undegraded":"2024-09-18T01:47:12.214210+0000","last_fullsized":"2024-09-18T01:47:12.214210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:40.269774+0000","last_change":"2024-09-18T01:48:40.269797+0000","last_active":"2024-09-18T01:48:40.269774+0000","last_peered":"2024-09-18T01:48:40.269774+0000","last_clean":"2024-09-18T01:48:40.269774+0000","last_became_active":"2024-09-18T01:45:08.292477+0000","last_became_peered":"2024-09-18T01:45:08.292477+0000","last_unstale":"2024-09-18T01:48:40.269774+0000","last_undegraded":"2024-09-18T01:48:40.269774+0000","last_fullsized":"2024-09-18T01:48:40.269774+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:40.269686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:40.269686+0000","last_clean_scrub_stamp":"2024-09-18T01:48:40.269686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:24:25.007900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'20","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:39.078548+0000","last_change":"2024-09-18T01:48:39.078586+0000","last_active":"2024-09-18T01:48:39.078548+0000","last_peered":"2024-09-18T01:48:39.078548+0000","last_clean":"2024-09-18T01:48:39.078548+0000","last_became_active":"2024-09-18T01:45:10.308018+0000","last_became_peered":"2024-09-18T01:45:10.308018+0000","last_unstale":"2024-09-18T01:48:39.078548+0000","last_undegraded":"2024-09-18T01:48:39.078548+0000","last_fullsized":"2024-09-18T01:48:39.078548+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'20","last_scrub_stamp":"2024-09-18T01:48:39.078443+0000","last_deep_scrub":"33'20","last_deep_scrub_stamp":"2024-09-18T01:48:39.078443+0000","last_clean_scrub_stamp":"2024-09-18T01:48:39.078443+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:25:17.630439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:22.216253+0000","last_change":"2024-09-18T01:45:12.315614+0000","last_active":"2024-09-18T01:47:22.216253+0000","last_peered":"2024-09-18T01:47:22.216253+0000","last_clean":"2024-09-18T01:47:22.216253+0000","last_became_active":"2024-09-18T01:45:12.315342+0000","last_became_peered":"2024-09-18T01:45:12.315342+0000","last_unstale":"2024-09-18T01:47:22.216253+0000","last_undegraded":"2024-09-18T01:47:22.216253+0000","last_fullsized":"2024-09-18T01:47:22.216253+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"33'6","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.849836+0000","last_change":"2024-09-18T01:45:14.323182+0000","last_active":"2024-09-18T01:48:12.849836+0000","last_peered":"2024-09-18T01:48:12.849836+0000","last_clean":"2024-09-18T01:48:12.849836+0000","last_became_active":"2024-09-18T01:45:14.322568+0000","last_became_peered":"2024-09-18T01:45:14.322568+0000","last_unstale":"2024-09-18T01:48:12.849836+0000","last_undegraded":"2024-09-18T01:48:12.849836+0000","last_fullsized":"2024-09-18T01:48:12.849836+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'14","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.846315+0000","last_change":"2024-09-18T01:45:06.292050+0000","last_active":"2024-09-18T01:48:12.846315+0000","last_peered":"2024-09-18T01:48:12.846315+0000","last_clean":"2024-09-18T01:48:12.846315+0000","last_became_active":"2024-09-18T01:45:06.291792+0000","last_became_peered":"2024-09-18T01:45:06.291792+0000","last_unstale":"2024-09-18T01:48:12.846315+0000","last_undegraded":"2024-09-18T01:48:12.846315+0000","last_fullsized":"2024-09-18T01:48:12.846315+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"31'2","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.214258+0000","last_change":"2024-09-18T01:45:04.291510+0000","last_active":"2024-09-18T01:47:12.214258+0000","last_peered":"2024-09-18T01:47:12.214258+0000","last_clean":"2024-09-18T01:47:12.214258+0000","last_became_active":"2024-09-18T01:45:04.291211+0000","last_became_peered":"2024-09-18T01:45:04.291211+0000","last_unstale":"2024-09-18T01:47:12.214258+0000","last_undegraded":"2024-09-18T01:47:12.214258+0000","last_fullsized":"2024-09-18T01:47:12.214258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:02.211388+0000","last_change":"2024-09-18T01:44:55.234985+0000","last_active":"2024-09-18T01:47:02.211388+0000","last_peered":"2024-09-18T01:47:02.211388+0000","last_clean":"2024-09-18T01:47:02.211388+0000","last_became_active":"2024-09-18T01:44:53.234966+0000","last_became_peered":"2024-09-18T01:44:53.234966+0000","last_unstale":"2024-09-18T01:47:02.211388+0000","last_undegraded":"2024-09-18T01:47:02.211388+0000","last_fullsized":"2024-09-18T01:47:02.211388+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045990099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"33'1","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.413032+0000","last_change":"2024-09-18T01:45:08.286575+0000","last_active":"2024-09-18T01:48:19.413032+0000","last_peered":"2024-09-18T01:48:19.413032+0000","last_clean":"2024-09-18T01:48:19.413032+0000","last_became_active":"2024-09-18T01:45:08.286195+0000","last_became_peered":"2024-09-18T01:45:08.286195+0000","last_unstale":"2024-09-18T01:48:19.413032+0000","last_undegraded":"2024-09-18T01:48:19.413032+0000","last_fullsized":"2024-09-18T01:48:19.413032+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'87","reported_seq":175,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:31.300441+0000","last_change":"2024-09-18T01:48:31.300515+0000","last_active":"2024-09-18T01:48:31.300441+0000","last_peered":"2024-09-18T01:48:31.300441+0000","last_clean":"2024-09-18T01:48:31.300441+0000","last_became_active":"2024-09-18T01:45:10.305948+0000","last_became_peered":"2024-09-18T01:45:10.305948+0000","last_unstale":"2024-09-18T01:48:31.300441+0000","last_undegraded":"2024-09-18T01:48:31.300441+0000","last_fullsized":"2024-09-18T01:48:31.300441+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'87","last_scrub_stamp":"2024-09-18T01:48:31.300310+0000","last_deep_scrub":"33'87","last_deep_scrub_stamp":"2024-09-18T01:48:31.300310+0000","last_clean_scrub_stamp":"2024-09-18T01:48:31.300310+0000","objects_scrubbed":11,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:18:03.428377+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":89,"num_read_kb":75,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:27.838862+0000","last_change":"2024-09-18T01:48:27.838906+0000","last_active":"2024-09-18T01:48:27.838862+0000","last_peered":"2024-09-18T01:48:27.838862+0000","last_clean":"2024-09-18T01:48:27.838862+0000","last_became_active":"2024-09-18T01:45:12.311862+0000","last_became_peered":"2024-09-18T01:45:12.311862+0000","last_unstale":"2024-09-18T01:48:27.838862+0000","last_undegraded":"2024-09-18T01:48:27.838862+0000","last_fullsized":"2024-09-18T01:48:27.838862+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:27.838756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:27.838756+0000","last_clean_scrub_stamp":"2024-09-18T01:48:27.838756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:26:33.881794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'13","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:32.215680+0000","last_change":"2024-09-18T01:45:14.311691+0000","last_active":"2024-09-18T01:47:32.215680+0000","last_peered":"2024-09-18T01:47:32.215680+0000","last_clean":"2024-09-18T01:47:32.215680+0000","last_became_active":"2024-09-18T01:45:14.311403+0000","last_became_peered":"2024-09-18T01:45:14.311403+0000","last_unstale":"2024-09-18T01:47:32.215680+0000","last_undegraded":"2024-09-18T01:47:32.215680+0000","last_fullsized":"2024-09-18T01:47:32.215680+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.214266+0000","last_change":"2024-09-18T01:45:06.292173+0000","last_active":"2024-09-18T01:47:12.214266+0000","last_peered":"2024-09-18T01:47:12.214266+0000","last_clean":"2024-09-18T01:47:12.214266+0000","last_became_active":"2024-09-18T01:45:06.291845+0000","last_became_peered":"2024-09-18T01:45:06.291845+0000","last_unstale":"2024-09-18T01:47:12.214266+0000","last_undegraded":"2024-09-18T01:47:12.214266+0000","last_fullsized":"2024-09-18T01:47:12.214266+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.212714+0000","last_change":"2024-09-18T01:45:04.273877+0000","last_active":"2024-09-18T01:47:12.212714+0000","last_peered":"2024-09-18T01:47:12.212714+0000","last_clean":"2024-09-18T01:47:12.212714+0000","last_became_active":"2024-09-18T01:45:04.273385+0000","last_became_peered":"2024-09-18T01:45:04.273385+0000","last_unstale":"2024-09-18T01:47:12.212714+0000","last_undegraded":"2024-09-18T01:47:12.212714+0000","last_fullsized":"2024-09-18T01:47:12.212714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:02.212954+0000","last_change":"2024-09-18T01:44:55.242318+0000","last_active":"2024-09-18T01:47:02.212954+0000","last_peered":"2024-09-18T01:47:02.212954+0000","last_clean":"2024-09-18T01:47:02.212954+0000","last_became_active":"2024-09-18T01:44:53.236927+0000","last_became_peered":"2024-09-18T01:44:53.236927+0000","last_unstale":"2024-09-18T01:47:02.212954+0000","last_undegraded":"2024-09-18T01:47:02.212954+0000","last_fullsized":"2024-09-18T01:47:02.212954+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00130324,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:24.061828+0000","last_change":"2024-09-18T01:48:24.061850+0000","last_active":"2024-09-18T01:48:24.061828+0000","last_peered":"2024-09-18T01:48:24.061828+0000","last_clean":"2024-09-18T01:48:24.061828+0000","last_became_active":"2024-09-18T01:45:08.296118+0000","last_became_peered":"2024-09-18T01:45:08.296118+0000","last_unstale":"2024-09-18T01:48:24.061828+0000","last_undegraded":"2024-09-18T01:48:24.061828+0000","last_fullsized":"2024-09-18T01:48:24.061828+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:24.061705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:24.061705+0000","last_clean_scrub_stamp":"2024-09-18T01:48:24.061705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:36:59.857585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"33'28","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:26.017200+0000","last_change":"2024-09-18T01:48:26.017268+0000","last_active":"2024-09-18T01:48:26.017200+0000","last_peered":"2024-09-18T01:48:26.017200+0000","last_clean":"2024-09-18T01:48:26.017200+0000","last_became_active":"2024-09-18T01:45:10.305932+0000","last_became_peered":"2024-09-18T01:45:10.305932+0000","last_unstale":"2024-09-18T01:48:26.017200+0000","last_undegraded":"2024-09-18T01:48:26.017200+0000","last_fullsized":"2024-09-18T01:48:26.017200+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'28","last_scrub_stamp":"2024-09-18T01:48:26.017059+0000","last_deep_scrub":"33'28","last_deep_scrub_stamp":"2024-09-18T01:48:26.017059+0000","last_clean_scrub_stamp":"2024-09-18T01:48:26.017059+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:54:30.634425+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'285","reported_seq":366,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:24.016372+0000","last_change":"2024-09-18T01:48:24.016399+0000","last_active":"2024-09-18T01:48:24.016372+0000","last_peered":"2024-09-18T01:48:24.016372+0000","last_clean":"2024-09-18T01:48:24.016372+0000","last_became_active":"2024-09-18T01:45:12.312117+0000","last_became_peered":"2024-09-18T01:45:12.312117+0000","last_unstale":"2024-09-18T01:48:24.016372+0000","last_undegraded":"2024-09-18T01:48:24.016372+0000","last_fullsized":"2024-09-18T01:48:24.016372+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-18T01:48:24.016276+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-18T01:48:24.016276+0000","last_clean_scrub_stamp":"2024-09-18T01:48:24.016276+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:28:28.633537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"33'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.875498+0000","last_change":"2024-09-18T01:45:14.322374+0000","last_active":"2024-09-18T01:48:12.875498+0000","last_peered":"2024-09-18T01:48:12.875498+0000","last_clean":"2024-09-18T01:48:12.875498+0000","last_became_active":"2024-09-18T01:45:14.322078+0000","last_became_peered":"2024-09-18T01:45:14.322078+0000","last_unstale":"2024-09-18T01:48:12.875498+0000","last_undegraded":"2024-09-18T01:48:12.875498+0000","last_fullsized":"2024-09-18T01:48:12.875498+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:36.099802+0000","last_change":"2024-09-18T01:48:36.099827+0000","last_active":"2024-09-18T01:48:36.099802+0000","last_peered":"2024-09-18T01:48:36.099802+0000","last_clean":"2024-09-18T01:48:36.099802+0000","last_became_active":"2024-09-18T01:45:06.297660+0000","last_became_peered":"2024-09-18T01:45:06.297660+0000","last_unstale":"2024-09-18T01:48:36.099802+0000","last_undegraded":"2024-09-18T01:48:36.099802+0000","last_fullsized":"2024-09-18T01:48:36.099802+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:48:36.099708+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:48:36.099708+0000","last_clean_scrub_stamp":"2024-09-18T01:48:36.099708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:13:48.036328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:17.215407+0000","last_change":"2024-09-18T01:45:04.294211+0000","last_active":"2024-09-18T01:47:17.215407+0000","last_peered":"2024-09-18T01:47:17.215407+0000","last_clean":"2024-09-18T01:47:17.215407+0000","last_became_active":"2024-09-18T01:45:04.288189+0000","last_became_peered":"2024-09-18T01:45:04.288189+0000","last_unstale":"2024-09-18T01:47:17.215407+0000","last_undegraded":"2024-09-18T01:47:17.215407+0000","last_fullsized":"2024-09-18T01:47:17.215407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:07.212083+0000","last_change":"2024-09-18T01:44:55.234985+0000","last_active":"2024-09-18T01:47:07.212083+0000","last_peered":"2024-09-18T01:47:07.212083+0000","last_clean":"2024-09-18T01:47:07.212083+0000","last_became_active":"2024-09-18T01:44:53.236812+0000","last_became_peered":"2024-09-18T01:44:53.236812+0000","last_unstale":"2024-09-18T01:47:07.212083+0000","last_undegraded":"2024-09-18T01:47:07.212083+0000","last_fullsized":"2024-09-18T01:47:07.212083+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044136000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:26.017291+0000","last_change":"2024-09-18T01:48:26.017324+0000","last_active":"2024-09-18T01:48:26.017291+0000","last_peered":"2024-09-18T01:48:26.017291+0000","last_clean":"2024-09-18T01:48:26.017291+0000","last_became_active":"2024-09-18T01:45:08.296102+0000","last_became_peered":"2024-09-18T01:45:08.296102+0000","last_unstale":"2024-09-18T01:48:26.017291+0000","last_undegraded":"2024-09-18T01:48:26.017291+0000","last_fullsized":"2024-09-18T01:48:26.017291+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:26.017211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:26.017211+0000","last_clean_scrub_stamp":"2024-09-18T01:48:26.017211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:29:58.682197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"31'16","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:17.215225+0000","last_change":"2024-09-18T01:45:10.309071+0000","last_active":"2024-09-18T01:47:17.215225+0000","last_peered":"2024-09-18T01:47:17.215225+0000","last_clean":"2024-09-18T01:47:17.215225+0000","last_became_active":"2024-09-18T01:45:10.308451+0000","last_became_peered":"2024-09-18T01:45:10.308451+0000","last_unstale":"2024-09-18T01:47:17.215225+0000","last_undegraded":"2024-09-18T01:47:17.215225+0000","last_fullsized":"2024-09-18T01:47:17.215225+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'285","reported_seq":432,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.581891+0000","last_change":"2024-09-18T01:45:12.314218+0000","last_active":"2024-09-18T01:48:19.581891+0000","last_peered":"2024-09-18T01:48:19.581891+0000","last_clean":"2024-09-18T01:48:19.581891+0000","last_became_active":"2024-09-18T01:45:12.313885+0000","last_became_peered":"2024-09-18T01:45:12.313885+0000","last_unstale":"2024-09-18T01:48:19.581891+0000","last_undegraded":"2024-09-18T01:48:19.581891+0000","last_fullsized":"2024-09-18T01:48:19.581891+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"33'7","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.798347+0000","last_change":"2024-09-18T01:45:14.317559+0000","last_active":"2024-09-18T01:48:12.798347+0000","last_peered":"2024-09-18T01:48:12.798347+0000","last_clean":"2024-09-18T01:48:12.798347+0000","last_became_active":"2024-09-18T01:45:14.317241+0000","last_became_peered":"2024-09-18T01:45:14.317241+0000","last_unstale":"2024-09-18T01:48:12.798347+0000","last_undegraded":"2024-09-18T01:48:12.798347+0000","last_fullsized":"2024-09-18T01:48:12.798347+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"33'8","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.660447+0000","last_change":"2024-09-18T01:45:06.285908+0000","last_active":"2024-09-18T01:48:12.660447+0000","last_peered":"2024-09-18T01:48:12.660447+0000","last_clean":"2024-09-18T01:48:12.660447+0000","last_became_active":"2024-09-18T01:45:06.285656+0000","last_became_peered":"2024-09-18T01:45:06.285656+0000","last_unstale":"2024-09-18T01:48:12.660447+0000","last_undegraded":"2024-09-18T01:48:12.660447+0000","last_fullsized":"2024-09-18T01:48:12.660447+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:17.215186+0000","last_change":"2024-09-18T01:45:04.290881+0000","last_active":"2024-09-18T01:47:17.215186+0000","last_peered":"2024-09-18T01:47:17.215186+0000","last_clean":"2024-09-18T01:47:17.215186+0000","last_became_active":"2024-09-18T01:45:04.290480+0000","last_became_peered":"2024-09-18T01:45:04.290480+0000","last_unstale":"2024-09-18T01:47:17.215186+0000","last_undegraded":"2024-09-18T01:47:17.215186+0000","last_fullsized":"2024-09-18T01:47:17.215186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:07.213812+0000","last_change":"2024-09-18T01:44:55.241531+0000","last_active":"2024-09-18T01:47:07.213812+0000","last_peered":"2024-09-18T01:47:07.213812+0000","last_clean":"2024-09-18T01:47:07.213812+0000","last_became_active":"2024-09-18T01:44:53.298677+0000","last_became_peered":"2024-09-18T01:44:53.298677+0000","last_unstale":"2024-09-18T01:47:07.213812+0000","last_undegraded":"2024-09-18T01:47:07.213812+0000","last_fullsized":"2024-09-18T01:47:07.213812+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052495500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:33.060079+0000","last_change":"2024-09-18T01:48:33.060133+0000","last_active":"2024-09-18T01:48:33.060079+0000","last_peered":"2024-09-18T01:48:33.060079+0000","last_clean":"2024-09-18T01:48:33.060079+0000","last_became_active":"2024-09-18T01:45:08.291696+0000","last_became_peered":"2024-09-18T01:45:08.291696+0000","last_unstale":"2024-09-18T01:48:33.060079+0000","last_undegraded":"2024-09-18T01:48:33.060079+0000","last_fullsized":"2024-09-18T01:48:33.060079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:33.059961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:33.059961+0000","last_clean_scrub_stamp":"2024-09-18T01:48:33.059961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:23:09.745291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'103","reported_seq":202,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:28.839003+0000","last_change":"2024-09-18T01:48:28.839049+0000","last_active":"2024-09-18T01:48:28.839003+0000","last_peered":"2024-09-18T01:48:28.839003+0000","last_clean":"2024-09-18T01:48:28.839003+0000","last_became_active":"2024-09-18T01:45:10.304662+0000","last_became_peered":"2024-09-18T01:45:10.304662+0000","last_unstale":"2024-09-18T01:48:28.839003+0000","last_undegraded":"2024-09-18T01:48:28.839003+0000","last_fullsized":"2024-09-18T01:48:28.839003+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'103","last_scrub_stamp":"2024-09-18T01:48:28.838915+0000","last_deep_scrub":"33'103","last_deep_scrub_stamp":"2024-09-18T01:48:28.838915+0000","last_clean_scrub_stamp":"2024-09-18T01:48:28.838915+0000","objects_scrubbed":9,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:19:33.132645+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":87,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:23.263295+0000","last_change":"2024-09-18T01:48:23.263316+0000","last_active":"2024-09-18T01:48:23.263295+0000","last_peered":"2024-09-18T01:48:23.263295+0000","last_clean":"2024-09-18T01:48:23.263295+0000","last_became_active":"2024-09-18T01:45:12.311399+0000","last_became_peered":"2024-09-18T01:45:12.311399+0000","last_unstale":"2024-09-18T01:48:23.263295+0000","last_undegraded":"2024-09-18T01:48:23.263295+0000","last_fullsized":"2024-09-18T01:48:23.263295+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:23.263202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:23.263202+0000","last_clean_scrub_stamp":"2024-09-18T01:48:23.263202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:54:27.880569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:32.218110+0000","last_change":"2024-09-18T01:45:14.315545+0000","last_active":"2024-09-18T01:47:32.218110+0000","last_peered":"2024-09-18T01:47:32.218110+0000","last_clean":"2024-09-18T01:47:32.218110+0000","last_became_active":"2024-09-18T01:45:14.314587+0000","last_became_peered":"2024-09-18T01:45:14.314587+0000","last_unstale":"2024-09-18T01:47:32.218110+0000","last_undegraded":"2024-09-18T01:47:32.218110+0000","last_fullsized":"2024-09-18T01:47:32.218110+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"31'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:22.216103+0000","last_change":"2024-09-18T01:45:14.326309+0000","last_active":"2024-09-18T01:47:22.216103+0000","last_peered":"2024-09-18T01:47:22.216103+0000","last_clean":"2024-09-18T01:47:22.216103+0000","last_became_active":"2024-09-18T01:45:14.326051+0000","last_became_peered":"2024-09-18T01:45:14.326051+0000","last_unstale":"2024-09-18T01:47:22.216103+0000","last_undegraded":"2024-09-18T01:47:22.216103+0000","last_fullsized":"2024-09-18T01:47:22.216103+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"33'8","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:27.217012+0000","last_change":"2024-09-18T01:45:06.284230+0000","last_active":"2024-09-18T01:47:27.217012+0000","last_peered":"2024-09-18T01:47:27.217012+0000","last_clean":"2024-09-18T01:47:27.217012+0000","last_became_active":"2024-09-18T01:45:06.283912+0000","last_became_peered":"2024-09-18T01:45:06.283912+0000","last_unstale":"2024-09-18T01:47:27.217012+0000","last_undegraded":"2024-09-18T01:47:27.217012+0000","last_fullsized":"2024-09-18T01:47:27.217012+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:27.217141+0000","last_change":"2024-09-18T01:45:04.289644+0000","last_active":"2024-09-18T01:47:27.217141+0000","last_peered":"2024-09-18T01:47:27.217141+0000","last_clean":"2024-09-18T01:47:27.217141+0000","last_became_active":"2024-09-18T01:45:04.285647+0000","last_became_peered":"2024-09-18T01:45:04.285647+0000","last_unstale":"2024-09-18T01:47:27.217141+0000","last_undegraded":"2024-09-18T01:47:27.217141+0000","last_fullsized":"2024-09-18T01:47:27.217141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:32.217992+0000","last_change":"2024-09-18T01:45:41.340307+0000","last_active":"2024-09-18T01:47:32.217992+0000","last_peered":"2024-09-18T01:47:32.217992+0000","last_clean":"2024-09-18T01:47:32.217992+0000","last_became_active":"2024-09-18T01:45:41.339936+0000","last_became_peered":"2024-09-18T01:45:41.339936+0000","last_unstale":"2024-09-18T01:47:32.217992+0000","last_undegraded":"2024-09-18T01:47:32.217992+0000","last_fullsized":"2024-09-18T01:47:32.217992+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'46","reported_seq":108,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:37.085340+0000","last_change":"2024-09-18T01:48:37.085399+0000","last_active":"2024-09-18T01:48:37.085340+0000","last_peered":"2024-09-18T01:48:37.085340+0000","last_clean":"2024-09-18T01:48:37.085340+0000","last_became_active":"2024-09-18T01:45:10.307670+0000","last_became_peered":"2024-09-18T01:45:10.307670+0000","last_unstale":"2024-09-18T01:48:37.085340+0000","last_undegraded":"2024-09-18T01:48:37.085340+0000","last_fullsized":"2024-09-18T01:48:37.085340+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'46","last_scrub_stamp":"2024-09-18T01:48:37.085236+0000","last_deep_scrub":"33'46","last_deep_scrub_stamp":"2024-09-18T01:48:37.085236+0000","last_clean_scrub_stamp":"2024-09-18T01:48:37.085236+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:57:59.334548+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:32.217950+0000","last_change":"2024-09-18T01:45:12.316684+0000","last_active":"2024-09-18T01:47:32.217950+0000","last_peered":"2024-09-18T01:47:32.217950+0000","last_clean":"2024-09-18T01:47:32.217950+0000","last_became_active":"2024-09-18T01:45:12.316192+0000","last_became_peered":"2024-09-18T01:45:12.316192+0000","last_unstale":"2024-09-18T01:47:32.217950+0000","last_undegraded":"2024-09-18T01:47:32.217950+0000","last_fullsized":"2024-09-18T01:47:32.217950+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"33'5","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.664141+0000","last_change":"2024-09-18T01:45:14.312071+0000","last_active":"2024-09-18T01:48:12.664141+0000","last_peered":"2024-09-18T01:48:12.664141+0000","last_clean":"2024-09-18T01:48:12.664141+0000","last_became_active":"2024-09-18T01:45:14.311776+0000","last_became_peered":"2024-09-18T01:45:14.311776+0000","last_unstale":"2024-09-18T01:48:12.664141+0000","last_undegraded":"2024-09-18T01:48:12.664141+0000","last_fullsized":"2024-09-18T01:48:12.664141+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'8","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.660664+0000","last_change":"2024-09-18T01:45:06.292121+0000","last_active":"2024-09-18T01:48:12.660664+0000","last_peered":"2024-09-18T01:48:12.660664+0000","last_clean":"2024-09-18T01:48:12.660664+0000","last_became_active":"2024-09-18T01:45:06.291811+0000","last_became_peered":"2024-09-18T01:45:06.291811+0000","last_unstale":"2024-09-18T01:48:12.660664+0000","last_undegraded":"2024-09-18T01:48:12.660664+0000","last_fullsized":"2024-09-18T01:48:12.660664+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:32.218083+0000","last_change":"2024-09-18T01:45:04.289933+0000","last_active":"2024-09-18T01:47:32.218083+0000","last_peered":"2024-09-18T01:47:32.218083+0000","last_clean":"2024-09-18T01:47:32.218083+0000","last_became_active":"2024-09-18T01:45:04.289655+0000","last_became_peered":"2024-09-18T01:45:04.289655+0000","last_unstale":"2024-09-18T01:47:32.218083+0000","last_undegraded":"2024-09-18T01:47:32.218083+0000","last_fullsized":"2024-09-18T01:47:32.218083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:32.218085+0000","last_change":"2024-09-18T01:45:41.342483+0000","last_active":"2024-09-18T01:47:32.218085+0000","last_peered":"2024-09-18T01:47:32.218085+0000","last_clean":"2024-09-18T01:47:32.218085+0000","last_became_active":"2024-09-18T01:45:41.342149+0000","last_became_peered":"2024-09-18T01:45:41.342149+0000","last_unstale":"2024-09-18T01:47:32.218085+0000","last_undegraded":"2024-09-18T01:47:32.218085+0000","last_fullsized":"2024-09-18T01:47:32.218085+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'8","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:36.330207+0000","last_change":"2024-09-18T01:48:36.330239+0000","last_active":"2024-09-18T01:48:36.330207+0000","last_peered":"2024-09-18T01:48:36.330207+0000","last_clean":"2024-09-18T01:48:36.330207+0000","last_became_active":"2024-09-18T01:45:10.296387+0000","last_became_peered":"2024-09-18T01:45:10.296387+0000","last_unstale":"2024-09-18T01:48:36.330207+0000","last_undegraded":"2024-09-18T01:48:36.330207+0000","last_fullsized":"2024-09-18T01:48:36.330207+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-18T01:48:36.330117+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-18T01:48:36.330117+0000","last_clean_scrub_stamp":"2024-09-18T01:48:36.330117+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:18:02.338887+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:35.876388+0000","last_change":"2024-09-18T01:48:35.876410+0000","last_active":"2024-09-18T01:48:35.876388+0000","last_peered":"2024-09-18T01:48:35.876388+0000","last_clean":"2024-09-18T01:48:35.876388+0000","last_became_active":"2024-09-18T01:45:12.313159+0000","last_became_peered":"2024-09-18T01:45:12.313159+0000","last_unstale":"2024-09-18T01:48:35.876388+0000","last_undegraded":"2024-09-18T01:48:35.876388+0000","last_fullsized":"2024-09-18T01:48:35.876388+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:35.876295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:35.876295+0000","last_clean_scrub_stamp":"2024-09-18T01:48:35.876295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:09:42.402630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:47.218043+0000","last_change":"2024-09-18T01:45:14.319376+0000","last_active":"2024-09-18T01:47:47.218043+0000","last_peered":"2024-09-18T01:47:47.218043+0000","last_clean":"2024-09-18T01:47:47.218043+0000","last_became_active":"2024-09-18T01:45:14.319073+0000","last_became_peered":"2024-09-18T01:45:14.319073+0000","last_unstale":"2024-09-18T01:47:47.218043+0000","last_undegraded":"2024-09-18T01:47:47.218043+0000","last_fullsized":"2024-09-18T01:47:47.218043+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'5","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.929453+0000","last_change":"2024-09-18T01:45:06.276739+0000","last_active":"2024-09-18T01:48:12.929453+0000","last_peered":"2024-09-18T01:48:12.929453+0000","last_clean":"2024-09-18T01:48:12.929453+0000","last_became_active":"2024-09-18T01:45:06.276408+0000","last_became_peered":"2024-09-18T01:45:06.276408+0000","last_unstale":"2024-09-18T01:48:12.929453+0000","last_undegraded":"2024-09-18T01:48:12.929453+0000","last_fullsized":"2024-09-18T01:48:12.929453+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"33'6","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.791435+0000","last_change":"2024-09-18T01:45:04.287172+0000","last_active":"2024-09-18T01:48:12.791435+0000","last_peered":"2024-09-18T01:48:12.791435+0000","last_clean":"2024-09-18T01:48:12.791435+0000","last_became_active":"2024-09-18T01:45:04.286887+0000","last_became_peered":"2024-09-18T01:45:04.286887+0000","last_unstale":"2024-09-18T01:48:12.791435+0000","last_undegraded":"2024-09-18T01:48:12.791435+0000","last_fullsized":"2024-09-18T01:48:12.791435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:37.881629+0000","last_change":"2024-09-18T01:48:37.881673+0000","last_active":"2024-09-18T01:48:37.881629+0000","last_peered":"2024-09-18T01:48:37.881629+0000","last_clean":"2024-09-18T01:48:37.881629+0000","last_became_active":"2024-09-18T01:45:08.291575+0000","last_became_peered":"2024-09-18T01:45:08.291575+0000","last_unstale":"2024-09-18T01:48:37.881629+0000","last_undegraded":"2024-09-18T01:48:37.881629+0000","last_fullsized":"2024-09-18T01:48:37.881629+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:37.881519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:37.881519+0000","last_clean_scrub_stamp":"2024-09-18T01:48:37.881519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:48:21.895224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'47","reported_seq":119,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:34.322285+0000","last_change":"2024-09-18T01:48:34.322343+0000","last_active":"2024-09-18T01:48:34.322285+0000","last_peered":"2024-09-18T01:48:34.322285+0000","last_clean":"2024-09-18T01:48:34.322285+0000","last_became_active":"2024-09-18T01:45:10.297904+0000","last_became_peered":"2024-09-18T01:45:10.297904+0000","last_unstale":"2024-09-18T01:48:34.322285+0000","last_undegraded":"2024-09-18T01:48:34.322285+0000","last_fullsized":"2024-09-18T01:48:34.322285+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'47","last_scrub_stamp":"2024-09-18T01:48:34.322182+0000","last_deep_scrub":"33'47","last_deep_scrub_stamp":"2024-09-18T01:48:34.322182+0000","last_clean_scrub_stamp":"2024-09-18T01:48:34.322182+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:23:05.910626+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:23.035826+0000","last_change":"2024-09-18T01:48:23.035896+0000","last_active":"2024-09-18T01:48:23.035826+0000","last_peered":"2024-09-18T01:48:23.035826+0000","last_clean":"2024-09-18T01:48:23.035826+0000","last_became_active":"2024-09-18T01:45:12.313186+0000","last_became_peered":"2024-09-18T01:45:12.313186+0000","last_unstale":"2024-09-18T01:48:23.035826+0000","last_undegraded":"2024-09-18T01:48:23.035826+0000","last_fullsized":"2024-09-18T01:48:23.035826+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:23.035704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:23.035704+0000","last_clean_scrub_stamp":"2024-09-18T01:48:23.035704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:54:29.422521+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:47.220828+0000","last_change":"2024-09-18T01:45:14.326931+0000","last_active":"2024-09-18T01:47:47.220828+0000","last_peered":"2024-09-18T01:47:47.220828+0000","last_clean":"2024-09-18T01:47:47.220828+0000","last_became_active":"2024-09-18T01:45:14.326668+0000","last_became_peered":"2024-09-18T01:45:14.326668+0000","last_unstale":"2024-09-18T01:47:47.220828+0000","last_undegraded":"2024-09-18T01:47:47.220828+0000","last_fullsized":"2024-09-18T01:47:47.220828+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'18","reported_seq":104,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:40.058439+0000","last_change":"2024-09-18T01:48:40.058472+0000","last_active":"2024-09-18T01:48:40.058439+0000","last_peered":"2024-09-18T01:48:40.058439+0000","last_clean":"2024-09-18T01:48:40.058439+0000","last_became_active":"2024-09-18T01:45:06.297220+0000","last_became_peered":"2024-09-18T01:45:06.297220+0000","last_unstale":"2024-09-18T01:48:40.058439+0000","last_undegraded":"2024-09-18T01:48:40.058439+0000","last_fullsized":"2024-09-18T01:48:40.058439+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'18","last_scrub_stamp":"2024-09-18T01:48:40.058351+0000","last_deep_scrub":"33'18","last_deep_scrub_stamp":"2024-09-18T01:48:40.058351+0000","last_clean_scrub_stamp":"2024-09-18T01:48:40.058351+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:54:41.006349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":76,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:32.218146+0000","last_change":"2024-09-18T01:45:04.283606+0000","last_active":"2024-09-18T01:47:32.218146+0000","last_peered":"2024-09-18T01:47:32.218146+0000","last_clean":"2024-09-18T01:47:32.218146+0000","last_became_active":"2024-09-18T01:45:04.283276+0000","last_became_peered":"2024-09-18T01:45:04.283276+0000","last_unstale":"2024-09-18T01:47:32.218146+0000","last_undegraded":"2024-09-18T01:47:32.218146+0000","last_fullsized":"2024-09-18T01:47:32.218146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:34.100552+0000","last_change":"2024-09-18T01:48:34.100576+0000","last_active":"2024-09-18T01:48:34.100552+0000","last_peered":"2024-09-18T01:48:34.100552+0000","last_clean":"2024-09-18T01:48:34.100552+0000","last_became_active":"2024-09-18T01:45:08.290911+0000","last_became_peered":"2024-09-18T01:45:08.290911+0000","last_unstale":"2024-09-18T01:48:34.100552+0000","last_undegraded":"2024-09-18T01:48:34.100552+0000","last_fullsized":"2024-09-18T01:48:34.100552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:34.100451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:34.100451+0000","last_clean_scrub_stamp":"2024-09-18T01:48:34.100451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:18:59.693645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'36","reported_seq":91,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:30.819537+0000","last_change":"2024-09-18T01:48:30.819572+0000","last_active":"2024-09-18T01:48:30.819537+0000","last_peered":"2024-09-18T01:48:30.819537+0000","last_clean":"2024-09-18T01:48:30.819537+0000","last_became_active":"2024-09-18T01:45:10.301622+0000","last_became_peered":"2024-09-18T01:45:10.301622+0000","last_unstale":"2024-09-18T01:48:30.819537+0000","last_undegraded":"2024-09-18T01:48:30.819537+0000","last_fullsized":"2024-09-18T01:48:30.819537+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'36","last_scrub_stamp":"2024-09-18T01:48:30.819448+0000","last_deep_scrub":"33'36","last_deep_scrub_stamp":"2024-09-18T01:48:30.819448+0000","last_clean_scrub_stamp":"2024-09-18T01:48:30.819448+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:02:48.244921+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:31.837156+0000","last_change":"2024-09-18T01:48:31.837196+0000","last_active":"2024-09-18T01:48:31.837156+0000","last_peered":"2024-09-18T01:48:31.837156+0000","last_clean":"2024-09-18T01:48:31.837156+0000","last_became_active":"2024-09-18T01:45:12.313096+0000","last_became_peered":"2024-09-18T01:45:12.313096+0000","last_unstale":"2024-09-18T01:48:31.837156+0000","last_undegraded":"2024-09-18T01:48:31.837156+0000","last_fullsized":"2024-09-18T01:48:31.837156+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:31.837028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:31.837028+0000","last_clean_scrub_stamp":"2024-09-18T01:48:31.837028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:55:19.988045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"33'12","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.879667+0000","last_change":"2024-09-18T01:45:06.282718+0000","last_active":"2024-09-18T01:48:12.879667+0000","last_peered":"2024-09-18T01:48:12.879667+0000","last_clean":"2024-09-18T01:48:12.879667+0000","last_became_active":"2024-09-18T01:45:06.282461+0000","last_became_peered":"2024-09-18T01:45:06.282461+0000","last_unstale":"2024-09-18T01:48:12.879667+0000","last_undegraded":"2024-09-18T01:48:12.879667+0000","last_fullsized":"2024-09-18T01:48:12.879667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"33'8","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.542077+0000","last_change":"2024-09-18T01:45:04.293367+0000","last_active":"2024-09-18T01:48:12.542077+0000","last_peered":"2024-09-18T01:48:12.542077+0000","last_clean":"2024-09-18T01:48:12.542077+0000","last_became_active":"2024-09-18T01:45:04.288082+0000","last_became_peered":"2024-09-18T01:45:04.288082+0000","last_unstale":"2024-09-18T01:48:12.542077+0000","last_undegraded":"2024-09-18T01:48:12.542077+0000","last_fullsized":"2024-09-18T01:48:12.542077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":48,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:39.315823+0000","last_change":"2024-09-18T01:48:39.315849+0000","last_active":"2024-09-18T01:48:39.315823+0000","last_peered":"2024-09-18T01:48:39.315823+0000","last_clean":"2024-09-18T01:48:39.315823+0000","last_became_active":"2024-09-18T01:45:08.292739+0000","last_became_peered":"2024-09-18T01:45:08.292739+0000","last_unstale":"2024-09-18T01:48:39.315823+0000","last_undegraded":"2024-09-18T01:48:39.315823+0000","last_fullsized":"2024-09-18T01:48:39.315823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:39.315733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:39.315733+0000","last_clean_scrub_stamp":"2024-09-18T01:48:39.315733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:28:18.241750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'70","reported_seq":149,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:35.355474+0000","last_change":"2024-09-18T01:48:35.355511+0000","last_active":"2024-09-18T01:48:35.355474+0000","last_peered":"2024-09-18T01:48:35.355474+0000","last_clean":"2024-09-18T01:48:35.355474+0000","last_became_active":"2024-09-18T01:45:10.296396+0000","last_became_peered":"2024-09-18T01:45:10.296396+0000","last_unstale":"2024-09-18T01:48:35.355474+0000","last_undegraded":"2024-09-18T01:48:35.355474+0000","last_fullsized":"2024-09-18T01:48:35.355474+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'70","last_scrub_stamp":"2024-09-18T01:48:35.355370+0000","last_deep_scrub":"33'70","last_deep_scrub_stamp":"2024-09-18T01:48:35.355370+0000","last_clean_scrub_stamp":"2024-09-18T01:48:35.355370+0000","objects_scrubbed":6,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:18:17.350454+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:23.816836+0000","last_change":"2024-09-18T01:48:23.816862+0000","last_active":"2024-09-18T01:48:23.816836+0000","last_peered":"2024-09-18T01:48:23.816836+0000","last_clean":"2024-09-18T01:48:23.816836+0000","last_became_active":"2024-09-18T01:45:12.307279+0000","last_became_peered":"2024-09-18T01:45:12.307279+0000","last_unstale":"2024-09-18T01:48:23.816836+0000","last_undegraded":"2024-09-18T01:48:23.816836+0000","last_fullsized":"2024-09-18T01:48:23.816836+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:23.816708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:23.816708+0000","last_clean_scrub_stamp":"2024-09-18T01:48:23.816708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:52:57.423754+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'22","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:37.216352+0000","last_change":"2024-09-18T01:45:14.320125+0000","last_active":"2024-09-18T01:47:37.216352+0000","last_peered":"2024-09-18T01:47:37.216352+0000","last_clean":"2024-09-18T01:47:37.216352+0000","last_became_active":"2024-09-18T01:45:14.319540+0000","last_became_peered":"2024-09-18T01:45:14.319540+0000","last_unstale":"2024-09-18T01:47:37.216352+0000","last_undegraded":"2024-09-18T01:47:37.216352+0000","last_fullsized":"2024-09-18T01:47:37.216352+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":65,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'18","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.803894+0000","last_change":"2024-09-18T01:45:06.293374+0000","last_active":"2024-09-18T01:48:12.803894+0000","last_peered":"2024-09-18T01:48:12.803894+0000","last_clean":"2024-09-18T01:48:12.803894+0000","last_became_active":"2024-09-18T01:45:06.293053+0000","last_became_peered":"2024-09-18T01:45:06.293053+0000","last_unstale":"2024-09-18T01:48:12.803894+0000","last_undegraded":"2024-09-18T01:48:12.803894+0000","last_fullsized":"2024-09-18T01:48:12.803894+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":45,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:32.217904+0000","last_change":"2024-09-18T01:45:04.292562+0000","last_active":"2024-09-18T01:47:32.217904+0000","last_peered":"2024-09-18T01:47:32.217904+0000","last_clean":"2024-09-18T01:47:32.217904+0000","last_became_active":"2024-09-18T01:45:04.292082+0000","last_became_peered":"2024-09-18T01:45:04.292082+0000","last_unstale":"2024-09-18T01:47:32.217904+0000","last_undegraded":"2024-09-18T01:47:32.217904+0000","last_fullsized":"2024-09-18T01:47:32.217904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:38.882271+0000","last_change":"2024-09-18T01:48:38.882296+0000","last_active":"2024-09-18T01:48:38.882271+0000","last_peered":"2024-09-18T01:48:38.882271+0000","last_clean":"2024-09-18T01:48:38.882271+0000","last_became_active":"2024-09-18T01:45:08.286609+0000","last_became_peered":"2024-09-18T01:45:08.286609+0000","last_unstale":"2024-09-18T01:48:38.882271+0000","last_undegraded":"2024-09-18T01:48:38.882271+0000","last_fullsized":"2024-09-18T01:48:38.882271+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:38.882174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:38.882174+0000","last_clean_scrub_stamp":"2024-09-18T01:48:38.882174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:30:42.400285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'39","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.510511+0000","last_change":"2024-09-18T01:45:10.309790+0000","last_active":"2024-09-18T01:48:19.510511+0000","last_peered":"2024-09-18T01:48:19.510511+0000","last_clean":"2024-09-18T01:48:19.510511+0000","last_became_active":"2024-09-18T01:45:10.309360+0000","last_became_peered":"2024-09-18T01:45:10.309360+0000","last_unstale":"2024-09-18T01:48:19.510511+0000","last_undegraded":"2024-09-18T01:48:19.510511+0000","last_fullsized":"2024-09-18T01:48:19.510511+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:30.911520+0000","last_change":"2024-09-18T01:48:30.911546+0000","last_active":"2024-09-18T01:48:30.911520+0000","last_peered":"2024-09-18T01:48:30.911520+0000","last_clean":"2024-09-18T01:48:30.911520+0000","last_became_active":"2024-09-18T01:45:12.314499+0000","last_became_peered":"2024-09-18T01:45:12.314499+0000","last_unstale":"2024-09-18T01:48:30.911520+0000","last_undegraded":"2024-09-18T01:48:30.911520+0000","last_fullsized":"2024-09-18T01:48:30.911520+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:30.911422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:30.911422+0000","last_clean_scrub_stamp":"2024-09-18T01:48:30.911422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:07:15.930276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"33'2","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:37.219002+0000","last_change":"2024-09-18T01:45:14.326163+0000","last_active":"2024-09-18T01:47:37.219002+0000","last_peered":"2024-09-18T01:47:37.219002+0000","last_clean":"2024-09-18T01:47:37.219002+0000","last_became_active":"2024-09-18T01:45:14.325421+0000","last_became_peered":"2024-09-18T01:45:14.325421+0000","last_unstale":"2024-09-18T01:47:37.219002+0000","last_undegraded":"2024-09-18T01:47:37.219002+0000","last_fullsized":"2024-09-18T01:47:37.219002+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'8","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.566862+0000","last_change":"2024-09-18T01:45:06.287633+0000","last_active":"2024-09-18T01:48:12.566862+0000","last_peered":"2024-09-18T01:48:12.566862+0000","last_clean":"2024-09-18T01:48:12.566862+0000","last_became_active":"2024-09-18T01:45:06.286153+0000","last_became_peered":"2024-09-18T01:45:06.286153+0000","last_unstale":"2024-09-18T01:48:12.566862+0000","last_undegraded":"2024-09-18T01:48:12.566862+0000","last_fullsized":"2024-09-18T01:48:12.566862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:37.219045+0000","last_change":"2024-09-18T01:45:04.295250+0000","last_active":"2024-09-18T01:47:37.219045+0000","last_peered":"2024-09-18T01:47:37.219045+0000","last_clean":"2024-09-18T01:47:37.219045+0000","last_became_active":"2024-09-18T01:45:04.294537+0000","last_became_peered":"2024-09-18T01:45:04.294537+0000","last_unstale":"2024-09-18T01:47:37.219045+0000","last_undegraded":"2024-09-18T01:47:37.219045+0000","last_fullsized":"2024-09-18T01:47:37.219045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:40.973877+0000","last_change":"2024-09-18T01:48:40.973902+0000","last_active":"2024-09-18T01:48:40.973877+0000","last_peered":"2024-09-18T01:48:40.973877+0000","last_clean":"2024-09-18T01:48:40.973877+0000","last_became_active":"2024-09-18T01:45:08.286466+0000","last_became_peered":"2024-09-18T01:45:08.286466+0000","last_unstale":"2024-09-18T01:48:40.973877+0000","last_undegraded":"2024-09-18T01:48:40.973877+0000","last_fullsized":"2024-09-18T01:48:40.973877+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:40.973787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:40.973787+0000","last_clean_scrub_stamp":"2024-09-18T01:48:40.973787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:56:31.069811+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'48","reported_seq":110,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:32.347306+0000","last_change":"2024-09-18T01:48:32.347342+0000","last_active":"2024-09-18T01:48:32.347306+0000","last_peered":"2024-09-18T01:48:32.347306+0000","last_clean":"2024-09-18T01:48:32.347306+0000","last_became_active":"2024-09-18T01:45:10.303911+0000","last_became_peered":"2024-09-18T01:45:10.303911+0000","last_unstale":"2024-09-18T01:48:32.347306+0000","last_undegraded":"2024-09-18T01:48:32.347306+0000","last_fullsized":"2024-09-18T01:48:32.347306+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'48","last_scrub_stamp":"2024-09-18T01:48:32.347225+0000","last_deep_scrub":"33'48","last_deep_scrub_stamp":"2024-09-18T01:48:32.347225+0000","last_clean_scrub_stamp":"2024-09-18T01:48:32.347225+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:04:17.415601+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:37.329010+0000","last_change":"2024-09-18T01:48:37.329031+0000","last_active":"2024-09-18T01:48:37.329010+0000","last_peered":"2024-09-18T01:48:37.329010+0000","last_clean":"2024-09-18T01:48:37.329010+0000","last_became_active":"2024-09-18T01:45:12.313180+0000","last_became_peered":"2024-09-18T01:45:12.313180+0000","last_unstale":"2024-09-18T01:48:37.329010+0000","last_undegraded":"2024-09-18T01:48:37.329010+0000","last_fullsized":"2024-09-18T01:48:37.329010+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:37.328895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:37.328895+0000","last_clean_scrub_stamp":"2024-09-18T01:48:37.328895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:52:12.877855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"33'3","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:37.218959+0000","last_change":"2024-09-18T01:45:14.326771+0000","last_active":"2024-09-18T01:47:37.218959+0000","last_peered":"2024-09-18T01:47:37.218959+0000","last_clean":"2024-09-18T01:47:37.218959+0000","last_became_active":"2024-09-18T01:45:14.326452+0000","last_became_peered":"2024-09-18T01:45:14.326452+0000","last_unstale":"2024-09-18T01:47:37.218959+0000","last_undegraded":"2024-09-18T01:47:37.218959+0000","last_fullsized":"2024-09-18T01:47:37.218959+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:37.216397+0000","last_change":"2024-09-18T01:45:06.282527+0000","last_active":"2024-09-18T01:47:37.216397+0000","last_peered":"2024-09-18T01:47:37.216397+0000","last_clean":"2024-09-18T01:47:37.216397+0000","last_became_active":"2024-09-18T01:45:06.281987+0000","last_became_peered":"2024-09-18T01:45:06.281987+0000","last_unstale":"2024-09-18T01:47:37.216397+0000","last_undegraded":"2024-09-18T01:47:37.216397+0000","last_fullsized":"2024-09-18T01:47:37.216397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.489501+0000","last_change":"2024-09-18T01:45:04.290235+0000","last_active":"2024-09-18T01:48:19.489501+0000","last_peered":"2024-09-18T01:48:19.489501+0000","last_clean":"2024-09-18T01:48:19.489501+0000","last_became_active":"2024-09-18T01:45:04.289909+0000","last_became_peered":"2024-09-18T01:45:04.289909+0000","last_unstale":"2024-09-18T01:48:19.489501+0000","last_undegraded":"2024-09-18T01:48:19.489501+0000","last_fullsized":"2024-09-18T01:48:19.489501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:42.220069+0000","last_change":"2024-09-18T01:45:41.342634+0000","last_active":"2024-09-18T01:47:42.220069+0000","last_peered":"2024-09-18T01:47:42.220069+0000","last_clean":"2024-09-18T01:47:42.220069+0000","last_became_active":"2024-09-18T01:45:41.342280+0000","last_became_peered":"2024-09-18T01:45:41.342280+0000","last_unstale":"2024-09-18T01:47:42.220069+0000","last_undegraded":"2024-09-18T01:47:42.220069+0000","last_fullsized":"2024-09-18T01:47:42.220069+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'16","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.214553+0000","last_change":"2024-09-18T01:45:10.308886+0000","last_active":"2024-09-18T01:47:12.214553+0000","last_peered":"2024-09-18T01:47:12.214553+0000","last_clean":"2024-09-18T01:47:12.214553+0000","last_became_active":"2024-09-18T01:45:10.308524+0000","last_became_peered":"2024-09-18T01:45:10.308524+0000","last_unstale":"2024-09-18T01:47:12.214553+0000","last_undegraded":"2024-09-18T01:47:12.214553+0000","last_fullsized":"2024-09-18T01:47:12.214553+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'285","reported_seq":428,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:24.767989+0000","last_change":"2024-09-18T01:48:24.768020+0000","last_active":"2024-09-18T01:48:24.767989+0000","last_peered":"2024-09-18T01:48:24.767989+0000","last_clean":"2024-09-18T01:48:24.767989+0000","last_became_active":"2024-09-18T01:45:12.307186+0000","last_became_peered":"2024-09-18T01:45:12.307186+0000","last_unstale":"2024-09-18T01:48:24.767989+0000","last_undegraded":"2024-09-18T01:48:24.767989+0000","last_fullsized":"2024-09-18T01:48:24.767989+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-18T01:48:24.767877+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-18T01:48:24.767877+0000","last_clean_scrub_stamp":"2024-09-18T01:48:24.767877+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:40:56.957174+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"33'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.988462+0000","last_change":"2024-09-18T01:45:14.326301+0000","last_active":"2024-09-18T01:48:12.988462+0000","last_peered":"2024-09-18T01:48:12.988462+0000","last_clean":"2024-09-18T01:48:12.988462+0000","last_became_active":"2024-09-18T01:45:14.326018+0000","last_became_peered":"2024-09-18T01:45:14.326018+0000","last_unstale":"2024-09-18T01:48:12.988462+0000","last_undegraded":"2024-09-18T01:48:12.988462+0000","last_fullsized":"2024-09-18T01:48:12.988462+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"33'8","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.567850+0000","last_change":"2024-09-18T01:45:06.282281+0000","last_active":"2024-09-18T01:48:12.567850+0000","last_peered":"2024-09-18T01:48:12.567850+0000","last_clean":"2024-09-18T01:48:12.567850+0000","last_became_active":"2024-09-18T01:45:06.281798+0000","last_became_peered":"2024-09-18T01:45:06.281798+0000","last_unstale":"2024-09-18T01:48:12.567850+0000","last_undegraded":"2024-09-18T01:48:12.567850+0000","last_fullsized":"2024-09-18T01:48:12.567850+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:37.219117+0000","last_change":"2024-09-18T01:45:04.293329+0000","last_active":"2024-09-18T01:47:37.219117+0000","last_peered":"2024-09-18T01:47:37.219117+0000","last_clean":"2024-09-18T01:47:37.219117+0000","last_became_active":"2024-09-18T01:45:04.293009+0000","last_became_peered":"2024-09-18T01:45:04.293009+0000","last_unstale":"2024-09-18T01:47:37.219117+0000","last_undegraded":"2024-09-18T01:47:37.219117+0000","last_fullsized":"2024-09-18T01:47:37.219117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:40.879858+0000","last_change":"2024-09-18T01:48:40.879897+0000","last_active":"2024-09-18T01:48:40.879858+0000","last_peered":"2024-09-18T01:48:40.879858+0000","last_clean":"2024-09-18T01:48:40.879858+0000","last_became_active":"2024-09-18T01:45:08.287884+0000","last_became_peered":"2024-09-18T01:45:08.287884+0000","last_unstale":"2024-09-18T01:48:40.879858+0000","last_undegraded":"2024-09-18T01:48:40.879858+0000","last_fullsized":"2024-09-18T01:48:40.879858+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:40.879744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:40.879744+0000","last_clean_scrub_stamp":"2024-09-18T01:48:40.879744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:23:57.801261+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'74","reported_seq":156,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:29.900192+0000","last_change":"2024-09-18T01:48:29.900260+0000","last_active":"2024-09-18T01:48:29.900192+0000","last_peered":"2024-09-18T01:48:29.900192+0000","last_clean":"2024-09-18T01:48:29.900192+0000","last_became_active":"2024-09-18T01:45:10.301087+0000","last_became_peered":"2024-09-18T01:45:10.301087+0000","last_unstale":"2024-09-18T01:48:29.900192+0000","last_undegraded":"2024-09-18T01:48:29.900192+0000","last_fullsized":"2024-09-18T01:48:29.900192+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'74","last_scrub_stamp":"2024-09-18T01:48:29.900089+0000","last_deep_scrub":"33'74","last_deep_scrub_stamp":"2024-09-18T01:48:29.900089+0000","last_clean_scrub_stamp":"2024-09-18T01:48:29.900089+0000","objects_scrubbed":11,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:03:12.147484+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:25.260421+0000","last_change":"2024-09-18T01:48:25.260445+0000","last_active":"2024-09-18T01:48:25.260421+0000","last_peered":"2024-09-18T01:48:25.260421+0000","last_clean":"2024-09-18T01:48:25.260421+0000","last_became_active":"2024-09-18T01:45:12.312055+0000","last_became_peered":"2024-09-18T01:45:12.312055+0000","last_unstale":"2024-09-18T01:48:25.260421+0000","last_undegraded":"2024-09-18T01:48:25.260421+0000","last_fullsized":"2024-09-18T01:48:25.260421+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:25.260301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:25.260301+0000","last_clean_scrub_stamp":"2024-09-18T01:48:25.260301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:20:06.632858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"33'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:42.220112+0000","last_change":"2024-09-18T01:45:14.323228+0000","last_active":"2024-09-18T01:47:42.220112+0000","last_peered":"2024-09-18T01:47:42.220112+0000","last_clean":"2024-09-18T01:47:42.220112+0000","last_became_active":"2024-09-18T01:45:14.322945+0000","last_became_peered":"2024-09-18T01:45:14.322945+0000","last_unstale":"2024-09-18T01:47:42.220112+0000","last_undegraded":"2024-09-18T01:47:42.220112+0000","last_fullsized":"2024-09-18T01:47:42.220112+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'6","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.659649+0000","last_change":"2024-09-18T01:45:06.282529+0000","last_active":"2024-09-18T01:48:12.659649+0000","last_peered":"2024-09-18T01:48:12.659649+0000","last_clean":"2024-09-18T01:48:12.659649+0000","last_became_active":"2024-09-18T01:45:06.281480+0000","last_became_peered":"2024-09-18T01:45:06.281480+0000","last_unstale":"2024-09-18T01:48:12.659649+0000","last_undegraded":"2024-09-18T01:48:12.659649+0000","last_fullsized":"2024-09-18T01:48:12.659649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:37.219189+0000","last_change":"2024-09-18T01:45:04.291296+0000","last_active":"2024-09-18T01:47:37.219189+0000","last_peered":"2024-09-18T01:47:37.219189+0000","last_clean":"2024-09-18T01:47:37.219189+0000","last_became_active":"2024-09-18T01:45:04.290901+0000","last_became_peered":"2024-09-18T01:45:04.290901+0000","last_unstale":"2024-09-18T01:47:37.219189+0000","last_undegraded":"2024-09-18T01:47:37.219189+0000","last_fullsized":"2024-09-18T01:47:37.219189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:41.995434+0000","last_change":"2024-09-18T01:48:41.995473+0000","last_active":"2024-09-18T01:48:41.995434+0000","last_peered":"2024-09-18T01:48:41.995434+0000","last_clean":"2024-09-18T01:48:41.995434+0000","last_became_active":"2024-09-18T01:45:08.286502+0000","last_became_peered":"2024-09-18T01:45:08.286502+0000","last_unstale":"2024-09-18T01:48:41.995434+0000","last_undegraded":"2024-09-18T01:48:41.995434+0000","last_fullsized":"2024-09-18T01:48:41.995434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:41.995333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:41.995333+0000","last_clean_scrub_stamp":"2024-09-18T01:48:41.995333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:40:51.267310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'43","reported_seq":104,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:30.281139+0000","last_change":"2024-09-18T01:48:30.281182+0000","last_active":"2024-09-18T01:48:30.281139+0000","last_peered":"2024-09-18T01:48:30.281139+0000","last_clean":"2024-09-18T01:48:30.281139+0000","last_became_active":"2024-09-18T01:45:10.306076+0000","last_became_peered":"2024-09-18T01:45:10.306076+0000","last_unstale":"2024-09-18T01:48:30.281139+0000","last_undegraded":"2024-09-18T01:48:30.281139+0000","last_fullsized":"2024-09-18T01:48:30.281139+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-09-18T01:48:30.281049+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-09-18T01:48:30.281049+0000","last_clean_scrub_stamp":"2024-09-18T01:48:30.281049+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:14:03.450919+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:37.218920+0000","last_change":"2024-09-18T01:45:12.316303+0000","last_active":"2024-09-18T01:47:37.218920+0000","last_peered":"2024-09-18T01:47:37.218920+0000","last_clean":"2024-09-18T01:47:37.218920+0000","last_became_active":"2024-09-18T01:45:12.316022+0000","last_became_peered":"2024-09-18T01:45:12.316022+0000","last_unstale":"2024-09-18T01:47:37.218920+0000","last_undegraded":"2024-09-18T01:47:37.218920+0000","last_fullsized":"2024-09-18T01:47:37.218920+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:42.220053+0000","last_change":"2024-09-18T01:45:14.325515+0000","last_active":"2024-09-18T01:47:42.220053+0000","last_peered":"2024-09-18T01:47:42.220053+0000","last_clean":"2024-09-18T01:47:42.220053+0000","last_became_active":"2024-09-18T01:45:14.325208+0000","last_became_peered":"2024-09-18T01:45:14.325208+0000","last_unstale":"2024-09-18T01:47:42.220053+0000","last_undegraded":"2024-09-18T01:47:42.220053+0000","last_fullsized":"2024-09-18T01:47:42.220053+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'26","reported_seq":95,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.879679+0000","last_change":"2024-09-18T01:45:06.283428+0000","last_active":"2024-09-18T01:48:12.879679+0000","last_peered":"2024-09-18T01:48:12.879679+0000","last_clean":"2024-09-18T01:48:12.879679+0000","last_became_active":"2024-09-18T01:45:06.283174+0000","last_became_peered":"2024-09-18T01:45:06.283174+0000","last_unstale":"2024-09-18T01:48:12.879679+0000","last_undegraded":"2024-09-18T01:48:12.879679+0000","last_fullsized":"2024-09-18T01:48:12.879679+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":84,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:07.212095+0000","last_change":"2024-09-18T01:45:04.273552+0000","last_active":"2024-09-18T01:47:07.212095+0000","last_peered":"2024-09-18T01:47:07.212095+0000","last_clean":"2024-09-18T01:47:07.212095+0000","last_became_active":"2024-09-18T01:45:04.273128+0000","last_became_peered":"2024-09-18T01:45:04.273128+0000","last_unstale":"2024-09-18T01:47:07.212095+0000","last_undegraded":"2024-09-18T01:47:07.212095+0000","last_fullsized":"2024-09-18T01:47:07.212095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"33'5","reported_seq":238,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:33.930151+0000","last_change":"2024-09-18T01:48:33.930178+0000","last_active":"2024-09-18T01:48:33.930151+0000","last_peered":"2024-09-18T01:48:33.930151+0000","last_clean":"2024-09-18T01:48:33.930151+0000","last_became_active":"2024-09-18T01:45:08.294338+0000","last_became_peered":"2024-09-18T01:45:08.294338+0000","last_unstale":"2024-09-18T01:48:33.930151+0000","last_undegraded":"2024-09-18T01:48:33.930151+0000","last_fullsized":"2024-09-18T01:48:33.930151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-18T01:48:33.930067+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-18T01:48:33.930067+0000","last_clean_scrub_stamp":"2024-09-18T01:48:33.930067+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:04:18.998443+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'36","reported_seq":87,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.557264+0000","last_change":"2024-09-18T01:45:10.308965+0000","last_active":"2024-09-18T01:48:19.557264+0000","last_peered":"2024-09-18T01:48:19.557264+0000","last_clean":"2024-09-18T01:48:19.557264+0000","last_became_active":"2024-09-18T01:45:10.308336+0000","last_became_peered":"2024-09-18T01:45:10.308336+0000","last_unstale":"2024-09-18T01:48:19.557264+0000","last_undegraded":"2024-09-18T01:48:19.557264+0000","last_fullsized":"2024-09-18T01:48:19.557264+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:42.219880+0000","last_change":"2024-09-18T01:45:12.313122+0000","last_active":"2024-09-18T01:47:42.219880+0000","last_peered":"2024-09-18T01:47:42.219880+0000","last_clean":"2024-09-18T01:47:42.219880+0000","last_became_active":"2024-09-18T01:45:12.312794+0000","last_became_peered":"2024-09-18T01:45:12.312794+0000","last_unstale":"2024-09-18T01:47:42.219880+0000","last_undegraded":"2024-09-18T01:47:42.219880+0000","last_fullsized":"2024-09-18T01:47:42.219880+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:11.287699+0000","last_clean_scrub_stamp":"2024-09-18T01:45:11.287699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"33'10","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.564345+0000","last_change":"2024-09-18T01:45:14.325782+0000","last_active":"2024-09-18T01:48:12.564345+0000","last_peered":"2024-09-18T01:48:12.564345+0000","last_clean":"2024-09-18T01:48:12.564345+0000","last_became_active":"2024-09-18T01:45:14.325464+0000","last_became_peered":"2024-09-18T01:45:14.325464+0000","last_unstale":"2024-09-18T01:48:12.564345+0000","last_undegraded":"2024-09-18T01:48:12.564345+0000","last_fullsized":"2024-09-18T01:48:12.564345+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'8","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.880197+0000","last_change":"2024-09-18T01:45:06.283599+0000","last_active":"2024-09-18T01:48:12.880197+0000","last_peered":"2024-09-18T01:48:12.880197+0000","last_clean":"2024-09-18T01:48:12.880197+0000","last_became_active":"2024-09-18T01:45:06.283071+0000","last_became_peered":"2024-09-18T01:45:06.283071+0000","last_unstale":"2024-09-18T01:48:12.880197+0000","last_undegraded":"2024-09-18T01:48:12.880197+0000","last_fullsized":"2024-09-18T01:48:12.880197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.784196+0000","last_change":"2024-09-18T01:45:04.298035+0000","last_active":"2024-09-18T01:48:12.784196+0000","last_peered":"2024-09-18T01:48:12.784196+0000","last_clean":"2024-09-18T01:48:12.784196+0000","last_became_active":"2024-09-18T01:45:04.297716+0000","last_became_peered":"2024-09-18T01:45:04.297716+0000","last_unstale":"2024-09-18T01:48:12.784196+0000","last_undegraded":"2024-09-18T01:48:12.784196+0000","last_fullsized":"2024-09-18T01:48:12.784196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'3","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:36.961597+0000","last_change":"2024-09-18T01:48:36.961625+0000","last_active":"2024-09-18T01:48:36.961597+0000","last_peered":"2024-09-18T01:48:36.961597+0000","last_clean":"2024-09-18T01:48:36.961597+0000","last_became_active":"2024-09-18T01:45:08.294160+0000","last_became_peered":"2024-09-18T01:45:08.294160+0000","last_unstale":"2024-09-18T01:48:36.961597+0000","last_undegraded":"2024-09-18T01:48:36.961597+0000","last_fullsized":"2024-09-18T01:48:36.961597+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-18T01:48:36.961514+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-18T01:48:36.961514+0000","last_clean_scrub_stamp":"2024-09-18T01:48:36.961514+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:20:37.663549+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'47","reported_seq":108,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.566365+0000","last_change":"2024-09-18T01:45:10.308624+0000","last_active":"2024-09-18T01:48:19.566365+0000","last_peered":"2024-09-18T01:48:19.566365+0000","last_clean":"2024-09-18T01:48:19.566365+0000","last_became_active":"2024-09-18T01:45:10.308302+0000","last_became_peered":"2024-09-18T01:45:10.308302+0000","last_unstale":"2024-09-18T01:48:19.566365+0000","last_undegraded":"2024-09-18T01:48:19.566365+0000","last_fullsized":"2024-09-18T01:48:19.566365+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:09.276176+0000","last_clean_scrub_stamp":"2024-09-18T01:45:09.276176+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:28.229701+0000","last_change":"2024-09-18T01:48:28.229726+0000","last_active":"2024-09-18T01:48:28.229701+0000","last_peered":"2024-09-18T01:48:28.229701+0000","last_clean":"2024-09-18T01:48:28.229701+0000","last_became_active":"2024-09-18T01:45:12.305742+0000","last_became_peered":"2024-09-18T01:45:12.305742+0000","last_unstale":"2024-09-18T01:48:28.229701+0000","last_undegraded":"2024-09-18T01:48:28.229701+0000","last_fullsized":"2024-09-18T01:48:28.229701+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:28.229607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:28.229607+0000","last_clean_scrub_stamp":"2024-09-18T01:48:28.229607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:03:10.477001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"33'2","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:37.219124+0000","last_change":"2024-09-18T01:45:14.325723+0000","last_active":"2024-09-18T01:47:37.219124+0000","last_peered":"2024-09-18T01:47:37.219124+0000","last_clean":"2024-09-18T01:47:37.219124+0000","last_became_active":"2024-09-18T01:45:14.325368+0000","last_became_peered":"2024-09-18T01:45:14.325368+0000","last_unstale":"2024-09-18T01:47:37.219124+0000","last_undegraded":"2024-09-18T01:47:37.219124+0000","last_fullsized":"2024-09-18T01:47:37.219124+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"33'8","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.932175+0000","last_change":"2024-09-18T01:45:41.342690+0000","last_active":"2024-09-18T01:48:12.932175+0000","last_peered":"2024-09-18T01:48:12.932175+0000","last_clean":"2024-09-18T01:48:12.932175+0000","last_became_active":"2024-09-18T01:45:41.342336+0000","last_became_peered":"2024-09-18T01:45:41.342336+0000","last_unstale":"2024-09-18T01:48:12.932175+0000","last_undegraded":"2024-09-18T01:48:12.932175+0000","last_fullsized":"2024-09-18T01:48:12.932175+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.214133+0000","last_change":"2024-09-18T01:45:04.285604+0000","last_active":"2024-09-18T01:47:12.214133+0000","last_peered":"2024-09-18T01:47:12.214133+0000","last_clean":"2024-09-18T01:47:12.214133+0000","last_became_active":"2024-09-18T01:45:04.284969+0000","last_became_peered":"2024-09-18T01:45:04.284969+0000","last_unstale":"2024-09-18T01:47:12.214133+0000","last_undegraded":"2024-09-18T01:47:12.214133+0000","last_fullsized":"2024-09-18T01:47:12.214133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'11","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.929547+0000","last_change":"2024-09-18T01:45:06.285979+0000","last_active":"2024-09-18T01:48:12.929547+0000","last_peered":"2024-09-18T01:48:12.929547+0000","last_clean":"2024-09-18T01:48:12.929547+0000","last_became_active":"2024-09-18T01:45:06.285500+0000","last_became_peered":"2024-09-18T01:45:06.285500+0000","last_unstale":"2024-09-18T01:48:12.929547+0000","last_undegraded":"2024-09-18T01:48:12.929547+0000","last_fullsized":"2024-09-18T01:48:12.929547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.212635+0000","last_change":"2024-09-18T01:45:04.280448+0000","last_active":"2024-09-18T01:47:12.212635+0000","last_peered":"2024-09-18T01:47:12.212635+0000","last_clean":"2024-09-18T01:47:12.212635+0000","last_became_active":"2024-09-18T01:45:04.280147+0000","last_became_peered":"2024-09-18T01:45:04.280147+0000","last_unstale":"2024-09-18T01:47:12.212635+0000","last_undegraded":"2024-09-18T01:47:12.212635+0000","last_fullsized":"2024-09-18T01:47:12.212635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.846101+0000","last_change":"2024-09-18T01:45:06.278954+0000","last_active":"2024-09-18T01:48:12.846101+0000","last_peered":"2024-09-18T01:48:12.846101+0000","last_clean":"2024-09-18T01:48:12.846101+0000","last_became_active":"2024-09-18T01:45:06.278684+0000","last_became_peered":"2024-09-18T01:45:06.278684+0000","last_unstale":"2024-09-18T01:48:12.846101+0000","last_undegraded":"2024-09-18T01:48:12.846101+0000","last_fullsized":"2024-09-18T01:48:12.846101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.214385+0000","last_change":"2024-09-18T01:45:04.283274+0000","last_active":"2024-09-18T01:47:12.214385+0000","last_peered":"2024-09-18T01:47:12.214385+0000","last_clean":"2024-09-18T01:47:12.214385+0000","last_became_active":"2024-09-18T01:45:04.281920+0000","last_became_peered":"2024-09-18T01:45:04.281920+0000","last_unstale":"2024-09-18T01:47:12.214385+0000","last_undegraded":"2024-09-18T01:47:12.214385+0000","last_fullsized":"2024-09-18T01:47:12.214385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"33'6","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:17.213452+0000","last_change":"2024-09-18T01:45:06.282298+0000","last_active":"2024-09-18T01:47:17.213452+0000","last_peered":"2024-09-18T01:47:17.213452+0000","last_clean":"2024-09-18T01:47:17.213452+0000","last_became_active":"2024-09-18T01:45:06.281998+0000","last_became_peered":"2024-09-18T01:45:06.281998+0000","last_unstale":"2024-09-18T01:47:17.213452+0000","last_undegraded":"2024-09-18T01:47:17.213452+0000","last_fullsized":"2024-09-18T01:47:17.213452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.212692+0000","last_change":"2024-09-18T01:45:04.280466+0000","last_active":"2024-09-18T01:47:12.212692+0000","last_peered":"2024-09-18T01:47:12.212692+0000","last_clean":"2024-09-18T01:47:12.212692+0000","last_became_active":"2024-09-18T01:45:04.280066+0000","last_became_peered":"2024-09-18T01:45:04.280066+0000","last_unstale":"2024-09-18T01:47:12.212692+0000","last_undegraded":"2024-09-18T01:47:12.212692+0000","last_fullsized":"2024-09-18T01:47:12.212692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.212683+0000","last_change":"2024-09-18T01:45:06.285899+0000","last_active":"2024-09-18T01:47:12.212683+0000","last_peered":"2024-09-18T01:47:12.212683+0000","last_clean":"2024-09-18T01:47:12.212683+0000","last_became_active":"2024-09-18T01:45:06.285054+0000","last_became_peered":"2024-09-18T01:45:06.285054+0000","last_unstale":"2024-09-18T01:47:12.212683+0000","last_undegraded":"2024-09-18T01:47:12.212683+0000","last_fullsized":"2024-09-18T01:47:12.212683+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"31'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:17.213465+0000","last_change":"2024-09-18T01:45:04.281591+0000","last_active":"2024-09-18T01:47:17.213465+0000","last_peered":"2024-09-18T01:47:17.213465+0000","last_clean":"2024-09-18T01:47:17.213465+0000","last_became_active":"2024-09-18T01:45:04.281146+0000","last_became_peered":"2024-09-18T01:45:04.281146+0000","last_unstale":"2024-09-18T01:47:17.213465+0000","last_undegraded":"2024-09-18T01:47:17.213465+0000","last_fullsized":"2024-09-18T01:47:17.213465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.214246+0000","last_change":"2024-09-18T01:45:06.292733+0000","last_active":"2024-09-18T01:47:12.214246+0000","last_peered":"2024-09-18T01:47:12.214246+0000","last_clean":"2024-09-18T01:47:12.214246+0000","last_became_active":"2024-09-18T01:45:06.292490+0000","last_became_peered":"2024-09-18T01:45:06.292490+0000","last_unstale":"2024-09-18T01:47:12.214246+0000","last_undegraded":"2024-09-18T01:47:12.214246+0000","last_fullsized":"2024-09-18T01:47:12.214246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:17.215148+0000","last_change":"2024-09-18T01:45:04.294522+0000","last_active":"2024-09-18T01:47:17.215148+0000","last_peered":"2024-09-18T01:47:17.215148+0000","last_clean":"2024-09-18T01:47:17.215148+0000","last_became_active":"2024-09-18T01:45:04.293767+0000","last_became_peered":"2024-09-18T01:45:04.293767+0000","last_unstale":"2024-09-18T01:47:17.215148+0000","last_undegraded":"2024-09-18T01:47:17.215148+0000","last_fullsized":"2024-09-18T01:47:17.215148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"33'10","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.212661+0000","last_change":"2024-09-18T01:45:06.293722+0000","last_active":"2024-09-18T01:47:12.212661+0000","last_peered":"2024-09-18T01:47:12.212661+0000","last_clean":"2024-09-18T01:47:12.212661+0000","last_became_active":"2024-09-18T01:45:06.293369+0000","last_became_peered":"2024-09-18T01:45:06.293369+0000","last_unstale":"2024-09-18T01:47:12.212661+0000","last_undegraded":"2024-09-18T01:47:12.212661+0000","last_fullsized":"2024-09-18T01:47:12.212661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.489315+0000","last_change":"2024-09-18T01:45:04.292372+0000","last_active":"2024-09-18T01:48:19.489315+0000","last_peered":"2024-09-18T01:48:19.489315+0000","last_clean":"2024-09-18T01:48:19.489315+0000","last_became_active":"2024-09-18T01:45:04.292056+0000","last_became_peered":"2024-09-18T01:45:04.292056+0000","last_unstale":"2024-09-18T01:48:19.489315+0000","last_undegraded":"2024-09-18T01:48:19.489315+0000","last_fullsized":"2024-09-18T01:48:19.489315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'8","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.566993+0000","last_change":"2024-09-18T01:45:06.296391+0000","last_active":"2024-09-18T01:48:12.566993+0000","last_peered":"2024-09-18T01:48:12.566993+0000","last_clean":"2024-09-18T01:48:12.566993+0000","last_became_active":"2024-09-18T01:45:06.295055+0000","last_became_peered":"2024-09-18T01:45:06.295055+0000","last_unstale":"2024-09-18T01:48:12.566993+0000","last_undegraded":"2024-09-18T01:48:12.566993+0000","last_fullsized":"2024-09-18T01:48:12.566993+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:17.213560+0000","last_change":"2024-09-18T01:45:04.284398+0000","last_active":"2024-09-18T01:47:17.213560+0000","last_peered":"2024-09-18T01:47:17.213560+0000","last_clean":"2024-09-18T01:47:17.213560+0000","last_became_active":"2024-09-18T01:45:04.283959+0000","last_became_peered":"2024-09-18T01:45:04.283959+0000","last_unstale":"2024-09-18T01:47:17.213560+0000","last_undegraded":"2024-09-18T01:47:17.213560+0000","last_fullsized":"2024-09-18T01:47:17.213560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"33'4","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.848853+0000","last_change":"2024-09-18T01:45:06.295541+0000","last_active":"2024-09-18T01:48:12.848853+0000","last_peered":"2024-09-18T01:48:12.848853+0000","last_clean":"2024-09-18T01:48:12.848853+0000","last_became_active":"2024-09-18T01:45:06.295270+0000","last_became_peered":"2024-09-18T01:45:06.295270+0000","last_unstale":"2024-09-18T01:48:12.848853+0000","last_undegraded":"2024-09-18T01:48:12.848853+0000","last_fullsized":"2024-09-18T01:48:12.848853+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:17.215081+0000","last_change":"2024-09-18T01:45:04.280658+0000","last_active":"2024-09-18T01:47:17.215081+0000","last_peered":"2024-09-18T01:47:17.215081+0000","last_clean":"2024-09-18T01:47:17.215081+0000","last_became_active":"2024-09-18T01:45:04.278951+0000","last_became_peered":"2024-09-18T01:45:04.278951+0000","last_unstale":"2024-09-18T01:47:17.215081+0000","last_undegraded":"2024-09-18T01:47:17.215081+0000","last_fullsized":"2024-09-18T01:47:17.215081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'4","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.800385+0000","last_change":"2024-09-18T01:45:06.285555+0000","last_active":"2024-09-18T01:48:12.800385+0000","last_peered":"2024-09-18T01:48:12.800385+0000","last_clean":"2024-09-18T01:48:12.800385+0000","last_became_active":"2024-09-18T01:45:06.285272+0000","last_became_peered":"2024-09-18T01:45:06.285272+0000","last_unstale":"2024-09-18T01:48:12.800385+0000","last_undegraded":"2024-09-18T01:48:12.800385+0000","last_fullsized":"2024-09-18T01:48:12.800385+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:22.214190+0000","last_change":"2024-09-18T01:45:04.281621+0000","last_active":"2024-09-18T01:47:22.214190+0000","last_peered":"2024-09-18T01:47:22.214190+0000","last_clean":"2024-09-18T01:47:22.214190+0000","last_became_active":"2024-09-18T01:45:04.281197+0000","last_became_peered":"2024-09-18T01:45:04.281197+0000","last_unstale":"2024-09-18T01:47:22.214190+0000","last_undegraded":"2024-09-18T01:47:22.214190+0000","last_fullsized":"2024-09-18T01:47:22.214190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"33'4","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:22.214291+0000","last_change":"2024-09-18T01:45:06.285297+0000","last_active":"2024-09-18T01:47:22.214291+0000","last_peered":"2024-09-18T01:47:22.214291+0000","last_clean":"2024-09-18T01:47:22.214291+0000","last_became_active":"2024-09-18T01:45:06.284989+0000","last_became_peered":"2024-09-18T01:45:06.284989+0000","last_unstale":"2024-09-18T01:47:22.214291+0000","last_undegraded":"2024-09-18T01:47:22.214291+0000","last_fullsized":"2024-09-18T01:47:22.214291+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:22.215920+0000","last_change":"2024-09-18T01:45:04.295486+0000","last_active":"2024-09-18T01:47:22.215920+0000","last_peered":"2024-09-18T01:47:22.215920+0000","last_clean":"2024-09-18T01:47:22.215920+0000","last_became_active":"2024-09-18T01:45:04.294125+0000","last_became_peered":"2024-09-18T01:45:04.294125+0000","last_unstale":"2024-09-18T01:47:22.215920+0000","last_undegraded":"2024-09-18T01:47:22.215920+0000","last_fullsized":"2024-09-18T01:47:22.215920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"33'10","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.848635+0000","last_change":"2024-09-18T01:45:06.279731+0000","last_active":"2024-09-18T01:48:12.848635+0000","last_peered":"2024-09-18T01:48:12.848635+0000","last_clean":"2024-09-18T01:48:12.848635+0000","last_became_active":"2024-09-18T01:45:06.279373+0000","last_became_peered":"2024-09-18T01:45:06.279373+0000","last_unstale":"2024-09-18T01:48:12.848635+0000","last_undegraded":"2024-09-18T01:48:12.848635+0000","last_fullsized":"2024-09-18T01:48:12.848635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.522581+0000","last_change":"2024-09-18T01:45:04.291798+0000","last_active":"2024-09-18T01:48:12.522581+0000","last_peered":"2024-09-18T01:48:12.522581+0000","last_clean":"2024-09-18T01:48:12.522581+0000","last_became_active":"2024-09-18T01:45:04.291442+0000","last_became_peered":"2024-09-18T01:45:04.291442+0000","last_unstale":"2024-09-18T01:48:12.522581+0000","last_undegraded":"2024-09-18T01:48:12.522581+0000","last_fullsized":"2024-09-18T01:48:12.522581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'6","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:22.216015+0000","last_change":"2024-09-18T01:45:06.292853+0000","last_active":"2024-09-18T01:47:22.216015+0000","last_peered":"2024-09-18T01:47:22.216015+0000","last_clean":"2024-09-18T01:47:22.216015+0000","last_became_active":"2024-09-18T01:45:06.292425+0000","last_became_peered":"2024-09-18T01:45:06.292425+0000","last_unstale":"2024-09-18T01:47:22.216015+0000","last_undegraded":"2024-09-18T01:47:22.216015+0000","last_fullsized":"2024-09-18T01:47:22.216015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:22.216129+0000","last_change":"2024-09-18T01:45:04.289922+0000","last_active":"2024-09-18T01:47:22.216129+0000","last_peered":"2024-09-18T01:47:22.216129+0000","last_clean":"2024-09-18T01:47:22.216129+0000","last_became_active":"2024-09-18T01:45:04.289365+0000","last_became_peered":"2024-09-18T01:45:04.289365+0000","last_unstale":"2024-09-18T01:47:22.216129+0000","last_undegraded":"2024-09-18T01:47:22.216129+0000","last_fullsized":"2024-09-18T01:47:22.216129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:22.215958+0000","last_change":"2024-09-18T01:45:06.293694+0000","last_active":"2024-09-18T01:47:22.215958+0000","last_peered":"2024-09-18T01:47:22.215958+0000","last_clean":"2024-09-18T01:47:22.215958+0000","last_became_active":"2024-09-18T01:45:06.293403+0000","last_became_peered":"2024-09-18T01:45:06.293403+0000","last_unstale":"2024-09-18T01:47:22.215958+0000","last_undegraded":"2024-09-18T01:47:22.215958+0000","last_fullsized":"2024-09-18T01:47:22.215958+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:22.216164+0000","last_change":"2024-09-18T01:45:04.278234+0000","last_active":"2024-09-18T01:47:22.216164+0000","last_peered":"2024-09-18T01:47:22.216164+0000","last_clean":"2024-09-18T01:47:22.216164+0000","last_became_active":"2024-09-18T01:45:04.277907+0000","last_became_peered":"2024-09-18T01:45:04.277907+0000","last_unstale":"2024-09-18T01:47:22.216164+0000","last_undegraded":"2024-09-18T01:47:22.216164+0000","last_fullsized":"2024-09-18T01:47:22.216164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'3","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:41.057651+0000","last_change":"2024-09-18T01:48:41.057681+0000","last_active":"2024-09-18T01:48:41.057651+0000","last_peered":"2024-09-18T01:48:41.057651+0000","last_clean":"2024-09-18T01:48:41.057651+0000","last_became_active":"2024-09-18T01:45:06.293036+0000","last_became_peered":"2024-09-18T01:45:06.293036+0000","last_unstale":"2024-09-18T01:48:41.057651+0000","last_undegraded":"2024-09-18T01:48:41.057651+0000","last_fullsized":"2024-09-18T01:48:41.057651+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-18T01:48:41.057559+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-18T01:48:41.057559+0000","last_clean_scrub_stamp":"2024-09-18T01:48:41.057559+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:16:03.544999+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:27.217142+0000","last_change":"2024-09-18T01:45:04.287307+0000","last_active":"2024-09-18T01:47:27.217142+0000","last_peered":"2024-09-18T01:47:27.217142+0000","last_clean":"2024-09-18T01:47:27.217142+0000","last_became_active":"2024-09-18T01:45:04.286591+0000","last_became_peered":"2024-09-18T01:45:04.286591+0000","last_unstale":"2024-09-18T01:47:27.217142+0000","last_undegraded":"2024-09-18T01:47:27.217142+0000","last_fullsized":"2024-09-18T01:47:27.217142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"33'4","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.878782+0000","last_change":"2024-09-18T01:45:06.295984+0000","last_active":"2024-09-18T01:48:12.878782+0000","last_peered":"2024-09-18T01:48:12.878782+0000","last_clean":"2024-09-18T01:48:12.878782+0000","last_became_active":"2024-09-18T01:45:06.294911+0000","last_became_peered":"2024-09-18T01:45:06.294911+0000","last_unstale":"2024-09-18T01:48:12.878782+0000","last_undegraded":"2024-09-18T01:48:12.878782+0000","last_fullsized":"2024-09-18T01:48:12.878782+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.868650+0000","last_change":"2024-09-18T01:45:04.287888+0000","last_active":"2024-09-18T01:48:12.868650+0000","last_peered":"2024-09-18T01:48:12.868650+0000","last_clean":"2024-09-18T01:48:12.868650+0000","last_became_active":"2024-09-18T01:45:04.285719+0000","last_became_peered":"2024-09-18T01:45:04.285719+0000","last_unstale":"2024-09-18T01:48:12.868650+0000","last_undegraded":"2024-09-18T01:48:12.868650+0000","last_fullsized":"2024-09-18T01:48:12.868650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.491079+0000","last_change":"2024-09-18T01:45:04.280417+0000","last_active":"2024-09-18T01:48:19.491079+0000","last_peered":"2024-09-18T01:48:19.491079+0000","last_clean":"2024-09-18T01:48:19.491079+0000","last_became_active":"2024-09-18T01:45:04.278266+0000","last_became_peered":"2024-09-18T01:45:04.278266+0000","last_unstale":"2024-09-18T01:48:19.491079+0000","last_undegraded":"2024-09-18T01:48:19.491079+0000","last_fullsized":"2024-09-18T01:48:19.491079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"33'10","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:32.215711+0000","last_change":"2024-09-18T01:45:06.292390+0000","last_active":"2024-09-18T01:47:32.215711+0000","last_peered":"2024-09-18T01:47:32.215711+0000","last_clean":"2024-09-18T01:47:32.215711+0000","last_became_active":"2024-09-18T01:45:06.292127+0000","last_became_peered":"2024-09-18T01:45:06.292127+0000","last_unstale":"2024-09-18T01:47:32.215711+0000","last_undegraded":"2024-09-18T01:47:32.215711+0000","last_fullsized":"2024-09-18T01:47:32.215711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:27.214892+0000","last_change":"2024-09-18T01:45:04.273996+0000","last_active":"2024-09-18T01:47:27.214892+0000","last_peered":"2024-09-18T01:47:27.214892+0000","last_clean":"2024-09-18T01:47:27.214892+0000","last_became_active":"2024-09-18T01:45:04.273575+0000","last_became_peered":"2024-09-18T01:45:04.273575+0000","last_unstale":"2024-09-18T01:47:27.214892+0000","last_undegraded":"2024-09-18T01:47:27.214892+0000","last_fullsized":"2024-09-18T01:47:27.214892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'6","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.880126+0000","last_change":"2024-09-18T01:45:06.292393+0000","last_active":"2024-09-18T01:48:12.880126+0000","last_peered":"2024-09-18T01:48:12.880126+0000","last_clean":"2024-09-18T01:48:12.880126+0000","last_became_active":"2024-09-18T01:45:06.292037+0000","last_became_peered":"2024-09-18T01:45:06.292037+0000","last_unstale":"2024-09-18T01:48:12.880126+0000","last_undegraded":"2024-09-18T01:48:12.880126+0000","last_fullsized":"2024-09-18T01:48:12.880126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":9385,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1888,"num_read_kb":1653,"num_write":789,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1554,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1713,"ondisk_log_size":1713,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1590,"num_read_kb":1480,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705714,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39972,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331868,"statfs":{"total":96636764160,"available":96595832832,"internally_reserved":0,"allocated":479232,"data_stored":150270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705714,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40480,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331360,"statfs":{"total":96636764160,"available":96595312640,"internally_reserved":0,"allocated":999424,"data_stored":737378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705714,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36348,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335492,"statfs":{"total":96636764160,"available":96599543808,"internally_reserved":0,"allocated":1028096,"data_stored":738692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705714,"num_pgs":150,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39936,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331904,"statfs":{"total":96636764160,"available":96595869696,"internally_reserved":0,"allocated":442368,"data_stored":148296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T01:48:44.338 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.338 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.339 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.339 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.339 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.339 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.339 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.339 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.339 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.339 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.339 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.340 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.340 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.340 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.340 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.340 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.340 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.340 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.340 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.341 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.341 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.341 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.341 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.341 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.341 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.341 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.341 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.341 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.341 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.342 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.342 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.342 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.342 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.342 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-18T01:45:07.267106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.342 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.342 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.342 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.343 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-18T01:45:07.267106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.343 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-18T01:45:11.287699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.343 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.343 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.343 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.343 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.343 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-18T01:45:11.287699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.343 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.344 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.344 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.344 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-18T01:45:09.276176+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.344 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.344 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.344 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.344 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-18T01:45:07.267106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.344 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.345 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.345 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.345 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-18T01:45:07.267106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.345 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-18T01:45:09.276176+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.345 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.345 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.345 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.345 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-18T01:45:11.287699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.345 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.346 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.346 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.346 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-18T01:45:07.267106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.346 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.346 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.346 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.346 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.346 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.347 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.347 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-18T01:44:48.210722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=44, tm_sec=48, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.347 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-18T01:44:52.219730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=44, tm_sec=52, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.347 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.347 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.347 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.347 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-18T01:44:52.219730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=44, tm_sec=52, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.347 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.348 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-18T01:45:11.287699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.348 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.348 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.348 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-18T01:44:52.219730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=44, tm_sec=52, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.348 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.348 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-18T01:45:07.267106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.348 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.348 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.348 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-18T01:44:52.219730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=44, tm_sec=52, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.349 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.349 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-18T01:45:11.287699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.349 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.349 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.349 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.349 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-18T01:44:52.219730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=44, tm_sec=52, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.349 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-18T01:45:07.267106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.349 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.350 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.350 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.350 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-18T01:44:52.219730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=44, tm_sec=52, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.350 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.350 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.350 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-18T01:44:52.219730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=44, tm_sec=52, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.350 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-18T01:45:09.276176+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.350 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-18T01:45:11.287699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.350 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.351 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.351 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.351 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-18T01:44:52.219730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=44, tm_sec=52, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.351 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.351 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.351 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.351 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.351 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-18T01:45:07.267106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.351 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-18T01:45:11.287699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.352 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.352 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.352 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.352 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-18T01:45:07.267106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.352 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.352 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.352 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.352 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.353 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.353 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.353 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.353 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.353 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.353 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.353 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-18T01:45:09.276176+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.353 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.354 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.354 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.354 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.354 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.354 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.354 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-18T01:45:07.267106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.354 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-18T01:45:09.276176+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.354 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.355 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.355 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.355 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.355 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.355 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.355 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-18T01:45:11.287699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.355 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.355 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.356 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.356 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-18T01:45:09.276176+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.356 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-18T01:45:11.287699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.356 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.356 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.356 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.356 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-18T01:45:09.276176+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=9, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.356 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.356 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.357 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.357 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.357 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.357 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.357 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.357 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.357 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.357 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.358 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.358 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.358 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.358 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.358 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.358 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.358 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.358 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.358 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.359 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.359 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.359 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.359 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.359 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.359 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.359 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.359 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.359 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.360 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.360 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.360 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.360 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.360 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.360 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.360 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.360 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:48:44.361 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-18T01:49:04.362 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T01:49:04.471 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:04.469+0000 7fe4b6a23640 1 Processor -- start 2024-09-18T01:49:04.472 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:04.470+0000 7fe4b6a23640 1 -- start start 2024-09-18T01:49:04.472 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:04.470+0000 7fe4b6a23640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fe4b009bd50 0x7fe4b009c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:49:04.472 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:04.470+0000 7fe4b6a23640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4b009d3b0 con 0x7fe4b009c670 2024-09-18T01:49:04.472 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:04.470+0000 7fe4b6a23640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x7fe4b0098230 con 0x7fe4b009bd50 2024-09-18T01:49:04.472 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:04.470+0000 7fe4affff640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fe4b009bd50 0x7fe4b009c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:49:04.472 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:04.470+0000 7fe4a7fff640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fe4b009c670 0x7fe4b00990f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:46180/0 (socket says 172.21.15.129:46180) 2024-09-18T01:49:04.472 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:04.470+0000 7fe4a7fff640 1 -- 172.21.15.129:0/3782068563 learned_addr learned my addr 172.21.15.129:0/3782068563 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-09-18T01:49:04.472 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:04.470+0000 7fe4affff640 1 -- 172.21.15.129:0/3782068563 >> v1:172.21.15.129:6789/0 conn(0x7fe4b009c670 legacy=0x7fe4b00990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:49:04.472 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:04.470+0000 7fe4affff640 1 -- 172.21.15.129:0/3782068563 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4b00983e0 con 0x7fe4b009bd50 2024-09-18T01:49:04.472 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:04.470+0000 7fe4af7fe640 1 -- 172.21.15.129:0/3782068563 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3648199516 0 0) 0x7fe498001110 con 0x7fe4b009c670 2024-09-18T01:49:04.474 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:04.471+0000 7fe4affff640 1 --2- 172.21.15.129:0/3782068563 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe4b009bd50 0x7fe4b009c130 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0009720 tx=0x7fe4a002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42b13e0c79fda01f server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:49:04.474 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:04.471+0000 7fe4af7fe640 1 -- 172.21.15.129:0/3782068563 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4a0037070 con 0x7fe4b009bd50 2024-09-18T01:49:04.474 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:04.471+0000 7fe4af7fe640 1 -- 172.21.15.129:0/3782068563 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4a002ad90 con 0x7fe4b009bd50 2024-09-18T01:49:04.474 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:04.471+0000 7fe4af7fe640 1 -- 172.21.15.129:0/3782068563 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4a0032590 con 0x7fe4b009bd50 2024-09-18T01:49:04.474 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:04.472+0000 7fe4b6a23640 1 -- 172.21.15.129:0/3782068563 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe4b009bd50 msgr2=0x7fe4b009c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:49:04.474 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:04.472+0000 7fe4b6a23640 1 --2- 172.21.15.129:0/3782068563 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe4b009bd50 0x7fe4b009c130 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0009720 tx=0x7fe4a002a110 comp rx=0 tx=0).stop 2024-09-18T01:49:04.474 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:04.472+0000 7fe4b6a23640 1 -- 172.21.15.129:0/3782068563 shutdown_connections 2024-09-18T01:49:04.474 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:04.472+0000 7fe4b6a23640 1 --2- 172.21.15.129:0/3782068563 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe4b009bd50 0x7fe4b009c130 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:49:04.474 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:04.472+0000 7fe4b6a23640 1 -- 172.21.15.129:0/3782068563 >> 172.21.15.129:0/3782068563 conn(0x7fe4b006d4a0 msgr2=0x7fe4b006d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:49:04.474 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:04.472+0000 7fe4b6a23640 1 -- 172.21.15.129:0/3782068563 shutdown_connections 2024-09-18T01:49:04.474 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:04.472+0000 7fe4b6a23640 1 -- 172.21.15.129:0/3782068563 wait complete. 2024-09-18T01:49:04.475 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:04.473+0000 7fe4b6a23640 1 Processor -- start 2024-09-18T01:49:04.475 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:04.473+0000 7fe4b6a23640 1 -- start start 2024-09-18T01:49:04.476 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:04.473+0000 7fe4b6a23640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe4b009bd50 0x7fe4b01b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:49:04.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:04.473+0000 7fe4b6a23640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b0099b90 con 0x7fe4b009bd50 2024-09-18T01:49:04.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:04.473+0000 7fe4affff640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe4b009bd50 0x7fe4b01b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:49:04.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:04.473+0000 7fe4affff640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe4b009bd50 0x7fe4b01b38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:54870/0 (socket says 172.21.15.129:54870) 2024-09-18T01:49:04.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:04.473+0000 7fe4affff640 1 -- 172.21.15.129:0/1893766481 learned_addr learned my addr 172.21.15.129:0/1893766481 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-18T01:49:04.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:04.474+0000 7fe4affff640 1 -- 172.21.15.129:0/1893766481 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4b01b3020 con 0x7fe4b009bd50 2024-09-18T01:49:04.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:04.474+0000 7fe4affff640 1 --2- 172.21.15.129:0/1893766481 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe4b009bd50 0x7fe4b01b38b0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0009720 tx=0x7fe4a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:49:04.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:04.474+0000 7fe4ad7fa640 1 -- 172.21.15.129:0/1893766481 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4a0041070 con 0x7fe4b009bd50 2024-09-18T01:49:04.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:04.474+0000 7fe4ad7fa640 1 -- 172.21.15.129:0/1893766481 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4a003c460 con 0x7fe4b009bd50 2024-09-18T01:49:04.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:04.474+0000 7fe4ad7fa640 1 -- 172.21.15.129:0/1893766481 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4a0037040 con 0x7fe4b009bd50 2024-09-18T01:49:04.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:04.474+0000 7fe4b6a23640 1 -- 172.21.15.129:0/1893766481 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4b009a760 con 0x7fe4b009bd50 2024-09-18T01:49:04.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:04.474+0000 7fe4b6a23640 1 -- 172.21.15.129:0/1893766481 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4b01b28f0 con 0x7fe4b009bd50 2024-09-18T01:49:04.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:04.475+0000 7fe4ad7fa640 1 -- 172.21.15.129:0/1893766481 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe4a0044070 con 0x7fe4b009bd50 2024-09-18T01:49:04.477 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:04.475+0000 7fe4b6a23640 1 -- 172.21.15.129:0/1893766481 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4b01b2670 con 0x7fe4b009bd50 2024-09-18T01:49:04.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:04.475+0000 7fe4ad7fa640 1 --2- 172.21.15.129:0/1893766481 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fe4900382d0 0x7fe49003a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:49:04.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:04.475+0000 7fe4ad7fa640 1 -- 172.21.15.129:0/1893766481 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7fe4a006c7c0 con 0x7fe4b009bd50 2024-09-18T01:49:04.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:04.475+0000 7fe4a7fff640 1 --2- 172.21.15.129:0/1893766481 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fe4900382d0 0x7fe49003a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:49:04.478 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:04.476+0000 7fe4a7fff640 1 --2- 172.21.15.129:0/1893766481 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fe4900382d0 0x7fe49003a790 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe498000c00 tx=0x7fe498001250 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:49:04.481 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:04.480+0000 7fe4ad7fa640 1 -- 172.21.15.129:0/1893766481 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe4b01b3020 con 0x7fe4b009bd50 2024-09-18T01:49:04.645 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:04.643+0000 7fe4b6a23640 1 -- 172.21.15.129:0/1893766481 --> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe4b009a130 con 0x7fe4900382d0 2024-09-18T01:49:04.659 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:04.659+0000 7fe4ad7fa640 1 -- 172.21.15.129:0/1893766481 <== mgr.4099 v2:172.21.15.146:6824/168968651 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+662063 (secure 0 0 0) 0x7fe4b009a130 con 0x7fe4900382d0 2024-09-18T01:49:04.668 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:49:04.673 INFO:teuthology.orchestra.run.smithi129.stderr:dumped all 2024-09-18T01:49:04.675 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:04.663+0000 7fe4b6a23640 1 -- 172.21.15.129:0/1893766481 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fe4900382d0 msgr2=0x7fe49003a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:49:04.676 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:04.663+0000 7fe4b6a23640 1 --2- 172.21.15.129:0/1893766481 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fe4900382d0 0x7fe49003a790 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe498000c00 tx=0x7fe498001250 comp rx=0 tx=0).stop 2024-09-18T01:49:04.676 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:04.663+0000 7fe4b6a23640 1 -- 172.21.15.129:0/1893766481 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe4b009bd50 msgr2=0x7fe4b01b38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:49:04.676 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:04.663+0000 7fe4b6a23640 1 --2- 172.21.15.129:0/1893766481 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe4b009bd50 0x7fe4b01b38b0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0009720 tx=0x7fe4a00046c0 comp rx=0 tx=0).stop 2024-09-18T01:49:04.676 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:04.663+0000 7fe4b6a23640 1 -- 172.21.15.129:0/1893766481 shutdown_connections 2024-09-18T01:49:04.676 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:04.663+0000 7fe4b6a23640 1 --2- 172.21.15.129:0/1893766481 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fe4900382d0 0x7fe49003a790 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:49:04.676 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:04.663+0000 7fe4b6a23640 1 --2- 172.21.15.129:0/1893766481 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe4b009bd50 0x7fe4b01b38b0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:49:04.676 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:04.663+0000 7fe4b6a23640 1 -- 172.21.15.129:0/1893766481 >> 172.21.15.129:0/1893766481 conn(0x7fe4b006d4a0 msgr2=0x7fe4b009eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:49:04.676 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:04.664+0000 7fe4b6a23640 1 -- 172.21.15.129:0/1893766481 shutdown_connections 2024-09-18T01:49:04.676 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:04.664+0000 7fe4b6a23640 1 -- 172.21.15.129:0/1893766481 wait complete. 2024-09-18T01:49:04.677 INFO:teuthology.orchestra.run.smithi129.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2024-09-18T01:49:04.255870+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":603113,"num_objects":254,"num_object_clones":0,"num_object_copies":508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":254,"num_whiteouts":0,"num_read":5366,"num_read_kb":4915,"num_write":2371,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2861,"num_omap_keys":15,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4999,"ondisk_log_size":4999,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":160896,"kb_used_data":2880,"kb_used_omap":6,"kb_used_meta":157945,"kb_avail":377326464,"statfs":{"total":386547056640,"available":386382299136,"internally_reserved":0,"allocated":2949120,"data_stored":1774636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":161736471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003937"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.214344+0000","last_change":"2024-09-18T01:45:04.287665+0000","last_active":"2024-09-18T01:47:12.214344+0000","last_peered":"2024-09-18T01:47:12.214344+0000","last_clean":"2024-09-18T01:47:12.214344+0000","last_became_active":"2024-09-18T01:45:04.287322+0000","last_became_peered":"2024-09-18T01:45:04.287322+0000","last_unstale":"2024-09-18T01:47:12.214344+0000","last_undegraded":"2024-09-18T01:47:12.214344+0000","last_fullsized":"2024-09-18T01:47:12.214344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"33'8","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:43.875122+0000","last_change":"2024-09-18T01:48:43.875148+0000","last_active":"2024-09-18T01:48:43.875122+0000","last_peered":"2024-09-18T01:48:43.875122+0000","last_clean":"2024-09-18T01:48:43.875122+0000","last_became_active":"2024-09-18T01:45:06.295819+0000","last_became_peered":"2024-09-18T01:45:06.295819+0000","last_unstale":"2024-09-18T01:48:43.875122+0000","last_undegraded":"2024-09-18T01:48:43.875122+0000","last_fullsized":"2024-09-18T01:48:43.875122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-18T01:48:43.875034+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-18T01:48:43.875034+0000","last_clean_scrub_stamp":"2024-09-18T01:48:43.875034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:39:10.860642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.212756+0000","last_change":"2024-09-18T01:45:04.280965+0000","last_active":"2024-09-18T01:47:12.212756+0000","last_peered":"2024-09-18T01:47:12.212756+0000","last_clean":"2024-09-18T01:47:12.212756+0000","last_became_active":"2024-09-18T01:45:04.280591+0000","last_became_peered":"2024-09-18T01:45:04.280591+0000","last_unstale":"2024-09-18T01:47:12.212756+0000","last_undegraded":"2024-09-18T01:47:12.212756+0000","last_fullsized":"2024-09-18T01:47:12.212756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"33'12","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.880422+0000","last_change":"2024-09-18T01:45:06.282040+0000","last_active":"2024-09-18T01:48:12.880422+0000","last_peered":"2024-09-18T01:48:12.880422+0000","last_clean":"2024-09-18T01:48:12.880422+0000","last_became_active":"2024-09-18T01:45:06.281659+0000","last_became_peered":"2024-09-18T01:45:06.281659+0000","last_unstale":"2024-09-18T01:48:12.880422+0000","last_undegraded":"2024-09-18T01:48:12.880422+0000","last_fullsized":"2024-09-18T01:48:12.880422+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"33'5","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.214522+0000","last_change":"2024-09-18T01:45:04.287682+0000","last_active":"2024-09-18T01:47:12.214522+0000","last_peered":"2024-09-18T01:47:12.214522+0000","last_clean":"2024-09-18T01:47:12.214522+0000","last_became_active":"2024-09-18T01:45:04.286007+0000","last_became_peered":"2024-09-18T01:45:04.286007+0000","last_unstale":"2024-09-18T01:47:12.214522+0000","last_undegraded":"2024-09-18T01:47:12.214522+0000","last_fullsized":"2024-09-18T01:47:12.214522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"33'18","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:00.934191+0000","last_change":"2024-09-18T01:49:00.934242+0000","last_active":"2024-09-18T01:49:00.934191+0000","last_peered":"2024-09-18T01:49:00.934191+0000","last_clean":"2024-09-18T01:49:00.934191+0000","last_became_active":"2024-09-18T01:45:06.285378+0000","last_became_peered":"2024-09-18T01:45:06.285378+0000","last_unstale":"2024-09-18T01:49:00.934191+0000","last_undegraded":"2024-09-18T01:49:00.934191+0000","last_fullsized":"2024-09-18T01:49:00.934191+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'18","last_scrub_stamp":"2024-09-18T01:49:00.934082+0000","last_deep_scrub":"33'18","last_deep_scrub_stamp":"2024-09-18T01:49:00.934082+0000","last_clean_scrub_stamp":"2024-09-18T01:49:00.934082+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:48:56.120020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":40,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:49.054772+0000","last_change":"2024-09-18T01:48:49.054796+0000","last_active":"2024-09-18T01:48:49.054772+0000","last_peered":"2024-09-18T01:48:49.054772+0000","last_clean":"2024-09-18T01:48:49.054772+0000","last_became_active":"2024-09-18T01:45:04.297791+0000","last_became_peered":"2024-09-18T01:45:04.297791+0000","last_unstale":"2024-09-18T01:48:49.054772+0000","last_undegraded":"2024-09-18T01:48:49.054772+0000","last_fullsized":"2024-09-18T01:48:49.054772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:49.054679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:49.054679+0000","last_clean_scrub_stamp":"2024-09-18T01:48:49.054679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:23:20.643124+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"33'6","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.931986+0000","last_change":"2024-09-18T01:45:06.281604+0000","last_active":"2024-09-18T01:48:12.931986+0000","last_peered":"2024-09-18T01:48:12.931986+0000","last_clean":"2024-09-18T01:48:12.931986+0000","last_became_active":"2024-09-18T01:45:06.280779+0000","last_became_peered":"2024-09-18T01:45:06.280779+0000","last_unstale":"2024-09-18T01:48:12.931986+0000","last_undegraded":"2024-09-18T01:48:12.931986+0000","last_fullsized":"2024-09-18T01:48:12.931986+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:37.219085+0000","last_change":"2024-09-18T01:45:04.280905+0000","last_active":"2024-09-18T01:47:37.219085+0000","last_peered":"2024-09-18T01:47:37.219085+0000","last_clean":"2024-09-18T01:47:37.219085+0000","last_became_active":"2024-09-18T01:45:04.280582+0000","last_became_peered":"2024-09-18T01:45:04.280582+0000","last_unstale":"2024-09-18T01:47:37.219085+0000","last_undegraded":"2024-09-18T01:47:37.219085+0000","last_fullsized":"2024-09-18T01:47:37.219085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'12","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:53.032085+0000","last_change":"2024-09-18T01:48:53.032110+0000","last_active":"2024-09-18T01:48:53.032085+0000","last_peered":"2024-09-18T01:48:53.032085+0000","last_clean":"2024-09-18T01:48:53.032085+0000","last_became_active":"2024-09-18T01:45:06.289036+0000","last_became_peered":"2024-09-18T01:45:06.289036+0000","last_unstale":"2024-09-18T01:48:53.032085+0000","last_undegraded":"2024-09-18T01:48:53.032085+0000","last_fullsized":"2024-09-18T01:48:53.032085+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-18T01:48:53.031994+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-18T01:48:53.031994+0000","last_clean_scrub_stamp":"2024-09-18T01:48:53.031994+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:49:17.553448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:37.219091+0000","last_change":"2024-09-18T01:45:04.286820+0000","last_active":"2024-09-18T01:47:37.219091+0000","last_peered":"2024-09-18T01:47:37.219091+0000","last_clean":"2024-09-18T01:47:37.219091+0000","last_became_active":"2024-09-18T01:45:04.286509+0000","last_became_peered":"2024-09-18T01:45:04.286509+0000","last_unstale":"2024-09-18T01:47:37.219091+0000","last_undegraded":"2024-09-18T01:47:37.219091+0000","last_fullsized":"2024-09-18T01:47:37.219091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:42.024892+0000","last_change":"2024-09-18T01:48:42.024918+0000","last_active":"2024-09-18T01:48:42.024892+0000","last_peered":"2024-09-18T01:48:42.024892+0000","last_clean":"2024-09-18T01:48:42.024892+0000","last_became_active":"2024-09-18T01:45:06.287110+0000","last_became_peered":"2024-09-18T01:45:06.287110+0000","last_unstale":"2024-09-18T01:48:42.024892+0000","last_undegraded":"2024-09-18T01:48:42.024892+0000","last_fullsized":"2024-09-18T01:48:42.024892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:48:42.024803+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:48:42.024803+0000","last_clean_scrub_stamp":"2024-09-18T01:48:42.024803+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:37:11.999864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.777098+0000","last_change":"2024-09-18T01:45:04.293823+0000","last_active":"2024-09-18T01:48:12.777098+0000","last_peered":"2024-09-18T01:48:12.777098+0000","last_clean":"2024-09-18T01:48:12.777098+0000","last_became_active":"2024-09-18T01:45:04.289290+0000","last_became_peered":"2024-09-18T01:45:04.289290+0000","last_unstale":"2024-09-18T01:48:12.777098+0000","last_undegraded":"2024-09-18T01:48:12.777098+0000","last_fullsized":"2024-09-18T01:48:12.777098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'14","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:45.086471+0000","last_change":"2024-09-18T01:48:45.086505+0000","last_active":"2024-09-18T01:48:45.086471+0000","last_peered":"2024-09-18T01:48:45.086471+0000","last_clean":"2024-09-18T01:48:45.086471+0000","last_became_active":"2024-09-18T01:45:06.295429+0000","last_became_peered":"2024-09-18T01:45:06.295429+0000","last_unstale":"2024-09-18T01:48:45.086471+0000","last_undegraded":"2024-09-18T01:48:45.086471+0000","last_fullsized":"2024-09-18T01:48:45.086471+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-09-18T01:48:45.086369+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-09-18T01:48:45.086369+0000","last_clean_scrub_stamp":"2024-09-18T01:48:45.086369+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:14:18.256239+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:37.216316+0000","last_change":"2024-09-18T01:45:04.273877+0000","last_active":"2024-09-18T01:47:37.216316+0000","last_peered":"2024-09-18T01:47:37.216316+0000","last_clean":"2024-09-18T01:47:37.216316+0000","last_became_active":"2024-09-18T01:45:04.273328+0000","last_became_peered":"2024-09-18T01:45:04.273328+0000","last_unstale":"2024-09-18T01:47:37.216316+0000","last_undegraded":"2024-09-18T01:47:37.216316+0000","last_fullsized":"2024-09-18T01:47:37.216316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'10","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:56.083927+0000","last_change":"2024-09-18T01:48:56.083996+0000","last_active":"2024-09-18T01:48:56.083927+0000","last_peered":"2024-09-18T01:48:56.083927+0000","last_clean":"2024-09-18T01:48:56.083927+0000","last_became_active":"2024-09-18T01:45:06.284994+0000","last_became_peered":"2024-09-18T01:45:06.284994+0000","last_unstale":"2024-09-18T01:48:56.083927+0000","last_undegraded":"2024-09-18T01:48:56.083927+0000","last_fullsized":"2024-09-18T01:48:56.083927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-18T01:48:56.083802+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-18T01:48:56.083802+0000","last_clean_scrub_stamp":"2024-09-18T01:48:56.083802+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:24:40.822016+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"33'4","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:59.956051+0000","last_change":"2024-09-18T01:48:59.956077+0000","last_active":"2024-09-18T01:48:59.956051+0000","last_peered":"2024-09-18T01:48:59.956051+0000","last_clean":"2024-09-18T01:48:59.956051+0000","last_became_active":"2024-09-18T01:45:06.286524+0000","last_became_peered":"2024-09-18T01:45:06.286524+0000","last_unstale":"2024-09-18T01:48:59.956051+0000","last_undegraded":"2024-09-18T01:48:59.956051+0000","last_fullsized":"2024-09-18T01:48:59.956051+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:48:59.955964+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:48:59.955964+0000","last_clean_scrub_stamp":"2024-09-18T01:48:59.955964+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:47:30.798351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:00.111939+0000","last_change":"2024-09-18T01:49:00.111985+0000","last_active":"2024-09-18T01:49:00.111939+0000","last_peered":"2024-09-18T01:49:00.111939+0000","last_clean":"2024-09-18T01:49:00.111939+0000","last_became_active":"2024-09-18T01:45:04.298399+0000","last_became_peered":"2024-09-18T01:45:04.298399+0000","last_unstale":"2024-09-18T01:49:00.111939+0000","last_undegraded":"2024-09-18T01:49:00.111939+0000","last_fullsized":"2024-09-18T01:49:00.111939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:00.111843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:00.111843+0000","last_clean_scrub_stamp":"2024-09-18T01:49:00.111843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:39:05.538284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"33'10","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:48.963664+0000","last_change":"2024-09-18T01:48:48.963691+0000","last_active":"2024-09-18T01:48:48.963664+0000","last_peered":"2024-09-18T01:48:48.963664+0000","last_clean":"2024-09-18T01:48:48.963664+0000","last_became_active":"2024-09-18T01:45:06.294670+0000","last_became_peered":"2024-09-18T01:45:06.294670+0000","last_unstale":"2024-09-18T01:48:48.963664+0000","last_undegraded":"2024-09-18T01:48:48.963664+0000","last_fullsized":"2024-09-18T01:48:48.963664+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-18T01:48:48.963573+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-18T01:48:48.963573+0000","last_clean_scrub_stamp":"2024-09-18T01:48:48.963573+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:47:46.867517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:32.218167+0000","last_change":"2024-09-18T01:45:04.286914+0000","last_active":"2024-09-18T01:47:32.218167+0000","last_peered":"2024-09-18T01:47:32.218167+0000","last_clean":"2024-09-18T01:47:32.218167+0000","last_became_active":"2024-09-18T01:45:04.286465+0000","last_became_peered":"2024-09-18T01:45:04.286465+0000","last_unstale":"2024-09-18T01:47:32.218167+0000","last_undegraded":"2024-09-18T01:47:32.218167+0000","last_fullsized":"2024-09-18T01:47:32.218167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:49.977271+0000","last_change":"2024-09-18T01:48:49.977300+0000","last_active":"2024-09-18T01:48:49.977271+0000","last_peered":"2024-09-18T01:48:49.977271+0000","last_clean":"2024-09-18T01:48:49.977271+0000","last_became_active":"2024-09-18T01:45:06.294118+0000","last_became_peered":"2024-09-18T01:45:06.294118+0000","last_unstale":"2024-09-18T01:48:49.977271+0000","last_undegraded":"2024-09-18T01:48:49.977271+0000","last_fullsized":"2024-09-18T01:48:49.977271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:48:49.977187+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:48:49.977187+0000","last_clean_scrub_stamp":"2024-09-18T01:48:49.977187+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:09:54.691187+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:32.218073+0000","last_change":"2024-09-18T01:45:04.294733+0000","last_active":"2024-09-18T01:47:32.218073+0000","last_peered":"2024-09-18T01:47:32.218073+0000","last_clean":"2024-09-18T01:47:32.218073+0000","last_became_active":"2024-09-18T01:45:04.294327+0000","last_became_peered":"2024-09-18T01:45:04.294327+0000","last_unstale":"2024-09-18T01:47:32.218073+0000","last_undegraded":"2024-09-18T01:47:32.218073+0000","last_fullsized":"2024-09-18T01:47:32.218073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'4","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:32.215625+0000","last_change":"2024-09-18T01:45:06.285844+0000","last_active":"2024-09-18T01:47:32.215625+0000","last_peered":"2024-09-18T01:47:32.215625+0000","last_clean":"2024-09-18T01:47:32.215625+0000","last_became_active":"2024-09-18T01:45:06.285429+0000","last_became_peered":"2024-09-18T01:45:06.285429+0000","last_unstale":"2024-09-18T01:47:32.215625+0000","last_undegraded":"2024-09-18T01:47:32.215625+0000","last_fullsized":"2024-09-18T01:47:32.215625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:58.089164+0000","last_change":"2024-09-18T01:48:58.089192+0000","last_active":"2024-09-18T01:48:58.089164+0000","last_peered":"2024-09-18T01:48:58.089164+0000","last_clean":"2024-09-18T01:48:58.089164+0000","last_became_active":"2024-09-18T01:45:04.298601+0000","last_became_peered":"2024-09-18T01:45:04.298601+0000","last_unstale":"2024-09-18T01:48:58.089164+0000","last_undegraded":"2024-09-18T01:48:58.089164+0000","last_fullsized":"2024-09-18T01:48:58.089164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:58.089075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:58.089075+0000","last_clean_scrub_stamp":"2024-09-18T01:48:58.089075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:14:10.025695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'10","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:00.074915+0000","last_change":"2024-09-18T01:49:00.074940+0000","last_active":"2024-09-18T01:49:00.074915+0000","last_peered":"2024-09-18T01:49:00.074915+0000","last_clean":"2024-09-18T01:49:00.074915+0000","last_became_active":"2024-09-18T01:45:06.285228+0000","last_became_peered":"2024-09-18T01:45:06.285228+0000","last_unstale":"2024-09-18T01:49:00.074915+0000","last_undegraded":"2024-09-18T01:49:00.074915+0000","last_fullsized":"2024-09-18T01:49:00.074915+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-18T01:49:00.074829+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-18T01:49:00.074829+0000","last_clean_scrub_stamp":"2024-09-18T01:49:00.074829+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:14:47.671460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:32.215612+0000","last_change":"2024-09-18T01:45:04.281502+0000","last_active":"2024-09-18T01:47:32.215612+0000","last_peered":"2024-09-18T01:47:32.215612+0000","last_clean":"2024-09-18T01:47:32.215612+0000","last_became_active":"2024-09-18T01:45:04.281118+0000","last_became_peered":"2024-09-18T01:45:04.281118+0000","last_unstale":"2024-09-18T01:47:32.215612+0000","last_undegraded":"2024-09-18T01:47:32.215612+0000","last_fullsized":"2024-09-18T01:47:32.215612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"33'16","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:54.067694+0000","last_change":"2024-09-18T01:48:54.067746+0000","last_active":"2024-09-18T01:48:54.067694+0000","last_peered":"2024-09-18T01:48:54.067694+0000","last_clean":"2024-09-18T01:48:54.067694+0000","last_became_active":"2024-09-18T01:45:06.284237+0000","last_became_peered":"2024-09-18T01:45:06.284237+0000","last_unstale":"2024-09-18T01:48:54.067694+0000","last_undegraded":"2024-09-18T01:48:54.067694+0000","last_fullsized":"2024-09-18T01:48:54.067694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2024-09-18T01:48:54.067597+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2024-09-18T01:48:54.067597+0000","last_clean_scrub_stamp":"2024-09-18T01:48:54.067597+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:44:52.155664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":48,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:27.217055+0000","last_change":"2024-09-18T01:45:04.285185+0000","last_active":"2024-09-18T01:47:27.217055+0000","last_peered":"2024-09-18T01:47:27.217055+0000","last_clean":"2024-09-18T01:47:27.217055+0000","last_became_active":"2024-09-18T01:45:04.284148+0000","last_became_peered":"2024-09-18T01:45:04.284148+0000","last_unstale":"2024-09-18T01:47:27.217055+0000","last_undegraded":"2024-09-18T01:47:27.217055+0000","last_fullsized":"2024-09-18T01:47:27.217055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'35","reported_seq":100,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.889492+0000","last_change":"2024-09-18T01:45:14.323024+0000","last_active":"2024-09-18T01:48:12.889492+0000","last_peered":"2024-09-18T01:48:12.889492+0000","last_clean":"2024-09-18T01:48:12.889492+0000","last_became_active":"2024-09-18T01:45:14.322729+0000","last_became_peered":"2024-09-18T01:45:14.322729+0000","last_unstale":"2024-09-18T01:48:12.889492+0000","last_undegraded":"2024-09-18T01:48:12.889492+0000","last_fullsized":"2024-09-18T01:48:12.889492+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'10","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.567043+0000","last_change":"2024-09-18T01:45:06.281639+0000","last_active":"2024-09-18T01:48:12.567043+0000","last_peered":"2024-09-18T01:48:12.567043+0000","last_clean":"2024-09-18T01:48:12.567043+0000","last_became_active":"2024-09-18T01:45:06.281361+0000","last_became_peered":"2024-09-18T01:45:06.281361+0000","last_unstale":"2024-09-18T01:48:12.567043+0000","last_undegraded":"2024-09-18T01:48:12.567043+0000","last_fullsized":"2024-09-18T01:48:12.567043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.488665+0000","last_change":"2024-09-18T01:45:04.285350+0000","last_active":"2024-09-18T01:48:19.488665+0000","last_peered":"2024-09-18T01:48:19.488665+0000","last_clean":"2024-09-18T01:48:19.488665+0000","last_became_active":"2024-09-18T01:45:04.285008+0000","last_became_peered":"2024-09-18T01:45:04.285008+0000","last_unstale":"2024-09-18T01:48:19.488665+0000","last_undegraded":"2024-09-18T01:48:19.488665+0000","last_fullsized":"2024-09-18T01:48:19.488665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:25.014640+0000","last_change":"2024-09-18T01:48:25.014675+0000","last_active":"2024-09-18T01:48:25.014640+0000","last_peered":"2024-09-18T01:48:25.014640+0000","last_clean":"2024-09-18T01:48:25.014640+0000","last_became_active":"2024-09-18T01:45:08.296241+0000","last_became_peered":"2024-09-18T01:45:08.296241+0000","last_unstale":"2024-09-18T01:48:25.014640+0000","last_undegraded":"2024-09-18T01:48:25.014640+0000","last_fullsized":"2024-09-18T01:48:25.014640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:25.014547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:25.014547+0000","last_clean_scrub_stamp":"2024-09-18T01:48:25.014547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:06:32.938495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'51","reported_seq":118,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:29.025471+0000","last_change":"2024-09-18T01:48:29.025537+0000","last_active":"2024-09-18T01:48:29.025471+0000","last_peered":"2024-09-18T01:48:29.025471+0000","last_clean":"2024-09-18T01:48:29.025471+0000","last_became_active":"2024-09-18T01:45:10.305713+0000","last_became_peered":"2024-09-18T01:45:10.305713+0000","last_unstale":"2024-09-18T01:48:29.025471+0000","last_undegraded":"2024-09-18T01:48:29.025471+0000","last_fullsized":"2024-09-18T01:48:29.025471+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'51","last_scrub_stamp":"2024-09-18T01:48:29.025349+0000","last_deep_scrub":"33'51","last_deep_scrub_stamp":"2024-09-18T01:48:29.025349+0000","last_clean_scrub_stamp":"2024-09-18T01:48:29.025349+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:55:10.299048+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:26.973099+0000","last_change":"2024-09-18T01:48:26.973124+0000","last_active":"2024-09-18T01:48:26.973099+0000","last_peered":"2024-09-18T01:48:26.973099+0000","last_clean":"2024-09-18T01:48:26.973099+0000","last_became_active":"2024-09-18T01:45:12.313276+0000","last_became_peered":"2024-09-18T01:45:12.313276+0000","last_unstale":"2024-09-18T01:48:26.973099+0000","last_undegraded":"2024-09-18T01:48:26.973099+0000","last_fullsized":"2024-09-18T01:48:26.973099+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:26.973012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:26.973012+0000","last_clean_scrub_stamp":"2024-09-18T01:48:26.973012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:54:46.334494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'7","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:46.918917+0000","last_change":"2024-09-18T01:48:46.918960+0000","last_active":"2024-09-18T01:48:46.918917+0000","last_peered":"2024-09-18T01:48:46.918917+0000","last_clean":"2024-09-18T01:48:46.918917+0000","last_became_active":"2024-09-18T01:45:14.318093+0000","last_became_peered":"2024-09-18T01:45:14.318093+0000","last_unstale":"2024-09-18T01:48:46.918917+0000","last_undegraded":"2024-09-18T01:48:46.918917+0000","last_fullsized":"2024-09-18T01:48:46.918917+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-09-18T01:48:46.918798+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-09-18T01:48:46.918798+0000","last_clean_scrub_stamp":"2024-09-18T01:48:46.918798+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:14:34.515429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"33'13","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.929325+0000","last_change":"2024-09-18T01:45:41.348633+0000","last_active":"2024-09-18T01:48:12.929325+0000","last_peered":"2024-09-18T01:48:12.929325+0000","last_clean":"2024-09-18T01:48:12.929325+0000","last_became_active":"2024-09-18T01:45:41.338243+0000","last_became_peered":"2024-09-18T01:45:41.338243+0000","last_unstale":"2024-09-18T01:48:12.929325+0000","last_undegraded":"2024-09-18T01:48:12.929325+0000","last_fullsized":"2024-09-18T01:48:12.929325+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":13,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:53.039033+0000","last_change":"2024-09-18T01:48:53.039071+0000","last_active":"2024-09-18T01:48:53.039033+0000","last_peered":"2024-09-18T01:48:53.039033+0000","last_clean":"2024-09-18T01:48:53.039033+0000","last_became_active":"2024-09-18T01:45:04.292853+0000","last_became_peered":"2024-09-18T01:45:04.292853+0000","last_unstale":"2024-09-18T01:48:53.039033+0000","last_undegraded":"2024-09-18T01:48:53.039033+0000","last_fullsized":"2024-09-18T01:48:53.039033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:48:53.038933+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:48:53.038933+0000","last_clean_scrub_stamp":"2024-09-18T01:48:53.038933+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:24:38.409165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:47.382739+0000","last_change":"2024-09-18T01:48:47.382764+0000","last_active":"2024-09-18T01:48:47.382739+0000","last_peered":"2024-09-18T01:48:47.382739+0000","last_clean":"2024-09-18T01:48:47.382739+0000","last_became_active":"2024-09-18T01:45:08.288390+0000","last_became_peered":"2024-09-18T01:45:08.288390+0000","last_unstale":"2024-09-18T01:48:47.382739+0000","last_undegraded":"2024-09-18T01:48:47.382739+0000","last_fullsized":"2024-09-18T01:48:47.382739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:47.382647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:47.382647+0000","last_clean_scrub_stamp":"2024-09-18T01:48:47.382647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:54:16.834483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"33'16","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:28.924284+0000","last_change":"2024-09-18T01:48:28.924317+0000","last_active":"2024-09-18T01:48:28.924284+0000","last_peered":"2024-09-18T01:48:28.924284+0000","last_clean":"2024-09-18T01:48:28.924284+0000","last_became_active":"2024-09-18T01:45:10.302957+0000","last_became_peered":"2024-09-18T01:45:10.302957+0000","last_unstale":"2024-09-18T01:48:28.924284+0000","last_undegraded":"2024-09-18T01:48:28.924284+0000","last_fullsized":"2024-09-18T01:48:28.924284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2024-09-18T01:48:28.924202+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2024-09-18T01:48:28.924202+0000","last_clean_scrub_stamp":"2024-09-18T01:48:28.924202+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:40:38.196180+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:34.948777+0000","last_change":"2024-09-18T01:48:34.948803+0000","last_active":"2024-09-18T01:48:34.948777+0000","last_peered":"2024-09-18T01:48:34.948777+0000","last_clean":"2024-09-18T01:48:34.948777+0000","last_became_active":"2024-09-18T01:45:12.317471+0000","last_became_peered":"2024-09-18T01:45:12.317471+0000","last_unstale":"2024-09-18T01:48:34.948777+0000","last_undegraded":"2024-09-18T01:48:34.948777+0000","last_fullsized":"2024-09-18T01:48:34.948777+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:34.948683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:34.948683+0000","last_clean_scrub_stamp":"2024-09-18T01:48:34.948683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:47:33.161713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:47.217975+0000","last_change":"2024-09-18T01:45:14.319762+0000","last_active":"2024-09-18T01:47:47.217975+0000","last_peered":"2024-09-18T01:47:47.217975+0000","last_clean":"2024-09-18T01:47:47.217975+0000","last_became_active":"2024-09-18T01:45:14.319387+0000","last_became_peered":"2024-09-18T01:45:14.319387+0000","last_unstale":"2024-09-18T01:47:47.217975+0000","last_undegraded":"2024-09-18T01:47:47.217975+0000","last_fullsized":"2024-09-18T01:47:47.217975+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'10","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:32.218154+0000","last_change":"2024-09-18T01:45:06.284632+0000","last_active":"2024-09-18T01:47:32.218154+0000","last_peered":"2024-09-18T01:47:32.218154+0000","last_clean":"2024-09-18T01:47:32.218154+0000","last_became_active":"2024-09-18T01:45:06.283815+0000","last_became_peered":"2024-09-18T01:45:06.283815+0000","last_unstale":"2024-09-18T01:47:32.218154+0000","last_undegraded":"2024-09-18T01:47:32.218154+0000","last_fullsized":"2024-09-18T01:47:32.218154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:27.216997+0000","last_change":"2024-09-18T01:45:04.293546+0000","last_active":"2024-09-18T01:47:27.216997+0000","last_peered":"2024-09-18T01:47:27.216997+0000","last_clean":"2024-09-18T01:47:27.216997+0000","last_became_active":"2024-09-18T01:45:04.288040+0000","last_became_peered":"2024-09-18T01:45:04.288040+0000","last_unstale":"2024-09-18T01:47:27.216997+0000","last_undegraded":"2024-09-18T01:47:27.216997+0000","last_fullsized":"2024-09-18T01:47:27.216997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:46.362514+0000","last_change":"2024-09-18T01:48:46.362538+0000","last_active":"2024-09-18T01:48:46.362514+0000","last_peered":"2024-09-18T01:48:46.362514+0000","last_clean":"2024-09-18T01:48:46.362514+0000","last_became_active":"2024-09-18T01:45:08.288667+0000","last_became_peered":"2024-09-18T01:45:08.288667+0000","last_unstale":"2024-09-18T01:48:46.362514+0000","last_undegraded":"2024-09-18T01:48:46.362514+0000","last_fullsized":"2024-09-18T01:48:46.362514+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:46.362403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:46.362403+0000","last_clean_scrub_stamp":"2024-09-18T01:48:46.362403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:47:44.266347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'30","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:29.796863+0000","last_change":"2024-09-18T01:48:29.796918+0000","last_active":"2024-09-18T01:48:29.796863+0000","last_peered":"2024-09-18T01:48:29.796863+0000","last_clean":"2024-09-18T01:48:29.796863+0000","last_became_active":"2024-09-18T01:45:10.304004+0000","last_became_peered":"2024-09-18T01:45:10.304004+0000","last_unstale":"2024-09-18T01:48:29.796863+0000","last_undegraded":"2024-09-18T01:48:29.796863+0000","last_fullsized":"2024-09-18T01:48:29.796863+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'30","last_scrub_stamp":"2024-09-18T01:48:29.796760+0000","last_deep_scrub":"33'30","last_deep_scrub_stamp":"2024-09-18T01:48:29.796760+0000","last_clean_scrub_stamp":"2024-09-18T01:48:29.796760+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:49:27.020491+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'286","reported_seq":397,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:58.927095+0000","last_change":"2024-09-18T01:48:58.927175+0000","last_active":"2024-09-18T01:48:58.927095+0000","last_peered":"2024-09-18T01:48:58.927095+0000","last_clean":"2024-09-18T01:48:58.927095+0000","last_became_active":"2024-09-18T01:45:12.317288+0000","last_became_peered":"2024-09-18T01:45:12.317288+0000","last_unstale":"2024-09-18T01:48:58.927095+0000","last_undegraded":"2024-09-18T01:48:58.927095+0000","last_fullsized":"2024-09-18T01:48:58.927095+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'286","last_scrub_stamp":"2024-09-18T01:48:58.926983+0000","last_deep_scrub":"33'286","last_deep_scrub_stamp":"2024-09-18T01:48:58.926983+0000","last_clean_scrub_stamp":"2024-09-18T01:48:58.926983+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:03:15.512790+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:47.220838+0000","last_change":"2024-09-18T01:45:14.326621+0000","last_active":"2024-09-18T01:47:47.220838+0000","last_peered":"2024-09-18T01:47:47.220838+0000","last_clean":"2024-09-18T01:47:47.220838+0000","last_became_active":"2024-09-18T01:45:14.325843+0000","last_became_peered":"2024-09-18T01:45:14.325843+0000","last_unstale":"2024-09-18T01:47:47.220838+0000","last_undegraded":"2024-09-18T01:47:47.220838+0000","last_fullsized":"2024-09-18T01:47:47.220838+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:50.402715+0000","last_change":"2024-09-18T01:48:50.402744+0000","last_active":"2024-09-18T01:48:50.402715+0000","last_peered":"2024-09-18T01:48:50.402715+0000","last_clean":"2024-09-18T01:48:50.402715+0000","last_became_active":"2024-09-18T01:45:06.295417+0000","last_became_peered":"2024-09-18T01:45:06.295417+0000","last_unstale":"2024-09-18T01:48:50.402715+0000","last_undegraded":"2024-09-18T01:48:50.402715+0000","last_fullsized":"2024-09-18T01:48:50.402715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:50.402623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:50.402623+0000","last_clean_scrub_stamp":"2024-09-18T01:48:50.402623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:19:27.434267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:27.216922+0000","last_change":"2024-09-18T01:45:04.282935+0000","last_active":"2024-09-18T01:47:27.216922+0000","last_peered":"2024-09-18T01:47:27.216922+0000","last_clean":"2024-09-18T01:47:27.216922+0000","last_became_active":"2024-09-18T01:45:04.282500+0000","last_became_peered":"2024-09-18T01:45:04.282500+0000","last_unstale":"2024-09-18T01:47:27.216922+0000","last_undegraded":"2024-09-18T01:47:27.216922+0000","last_fullsized":"2024-09-18T01:47:27.216922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:27.978926+0000","last_change":"2024-09-18T01:48:27.978949+0000","last_active":"2024-09-18T01:48:27.978926+0000","last_peered":"2024-09-18T01:48:27.978926+0000","last_clean":"2024-09-18T01:48:27.978926+0000","last_became_active":"2024-09-18T01:45:08.296192+0000","last_became_peered":"2024-09-18T01:45:08.296192+0000","last_unstale":"2024-09-18T01:48:27.978926+0000","last_undegraded":"2024-09-18T01:48:27.978926+0000","last_fullsized":"2024-09-18T01:48:27.978926+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:27.978844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:27.978844+0000","last_clean_scrub_stamp":"2024-09-18T01:48:27.978844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:53:57.430680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'43","reported_seq":104,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:26.798254+0000","last_change":"2024-09-18T01:48:26.798290+0000","last_active":"2024-09-18T01:48:26.798254+0000","last_peered":"2024-09-18T01:48:26.798254+0000","last_clean":"2024-09-18T01:48:26.798254+0000","last_became_active":"2024-09-18T01:45:10.305515+0000","last_became_peered":"2024-09-18T01:45:10.305515+0000","last_unstale":"2024-09-18T01:48:26.798254+0000","last_undegraded":"2024-09-18T01:48:26.798254+0000","last_fullsized":"2024-09-18T01:48:26.798254+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-09-18T01:48:26.798150+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-09-18T01:48:26.798150+0000","last_clean_scrub_stamp":"2024-09-18T01:48:26.798150+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:49:57.532711+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'285","reported_seq":412,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:41.311359+0000","last_change":"2024-09-18T01:48:41.311390+0000","last_active":"2024-09-18T01:48:41.311359+0000","last_peered":"2024-09-18T01:48:41.311359+0000","last_clean":"2024-09-18T01:48:41.311359+0000","last_became_active":"2024-09-18T01:45:12.313219+0000","last_became_peered":"2024-09-18T01:45:12.313219+0000","last_unstale":"2024-09-18T01:48:41.311359+0000","last_undegraded":"2024-09-18T01:48:41.311359+0000","last_fullsized":"2024-09-18T01:48:41.311359+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-18T01:48:41.311241+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-18T01:48:41.311241+0000","last_clean_scrub_stamp":"2024-09-18T01:48:41.311241+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:53:48.228429+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:38.059825+0000","last_change":"2024-09-18T01:48:38.059865+0000","last_active":"2024-09-18T01:48:38.059825+0000","last_peered":"2024-09-18T01:48:38.059825+0000","last_clean":"2024-09-18T01:48:38.059825+0000","last_became_active":"2024-09-18T01:45:06.297283+0000","last_became_peered":"2024-09-18T01:45:06.297283+0000","last_unstale":"2024-09-18T01:48:38.059825+0000","last_undegraded":"2024-09-18T01:48:38.059825+0000","last_fullsized":"2024-09-18T01:48:38.059825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-18T01:48:38.059683+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-18T01:48:38.059683+0000","last_clean_scrub_stamp":"2024-09-18T01:48:38.059683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:38:43.486124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:01.044750+0000","last_change":"2024-09-18T01:49:01.044789+0000","last_active":"2024-09-18T01:49:01.044750+0000","last_peered":"2024-09-18T01:49:01.044750+0000","last_clean":"2024-09-18T01:49:01.044750+0000","last_became_active":"2024-09-18T01:45:04.289629+0000","last_became_peered":"2024-09-18T01:45:04.289629+0000","last_unstale":"2024-09-18T01:49:01.044750+0000","last_undegraded":"2024-09-18T01:49:01.044750+0000","last_fullsized":"2024-09-18T01:49:01.044750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:01.044645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:01.044645+0000","last_clean_scrub_stamp":"2024-09-18T01:49:01.044645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:49:00.735559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:35.930454+0000","last_change":"2024-09-18T01:48:35.930488+0000","last_active":"2024-09-18T01:48:35.930454+0000","last_peered":"2024-09-18T01:48:35.930454+0000","last_clean":"2024-09-18T01:48:35.930454+0000","last_became_active":"2024-09-18T01:45:08.294273+0000","last_became_peered":"2024-09-18T01:45:08.294273+0000","last_unstale":"2024-09-18T01:48:35.930454+0000","last_undegraded":"2024-09-18T01:48:35.930454+0000","last_fullsized":"2024-09-18T01:48:35.930454+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:35.930363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:35.930363+0000","last_clean_scrub_stamp":"2024-09-18T01:48:35.930363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:23:07.518807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'58","reported_seq":124,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:33.850412+0000","last_change":"2024-09-18T01:48:33.850466+0000","last_active":"2024-09-18T01:48:33.850412+0000","last_peered":"2024-09-18T01:48:33.850412+0000","last_clean":"2024-09-18T01:48:33.850412+0000","last_became_active":"2024-09-18T01:45:10.298021+0000","last_became_peered":"2024-09-18T01:45:10.298021+0000","last_unstale":"2024-09-18T01:48:33.850412+0000","last_undegraded":"2024-09-18T01:48:33.850412+0000","last_fullsized":"2024-09-18T01:48:33.850412+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'58","last_scrub_stamp":"2024-09-18T01:48:33.850320+0000","last_deep_scrub":"33'58","last_deep_scrub_stamp":"2024-09-18T01:48:33.850320+0000","last_clean_scrub_stamp":"2024-09-18T01:48:33.850320+0000","objects_scrubbed":10,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:47:26.923881+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:45.319936+0000","last_change":"2024-09-18T01:48:45.319977+0000","last_active":"2024-09-18T01:48:45.319936+0000","last_peered":"2024-09-18T01:48:45.319936+0000","last_clean":"2024-09-18T01:48:45.319936+0000","last_became_active":"2024-09-18T01:45:12.313875+0000","last_became_peered":"2024-09-18T01:45:12.313875+0000","last_unstale":"2024-09-18T01:48:45.319936+0000","last_undegraded":"2024-09-18T01:48:45.319936+0000","last_fullsized":"2024-09-18T01:48:45.319936+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:45.319802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:45.319802+0000","last_clean_scrub_stamp":"2024-09-18T01:48:45.319802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:30:17.984788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'7","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:22.215974+0000","last_change":"2024-09-18T01:45:14.322757+0000","last_active":"2024-09-18T01:47:22.215974+0000","last_peered":"2024-09-18T01:47:22.215974+0000","last_clean":"2024-09-18T01:47:22.215974+0000","last_became_active":"2024-09-18T01:45:14.322448+0000","last_became_peered":"2024-09-18T01:45:14.322448+0000","last_unstale":"2024-09-18T01:47:22.215974+0000","last_undegraded":"2024-09-18T01:47:22.215974+0000","last_fullsized":"2024-09-18T01:47:22.215974+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":17,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'8","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.659827+0000","last_change":"2024-09-18T01:45:06.292485+0000","last_active":"2024-09-18T01:48:12.659827+0000","last_peered":"2024-09-18T01:48:12.659827+0000","last_clean":"2024-09-18T01:48:12.659827+0000","last_became_active":"2024-09-18T01:45:06.292143+0000","last_became_peered":"2024-09-18T01:45:06.292143+0000","last_unstale":"2024-09-18T01:48:12.659827+0000","last_undegraded":"2024-09-18T01:48:12.659827+0000","last_fullsized":"2024-09-18T01:48:12.659827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:55.061212+0000","last_change":"2024-09-18T01:48:55.061241+0000","last_active":"2024-09-18T01:48:55.061212+0000","last_peered":"2024-09-18T01:48:55.061212+0000","last_clean":"2024-09-18T01:48:55.061212+0000","last_became_active":"2024-09-18T01:45:04.292734+0000","last_became_peered":"2024-09-18T01:45:04.292734+0000","last_unstale":"2024-09-18T01:48:55.061212+0000","last_undegraded":"2024-09-18T01:48:55.061212+0000","last_fullsized":"2024-09-18T01:48:55.061212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:55.061101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:55.061101+0000","last_clean_scrub_stamp":"2024-09-18T01:48:55.061101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:28:33.987118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:38.340690+0000","last_change":"2024-09-18T01:48:38.340714+0000","last_active":"2024-09-18T01:48:38.340690+0000","last_peered":"2024-09-18T01:48:38.340690+0000","last_clean":"2024-09-18T01:48:38.340690+0000","last_became_active":"2024-09-18T01:45:08.294026+0000","last_became_peered":"2024-09-18T01:45:08.294026+0000","last_unstale":"2024-09-18T01:48:38.340690+0000","last_undegraded":"2024-09-18T01:48:38.340690+0000","last_fullsized":"2024-09-18T01:48:38.340690+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:38.340604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:38.340604+0000","last_clean_scrub_stamp":"2024-09-18T01:48:38.340604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:23:55.262120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'44","reported_seq":105,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:55.980849+0000","last_change":"2024-09-18T01:48:55.980889+0000","last_active":"2024-09-18T01:48:55.980849+0000","last_peered":"2024-09-18T01:48:55.980849+0000","last_clean":"2024-09-18T01:48:55.980849+0000","last_became_active":"2024-09-18T01:45:10.307420+0000","last_became_peered":"2024-09-18T01:45:10.307420+0000","last_unstale":"2024-09-18T01:48:55.980849+0000","last_undegraded":"2024-09-18T01:48:55.980849+0000","last_fullsized":"2024-09-18T01:48:55.980849+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'44","last_scrub_stamp":"2024-09-18T01:48:55.980766+0000","last_deep_scrub":"33'44","last_deep_scrub_stamp":"2024-09-18T01:48:55.980766+0000","last_clean_scrub_stamp":"2024-09-18T01:48:55.980766+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:39:00.785127+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:27.225360+0000","last_change":"2024-09-18T01:48:27.225386+0000","last_active":"2024-09-18T01:48:27.225360+0000","last_peered":"2024-09-18T01:48:27.225360+0000","last_clean":"2024-09-18T01:48:27.225360+0000","last_became_active":"2024-09-18T01:45:12.305838+0000","last_became_peered":"2024-09-18T01:45:12.305838+0000","last_unstale":"2024-09-18T01:48:27.225360+0000","last_undegraded":"2024-09-18T01:48:27.225360+0000","last_fullsized":"2024-09-18T01:48:27.225360+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:27.225273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:27.225273+0000","last_clean_scrub_stamp":"2024-09-18T01:48:27.225273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:40:36.497250+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'4","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:50.995270+0000","last_change":"2024-09-18T01:48:50.995327+0000","last_active":"2024-09-18T01:48:50.995270+0000","last_peered":"2024-09-18T01:48:50.995270+0000","last_clean":"2024-09-18T01:48:50.995270+0000","last_became_active":"2024-09-18T01:45:14.322272+0000","last_became_peered":"2024-09-18T01:45:14.322272+0000","last_unstale":"2024-09-18T01:48:50.995270+0000","last_undegraded":"2024-09-18T01:48:50.995270+0000","last_fullsized":"2024-09-18T01:48:50.995270+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:48:50.995161+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:48:50.995161+0000","last_clean_scrub_stamp":"2024-09-18T01:48:50.995161+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:39:37.704225+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"33'8","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:54.036665+0000","last_change":"2024-09-18T01:48:54.036697+0000","last_active":"2024-09-18T01:48:54.036665+0000","last_peered":"2024-09-18T01:48:54.036665+0000","last_clean":"2024-09-18T01:48:54.036665+0000","last_became_active":"2024-09-18T01:45:06.284677+0000","last_became_peered":"2024-09-18T01:45:06.284677+0000","last_unstale":"2024-09-18T01:48:54.036665+0000","last_undegraded":"2024-09-18T01:48:54.036665+0000","last_fullsized":"2024-09-18T01:48:54.036665+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-18T01:48:54.036561+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-18T01:48:54.036561+0000","last_clean_scrub_stamp":"2024-09-18T01:48:54.036561+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:24:10.958078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:22.216180+0000","last_change":"2024-09-18T01:45:04.287402+0000","last_active":"2024-09-18T01:47:22.216180+0000","last_peered":"2024-09-18T01:47:22.216180+0000","last_clean":"2024-09-18T01:47:22.216180+0000","last_became_active":"2024-09-18T01:45:04.284151+0000","last_became_peered":"2024-09-18T01:45:04.284151+0000","last_unstale":"2024-09-18T01:47:22.216180+0000","last_undegraded":"2024-09-18T01:47:22.216180+0000","last_fullsized":"2024-09-18T01:47:22.216180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:44.316900+0000","last_change":"2024-09-18T01:48:44.316921+0000","last_active":"2024-09-18T01:48:44.316900+0000","last_peered":"2024-09-18T01:48:44.316900+0000","last_clean":"2024-09-18T01:48:44.316900+0000","last_became_active":"2024-09-18T01:45:08.289521+0000","last_became_peered":"2024-09-18T01:45:08.289521+0000","last_unstale":"2024-09-18T01:48:44.316900+0000","last_undegraded":"2024-09-18T01:48:44.316900+0000","last_fullsized":"2024-09-18T01:48:44.316900+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:44.316811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:44.316811+0000","last_clean_scrub_stamp":"2024-09-18T01:48:44.316811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:06:52.240759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'60","reported_seq":130,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:31.041184+0000","last_change":"2024-09-18T01:48:31.041221+0000","last_active":"2024-09-18T01:48:31.041184+0000","last_peered":"2024-09-18T01:48:31.041184+0000","last_clean":"2024-09-18T01:48:31.041184+0000","last_became_active":"2024-09-18T01:45:10.306481+0000","last_became_peered":"2024-09-18T01:45:10.306481+0000","last_unstale":"2024-09-18T01:48:31.041184+0000","last_undegraded":"2024-09-18T01:48:31.041184+0000","last_fullsized":"2024-09-18T01:48:31.041184+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'60","last_scrub_stamp":"2024-09-18T01:48:31.041096+0000","last_deep_scrub":"33'60","last_deep_scrub_stamp":"2024-09-18T01:48:31.041096+0000","last_clean_scrub_stamp":"2024-09-18T01:48:31.041096+0000","objects_scrubbed":9,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:19:08.072740+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'285","reported_seq":359,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:33.295878+0000","last_change":"2024-09-18T01:48:33.295906+0000","last_active":"2024-09-18T01:48:33.295878+0000","last_peered":"2024-09-18T01:48:33.295878+0000","last_clean":"2024-09-18T01:48:33.295878+0000","last_became_active":"2024-09-18T01:45:12.313065+0000","last_became_peered":"2024-09-18T01:45:12.313065+0000","last_unstale":"2024-09-18T01:48:33.295878+0000","last_undegraded":"2024-09-18T01:48:33.295878+0000","last_fullsized":"2024-09-18T01:48:33.295878+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-18T01:48:33.295792+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-18T01:48:33.295792+0000","last_clean_scrub_stamp":"2024-09-18T01:48:33.295792+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:47:31.508822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"33'2","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:27.215024+0000","last_change":"2024-09-18T01:45:14.320158+0000","last_active":"2024-09-18T01:47:27.215024+0000","last_peered":"2024-09-18T01:47:27.215024+0000","last_clean":"2024-09-18T01:47:27.215024+0000","last_became_active":"2024-09-18T01:45:14.319805+0000","last_became_peered":"2024-09-18T01:45:14.319805+0000","last_unstale":"2024-09-18T01:47:27.215024+0000","last_undegraded":"2024-09-18T01:47:27.215024+0000","last_fullsized":"2024-09-18T01:47:27.215024+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"33'10","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:47.050689+0000","last_change":"2024-09-18T01:48:47.050714+0000","last_active":"2024-09-18T01:48:47.050689+0000","last_peered":"2024-09-18T01:48:47.050689+0000","last_clean":"2024-09-18T01:48:47.050689+0000","last_became_active":"2024-09-18T01:45:06.281444+0000","last_became_peered":"2024-09-18T01:45:06.281444+0000","last_unstale":"2024-09-18T01:48:47.050689+0000","last_undegraded":"2024-09-18T01:48:47.050689+0000","last_fullsized":"2024-09-18T01:48:47.050689+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-18T01:48:47.050596+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-18T01:48:47.050596+0000","last_clean_scrub_stamp":"2024-09-18T01:48:47.050596+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:04:32.118971+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:22.216103+0000","last_change":"2024-09-18T01:45:04.289841+0000","last_active":"2024-09-18T01:47:22.216103+0000","last_peered":"2024-09-18T01:47:22.216103+0000","last_clean":"2024-09-18T01:47:22.216103+0000","last_became_active":"2024-09-18T01:45:04.289216+0000","last_became_peered":"2024-09-18T01:45:04.289216+0000","last_unstale":"2024-09-18T01:47:22.216103+0000","last_undegraded":"2024-09-18T01:47:22.216103+0000","last_fullsized":"2024-09-18T01:47:22.216103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:42.306210+0000","last_change":"2024-09-18T01:48:42.306236+0000","last_active":"2024-09-18T01:48:42.306210+0000","last_peered":"2024-09-18T01:48:42.306210+0000","last_clean":"2024-09-18T01:48:42.306210+0000","last_became_active":"2024-09-18T01:45:08.289725+0000","last_became_peered":"2024-09-18T01:45:08.289725+0000","last_unstale":"2024-09-18T01:48:42.306210+0000","last_undegraded":"2024-09-18T01:48:42.306210+0000","last_fullsized":"2024-09-18T01:48:42.306210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:42.306116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:42.306116+0000","last_clean_scrub_stamp":"2024-09-18T01:48:42.306116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:12:34.242137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"33'84","reported_seq":169,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:48.994644+0000","last_change":"2024-09-18T01:48:48.994684+0000","last_active":"2024-09-18T01:48:48.994644+0000","last_peered":"2024-09-18T01:48:48.994644+0000","last_clean":"2024-09-18T01:48:48.994644+0000","last_became_active":"2024-09-18T01:45:10.309360+0000","last_became_peered":"2024-09-18T01:45:10.309360+0000","last_unstale":"2024-09-18T01:48:48.994644+0000","last_undegraded":"2024-09-18T01:48:48.994644+0000","last_fullsized":"2024-09-18T01:48:48.994644+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'84","last_scrub_stamp":"2024-09-18T01:48:48.994559+0000","last_deep_scrub":"33'84","last_deep_scrub_stamp":"2024-09-18T01:48:48.994559+0000","last_clean_scrub_stamp":"2024-09-18T01:48:48.994559+0000","objects_scrubbed":7,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:06:39.021603+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5903,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":90,"num_read_kb":105,"num_write":42,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:29.256572+0000","last_change":"2024-09-18T01:48:29.256596+0000","last_active":"2024-09-18T01:48:29.256572+0000","last_peered":"2024-09-18T01:48:29.256572+0000","last_clean":"2024-09-18T01:48:29.256572+0000","last_became_active":"2024-09-18T01:45:12.312665+0000","last_became_peered":"2024-09-18T01:45:12.312665+0000","last_unstale":"2024-09-18T01:48:29.256572+0000","last_undegraded":"2024-09-18T01:48:29.256572+0000","last_fullsized":"2024-09-18T01:48:29.256572+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:29.256466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:29.256466+0000","last_clean_scrub_stamp":"2024-09-18T01:48:29.256466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:07:14.275320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'18","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.979585+0000","last_change":"2024-09-18T01:45:14.320179+0000","last_active":"2024-09-18T01:48:12.979585+0000","last_peered":"2024-09-18T01:48:12.979585+0000","last_clean":"2024-09-18T01:48:12.979585+0000","last_became_active":"2024-09-18T01:45:14.319638+0000","last_became_peered":"2024-09-18T01:45:14.319638+0000","last_unstale":"2024-09-18T01:48:12.979585+0000","last_undegraded":"2024-09-18T01:48:12.979585+0000","last_fullsized":"2024-09-18T01:48:12.979585+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:55.048126+0000","last_change":"2024-09-18T01:48:55.048167+0000","last_active":"2024-09-18T01:48:55.048126+0000","last_peered":"2024-09-18T01:48:55.048126+0000","last_clean":"2024-09-18T01:48:55.048126+0000","last_became_active":"2024-09-18T01:45:06.290087+0000","last_became_peered":"2024-09-18T01:45:06.290087+0000","last_unstale":"2024-09-18T01:48:55.048126+0000","last_undegraded":"2024-09-18T01:48:55.048126+0000","last_fullsized":"2024-09-18T01:48:55.048126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:48:55.048003+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:48:55.048003+0000","last_clean_scrub_stamp":"2024-09-18T01:48:55.048003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:28:28.602326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:22.214246+0000","last_change":"2024-09-18T01:45:04.279319+0000","last_active":"2024-09-18T01:47:22.214246+0000","last_peered":"2024-09-18T01:47:22.214246+0000","last_clean":"2024-09-18T01:47:22.214246+0000","last_became_active":"2024-09-18T01:45:04.278979+0000","last_became_peered":"2024-09-18T01:45:04.278979+0000","last_unstale":"2024-09-18T01:47:22.214246+0000","last_undegraded":"2024-09-18T01:47:22.214246+0000","last_fullsized":"2024-09-18T01:47:22.214246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:36.904915+0000","last_change":"2024-09-18T01:48:36.904948+0000","last_active":"2024-09-18T01:48:36.904915+0000","last_peered":"2024-09-18T01:48:36.904915+0000","last_clean":"2024-09-18T01:48:36.904915+0000","last_became_active":"2024-09-18T01:45:08.292156+0000","last_became_peered":"2024-09-18T01:45:08.292156+0000","last_unstale":"2024-09-18T01:48:36.904915+0000","last_undegraded":"2024-09-18T01:48:36.904915+0000","last_fullsized":"2024-09-18T01:48:36.904915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:36.904811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:36.904811+0000","last_clean_scrub_stamp":"2024-09-18T01:48:36.904811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:16:10.795874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'46","reported_seq":108,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:31.876714+0000","last_change":"2024-09-18T01:48:31.876752+0000","last_active":"2024-09-18T01:48:31.876714+0000","last_peered":"2024-09-18T01:48:31.876714+0000","last_clean":"2024-09-18T01:48:31.876714+0000","last_became_active":"2024-09-18T01:45:10.300488+0000","last_became_peered":"2024-09-18T01:45:10.300488+0000","last_unstale":"2024-09-18T01:48:31.876714+0000","last_undegraded":"2024-09-18T01:48:31.876714+0000","last_fullsized":"2024-09-18T01:48:31.876714+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'46","last_scrub_stamp":"2024-09-18T01:48:31.876630+0000","last_deep_scrub":"33'46","last_deep_scrub_stamp":"2024-09-18T01:48:31.876630+0000","last_clean_scrub_stamp":"2024-09-18T01:48:31.876630+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:14:05.046500+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:45.045908+0000","last_change":"2024-09-18T01:48:45.045948+0000","last_active":"2024-09-18T01:48:45.045908+0000","last_peered":"2024-09-18T01:48:45.045908+0000","last_clean":"2024-09-18T01:48:45.045908+0000","last_became_active":"2024-09-18T01:45:12.315695+0000","last_became_peered":"2024-09-18T01:45:12.315695+0000","last_unstale":"2024-09-18T01:48:45.045908+0000","last_undegraded":"2024-09-18T01:48:45.045908+0000","last_fullsized":"2024-09-18T01:48:45.045908+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:45.045766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:45.045766+0000","last_clean_scrub_stamp":"2024-09-18T01:48:45.045766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:18:11.087673+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"33'3","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.939005+0000","last_change":"2024-09-18T01:45:14.326486+0000","last_active":"2024-09-18T01:48:12.939005+0000","last_peered":"2024-09-18T01:48:12.939005+0000","last_clean":"2024-09-18T01:48:12.939005+0000","last_became_active":"2024-09-18T01:45:14.326209+0000","last_became_peered":"2024-09-18T01:45:14.326209+0000","last_unstale":"2024-09-18T01:48:12.939005+0000","last_undegraded":"2024-09-18T01:48:12.939005+0000","last_fullsized":"2024-09-18T01:48:12.939005+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:44.062748+0000","last_change":"2024-09-18T01:48:44.062795+0000","last_active":"2024-09-18T01:48:44.062748+0000","last_peered":"2024-09-18T01:48:44.062748+0000","last_clean":"2024-09-18T01:48:44.062748+0000","last_became_active":"2024-09-18T01:45:06.285771+0000","last_became_peered":"2024-09-18T01:45:06.285771+0000","last_unstale":"2024-09-18T01:48:44.062748+0000","last_undegraded":"2024-09-18T01:48:44.062748+0000","last_fullsized":"2024-09-18T01:48:44.062748+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:48:44.062649+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:48:44.062649+0000","last_clean_scrub_stamp":"2024-09-18T01:48:44.062649+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:57:52.976791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.491204+0000","last_change":"2024-09-18T01:45:04.287560+0000","last_active":"2024-09-18T01:48:19.491204+0000","last_peered":"2024-09-18T01:48:19.491204+0000","last_clean":"2024-09-18T01:48:19.491204+0000","last_became_active":"2024-09-18T01:45:04.287263+0000","last_became_peered":"2024-09-18T01:45:04.287263+0000","last_unstale":"2024-09-18T01:48:19.491204+0000","last_undegraded":"2024-09-18T01:48:19.491204+0000","last_fullsized":"2024-09-18T01:48:19.491204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:43.281572+0000","last_change":"2024-09-18T01:48:43.281610+0000","last_active":"2024-09-18T01:48:43.281572+0000","last_peered":"2024-09-18T01:48:43.281572+0000","last_clean":"2024-09-18T01:48:43.281572+0000","last_became_active":"2024-09-18T01:45:08.289604+0000","last_became_peered":"2024-09-18T01:45:08.289604+0000","last_unstale":"2024-09-18T01:48:43.281572+0000","last_undegraded":"2024-09-18T01:48:43.281572+0000","last_fullsized":"2024-09-18T01:48:43.281572+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:43.281481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:43.281481+0000","last_clean_scrub_stamp":"2024-09-18T01:48:43.281481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:37:19.077361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'46","reported_seq":104,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:32.804739+0000","last_change":"2024-09-18T01:48:32.804773+0000","last_active":"2024-09-18T01:48:32.804739+0000","last_peered":"2024-09-18T01:48:32.804739+0000","last_clean":"2024-09-18T01:48:32.804739+0000","last_became_active":"2024-09-18T01:45:10.297511+0000","last_became_peered":"2024-09-18T01:45:10.297511+0000","last_unstale":"2024-09-18T01:48:32.804739+0000","last_undegraded":"2024-09-18T01:48:32.804739+0000","last_fullsized":"2024-09-18T01:48:32.804739+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'46","last_scrub_stamp":"2024-09-18T01:48:32.804654+0000","last_deep_scrub":"33'46","last_deep_scrub_stamp":"2024-09-18T01:48:32.804654+0000","last_clean_scrub_stamp":"2024-09-18T01:48:32.804654+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:33:34.219867+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'285","reported_seq":414,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:39.926591+0000","last_change":"2024-09-18T01:48:39.926622+0000","last_active":"2024-09-18T01:48:39.926591+0000","last_peered":"2024-09-18T01:48:39.926591+0000","last_clean":"2024-09-18T01:48:39.926591+0000","last_became_active":"2024-09-18T01:45:12.314918+0000","last_became_peered":"2024-09-18T01:45:12.314918+0000","last_unstale":"2024-09-18T01:48:39.926591+0000","last_undegraded":"2024-09-18T01:48:39.926591+0000","last_fullsized":"2024-09-18T01:48:39.926591+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-18T01:48:39.926503+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-18T01:48:39.926503+0000","last_clean_scrub_stamp":"2024-09-18T01:48:39.926503+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:49:29.916648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'12","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.940929+0000","last_change":"2024-09-18T01:45:14.319866+0000","last_active":"2024-09-18T01:48:12.940929+0000","last_peered":"2024-09-18T01:48:12.940929+0000","last_clean":"2024-09-18T01:48:12.940929+0000","last_became_active":"2024-09-18T01:45:14.319364+0000","last_became_peered":"2024-09-18T01:45:14.319364+0000","last_unstale":"2024-09-18T01:48:12.940929+0000","last_undegraded":"2024-09-18T01:48:12.940929+0000","last_fullsized":"2024-09-18T01:48:12.940929+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:22.216078+0000","last_change":"2024-09-18T01:45:06.291329+0000","last_active":"2024-09-18T01:47:22.216078+0000","last_peered":"2024-09-18T01:47:22.216078+0000","last_clean":"2024-09-18T01:47:22.216078+0000","last_became_active":"2024-09-18T01:45:06.291023+0000","last_became_peered":"2024-09-18T01:45:06.291023+0000","last_unstale":"2024-09-18T01:47:22.216078+0000","last_undegraded":"2024-09-18T01:47:22.216078+0000","last_fullsized":"2024-09-18T01:47:22.216078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:17.215165+0000","last_change":"2024-09-18T01:45:04.294066+0000","last_active":"2024-09-18T01:47:17.215165+0000","last_peered":"2024-09-18T01:47:17.215165+0000","last_clean":"2024-09-18T01:47:17.215165+0000","last_became_active":"2024-09-18T01:45:04.288386+0000","last_became_peered":"2024-09-18T01:45:04.288386+0000","last_unstale":"2024-09-18T01:47:17.215165+0000","last_undegraded":"2024-09-18T01:47:17.215165+0000","last_fullsized":"2024-09-18T01:47:17.215165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'5","reported_seq":428,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:37.935954+0000","last_change":"2024-09-18T01:48:37.935983+0000","last_active":"2024-09-18T01:48:37.935954+0000","last_peered":"2024-09-18T01:48:37.935954+0000","last_clean":"2024-09-18T01:48:37.935954+0000","last_became_active":"2024-09-18T01:45:08.289478+0000","last_became_peered":"2024-09-18T01:45:08.289478+0000","last_unstale":"2024-09-18T01:48:37.935954+0000","last_undegraded":"2024-09-18T01:48:37.935954+0000","last_fullsized":"2024-09-18T01:48:37.935954+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-18T01:48:37.935837+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-18T01:48:37.935837+0000","last_clean_scrub_stamp":"2024-09-18T01:48:37.935837+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:10:09.966686+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'16","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:35.107094+0000","last_change":"2024-09-18T01:48:35.107168+0000","last_active":"2024-09-18T01:48:35.107094+0000","last_peered":"2024-09-18T01:48:35.107094+0000","last_clean":"2024-09-18T01:48:35.107094+0000","last_became_active":"2024-09-18T01:45:10.307374+0000","last_became_peered":"2024-09-18T01:45:10.307374+0000","last_unstale":"2024-09-18T01:48:35.107094+0000","last_undegraded":"2024-09-18T01:48:35.107094+0000","last_fullsized":"2024-09-18T01:48:35.107094+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2024-09-18T01:48:35.106992+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2024-09-18T01:48:35.106992+0000","last_clean_scrub_stamp":"2024-09-18T01:48:35.106992+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:54:20.385136+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'285","reported_seq":476,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:25.009751+0000","last_change":"2024-09-18T01:48:25.009780+0000","last_active":"2024-09-18T01:48:25.009751+0000","last_peered":"2024-09-18T01:48:25.009751+0000","last_clean":"2024-09-18T01:48:25.009751+0000","last_became_active":"2024-09-18T01:45:12.311929+0000","last_became_peered":"2024-09-18T01:45:12.311929+0000","last_unstale":"2024-09-18T01:48:25.009751+0000","last_undegraded":"2024-09-18T01:48:25.009751+0000","last_fullsized":"2024-09-18T01:48:25.009751+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-18T01:48:25.009658+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-18T01:48:25.009658+0000","last_clean_scrub_stamp":"2024-09-18T01:48:25.009658+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:37:56.338472+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"33'6","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:22.215865+0000","last_change":"2024-09-18T01:45:14.318697+0000","last_active":"2024-09-18T01:47:22.215865+0000","last_peered":"2024-09-18T01:47:22.215865+0000","last_clean":"2024-09-18T01:47:22.215865+0000","last_became_active":"2024-09-18T01:45:14.318418+0000","last_became_peered":"2024-09-18T01:45:14.318418+0000","last_unstale":"2024-09-18T01:47:22.215865+0000","last_undegraded":"2024-09-18T01:47:22.215865+0000","last_fullsized":"2024-09-18T01:47:22.215865+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"31'4","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:41.845898+0000","last_change":"2024-09-18T01:48:41.845938+0000","last_active":"2024-09-18T01:48:41.845898+0000","last_peered":"2024-09-18T01:48:41.845898+0000","last_clean":"2024-09-18T01:48:41.845898+0000","last_became_active":"2024-09-18T01:45:06.296824+0000","last_became_peered":"2024-09-18T01:45:06.296824+0000","last_unstale":"2024-09-18T01:48:41.845898+0000","last_undegraded":"2024-09-18T01:48:41.845898+0000","last_fullsized":"2024-09-18T01:48:41.845898+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-18T01:48:41.845784+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-18T01:48:41.845784+0000","last_clean_scrub_stamp":"2024-09-18T01:48:41.845784+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:28:20.771801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.489403+0000","last_change":"2024-09-18T01:45:04.288364+0000","last_active":"2024-09-18T01:48:19.489403+0000","last_peered":"2024-09-18T01:48:19.489403+0000","last_clean":"2024-09-18T01:48:19.489403+0000","last_became_active":"2024-09-18T01:45:04.287961+0000","last_became_peered":"2024-09-18T01:45:04.287961+0000","last_unstale":"2024-09-18T01:48:19.489403+0000","last_undegraded":"2024-09-18T01:48:19.489403+0000","last_fullsized":"2024-09-18T01:48:19.489403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:30.056211+0000","last_change":"2024-09-18T01:48:30.056238+0000","last_active":"2024-09-18T01:48:30.056211+0000","last_peered":"2024-09-18T01:48:30.056211+0000","last_clean":"2024-09-18T01:48:30.056211+0000","last_became_active":"2024-09-18T01:45:08.294053+0000","last_became_peered":"2024-09-18T01:45:08.294053+0000","last_unstale":"2024-09-18T01:48:30.056211+0000","last_undegraded":"2024-09-18T01:48:30.056211+0000","last_fullsized":"2024-09-18T01:48:30.056211+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:30.056116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:30.056116+0000","last_clean_scrub_stamp":"2024-09-18T01:48:30.056116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:08:42.773951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'49","reported_seq":108,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:32.916909+0000","last_change":"2024-09-18T01:48:32.916950+0000","last_active":"2024-09-18T01:48:32.916909+0000","last_peered":"2024-09-18T01:48:32.916909+0000","last_clean":"2024-09-18T01:48:32.916909+0000","last_became_active":"2024-09-18T01:45:10.300337+0000","last_became_peered":"2024-09-18T01:45:10.300337+0000","last_unstale":"2024-09-18T01:48:32.916909+0000","last_undegraded":"2024-09-18T01:48:32.916909+0000","last_fullsized":"2024-09-18T01:48:32.916909+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'49","last_scrub_stamp":"2024-09-18T01:48:32.916825+0000","last_deep_scrub":"33'49","last_deep_scrub_stamp":"2024-09-18T01:48:32.916825+0000","last_clean_scrub_stamp":"2024-09-18T01:48:32.916825+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:18:05.044892+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:25.794769+0000","last_change":"2024-09-18T01:48:25.794798+0000","last_active":"2024-09-18T01:48:25.794769+0000","last_peered":"2024-09-18T01:48:25.794769+0000","last_clean":"2024-09-18T01:48:25.794769+0000","last_became_active":"2024-09-18T01:45:12.307210+0000","last_became_peered":"2024-09-18T01:45:12.307210+0000","last_unstale":"2024-09-18T01:48:25.794769+0000","last_undegraded":"2024-09-18T01:48:25.794769+0000","last_fullsized":"2024-09-18T01:48:25.794769+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:25.794656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:25.794656+0000","last_clean_scrub_stamp":"2024-09-18T01:48:25.794656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:43:11.167455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'6","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:38.907928+0000","last_change":"2024-09-18T01:48:38.907977+0000","last_active":"2024-09-18T01:48:38.907928+0000","last_peered":"2024-09-18T01:48:38.907928+0000","last_clean":"2024-09-18T01:48:38.907928+0000","last_became_active":"2024-09-18T01:45:14.314786+0000","last_became_peered":"2024-09-18T01:45:14.314786+0000","last_unstale":"2024-09-18T01:48:38.907928+0000","last_undegraded":"2024-09-18T01:48:38.907928+0000","last_fullsized":"2024-09-18T01:48:38.907928+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-18T01:48:38.907803+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-18T01:48:38.907803+0000","last_clean_scrub_stamp":"2024-09-18T01:48:38.907803+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:42:22.155558+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"33'2","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:57.935993+0000","last_change":"2024-09-18T01:48:57.936018+0000","last_active":"2024-09-18T01:48:57.935993+0000","last_peered":"2024-09-18T01:48:57.935993+0000","last_clean":"2024-09-18T01:48:57.935993+0000","last_became_active":"2024-09-18T01:45:06.286138+0000","last_became_peered":"2024-09-18T01:45:06.286138+0000","last_unstale":"2024-09-18T01:48:57.935993+0000","last_undegraded":"2024-09-18T01:48:57.935993+0000","last_fullsized":"2024-09-18T01:48:57.935993+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:48:57.935901+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:48:57.935901+0000","last_clean_scrub_stamp":"2024-09-18T01:48:57.935901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:05:06.158791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":207,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:22.809890+0000","last_change":"2024-09-18T01:44:49.573399+0000","last_active":"2024-09-18T01:48:22.809890+0000","last_peered":"2024-09-18T01:48:22.809890+0000","last_clean":"2024-09-18T01:48:22.809890+0000","last_became_active":"2024-09-18T01:44:49.572263+0000","last_became_peered":"2024-09-18T01:44:49.572263+0000","last_unstale":"2024-09-18T01:48:22.809890+0000","last_undegraded":"2024-09-18T01:48:22.809890+0000","last_fullsized":"2024-09-18T01:48:22.809890+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:48.210722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:48.210722+0000","last_clean_scrub_stamp":"2024-09-18T01:44:48.210722+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:02.212893+0000","last_change":"2024-09-18T01:44:55.241426+0000","last_active":"2024-09-18T01:47:02.212893+0000","last_peered":"2024-09-18T01:47:02.212893+0000","last_clean":"2024-09-18T01:47:02.212893+0000","last_became_active":"2024-09-18T01:44:53.233974+0000","last_became_peered":"2024-09-18T01:44:53.233974+0000","last_unstale":"2024-09-18T01:47:02.212893+0000","last_undegraded":"2024-09-18T01:47:02.212893+0000","last_fullsized":"2024-09-18T01:47:02.212893+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045237700000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.214400+0000","last_change":"2024-09-18T01:45:04.289472+0000","last_active":"2024-09-18T01:47:12.214400+0000","last_peered":"2024-09-18T01:47:12.214400+0000","last_clean":"2024-09-18T01:47:12.214400+0000","last_became_active":"2024-09-18T01:45:04.287763+0000","last_became_peered":"2024-09-18T01:45:04.287763+0000","last_unstale":"2024-09-18T01:47:12.214400+0000","last_undegraded":"2024-09-18T01:47:12.214400+0000","last_fullsized":"2024-09-18T01:47:12.214400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:39.901202+0000","last_change":"2024-09-18T01:48:39.901227+0000","last_active":"2024-09-18T01:48:39.901202+0000","last_peered":"2024-09-18T01:48:39.901202+0000","last_clean":"2024-09-18T01:48:39.901202+0000","last_became_active":"2024-09-18T01:45:08.288131+0000","last_became_peered":"2024-09-18T01:45:08.288131+0000","last_unstale":"2024-09-18T01:48:39.901202+0000","last_undegraded":"2024-09-18T01:48:39.901202+0000","last_fullsized":"2024-09-18T01:48:39.901202+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:39.901111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:39.901111+0000","last_clean_scrub_stamp":"2024-09-18T01:48:39.901111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:24:25.271343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'95","reported_seq":191,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:27.011310+0000","last_change":"2024-09-18T01:48:27.011354+0000","last_active":"2024-09-18T01:48:27.011310+0000","last_peered":"2024-09-18T01:48:27.011310+0000","last_clean":"2024-09-18T01:48:27.011310+0000","last_became_active":"2024-09-18T01:45:10.305004+0000","last_became_peered":"2024-09-18T01:45:10.305004+0000","last_unstale":"2024-09-18T01:48:27.011310+0000","last_undegraded":"2024-09-18T01:48:27.011310+0000","last_fullsized":"2024-09-18T01:48:27.011310+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'95","last_scrub_stamp":"2024-09-18T01:48:27.011228+0000","last_deep_scrub":"33'95","last_deep_scrub_stamp":"2024-09-18T01:48:27.011228+0000","last_clean_scrub_stamp":"2024-09-18T01:48:27.011228+0000","objects_scrubbed":6,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:47:24.915172+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":81,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:24.264559+0000","last_change":"2024-09-18T01:48:24.264584+0000","last_active":"2024-09-18T01:48:24.264559+0000","last_peered":"2024-09-18T01:48:24.264559+0000","last_clean":"2024-09-18T01:48:24.264559+0000","last_became_active":"2024-09-18T01:45:12.311337+0000","last_became_peered":"2024-09-18T01:45:12.311337+0000","last_unstale":"2024-09-18T01:48:24.264559+0000","last_undegraded":"2024-09-18T01:48:24.264559+0000","last_fullsized":"2024-09-18T01:48:24.264559+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:24.264452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:24.264452+0000","last_clean_scrub_stamp":"2024-09-18T01:48:24.264452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:54:43.625934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'81","reported_seq":171,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:44.040674+0000","last_change":"2024-09-18T01:48:44.040748+0000","last_active":"2024-09-18T01:48:44.040674+0000","last_peered":"2024-09-18T01:48:44.040674+0000","last_clean":"2024-09-18T01:48:44.040674+0000","last_became_active":"2024-09-18T01:45:14.314784+0000","last_became_peered":"2024-09-18T01:45:14.314784+0000","last_unstale":"2024-09-18T01:48:44.040674+0000","last_undegraded":"2024-09-18T01:48:44.040674+0000","last_fullsized":"2024-09-18T01:48:44.040674+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'81","last_scrub_stamp":"2024-09-18T01:48:44.040554+0000","last_deep_scrub":"33'81","last_deep_scrub_stamp":"2024-09-18T01:48:44.040554+0000","last_clean_scrub_stamp":"2024-09-18T01:48:44.040554+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:07:29.059407+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'4","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:52.221891+0000","last_change":"2024-09-18T01:45:41.350104+0000","last_active":"2024-09-18T01:47:52.221891+0000","last_peered":"2024-09-18T01:47:52.221891+0000","last_clean":"2024-09-18T01:47:52.221891+0000","last_became_active":"2024-09-18T01:45:41.338925+0000","last_became_peered":"2024-09-18T01:45:41.338925+0000","last_unstale":"2024-09-18T01:47:52.221891+0000","last_undegraded":"2024-09-18T01:47:52.221891+0000","last_fullsized":"2024-09-18T01:47:52.221891+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:23.650889+0000","last_change":"2024-09-18T01:44:55.242126+0000","last_active":"2024-09-18T01:48:23.650889+0000","last_peered":"2024-09-18T01:48:23.650889+0000","last_clean":"2024-09-18T01:48:23.650889+0000","last_became_active":"2024-09-18T01:44:53.237059+0000","last_became_peered":"2024-09-18T01:44:53.237059+0000","last_unstale":"2024-09-18T01:48:23.650889+0000","last_undegraded":"2024-09-18T01:48:23.650889+0000","last_fullsized":"2024-09-18T01:48:23.650889+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011095359999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.212643+0000","last_change":"2024-09-18T01:45:04.273879+0000","last_active":"2024-09-18T01:47:12.212643+0000","last_peered":"2024-09-18T01:47:12.212643+0000","last_clean":"2024-09-18T01:47:12.212643+0000","last_became_active":"2024-09-18T01:45:04.273354+0000","last_became_peered":"2024-09-18T01:45:04.273354+0000","last_unstale":"2024-09-18T01:47:12.212643+0000","last_undegraded":"2024-09-18T01:47:12.212643+0000","last_fullsized":"2024-09-18T01:47:12.212643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:32.043568+0000","last_change":"2024-09-18T01:48:32.043612+0000","last_active":"2024-09-18T01:48:32.043568+0000","last_peered":"2024-09-18T01:48:32.043568+0000","last_clean":"2024-09-18T01:48:32.043568+0000","last_became_active":"2024-09-18T01:45:08.291681+0000","last_became_peered":"2024-09-18T01:45:08.291681+0000","last_unstale":"2024-09-18T01:48:32.043568+0000","last_undegraded":"2024-09-18T01:48:32.043568+0000","last_fullsized":"2024-09-18T01:48:32.043568+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:32.043454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:32.043454+0000","last_clean_scrub_stamp":"2024-09-18T01:48:32.043454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:43:29.802788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'297","reported_seq":527,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:27.957007+0000","last_change":"2024-09-18T01:48:27.957047+0000","last_active":"2024-09-18T01:48:27.957007+0000","last_peered":"2024-09-18T01:48:27.957007+0000","last_clean":"2024-09-18T01:48:27.957007+0000","last_became_active":"2024-09-18T01:45:10.305472+0000","last_became_peered":"2024-09-18T01:45:10.305472+0000","last_unstale":"2024-09-18T01:48:27.957007+0000","last_undegraded":"2024-09-18T01:48:27.957007+0000","last_fullsized":"2024-09-18T01:48:27.957007+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'297","last_scrub_stamp":"2024-09-18T01:48:27.956904+0000","last_deep_scrub":"33'297","last_deep_scrub_stamp":"2024-09-18T01:48:27.956904+0000","last_clean_scrub_stamp":"2024-09-18T01:48:27.956904+0000","objects_scrubbed":11,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:56:18.052928+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":387,"num_read_kb":371,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:55.023415+0000","last_change":"2024-09-18T01:48:55.023485+0000","last_active":"2024-09-18T01:48:55.023415+0000","last_peered":"2024-09-18T01:48:55.023415+0000","last_clean":"2024-09-18T01:48:55.023415+0000","last_became_active":"2024-09-18T01:45:12.316110+0000","last_became_peered":"2024-09-18T01:45:12.316110+0000","last_unstale":"2024-09-18T01:48:55.023415+0000","last_undegraded":"2024-09-18T01:48:55.023415+0000","last_fullsized":"2024-09-18T01:48:55.023415+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:55.023295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:55.023295+0000","last_clean_scrub_stamp":"2024-09-18T01:48:55.023295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:00:27.945139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'5","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:27.217057+0000","last_change":"2024-09-18T01:45:14.323262+0000","last_active":"2024-09-18T01:47:27.217057+0000","last_peered":"2024-09-18T01:47:27.217057+0000","last_clean":"2024-09-18T01:47:27.217057+0000","last_became_active":"2024-09-18T01:45:14.322986+0000","last_became_peered":"2024-09-18T01:45:14.322986+0000","last_unstale":"2024-09-18T01:47:27.217057+0000","last_undegraded":"2024-09-18T01:47:27.217057+0000","last_fullsized":"2024-09-18T01:47:27.217057+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'8","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:54.374788+0000","last_change":"2024-09-18T01:48:54.374813+0000","last_active":"2024-09-18T01:48:54.374788+0000","last_peered":"2024-09-18T01:48:54.374788+0000","last_clean":"2024-09-18T01:48:54.374788+0000","last_became_active":"2024-09-18T01:45:06.292996+0000","last_became_peered":"2024-09-18T01:45:06.292996+0000","last_unstale":"2024-09-18T01:48:54.374788+0000","last_undegraded":"2024-09-18T01:48:54.374788+0000","last_fullsized":"2024-09-18T01:48:54.374788+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-18T01:48:54.374701+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-18T01:48:54.374701+0000","last_clean_scrub_stamp":"2024-09-18T01:48:54.374701+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:54:39.652845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:02.043839+0000","last_change":"2024-09-18T01:49:02.043873+0000","last_active":"2024-09-18T01:49:02.043839+0000","last_peered":"2024-09-18T01:49:02.043839+0000","last_clean":"2024-09-18T01:49:02.043839+0000","last_became_active":"2024-09-18T01:44:53.237016+0000","last_became_peered":"2024-09-18T01:44:53.237016+0000","last_unstale":"2024-09-18T01:49:02.043839+0000","last_undegraded":"2024-09-18T01:49:02.043839+0000","last_fullsized":"2024-09-18T01:49:02.043839+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:02.043751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:02.043751+0000","last_clean_scrub_stamp":"2024-09-18T01:49:02.043751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:47:59.947696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039942899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:58.422394+0000","last_change":"2024-09-18T01:48:58.422425+0000","last_active":"2024-09-18T01:48:58.422394+0000","last_peered":"2024-09-18T01:48:58.422394+0000","last_clean":"2024-09-18T01:48:58.422394+0000","last_became_active":"2024-09-18T01:45:04.283999+0000","last_became_peered":"2024-09-18T01:45:04.283999+0000","last_unstale":"2024-09-18T01:48:58.422394+0000","last_undegraded":"2024-09-18T01:48:58.422394+0000","last_fullsized":"2024-09-18T01:48:58.422394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:48:58.422302+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:48:58.422302+0000","last_clean_scrub_stamp":"2024-09-18T01:48:58.422302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:21:30.620518+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"33'4","reported_seq":232,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:43.006487+0000","last_change":"2024-09-18T01:48:43.006522+0000","last_active":"2024-09-18T01:48:43.006487+0000","last_peered":"2024-09-18T01:48:43.006487+0000","last_clean":"2024-09-18T01:48:43.006487+0000","last_became_active":"2024-09-18T01:45:08.284186+0000","last_became_peered":"2024-09-18T01:45:08.284186+0000","last_unstale":"2024-09-18T01:48:43.006487+0000","last_undegraded":"2024-09-18T01:48:43.006487+0000","last_fullsized":"2024-09-18T01:48:43.006487+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:48:43.006376+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:48:43.006376+0000","last_clean_scrub_stamp":"2024-09-18T01:48:43.006376+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:03:25.253771+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'24","reported_seq":100,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:34.888891+0000","last_change":"2024-09-18T01:48:34.888969+0000","last_active":"2024-09-18T01:48:34.888891+0000","last_peered":"2024-09-18T01:48:34.888891+0000","last_clean":"2024-09-18T01:48:34.888891+0000","last_became_active":"2024-09-18T01:45:10.296284+0000","last_became_peered":"2024-09-18T01:45:10.296284+0000","last_unstale":"2024-09-18T01:48:34.888891+0000","last_undegraded":"2024-09-18T01:48:34.888891+0000","last_fullsized":"2024-09-18T01:48:34.888891+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'24","last_scrub_stamp":"2024-09-18T01:48:34.888775+0000","last_deep_scrub":"33'24","last_deep_scrub_stamp":"2024-09-18T01:48:34.888775+0000","last_clean_scrub_stamp":"2024-09-18T01:48:34.888775+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:24:45.905214+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:26.266579+0000","last_change":"2024-09-18T01:48:26.266603+0000","last_active":"2024-09-18T01:48:26.266579+0000","last_peered":"2024-09-18T01:48:26.266579+0000","last_clean":"2024-09-18T01:48:26.266579+0000","last_became_active":"2024-09-18T01:45:12.311266+0000","last_became_peered":"2024-09-18T01:45:12.311266+0000","last_unstale":"2024-09-18T01:48:26.266579+0000","last_undegraded":"2024-09-18T01:48:26.266579+0000","last_fullsized":"2024-09-18T01:48:26.266579+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:26.266453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:26.266453+0000","last_clean_scrub_stamp":"2024-09-18T01:48:26.266453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:33:31.954590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"33'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:32.218060+0000","last_change":"2024-09-18T01:45:14.318619+0000","last_active":"2024-09-18T01:47:32.218060+0000","last_peered":"2024-09-18T01:47:32.218060+0000","last_clean":"2024-09-18T01:47:32.218060+0000","last_became_active":"2024-09-18T01:45:14.318346+0000","last_became_peered":"2024-09-18T01:45:14.318346+0000","last_unstale":"2024-09-18T01:47:32.218060+0000","last_undegraded":"2024-09-18T01:47:32.218060+0000","last_fullsized":"2024-09-18T01:47:32.218060+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:59.400943+0000","last_change":"2024-09-18T01:48:59.400983+0000","last_active":"2024-09-18T01:48:59.400943+0000","last_peered":"2024-09-18T01:48:59.400943+0000","last_clean":"2024-09-18T01:48:59.400943+0000","last_became_active":"2024-09-18T01:45:06.282319+0000","last_became_peered":"2024-09-18T01:45:06.282319+0000","last_unstale":"2024-09-18T01:48:59.400943+0000","last_undegraded":"2024-09-18T01:48:59.400943+0000","last_fullsized":"2024-09-18T01:48:59.400943+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:48:59.400854+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:48:59.400854+0000","last_clean_scrub_stamp":"2024-09-18T01:48:59.400854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:57:19.245005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:02.212833+0000","last_change":"2024-09-18T01:44:55.242065+0000","last_active":"2024-09-18T01:47:02.212833+0000","last_peered":"2024-09-18T01:47:02.212833+0000","last_clean":"2024-09-18T01:47:02.212833+0000","last_became_active":"2024-09-18T01:44:53.236990+0000","last_became_peered":"2024-09-18T01:44:53.236990+0000","last_unstale":"2024-09-18T01:47:02.212833+0000","last_undegraded":"2024-09-18T01:47:02.212833+0000","last_fullsized":"2024-09-18T01:47:02.212833+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001062627,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:50.989503+0000","last_change":"2024-09-18T01:48:50.989543+0000","last_active":"2024-09-18T01:48:50.989503+0000","last_peered":"2024-09-18T01:48:50.989503+0000","last_clean":"2024-09-18T01:48:50.989503+0000","last_became_active":"2024-09-18T01:45:04.293064+0000","last_became_peered":"2024-09-18T01:45:04.293064+0000","last_unstale":"2024-09-18T01:48:50.989503+0000","last_undegraded":"2024-09-18T01:48:50.989503+0000","last_fullsized":"2024-09-18T01:48:50.989503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:50.989373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:50.989373+0000","last_clean_scrub_stamp":"2024-09-18T01:48:50.989373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:10:23.020221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:40.269774+0000","last_change":"2024-09-18T01:48:40.269797+0000","last_active":"2024-09-18T01:48:40.269774+0000","last_peered":"2024-09-18T01:48:40.269774+0000","last_clean":"2024-09-18T01:48:40.269774+0000","last_became_active":"2024-09-18T01:45:08.292477+0000","last_became_peered":"2024-09-18T01:45:08.292477+0000","last_unstale":"2024-09-18T01:48:40.269774+0000","last_undegraded":"2024-09-18T01:48:40.269774+0000","last_fullsized":"2024-09-18T01:48:40.269774+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:40.269686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:40.269686+0000","last_clean_scrub_stamp":"2024-09-18T01:48:40.269686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:24:25.007900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'20","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:39.078548+0000","last_change":"2024-09-18T01:48:39.078586+0000","last_active":"2024-09-18T01:48:39.078548+0000","last_peered":"2024-09-18T01:48:39.078548+0000","last_clean":"2024-09-18T01:48:39.078548+0000","last_became_active":"2024-09-18T01:45:10.308018+0000","last_became_peered":"2024-09-18T01:45:10.308018+0000","last_unstale":"2024-09-18T01:48:39.078548+0000","last_undegraded":"2024-09-18T01:48:39.078548+0000","last_fullsized":"2024-09-18T01:48:39.078548+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'20","last_scrub_stamp":"2024-09-18T01:48:39.078443+0000","last_deep_scrub":"33'20","last_deep_scrub_stamp":"2024-09-18T01:48:39.078443+0000","last_clean_scrub_stamp":"2024-09-18T01:48:39.078443+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:25:17.630439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:46.034782+0000","last_change":"2024-09-18T01:48:46.034806+0000","last_active":"2024-09-18T01:48:46.034782+0000","last_peered":"2024-09-18T01:48:46.034782+0000","last_clean":"2024-09-18T01:48:46.034782+0000","last_became_active":"2024-09-18T01:45:12.315342+0000","last_became_peered":"2024-09-18T01:45:12.315342+0000","last_unstale":"2024-09-18T01:48:46.034782+0000","last_undegraded":"2024-09-18T01:48:46.034782+0000","last_fullsized":"2024-09-18T01:48:46.034782+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:46.034692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:46.034692+0000","last_clean_scrub_stamp":"2024-09-18T01:48:46.034692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:33:00.369957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"33'6","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.849836+0000","last_change":"2024-09-18T01:45:14.323182+0000","last_active":"2024-09-18T01:48:12.849836+0000","last_peered":"2024-09-18T01:48:12.849836+0000","last_clean":"2024-09-18T01:48:12.849836+0000","last_became_active":"2024-09-18T01:45:14.322568+0000","last_became_peered":"2024-09-18T01:45:14.322568+0000","last_unstale":"2024-09-18T01:48:12.849836+0000","last_undegraded":"2024-09-18T01:48:12.849836+0000","last_fullsized":"2024-09-18T01:48:12.849836+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'14","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:59.099329+0000","last_change":"2024-09-18T01:48:59.099373+0000","last_active":"2024-09-18T01:48:59.099329+0000","last_peered":"2024-09-18T01:48:59.099329+0000","last_clean":"2024-09-18T01:48:59.099329+0000","last_became_active":"2024-09-18T01:45:06.291792+0000","last_became_peered":"2024-09-18T01:45:06.291792+0000","last_unstale":"2024-09-18T01:48:59.099329+0000","last_undegraded":"2024-09-18T01:48:59.099329+0000","last_fullsized":"2024-09-18T01:48:59.099329+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-09-18T01:48:59.099213+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-09-18T01:48:59.099213+0000","last_clean_scrub_stamp":"2024-09-18T01:48:59.099213+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:58:21.348526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"31'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:59.100181+0000","last_change":"2024-09-18T01:48:59.100243+0000","last_active":"2024-09-18T01:48:59.100181+0000","last_peered":"2024-09-18T01:48:59.100181+0000","last_clean":"2024-09-18T01:48:59.100181+0000","last_became_active":"2024-09-18T01:45:04.291211+0000","last_became_peered":"2024-09-18T01:45:04.291211+0000","last_unstale":"2024-09-18T01:48:59.100181+0000","last_undegraded":"2024-09-18T01:48:59.100181+0000","last_fullsized":"2024-09-18T01:48:59.100181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-18T01:48:59.100062+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-18T01:48:59.100062+0000","last_clean_scrub_stamp":"2024-09-18T01:48:59.100062+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:37:34.895942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:02.211388+0000","last_change":"2024-09-18T01:44:55.234985+0000","last_active":"2024-09-18T01:47:02.211388+0000","last_peered":"2024-09-18T01:47:02.211388+0000","last_clean":"2024-09-18T01:47:02.211388+0000","last_became_active":"2024-09-18T01:44:53.234966+0000","last_became_peered":"2024-09-18T01:44:53.234966+0000","last_unstale":"2024-09-18T01:47:02.211388+0000","last_undegraded":"2024-09-18T01:47:02.211388+0000","last_fullsized":"2024-09-18T01:47:02.211388+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045990099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:48.358564+0000","last_change":"2024-09-18T01:48:48.358622+0000","last_active":"2024-09-18T01:48:48.358564+0000","last_peered":"2024-09-18T01:48:48.358564+0000","last_clean":"2024-09-18T01:48:48.358564+0000","last_became_active":"2024-09-18T01:45:08.286195+0000","last_became_peered":"2024-09-18T01:45:08.286195+0000","last_unstale":"2024-09-18T01:48:48.358564+0000","last_undegraded":"2024-09-18T01:48:48.358564+0000","last_fullsized":"2024-09-18T01:48:48.358564+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:48:48.358462+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:48:48.358462+0000","last_clean_scrub_stamp":"2024-09-18T01:48:48.358462+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:55:29.632161+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'87","reported_seq":175,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:31.300441+0000","last_change":"2024-09-18T01:48:31.300515+0000","last_active":"2024-09-18T01:48:31.300441+0000","last_peered":"2024-09-18T01:48:31.300441+0000","last_clean":"2024-09-18T01:48:31.300441+0000","last_became_active":"2024-09-18T01:45:10.305948+0000","last_became_peered":"2024-09-18T01:45:10.305948+0000","last_unstale":"2024-09-18T01:48:31.300441+0000","last_undegraded":"2024-09-18T01:48:31.300441+0000","last_fullsized":"2024-09-18T01:48:31.300441+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'87","last_scrub_stamp":"2024-09-18T01:48:31.300310+0000","last_deep_scrub":"33'87","last_deep_scrub_stamp":"2024-09-18T01:48:31.300310+0000","last_clean_scrub_stamp":"2024-09-18T01:48:31.300310+0000","objects_scrubbed":11,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:18:03.428377+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":89,"num_read_kb":75,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:27.838862+0000","last_change":"2024-09-18T01:48:27.838906+0000","last_active":"2024-09-18T01:48:27.838862+0000","last_peered":"2024-09-18T01:48:27.838862+0000","last_clean":"2024-09-18T01:48:27.838862+0000","last_became_active":"2024-09-18T01:45:12.311862+0000","last_became_peered":"2024-09-18T01:45:12.311862+0000","last_unstale":"2024-09-18T01:48:27.838862+0000","last_undegraded":"2024-09-18T01:48:27.838862+0000","last_fullsized":"2024-09-18T01:48:27.838862+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:27.838756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:27.838756+0000","last_clean_scrub_stamp":"2024-09-18T01:48:27.838756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:26:33.881794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'13","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:53.409197+0000","last_change":"2024-09-18T01:48:53.409223+0000","last_active":"2024-09-18T01:48:53.409197+0000","last_peered":"2024-09-18T01:48:53.409197+0000","last_clean":"2024-09-18T01:48:53.409197+0000","last_became_active":"2024-09-18T01:45:14.311403+0000","last_became_peered":"2024-09-18T01:45:14.311403+0000","last_unstale":"2024-09-18T01:48:53.409197+0000","last_undegraded":"2024-09-18T01:48:53.409197+0000","last_fullsized":"2024-09-18T01:48:53.409197+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'13","last_scrub_stamp":"2024-09-18T01:48:53.409107+0000","last_deep_scrub":"33'13","last_deep_scrub_stamp":"2024-09-18T01:48:53.409107+0000","last_clean_scrub_stamp":"2024-09-18T01:48:53.409107+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:19:19.002301+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:01.149348+0000","last_change":"2024-09-18T01:49:01.149371+0000","last_active":"2024-09-18T01:49:01.149348+0000","last_peered":"2024-09-18T01:49:01.149348+0000","last_clean":"2024-09-18T01:49:01.149348+0000","last_became_active":"2024-09-18T01:45:06.291845+0000","last_became_peered":"2024-09-18T01:45:06.291845+0000","last_unstale":"2024-09-18T01:49:01.149348+0000","last_undegraded":"2024-09-18T01:49:01.149348+0000","last_fullsized":"2024-09-18T01:49:01.149348+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:01.149256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:01.149256+0000","last_clean_scrub_stamp":"2024-09-18T01:49:01.149256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:25:39.701253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.212714+0000","last_change":"2024-09-18T01:45:04.273877+0000","last_active":"2024-09-18T01:47:12.212714+0000","last_peered":"2024-09-18T01:47:12.212714+0000","last_clean":"2024-09-18T01:47:12.212714+0000","last_became_active":"2024-09-18T01:45:04.273385+0000","last_became_peered":"2024-09-18T01:45:04.273385+0000","last_unstale":"2024-09-18T01:47:12.212714+0000","last_undegraded":"2024-09-18T01:47:12.212714+0000","last_fullsized":"2024-09-18T01:47:12.212714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:02.212954+0000","last_change":"2024-09-18T01:44:55.242318+0000","last_active":"2024-09-18T01:47:02.212954+0000","last_peered":"2024-09-18T01:47:02.212954+0000","last_clean":"2024-09-18T01:47:02.212954+0000","last_became_active":"2024-09-18T01:44:53.236927+0000","last_became_peered":"2024-09-18T01:44:53.236927+0000","last_unstale":"2024-09-18T01:47:02.212954+0000","last_undegraded":"2024-09-18T01:47:02.212954+0000","last_fullsized":"2024-09-18T01:47:02.212954+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00130324,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:24.061828+0000","last_change":"2024-09-18T01:48:24.061850+0000","last_active":"2024-09-18T01:48:24.061828+0000","last_peered":"2024-09-18T01:48:24.061828+0000","last_clean":"2024-09-18T01:48:24.061828+0000","last_became_active":"2024-09-18T01:45:08.296118+0000","last_became_peered":"2024-09-18T01:45:08.296118+0000","last_unstale":"2024-09-18T01:48:24.061828+0000","last_undegraded":"2024-09-18T01:48:24.061828+0000","last_fullsized":"2024-09-18T01:48:24.061828+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:24.061705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:24.061705+0000","last_clean_scrub_stamp":"2024-09-18T01:48:24.061705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:36:59.857585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"33'28","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:26.017200+0000","last_change":"2024-09-18T01:48:26.017268+0000","last_active":"2024-09-18T01:48:26.017200+0000","last_peered":"2024-09-18T01:48:26.017200+0000","last_clean":"2024-09-18T01:48:26.017200+0000","last_became_active":"2024-09-18T01:45:10.305932+0000","last_became_peered":"2024-09-18T01:45:10.305932+0000","last_unstale":"2024-09-18T01:48:26.017200+0000","last_undegraded":"2024-09-18T01:48:26.017200+0000","last_fullsized":"2024-09-18T01:48:26.017200+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'28","last_scrub_stamp":"2024-09-18T01:48:26.017059+0000","last_deep_scrub":"33'28","last_deep_scrub_stamp":"2024-09-18T01:48:26.017059+0000","last_clean_scrub_stamp":"2024-09-18T01:48:26.017059+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:54:30.634425+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'285","reported_seq":366,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:24.016372+0000","last_change":"2024-09-18T01:48:24.016399+0000","last_active":"2024-09-18T01:48:24.016372+0000","last_peered":"2024-09-18T01:48:24.016372+0000","last_clean":"2024-09-18T01:48:24.016372+0000","last_became_active":"2024-09-18T01:45:12.312117+0000","last_became_peered":"2024-09-18T01:45:12.312117+0000","last_unstale":"2024-09-18T01:48:24.016372+0000","last_undegraded":"2024-09-18T01:48:24.016372+0000","last_fullsized":"2024-09-18T01:48:24.016372+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-18T01:48:24.016276+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-18T01:48:24.016276+0000","last_clean_scrub_stamp":"2024-09-18T01:48:24.016276+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:28:28.633537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"33'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.875498+0000","last_change":"2024-09-18T01:45:14.322374+0000","last_active":"2024-09-18T01:48:12.875498+0000","last_peered":"2024-09-18T01:48:12.875498+0000","last_clean":"2024-09-18T01:48:12.875498+0000","last_became_active":"2024-09-18T01:45:14.322078+0000","last_became_peered":"2024-09-18T01:45:14.322078+0000","last_unstale":"2024-09-18T01:48:12.875498+0000","last_undegraded":"2024-09-18T01:48:12.875498+0000","last_fullsized":"2024-09-18T01:48:12.875498+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:36.099802+0000","last_change":"2024-09-18T01:48:36.099827+0000","last_active":"2024-09-18T01:48:36.099802+0000","last_peered":"2024-09-18T01:48:36.099802+0000","last_clean":"2024-09-18T01:48:36.099802+0000","last_became_active":"2024-09-18T01:45:06.297660+0000","last_became_peered":"2024-09-18T01:45:06.297660+0000","last_unstale":"2024-09-18T01:48:36.099802+0000","last_undegraded":"2024-09-18T01:48:36.099802+0000","last_fullsized":"2024-09-18T01:48:36.099802+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:48:36.099708+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:48:36.099708+0000","last_clean_scrub_stamp":"2024-09-18T01:48:36.099708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:13:48.036328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:17.215407+0000","last_change":"2024-09-18T01:45:04.294211+0000","last_active":"2024-09-18T01:47:17.215407+0000","last_peered":"2024-09-18T01:47:17.215407+0000","last_clean":"2024-09-18T01:47:17.215407+0000","last_became_active":"2024-09-18T01:45:04.288189+0000","last_became_peered":"2024-09-18T01:45:04.288189+0000","last_unstale":"2024-09-18T01:47:17.215407+0000","last_undegraded":"2024-09-18T01:47:17.215407+0000","last_fullsized":"2024-09-18T01:47:17.215407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:07.212083+0000","last_change":"2024-09-18T01:44:55.234985+0000","last_active":"2024-09-18T01:47:07.212083+0000","last_peered":"2024-09-18T01:47:07.212083+0000","last_clean":"2024-09-18T01:47:07.212083+0000","last_became_active":"2024-09-18T01:44:53.236812+0000","last_became_peered":"2024-09-18T01:44:53.236812+0000","last_unstale":"2024-09-18T01:47:07.212083+0000","last_undegraded":"2024-09-18T01:47:07.212083+0000","last_fullsized":"2024-09-18T01:47:07.212083+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044136000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:26.017291+0000","last_change":"2024-09-18T01:48:26.017324+0000","last_active":"2024-09-18T01:48:26.017291+0000","last_peered":"2024-09-18T01:48:26.017291+0000","last_clean":"2024-09-18T01:48:26.017291+0000","last_became_active":"2024-09-18T01:45:08.296102+0000","last_became_peered":"2024-09-18T01:45:08.296102+0000","last_unstale":"2024-09-18T01:48:26.017291+0000","last_undegraded":"2024-09-18T01:48:26.017291+0000","last_fullsized":"2024-09-18T01:48:26.017291+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:26.017211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:26.017211+0000","last_clean_scrub_stamp":"2024-09-18T01:48:26.017211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:29:58.682197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"33'22","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:52.020351+0000","last_change":"2024-09-18T01:48:52.020412+0000","last_active":"2024-09-18T01:48:52.020351+0000","last_peered":"2024-09-18T01:48:52.020351+0000","last_clean":"2024-09-18T01:48:52.020351+0000","last_became_active":"2024-09-18T01:45:10.308451+0000","last_became_peered":"2024-09-18T01:45:10.308451+0000","last_unstale":"2024-09-18T01:48:52.020351+0000","last_undegraded":"2024-09-18T01:48:52.020351+0000","last_fullsized":"2024-09-18T01:48:52.020351+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2024-09-18T01:48:52.020253+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2024-09-18T01:48:52.020253+0000","last_clean_scrub_stamp":"2024-09-18T01:48:52.020253+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:29:39.718171+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'285","reported_seq":440,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:49.394819+0000","last_change":"2024-09-18T01:48:49.394846+0000","last_active":"2024-09-18T01:48:49.394819+0000","last_peered":"2024-09-18T01:48:49.394819+0000","last_clean":"2024-09-18T01:48:49.394819+0000","last_became_active":"2024-09-18T01:45:12.313885+0000","last_became_peered":"2024-09-18T01:45:12.313885+0000","last_unstale":"2024-09-18T01:48:49.394819+0000","last_undegraded":"2024-09-18T01:48:49.394819+0000","last_fullsized":"2024-09-18T01:48:49.394819+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-18T01:48:49.394735+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-18T01:48:49.394735+0000","last_clean_scrub_stamp":"2024-09-18T01:48:49.394735+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:09:02.112570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"33'7","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:42.846796+0000","last_change":"2024-09-18T01:48:42.846821+0000","last_active":"2024-09-18T01:48:42.846796+0000","last_peered":"2024-09-18T01:48:42.846796+0000","last_clean":"2024-09-18T01:48:42.846796+0000","last_became_active":"2024-09-18T01:45:14.317241+0000","last_became_peered":"2024-09-18T01:45:14.317241+0000","last_unstale":"2024-09-18T01:48:42.846796+0000","last_undegraded":"2024-09-18T01:48:42.846796+0000","last_fullsized":"2024-09-18T01:48:42.846796+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-09-18T01:48:42.846695+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-09-18T01:48:42.846695+0000","last_clean_scrub_stamp":"2024-09-18T01:48:42.846695+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:24:27.584908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"33'8","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:58.082245+0000","last_change":"2024-09-18T01:48:58.082270+0000","last_active":"2024-09-18T01:48:58.082245+0000","last_peered":"2024-09-18T01:48:58.082245+0000","last_clean":"2024-09-18T01:48:58.082245+0000","last_became_active":"2024-09-18T01:45:06.285656+0000","last_became_peered":"2024-09-18T01:45:06.285656+0000","last_unstale":"2024-09-18T01:48:58.082245+0000","last_undegraded":"2024-09-18T01:48:58.082245+0000","last_fullsized":"2024-09-18T01:48:58.082245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-18T01:48:58.082155+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-18T01:48:58.082155+0000","last_clean_scrub_stamp":"2024-09-18T01:48:58.082155+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:12:50.018176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:17.215186+0000","last_change":"2024-09-18T01:45:04.290881+0000","last_active":"2024-09-18T01:47:17.215186+0000","last_peered":"2024-09-18T01:47:17.215186+0000","last_clean":"2024-09-18T01:47:17.215186+0000","last_became_active":"2024-09-18T01:45:04.290480+0000","last_became_peered":"2024-09-18T01:45:04.290480+0000","last_unstale":"2024-09-18T01:47:17.215186+0000","last_undegraded":"2024-09-18T01:47:17.215186+0000","last_fullsized":"2024-09-18T01:47:17.215186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:07.213812+0000","last_change":"2024-09-18T01:44:55.241531+0000","last_active":"2024-09-18T01:47:07.213812+0000","last_peered":"2024-09-18T01:47:07.213812+0000","last_clean":"2024-09-18T01:47:07.213812+0000","last_became_active":"2024-09-18T01:44:53.298677+0000","last_became_peered":"2024-09-18T01:44:53.298677+0000","last_unstale":"2024-09-18T01:47:07.213812+0000","last_undegraded":"2024-09-18T01:47:07.213812+0000","last_fullsized":"2024-09-18T01:47:07.213812+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052495500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:33.060079+0000","last_change":"2024-09-18T01:48:33.060133+0000","last_active":"2024-09-18T01:48:33.060079+0000","last_peered":"2024-09-18T01:48:33.060079+0000","last_clean":"2024-09-18T01:48:33.060079+0000","last_became_active":"2024-09-18T01:45:08.291696+0000","last_became_peered":"2024-09-18T01:45:08.291696+0000","last_unstale":"2024-09-18T01:48:33.060079+0000","last_undegraded":"2024-09-18T01:48:33.060079+0000","last_fullsized":"2024-09-18T01:48:33.060079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:33.059961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:33.059961+0000","last_clean_scrub_stamp":"2024-09-18T01:48:33.059961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:23:09.745291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'103","reported_seq":202,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:28.839003+0000","last_change":"2024-09-18T01:48:28.839049+0000","last_active":"2024-09-18T01:48:28.839003+0000","last_peered":"2024-09-18T01:48:28.839003+0000","last_clean":"2024-09-18T01:48:28.839003+0000","last_became_active":"2024-09-18T01:45:10.304662+0000","last_became_peered":"2024-09-18T01:45:10.304662+0000","last_unstale":"2024-09-18T01:48:28.839003+0000","last_undegraded":"2024-09-18T01:48:28.839003+0000","last_fullsized":"2024-09-18T01:48:28.839003+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'103","last_scrub_stamp":"2024-09-18T01:48:28.838915+0000","last_deep_scrub":"33'103","last_deep_scrub_stamp":"2024-09-18T01:48:28.838915+0000","last_clean_scrub_stamp":"2024-09-18T01:48:28.838915+0000","objects_scrubbed":9,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:19:33.132645+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":87,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:23.263295+0000","last_change":"2024-09-18T01:48:23.263316+0000","last_active":"2024-09-18T01:48:23.263295+0000","last_peered":"2024-09-18T01:48:23.263295+0000","last_clean":"2024-09-18T01:48:23.263295+0000","last_became_active":"2024-09-18T01:45:12.311399+0000","last_became_peered":"2024-09-18T01:45:12.311399+0000","last_unstale":"2024-09-18T01:48:23.263295+0000","last_undegraded":"2024-09-18T01:48:23.263295+0000","last_fullsized":"2024-09-18T01:48:23.263295+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:23.263202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:23.263202+0000","last_clean_scrub_stamp":"2024-09-18T01:48:23.263202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:54:27.880569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:32.218110+0000","last_change":"2024-09-18T01:45:14.315545+0000","last_active":"2024-09-18T01:47:32.218110+0000","last_peered":"2024-09-18T01:47:32.218110+0000","last_clean":"2024-09-18T01:47:32.218110+0000","last_became_active":"2024-09-18T01:45:14.314587+0000","last_became_peered":"2024-09-18T01:45:14.314587+0000","last_unstale":"2024-09-18T01:47:32.218110+0000","last_undegraded":"2024-09-18T01:47:32.218110+0000","last_fullsized":"2024-09-18T01:47:32.218110+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"31'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:22.216103+0000","last_change":"2024-09-18T01:45:14.326309+0000","last_active":"2024-09-18T01:47:22.216103+0000","last_peered":"2024-09-18T01:47:22.216103+0000","last_clean":"2024-09-18T01:47:22.216103+0000","last_became_active":"2024-09-18T01:45:14.326051+0000","last_became_peered":"2024-09-18T01:45:14.326051+0000","last_unstale":"2024-09-18T01:47:22.216103+0000","last_undegraded":"2024-09-18T01:47:22.216103+0000","last_fullsized":"2024-09-18T01:47:22.216103+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"33'8","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:52.038813+0000","last_change":"2024-09-18T01:48:52.038841+0000","last_active":"2024-09-18T01:48:52.038813+0000","last_peered":"2024-09-18T01:48:52.038813+0000","last_clean":"2024-09-18T01:48:52.038813+0000","last_became_active":"2024-09-18T01:45:06.283912+0000","last_became_peered":"2024-09-18T01:45:06.283912+0000","last_unstale":"2024-09-18T01:48:52.038813+0000","last_undegraded":"2024-09-18T01:48:52.038813+0000","last_fullsized":"2024-09-18T01:48:52.038813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-18T01:48:52.038726+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-18T01:48:52.038726+0000","last_clean_scrub_stamp":"2024-09-18T01:48:52.038726+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:42:35.286481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:27.217141+0000","last_change":"2024-09-18T01:45:04.289644+0000","last_active":"2024-09-18T01:47:27.217141+0000","last_peered":"2024-09-18T01:47:27.217141+0000","last_clean":"2024-09-18T01:47:27.217141+0000","last_became_active":"2024-09-18T01:45:04.285647+0000","last_became_peered":"2024-09-18T01:45:04.285647+0000","last_unstale":"2024-09-18T01:47:27.217141+0000","last_undegraded":"2024-09-18T01:47:27.217141+0000","last_fullsized":"2024-09-18T01:47:27.217141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:32.217992+0000","last_change":"2024-09-18T01:45:41.340307+0000","last_active":"2024-09-18T01:47:32.217992+0000","last_peered":"2024-09-18T01:47:32.217992+0000","last_clean":"2024-09-18T01:47:32.217992+0000","last_became_active":"2024-09-18T01:45:41.339936+0000","last_became_peered":"2024-09-18T01:45:41.339936+0000","last_unstale":"2024-09-18T01:47:32.217992+0000","last_undegraded":"2024-09-18T01:47:32.217992+0000","last_fullsized":"2024-09-18T01:47:32.217992+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'46","reported_seq":108,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:37.085340+0000","last_change":"2024-09-18T01:48:37.085399+0000","last_active":"2024-09-18T01:48:37.085340+0000","last_peered":"2024-09-18T01:48:37.085340+0000","last_clean":"2024-09-18T01:48:37.085340+0000","last_became_active":"2024-09-18T01:45:10.307670+0000","last_became_peered":"2024-09-18T01:45:10.307670+0000","last_unstale":"2024-09-18T01:48:37.085340+0000","last_undegraded":"2024-09-18T01:48:37.085340+0000","last_fullsized":"2024-09-18T01:48:37.085340+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'46","last_scrub_stamp":"2024-09-18T01:48:37.085236+0000","last_deep_scrub":"33'46","last_deep_scrub_stamp":"2024-09-18T01:48:37.085236+0000","last_clean_scrub_stamp":"2024-09-18T01:48:37.085236+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:57:59.334548+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:51.057246+0000","last_change":"2024-09-18T01:48:51.057271+0000","last_active":"2024-09-18T01:48:51.057246+0000","last_peered":"2024-09-18T01:48:51.057246+0000","last_clean":"2024-09-18T01:48:51.057246+0000","last_became_active":"2024-09-18T01:45:12.316192+0000","last_became_peered":"2024-09-18T01:45:12.316192+0000","last_unstale":"2024-09-18T01:48:51.057246+0000","last_undegraded":"2024-09-18T01:48:51.057246+0000","last_fullsized":"2024-09-18T01:48:51.057246+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:51.057141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:51.057141+0000","last_clean_scrub_stamp":"2024-09-18T01:48:51.057141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:10:20.432939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"33'5","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.664141+0000","last_change":"2024-09-18T01:45:14.312071+0000","last_active":"2024-09-18T01:48:12.664141+0000","last_peered":"2024-09-18T01:48:12.664141+0000","last_clean":"2024-09-18T01:48:12.664141+0000","last_became_active":"2024-09-18T01:45:14.311776+0000","last_became_peered":"2024-09-18T01:45:14.311776+0000","last_unstale":"2024-09-18T01:48:12.664141+0000","last_undegraded":"2024-09-18T01:48:12.664141+0000","last_fullsized":"2024-09-18T01:48:12.664141+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'8","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:57.040683+0000","last_change":"2024-09-18T01:48:57.040711+0000","last_active":"2024-09-18T01:48:57.040683+0000","last_peered":"2024-09-18T01:48:57.040683+0000","last_clean":"2024-09-18T01:48:57.040683+0000","last_became_active":"2024-09-18T01:45:06.291811+0000","last_became_peered":"2024-09-18T01:45:06.291811+0000","last_unstale":"2024-09-18T01:48:57.040683+0000","last_undegraded":"2024-09-18T01:48:57.040683+0000","last_fullsized":"2024-09-18T01:48:57.040683+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-18T01:48:57.040600+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-18T01:48:57.040600+0000","last_clean_scrub_stamp":"2024-09-18T01:48:57.040600+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:54:42.318745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:32.218083+0000","last_change":"2024-09-18T01:45:04.289933+0000","last_active":"2024-09-18T01:47:32.218083+0000","last_peered":"2024-09-18T01:47:32.218083+0000","last_clean":"2024-09-18T01:47:32.218083+0000","last_became_active":"2024-09-18T01:45:04.289655+0000","last_became_peered":"2024-09-18T01:45:04.289655+0000","last_unstale":"2024-09-18T01:47:32.218083+0000","last_undegraded":"2024-09-18T01:47:32.218083+0000","last_fullsized":"2024-09-18T01:47:32.218083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:32.218085+0000","last_change":"2024-09-18T01:45:41.342483+0000","last_active":"2024-09-18T01:47:32.218085+0000","last_peered":"2024-09-18T01:47:32.218085+0000","last_clean":"2024-09-18T01:47:32.218085+0000","last_became_active":"2024-09-18T01:45:41.342149+0000","last_became_peered":"2024-09-18T01:45:41.342149+0000","last_unstale":"2024-09-18T01:47:32.218085+0000","last_undegraded":"2024-09-18T01:47:32.218085+0000","last_fullsized":"2024-09-18T01:47:32.218085+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'8","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:36.330207+0000","last_change":"2024-09-18T01:48:36.330239+0000","last_active":"2024-09-18T01:48:36.330207+0000","last_peered":"2024-09-18T01:48:36.330207+0000","last_clean":"2024-09-18T01:48:36.330207+0000","last_became_active":"2024-09-18T01:45:10.296387+0000","last_became_peered":"2024-09-18T01:45:10.296387+0000","last_unstale":"2024-09-18T01:48:36.330207+0000","last_undegraded":"2024-09-18T01:48:36.330207+0000","last_fullsized":"2024-09-18T01:48:36.330207+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-18T01:48:36.330117+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-18T01:48:36.330117+0000","last_clean_scrub_stamp":"2024-09-18T01:48:36.330117+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:18:02.338887+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:35.876388+0000","last_change":"2024-09-18T01:48:35.876410+0000","last_active":"2024-09-18T01:48:35.876388+0000","last_peered":"2024-09-18T01:48:35.876388+0000","last_clean":"2024-09-18T01:48:35.876388+0000","last_became_active":"2024-09-18T01:45:12.313159+0000","last_became_peered":"2024-09-18T01:45:12.313159+0000","last_unstale":"2024-09-18T01:48:35.876388+0000","last_undegraded":"2024-09-18T01:48:35.876388+0000","last_fullsized":"2024-09-18T01:48:35.876388+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:35.876295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:35.876295+0000","last_clean_scrub_stamp":"2024-09-18T01:48:35.876295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:09:42.402630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:47.218043+0000","last_change":"2024-09-18T01:45:14.319376+0000","last_active":"2024-09-18T01:47:47.218043+0000","last_peered":"2024-09-18T01:47:47.218043+0000","last_clean":"2024-09-18T01:47:47.218043+0000","last_became_active":"2024-09-18T01:45:14.319073+0000","last_became_peered":"2024-09-18T01:45:14.319073+0000","last_unstale":"2024-09-18T01:47:47.218043+0000","last_undegraded":"2024-09-18T01:47:47.218043+0000","last_fullsized":"2024-09-18T01:47:47.218043+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'6","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:55.348662+0000","last_change":"2024-09-18T01:48:55.348701+0000","last_active":"2024-09-18T01:48:55.348662+0000","last_peered":"2024-09-18T01:48:55.348662+0000","last_clean":"2024-09-18T01:48:55.348662+0000","last_became_active":"2024-09-18T01:45:06.276408+0000","last_became_peered":"2024-09-18T01:45:06.276408+0000","last_unstale":"2024-09-18T01:48:55.348662+0000","last_undegraded":"2024-09-18T01:48:55.348662+0000","last_fullsized":"2024-09-18T01:48:55.348662+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-18T01:48:55.348539+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-18T01:48:55.348539+0000","last_clean_scrub_stamp":"2024-09-18T01:48:55.348539+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:08:52.491981+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"33'6","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.791435+0000","last_change":"2024-09-18T01:45:04.287172+0000","last_active":"2024-09-18T01:48:12.791435+0000","last_peered":"2024-09-18T01:48:12.791435+0000","last_clean":"2024-09-18T01:48:12.791435+0000","last_became_active":"2024-09-18T01:45:04.286887+0000","last_became_peered":"2024-09-18T01:45:04.286887+0000","last_unstale":"2024-09-18T01:48:12.791435+0000","last_undegraded":"2024-09-18T01:48:12.791435+0000","last_fullsized":"2024-09-18T01:48:12.791435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:37.881629+0000","last_change":"2024-09-18T01:48:37.881673+0000","last_active":"2024-09-18T01:48:37.881629+0000","last_peered":"2024-09-18T01:48:37.881629+0000","last_clean":"2024-09-18T01:48:37.881629+0000","last_became_active":"2024-09-18T01:45:08.291575+0000","last_became_peered":"2024-09-18T01:45:08.291575+0000","last_unstale":"2024-09-18T01:48:37.881629+0000","last_undegraded":"2024-09-18T01:48:37.881629+0000","last_fullsized":"2024-09-18T01:48:37.881629+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:37.881519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:37.881519+0000","last_clean_scrub_stamp":"2024-09-18T01:48:37.881519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:48:21.895224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'47","reported_seq":119,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:34.322285+0000","last_change":"2024-09-18T01:48:34.322343+0000","last_active":"2024-09-18T01:48:34.322285+0000","last_peered":"2024-09-18T01:48:34.322285+0000","last_clean":"2024-09-18T01:48:34.322285+0000","last_became_active":"2024-09-18T01:45:10.297904+0000","last_became_peered":"2024-09-18T01:45:10.297904+0000","last_unstale":"2024-09-18T01:48:34.322285+0000","last_undegraded":"2024-09-18T01:48:34.322285+0000","last_fullsized":"2024-09-18T01:48:34.322285+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'47","last_scrub_stamp":"2024-09-18T01:48:34.322182+0000","last_deep_scrub":"33'47","last_deep_scrub_stamp":"2024-09-18T01:48:34.322182+0000","last_clean_scrub_stamp":"2024-09-18T01:48:34.322182+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:23:05.910626+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:23.035826+0000","last_change":"2024-09-18T01:48:23.035896+0000","last_active":"2024-09-18T01:48:23.035826+0000","last_peered":"2024-09-18T01:48:23.035826+0000","last_clean":"2024-09-18T01:48:23.035826+0000","last_became_active":"2024-09-18T01:45:12.313186+0000","last_became_peered":"2024-09-18T01:45:12.313186+0000","last_unstale":"2024-09-18T01:48:23.035826+0000","last_undegraded":"2024-09-18T01:48:23.035826+0000","last_fullsized":"2024-09-18T01:48:23.035826+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:23.035704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:23.035704+0000","last_clean_scrub_stamp":"2024-09-18T01:48:23.035704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:54:29.422521+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:47.220828+0000","last_change":"2024-09-18T01:45:14.326931+0000","last_active":"2024-09-18T01:47:47.220828+0000","last_peered":"2024-09-18T01:47:47.220828+0000","last_clean":"2024-09-18T01:47:47.220828+0000","last_became_active":"2024-09-18T01:45:14.326668+0000","last_became_peered":"2024-09-18T01:45:14.326668+0000","last_unstale":"2024-09-18T01:47:47.220828+0000","last_undegraded":"2024-09-18T01:47:47.220828+0000","last_fullsized":"2024-09-18T01:47:47.220828+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'18","reported_seq":104,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:40.058439+0000","last_change":"2024-09-18T01:48:40.058472+0000","last_active":"2024-09-18T01:48:40.058439+0000","last_peered":"2024-09-18T01:48:40.058439+0000","last_clean":"2024-09-18T01:48:40.058439+0000","last_became_active":"2024-09-18T01:45:06.297220+0000","last_became_peered":"2024-09-18T01:45:06.297220+0000","last_unstale":"2024-09-18T01:48:40.058439+0000","last_undegraded":"2024-09-18T01:48:40.058439+0000","last_fullsized":"2024-09-18T01:48:40.058439+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'18","last_scrub_stamp":"2024-09-18T01:48:40.058351+0000","last_deep_scrub":"33'18","last_deep_scrub_stamp":"2024-09-18T01:48:40.058351+0000","last_clean_scrub_stamp":"2024-09-18T01:48:40.058351+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:54:41.006349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":76,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:32.218146+0000","last_change":"2024-09-18T01:45:04.283606+0000","last_active":"2024-09-18T01:47:32.218146+0000","last_peered":"2024-09-18T01:47:32.218146+0000","last_clean":"2024-09-18T01:47:32.218146+0000","last_became_active":"2024-09-18T01:45:04.283276+0000","last_became_peered":"2024-09-18T01:45:04.283276+0000","last_unstale":"2024-09-18T01:47:32.218146+0000","last_undegraded":"2024-09-18T01:47:32.218146+0000","last_fullsized":"2024-09-18T01:47:32.218146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:34.100552+0000","last_change":"2024-09-18T01:48:34.100576+0000","last_active":"2024-09-18T01:48:34.100552+0000","last_peered":"2024-09-18T01:48:34.100552+0000","last_clean":"2024-09-18T01:48:34.100552+0000","last_became_active":"2024-09-18T01:45:08.290911+0000","last_became_peered":"2024-09-18T01:45:08.290911+0000","last_unstale":"2024-09-18T01:48:34.100552+0000","last_undegraded":"2024-09-18T01:48:34.100552+0000","last_fullsized":"2024-09-18T01:48:34.100552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:34.100451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:34.100451+0000","last_clean_scrub_stamp":"2024-09-18T01:48:34.100451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:18:59.693645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'36","reported_seq":91,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:30.819537+0000","last_change":"2024-09-18T01:48:30.819572+0000","last_active":"2024-09-18T01:48:30.819537+0000","last_peered":"2024-09-18T01:48:30.819537+0000","last_clean":"2024-09-18T01:48:30.819537+0000","last_became_active":"2024-09-18T01:45:10.301622+0000","last_became_peered":"2024-09-18T01:45:10.301622+0000","last_unstale":"2024-09-18T01:48:30.819537+0000","last_undegraded":"2024-09-18T01:48:30.819537+0000","last_fullsized":"2024-09-18T01:48:30.819537+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'36","last_scrub_stamp":"2024-09-18T01:48:30.819448+0000","last_deep_scrub":"33'36","last_deep_scrub_stamp":"2024-09-18T01:48:30.819448+0000","last_clean_scrub_stamp":"2024-09-18T01:48:30.819448+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:02:48.244921+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:31.837156+0000","last_change":"2024-09-18T01:48:31.837196+0000","last_active":"2024-09-18T01:48:31.837156+0000","last_peered":"2024-09-18T01:48:31.837156+0000","last_clean":"2024-09-18T01:48:31.837156+0000","last_became_active":"2024-09-18T01:45:12.313096+0000","last_became_peered":"2024-09-18T01:45:12.313096+0000","last_unstale":"2024-09-18T01:48:31.837156+0000","last_undegraded":"2024-09-18T01:48:31.837156+0000","last_fullsized":"2024-09-18T01:48:31.837156+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:31.837028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:31.837028+0000","last_clean_scrub_stamp":"2024-09-18T01:48:31.837028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:55:19.988045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"33'12","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.879667+0000","last_change":"2024-09-18T01:45:06.282718+0000","last_active":"2024-09-18T01:48:12.879667+0000","last_peered":"2024-09-18T01:48:12.879667+0000","last_clean":"2024-09-18T01:48:12.879667+0000","last_became_active":"2024-09-18T01:45:06.282461+0000","last_became_peered":"2024-09-18T01:45:06.282461+0000","last_unstale":"2024-09-18T01:48:12.879667+0000","last_undegraded":"2024-09-18T01:48:12.879667+0000","last_fullsized":"2024-09-18T01:48:12.879667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"33'8","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.542077+0000","last_change":"2024-09-18T01:45:04.293367+0000","last_active":"2024-09-18T01:48:12.542077+0000","last_peered":"2024-09-18T01:48:12.542077+0000","last_clean":"2024-09-18T01:48:12.542077+0000","last_became_active":"2024-09-18T01:45:04.288082+0000","last_became_peered":"2024-09-18T01:45:04.288082+0000","last_unstale":"2024-09-18T01:48:12.542077+0000","last_undegraded":"2024-09-18T01:48:12.542077+0000","last_fullsized":"2024-09-18T01:48:12.542077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":48,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:39.315823+0000","last_change":"2024-09-18T01:48:39.315849+0000","last_active":"2024-09-18T01:48:39.315823+0000","last_peered":"2024-09-18T01:48:39.315823+0000","last_clean":"2024-09-18T01:48:39.315823+0000","last_became_active":"2024-09-18T01:45:08.292739+0000","last_became_peered":"2024-09-18T01:45:08.292739+0000","last_unstale":"2024-09-18T01:48:39.315823+0000","last_undegraded":"2024-09-18T01:48:39.315823+0000","last_fullsized":"2024-09-18T01:48:39.315823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:39.315733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:39.315733+0000","last_clean_scrub_stamp":"2024-09-18T01:48:39.315733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:28:18.241750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'70","reported_seq":149,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:35.355474+0000","last_change":"2024-09-18T01:48:35.355511+0000","last_active":"2024-09-18T01:48:35.355474+0000","last_peered":"2024-09-18T01:48:35.355474+0000","last_clean":"2024-09-18T01:48:35.355474+0000","last_became_active":"2024-09-18T01:45:10.296396+0000","last_became_peered":"2024-09-18T01:45:10.296396+0000","last_unstale":"2024-09-18T01:48:35.355474+0000","last_undegraded":"2024-09-18T01:48:35.355474+0000","last_fullsized":"2024-09-18T01:48:35.355474+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'70","last_scrub_stamp":"2024-09-18T01:48:35.355370+0000","last_deep_scrub":"33'70","last_deep_scrub_stamp":"2024-09-18T01:48:35.355370+0000","last_clean_scrub_stamp":"2024-09-18T01:48:35.355370+0000","objects_scrubbed":6,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:18:17.350454+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:23.816836+0000","last_change":"2024-09-18T01:48:23.816862+0000","last_active":"2024-09-18T01:48:23.816836+0000","last_peered":"2024-09-18T01:48:23.816836+0000","last_clean":"2024-09-18T01:48:23.816836+0000","last_became_active":"2024-09-18T01:45:12.307279+0000","last_became_peered":"2024-09-18T01:45:12.307279+0000","last_unstale":"2024-09-18T01:48:23.816836+0000","last_undegraded":"2024-09-18T01:48:23.816836+0000","last_fullsized":"2024-09-18T01:48:23.816836+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:23.816708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:23.816708+0000","last_clean_scrub_stamp":"2024-09-18T01:48:23.816708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:52:57.423754+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'22","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:37.216352+0000","last_change":"2024-09-18T01:45:14.320125+0000","last_active":"2024-09-18T01:47:37.216352+0000","last_peered":"2024-09-18T01:47:37.216352+0000","last_clean":"2024-09-18T01:47:37.216352+0000","last_became_active":"2024-09-18T01:45:14.319540+0000","last_became_peered":"2024-09-18T01:45:14.319540+0000","last_unstale":"2024-09-18T01:47:37.216352+0000","last_undegraded":"2024-09-18T01:47:37.216352+0000","last_fullsized":"2024-09-18T01:47:37.216352+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":65,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'18","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:52.432375+0000","last_change":"2024-09-18T01:48:52.432402+0000","last_active":"2024-09-18T01:48:52.432375+0000","last_peered":"2024-09-18T01:48:52.432375+0000","last_clean":"2024-09-18T01:48:52.432375+0000","last_became_active":"2024-09-18T01:45:06.293053+0000","last_became_peered":"2024-09-18T01:45:06.293053+0000","last_unstale":"2024-09-18T01:48:52.432375+0000","last_undegraded":"2024-09-18T01:48:52.432375+0000","last_fullsized":"2024-09-18T01:48:52.432375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'18","last_scrub_stamp":"2024-09-18T01:48:52.432288+0000","last_deep_scrub":"33'18","last_deep_scrub_stamp":"2024-09-18T01:48:52.432288+0000","last_clean_scrub_stamp":"2024-09-18T01:48:52.432288+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:28:25.986612+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":45,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:32.217904+0000","last_change":"2024-09-18T01:45:04.292562+0000","last_active":"2024-09-18T01:47:32.217904+0000","last_peered":"2024-09-18T01:47:32.217904+0000","last_clean":"2024-09-18T01:47:32.217904+0000","last_became_active":"2024-09-18T01:45:04.292082+0000","last_became_peered":"2024-09-18T01:45:04.292082+0000","last_unstale":"2024-09-18T01:47:32.217904+0000","last_undegraded":"2024-09-18T01:47:32.217904+0000","last_fullsized":"2024-09-18T01:47:32.217904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:38.882271+0000","last_change":"2024-09-18T01:48:38.882296+0000","last_active":"2024-09-18T01:48:38.882271+0000","last_peered":"2024-09-18T01:48:38.882271+0000","last_clean":"2024-09-18T01:48:38.882271+0000","last_became_active":"2024-09-18T01:45:08.286609+0000","last_became_peered":"2024-09-18T01:45:08.286609+0000","last_unstale":"2024-09-18T01:48:38.882271+0000","last_undegraded":"2024-09-18T01:48:38.882271+0000","last_fullsized":"2024-09-18T01:48:38.882271+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:38.882174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:38.882174+0000","last_clean_scrub_stamp":"2024-09-18T01:48:38.882174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:30:42.400285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'46","reported_seq":104,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:50.033208+0000","last_change":"2024-09-18T01:48:50.033254+0000","last_active":"2024-09-18T01:48:50.033208+0000","last_peered":"2024-09-18T01:48:50.033208+0000","last_clean":"2024-09-18T01:48:50.033208+0000","last_became_active":"2024-09-18T01:45:10.309360+0000","last_became_peered":"2024-09-18T01:45:10.309360+0000","last_unstale":"2024-09-18T01:48:50.033208+0000","last_undegraded":"2024-09-18T01:48:50.033208+0000","last_fullsized":"2024-09-18T01:48:50.033208+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'46","last_scrub_stamp":"2024-09-18T01:48:50.033115+0000","last_deep_scrub":"33'46","last_deep_scrub_stamp":"2024-09-18T01:48:50.033115+0000","last_clean_scrub_stamp":"2024-09-18T01:48:50.033115+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:38:37.562652+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:30.911520+0000","last_change":"2024-09-18T01:48:30.911546+0000","last_active":"2024-09-18T01:48:30.911520+0000","last_peered":"2024-09-18T01:48:30.911520+0000","last_clean":"2024-09-18T01:48:30.911520+0000","last_became_active":"2024-09-18T01:45:12.314499+0000","last_became_peered":"2024-09-18T01:45:12.314499+0000","last_unstale":"2024-09-18T01:48:30.911520+0000","last_undegraded":"2024-09-18T01:48:30.911520+0000","last_fullsized":"2024-09-18T01:48:30.911520+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:30.911422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:30.911422+0000","last_clean_scrub_stamp":"2024-09-18T01:48:30.911422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:07:15.930276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"33'2","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:37.219002+0000","last_change":"2024-09-18T01:45:14.326163+0000","last_active":"2024-09-18T01:47:37.219002+0000","last_peered":"2024-09-18T01:47:37.219002+0000","last_clean":"2024-09-18T01:47:37.219002+0000","last_became_active":"2024-09-18T01:45:14.325421+0000","last_became_peered":"2024-09-18T01:45:14.325421+0000","last_unstale":"2024-09-18T01:47:37.219002+0000","last_undegraded":"2024-09-18T01:47:37.219002+0000","last_fullsized":"2024-09-18T01:47:37.219002+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'8","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:56.955755+0000","last_change":"2024-09-18T01:48:56.955784+0000","last_active":"2024-09-18T01:48:56.955755+0000","last_peered":"2024-09-18T01:48:56.955755+0000","last_clean":"2024-09-18T01:48:56.955755+0000","last_became_active":"2024-09-18T01:45:06.286153+0000","last_became_peered":"2024-09-18T01:45:06.286153+0000","last_unstale":"2024-09-18T01:48:56.955755+0000","last_undegraded":"2024-09-18T01:48:56.955755+0000","last_fullsized":"2024-09-18T01:48:56.955755+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-18T01:48:56.955654+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-18T01:48:56.955654+0000","last_clean_scrub_stamp":"2024-09-18T01:48:56.955654+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:13:59.028876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:37.219045+0000","last_change":"2024-09-18T01:45:04.295250+0000","last_active":"2024-09-18T01:47:37.219045+0000","last_peered":"2024-09-18T01:47:37.219045+0000","last_clean":"2024-09-18T01:47:37.219045+0000","last_became_active":"2024-09-18T01:45:04.294537+0000","last_became_peered":"2024-09-18T01:45:04.294537+0000","last_unstale":"2024-09-18T01:47:37.219045+0000","last_undegraded":"2024-09-18T01:47:37.219045+0000","last_fullsized":"2024-09-18T01:47:37.219045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:40.973877+0000","last_change":"2024-09-18T01:48:40.973902+0000","last_active":"2024-09-18T01:48:40.973877+0000","last_peered":"2024-09-18T01:48:40.973877+0000","last_clean":"2024-09-18T01:48:40.973877+0000","last_became_active":"2024-09-18T01:45:08.286466+0000","last_became_peered":"2024-09-18T01:45:08.286466+0000","last_unstale":"2024-09-18T01:48:40.973877+0000","last_undegraded":"2024-09-18T01:48:40.973877+0000","last_fullsized":"2024-09-18T01:48:40.973877+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:40.973787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:40.973787+0000","last_clean_scrub_stamp":"2024-09-18T01:48:40.973787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:56:31.069811+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'48","reported_seq":110,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:32.347306+0000","last_change":"2024-09-18T01:48:32.347342+0000","last_active":"2024-09-18T01:48:32.347306+0000","last_peered":"2024-09-18T01:48:32.347306+0000","last_clean":"2024-09-18T01:48:32.347306+0000","last_became_active":"2024-09-18T01:45:10.303911+0000","last_became_peered":"2024-09-18T01:45:10.303911+0000","last_unstale":"2024-09-18T01:48:32.347306+0000","last_undegraded":"2024-09-18T01:48:32.347306+0000","last_fullsized":"2024-09-18T01:48:32.347306+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'48","last_scrub_stamp":"2024-09-18T01:48:32.347225+0000","last_deep_scrub":"33'48","last_deep_scrub_stamp":"2024-09-18T01:48:32.347225+0000","last_clean_scrub_stamp":"2024-09-18T01:48:32.347225+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:04:17.415601+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:37.329010+0000","last_change":"2024-09-18T01:48:37.329031+0000","last_active":"2024-09-18T01:48:37.329010+0000","last_peered":"2024-09-18T01:48:37.329010+0000","last_clean":"2024-09-18T01:48:37.329010+0000","last_became_active":"2024-09-18T01:45:12.313180+0000","last_became_peered":"2024-09-18T01:45:12.313180+0000","last_unstale":"2024-09-18T01:48:37.329010+0000","last_undegraded":"2024-09-18T01:48:37.329010+0000","last_fullsized":"2024-09-18T01:48:37.329010+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:37.328895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:37.328895+0000","last_clean_scrub_stamp":"2024-09-18T01:48:37.328895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:52:12.877855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"33'3","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:37.218959+0000","last_change":"2024-09-18T01:45:14.326771+0000","last_active":"2024-09-18T01:47:37.218959+0000","last_peered":"2024-09-18T01:47:37.218959+0000","last_clean":"2024-09-18T01:47:37.218959+0000","last_became_active":"2024-09-18T01:45:14.326452+0000","last_became_peered":"2024-09-18T01:45:14.326452+0000","last_unstale":"2024-09-18T01:47:37.218959+0000","last_undegraded":"2024-09-18T01:47:37.218959+0000","last_fullsized":"2024-09-18T01:47:37.218959+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:01.377573+0000","last_change":"2024-09-18T01:49:01.377628+0000","last_active":"2024-09-18T01:49:01.377573+0000","last_peered":"2024-09-18T01:49:01.377573+0000","last_clean":"2024-09-18T01:49:01.377573+0000","last_became_active":"2024-09-18T01:45:06.281987+0000","last_became_peered":"2024-09-18T01:45:06.281987+0000","last_unstale":"2024-09-18T01:49:01.377573+0000","last_undegraded":"2024-09-18T01:49:01.377573+0000","last_fullsized":"2024-09-18T01:49:01.377573+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:01.377468+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:01.377468+0000","last_clean_scrub_stamp":"2024-09-18T01:49:01.377468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:37:31.352529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.489501+0000","last_change":"2024-09-18T01:45:04.290235+0000","last_active":"2024-09-18T01:48:19.489501+0000","last_peered":"2024-09-18T01:48:19.489501+0000","last_clean":"2024-09-18T01:48:19.489501+0000","last_became_active":"2024-09-18T01:45:04.289909+0000","last_became_peered":"2024-09-18T01:45:04.289909+0000","last_unstale":"2024-09-18T01:48:19.489501+0000","last_undegraded":"2024-09-18T01:48:19.489501+0000","last_fullsized":"2024-09-18T01:48:19.489501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:42.220069+0000","last_change":"2024-09-18T01:45:41.342634+0000","last_active":"2024-09-18T01:47:42.220069+0000","last_peered":"2024-09-18T01:47:42.220069+0000","last_clean":"2024-09-18T01:47:42.220069+0000","last_became_active":"2024-09-18T01:45:41.342280+0000","last_became_peered":"2024-09-18T01:45:41.342280+0000","last_unstale":"2024-09-18T01:47:42.220069+0000","last_undegraded":"2024-09-18T01:47:42.220069+0000","last_fullsized":"2024-09-18T01:47:42.220069+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'22","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:53.997351+0000","last_change":"2024-09-18T01:48:53.997424+0000","last_active":"2024-09-18T01:48:53.997351+0000","last_peered":"2024-09-18T01:48:53.997351+0000","last_clean":"2024-09-18T01:48:53.997351+0000","last_became_active":"2024-09-18T01:45:10.308524+0000","last_became_peered":"2024-09-18T01:45:10.308524+0000","last_unstale":"2024-09-18T01:48:53.997351+0000","last_undegraded":"2024-09-18T01:48:53.997351+0000","last_fullsized":"2024-09-18T01:48:53.997351+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2024-09-18T01:48:53.997246+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2024-09-18T01:48:53.997246+0000","last_clean_scrub_stamp":"2024-09-18T01:48:53.997246+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:03:08.771218+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'285","reported_seq":428,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:24.767989+0000","last_change":"2024-09-18T01:48:24.768020+0000","last_active":"2024-09-18T01:48:24.767989+0000","last_peered":"2024-09-18T01:48:24.767989+0000","last_clean":"2024-09-18T01:48:24.767989+0000","last_became_active":"2024-09-18T01:45:12.307186+0000","last_became_peered":"2024-09-18T01:45:12.307186+0000","last_unstale":"2024-09-18T01:48:24.767989+0000","last_undegraded":"2024-09-18T01:48:24.767989+0000","last_fullsized":"2024-09-18T01:48:24.767989+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-18T01:48:24.767877+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-18T01:48:24.767877+0000","last_clean_scrub_stamp":"2024-09-18T01:48:24.767877+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:40:56.957174+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"33'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.988462+0000","last_change":"2024-09-18T01:45:14.326301+0000","last_active":"2024-09-18T01:48:12.988462+0000","last_peered":"2024-09-18T01:48:12.988462+0000","last_clean":"2024-09-18T01:48:12.988462+0000","last_became_active":"2024-09-18T01:45:14.326018+0000","last_became_peered":"2024-09-18T01:45:14.326018+0000","last_unstale":"2024-09-18T01:48:12.988462+0000","last_undegraded":"2024-09-18T01:48:12.988462+0000","last_fullsized":"2024-09-18T01:48:12.988462+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"33'8","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:46.046853+0000","last_change":"2024-09-18T01:48:46.046882+0000","last_active":"2024-09-18T01:48:46.046853+0000","last_peered":"2024-09-18T01:48:46.046853+0000","last_clean":"2024-09-18T01:48:46.046853+0000","last_became_active":"2024-09-18T01:45:06.281798+0000","last_became_peered":"2024-09-18T01:45:06.281798+0000","last_unstale":"2024-09-18T01:48:46.046853+0000","last_undegraded":"2024-09-18T01:48:46.046853+0000","last_fullsized":"2024-09-18T01:48:46.046853+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-18T01:48:46.046757+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-18T01:48:46.046757+0000","last_clean_scrub_stamp":"2024-09-18T01:48:46.046757+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:18:18.174824+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:37.219117+0000","last_change":"2024-09-18T01:45:04.293329+0000","last_active":"2024-09-18T01:47:37.219117+0000","last_peered":"2024-09-18T01:47:37.219117+0000","last_clean":"2024-09-18T01:47:37.219117+0000","last_became_active":"2024-09-18T01:45:04.293009+0000","last_became_peered":"2024-09-18T01:45:04.293009+0000","last_unstale":"2024-09-18T01:47:37.219117+0000","last_undegraded":"2024-09-18T01:47:37.219117+0000","last_fullsized":"2024-09-18T01:47:37.219117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:40.879858+0000","last_change":"2024-09-18T01:48:40.879897+0000","last_active":"2024-09-18T01:48:40.879858+0000","last_peered":"2024-09-18T01:48:40.879858+0000","last_clean":"2024-09-18T01:48:40.879858+0000","last_became_active":"2024-09-18T01:45:08.287884+0000","last_became_peered":"2024-09-18T01:45:08.287884+0000","last_unstale":"2024-09-18T01:48:40.879858+0000","last_undegraded":"2024-09-18T01:48:40.879858+0000","last_fullsized":"2024-09-18T01:48:40.879858+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:40.879744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:40.879744+0000","last_clean_scrub_stamp":"2024-09-18T01:48:40.879744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:23:57.801261+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'74","reported_seq":156,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:29.900192+0000","last_change":"2024-09-18T01:48:29.900260+0000","last_active":"2024-09-18T01:48:29.900192+0000","last_peered":"2024-09-18T01:48:29.900192+0000","last_clean":"2024-09-18T01:48:29.900192+0000","last_became_active":"2024-09-18T01:45:10.301087+0000","last_became_peered":"2024-09-18T01:45:10.301087+0000","last_unstale":"2024-09-18T01:48:29.900192+0000","last_undegraded":"2024-09-18T01:48:29.900192+0000","last_fullsized":"2024-09-18T01:48:29.900192+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'74","last_scrub_stamp":"2024-09-18T01:48:29.900089+0000","last_deep_scrub":"33'74","last_deep_scrub_stamp":"2024-09-18T01:48:29.900089+0000","last_clean_scrub_stamp":"2024-09-18T01:48:29.900089+0000","objects_scrubbed":11,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:03:12.147484+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:25.260421+0000","last_change":"2024-09-18T01:48:25.260445+0000","last_active":"2024-09-18T01:48:25.260421+0000","last_peered":"2024-09-18T01:48:25.260421+0000","last_clean":"2024-09-18T01:48:25.260421+0000","last_became_active":"2024-09-18T01:45:12.312055+0000","last_became_peered":"2024-09-18T01:45:12.312055+0000","last_unstale":"2024-09-18T01:48:25.260421+0000","last_undegraded":"2024-09-18T01:48:25.260421+0000","last_fullsized":"2024-09-18T01:48:25.260421+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:25.260301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:25.260301+0000","last_clean_scrub_stamp":"2024-09-18T01:48:25.260301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:20:06.632858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"33'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:42.220112+0000","last_change":"2024-09-18T01:45:14.323228+0000","last_active":"2024-09-18T01:47:42.220112+0000","last_peered":"2024-09-18T01:47:42.220112+0000","last_clean":"2024-09-18T01:47:42.220112+0000","last_became_active":"2024-09-18T01:45:14.322945+0000","last_became_peered":"2024-09-18T01:45:14.322945+0000","last_unstale":"2024-09-18T01:47:42.220112+0000","last_undegraded":"2024-09-18T01:47:42.220112+0000","last_fullsized":"2024-09-18T01:47:42.220112+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'6","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:48.023951+0000","last_change":"2024-09-18T01:48:48.023979+0000","last_active":"2024-09-18T01:48:48.023951+0000","last_peered":"2024-09-18T01:48:48.023951+0000","last_clean":"2024-09-18T01:48:48.023951+0000","last_became_active":"2024-09-18T01:45:06.281480+0000","last_became_peered":"2024-09-18T01:45:06.281480+0000","last_unstale":"2024-09-18T01:48:48.023951+0000","last_undegraded":"2024-09-18T01:48:48.023951+0000","last_fullsized":"2024-09-18T01:48:48.023951+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-18T01:48:48.023825+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-18T01:48:48.023825+0000","last_clean_scrub_stamp":"2024-09-18T01:48:48.023825+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:47:46.236855+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:37.219189+0000","last_change":"2024-09-18T01:45:04.291296+0000","last_active":"2024-09-18T01:47:37.219189+0000","last_peered":"2024-09-18T01:47:37.219189+0000","last_clean":"2024-09-18T01:47:37.219189+0000","last_became_active":"2024-09-18T01:45:04.290901+0000","last_became_peered":"2024-09-18T01:45:04.290901+0000","last_unstale":"2024-09-18T01:47:37.219189+0000","last_undegraded":"2024-09-18T01:47:37.219189+0000","last_fullsized":"2024-09-18T01:47:37.219189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:41.995434+0000","last_change":"2024-09-18T01:48:41.995473+0000","last_active":"2024-09-18T01:48:41.995434+0000","last_peered":"2024-09-18T01:48:41.995434+0000","last_clean":"2024-09-18T01:48:41.995434+0000","last_became_active":"2024-09-18T01:45:08.286502+0000","last_became_peered":"2024-09-18T01:45:08.286502+0000","last_unstale":"2024-09-18T01:48:41.995434+0000","last_undegraded":"2024-09-18T01:48:41.995434+0000","last_fullsized":"2024-09-18T01:48:41.995434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:41.995333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:41.995333+0000","last_clean_scrub_stamp":"2024-09-18T01:48:41.995333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:40:51.267310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'43","reported_seq":104,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:30.281139+0000","last_change":"2024-09-18T01:48:30.281182+0000","last_active":"2024-09-18T01:48:30.281139+0000","last_peered":"2024-09-18T01:48:30.281139+0000","last_clean":"2024-09-18T01:48:30.281139+0000","last_became_active":"2024-09-18T01:45:10.306076+0000","last_became_peered":"2024-09-18T01:45:10.306076+0000","last_unstale":"2024-09-18T01:48:30.281139+0000","last_undegraded":"2024-09-18T01:48:30.281139+0000","last_fullsized":"2024-09-18T01:48:30.281139+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-09-18T01:48:30.281049+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-09-18T01:48:30.281049+0000","last_clean_scrub_stamp":"2024-09-18T01:48:30.281049+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:14:03.450919+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:46.991470+0000","last_change":"2024-09-18T01:48:46.991507+0000","last_active":"2024-09-18T01:48:46.991470+0000","last_peered":"2024-09-18T01:48:46.991470+0000","last_clean":"2024-09-18T01:48:46.991470+0000","last_became_active":"2024-09-18T01:45:12.316022+0000","last_became_peered":"2024-09-18T01:45:12.316022+0000","last_unstale":"2024-09-18T01:48:46.991470+0000","last_undegraded":"2024-09-18T01:48:46.991470+0000","last_fullsized":"2024-09-18T01:48:46.991470+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:46.991352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:46.991352+0000","last_clean_scrub_stamp":"2024-09-18T01:48:46.991352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:54:48.148908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:42.220053+0000","last_change":"2024-09-18T01:45:14.325515+0000","last_active":"2024-09-18T01:47:42.220053+0000","last_peered":"2024-09-18T01:47:42.220053+0000","last_clean":"2024-09-18T01:47:42.220053+0000","last_became_active":"2024-09-18T01:45:14.325208+0000","last_became_peered":"2024-09-18T01:45:14.325208+0000","last_unstale":"2024-09-18T01:47:42.220053+0000","last_undegraded":"2024-09-18T01:47:42.220053+0000","last_fullsized":"2024-09-18T01:47:42.220053+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'26","reported_seq":95,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.879679+0000","last_change":"2024-09-18T01:45:06.283428+0000","last_active":"2024-09-18T01:48:12.879679+0000","last_peered":"2024-09-18T01:48:12.879679+0000","last_clean":"2024-09-18T01:48:12.879679+0000","last_became_active":"2024-09-18T01:45:06.283174+0000","last_became_peered":"2024-09-18T01:45:06.283174+0000","last_unstale":"2024-09-18T01:48:12.879679+0000","last_undegraded":"2024-09-18T01:48:12.879679+0000","last_fullsized":"2024-09-18T01:48:12.879679+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":84,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:07.212095+0000","last_change":"2024-09-18T01:45:04.273552+0000","last_active":"2024-09-18T01:47:07.212095+0000","last_peered":"2024-09-18T01:47:07.212095+0000","last_clean":"2024-09-18T01:47:07.212095+0000","last_became_active":"2024-09-18T01:45:04.273128+0000","last_became_peered":"2024-09-18T01:45:04.273128+0000","last_unstale":"2024-09-18T01:47:07.212095+0000","last_undegraded":"2024-09-18T01:47:07.212095+0000","last_fullsized":"2024-09-18T01:47:07.212095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"33'5","reported_seq":238,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:33.930151+0000","last_change":"2024-09-18T01:48:33.930178+0000","last_active":"2024-09-18T01:48:33.930151+0000","last_peered":"2024-09-18T01:48:33.930151+0000","last_clean":"2024-09-18T01:48:33.930151+0000","last_became_active":"2024-09-18T01:45:08.294338+0000","last_became_peered":"2024-09-18T01:45:08.294338+0000","last_unstale":"2024-09-18T01:48:33.930151+0000","last_undegraded":"2024-09-18T01:48:33.930151+0000","last_fullsized":"2024-09-18T01:48:33.930151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-18T01:48:33.930067+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-18T01:48:33.930067+0000","last_clean_scrub_stamp":"2024-09-18T01:48:33.930067+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:04:18.998443+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'39","reported_seq":98,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:53.009496+0000","last_change":"2024-09-18T01:48:53.009528+0000","last_active":"2024-09-18T01:48:53.009496+0000","last_peered":"2024-09-18T01:48:53.009496+0000","last_clean":"2024-09-18T01:48:53.009496+0000","last_became_active":"2024-09-18T01:45:10.308336+0000","last_became_peered":"2024-09-18T01:45:10.308336+0000","last_unstale":"2024-09-18T01:48:53.009496+0000","last_undegraded":"2024-09-18T01:48:53.009496+0000","last_fullsized":"2024-09-18T01:48:53.009496+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'39","last_scrub_stamp":"2024-09-18T01:48:53.009391+0000","last_deep_scrub":"33'39","last_deep_scrub_stamp":"2024-09-18T01:48:53.009391+0000","last_clean_scrub_stamp":"2024-09-18T01:48:53.009391+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:38:00.551480+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:48.000035+0000","last_change":"2024-09-18T01:48:48.000061+0000","last_active":"2024-09-18T01:48:48.000035+0000","last_peered":"2024-09-18T01:48:48.000035+0000","last_clean":"2024-09-18T01:48:48.000035+0000","last_became_active":"2024-09-18T01:45:12.312794+0000","last_became_peered":"2024-09-18T01:45:12.312794+0000","last_unstale":"2024-09-18T01:48:48.000035+0000","last_undegraded":"2024-09-18T01:48:48.000035+0000","last_fullsized":"2024-09-18T01:48:48.000035+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:47.999948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:47.999948+0000","last_clean_scrub_stamp":"2024-09-18T01:48:47.999948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:23:16.320379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"33'10","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.564345+0000","last_change":"2024-09-18T01:45:14.325782+0000","last_active":"2024-09-18T01:48:12.564345+0000","last_peered":"2024-09-18T01:48:12.564345+0000","last_clean":"2024-09-18T01:48:12.564345+0000","last_became_active":"2024-09-18T01:45:14.325464+0000","last_became_peered":"2024-09-18T01:45:14.325464+0000","last_unstale":"2024-09-18T01:48:12.564345+0000","last_undegraded":"2024-09-18T01:48:12.564345+0000","last_fullsized":"2024-09-18T01:48:12.564345+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'8","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:50.009611+0000","last_change":"2024-09-18T01:48:50.009639+0000","last_active":"2024-09-18T01:48:50.009611+0000","last_peered":"2024-09-18T01:48:50.009611+0000","last_clean":"2024-09-18T01:48:50.009611+0000","last_became_active":"2024-09-18T01:45:06.283071+0000","last_became_peered":"2024-09-18T01:45:06.283071+0000","last_unstale":"2024-09-18T01:48:50.009611+0000","last_undegraded":"2024-09-18T01:48:50.009611+0000","last_fullsized":"2024-09-18T01:48:50.009611+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-18T01:48:50.009508+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-18T01:48:50.009508+0000","last_clean_scrub_stamp":"2024-09-18T01:48:50.009508+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:20:50.711544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:02.173662+0000","last_change":"2024-09-18T01:49:02.173712+0000","last_active":"2024-09-18T01:49:02.173662+0000","last_peered":"2024-09-18T01:49:02.173662+0000","last_clean":"2024-09-18T01:49:02.173662+0000","last_became_active":"2024-09-18T01:45:04.297716+0000","last_became_peered":"2024-09-18T01:45:04.297716+0000","last_unstale":"2024-09-18T01:49:02.173662+0000","last_undegraded":"2024-09-18T01:49:02.173662+0000","last_fullsized":"2024-09-18T01:49:02.173662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:49:02.173559+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:49:02.173559+0000","last_clean_scrub_stamp":"2024-09-18T01:49:02.173559+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:55:03.121556+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'3","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:36.961597+0000","last_change":"2024-09-18T01:48:36.961625+0000","last_active":"2024-09-18T01:48:36.961597+0000","last_peered":"2024-09-18T01:48:36.961597+0000","last_clean":"2024-09-18T01:48:36.961597+0000","last_became_active":"2024-09-18T01:45:08.294160+0000","last_became_peered":"2024-09-18T01:45:08.294160+0000","last_unstale":"2024-09-18T01:48:36.961597+0000","last_undegraded":"2024-09-18T01:48:36.961597+0000","last_fullsized":"2024-09-18T01:48:36.961597+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-18T01:48:36.961514+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-18T01:48:36.961514+0000","last_clean_scrub_stamp":"2024-09-18T01:48:36.961514+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:20:37.663549+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'53","reported_seq":122,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:43.072087+0000","last_change":"2024-09-18T01:48:43.072125+0000","last_active":"2024-09-18T01:48:43.072087+0000","last_peered":"2024-09-18T01:48:43.072087+0000","last_clean":"2024-09-18T01:48:43.072087+0000","last_became_active":"2024-09-18T01:45:10.308302+0000","last_became_peered":"2024-09-18T01:45:10.308302+0000","last_unstale":"2024-09-18T01:48:43.072087+0000","last_undegraded":"2024-09-18T01:48:43.072087+0000","last_fullsized":"2024-09-18T01:48:43.072087+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'53","last_scrub_stamp":"2024-09-18T01:48:43.071994+0000","last_deep_scrub":"33'53","last_deep_scrub_stamp":"2024-09-18T01:48:43.071994+0000","last_clean_scrub_stamp":"2024-09-18T01:48:43.071994+0000","objects_scrubbed":7,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:57:25.764909+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:28.229701+0000","last_change":"2024-09-18T01:48:28.229726+0000","last_active":"2024-09-18T01:48:28.229701+0000","last_peered":"2024-09-18T01:48:28.229701+0000","last_clean":"2024-09-18T01:48:28.229701+0000","last_became_active":"2024-09-18T01:45:12.305742+0000","last_became_peered":"2024-09-18T01:45:12.305742+0000","last_unstale":"2024-09-18T01:48:28.229701+0000","last_undegraded":"2024-09-18T01:48:28.229701+0000","last_fullsized":"2024-09-18T01:48:28.229701+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:28.229607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:28.229607+0000","last_clean_scrub_stamp":"2024-09-18T01:48:28.229607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:03:10.477001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"33'2","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:37.219124+0000","last_change":"2024-09-18T01:45:14.325723+0000","last_active":"2024-09-18T01:47:37.219124+0000","last_peered":"2024-09-18T01:47:37.219124+0000","last_clean":"2024-09-18T01:47:37.219124+0000","last_became_active":"2024-09-18T01:45:14.325368+0000","last_became_peered":"2024-09-18T01:45:14.325368+0000","last_unstale":"2024-09-18T01:47:37.219124+0000","last_undegraded":"2024-09-18T01:47:37.219124+0000","last_fullsized":"2024-09-18T01:47:37.219124+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"33'8","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.932175+0000","last_change":"2024-09-18T01:45:41.342690+0000","last_active":"2024-09-18T01:48:12.932175+0000","last_peered":"2024-09-18T01:48:12.932175+0000","last_clean":"2024-09-18T01:48:12.932175+0000","last_became_active":"2024-09-18T01:45:41.342336+0000","last_became_peered":"2024-09-18T01:45:41.342336+0000","last_unstale":"2024-09-18T01:48:12.932175+0000","last_undegraded":"2024-09-18T01:48:12.932175+0000","last_fullsized":"2024-09-18T01:48:12.932175+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.214133+0000","last_change":"2024-09-18T01:45:04.285604+0000","last_active":"2024-09-18T01:47:12.214133+0000","last_peered":"2024-09-18T01:47:12.214133+0000","last_clean":"2024-09-18T01:47:12.214133+0000","last_became_active":"2024-09-18T01:45:04.284969+0000","last_became_peered":"2024-09-18T01:45:04.284969+0000","last_unstale":"2024-09-18T01:47:12.214133+0000","last_undegraded":"2024-09-18T01:47:12.214133+0000","last_fullsized":"2024-09-18T01:47:12.214133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'11","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.929547+0000","last_change":"2024-09-18T01:45:06.285979+0000","last_active":"2024-09-18T01:48:12.929547+0000","last_peered":"2024-09-18T01:48:12.929547+0000","last_clean":"2024-09-18T01:48:12.929547+0000","last_became_active":"2024-09-18T01:45:06.285500+0000","last_became_peered":"2024-09-18T01:45:06.285500+0000","last_unstale":"2024-09-18T01:48:12.929547+0000","last_undegraded":"2024-09-18T01:48:12.929547+0000","last_fullsized":"2024-09-18T01:48:12.929547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.212635+0000","last_change":"2024-09-18T01:45:04.280448+0000","last_active":"2024-09-18T01:47:12.212635+0000","last_peered":"2024-09-18T01:47:12.212635+0000","last_clean":"2024-09-18T01:47:12.212635+0000","last_became_active":"2024-09-18T01:45:04.280147+0000","last_became_peered":"2024-09-18T01:45:04.280147+0000","last_unstale":"2024-09-18T01:47:12.212635+0000","last_undegraded":"2024-09-18T01:47:12.212635+0000","last_fullsized":"2024-09-18T01:47:12.212635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.846101+0000","last_change":"2024-09-18T01:45:06.278954+0000","last_active":"2024-09-18T01:48:12.846101+0000","last_peered":"2024-09-18T01:48:12.846101+0000","last_clean":"2024-09-18T01:48:12.846101+0000","last_became_active":"2024-09-18T01:45:06.278684+0000","last_became_peered":"2024-09-18T01:45:06.278684+0000","last_unstale":"2024-09-18T01:48:12.846101+0000","last_undegraded":"2024-09-18T01:48:12.846101+0000","last_fullsized":"2024-09-18T01:48:12.846101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.214385+0000","last_change":"2024-09-18T01:45:04.283274+0000","last_active":"2024-09-18T01:47:12.214385+0000","last_peered":"2024-09-18T01:47:12.214385+0000","last_clean":"2024-09-18T01:47:12.214385+0000","last_became_active":"2024-09-18T01:45:04.281920+0000","last_became_peered":"2024-09-18T01:45:04.281920+0000","last_unstale":"2024-09-18T01:47:12.214385+0000","last_undegraded":"2024-09-18T01:47:12.214385+0000","last_fullsized":"2024-09-18T01:47:12.214385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"33'6","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:57.372948+0000","last_change":"2024-09-18T01:48:57.373010+0000","last_active":"2024-09-18T01:48:57.372948+0000","last_peered":"2024-09-18T01:48:57.372948+0000","last_clean":"2024-09-18T01:48:57.372948+0000","last_became_active":"2024-09-18T01:45:06.281998+0000","last_became_peered":"2024-09-18T01:45:06.281998+0000","last_unstale":"2024-09-18T01:48:57.372948+0000","last_undegraded":"2024-09-18T01:48:57.372948+0000","last_fullsized":"2024-09-18T01:48:57.372948+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-18T01:48:57.372819+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-18T01:48:57.372819+0000","last_clean_scrub_stamp":"2024-09-18T01:48:57.372819+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:39:02.799260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.212692+0000","last_change":"2024-09-18T01:45:04.280466+0000","last_active":"2024-09-18T01:47:12.212692+0000","last_peered":"2024-09-18T01:47:12.212692+0000","last_clean":"2024-09-18T01:47:12.212692+0000","last_became_active":"2024-09-18T01:45:04.280066+0000","last_became_peered":"2024-09-18T01:45:04.280066+0000","last_unstale":"2024-09-18T01:47:12.212692+0000","last_undegraded":"2024-09-18T01:47:12.212692+0000","last_fullsized":"2024-09-18T01:47:12.212692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.212683+0000","last_change":"2024-09-18T01:45:06.285899+0000","last_active":"2024-09-18T01:47:12.212683+0000","last_peered":"2024-09-18T01:47:12.212683+0000","last_clean":"2024-09-18T01:47:12.212683+0000","last_became_active":"2024-09-18T01:45:06.285054+0000","last_became_peered":"2024-09-18T01:45:06.285054+0000","last_unstale":"2024-09-18T01:47:12.212683+0000","last_undegraded":"2024-09-18T01:47:12.212683+0000","last_fullsized":"2024-09-18T01:47:12.212683+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"31'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:17.213465+0000","last_change":"2024-09-18T01:45:04.281591+0000","last_active":"2024-09-18T01:47:17.213465+0000","last_peered":"2024-09-18T01:47:17.213465+0000","last_clean":"2024-09-18T01:47:17.213465+0000","last_became_active":"2024-09-18T01:45:04.281146+0000","last_became_peered":"2024-09-18T01:45:04.281146+0000","last_unstale":"2024-09-18T01:47:17.213465+0000","last_undegraded":"2024-09-18T01:47:17.213465+0000","last_fullsized":"2024-09-18T01:47:17.213465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:12.214246+0000","last_change":"2024-09-18T01:45:06.292733+0000","last_active":"2024-09-18T01:47:12.214246+0000","last_peered":"2024-09-18T01:47:12.214246+0000","last_clean":"2024-09-18T01:47:12.214246+0000","last_became_active":"2024-09-18T01:45:06.292490+0000","last_became_peered":"2024-09-18T01:45:06.292490+0000","last_unstale":"2024-09-18T01:47:12.214246+0000","last_undegraded":"2024-09-18T01:47:12.214246+0000","last_fullsized":"2024-09-18T01:47:12.214246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:17.215148+0000","last_change":"2024-09-18T01:45:04.294522+0000","last_active":"2024-09-18T01:47:17.215148+0000","last_peered":"2024-09-18T01:47:17.215148+0000","last_clean":"2024-09-18T01:47:17.215148+0000","last_became_active":"2024-09-18T01:45:04.293767+0000","last_became_peered":"2024-09-18T01:45:04.293767+0000","last_unstale":"2024-09-18T01:47:17.215148+0000","last_undegraded":"2024-09-18T01:47:17.215148+0000","last_fullsized":"2024-09-18T01:47:17.215148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"33'10","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:51.420763+0000","last_change":"2024-09-18T01:48:51.420813+0000","last_active":"2024-09-18T01:48:51.420763+0000","last_peered":"2024-09-18T01:48:51.420763+0000","last_clean":"2024-09-18T01:48:51.420763+0000","last_became_active":"2024-09-18T01:45:06.293369+0000","last_became_peered":"2024-09-18T01:45:06.293369+0000","last_unstale":"2024-09-18T01:48:51.420763+0000","last_undegraded":"2024-09-18T01:48:51.420763+0000","last_fullsized":"2024-09-18T01:48:51.420763+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-18T01:48:51.420614+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-18T01:48:51.420614+0000","last_clean_scrub_stamp":"2024-09-18T01:48:51.420614+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:43:49.179948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:57.058301+0000","last_change":"2024-09-18T01:48:57.058359+0000","last_active":"2024-09-18T01:48:57.058301+0000","last_peered":"2024-09-18T01:48:57.058301+0000","last_clean":"2024-09-18T01:48:57.058301+0000","last_became_active":"2024-09-18T01:45:04.292056+0000","last_became_peered":"2024-09-18T01:45:04.292056+0000","last_unstale":"2024-09-18T01:48:57.058301+0000","last_undegraded":"2024-09-18T01:48:57.058301+0000","last_fullsized":"2024-09-18T01:48:57.058301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:48:57.058174+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:48:57.058174+0000","last_clean_scrub_stamp":"2024-09-18T01:48:57.058174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:39:24.043782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'8","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:44.891243+0000","last_change":"2024-09-18T01:48:44.891289+0000","last_active":"2024-09-18T01:48:44.891243+0000","last_peered":"2024-09-18T01:48:44.891243+0000","last_clean":"2024-09-18T01:48:44.891243+0000","last_became_active":"2024-09-18T01:45:06.295055+0000","last_became_peered":"2024-09-18T01:45:06.295055+0000","last_unstale":"2024-09-18T01:48:44.891243+0000","last_undegraded":"2024-09-18T01:48:44.891243+0000","last_fullsized":"2024-09-18T01:48:44.891243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-18T01:48:44.891111+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-18T01:48:44.891111+0000","last_clean_scrub_stamp":"2024-09-18T01:48:44.891111+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:12:36.827132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:56.346211+0000","last_change":"2024-09-18T01:48:56.346237+0000","last_active":"2024-09-18T01:48:56.346211+0000","last_peered":"2024-09-18T01:48:56.346211+0000","last_clean":"2024-09-18T01:48:56.346211+0000","last_became_active":"2024-09-18T01:45:04.283959+0000","last_became_peered":"2024-09-18T01:45:04.283959+0000","last_unstale":"2024-09-18T01:48:56.346211+0000","last_undegraded":"2024-09-18T01:48:56.346211+0000","last_fullsized":"2024-09-18T01:48:56.346211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:56.346122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:56.346122+0000","last_clean_scrub_stamp":"2024-09-18T01:48:56.346122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:58:18.595435+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:47.927642+0000","last_change":"2024-09-18T01:48:47.927701+0000","last_active":"2024-09-18T01:48:47.927642+0000","last_peered":"2024-09-18T01:48:47.927642+0000","last_clean":"2024-09-18T01:48:47.927642+0000","last_became_active":"2024-09-18T01:45:06.295270+0000","last_became_peered":"2024-09-18T01:45:06.295270+0000","last_unstale":"2024-09-18T01:48:47.927642+0000","last_undegraded":"2024-09-18T01:48:47.927642+0000","last_fullsized":"2024-09-18T01:48:47.927642+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:48:47.927542+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:48:47.927542+0000","last_clean_scrub_stamp":"2024-09-18T01:48:47.927542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:48:47.618456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:17.215081+0000","last_change":"2024-09-18T01:45:04.280658+0000","last_active":"2024-09-18T01:47:17.215081+0000","last_peered":"2024-09-18T01:47:17.215081+0000","last_clean":"2024-09-18T01:47:17.215081+0000","last_became_active":"2024-09-18T01:45:04.278951+0000","last_became_peered":"2024-09-18T01:45:04.278951+0000","last_unstale":"2024-09-18T01:47:17.215081+0000","last_undegraded":"2024-09-18T01:47:17.215081+0000","last_fullsized":"2024-09-18T01:47:17.215081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'4","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:01.924260+0000","last_change":"2024-09-18T01:49:01.924286+0000","last_active":"2024-09-18T01:49:01.924260+0000","last_peered":"2024-09-18T01:49:01.924260+0000","last_clean":"2024-09-18T01:49:01.924260+0000","last_became_active":"2024-09-18T01:45:06.285272+0000","last_became_peered":"2024-09-18T01:45:06.285272+0000","last_unstale":"2024-09-18T01:49:01.924260+0000","last_undegraded":"2024-09-18T01:49:01.924260+0000","last_fullsized":"2024-09-18T01:49:01.924260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:49:01.924168+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:49:01.924168+0000","last_clean_scrub_stamp":"2024-09-18T01:49:01.924168+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:54:15.016033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:00.389539+0000","last_change":"2024-09-18T01:49:00.389566+0000","last_active":"2024-09-18T01:49:00.389539+0000","last_peered":"2024-09-18T01:49:00.389539+0000","last_clean":"2024-09-18T01:49:00.389539+0000","last_became_active":"2024-09-18T01:45:04.281197+0000","last_became_peered":"2024-09-18T01:45:04.281197+0000","last_unstale":"2024-09-18T01:49:00.389539+0000","last_undegraded":"2024-09-18T01:49:00.389539+0000","last_fullsized":"2024-09-18T01:49:00.389539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:00.389446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:00.389446+0000","last_clean_scrub_stamp":"2024-09-18T01:49:00.389446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:16:22.876886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"33'4","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:22.214291+0000","last_change":"2024-09-18T01:45:06.285297+0000","last_active":"2024-09-18T01:47:22.214291+0000","last_peered":"2024-09-18T01:47:22.214291+0000","last_clean":"2024-09-18T01:47:22.214291+0000","last_became_active":"2024-09-18T01:45:06.284989+0000","last_became_peered":"2024-09-18T01:45:06.284989+0000","last_unstale":"2024-09-18T01:47:22.214291+0000","last_undegraded":"2024-09-18T01:47:22.214291+0000","last_fullsized":"2024-09-18T01:47:22.214291+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:22.215920+0000","last_change":"2024-09-18T01:45:04.295486+0000","last_active":"2024-09-18T01:47:22.215920+0000","last_peered":"2024-09-18T01:47:22.215920+0000","last_clean":"2024-09-18T01:47:22.215920+0000","last_became_active":"2024-09-18T01:45:04.294125+0000","last_became_peered":"2024-09-18T01:45:04.294125+0000","last_unstale":"2024-09-18T01:47:22.215920+0000","last_undegraded":"2024-09-18T01:47:22.215920+0000","last_fullsized":"2024-09-18T01:47:22.215920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"33'10","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:56.058236+0000","last_change":"2024-09-18T01:48:56.058261+0000","last_active":"2024-09-18T01:48:56.058236+0000","last_peered":"2024-09-18T01:48:56.058236+0000","last_clean":"2024-09-18T01:48:56.058236+0000","last_became_active":"2024-09-18T01:45:06.279373+0000","last_became_peered":"2024-09-18T01:45:06.279373+0000","last_unstale":"2024-09-18T01:48:56.058236+0000","last_undegraded":"2024-09-18T01:48:56.058236+0000","last_fullsized":"2024-09-18T01:48:56.058236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-18T01:48:56.058151+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-18T01:48:56.058151+0000","last_clean_scrub_stamp":"2024-09-18T01:48:56.058151+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:04:14.350688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.522581+0000","last_change":"2024-09-18T01:45:04.291798+0000","last_active":"2024-09-18T01:48:12.522581+0000","last_peered":"2024-09-18T01:48:12.522581+0000","last_clean":"2024-09-18T01:48:12.522581+0000","last_became_active":"2024-09-18T01:45:04.291442+0000","last_became_peered":"2024-09-18T01:45:04.291442+0000","last_unstale":"2024-09-18T01:48:12.522581+0000","last_undegraded":"2024-09-18T01:48:12.522581+0000","last_fullsized":"2024-09-18T01:48:12.522581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'6","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:22.216015+0000","last_change":"2024-09-18T01:45:06.292853+0000","last_active":"2024-09-18T01:47:22.216015+0000","last_peered":"2024-09-18T01:47:22.216015+0000","last_clean":"2024-09-18T01:47:22.216015+0000","last_became_active":"2024-09-18T01:45:06.292425+0000","last_became_peered":"2024-09-18T01:45:06.292425+0000","last_unstale":"2024-09-18T01:47:22.216015+0000","last_undegraded":"2024-09-18T01:47:22.216015+0000","last_fullsized":"2024-09-18T01:47:22.216015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:22.216129+0000","last_change":"2024-09-18T01:45:04.289922+0000","last_active":"2024-09-18T01:47:22.216129+0000","last_peered":"2024-09-18T01:47:22.216129+0000","last_clean":"2024-09-18T01:47:22.216129+0000","last_became_active":"2024-09-18T01:45:04.289365+0000","last_became_peered":"2024-09-18T01:45:04.289365+0000","last_unstale":"2024-09-18T01:47:22.216129+0000","last_undegraded":"2024-09-18T01:47:22.216129+0000","last_fullsized":"2024-09-18T01:47:22.216129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:52.005609+0000","last_change":"2024-09-18T01:48:52.005632+0000","last_active":"2024-09-18T01:48:52.005609+0000","last_peered":"2024-09-18T01:48:52.005609+0000","last_clean":"2024-09-18T01:48:52.005609+0000","last_became_active":"2024-09-18T01:45:06.293403+0000","last_became_peered":"2024-09-18T01:45:06.293403+0000","last_unstale":"2024-09-18T01:48:52.005609+0000","last_undegraded":"2024-09-18T01:48:52.005609+0000","last_fullsized":"2024-09-18T01:48:52.005609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:52.005522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:52.005522+0000","last_clean_scrub_stamp":"2024-09-18T01:48:52.005522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:15:53.488207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:22.216164+0000","last_change":"2024-09-18T01:45:04.278234+0000","last_active":"2024-09-18T01:47:22.216164+0000","last_peered":"2024-09-18T01:47:22.216164+0000","last_clean":"2024-09-18T01:47:22.216164+0000","last_became_active":"2024-09-18T01:45:04.277907+0000","last_became_peered":"2024-09-18T01:45:04.277907+0000","last_unstale":"2024-09-18T01:47:22.216164+0000","last_undegraded":"2024-09-18T01:47:22.216164+0000","last_fullsized":"2024-09-18T01:47:22.216164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'3","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:41.057651+0000","last_change":"2024-09-18T01:48:41.057681+0000","last_active":"2024-09-18T01:48:41.057651+0000","last_peered":"2024-09-18T01:48:41.057651+0000","last_clean":"2024-09-18T01:48:41.057651+0000","last_became_active":"2024-09-18T01:45:06.293036+0000","last_became_peered":"2024-09-18T01:45:06.293036+0000","last_unstale":"2024-09-18T01:48:41.057651+0000","last_undegraded":"2024-09-18T01:48:41.057651+0000","last_fullsized":"2024-09-18T01:48:41.057651+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-18T01:48:41.057559+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-18T01:48:41.057559+0000","last_clean_scrub_stamp":"2024-09-18T01:48:41.057559+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:16:03.544999+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:27.217142+0000","last_change":"2024-09-18T01:45:04.287307+0000","last_active":"2024-09-18T01:47:27.217142+0000","last_peered":"2024-09-18T01:47:27.217142+0000","last_clean":"2024-09-18T01:47:27.217142+0000","last_became_active":"2024-09-18T01:45:04.286591+0000","last_became_peered":"2024-09-18T01:45:04.286591+0000","last_unstale":"2024-09-18T01:47:27.217142+0000","last_undegraded":"2024-09-18T01:47:27.217142+0000","last_fullsized":"2024-09-18T01:47:27.217142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"33'4","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:45.923327+0000","last_change":"2024-09-18T01:48:45.923392+0000","last_active":"2024-09-18T01:48:45.923327+0000","last_peered":"2024-09-18T01:48:45.923327+0000","last_clean":"2024-09-18T01:48:45.923327+0000","last_became_active":"2024-09-18T01:45:06.294911+0000","last_became_peered":"2024-09-18T01:45:06.294911+0000","last_unstale":"2024-09-18T01:48:45.923327+0000","last_undegraded":"2024-09-18T01:48:45.923327+0000","last_fullsized":"2024-09-18T01:48:45.923327+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:48:45.923209+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:48:45.923209+0000","last_clean_scrub_stamp":"2024-09-18T01:48:45.923209+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:37:21.719090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.868650+0000","last_change":"2024-09-18T01:45:04.287888+0000","last_active":"2024-09-18T01:48:12.868650+0000","last_peered":"2024-09-18T01:48:12.868650+0000","last_clean":"2024-09-18T01:48:12.868650+0000","last_became_active":"2024-09-18T01:45:04.285719+0000","last_became_peered":"2024-09-18T01:45:04.285719+0000","last_unstale":"2024-09-18T01:48:12.868650+0000","last_undegraded":"2024-09-18T01:48:12.868650+0000","last_fullsized":"2024-09-18T01:48:12.868650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.491079+0000","last_change":"2024-09-18T01:45:04.280417+0000","last_active":"2024-09-18T01:48:19.491079+0000","last_peered":"2024-09-18T01:48:19.491079+0000","last_clean":"2024-09-18T01:48:19.491079+0000","last_became_active":"2024-09-18T01:45:04.278266+0000","last_became_peered":"2024-09-18T01:45:04.278266+0000","last_unstale":"2024-09-18T01:48:19.491079+0000","last_undegraded":"2024-09-18T01:48:19.491079+0000","last_fullsized":"2024-09-18T01:48:19.491079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"33'10","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:32.215711+0000","last_change":"2024-09-18T01:45:06.292390+0000","last_active":"2024-09-18T01:47:32.215711+0000","last_peered":"2024-09-18T01:47:32.215711+0000","last_clean":"2024-09-18T01:47:32.215711+0000","last_became_active":"2024-09-18T01:45:06.292127+0000","last_became_peered":"2024-09-18T01:45:06.292127+0000","last_unstale":"2024-09-18T01:47:32.215711+0000","last_undegraded":"2024-09-18T01:47:32.215711+0000","last_fullsized":"2024-09-18T01:47:32.215711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:27.214892+0000","last_change":"2024-09-18T01:45:04.273996+0000","last_active":"2024-09-18T01:47:27.214892+0000","last_peered":"2024-09-18T01:47:27.214892+0000","last_clean":"2024-09-18T01:47:27.214892+0000","last_became_active":"2024-09-18T01:45:04.273575+0000","last_became_peered":"2024-09-18T01:45:04.273575+0000","last_unstale":"2024-09-18T01:47:27.214892+0000","last_undegraded":"2024-09-18T01:47:27.214892+0000","last_fullsized":"2024-09-18T01:47:27.214892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'6","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.880126+0000","last_change":"2024-09-18T01:45:06.292393+0000","last_active":"2024-09-18T01:48:12.880126+0000","last_peered":"2024-09-18T01:48:12.880126+0000","last_clean":"2024-09-18T01:48:12.880126+0000","last_became_active":"2024-09-18T01:45:06.292037+0000","last_became_peered":"2024-09-18T01:45:06.292037+0000","last_unstale":"2024-09-18T01:48:12.880126+0000","last_undegraded":"2024-09-18T01:48:12.880126+0000","last_fullsized":"2024-09-18T01:48:12.880126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":9385,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1888,"num_read_kb":1653,"num_write":789,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1751,"ondisk_log_size":1751,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1590,"num_read_kb":1480,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":477,"ondisk_log_size":477,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705718,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39972,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331868,"statfs":{"total":96636764160,"available":96595832832,"internally_reserved":0,"allocated":479232,"data_stored":150270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705718,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40480,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331360,"statfs":{"total":96636764160,"available":96595312640,"internally_reserved":0,"allocated":999424,"data_stored":737378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705718,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40508,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331332,"statfs":{"total":96636764160,"available":96595283968,"internally_reserved":0,"allocated":1028096,"data_stored":738692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705718,"num_pgs":150,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39936,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331904,"statfs":{"total":96636764160,"available":96595869696,"internally_reserved":0,"allocated":442368,"data_stored":148296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T01:49:04.687 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.687 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.687 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.687 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.688 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.688 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.688 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.688 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.688 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.688 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.689 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.689 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.689 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.689 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.689 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.689 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.689 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.689 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.690 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.690 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.690 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.690 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.690 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.691 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.691 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.691 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.691 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.691 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.692 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.692 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.692 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.692 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.692 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.692 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.692 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.693 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.693 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.693 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-18T01:44:48.210722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=44, tm_sec=48, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.693 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-18T01:44:52.219730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=44, tm_sec=52, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.693 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.693 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.694 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-18T01:44:52.219730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=44, tm_sec=52, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.694 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.694 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.694 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.694 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-18T01:44:52.219730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=44, tm_sec=52, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.694 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.695 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-18T01:44:52.219730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=44, tm_sec=52, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.695 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.695 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-18T01:44:52.219730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=44, tm_sec=52, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.695 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.695 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.695 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-18T01:44:52.219730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=44, tm_sec=52, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.695 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.696 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-18T01:44:52.219730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=44, tm_sec=52, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.696 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.696 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.696 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.696 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-18T01:45:07.267106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.696 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.696 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.697 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-18T01:45:07.267106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.697 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.697 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.697 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.697 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.698 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.698 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.698 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.698 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.698 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.698 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.699 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.699 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.699 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-18T01:45:07.267106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.699 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.699 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.699 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.699 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.700 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.700 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.700 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.700 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.700 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.700 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.701 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.701 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.701 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.701 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.701 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.701 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.701 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.701 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.702 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.702 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.702 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.702 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.702 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.702 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.703 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.703 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.703 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.703 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.703 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.703 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.703 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.704 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.704 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:04.704 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-18T01:49:24.705 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T01:49:24.815 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:24.814+0000 7f92e23c6640 1 Processor -- start 2024-09-18T01:49:24.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:24.814+0000 7f92e23c6640 1 -- start start 2024-09-18T01:49:24.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:24.814+0000 7f92e23c6640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f92dc12cca0 0x7f92dc12d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:49:24.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:24.814+0000 7f92e23c6640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92dc12d5c0 con 0x7f92dc1290e0 2024-09-18T01:49:24.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:24.814+0000 7f92e23c6640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x7f92dc06e350 con 0x7f92dc12cca0 2024-09-18T01:49:24.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:24.814+0000 7f92dbfff640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f92dc12cca0 0x7f92dc12d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:49:24.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:24.814+0000 7f92db7fe640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f92dc1290e0 0x7f92dc129530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:46968/0 (socket says 172.21.15.129:46968) 2024-09-18T01:49:24.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:24.814+0000 7f92db7fe640 1 -- 172.21.15.129:0/259729499 learned_addr learned my addr 172.21.15.129:0/259729499 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-09-18T01:49:24.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:24.814+0000 7f92dbfff640 1 -- 172.21.15.129:0/259729499 >> v1:172.21.15.129:6789/0 conn(0x7f92dc1290e0 legacy=0x7f92dc129530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:49:24.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:24.814+0000 7f92dbfff640 1 -- 172.21.15.129:0/259729499 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92dc071f70 con 0x7f92dc12cca0 2024-09-18T01:49:24.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:24.815+0000 7f92dbfff640 1 --2- 172.21.15.129:0/259729499 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f92dc12cca0 0x7f92dc12d080 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f92cc009720 tx=0x7f92cc02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65dd978356978599 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:49:24.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:24.815+0000 7f92daffd640 1 -- 172.21.15.129:0/259729499 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92cc037070 con 0x7f92dc12cca0 2024-09-18T01:49:24.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:24.815+0000 7f92daffd640 1 -- 172.21.15.129:0/259729499 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92cc02ad90 con 0x7f92dc12cca0 2024-09-18T01:49:24.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:24.815+0000 7f92daffd640 1 -- 172.21.15.129:0/259729499 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92cc032590 con 0x7f92dc12cca0 2024-09-18T01:49:24.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:24.816+0000 7f92e23c6640 1 -- 172.21.15.129:0/259729499 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f92dc12cca0 msgr2=0x7f92dc12d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:49:24.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:24.816+0000 7f92e23c6640 1 --2- 172.21.15.129:0/259729499 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f92dc12cca0 0x7f92dc12d080 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f92cc009720 tx=0x7f92cc02a110 comp rx=0 tx=0).stop 2024-09-18T01:49:24.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:24.816+0000 7f92e23c6640 1 -- 172.21.15.129:0/259729499 shutdown_connections 2024-09-18T01:49:24.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:24.816+0000 7f92e23c6640 1 --2- 172.21.15.129:0/259729499 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f92dc12cca0 0x7f92dc12d080 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:49:24.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:24.816+0000 7f92e23c6640 1 -- 172.21.15.129:0/259729499 >> 172.21.15.129:0/259729499 conn(0x7f92dc09a890 msgr2=0x7f92dc09aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:49:24.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:24.816+0000 7f92e23c6640 1 -- 172.21.15.129:0/259729499 shutdown_connections 2024-09-18T01:49:24.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:24.816+0000 7f92e23c6640 1 -- 172.21.15.129:0/259729499 wait complete. 2024-09-18T01:49:24.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:24.817+0000 7f92e23c6640 1 Processor -- start 2024-09-18T01:49:24.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:24.817+0000 7f92e23c6640 1 -- start start 2024-09-18T01:49:24.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:24.817+0000 7f92e23c6640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f92dc1290e0 0x7f92dc1c1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:49:24.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:24.817+0000 7f92e23c6640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f92dc070e60 con 0x7f92dc1290e0 2024-09-18T01:49:24.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:24.817+0000 7f92dbfff640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f92dc1290e0 0x7f92dc1c1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:49:24.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:24.817+0000 7f92dbfff640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f92dc1290e0 0x7f92dc1c1820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:37020/0 (socket says 172.21.15.129:37020) 2024-09-18T01:49:24.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:24.817+0000 7f92dbfff640 1 -- 172.21.15.129:0/4241283776 learned_addr learned my addr 172.21.15.129:0/4241283776 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-18T01:49:24.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:24.818+0000 7f92dbfff640 1 -- 172.21.15.129:0/4241283776 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92dc08cb30 con 0x7f92dc1290e0 2024-09-18T01:49:24.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:24.818+0000 7f92dbfff640 1 --2- 172.21.15.129:0/4241283776 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f92dc1290e0 0x7f92dc1c1820 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f92cc000c00 tx=0x7f92cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:49:24.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:24.818+0000 7f92d8ff9640 1 -- 172.21.15.129:0/4241283776 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92cc037040 con 0x7f92dc1290e0 2024-09-18T01:49:24.821 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:24.818+0000 7f92d8ff9640 1 -- 172.21.15.129:0/4241283776 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92cc042070 con 0x7f92dc1290e0 2024-09-18T01:49:24.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:24.818+0000 7f92e23c6640 1 -- 172.21.15.129:0/4241283776 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92dc08c690 con 0x7f92dc1290e0 2024-09-18T01:49:24.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:24.818+0000 7f92d8ff9640 1 -- 172.21.15.129:0/4241283776 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92cc03d6e0 con 0x7f92dc1290e0 2024-09-18T01:49:24.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:24.818+0000 7f92e23c6640 1 -- 172.21.15.129:0/4241283776 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92dc08da80 con 0x7f92dc1290e0 2024-09-18T01:49:24.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:24.819+0000 7f92d8ff9640 1 -- 172.21.15.129:0/4241283776 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f92cc03d880 con 0x7f92dc1290e0 2024-09-18T01:49:24.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:24.819+0000 7f92e23c6640 1 -- 172.21.15.129:0/4241283776 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92dc08d300 con 0x7f92dc1290e0 2024-09-18T01:49:24.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:24.819+0000 7f92d8ff9640 1 --2- 172.21.15.129:0/4241283776 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f92bc0382a0 0x7f92bc03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:49:24.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:24.819+0000 7f92d8ff9640 1 -- 172.21.15.129:0/4241283776 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f92cc06c730 con 0x7f92dc1290e0 2024-09-18T01:49:24.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:24.820+0000 7f92db7fe640 1 --2- 172.21.15.129:0/4241283776 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f92bc0382a0 0x7f92bc03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:49:24.822 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:24.820+0000 7f92db7fe640 1 --2- 172.21.15.129:0/4241283776 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f92bc0382a0 0x7f92bc03a760 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f92c4007fd0 tx=0x7f92c4007ac0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:49:24.825 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:24.824+0000 7f92d8ff9640 1 -- 172.21.15.129:0/4241283776 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f92cc030e20 con 0x7f92dc1290e0 2024-09-18T01:49:24.988 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:24.987+0000 7f92e23c6640 1 -- 172.21.15.129:0/4241283776 --> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f92dc08e170 con 0x7f92bc0382a0 2024-09-18T01:49:25.003 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:25.002+0000 7f92d8ff9640 1 -- 172.21.15.129:0/4241283776 <== mgr.4099 v2:172.21.15.146:6824/168968651 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+664959 (secure 0 0 0) 0x7f92dc08e170 con 0x7f92bc0382a0 2024-09-18T01:49:25.010 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:49:25.016 INFO:teuthology.orchestra.run.smithi129.stderr:dumped all 2024-09-18T01:49:25.018 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:25.007+0000 7f92e23c6640 1 -- 172.21.15.129:0/4241283776 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f92bc0382a0 msgr2=0x7f92bc03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:49:25.018 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:25.007+0000 7f92e23c6640 1 --2- 172.21.15.129:0/4241283776 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f92bc0382a0 0x7f92bc03a760 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f92c4007fd0 tx=0x7f92c4007ac0 comp rx=0 tx=0).stop 2024-09-18T01:49:25.018 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:25.007+0000 7f92e23c6640 1 -- 172.21.15.129:0/4241283776 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f92dc1290e0 msgr2=0x7f92dc1c1820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:49:25.018 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:25.007+0000 7f92e23c6640 1 --2- 172.21.15.129:0/4241283776 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f92dc1290e0 0x7f92dc1c1820 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f92cc000c00 tx=0x7f92cc0046c0 comp rx=0 tx=0).stop 2024-09-18T01:49:25.018 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:25.007+0000 7f92e23c6640 1 -- 172.21.15.129:0/4241283776 shutdown_connections 2024-09-18T01:49:25.018 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:25.007+0000 7f92e23c6640 1 --2- 172.21.15.129:0/4241283776 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f92bc0382a0 0x7f92bc03a760 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:49:25.018 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:25.007+0000 7f92e23c6640 1 --2- 172.21.15.129:0/4241283776 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f92dc1290e0 0x7f92dc1c1820 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:49:25.018 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:25.007+0000 7f92e23c6640 1 -- 172.21.15.129:0/4241283776 >> 172.21.15.129:0/4241283776 conn(0x7f92dc09a890 msgr2=0x7f92dc09ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:49:25.018 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:25.007+0000 7f92e23c6640 1 -- 172.21.15.129:0/4241283776 shutdown_connections 2024-09-18T01:49:25.018 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:25.007+0000 7f92e23c6640 1 -- 172.21.15.129:0/4241283776 wait complete. 2024-09-18T01:49:25.019 INFO:teuthology.orchestra.run.smithi129.stdout:{"pg_ready":true,"pg_map":{"version":169,"stamp":"2024-09-18T01:49:24.262009+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":603113,"num_objects":254,"num_object_clones":0,"num_object_copies":508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":254,"num_whiteouts":0,"num_read":5366,"num_read_kb":4915,"num_write":2371,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2861,"num_omap_keys":15,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5006,"ondisk_log_size":5006,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":160896,"kb_used_data":2880,"kb_used_omap":6,"kb_used_meta":157945,"kb_avail":377326464,"statfs":{"total":386547056640,"available":386382299136,"internally_reserved":0,"allocated":2949120,"data_stored":1774636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":161736471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004013"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:08.035201+0000","last_change":"2024-09-18T01:49:08.035201+0000","last_active":"2024-09-18T01:49:08.035201+0000","last_peered":"2024-09-18T01:49:08.035201+0000","last_clean":"2024-09-18T01:49:08.035201+0000","last_became_active":"2024-09-18T01:45:04.287322+0000","last_became_peered":"2024-09-18T01:45:04.287322+0000","last_unstale":"2024-09-18T01:49:08.035201+0000","last_undegraded":"2024-09-18T01:49:08.035201+0000","last_fullsized":"2024-09-18T01:49:08.035201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:08.035082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:08.035082+0000","last_clean_scrub_stamp":"2024-09-18T01:49:08.035082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:28:41.589405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"33'8","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:43.875122+0000","last_change":"2024-09-18T01:48:43.875148+0000","last_active":"2024-09-18T01:48:43.875122+0000","last_peered":"2024-09-18T01:48:43.875122+0000","last_clean":"2024-09-18T01:48:43.875122+0000","last_became_active":"2024-09-18T01:45:06.295819+0000","last_became_peered":"2024-09-18T01:45:06.295819+0000","last_unstale":"2024-09-18T01:48:43.875122+0000","last_undegraded":"2024-09-18T01:48:43.875122+0000","last_fullsized":"2024-09-18T01:48:43.875122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-18T01:48:43.875034+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-18T01:48:43.875034+0000","last_clean_scrub_stamp":"2024-09-18T01:48:43.875034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:39:10.860642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:06.316407+0000","last_change":"2024-09-18T01:49:06.316407+0000","last_active":"2024-09-18T01:49:06.316407+0000","last_peered":"2024-09-18T01:49:06.316407+0000","last_clean":"2024-09-18T01:49:06.316407+0000","last_became_active":"2024-09-18T01:45:04.280591+0000","last_became_peered":"2024-09-18T01:45:04.280591+0000","last_unstale":"2024-09-18T01:49:06.316407+0000","last_undegraded":"2024-09-18T01:49:06.316407+0000","last_fullsized":"2024-09-18T01:49:06.316407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:06.316273+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:06.316273+0000","last_clean_scrub_stamp":"2024-09-18T01:49:06.316273+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:23:34.636704+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"33'12","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:07.934928+0000","last_change":"2024-09-18T01:49:07.934963+0000","last_active":"2024-09-18T01:49:07.934928+0000","last_peered":"2024-09-18T01:49:07.934928+0000","last_clean":"2024-09-18T01:49:07.934928+0000","last_became_active":"2024-09-18T01:45:06.281659+0000","last_became_peered":"2024-09-18T01:45:06.281659+0000","last_unstale":"2024-09-18T01:49:07.934928+0000","last_undegraded":"2024-09-18T01:49:07.934928+0000","last_fullsized":"2024-09-18T01:49:07.934928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-18T01:49:07.934844+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-18T01:49:07.934844+0000","last_clean_scrub_stamp":"2024-09-18T01:49:07.934844+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:40:23.892087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"33'5","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:19.942538+0000","last_change":"2024-09-18T01:49:19.942570+0000","last_active":"2024-09-18T01:49:19.942538+0000","last_peered":"2024-09-18T01:49:19.942538+0000","last_clean":"2024-09-18T01:49:19.942538+0000","last_became_active":"2024-09-18T01:45:04.286007+0000","last_became_peered":"2024-09-18T01:45:04.286007+0000","last_unstale":"2024-09-18T01:49:19.942538+0000","last_undegraded":"2024-09-18T01:49:19.942538+0000","last_fullsized":"2024-09-18T01:49:19.942538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-18T01:49:19.942440+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-18T01:49:19.942440+0000","last_clean_scrub_stamp":"2024-09-18T01:49:19.942440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:40:36.278314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"33'18","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:00.934191+0000","last_change":"2024-09-18T01:49:00.934242+0000","last_active":"2024-09-18T01:49:00.934191+0000","last_peered":"2024-09-18T01:49:00.934191+0000","last_clean":"2024-09-18T01:49:00.934191+0000","last_became_active":"2024-09-18T01:45:06.285378+0000","last_became_peered":"2024-09-18T01:45:06.285378+0000","last_unstale":"2024-09-18T01:49:00.934191+0000","last_undegraded":"2024-09-18T01:49:00.934191+0000","last_fullsized":"2024-09-18T01:49:00.934191+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'18","last_scrub_stamp":"2024-09-18T01:49:00.934082+0000","last_deep_scrub":"33'18","last_deep_scrub_stamp":"2024-09-18T01:49:00.934082+0000","last_clean_scrub_stamp":"2024-09-18T01:49:00.934082+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:48:56.120020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":40,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:49.054796+0000","last_change":"2024-09-18T01:48:49.054796+0000","last_active":"2024-09-18T01:48:49.054796+0000","last_peered":"2024-09-18T01:48:49.054796+0000","last_clean":"2024-09-18T01:48:49.054796+0000","last_became_active":"2024-09-18T01:45:04.297791+0000","last_became_peered":"2024-09-18T01:45:04.297791+0000","last_unstale":"2024-09-18T01:48:49.054796+0000","last_undegraded":"2024-09-18T01:48:49.054796+0000","last_fullsized":"2024-09-18T01:48:49.054796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:49.054679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:49.054679+0000","last_clean_scrub_stamp":"2024-09-18T01:48:49.054679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:23:20.643124+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"33'8","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:09.877827+0000","last_change":"2024-09-18T01:49:09.877886+0000","last_active":"2024-09-18T01:49:09.877827+0000","last_peered":"2024-09-18T01:49:09.877827+0000","last_clean":"2024-09-18T01:49:09.877827+0000","last_became_active":"2024-09-18T01:45:06.280779+0000","last_became_peered":"2024-09-18T01:45:06.280779+0000","last_unstale":"2024-09-18T01:49:09.877827+0000","last_undegraded":"2024-09-18T01:49:09.877827+0000","last_fullsized":"2024-09-18T01:49:09.877827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-18T01:49:09.877733+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-18T01:49:09.877733+0000","last_clean_scrub_stamp":"2024-09-18T01:49:09.877733+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:42:04.010151+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:37.219085+0000","last_change":"2024-09-18T01:45:04.280905+0000","last_active":"2024-09-18T01:47:37.219085+0000","last_peered":"2024-09-18T01:47:37.219085+0000","last_clean":"2024-09-18T01:47:37.219085+0000","last_became_active":"2024-09-18T01:45:04.280582+0000","last_became_peered":"2024-09-18T01:45:04.280582+0000","last_unstale":"2024-09-18T01:47:37.219085+0000","last_undegraded":"2024-09-18T01:47:37.219085+0000","last_fullsized":"2024-09-18T01:47:37.219085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'12","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:53.032110+0000","last_change":"2024-09-18T01:48:53.032110+0000","last_active":"2024-09-18T01:48:53.032110+0000","last_peered":"2024-09-18T01:48:53.032110+0000","last_clean":"2024-09-18T01:48:53.032110+0000","last_became_active":"2024-09-18T01:45:06.289036+0000","last_became_peered":"2024-09-18T01:45:06.289036+0000","last_unstale":"2024-09-18T01:48:53.032110+0000","last_undegraded":"2024-09-18T01:48:53.032110+0000","last_fullsized":"2024-09-18T01:48:53.032110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-18T01:48:53.031994+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-18T01:48:53.031994+0000","last_clean_scrub_stamp":"2024-09-18T01:48:53.031994+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:49:17.553448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:04.058776+0000","last_change":"2024-09-18T01:49:04.058805+0000","last_active":"2024-09-18T01:49:04.058776+0000","last_peered":"2024-09-18T01:49:04.058776+0000","last_clean":"2024-09-18T01:49:04.058776+0000","last_became_active":"2024-09-18T01:45:04.286509+0000","last_became_peered":"2024-09-18T01:45:04.286509+0000","last_unstale":"2024-09-18T01:49:04.058776+0000","last_undegraded":"2024-09-18T01:49:04.058776+0000","last_fullsized":"2024-09-18T01:49:04.058776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:04.058678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:04.058678+0000","last_clean_scrub_stamp":"2024-09-18T01:49:04.058678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:39:50.767742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:42.024918+0000","last_change":"2024-09-18T01:48:42.024918+0000","last_active":"2024-09-18T01:48:42.024918+0000","last_peered":"2024-09-18T01:48:42.024918+0000","last_clean":"2024-09-18T01:48:42.024918+0000","last_became_active":"2024-09-18T01:45:06.287110+0000","last_became_peered":"2024-09-18T01:45:06.287110+0000","last_unstale":"2024-09-18T01:48:42.024918+0000","last_undegraded":"2024-09-18T01:48:42.024918+0000","last_fullsized":"2024-09-18T01:48:42.024918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:48:42.024803+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:48:42.024803+0000","last_clean_scrub_stamp":"2024-09-18T01:48:42.024803+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:37:11.999864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:15.881268+0000","last_change":"2024-09-18T01:49:15.881301+0000","last_active":"2024-09-18T01:49:15.881268+0000","last_peered":"2024-09-18T01:49:15.881268+0000","last_clean":"2024-09-18T01:49:15.881268+0000","last_became_active":"2024-09-18T01:45:04.289290+0000","last_became_peered":"2024-09-18T01:45:04.289290+0000","last_unstale":"2024-09-18T01:49:15.881268+0000","last_undegraded":"2024-09-18T01:49:15.881268+0000","last_fullsized":"2024-09-18T01:49:15.881268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:49:15.881149+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:49:15.881149+0000","last_clean_scrub_stamp":"2024-09-18T01:49:15.881149+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:23:57.699141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'14","reported_seq":80,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:45.086505+0000","last_change":"2024-09-18T01:48:45.086505+0000","last_active":"2024-09-18T01:48:45.086505+0000","last_peered":"2024-09-18T01:48:45.086505+0000","last_clean":"2024-09-18T01:48:45.086505+0000","last_became_active":"2024-09-18T01:45:06.295429+0000","last_became_peered":"2024-09-18T01:45:06.295429+0000","last_unstale":"2024-09-18T01:48:45.086505+0000","last_undegraded":"2024-09-18T01:48:45.086505+0000","last_fullsized":"2024-09-18T01:48:45.086505+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-09-18T01:48:45.086369+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-09-18T01:48:45.086369+0000","last_clean_scrub_stamp":"2024-09-18T01:48:45.086369+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:14:18.256239+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:16.394781+0000","last_change":"2024-09-18T01:49:16.394839+0000","last_active":"2024-09-18T01:49:16.394781+0000","last_peered":"2024-09-18T01:49:16.394781+0000","last_clean":"2024-09-18T01:49:16.394781+0000","last_became_active":"2024-09-18T01:45:04.273328+0000","last_became_peered":"2024-09-18T01:45:04.273328+0000","last_unstale":"2024-09-18T01:49:16.394781+0000","last_undegraded":"2024-09-18T01:49:16.394781+0000","last_fullsized":"2024-09-18T01:49:16.394781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:16.394672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:16.394672+0000","last_clean_scrub_stamp":"2024-09-18T01:49:16.394672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:48:30.113176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'10","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:56.083996+0000","last_change":"2024-09-18T01:48:56.083996+0000","last_active":"2024-09-18T01:48:56.083996+0000","last_peered":"2024-09-18T01:48:56.083996+0000","last_clean":"2024-09-18T01:48:56.083996+0000","last_became_active":"2024-09-18T01:45:06.284994+0000","last_became_peered":"2024-09-18T01:45:06.284994+0000","last_unstale":"2024-09-18T01:48:56.083996+0000","last_undegraded":"2024-09-18T01:48:56.083996+0000","last_fullsized":"2024-09-18T01:48:56.083996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-18T01:48:56.083802+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-18T01:48:56.083802+0000","last_clean_scrub_stamp":"2024-09-18T01:48:56.083802+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:24:40.822016+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"33'4","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:59.956051+0000","last_change":"2024-09-18T01:48:59.956077+0000","last_active":"2024-09-18T01:48:59.956051+0000","last_peered":"2024-09-18T01:48:59.956051+0000","last_clean":"2024-09-18T01:48:59.956051+0000","last_became_active":"2024-09-18T01:45:06.286524+0000","last_became_peered":"2024-09-18T01:45:06.286524+0000","last_unstale":"2024-09-18T01:48:59.956051+0000","last_undegraded":"2024-09-18T01:48:59.956051+0000","last_fullsized":"2024-09-18T01:48:59.956051+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:48:59.955964+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:48:59.955964+0000","last_clean_scrub_stamp":"2024-09-18T01:48:59.955964+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:47:30.798351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:00.111939+0000","last_change":"2024-09-18T01:49:00.111985+0000","last_active":"2024-09-18T01:49:00.111939+0000","last_peered":"2024-09-18T01:49:00.111939+0000","last_clean":"2024-09-18T01:49:00.111939+0000","last_became_active":"2024-09-18T01:45:04.298399+0000","last_became_peered":"2024-09-18T01:45:04.298399+0000","last_unstale":"2024-09-18T01:49:00.111939+0000","last_undegraded":"2024-09-18T01:49:00.111939+0000","last_fullsized":"2024-09-18T01:49:00.111939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:00.111843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:00.111843+0000","last_clean_scrub_stamp":"2024-09-18T01:49:00.111843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:39:05.538284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"33'10","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:48.963664+0000","last_change":"2024-09-18T01:48:48.963691+0000","last_active":"2024-09-18T01:48:48.963664+0000","last_peered":"2024-09-18T01:48:48.963664+0000","last_clean":"2024-09-18T01:48:48.963664+0000","last_became_active":"2024-09-18T01:45:06.294670+0000","last_became_peered":"2024-09-18T01:45:06.294670+0000","last_unstale":"2024-09-18T01:48:48.963664+0000","last_undegraded":"2024-09-18T01:48:48.963664+0000","last_fullsized":"2024-09-18T01:48:48.963664+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-18T01:48:48.963573+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-18T01:48:48.963573+0000","last_clean_scrub_stamp":"2024-09-18T01:48:48.963573+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:47:46.867517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:05.082389+0000","last_change":"2024-09-18T01:49:05.082415+0000","last_active":"2024-09-18T01:49:05.082389+0000","last_peered":"2024-09-18T01:49:05.082389+0000","last_clean":"2024-09-18T01:49:05.082389+0000","last_became_active":"2024-09-18T01:45:04.286465+0000","last_became_peered":"2024-09-18T01:45:04.286465+0000","last_unstale":"2024-09-18T01:49:05.082389+0000","last_undegraded":"2024-09-18T01:49:05.082389+0000","last_fullsized":"2024-09-18T01:49:05.082389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:05.082258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:05.082258+0000","last_clean_scrub_stamp":"2024-09-18T01:49:05.082258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:16:06.564943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:49.977271+0000","last_change":"2024-09-18T01:48:49.977300+0000","last_active":"2024-09-18T01:48:49.977271+0000","last_peered":"2024-09-18T01:48:49.977271+0000","last_clean":"2024-09-18T01:48:49.977271+0000","last_became_active":"2024-09-18T01:45:06.294118+0000","last_became_peered":"2024-09-18T01:45:06.294118+0000","last_unstale":"2024-09-18T01:48:49.977271+0000","last_undegraded":"2024-09-18T01:48:49.977271+0000","last_fullsized":"2024-09-18T01:48:49.977271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:48:49.977187+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:48:49.977187+0000","last_clean_scrub_stamp":"2024-09-18T01:48:49.977187+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:09:54.691187+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:08.073194+0000","last_change":"2024-09-18T01:49:08.073231+0000","last_active":"2024-09-18T01:49:08.073194+0000","last_peered":"2024-09-18T01:49:08.073194+0000","last_clean":"2024-09-18T01:49:08.073194+0000","last_became_active":"2024-09-18T01:45:04.294327+0000","last_became_peered":"2024-09-18T01:45:04.294327+0000","last_unstale":"2024-09-18T01:49:08.073194+0000","last_undegraded":"2024-09-18T01:49:08.073194+0000","last_fullsized":"2024-09-18T01:49:08.073194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:08.073097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:08.073097+0000","last_clean_scrub_stamp":"2024-09-18T01:49:08.073097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:33:22.408363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'4","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:05.363099+0000","last_change":"2024-09-18T01:49:05.363125+0000","last_active":"2024-09-18T01:49:05.363099+0000","last_peered":"2024-09-18T01:49:05.363099+0000","last_clean":"2024-09-18T01:49:05.363099+0000","last_became_active":"2024-09-18T01:45:06.285429+0000","last_became_peered":"2024-09-18T01:45:06.285429+0000","last_unstale":"2024-09-18T01:49:05.363099+0000","last_undegraded":"2024-09-18T01:49:05.363099+0000","last_fullsized":"2024-09-18T01:49:05.363099+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:49:05.363015+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:49:05.363015+0000","last_clean_scrub_stamp":"2024-09-18T01:49:05.363015+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:53:08.090252+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:58.089164+0000","last_change":"2024-09-18T01:48:58.089192+0000","last_active":"2024-09-18T01:48:58.089164+0000","last_peered":"2024-09-18T01:48:58.089164+0000","last_clean":"2024-09-18T01:48:58.089164+0000","last_became_active":"2024-09-18T01:45:04.298601+0000","last_became_peered":"2024-09-18T01:45:04.298601+0000","last_unstale":"2024-09-18T01:48:58.089164+0000","last_undegraded":"2024-09-18T01:48:58.089164+0000","last_fullsized":"2024-09-18T01:48:58.089164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:58.089075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:58.089075+0000","last_clean_scrub_stamp":"2024-09-18T01:48:58.089075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:14:10.025695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'10","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:00.074915+0000","last_change":"2024-09-18T01:49:00.074940+0000","last_active":"2024-09-18T01:49:00.074915+0000","last_peered":"2024-09-18T01:49:00.074915+0000","last_clean":"2024-09-18T01:49:00.074915+0000","last_became_active":"2024-09-18T01:45:06.285228+0000","last_became_peered":"2024-09-18T01:45:06.285228+0000","last_unstale":"2024-09-18T01:49:00.074915+0000","last_undegraded":"2024-09-18T01:49:00.074915+0000","last_fullsized":"2024-09-18T01:49:00.074915+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-18T01:49:00.074829+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-18T01:49:00.074829+0000","last_clean_scrub_stamp":"2024-09-18T01:49:00.074829+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:14:47.671460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:04.355120+0000","last_change":"2024-09-18T01:49:04.355158+0000","last_active":"2024-09-18T01:49:04.355120+0000","last_peered":"2024-09-18T01:49:04.355120+0000","last_clean":"2024-09-18T01:49:04.355120+0000","last_became_active":"2024-09-18T01:45:04.281118+0000","last_became_peered":"2024-09-18T01:45:04.281118+0000","last_unstale":"2024-09-18T01:49:04.355120+0000","last_undegraded":"2024-09-18T01:49:04.355120+0000","last_fullsized":"2024-09-18T01:49:04.355120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:04.355016+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:04.355016+0000","last_clean_scrub_stamp":"2024-09-18T01:49:04.355016+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:04:07.222319+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"33'16","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:54.067694+0000","last_change":"2024-09-18T01:48:54.067746+0000","last_active":"2024-09-18T01:48:54.067694+0000","last_peered":"2024-09-18T01:48:54.067694+0000","last_clean":"2024-09-18T01:48:54.067694+0000","last_became_active":"2024-09-18T01:45:06.284237+0000","last_became_peered":"2024-09-18T01:45:06.284237+0000","last_unstale":"2024-09-18T01:48:54.067694+0000","last_undegraded":"2024-09-18T01:48:54.067694+0000","last_fullsized":"2024-09-18T01:48:54.067694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2024-09-18T01:48:54.067597+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2024-09-18T01:48:54.067597+0000","last_clean_scrub_stamp":"2024-09-18T01:48:54.067597+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:44:52.155664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":48,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:27.217055+0000","last_change":"2024-09-18T01:45:04.285185+0000","last_active":"2024-09-18T01:47:27.217055+0000","last_peered":"2024-09-18T01:47:27.217055+0000","last_clean":"2024-09-18T01:47:27.217055+0000","last_became_active":"2024-09-18T01:45:04.284148+0000","last_became_peered":"2024-09-18T01:45:04.284148+0000","last_unstale":"2024-09-18T01:47:27.217055+0000","last_undegraded":"2024-09-18T01:47:27.217055+0000","last_fullsized":"2024-09-18T01:47:27.217055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'36","reported_seq":109,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:18.085041+0000","last_change":"2024-09-18T01:49:18.085074+0000","last_active":"2024-09-18T01:49:18.085041+0000","last_peered":"2024-09-18T01:49:18.085041+0000","last_clean":"2024-09-18T01:49:18.085041+0000","last_became_active":"2024-09-18T01:45:14.322729+0000","last_became_peered":"2024-09-18T01:45:14.322729+0000","last_unstale":"2024-09-18T01:49:18.085041+0000","last_undegraded":"2024-09-18T01:49:18.085041+0000","last_fullsized":"2024-09-18T01:49:18.085041+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'36","last_scrub_stamp":"2024-09-18T01:49:18.084950+0000","last_deep_scrub":"33'36","last_deep_scrub_stamp":"2024-09-18T01:49:18.084950+0000","last_clean_scrub_stamp":"2024-09-18T01:49:18.084950+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:39:22.889311+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'10","reported_seq":82,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:08.901679+0000","last_change":"2024-09-18T01:49:08.901728+0000","last_active":"2024-09-18T01:49:08.901679+0000","last_peered":"2024-09-18T01:49:08.901679+0000","last_clean":"2024-09-18T01:49:08.901679+0000","last_became_active":"2024-09-18T01:45:06.281361+0000","last_became_peered":"2024-09-18T01:45:06.281361+0000","last_unstale":"2024-09-18T01:49:08.901679+0000","last_undegraded":"2024-09-18T01:49:08.901679+0000","last_fullsized":"2024-09-18T01:49:08.901679+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-18T01:49:08.901575+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-18T01:49:08.901575+0000","last_clean_scrub_stamp":"2024-09-18T01:49:08.901575+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:51:58.229652+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.488665+0000","last_change":"2024-09-18T01:45:04.285350+0000","last_active":"2024-09-18T01:48:19.488665+0000","last_peered":"2024-09-18T01:48:19.488665+0000","last_clean":"2024-09-18T01:48:19.488665+0000","last_became_active":"2024-09-18T01:45:04.285008+0000","last_became_peered":"2024-09-18T01:45:04.285008+0000","last_unstale":"2024-09-18T01:48:19.488665+0000","last_undegraded":"2024-09-18T01:48:19.488665+0000","last_fullsized":"2024-09-18T01:48:19.488665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:25.014640+0000","last_change":"2024-09-18T01:48:25.014675+0000","last_active":"2024-09-18T01:48:25.014640+0000","last_peered":"2024-09-18T01:48:25.014640+0000","last_clean":"2024-09-18T01:48:25.014640+0000","last_became_active":"2024-09-18T01:45:08.296241+0000","last_became_peered":"2024-09-18T01:45:08.296241+0000","last_unstale":"2024-09-18T01:48:25.014640+0000","last_undegraded":"2024-09-18T01:48:25.014640+0000","last_fullsized":"2024-09-18T01:48:25.014640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:25.014547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:25.014547+0000","last_clean_scrub_stamp":"2024-09-18T01:48:25.014547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:06:32.938495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'51","reported_seq":118,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:29.025471+0000","last_change":"2024-09-18T01:48:29.025537+0000","last_active":"2024-09-18T01:48:29.025471+0000","last_peered":"2024-09-18T01:48:29.025471+0000","last_clean":"2024-09-18T01:48:29.025471+0000","last_became_active":"2024-09-18T01:45:10.305713+0000","last_became_peered":"2024-09-18T01:45:10.305713+0000","last_unstale":"2024-09-18T01:48:29.025471+0000","last_undegraded":"2024-09-18T01:48:29.025471+0000","last_fullsized":"2024-09-18T01:48:29.025471+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'51","last_scrub_stamp":"2024-09-18T01:48:29.025349+0000","last_deep_scrub":"33'51","last_deep_scrub_stamp":"2024-09-18T01:48:29.025349+0000","last_clean_scrub_stamp":"2024-09-18T01:48:29.025349+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:55:10.299048+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:26.973099+0000","last_change":"2024-09-18T01:48:26.973124+0000","last_active":"2024-09-18T01:48:26.973099+0000","last_peered":"2024-09-18T01:48:26.973099+0000","last_clean":"2024-09-18T01:48:26.973099+0000","last_became_active":"2024-09-18T01:45:12.313276+0000","last_became_peered":"2024-09-18T01:45:12.313276+0000","last_unstale":"2024-09-18T01:48:26.973099+0000","last_undegraded":"2024-09-18T01:48:26.973099+0000","last_fullsized":"2024-09-18T01:48:26.973099+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:26.973012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:26.973012+0000","last_clean_scrub_stamp":"2024-09-18T01:48:26.973012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:54:46.334494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'7","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:46.918917+0000","last_change":"2024-09-18T01:48:46.918960+0000","last_active":"2024-09-18T01:48:46.918917+0000","last_peered":"2024-09-18T01:48:46.918917+0000","last_clean":"2024-09-18T01:48:46.918917+0000","last_became_active":"2024-09-18T01:45:14.318093+0000","last_became_peered":"2024-09-18T01:45:14.318093+0000","last_unstale":"2024-09-18T01:48:46.918917+0000","last_undegraded":"2024-09-18T01:48:46.918917+0000","last_fullsized":"2024-09-18T01:48:46.918917+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-09-18T01:48:46.918798+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-09-18T01:48:46.918798+0000","last_clean_scrub_stamp":"2024-09-18T01:48:46.918798+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:14:34.515429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"33'14","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:16.116506+0000","last_change":"2024-09-18T01:49:16.116550+0000","last_active":"2024-09-18T01:49:16.116506+0000","last_peered":"2024-09-18T01:49:16.116506+0000","last_clean":"2024-09-18T01:49:16.116506+0000","last_became_active":"2024-09-18T01:45:41.338243+0000","last_became_peered":"2024-09-18T01:45:41.338243+0000","last_unstale":"2024-09-18T01:49:16.116506+0000","last_undegraded":"2024-09-18T01:49:16.116506+0000","last_fullsized":"2024-09-18T01:49:16.116506+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-09-18T01:49:16.116373+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-09-18T01:49:16.116373+0000","last_clean_scrub_stamp":"2024-09-18T01:49:16.116373+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:55:17.064370+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":13,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:53.039033+0000","last_change":"2024-09-18T01:48:53.039071+0000","last_active":"2024-09-18T01:48:53.039033+0000","last_peered":"2024-09-18T01:48:53.039033+0000","last_clean":"2024-09-18T01:48:53.039033+0000","last_became_active":"2024-09-18T01:45:04.292853+0000","last_became_peered":"2024-09-18T01:45:04.292853+0000","last_unstale":"2024-09-18T01:48:53.039033+0000","last_undegraded":"2024-09-18T01:48:53.039033+0000","last_fullsized":"2024-09-18T01:48:53.039033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:48:53.038933+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:48:53.038933+0000","last_clean_scrub_stamp":"2024-09-18T01:48:53.038933+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:24:38.409165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:47.382739+0000","last_change":"2024-09-18T01:48:47.382764+0000","last_active":"2024-09-18T01:48:47.382739+0000","last_peered":"2024-09-18T01:48:47.382739+0000","last_clean":"2024-09-18T01:48:47.382739+0000","last_became_active":"2024-09-18T01:45:08.288390+0000","last_became_peered":"2024-09-18T01:45:08.288390+0000","last_unstale":"2024-09-18T01:48:47.382739+0000","last_undegraded":"2024-09-18T01:48:47.382739+0000","last_fullsized":"2024-09-18T01:48:47.382739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:47.382647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:47.382647+0000","last_clean_scrub_stamp":"2024-09-18T01:48:47.382647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:54:16.834483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"33'16","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:28.924284+0000","last_change":"2024-09-18T01:48:28.924317+0000","last_active":"2024-09-18T01:48:28.924284+0000","last_peered":"2024-09-18T01:48:28.924284+0000","last_clean":"2024-09-18T01:48:28.924284+0000","last_became_active":"2024-09-18T01:45:10.302957+0000","last_became_peered":"2024-09-18T01:45:10.302957+0000","last_unstale":"2024-09-18T01:48:28.924284+0000","last_undegraded":"2024-09-18T01:48:28.924284+0000","last_fullsized":"2024-09-18T01:48:28.924284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2024-09-18T01:48:28.924202+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2024-09-18T01:48:28.924202+0000","last_clean_scrub_stamp":"2024-09-18T01:48:28.924202+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:40:38.196180+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:34.948777+0000","last_change":"2024-09-18T01:48:34.948803+0000","last_active":"2024-09-18T01:48:34.948777+0000","last_peered":"2024-09-18T01:48:34.948777+0000","last_clean":"2024-09-18T01:48:34.948777+0000","last_became_active":"2024-09-18T01:45:12.317471+0000","last_became_peered":"2024-09-18T01:45:12.317471+0000","last_unstale":"2024-09-18T01:48:34.948777+0000","last_undegraded":"2024-09-18T01:48:34.948777+0000","last_fullsized":"2024-09-18T01:48:34.948777+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:34.948683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:34.948683+0000","last_clean_scrub_stamp":"2024-09-18T01:48:34.948683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:47:33.161713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:47.217975+0000","last_change":"2024-09-18T01:45:14.319762+0000","last_active":"2024-09-18T01:47:47.217975+0000","last_peered":"2024-09-18T01:47:47.217975+0000","last_clean":"2024-09-18T01:47:47.217975+0000","last_became_active":"2024-09-18T01:45:14.319387+0000","last_became_peered":"2024-09-18T01:45:14.319387+0000","last_unstale":"2024-09-18T01:47:47.217975+0000","last_undegraded":"2024-09-18T01:47:47.217975+0000","last_fullsized":"2024-09-18T01:47:47.217975+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'10","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:03.891051+0000","last_change":"2024-09-18T01:49:03.891076+0000","last_active":"2024-09-18T01:49:03.891051+0000","last_peered":"2024-09-18T01:49:03.891051+0000","last_clean":"2024-09-18T01:49:03.891051+0000","last_became_active":"2024-09-18T01:45:06.283815+0000","last_became_peered":"2024-09-18T01:45:06.283815+0000","last_unstale":"2024-09-18T01:49:03.891051+0000","last_undegraded":"2024-09-18T01:49:03.891051+0000","last_fullsized":"2024-09-18T01:49:03.891051+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-18T01:49:03.890961+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-18T01:49:03.890961+0000","last_clean_scrub_stamp":"2024-09-18T01:49:03.890961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:29:40.610319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:27.216997+0000","last_change":"2024-09-18T01:45:04.293546+0000","last_active":"2024-09-18T01:47:27.216997+0000","last_peered":"2024-09-18T01:47:27.216997+0000","last_clean":"2024-09-18T01:47:27.216997+0000","last_became_active":"2024-09-18T01:45:04.288040+0000","last_became_peered":"2024-09-18T01:45:04.288040+0000","last_unstale":"2024-09-18T01:47:27.216997+0000","last_undegraded":"2024-09-18T01:47:27.216997+0000","last_fullsized":"2024-09-18T01:47:27.216997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:46.362514+0000","last_change":"2024-09-18T01:48:46.362538+0000","last_active":"2024-09-18T01:48:46.362514+0000","last_peered":"2024-09-18T01:48:46.362514+0000","last_clean":"2024-09-18T01:48:46.362514+0000","last_became_active":"2024-09-18T01:45:08.288667+0000","last_became_peered":"2024-09-18T01:45:08.288667+0000","last_unstale":"2024-09-18T01:48:46.362514+0000","last_undegraded":"2024-09-18T01:48:46.362514+0000","last_fullsized":"2024-09-18T01:48:46.362514+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:46.362403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:46.362403+0000","last_clean_scrub_stamp":"2024-09-18T01:48:46.362403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:47:44.266347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'30","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:29.796863+0000","last_change":"2024-09-18T01:48:29.796918+0000","last_active":"2024-09-18T01:48:29.796863+0000","last_peered":"2024-09-18T01:48:29.796863+0000","last_clean":"2024-09-18T01:48:29.796863+0000","last_became_active":"2024-09-18T01:45:10.304004+0000","last_became_peered":"2024-09-18T01:45:10.304004+0000","last_unstale":"2024-09-18T01:48:29.796863+0000","last_undegraded":"2024-09-18T01:48:29.796863+0000","last_fullsized":"2024-09-18T01:48:29.796863+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'30","last_scrub_stamp":"2024-09-18T01:48:29.796760+0000","last_deep_scrub":"33'30","last_deep_scrub_stamp":"2024-09-18T01:48:29.796760+0000","last_clean_scrub_stamp":"2024-09-18T01:48:29.796760+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:49:27.020491+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'286","reported_seq":397,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:58.927095+0000","last_change":"2024-09-18T01:48:58.927175+0000","last_active":"2024-09-18T01:48:58.927095+0000","last_peered":"2024-09-18T01:48:58.927095+0000","last_clean":"2024-09-18T01:48:58.927095+0000","last_became_active":"2024-09-18T01:45:12.317288+0000","last_became_peered":"2024-09-18T01:45:12.317288+0000","last_unstale":"2024-09-18T01:48:58.927095+0000","last_undegraded":"2024-09-18T01:48:58.927095+0000","last_fullsized":"2024-09-18T01:48:58.927095+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'286","last_scrub_stamp":"2024-09-18T01:48:58.926983+0000","last_deep_scrub":"33'286","last_deep_scrub_stamp":"2024-09-18T01:48:58.926983+0000","last_clean_scrub_stamp":"2024-09-18T01:48:58.926983+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:03:15.512790+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:15.087093+0000","last_change":"2024-09-18T01:49:15.087120+0000","last_active":"2024-09-18T01:49:15.087093+0000","last_peered":"2024-09-18T01:49:15.087093+0000","last_clean":"2024-09-18T01:49:15.087093+0000","last_became_active":"2024-09-18T01:45:14.325843+0000","last_became_peered":"2024-09-18T01:45:14.325843+0000","last_unstale":"2024-09-18T01:49:15.087093+0000","last_undegraded":"2024-09-18T01:49:15.087093+0000","last_fullsized":"2024-09-18T01:49:15.087093+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:15.086999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:15.086999+0000","last_clean_scrub_stamp":"2024-09-18T01:49:15.086999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:25:53.638995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:50.402715+0000","last_change":"2024-09-18T01:48:50.402744+0000","last_active":"2024-09-18T01:48:50.402715+0000","last_peered":"2024-09-18T01:48:50.402715+0000","last_clean":"2024-09-18T01:48:50.402715+0000","last_became_active":"2024-09-18T01:45:06.295417+0000","last_became_peered":"2024-09-18T01:45:06.295417+0000","last_unstale":"2024-09-18T01:48:50.402715+0000","last_undegraded":"2024-09-18T01:48:50.402715+0000","last_fullsized":"2024-09-18T01:48:50.402715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:50.402623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:50.402623+0000","last_clean_scrub_stamp":"2024-09-18T01:48:50.402623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:19:27.434267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:10.036613+0000","last_change":"2024-09-18T01:49:10.036641+0000","last_active":"2024-09-18T01:49:10.036613+0000","last_peered":"2024-09-18T01:49:10.036613+0000","last_clean":"2024-09-18T01:49:10.036613+0000","last_became_active":"2024-09-18T01:45:04.282500+0000","last_became_peered":"2024-09-18T01:45:04.282500+0000","last_unstale":"2024-09-18T01:49:10.036613+0000","last_undegraded":"2024-09-18T01:49:10.036613+0000","last_fullsized":"2024-09-18T01:49:10.036613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:10.036519+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:10.036519+0000","last_clean_scrub_stamp":"2024-09-18T01:49:10.036519+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:23:38.356950+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:27.978926+0000","last_change":"2024-09-18T01:48:27.978949+0000","last_active":"2024-09-18T01:48:27.978926+0000","last_peered":"2024-09-18T01:48:27.978926+0000","last_clean":"2024-09-18T01:48:27.978926+0000","last_became_active":"2024-09-18T01:45:08.296192+0000","last_became_peered":"2024-09-18T01:45:08.296192+0000","last_unstale":"2024-09-18T01:48:27.978926+0000","last_undegraded":"2024-09-18T01:48:27.978926+0000","last_fullsized":"2024-09-18T01:48:27.978926+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:27.978844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:27.978844+0000","last_clean_scrub_stamp":"2024-09-18T01:48:27.978844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:53:57.430680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'43","reported_seq":104,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:26.798254+0000","last_change":"2024-09-18T01:48:26.798290+0000","last_active":"2024-09-18T01:48:26.798254+0000","last_peered":"2024-09-18T01:48:26.798254+0000","last_clean":"2024-09-18T01:48:26.798254+0000","last_became_active":"2024-09-18T01:45:10.305515+0000","last_became_peered":"2024-09-18T01:45:10.305515+0000","last_unstale":"2024-09-18T01:48:26.798254+0000","last_undegraded":"2024-09-18T01:48:26.798254+0000","last_fullsized":"2024-09-18T01:48:26.798254+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-09-18T01:48:26.798150+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-09-18T01:48:26.798150+0000","last_clean_scrub_stamp":"2024-09-18T01:48:26.798150+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:49:57.532711+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'285","reported_seq":412,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:41.311359+0000","last_change":"2024-09-18T01:48:41.311390+0000","last_active":"2024-09-18T01:48:41.311359+0000","last_peered":"2024-09-18T01:48:41.311359+0000","last_clean":"2024-09-18T01:48:41.311359+0000","last_became_active":"2024-09-18T01:45:12.313219+0000","last_became_peered":"2024-09-18T01:45:12.313219+0000","last_unstale":"2024-09-18T01:48:41.311359+0000","last_undegraded":"2024-09-18T01:48:41.311359+0000","last_fullsized":"2024-09-18T01:48:41.311359+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-18T01:48:41.311241+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-18T01:48:41.311241+0000","last_clean_scrub_stamp":"2024-09-18T01:48:41.311241+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:53:48.228429+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:38.059825+0000","last_change":"2024-09-18T01:48:38.059865+0000","last_active":"2024-09-18T01:48:38.059825+0000","last_peered":"2024-09-18T01:48:38.059825+0000","last_clean":"2024-09-18T01:48:38.059825+0000","last_became_active":"2024-09-18T01:45:06.297283+0000","last_became_peered":"2024-09-18T01:45:06.297283+0000","last_unstale":"2024-09-18T01:48:38.059825+0000","last_undegraded":"2024-09-18T01:48:38.059825+0000","last_fullsized":"2024-09-18T01:48:38.059825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-18T01:48:38.059683+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-18T01:48:38.059683+0000","last_clean_scrub_stamp":"2024-09-18T01:48:38.059683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:38:43.486124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:01.044750+0000","last_change":"2024-09-18T01:49:01.044789+0000","last_active":"2024-09-18T01:49:01.044750+0000","last_peered":"2024-09-18T01:49:01.044750+0000","last_clean":"2024-09-18T01:49:01.044750+0000","last_became_active":"2024-09-18T01:45:04.289629+0000","last_became_peered":"2024-09-18T01:45:04.289629+0000","last_unstale":"2024-09-18T01:49:01.044750+0000","last_undegraded":"2024-09-18T01:49:01.044750+0000","last_fullsized":"2024-09-18T01:49:01.044750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:01.044645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:01.044645+0000","last_clean_scrub_stamp":"2024-09-18T01:49:01.044645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:49:00.735559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:35.930454+0000","last_change":"2024-09-18T01:48:35.930488+0000","last_active":"2024-09-18T01:48:35.930454+0000","last_peered":"2024-09-18T01:48:35.930454+0000","last_clean":"2024-09-18T01:48:35.930454+0000","last_became_active":"2024-09-18T01:45:08.294273+0000","last_became_peered":"2024-09-18T01:45:08.294273+0000","last_unstale":"2024-09-18T01:48:35.930454+0000","last_undegraded":"2024-09-18T01:48:35.930454+0000","last_fullsized":"2024-09-18T01:48:35.930454+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:35.930363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:35.930363+0000","last_clean_scrub_stamp":"2024-09-18T01:48:35.930363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:23:07.518807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'58","reported_seq":124,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:33.850412+0000","last_change":"2024-09-18T01:48:33.850466+0000","last_active":"2024-09-18T01:48:33.850412+0000","last_peered":"2024-09-18T01:48:33.850412+0000","last_clean":"2024-09-18T01:48:33.850412+0000","last_became_active":"2024-09-18T01:45:10.298021+0000","last_became_peered":"2024-09-18T01:45:10.298021+0000","last_unstale":"2024-09-18T01:48:33.850412+0000","last_undegraded":"2024-09-18T01:48:33.850412+0000","last_fullsized":"2024-09-18T01:48:33.850412+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'58","last_scrub_stamp":"2024-09-18T01:48:33.850320+0000","last_deep_scrub":"33'58","last_deep_scrub_stamp":"2024-09-18T01:48:33.850320+0000","last_clean_scrub_stamp":"2024-09-18T01:48:33.850320+0000","objects_scrubbed":10,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:47:26.923881+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:45.319936+0000","last_change":"2024-09-18T01:48:45.319977+0000","last_active":"2024-09-18T01:48:45.319936+0000","last_peered":"2024-09-18T01:48:45.319936+0000","last_clean":"2024-09-18T01:48:45.319936+0000","last_became_active":"2024-09-18T01:45:12.313875+0000","last_became_peered":"2024-09-18T01:45:12.313875+0000","last_unstale":"2024-09-18T01:48:45.319936+0000","last_undegraded":"2024-09-18T01:48:45.319936+0000","last_fullsized":"2024-09-18T01:48:45.319936+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:45.319802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:45.319802+0000","last_clean_scrub_stamp":"2024-09-18T01:48:45.319802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:30:17.984788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'7","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:13.056495+0000","last_change":"2024-09-18T01:49:13.056537+0000","last_active":"2024-09-18T01:49:13.056495+0000","last_peered":"2024-09-18T01:49:13.056495+0000","last_clean":"2024-09-18T01:49:13.056495+0000","last_became_active":"2024-09-18T01:45:14.322448+0000","last_became_peered":"2024-09-18T01:45:14.322448+0000","last_unstale":"2024-09-18T01:49:13.056495+0000","last_undegraded":"2024-09-18T01:49:13.056495+0000","last_fullsized":"2024-09-18T01:49:13.056495+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-09-18T01:49:13.056380+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-09-18T01:49:13.056380+0000","last_clean_scrub_stamp":"2024-09-18T01:49:13.056380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:58:35.305693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":17,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'8","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:05.100854+0000","last_change":"2024-09-18T01:49:05.100881+0000","last_active":"2024-09-18T01:49:05.100854+0000","last_peered":"2024-09-18T01:49:05.100854+0000","last_clean":"2024-09-18T01:49:05.100854+0000","last_became_active":"2024-09-18T01:45:06.292143+0000","last_became_peered":"2024-09-18T01:45:06.292143+0000","last_unstale":"2024-09-18T01:49:05.100854+0000","last_undegraded":"2024-09-18T01:49:05.100854+0000","last_fullsized":"2024-09-18T01:49:05.100854+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-18T01:49:05.100764+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-18T01:49:05.100764+0000","last_clean_scrub_stamp":"2024-09-18T01:49:05.100764+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:57:47.793679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:55.061212+0000","last_change":"2024-09-18T01:48:55.061241+0000","last_active":"2024-09-18T01:48:55.061212+0000","last_peered":"2024-09-18T01:48:55.061212+0000","last_clean":"2024-09-18T01:48:55.061212+0000","last_became_active":"2024-09-18T01:45:04.292734+0000","last_became_peered":"2024-09-18T01:45:04.292734+0000","last_unstale":"2024-09-18T01:48:55.061212+0000","last_undegraded":"2024-09-18T01:48:55.061212+0000","last_fullsized":"2024-09-18T01:48:55.061212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:55.061101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:55.061101+0000","last_clean_scrub_stamp":"2024-09-18T01:48:55.061101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:28:33.987118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:38.340690+0000","last_change":"2024-09-18T01:48:38.340714+0000","last_active":"2024-09-18T01:48:38.340690+0000","last_peered":"2024-09-18T01:48:38.340690+0000","last_clean":"2024-09-18T01:48:38.340690+0000","last_became_active":"2024-09-18T01:45:08.294026+0000","last_became_peered":"2024-09-18T01:45:08.294026+0000","last_unstale":"2024-09-18T01:48:38.340690+0000","last_undegraded":"2024-09-18T01:48:38.340690+0000","last_fullsized":"2024-09-18T01:48:38.340690+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:38.340604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:38.340604+0000","last_clean_scrub_stamp":"2024-09-18T01:48:38.340604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:23:55.262120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'44","reported_seq":105,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:55.980849+0000","last_change":"2024-09-18T01:48:55.980889+0000","last_active":"2024-09-18T01:48:55.980849+0000","last_peered":"2024-09-18T01:48:55.980849+0000","last_clean":"2024-09-18T01:48:55.980849+0000","last_became_active":"2024-09-18T01:45:10.307420+0000","last_became_peered":"2024-09-18T01:45:10.307420+0000","last_unstale":"2024-09-18T01:48:55.980849+0000","last_undegraded":"2024-09-18T01:48:55.980849+0000","last_fullsized":"2024-09-18T01:48:55.980849+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'44","last_scrub_stamp":"2024-09-18T01:48:55.980766+0000","last_deep_scrub":"33'44","last_deep_scrub_stamp":"2024-09-18T01:48:55.980766+0000","last_clean_scrub_stamp":"2024-09-18T01:48:55.980766+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:39:00.785127+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:27.225360+0000","last_change":"2024-09-18T01:48:27.225386+0000","last_active":"2024-09-18T01:48:27.225360+0000","last_peered":"2024-09-18T01:48:27.225360+0000","last_clean":"2024-09-18T01:48:27.225360+0000","last_became_active":"2024-09-18T01:45:12.305838+0000","last_became_peered":"2024-09-18T01:45:12.305838+0000","last_unstale":"2024-09-18T01:48:27.225360+0000","last_undegraded":"2024-09-18T01:48:27.225360+0000","last_fullsized":"2024-09-18T01:48:27.225360+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:27.225273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:27.225273+0000","last_clean_scrub_stamp":"2024-09-18T01:48:27.225273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:40:36.497250+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'4","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:50.995270+0000","last_change":"2024-09-18T01:48:50.995327+0000","last_active":"2024-09-18T01:48:50.995270+0000","last_peered":"2024-09-18T01:48:50.995270+0000","last_clean":"2024-09-18T01:48:50.995270+0000","last_became_active":"2024-09-18T01:45:14.322272+0000","last_became_peered":"2024-09-18T01:45:14.322272+0000","last_unstale":"2024-09-18T01:48:50.995270+0000","last_undegraded":"2024-09-18T01:48:50.995270+0000","last_fullsized":"2024-09-18T01:48:50.995270+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:48:50.995161+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:48:50.995161+0000","last_clean_scrub_stamp":"2024-09-18T01:48:50.995161+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:39:37.704225+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"33'8","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:54.036665+0000","last_change":"2024-09-18T01:48:54.036697+0000","last_active":"2024-09-18T01:48:54.036665+0000","last_peered":"2024-09-18T01:48:54.036665+0000","last_clean":"2024-09-18T01:48:54.036665+0000","last_became_active":"2024-09-18T01:45:06.284677+0000","last_became_peered":"2024-09-18T01:45:06.284677+0000","last_unstale":"2024-09-18T01:48:54.036665+0000","last_undegraded":"2024-09-18T01:48:54.036665+0000","last_fullsized":"2024-09-18T01:48:54.036665+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-18T01:48:54.036561+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-18T01:48:54.036561+0000","last_clean_scrub_stamp":"2024-09-18T01:48:54.036561+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:24:10.958078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:22.216180+0000","last_change":"2024-09-18T01:45:04.287402+0000","last_active":"2024-09-18T01:47:22.216180+0000","last_peered":"2024-09-18T01:47:22.216180+0000","last_clean":"2024-09-18T01:47:22.216180+0000","last_became_active":"2024-09-18T01:45:04.284151+0000","last_became_peered":"2024-09-18T01:45:04.284151+0000","last_unstale":"2024-09-18T01:47:22.216180+0000","last_undegraded":"2024-09-18T01:47:22.216180+0000","last_fullsized":"2024-09-18T01:47:22.216180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:44.316900+0000","last_change":"2024-09-18T01:48:44.316921+0000","last_active":"2024-09-18T01:48:44.316900+0000","last_peered":"2024-09-18T01:48:44.316900+0000","last_clean":"2024-09-18T01:48:44.316900+0000","last_became_active":"2024-09-18T01:45:08.289521+0000","last_became_peered":"2024-09-18T01:45:08.289521+0000","last_unstale":"2024-09-18T01:48:44.316900+0000","last_undegraded":"2024-09-18T01:48:44.316900+0000","last_fullsized":"2024-09-18T01:48:44.316900+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:44.316811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:44.316811+0000","last_clean_scrub_stamp":"2024-09-18T01:48:44.316811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:06:52.240759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'60","reported_seq":130,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:31.041184+0000","last_change":"2024-09-18T01:48:31.041221+0000","last_active":"2024-09-18T01:48:31.041184+0000","last_peered":"2024-09-18T01:48:31.041184+0000","last_clean":"2024-09-18T01:48:31.041184+0000","last_became_active":"2024-09-18T01:45:10.306481+0000","last_became_peered":"2024-09-18T01:45:10.306481+0000","last_unstale":"2024-09-18T01:48:31.041184+0000","last_undegraded":"2024-09-18T01:48:31.041184+0000","last_fullsized":"2024-09-18T01:48:31.041184+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'60","last_scrub_stamp":"2024-09-18T01:48:31.041096+0000","last_deep_scrub":"33'60","last_deep_scrub_stamp":"2024-09-18T01:48:31.041096+0000","last_clean_scrub_stamp":"2024-09-18T01:48:31.041096+0000","objects_scrubbed":9,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:19:08.072740+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'285","reported_seq":359,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:33.295878+0000","last_change":"2024-09-18T01:48:33.295906+0000","last_active":"2024-09-18T01:48:33.295878+0000","last_peered":"2024-09-18T01:48:33.295878+0000","last_clean":"2024-09-18T01:48:33.295878+0000","last_became_active":"2024-09-18T01:45:12.313065+0000","last_became_peered":"2024-09-18T01:45:12.313065+0000","last_unstale":"2024-09-18T01:48:33.295878+0000","last_undegraded":"2024-09-18T01:48:33.295878+0000","last_fullsized":"2024-09-18T01:48:33.295878+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-18T01:48:33.295792+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-18T01:48:33.295792+0000","last_clean_scrub_stamp":"2024-09-18T01:48:33.295792+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:47:31.508822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"33'2","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:27.215024+0000","last_change":"2024-09-18T01:45:14.320158+0000","last_active":"2024-09-18T01:47:27.215024+0000","last_peered":"2024-09-18T01:47:27.215024+0000","last_clean":"2024-09-18T01:47:27.215024+0000","last_became_active":"2024-09-18T01:45:14.319805+0000","last_became_peered":"2024-09-18T01:45:14.319805+0000","last_unstale":"2024-09-18T01:47:27.215024+0000","last_undegraded":"2024-09-18T01:47:27.215024+0000","last_fullsized":"2024-09-18T01:47:27.215024+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"33'10","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:47.050689+0000","last_change":"2024-09-18T01:48:47.050714+0000","last_active":"2024-09-18T01:48:47.050689+0000","last_peered":"2024-09-18T01:48:47.050689+0000","last_clean":"2024-09-18T01:48:47.050689+0000","last_became_active":"2024-09-18T01:45:06.281444+0000","last_became_peered":"2024-09-18T01:45:06.281444+0000","last_unstale":"2024-09-18T01:48:47.050689+0000","last_undegraded":"2024-09-18T01:48:47.050689+0000","last_fullsized":"2024-09-18T01:48:47.050689+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-18T01:48:47.050596+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-18T01:48:47.050596+0000","last_clean_scrub_stamp":"2024-09-18T01:48:47.050596+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:04:32.118971+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:22.216103+0000","last_change":"2024-09-18T01:45:04.289841+0000","last_active":"2024-09-18T01:47:22.216103+0000","last_peered":"2024-09-18T01:47:22.216103+0000","last_clean":"2024-09-18T01:47:22.216103+0000","last_became_active":"2024-09-18T01:45:04.289216+0000","last_became_peered":"2024-09-18T01:45:04.289216+0000","last_unstale":"2024-09-18T01:47:22.216103+0000","last_undegraded":"2024-09-18T01:47:22.216103+0000","last_fullsized":"2024-09-18T01:47:22.216103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:42.306210+0000","last_change":"2024-09-18T01:48:42.306236+0000","last_active":"2024-09-18T01:48:42.306210+0000","last_peered":"2024-09-18T01:48:42.306210+0000","last_clean":"2024-09-18T01:48:42.306210+0000","last_became_active":"2024-09-18T01:45:08.289725+0000","last_became_peered":"2024-09-18T01:45:08.289725+0000","last_unstale":"2024-09-18T01:48:42.306210+0000","last_undegraded":"2024-09-18T01:48:42.306210+0000","last_fullsized":"2024-09-18T01:48:42.306210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:42.306116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:42.306116+0000","last_clean_scrub_stamp":"2024-09-18T01:48:42.306116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:12:34.242137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"33'84","reported_seq":169,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:48.994644+0000","last_change":"2024-09-18T01:48:48.994684+0000","last_active":"2024-09-18T01:48:48.994644+0000","last_peered":"2024-09-18T01:48:48.994644+0000","last_clean":"2024-09-18T01:48:48.994644+0000","last_became_active":"2024-09-18T01:45:10.309360+0000","last_became_peered":"2024-09-18T01:45:10.309360+0000","last_unstale":"2024-09-18T01:48:48.994644+0000","last_undegraded":"2024-09-18T01:48:48.994644+0000","last_fullsized":"2024-09-18T01:48:48.994644+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'84","last_scrub_stamp":"2024-09-18T01:48:48.994559+0000","last_deep_scrub":"33'84","last_deep_scrub_stamp":"2024-09-18T01:48:48.994559+0000","last_clean_scrub_stamp":"2024-09-18T01:48:48.994559+0000","objects_scrubbed":7,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:06:39.021603+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5903,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":90,"num_read_kb":105,"num_write":42,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:29.256572+0000","last_change":"2024-09-18T01:48:29.256596+0000","last_active":"2024-09-18T01:48:29.256572+0000","last_peered":"2024-09-18T01:48:29.256572+0000","last_clean":"2024-09-18T01:48:29.256572+0000","last_became_active":"2024-09-18T01:45:12.312665+0000","last_became_peered":"2024-09-18T01:45:12.312665+0000","last_unstale":"2024-09-18T01:48:29.256572+0000","last_undegraded":"2024-09-18T01:48:29.256572+0000","last_fullsized":"2024-09-18T01:48:29.256572+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:29.256466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:29.256466+0000","last_clean_scrub_stamp":"2024-09-18T01:48:29.256466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:07:14.275320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'18","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.979585+0000","last_change":"2024-09-18T01:45:14.320179+0000","last_active":"2024-09-18T01:48:12.979585+0000","last_peered":"2024-09-18T01:48:12.979585+0000","last_clean":"2024-09-18T01:48:12.979585+0000","last_became_active":"2024-09-18T01:45:14.319638+0000","last_became_peered":"2024-09-18T01:45:14.319638+0000","last_unstale":"2024-09-18T01:48:12.979585+0000","last_undegraded":"2024-09-18T01:48:12.979585+0000","last_fullsized":"2024-09-18T01:48:12.979585+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:55.048126+0000","last_change":"2024-09-18T01:48:55.048167+0000","last_active":"2024-09-18T01:48:55.048126+0000","last_peered":"2024-09-18T01:48:55.048126+0000","last_clean":"2024-09-18T01:48:55.048126+0000","last_became_active":"2024-09-18T01:45:06.290087+0000","last_became_peered":"2024-09-18T01:45:06.290087+0000","last_unstale":"2024-09-18T01:48:55.048126+0000","last_undegraded":"2024-09-18T01:48:55.048126+0000","last_fullsized":"2024-09-18T01:48:55.048126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:48:55.048003+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:48:55.048003+0000","last_clean_scrub_stamp":"2024-09-18T01:48:55.048003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:28:28.602326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:18.345169+0000","last_change":"2024-09-18T01:49:18.345193+0000","last_active":"2024-09-18T01:49:18.345169+0000","last_peered":"2024-09-18T01:49:18.345169+0000","last_clean":"2024-09-18T01:49:18.345169+0000","last_became_active":"2024-09-18T01:45:04.278979+0000","last_became_peered":"2024-09-18T01:45:04.278979+0000","last_unstale":"2024-09-18T01:49:18.345169+0000","last_undegraded":"2024-09-18T01:49:18.345169+0000","last_fullsized":"2024-09-18T01:49:18.345169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:18.345077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:18.345077+0000","last_clean_scrub_stamp":"2024-09-18T01:49:18.345077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:47:49.187464+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:36.904915+0000","last_change":"2024-09-18T01:48:36.904948+0000","last_active":"2024-09-18T01:48:36.904915+0000","last_peered":"2024-09-18T01:48:36.904915+0000","last_clean":"2024-09-18T01:48:36.904915+0000","last_became_active":"2024-09-18T01:45:08.292156+0000","last_became_peered":"2024-09-18T01:45:08.292156+0000","last_unstale":"2024-09-18T01:48:36.904915+0000","last_undegraded":"2024-09-18T01:48:36.904915+0000","last_fullsized":"2024-09-18T01:48:36.904915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:36.904811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:36.904811+0000","last_clean_scrub_stamp":"2024-09-18T01:48:36.904811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:16:10.795874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'46","reported_seq":108,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:31.876714+0000","last_change":"2024-09-18T01:48:31.876752+0000","last_active":"2024-09-18T01:48:31.876714+0000","last_peered":"2024-09-18T01:48:31.876714+0000","last_clean":"2024-09-18T01:48:31.876714+0000","last_became_active":"2024-09-18T01:45:10.300488+0000","last_became_peered":"2024-09-18T01:45:10.300488+0000","last_unstale":"2024-09-18T01:48:31.876714+0000","last_undegraded":"2024-09-18T01:48:31.876714+0000","last_fullsized":"2024-09-18T01:48:31.876714+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'46","last_scrub_stamp":"2024-09-18T01:48:31.876630+0000","last_deep_scrub":"33'46","last_deep_scrub_stamp":"2024-09-18T01:48:31.876630+0000","last_clean_scrub_stamp":"2024-09-18T01:48:31.876630+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:14:05.046500+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:45.045908+0000","last_change":"2024-09-18T01:48:45.045948+0000","last_active":"2024-09-18T01:48:45.045908+0000","last_peered":"2024-09-18T01:48:45.045908+0000","last_clean":"2024-09-18T01:48:45.045908+0000","last_became_active":"2024-09-18T01:45:12.315695+0000","last_became_peered":"2024-09-18T01:45:12.315695+0000","last_unstale":"2024-09-18T01:48:45.045908+0000","last_undegraded":"2024-09-18T01:48:45.045908+0000","last_fullsized":"2024-09-18T01:48:45.045908+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:45.045766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:45.045766+0000","last_clean_scrub_stamp":"2024-09-18T01:48:45.045766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:18:11.087673+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"33'3","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:23.652303+0000","last_change":"2024-09-18T01:45:14.326486+0000","last_active":"2024-09-18T01:48:23.652303+0000","last_peered":"2024-09-18T01:48:23.652303+0000","last_clean":"2024-09-18T01:48:23.652303+0000","last_became_active":"2024-09-18T01:45:14.326209+0000","last_became_peered":"2024-09-18T01:45:14.326209+0000","last_unstale":"2024-09-18T01:48:23.652303+0000","last_undegraded":"2024-09-18T01:48:23.652303+0000","last_fullsized":"2024-09-18T01:48:23.652303+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:44.062748+0000","last_change":"2024-09-18T01:48:44.062795+0000","last_active":"2024-09-18T01:48:44.062748+0000","last_peered":"2024-09-18T01:48:44.062748+0000","last_clean":"2024-09-18T01:48:44.062748+0000","last_became_active":"2024-09-18T01:45:06.285771+0000","last_became_peered":"2024-09-18T01:45:06.285771+0000","last_unstale":"2024-09-18T01:48:44.062748+0000","last_undegraded":"2024-09-18T01:48:44.062748+0000","last_fullsized":"2024-09-18T01:48:44.062748+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:48:44.062649+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:48:44.062649+0000","last_clean_scrub_stamp":"2024-09-18T01:48:44.062649+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:57:52.976791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"33'4","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:21.979181+0000","last_change":"2024-09-18T01:49:21.979209+0000","last_active":"2024-09-18T01:49:21.979181+0000","last_peered":"2024-09-18T01:49:21.979181+0000","last_clean":"2024-09-18T01:49:21.979181+0000","last_became_active":"2024-09-18T01:45:04.287263+0000","last_became_peered":"2024-09-18T01:45:04.287263+0000","last_unstale":"2024-09-18T01:49:21.979181+0000","last_undegraded":"2024-09-18T01:49:21.979181+0000","last_fullsized":"2024-09-18T01:49:21.979181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:49:21.979054+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:49:21.979054+0000","last_clean_scrub_stamp":"2024-09-18T01:49:21.979054+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:23:37.589553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:43.281572+0000","last_change":"2024-09-18T01:48:43.281610+0000","last_active":"2024-09-18T01:48:43.281572+0000","last_peered":"2024-09-18T01:48:43.281572+0000","last_clean":"2024-09-18T01:48:43.281572+0000","last_became_active":"2024-09-18T01:45:08.289604+0000","last_became_peered":"2024-09-18T01:45:08.289604+0000","last_unstale":"2024-09-18T01:48:43.281572+0000","last_undegraded":"2024-09-18T01:48:43.281572+0000","last_fullsized":"2024-09-18T01:48:43.281572+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:43.281481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:43.281481+0000","last_clean_scrub_stamp":"2024-09-18T01:48:43.281481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:37:19.077361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'46","reported_seq":104,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:32.804739+0000","last_change":"2024-09-18T01:48:32.804773+0000","last_active":"2024-09-18T01:48:32.804739+0000","last_peered":"2024-09-18T01:48:32.804739+0000","last_clean":"2024-09-18T01:48:32.804739+0000","last_became_active":"2024-09-18T01:45:10.297511+0000","last_became_peered":"2024-09-18T01:45:10.297511+0000","last_unstale":"2024-09-18T01:48:32.804739+0000","last_undegraded":"2024-09-18T01:48:32.804739+0000","last_fullsized":"2024-09-18T01:48:32.804739+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'46","last_scrub_stamp":"2024-09-18T01:48:32.804654+0000","last_deep_scrub":"33'46","last_deep_scrub_stamp":"2024-09-18T01:48:32.804654+0000","last_clean_scrub_stamp":"2024-09-18T01:48:32.804654+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:33:34.219867+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'285","reported_seq":414,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:39.926591+0000","last_change":"2024-09-18T01:48:39.926622+0000","last_active":"2024-09-18T01:48:39.926591+0000","last_peered":"2024-09-18T01:48:39.926591+0000","last_clean":"2024-09-18T01:48:39.926591+0000","last_became_active":"2024-09-18T01:45:12.314918+0000","last_became_peered":"2024-09-18T01:45:12.314918+0000","last_unstale":"2024-09-18T01:48:39.926591+0000","last_undegraded":"2024-09-18T01:48:39.926591+0000","last_fullsized":"2024-09-18T01:48:39.926591+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-18T01:48:39.926503+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-18T01:48:39.926503+0000","last_clean_scrub_stamp":"2024-09-18T01:48:39.926503+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:49:29.916648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'12","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.940929+0000","last_change":"2024-09-18T01:45:14.319866+0000","last_active":"2024-09-18T01:48:12.940929+0000","last_peered":"2024-09-18T01:48:12.940929+0000","last_clean":"2024-09-18T01:48:12.940929+0000","last_became_active":"2024-09-18T01:45:14.319364+0000","last_became_peered":"2024-09-18T01:45:14.319364+0000","last_unstale":"2024-09-18T01:48:12.940929+0000","last_undegraded":"2024-09-18T01:48:12.940929+0000","last_fullsized":"2024-09-18T01:48:12.940929+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:10.031009+0000","last_change":"2024-09-18T01:49:10.031044+0000","last_active":"2024-09-18T01:49:10.031009+0000","last_peered":"2024-09-18T01:49:10.031009+0000","last_clean":"2024-09-18T01:49:10.031009+0000","last_became_active":"2024-09-18T01:45:06.291023+0000","last_became_peered":"2024-09-18T01:45:06.291023+0000","last_unstale":"2024-09-18T01:49:10.031009+0000","last_undegraded":"2024-09-18T01:49:10.031009+0000","last_fullsized":"2024-09-18T01:49:10.031009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:49:10.030902+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:49:10.030902+0000","last_clean_scrub_stamp":"2024-09-18T01:49:10.030902+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:45:15.238343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:13.876193+0000","last_change":"2024-09-18T01:49:13.876222+0000","last_active":"2024-09-18T01:49:13.876193+0000","last_peered":"2024-09-18T01:49:13.876193+0000","last_clean":"2024-09-18T01:49:13.876193+0000","last_became_active":"2024-09-18T01:45:04.288386+0000","last_became_peered":"2024-09-18T01:45:04.288386+0000","last_unstale":"2024-09-18T01:49:13.876193+0000","last_undegraded":"2024-09-18T01:49:13.876193+0000","last_fullsized":"2024-09-18T01:49:13.876193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:13.876090+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:13.876090+0000","last_clean_scrub_stamp":"2024-09-18T01:49:13.876090+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:15:56.056182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'5","reported_seq":428,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:37.935954+0000","last_change":"2024-09-18T01:48:37.935983+0000","last_active":"2024-09-18T01:48:37.935954+0000","last_peered":"2024-09-18T01:48:37.935954+0000","last_clean":"2024-09-18T01:48:37.935954+0000","last_became_active":"2024-09-18T01:45:08.289478+0000","last_became_peered":"2024-09-18T01:45:08.289478+0000","last_unstale":"2024-09-18T01:48:37.935954+0000","last_undegraded":"2024-09-18T01:48:37.935954+0000","last_fullsized":"2024-09-18T01:48:37.935954+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-18T01:48:37.935837+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-18T01:48:37.935837+0000","last_clean_scrub_stamp":"2024-09-18T01:48:37.935837+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:10:09.966686+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'16","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:35.107094+0000","last_change":"2024-09-18T01:48:35.107168+0000","last_active":"2024-09-18T01:48:35.107094+0000","last_peered":"2024-09-18T01:48:35.107094+0000","last_clean":"2024-09-18T01:48:35.107094+0000","last_became_active":"2024-09-18T01:45:10.307374+0000","last_became_peered":"2024-09-18T01:45:10.307374+0000","last_unstale":"2024-09-18T01:48:35.107094+0000","last_undegraded":"2024-09-18T01:48:35.107094+0000","last_fullsized":"2024-09-18T01:48:35.107094+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2024-09-18T01:48:35.106992+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2024-09-18T01:48:35.106992+0000","last_clean_scrub_stamp":"2024-09-18T01:48:35.106992+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:54:20.385136+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'285","reported_seq":476,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:25.009751+0000","last_change":"2024-09-18T01:48:25.009780+0000","last_active":"2024-09-18T01:48:25.009751+0000","last_peered":"2024-09-18T01:48:25.009751+0000","last_clean":"2024-09-18T01:48:25.009751+0000","last_became_active":"2024-09-18T01:45:12.311929+0000","last_became_peered":"2024-09-18T01:45:12.311929+0000","last_unstale":"2024-09-18T01:48:25.009751+0000","last_undegraded":"2024-09-18T01:48:25.009751+0000","last_fullsized":"2024-09-18T01:48:25.009751+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-18T01:48:25.009658+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-18T01:48:25.009658+0000","last_clean_scrub_stamp":"2024-09-18T01:48:25.009658+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:37:56.338472+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"33'6","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:12.045692+0000","last_change":"2024-09-18T01:49:12.045730+0000","last_active":"2024-09-18T01:49:12.045692+0000","last_peered":"2024-09-18T01:49:12.045692+0000","last_clean":"2024-09-18T01:49:12.045692+0000","last_became_active":"2024-09-18T01:45:14.318418+0000","last_became_peered":"2024-09-18T01:45:14.318418+0000","last_unstale":"2024-09-18T01:49:12.045692+0000","last_undegraded":"2024-09-18T01:49:12.045692+0000","last_fullsized":"2024-09-18T01:49:12.045692+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-18T01:49:12.045604+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-18T01:49:12.045604+0000","last_clean_scrub_stamp":"2024-09-18T01:49:12.045604+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:14:23.982223+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"31'4","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:41.845898+0000","last_change":"2024-09-18T01:48:41.845938+0000","last_active":"2024-09-18T01:48:41.845898+0000","last_peered":"2024-09-18T01:48:41.845898+0000","last_clean":"2024-09-18T01:48:41.845898+0000","last_became_active":"2024-09-18T01:45:06.296824+0000","last_became_peered":"2024-09-18T01:45:06.296824+0000","last_unstale":"2024-09-18T01:48:41.845898+0000","last_undegraded":"2024-09-18T01:48:41.845898+0000","last_fullsized":"2024-09-18T01:48:41.845898+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-18T01:48:41.845784+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-18T01:48:41.845784+0000","last_clean_scrub_stamp":"2024-09-18T01:48:41.845784+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:28:20.771801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:16.871248+0000","last_change":"2024-09-18T01:49:16.871275+0000","last_active":"2024-09-18T01:49:16.871248+0000","last_peered":"2024-09-18T01:49:16.871248+0000","last_clean":"2024-09-18T01:49:16.871248+0000","last_became_active":"2024-09-18T01:45:04.287961+0000","last_became_peered":"2024-09-18T01:45:04.287961+0000","last_unstale":"2024-09-18T01:49:16.871248+0000","last_undegraded":"2024-09-18T01:49:16.871248+0000","last_fullsized":"2024-09-18T01:49:16.871248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:49:16.871156+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:49:16.871156+0000","last_clean_scrub_stamp":"2024-09-18T01:49:16.871156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:52:07.012599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:30.056211+0000","last_change":"2024-09-18T01:48:30.056238+0000","last_active":"2024-09-18T01:48:30.056211+0000","last_peered":"2024-09-18T01:48:30.056211+0000","last_clean":"2024-09-18T01:48:30.056211+0000","last_became_active":"2024-09-18T01:45:08.294053+0000","last_became_peered":"2024-09-18T01:45:08.294053+0000","last_unstale":"2024-09-18T01:48:30.056211+0000","last_undegraded":"2024-09-18T01:48:30.056211+0000","last_fullsized":"2024-09-18T01:48:30.056211+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:30.056116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:30.056116+0000","last_clean_scrub_stamp":"2024-09-18T01:48:30.056116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:08:42.773951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'49","reported_seq":108,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:32.916909+0000","last_change":"2024-09-18T01:48:32.916950+0000","last_active":"2024-09-18T01:48:32.916909+0000","last_peered":"2024-09-18T01:48:32.916909+0000","last_clean":"2024-09-18T01:48:32.916909+0000","last_became_active":"2024-09-18T01:45:10.300337+0000","last_became_peered":"2024-09-18T01:45:10.300337+0000","last_unstale":"2024-09-18T01:48:32.916909+0000","last_undegraded":"2024-09-18T01:48:32.916909+0000","last_fullsized":"2024-09-18T01:48:32.916909+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'49","last_scrub_stamp":"2024-09-18T01:48:32.916825+0000","last_deep_scrub":"33'49","last_deep_scrub_stamp":"2024-09-18T01:48:32.916825+0000","last_clean_scrub_stamp":"2024-09-18T01:48:32.916825+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:18:05.044892+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:25.794769+0000","last_change":"2024-09-18T01:48:25.794798+0000","last_active":"2024-09-18T01:48:25.794769+0000","last_peered":"2024-09-18T01:48:25.794769+0000","last_clean":"2024-09-18T01:48:25.794769+0000","last_became_active":"2024-09-18T01:45:12.307210+0000","last_became_peered":"2024-09-18T01:45:12.307210+0000","last_unstale":"2024-09-18T01:48:25.794769+0000","last_undegraded":"2024-09-18T01:48:25.794769+0000","last_fullsized":"2024-09-18T01:48:25.794769+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:25.794656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:25.794656+0000","last_clean_scrub_stamp":"2024-09-18T01:48:25.794656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:43:11.167455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'6","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:38.907928+0000","last_change":"2024-09-18T01:48:38.907977+0000","last_active":"2024-09-18T01:48:38.907928+0000","last_peered":"2024-09-18T01:48:38.907928+0000","last_clean":"2024-09-18T01:48:38.907928+0000","last_became_active":"2024-09-18T01:45:14.314786+0000","last_became_peered":"2024-09-18T01:45:14.314786+0000","last_unstale":"2024-09-18T01:48:38.907928+0000","last_undegraded":"2024-09-18T01:48:38.907928+0000","last_fullsized":"2024-09-18T01:48:38.907928+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-18T01:48:38.907803+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-18T01:48:38.907803+0000","last_clean_scrub_stamp":"2024-09-18T01:48:38.907803+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:42:22.155558+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"33'2","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:57.936018+0000","last_change":"2024-09-18T01:48:57.936018+0000","last_active":"2024-09-18T01:48:57.936018+0000","last_peered":"2024-09-18T01:48:57.936018+0000","last_clean":"2024-09-18T01:48:57.936018+0000","last_became_active":"2024-09-18T01:45:06.286138+0000","last_became_peered":"2024-09-18T01:45:06.286138+0000","last_unstale":"2024-09-18T01:48:57.936018+0000","last_undegraded":"2024-09-18T01:48:57.936018+0000","last_fullsized":"2024-09-18T01:48:57.936018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:48:57.935901+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:48:57.935901+0000","last_clean_scrub_stamp":"2024-09-18T01:48:57.935901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:05:06.158791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"33'119","reported_seq":217,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:09.052864+0000","last_change":"2024-09-18T01:49:09.052903+0000","last_active":"2024-09-18T01:49:09.052864+0000","last_peered":"2024-09-18T01:49:09.052864+0000","last_clean":"2024-09-18T01:49:09.052864+0000","last_became_active":"2024-09-18T01:44:49.572263+0000","last_became_peered":"2024-09-18T01:44:49.572263+0000","last_unstale":"2024-09-18T01:49:09.052864+0000","last_undegraded":"2024-09-18T01:49:09.052864+0000","last_fullsized":"2024-09-18T01:49:09.052864+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'119","last_scrub_stamp":"2024-09-18T01:49:09.052773+0000","last_deep_scrub":"33'119","last_deep_scrub_stamp":"2024-09-18T01:49:09.052773+0000","last_clean_scrub_stamp":"2024-09-18T01:49:09.052773+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:55:10.210330+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:23.650833+0000","last_change":"2024-09-18T01:44:55.241426+0000","last_active":"2024-09-18T01:48:23.650833+0000","last_peered":"2024-09-18T01:48:23.650833+0000","last_clean":"2024-09-18T01:48:23.650833+0000","last_became_active":"2024-09-18T01:44:53.233974+0000","last_became_peered":"2024-09-18T01:44:53.233974+0000","last_unstale":"2024-09-18T01:48:23.650833+0000","last_undegraded":"2024-09-18T01:48:23.650833+0000","last_fullsized":"2024-09-18T01:48:23.650833+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045237700000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:18.910758+0000","last_change":"2024-09-18T01:49:18.910786+0000","last_active":"2024-09-18T01:49:18.910758+0000","last_peered":"2024-09-18T01:49:18.910758+0000","last_clean":"2024-09-18T01:49:18.910758+0000","last_became_active":"2024-09-18T01:45:04.287763+0000","last_became_peered":"2024-09-18T01:45:04.287763+0000","last_unstale":"2024-09-18T01:49:18.910758+0000","last_undegraded":"2024-09-18T01:49:18.910758+0000","last_fullsized":"2024-09-18T01:49:18.910758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:18.910665+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:18.910665+0000","last_clean_scrub_stamp":"2024-09-18T01:49:18.910665+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:25:07.123332+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:39.901227+0000","last_change":"2024-09-18T01:48:39.901227+0000","last_active":"2024-09-18T01:48:39.901227+0000","last_peered":"2024-09-18T01:48:39.901227+0000","last_clean":"2024-09-18T01:48:39.901227+0000","last_became_active":"2024-09-18T01:45:08.288131+0000","last_became_peered":"2024-09-18T01:45:08.288131+0000","last_unstale":"2024-09-18T01:48:39.901227+0000","last_undegraded":"2024-09-18T01:48:39.901227+0000","last_fullsized":"2024-09-18T01:48:39.901227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:39.901111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:39.901111+0000","last_clean_scrub_stamp":"2024-09-18T01:48:39.901111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:24:25.271343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'95","reported_seq":191,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:27.011310+0000","last_change":"2024-09-18T01:48:27.011354+0000","last_active":"2024-09-18T01:48:27.011310+0000","last_peered":"2024-09-18T01:48:27.011310+0000","last_clean":"2024-09-18T01:48:27.011310+0000","last_became_active":"2024-09-18T01:45:10.305004+0000","last_became_peered":"2024-09-18T01:45:10.305004+0000","last_unstale":"2024-09-18T01:48:27.011310+0000","last_undegraded":"2024-09-18T01:48:27.011310+0000","last_fullsized":"2024-09-18T01:48:27.011310+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'95","last_scrub_stamp":"2024-09-18T01:48:27.011228+0000","last_deep_scrub":"33'95","last_deep_scrub_stamp":"2024-09-18T01:48:27.011228+0000","last_clean_scrub_stamp":"2024-09-18T01:48:27.011228+0000","objects_scrubbed":6,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:47:24.915172+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":81,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:24.264559+0000","last_change":"2024-09-18T01:48:24.264584+0000","last_active":"2024-09-18T01:48:24.264559+0000","last_peered":"2024-09-18T01:48:24.264559+0000","last_clean":"2024-09-18T01:48:24.264559+0000","last_became_active":"2024-09-18T01:45:12.311337+0000","last_became_peered":"2024-09-18T01:45:12.311337+0000","last_unstale":"2024-09-18T01:48:24.264559+0000","last_undegraded":"2024-09-18T01:48:24.264559+0000","last_fullsized":"2024-09-18T01:48:24.264559+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:24.264452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:24.264452+0000","last_clean_scrub_stamp":"2024-09-18T01:48:24.264452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:54:43.625934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'81","reported_seq":171,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:44.040674+0000","last_change":"2024-09-18T01:48:44.040748+0000","last_active":"2024-09-18T01:48:44.040674+0000","last_peered":"2024-09-18T01:48:44.040674+0000","last_clean":"2024-09-18T01:48:44.040674+0000","last_became_active":"2024-09-18T01:45:14.314784+0000","last_became_peered":"2024-09-18T01:45:14.314784+0000","last_unstale":"2024-09-18T01:48:44.040674+0000","last_undegraded":"2024-09-18T01:48:44.040674+0000","last_fullsized":"2024-09-18T01:48:44.040674+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'81","last_scrub_stamp":"2024-09-18T01:48:44.040554+0000","last_deep_scrub":"33'81","last_deep_scrub_stamp":"2024-09-18T01:48:44.040554+0000","last_clean_scrub_stamp":"2024-09-18T01:48:44.040554+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:07:29.059407+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'4","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:17.112658+0000","last_change":"2024-09-18T01:49:17.112711+0000","last_active":"2024-09-18T01:49:17.112658+0000","last_peered":"2024-09-18T01:49:17.112658+0000","last_clean":"2024-09-18T01:49:17.112658+0000","last_became_active":"2024-09-18T01:45:41.338925+0000","last_became_peered":"2024-09-18T01:45:41.338925+0000","last_unstale":"2024-09-18T01:49:17.112658+0000","last_undegraded":"2024-09-18T01:49:17.112658+0000","last_fullsized":"2024-09-18T01:49:17.112658+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:49:17.112556+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:49:17.112556+0000","last_clean_scrub_stamp":"2024-09-18T01:49:17.112556+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:16:39.599997+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:23.650889+0000","last_change":"2024-09-18T01:44:55.242126+0000","last_active":"2024-09-18T01:48:23.650889+0000","last_peered":"2024-09-18T01:48:23.650889+0000","last_clean":"2024-09-18T01:48:23.650889+0000","last_became_active":"2024-09-18T01:44:53.237059+0000","last_became_peered":"2024-09-18T01:44:53.237059+0000","last_unstale":"2024-09-18T01:48:23.650889+0000","last_undegraded":"2024-09-18T01:48:23.650889+0000","last_fullsized":"2024-09-18T01:48:23.650889+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011095359999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:14.329892+0000","last_change":"2024-09-18T01:49:14.329892+0000","last_active":"2024-09-18T01:49:14.329892+0000","last_peered":"2024-09-18T01:49:14.329892+0000","last_clean":"2024-09-18T01:49:14.329892+0000","last_became_active":"2024-09-18T01:45:04.273354+0000","last_became_peered":"2024-09-18T01:45:04.273354+0000","last_unstale":"2024-09-18T01:49:14.329892+0000","last_undegraded":"2024-09-18T01:49:14.329892+0000","last_fullsized":"2024-09-18T01:49:14.329892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:14.329766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:14.329766+0000","last_clean_scrub_stamp":"2024-09-18T01:49:14.329766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:39:48.120415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:32.043568+0000","last_change":"2024-09-18T01:48:32.043612+0000","last_active":"2024-09-18T01:48:32.043568+0000","last_peered":"2024-09-18T01:48:32.043568+0000","last_clean":"2024-09-18T01:48:32.043568+0000","last_became_active":"2024-09-18T01:45:08.291681+0000","last_became_peered":"2024-09-18T01:45:08.291681+0000","last_unstale":"2024-09-18T01:48:32.043568+0000","last_undegraded":"2024-09-18T01:48:32.043568+0000","last_fullsized":"2024-09-18T01:48:32.043568+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:32.043454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:32.043454+0000","last_clean_scrub_stamp":"2024-09-18T01:48:32.043454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:43:29.802788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'297","reported_seq":528,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:27.957047+0000","last_change":"2024-09-18T01:48:27.957047+0000","last_active":"2024-09-18T01:48:27.957047+0000","last_peered":"2024-09-18T01:48:27.957047+0000","last_clean":"2024-09-18T01:48:27.957047+0000","last_became_active":"2024-09-18T01:45:10.305472+0000","last_became_peered":"2024-09-18T01:45:10.305472+0000","last_unstale":"2024-09-18T01:48:27.957047+0000","last_undegraded":"2024-09-18T01:48:27.957047+0000","last_fullsized":"2024-09-18T01:48:27.957047+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'297","last_scrub_stamp":"2024-09-18T01:48:27.956904+0000","last_deep_scrub":"33'297","last_deep_scrub_stamp":"2024-09-18T01:48:27.956904+0000","last_clean_scrub_stamp":"2024-09-18T01:48:27.956904+0000","objects_scrubbed":11,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:56:18.052928+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":387,"num_read_kb":371,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:55.023485+0000","last_change":"2024-09-18T01:48:55.023485+0000","last_active":"2024-09-18T01:48:55.023485+0000","last_peered":"2024-09-18T01:48:55.023485+0000","last_clean":"2024-09-18T01:48:55.023485+0000","last_became_active":"2024-09-18T01:45:12.316110+0000","last_became_peered":"2024-09-18T01:45:12.316110+0000","last_unstale":"2024-09-18T01:48:55.023485+0000","last_undegraded":"2024-09-18T01:48:55.023485+0000","last_fullsized":"2024-09-18T01:48:55.023485+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:55.023295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:55.023295+0000","last_clean_scrub_stamp":"2024-09-18T01:48:55.023295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:00:27.945139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'5","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:21.046005+0000","last_change":"2024-09-18T01:49:21.046038+0000","last_active":"2024-09-18T01:49:21.046005+0000","last_peered":"2024-09-18T01:49:21.046005+0000","last_clean":"2024-09-18T01:49:21.046005+0000","last_became_active":"2024-09-18T01:45:14.322986+0000","last_became_peered":"2024-09-18T01:45:14.322986+0000","last_unstale":"2024-09-18T01:49:21.046005+0000","last_undegraded":"2024-09-18T01:49:21.046005+0000","last_fullsized":"2024-09-18T01:49:21.046005+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-18T01:49:21.045917+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-18T01:49:21.045917+0000","last_clean_scrub_stamp":"2024-09-18T01:49:21.045917+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:03:37.631724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'8","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:54.374788+0000","last_change":"2024-09-18T01:48:54.374813+0000","last_active":"2024-09-18T01:48:54.374788+0000","last_peered":"2024-09-18T01:48:54.374788+0000","last_clean":"2024-09-18T01:48:54.374788+0000","last_became_active":"2024-09-18T01:45:06.292996+0000","last_became_peered":"2024-09-18T01:45:06.292996+0000","last_unstale":"2024-09-18T01:48:54.374788+0000","last_undegraded":"2024-09-18T01:48:54.374788+0000","last_fullsized":"2024-09-18T01:48:54.374788+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-18T01:48:54.374701+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-18T01:48:54.374701+0000","last_clean_scrub_stamp":"2024-09-18T01:48:54.374701+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:54:39.652845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:02.043873+0000","last_change":"2024-09-18T01:49:02.043873+0000","last_active":"2024-09-18T01:49:02.043873+0000","last_peered":"2024-09-18T01:49:02.043873+0000","last_clean":"2024-09-18T01:49:02.043873+0000","last_became_active":"2024-09-18T01:44:53.237016+0000","last_became_peered":"2024-09-18T01:44:53.237016+0000","last_unstale":"2024-09-18T01:49:02.043873+0000","last_undegraded":"2024-09-18T01:49:02.043873+0000","last_fullsized":"2024-09-18T01:49:02.043873+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:02.043751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:02.043751+0000","last_clean_scrub_stamp":"2024-09-18T01:49:02.043751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:47:59.947696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039942899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:58.422425+0000","last_change":"2024-09-18T01:48:58.422425+0000","last_active":"2024-09-18T01:48:58.422425+0000","last_peered":"2024-09-18T01:48:58.422425+0000","last_clean":"2024-09-18T01:48:58.422425+0000","last_became_active":"2024-09-18T01:45:04.283999+0000","last_became_peered":"2024-09-18T01:45:04.283999+0000","last_unstale":"2024-09-18T01:48:58.422425+0000","last_undegraded":"2024-09-18T01:48:58.422425+0000","last_fullsized":"2024-09-18T01:48:58.422425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:48:58.422302+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:48:58.422302+0000","last_clean_scrub_stamp":"2024-09-18T01:48:58.422302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:21:30.620518+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"33'4","reported_seq":232,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:43.006487+0000","last_change":"2024-09-18T01:48:43.006522+0000","last_active":"2024-09-18T01:48:43.006487+0000","last_peered":"2024-09-18T01:48:43.006487+0000","last_clean":"2024-09-18T01:48:43.006487+0000","last_became_active":"2024-09-18T01:45:08.284186+0000","last_became_peered":"2024-09-18T01:45:08.284186+0000","last_unstale":"2024-09-18T01:48:43.006487+0000","last_undegraded":"2024-09-18T01:48:43.006487+0000","last_fullsized":"2024-09-18T01:48:43.006487+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:48:43.006376+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:48:43.006376+0000","last_clean_scrub_stamp":"2024-09-18T01:48:43.006376+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:03:25.253771+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'24","reported_seq":101,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:34.888969+0000","last_change":"2024-09-18T01:48:34.888969+0000","last_active":"2024-09-18T01:48:34.888969+0000","last_peered":"2024-09-18T01:48:34.888969+0000","last_clean":"2024-09-18T01:48:34.888969+0000","last_became_active":"2024-09-18T01:45:10.296284+0000","last_became_peered":"2024-09-18T01:45:10.296284+0000","last_unstale":"2024-09-18T01:48:34.888969+0000","last_undegraded":"2024-09-18T01:48:34.888969+0000","last_fullsized":"2024-09-18T01:48:34.888969+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'24","last_scrub_stamp":"2024-09-18T01:48:34.888775+0000","last_deep_scrub":"33'24","last_deep_scrub_stamp":"2024-09-18T01:48:34.888775+0000","last_clean_scrub_stamp":"2024-09-18T01:48:34.888775+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:24:45.905214+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:26.266603+0000","last_change":"2024-09-18T01:48:26.266603+0000","last_active":"2024-09-18T01:48:26.266603+0000","last_peered":"2024-09-18T01:48:26.266603+0000","last_clean":"2024-09-18T01:48:26.266603+0000","last_became_active":"2024-09-18T01:45:12.311266+0000","last_became_peered":"2024-09-18T01:45:12.311266+0000","last_unstale":"2024-09-18T01:48:26.266603+0000","last_undegraded":"2024-09-18T01:48:26.266603+0000","last_fullsized":"2024-09-18T01:48:26.266603+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:26.266453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:26.266453+0000","last_clean_scrub_stamp":"2024-09-18T01:48:26.266453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:33:31.954590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"33'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:02.888947+0000","last_change":"2024-09-18T01:49:02.888972+0000","last_active":"2024-09-18T01:49:02.888947+0000","last_peered":"2024-09-18T01:49:02.888947+0000","last_clean":"2024-09-18T01:49:02.888947+0000","last_became_active":"2024-09-18T01:45:14.318346+0000","last_became_peered":"2024-09-18T01:45:14.318346+0000","last_unstale":"2024-09-18T01:49:02.888947+0000","last_undegraded":"2024-09-18T01:49:02.888947+0000","last_fullsized":"2024-09-18T01:49:02.888947+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:02.888860+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:02.888860+0000","last_clean_scrub_stamp":"2024-09-18T01:49:02.888860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:33:30.505620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:59.400983+0000","last_change":"2024-09-18T01:48:59.400983+0000","last_active":"2024-09-18T01:48:59.400983+0000","last_peered":"2024-09-18T01:48:59.400983+0000","last_clean":"2024-09-18T01:48:59.400983+0000","last_became_active":"2024-09-18T01:45:06.282319+0000","last_became_peered":"2024-09-18T01:45:06.282319+0000","last_unstale":"2024-09-18T01:48:59.400983+0000","last_undegraded":"2024-09-18T01:48:59.400983+0000","last_fullsized":"2024-09-18T01:48:59.400983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:48:59.400854+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:48:59.400854+0000","last_clean_scrub_stamp":"2024-09-18T01:48:59.400854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:57:19.245005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:23.650841+0000","last_change":"2024-09-18T01:44:55.242065+0000","last_active":"2024-09-18T01:48:23.650841+0000","last_peered":"2024-09-18T01:48:23.650841+0000","last_clean":"2024-09-18T01:48:23.650841+0000","last_became_active":"2024-09-18T01:44:53.236990+0000","last_became_peered":"2024-09-18T01:44:53.236990+0000","last_unstale":"2024-09-18T01:48:23.650841+0000","last_undegraded":"2024-09-18T01:48:23.650841+0000","last_fullsized":"2024-09-18T01:48:23.650841+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001062627,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:50.989543+0000","last_change":"2024-09-18T01:48:50.989543+0000","last_active":"2024-09-18T01:48:50.989543+0000","last_peered":"2024-09-18T01:48:50.989543+0000","last_clean":"2024-09-18T01:48:50.989543+0000","last_became_active":"2024-09-18T01:45:04.293064+0000","last_became_peered":"2024-09-18T01:45:04.293064+0000","last_unstale":"2024-09-18T01:48:50.989543+0000","last_undegraded":"2024-09-18T01:48:50.989543+0000","last_fullsized":"2024-09-18T01:48:50.989543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:50.989373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:50.989373+0000","last_clean_scrub_stamp":"2024-09-18T01:48:50.989373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:10:23.020221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:40.269797+0000","last_change":"2024-09-18T01:48:40.269797+0000","last_active":"2024-09-18T01:48:40.269797+0000","last_peered":"2024-09-18T01:48:40.269797+0000","last_clean":"2024-09-18T01:48:40.269797+0000","last_became_active":"2024-09-18T01:45:08.292477+0000","last_became_peered":"2024-09-18T01:45:08.292477+0000","last_unstale":"2024-09-18T01:48:40.269797+0000","last_undegraded":"2024-09-18T01:48:40.269797+0000","last_fullsized":"2024-09-18T01:48:40.269797+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:40.269686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:40.269686+0000","last_clean_scrub_stamp":"2024-09-18T01:48:40.269686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:24:25.007900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'20","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:39.078548+0000","last_change":"2024-09-18T01:48:39.078586+0000","last_active":"2024-09-18T01:48:39.078548+0000","last_peered":"2024-09-18T01:48:39.078548+0000","last_clean":"2024-09-18T01:48:39.078548+0000","last_became_active":"2024-09-18T01:45:10.308018+0000","last_became_peered":"2024-09-18T01:45:10.308018+0000","last_unstale":"2024-09-18T01:48:39.078548+0000","last_undegraded":"2024-09-18T01:48:39.078548+0000","last_fullsized":"2024-09-18T01:48:39.078548+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'20","last_scrub_stamp":"2024-09-18T01:48:39.078443+0000","last_deep_scrub":"33'20","last_deep_scrub_stamp":"2024-09-18T01:48:39.078443+0000","last_clean_scrub_stamp":"2024-09-18T01:48:39.078443+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:25:17.630439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:46.034782+0000","last_change":"2024-09-18T01:48:46.034806+0000","last_active":"2024-09-18T01:48:46.034782+0000","last_peered":"2024-09-18T01:48:46.034782+0000","last_clean":"2024-09-18T01:48:46.034782+0000","last_became_active":"2024-09-18T01:45:12.315342+0000","last_became_peered":"2024-09-18T01:45:12.315342+0000","last_unstale":"2024-09-18T01:48:46.034782+0000","last_undegraded":"2024-09-18T01:48:46.034782+0000","last_fullsized":"2024-09-18T01:48:46.034782+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:46.034692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:46.034692+0000","last_clean_scrub_stamp":"2024-09-18T01:48:46.034692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:33:00.369957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"33'6","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:19.078971+0000","last_change":"2024-09-18T01:49:19.079014+0000","last_active":"2024-09-18T01:49:19.078971+0000","last_peered":"2024-09-18T01:49:19.078971+0000","last_clean":"2024-09-18T01:49:19.078971+0000","last_became_active":"2024-09-18T01:45:14.322568+0000","last_became_peered":"2024-09-18T01:45:14.322568+0000","last_unstale":"2024-09-18T01:49:19.078971+0000","last_undegraded":"2024-09-18T01:49:19.078971+0000","last_fullsized":"2024-09-18T01:49:19.078971+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-18T01:49:19.078859+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-18T01:49:19.078859+0000","last_clean_scrub_stamp":"2024-09-18T01:49:19.078859+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:14:21.152081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'14","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:59.099373+0000","last_change":"2024-09-18T01:48:59.099373+0000","last_active":"2024-09-18T01:48:59.099373+0000","last_peered":"2024-09-18T01:48:59.099373+0000","last_clean":"2024-09-18T01:48:59.099373+0000","last_became_active":"2024-09-18T01:45:06.291792+0000","last_became_peered":"2024-09-18T01:45:06.291792+0000","last_unstale":"2024-09-18T01:48:59.099373+0000","last_undegraded":"2024-09-18T01:48:59.099373+0000","last_fullsized":"2024-09-18T01:48:59.099373+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-09-18T01:48:59.099213+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-09-18T01:48:59.099213+0000","last_clean_scrub_stamp":"2024-09-18T01:48:59.099213+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:58:21.348526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"31'2","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:59.100243+0000","last_change":"2024-09-18T01:48:59.100243+0000","last_active":"2024-09-18T01:48:59.100243+0000","last_peered":"2024-09-18T01:48:59.100243+0000","last_clean":"2024-09-18T01:48:59.100243+0000","last_became_active":"2024-09-18T01:45:04.291211+0000","last_became_peered":"2024-09-18T01:45:04.291211+0000","last_unstale":"2024-09-18T01:48:59.100243+0000","last_undegraded":"2024-09-18T01:48:59.100243+0000","last_fullsized":"2024-09-18T01:48:59.100243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-18T01:48:59.100062+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-18T01:48:59.100062+0000","last_clean_scrub_stamp":"2024-09-18T01:48:59.100062+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:37:34.895942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:11.357763+0000","last_change":"2024-09-18T01:49:11.357787+0000","last_active":"2024-09-18T01:49:11.357763+0000","last_peered":"2024-09-18T01:49:11.357763+0000","last_clean":"2024-09-18T01:49:11.357763+0000","last_became_active":"2024-09-18T01:44:53.234966+0000","last_became_peered":"2024-09-18T01:44:53.234966+0000","last_unstale":"2024-09-18T01:49:11.357763+0000","last_undegraded":"2024-09-18T01:49:11.357763+0000","last_fullsized":"2024-09-18T01:49:11.357763+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:11.357662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:11.357662+0000","last_clean_scrub_stamp":"2024-09-18T01:49:11.357662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:05:42.865637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045990099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:48.358622+0000","last_change":"2024-09-18T01:48:48.358622+0000","last_active":"2024-09-18T01:48:48.358622+0000","last_peered":"2024-09-18T01:48:48.358622+0000","last_clean":"2024-09-18T01:48:48.358622+0000","last_became_active":"2024-09-18T01:45:08.286195+0000","last_became_peered":"2024-09-18T01:45:08.286195+0000","last_unstale":"2024-09-18T01:48:48.358622+0000","last_undegraded":"2024-09-18T01:48:48.358622+0000","last_fullsized":"2024-09-18T01:48:48.358622+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:48:48.358462+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:48:48.358462+0000","last_clean_scrub_stamp":"2024-09-18T01:48:48.358462+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:55:29.632161+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'87","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:31.300515+0000","last_change":"2024-09-18T01:48:31.300515+0000","last_active":"2024-09-18T01:48:31.300515+0000","last_peered":"2024-09-18T01:48:31.300515+0000","last_clean":"2024-09-18T01:48:31.300515+0000","last_became_active":"2024-09-18T01:45:10.305948+0000","last_became_peered":"2024-09-18T01:45:10.305948+0000","last_unstale":"2024-09-18T01:48:31.300515+0000","last_undegraded":"2024-09-18T01:48:31.300515+0000","last_fullsized":"2024-09-18T01:48:31.300515+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'87","last_scrub_stamp":"2024-09-18T01:48:31.300310+0000","last_deep_scrub":"33'87","last_deep_scrub_stamp":"2024-09-18T01:48:31.300310+0000","last_clean_scrub_stamp":"2024-09-18T01:48:31.300310+0000","objects_scrubbed":11,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:18:03.428377+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":89,"num_read_kb":75,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:27.838906+0000","last_change":"2024-09-18T01:48:27.838906+0000","last_active":"2024-09-18T01:48:27.838906+0000","last_peered":"2024-09-18T01:48:27.838906+0000","last_clean":"2024-09-18T01:48:27.838906+0000","last_became_active":"2024-09-18T01:45:12.311862+0000","last_became_peered":"2024-09-18T01:45:12.311862+0000","last_unstale":"2024-09-18T01:48:27.838906+0000","last_undegraded":"2024-09-18T01:48:27.838906+0000","last_fullsized":"2024-09-18T01:48:27.838906+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:27.838756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:27.838756+0000","last_clean_scrub_stamp":"2024-09-18T01:48:27.838756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:26:33.881794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'13","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:53.409197+0000","last_change":"2024-09-18T01:48:53.409223+0000","last_active":"2024-09-18T01:48:53.409197+0000","last_peered":"2024-09-18T01:48:53.409197+0000","last_clean":"2024-09-18T01:48:53.409197+0000","last_became_active":"2024-09-18T01:45:14.311403+0000","last_became_peered":"2024-09-18T01:45:14.311403+0000","last_unstale":"2024-09-18T01:48:53.409197+0000","last_undegraded":"2024-09-18T01:48:53.409197+0000","last_fullsized":"2024-09-18T01:48:53.409197+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'13","last_scrub_stamp":"2024-09-18T01:48:53.409107+0000","last_deep_scrub":"33'13","last_deep_scrub_stamp":"2024-09-18T01:48:53.409107+0000","last_clean_scrub_stamp":"2024-09-18T01:48:53.409107+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:19:19.002301+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:01.149371+0000","last_change":"2024-09-18T01:49:01.149371+0000","last_active":"2024-09-18T01:49:01.149371+0000","last_peered":"2024-09-18T01:49:01.149371+0000","last_clean":"2024-09-18T01:49:01.149371+0000","last_became_active":"2024-09-18T01:45:06.291845+0000","last_became_peered":"2024-09-18T01:45:06.291845+0000","last_unstale":"2024-09-18T01:49:01.149371+0000","last_undegraded":"2024-09-18T01:49:01.149371+0000","last_fullsized":"2024-09-18T01:49:01.149371+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:01.149256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:01.149256+0000","last_clean_scrub_stamp":"2024-09-18T01:49:01.149256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:25:39.701253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:15.355172+0000","last_change":"2024-09-18T01:49:15.355172+0000","last_active":"2024-09-18T01:49:15.355172+0000","last_peered":"2024-09-18T01:49:15.355172+0000","last_clean":"2024-09-18T01:49:15.355172+0000","last_became_active":"2024-09-18T01:45:04.273385+0000","last_became_peered":"2024-09-18T01:45:04.273385+0000","last_unstale":"2024-09-18T01:49:15.355172+0000","last_undegraded":"2024-09-18T01:49:15.355172+0000","last_fullsized":"2024-09-18T01:49:15.355172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:15.355018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:15.355018+0000","last_clean_scrub_stamp":"2024-09-18T01:49:15.355018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:00:42.796946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:23.650894+0000","last_change":"2024-09-18T01:44:55.242318+0000","last_active":"2024-09-18T01:48:23.650894+0000","last_peered":"2024-09-18T01:48:23.650894+0000","last_clean":"2024-09-18T01:48:23.650894+0000","last_became_active":"2024-09-18T01:44:53.236927+0000","last_became_peered":"2024-09-18T01:44:53.236927+0000","last_unstale":"2024-09-18T01:48:23.650894+0000","last_undegraded":"2024-09-18T01:48:23.650894+0000","last_fullsized":"2024-09-18T01:48:23.650894+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00130324,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:24.061850+0000","last_change":"2024-09-18T01:48:24.061850+0000","last_active":"2024-09-18T01:48:24.061850+0000","last_peered":"2024-09-18T01:48:24.061850+0000","last_clean":"2024-09-18T01:48:24.061850+0000","last_became_active":"2024-09-18T01:45:08.296118+0000","last_became_peered":"2024-09-18T01:45:08.296118+0000","last_unstale":"2024-09-18T01:48:24.061850+0000","last_undegraded":"2024-09-18T01:48:24.061850+0000","last_fullsized":"2024-09-18T01:48:24.061850+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:24.061705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:24.061705+0000","last_clean_scrub_stamp":"2024-09-18T01:48:24.061705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:36:59.857585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"33'28","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:26.017268+0000","last_change":"2024-09-18T01:48:26.017268+0000","last_active":"2024-09-18T01:48:26.017268+0000","last_peered":"2024-09-18T01:48:26.017268+0000","last_clean":"2024-09-18T01:48:26.017268+0000","last_became_active":"2024-09-18T01:45:10.305932+0000","last_became_peered":"2024-09-18T01:45:10.305932+0000","last_unstale":"2024-09-18T01:48:26.017268+0000","last_undegraded":"2024-09-18T01:48:26.017268+0000","last_fullsized":"2024-09-18T01:48:26.017268+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'28","last_scrub_stamp":"2024-09-18T01:48:26.017059+0000","last_deep_scrub":"33'28","last_deep_scrub_stamp":"2024-09-18T01:48:26.017059+0000","last_clean_scrub_stamp":"2024-09-18T01:48:26.017059+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:54:30.634425+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'285","reported_seq":367,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:24.016399+0000","last_change":"2024-09-18T01:48:24.016399+0000","last_active":"2024-09-18T01:48:24.016399+0000","last_peered":"2024-09-18T01:48:24.016399+0000","last_clean":"2024-09-18T01:48:24.016399+0000","last_became_active":"2024-09-18T01:45:12.312117+0000","last_became_peered":"2024-09-18T01:45:12.312117+0000","last_unstale":"2024-09-18T01:48:24.016399+0000","last_undegraded":"2024-09-18T01:48:24.016399+0000","last_fullsized":"2024-09-18T01:48:24.016399+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-18T01:48:24.016276+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-18T01:48:24.016276+0000","last_clean_scrub_stamp":"2024-09-18T01:48:24.016276+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:28:28.633537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"33'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:06.901049+0000","last_change":"2024-09-18T01:49:06.901109+0000","last_active":"2024-09-18T01:49:06.901049+0000","last_peered":"2024-09-18T01:49:06.901049+0000","last_clean":"2024-09-18T01:49:06.901049+0000","last_became_active":"2024-09-18T01:45:14.322078+0000","last_became_peered":"2024-09-18T01:45:14.322078+0000","last_unstale":"2024-09-18T01:49:06.901049+0000","last_undegraded":"2024-09-18T01:49:06.901049+0000","last_fullsized":"2024-09-18T01:49:06.901049+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:06.900920+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:06.900920+0000","last_clean_scrub_stamp":"2024-09-18T01:49:06.900920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:34:55.515398+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:36.099827+0000","last_change":"2024-09-18T01:48:36.099827+0000","last_active":"2024-09-18T01:48:36.099827+0000","last_peered":"2024-09-18T01:48:36.099827+0000","last_clean":"2024-09-18T01:48:36.099827+0000","last_became_active":"2024-09-18T01:45:06.297660+0000","last_became_peered":"2024-09-18T01:45:06.297660+0000","last_unstale":"2024-09-18T01:48:36.099827+0000","last_undegraded":"2024-09-18T01:48:36.099827+0000","last_fullsized":"2024-09-18T01:48:36.099827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:48:36.099708+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:48:36.099708+0000","last_clean_scrub_stamp":"2024-09-18T01:48:36.099708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:13:48.036328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:12.849022+0000","last_change":"2024-09-18T01:49:12.849067+0000","last_active":"2024-09-18T01:49:12.849022+0000","last_peered":"2024-09-18T01:49:12.849022+0000","last_clean":"2024-09-18T01:49:12.849022+0000","last_became_active":"2024-09-18T01:45:04.288189+0000","last_became_peered":"2024-09-18T01:45:04.288189+0000","last_unstale":"2024-09-18T01:49:12.849022+0000","last_undegraded":"2024-09-18T01:49:12.849022+0000","last_fullsized":"2024-09-18T01:49:12.849022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:12.848889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:12.848889+0000","last_clean_scrub_stamp":"2024-09-18T01:49:12.848889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:11:11.778098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:12.325355+0000","last_change":"2024-09-18T01:49:12.325355+0000","last_active":"2024-09-18T01:49:12.325355+0000","last_peered":"2024-09-18T01:49:12.325355+0000","last_clean":"2024-09-18T01:49:12.325355+0000","last_became_active":"2024-09-18T01:44:53.236812+0000","last_became_peered":"2024-09-18T01:44:53.236812+0000","last_unstale":"2024-09-18T01:49:12.325355+0000","last_undegraded":"2024-09-18T01:49:12.325355+0000","last_fullsized":"2024-09-18T01:49:12.325355+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:12.325216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:12.325216+0000","last_clean_scrub_stamp":"2024-09-18T01:49:12.325216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:49:14.847227+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00044136000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:26.017324+0000","last_change":"2024-09-18T01:48:26.017324+0000","last_active":"2024-09-18T01:48:26.017324+0000","last_peered":"2024-09-18T01:48:26.017324+0000","last_clean":"2024-09-18T01:48:26.017324+0000","last_became_active":"2024-09-18T01:45:08.296102+0000","last_became_peered":"2024-09-18T01:45:08.296102+0000","last_unstale":"2024-09-18T01:48:26.017324+0000","last_undegraded":"2024-09-18T01:48:26.017324+0000","last_fullsized":"2024-09-18T01:48:26.017324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:26.017211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:26.017211+0000","last_clean_scrub_stamp":"2024-09-18T01:48:26.017211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:29:58.682197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"33'22","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:52.020412+0000","last_change":"2024-09-18T01:48:52.020412+0000","last_active":"2024-09-18T01:48:52.020412+0000","last_peered":"2024-09-18T01:48:52.020412+0000","last_clean":"2024-09-18T01:48:52.020412+0000","last_became_active":"2024-09-18T01:45:10.308451+0000","last_became_peered":"2024-09-18T01:45:10.308451+0000","last_unstale":"2024-09-18T01:48:52.020412+0000","last_undegraded":"2024-09-18T01:48:52.020412+0000","last_fullsized":"2024-09-18T01:48:52.020412+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2024-09-18T01:48:52.020253+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2024-09-18T01:48:52.020253+0000","last_clean_scrub_stamp":"2024-09-18T01:48:52.020253+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:29:39.718171+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'285","reported_seq":441,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:49.394846+0000","last_change":"2024-09-18T01:48:49.394846+0000","last_active":"2024-09-18T01:48:49.394846+0000","last_peered":"2024-09-18T01:48:49.394846+0000","last_clean":"2024-09-18T01:48:49.394846+0000","last_became_active":"2024-09-18T01:45:12.313885+0000","last_became_peered":"2024-09-18T01:45:12.313885+0000","last_unstale":"2024-09-18T01:48:49.394846+0000","last_undegraded":"2024-09-18T01:48:49.394846+0000","last_fullsized":"2024-09-18T01:48:49.394846+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-18T01:48:49.394735+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-18T01:48:49.394735+0000","last_clean_scrub_stamp":"2024-09-18T01:48:49.394735+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:09:02.112570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"33'7","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:42.846796+0000","last_change":"2024-09-18T01:48:42.846821+0000","last_active":"2024-09-18T01:48:42.846796+0000","last_peered":"2024-09-18T01:48:42.846796+0000","last_clean":"2024-09-18T01:48:42.846796+0000","last_became_active":"2024-09-18T01:45:14.317241+0000","last_became_peered":"2024-09-18T01:45:14.317241+0000","last_unstale":"2024-09-18T01:48:42.846796+0000","last_undegraded":"2024-09-18T01:48:42.846796+0000","last_fullsized":"2024-09-18T01:48:42.846796+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-09-18T01:48:42.846695+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-09-18T01:48:42.846695+0000","last_clean_scrub_stamp":"2024-09-18T01:48:42.846695+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:24:27.584908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"33'8","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:58.082270+0000","last_change":"2024-09-18T01:48:58.082270+0000","last_active":"2024-09-18T01:48:58.082270+0000","last_peered":"2024-09-18T01:48:58.082270+0000","last_clean":"2024-09-18T01:48:58.082270+0000","last_became_active":"2024-09-18T01:45:06.285656+0000","last_became_peered":"2024-09-18T01:45:06.285656+0000","last_unstale":"2024-09-18T01:48:58.082270+0000","last_undegraded":"2024-09-18T01:48:58.082270+0000","last_fullsized":"2024-09-18T01:48:58.082270+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-18T01:48:58.082155+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-18T01:48:58.082155+0000","last_clean_scrub_stamp":"2024-09-18T01:48:58.082155+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:12:50.018176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:12.022413+0000","last_change":"2024-09-18T01:49:12.022442+0000","last_active":"2024-09-18T01:49:12.022413+0000","last_peered":"2024-09-18T01:49:12.022413+0000","last_clean":"2024-09-18T01:49:12.022413+0000","last_became_active":"2024-09-18T01:45:04.290480+0000","last_became_peered":"2024-09-18T01:45:04.290480+0000","last_unstale":"2024-09-18T01:49:12.022413+0000","last_undegraded":"2024-09-18T01:49:12.022413+0000","last_fullsized":"2024-09-18T01:49:12.022413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:12.022321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:12.022321+0000","last_clean_scrub_stamp":"2024-09-18T01:49:12.022321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:38:59.551859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:23.650933+0000","last_change":"2024-09-18T01:44:55.241531+0000","last_active":"2024-09-18T01:48:23.650933+0000","last_peered":"2024-09-18T01:48:23.650933+0000","last_clean":"2024-09-18T01:48:23.650933+0000","last_became_active":"2024-09-18T01:44:53.298677+0000","last_became_peered":"2024-09-18T01:44:53.298677+0000","last_unstale":"2024-09-18T01:48:23.650933+0000","last_undegraded":"2024-09-18T01:48:23.650933+0000","last_fullsized":"2024-09-18T01:48:23.650933+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:44:52.219730+0000","last_clean_scrub_stamp":"2024-09-18T01:44:52.219730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052495500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:33.060133+0000","last_change":"2024-09-18T01:48:33.060133+0000","last_active":"2024-09-18T01:48:33.060133+0000","last_peered":"2024-09-18T01:48:33.060133+0000","last_clean":"2024-09-18T01:48:33.060133+0000","last_became_active":"2024-09-18T01:45:08.291696+0000","last_became_peered":"2024-09-18T01:45:08.291696+0000","last_unstale":"2024-09-18T01:48:33.060133+0000","last_undegraded":"2024-09-18T01:48:33.060133+0000","last_fullsized":"2024-09-18T01:48:33.060133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:33.059961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:33.059961+0000","last_clean_scrub_stamp":"2024-09-18T01:48:33.059961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:23:09.745291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'103","reported_seq":203,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:28.839049+0000","last_change":"2024-09-18T01:48:28.839049+0000","last_active":"2024-09-18T01:48:28.839049+0000","last_peered":"2024-09-18T01:48:28.839049+0000","last_clean":"2024-09-18T01:48:28.839049+0000","last_became_active":"2024-09-18T01:45:10.304662+0000","last_became_peered":"2024-09-18T01:45:10.304662+0000","last_unstale":"2024-09-18T01:48:28.839049+0000","last_undegraded":"2024-09-18T01:48:28.839049+0000","last_fullsized":"2024-09-18T01:48:28.839049+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'103","last_scrub_stamp":"2024-09-18T01:48:28.838915+0000","last_deep_scrub":"33'103","last_deep_scrub_stamp":"2024-09-18T01:48:28.838915+0000","last_clean_scrub_stamp":"2024-09-18T01:48:28.838915+0000","objects_scrubbed":9,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:19:33.132645+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":87,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:23.263316+0000","last_change":"2024-09-18T01:48:23.263316+0000","last_active":"2024-09-18T01:48:23.263316+0000","last_peered":"2024-09-18T01:48:23.263316+0000","last_clean":"2024-09-18T01:48:23.263316+0000","last_became_active":"2024-09-18T01:45:12.311399+0000","last_became_peered":"2024-09-18T01:45:12.311399+0000","last_unstale":"2024-09-18T01:48:23.263316+0000","last_undegraded":"2024-09-18T01:48:23.263316+0000","last_fullsized":"2024-09-18T01:48:23.263316+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:23.263202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:23.263202+0000","last_clean_scrub_stamp":"2024-09-18T01:48:23.263202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:54:27.880569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:11.051531+0000","last_change":"2024-09-18T01:49:11.051570+0000","last_active":"2024-09-18T01:49:11.051531+0000","last_peered":"2024-09-18T01:49:11.051531+0000","last_clean":"2024-09-18T01:49:11.051531+0000","last_became_active":"2024-09-18T01:45:14.314587+0000","last_became_peered":"2024-09-18T01:45:14.314587+0000","last_unstale":"2024-09-18T01:49:11.051531+0000","last_undegraded":"2024-09-18T01:49:11.051531+0000","last_fullsized":"2024-09-18T01:49:11.051531+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:11.051420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:11.051420+0000","last_clean_scrub_stamp":"2024-09-18T01:49:11.051420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:32:32.758053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:14.065542+0000","last_change":"2024-09-18T01:49:14.065572+0000","last_active":"2024-09-18T01:49:14.065542+0000","last_peered":"2024-09-18T01:49:14.065542+0000","last_clean":"2024-09-18T01:49:14.065542+0000","last_became_active":"2024-09-18T01:45:14.326051+0000","last_became_peered":"2024-09-18T01:45:14.326051+0000","last_unstale":"2024-09-18T01:49:14.065542+0000","last_undegraded":"2024-09-18T01:49:14.065542+0000","last_fullsized":"2024-09-18T01:49:14.065542+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-18T01:49:14.065439+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-18T01:49:14.065439+0000","last_clean_scrub_stamp":"2024-09-18T01:49:14.065439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:58:36.005665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"33'8","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:52.038813+0000","last_change":"2024-09-18T01:48:52.038841+0000","last_active":"2024-09-18T01:48:52.038813+0000","last_peered":"2024-09-18T01:48:52.038813+0000","last_clean":"2024-09-18T01:48:52.038813+0000","last_became_active":"2024-09-18T01:45:06.283912+0000","last_became_peered":"2024-09-18T01:45:06.283912+0000","last_unstale":"2024-09-18T01:48:52.038813+0000","last_undegraded":"2024-09-18T01:48:52.038813+0000","last_fullsized":"2024-09-18T01:48:52.038813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-18T01:48:52.038726+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-18T01:48:52.038726+0000","last_clean_scrub_stamp":"2024-09-18T01:48:52.038726+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:42:35.286481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:20.957556+0000","last_change":"2024-09-18T01:49:20.957600+0000","last_active":"2024-09-18T01:49:20.957556+0000","last_peered":"2024-09-18T01:49:20.957556+0000","last_clean":"2024-09-18T01:49:20.957556+0000","last_became_active":"2024-09-18T01:45:04.285647+0000","last_became_peered":"2024-09-18T01:45:04.285647+0000","last_unstale":"2024-09-18T01:49:20.957556+0000","last_undegraded":"2024-09-18T01:49:20.957556+0000","last_fullsized":"2024-09-18T01:49:20.957556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:49:20.957430+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:49:20.957430+0000","last_clean_scrub_stamp":"2024-09-18T01:49:20.957430+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:31:53.699536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:22.003691+0000","last_change":"2024-09-18T01:49:22.003715+0000","last_active":"2024-09-18T01:49:22.003691+0000","last_peered":"2024-09-18T01:49:22.003691+0000","last_clean":"2024-09-18T01:49:22.003691+0000","last_became_active":"2024-09-18T01:45:41.339936+0000","last_became_peered":"2024-09-18T01:45:41.339936+0000","last_unstale":"2024-09-18T01:49:22.003691+0000","last_undegraded":"2024-09-18T01:49:22.003691+0000","last_fullsized":"2024-09-18T01:49:22.003691+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:22.003607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:22.003607+0000","last_clean_scrub_stamp":"2024-09-18T01:49:22.003607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:47:52.845993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'46","reported_seq":108,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:37.085340+0000","last_change":"2024-09-18T01:48:37.085399+0000","last_active":"2024-09-18T01:48:37.085340+0000","last_peered":"2024-09-18T01:48:37.085340+0000","last_clean":"2024-09-18T01:48:37.085340+0000","last_became_active":"2024-09-18T01:45:10.307670+0000","last_became_peered":"2024-09-18T01:45:10.307670+0000","last_unstale":"2024-09-18T01:48:37.085340+0000","last_undegraded":"2024-09-18T01:48:37.085340+0000","last_fullsized":"2024-09-18T01:48:37.085340+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'46","last_scrub_stamp":"2024-09-18T01:48:37.085236+0000","last_deep_scrub":"33'46","last_deep_scrub_stamp":"2024-09-18T01:48:37.085236+0000","last_clean_scrub_stamp":"2024-09-18T01:48:37.085236+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:57:59.334548+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:51.057246+0000","last_change":"2024-09-18T01:48:51.057271+0000","last_active":"2024-09-18T01:48:51.057246+0000","last_peered":"2024-09-18T01:48:51.057246+0000","last_clean":"2024-09-18T01:48:51.057246+0000","last_became_active":"2024-09-18T01:45:12.316192+0000","last_became_peered":"2024-09-18T01:45:12.316192+0000","last_unstale":"2024-09-18T01:48:51.057246+0000","last_undegraded":"2024-09-18T01:48:51.057246+0000","last_fullsized":"2024-09-18T01:48:51.057246+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:51.057141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:51.057141+0000","last_clean_scrub_stamp":"2024-09-18T01:48:51.057141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:10:20.432939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"33'5","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:20.339718+0000","last_change":"2024-09-18T01:49:20.339745+0000","last_active":"2024-09-18T01:49:20.339718+0000","last_peered":"2024-09-18T01:49:20.339718+0000","last_clean":"2024-09-18T01:49:20.339718+0000","last_became_active":"2024-09-18T01:45:14.311776+0000","last_became_peered":"2024-09-18T01:45:14.311776+0000","last_unstale":"2024-09-18T01:49:20.339718+0000","last_undegraded":"2024-09-18T01:49:20.339718+0000","last_fullsized":"2024-09-18T01:49:20.339718+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-18T01:49:20.339616+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-18T01:49:20.339616+0000","last_clean_scrub_stamp":"2024-09-18T01:49:20.339616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:11:44.447957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'8","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:57.040683+0000","last_change":"2024-09-18T01:48:57.040711+0000","last_active":"2024-09-18T01:48:57.040683+0000","last_peered":"2024-09-18T01:48:57.040683+0000","last_clean":"2024-09-18T01:48:57.040683+0000","last_became_active":"2024-09-18T01:45:06.291811+0000","last_became_peered":"2024-09-18T01:45:06.291811+0000","last_unstale":"2024-09-18T01:48:57.040683+0000","last_undegraded":"2024-09-18T01:48:57.040683+0000","last_fullsized":"2024-09-18T01:48:57.040683+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-18T01:48:57.040600+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-18T01:48:57.040600+0000","last_clean_scrub_stamp":"2024-09-18T01:48:57.040600+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:54:42.318745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:09.024995+0000","last_change":"2024-09-18T01:49:09.025049+0000","last_active":"2024-09-18T01:49:09.024995+0000","last_peered":"2024-09-18T01:49:09.024995+0000","last_clean":"2024-09-18T01:49:09.024995+0000","last_became_active":"2024-09-18T01:45:04.289655+0000","last_became_peered":"2024-09-18T01:45:04.289655+0000","last_unstale":"2024-09-18T01:49:09.024995+0000","last_undegraded":"2024-09-18T01:49:09.024995+0000","last_fullsized":"2024-09-18T01:49:09.024995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:09.024890+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:09.024890+0000","last_clean_scrub_stamp":"2024-09-18T01:49:09.024890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:40:07.315143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:32.218085+0000","last_change":"2024-09-18T01:45:41.342483+0000","last_active":"2024-09-18T01:47:32.218085+0000","last_peered":"2024-09-18T01:47:32.218085+0000","last_clean":"2024-09-18T01:47:32.218085+0000","last_became_active":"2024-09-18T01:45:41.342149+0000","last_became_peered":"2024-09-18T01:45:41.342149+0000","last_unstale":"2024-09-18T01:47:32.218085+0000","last_undegraded":"2024-09-18T01:47:32.218085+0000","last_fullsized":"2024-09-18T01:47:32.218085+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'8","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:36.330207+0000","last_change":"2024-09-18T01:48:36.330239+0000","last_active":"2024-09-18T01:48:36.330207+0000","last_peered":"2024-09-18T01:48:36.330207+0000","last_clean":"2024-09-18T01:48:36.330207+0000","last_became_active":"2024-09-18T01:45:10.296387+0000","last_became_peered":"2024-09-18T01:45:10.296387+0000","last_unstale":"2024-09-18T01:48:36.330207+0000","last_undegraded":"2024-09-18T01:48:36.330207+0000","last_fullsized":"2024-09-18T01:48:36.330207+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-18T01:48:36.330117+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-18T01:48:36.330117+0000","last_clean_scrub_stamp":"2024-09-18T01:48:36.330117+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:18:02.338887+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:35.876388+0000","last_change":"2024-09-18T01:48:35.876410+0000","last_active":"2024-09-18T01:48:35.876388+0000","last_peered":"2024-09-18T01:48:35.876388+0000","last_clean":"2024-09-18T01:48:35.876388+0000","last_became_active":"2024-09-18T01:45:12.313159+0000","last_became_peered":"2024-09-18T01:45:12.313159+0000","last_unstale":"2024-09-18T01:48:35.876388+0000","last_undegraded":"2024-09-18T01:48:35.876388+0000","last_fullsized":"2024-09-18T01:48:35.876388+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:35.876295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:35.876295+0000","last_clean_scrub_stamp":"2024-09-18T01:48:35.876295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:09:42.402630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:21.322150+0000","last_change":"2024-09-18T01:49:21.322173+0000","last_active":"2024-09-18T01:49:21.322150+0000","last_peered":"2024-09-18T01:49:21.322150+0000","last_clean":"2024-09-18T01:49:21.322150+0000","last_became_active":"2024-09-18T01:45:14.319073+0000","last_became_peered":"2024-09-18T01:45:14.319073+0000","last_unstale":"2024-09-18T01:49:21.322150+0000","last_undegraded":"2024-09-18T01:49:21.322150+0000","last_fullsized":"2024-09-18T01:49:21.322150+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:21.322041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:21.322041+0000","last_clean_scrub_stamp":"2024-09-18T01:49:21.322041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:33:48.938800+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'6","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:55.348662+0000","last_change":"2024-09-18T01:48:55.348701+0000","last_active":"2024-09-18T01:48:55.348662+0000","last_peered":"2024-09-18T01:48:55.348662+0000","last_clean":"2024-09-18T01:48:55.348662+0000","last_became_active":"2024-09-18T01:45:06.276408+0000","last_became_peered":"2024-09-18T01:45:06.276408+0000","last_unstale":"2024-09-18T01:48:55.348662+0000","last_undegraded":"2024-09-18T01:48:55.348662+0000","last_fullsized":"2024-09-18T01:48:55.348662+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-18T01:48:55.348539+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-18T01:48:55.348539+0000","last_clean_scrub_stamp":"2024-09-18T01:48:55.348539+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:08:52.491981+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"33'6","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:06.040015+0000","last_change":"2024-09-18T01:49:06.040054+0000","last_active":"2024-09-18T01:49:06.040015+0000","last_peered":"2024-09-18T01:49:06.040015+0000","last_clean":"2024-09-18T01:49:06.040015+0000","last_became_active":"2024-09-18T01:45:04.286887+0000","last_became_peered":"2024-09-18T01:45:04.286887+0000","last_unstale":"2024-09-18T01:49:06.040015+0000","last_undegraded":"2024-09-18T01:49:06.040015+0000","last_fullsized":"2024-09-18T01:49:06.040015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-18T01:49:06.039927+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-18T01:49:06.039927+0000","last_clean_scrub_stamp":"2024-09-18T01:49:06.039927+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:49:30.561380+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:37.881629+0000","last_change":"2024-09-18T01:48:37.881673+0000","last_active":"2024-09-18T01:48:37.881629+0000","last_peered":"2024-09-18T01:48:37.881629+0000","last_clean":"2024-09-18T01:48:37.881629+0000","last_became_active":"2024-09-18T01:45:08.291575+0000","last_became_peered":"2024-09-18T01:45:08.291575+0000","last_unstale":"2024-09-18T01:48:37.881629+0000","last_undegraded":"2024-09-18T01:48:37.881629+0000","last_fullsized":"2024-09-18T01:48:37.881629+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:37.881519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:37.881519+0000","last_clean_scrub_stamp":"2024-09-18T01:48:37.881519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:48:21.895224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'47","reported_seq":119,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:34.322285+0000","last_change":"2024-09-18T01:48:34.322343+0000","last_active":"2024-09-18T01:48:34.322285+0000","last_peered":"2024-09-18T01:48:34.322285+0000","last_clean":"2024-09-18T01:48:34.322285+0000","last_became_active":"2024-09-18T01:45:10.297904+0000","last_became_peered":"2024-09-18T01:45:10.297904+0000","last_unstale":"2024-09-18T01:48:34.322285+0000","last_undegraded":"2024-09-18T01:48:34.322285+0000","last_fullsized":"2024-09-18T01:48:34.322285+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'47","last_scrub_stamp":"2024-09-18T01:48:34.322182+0000","last_deep_scrub":"33'47","last_deep_scrub_stamp":"2024-09-18T01:48:34.322182+0000","last_clean_scrub_stamp":"2024-09-18T01:48:34.322182+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:23:05.910626+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:23.035826+0000","last_change":"2024-09-18T01:48:23.035896+0000","last_active":"2024-09-18T01:48:23.035826+0000","last_peered":"2024-09-18T01:48:23.035826+0000","last_clean":"2024-09-18T01:48:23.035826+0000","last_became_active":"2024-09-18T01:45:12.313186+0000","last_became_peered":"2024-09-18T01:45:12.313186+0000","last_unstale":"2024-09-18T01:48:23.035826+0000","last_undegraded":"2024-09-18T01:48:23.035826+0000","last_fullsized":"2024-09-18T01:48:23.035826+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:23.035704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:23.035704+0000","last_clean_scrub_stamp":"2024-09-18T01:48:23.035704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:54:29.422521+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:47.220828+0000","last_change":"2024-09-18T01:45:14.326931+0000","last_active":"2024-09-18T01:47:47.220828+0000","last_peered":"2024-09-18T01:47:47.220828+0000","last_clean":"2024-09-18T01:47:47.220828+0000","last_became_active":"2024-09-18T01:45:14.326668+0000","last_became_peered":"2024-09-18T01:45:14.326668+0000","last_unstale":"2024-09-18T01:47:47.220828+0000","last_undegraded":"2024-09-18T01:47:47.220828+0000","last_fullsized":"2024-09-18T01:47:47.220828+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'18","reported_seq":104,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:40.058439+0000","last_change":"2024-09-18T01:48:40.058472+0000","last_active":"2024-09-18T01:48:40.058439+0000","last_peered":"2024-09-18T01:48:40.058439+0000","last_clean":"2024-09-18T01:48:40.058439+0000","last_became_active":"2024-09-18T01:45:06.297220+0000","last_became_peered":"2024-09-18T01:45:06.297220+0000","last_unstale":"2024-09-18T01:48:40.058439+0000","last_undegraded":"2024-09-18T01:48:40.058439+0000","last_fullsized":"2024-09-18T01:48:40.058439+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'18","last_scrub_stamp":"2024-09-18T01:48:40.058351+0000","last_deep_scrub":"33'18","last_deep_scrub_stamp":"2024-09-18T01:48:40.058351+0000","last_clean_scrub_stamp":"2024-09-18T01:48:40.058351+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:54:41.006349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":76,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:11.054309+0000","last_change":"2024-09-18T01:49:11.054340+0000","last_active":"2024-09-18T01:49:11.054309+0000","last_peered":"2024-09-18T01:49:11.054309+0000","last_clean":"2024-09-18T01:49:11.054309+0000","last_became_active":"2024-09-18T01:45:04.283276+0000","last_became_peered":"2024-09-18T01:45:04.283276+0000","last_unstale":"2024-09-18T01:49:11.054309+0000","last_undegraded":"2024-09-18T01:49:11.054309+0000","last_fullsized":"2024-09-18T01:49:11.054309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:11.054211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:11.054211+0000","last_clean_scrub_stamp":"2024-09-18T01:49:11.054211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:11:14.562630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:34.100552+0000","last_change":"2024-09-18T01:48:34.100576+0000","last_active":"2024-09-18T01:48:34.100552+0000","last_peered":"2024-09-18T01:48:34.100552+0000","last_clean":"2024-09-18T01:48:34.100552+0000","last_became_active":"2024-09-18T01:45:08.290911+0000","last_became_peered":"2024-09-18T01:45:08.290911+0000","last_unstale":"2024-09-18T01:48:34.100552+0000","last_undegraded":"2024-09-18T01:48:34.100552+0000","last_fullsized":"2024-09-18T01:48:34.100552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:34.100451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:34.100451+0000","last_clean_scrub_stamp":"2024-09-18T01:48:34.100451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:18:59.693645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'36","reported_seq":91,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:30.819537+0000","last_change":"2024-09-18T01:48:30.819572+0000","last_active":"2024-09-18T01:48:30.819537+0000","last_peered":"2024-09-18T01:48:30.819537+0000","last_clean":"2024-09-18T01:48:30.819537+0000","last_became_active":"2024-09-18T01:45:10.301622+0000","last_became_peered":"2024-09-18T01:45:10.301622+0000","last_unstale":"2024-09-18T01:48:30.819537+0000","last_undegraded":"2024-09-18T01:48:30.819537+0000","last_fullsized":"2024-09-18T01:48:30.819537+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'36","last_scrub_stamp":"2024-09-18T01:48:30.819448+0000","last_deep_scrub":"33'36","last_deep_scrub_stamp":"2024-09-18T01:48:30.819448+0000","last_clean_scrub_stamp":"2024-09-18T01:48:30.819448+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:02:48.244921+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:31.837156+0000","last_change":"2024-09-18T01:48:31.837196+0000","last_active":"2024-09-18T01:48:31.837156+0000","last_peered":"2024-09-18T01:48:31.837156+0000","last_clean":"2024-09-18T01:48:31.837156+0000","last_became_active":"2024-09-18T01:45:12.313096+0000","last_became_peered":"2024-09-18T01:45:12.313096+0000","last_unstale":"2024-09-18T01:48:31.837156+0000","last_undegraded":"2024-09-18T01:48:31.837156+0000","last_fullsized":"2024-09-18T01:48:31.837156+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:31.837028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:31.837028+0000","last_clean_scrub_stamp":"2024-09-18T01:48:31.837028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:55:19.988045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"33'12","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:05.899263+0000","last_change":"2024-09-18T01:49:05.899263+0000","last_active":"2024-09-18T01:49:05.899263+0000","last_peered":"2024-09-18T01:49:05.899263+0000","last_clean":"2024-09-18T01:49:05.899263+0000","last_became_active":"2024-09-18T01:45:06.282461+0000","last_became_peered":"2024-09-18T01:45:06.282461+0000","last_unstale":"2024-09-18T01:49:05.899263+0000","last_undegraded":"2024-09-18T01:49:05.899263+0000","last_fullsized":"2024-09-18T01:49:05.899263+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-18T01:49:05.899152+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-18T01:49:05.899152+0000","last_clean_scrub_stamp":"2024-09-18T01:49:05.899152+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:45:46.971541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"33'8","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.542077+0000","last_change":"2024-09-18T01:45:04.293367+0000","last_active":"2024-09-18T01:48:12.542077+0000","last_peered":"2024-09-18T01:48:12.542077+0000","last_clean":"2024-09-18T01:48:12.542077+0000","last_became_active":"2024-09-18T01:45:04.288082+0000","last_became_peered":"2024-09-18T01:45:04.288082+0000","last_unstale":"2024-09-18T01:48:12.542077+0000","last_undegraded":"2024-09-18T01:48:12.542077+0000","last_fullsized":"2024-09-18T01:48:12.542077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":48,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:39.315849+0000","last_change":"2024-09-18T01:48:39.315849+0000","last_active":"2024-09-18T01:48:39.315849+0000","last_peered":"2024-09-18T01:48:39.315849+0000","last_clean":"2024-09-18T01:48:39.315849+0000","last_became_active":"2024-09-18T01:45:08.292739+0000","last_became_peered":"2024-09-18T01:45:08.292739+0000","last_unstale":"2024-09-18T01:48:39.315849+0000","last_undegraded":"2024-09-18T01:48:39.315849+0000","last_fullsized":"2024-09-18T01:48:39.315849+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:39.315733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:39.315733+0000","last_clean_scrub_stamp":"2024-09-18T01:48:39.315733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:28:18.241750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'70","reported_seq":149,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:35.355474+0000","last_change":"2024-09-18T01:48:35.355511+0000","last_active":"2024-09-18T01:48:35.355474+0000","last_peered":"2024-09-18T01:48:35.355474+0000","last_clean":"2024-09-18T01:48:35.355474+0000","last_became_active":"2024-09-18T01:45:10.296396+0000","last_became_peered":"2024-09-18T01:45:10.296396+0000","last_unstale":"2024-09-18T01:48:35.355474+0000","last_undegraded":"2024-09-18T01:48:35.355474+0000","last_fullsized":"2024-09-18T01:48:35.355474+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'70","last_scrub_stamp":"2024-09-18T01:48:35.355370+0000","last_deep_scrub":"33'70","last_deep_scrub_stamp":"2024-09-18T01:48:35.355370+0000","last_clean_scrub_stamp":"2024-09-18T01:48:35.355370+0000","objects_scrubbed":6,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:18:17.350454+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:23.816836+0000","last_change":"2024-09-18T01:48:23.816862+0000","last_active":"2024-09-18T01:48:23.816836+0000","last_peered":"2024-09-18T01:48:23.816836+0000","last_clean":"2024-09-18T01:48:23.816836+0000","last_became_active":"2024-09-18T01:45:12.307279+0000","last_became_peered":"2024-09-18T01:45:12.307279+0000","last_unstale":"2024-09-18T01:48:23.816836+0000","last_undegraded":"2024-09-18T01:48:23.816836+0000","last_fullsized":"2024-09-18T01:48:23.816836+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:23.816708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:23.816708+0000","last_clean_scrub_stamp":"2024-09-18T01:48:23.816708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:52:57.423754+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'22","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:37.216352+0000","last_change":"2024-09-18T01:45:14.320125+0000","last_active":"2024-09-18T01:47:37.216352+0000","last_peered":"2024-09-18T01:47:37.216352+0000","last_clean":"2024-09-18T01:47:37.216352+0000","last_became_active":"2024-09-18T01:45:14.319540+0000","last_became_peered":"2024-09-18T01:45:14.319540+0000","last_unstale":"2024-09-18T01:47:37.216352+0000","last_undegraded":"2024-09-18T01:47:37.216352+0000","last_fullsized":"2024-09-18T01:47:37.216352+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":65,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'18","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:52.432402+0000","last_change":"2024-09-18T01:48:52.432402+0000","last_active":"2024-09-18T01:48:52.432402+0000","last_peered":"2024-09-18T01:48:52.432402+0000","last_clean":"2024-09-18T01:48:52.432402+0000","last_became_active":"2024-09-18T01:45:06.293053+0000","last_became_peered":"2024-09-18T01:45:06.293053+0000","last_unstale":"2024-09-18T01:48:52.432402+0000","last_undegraded":"2024-09-18T01:48:52.432402+0000","last_fullsized":"2024-09-18T01:48:52.432402+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'18","last_scrub_stamp":"2024-09-18T01:48:52.432288+0000","last_deep_scrub":"33'18","last_deep_scrub_stamp":"2024-09-18T01:48:52.432288+0000","last_clean_scrub_stamp":"2024-09-18T01:48:52.432288+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:28:25.986612+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":45,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:14.095878+0000","last_change":"2024-09-18T01:49:14.095903+0000","last_active":"2024-09-18T01:49:14.095878+0000","last_peered":"2024-09-18T01:49:14.095878+0000","last_clean":"2024-09-18T01:49:14.095878+0000","last_became_active":"2024-09-18T01:45:04.292082+0000","last_became_peered":"2024-09-18T01:45:04.292082+0000","last_unstale":"2024-09-18T01:49:14.095878+0000","last_undegraded":"2024-09-18T01:49:14.095878+0000","last_fullsized":"2024-09-18T01:49:14.095878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:14.095775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:14.095775+0000","last_clean_scrub_stamp":"2024-09-18T01:49:14.095775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:30:01.793692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:38.882296+0000","last_change":"2024-09-18T01:48:38.882296+0000","last_active":"2024-09-18T01:48:38.882296+0000","last_peered":"2024-09-18T01:48:38.882296+0000","last_clean":"2024-09-18T01:48:38.882296+0000","last_became_active":"2024-09-18T01:45:08.286609+0000","last_became_peered":"2024-09-18T01:45:08.286609+0000","last_unstale":"2024-09-18T01:48:38.882296+0000","last_undegraded":"2024-09-18T01:48:38.882296+0000","last_fullsized":"2024-09-18T01:48:38.882296+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:38.882174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:38.882174+0000","last_clean_scrub_stamp":"2024-09-18T01:48:38.882174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:30:42.400285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'46","reported_seq":104,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:50.033208+0000","last_change":"2024-09-18T01:48:50.033254+0000","last_active":"2024-09-18T01:48:50.033208+0000","last_peered":"2024-09-18T01:48:50.033208+0000","last_clean":"2024-09-18T01:48:50.033208+0000","last_became_active":"2024-09-18T01:45:10.309360+0000","last_became_peered":"2024-09-18T01:45:10.309360+0000","last_unstale":"2024-09-18T01:48:50.033208+0000","last_undegraded":"2024-09-18T01:48:50.033208+0000","last_fullsized":"2024-09-18T01:48:50.033208+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'46","last_scrub_stamp":"2024-09-18T01:48:50.033115+0000","last_deep_scrub":"33'46","last_deep_scrub_stamp":"2024-09-18T01:48:50.033115+0000","last_clean_scrub_stamp":"2024-09-18T01:48:50.033115+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:38:37.562652+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:30.911520+0000","last_change":"2024-09-18T01:48:30.911546+0000","last_active":"2024-09-18T01:48:30.911520+0000","last_peered":"2024-09-18T01:48:30.911520+0000","last_clean":"2024-09-18T01:48:30.911520+0000","last_became_active":"2024-09-18T01:45:12.314499+0000","last_became_peered":"2024-09-18T01:45:12.314499+0000","last_unstale":"2024-09-18T01:48:30.911520+0000","last_undegraded":"2024-09-18T01:48:30.911520+0000","last_fullsized":"2024-09-18T01:48:30.911520+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:30.911422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:30.911422+0000","last_clean_scrub_stamp":"2024-09-18T01:48:30.911422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:07:15.930276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"33'2","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:37.219002+0000","last_change":"2024-09-18T01:45:14.326163+0000","last_active":"2024-09-18T01:47:37.219002+0000","last_peered":"2024-09-18T01:47:37.219002+0000","last_clean":"2024-09-18T01:47:37.219002+0000","last_became_active":"2024-09-18T01:45:14.325421+0000","last_became_peered":"2024-09-18T01:45:14.325421+0000","last_unstale":"2024-09-18T01:47:37.219002+0000","last_undegraded":"2024-09-18T01:47:37.219002+0000","last_fullsized":"2024-09-18T01:47:37.219002+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'8","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:56.955755+0000","last_change":"2024-09-18T01:48:56.955784+0000","last_active":"2024-09-18T01:48:56.955755+0000","last_peered":"2024-09-18T01:48:56.955755+0000","last_clean":"2024-09-18T01:48:56.955755+0000","last_became_active":"2024-09-18T01:45:06.286153+0000","last_became_peered":"2024-09-18T01:45:06.286153+0000","last_unstale":"2024-09-18T01:48:56.955755+0000","last_undegraded":"2024-09-18T01:48:56.955755+0000","last_fullsized":"2024-09-18T01:48:56.955755+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-18T01:48:56.955654+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-18T01:48:56.955654+0000","last_clean_scrub_stamp":"2024-09-18T01:48:56.955654+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:13:59.028876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:06.115374+0000","last_change":"2024-09-18T01:49:06.115400+0000","last_active":"2024-09-18T01:49:06.115374+0000","last_peered":"2024-09-18T01:49:06.115374+0000","last_clean":"2024-09-18T01:49:06.115374+0000","last_became_active":"2024-09-18T01:45:04.294537+0000","last_became_peered":"2024-09-18T01:45:04.294537+0000","last_unstale":"2024-09-18T01:49:06.115374+0000","last_undegraded":"2024-09-18T01:49:06.115374+0000","last_fullsized":"2024-09-18T01:49:06.115374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-18T01:49:06.115277+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-18T01:49:06.115277+0000","last_clean_scrub_stamp":"2024-09-18T01:49:06.115277+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:58:15.029419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:40.973877+0000","last_change":"2024-09-18T01:48:40.973902+0000","last_active":"2024-09-18T01:48:40.973877+0000","last_peered":"2024-09-18T01:48:40.973877+0000","last_clean":"2024-09-18T01:48:40.973877+0000","last_became_active":"2024-09-18T01:45:08.286466+0000","last_became_peered":"2024-09-18T01:45:08.286466+0000","last_unstale":"2024-09-18T01:48:40.973877+0000","last_undegraded":"2024-09-18T01:48:40.973877+0000","last_fullsized":"2024-09-18T01:48:40.973877+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:40.973787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:40.973787+0000","last_clean_scrub_stamp":"2024-09-18T01:48:40.973787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:56:31.069811+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'48","reported_seq":111,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:32.347342+0000","last_change":"2024-09-18T01:48:32.347342+0000","last_active":"2024-09-18T01:48:32.347342+0000","last_peered":"2024-09-18T01:48:32.347342+0000","last_clean":"2024-09-18T01:48:32.347342+0000","last_became_active":"2024-09-18T01:45:10.303911+0000","last_became_peered":"2024-09-18T01:45:10.303911+0000","last_unstale":"2024-09-18T01:48:32.347342+0000","last_undegraded":"2024-09-18T01:48:32.347342+0000","last_fullsized":"2024-09-18T01:48:32.347342+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'48","last_scrub_stamp":"2024-09-18T01:48:32.347225+0000","last_deep_scrub":"33'48","last_deep_scrub_stamp":"2024-09-18T01:48:32.347225+0000","last_clean_scrub_stamp":"2024-09-18T01:48:32.347225+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:04:17.415601+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:37.329031+0000","last_change":"2024-09-18T01:48:37.329031+0000","last_active":"2024-09-18T01:48:37.329031+0000","last_peered":"2024-09-18T01:48:37.329031+0000","last_clean":"2024-09-18T01:48:37.329031+0000","last_became_active":"2024-09-18T01:45:12.313180+0000","last_became_peered":"2024-09-18T01:45:12.313180+0000","last_unstale":"2024-09-18T01:48:37.329031+0000","last_undegraded":"2024-09-18T01:48:37.329031+0000","last_fullsized":"2024-09-18T01:48:37.329031+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:37.328895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:37.328895+0000","last_clean_scrub_stamp":"2024-09-18T01:48:37.328895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:52:12.877855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"33'3","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:37.218959+0000","last_change":"2024-09-18T01:45:14.326771+0000","last_active":"2024-09-18T01:47:37.218959+0000","last_peered":"2024-09-18T01:47:37.218959+0000","last_clean":"2024-09-18T01:47:37.218959+0000","last_became_active":"2024-09-18T01:45:14.326452+0000","last_became_peered":"2024-09-18T01:45:14.326452+0000","last_unstale":"2024-09-18T01:47:37.218959+0000","last_undegraded":"2024-09-18T01:47:37.218959+0000","last_fullsized":"2024-09-18T01:47:37.218959+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:01.377573+0000","last_change":"2024-09-18T01:49:01.377628+0000","last_active":"2024-09-18T01:49:01.377573+0000","last_peered":"2024-09-18T01:49:01.377573+0000","last_clean":"2024-09-18T01:49:01.377573+0000","last_became_active":"2024-09-18T01:45:06.281987+0000","last_became_peered":"2024-09-18T01:45:06.281987+0000","last_unstale":"2024-09-18T01:49:01.377573+0000","last_undegraded":"2024-09-18T01:49:01.377573+0000","last_fullsized":"2024-09-18T01:49:01.377573+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:01.377468+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:01.377468+0000","last_clean_scrub_stamp":"2024-09-18T01:49:01.377468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:37:31.352529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.489501+0000","last_change":"2024-09-18T01:45:04.290235+0000","last_active":"2024-09-18T01:48:19.489501+0000","last_peered":"2024-09-18T01:48:19.489501+0000","last_clean":"2024-09-18T01:48:19.489501+0000","last_became_active":"2024-09-18T01:45:04.289909+0000","last_became_peered":"2024-09-18T01:45:04.289909+0000","last_unstale":"2024-09-18T01:48:19.489501+0000","last_undegraded":"2024-09-18T01:48:19.489501+0000","last_fullsized":"2024-09-18T01:48:19.489501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:42.220069+0000","last_change":"2024-09-18T01:45:41.342634+0000","last_active":"2024-09-18T01:47:42.220069+0000","last_peered":"2024-09-18T01:47:42.220069+0000","last_clean":"2024-09-18T01:47:42.220069+0000","last_became_active":"2024-09-18T01:45:41.342280+0000","last_became_peered":"2024-09-18T01:45:41.342280+0000","last_unstale":"2024-09-18T01:47:42.220069+0000","last_undegraded":"2024-09-18T01:47:42.220069+0000","last_fullsized":"2024-09-18T01:47:42.220069+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'22","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:53.997424+0000","last_change":"2024-09-18T01:48:53.997424+0000","last_active":"2024-09-18T01:48:53.997424+0000","last_peered":"2024-09-18T01:48:53.997424+0000","last_clean":"2024-09-18T01:48:53.997424+0000","last_became_active":"2024-09-18T01:45:10.308524+0000","last_became_peered":"2024-09-18T01:45:10.308524+0000","last_unstale":"2024-09-18T01:48:53.997424+0000","last_undegraded":"2024-09-18T01:48:53.997424+0000","last_fullsized":"2024-09-18T01:48:53.997424+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2024-09-18T01:48:53.997246+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2024-09-18T01:48:53.997246+0000","last_clean_scrub_stamp":"2024-09-18T01:48:53.997246+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:03:08.771218+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'285","reported_seq":429,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:24.768020+0000","last_change":"2024-09-18T01:48:24.768020+0000","last_active":"2024-09-18T01:48:24.768020+0000","last_peered":"2024-09-18T01:48:24.768020+0000","last_clean":"2024-09-18T01:48:24.768020+0000","last_became_active":"2024-09-18T01:45:12.307186+0000","last_became_peered":"2024-09-18T01:45:12.307186+0000","last_unstale":"2024-09-18T01:48:24.768020+0000","last_undegraded":"2024-09-18T01:48:24.768020+0000","last_fullsized":"2024-09-18T01:48:24.768020+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-18T01:48:24.767877+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-18T01:48:24.767877+0000","last_clean_scrub_stamp":"2024-09-18T01:48:24.767877+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:40:56.957174+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"33'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.988462+0000","last_change":"2024-09-18T01:45:14.326301+0000","last_active":"2024-09-18T01:48:12.988462+0000","last_peered":"2024-09-18T01:48:12.988462+0000","last_clean":"2024-09-18T01:48:12.988462+0000","last_became_active":"2024-09-18T01:45:14.326018+0000","last_became_peered":"2024-09-18T01:45:14.326018+0000","last_unstale":"2024-09-18T01:48:12.988462+0000","last_undegraded":"2024-09-18T01:48:12.988462+0000","last_fullsized":"2024-09-18T01:48:12.988462+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"33'8","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:46.046853+0000","last_change":"2024-09-18T01:48:46.046882+0000","last_active":"2024-09-18T01:48:46.046853+0000","last_peered":"2024-09-18T01:48:46.046853+0000","last_clean":"2024-09-18T01:48:46.046853+0000","last_became_active":"2024-09-18T01:45:06.281798+0000","last_became_peered":"2024-09-18T01:45:06.281798+0000","last_unstale":"2024-09-18T01:48:46.046853+0000","last_undegraded":"2024-09-18T01:48:46.046853+0000","last_fullsized":"2024-09-18T01:48:46.046853+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-18T01:48:46.046757+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-18T01:48:46.046757+0000","last_clean_scrub_stamp":"2024-09-18T01:48:46.046757+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:18:18.174824+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:15.076405+0000","last_change":"2024-09-18T01:49:15.076439+0000","last_active":"2024-09-18T01:49:15.076405+0000","last_peered":"2024-09-18T01:49:15.076405+0000","last_clean":"2024-09-18T01:49:15.076405+0000","last_became_active":"2024-09-18T01:45:04.293009+0000","last_became_peered":"2024-09-18T01:45:04.293009+0000","last_unstale":"2024-09-18T01:49:15.076405+0000","last_undegraded":"2024-09-18T01:49:15.076405+0000","last_fullsized":"2024-09-18T01:49:15.076405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:15.076307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:15.076307+0000","last_clean_scrub_stamp":"2024-09-18T01:49:15.076307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:38:22.618396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:40.879858+0000","last_change":"2024-09-18T01:48:40.879897+0000","last_active":"2024-09-18T01:48:40.879858+0000","last_peered":"2024-09-18T01:48:40.879858+0000","last_clean":"2024-09-18T01:48:40.879858+0000","last_became_active":"2024-09-18T01:45:08.287884+0000","last_became_peered":"2024-09-18T01:45:08.287884+0000","last_unstale":"2024-09-18T01:48:40.879858+0000","last_undegraded":"2024-09-18T01:48:40.879858+0000","last_fullsized":"2024-09-18T01:48:40.879858+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:40.879744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:40.879744+0000","last_clean_scrub_stamp":"2024-09-18T01:48:40.879744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:23:57.801261+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'74","reported_seq":156,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:29.900192+0000","last_change":"2024-09-18T01:48:29.900260+0000","last_active":"2024-09-18T01:48:29.900192+0000","last_peered":"2024-09-18T01:48:29.900192+0000","last_clean":"2024-09-18T01:48:29.900192+0000","last_became_active":"2024-09-18T01:45:10.301087+0000","last_became_peered":"2024-09-18T01:45:10.301087+0000","last_unstale":"2024-09-18T01:48:29.900192+0000","last_undegraded":"2024-09-18T01:48:29.900192+0000","last_fullsized":"2024-09-18T01:48:29.900192+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'74","last_scrub_stamp":"2024-09-18T01:48:29.900089+0000","last_deep_scrub":"33'74","last_deep_scrub_stamp":"2024-09-18T01:48:29.900089+0000","last_clean_scrub_stamp":"2024-09-18T01:48:29.900089+0000","objects_scrubbed":11,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:03:12.147484+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:25.260421+0000","last_change":"2024-09-18T01:48:25.260445+0000","last_active":"2024-09-18T01:48:25.260421+0000","last_peered":"2024-09-18T01:48:25.260421+0000","last_clean":"2024-09-18T01:48:25.260421+0000","last_became_active":"2024-09-18T01:45:12.312055+0000","last_became_peered":"2024-09-18T01:45:12.312055+0000","last_unstale":"2024-09-18T01:48:25.260421+0000","last_undegraded":"2024-09-18T01:48:25.260421+0000","last_fullsized":"2024-09-18T01:48:25.260421+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:25.260301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:25.260301+0000","last_clean_scrub_stamp":"2024-09-18T01:48:25.260301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:20:06.632858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"33'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:20.049248+0000","last_change":"2024-09-18T01:49:20.049275+0000","last_active":"2024-09-18T01:49:20.049248+0000","last_peered":"2024-09-18T01:49:20.049248+0000","last_clean":"2024-09-18T01:49:20.049248+0000","last_became_active":"2024-09-18T01:45:14.322945+0000","last_became_peered":"2024-09-18T01:45:14.322945+0000","last_unstale":"2024-09-18T01:49:20.049248+0000","last_undegraded":"2024-09-18T01:49:20.049248+0000","last_fullsized":"2024-09-18T01:49:20.049248+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:20.049159+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:20.049159+0000","last_clean_scrub_stamp":"2024-09-18T01:49:20.049159+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:05:28.272049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'6","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:48.023951+0000","last_change":"2024-09-18T01:48:48.023979+0000","last_active":"2024-09-18T01:48:48.023951+0000","last_peered":"2024-09-18T01:48:48.023951+0000","last_clean":"2024-09-18T01:48:48.023951+0000","last_became_active":"2024-09-18T01:45:06.281480+0000","last_became_peered":"2024-09-18T01:45:06.281480+0000","last_unstale":"2024-09-18T01:48:48.023951+0000","last_undegraded":"2024-09-18T01:48:48.023951+0000","last_fullsized":"2024-09-18T01:48:48.023951+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-18T01:48:48.023825+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-18T01:48:48.023825+0000","last_clean_scrub_stamp":"2024-09-18T01:48:48.023825+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:47:46.236855+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:37.219189+0000","last_change":"2024-09-18T01:45:04.291296+0000","last_active":"2024-09-18T01:47:37.219189+0000","last_peered":"2024-09-18T01:47:37.219189+0000","last_clean":"2024-09-18T01:47:37.219189+0000","last_became_active":"2024-09-18T01:45:04.290901+0000","last_became_peered":"2024-09-18T01:45:04.290901+0000","last_unstale":"2024-09-18T01:47:37.219189+0000","last_undegraded":"2024-09-18T01:47:37.219189+0000","last_fullsized":"2024-09-18T01:47:37.219189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:41.995434+0000","last_change":"2024-09-18T01:48:41.995473+0000","last_active":"2024-09-18T01:48:41.995434+0000","last_peered":"2024-09-18T01:48:41.995434+0000","last_clean":"2024-09-18T01:48:41.995434+0000","last_became_active":"2024-09-18T01:45:08.286502+0000","last_became_peered":"2024-09-18T01:45:08.286502+0000","last_unstale":"2024-09-18T01:48:41.995434+0000","last_undegraded":"2024-09-18T01:48:41.995434+0000","last_fullsized":"2024-09-18T01:48:41.995434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:41.995333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:41.995333+0000","last_clean_scrub_stamp":"2024-09-18T01:48:41.995333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:40:51.267310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'43","reported_seq":104,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:30.281139+0000","last_change":"2024-09-18T01:48:30.281182+0000","last_active":"2024-09-18T01:48:30.281139+0000","last_peered":"2024-09-18T01:48:30.281139+0000","last_clean":"2024-09-18T01:48:30.281139+0000","last_became_active":"2024-09-18T01:45:10.306076+0000","last_became_peered":"2024-09-18T01:45:10.306076+0000","last_unstale":"2024-09-18T01:48:30.281139+0000","last_undegraded":"2024-09-18T01:48:30.281139+0000","last_fullsized":"2024-09-18T01:48:30.281139+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-09-18T01:48:30.281049+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-09-18T01:48:30.281049+0000","last_clean_scrub_stamp":"2024-09-18T01:48:30.281049+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:14:03.450919+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:46.991470+0000","last_change":"2024-09-18T01:48:46.991507+0000","last_active":"2024-09-18T01:48:46.991470+0000","last_peered":"2024-09-18T01:48:46.991470+0000","last_clean":"2024-09-18T01:48:46.991470+0000","last_became_active":"2024-09-18T01:45:12.316022+0000","last_became_peered":"2024-09-18T01:45:12.316022+0000","last_unstale":"2024-09-18T01:48:46.991470+0000","last_undegraded":"2024-09-18T01:48:46.991470+0000","last_fullsized":"2024-09-18T01:48:46.991470+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:46.991352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:46.991352+0000","last_clean_scrub_stamp":"2024-09-18T01:48:46.991352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:54:48.148908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:10.901935+0000","last_change":"2024-09-18T01:49:10.901958+0000","last_active":"2024-09-18T01:49:10.901935+0000","last_peered":"2024-09-18T01:49:10.901935+0000","last_clean":"2024-09-18T01:49:10.901935+0000","last_became_active":"2024-09-18T01:45:14.325208+0000","last_became_peered":"2024-09-18T01:45:14.325208+0000","last_unstale":"2024-09-18T01:49:10.901935+0000","last_undegraded":"2024-09-18T01:49:10.901935+0000","last_fullsized":"2024-09-18T01:49:10.901935+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:10.901834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:10.901834+0000","last_clean_scrub_stamp":"2024-09-18T01:49:10.901834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:07:05.409713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'26","reported_seq":103,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:04.884554+0000","last_change":"2024-09-18T01:49:04.884579+0000","last_active":"2024-09-18T01:49:04.884554+0000","last_peered":"2024-09-18T01:49:04.884554+0000","last_clean":"2024-09-18T01:49:04.884554+0000","last_became_active":"2024-09-18T01:45:06.283174+0000","last_became_peered":"2024-09-18T01:45:06.283174+0000","last_unstale":"2024-09-18T01:49:04.884554+0000","last_undegraded":"2024-09-18T01:49:04.884554+0000","last_fullsized":"2024-09-18T01:49:04.884554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'26","last_scrub_stamp":"2024-09-18T01:49:04.884436+0000","last_deep_scrub":"33'26","last_deep_scrub_stamp":"2024-09-18T01:49:04.884436+0000","last_clean_scrub_stamp":"2024-09-18T01:49:04.884436+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:46:17.194645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":84,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:13.343822+0000","last_change":"2024-09-18T01:49:13.343852+0000","last_active":"2024-09-18T01:49:13.343822+0000","last_peered":"2024-09-18T01:49:13.343822+0000","last_clean":"2024-09-18T01:49:13.343822+0000","last_became_active":"2024-09-18T01:45:04.273128+0000","last_became_peered":"2024-09-18T01:45:04.273128+0000","last_unstale":"2024-09-18T01:49:13.343822+0000","last_undegraded":"2024-09-18T01:49:13.343822+0000","last_fullsized":"2024-09-18T01:49:13.343822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:13.343714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:13.343714+0000","last_clean_scrub_stamp":"2024-09-18T01:49:13.343714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:05:43.373224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"33'5","reported_seq":238,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:33.930151+0000","last_change":"2024-09-18T01:48:33.930178+0000","last_active":"2024-09-18T01:48:33.930151+0000","last_peered":"2024-09-18T01:48:33.930151+0000","last_clean":"2024-09-18T01:48:33.930151+0000","last_became_active":"2024-09-18T01:45:08.294338+0000","last_became_peered":"2024-09-18T01:45:08.294338+0000","last_unstale":"2024-09-18T01:48:33.930151+0000","last_undegraded":"2024-09-18T01:48:33.930151+0000","last_fullsized":"2024-09-18T01:48:33.930151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-18T01:48:33.930067+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-18T01:48:33.930067+0000","last_clean_scrub_stamp":"2024-09-18T01:48:33.930067+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:04:18.998443+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'39","reported_seq":98,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:53.009496+0000","last_change":"2024-09-18T01:48:53.009528+0000","last_active":"2024-09-18T01:48:53.009496+0000","last_peered":"2024-09-18T01:48:53.009496+0000","last_clean":"2024-09-18T01:48:53.009496+0000","last_became_active":"2024-09-18T01:45:10.308336+0000","last_became_peered":"2024-09-18T01:45:10.308336+0000","last_unstale":"2024-09-18T01:48:53.009496+0000","last_undegraded":"2024-09-18T01:48:53.009496+0000","last_fullsized":"2024-09-18T01:48:53.009496+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'39","last_scrub_stamp":"2024-09-18T01:48:53.009391+0000","last_deep_scrub":"33'39","last_deep_scrub_stamp":"2024-09-18T01:48:53.009391+0000","last_clean_scrub_stamp":"2024-09-18T01:48:53.009391+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:38:00.551480+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:48.000035+0000","last_change":"2024-09-18T01:48:48.000061+0000","last_active":"2024-09-18T01:48:48.000035+0000","last_peered":"2024-09-18T01:48:48.000035+0000","last_clean":"2024-09-18T01:48:48.000035+0000","last_became_active":"2024-09-18T01:45:12.312794+0000","last_became_peered":"2024-09-18T01:45:12.312794+0000","last_unstale":"2024-09-18T01:48:48.000035+0000","last_undegraded":"2024-09-18T01:48:48.000035+0000","last_fullsized":"2024-09-18T01:48:48.000035+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:47.999948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:47.999948+0000","last_clean_scrub_stamp":"2024-09-18T01:48:47.999948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:23:16.320379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"33'10","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.564345+0000","last_change":"2024-09-18T01:45:14.325782+0000","last_active":"2024-09-18T01:48:12.564345+0000","last_peered":"2024-09-18T01:48:12.564345+0000","last_clean":"2024-09-18T01:48:12.564345+0000","last_became_active":"2024-09-18T01:45:14.325464+0000","last_became_peered":"2024-09-18T01:45:14.325464+0000","last_unstale":"2024-09-18T01:48:12.564345+0000","last_undegraded":"2024-09-18T01:48:12.564345+0000","last_fullsized":"2024-09-18T01:48:12.564345+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'8","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:50.009611+0000","last_change":"2024-09-18T01:48:50.009639+0000","last_active":"2024-09-18T01:48:50.009611+0000","last_peered":"2024-09-18T01:48:50.009611+0000","last_clean":"2024-09-18T01:48:50.009611+0000","last_became_active":"2024-09-18T01:45:06.283071+0000","last_became_peered":"2024-09-18T01:45:06.283071+0000","last_unstale":"2024-09-18T01:48:50.009611+0000","last_undegraded":"2024-09-18T01:48:50.009611+0000","last_fullsized":"2024-09-18T01:48:50.009611+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-18T01:48:50.009508+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-18T01:48:50.009508+0000","last_clean_scrub_stamp":"2024-09-18T01:48:50.009508+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:20:50.711544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:02.173712+0000","last_change":"2024-09-18T01:49:02.173712+0000","last_active":"2024-09-18T01:49:02.173712+0000","last_peered":"2024-09-18T01:49:02.173712+0000","last_clean":"2024-09-18T01:49:02.173712+0000","last_became_active":"2024-09-18T01:45:04.297716+0000","last_became_peered":"2024-09-18T01:45:04.297716+0000","last_unstale":"2024-09-18T01:49:02.173712+0000","last_undegraded":"2024-09-18T01:49:02.173712+0000","last_fullsized":"2024-09-18T01:49:02.173712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:49:02.173559+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:49:02.173559+0000","last_clean_scrub_stamp":"2024-09-18T01:49:02.173559+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:55:03.121556+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'3","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:36.961597+0000","last_change":"2024-09-18T01:48:36.961625+0000","last_active":"2024-09-18T01:48:36.961597+0000","last_peered":"2024-09-18T01:48:36.961597+0000","last_clean":"2024-09-18T01:48:36.961597+0000","last_became_active":"2024-09-18T01:45:08.294160+0000","last_became_peered":"2024-09-18T01:45:08.294160+0000","last_unstale":"2024-09-18T01:48:36.961597+0000","last_undegraded":"2024-09-18T01:48:36.961597+0000","last_fullsized":"2024-09-18T01:48:36.961597+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-18T01:48:36.961514+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-18T01:48:36.961514+0000","last_clean_scrub_stamp":"2024-09-18T01:48:36.961514+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:20:37.663549+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'53","reported_seq":122,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:43.072087+0000","last_change":"2024-09-18T01:48:43.072125+0000","last_active":"2024-09-18T01:48:43.072087+0000","last_peered":"2024-09-18T01:48:43.072087+0000","last_clean":"2024-09-18T01:48:43.072087+0000","last_became_active":"2024-09-18T01:45:10.308302+0000","last_became_peered":"2024-09-18T01:45:10.308302+0000","last_unstale":"2024-09-18T01:48:43.072087+0000","last_undegraded":"2024-09-18T01:48:43.072087+0000","last_fullsized":"2024-09-18T01:48:43.072087+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'53","last_scrub_stamp":"2024-09-18T01:48:43.071994+0000","last_deep_scrub":"33'53","last_deep_scrub_stamp":"2024-09-18T01:48:43.071994+0000","last_clean_scrub_stamp":"2024-09-18T01:48:43.071994+0000","objects_scrubbed":7,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:57:25.764909+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:28.229701+0000","last_change":"2024-09-18T01:48:28.229726+0000","last_active":"2024-09-18T01:48:28.229701+0000","last_peered":"2024-09-18T01:48:28.229701+0000","last_clean":"2024-09-18T01:48:28.229701+0000","last_became_active":"2024-09-18T01:45:12.305742+0000","last_became_peered":"2024-09-18T01:45:12.305742+0000","last_unstale":"2024-09-18T01:48:28.229701+0000","last_undegraded":"2024-09-18T01:48:28.229701+0000","last_fullsized":"2024-09-18T01:48:28.229701+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:28.229607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:28.229607+0000","last_clean_scrub_stamp":"2024-09-18T01:48:28.229607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:03:10.477001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"33'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:14.923041+0000","last_change":"2024-09-18T01:49:14.923068+0000","last_active":"2024-09-18T01:49:14.923041+0000","last_peered":"2024-09-18T01:49:14.923041+0000","last_clean":"2024-09-18T01:49:14.923041+0000","last_became_active":"2024-09-18T01:45:14.325368+0000","last_became_peered":"2024-09-18T01:45:14.325368+0000","last_unstale":"2024-09-18T01:49:14.923041+0000","last_undegraded":"2024-09-18T01:49:14.923041+0000","last_fullsized":"2024-09-18T01:49:14.923041+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:14.922951+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:14.922951+0000","last_clean_scrub_stamp":"2024-09-18T01:49:14.922951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:33:07.551122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"33'8","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.932175+0000","last_change":"2024-09-18T01:45:41.342690+0000","last_active":"2024-09-18T01:48:12.932175+0000","last_peered":"2024-09-18T01:48:12.932175+0000","last_clean":"2024-09-18T01:48:12.932175+0000","last_became_active":"2024-09-18T01:45:41.342336+0000","last_became_peered":"2024-09-18T01:45:41.342336+0000","last_unstale":"2024-09-18T01:48:12.932175+0000","last_undegraded":"2024-09-18T01:48:12.932175+0000","last_fullsized":"2024-09-18T01:48:12.932175+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:05.257734+0000","last_clean_scrub_stamp":"2024-09-18T01:45:05.257734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:03.045975+0000","last_change":"2024-09-18T01:49:03.045975+0000","last_active":"2024-09-18T01:49:03.045975+0000","last_peered":"2024-09-18T01:49:03.045975+0000","last_clean":"2024-09-18T01:49:03.045975+0000","last_became_active":"2024-09-18T01:45:04.284969+0000","last_became_peered":"2024-09-18T01:45:04.284969+0000","last_unstale":"2024-09-18T01:49:03.045975+0000","last_undegraded":"2024-09-18T01:49:03.045975+0000","last_fullsized":"2024-09-18T01:49:03.045975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:03.045840+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:03.045840+0000","last_clean_scrub_stamp":"2024-09-18T01:49:03.045840+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:10:07.759840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'12","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:09.314716+0000","last_change":"2024-09-18T01:49:09.314766+0000","last_active":"2024-09-18T01:49:09.314716+0000","last_peered":"2024-09-18T01:49:09.314716+0000","last_clean":"2024-09-18T01:49:09.314716+0000","last_became_active":"2024-09-18T01:45:06.285500+0000","last_became_peered":"2024-09-18T01:45:06.285500+0000","last_unstale":"2024-09-18T01:49:09.314716+0000","last_undegraded":"2024-09-18T01:49:09.314716+0000","last_fullsized":"2024-09-18T01:49:09.314716+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-18T01:49:09.314630+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-18T01:49:09.314630+0000","last_clean_scrub_stamp":"2024-09-18T01:49:09.314630+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:20:35.072341+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:10.357393+0000","last_change":"2024-09-18T01:49:10.357393+0000","last_active":"2024-09-18T01:49:10.357393+0000","last_peered":"2024-09-18T01:49:10.357393+0000","last_clean":"2024-09-18T01:49:10.357393+0000","last_became_active":"2024-09-18T01:45:04.280147+0000","last_became_peered":"2024-09-18T01:45:04.280147+0000","last_unstale":"2024-09-18T01:49:10.357393+0000","last_undegraded":"2024-09-18T01:49:10.357393+0000","last_fullsized":"2024-09-18T01:49:10.357393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:10.357273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:10.357273+0000","last_clean_scrub_stamp":"2024-09-18T01:49:10.357273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:29:03.313231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:11.874640+0000","last_change":"2024-09-18T01:49:11.874685+0000","last_active":"2024-09-18T01:49:11.874640+0000","last_peered":"2024-09-18T01:49:11.874640+0000","last_clean":"2024-09-18T01:49:11.874640+0000","last_became_active":"2024-09-18T01:45:06.278684+0000","last_became_peered":"2024-09-18T01:45:06.278684+0000","last_unstale":"2024-09-18T01:49:11.874640+0000","last_undegraded":"2024-09-18T01:49:11.874640+0000","last_fullsized":"2024-09-18T01:49:11.874640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:49:11.874525+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:49:11.874525+0000","last_clean_scrub_stamp":"2024-09-18T01:49:11.874525+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:10:48.245598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:23.651163+0000","last_change":"2024-09-18T01:45:04.283274+0000","last_active":"2024-09-18T01:48:23.651163+0000","last_peered":"2024-09-18T01:48:23.651163+0000","last_clean":"2024-09-18T01:48:23.651163+0000","last_became_active":"2024-09-18T01:45:04.281920+0000","last_became_peered":"2024-09-18T01:45:04.281920+0000","last_unstale":"2024-09-18T01:48:23.651163+0000","last_undegraded":"2024-09-18T01:48:23.651163+0000","last_fullsized":"2024-09-18T01:48:23.651163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"33'6","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:57.372948+0000","last_change":"2024-09-18T01:48:57.373010+0000","last_active":"2024-09-18T01:48:57.372948+0000","last_peered":"2024-09-18T01:48:57.372948+0000","last_clean":"2024-09-18T01:48:57.372948+0000","last_became_active":"2024-09-18T01:45:06.281998+0000","last_became_peered":"2024-09-18T01:45:06.281998+0000","last_unstale":"2024-09-18T01:48:57.372948+0000","last_undegraded":"2024-09-18T01:48:57.372948+0000","last_fullsized":"2024-09-18T01:48:57.372948+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-18T01:48:57.372819+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-18T01:48:57.372819+0000","last_clean_scrub_stamp":"2024-09-18T01:48:57.372819+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:39:02.799260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:08.302464+0000","last_change":"2024-09-18T01:49:08.302464+0000","last_active":"2024-09-18T01:49:08.302464+0000","last_peered":"2024-09-18T01:49:08.302464+0000","last_clean":"2024-09-18T01:49:08.302464+0000","last_became_active":"2024-09-18T01:45:04.280066+0000","last_became_peered":"2024-09-18T01:45:04.280066+0000","last_unstale":"2024-09-18T01:49:08.302464+0000","last_undegraded":"2024-09-18T01:49:08.302464+0000","last_fullsized":"2024-09-18T01:49:08.302464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:08.302332+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:08.302332+0000","last_clean_scrub_stamp":"2024-09-18T01:49:08.302332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:19:38.144899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:07.279054+0000","last_change":"2024-09-18T01:49:07.279054+0000","last_active":"2024-09-18T01:49:07.279054+0000","last_peered":"2024-09-18T01:49:07.279054+0000","last_clean":"2024-09-18T01:49:07.279054+0000","last_became_active":"2024-09-18T01:45:06.285054+0000","last_became_peered":"2024-09-18T01:45:06.285054+0000","last_unstale":"2024-09-18T01:49:07.279054+0000","last_undegraded":"2024-09-18T01:49:07.279054+0000","last_fullsized":"2024-09-18T01:49:07.279054+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:07.278872+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:07.278872+0000","last_clean_scrub_stamp":"2024-09-18T01:49:07.278872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:54:25.184819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:02.362657+0000","last_change":"2024-09-18T01:49:02.362686+0000","last_active":"2024-09-18T01:49:02.362657+0000","last_peered":"2024-09-18T01:49:02.362657+0000","last_clean":"2024-09-18T01:49:02.362657+0000","last_became_active":"2024-09-18T01:45:04.281146+0000","last_became_peered":"2024-09-18T01:45:04.281146+0000","last_unstale":"2024-09-18T01:49:02.362657+0000","last_undegraded":"2024-09-18T01:49:02.362657+0000","last_fullsized":"2024-09-18T01:49:02.362657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-18T01:49:02.362562+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-18T01:49:02.362562+0000","last_clean_scrub_stamp":"2024-09-18T01:49:02.362562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:27:34.245079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:07.095514+0000","last_change":"2024-09-18T01:49:07.095514+0000","last_active":"2024-09-18T01:49:07.095514+0000","last_peered":"2024-09-18T01:49:07.095514+0000","last_clean":"2024-09-18T01:49:07.095514+0000","last_became_active":"2024-09-18T01:45:06.292490+0000","last_became_peered":"2024-09-18T01:45:06.292490+0000","last_unstale":"2024-09-18T01:49:07.095514+0000","last_undegraded":"2024-09-18T01:49:07.095514+0000","last_fullsized":"2024-09-18T01:49:07.095514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:07.095395+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:07.095395+0000","last_clean_scrub_stamp":"2024-09-18T01:49:07.095395+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:18:33.137302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:16.106772+0000","last_change":"2024-09-18T01:49:16.106798+0000","last_active":"2024-09-18T01:49:16.106772+0000","last_peered":"2024-09-18T01:49:16.106772+0000","last_clean":"2024-09-18T01:49:16.106772+0000","last_became_active":"2024-09-18T01:45:04.293767+0000","last_became_peered":"2024-09-18T01:45:04.293767+0000","last_unstale":"2024-09-18T01:49:16.106772+0000","last_undegraded":"2024-09-18T01:49:16.106772+0000","last_fullsized":"2024-09-18T01:49:16.106772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:16.106685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:16.106685+0000","last_clean_scrub_stamp":"2024-09-18T01:49:16.106685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:03:30.880656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"33'10","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:51.420813+0000","last_change":"2024-09-18T01:48:51.420813+0000","last_active":"2024-09-18T01:48:51.420813+0000","last_peered":"2024-09-18T01:48:51.420813+0000","last_clean":"2024-09-18T01:48:51.420813+0000","last_became_active":"2024-09-18T01:45:06.293369+0000","last_became_peered":"2024-09-18T01:45:06.293369+0000","last_unstale":"2024-09-18T01:48:51.420813+0000","last_undegraded":"2024-09-18T01:48:51.420813+0000","last_fullsized":"2024-09-18T01:48:51.420813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-18T01:48:51.420614+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-18T01:48:51.420614+0000","last_clean_scrub_stamp":"2024-09-18T01:48:51.420614+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:43:49.179948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:57.058301+0000","last_change":"2024-09-18T01:48:57.058359+0000","last_active":"2024-09-18T01:48:57.058301+0000","last_peered":"2024-09-18T01:48:57.058301+0000","last_clean":"2024-09-18T01:48:57.058301+0000","last_became_active":"2024-09-18T01:45:04.292056+0000","last_became_peered":"2024-09-18T01:45:04.292056+0000","last_unstale":"2024-09-18T01:48:57.058301+0000","last_undegraded":"2024-09-18T01:48:57.058301+0000","last_fullsized":"2024-09-18T01:48:57.058301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:48:57.058174+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:48:57.058174+0000","last_clean_scrub_stamp":"2024-09-18T01:48:57.058174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:39:24.043782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'8","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:44.891289+0000","last_change":"2024-09-18T01:48:44.891289+0000","last_active":"2024-09-18T01:48:44.891289+0000","last_peered":"2024-09-18T01:48:44.891289+0000","last_clean":"2024-09-18T01:48:44.891289+0000","last_became_active":"2024-09-18T01:45:06.295055+0000","last_became_peered":"2024-09-18T01:45:06.295055+0000","last_unstale":"2024-09-18T01:48:44.891289+0000","last_undegraded":"2024-09-18T01:48:44.891289+0000","last_fullsized":"2024-09-18T01:48:44.891289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-18T01:48:44.891111+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-18T01:48:44.891111+0000","last_clean_scrub_stamp":"2024-09-18T01:48:44.891111+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:12:36.827132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:56.346211+0000","last_change":"2024-09-18T01:48:56.346237+0000","last_active":"2024-09-18T01:48:56.346211+0000","last_peered":"2024-09-18T01:48:56.346211+0000","last_clean":"2024-09-18T01:48:56.346211+0000","last_became_active":"2024-09-18T01:45:04.283959+0000","last_became_peered":"2024-09-18T01:45:04.283959+0000","last_unstale":"2024-09-18T01:48:56.346211+0000","last_undegraded":"2024-09-18T01:48:56.346211+0000","last_fullsized":"2024-09-18T01:48:56.346211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:56.346122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:56.346122+0000","last_clean_scrub_stamp":"2024-09-18T01:48:56.346122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:58:18.595435+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:47.927642+0000","last_change":"2024-09-18T01:48:47.927701+0000","last_active":"2024-09-18T01:48:47.927642+0000","last_peered":"2024-09-18T01:48:47.927642+0000","last_clean":"2024-09-18T01:48:47.927642+0000","last_became_active":"2024-09-18T01:45:06.295270+0000","last_became_peered":"2024-09-18T01:45:06.295270+0000","last_unstale":"2024-09-18T01:48:47.927642+0000","last_undegraded":"2024-09-18T01:48:47.927642+0000","last_fullsized":"2024-09-18T01:48:47.927642+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:48:47.927542+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:48:47.927542+0000","last_clean_scrub_stamp":"2024-09-18T01:48:47.927542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:48:47.618456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:17.215081+0000","last_change":"2024-09-18T01:45:04.280658+0000","last_active":"2024-09-18T01:47:17.215081+0000","last_peered":"2024-09-18T01:47:17.215081+0000","last_clean":"2024-09-18T01:47:17.215081+0000","last_became_active":"2024-09-18T01:45:04.278951+0000","last_became_peered":"2024-09-18T01:45:04.278951+0000","last_unstale":"2024-09-18T01:47:17.215081+0000","last_undegraded":"2024-09-18T01:47:17.215081+0000","last_fullsized":"2024-09-18T01:47:17.215081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'4","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:01.924260+0000","last_change":"2024-09-18T01:49:01.924286+0000","last_active":"2024-09-18T01:49:01.924260+0000","last_peered":"2024-09-18T01:49:01.924260+0000","last_clean":"2024-09-18T01:49:01.924260+0000","last_became_active":"2024-09-18T01:45:06.285272+0000","last_became_peered":"2024-09-18T01:45:06.285272+0000","last_unstale":"2024-09-18T01:49:01.924260+0000","last_undegraded":"2024-09-18T01:49:01.924260+0000","last_fullsized":"2024-09-18T01:49:01.924260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:49:01.924168+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:49:01.924168+0000","last_clean_scrub_stamp":"2024-09-18T01:49:01.924168+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:54:15.016033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:00.389539+0000","last_change":"2024-09-18T01:49:00.389566+0000","last_active":"2024-09-18T01:49:00.389539+0000","last_peered":"2024-09-18T01:49:00.389539+0000","last_clean":"2024-09-18T01:49:00.389539+0000","last_became_active":"2024-09-18T01:45:04.281197+0000","last_became_peered":"2024-09-18T01:45:04.281197+0000","last_unstale":"2024-09-18T01:49:00.389539+0000","last_undegraded":"2024-09-18T01:49:00.389539+0000","last_fullsized":"2024-09-18T01:49:00.389539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:00.389446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:00.389446+0000","last_clean_scrub_stamp":"2024-09-18T01:49:00.389446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:16:22.876886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"33'4","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:03.333738+0000","last_change":"2024-09-18T01:49:03.333763+0000","last_active":"2024-09-18T01:49:03.333738+0000","last_peered":"2024-09-18T01:49:03.333738+0000","last_clean":"2024-09-18T01:49:03.333738+0000","last_became_active":"2024-09-18T01:45:06.284989+0000","last_became_peered":"2024-09-18T01:45:06.284989+0000","last_unstale":"2024-09-18T01:49:03.333738+0000","last_undegraded":"2024-09-18T01:49:03.333738+0000","last_fullsized":"2024-09-18T01:49:03.333738+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:49:03.333650+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:49:03.333650+0000","last_clean_scrub_stamp":"2024-09-18T01:49:03.333650+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:58:12.247792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:04.101148+0000","last_change":"2024-09-18T01:49:04.101172+0000","last_active":"2024-09-18T01:49:04.101148+0000","last_peered":"2024-09-18T01:49:04.101148+0000","last_clean":"2024-09-18T01:49:04.101148+0000","last_became_active":"2024-09-18T01:45:04.294125+0000","last_became_peered":"2024-09-18T01:45:04.294125+0000","last_unstale":"2024-09-18T01:49:04.101148+0000","last_undegraded":"2024-09-18T01:49:04.101148+0000","last_fullsized":"2024-09-18T01:49:04.101148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:04.101055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:04.101055+0000","last_clean_scrub_stamp":"2024-09-18T01:49:04.101055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:37:34.076116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"33'10","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:56.058236+0000","last_change":"2024-09-18T01:48:56.058261+0000","last_active":"2024-09-18T01:48:56.058236+0000","last_peered":"2024-09-18T01:48:56.058236+0000","last_clean":"2024-09-18T01:48:56.058236+0000","last_became_active":"2024-09-18T01:45:06.279373+0000","last_became_peered":"2024-09-18T01:45:06.279373+0000","last_unstale":"2024-09-18T01:48:56.058236+0000","last_undegraded":"2024-09-18T01:48:56.058236+0000","last_fullsized":"2024-09-18T01:48:56.058236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-18T01:48:56.058151+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-18T01:48:56.058151+0000","last_clean_scrub_stamp":"2024-09-18T01:48:56.058151+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:04:14.350688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:13.057392+0000","last_change":"2024-09-18T01:49:13.057421+0000","last_active":"2024-09-18T01:49:13.057392+0000","last_peered":"2024-09-18T01:49:13.057392+0000","last_clean":"2024-09-18T01:49:13.057392+0000","last_became_active":"2024-09-18T01:45:04.291442+0000","last_became_peered":"2024-09-18T01:45:04.291442+0000","last_unstale":"2024-09-18T01:49:13.057392+0000","last_undegraded":"2024-09-18T01:49:13.057392+0000","last_fullsized":"2024-09-18T01:49:13.057392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:49:13.057304+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:49:13.057304+0000","last_clean_scrub_stamp":"2024-09-18T01:49:13.057304+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:10:42.433101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'6","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:17.085663+0000","last_change":"2024-09-18T01:49:17.085686+0000","last_active":"2024-09-18T01:49:17.085663+0000","last_peered":"2024-09-18T01:49:17.085663+0000","last_clean":"2024-09-18T01:49:17.085663+0000","last_became_active":"2024-09-18T01:45:06.292425+0000","last_became_peered":"2024-09-18T01:45:06.292425+0000","last_unstale":"2024-09-18T01:49:17.085663+0000","last_undegraded":"2024-09-18T01:49:17.085663+0000","last_fullsized":"2024-09-18T01:49:17.085663+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-18T01:49:17.085574+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-18T01:49:17.085574+0000","last_clean_scrub_stamp":"2024-09-18T01:49:17.085574+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:00:50.007418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:22.216129+0000","last_change":"2024-09-18T01:45:04.289922+0000","last_active":"2024-09-18T01:47:22.216129+0000","last_peered":"2024-09-18T01:47:22.216129+0000","last_clean":"2024-09-18T01:47:22.216129+0000","last_became_active":"2024-09-18T01:45:04.289365+0000","last_became_peered":"2024-09-18T01:45:04.289365+0000","last_unstale":"2024-09-18T01:47:22.216129+0000","last_undegraded":"2024-09-18T01:47:22.216129+0000","last_fullsized":"2024-09-18T01:47:22.216129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:52.005609+0000","last_change":"2024-09-18T01:48:52.005632+0000","last_active":"2024-09-18T01:48:52.005609+0000","last_peered":"2024-09-18T01:48:52.005609+0000","last_clean":"2024-09-18T01:48:52.005609+0000","last_became_active":"2024-09-18T01:45:06.293403+0000","last_became_peered":"2024-09-18T01:45:06.293403+0000","last_unstale":"2024-09-18T01:48:52.005609+0000","last_undegraded":"2024-09-18T01:48:52.005609+0000","last_fullsized":"2024-09-18T01:48:52.005609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:52.005522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:52.005522+0000","last_clean_scrub_stamp":"2024-09-18T01:48:52.005522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:15:53.488207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:22.216164+0000","last_change":"2024-09-18T01:45:04.278234+0000","last_active":"2024-09-18T01:47:22.216164+0000","last_peered":"2024-09-18T01:47:22.216164+0000","last_clean":"2024-09-18T01:47:22.216164+0000","last_became_active":"2024-09-18T01:45:04.277907+0000","last_became_peered":"2024-09-18T01:45:04.277907+0000","last_unstale":"2024-09-18T01:47:22.216164+0000","last_undegraded":"2024-09-18T01:47:22.216164+0000","last_fullsized":"2024-09-18T01:47:22.216164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'3","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:41.057651+0000","last_change":"2024-09-18T01:48:41.057681+0000","last_active":"2024-09-18T01:48:41.057651+0000","last_peered":"2024-09-18T01:48:41.057651+0000","last_clean":"2024-09-18T01:48:41.057651+0000","last_became_active":"2024-09-18T01:45:06.293036+0000","last_became_peered":"2024-09-18T01:45:06.293036+0000","last_unstale":"2024-09-18T01:48:41.057651+0000","last_undegraded":"2024-09-18T01:48:41.057651+0000","last_fullsized":"2024-09-18T01:48:41.057651+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-18T01:48:41.057559+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-18T01:48:41.057559+0000","last_clean_scrub_stamp":"2024-09-18T01:48:41.057559+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:16:03.544999+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:07.082784+0000","last_change":"2024-09-18T01:49:07.082806+0000","last_active":"2024-09-18T01:49:07.082784+0000","last_peered":"2024-09-18T01:49:07.082784+0000","last_clean":"2024-09-18T01:49:07.082784+0000","last_became_active":"2024-09-18T01:45:04.286591+0000","last_became_peered":"2024-09-18T01:45:04.286591+0000","last_unstale":"2024-09-18T01:49:07.082784+0000","last_undegraded":"2024-09-18T01:49:07.082784+0000","last_fullsized":"2024-09-18T01:49:07.082784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:07.082676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:07.082676+0000","last_clean_scrub_stamp":"2024-09-18T01:49:07.082676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:45:05.170743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"33'4","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:45.923327+0000","last_change":"2024-09-18T01:48:45.923392+0000","last_active":"2024-09-18T01:48:45.923327+0000","last_peered":"2024-09-18T01:48:45.923327+0000","last_clean":"2024-09-18T01:48:45.923327+0000","last_became_active":"2024-09-18T01:45:06.294911+0000","last_became_peered":"2024-09-18T01:45:06.294911+0000","last_unstale":"2024-09-18T01:48:45.923327+0000","last_undegraded":"2024-09-18T01:48:45.923327+0000","last_fullsized":"2024-09-18T01:48:45.923327+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:48:45.923209+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:48:45.923209+0000","last_clean_scrub_stamp":"2024-09-18T01:48:45.923209+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:37:21.719090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:17.884419+0000","last_change":"2024-09-18T01:49:17.884480+0000","last_active":"2024-09-18T01:49:17.884419+0000","last_peered":"2024-09-18T01:49:17.884419+0000","last_clean":"2024-09-18T01:49:17.884419+0000","last_became_active":"2024-09-18T01:45:04.285719+0000","last_became_peered":"2024-09-18T01:45:04.285719+0000","last_unstale":"2024-09-18T01:49:17.884419+0000","last_undegraded":"2024-09-18T01:49:17.884419+0000","last_fullsized":"2024-09-18T01:49:17.884419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:49:17.884301+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:49:17.884301+0000","last_clean_scrub_stamp":"2024-09-18T01:49:17.884301+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:38:45.163944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:19.491079+0000","last_change":"2024-09-18T01:45:04.280417+0000","last_active":"2024-09-18T01:48:19.491079+0000","last_peered":"2024-09-18T01:48:19.491079+0000","last_clean":"2024-09-18T01:48:19.491079+0000","last_became_active":"2024-09-18T01:45:04.278266+0000","last_became_peered":"2024-09-18T01:45:04.278266+0000","last_unstale":"2024-09-18T01:48:19.491079+0000","last_undegraded":"2024-09-18T01:48:19.491079+0000","last_fullsized":"2024-09-18T01:48:19.491079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:03.250238+0000","last_clean_scrub_stamp":"2024-09-18T01:45:03.250238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"33'10","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:19.358776+0000","last_change":"2024-09-18T01:49:19.358802+0000","last_active":"2024-09-18T01:49:19.358776+0000","last_peered":"2024-09-18T01:49:19.358776+0000","last_clean":"2024-09-18T01:49:19.358776+0000","last_became_active":"2024-09-18T01:45:06.292127+0000","last_became_peered":"2024-09-18T01:45:06.292127+0000","last_unstale":"2024-09-18T01:49:19.358776+0000","last_undegraded":"2024-09-18T01:49:19.358776+0000","last_fullsized":"2024-09-18T01:49:19.358776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-18T01:49:19.358648+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-18T01:49:19.358648+0000","last_clean_scrub_stamp":"2024-09-18T01:49:19.358648+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:49:14.544586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:17.377394+0000","last_change":"2024-09-18T01:49:17.377446+0000","last_active":"2024-09-18T01:49:17.377394+0000","last_peered":"2024-09-18T01:49:17.377394+0000","last_clean":"2024-09-18T01:49:17.377394+0000","last_became_active":"2024-09-18T01:45:04.273575+0000","last_became_peered":"2024-09-18T01:45:04.273575+0000","last_unstale":"2024-09-18T01:49:17.377394+0000","last_undegraded":"2024-09-18T01:49:17.377394+0000","last_fullsized":"2024-09-18T01:49:17.377394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:17.377288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:17.377288+0000","last_clean_scrub_stamp":"2024-09-18T01:49:17.377288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:03:33.963095+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'6","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:03.126363+0000","last_change":"2024-09-18T01:49:03.126408+0000","last_active":"2024-09-18T01:49:03.126363+0000","last_peered":"2024-09-18T01:49:03.126363+0000","last_clean":"2024-09-18T01:49:03.126363+0000","last_became_active":"2024-09-18T01:45:06.292037+0000","last_became_peered":"2024-09-18T01:45:06.292037+0000","last_unstale":"2024-09-18T01:49:03.126363+0000","last_undegraded":"2024-09-18T01:49:03.126363+0000","last_fullsized":"2024-09-18T01:49:03.126363+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-18T01:49:03.126249+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-18T01:49:03.126249+0000","last_clean_scrub_stamp":"2024-09-18T01:49:03.126249+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:16:25.613689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":269,"ondisk_log_size":269,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":9385,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1888,"num_read_kb":1653,"num_write":789,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1751,"ondisk_log_size":1751,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1590,"num_read_kb":1480,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":481,"ondisk_log_size":481,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705722,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39972,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331868,"statfs":{"total":96636764160,"available":96595832832,"internally_reserved":0,"allocated":479232,"data_stored":150270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705722,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40480,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331360,"statfs":{"total":96636764160,"available":96595312640,"internally_reserved":0,"allocated":999424,"data_stored":737378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705722,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40508,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331332,"statfs":{"total":96636764160,"available":96595283968,"internally_reserved":0,"allocated":1028096,"data_stored":738692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705722,"num_pgs":150,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39936,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331904,"statfs":{"total":96636764160,"available":96595869696,"internally_reserved":0,"allocated":442368,"data_stored":148296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T01:49:25.030 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:25.030 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:25.030 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:25.030 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:25.031 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:25.031 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:25.031 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:25.031 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:25.031 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:25.032 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:25.032 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:25.032 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-18T01:44:52.219730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=44, tm_sec=52, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:25.032 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-18T01:44:52.219730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=44, tm_sec=52, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:25.033 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-18T01:44:52.219730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=44, tm_sec=52, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:25.033 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-18T01:44:52.219730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=44, tm_sec=52, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:25.033 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-18T01:44:52.219730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=44, tm_sec=52, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:25.034 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-18T01:45:07.267106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:25.034 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:25.034 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:25.034 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:25.034 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:25.035 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:25.035 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:25.035 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-18T01:45:07.267106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:25.035 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:25.035 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:25.036 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:25.036 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-18T01:45:05.257734+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=5, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:25.036 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:25.036 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:25.036 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:25.036 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:25.037 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-18T01:45:03.250238+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=3, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:25.037 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-18T01:49:45.038 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T01:49:45.149 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:45.148+0000 7f6e441fd640 1 Processor -- start 2024-09-18T01:49:45.149 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:45.148+0000 7f6e441fd640 1 -- start start 2024-09-18T01:49:45.151 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:45.148+0000 7f6e441fd640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f6e3c096a10 0x7f6e3c06e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:49:45.151 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:45.148+0000 7f6e441fd640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e3c0702f0 con 0x7f6e3c096630 2024-09-18T01:49:45.151 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:45.148+0000 7f6e441fd640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x7f6e3c096e20 con 0x7f6e3c096a10 2024-09-18T01:49:45.151 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:45.149+0000 7f6e41798640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f6e3c096a10 0x7f6e3c06e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:49:45.151 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:45.149+0000 7f6e41f99640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f6e3c096630 0x7f6e3c06d910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:45980/0 (socket says 172.21.15.129:45980) 2024-09-18T01:49:45.151 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:45.149+0000 7f6e41798640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f6e3c096a10 0x7f6e3c06e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:46110/0 (socket says 172.21.15.129:46110) 2024-09-18T01:49:45.151 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:45.149+0000 7f6e41f99640 1 -- 172.21.15.129:0/3444190376 learned_addr learned my addr 172.21.15.129:0/3444190376 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-09-18T01:49:45.151 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:45.149+0000 7f6e41798640 1 -- 172.21.15.129:0/3444190376 >> v1:172.21.15.129:6789/0 conn(0x7f6e3c096630 legacy=0x7f6e3c06d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:49:45.151 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:45.149+0000 7f6e41798640 1 -- 172.21.15.129:0/3444190376 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e3c06f1f0 con 0x7f6e3c096a10 2024-09-18T01:49:45.152 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:45.149+0000 7f6e40f97640 1 -- 172.21.15.129:0/3444190376 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1141960023 0 0) 0x7f6e3c0702f0 con 0x7f6e3c096630 2024-09-18T01:49:45.152 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:45.150+0000 7f6e41798640 1 --2- 172.21.15.129:0/3444190376 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6e3c096a10 0x7f6e3c06e020 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c009720 tx=0x7f6e2c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86a70626646f8ea5 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:49:45.152 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:45.150+0000 7f6e40f97640 1 -- 172.21.15.129:0/3444190376 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e2c037070 con 0x7f6e3c096a10 2024-09-18T01:49:45.152 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:45.150+0000 7f6e40f97640 1 -- 172.21.15.129:0/3444190376 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e2c02ad90 con 0x7f6e3c096a10 2024-09-18T01:49:45.152 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:45.150+0000 7f6e40f97640 1 -- 172.21.15.129:0/3444190376 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e2c032590 con 0x7f6e3c096a10 2024-09-18T01:49:45.154 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:45.150+0000 7f6e441fd640 1 -- 172.21.15.129:0/3444190376 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6e3c096a10 msgr2=0x7f6e3c06e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:49:45.154 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:45.150+0000 7f6e441fd640 1 --2- 172.21.15.129:0/3444190376 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6e3c096a10 0x7f6e3c06e020 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c009720 tx=0x7f6e2c02a110 comp rx=0 tx=0).stop 2024-09-18T01:49:45.154 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:45.150+0000 7f6e441fd640 1 -- 172.21.15.129:0/3444190376 shutdown_connections 2024-09-18T01:49:45.155 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:45.150+0000 7f6e441fd640 1 --2- 172.21.15.129:0/3444190376 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6e3c096a10 0x7f6e3c06e020 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:49:45.155 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:45.150+0000 7f6e441fd640 1 -- 172.21.15.129:0/3444190376 >> 172.21.15.129:0/3444190376 conn(0x7f6e3c09a890 msgr2=0x7f6e3c09aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:49:45.155 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:45.150+0000 7f6e441fd640 1 -- 172.21.15.129:0/3444190376 shutdown_connections 2024-09-18T01:49:45.155 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:45.151+0000 7f6e441fd640 1 -- 172.21.15.129:0/3444190376 wait complete. 2024-09-18T01:49:45.155 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:45.151+0000 7f6e441fd640 1 Processor -- start 2024-09-18T01:49:45.155 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:45.151+0000 7f6e441fd640 1 -- start start 2024-09-18T01:49:45.155 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:45.152+0000 7f6e441fd640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6e3c096630 0x7f6e3c127740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:49:45.155 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:45.152+0000 7f6e441fd640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3c06e6e0 con 0x7f6e3c096630 2024-09-18T01:49:45.155 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:45.152+0000 7f6e41f99640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6e3c096630 0x7f6e3c127740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:49:45.155 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:45.152+0000 7f6e41f99640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6e3c096630 0x7f6e3c127740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:46122/0 (socket says 172.21.15.129:46122) 2024-09-18T01:49:45.156 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:45.152+0000 7f6e41f99640 1 -- 172.21.15.129:0/1614031139 learned_addr learned my addr 172.21.15.129:0/1614031139 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-18T01:49:45.156 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:45.152+0000 7f6e41f99640 1 -- 172.21.15.129:0/1614031139 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e3c072ea0 con 0x7f6e3c096630 2024-09-18T01:49:45.156 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:45.152+0000 7f6e41f99640 1 --2- 172.21.15.129:0/1614031139 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6e3c096630 0x7f6e3c127740 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f6e3800c420 tx=0x7f6e3800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:49:45.156 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:45.152+0000 7f6e327fc640 1 -- 172.21.15.129:0/1614031139 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e38018070 con 0x7f6e3c096630 2024-09-18T01:49:45.156 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:45.152+0000 7f6e327fc640 1 -- 172.21.15.129:0/1614031139 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e380074d0 con 0x7f6e3c096630 2024-09-18T01:49:45.156 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:45.152+0000 7f6e327fc640 1 -- 172.21.15.129:0/1614031139 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e38004950 con 0x7f6e3c096630 2024-09-18T01:49:45.156 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:45.152+0000 7f6e441fd640 1 -- 172.21.15.129:0/1614031139 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e3c1322e0 con 0x7f6e3c096630 2024-09-18T01:49:45.156 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:45.152+0000 7f6e441fd640 1 -- 172.21.15.129:0/1614031139 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e3c126a30 con 0x7f6e3c096630 2024-09-18T01:49:45.156 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:45.153+0000 7f6e327fc640 1 -- 172.21.15.129:0/1614031139 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6e3801b070 con 0x7f6e3c096630 2024-09-18T01:49:45.157 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:45.153+0000 7f6e327fc640 1 --2- 172.21.15.129:0/1614031139 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6e200382a0 0x7f6e2003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:49:45.157 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:45.153+0000 7f6e441fd640 1 -- 172.21.15.129:0/1614031139 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e3c126120 con 0x7f6e3c096630 2024-09-18T01:49:45.157 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:45.154+0000 7f6e327fc640 1 -- 172.21.15.129:0/1614031139 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f6e3804b0d0 con 0x7f6e3c096630 2024-09-18T01:49:45.157 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:45.154+0000 7f6e41798640 1 --2- 172.21.15.129:0/1614031139 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6e200382a0 0x7f6e2003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:49:45.157 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:45.154+0000 7f6e41798640 1 --2- 172.21.15.129:0/1614031139 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6e200382a0 0x7f6e2003a760 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c034000 tx=0x7f6e2c02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:49:45.159 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:45.158+0000 7f6e327fc640 1 -- 172.21.15.129:0/1614031139 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6e3c072ea0 con 0x7f6e3c096630 2024-09-18T01:49:45.324 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:45.322+0000 7f6e441fd640 1 -- 172.21.15.129:0/1614031139 --> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6e3c06d080 con 0x7f6e200382a0 2024-09-18T01:49:45.339 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:45.338+0000 7f6e327fc640 1 -- 172.21.15.129:0/1614031139 <== mgr.4099 v2:172.21.15.146:6824/168968651 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666001 (secure 0 0 0) 0x7f6e3c06d080 con 0x7f6e200382a0 2024-09-18T01:49:45.346 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:49:45.352 INFO:teuthology.orchestra.run.smithi129.stderr:dumped all 2024-09-18T01:49:45.355 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:45.343+0000 7f6e441fd640 1 -- 172.21.15.129:0/1614031139 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6e200382a0 msgr2=0x7f6e2003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:49:45.355 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:45.343+0000 7f6e441fd640 1 --2- 172.21.15.129:0/1614031139 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6e200382a0 0x7f6e2003a760 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c034000 tx=0x7f6e2c02e000 comp rx=0 tx=0).stop 2024-09-18T01:49:45.355 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:45.343+0000 7f6e441fd640 1 -- 172.21.15.129:0/1614031139 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6e3c096630 msgr2=0x7f6e3c127740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:49:45.355 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:45.343+0000 7f6e441fd640 1 --2- 172.21.15.129:0/1614031139 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6e3c096630 0x7f6e3c127740 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f6e3800c420 tx=0x7f6e3800c8e0 comp rx=0 tx=0).stop 2024-09-18T01:49:45.355 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:45.343+0000 7f6e441fd640 1 -- 172.21.15.129:0/1614031139 shutdown_connections 2024-09-18T01:49:45.355 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:45.343+0000 7f6e441fd640 1 --2- 172.21.15.129:0/1614031139 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f6e200382a0 0x7f6e2003a760 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:49:45.355 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:45.343+0000 7f6e441fd640 1 --2- 172.21.15.129:0/1614031139 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6e3c096630 0x7f6e3c127740 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:49:45.355 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:45.343+0000 7f6e441fd640 1 -- 172.21.15.129:0/1614031139 >> 172.21.15.129:0/1614031139 conn(0x7f6e3c09a890 msgr2=0x7f6e3c12ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:49:45.355 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:45.343+0000 7f6e441fd640 1 -- 172.21.15.129:0/1614031139 shutdown_connections 2024-09-18T01:49:45.356 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:49:45.343+0000 7f6e441fd640 1 -- 172.21.15.129:0/1614031139 wait complete. 2024-09-18T01:49:45.356 INFO:teuthology.orchestra.run.smithi129.stdout:{"pg_ready":true,"pg_map":{"version":179,"stamp":"2024-09-18T01:49:44.268513+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":603113,"num_objects":254,"num_object_clones":0,"num_object_copies":508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":254,"num_whiteouts":0,"num_read":5366,"num_read_kb":4915,"num_write":2371,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5014,"ondisk_log_size":5014,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":160896,"kb_used_data":2880,"kb_used_omap":6,"kb_used_meta":157945,"kb_avail":377326464,"statfs":{"total":386547056640,"available":386382299136,"internally_reserved":0,"allocated":2949120,"data_stored":1774636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":161736471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004371"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:08.035201+0000","last_change":"2024-09-18T01:49:08.035201+0000","last_active":"2024-09-18T01:49:08.035201+0000","last_peered":"2024-09-18T01:49:08.035201+0000","last_clean":"2024-09-18T01:49:08.035201+0000","last_became_active":"2024-09-18T01:45:04.287322+0000","last_became_peered":"2024-09-18T01:45:04.287322+0000","last_unstale":"2024-09-18T01:49:08.035201+0000","last_undegraded":"2024-09-18T01:49:08.035201+0000","last_fullsized":"2024-09-18T01:49:08.035201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:08.035082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:08.035082+0000","last_clean_scrub_stamp":"2024-09-18T01:49:08.035082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:28:41.589405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"33'8","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:43.875122+0000","last_change":"2024-09-18T01:48:43.875148+0000","last_active":"2024-09-18T01:48:43.875122+0000","last_peered":"2024-09-18T01:48:43.875122+0000","last_clean":"2024-09-18T01:48:43.875122+0000","last_became_active":"2024-09-18T01:45:06.295819+0000","last_became_peered":"2024-09-18T01:45:06.295819+0000","last_unstale":"2024-09-18T01:48:43.875122+0000","last_undegraded":"2024-09-18T01:48:43.875122+0000","last_fullsized":"2024-09-18T01:48:43.875122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-18T01:48:43.875034+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-18T01:48:43.875034+0000","last_clean_scrub_stamp":"2024-09-18T01:48:43.875034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:39:10.860642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:06.316407+0000","last_change":"2024-09-18T01:49:06.316407+0000","last_active":"2024-09-18T01:49:06.316407+0000","last_peered":"2024-09-18T01:49:06.316407+0000","last_clean":"2024-09-18T01:49:06.316407+0000","last_became_active":"2024-09-18T01:45:04.280591+0000","last_became_peered":"2024-09-18T01:45:04.280591+0000","last_unstale":"2024-09-18T01:49:06.316407+0000","last_undegraded":"2024-09-18T01:49:06.316407+0000","last_fullsized":"2024-09-18T01:49:06.316407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:06.316273+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:06.316273+0000","last_clean_scrub_stamp":"2024-09-18T01:49:06.316273+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:23:34.636704+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"33'12","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:07.934928+0000","last_change":"2024-09-18T01:49:07.934963+0000","last_active":"2024-09-18T01:49:07.934928+0000","last_peered":"2024-09-18T01:49:07.934928+0000","last_clean":"2024-09-18T01:49:07.934928+0000","last_became_active":"2024-09-18T01:45:06.281659+0000","last_became_peered":"2024-09-18T01:45:06.281659+0000","last_unstale":"2024-09-18T01:49:07.934928+0000","last_undegraded":"2024-09-18T01:49:07.934928+0000","last_fullsized":"2024-09-18T01:49:07.934928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-18T01:49:07.934844+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-18T01:49:07.934844+0000","last_clean_scrub_stamp":"2024-09-18T01:49:07.934844+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:40:23.892087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"33'5","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:19.942538+0000","last_change":"2024-09-18T01:49:19.942570+0000","last_active":"2024-09-18T01:49:19.942538+0000","last_peered":"2024-09-18T01:49:19.942538+0000","last_clean":"2024-09-18T01:49:19.942538+0000","last_became_active":"2024-09-18T01:45:04.286007+0000","last_became_peered":"2024-09-18T01:45:04.286007+0000","last_unstale":"2024-09-18T01:49:19.942538+0000","last_undegraded":"2024-09-18T01:49:19.942538+0000","last_fullsized":"2024-09-18T01:49:19.942538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-18T01:49:19.942440+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-18T01:49:19.942440+0000","last_clean_scrub_stamp":"2024-09-18T01:49:19.942440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:40:36.278314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"33'18","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:00.934191+0000","last_change":"2024-09-18T01:49:00.934242+0000","last_active":"2024-09-18T01:49:00.934191+0000","last_peered":"2024-09-18T01:49:00.934191+0000","last_clean":"2024-09-18T01:49:00.934191+0000","last_became_active":"2024-09-18T01:45:06.285378+0000","last_became_peered":"2024-09-18T01:45:06.285378+0000","last_unstale":"2024-09-18T01:49:00.934191+0000","last_undegraded":"2024-09-18T01:49:00.934191+0000","last_fullsized":"2024-09-18T01:49:00.934191+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'18","last_scrub_stamp":"2024-09-18T01:49:00.934082+0000","last_deep_scrub":"33'18","last_deep_scrub_stamp":"2024-09-18T01:49:00.934082+0000","last_clean_scrub_stamp":"2024-09-18T01:49:00.934082+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:48:56.120020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":40,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:49.054796+0000","last_change":"2024-09-18T01:48:49.054796+0000","last_active":"2024-09-18T01:48:49.054796+0000","last_peered":"2024-09-18T01:48:49.054796+0000","last_clean":"2024-09-18T01:48:49.054796+0000","last_became_active":"2024-09-18T01:45:04.297791+0000","last_became_peered":"2024-09-18T01:45:04.297791+0000","last_unstale":"2024-09-18T01:48:49.054796+0000","last_undegraded":"2024-09-18T01:48:49.054796+0000","last_fullsized":"2024-09-18T01:48:49.054796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:49.054679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:49.054679+0000","last_clean_scrub_stamp":"2024-09-18T01:48:49.054679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:23:20.643124+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"33'8","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:09.877827+0000","last_change":"2024-09-18T01:49:09.877886+0000","last_active":"2024-09-18T01:49:09.877827+0000","last_peered":"2024-09-18T01:49:09.877827+0000","last_clean":"2024-09-18T01:49:09.877827+0000","last_became_active":"2024-09-18T01:45:06.280779+0000","last_became_peered":"2024-09-18T01:45:06.280779+0000","last_unstale":"2024-09-18T01:49:09.877827+0000","last_undegraded":"2024-09-18T01:49:09.877827+0000","last_fullsized":"2024-09-18T01:49:09.877827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-18T01:49:09.877733+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-18T01:49:09.877733+0000","last_clean_scrub_stamp":"2024-09-18T01:49:09.877733+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:42:04.010151+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:32.007202+0000","last_change":"2024-09-18T01:49:32.007227+0000","last_active":"2024-09-18T01:49:32.007202+0000","last_peered":"2024-09-18T01:49:32.007202+0000","last_clean":"2024-09-18T01:49:32.007202+0000","last_became_active":"2024-09-18T01:45:04.280582+0000","last_became_peered":"2024-09-18T01:45:04.280582+0000","last_unstale":"2024-09-18T01:49:32.007202+0000","last_undegraded":"2024-09-18T01:49:32.007202+0000","last_fullsized":"2024-09-18T01:49:32.007202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:32.007109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:32.007109+0000","last_clean_scrub_stamp":"2024-09-18T01:49:32.007109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:07:31.844624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'12","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:53.032110+0000","last_change":"2024-09-18T01:48:53.032110+0000","last_active":"2024-09-18T01:48:53.032110+0000","last_peered":"2024-09-18T01:48:53.032110+0000","last_clean":"2024-09-18T01:48:53.032110+0000","last_became_active":"2024-09-18T01:45:06.289036+0000","last_became_peered":"2024-09-18T01:45:06.289036+0000","last_unstale":"2024-09-18T01:48:53.032110+0000","last_undegraded":"2024-09-18T01:48:53.032110+0000","last_fullsized":"2024-09-18T01:48:53.032110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-18T01:48:53.031994+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-18T01:48:53.031994+0000","last_clean_scrub_stamp":"2024-09-18T01:48:53.031994+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:49:17.553448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:04.058776+0000","last_change":"2024-09-18T01:49:04.058805+0000","last_active":"2024-09-18T01:49:04.058776+0000","last_peered":"2024-09-18T01:49:04.058776+0000","last_clean":"2024-09-18T01:49:04.058776+0000","last_became_active":"2024-09-18T01:45:04.286509+0000","last_became_peered":"2024-09-18T01:45:04.286509+0000","last_unstale":"2024-09-18T01:49:04.058776+0000","last_undegraded":"2024-09-18T01:49:04.058776+0000","last_fullsized":"2024-09-18T01:49:04.058776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:04.058678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:04.058678+0000","last_clean_scrub_stamp":"2024-09-18T01:49:04.058678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:39:50.767742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:42.024918+0000","last_change":"2024-09-18T01:48:42.024918+0000","last_active":"2024-09-18T01:48:42.024918+0000","last_peered":"2024-09-18T01:48:42.024918+0000","last_clean":"2024-09-18T01:48:42.024918+0000","last_became_active":"2024-09-18T01:45:06.287110+0000","last_became_peered":"2024-09-18T01:45:06.287110+0000","last_unstale":"2024-09-18T01:48:42.024918+0000","last_undegraded":"2024-09-18T01:48:42.024918+0000","last_fullsized":"2024-09-18T01:48:42.024918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:48:42.024803+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:48:42.024803+0000","last_clean_scrub_stamp":"2024-09-18T01:48:42.024803+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:37:11.999864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:15.881268+0000","last_change":"2024-09-18T01:49:15.881301+0000","last_active":"2024-09-18T01:49:15.881268+0000","last_peered":"2024-09-18T01:49:15.881268+0000","last_clean":"2024-09-18T01:49:15.881268+0000","last_became_active":"2024-09-18T01:45:04.289290+0000","last_became_peered":"2024-09-18T01:45:04.289290+0000","last_unstale":"2024-09-18T01:49:15.881268+0000","last_undegraded":"2024-09-18T01:49:15.881268+0000","last_fullsized":"2024-09-18T01:49:15.881268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:49:15.881149+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:49:15.881149+0000","last_clean_scrub_stamp":"2024-09-18T01:49:15.881149+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:23:57.699141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'14","reported_seq":80,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:45.086505+0000","last_change":"2024-09-18T01:48:45.086505+0000","last_active":"2024-09-18T01:48:45.086505+0000","last_peered":"2024-09-18T01:48:45.086505+0000","last_clean":"2024-09-18T01:48:45.086505+0000","last_became_active":"2024-09-18T01:45:06.295429+0000","last_became_peered":"2024-09-18T01:45:06.295429+0000","last_unstale":"2024-09-18T01:48:45.086505+0000","last_undegraded":"2024-09-18T01:48:45.086505+0000","last_fullsized":"2024-09-18T01:48:45.086505+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-09-18T01:48:45.086369+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-09-18T01:48:45.086369+0000","last_clean_scrub_stamp":"2024-09-18T01:48:45.086369+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:14:18.256239+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:16.394781+0000","last_change":"2024-09-18T01:49:16.394839+0000","last_active":"2024-09-18T01:49:16.394781+0000","last_peered":"2024-09-18T01:49:16.394781+0000","last_clean":"2024-09-18T01:49:16.394781+0000","last_became_active":"2024-09-18T01:45:04.273328+0000","last_became_peered":"2024-09-18T01:45:04.273328+0000","last_unstale":"2024-09-18T01:49:16.394781+0000","last_undegraded":"2024-09-18T01:49:16.394781+0000","last_fullsized":"2024-09-18T01:49:16.394781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:16.394672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:16.394672+0000","last_clean_scrub_stamp":"2024-09-18T01:49:16.394672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:48:30.113176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'10","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:56.083996+0000","last_change":"2024-09-18T01:48:56.083996+0000","last_active":"2024-09-18T01:48:56.083996+0000","last_peered":"2024-09-18T01:48:56.083996+0000","last_clean":"2024-09-18T01:48:56.083996+0000","last_became_active":"2024-09-18T01:45:06.284994+0000","last_became_peered":"2024-09-18T01:45:06.284994+0000","last_unstale":"2024-09-18T01:48:56.083996+0000","last_undegraded":"2024-09-18T01:48:56.083996+0000","last_fullsized":"2024-09-18T01:48:56.083996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-18T01:48:56.083802+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-18T01:48:56.083802+0000","last_clean_scrub_stamp":"2024-09-18T01:48:56.083802+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:24:40.822016+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"33'4","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:59.956051+0000","last_change":"2024-09-18T01:48:59.956077+0000","last_active":"2024-09-18T01:48:59.956051+0000","last_peered":"2024-09-18T01:48:59.956051+0000","last_clean":"2024-09-18T01:48:59.956051+0000","last_became_active":"2024-09-18T01:45:06.286524+0000","last_became_peered":"2024-09-18T01:45:06.286524+0000","last_unstale":"2024-09-18T01:48:59.956051+0000","last_undegraded":"2024-09-18T01:48:59.956051+0000","last_fullsized":"2024-09-18T01:48:59.956051+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:48:59.955964+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:48:59.955964+0000","last_clean_scrub_stamp":"2024-09-18T01:48:59.955964+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:47:30.798351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:00.111939+0000","last_change":"2024-09-18T01:49:00.111985+0000","last_active":"2024-09-18T01:49:00.111939+0000","last_peered":"2024-09-18T01:49:00.111939+0000","last_clean":"2024-09-18T01:49:00.111939+0000","last_became_active":"2024-09-18T01:45:04.298399+0000","last_became_peered":"2024-09-18T01:45:04.298399+0000","last_unstale":"2024-09-18T01:49:00.111939+0000","last_undegraded":"2024-09-18T01:49:00.111939+0000","last_fullsized":"2024-09-18T01:49:00.111939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:00.111843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:00.111843+0000","last_clean_scrub_stamp":"2024-09-18T01:49:00.111843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:39:05.538284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"33'10","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:48.963664+0000","last_change":"2024-09-18T01:48:48.963691+0000","last_active":"2024-09-18T01:48:48.963664+0000","last_peered":"2024-09-18T01:48:48.963664+0000","last_clean":"2024-09-18T01:48:48.963664+0000","last_became_active":"2024-09-18T01:45:06.294670+0000","last_became_peered":"2024-09-18T01:45:06.294670+0000","last_unstale":"2024-09-18T01:48:48.963664+0000","last_undegraded":"2024-09-18T01:48:48.963664+0000","last_fullsized":"2024-09-18T01:48:48.963664+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-18T01:48:48.963573+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-18T01:48:48.963573+0000","last_clean_scrub_stamp":"2024-09-18T01:48:48.963573+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:47:46.867517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:05.082389+0000","last_change":"2024-09-18T01:49:05.082415+0000","last_active":"2024-09-18T01:49:05.082389+0000","last_peered":"2024-09-18T01:49:05.082389+0000","last_clean":"2024-09-18T01:49:05.082389+0000","last_became_active":"2024-09-18T01:45:04.286465+0000","last_became_peered":"2024-09-18T01:45:04.286465+0000","last_unstale":"2024-09-18T01:49:05.082389+0000","last_undegraded":"2024-09-18T01:49:05.082389+0000","last_fullsized":"2024-09-18T01:49:05.082389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:05.082258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:05.082258+0000","last_clean_scrub_stamp":"2024-09-18T01:49:05.082258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:16:06.564943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:49.977271+0000","last_change":"2024-09-18T01:48:49.977300+0000","last_active":"2024-09-18T01:48:49.977271+0000","last_peered":"2024-09-18T01:48:49.977271+0000","last_clean":"2024-09-18T01:48:49.977271+0000","last_became_active":"2024-09-18T01:45:06.294118+0000","last_became_peered":"2024-09-18T01:45:06.294118+0000","last_unstale":"2024-09-18T01:48:49.977271+0000","last_undegraded":"2024-09-18T01:48:49.977271+0000","last_fullsized":"2024-09-18T01:48:49.977271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:48:49.977187+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:48:49.977187+0000","last_clean_scrub_stamp":"2024-09-18T01:48:49.977187+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:09:54.691187+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:08.073194+0000","last_change":"2024-09-18T01:49:08.073231+0000","last_active":"2024-09-18T01:49:08.073194+0000","last_peered":"2024-09-18T01:49:08.073194+0000","last_clean":"2024-09-18T01:49:08.073194+0000","last_became_active":"2024-09-18T01:45:04.294327+0000","last_became_peered":"2024-09-18T01:45:04.294327+0000","last_unstale":"2024-09-18T01:49:08.073194+0000","last_undegraded":"2024-09-18T01:49:08.073194+0000","last_fullsized":"2024-09-18T01:49:08.073194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:08.073097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:08.073097+0000","last_clean_scrub_stamp":"2024-09-18T01:49:08.073097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:33:22.408363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'4","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:05.363099+0000","last_change":"2024-09-18T01:49:05.363125+0000","last_active":"2024-09-18T01:49:05.363099+0000","last_peered":"2024-09-18T01:49:05.363099+0000","last_clean":"2024-09-18T01:49:05.363099+0000","last_became_active":"2024-09-18T01:45:06.285429+0000","last_became_peered":"2024-09-18T01:45:06.285429+0000","last_unstale":"2024-09-18T01:49:05.363099+0000","last_undegraded":"2024-09-18T01:49:05.363099+0000","last_fullsized":"2024-09-18T01:49:05.363099+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:49:05.363015+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:49:05.363015+0000","last_clean_scrub_stamp":"2024-09-18T01:49:05.363015+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:53:08.090252+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:58.089164+0000","last_change":"2024-09-18T01:48:58.089192+0000","last_active":"2024-09-18T01:48:58.089164+0000","last_peered":"2024-09-18T01:48:58.089164+0000","last_clean":"2024-09-18T01:48:58.089164+0000","last_became_active":"2024-09-18T01:45:04.298601+0000","last_became_peered":"2024-09-18T01:45:04.298601+0000","last_unstale":"2024-09-18T01:48:58.089164+0000","last_undegraded":"2024-09-18T01:48:58.089164+0000","last_fullsized":"2024-09-18T01:48:58.089164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:58.089075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:58.089075+0000","last_clean_scrub_stamp":"2024-09-18T01:48:58.089075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:14:10.025695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'10","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:00.074915+0000","last_change":"2024-09-18T01:49:00.074940+0000","last_active":"2024-09-18T01:49:00.074915+0000","last_peered":"2024-09-18T01:49:00.074915+0000","last_clean":"2024-09-18T01:49:00.074915+0000","last_became_active":"2024-09-18T01:45:06.285228+0000","last_became_peered":"2024-09-18T01:45:06.285228+0000","last_unstale":"2024-09-18T01:49:00.074915+0000","last_undegraded":"2024-09-18T01:49:00.074915+0000","last_fullsized":"2024-09-18T01:49:00.074915+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-18T01:49:00.074829+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-18T01:49:00.074829+0000","last_clean_scrub_stamp":"2024-09-18T01:49:00.074829+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:14:47.671460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:04.355120+0000","last_change":"2024-09-18T01:49:04.355158+0000","last_active":"2024-09-18T01:49:04.355120+0000","last_peered":"2024-09-18T01:49:04.355120+0000","last_clean":"2024-09-18T01:49:04.355120+0000","last_became_active":"2024-09-18T01:45:04.281118+0000","last_became_peered":"2024-09-18T01:45:04.281118+0000","last_unstale":"2024-09-18T01:49:04.355120+0000","last_undegraded":"2024-09-18T01:49:04.355120+0000","last_fullsized":"2024-09-18T01:49:04.355120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:04.355016+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:04.355016+0000","last_clean_scrub_stamp":"2024-09-18T01:49:04.355016+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:04:07.222319+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"33'16","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:54.067694+0000","last_change":"2024-09-18T01:48:54.067746+0000","last_active":"2024-09-18T01:48:54.067694+0000","last_peered":"2024-09-18T01:48:54.067694+0000","last_clean":"2024-09-18T01:48:54.067694+0000","last_became_active":"2024-09-18T01:45:06.284237+0000","last_became_peered":"2024-09-18T01:45:06.284237+0000","last_unstale":"2024-09-18T01:48:54.067694+0000","last_undegraded":"2024-09-18T01:48:54.067694+0000","last_fullsized":"2024-09-18T01:48:54.067694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2024-09-18T01:48:54.067597+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2024-09-18T01:48:54.067597+0000","last_clean_scrub_stamp":"2024-09-18T01:48:54.067597+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:44:52.155664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":48,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:28.008854+0000","last_change":"2024-09-18T01:49:28.008884+0000","last_active":"2024-09-18T01:49:28.008854+0000","last_peered":"2024-09-18T01:49:28.008854+0000","last_clean":"2024-09-18T01:49:28.008854+0000","last_became_active":"2024-09-18T01:45:04.284148+0000","last_became_peered":"2024-09-18T01:45:04.284148+0000","last_unstale":"2024-09-18T01:49:28.008854+0000","last_undegraded":"2024-09-18T01:49:28.008854+0000","last_fullsized":"2024-09-18T01:49:28.008854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:28.008717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:28.008717+0000","last_clean_scrub_stamp":"2024-09-18T01:49:28.008717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:41:39.278243+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'36","reported_seq":109,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:18.085041+0000","last_change":"2024-09-18T01:49:18.085074+0000","last_active":"2024-09-18T01:49:18.085041+0000","last_peered":"2024-09-18T01:49:18.085041+0000","last_clean":"2024-09-18T01:49:18.085041+0000","last_became_active":"2024-09-18T01:45:14.322729+0000","last_became_peered":"2024-09-18T01:45:14.322729+0000","last_unstale":"2024-09-18T01:49:18.085041+0000","last_undegraded":"2024-09-18T01:49:18.085041+0000","last_fullsized":"2024-09-18T01:49:18.085041+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'36","last_scrub_stamp":"2024-09-18T01:49:18.084950+0000","last_deep_scrub":"33'36","last_deep_scrub_stamp":"2024-09-18T01:49:18.084950+0000","last_clean_scrub_stamp":"2024-09-18T01:49:18.084950+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:39:22.889311+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'10","reported_seq":82,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:08.901679+0000","last_change":"2024-09-18T01:49:08.901728+0000","last_active":"2024-09-18T01:49:08.901679+0000","last_peered":"2024-09-18T01:49:08.901679+0000","last_clean":"2024-09-18T01:49:08.901679+0000","last_became_active":"2024-09-18T01:45:06.281361+0000","last_became_peered":"2024-09-18T01:45:06.281361+0000","last_unstale":"2024-09-18T01:49:08.901679+0000","last_undegraded":"2024-09-18T01:49:08.901679+0000","last_fullsized":"2024-09-18T01:49:08.901679+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-18T01:49:08.901575+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-18T01:49:08.901575+0000","last_clean_scrub_stamp":"2024-09-18T01:49:08.901575+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:51:58.229652+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:25.951098+0000","last_change":"2024-09-18T01:49:25.951126+0000","last_active":"2024-09-18T01:49:25.951098+0000","last_peered":"2024-09-18T01:49:25.951098+0000","last_clean":"2024-09-18T01:49:25.951098+0000","last_became_active":"2024-09-18T01:45:04.285008+0000","last_became_peered":"2024-09-18T01:45:04.285008+0000","last_unstale":"2024-09-18T01:49:25.951098+0000","last_undegraded":"2024-09-18T01:49:25.951098+0000","last_fullsized":"2024-09-18T01:49:25.951098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:25.951000+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:25.951000+0000","last_clean_scrub_stamp":"2024-09-18T01:49:25.951000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:26:14.441210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:25.014640+0000","last_change":"2024-09-18T01:48:25.014675+0000","last_active":"2024-09-18T01:48:25.014640+0000","last_peered":"2024-09-18T01:48:25.014640+0000","last_clean":"2024-09-18T01:48:25.014640+0000","last_became_active":"2024-09-18T01:45:08.296241+0000","last_became_peered":"2024-09-18T01:45:08.296241+0000","last_unstale":"2024-09-18T01:48:25.014640+0000","last_undegraded":"2024-09-18T01:48:25.014640+0000","last_fullsized":"2024-09-18T01:48:25.014640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:25.014547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:25.014547+0000","last_clean_scrub_stamp":"2024-09-18T01:48:25.014547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:06:32.938495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'51","reported_seq":118,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:29.025471+0000","last_change":"2024-09-18T01:48:29.025537+0000","last_active":"2024-09-18T01:48:29.025471+0000","last_peered":"2024-09-18T01:48:29.025471+0000","last_clean":"2024-09-18T01:48:29.025471+0000","last_became_active":"2024-09-18T01:45:10.305713+0000","last_became_peered":"2024-09-18T01:45:10.305713+0000","last_unstale":"2024-09-18T01:48:29.025471+0000","last_undegraded":"2024-09-18T01:48:29.025471+0000","last_fullsized":"2024-09-18T01:48:29.025471+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'51","last_scrub_stamp":"2024-09-18T01:48:29.025349+0000","last_deep_scrub":"33'51","last_deep_scrub_stamp":"2024-09-18T01:48:29.025349+0000","last_clean_scrub_stamp":"2024-09-18T01:48:29.025349+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:55:10.299048+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:26.973099+0000","last_change":"2024-09-18T01:48:26.973124+0000","last_active":"2024-09-18T01:48:26.973099+0000","last_peered":"2024-09-18T01:48:26.973099+0000","last_clean":"2024-09-18T01:48:26.973099+0000","last_became_active":"2024-09-18T01:45:12.313276+0000","last_became_peered":"2024-09-18T01:45:12.313276+0000","last_unstale":"2024-09-18T01:48:26.973099+0000","last_undegraded":"2024-09-18T01:48:26.973099+0000","last_fullsized":"2024-09-18T01:48:26.973099+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:26.973012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:26.973012+0000","last_clean_scrub_stamp":"2024-09-18T01:48:26.973012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:54:46.334494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'7","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:46.918917+0000","last_change":"2024-09-18T01:48:46.918960+0000","last_active":"2024-09-18T01:48:46.918917+0000","last_peered":"2024-09-18T01:48:46.918917+0000","last_clean":"2024-09-18T01:48:46.918917+0000","last_became_active":"2024-09-18T01:45:14.318093+0000","last_became_peered":"2024-09-18T01:45:14.318093+0000","last_unstale":"2024-09-18T01:48:46.918917+0000","last_undegraded":"2024-09-18T01:48:46.918917+0000","last_fullsized":"2024-09-18T01:48:46.918917+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-09-18T01:48:46.918798+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-09-18T01:48:46.918798+0000","last_clean_scrub_stamp":"2024-09-18T01:48:46.918798+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:14:34.515429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"33'14","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:16.116506+0000","last_change":"2024-09-18T01:49:16.116550+0000","last_active":"2024-09-18T01:49:16.116506+0000","last_peered":"2024-09-18T01:49:16.116506+0000","last_clean":"2024-09-18T01:49:16.116506+0000","last_became_active":"2024-09-18T01:45:41.338243+0000","last_became_peered":"2024-09-18T01:45:41.338243+0000","last_unstale":"2024-09-18T01:49:16.116506+0000","last_undegraded":"2024-09-18T01:49:16.116506+0000","last_fullsized":"2024-09-18T01:49:16.116506+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-09-18T01:49:16.116373+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-09-18T01:49:16.116373+0000","last_clean_scrub_stamp":"2024-09-18T01:49:16.116373+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:55:17.064370+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":13,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:53.039033+0000","last_change":"2024-09-18T01:48:53.039071+0000","last_active":"2024-09-18T01:48:53.039033+0000","last_peered":"2024-09-18T01:48:53.039033+0000","last_clean":"2024-09-18T01:48:53.039033+0000","last_became_active":"2024-09-18T01:45:04.292853+0000","last_became_peered":"2024-09-18T01:45:04.292853+0000","last_unstale":"2024-09-18T01:48:53.039033+0000","last_undegraded":"2024-09-18T01:48:53.039033+0000","last_fullsized":"2024-09-18T01:48:53.039033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:48:53.038933+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:48:53.038933+0000","last_clean_scrub_stamp":"2024-09-18T01:48:53.038933+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:24:38.409165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:47.382739+0000","last_change":"2024-09-18T01:48:47.382764+0000","last_active":"2024-09-18T01:48:47.382739+0000","last_peered":"2024-09-18T01:48:47.382739+0000","last_clean":"2024-09-18T01:48:47.382739+0000","last_became_active":"2024-09-18T01:45:08.288390+0000","last_became_peered":"2024-09-18T01:45:08.288390+0000","last_unstale":"2024-09-18T01:48:47.382739+0000","last_undegraded":"2024-09-18T01:48:47.382739+0000","last_fullsized":"2024-09-18T01:48:47.382739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:47.382647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:47.382647+0000","last_clean_scrub_stamp":"2024-09-18T01:48:47.382647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:54:16.834483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"33'16","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:28.924284+0000","last_change":"2024-09-18T01:48:28.924317+0000","last_active":"2024-09-18T01:48:28.924284+0000","last_peered":"2024-09-18T01:48:28.924284+0000","last_clean":"2024-09-18T01:48:28.924284+0000","last_became_active":"2024-09-18T01:45:10.302957+0000","last_became_peered":"2024-09-18T01:45:10.302957+0000","last_unstale":"2024-09-18T01:48:28.924284+0000","last_undegraded":"2024-09-18T01:48:28.924284+0000","last_fullsized":"2024-09-18T01:48:28.924284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2024-09-18T01:48:28.924202+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2024-09-18T01:48:28.924202+0000","last_clean_scrub_stamp":"2024-09-18T01:48:28.924202+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:40:38.196180+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:34.948777+0000","last_change":"2024-09-18T01:48:34.948803+0000","last_active":"2024-09-18T01:48:34.948777+0000","last_peered":"2024-09-18T01:48:34.948777+0000","last_clean":"2024-09-18T01:48:34.948777+0000","last_became_active":"2024-09-18T01:45:12.317471+0000","last_became_peered":"2024-09-18T01:45:12.317471+0000","last_unstale":"2024-09-18T01:48:34.948777+0000","last_undegraded":"2024-09-18T01:48:34.948777+0000","last_fullsized":"2024-09-18T01:48:34.948777+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:34.948683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:34.948683+0000","last_clean_scrub_stamp":"2024-09-18T01:48:34.948683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:47:33.161713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:22.311066+0000","last_change":"2024-09-18T01:49:22.311092+0000","last_active":"2024-09-18T01:49:22.311066+0000","last_peered":"2024-09-18T01:49:22.311066+0000","last_clean":"2024-09-18T01:49:22.311066+0000","last_became_active":"2024-09-18T01:45:14.319387+0000","last_became_peered":"2024-09-18T01:45:14.319387+0000","last_unstale":"2024-09-18T01:49:22.311066+0000","last_undegraded":"2024-09-18T01:49:22.311066+0000","last_fullsized":"2024-09-18T01:49:22.311066+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-18T01:49:22.310976+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-18T01:49:22.310976+0000","last_clean_scrub_stamp":"2024-09-18T01:49:22.310976+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:05:15.685447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'10","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:03.891051+0000","last_change":"2024-09-18T01:49:03.891076+0000","last_active":"2024-09-18T01:49:03.891051+0000","last_peered":"2024-09-18T01:49:03.891051+0000","last_clean":"2024-09-18T01:49:03.891051+0000","last_became_active":"2024-09-18T01:45:06.283815+0000","last_became_peered":"2024-09-18T01:45:06.283815+0000","last_unstale":"2024-09-18T01:49:03.891051+0000","last_undegraded":"2024-09-18T01:49:03.891051+0000","last_fullsized":"2024-09-18T01:49:03.891051+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-18T01:49:03.890961+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-18T01:49:03.890961+0000","last_clean_scrub_stamp":"2024-09-18T01:49:03.890961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:29:40.610319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:41.028761+0000","last_change":"2024-09-18T01:49:41.028787+0000","last_active":"2024-09-18T01:49:41.028761+0000","last_peered":"2024-09-18T01:49:41.028761+0000","last_clean":"2024-09-18T01:49:41.028761+0000","last_became_active":"2024-09-18T01:45:04.288040+0000","last_became_peered":"2024-09-18T01:45:04.288040+0000","last_unstale":"2024-09-18T01:49:41.028761+0000","last_undegraded":"2024-09-18T01:49:41.028761+0000","last_fullsized":"2024-09-18T01:49:41.028761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:41.028670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:41.028670+0000","last_clean_scrub_stamp":"2024-09-18T01:49:41.028670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:29:31.975214+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:46.362514+0000","last_change":"2024-09-18T01:48:46.362538+0000","last_active":"2024-09-18T01:48:46.362514+0000","last_peered":"2024-09-18T01:48:46.362514+0000","last_clean":"2024-09-18T01:48:46.362514+0000","last_became_active":"2024-09-18T01:45:08.288667+0000","last_became_peered":"2024-09-18T01:45:08.288667+0000","last_unstale":"2024-09-18T01:48:46.362514+0000","last_undegraded":"2024-09-18T01:48:46.362514+0000","last_fullsized":"2024-09-18T01:48:46.362514+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:46.362403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:46.362403+0000","last_clean_scrub_stamp":"2024-09-18T01:48:46.362403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:47:44.266347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'30","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:29.796863+0000","last_change":"2024-09-18T01:48:29.796918+0000","last_active":"2024-09-18T01:48:29.796863+0000","last_peered":"2024-09-18T01:48:29.796863+0000","last_clean":"2024-09-18T01:48:29.796863+0000","last_became_active":"2024-09-18T01:45:10.304004+0000","last_became_peered":"2024-09-18T01:45:10.304004+0000","last_unstale":"2024-09-18T01:48:29.796863+0000","last_undegraded":"2024-09-18T01:48:29.796863+0000","last_fullsized":"2024-09-18T01:48:29.796863+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'30","last_scrub_stamp":"2024-09-18T01:48:29.796760+0000","last_deep_scrub":"33'30","last_deep_scrub_stamp":"2024-09-18T01:48:29.796760+0000","last_clean_scrub_stamp":"2024-09-18T01:48:29.796760+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:49:27.020491+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'286","reported_seq":397,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:58.927095+0000","last_change":"2024-09-18T01:48:58.927175+0000","last_active":"2024-09-18T01:48:58.927095+0000","last_peered":"2024-09-18T01:48:58.927095+0000","last_clean":"2024-09-18T01:48:58.927095+0000","last_became_active":"2024-09-18T01:45:12.317288+0000","last_became_peered":"2024-09-18T01:45:12.317288+0000","last_unstale":"2024-09-18T01:48:58.927095+0000","last_undegraded":"2024-09-18T01:48:58.927095+0000","last_fullsized":"2024-09-18T01:48:58.927095+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'286","last_scrub_stamp":"2024-09-18T01:48:58.926983+0000","last_deep_scrub":"33'286","last_deep_scrub_stamp":"2024-09-18T01:48:58.926983+0000","last_clean_scrub_stamp":"2024-09-18T01:48:58.926983+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:03:15.512790+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:15.087093+0000","last_change":"2024-09-18T01:49:15.087120+0000","last_active":"2024-09-18T01:49:15.087093+0000","last_peered":"2024-09-18T01:49:15.087093+0000","last_clean":"2024-09-18T01:49:15.087093+0000","last_became_active":"2024-09-18T01:45:14.325843+0000","last_became_peered":"2024-09-18T01:45:14.325843+0000","last_unstale":"2024-09-18T01:49:15.087093+0000","last_undegraded":"2024-09-18T01:49:15.087093+0000","last_fullsized":"2024-09-18T01:49:15.087093+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:15.086999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:15.086999+0000","last_clean_scrub_stamp":"2024-09-18T01:49:15.086999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:25:53.638995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:50.402715+0000","last_change":"2024-09-18T01:48:50.402744+0000","last_active":"2024-09-18T01:48:50.402715+0000","last_peered":"2024-09-18T01:48:50.402715+0000","last_clean":"2024-09-18T01:48:50.402715+0000","last_became_active":"2024-09-18T01:45:06.295417+0000","last_became_peered":"2024-09-18T01:45:06.295417+0000","last_unstale":"2024-09-18T01:48:50.402715+0000","last_undegraded":"2024-09-18T01:48:50.402715+0000","last_fullsized":"2024-09-18T01:48:50.402715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:50.402623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:50.402623+0000","last_clean_scrub_stamp":"2024-09-18T01:48:50.402623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:19:27.434267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:10.036613+0000","last_change":"2024-09-18T01:49:10.036641+0000","last_active":"2024-09-18T01:49:10.036613+0000","last_peered":"2024-09-18T01:49:10.036613+0000","last_clean":"2024-09-18T01:49:10.036613+0000","last_became_active":"2024-09-18T01:45:04.282500+0000","last_became_peered":"2024-09-18T01:45:04.282500+0000","last_unstale":"2024-09-18T01:49:10.036613+0000","last_undegraded":"2024-09-18T01:49:10.036613+0000","last_fullsized":"2024-09-18T01:49:10.036613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:10.036519+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:10.036519+0000","last_clean_scrub_stamp":"2024-09-18T01:49:10.036519+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:23:38.356950+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:27.978926+0000","last_change":"2024-09-18T01:48:27.978949+0000","last_active":"2024-09-18T01:48:27.978926+0000","last_peered":"2024-09-18T01:48:27.978926+0000","last_clean":"2024-09-18T01:48:27.978926+0000","last_became_active":"2024-09-18T01:45:08.296192+0000","last_became_peered":"2024-09-18T01:45:08.296192+0000","last_unstale":"2024-09-18T01:48:27.978926+0000","last_undegraded":"2024-09-18T01:48:27.978926+0000","last_fullsized":"2024-09-18T01:48:27.978926+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:27.978844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:27.978844+0000","last_clean_scrub_stamp":"2024-09-18T01:48:27.978844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:53:57.430680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'43","reported_seq":104,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:26.798254+0000","last_change":"2024-09-18T01:48:26.798290+0000","last_active":"2024-09-18T01:48:26.798254+0000","last_peered":"2024-09-18T01:48:26.798254+0000","last_clean":"2024-09-18T01:48:26.798254+0000","last_became_active":"2024-09-18T01:45:10.305515+0000","last_became_peered":"2024-09-18T01:45:10.305515+0000","last_unstale":"2024-09-18T01:48:26.798254+0000","last_undegraded":"2024-09-18T01:48:26.798254+0000","last_fullsized":"2024-09-18T01:48:26.798254+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-09-18T01:48:26.798150+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-09-18T01:48:26.798150+0000","last_clean_scrub_stamp":"2024-09-18T01:48:26.798150+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:49:57.532711+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'285","reported_seq":412,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:41.311359+0000","last_change":"2024-09-18T01:48:41.311390+0000","last_active":"2024-09-18T01:48:41.311359+0000","last_peered":"2024-09-18T01:48:41.311359+0000","last_clean":"2024-09-18T01:48:41.311359+0000","last_became_active":"2024-09-18T01:45:12.313219+0000","last_became_peered":"2024-09-18T01:45:12.313219+0000","last_unstale":"2024-09-18T01:48:41.311359+0000","last_undegraded":"2024-09-18T01:48:41.311359+0000","last_fullsized":"2024-09-18T01:48:41.311359+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-18T01:48:41.311241+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-18T01:48:41.311241+0000","last_clean_scrub_stamp":"2024-09-18T01:48:41.311241+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:53:48.228429+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"31'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:38.059865+0000","last_change":"2024-09-18T01:48:38.059865+0000","last_active":"2024-09-18T01:48:38.059865+0000","last_peered":"2024-09-18T01:48:38.059865+0000","last_clean":"2024-09-18T01:48:38.059865+0000","last_became_active":"2024-09-18T01:45:06.297283+0000","last_became_peered":"2024-09-18T01:45:06.297283+0000","last_unstale":"2024-09-18T01:48:38.059865+0000","last_undegraded":"2024-09-18T01:48:38.059865+0000","last_fullsized":"2024-09-18T01:48:38.059865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-18T01:48:38.059683+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-18T01:48:38.059683+0000","last_clean_scrub_stamp":"2024-09-18T01:48:38.059683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:38:43.486124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:01.044789+0000","last_change":"2024-09-18T01:49:01.044789+0000","last_active":"2024-09-18T01:49:01.044789+0000","last_peered":"2024-09-18T01:49:01.044789+0000","last_clean":"2024-09-18T01:49:01.044789+0000","last_became_active":"2024-09-18T01:45:04.289629+0000","last_became_peered":"2024-09-18T01:45:04.289629+0000","last_unstale":"2024-09-18T01:49:01.044789+0000","last_undegraded":"2024-09-18T01:49:01.044789+0000","last_fullsized":"2024-09-18T01:49:01.044789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:01.044645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:01.044645+0000","last_clean_scrub_stamp":"2024-09-18T01:49:01.044645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:49:00.735559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:35.930488+0000","last_change":"2024-09-18T01:48:35.930488+0000","last_active":"2024-09-18T01:48:35.930488+0000","last_peered":"2024-09-18T01:48:35.930488+0000","last_clean":"2024-09-18T01:48:35.930488+0000","last_became_active":"2024-09-18T01:45:08.294273+0000","last_became_peered":"2024-09-18T01:45:08.294273+0000","last_unstale":"2024-09-18T01:48:35.930488+0000","last_undegraded":"2024-09-18T01:48:35.930488+0000","last_fullsized":"2024-09-18T01:48:35.930488+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:35.930363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:35.930363+0000","last_clean_scrub_stamp":"2024-09-18T01:48:35.930363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:23:07.518807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'58","reported_seq":125,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:33.850466+0000","last_change":"2024-09-18T01:48:33.850466+0000","last_active":"2024-09-18T01:48:33.850466+0000","last_peered":"2024-09-18T01:48:33.850466+0000","last_clean":"2024-09-18T01:48:33.850466+0000","last_became_active":"2024-09-18T01:45:10.298021+0000","last_became_peered":"2024-09-18T01:45:10.298021+0000","last_unstale":"2024-09-18T01:48:33.850466+0000","last_undegraded":"2024-09-18T01:48:33.850466+0000","last_fullsized":"2024-09-18T01:48:33.850466+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'58","last_scrub_stamp":"2024-09-18T01:48:33.850320+0000","last_deep_scrub":"33'58","last_deep_scrub_stamp":"2024-09-18T01:48:33.850320+0000","last_clean_scrub_stamp":"2024-09-18T01:48:33.850320+0000","objects_scrubbed":10,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:47:26.923881+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:45.319977+0000","last_change":"2024-09-18T01:48:45.319977+0000","last_active":"2024-09-18T01:48:45.319977+0000","last_peered":"2024-09-18T01:48:45.319977+0000","last_clean":"2024-09-18T01:48:45.319977+0000","last_became_active":"2024-09-18T01:45:12.313875+0000","last_became_peered":"2024-09-18T01:45:12.313875+0000","last_unstale":"2024-09-18T01:48:45.319977+0000","last_undegraded":"2024-09-18T01:48:45.319977+0000","last_fullsized":"2024-09-18T01:48:45.319977+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:45.319802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:45.319802+0000","last_clean_scrub_stamp":"2024-09-18T01:48:45.319802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:30:17.984788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'7","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:13.056537+0000","last_change":"2024-09-18T01:49:13.056537+0000","last_active":"2024-09-18T01:49:13.056537+0000","last_peered":"2024-09-18T01:49:13.056537+0000","last_clean":"2024-09-18T01:49:13.056537+0000","last_became_active":"2024-09-18T01:45:14.322448+0000","last_became_peered":"2024-09-18T01:45:14.322448+0000","last_unstale":"2024-09-18T01:49:13.056537+0000","last_undegraded":"2024-09-18T01:49:13.056537+0000","last_fullsized":"2024-09-18T01:49:13.056537+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-09-18T01:49:13.056380+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-09-18T01:49:13.056380+0000","last_clean_scrub_stamp":"2024-09-18T01:49:13.056380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:58:35.305693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":17,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'8","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:05.100881+0000","last_change":"2024-09-18T01:49:05.100881+0000","last_active":"2024-09-18T01:49:05.100881+0000","last_peered":"2024-09-18T01:49:05.100881+0000","last_clean":"2024-09-18T01:49:05.100881+0000","last_became_active":"2024-09-18T01:45:06.292143+0000","last_became_peered":"2024-09-18T01:45:06.292143+0000","last_unstale":"2024-09-18T01:49:05.100881+0000","last_undegraded":"2024-09-18T01:49:05.100881+0000","last_fullsized":"2024-09-18T01:49:05.100881+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-18T01:49:05.100764+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-18T01:49:05.100764+0000","last_clean_scrub_stamp":"2024-09-18T01:49:05.100764+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:57:47.793679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:55.061241+0000","last_change":"2024-09-18T01:48:55.061241+0000","last_active":"2024-09-18T01:48:55.061241+0000","last_peered":"2024-09-18T01:48:55.061241+0000","last_clean":"2024-09-18T01:48:55.061241+0000","last_became_active":"2024-09-18T01:45:04.292734+0000","last_became_peered":"2024-09-18T01:45:04.292734+0000","last_unstale":"2024-09-18T01:48:55.061241+0000","last_undegraded":"2024-09-18T01:48:55.061241+0000","last_fullsized":"2024-09-18T01:48:55.061241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:55.061101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:55.061101+0000","last_clean_scrub_stamp":"2024-09-18T01:48:55.061101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:28:33.987118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:38.340714+0000","last_change":"2024-09-18T01:48:38.340714+0000","last_active":"2024-09-18T01:48:38.340714+0000","last_peered":"2024-09-18T01:48:38.340714+0000","last_clean":"2024-09-18T01:48:38.340714+0000","last_became_active":"2024-09-18T01:45:08.294026+0000","last_became_peered":"2024-09-18T01:45:08.294026+0000","last_unstale":"2024-09-18T01:48:38.340714+0000","last_undegraded":"2024-09-18T01:48:38.340714+0000","last_fullsized":"2024-09-18T01:48:38.340714+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:38.340604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:38.340604+0000","last_clean_scrub_stamp":"2024-09-18T01:48:38.340604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:23:55.262120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'44","reported_seq":106,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:55.980889+0000","last_change":"2024-09-18T01:48:55.980889+0000","last_active":"2024-09-18T01:48:55.980889+0000","last_peered":"2024-09-18T01:48:55.980889+0000","last_clean":"2024-09-18T01:48:55.980889+0000","last_became_active":"2024-09-18T01:45:10.307420+0000","last_became_peered":"2024-09-18T01:45:10.307420+0000","last_unstale":"2024-09-18T01:48:55.980889+0000","last_undegraded":"2024-09-18T01:48:55.980889+0000","last_fullsized":"2024-09-18T01:48:55.980889+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'44","last_scrub_stamp":"2024-09-18T01:48:55.980766+0000","last_deep_scrub":"33'44","last_deep_scrub_stamp":"2024-09-18T01:48:55.980766+0000","last_clean_scrub_stamp":"2024-09-18T01:48:55.980766+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:39:00.785127+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:27.225386+0000","last_change":"2024-09-18T01:48:27.225386+0000","last_active":"2024-09-18T01:48:27.225386+0000","last_peered":"2024-09-18T01:48:27.225386+0000","last_clean":"2024-09-18T01:48:27.225386+0000","last_became_active":"2024-09-18T01:45:12.305838+0000","last_became_peered":"2024-09-18T01:45:12.305838+0000","last_unstale":"2024-09-18T01:48:27.225386+0000","last_undegraded":"2024-09-18T01:48:27.225386+0000","last_fullsized":"2024-09-18T01:48:27.225386+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:27.225273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:27.225273+0000","last_clean_scrub_stamp":"2024-09-18T01:48:27.225273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:40:36.497250+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'4","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:50.995327+0000","last_change":"2024-09-18T01:48:50.995327+0000","last_active":"2024-09-18T01:48:50.995327+0000","last_peered":"2024-09-18T01:48:50.995327+0000","last_clean":"2024-09-18T01:48:50.995327+0000","last_became_active":"2024-09-18T01:45:14.322272+0000","last_became_peered":"2024-09-18T01:45:14.322272+0000","last_unstale":"2024-09-18T01:48:50.995327+0000","last_undegraded":"2024-09-18T01:48:50.995327+0000","last_fullsized":"2024-09-18T01:48:50.995327+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:48:50.995161+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:48:50.995161+0000","last_clean_scrub_stamp":"2024-09-18T01:48:50.995161+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:39:37.704225+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"33'8","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:54.036697+0000","last_change":"2024-09-18T01:48:54.036697+0000","last_active":"2024-09-18T01:48:54.036697+0000","last_peered":"2024-09-18T01:48:54.036697+0000","last_clean":"2024-09-18T01:48:54.036697+0000","last_became_active":"2024-09-18T01:45:06.284677+0000","last_became_peered":"2024-09-18T01:45:06.284677+0000","last_unstale":"2024-09-18T01:48:54.036697+0000","last_undegraded":"2024-09-18T01:48:54.036697+0000","last_fullsized":"2024-09-18T01:48:54.036697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-18T01:48:54.036561+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-18T01:48:54.036561+0000","last_clean_scrub_stamp":"2024-09-18T01:48:54.036561+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:24:10.958078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:23.928837+0000","last_change":"2024-09-18T01:49:23.928837+0000","last_active":"2024-09-18T01:49:23.928837+0000","last_peered":"2024-09-18T01:49:23.928837+0000","last_clean":"2024-09-18T01:49:23.928837+0000","last_became_active":"2024-09-18T01:45:04.284151+0000","last_became_peered":"2024-09-18T01:45:04.284151+0000","last_unstale":"2024-09-18T01:49:23.928837+0000","last_undegraded":"2024-09-18T01:49:23.928837+0000","last_fullsized":"2024-09-18T01:49:23.928837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:23.928722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:23.928722+0000","last_clean_scrub_stamp":"2024-09-18T01:49:23.928722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:34:26.481735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:44.316921+0000","last_change":"2024-09-18T01:48:44.316921+0000","last_active":"2024-09-18T01:48:44.316921+0000","last_peered":"2024-09-18T01:48:44.316921+0000","last_clean":"2024-09-18T01:48:44.316921+0000","last_became_active":"2024-09-18T01:45:08.289521+0000","last_became_peered":"2024-09-18T01:45:08.289521+0000","last_unstale":"2024-09-18T01:48:44.316921+0000","last_undegraded":"2024-09-18T01:48:44.316921+0000","last_fullsized":"2024-09-18T01:48:44.316921+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:44.316811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:44.316811+0000","last_clean_scrub_stamp":"2024-09-18T01:48:44.316811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:06:52.240759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'60","reported_seq":131,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:31.041221+0000","last_change":"2024-09-18T01:48:31.041221+0000","last_active":"2024-09-18T01:48:31.041221+0000","last_peered":"2024-09-18T01:48:31.041221+0000","last_clean":"2024-09-18T01:48:31.041221+0000","last_became_active":"2024-09-18T01:45:10.306481+0000","last_became_peered":"2024-09-18T01:45:10.306481+0000","last_unstale":"2024-09-18T01:48:31.041221+0000","last_undegraded":"2024-09-18T01:48:31.041221+0000","last_fullsized":"2024-09-18T01:48:31.041221+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'60","last_scrub_stamp":"2024-09-18T01:48:31.041096+0000","last_deep_scrub":"33'60","last_deep_scrub_stamp":"2024-09-18T01:48:31.041096+0000","last_clean_scrub_stamp":"2024-09-18T01:48:31.041096+0000","objects_scrubbed":9,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:19:08.072740+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'285","reported_seq":360,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:33.295906+0000","last_change":"2024-09-18T01:48:33.295906+0000","last_active":"2024-09-18T01:48:33.295906+0000","last_peered":"2024-09-18T01:48:33.295906+0000","last_clean":"2024-09-18T01:48:33.295906+0000","last_became_active":"2024-09-18T01:45:12.313065+0000","last_became_peered":"2024-09-18T01:45:12.313065+0000","last_unstale":"2024-09-18T01:48:33.295906+0000","last_undegraded":"2024-09-18T01:48:33.295906+0000","last_fullsized":"2024-09-18T01:48:33.295906+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-18T01:48:33.295792+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-18T01:48:33.295792+0000","last_clean_scrub_stamp":"2024-09-18T01:48:33.295792+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:47:31.508822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"33'2","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:25.311129+0000","last_change":"2024-09-18T01:49:25.311129+0000","last_active":"2024-09-18T01:49:25.311129+0000","last_peered":"2024-09-18T01:49:25.311129+0000","last_clean":"2024-09-18T01:49:25.311129+0000","last_became_active":"2024-09-18T01:45:14.319805+0000","last_became_peered":"2024-09-18T01:45:14.319805+0000","last_unstale":"2024-09-18T01:49:25.311129+0000","last_undegraded":"2024-09-18T01:49:25.311129+0000","last_fullsized":"2024-09-18T01:49:25.311129+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:25.311030+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:25.311030+0000","last_clean_scrub_stamp":"2024-09-18T01:49:25.311030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:40:41.717263+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"33'10","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:47.050714+0000","last_change":"2024-09-18T01:48:47.050714+0000","last_active":"2024-09-18T01:48:47.050714+0000","last_peered":"2024-09-18T01:48:47.050714+0000","last_clean":"2024-09-18T01:48:47.050714+0000","last_became_active":"2024-09-18T01:45:06.281444+0000","last_became_peered":"2024-09-18T01:45:06.281444+0000","last_unstale":"2024-09-18T01:48:47.050714+0000","last_undegraded":"2024-09-18T01:48:47.050714+0000","last_fullsized":"2024-09-18T01:48:47.050714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-18T01:48:47.050596+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-18T01:48:47.050596+0000","last_clean_scrub_stamp":"2024-09-18T01:48:47.050596+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:04:32.118971+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:22.931837+0000","last_change":"2024-09-18T01:49:22.931837+0000","last_active":"2024-09-18T01:49:22.931837+0000","last_peered":"2024-09-18T01:49:22.931837+0000","last_clean":"2024-09-18T01:49:22.931837+0000","last_became_active":"2024-09-18T01:45:04.289216+0000","last_became_peered":"2024-09-18T01:45:04.289216+0000","last_unstale":"2024-09-18T01:49:22.931837+0000","last_undegraded":"2024-09-18T01:49:22.931837+0000","last_fullsized":"2024-09-18T01:49:22.931837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:22.931666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:22.931666+0000","last_clean_scrub_stamp":"2024-09-18T01:49:22.931666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:47:28.991122+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:42.306236+0000","last_change":"2024-09-18T01:48:42.306236+0000","last_active":"2024-09-18T01:48:42.306236+0000","last_peered":"2024-09-18T01:48:42.306236+0000","last_clean":"2024-09-18T01:48:42.306236+0000","last_became_active":"2024-09-18T01:45:08.289725+0000","last_became_peered":"2024-09-18T01:45:08.289725+0000","last_unstale":"2024-09-18T01:48:42.306236+0000","last_undegraded":"2024-09-18T01:48:42.306236+0000","last_fullsized":"2024-09-18T01:48:42.306236+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:42.306116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:42.306116+0000","last_clean_scrub_stamp":"2024-09-18T01:48:42.306116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:12:34.242137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"33'84","reported_seq":170,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:48.994684+0000","last_change":"2024-09-18T01:48:48.994684+0000","last_active":"2024-09-18T01:48:48.994684+0000","last_peered":"2024-09-18T01:48:48.994684+0000","last_clean":"2024-09-18T01:48:48.994684+0000","last_became_active":"2024-09-18T01:45:10.309360+0000","last_became_peered":"2024-09-18T01:45:10.309360+0000","last_unstale":"2024-09-18T01:48:48.994684+0000","last_undegraded":"2024-09-18T01:48:48.994684+0000","last_fullsized":"2024-09-18T01:48:48.994684+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'84","last_scrub_stamp":"2024-09-18T01:48:48.994559+0000","last_deep_scrub":"33'84","last_deep_scrub_stamp":"2024-09-18T01:48:48.994559+0000","last_clean_scrub_stamp":"2024-09-18T01:48:48.994559+0000","objects_scrubbed":7,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:06:39.021603+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5903,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":90,"num_read_kb":105,"num_write":42,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:29.256596+0000","last_change":"2024-09-18T01:48:29.256596+0000","last_active":"2024-09-18T01:48:29.256596+0000","last_peered":"2024-09-18T01:48:29.256596+0000","last_clean":"2024-09-18T01:48:29.256596+0000","last_became_active":"2024-09-18T01:45:12.312665+0000","last_became_peered":"2024-09-18T01:45:12.312665+0000","last_unstale":"2024-09-18T01:48:29.256596+0000","last_undegraded":"2024-09-18T01:48:29.256596+0000","last_fullsized":"2024-09-18T01:48:29.256596+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:29.256466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:29.256466+0000","last_clean_scrub_stamp":"2024-09-18T01:48:29.256466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:07:14.275320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'21","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:26.309796+0000","last_change":"2024-09-18T01:49:26.309796+0000","last_active":"2024-09-18T01:49:26.309796+0000","last_peered":"2024-09-18T01:49:26.309796+0000","last_clean":"2024-09-18T01:49:26.309796+0000","last_became_active":"2024-09-18T01:45:14.319638+0000","last_became_peered":"2024-09-18T01:45:14.319638+0000","last_unstale":"2024-09-18T01:49:26.309796+0000","last_undegraded":"2024-09-18T01:49:26.309796+0000","last_fullsized":"2024-09-18T01:49:26.309796+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'21","last_scrub_stamp":"2024-09-18T01:49:26.309628+0000","last_deep_scrub":"33'21","last_deep_scrub_stamp":"2024-09-18T01:49:26.309628+0000","last_clean_scrub_stamp":"2024-09-18T01:49:26.309628+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:51:44.953615+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:55.048167+0000","last_change":"2024-09-18T01:48:55.048167+0000","last_active":"2024-09-18T01:48:55.048167+0000","last_peered":"2024-09-18T01:48:55.048167+0000","last_clean":"2024-09-18T01:48:55.048167+0000","last_became_active":"2024-09-18T01:45:06.290087+0000","last_became_peered":"2024-09-18T01:45:06.290087+0000","last_unstale":"2024-09-18T01:48:55.048167+0000","last_undegraded":"2024-09-18T01:48:55.048167+0000","last_fullsized":"2024-09-18T01:48:55.048167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:48:55.048003+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:48:55.048003+0000","last_clean_scrub_stamp":"2024-09-18T01:48:55.048003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:28:28.602326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:18.345193+0000","last_change":"2024-09-18T01:49:18.345193+0000","last_active":"2024-09-18T01:49:18.345193+0000","last_peered":"2024-09-18T01:49:18.345193+0000","last_clean":"2024-09-18T01:49:18.345193+0000","last_became_active":"2024-09-18T01:45:04.278979+0000","last_became_peered":"2024-09-18T01:45:04.278979+0000","last_unstale":"2024-09-18T01:49:18.345193+0000","last_undegraded":"2024-09-18T01:49:18.345193+0000","last_fullsized":"2024-09-18T01:49:18.345193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:18.345077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:18.345077+0000","last_clean_scrub_stamp":"2024-09-18T01:49:18.345077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:47:49.187464+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:36.904948+0000","last_change":"2024-09-18T01:48:36.904948+0000","last_active":"2024-09-18T01:48:36.904948+0000","last_peered":"2024-09-18T01:48:36.904948+0000","last_clean":"2024-09-18T01:48:36.904948+0000","last_became_active":"2024-09-18T01:45:08.292156+0000","last_became_peered":"2024-09-18T01:45:08.292156+0000","last_unstale":"2024-09-18T01:48:36.904948+0000","last_undegraded":"2024-09-18T01:48:36.904948+0000","last_fullsized":"2024-09-18T01:48:36.904948+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:36.904811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:36.904811+0000","last_clean_scrub_stamp":"2024-09-18T01:48:36.904811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:16:10.795874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'46","reported_seq":109,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:31.876752+0000","last_change":"2024-09-18T01:48:31.876752+0000","last_active":"2024-09-18T01:48:31.876752+0000","last_peered":"2024-09-18T01:48:31.876752+0000","last_clean":"2024-09-18T01:48:31.876752+0000","last_became_active":"2024-09-18T01:45:10.300488+0000","last_became_peered":"2024-09-18T01:45:10.300488+0000","last_unstale":"2024-09-18T01:48:31.876752+0000","last_undegraded":"2024-09-18T01:48:31.876752+0000","last_fullsized":"2024-09-18T01:48:31.876752+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'46","last_scrub_stamp":"2024-09-18T01:48:31.876630+0000","last_deep_scrub":"33'46","last_deep_scrub_stamp":"2024-09-18T01:48:31.876630+0000","last_clean_scrub_stamp":"2024-09-18T01:48:31.876630+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:14:05.046500+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:45.045948+0000","last_change":"2024-09-18T01:48:45.045948+0000","last_active":"2024-09-18T01:48:45.045948+0000","last_peered":"2024-09-18T01:48:45.045948+0000","last_clean":"2024-09-18T01:48:45.045948+0000","last_became_active":"2024-09-18T01:45:12.315695+0000","last_became_peered":"2024-09-18T01:45:12.315695+0000","last_unstale":"2024-09-18T01:48:45.045948+0000","last_undegraded":"2024-09-18T01:48:45.045948+0000","last_fullsized":"2024-09-18T01:48:45.045948+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:45.045766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:45.045766+0000","last_clean_scrub_stamp":"2024-09-18T01:48:45.045766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:18:11.087673+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"33'3","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:23.652303+0000","last_change":"2024-09-18T01:45:14.326486+0000","last_active":"2024-09-18T01:48:23.652303+0000","last_peered":"2024-09-18T01:48:23.652303+0000","last_clean":"2024-09-18T01:48:23.652303+0000","last_became_active":"2024-09-18T01:45:14.326209+0000","last_became_peered":"2024-09-18T01:45:14.326209+0000","last_unstale":"2024-09-18T01:48:23.652303+0000","last_undegraded":"2024-09-18T01:48:23.652303+0000","last_fullsized":"2024-09-18T01:48:23.652303+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:44.062795+0000","last_change":"2024-09-18T01:48:44.062795+0000","last_active":"2024-09-18T01:48:44.062795+0000","last_peered":"2024-09-18T01:48:44.062795+0000","last_clean":"2024-09-18T01:48:44.062795+0000","last_became_active":"2024-09-18T01:45:06.285771+0000","last_became_peered":"2024-09-18T01:45:06.285771+0000","last_unstale":"2024-09-18T01:48:44.062795+0000","last_undegraded":"2024-09-18T01:48:44.062795+0000","last_fullsized":"2024-09-18T01:48:44.062795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:48:44.062649+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:48:44.062649+0000","last_clean_scrub_stamp":"2024-09-18T01:48:44.062649+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:57:52.976791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:21.979209+0000","last_change":"2024-09-18T01:49:21.979209+0000","last_active":"2024-09-18T01:49:21.979209+0000","last_peered":"2024-09-18T01:49:21.979209+0000","last_clean":"2024-09-18T01:49:21.979209+0000","last_became_active":"2024-09-18T01:45:04.287263+0000","last_became_peered":"2024-09-18T01:45:04.287263+0000","last_unstale":"2024-09-18T01:49:21.979209+0000","last_undegraded":"2024-09-18T01:49:21.979209+0000","last_fullsized":"2024-09-18T01:49:21.979209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:49:21.979054+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:49:21.979054+0000","last_clean_scrub_stamp":"2024-09-18T01:49:21.979054+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:23:37.589553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:43.281610+0000","last_change":"2024-09-18T01:48:43.281610+0000","last_active":"2024-09-18T01:48:43.281610+0000","last_peered":"2024-09-18T01:48:43.281610+0000","last_clean":"2024-09-18T01:48:43.281610+0000","last_became_active":"2024-09-18T01:45:08.289604+0000","last_became_peered":"2024-09-18T01:45:08.289604+0000","last_unstale":"2024-09-18T01:48:43.281610+0000","last_undegraded":"2024-09-18T01:48:43.281610+0000","last_fullsized":"2024-09-18T01:48:43.281610+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:43.281481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:43.281481+0000","last_clean_scrub_stamp":"2024-09-18T01:48:43.281481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:37:19.077361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'46","reported_seq":105,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:32.804773+0000","last_change":"2024-09-18T01:48:32.804773+0000","last_active":"2024-09-18T01:48:32.804773+0000","last_peered":"2024-09-18T01:48:32.804773+0000","last_clean":"2024-09-18T01:48:32.804773+0000","last_became_active":"2024-09-18T01:45:10.297511+0000","last_became_peered":"2024-09-18T01:45:10.297511+0000","last_unstale":"2024-09-18T01:48:32.804773+0000","last_undegraded":"2024-09-18T01:48:32.804773+0000","last_fullsized":"2024-09-18T01:48:32.804773+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'46","last_scrub_stamp":"2024-09-18T01:48:32.804654+0000","last_deep_scrub":"33'46","last_deep_scrub_stamp":"2024-09-18T01:48:32.804654+0000","last_clean_scrub_stamp":"2024-09-18T01:48:32.804654+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:33:34.219867+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'285","reported_seq":415,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:39.926622+0000","last_change":"2024-09-18T01:48:39.926622+0000","last_active":"2024-09-18T01:48:39.926622+0000","last_peered":"2024-09-18T01:48:39.926622+0000","last_clean":"2024-09-18T01:48:39.926622+0000","last_became_active":"2024-09-18T01:45:12.314918+0000","last_became_peered":"2024-09-18T01:45:12.314918+0000","last_unstale":"2024-09-18T01:48:39.926622+0000","last_undegraded":"2024-09-18T01:48:39.926622+0000","last_fullsized":"2024-09-18T01:48:39.926622+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-18T01:48:39.926503+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-18T01:48:39.926503+0000","last_clean_scrub_stamp":"2024-09-18T01:48:39.926503+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:49:29.916648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'13","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:23.297272+0000","last_change":"2024-09-18T01:49:23.297272+0000","last_active":"2024-09-18T01:49:23.297272+0000","last_peered":"2024-09-18T01:49:23.297272+0000","last_clean":"2024-09-18T01:49:23.297272+0000","last_became_active":"2024-09-18T01:45:14.319364+0000","last_became_peered":"2024-09-18T01:45:14.319364+0000","last_unstale":"2024-09-18T01:49:23.297272+0000","last_undegraded":"2024-09-18T01:49:23.297272+0000","last_fullsized":"2024-09-18T01:49:23.297272+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'13","last_scrub_stamp":"2024-09-18T01:49:23.297109+0000","last_deep_scrub":"33'13","last_deep_scrub_stamp":"2024-09-18T01:49:23.297109+0000","last_clean_scrub_stamp":"2024-09-18T01:49:23.297109+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:09:52.972445+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:10.031044+0000","last_change":"2024-09-18T01:49:10.031044+0000","last_active":"2024-09-18T01:49:10.031044+0000","last_peered":"2024-09-18T01:49:10.031044+0000","last_clean":"2024-09-18T01:49:10.031044+0000","last_became_active":"2024-09-18T01:45:06.291023+0000","last_became_peered":"2024-09-18T01:45:06.291023+0000","last_unstale":"2024-09-18T01:49:10.031044+0000","last_undegraded":"2024-09-18T01:49:10.031044+0000","last_fullsized":"2024-09-18T01:49:10.031044+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:49:10.030902+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:49:10.030902+0000","last_clean_scrub_stamp":"2024-09-18T01:49:10.030902+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:45:15.238343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:13.876222+0000","last_change":"2024-09-18T01:49:13.876222+0000","last_active":"2024-09-18T01:49:13.876222+0000","last_peered":"2024-09-18T01:49:13.876222+0000","last_clean":"2024-09-18T01:49:13.876222+0000","last_became_active":"2024-09-18T01:45:04.288386+0000","last_became_peered":"2024-09-18T01:45:04.288386+0000","last_unstale":"2024-09-18T01:49:13.876222+0000","last_undegraded":"2024-09-18T01:49:13.876222+0000","last_fullsized":"2024-09-18T01:49:13.876222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:13.876090+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:13.876090+0000","last_clean_scrub_stamp":"2024-09-18T01:49:13.876090+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:15:56.056182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'5","reported_seq":429,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:37.935983+0000","last_change":"2024-09-18T01:48:37.935983+0000","last_active":"2024-09-18T01:48:37.935983+0000","last_peered":"2024-09-18T01:48:37.935983+0000","last_clean":"2024-09-18T01:48:37.935983+0000","last_became_active":"2024-09-18T01:45:08.289478+0000","last_became_peered":"2024-09-18T01:45:08.289478+0000","last_unstale":"2024-09-18T01:48:37.935983+0000","last_undegraded":"2024-09-18T01:48:37.935983+0000","last_fullsized":"2024-09-18T01:48:37.935983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-18T01:48:37.935837+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-18T01:48:37.935837+0000","last_clean_scrub_stamp":"2024-09-18T01:48:37.935837+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:10:09.966686+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'16","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:35.107168+0000","last_change":"2024-09-18T01:48:35.107168+0000","last_active":"2024-09-18T01:48:35.107168+0000","last_peered":"2024-09-18T01:48:35.107168+0000","last_clean":"2024-09-18T01:48:35.107168+0000","last_became_active":"2024-09-18T01:45:10.307374+0000","last_became_peered":"2024-09-18T01:45:10.307374+0000","last_unstale":"2024-09-18T01:48:35.107168+0000","last_undegraded":"2024-09-18T01:48:35.107168+0000","last_fullsized":"2024-09-18T01:48:35.107168+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2024-09-18T01:48:35.106992+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2024-09-18T01:48:35.106992+0000","last_clean_scrub_stamp":"2024-09-18T01:48:35.106992+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:54:20.385136+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'285","reported_seq":477,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:25.009780+0000","last_change":"2024-09-18T01:48:25.009780+0000","last_active":"2024-09-18T01:48:25.009780+0000","last_peered":"2024-09-18T01:48:25.009780+0000","last_clean":"2024-09-18T01:48:25.009780+0000","last_became_active":"2024-09-18T01:45:12.311929+0000","last_became_peered":"2024-09-18T01:45:12.311929+0000","last_unstale":"2024-09-18T01:48:25.009780+0000","last_undegraded":"2024-09-18T01:48:25.009780+0000","last_fullsized":"2024-09-18T01:48:25.009780+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-18T01:48:25.009658+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-18T01:48:25.009658+0000","last_clean_scrub_stamp":"2024-09-18T01:48:25.009658+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:37:56.338472+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"33'6","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:12.045730+0000","last_change":"2024-09-18T01:49:12.045730+0000","last_active":"2024-09-18T01:49:12.045730+0000","last_peered":"2024-09-18T01:49:12.045730+0000","last_clean":"2024-09-18T01:49:12.045730+0000","last_became_active":"2024-09-18T01:45:14.318418+0000","last_became_peered":"2024-09-18T01:45:14.318418+0000","last_unstale":"2024-09-18T01:49:12.045730+0000","last_undegraded":"2024-09-18T01:49:12.045730+0000","last_fullsized":"2024-09-18T01:49:12.045730+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-18T01:49:12.045604+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-18T01:49:12.045604+0000","last_clean_scrub_stamp":"2024-09-18T01:49:12.045604+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:14:23.982223+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"31'4","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:41.845938+0000","last_change":"2024-09-18T01:48:41.845938+0000","last_active":"2024-09-18T01:48:41.845938+0000","last_peered":"2024-09-18T01:48:41.845938+0000","last_clean":"2024-09-18T01:48:41.845938+0000","last_became_active":"2024-09-18T01:45:06.296824+0000","last_became_peered":"2024-09-18T01:45:06.296824+0000","last_unstale":"2024-09-18T01:48:41.845938+0000","last_undegraded":"2024-09-18T01:48:41.845938+0000","last_fullsized":"2024-09-18T01:48:41.845938+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-18T01:48:41.845784+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-18T01:48:41.845784+0000","last_clean_scrub_stamp":"2024-09-18T01:48:41.845784+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:28:20.771801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:16.871275+0000","last_change":"2024-09-18T01:49:16.871275+0000","last_active":"2024-09-18T01:49:16.871275+0000","last_peered":"2024-09-18T01:49:16.871275+0000","last_clean":"2024-09-18T01:49:16.871275+0000","last_became_active":"2024-09-18T01:45:04.287961+0000","last_became_peered":"2024-09-18T01:45:04.287961+0000","last_unstale":"2024-09-18T01:49:16.871275+0000","last_undegraded":"2024-09-18T01:49:16.871275+0000","last_fullsized":"2024-09-18T01:49:16.871275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:49:16.871156+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:49:16.871156+0000","last_clean_scrub_stamp":"2024-09-18T01:49:16.871156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:52:07.012599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:30.056238+0000","last_change":"2024-09-18T01:48:30.056238+0000","last_active":"2024-09-18T01:48:30.056238+0000","last_peered":"2024-09-18T01:48:30.056238+0000","last_clean":"2024-09-18T01:48:30.056238+0000","last_became_active":"2024-09-18T01:45:08.294053+0000","last_became_peered":"2024-09-18T01:45:08.294053+0000","last_unstale":"2024-09-18T01:48:30.056238+0000","last_undegraded":"2024-09-18T01:48:30.056238+0000","last_fullsized":"2024-09-18T01:48:30.056238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:30.056116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:30.056116+0000","last_clean_scrub_stamp":"2024-09-18T01:48:30.056116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:08:42.773951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'49","reported_seq":109,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:32.916950+0000","last_change":"2024-09-18T01:48:32.916950+0000","last_active":"2024-09-18T01:48:32.916950+0000","last_peered":"2024-09-18T01:48:32.916950+0000","last_clean":"2024-09-18T01:48:32.916950+0000","last_became_active":"2024-09-18T01:45:10.300337+0000","last_became_peered":"2024-09-18T01:45:10.300337+0000","last_unstale":"2024-09-18T01:48:32.916950+0000","last_undegraded":"2024-09-18T01:48:32.916950+0000","last_fullsized":"2024-09-18T01:48:32.916950+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'49","last_scrub_stamp":"2024-09-18T01:48:32.916825+0000","last_deep_scrub":"33'49","last_deep_scrub_stamp":"2024-09-18T01:48:32.916825+0000","last_clean_scrub_stamp":"2024-09-18T01:48:32.916825+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:18:05.044892+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:25.794798+0000","last_change":"2024-09-18T01:48:25.794798+0000","last_active":"2024-09-18T01:48:25.794798+0000","last_peered":"2024-09-18T01:48:25.794798+0000","last_clean":"2024-09-18T01:48:25.794798+0000","last_became_active":"2024-09-18T01:45:12.307210+0000","last_became_peered":"2024-09-18T01:45:12.307210+0000","last_unstale":"2024-09-18T01:48:25.794798+0000","last_undegraded":"2024-09-18T01:48:25.794798+0000","last_fullsized":"2024-09-18T01:48:25.794798+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:25.794656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:25.794656+0000","last_clean_scrub_stamp":"2024-09-18T01:48:25.794656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:43:11.167455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'6","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:38.907977+0000","last_change":"2024-09-18T01:48:38.907977+0000","last_active":"2024-09-18T01:48:38.907977+0000","last_peered":"2024-09-18T01:48:38.907977+0000","last_clean":"2024-09-18T01:48:38.907977+0000","last_became_active":"2024-09-18T01:45:14.314786+0000","last_became_peered":"2024-09-18T01:45:14.314786+0000","last_unstale":"2024-09-18T01:48:38.907977+0000","last_undegraded":"2024-09-18T01:48:38.907977+0000","last_fullsized":"2024-09-18T01:48:38.907977+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-18T01:48:38.907803+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-18T01:48:38.907803+0000","last_clean_scrub_stamp":"2024-09-18T01:48:38.907803+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:42:22.155558+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"33'2","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:57.936018+0000","last_change":"2024-09-18T01:48:57.936018+0000","last_active":"2024-09-18T01:48:57.936018+0000","last_peered":"2024-09-18T01:48:57.936018+0000","last_clean":"2024-09-18T01:48:57.936018+0000","last_became_active":"2024-09-18T01:45:06.286138+0000","last_became_peered":"2024-09-18T01:45:06.286138+0000","last_unstale":"2024-09-18T01:48:57.936018+0000","last_undegraded":"2024-09-18T01:48:57.936018+0000","last_fullsized":"2024-09-18T01:48:57.936018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:48:57.935901+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:48:57.935901+0000","last_clean_scrub_stamp":"2024-09-18T01:48:57.935901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:05:06.158791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"33'119","reported_seq":217,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:09.052864+0000","last_change":"2024-09-18T01:49:09.052903+0000","last_active":"2024-09-18T01:49:09.052864+0000","last_peered":"2024-09-18T01:49:09.052864+0000","last_clean":"2024-09-18T01:49:09.052864+0000","last_became_active":"2024-09-18T01:44:49.572263+0000","last_became_peered":"2024-09-18T01:44:49.572263+0000","last_unstale":"2024-09-18T01:49:09.052864+0000","last_undegraded":"2024-09-18T01:49:09.052864+0000","last_fullsized":"2024-09-18T01:49:09.052864+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'119","last_scrub_stamp":"2024-09-18T01:49:09.052773+0000","last_deep_scrub":"33'119","last_deep_scrub_stamp":"2024-09-18T01:49:09.052773+0000","last_clean_scrub_stamp":"2024-09-18T01:49:09.052773+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:55:10.210330+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"33'2","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:32.978027+0000","last_change":"2024-09-18T01:49:32.978053+0000","last_active":"2024-09-18T01:49:32.978027+0000","last_peered":"2024-09-18T01:49:32.978027+0000","last_clean":"2024-09-18T01:49:32.978027+0000","last_became_active":"2024-09-18T01:44:53.233974+0000","last_became_peered":"2024-09-18T01:44:53.233974+0000","last_unstale":"2024-09-18T01:49:32.978027+0000","last_undegraded":"2024-09-18T01:49:32.978027+0000","last_fullsized":"2024-09-18T01:49:32.978027+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:32.977943+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:32.977943+0000","last_clean_scrub_stamp":"2024-09-18T01:49:32.977943+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:19:52.736971+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00045237700000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:18.910758+0000","last_change":"2024-09-18T01:49:18.910786+0000","last_active":"2024-09-18T01:49:18.910758+0000","last_peered":"2024-09-18T01:49:18.910758+0000","last_clean":"2024-09-18T01:49:18.910758+0000","last_became_active":"2024-09-18T01:45:04.287763+0000","last_became_peered":"2024-09-18T01:45:04.287763+0000","last_unstale":"2024-09-18T01:49:18.910758+0000","last_undegraded":"2024-09-18T01:49:18.910758+0000","last_fullsized":"2024-09-18T01:49:18.910758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:18.910665+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:18.910665+0000","last_clean_scrub_stamp":"2024-09-18T01:49:18.910665+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:25:07.123332+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:39.901227+0000","last_change":"2024-09-18T01:48:39.901227+0000","last_active":"2024-09-18T01:48:39.901227+0000","last_peered":"2024-09-18T01:48:39.901227+0000","last_clean":"2024-09-18T01:48:39.901227+0000","last_became_active":"2024-09-18T01:45:08.288131+0000","last_became_peered":"2024-09-18T01:45:08.288131+0000","last_unstale":"2024-09-18T01:48:39.901227+0000","last_undegraded":"2024-09-18T01:48:39.901227+0000","last_fullsized":"2024-09-18T01:48:39.901227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:39.901111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:39.901111+0000","last_clean_scrub_stamp":"2024-09-18T01:48:39.901111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:24:25.271343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'95","reported_seq":192,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:27.011354+0000","last_change":"2024-09-18T01:48:27.011354+0000","last_active":"2024-09-18T01:48:27.011354+0000","last_peered":"2024-09-18T01:48:27.011354+0000","last_clean":"2024-09-18T01:48:27.011354+0000","last_became_active":"2024-09-18T01:45:10.305004+0000","last_became_peered":"2024-09-18T01:45:10.305004+0000","last_unstale":"2024-09-18T01:48:27.011354+0000","last_undegraded":"2024-09-18T01:48:27.011354+0000","last_fullsized":"2024-09-18T01:48:27.011354+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'95","last_scrub_stamp":"2024-09-18T01:48:27.011228+0000","last_deep_scrub":"33'95","last_deep_scrub_stamp":"2024-09-18T01:48:27.011228+0000","last_clean_scrub_stamp":"2024-09-18T01:48:27.011228+0000","objects_scrubbed":6,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:47:24.915172+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":81,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:24.264584+0000","last_change":"2024-09-18T01:48:24.264584+0000","last_active":"2024-09-18T01:48:24.264584+0000","last_peered":"2024-09-18T01:48:24.264584+0000","last_clean":"2024-09-18T01:48:24.264584+0000","last_became_active":"2024-09-18T01:45:12.311337+0000","last_became_peered":"2024-09-18T01:45:12.311337+0000","last_unstale":"2024-09-18T01:48:24.264584+0000","last_undegraded":"2024-09-18T01:48:24.264584+0000","last_fullsized":"2024-09-18T01:48:24.264584+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:24.264452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:24.264452+0000","last_clean_scrub_stamp":"2024-09-18T01:48:24.264452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:54:43.625934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'81","reported_seq":172,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:44.040748+0000","last_change":"2024-09-18T01:48:44.040748+0000","last_active":"2024-09-18T01:48:44.040748+0000","last_peered":"2024-09-18T01:48:44.040748+0000","last_clean":"2024-09-18T01:48:44.040748+0000","last_became_active":"2024-09-18T01:45:14.314784+0000","last_became_peered":"2024-09-18T01:45:14.314784+0000","last_unstale":"2024-09-18T01:48:44.040748+0000","last_undegraded":"2024-09-18T01:48:44.040748+0000","last_fullsized":"2024-09-18T01:48:44.040748+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'81","last_scrub_stamp":"2024-09-18T01:48:44.040554+0000","last_deep_scrub":"33'81","last_deep_scrub_stamp":"2024-09-18T01:48:44.040554+0000","last_clean_scrub_stamp":"2024-09-18T01:48:44.040554+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:07:29.059407+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'4","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:17.112658+0000","last_change":"2024-09-18T01:49:17.112711+0000","last_active":"2024-09-18T01:49:17.112658+0000","last_peered":"2024-09-18T01:49:17.112658+0000","last_clean":"2024-09-18T01:49:17.112658+0000","last_became_active":"2024-09-18T01:45:41.338925+0000","last_became_peered":"2024-09-18T01:45:41.338925+0000","last_unstale":"2024-09-18T01:49:17.112658+0000","last_undegraded":"2024-09-18T01:49:17.112658+0000","last_fullsized":"2024-09-18T01:49:17.112658+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:49:17.112556+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:49:17.112556+0000","last_clean_scrub_stamp":"2024-09-18T01:49:17.112556+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:16:39.599997+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:35.974267+0000","last_change":"2024-09-18T01:49:35.974289+0000","last_active":"2024-09-18T01:49:35.974267+0000","last_peered":"2024-09-18T01:49:35.974267+0000","last_clean":"2024-09-18T01:49:35.974267+0000","last_became_active":"2024-09-18T01:44:53.237059+0000","last_became_peered":"2024-09-18T01:44:53.237059+0000","last_unstale":"2024-09-18T01:49:35.974267+0000","last_undegraded":"2024-09-18T01:49:35.974267+0000","last_fullsized":"2024-09-18T01:49:35.974267+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:35.974172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:35.974172+0000","last_clean_scrub_stamp":"2024-09-18T01:49:35.974172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:24:43.091880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011095359999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:14.329892+0000","last_change":"2024-09-18T01:49:14.329892+0000","last_active":"2024-09-18T01:49:14.329892+0000","last_peered":"2024-09-18T01:49:14.329892+0000","last_clean":"2024-09-18T01:49:14.329892+0000","last_became_active":"2024-09-18T01:45:04.273354+0000","last_became_peered":"2024-09-18T01:45:04.273354+0000","last_unstale":"2024-09-18T01:49:14.329892+0000","last_undegraded":"2024-09-18T01:49:14.329892+0000","last_fullsized":"2024-09-18T01:49:14.329892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:14.329766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:14.329766+0000","last_clean_scrub_stamp":"2024-09-18T01:49:14.329766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:39:48.120415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:32.043612+0000","last_change":"2024-09-18T01:48:32.043612+0000","last_active":"2024-09-18T01:48:32.043612+0000","last_peered":"2024-09-18T01:48:32.043612+0000","last_clean":"2024-09-18T01:48:32.043612+0000","last_became_active":"2024-09-18T01:45:08.291681+0000","last_became_peered":"2024-09-18T01:45:08.291681+0000","last_unstale":"2024-09-18T01:48:32.043612+0000","last_undegraded":"2024-09-18T01:48:32.043612+0000","last_fullsized":"2024-09-18T01:48:32.043612+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:32.043454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:32.043454+0000","last_clean_scrub_stamp":"2024-09-18T01:48:32.043454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:43:29.802788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'297","reported_seq":528,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:27.957047+0000","last_change":"2024-09-18T01:48:27.957047+0000","last_active":"2024-09-18T01:48:27.957047+0000","last_peered":"2024-09-18T01:48:27.957047+0000","last_clean":"2024-09-18T01:48:27.957047+0000","last_became_active":"2024-09-18T01:45:10.305472+0000","last_became_peered":"2024-09-18T01:45:10.305472+0000","last_unstale":"2024-09-18T01:48:27.957047+0000","last_undegraded":"2024-09-18T01:48:27.957047+0000","last_fullsized":"2024-09-18T01:48:27.957047+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'297","last_scrub_stamp":"2024-09-18T01:48:27.956904+0000","last_deep_scrub":"33'297","last_deep_scrub_stamp":"2024-09-18T01:48:27.956904+0000","last_clean_scrub_stamp":"2024-09-18T01:48:27.956904+0000","objects_scrubbed":11,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:56:18.052928+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":387,"num_read_kb":371,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:55.023485+0000","last_change":"2024-09-18T01:48:55.023485+0000","last_active":"2024-09-18T01:48:55.023485+0000","last_peered":"2024-09-18T01:48:55.023485+0000","last_clean":"2024-09-18T01:48:55.023485+0000","last_became_active":"2024-09-18T01:45:12.316110+0000","last_became_peered":"2024-09-18T01:45:12.316110+0000","last_unstale":"2024-09-18T01:48:55.023485+0000","last_undegraded":"2024-09-18T01:48:55.023485+0000","last_fullsized":"2024-09-18T01:48:55.023485+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:55.023295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:55.023295+0000","last_clean_scrub_stamp":"2024-09-18T01:48:55.023295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:00:27.945139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'5","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:21.046038+0000","last_change":"2024-09-18T01:49:21.046038+0000","last_active":"2024-09-18T01:49:21.046038+0000","last_peered":"2024-09-18T01:49:21.046038+0000","last_clean":"2024-09-18T01:49:21.046038+0000","last_became_active":"2024-09-18T01:45:14.322986+0000","last_became_peered":"2024-09-18T01:45:14.322986+0000","last_unstale":"2024-09-18T01:49:21.046038+0000","last_undegraded":"2024-09-18T01:49:21.046038+0000","last_fullsized":"2024-09-18T01:49:21.046038+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-18T01:49:21.045917+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-18T01:49:21.045917+0000","last_clean_scrub_stamp":"2024-09-18T01:49:21.045917+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:03:37.631724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'8","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:54.374813+0000","last_change":"2024-09-18T01:48:54.374813+0000","last_active":"2024-09-18T01:48:54.374813+0000","last_peered":"2024-09-18T01:48:54.374813+0000","last_clean":"2024-09-18T01:48:54.374813+0000","last_became_active":"2024-09-18T01:45:06.292996+0000","last_became_peered":"2024-09-18T01:45:06.292996+0000","last_unstale":"2024-09-18T01:48:54.374813+0000","last_undegraded":"2024-09-18T01:48:54.374813+0000","last_fullsized":"2024-09-18T01:48:54.374813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-18T01:48:54.374701+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-18T01:48:54.374701+0000","last_clean_scrub_stamp":"2024-09-18T01:48:54.374701+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:54:39.652845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:02.043873+0000","last_change":"2024-09-18T01:49:02.043873+0000","last_active":"2024-09-18T01:49:02.043873+0000","last_peered":"2024-09-18T01:49:02.043873+0000","last_clean":"2024-09-18T01:49:02.043873+0000","last_became_active":"2024-09-18T01:44:53.237016+0000","last_became_peered":"2024-09-18T01:44:53.237016+0000","last_unstale":"2024-09-18T01:49:02.043873+0000","last_undegraded":"2024-09-18T01:49:02.043873+0000","last_fullsized":"2024-09-18T01:49:02.043873+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:02.043751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:02.043751+0000","last_clean_scrub_stamp":"2024-09-18T01:49:02.043751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:47:59.947696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039942899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:58.422425+0000","last_change":"2024-09-18T01:48:58.422425+0000","last_active":"2024-09-18T01:48:58.422425+0000","last_peered":"2024-09-18T01:48:58.422425+0000","last_clean":"2024-09-18T01:48:58.422425+0000","last_became_active":"2024-09-18T01:45:04.283999+0000","last_became_peered":"2024-09-18T01:45:04.283999+0000","last_unstale":"2024-09-18T01:48:58.422425+0000","last_undegraded":"2024-09-18T01:48:58.422425+0000","last_fullsized":"2024-09-18T01:48:58.422425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:48:58.422302+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:48:58.422302+0000","last_clean_scrub_stamp":"2024-09-18T01:48:58.422302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:21:30.620518+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"33'4","reported_seq":233,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:43.006522+0000","last_change":"2024-09-18T01:48:43.006522+0000","last_active":"2024-09-18T01:48:43.006522+0000","last_peered":"2024-09-18T01:48:43.006522+0000","last_clean":"2024-09-18T01:48:43.006522+0000","last_became_active":"2024-09-18T01:45:08.284186+0000","last_became_peered":"2024-09-18T01:45:08.284186+0000","last_unstale":"2024-09-18T01:48:43.006522+0000","last_undegraded":"2024-09-18T01:48:43.006522+0000","last_fullsized":"2024-09-18T01:48:43.006522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:48:43.006376+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:48:43.006376+0000","last_clean_scrub_stamp":"2024-09-18T01:48:43.006376+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:03:25.253771+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'24","reported_seq":101,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:34.888969+0000","last_change":"2024-09-18T01:48:34.888969+0000","last_active":"2024-09-18T01:48:34.888969+0000","last_peered":"2024-09-18T01:48:34.888969+0000","last_clean":"2024-09-18T01:48:34.888969+0000","last_became_active":"2024-09-18T01:45:10.296284+0000","last_became_peered":"2024-09-18T01:45:10.296284+0000","last_unstale":"2024-09-18T01:48:34.888969+0000","last_undegraded":"2024-09-18T01:48:34.888969+0000","last_fullsized":"2024-09-18T01:48:34.888969+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'24","last_scrub_stamp":"2024-09-18T01:48:34.888775+0000","last_deep_scrub":"33'24","last_deep_scrub_stamp":"2024-09-18T01:48:34.888775+0000","last_clean_scrub_stamp":"2024-09-18T01:48:34.888775+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:24:45.905214+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:26.266603+0000","last_change":"2024-09-18T01:48:26.266603+0000","last_active":"2024-09-18T01:48:26.266603+0000","last_peered":"2024-09-18T01:48:26.266603+0000","last_clean":"2024-09-18T01:48:26.266603+0000","last_became_active":"2024-09-18T01:45:12.311266+0000","last_became_peered":"2024-09-18T01:45:12.311266+0000","last_unstale":"2024-09-18T01:48:26.266603+0000","last_undegraded":"2024-09-18T01:48:26.266603+0000","last_fullsized":"2024-09-18T01:48:26.266603+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:26.266453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:26.266453+0000","last_clean_scrub_stamp":"2024-09-18T01:48:26.266453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:33:31.954590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"33'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:02.888947+0000","last_change":"2024-09-18T01:49:02.888972+0000","last_active":"2024-09-18T01:49:02.888947+0000","last_peered":"2024-09-18T01:49:02.888947+0000","last_clean":"2024-09-18T01:49:02.888947+0000","last_became_active":"2024-09-18T01:45:14.318346+0000","last_became_peered":"2024-09-18T01:45:14.318346+0000","last_unstale":"2024-09-18T01:49:02.888947+0000","last_undegraded":"2024-09-18T01:49:02.888947+0000","last_fullsized":"2024-09-18T01:49:02.888947+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:02.888860+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:02.888860+0000","last_clean_scrub_stamp":"2024-09-18T01:49:02.888860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:33:30.505620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:59.400983+0000","last_change":"2024-09-18T01:48:59.400983+0000","last_active":"2024-09-18T01:48:59.400983+0000","last_peered":"2024-09-18T01:48:59.400983+0000","last_clean":"2024-09-18T01:48:59.400983+0000","last_became_active":"2024-09-18T01:45:06.282319+0000","last_became_peered":"2024-09-18T01:45:06.282319+0000","last_unstale":"2024-09-18T01:48:59.400983+0000","last_undegraded":"2024-09-18T01:48:59.400983+0000","last_fullsized":"2024-09-18T01:48:59.400983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:48:59.400854+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:48:59.400854+0000","last_clean_scrub_stamp":"2024-09-18T01:48:59.400854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:57:19.245005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"33'3","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:34.947318+0000","last_change":"2024-09-18T01:49:34.947388+0000","last_active":"2024-09-18T01:49:34.947318+0000","last_peered":"2024-09-18T01:49:34.947318+0000","last_clean":"2024-09-18T01:49:34.947318+0000","last_became_active":"2024-09-18T01:44:53.236990+0000","last_became_peered":"2024-09-18T01:44:53.236990+0000","last_unstale":"2024-09-18T01:49:34.947318+0000","last_undegraded":"2024-09-18T01:49:34.947318+0000","last_fullsized":"2024-09-18T01:49:34.947318+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-18T01:49:34.947196+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-18T01:49:34.947196+0000","last_clean_scrub_stamp":"2024-09-18T01:49:34.947196+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:57:34.019768+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.001062627,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:50.989543+0000","last_change":"2024-09-18T01:48:50.989543+0000","last_active":"2024-09-18T01:48:50.989543+0000","last_peered":"2024-09-18T01:48:50.989543+0000","last_clean":"2024-09-18T01:48:50.989543+0000","last_became_active":"2024-09-18T01:45:04.293064+0000","last_became_peered":"2024-09-18T01:45:04.293064+0000","last_unstale":"2024-09-18T01:48:50.989543+0000","last_undegraded":"2024-09-18T01:48:50.989543+0000","last_fullsized":"2024-09-18T01:48:50.989543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:50.989373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:50.989373+0000","last_clean_scrub_stamp":"2024-09-18T01:48:50.989373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:10:23.020221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:40.269797+0000","last_change":"2024-09-18T01:48:40.269797+0000","last_active":"2024-09-18T01:48:40.269797+0000","last_peered":"2024-09-18T01:48:40.269797+0000","last_clean":"2024-09-18T01:48:40.269797+0000","last_became_active":"2024-09-18T01:45:08.292477+0000","last_became_peered":"2024-09-18T01:45:08.292477+0000","last_unstale":"2024-09-18T01:48:40.269797+0000","last_undegraded":"2024-09-18T01:48:40.269797+0000","last_fullsized":"2024-09-18T01:48:40.269797+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:40.269686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:40.269686+0000","last_clean_scrub_stamp":"2024-09-18T01:48:40.269686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:24:25.007900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'20","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:39.078586+0000","last_change":"2024-09-18T01:48:39.078586+0000","last_active":"2024-09-18T01:48:39.078586+0000","last_peered":"2024-09-18T01:48:39.078586+0000","last_clean":"2024-09-18T01:48:39.078586+0000","last_became_active":"2024-09-18T01:45:10.308018+0000","last_became_peered":"2024-09-18T01:45:10.308018+0000","last_unstale":"2024-09-18T01:48:39.078586+0000","last_undegraded":"2024-09-18T01:48:39.078586+0000","last_fullsized":"2024-09-18T01:48:39.078586+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'20","last_scrub_stamp":"2024-09-18T01:48:39.078443+0000","last_deep_scrub":"33'20","last_deep_scrub_stamp":"2024-09-18T01:48:39.078443+0000","last_clean_scrub_stamp":"2024-09-18T01:48:39.078443+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:25:17.630439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:46.034806+0000","last_change":"2024-09-18T01:48:46.034806+0000","last_active":"2024-09-18T01:48:46.034806+0000","last_peered":"2024-09-18T01:48:46.034806+0000","last_clean":"2024-09-18T01:48:46.034806+0000","last_became_active":"2024-09-18T01:45:12.315342+0000","last_became_peered":"2024-09-18T01:45:12.315342+0000","last_unstale":"2024-09-18T01:48:46.034806+0000","last_undegraded":"2024-09-18T01:48:46.034806+0000","last_fullsized":"2024-09-18T01:48:46.034806+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:46.034692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:46.034692+0000","last_clean_scrub_stamp":"2024-09-18T01:48:46.034692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:33:00.369957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"33'6","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:19.079014+0000","last_change":"2024-09-18T01:49:19.079014+0000","last_active":"2024-09-18T01:49:19.079014+0000","last_peered":"2024-09-18T01:49:19.079014+0000","last_clean":"2024-09-18T01:49:19.079014+0000","last_became_active":"2024-09-18T01:45:14.322568+0000","last_became_peered":"2024-09-18T01:45:14.322568+0000","last_unstale":"2024-09-18T01:49:19.079014+0000","last_undegraded":"2024-09-18T01:49:19.079014+0000","last_fullsized":"2024-09-18T01:49:19.079014+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-18T01:49:19.078859+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-18T01:49:19.078859+0000","last_clean_scrub_stamp":"2024-09-18T01:49:19.078859+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:14:21.152081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'14","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:59.099373+0000","last_change":"2024-09-18T01:48:59.099373+0000","last_active":"2024-09-18T01:48:59.099373+0000","last_peered":"2024-09-18T01:48:59.099373+0000","last_clean":"2024-09-18T01:48:59.099373+0000","last_became_active":"2024-09-18T01:45:06.291792+0000","last_became_peered":"2024-09-18T01:45:06.291792+0000","last_unstale":"2024-09-18T01:48:59.099373+0000","last_undegraded":"2024-09-18T01:48:59.099373+0000","last_fullsized":"2024-09-18T01:48:59.099373+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-09-18T01:48:59.099213+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-09-18T01:48:59.099213+0000","last_clean_scrub_stamp":"2024-09-18T01:48:59.099213+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:58:21.348526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"31'2","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:59.100243+0000","last_change":"2024-09-18T01:48:59.100243+0000","last_active":"2024-09-18T01:48:59.100243+0000","last_peered":"2024-09-18T01:48:59.100243+0000","last_clean":"2024-09-18T01:48:59.100243+0000","last_became_active":"2024-09-18T01:45:04.291211+0000","last_became_peered":"2024-09-18T01:45:04.291211+0000","last_unstale":"2024-09-18T01:48:59.100243+0000","last_undegraded":"2024-09-18T01:48:59.100243+0000","last_fullsized":"2024-09-18T01:48:59.100243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-18T01:48:59.100062+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-18T01:48:59.100062+0000","last_clean_scrub_stamp":"2024-09-18T01:48:59.100062+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:37:34.895942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:11.357763+0000","last_change":"2024-09-18T01:49:11.357787+0000","last_active":"2024-09-18T01:49:11.357763+0000","last_peered":"2024-09-18T01:49:11.357763+0000","last_clean":"2024-09-18T01:49:11.357763+0000","last_became_active":"2024-09-18T01:44:53.234966+0000","last_became_peered":"2024-09-18T01:44:53.234966+0000","last_unstale":"2024-09-18T01:49:11.357763+0000","last_undegraded":"2024-09-18T01:49:11.357763+0000","last_fullsized":"2024-09-18T01:49:11.357763+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:11.357662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:11.357662+0000","last_clean_scrub_stamp":"2024-09-18T01:49:11.357662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:05:42.865637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045990099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:48.358622+0000","last_change":"2024-09-18T01:48:48.358622+0000","last_active":"2024-09-18T01:48:48.358622+0000","last_peered":"2024-09-18T01:48:48.358622+0000","last_clean":"2024-09-18T01:48:48.358622+0000","last_became_active":"2024-09-18T01:45:08.286195+0000","last_became_peered":"2024-09-18T01:45:08.286195+0000","last_unstale":"2024-09-18T01:48:48.358622+0000","last_undegraded":"2024-09-18T01:48:48.358622+0000","last_fullsized":"2024-09-18T01:48:48.358622+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:48:48.358462+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:48:48.358462+0000","last_clean_scrub_stamp":"2024-09-18T01:48:48.358462+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:55:29.632161+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'87","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:31.300515+0000","last_change":"2024-09-18T01:48:31.300515+0000","last_active":"2024-09-18T01:48:31.300515+0000","last_peered":"2024-09-18T01:48:31.300515+0000","last_clean":"2024-09-18T01:48:31.300515+0000","last_became_active":"2024-09-18T01:45:10.305948+0000","last_became_peered":"2024-09-18T01:45:10.305948+0000","last_unstale":"2024-09-18T01:48:31.300515+0000","last_undegraded":"2024-09-18T01:48:31.300515+0000","last_fullsized":"2024-09-18T01:48:31.300515+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'87","last_scrub_stamp":"2024-09-18T01:48:31.300310+0000","last_deep_scrub":"33'87","last_deep_scrub_stamp":"2024-09-18T01:48:31.300310+0000","last_clean_scrub_stamp":"2024-09-18T01:48:31.300310+0000","objects_scrubbed":11,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:18:03.428377+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":89,"num_read_kb":75,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:27.838906+0000","last_change":"2024-09-18T01:48:27.838906+0000","last_active":"2024-09-18T01:48:27.838906+0000","last_peered":"2024-09-18T01:48:27.838906+0000","last_clean":"2024-09-18T01:48:27.838906+0000","last_became_active":"2024-09-18T01:45:12.311862+0000","last_became_peered":"2024-09-18T01:45:12.311862+0000","last_unstale":"2024-09-18T01:48:27.838906+0000","last_undegraded":"2024-09-18T01:48:27.838906+0000","last_fullsized":"2024-09-18T01:48:27.838906+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:27.838756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:27.838756+0000","last_clean_scrub_stamp":"2024-09-18T01:48:27.838756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:26:33.881794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'13","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:53.409197+0000","last_change":"2024-09-18T01:48:53.409223+0000","last_active":"2024-09-18T01:48:53.409197+0000","last_peered":"2024-09-18T01:48:53.409197+0000","last_clean":"2024-09-18T01:48:53.409197+0000","last_became_active":"2024-09-18T01:45:14.311403+0000","last_became_peered":"2024-09-18T01:45:14.311403+0000","last_unstale":"2024-09-18T01:48:53.409197+0000","last_undegraded":"2024-09-18T01:48:53.409197+0000","last_fullsized":"2024-09-18T01:48:53.409197+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'13","last_scrub_stamp":"2024-09-18T01:48:53.409107+0000","last_deep_scrub":"33'13","last_deep_scrub_stamp":"2024-09-18T01:48:53.409107+0000","last_clean_scrub_stamp":"2024-09-18T01:48:53.409107+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:19:19.002301+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:01.149371+0000","last_change":"2024-09-18T01:49:01.149371+0000","last_active":"2024-09-18T01:49:01.149371+0000","last_peered":"2024-09-18T01:49:01.149371+0000","last_clean":"2024-09-18T01:49:01.149371+0000","last_became_active":"2024-09-18T01:45:06.291845+0000","last_became_peered":"2024-09-18T01:45:06.291845+0000","last_unstale":"2024-09-18T01:49:01.149371+0000","last_undegraded":"2024-09-18T01:49:01.149371+0000","last_fullsized":"2024-09-18T01:49:01.149371+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:01.149256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:01.149256+0000","last_clean_scrub_stamp":"2024-09-18T01:49:01.149256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:25:39.701253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:15.355172+0000","last_change":"2024-09-18T01:49:15.355172+0000","last_active":"2024-09-18T01:49:15.355172+0000","last_peered":"2024-09-18T01:49:15.355172+0000","last_clean":"2024-09-18T01:49:15.355172+0000","last_became_active":"2024-09-18T01:45:04.273385+0000","last_became_peered":"2024-09-18T01:45:04.273385+0000","last_unstale":"2024-09-18T01:49:15.355172+0000","last_undegraded":"2024-09-18T01:49:15.355172+0000","last_fullsized":"2024-09-18T01:49:15.355172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:15.355018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:15.355018+0000","last_clean_scrub_stamp":"2024-09-18T01:49:15.355018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:00:42.796946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:33.965833+0000","last_change":"2024-09-18T01:49:33.965898+0000","last_active":"2024-09-18T01:49:33.965833+0000","last_peered":"2024-09-18T01:49:33.965833+0000","last_clean":"2024-09-18T01:49:33.965833+0000","last_became_active":"2024-09-18T01:44:53.236927+0000","last_became_peered":"2024-09-18T01:44:53.236927+0000","last_unstale":"2024-09-18T01:49:33.965833+0000","last_undegraded":"2024-09-18T01:49:33.965833+0000","last_fullsized":"2024-09-18T01:49:33.965833+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:33.965692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:33.965692+0000","last_clean_scrub_stamp":"2024-09-18T01:49:33.965692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:23:17.427766+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00130324,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:24.061850+0000","last_change":"2024-09-18T01:48:24.061850+0000","last_active":"2024-09-18T01:48:24.061850+0000","last_peered":"2024-09-18T01:48:24.061850+0000","last_clean":"2024-09-18T01:48:24.061850+0000","last_became_active":"2024-09-18T01:45:08.296118+0000","last_became_peered":"2024-09-18T01:45:08.296118+0000","last_unstale":"2024-09-18T01:48:24.061850+0000","last_undegraded":"2024-09-18T01:48:24.061850+0000","last_fullsized":"2024-09-18T01:48:24.061850+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:24.061705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:24.061705+0000","last_clean_scrub_stamp":"2024-09-18T01:48:24.061705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:36:59.857585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"33'28","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:26.017268+0000","last_change":"2024-09-18T01:48:26.017268+0000","last_active":"2024-09-18T01:48:26.017268+0000","last_peered":"2024-09-18T01:48:26.017268+0000","last_clean":"2024-09-18T01:48:26.017268+0000","last_became_active":"2024-09-18T01:45:10.305932+0000","last_became_peered":"2024-09-18T01:45:10.305932+0000","last_unstale":"2024-09-18T01:48:26.017268+0000","last_undegraded":"2024-09-18T01:48:26.017268+0000","last_fullsized":"2024-09-18T01:48:26.017268+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'28","last_scrub_stamp":"2024-09-18T01:48:26.017059+0000","last_deep_scrub":"33'28","last_deep_scrub_stamp":"2024-09-18T01:48:26.017059+0000","last_clean_scrub_stamp":"2024-09-18T01:48:26.017059+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:54:30.634425+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'285","reported_seq":367,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:24.016399+0000","last_change":"2024-09-18T01:48:24.016399+0000","last_active":"2024-09-18T01:48:24.016399+0000","last_peered":"2024-09-18T01:48:24.016399+0000","last_clean":"2024-09-18T01:48:24.016399+0000","last_became_active":"2024-09-18T01:45:12.312117+0000","last_became_peered":"2024-09-18T01:45:12.312117+0000","last_unstale":"2024-09-18T01:48:24.016399+0000","last_undegraded":"2024-09-18T01:48:24.016399+0000","last_fullsized":"2024-09-18T01:48:24.016399+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-18T01:48:24.016276+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-18T01:48:24.016276+0000","last_clean_scrub_stamp":"2024-09-18T01:48:24.016276+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:28:28.633537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"33'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:06.901049+0000","last_change":"2024-09-18T01:49:06.901109+0000","last_active":"2024-09-18T01:49:06.901049+0000","last_peered":"2024-09-18T01:49:06.901049+0000","last_clean":"2024-09-18T01:49:06.901049+0000","last_became_active":"2024-09-18T01:45:14.322078+0000","last_became_peered":"2024-09-18T01:45:14.322078+0000","last_unstale":"2024-09-18T01:49:06.901049+0000","last_undegraded":"2024-09-18T01:49:06.901049+0000","last_fullsized":"2024-09-18T01:49:06.901049+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:06.900920+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:06.900920+0000","last_clean_scrub_stamp":"2024-09-18T01:49:06.900920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:34:55.515398+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:36.099827+0000","last_change":"2024-09-18T01:48:36.099827+0000","last_active":"2024-09-18T01:48:36.099827+0000","last_peered":"2024-09-18T01:48:36.099827+0000","last_clean":"2024-09-18T01:48:36.099827+0000","last_became_active":"2024-09-18T01:45:06.297660+0000","last_became_peered":"2024-09-18T01:45:06.297660+0000","last_unstale":"2024-09-18T01:48:36.099827+0000","last_undegraded":"2024-09-18T01:48:36.099827+0000","last_fullsized":"2024-09-18T01:48:36.099827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:48:36.099708+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:48:36.099708+0000","last_clean_scrub_stamp":"2024-09-18T01:48:36.099708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:13:48.036328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:12.849067+0000","last_change":"2024-09-18T01:49:12.849067+0000","last_active":"2024-09-18T01:49:12.849067+0000","last_peered":"2024-09-18T01:49:12.849067+0000","last_clean":"2024-09-18T01:49:12.849067+0000","last_became_active":"2024-09-18T01:45:04.288189+0000","last_became_peered":"2024-09-18T01:45:04.288189+0000","last_unstale":"2024-09-18T01:49:12.849067+0000","last_undegraded":"2024-09-18T01:49:12.849067+0000","last_fullsized":"2024-09-18T01:49:12.849067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:12.848889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:12.848889+0000","last_clean_scrub_stamp":"2024-09-18T01:49:12.848889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:11:11.778098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:12.325355+0000","last_change":"2024-09-18T01:49:12.325355+0000","last_active":"2024-09-18T01:49:12.325355+0000","last_peered":"2024-09-18T01:49:12.325355+0000","last_clean":"2024-09-18T01:49:12.325355+0000","last_became_active":"2024-09-18T01:44:53.236812+0000","last_became_peered":"2024-09-18T01:44:53.236812+0000","last_unstale":"2024-09-18T01:49:12.325355+0000","last_undegraded":"2024-09-18T01:49:12.325355+0000","last_fullsized":"2024-09-18T01:49:12.325355+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:12.325216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:12.325216+0000","last_clean_scrub_stamp":"2024-09-18T01:49:12.325216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:49:14.847227+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00044136000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:26.017324+0000","last_change":"2024-09-18T01:48:26.017324+0000","last_active":"2024-09-18T01:48:26.017324+0000","last_peered":"2024-09-18T01:48:26.017324+0000","last_clean":"2024-09-18T01:48:26.017324+0000","last_became_active":"2024-09-18T01:45:08.296102+0000","last_became_peered":"2024-09-18T01:45:08.296102+0000","last_unstale":"2024-09-18T01:48:26.017324+0000","last_undegraded":"2024-09-18T01:48:26.017324+0000","last_fullsized":"2024-09-18T01:48:26.017324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:26.017211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:26.017211+0000","last_clean_scrub_stamp":"2024-09-18T01:48:26.017211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:29:58.682197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"33'22","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:52.020412+0000","last_change":"2024-09-18T01:48:52.020412+0000","last_active":"2024-09-18T01:48:52.020412+0000","last_peered":"2024-09-18T01:48:52.020412+0000","last_clean":"2024-09-18T01:48:52.020412+0000","last_became_active":"2024-09-18T01:45:10.308451+0000","last_became_peered":"2024-09-18T01:45:10.308451+0000","last_unstale":"2024-09-18T01:48:52.020412+0000","last_undegraded":"2024-09-18T01:48:52.020412+0000","last_fullsized":"2024-09-18T01:48:52.020412+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2024-09-18T01:48:52.020253+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2024-09-18T01:48:52.020253+0000","last_clean_scrub_stamp":"2024-09-18T01:48:52.020253+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:29:39.718171+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'285","reported_seq":441,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:49.394846+0000","last_change":"2024-09-18T01:48:49.394846+0000","last_active":"2024-09-18T01:48:49.394846+0000","last_peered":"2024-09-18T01:48:49.394846+0000","last_clean":"2024-09-18T01:48:49.394846+0000","last_became_active":"2024-09-18T01:45:12.313885+0000","last_became_peered":"2024-09-18T01:45:12.313885+0000","last_unstale":"2024-09-18T01:48:49.394846+0000","last_undegraded":"2024-09-18T01:48:49.394846+0000","last_fullsized":"2024-09-18T01:48:49.394846+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-18T01:48:49.394735+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-18T01:48:49.394735+0000","last_clean_scrub_stamp":"2024-09-18T01:48:49.394735+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:09:02.112570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"33'7","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:42.846796+0000","last_change":"2024-09-18T01:48:42.846821+0000","last_active":"2024-09-18T01:48:42.846796+0000","last_peered":"2024-09-18T01:48:42.846796+0000","last_clean":"2024-09-18T01:48:42.846796+0000","last_became_active":"2024-09-18T01:45:14.317241+0000","last_became_peered":"2024-09-18T01:45:14.317241+0000","last_unstale":"2024-09-18T01:48:42.846796+0000","last_undegraded":"2024-09-18T01:48:42.846796+0000","last_fullsized":"2024-09-18T01:48:42.846796+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-09-18T01:48:42.846695+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-09-18T01:48:42.846695+0000","last_clean_scrub_stamp":"2024-09-18T01:48:42.846695+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:24:27.584908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"33'8","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:58.082270+0000","last_change":"2024-09-18T01:48:58.082270+0000","last_active":"2024-09-18T01:48:58.082270+0000","last_peered":"2024-09-18T01:48:58.082270+0000","last_clean":"2024-09-18T01:48:58.082270+0000","last_became_active":"2024-09-18T01:45:06.285656+0000","last_became_peered":"2024-09-18T01:45:06.285656+0000","last_unstale":"2024-09-18T01:48:58.082270+0000","last_undegraded":"2024-09-18T01:48:58.082270+0000","last_fullsized":"2024-09-18T01:48:58.082270+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-18T01:48:58.082155+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-18T01:48:58.082155+0000","last_clean_scrub_stamp":"2024-09-18T01:48:58.082155+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:12:50.018176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:12.022442+0000","last_change":"2024-09-18T01:49:12.022442+0000","last_active":"2024-09-18T01:49:12.022442+0000","last_peered":"2024-09-18T01:49:12.022442+0000","last_clean":"2024-09-18T01:49:12.022442+0000","last_became_active":"2024-09-18T01:45:04.290480+0000","last_became_peered":"2024-09-18T01:45:04.290480+0000","last_unstale":"2024-09-18T01:49:12.022442+0000","last_undegraded":"2024-09-18T01:49:12.022442+0000","last_fullsized":"2024-09-18T01:49:12.022442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:12.022321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:12.022321+0000","last_clean_scrub_stamp":"2024-09-18T01:49:12.022321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:38:59.551859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:37.006285+0000","last_change":"2024-09-18T01:49:37.006310+0000","last_active":"2024-09-18T01:49:37.006285+0000","last_peered":"2024-09-18T01:49:37.006285+0000","last_clean":"2024-09-18T01:49:37.006285+0000","last_became_active":"2024-09-18T01:44:53.298677+0000","last_became_peered":"2024-09-18T01:44:53.298677+0000","last_unstale":"2024-09-18T01:49:37.006285+0000","last_undegraded":"2024-09-18T01:49:37.006285+0000","last_fullsized":"2024-09-18T01:49:37.006285+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:37.006189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:37.006189+0000","last_clean_scrub_stamp":"2024-09-18T01:49:37.006189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:26:11.859958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052495500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:33.060133+0000","last_change":"2024-09-18T01:48:33.060133+0000","last_active":"2024-09-18T01:48:33.060133+0000","last_peered":"2024-09-18T01:48:33.060133+0000","last_clean":"2024-09-18T01:48:33.060133+0000","last_became_active":"2024-09-18T01:45:08.291696+0000","last_became_peered":"2024-09-18T01:45:08.291696+0000","last_unstale":"2024-09-18T01:48:33.060133+0000","last_undegraded":"2024-09-18T01:48:33.060133+0000","last_fullsized":"2024-09-18T01:48:33.060133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:33.059961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:33.059961+0000","last_clean_scrub_stamp":"2024-09-18T01:48:33.059961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:23:09.745291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'103","reported_seq":203,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:28.839049+0000","last_change":"2024-09-18T01:48:28.839049+0000","last_active":"2024-09-18T01:48:28.839049+0000","last_peered":"2024-09-18T01:48:28.839049+0000","last_clean":"2024-09-18T01:48:28.839049+0000","last_became_active":"2024-09-18T01:45:10.304662+0000","last_became_peered":"2024-09-18T01:45:10.304662+0000","last_unstale":"2024-09-18T01:48:28.839049+0000","last_undegraded":"2024-09-18T01:48:28.839049+0000","last_fullsized":"2024-09-18T01:48:28.839049+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'103","last_scrub_stamp":"2024-09-18T01:48:28.838915+0000","last_deep_scrub":"33'103","last_deep_scrub_stamp":"2024-09-18T01:48:28.838915+0000","last_clean_scrub_stamp":"2024-09-18T01:48:28.838915+0000","objects_scrubbed":9,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:19:33.132645+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":87,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:23.263316+0000","last_change":"2024-09-18T01:48:23.263316+0000","last_active":"2024-09-18T01:48:23.263316+0000","last_peered":"2024-09-18T01:48:23.263316+0000","last_clean":"2024-09-18T01:48:23.263316+0000","last_became_active":"2024-09-18T01:45:12.311399+0000","last_became_peered":"2024-09-18T01:45:12.311399+0000","last_unstale":"2024-09-18T01:48:23.263316+0000","last_undegraded":"2024-09-18T01:48:23.263316+0000","last_fullsized":"2024-09-18T01:48:23.263316+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:23.263202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:23.263202+0000","last_clean_scrub_stamp":"2024-09-18T01:48:23.263202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:54:27.880569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:11.051531+0000","last_change":"2024-09-18T01:49:11.051570+0000","last_active":"2024-09-18T01:49:11.051531+0000","last_peered":"2024-09-18T01:49:11.051531+0000","last_clean":"2024-09-18T01:49:11.051531+0000","last_became_active":"2024-09-18T01:45:14.314587+0000","last_became_peered":"2024-09-18T01:45:14.314587+0000","last_unstale":"2024-09-18T01:49:11.051531+0000","last_undegraded":"2024-09-18T01:49:11.051531+0000","last_fullsized":"2024-09-18T01:49:11.051531+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:11.051420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:11.051420+0000","last_clean_scrub_stamp":"2024-09-18T01:49:11.051420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:32:32.758053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"31'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:14.065572+0000","last_change":"2024-09-18T01:49:14.065572+0000","last_active":"2024-09-18T01:49:14.065572+0000","last_peered":"2024-09-18T01:49:14.065572+0000","last_clean":"2024-09-18T01:49:14.065572+0000","last_became_active":"2024-09-18T01:45:14.326051+0000","last_became_peered":"2024-09-18T01:45:14.326051+0000","last_unstale":"2024-09-18T01:49:14.065572+0000","last_undegraded":"2024-09-18T01:49:14.065572+0000","last_fullsized":"2024-09-18T01:49:14.065572+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-18T01:49:14.065439+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-18T01:49:14.065439+0000","last_clean_scrub_stamp":"2024-09-18T01:49:14.065439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:58:36.005665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"33'8","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:52.038813+0000","last_change":"2024-09-18T01:48:52.038841+0000","last_active":"2024-09-18T01:48:52.038813+0000","last_peered":"2024-09-18T01:48:52.038813+0000","last_clean":"2024-09-18T01:48:52.038813+0000","last_became_active":"2024-09-18T01:45:06.283912+0000","last_became_peered":"2024-09-18T01:45:06.283912+0000","last_unstale":"2024-09-18T01:48:52.038813+0000","last_undegraded":"2024-09-18T01:48:52.038813+0000","last_fullsized":"2024-09-18T01:48:52.038813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-18T01:48:52.038726+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-18T01:48:52.038726+0000","last_clean_scrub_stamp":"2024-09-18T01:48:52.038726+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:42:35.286481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:20.957556+0000","last_change":"2024-09-18T01:49:20.957600+0000","last_active":"2024-09-18T01:49:20.957556+0000","last_peered":"2024-09-18T01:49:20.957556+0000","last_clean":"2024-09-18T01:49:20.957556+0000","last_became_active":"2024-09-18T01:45:04.285647+0000","last_became_peered":"2024-09-18T01:45:04.285647+0000","last_unstale":"2024-09-18T01:49:20.957556+0000","last_undegraded":"2024-09-18T01:49:20.957556+0000","last_fullsized":"2024-09-18T01:49:20.957556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:49:20.957430+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:49:20.957430+0000","last_clean_scrub_stamp":"2024-09-18T01:49:20.957430+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:31:53.699536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:22.003691+0000","last_change":"2024-09-18T01:49:22.003715+0000","last_active":"2024-09-18T01:49:22.003691+0000","last_peered":"2024-09-18T01:49:22.003691+0000","last_clean":"2024-09-18T01:49:22.003691+0000","last_became_active":"2024-09-18T01:45:41.339936+0000","last_became_peered":"2024-09-18T01:45:41.339936+0000","last_unstale":"2024-09-18T01:49:22.003691+0000","last_undegraded":"2024-09-18T01:49:22.003691+0000","last_fullsized":"2024-09-18T01:49:22.003691+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:22.003607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:22.003607+0000","last_clean_scrub_stamp":"2024-09-18T01:49:22.003607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:47:52.845993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'46","reported_seq":108,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:37.085340+0000","last_change":"2024-09-18T01:48:37.085399+0000","last_active":"2024-09-18T01:48:37.085340+0000","last_peered":"2024-09-18T01:48:37.085340+0000","last_clean":"2024-09-18T01:48:37.085340+0000","last_became_active":"2024-09-18T01:45:10.307670+0000","last_became_peered":"2024-09-18T01:45:10.307670+0000","last_unstale":"2024-09-18T01:48:37.085340+0000","last_undegraded":"2024-09-18T01:48:37.085340+0000","last_fullsized":"2024-09-18T01:48:37.085340+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'46","last_scrub_stamp":"2024-09-18T01:48:37.085236+0000","last_deep_scrub":"33'46","last_deep_scrub_stamp":"2024-09-18T01:48:37.085236+0000","last_clean_scrub_stamp":"2024-09-18T01:48:37.085236+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:57:59.334548+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:51.057246+0000","last_change":"2024-09-18T01:48:51.057271+0000","last_active":"2024-09-18T01:48:51.057246+0000","last_peered":"2024-09-18T01:48:51.057246+0000","last_clean":"2024-09-18T01:48:51.057246+0000","last_became_active":"2024-09-18T01:45:12.316192+0000","last_became_peered":"2024-09-18T01:45:12.316192+0000","last_unstale":"2024-09-18T01:48:51.057246+0000","last_undegraded":"2024-09-18T01:48:51.057246+0000","last_fullsized":"2024-09-18T01:48:51.057246+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:51.057141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:51.057141+0000","last_clean_scrub_stamp":"2024-09-18T01:48:51.057141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:10:20.432939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"33'5","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:20.339718+0000","last_change":"2024-09-18T01:49:20.339745+0000","last_active":"2024-09-18T01:49:20.339718+0000","last_peered":"2024-09-18T01:49:20.339718+0000","last_clean":"2024-09-18T01:49:20.339718+0000","last_became_active":"2024-09-18T01:45:14.311776+0000","last_became_peered":"2024-09-18T01:45:14.311776+0000","last_unstale":"2024-09-18T01:49:20.339718+0000","last_undegraded":"2024-09-18T01:49:20.339718+0000","last_fullsized":"2024-09-18T01:49:20.339718+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-18T01:49:20.339616+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-18T01:49:20.339616+0000","last_clean_scrub_stamp":"2024-09-18T01:49:20.339616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:11:44.447957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'8","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:57.040683+0000","last_change":"2024-09-18T01:48:57.040711+0000","last_active":"2024-09-18T01:48:57.040683+0000","last_peered":"2024-09-18T01:48:57.040683+0000","last_clean":"2024-09-18T01:48:57.040683+0000","last_became_active":"2024-09-18T01:45:06.291811+0000","last_became_peered":"2024-09-18T01:45:06.291811+0000","last_unstale":"2024-09-18T01:48:57.040683+0000","last_undegraded":"2024-09-18T01:48:57.040683+0000","last_fullsized":"2024-09-18T01:48:57.040683+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-18T01:48:57.040600+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-18T01:48:57.040600+0000","last_clean_scrub_stamp":"2024-09-18T01:48:57.040600+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:54:42.318745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:09.024995+0000","last_change":"2024-09-18T01:49:09.025049+0000","last_active":"2024-09-18T01:49:09.024995+0000","last_peered":"2024-09-18T01:49:09.024995+0000","last_clean":"2024-09-18T01:49:09.024995+0000","last_became_active":"2024-09-18T01:45:04.289655+0000","last_became_peered":"2024-09-18T01:45:04.289655+0000","last_unstale":"2024-09-18T01:49:09.024995+0000","last_undegraded":"2024-09-18T01:49:09.024995+0000","last_fullsized":"2024-09-18T01:49:09.024995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:09.024890+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:09.024890+0000","last_clean_scrub_stamp":"2024-09-18T01:49:09.024890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:40:07.315143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:32.218085+0000","last_change":"2024-09-18T01:45:41.342483+0000","last_active":"2024-09-18T01:47:32.218085+0000","last_peered":"2024-09-18T01:47:32.218085+0000","last_clean":"2024-09-18T01:47:32.218085+0000","last_became_active":"2024-09-18T01:45:41.342149+0000","last_became_peered":"2024-09-18T01:45:41.342149+0000","last_unstale":"2024-09-18T01:47:32.218085+0000","last_undegraded":"2024-09-18T01:47:32.218085+0000","last_fullsized":"2024-09-18T01:47:32.218085+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:07.267106+0000","last_clean_scrub_stamp":"2024-09-18T01:45:07.267106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'8","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:36.330207+0000","last_change":"2024-09-18T01:48:36.330239+0000","last_active":"2024-09-18T01:48:36.330207+0000","last_peered":"2024-09-18T01:48:36.330207+0000","last_clean":"2024-09-18T01:48:36.330207+0000","last_became_active":"2024-09-18T01:45:10.296387+0000","last_became_peered":"2024-09-18T01:45:10.296387+0000","last_unstale":"2024-09-18T01:48:36.330207+0000","last_undegraded":"2024-09-18T01:48:36.330207+0000","last_fullsized":"2024-09-18T01:48:36.330207+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-18T01:48:36.330117+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-18T01:48:36.330117+0000","last_clean_scrub_stamp":"2024-09-18T01:48:36.330117+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:18:02.338887+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:35.876388+0000","last_change":"2024-09-18T01:48:35.876410+0000","last_active":"2024-09-18T01:48:35.876388+0000","last_peered":"2024-09-18T01:48:35.876388+0000","last_clean":"2024-09-18T01:48:35.876388+0000","last_became_active":"2024-09-18T01:45:12.313159+0000","last_became_peered":"2024-09-18T01:45:12.313159+0000","last_unstale":"2024-09-18T01:48:35.876388+0000","last_undegraded":"2024-09-18T01:48:35.876388+0000","last_fullsized":"2024-09-18T01:48:35.876388+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:35.876295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:35.876295+0000","last_clean_scrub_stamp":"2024-09-18T01:48:35.876295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:09:42.402630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:21.322150+0000","last_change":"2024-09-18T01:49:21.322173+0000","last_active":"2024-09-18T01:49:21.322150+0000","last_peered":"2024-09-18T01:49:21.322150+0000","last_clean":"2024-09-18T01:49:21.322150+0000","last_became_active":"2024-09-18T01:45:14.319073+0000","last_became_peered":"2024-09-18T01:45:14.319073+0000","last_unstale":"2024-09-18T01:49:21.322150+0000","last_undegraded":"2024-09-18T01:49:21.322150+0000","last_fullsized":"2024-09-18T01:49:21.322150+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:21.322041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:21.322041+0000","last_clean_scrub_stamp":"2024-09-18T01:49:21.322041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:33:48.938800+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'6","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:55.348662+0000","last_change":"2024-09-18T01:48:55.348701+0000","last_active":"2024-09-18T01:48:55.348662+0000","last_peered":"2024-09-18T01:48:55.348662+0000","last_clean":"2024-09-18T01:48:55.348662+0000","last_became_active":"2024-09-18T01:45:06.276408+0000","last_became_peered":"2024-09-18T01:45:06.276408+0000","last_unstale":"2024-09-18T01:48:55.348662+0000","last_undegraded":"2024-09-18T01:48:55.348662+0000","last_fullsized":"2024-09-18T01:48:55.348662+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-18T01:48:55.348539+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-18T01:48:55.348539+0000","last_clean_scrub_stamp":"2024-09-18T01:48:55.348539+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:08:52.491981+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"33'6","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:06.040015+0000","last_change":"2024-09-18T01:49:06.040054+0000","last_active":"2024-09-18T01:49:06.040015+0000","last_peered":"2024-09-18T01:49:06.040015+0000","last_clean":"2024-09-18T01:49:06.040015+0000","last_became_active":"2024-09-18T01:45:04.286887+0000","last_became_peered":"2024-09-18T01:45:04.286887+0000","last_unstale":"2024-09-18T01:49:06.040015+0000","last_undegraded":"2024-09-18T01:49:06.040015+0000","last_fullsized":"2024-09-18T01:49:06.040015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-18T01:49:06.039927+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-18T01:49:06.039927+0000","last_clean_scrub_stamp":"2024-09-18T01:49:06.039927+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:49:30.561380+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:37.881629+0000","last_change":"2024-09-18T01:48:37.881673+0000","last_active":"2024-09-18T01:48:37.881629+0000","last_peered":"2024-09-18T01:48:37.881629+0000","last_clean":"2024-09-18T01:48:37.881629+0000","last_became_active":"2024-09-18T01:45:08.291575+0000","last_became_peered":"2024-09-18T01:45:08.291575+0000","last_unstale":"2024-09-18T01:48:37.881629+0000","last_undegraded":"2024-09-18T01:48:37.881629+0000","last_fullsized":"2024-09-18T01:48:37.881629+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:37.881519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:37.881519+0000","last_clean_scrub_stamp":"2024-09-18T01:48:37.881519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:48:21.895224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'47","reported_seq":119,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:34.322285+0000","last_change":"2024-09-18T01:48:34.322343+0000","last_active":"2024-09-18T01:48:34.322285+0000","last_peered":"2024-09-18T01:48:34.322285+0000","last_clean":"2024-09-18T01:48:34.322285+0000","last_became_active":"2024-09-18T01:45:10.297904+0000","last_became_peered":"2024-09-18T01:45:10.297904+0000","last_unstale":"2024-09-18T01:48:34.322285+0000","last_undegraded":"2024-09-18T01:48:34.322285+0000","last_fullsized":"2024-09-18T01:48:34.322285+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'47","last_scrub_stamp":"2024-09-18T01:48:34.322182+0000","last_deep_scrub":"33'47","last_deep_scrub_stamp":"2024-09-18T01:48:34.322182+0000","last_clean_scrub_stamp":"2024-09-18T01:48:34.322182+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:23:05.910626+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:23.035826+0000","last_change":"2024-09-18T01:48:23.035896+0000","last_active":"2024-09-18T01:48:23.035826+0000","last_peered":"2024-09-18T01:48:23.035826+0000","last_clean":"2024-09-18T01:48:23.035826+0000","last_became_active":"2024-09-18T01:45:12.313186+0000","last_became_peered":"2024-09-18T01:45:12.313186+0000","last_unstale":"2024-09-18T01:48:23.035826+0000","last_undegraded":"2024-09-18T01:48:23.035826+0000","last_fullsized":"2024-09-18T01:48:23.035826+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:23.035704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:23.035704+0000","last_clean_scrub_stamp":"2024-09-18T01:48:23.035704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:54:29.422521+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:47.220828+0000","last_change":"2024-09-18T01:45:14.326931+0000","last_active":"2024-09-18T01:47:47.220828+0000","last_peered":"2024-09-18T01:47:47.220828+0000","last_clean":"2024-09-18T01:47:47.220828+0000","last_became_active":"2024-09-18T01:45:14.326668+0000","last_became_peered":"2024-09-18T01:45:14.326668+0000","last_unstale":"2024-09-18T01:47:47.220828+0000","last_undegraded":"2024-09-18T01:47:47.220828+0000","last_fullsized":"2024-09-18T01:47:47.220828+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'18","reported_seq":104,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:40.058439+0000","last_change":"2024-09-18T01:48:40.058472+0000","last_active":"2024-09-18T01:48:40.058439+0000","last_peered":"2024-09-18T01:48:40.058439+0000","last_clean":"2024-09-18T01:48:40.058439+0000","last_became_active":"2024-09-18T01:45:06.297220+0000","last_became_peered":"2024-09-18T01:45:06.297220+0000","last_unstale":"2024-09-18T01:48:40.058439+0000","last_undegraded":"2024-09-18T01:48:40.058439+0000","last_fullsized":"2024-09-18T01:48:40.058439+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'18","last_scrub_stamp":"2024-09-18T01:48:40.058351+0000","last_deep_scrub":"33'18","last_deep_scrub_stamp":"2024-09-18T01:48:40.058351+0000","last_clean_scrub_stamp":"2024-09-18T01:48:40.058351+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:54:41.006349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":76,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:11.054309+0000","last_change":"2024-09-18T01:49:11.054340+0000","last_active":"2024-09-18T01:49:11.054309+0000","last_peered":"2024-09-18T01:49:11.054309+0000","last_clean":"2024-09-18T01:49:11.054309+0000","last_became_active":"2024-09-18T01:45:04.283276+0000","last_became_peered":"2024-09-18T01:45:04.283276+0000","last_unstale":"2024-09-18T01:49:11.054309+0000","last_undegraded":"2024-09-18T01:49:11.054309+0000","last_fullsized":"2024-09-18T01:49:11.054309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:11.054211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:11.054211+0000","last_clean_scrub_stamp":"2024-09-18T01:49:11.054211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:11:14.562630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:34.100552+0000","last_change":"2024-09-18T01:48:34.100576+0000","last_active":"2024-09-18T01:48:34.100552+0000","last_peered":"2024-09-18T01:48:34.100552+0000","last_clean":"2024-09-18T01:48:34.100552+0000","last_became_active":"2024-09-18T01:45:08.290911+0000","last_became_peered":"2024-09-18T01:45:08.290911+0000","last_unstale":"2024-09-18T01:48:34.100552+0000","last_undegraded":"2024-09-18T01:48:34.100552+0000","last_fullsized":"2024-09-18T01:48:34.100552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:34.100451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:34.100451+0000","last_clean_scrub_stamp":"2024-09-18T01:48:34.100451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:18:59.693645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'36","reported_seq":91,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:30.819537+0000","last_change":"2024-09-18T01:48:30.819572+0000","last_active":"2024-09-18T01:48:30.819537+0000","last_peered":"2024-09-18T01:48:30.819537+0000","last_clean":"2024-09-18T01:48:30.819537+0000","last_became_active":"2024-09-18T01:45:10.301622+0000","last_became_peered":"2024-09-18T01:45:10.301622+0000","last_unstale":"2024-09-18T01:48:30.819537+0000","last_undegraded":"2024-09-18T01:48:30.819537+0000","last_fullsized":"2024-09-18T01:48:30.819537+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'36","last_scrub_stamp":"2024-09-18T01:48:30.819448+0000","last_deep_scrub":"33'36","last_deep_scrub_stamp":"2024-09-18T01:48:30.819448+0000","last_clean_scrub_stamp":"2024-09-18T01:48:30.819448+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:02:48.244921+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:31.837156+0000","last_change":"2024-09-18T01:48:31.837196+0000","last_active":"2024-09-18T01:48:31.837156+0000","last_peered":"2024-09-18T01:48:31.837156+0000","last_clean":"2024-09-18T01:48:31.837156+0000","last_became_active":"2024-09-18T01:45:12.313096+0000","last_became_peered":"2024-09-18T01:45:12.313096+0000","last_unstale":"2024-09-18T01:48:31.837156+0000","last_undegraded":"2024-09-18T01:48:31.837156+0000","last_fullsized":"2024-09-18T01:48:31.837156+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:31.837028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:31.837028+0000","last_clean_scrub_stamp":"2024-09-18T01:48:31.837028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:55:19.988045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"33'12","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:05.899263+0000","last_change":"2024-09-18T01:49:05.899263+0000","last_active":"2024-09-18T01:49:05.899263+0000","last_peered":"2024-09-18T01:49:05.899263+0000","last_clean":"2024-09-18T01:49:05.899263+0000","last_became_active":"2024-09-18T01:45:06.282461+0000","last_became_peered":"2024-09-18T01:45:06.282461+0000","last_unstale":"2024-09-18T01:49:05.899263+0000","last_undegraded":"2024-09-18T01:49:05.899263+0000","last_fullsized":"2024-09-18T01:49:05.899263+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-18T01:49:05.899152+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-18T01:49:05.899152+0000","last_clean_scrub_stamp":"2024-09-18T01:49:05.899152+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:45:46.971541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"33'8","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:31.037684+0000","last_change":"2024-09-18T01:49:31.037714+0000","last_active":"2024-09-18T01:49:31.037684+0000","last_peered":"2024-09-18T01:49:31.037684+0000","last_clean":"2024-09-18T01:49:31.037684+0000","last_became_active":"2024-09-18T01:45:04.288082+0000","last_became_peered":"2024-09-18T01:45:04.288082+0000","last_unstale":"2024-09-18T01:49:31.037684+0000","last_undegraded":"2024-09-18T01:49:31.037684+0000","last_fullsized":"2024-09-18T01:49:31.037684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-18T01:49:31.037590+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-18T01:49:31.037590+0000","last_clean_scrub_stamp":"2024-09-18T01:49:31.037590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:05:09.181100+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":48,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:39.315849+0000","last_change":"2024-09-18T01:48:39.315849+0000","last_active":"2024-09-18T01:48:39.315849+0000","last_peered":"2024-09-18T01:48:39.315849+0000","last_clean":"2024-09-18T01:48:39.315849+0000","last_became_active":"2024-09-18T01:45:08.292739+0000","last_became_peered":"2024-09-18T01:45:08.292739+0000","last_unstale":"2024-09-18T01:48:39.315849+0000","last_undegraded":"2024-09-18T01:48:39.315849+0000","last_fullsized":"2024-09-18T01:48:39.315849+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:39.315733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:39.315733+0000","last_clean_scrub_stamp":"2024-09-18T01:48:39.315733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:28:18.241750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'70","reported_seq":149,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:35.355474+0000","last_change":"2024-09-18T01:48:35.355511+0000","last_active":"2024-09-18T01:48:35.355474+0000","last_peered":"2024-09-18T01:48:35.355474+0000","last_clean":"2024-09-18T01:48:35.355474+0000","last_became_active":"2024-09-18T01:45:10.296396+0000","last_became_peered":"2024-09-18T01:45:10.296396+0000","last_unstale":"2024-09-18T01:48:35.355474+0000","last_undegraded":"2024-09-18T01:48:35.355474+0000","last_fullsized":"2024-09-18T01:48:35.355474+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'70","last_scrub_stamp":"2024-09-18T01:48:35.355370+0000","last_deep_scrub":"33'70","last_deep_scrub_stamp":"2024-09-18T01:48:35.355370+0000","last_clean_scrub_stamp":"2024-09-18T01:48:35.355370+0000","objects_scrubbed":6,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:18:17.350454+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:23.816836+0000","last_change":"2024-09-18T01:48:23.816862+0000","last_active":"2024-09-18T01:48:23.816836+0000","last_peered":"2024-09-18T01:48:23.816836+0000","last_clean":"2024-09-18T01:48:23.816836+0000","last_became_active":"2024-09-18T01:45:12.307279+0000","last_became_peered":"2024-09-18T01:45:12.307279+0000","last_unstale":"2024-09-18T01:48:23.816836+0000","last_undegraded":"2024-09-18T01:48:23.816836+0000","last_fullsized":"2024-09-18T01:48:23.816836+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:23.816708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:23.816708+0000","last_clean_scrub_stamp":"2024-09-18T01:48:23.816708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:52:57.423754+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'22","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:24.317905+0000","last_change":"2024-09-18T01:49:24.317930+0000","last_active":"2024-09-18T01:49:24.317905+0000","last_peered":"2024-09-18T01:49:24.317905+0000","last_clean":"2024-09-18T01:49:24.317905+0000","last_became_active":"2024-09-18T01:45:14.319540+0000","last_became_peered":"2024-09-18T01:45:14.319540+0000","last_unstale":"2024-09-18T01:49:24.317905+0000","last_undegraded":"2024-09-18T01:49:24.317905+0000","last_fullsized":"2024-09-18T01:49:24.317905+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2024-09-18T01:49:24.317811+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2024-09-18T01:49:24.317811+0000","last_clean_scrub_stamp":"2024-09-18T01:49:24.317811+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:26:25.501102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":65,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'18","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:52.432402+0000","last_change":"2024-09-18T01:48:52.432402+0000","last_active":"2024-09-18T01:48:52.432402+0000","last_peered":"2024-09-18T01:48:52.432402+0000","last_clean":"2024-09-18T01:48:52.432402+0000","last_became_active":"2024-09-18T01:45:06.293053+0000","last_became_peered":"2024-09-18T01:45:06.293053+0000","last_unstale":"2024-09-18T01:48:52.432402+0000","last_undegraded":"2024-09-18T01:48:52.432402+0000","last_fullsized":"2024-09-18T01:48:52.432402+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'18","last_scrub_stamp":"2024-09-18T01:48:52.432288+0000","last_deep_scrub":"33'18","last_deep_scrub_stamp":"2024-09-18T01:48:52.432288+0000","last_clean_scrub_stamp":"2024-09-18T01:48:52.432288+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:28:25.986612+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":45,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:14.095878+0000","last_change":"2024-09-18T01:49:14.095903+0000","last_active":"2024-09-18T01:49:14.095878+0000","last_peered":"2024-09-18T01:49:14.095878+0000","last_clean":"2024-09-18T01:49:14.095878+0000","last_became_active":"2024-09-18T01:45:04.292082+0000","last_became_peered":"2024-09-18T01:45:04.292082+0000","last_unstale":"2024-09-18T01:49:14.095878+0000","last_undegraded":"2024-09-18T01:49:14.095878+0000","last_fullsized":"2024-09-18T01:49:14.095878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:14.095775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:14.095775+0000","last_clean_scrub_stamp":"2024-09-18T01:49:14.095775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:30:01.793692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:38.882296+0000","last_change":"2024-09-18T01:48:38.882296+0000","last_active":"2024-09-18T01:48:38.882296+0000","last_peered":"2024-09-18T01:48:38.882296+0000","last_clean":"2024-09-18T01:48:38.882296+0000","last_became_active":"2024-09-18T01:45:08.286609+0000","last_became_peered":"2024-09-18T01:45:08.286609+0000","last_unstale":"2024-09-18T01:48:38.882296+0000","last_undegraded":"2024-09-18T01:48:38.882296+0000","last_fullsized":"2024-09-18T01:48:38.882296+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:38.882174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:38.882174+0000","last_clean_scrub_stamp":"2024-09-18T01:48:38.882174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:30:42.400285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'46","reported_seq":104,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:50.033208+0000","last_change":"2024-09-18T01:48:50.033254+0000","last_active":"2024-09-18T01:48:50.033208+0000","last_peered":"2024-09-18T01:48:50.033208+0000","last_clean":"2024-09-18T01:48:50.033208+0000","last_became_active":"2024-09-18T01:45:10.309360+0000","last_became_peered":"2024-09-18T01:45:10.309360+0000","last_unstale":"2024-09-18T01:48:50.033208+0000","last_undegraded":"2024-09-18T01:48:50.033208+0000","last_fullsized":"2024-09-18T01:48:50.033208+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'46","last_scrub_stamp":"2024-09-18T01:48:50.033115+0000","last_deep_scrub":"33'46","last_deep_scrub_stamp":"2024-09-18T01:48:50.033115+0000","last_clean_scrub_stamp":"2024-09-18T01:48:50.033115+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:38:37.562652+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:30.911520+0000","last_change":"2024-09-18T01:48:30.911546+0000","last_active":"2024-09-18T01:48:30.911520+0000","last_peered":"2024-09-18T01:48:30.911520+0000","last_clean":"2024-09-18T01:48:30.911520+0000","last_became_active":"2024-09-18T01:45:12.314499+0000","last_became_peered":"2024-09-18T01:45:12.314499+0000","last_unstale":"2024-09-18T01:48:30.911520+0000","last_undegraded":"2024-09-18T01:48:30.911520+0000","last_fullsized":"2024-09-18T01:48:30.911520+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:30.911422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:30.911422+0000","last_clean_scrub_stamp":"2024-09-18T01:48:30.911422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:07:15.930276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"33'2","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:37.219002+0000","last_change":"2024-09-18T01:45:14.326163+0000","last_active":"2024-09-18T01:47:37.219002+0000","last_peered":"2024-09-18T01:47:37.219002+0000","last_clean":"2024-09-18T01:47:37.219002+0000","last_became_active":"2024-09-18T01:45:14.325421+0000","last_became_peered":"2024-09-18T01:45:14.325421+0000","last_unstale":"2024-09-18T01:47:37.219002+0000","last_undegraded":"2024-09-18T01:47:37.219002+0000","last_fullsized":"2024-09-18T01:47:37.219002+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'8","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:56.955755+0000","last_change":"2024-09-18T01:48:56.955784+0000","last_active":"2024-09-18T01:48:56.955755+0000","last_peered":"2024-09-18T01:48:56.955755+0000","last_clean":"2024-09-18T01:48:56.955755+0000","last_became_active":"2024-09-18T01:45:06.286153+0000","last_became_peered":"2024-09-18T01:45:06.286153+0000","last_unstale":"2024-09-18T01:48:56.955755+0000","last_undegraded":"2024-09-18T01:48:56.955755+0000","last_fullsized":"2024-09-18T01:48:56.955755+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-18T01:48:56.955654+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-18T01:48:56.955654+0000","last_clean_scrub_stamp":"2024-09-18T01:48:56.955654+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:13:59.028876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:06.115374+0000","last_change":"2024-09-18T01:49:06.115400+0000","last_active":"2024-09-18T01:49:06.115374+0000","last_peered":"2024-09-18T01:49:06.115374+0000","last_clean":"2024-09-18T01:49:06.115374+0000","last_became_active":"2024-09-18T01:45:04.294537+0000","last_became_peered":"2024-09-18T01:45:04.294537+0000","last_unstale":"2024-09-18T01:49:06.115374+0000","last_undegraded":"2024-09-18T01:49:06.115374+0000","last_fullsized":"2024-09-18T01:49:06.115374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-18T01:49:06.115277+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-18T01:49:06.115277+0000","last_clean_scrub_stamp":"2024-09-18T01:49:06.115277+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:58:15.029419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:40.973877+0000","last_change":"2024-09-18T01:48:40.973902+0000","last_active":"2024-09-18T01:48:40.973877+0000","last_peered":"2024-09-18T01:48:40.973877+0000","last_clean":"2024-09-18T01:48:40.973877+0000","last_became_active":"2024-09-18T01:45:08.286466+0000","last_became_peered":"2024-09-18T01:45:08.286466+0000","last_unstale":"2024-09-18T01:48:40.973877+0000","last_undegraded":"2024-09-18T01:48:40.973877+0000","last_fullsized":"2024-09-18T01:48:40.973877+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:40.973787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:40.973787+0000","last_clean_scrub_stamp":"2024-09-18T01:48:40.973787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:56:31.069811+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'48","reported_seq":111,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:32.347342+0000","last_change":"2024-09-18T01:48:32.347342+0000","last_active":"2024-09-18T01:48:32.347342+0000","last_peered":"2024-09-18T01:48:32.347342+0000","last_clean":"2024-09-18T01:48:32.347342+0000","last_became_active":"2024-09-18T01:45:10.303911+0000","last_became_peered":"2024-09-18T01:45:10.303911+0000","last_unstale":"2024-09-18T01:48:32.347342+0000","last_undegraded":"2024-09-18T01:48:32.347342+0000","last_fullsized":"2024-09-18T01:48:32.347342+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'48","last_scrub_stamp":"2024-09-18T01:48:32.347225+0000","last_deep_scrub":"33'48","last_deep_scrub_stamp":"2024-09-18T01:48:32.347225+0000","last_clean_scrub_stamp":"2024-09-18T01:48:32.347225+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:04:17.415601+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:37.329031+0000","last_change":"2024-09-18T01:48:37.329031+0000","last_active":"2024-09-18T01:48:37.329031+0000","last_peered":"2024-09-18T01:48:37.329031+0000","last_clean":"2024-09-18T01:48:37.329031+0000","last_became_active":"2024-09-18T01:45:12.313180+0000","last_became_peered":"2024-09-18T01:45:12.313180+0000","last_unstale":"2024-09-18T01:48:37.329031+0000","last_undegraded":"2024-09-18T01:48:37.329031+0000","last_fullsized":"2024-09-18T01:48:37.329031+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:37.328895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:37.328895+0000","last_clean_scrub_stamp":"2024-09-18T01:48:37.328895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:52:12.877855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"33'3","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:47:37.218959+0000","last_change":"2024-09-18T01:45:14.326771+0000","last_active":"2024-09-18T01:47:37.218959+0000","last_peered":"2024-09-18T01:47:37.218959+0000","last_clean":"2024-09-18T01:47:37.218959+0000","last_became_active":"2024-09-18T01:45:14.326452+0000","last_became_peered":"2024-09-18T01:45:14.326452+0000","last_unstale":"2024-09-18T01:47:37.218959+0000","last_undegraded":"2024-09-18T01:47:37.218959+0000","last_fullsized":"2024-09-18T01:47:37.218959+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:01.377573+0000","last_change":"2024-09-18T01:49:01.377628+0000","last_active":"2024-09-18T01:49:01.377573+0000","last_peered":"2024-09-18T01:49:01.377573+0000","last_clean":"2024-09-18T01:49:01.377573+0000","last_became_active":"2024-09-18T01:45:06.281987+0000","last_became_peered":"2024-09-18T01:45:06.281987+0000","last_unstale":"2024-09-18T01:49:01.377573+0000","last_undegraded":"2024-09-18T01:49:01.377573+0000","last_fullsized":"2024-09-18T01:49:01.377573+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:01.377468+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:01.377468+0000","last_clean_scrub_stamp":"2024-09-18T01:49:01.377468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:37:31.352529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:26.974759+0000","last_change":"2024-09-18T01:49:26.974785+0000","last_active":"2024-09-18T01:49:26.974759+0000","last_peered":"2024-09-18T01:49:26.974759+0000","last_clean":"2024-09-18T01:49:26.974759+0000","last_became_active":"2024-09-18T01:45:04.289909+0000","last_became_peered":"2024-09-18T01:45:04.289909+0000","last_unstale":"2024-09-18T01:49:26.974759+0000","last_undegraded":"2024-09-18T01:49:26.974759+0000","last_fullsized":"2024-09-18T01:49:26.974759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:26.974659+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:26.974659+0000","last_clean_scrub_stamp":"2024-09-18T01:49:26.974659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:52:57.644940+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:22.969948+0000","last_change":"2024-09-18T01:49:22.969972+0000","last_active":"2024-09-18T01:49:22.969948+0000","last_peered":"2024-09-18T01:49:22.969948+0000","last_clean":"2024-09-18T01:49:22.969948+0000","last_became_active":"2024-09-18T01:45:41.342280+0000","last_became_peered":"2024-09-18T01:45:41.342280+0000","last_unstale":"2024-09-18T01:49:22.969948+0000","last_undegraded":"2024-09-18T01:49:22.969948+0000","last_fullsized":"2024-09-18T01:49:22.969948+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:22.969861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:22.969861+0000","last_clean_scrub_stamp":"2024-09-18T01:49:22.969861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:49:18.155799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'22","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:53.997424+0000","last_change":"2024-09-18T01:48:53.997424+0000","last_active":"2024-09-18T01:48:53.997424+0000","last_peered":"2024-09-18T01:48:53.997424+0000","last_clean":"2024-09-18T01:48:53.997424+0000","last_became_active":"2024-09-18T01:45:10.308524+0000","last_became_peered":"2024-09-18T01:45:10.308524+0000","last_unstale":"2024-09-18T01:48:53.997424+0000","last_undegraded":"2024-09-18T01:48:53.997424+0000","last_fullsized":"2024-09-18T01:48:53.997424+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2024-09-18T01:48:53.997246+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2024-09-18T01:48:53.997246+0000","last_clean_scrub_stamp":"2024-09-18T01:48:53.997246+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:03:08.771218+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'285","reported_seq":429,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:24.768020+0000","last_change":"2024-09-18T01:48:24.768020+0000","last_active":"2024-09-18T01:48:24.768020+0000","last_peered":"2024-09-18T01:48:24.768020+0000","last_clean":"2024-09-18T01:48:24.768020+0000","last_became_active":"2024-09-18T01:45:12.307186+0000","last_became_peered":"2024-09-18T01:45:12.307186+0000","last_unstale":"2024-09-18T01:48:24.768020+0000","last_undegraded":"2024-09-18T01:48:24.768020+0000","last_fullsized":"2024-09-18T01:48:24.768020+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-18T01:48:24.767877+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-18T01:48:24.767877+0000","last_clean_scrub_stamp":"2024-09-18T01:48:24.767877+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:40:56.957174+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"33'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:12.988462+0000","last_change":"2024-09-18T01:45:14.326301+0000","last_active":"2024-09-18T01:48:12.988462+0000","last_peered":"2024-09-18T01:48:12.988462+0000","last_clean":"2024-09-18T01:48:12.988462+0000","last_became_active":"2024-09-18T01:45:14.326018+0000","last_became_peered":"2024-09-18T01:45:14.326018+0000","last_unstale":"2024-09-18T01:48:12.988462+0000","last_undegraded":"2024-09-18T01:48:12.988462+0000","last_fullsized":"2024-09-18T01:48:12.988462+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:45:13.296584+0000","last_clean_scrub_stamp":"2024-09-18T01:45:13.296584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"33'8","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:46.046853+0000","last_change":"2024-09-18T01:48:46.046882+0000","last_active":"2024-09-18T01:48:46.046853+0000","last_peered":"2024-09-18T01:48:46.046853+0000","last_clean":"2024-09-18T01:48:46.046853+0000","last_became_active":"2024-09-18T01:45:06.281798+0000","last_became_peered":"2024-09-18T01:45:06.281798+0000","last_unstale":"2024-09-18T01:48:46.046853+0000","last_undegraded":"2024-09-18T01:48:46.046853+0000","last_fullsized":"2024-09-18T01:48:46.046853+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-18T01:48:46.046757+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-18T01:48:46.046757+0000","last_clean_scrub_stamp":"2024-09-18T01:48:46.046757+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:18:18.174824+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:15.076405+0000","last_change":"2024-09-18T01:49:15.076439+0000","last_active":"2024-09-18T01:49:15.076405+0000","last_peered":"2024-09-18T01:49:15.076405+0000","last_clean":"2024-09-18T01:49:15.076405+0000","last_became_active":"2024-09-18T01:45:04.293009+0000","last_became_peered":"2024-09-18T01:45:04.293009+0000","last_unstale":"2024-09-18T01:49:15.076405+0000","last_undegraded":"2024-09-18T01:49:15.076405+0000","last_fullsized":"2024-09-18T01:49:15.076405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:15.076307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:15.076307+0000","last_clean_scrub_stamp":"2024-09-18T01:49:15.076307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:38:22.618396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:40.879858+0000","last_change":"2024-09-18T01:48:40.879897+0000","last_active":"2024-09-18T01:48:40.879858+0000","last_peered":"2024-09-18T01:48:40.879858+0000","last_clean":"2024-09-18T01:48:40.879858+0000","last_became_active":"2024-09-18T01:45:08.287884+0000","last_became_peered":"2024-09-18T01:45:08.287884+0000","last_unstale":"2024-09-18T01:48:40.879858+0000","last_undegraded":"2024-09-18T01:48:40.879858+0000","last_fullsized":"2024-09-18T01:48:40.879858+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:40.879744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:40.879744+0000","last_clean_scrub_stamp":"2024-09-18T01:48:40.879744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:23:57.801261+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'74","reported_seq":156,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:29.900192+0000","last_change":"2024-09-18T01:48:29.900260+0000","last_active":"2024-09-18T01:48:29.900192+0000","last_peered":"2024-09-18T01:48:29.900192+0000","last_clean":"2024-09-18T01:48:29.900192+0000","last_became_active":"2024-09-18T01:45:10.301087+0000","last_became_peered":"2024-09-18T01:45:10.301087+0000","last_unstale":"2024-09-18T01:48:29.900192+0000","last_undegraded":"2024-09-18T01:48:29.900192+0000","last_fullsized":"2024-09-18T01:48:29.900192+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'74","last_scrub_stamp":"2024-09-18T01:48:29.900089+0000","last_deep_scrub":"33'74","last_deep_scrub_stamp":"2024-09-18T01:48:29.900089+0000","last_clean_scrub_stamp":"2024-09-18T01:48:29.900089+0000","objects_scrubbed":11,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:03:12.147484+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:25.260421+0000","last_change":"2024-09-18T01:48:25.260445+0000","last_active":"2024-09-18T01:48:25.260421+0000","last_peered":"2024-09-18T01:48:25.260421+0000","last_clean":"2024-09-18T01:48:25.260421+0000","last_became_active":"2024-09-18T01:45:12.312055+0000","last_became_peered":"2024-09-18T01:45:12.312055+0000","last_unstale":"2024-09-18T01:48:25.260421+0000","last_undegraded":"2024-09-18T01:48:25.260421+0000","last_fullsized":"2024-09-18T01:48:25.260421+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:25.260301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:25.260301+0000","last_clean_scrub_stamp":"2024-09-18T01:48:25.260301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:20:06.632858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"33'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:20.049248+0000","last_change":"2024-09-18T01:49:20.049275+0000","last_active":"2024-09-18T01:49:20.049248+0000","last_peered":"2024-09-18T01:49:20.049248+0000","last_clean":"2024-09-18T01:49:20.049248+0000","last_became_active":"2024-09-18T01:45:14.322945+0000","last_became_peered":"2024-09-18T01:45:14.322945+0000","last_unstale":"2024-09-18T01:49:20.049248+0000","last_undegraded":"2024-09-18T01:49:20.049248+0000","last_fullsized":"2024-09-18T01:49:20.049248+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:20.049159+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:20.049159+0000","last_clean_scrub_stamp":"2024-09-18T01:49:20.049159+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:05:28.272049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'6","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:48.023951+0000","last_change":"2024-09-18T01:48:48.023979+0000","last_active":"2024-09-18T01:48:48.023951+0000","last_peered":"2024-09-18T01:48:48.023951+0000","last_clean":"2024-09-18T01:48:48.023951+0000","last_became_active":"2024-09-18T01:45:06.281480+0000","last_became_peered":"2024-09-18T01:45:06.281480+0000","last_unstale":"2024-09-18T01:48:48.023951+0000","last_undegraded":"2024-09-18T01:48:48.023951+0000","last_fullsized":"2024-09-18T01:48:48.023951+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-18T01:48:48.023825+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-18T01:48:48.023825+0000","last_clean_scrub_stamp":"2024-09-18T01:48:48.023825+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:47:46.236855+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:29.039620+0000","last_change":"2024-09-18T01:49:29.039649+0000","last_active":"2024-09-18T01:49:29.039620+0000","last_peered":"2024-09-18T01:49:29.039620+0000","last_clean":"2024-09-18T01:49:29.039620+0000","last_became_active":"2024-09-18T01:45:04.290901+0000","last_became_peered":"2024-09-18T01:45:04.290901+0000","last_unstale":"2024-09-18T01:49:29.039620+0000","last_undegraded":"2024-09-18T01:49:29.039620+0000","last_fullsized":"2024-09-18T01:49:29.039620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:29.039515+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:29.039515+0000","last_clean_scrub_stamp":"2024-09-18T01:49:29.039515+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:16:22.127013+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:41.995434+0000","last_change":"2024-09-18T01:48:41.995473+0000","last_active":"2024-09-18T01:48:41.995434+0000","last_peered":"2024-09-18T01:48:41.995434+0000","last_clean":"2024-09-18T01:48:41.995434+0000","last_became_active":"2024-09-18T01:45:08.286502+0000","last_became_peered":"2024-09-18T01:45:08.286502+0000","last_unstale":"2024-09-18T01:48:41.995434+0000","last_undegraded":"2024-09-18T01:48:41.995434+0000","last_fullsized":"2024-09-18T01:48:41.995434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:41.995333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:41.995333+0000","last_clean_scrub_stamp":"2024-09-18T01:48:41.995333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:40:51.267310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'43","reported_seq":104,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:30.281139+0000","last_change":"2024-09-18T01:48:30.281182+0000","last_active":"2024-09-18T01:48:30.281139+0000","last_peered":"2024-09-18T01:48:30.281139+0000","last_clean":"2024-09-18T01:48:30.281139+0000","last_became_active":"2024-09-18T01:45:10.306076+0000","last_became_peered":"2024-09-18T01:45:10.306076+0000","last_unstale":"2024-09-18T01:48:30.281139+0000","last_undegraded":"2024-09-18T01:48:30.281139+0000","last_fullsized":"2024-09-18T01:48:30.281139+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-09-18T01:48:30.281049+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-09-18T01:48:30.281049+0000","last_clean_scrub_stamp":"2024-09-18T01:48:30.281049+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:14:03.450919+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:46.991470+0000","last_change":"2024-09-18T01:48:46.991507+0000","last_active":"2024-09-18T01:48:46.991470+0000","last_peered":"2024-09-18T01:48:46.991470+0000","last_clean":"2024-09-18T01:48:46.991470+0000","last_became_active":"2024-09-18T01:45:12.316022+0000","last_became_peered":"2024-09-18T01:45:12.316022+0000","last_unstale":"2024-09-18T01:48:46.991470+0000","last_undegraded":"2024-09-18T01:48:46.991470+0000","last_fullsized":"2024-09-18T01:48:46.991470+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:46.991352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:46.991352+0000","last_clean_scrub_stamp":"2024-09-18T01:48:46.991352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:54:48.148908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:10.901935+0000","last_change":"2024-09-18T01:49:10.901958+0000","last_active":"2024-09-18T01:49:10.901935+0000","last_peered":"2024-09-18T01:49:10.901935+0000","last_clean":"2024-09-18T01:49:10.901935+0000","last_became_active":"2024-09-18T01:45:14.325208+0000","last_became_peered":"2024-09-18T01:45:14.325208+0000","last_unstale":"2024-09-18T01:49:10.901935+0000","last_undegraded":"2024-09-18T01:49:10.901935+0000","last_fullsized":"2024-09-18T01:49:10.901935+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:10.901834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:10.901834+0000","last_clean_scrub_stamp":"2024-09-18T01:49:10.901834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:07:05.409713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'26","reported_seq":103,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:04.884554+0000","last_change":"2024-09-18T01:49:04.884579+0000","last_active":"2024-09-18T01:49:04.884554+0000","last_peered":"2024-09-18T01:49:04.884554+0000","last_clean":"2024-09-18T01:49:04.884554+0000","last_became_active":"2024-09-18T01:45:06.283174+0000","last_became_peered":"2024-09-18T01:45:06.283174+0000","last_unstale":"2024-09-18T01:49:04.884554+0000","last_undegraded":"2024-09-18T01:49:04.884554+0000","last_fullsized":"2024-09-18T01:49:04.884554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'26","last_scrub_stamp":"2024-09-18T01:49:04.884436+0000","last_deep_scrub":"33'26","last_deep_scrub_stamp":"2024-09-18T01:49:04.884436+0000","last_clean_scrub_stamp":"2024-09-18T01:49:04.884436+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:46:17.194645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":84,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:13.343822+0000","last_change":"2024-09-18T01:49:13.343852+0000","last_active":"2024-09-18T01:49:13.343822+0000","last_peered":"2024-09-18T01:49:13.343822+0000","last_clean":"2024-09-18T01:49:13.343822+0000","last_became_active":"2024-09-18T01:45:04.273128+0000","last_became_peered":"2024-09-18T01:45:04.273128+0000","last_unstale":"2024-09-18T01:49:13.343822+0000","last_undegraded":"2024-09-18T01:49:13.343822+0000","last_fullsized":"2024-09-18T01:49:13.343822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:13.343714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:13.343714+0000","last_clean_scrub_stamp":"2024-09-18T01:49:13.343714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:05:43.373224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"33'5","reported_seq":238,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:33.930151+0000","last_change":"2024-09-18T01:48:33.930178+0000","last_active":"2024-09-18T01:48:33.930151+0000","last_peered":"2024-09-18T01:48:33.930151+0000","last_clean":"2024-09-18T01:48:33.930151+0000","last_became_active":"2024-09-18T01:45:08.294338+0000","last_became_peered":"2024-09-18T01:45:08.294338+0000","last_unstale":"2024-09-18T01:48:33.930151+0000","last_undegraded":"2024-09-18T01:48:33.930151+0000","last_fullsized":"2024-09-18T01:48:33.930151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-18T01:48:33.930067+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-18T01:48:33.930067+0000","last_clean_scrub_stamp":"2024-09-18T01:48:33.930067+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:04:18.998443+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'39","reported_seq":98,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:53.009496+0000","last_change":"2024-09-18T01:48:53.009528+0000","last_active":"2024-09-18T01:48:53.009496+0000","last_peered":"2024-09-18T01:48:53.009496+0000","last_clean":"2024-09-18T01:48:53.009496+0000","last_became_active":"2024-09-18T01:45:10.308336+0000","last_became_peered":"2024-09-18T01:45:10.308336+0000","last_unstale":"2024-09-18T01:48:53.009496+0000","last_undegraded":"2024-09-18T01:48:53.009496+0000","last_fullsized":"2024-09-18T01:48:53.009496+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'39","last_scrub_stamp":"2024-09-18T01:48:53.009391+0000","last_deep_scrub":"33'39","last_deep_scrub_stamp":"2024-09-18T01:48:53.009391+0000","last_clean_scrub_stamp":"2024-09-18T01:48:53.009391+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:38:00.551480+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:48.000035+0000","last_change":"2024-09-18T01:48:48.000061+0000","last_active":"2024-09-18T01:48:48.000035+0000","last_peered":"2024-09-18T01:48:48.000035+0000","last_clean":"2024-09-18T01:48:48.000035+0000","last_became_active":"2024-09-18T01:45:12.312794+0000","last_became_peered":"2024-09-18T01:45:12.312794+0000","last_unstale":"2024-09-18T01:48:48.000035+0000","last_undegraded":"2024-09-18T01:48:48.000035+0000","last_fullsized":"2024-09-18T01:48:48.000035+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:47.999948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:47.999948+0000","last_clean_scrub_stamp":"2024-09-18T01:48:47.999948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:23:16.320379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"33'10","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:42.031408+0000","last_change":"2024-09-18T01:49:42.031433+0000","last_active":"2024-09-18T01:49:42.031408+0000","last_peered":"2024-09-18T01:49:42.031408+0000","last_clean":"2024-09-18T01:49:42.031408+0000","last_became_active":"2024-09-18T01:45:14.325464+0000","last_became_peered":"2024-09-18T01:45:14.325464+0000","last_unstale":"2024-09-18T01:49:42.031408+0000","last_undegraded":"2024-09-18T01:49:42.031408+0000","last_fullsized":"2024-09-18T01:49:42.031408+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-18T01:49:42.031309+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-18T01:49:42.031309+0000","last_clean_scrub_stamp":"2024-09-18T01:49:42.031309+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:34:39.876369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'8","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:50.009611+0000","last_change":"2024-09-18T01:48:50.009639+0000","last_active":"2024-09-18T01:48:50.009611+0000","last_peered":"2024-09-18T01:48:50.009611+0000","last_clean":"2024-09-18T01:48:50.009611+0000","last_became_active":"2024-09-18T01:45:06.283071+0000","last_became_peered":"2024-09-18T01:45:06.283071+0000","last_unstale":"2024-09-18T01:48:50.009611+0000","last_undegraded":"2024-09-18T01:48:50.009611+0000","last_fullsized":"2024-09-18T01:48:50.009611+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-18T01:48:50.009508+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-18T01:48:50.009508+0000","last_clean_scrub_stamp":"2024-09-18T01:48:50.009508+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:20:50.711544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:02.173712+0000","last_change":"2024-09-18T01:49:02.173712+0000","last_active":"2024-09-18T01:49:02.173712+0000","last_peered":"2024-09-18T01:49:02.173712+0000","last_clean":"2024-09-18T01:49:02.173712+0000","last_became_active":"2024-09-18T01:45:04.297716+0000","last_became_peered":"2024-09-18T01:45:04.297716+0000","last_unstale":"2024-09-18T01:49:02.173712+0000","last_undegraded":"2024-09-18T01:49:02.173712+0000","last_fullsized":"2024-09-18T01:49:02.173712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:49:02.173559+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:49:02.173559+0000","last_clean_scrub_stamp":"2024-09-18T01:49:02.173559+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:55:03.121556+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'3","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:36.961597+0000","last_change":"2024-09-18T01:48:36.961625+0000","last_active":"2024-09-18T01:48:36.961597+0000","last_peered":"2024-09-18T01:48:36.961597+0000","last_clean":"2024-09-18T01:48:36.961597+0000","last_became_active":"2024-09-18T01:45:08.294160+0000","last_became_peered":"2024-09-18T01:45:08.294160+0000","last_unstale":"2024-09-18T01:48:36.961597+0000","last_undegraded":"2024-09-18T01:48:36.961597+0000","last_fullsized":"2024-09-18T01:48:36.961597+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-18T01:48:36.961514+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-18T01:48:36.961514+0000","last_clean_scrub_stamp":"2024-09-18T01:48:36.961514+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:20:37.663549+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'53","reported_seq":122,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:43.072087+0000","last_change":"2024-09-18T01:48:43.072125+0000","last_active":"2024-09-18T01:48:43.072087+0000","last_peered":"2024-09-18T01:48:43.072087+0000","last_clean":"2024-09-18T01:48:43.072087+0000","last_became_active":"2024-09-18T01:45:10.308302+0000","last_became_peered":"2024-09-18T01:45:10.308302+0000","last_unstale":"2024-09-18T01:48:43.072087+0000","last_undegraded":"2024-09-18T01:48:43.072087+0000","last_fullsized":"2024-09-18T01:48:43.072087+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'53","last_scrub_stamp":"2024-09-18T01:48:43.071994+0000","last_deep_scrub":"33'53","last_deep_scrub_stamp":"2024-09-18T01:48:43.071994+0000","last_clean_scrub_stamp":"2024-09-18T01:48:43.071994+0000","objects_scrubbed":7,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:57:25.764909+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:28.229701+0000","last_change":"2024-09-18T01:48:28.229726+0000","last_active":"2024-09-18T01:48:28.229701+0000","last_peered":"2024-09-18T01:48:28.229701+0000","last_clean":"2024-09-18T01:48:28.229701+0000","last_became_active":"2024-09-18T01:45:12.305742+0000","last_became_peered":"2024-09-18T01:45:12.305742+0000","last_unstale":"2024-09-18T01:48:28.229701+0000","last_undegraded":"2024-09-18T01:48:28.229701+0000","last_fullsized":"2024-09-18T01:48:28.229701+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:28.229607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:28.229607+0000","last_clean_scrub_stamp":"2024-09-18T01:48:28.229607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:03:10.477001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"33'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:14.923041+0000","last_change":"2024-09-18T01:49:14.923068+0000","last_active":"2024-09-18T01:49:14.923041+0000","last_peered":"2024-09-18T01:49:14.923041+0000","last_clean":"2024-09-18T01:49:14.923041+0000","last_became_active":"2024-09-18T01:45:14.325368+0000","last_became_peered":"2024-09-18T01:45:14.325368+0000","last_unstale":"2024-09-18T01:49:14.923041+0000","last_undegraded":"2024-09-18T01:49:14.923041+0000","last_fullsized":"2024-09-18T01:49:14.923041+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:14.922951+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:14.922951+0000","last_clean_scrub_stamp":"2024-09-18T01:49:14.922951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:33:07.551122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"33'10","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:23.933837+0000","last_change":"2024-09-18T01:49:23.933837+0000","last_active":"2024-09-18T01:49:23.933837+0000","last_peered":"2024-09-18T01:49:23.933837+0000","last_clean":"2024-09-18T01:49:23.933837+0000","last_became_active":"2024-09-18T01:45:41.342336+0000","last_became_peered":"2024-09-18T01:45:41.342336+0000","last_unstale":"2024-09-18T01:49:23.933837+0000","last_undegraded":"2024-09-18T01:49:23.933837+0000","last_fullsized":"2024-09-18T01:49:23.933837+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-18T01:49:23.933706+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-18T01:49:23.933706+0000","last_clean_scrub_stamp":"2024-09-18T01:49:23.933706+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:54:37.025570+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:03.045975+0000","last_change":"2024-09-18T01:49:03.045975+0000","last_active":"2024-09-18T01:49:03.045975+0000","last_peered":"2024-09-18T01:49:03.045975+0000","last_clean":"2024-09-18T01:49:03.045975+0000","last_became_active":"2024-09-18T01:45:04.284969+0000","last_became_peered":"2024-09-18T01:45:04.284969+0000","last_unstale":"2024-09-18T01:49:03.045975+0000","last_undegraded":"2024-09-18T01:49:03.045975+0000","last_fullsized":"2024-09-18T01:49:03.045975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:03.045840+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:03.045840+0000","last_clean_scrub_stamp":"2024-09-18T01:49:03.045840+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:10:07.759840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'12","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:09.314766+0000","last_change":"2024-09-18T01:49:09.314766+0000","last_active":"2024-09-18T01:49:09.314766+0000","last_peered":"2024-09-18T01:49:09.314766+0000","last_clean":"2024-09-18T01:49:09.314766+0000","last_became_active":"2024-09-18T01:45:06.285500+0000","last_became_peered":"2024-09-18T01:45:06.285500+0000","last_unstale":"2024-09-18T01:49:09.314766+0000","last_undegraded":"2024-09-18T01:49:09.314766+0000","last_fullsized":"2024-09-18T01:49:09.314766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-18T01:49:09.314630+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-18T01:49:09.314630+0000","last_clean_scrub_stamp":"2024-09-18T01:49:09.314630+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:20:35.072341+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:10.357393+0000","last_change":"2024-09-18T01:49:10.357393+0000","last_active":"2024-09-18T01:49:10.357393+0000","last_peered":"2024-09-18T01:49:10.357393+0000","last_clean":"2024-09-18T01:49:10.357393+0000","last_became_active":"2024-09-18T01:45:04.280147+0000","last_became_peered":"2024-09-18T01:45:04.280147+0000","last_unstale":"2024-09-18T01:49:10.357393+0000","last_undegraded":"2024-09-18T01:49:10.357393+0000","last_fullsized":"2024-09-18T01:49:10.357393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:10.357273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:10.357273+0000","last_clean_scrub_stamp":"2024-09-18T01:49:10.357273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:29:03.313231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:11.874685+0000","last_change":"2024-09-18T01:49:11.874685+0000","last_active":"2024-09-18T01:49:11.874685+0000","last_peered":"2024-09-18T01:49:11.874685+0000","last_clean":"2024-09-18T01:49:11.874685+0000","last_became_active":"2024-09-18T01:45:06.278684+0000","last_became_peered":"2024-09-18T01:45:06.278684+0000","last_unstale":"2024-09-18T01:49:11.874685+0000","last_undegraded":"2024-09-18T01:49:11.874685+0000","last_fullsized":"2024-09-18T01:49:11.874685+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:49:11.874525+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:49:11.874525+0000","last_clean_scrub_stamp":"2024-09-18T01:49:11.874525+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:10:48.245598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:30.048139+0000","last_change":"2024-09-18T01:49:30.048177+0000","last_active":"2024-09-18T01:49:30.048139+0000","last_peered":"2024-09-18T01:49:30.048139+0000","last_clean":"2024-09-18T01:49:30.048139+0000","last_became_active":"2024-09-18T01:45:04.281920+0000","last_became_peered":"2024-09-18T01:45:04.281920+0000","last_unstale":"2024-09-18T01:49:30.048139+0000","last_undegraded":"2024-09-18T01:49:30.048139+0000","last_fullsized":"2024-09-18T01:49:30.048139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:30.048046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:30.048046+0000","last_clean_scrub_stamp":"2024-09-18T01:49:30.048046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:28:31.019549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"33'6","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:57.373010+0000","last_change":"2024-09-18T01:48:57.373010+0000","last_active":"2024-09-18T01:48:57.373010+0000","last_peered":"2024-09-18T01:48:57.373010+0000","last_clean":"2024-09-18T01:48:57.373010+0000","last_became_active":"2024-09-18T01:45:06.281998+0000","last_became_peered":"2024-09-18T01:45:06.281998+0000","last_unstale":"2024-09-18T01:48:57.373010+0000","last_undegraded":"2024-09-18T01:48:57.373010+0000","last_fullsized":"2024-09-18T01:48:57.373010+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-18T01:48:57.372819+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-18T01:48:57.372819+0000","last_clean_scrub_stamp":"2024-09-18T01:48:57.372819+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:39:02.799260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:08.302464+0000","last_change":"2024-09-18T01:49:08.302464+0000","last_active":"2024-09-18T01:49:08.302464+0000","last_peered":"2024-09-18T01:49:08.302464+0000","last_clean":"2024-09-18T01:49:08.302464+0000","last_became_active":"2024-09-18T01:45:04.280066+0000","last_became_peered":"2024-09-18T01:45:04.280066+0000","last_unstale":"2024-09-18T01:49:08.302464+0000","last_undegraded":"2024-09-18T01:49:08.302464+0000","last_fullsized":"2024-09-18T01:49:08.302464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:08.302332+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:08.302332+0000","last_clean_scrub_stamp":"2024-09-18T01:49:08.302332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:19:38.144899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:07.279054+0000","last_change":"2024-09-18T01:49:07.279054+0000","last_active":"2024-09-18T01:49:07.279054+0000","last_peered":"2024-09-18T01:49:07.279054+0000","last_clean":"2024-09-18T01:49:07.279054+0000","last_became_active":"2024-09-18T01:45:06.285054+0000","last_became_peered":"2024-09-18T01:45:06.285054+0000","last_unstale":"2024-09-18T01:49:07.279054+0000","last_undegraded":"2024-09-18T01:49:07.279054+0000","last_fullsized":"2024-09-18T01:49:07.279054+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:07.278872+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:07.278872+0000","last_clean_scrub_stamp":"2024-09-18T01:49:07.278872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:54:25.184819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"31'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:02.362686+0000","last_change":"2024-09-18T01:49:02.362686+0000","last_active":"2024-09-18T01:49:02.362686+0000","last_peered":"2024-09-18T01:49:02.362686+0000","last_clean":"2024-09-18T01:49:02.362686+0000","last_became_active":"2024-09-18T01:45:04.281146+0000","last_became_peered":"2024-09-18T01:45:04.281146+0000","last_unstale":"2024-09-18T01:49:02.362686+0000","last_undegraded":"2024-09-18T01:49:02.362686+0000","last_fullsized":"2024-09-18T01:49:02.362686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-18T01:49:02.362562+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-18T01:49:02.362562+0000","last_clean_scrub_stamp":"2024-09-18T01:49:02.362562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:27:34.245079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:07.095514+0000","last_change":"2024-09-18T01:49:07.095514+0000","last_active":"2024-09-18T01:49:07.095514+0000","last_peered":"2024-09-18T01:49:07.095514+0000","last_clean":"2024-09-18T01:49:07.095514+0000","last_became_active":"2024-09-18T01:45:06.292490+0000","last_became_peered":"2024-09-18T01:45:06.292490+0000","last_unstale":"2024-09-18T01:49:07.095514+0000","last_undegraded":"2024-09-18T01:49:07.095514+0000","last_fullsized":"2024-09-18T01:49:07.095514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:07.095395+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:07.095395+0000","last_clean_scrub_stamp":"2024-09-18T01:49:07.095395+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:18:33.137302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:16.106798+0000","last_change":"2024-09-18T01:49:16.106798+0000","last_active":"2024-09-18T01:49:16.106798+0000","last_peered":"2024-09-18T01:49:16.106798+0000","last_clean":"2024-09-18T01:49:16.106798+0000","last_became_active":"2024-09-18T01:45:04.293767+0000","last_became_peered":"2024-09-18T01:45:04.293767+0000","last_unstale":"2024-09-18T01:49:16.106798+0000","last_undegraded":"2024-09-18T01:49:16.106798+0000","last_fullsized":"2024-09-18T01:49:16.106798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:16.106685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:16.106685+0000","last_clean_scrub_stamp":"2024-09-18T01:49:16.106685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:03:30.880656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"33'10","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:51.420813+0000","last_change":"2024-09-18T01:48:51.420813+0000","last_active":"2024-09-18T01:48:51.420813+0000","last_peered":"2024-09-18T01:48:51.420813+0000","last_clean":"2024-09-18T01:48:51.420813+0000","last_became_active":"2024-09-18T01:45:06.293369+0000","last_became_peered":"2024-09-18T01:45:06.293369+0000","last_unstale":"2024-09-18T01:48:51.420813+0000","last_undegraded":"2024-09-18T01:48:51.420813+0000","last_fullsized":"2024-09-18T01:48:51.420813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-18T01:48:51.420614+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-18T01:48:51.420614+0000","last_clean_scrub_stamp":"2024-09-18T01:48:51.420614+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:43:49.179948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:57.058359+0000","last_change":"2024-09-18T01:48:57.058359+0000","last_active":"2024-09-18T01:48:57.058359+0000","last_peered":"2024-09-18T01:48:57.058359+0000","last_clean":"2024-09-18T01:48:57.058359+0000","last_became_active":"2024-09-18T01:45:04.292056+0000","last_became_peered":"2024-09-18T01:45:04.292056+0000","last_unstale":"2024-09-18T01:48:57.058359+0000","last_undegraded":"2024-09-18T01:48:57.058359+0000","last_fullsized":"2024-09-18T01:48:57.058359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:48:57.058174+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:48:57.058174+0000","last_clean_scrub_stamp":"2024-09-18T01:48:57.058174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:39:24.043782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'8","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:44.891289+0000","last_change":"2024-09-18T01:48:44.891289+0000","last_active":"2024-09-18T01:48:44.891289+0000","last_peered":"2024-09-18T01:48:44.891289+0000","last_clean":"2024-09-18T01:48:44.891289+0000","last_became_active":"2024-09-18T01:45:06.295055+0000","last_became_peered":"2024-09-18T01:45:06.295055+0000","last_unstale":"2024-09-18T01:48:44.891289+0000","last_undegraded":"2024-09-18T01:48:44.891289+0000","last_fullsized":"2024-09-18T01:48:44.891289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-18T01:48:44.891111+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-18T01:48:44.891111+0000","last_clean_scrub_stamp":"2024-09-18T01:48:44.891111+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:12:36.827132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:56.346237+0000","last_change":"2024-09-18T01:48:56.346237+0000","last_active":"2024-09-18T01:48:56.346237+0000","last_peered":"2024-09-18T01:48:56.346237+0000","last_clean":"2024-09-18T01:48:56.346237+0000","last_became_active":"2024-09-18T01:45:04.283959+0000","last_became_peered":"2024-09-18T01:45:04.283959+0000","last_unstale":"2024-09-18T01:48:56.346237+0000","last_undegraded":"2024-09-18T01:48:56.346237+0000","last_fullsized":"2024-09-18T01:48:56.346237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:56.346122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:56.346122+0000","last_clean_scrub_stamp":"2024-09-18T01:48:56.346122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:58:18.595435+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:47.927642+0000","last_change":"2024-09-18T01:48:47.927701+0000","last_active":"2024-09-18T01:48:47.927642+0000","last_peered":"2024-09-18T01:48:47.927642+0000","last_clean":"2024-09-18T01:48:47.927642+0000","last_became_active":"2024-09-18T01:45:06.295270+0000","last_became_peered":"2024-09-18T01:45:06.295270+0000","last_unstale":"2024-09-18T01:48:47.927642+0000","last_undegraded":"2024-09-18T01:48:47.927642+0000","last_fullsized":"2024-09-18T01:48:47.927642+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:48:47.927542+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:48:47.927542+0000","last_clean_scrub_stamp":"2024-09-18T01:48:47.927542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:48:47.618456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:39.040364+0000","last_change":"2024-09-18T01:49:39.040409+0000","last_active":"2024-09-18T01:49:39.040364+0000","last_peered":"2024-09-18T01:49:39.040364+0000","last_clean":"2024-09-18T01:49:39.040364+0000","last_became_active":"2024-09-18T01:45:04.278951+0000","last_became_peered":"2024-09-18T01:45:04.278951+0000","last_unstale":"2024-09-18T01:49:39.040364+0000","last_undegraded":"2024-09-18T01:49:39.040364+0000","last_fullsized":"2024-09-18T01:49:39.040364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:39.040257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:39.040257+0000","last_clean_scrub_stamp":"2024-09-18T01:49:39.040257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:07:13.886958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'4","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:01.924260+0000","last_change":"2024-09-18T01:49:01.924286+0000","last_active":"2024-09-18T01:49:01.924260+0000","last_peered":"2024-09-18T01:49:01.924260+0000","last_clean":"2024-09-18T01:49:01.924260+0000","last_became_active":"2024-09-18T01:45:06.285272+0000","last_became_peered":"2024-09-18T01:45:06.285272+0000","last_unstale":"2024-09-18T01:49:01.924260+0000","last_undegraded":"2024-09-18T01:49:01.924260+0000","last_fullsized":"2024-09-18T01:49:01.924260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:49:01.924168+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:49:01.924168+0000","last_clean_scrub_stamp":"2024-09-18T01:49:01.924168+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:54:15.016033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:00.389566+0000","last_change":"2024-09-18T01:49:00.389566+0000","last_active":"2024-09-18T01:49:00.389566+0000","last_peered":"2024-09-18T01:49:00.389566+0000","last_clean":"2024-09-18T01:49:00.389566+0000","last_became_active":"2024-09-18T01:45:04.281197+0000","last_became_peered":"2024-09-18T01:45:04.281197+0000","last_unstale":"2024-09-18T01:49:00.389566+0000","last_undegraded":"2024-09-18T01:49:00.389566+0000","last_fullsized":"2024-09-18T01:49:00.389566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:00.389446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:00.389446+0000","last_clean_scrub_stamp":"2024-09-18T01:49:00.389446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:16:22.876886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"33'4","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:03.333763+0000","last_change":"2024-09-18T01:49:03.333763+0000","last_active":"2024-09-18T01:49:03.333763+0000","last_peered":"2024-09-18T01:49:03.333763+0000","last_clean":"2024-09-18T01:49:03.333763+0000","last_became_active":"2024-09-18T01:45:06.284989+0000","last_became_peered":"2024-09-18T01:45:06.284989+0000","last_unstale":"2024-09-18T01:49:03.333763+0000","last_undegraded":"2024-09-18T01:49:03.333763+0000","last_fullsized":"2024-09-18T01:49:03.333763+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:49:03.333650+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:49:03.333650+0000","last_clean_scrub_stamp":"2024-09-18T01:49:03.333650+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:58:12.247792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:04.101172+0000","last_change":"2024-09-18T01:49:04.101172+0000","last_active":"2024-09-18T01:49:04.101172+0000","last_peered":"2024-09-18T01:49:04.101172+0000","last_clean":"2024-09-18T01:49:04.101172+0000","last_became_active":"2024-09-18T01:45:04.294125+0000","last_became_peered":"2024-09-18T01:45:04.294125+0000","last_unstale":"2024-09-18T01:49:04.101172+0000","last_undegraded":"2024-09-18T01:49:04.101172+0000","last_fullsized":"2024-09-18T01:49:04.101172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:04.101055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:04.101055+0000","last_clean_scrub_stamp":"2024-09-18T01:49:04.101055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:37:34.076116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"33'10","reported_seq":77,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:56.058261+0000","last_change":"2024-09-18T01:48:56.058261+0000","last_active":"2024-09-18T01:48:56.058261+0000","last_peered":"2024-09-18T01:48:56.058261+0000","last_clean":"2024-09-18T01:48:56.058261+0000","last_became_active":"2024-09-18T01:45:06.279373+0000","last_became_peered":"2024-09-18T01:45:06.279373+0000","last_unstale":"2024-09-18T01:48:56.058261+0000","last_undegraded":"2024-09-18T01:48:56.058261+0000","last_fullsized":"2024-09-18T01:48:56.058261+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-18T01:48:56.058151+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-18T01:48:56.058151+0000","last_clean_scrub_stamp":"2024-09-18T01:48:56.058151+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:04:14.350688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"33'4","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:13.057421+0000","last_change":"2024-09-18T01:49:13.057421+0000","last_active":"2024-09-18T01:49:13.057421+0000","last_peered":"2024-09-18T01:49:13.057421+0000","last_clean":"2024-09-18T01:49:13.057421+0000","last_became_active":"2024-09-18T01:45:04.291442+0000","last_became_peered":"2024-09-18T01:45:04.291442+0000","last_unstale":"2024-09-18T01:49:13.057421+0000","last_undegraded":"2024-09-18T01:49:13.057421+0000","last_fullsized":"2024-09-18T01:49:13.057421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:49:13.057304+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:49:13.057304+0000","last_clean_scrub_stamp":"2024-09-18T01:49:13.057304+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:10:42.433101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'6","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:17.085686+0000","last_change":"2024-09-18T01:49:17.085686+0000","last_active":"2024-09-18T01:49:17.085686+0000","last_peered":"2024-09-18T01:49:17.085686+0000","last_clean":"2024-09-18T01:49:17.085686+0000","last_became_active":"2024-09-18T01:45:06.292425+0000","last_became_peered":"2024-09-18T01:45:06.292425+0000","last_unstale":"2024-09-18T01:49:17.085686+0000","last_undegraded":"2024-09-18T01:49:17.085686+0000","last_fullsized":"2024-09-18T01:49:17.085686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-18T01:49:17.085574+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-18T01:49:17.085574+0000","last_clean_scrub_stamp":"2024-09-18T01:49:17.085574+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:00:50.007418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:24.905956+0000","last_change":"2024-09-18T01:49:24.905956+0000","last_active":"2024-09-18T01:49:24.905956+0000","last_peered":"2024-09-18T01:49:24.905956+0000","last_clean":"2024-09-18T01:49:24.905956+0000","last_became_active":"2024-09-18T01:45:04.289365+0000","last_became_peered":"2024-09-18T01:45:04.289365+0000","last_unstale":"2024-09-18T01:49:24.905956+0000","last_undegraded":"2024-09-18T01:49:24.905956+0000","last_fullsized":"2024-09-18T01:49:24.905956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:24.905795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:24.905795+0000","last_clean_scrub_stamp":"2024-09-18T01:49:24.905795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:14:35.484488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:52.005632+0000","last_change":"2024-09-18T01:48:52.005632+0000","last_active":"2024-09-18T01:48:52.005632+0000","last_peered":"2024-09-18T01:48:52.005632+0000","last_clean":"2024-09-18T01:48:52.005632+0000","last_became_active":"2024-09-18T01:45:06.293403+0000","last_became_peered":"2024-09-18T01:45:06.293403+0000","last_unstale":"2024-09-18T01:48:52.005632+0000","last_undegraded":"2024-09-18T01:48:52.005632+0000","last_fullsized":"2024-09-18T01:48:52.005632+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:52.005522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:52.005522+0000","last_clean_scrub_stamp":"2024-09-18T01:48:52.005522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:15:53.488207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:37.999869+0000","last_change":"2024-09-18T01:49:37.999892+0000","last_active":"2024-09-18T01:49:37.999869+0000","last_peered":"2024-09-18T01:49:37.999869+0000","last_clean":"2024-09-18T01:49:37.999869+0000","last_became_active":"2024-09-18T01:45:04.277907+0000","last_became_peered":"2024-09-18T01:45:04.277907+0000","last_unstale":"2024-09-18T01:49:37.999869+0000","last_undegraded":"2024-09-18T01:49:37.999869+0000","last_fullsized":"2024-09-18T01:49:37.999869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:37.999759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:37.999759+0000","last_clean_scrub_stamp":"2024-09-18T01:49:37.999759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:56:32.827098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'3","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:41.057681+0000","last_change":"2024-09-18T01:48:41.057681+0000","last_active":"2024-09-18T01:48:41.057681+0000","last_peered":"2024-09-18T01:48:41.057681+0000","last_clean":"2024-09-18T01:48:41.057681+0000","last_became_active":"2024-09-18T01:45:06.293036+0000","last_became_peered":"2024-09-18T01:45:06.293036+0000","last_unstale":"2024-09-18T01:48:41.057681+0000","last_undegraded":"2024-09-18T01:48:41.057681+0000","last_fullsized":"2024-09-18T01:48:41.057681+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-18T01:48:41.057559+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-18T01:48:41.057559+0000","last_clean_scrub_stamp":"2024-09-18T01:48:41.057559+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:16:03.544999+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:07.082784+0000","last_change":"2024-09-18T01:49:07.082806+0000","last_active":"2024-09-18T01:49:07.082784+0000","last_peered":"2024-09-18T01:49:07.082784+0000","last_clean":"2024-09-18T01:49:07.082784+0000","last_became_active":"2024-09-18T01:45:04.286591+0000","last_became_peered":"2024-09-18T01:45:04.286591+0000","last_unstale":"2024-09-18T01:49:07.082784+0000","last_undegraded":"2024-09-18T01:49:07.082784+0000","last_fullsized":"2024-09-18T01:49:07.082784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:07.082676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:07.082676+0000","last_clean_scrub_stamp":"2024-09-18T01:49:07.082676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:45:05.170743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"33'4","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:45.923392+0000","last_change":"2024-09-18T01:48:45.923392+0000","last_active":"2024-09-18T01:48:45.923392+0000","last_peered":"2024-09-18T01:48:45.923392+0000","last_clean":"2024-09-18T01:48:45.923392+0000","last_became_active":"2024-09-18T01:45:06.294911+0000","last_became_peered":"2024-09-18T01:45:06.294911+0000","last_unstale":"2024-09-18T01:48:45.923392+0000","last_undegraded":"2024-09-18T01:48:45.923392+0000","last_fullsized":"2024-09-18T01:48:45.923392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:48:45.923209+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:48:45.923209+0000","last_clean_scrub_stamp":"2024-09-18T01:48:45.923209+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:37:21.719090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:17.884419+0000","last_change":"2024-09-18T01:49:17.884480+0000","last_active":"2024-09-18T01:49:17.884419+0000","last_peered":"2024-09-18T01:49:17.884419+0000","last_clean":"2024-09-18T01:49:17.884419+0000","last_became_active":"2024-09-18T01:45:04.285719+0000","last_became_peered":"2024-09-18T01:45:04.285719+0000","last_unstale":"2024-09-18T01:49:17.884419+0000","last_undegraded":"2024-09-18T01:49:17.884419+0000","last_fullsized":"2024-09-18T01:49:17.884419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:49:17.884301+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:49:17.884301+0000","last_clean_scrub_stamp":"2024-09-18T01:49:17.884301+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:38:45.163944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:40.000431+0000","last_change":"2024-09-18T01:49:40.000487+0000","last_active":"2024-09-18T01:49:40.000431+0000","last_peered":"2024-09-18T01:49:40.000431+0000","last_clean":"2024-09-18T01:49:40.000431+0000","last_became_active":"2024-09-18T01:45:04.278266+0000","last_became_peered":"2024-09-18T01:45:04.278266+0000","last_unstale":"2024-09-18T01:49:40.000431+0000","last_undegraded":"2024-09-18T01:49:40.000431+0000","last_fullsized":"2024-09-18T01:49:40.000431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:40.000327+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:40.000327+0000","last_clean_scrub_stamp":"2024-09-18T01:49:40.000327+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:36:53.988157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"33'10","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:19.358776+0000","last_change":"2024-09-18T01:49:19.358802+0000","last_active":"2024-09-18T01:49:19.358776+0000","last_peered":"2024-09-18T01:49:19.358776+0000","last_clean":"2024-09-18T01:49:19.358776+0000","last_became_active":"2024-09-18T01:45:06.292127+0000","last_became_peered":"2024-09-18T01:45:06.292127+0000","last_unstale":"2024-09-18T01:49:19.358776+0000","last_undegraded":"2024-09-18T01:49:19.358776+0000","last_fullsized":"2024-09-18T01:49:19.358776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-18T01:49:19.358648+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-18T01:49:19.358648+0000","last_clean_scrub_stamp":"2024-09-18T01:49:19.358648+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:49:14.544586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:17.377394+0000","last_change":"2024-09-18T01:49:17.377446+0000","last_active":"2024-09-18T01:49:17.377394+0000","last_peered":"2024-09-18T01:49:17.377394+0000","last_clean":"2024-09-18T01:49:17.377394+0000","last_became_active":"2024-09-18T01:45:04.273575+0000","last_became_peered":"2024-09-18T01:45:04.273575+0000","last_unstale":"2024-09-18T01:49:17.377394+0000","last_undegraded":"2024-09-18T01:49:17.377394+0000","last_fullsized":"2024-09-18T01:49:17.377394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:17.377288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:17.377288+0000","last_clean_scrub_stamp":"2024-09-18T01:49:17.377288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:03:33.963095+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'6","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:03.126363+0000","last_change":"2024-09-18T01:49:03.126408+0000","last_active":"2024-09-18T01:49:03.126363+0000","last_peered":"2024-09-18T01:49:03.126363+0000","last_clean":"2024-09-18T01:49:03.126363+0000","last_became_active":"2024-09-18T01:45:06.292037+0000","last_became_peered":"2024-09-18T01:45:06.292037+0000","last_unstale":"2024-09-18T01:49:03.126363+0000","last_undegraded":"2024-09-18T01:49:03.126363+0000","last_fullsized":"2024-09-18T01:49:03.126363+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-18T01:49:03.126249+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-18T01:49:03.126249+0000","last_clean_scrub_stamp":"2024-09-18T01:49:03.126249+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:16:25.613689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":273,"ondisk_log_size":273,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":9385,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1888,"num_read_kb":1653,"num_write":789,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1751,"ondisk_log_size":1751,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1590,"num_read_kb":1480,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":483,"ondisk_log_size":483,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705726,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39972,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331868,"statfs":{"total":96636764160,"available":96595832832,"internally_reserved":0,"allocated":479232,"data_stored":150270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705726,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40480,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331360,"statfs":{"total":96636764160,"available":96595312640,"internally_reserved":0,"allocated":999424,"data_stored":737378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705726,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40508,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331332,"statfs":{"total":96636764160,"available":96595283968,"internally_reserved":0,"allocated":1028096,"data_stored":738692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705726,"num_pgs":150,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39936,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331904,"statfs":{"total":96636764160,"available":96595869696,"internally_reserved":0,"allocated":442368,"data_stored":148296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T01:49:45.368 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:45.369 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-18T01:45:07.267106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=7, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:45.369 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:45.369 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:45.370 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:45.370 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-18T01:45:13.296584+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=45, tm_sec=13, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=1, tm_min=48, tm_sec=20, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T01:49:45.371 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-18T01:50:05.372 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T01:50:05.485 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.483+0000 7fa72bd5f640 1 Processor -- start 2024-09-18T01:50:05.485 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.484+0000 7fa72bd5f640 1 -- start start 2024-09-18T01:50:05.486 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.484+0000 7fa72bd5f640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fa724096230 0x7fa724133e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:50:05.486 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.484+0000 7fa72bd5f640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa72409e100 con 0x7fa724095740 2024-09-18T01:50:05.486 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.484+0000 7fa72bd5f640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x7fa72409a960 con 0x7fa724096230 2024-09-18T01:50:05.486 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.484+0000 7fa7292fa640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fa724096230 0x7fa724133e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:50:05.486 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.484+0000 7fa729afb640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fa724095740 0x7fa724095b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:56850/0 (socket says 172.21.15.129:56850) 2024-09-18T01:50:05.486 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.484+0000 7fa729afb640 1 -- 172.21.15.129:0/1942031996 learned_addr learned my addr 172.21.15.129:0/1942031996 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-09-18T01:50:05.486 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.484+0000 7fa7292fa640 1 -- 172.21.15.129:0/1942031996 >> v1:172.21.15.129:6789/0 conn(0x7fa724095740 legacy=0x7fa724095b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:50:05.486 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.485+0000 7fa7292fa640 1 -- 172.21.15.129:0/1942031996 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa724097220 con 0x7fa724096230 2024-09-18T01:50:05.487 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.485+0000 7fa7292fa640 1 --2- 172.21.15.129:0/1942031996 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa724096230 0x7fa724133e20 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fa714009720 tx=0x7fa71402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=765282bbecc1bff5 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:50:05.487 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.485+0000 7fa728af9640 1 -- 172.21.15.129:0/1942031996 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa714037070 con 0x7fa724096230 2024-09-18T01:50:05.487 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.485+0000 7fa728af9640 1 -- 172.21.15.129:0/1942031996 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa71402ae20 con 0x7fa724096230 2024-09-18T01:50:05.488 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.485+0000 7fa728af9640 1 -- 172.21.15.129:0/1942031996 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa714032590 con 0x7fa724096230 2024-09-18T01:50:05.488 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.486+0000 7fa72bd5f640 1 -- 172.21.15.129:0/1942031996 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa724096230 msgr2=0x7fa724133e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:50:05.488 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.486+0000 7fa72bd5f640 1 --2- 172.21.15.129:0/1942031996 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa724096230 0x7fa724133e20 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fa714009720 tx=0x7fa71402a1a0 comp rx=0 tx=0).stop 2024-09-18T01:50:05.488 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.486+0000 7fa72bd5f640 1 -- 172.21.15.129:0/1942031996 shutdown_connections 2024-09-18T01:50:05.488 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.486+0000 7fa72bd5f640 1 --2- 172.21.15.129:0/1942031996 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa724096230 0x7fa724133e20 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:50:05.488 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.486+0000 7fa72bd5f640 1 -- 172.21.15.129:0/1942031996 >> 172.21.15.129:0/1942031996 conn(0x7fa72409d860 msgr2=0x7fa724099d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:50:05.488 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.486+0000 7fa72bd5f640 1 -- 172.21.15.129:0/1942031996 shutdown_connections 2024-09-18T01:50:05.488 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.486+0000 7fa72bd5f640 1 -- 172.21.15.129:0/1942031996 wait complete. 2024-09-18T01:50:05.490 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.487+0000 7fa72bd5f640 1 Processor -- start 2024-09-18T01:50:05.490 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.487+0000 7fa72bd5f640 1 -- start start 2024-09-18T01:50:05.490 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.487+0000 7fa72bd5f640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa724095740 0x7fa72406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:50:05.490 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.487+0000 7fa72bd5f640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7fa724096bd0 con 0x7fa724095740 2024-09-18T01:50:05.490 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.487+0000 7fa729afb640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa724095740 0x7fa72406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:50:05.490 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.487+0000 7fa729afb640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa724095740 0x7fa72406d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:37612/0 (socket says 172.21.15.129:37612) 2024-09-18T01:50:05.491 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.487+0000 7fa729afb640 1 -- 172.21.15.129:0/1538808718 learned_addr learned my addr 172.21.15.129:0/1538808718 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-18T01:50:05.491 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.488+0000 7fa729afb640 1 -- 172.21.15.129:0/1538808718 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa724093fa0 con 0x7fa724095740 2024-09-18T01:50:05.491 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.488+0000 7fa729afb640 1 --2- 172.21.15.129:0/1538808718 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa724095740 0x7fa72406d7b0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fa72000c4a0 tx=0x7fa72000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:50:05.491 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.488+0000 7fa71a7fc640 1 -- 172.21.15.129:0/1538808718 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa720017070 con 0x7fa724095740 2024-09-18T01:50:05.491 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.488+0000 7fa71a7fc640 1 -- 172.21.15.129:0/1538808718 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa720005c10 con 0x7fa724095740 2024-09-18T01:50:05.491 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.488+0000 7fa72bd5f640 1 -- 172.21.15.129:0/1538808718 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7240937b0 con 0x7fa724095740 2024-09-18T01:50:05.491 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.488+0000 7fa71a7fc640 1 -- 172.21.15.129:0/1538808718 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa720007070 con 0x7fa724095740 2024-09-18T01:50:05.491 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.488+0000 7fa72bd5f640 1 -- 172.21.15.129:0/1538808718 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa72406ec20 con 0x7fa724095740 2024-09-18T01:50:05.491 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.489+0000 7fa71a7fc640 1 -- 172.21.15.129:0/1538808718 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa72001a070 con 0x7fa724095740 2024-09-18T01:50:05.491 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.489+0000 7fa72bd5f640 1 -- 172.21.15.129:0/1538808718 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa724095b20 con 0x7fa724095740 2024-09-18T01:50:05.491 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.489+0000 7fa71a7fc640 1 --2- 172.21.15.129:0/1538808718 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fa7080382a0 0x7fa70803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:50:05.491 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.489+0000 7fa71a7fc640 1 -- 172.21.15.129:0/1538808718 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7fa72004afe0 con 0x7fa724095740 2024-09-18T01:50:05.491 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.489+0000 7fa7292fa640 1 --2- 172.21.15.129:0/1538808718 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fa7080382a0 0x7fa70803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:50:05.492 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.490+0000 7fa7292fa640 1 --2- 172.21.15.129:0/1538808718 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fa7080382a0 0x7fa70803a760 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa714034000 tx=0x7fa71402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:50:05.495 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.494+0000 7fa71a7fc640 1 -- 172.21.15.129:0/1538808718 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa72001b3b0 con 0x7fa724095740 2024-09-18T01:50:05.658 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.656+0000 7fa72bd5f640 1 -- 172.21.15.129:0/1538808718 --> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa724070100 con 0x7fa7080382a0 2024-09-18T01:50:05.673 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.672+0000 7fa71a7fc640 1 -- 172.21.15.129:0/1538808718 <== mgr.4099 v2:172.21.15.146:6824/168968651 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666231 (secure 0 0 0) 0x7fa724070100 con 0x7fa7080382a0 2024-09-18T01:50:05.680 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-09-18T01:50:05.685 INFO:teuthology.orchestra.run.smithi129.stderr:dumped all 2024-09-18T01:50:05.687 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.676+0000 7fa72bd5f640 1 -- 172.21.15.129:0/1538808718 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fa7080382a0 msgr2=0x7fa70803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:50:05.687 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.676+0000 7fa72bd5f640 1 --2- 172.21.15.129:0/1538808718 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fa7080382a0 0x7fa70803a760 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa714034000 tx=0x7fa71402e000 comp rx=0 tx=0).stop 2024-09-18T01:50:05.687 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.676+0000 7fa72bd5f640 1 -- 172.21.15.129:0/1538808718 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa724095740 msgr2=0x7fa72406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:50:05.687 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.676+0000 7fa72bd5f640 1 --2- 172.21.15.129:0/1538808718 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa724095740 0x7fa72406d7b0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fa72000c4a0 tx=0x7fa72000c960 comp rx=0 tx=0).stop 2024-09-18T01:50:05.687 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.676+0000 7fa72bd5f640 1 -- 172.21.15.129:0/1538808718 shutdown_connections 2024-09-18T01:50:05.687 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.676+0000 7fa72bd5f640 1 --2- 172.21.15.129:0/1538808718 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7fa7080382a0 0x7fa70803a760 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:50:05.688 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.676+0000 7fa72bd5f640 1 --2- 172.21.15.129:0/1538808718 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa724095740 0x7fa72406d7b0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:50:05.688 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.676+0000 7fa72bd5f640 1 -- 172.21.15.129:0/1538808718 >> 172.21.15.129:0/1538808718 conn(0x7fa72409d860 msgr2=0x7fa724098520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:50:05.688 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.676+0000 7fa72bd5f640 1 -- 172.21.15.129:0/1538808718 shutdown_connections 2024-09-18T01:50:05.688 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.676+0000 7fa72bd5f640 1 -- 172.21.15.129:0/1538808718 wait complete. 2024-09-18T01:50:05.689 INFO:teuthology.orchestra.run.smithi129.stdout:{"pg_ready":true,"pg_map":{"version":189,"stamp":"2024-09-18T01:50:04.274595+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":603113,"num_objects":254,"num_object_clones":0,"num_object_copies":508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":254,"num_whiteouts":0,"num_read":5366,"num_read_kb":4915,"num_write":2371,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5016,"ondisk_log_size":5016,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":160896,"kb_used_data":2880,"kb_used_omap":6,"kb_used_meta":157945,"kb_avail":377326464,"statfs":{"total":386547056640,"available":386382299136,"internally_reserved":0,"allocated":2949120,"data_stored":1774636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":161736471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003873"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:08.035201+0000","last_change":"2024-09-18T01:49:08.035201+0000","last_active":"2024-09-18T01:49:08.035201+0000","last_peered":"2024-09-18T01:49:08.035201+0000","last_clean":"2024-09-18T01:49:08.035201+0000","last_became_active":"2024-09-18T01:45:04.287322+0000","last_became_peered":"2024-09-18T01:45:04.287322+0000","last_unstale":"2024-09-18T01:49:08.035201+0000","last_undegraded":"2024-09-18T01:49:08.035201+0000","last_fullsized":"2024-09-18T01:49:08.035201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:08.035082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:08.035082+0000","last_clean_scrub_stamp":"2024-09-18T01:49:08.035082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:28:41.589405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"33'8","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:43.875122+0000","last_change":"2024-09-18T01:48:43.875148+0000","last_active":"2024-09-18T01:48:43.875122+0000","last_peered":"2024-09-18T01:48:43.875122+0000","last_clean":"2024-09-18T01:48:43.875122+0000","last_became_active":"2024-09-18T01:45:06.295819+0000","last_became_peered":"2024-09-18T01:45:06.295819+0000","last_unstale":"2024-09-18T01:48:43.875122+0000","last_undegraded":"2024-09-18T01:48:43.875122+0000","last_fullsized":"2024-09-18T01:48:43.875122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-18T01:48:43.875034+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-18T01:48:43.875034+0000","last_clean_scrub_stamp":"2024-09-18T01:48:43.875034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:39:10.860642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:06.316407+0000","last_change":"2024-09-18T01:49:06.316407+0000","last_active":"2024-09-18T01:49:06.316407+0000","last_peered":"2024-09-18T01:49:06.316407+0000","last_clean":"2024-09-18T01:49:06.316407+0000","last_became_active":"2024-09-18T01:45:04.280591+0000","last_became_peered":"2024-09-18T01:45:04.280591+0000","last_unstale":"2024-09-18T01:49:06.316407+0000","last_undegraded":"2024-09-18T01:49:06.316407+0000","last_fullsized":"2024-09-18T01:49:06.316407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:06.316273+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:06.316273+0000","last_clean_scrub_stamp":"2024-09-18T01:49:06.316273+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:23:34.636704+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"33'12","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:07.934928+0000","last_change":"2024-09-18T01:49:07.934963+0000","last_active":"2024-09-18T01:49:07.934928+0000","last_peered":"2024-09-18T01:49:07.934928+0000","last_clean":"2024-09-18T01:49:07.934928+0000","last_became_active":"2024-09-18T01:45:06.281659+0000","last_became_peered":"2024-09-18T01:45:06.281659+0000","last_unstale":"2024-09-18T01:49:07.934928+0000","last_undegraded":"2024-09-18T01:49:07.934928+0000","last_fullsized":"2024-09-18T01:49:07.934928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-18T01:49:07.934844+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-18T01:49:07.934844+0000","last_clean_scrub_stamp":"2024-09-18T01:49:07.934844+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:40:23.892087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"33'5","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:19.942538+0000","last_change":"2024-09-18T01:49:19.942570+0000","last_active":"2024-09-18T01:49:19.942538+0000","last_peered":"2024-09-18T01:49:19.942538+0000","last_clean":"2024-09-18T01:49:19.942538+0000","last_became_active":"2024-09-18T01:45:04.286007+0000","last_became_peered":"2024-09-18T01:45:04.286007+0000","last_unstale":"2024-09-18T01:49:19.942538+0000","last_undegraded":"2024-09-18T01:49:19.942538+0000","last_fullsized":"2024-09-18T01:49:19.942538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-18T01:49:19.942440+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-18T01:49:19.942440+0000","last_clean_scrub_stamp":"2024-09-18T01:49:19.942440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:40:36.278314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"33'18","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:00.934191+0000","last_change":"2024-09-18T01:49:00.934242+0000","last_active":"2024-09-18T01:49:00.934191+0000","last_peered":"2024-09-18T01:49:00.934191+0000","last_clean":"2024-09-18T01:49:00.934191+0000","last_became_active":"2024-09-18T01:45:06.285378+0000","last_became_peered":"2024-09-18T01:45:06.285378+0000","last_unstale":"2024-09-18T01:49:00.934191+0000","last_undegraded":"2024-09-18T01:49:00.934191+0000","last_fullsized":"2024-09-18T01:49:00.934191+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'18","last_scrub_stamp":"2024-09-18T01:49:00.934082+0000","last_deep_scrub":"33'18","last_deep_scrub_stamp":"2024-09-18T01:49:00.934082+0000","last_clean_scrub_stamp":"2024-09-18T01:49:00.934082+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:48:56.120020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":40,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:49.054796+0000","last_change":"2024-09-18T01:48:49.054796+0000","last_active":"2024-09-18T01:48:49.054796+0000","last_peered":"2024-09-18T01:48:49.054796+0000","last_clean":"2024-09-18T01:48:49.054796+0000","last_became_active":"2024-09-18T01:45:04.297791+0000","last_became_peered":"2024-09-18T01:45:04.297791+0000","last_unstale":"2024-09-18T01:48:49.054796+0000","last_undegraded":"2024-09-18T01:48:49.054796+0000","last_fullsized":"2024-09-18T01:48:49.054796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:49.054679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:49.054679+0000","last_clean_scrub_stamp":"2024-09-18T01:48:49.054679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:23:20.643124+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"33'8","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:09.877827+0000","last_change":"2024-09-18T01:49:09.877886+0000","last_active":"2024-09-18T01:49:09.877827+0000","last_peered":"2024-09-18T01:49:09.877827+0000","last_clean":"2024-09-18T01:49:09.877827+0000","last_became_active":"2024-09-18T01:45:06.280779+0000","last_became_peered":"2024-09-18T01:45:06.280779+0000","last_unstale":"2024-09-18T01:49:09.877827+0000","last_undegraded":"2024-09-18T01:49:09.877827+0000","last_fullsized":"2024-09-18T01:49:09.877827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-18T01:49:09.877733+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-18T01:49:09.877733+0000","last_clean_scrub_stamp":"2024-09-18T01:49:09.877733+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:42:04.010151+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:32.007202+0000","last_change":"2024-09-18T01:49:32.007227+0000","last_active":"2024-09-18T01:49:32.007202+0000","last_peered":"2024-09-18T01:49:32.007202+0000","last_clean":"2024-09-18T01:49:32.007202+0000","last_became_active":"2024-09-18T01:45:04.280582+0000","last_became_peered":"2024-09-18T01:45:04.280582+0000","last_unstale":"2024-09-18T01:49:32.007202+0000","last_undegraded":"2024-09-18T01:49:32.007202+0000","last_fullsized":"2024-09-18T01:49:32.007202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:32.007109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:32.007109+0000","last_clean_scrub_stamp":"2024-09-18T01:49:32.007109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:07:31.844624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'12","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:53.032110+0000","last_change":"2024-09-18T01:48:53.032110+0000","last_active":"2024-09-18T01:48:53.032110+0000","last_peered":"2024-09-18T01:48:53.032110+0000","last_clean":"2024-09-18T01:48:53.032110+0000","last_became_active":"2024-09-18T01:45:06.289036+0000","last_became_peered":"2024-09-18T01:45:06.289036+0000","last_unstale":"2024-09-18T01:48:53.032110+0000","last_undegraded":"2024-09-18T01:48:53.032110+0000","last_fullsized":"2024-09-18T01:48:53.032110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-18T01:48:53.031994+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-18T01:48:53.031994+0000","last_clean_scrub_stamp":"2024-09-18T01:48:53.031994+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:49:17.553448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:04.058776+0000","last_change":"2024-09-18T01:49:04.058805+0000","last_active":"2024-09-18T01:49:04.058776+0000","last_peered":"2024-09-18T01:49:04.058776+0000","last_clean":"2024-09-18T01:49:04.058776+0000","last_became_active":"2024-09-18T01:45:04.286509+0000","last_became_peered":"2024-09-18T01:45:04.286509+0000","last_unstale":"2024-09-18T01:49:04.058776+0000","last_undegraded":"2024-09-18T01:49:04.058776+0000","last_fullsized":"2024-09-18T01:49:04.058776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:04.058678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:04.058678+0000","last_clean_scrub_stamp":"2024-09-18T01:49:04.058678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:39:50.767742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:42.024918+0000","last_change":"2024-09-18T01:48:42.024918+0000","last_active":"2024-09-18T01:48:42.024918+0000","last_peered":"2024-09-18T01:48:42.024918+0000","last_clean":"2024-09-18T01:48:42.024918+0000","last_became_active":"2024-09-18T01:45:06.287110+0000","last_became_peered":"2024-09-18T01:45:06.287110+0000","last_unstale":"2024-09-18T01:48:42.024918+0000","last_undegraded":"2024-09-18T01:48:42.024918+0000","last_fullsized":"2024-09-18T01:48:42.024918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:48:42.024803+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:48:42.024803+0000","last_clean_scrub_stamp":"2024-09-18T01:48:42.024803+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:37:11.999864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:15.881268+0000","last_change":"2024-09-18T01:49:15.881301+0000","last_active":"2024-09-18T01:49:15.881268+0000","last_peered":"2024-09-18T01:49:15.881268+0000","last_clean":"2024-09-18T01:49:15.881268+0000","last_became_active":"2024-09-18T01:45:04.289290+0000","last_became_peered":"2024-09-18T01:45:04.289290+0000","last_unstale":"2024-09-18T01:49:15.881268+0000","last_undegraded":"2024-09-18T01:49:15.881268+0000","last_fullsized":"2024-09-18T01:49:15.881268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:49:15.881149+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:49:15.881149+0000","last_clean_scrub_stamp":"2024-09-18T01:49:15.881149+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:23:57.699141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'14","reported_seq":80,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:45.086505+0000","last_change":"2024-09-18T01:48:45.086505+0000","last_active":"2024-09-18T01:48:45.086505+0000","last_peered":"2024-09-18T01:48:45.086505+0000","last_clean":"2024-09-18T01:48:45.086505+0000","last_became_active":"2024-09-18T01:45:06.295429+0000","last_became_peered":"2024-09-18T01:45:06.295429+0000","last_unstale":"2024-09-18T01:48:45.086505+0000","last_undegraded":"2024-09-18T01:48:45.086505+0000","last_fullsized":"2024-09-18T01:48:45.086505+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-09-18T01:48:45.086369+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-09-18T01:48:45.086369+0000","last_clean_scrub_stamp":"2024-09-18T01:48:45.086369+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:14:18.256239+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:16.394781+0000","last_change":"2024-09-18T01:49:16.394839+0000","last_active":"2024-09-18T01:49:16.394781+0000","last_peered":"2024-09-18T01:49:16.394781+0000","last_clean":"2024-09-18T01:49:16.394781+0000","last_became_active":"2024-09-18T01:45:04.273328+0000","last_became_peered":"2024-09-18T01:45:04.273328+0000","last_unstale":"2024-09-18T01:49:16.394781+0000","last_undegraded":"2024-09-18T01:49:16.394781+0000","last_fullsized":"2024-09-18T01:49:16.394781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:16.394672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:16.394672+0000","last_clean_scrub_stamp":"2024-09-18T01:49:16.394672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:48:30.113176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'10","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:56.083996+0000","last_change":"2024-09-18T01:48:56.083996+0000","last_active":"2024-09-18T01:48:56.083996+0000","last_peered":"2024-09-18T01:48:56.083996+0000","last_clean":"2024-09-18T01:48:56.083996+0000","last_became_active":"2024-09-18T01:45:06.284994+0000","last_became_peered":"2024-09-18T01:45:06.284994+0000","last_unstale":"2024-09-18T01:48:56.083996+0000","last_undegraded":"2024-09-18T01:48:56.083996+0000","last_fullsized":"2024-09-18T01:48:56.083996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-18T01:48:56.083802+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-18T01:48:56.083802+0000","last_clean_scrub_stamp":"2024-09-18T01:48:56.083802+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:24:40.822016+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"33'4","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:59.956077+0000","last_change":"2024-09-18T01:48:59.956077+0000","last_active":"2024-09-18T01:48:59.956077+0000","last_peered":"2024-09-18T01:48:59.956077+0000","last_clean":"2024-09-18T01:48:59.956077+0000","last_became_active":"2024-09-18T01:45:06.286524+0000","last_became_peered":"2024-09-18T01:45:06.286524+0000","last_unstale":"2024-09-18T01:48:59.956077+0000","last_undegraded":"2024-09-18T01:48:59.956077+0000","last_fullsized":"2024-09-18T01:48:59.956077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:48:59.955964+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:48:59.955964+0000","last_clean_scrub_stamp":"2024-09-18T01:48:59.955964+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:47:30.798351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:00.111985+0000","last_change":"2024-09-18T01:49:00.111985+0000","last_active":"2024-09-18T01:49:00.111985+0000","last_peered":"2024-09-18T01:49:00.111985+0000","last_clean":"2024-09-18T01:49:00.111985+0000","last_became_active":"2024-09-18T01:45:04.298399+0000","last_became_peered":"2024-09-18T01:45:04.298399+0000","last_unstale":"2024-09-18T01:49:00.111985+0000","last_undegraded":"2024-09-18T01:49:00.111985+0000","last_fullsized":"2024-09-18T01:49:00.111985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:00.111843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:00.111843+0000","last_clean_scrub_stamp":"2024-09-18T01:49:00.111843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:39:05.538284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"33'10","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:48.963691+0000","last_change":"2024-09-18T01:48:48.963691+0000","last_active":"2024-09-18T01:48:48.963691+0000","last_peered":"2024-09-18T01:48:48.963691+0000","last_clean":"2024-09-18T01:48:48.963691+0000","last_became_active":"2024-09-18T01:45:06.294670+0000","last_became_peered":"2024-09-18T01:45:06.294670+0000","last_unstale":"2024-09-18T01:48:48.963691+0000","last_undegraded":"2024-09-18T01:48:48.963691+0000","last_fullsized":"2024-09-18T01:48:48.963691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-18T01:48:48.963573+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-18T01:48:48.963573+0000","last_clean_scrub_stamp":"2024-09-18T01:48:48.963573+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:47:46.867517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:05.082415+0000","last_change":"2024-09-18T01:49:05.082415+0000","last_active":"2024-09-18T01:49:05.082415+0000","last_peered":"2024-09-18T01:49:05.082415+0000","last_clean":"2024-09-18T01:49:05.082415+0000","last_became_active":"2024-09-18T01:45:04.286465+0000","last_became_peered":"2024-09-18T01:45:04.286465+0000","last_unstale":"2024-09-18T01:49:05.082415+0000","last_undegraded":"2024-09-18T01:49:05.082415+0000","last_fullsized":"2024-09-18T01:49:05.082415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:05.082258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:05.082258+0000","last_clean_scrub_stamp":"2024-09-18T01:49:05.082258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:16:06.564943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:49.977300+0000","last_change":"2024-09-18T01:48:49.977300+0000","last_active":"2024-09-18T01:48:49.977300+0000","last_peered":"2024-09-18T01:48:49.977300+0000","last_clean":"2024-09-18T01:48:49.977300+0000","last_became_active":"2024-09-18T01:45:06.294118+0000","last_became_peered":"2024-09-18T01:45:06.294118+0000","last_unstale":"2024-09-18T01:48:49.977300+0000","last_undegraded":"2024-09-18T01:48:49.977300+0000","last_fullsized":"2024-09-18T01:48:49.977300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:48:49.977187+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:48:49.977187+0000","last_clean_scrub_stamp":"2024-09-18T01:48:49.977187+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:09:54.691187+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:08.073231+0000","last_change":"2024-09-18T01:49:08.073231+0000","last_active":"2024-09-18T01:49:08.073231+0000","last_peered":"2024-09-18T01:49:08.073231+0000","last_clean":"2024-09-18T01:49:08.073231+0000","last_became_active":"2024-09-18T01:45:04.294327+0000","last_became_peered":"2024-09-18T01:45:04.294327+0000","last_unstale":"2024-09-18T01:49:08.073231+0000","last_undegraded":"2024-09-18T01:49:08.073231+0000","last_fullsized":"2024-09-18T01:49:08.073231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:08.073097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:08.073097+0000","last_clean_scrub_stamp":"2024-09-18T01:49:08.073097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:33:22.408363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'4","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:05.363125+0000","last_change":"2024-09-18T01:49:05.363125+0000","last_active":"2024-09-18T01:49:05.363125+0000","last_peered":"2024-09-18T01:49:05.363125+0000","last_clean":"2024-09-18T01:49:05.363125+0000","last_became_active":"2024-09-18T01:45:06.285429+0000","last_became_peered":"2024-09-18T01:45:06.285429+0000","last_unstale":"2024-09-18T01:49:05.363125+0000","last_undegraded":"2024-09-18T01:49:05.363125+0000","last_fullsized":"2024-09-18T01:49:05.363125+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:49:05.363015+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:49:05.363015+0000","last_clean_scrub_stamp":"2024-09-18T01:49:05.363015+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:53:08.090252+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:58.089192+0000","last_change":"2024-09-18T01:48:58.089192+0000","last_active":"2024-09-18T01:48:58.089192+0000","last_peered":"2024-09-18T01:48:58.089192+0000","last_clean":"2024-09-18T01:48:58.089192+0000","last_became_active":"2024-09-18T01:45:04.298601+0000","last_became_peered":"2024-09-18T01:45:04.298601+0000","last_unstale":"2024-09-18T01:48:58.089192+0000","last_undegraded":"2024-09-18T01:48:58.089192+0000","last_fullsized":"2024-09-18T01:48:58.089192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:58.089075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:58.089075+0000","last_clean_scrub_stamp":"2024-09-18T01:48:58.089075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:14:10.025695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'10","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:00.074940+0000","last_change":"2024-09-18T01:49:00.074940+0000","last_active":"2024-09-18T01:49:00.074940+0000","last_peered":"2024-09-18T01:49:00.074940+0000","last_clean":"2024-09-18T01:49:00.074940+0000","last_became_active":"2024-09-18T01:45:06.285228+0000","last_became_peered":"2024-09-18T01:45:06.285228+0000","last_unstale":"2024-09-18T01:49:00.074940+0000","last_undegraded":"2024-09-18T01:49:00.074940+0000","last_fullsized":"2024-09-18T01:49:00.074940+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-18T01:49:00.074829+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-18T01:49:00.074829+0000","last_clean_scrub_stamp":"2024-09-18T01:49:00.074829+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:14:47.671460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:04.355158+0000","last_change":"2024-09-18T01:49:04.355158+0000","last_active":"2024-09-18T01:49:04.355158+0000","last_peered":"2024-09-18T01:49:04.355158+0000","last_clean":"2024-09-18T01:49:04.355158+0000","last_became_active":"2024-09-18T01:45:04.281118+0000","last_became_peered":"2024-09-18T01:45:04.281118+0000","last_unstale":"2024-09-18T01:49:04.355158+0000","last_undegraded":"2024-09-18T01:49:04.355158+0000","last_fullsized":"2024-09-18T01:49:04.355158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:04.355016+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:04.355016+0000","last_clean_scrub_stamp":"2024-09-18T01:49:04.355016+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:04:07.222319+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"33'16","reported_seq":80,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:54.067746+0000","last_change":"2024-09-18T01:48:54.067746+0000","last_active":"2024-09-18T01:48:54.067746+0000","last_peered":"2024-09-18T01:48:54.067746+0000","last_clean":"2024-09-18T01:48:54.067746+0000","last_became_active":"2024-09-18T01:45:06.284237+0000","last_became_peered":"2024-09-18T01:45:06.284237+0000","last_unstale":"2024-09-18T01:48:54.067746+0000","last_undegraded":"2024-09-18T01:48:54.067746+0000","last_fullsized":"2024-09-18T01:48:54.067746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2024-09-18T01:48:54.067597+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2024-09-18T01:48:54.067597+0000","last_clean_scrub_stamp":"2024-09-18T01:48:54.067597+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:44:52.155664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":48,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:28.008884+0000","last_change":"2024-09-18T01:49:28.008884+0000","last_active":"2024-09-18T01:49:28.008884+0000","last_peered":"2024-09-18T01:49:28.008884+0000","last_clean":"2024-09-18T01:49:28.008884+0000","last_became_active":"2024-09-18T01:45:04.284148+0000","last_became_peered":"2024-09-18T01:45:04.284148+0000","last_unstale":"2024-09-18T01:49:28.008884+0000","last_undegraded":"2024-09-18T01:49:28.008884+0000","last_fullsized":"2024-09-18T01:49:28.008884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:28.008717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:28.008717+0000","last_clean_scrub_stamp":"2024-09-18T01:49:28.008717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:41:39.278243+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'36","reported_seq":109,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:18.085041+0000","last_change":"2024-09-18T01:49:18.085074+0000","last_active":"2024-09-18T01:49:18.085041+0000","last_peered":"2024-09-18T01:49:18.085041+0000","last_clean":"2024-09-18T01:49:18.085041+0000","last_became_active":"2024-09-18T01:45:14.322729+0000","last_became_peered":"2024-09-18T01:45:14.322729+0000","last_unstale":"2024-09-18T01:49:18.085041+0000","last_undegraded":"2024-09-18T01:49:18.085041+0000","last_fullsized":"2024-09-18T01:49:18.085041+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'36","last_scrub_stamp":"2024-09-18T01:49:18.084950+0000","last_deep_scrub":"33'36","last_deep_scrub_stamp":"2024-09-18T01:49:18.084950+0000","last_clean_scrub_stamp":"2024-09-18T01:49:18.084950+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:39:22.889311+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'10","reported_seq":83,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:08.901728+0000","last_change":"2024-09-18T01:49:08.901728+0000","last_active":"2024-09-18T01:49:08.901728+0000","last_peered":"2024-09-18T01:49:08.901728+0000","last_clean":"2024-09-18T01:49:08.901728+0000","last_became_active":"2024-09-18T01:45:06.281361+0000","last_became_peered":"2024-09-18T01:45:06.281361+0000","last_unstale":"2024-09-18T01:49:08.901728+0000","last_undegraded":"2024-09-18T01:49:08.901728+0000","last_fullsized":"2024-09-18T01:49:08.901728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-18T01:49:08.901575+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-18T01:49:08.901575+0000","last_clean_scrub_stamp":"2024-09-18T01:49:08.901575+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:51:58.229652+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:25.951126+0000","last_change":"2024-09-18T01:49:25.951126+0000","last_active":"2024-09-18T01:49:25.951126+0000","last_peered":"2024-09-18T01:49:25.951126+0000","last_clean":"2024-09-18T01:49:25.951126+0000","last_became_active":"2024-09-18T01:45:04.285008+0000","last_became_peered":"2024-09-18T01:45:04.285008+0000","last_unstale":"2024-09-18T01:49:25.951126+0000","last_undegraded":"2024-09-18T01:49:25.951126+0000","last_fullsized":"2024-09-18T01:49:25.951126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:25.951000+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:25.951000+0000","last_clean_scrub_stamp":"2024-09-18T01:49:25.951000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:26:14.441210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:25.014675+0000","last_change":"2024-09-18T01:48:25.014675+0000","last_active":"2024-09-18T01:48:25.014675+0000","last_peered":"2024-09-18T01:48:25.014675+0000","last_clean":"2024-09-18T01:48:25.014675+0000","last_became_active":"2024-09-18T01:45:08.296241+0000","last_became_peered":"2024-09-18T01:45:08.296241+0000","last_unstale":"2024-09-18T01:48:25.014675+0000","last_undegraded":"2024-09-18T01:48:25.014675+0000","last_fullsized":"2024-09-18T01:48:25.014675+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:25.014547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:25.014547+0000","last_clean_scrub_stamp":"2024-09-18T01:48:25.014547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:06:32.938495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'51","reported_seq":119,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:29.025537+0000","last_change":"2024-09-18T01:48:29.025537+0000","last_active":"2024-09-18T01:48:29.025537+0000","last_peered":"2024-09-18T01:48:29.025537+0000","last_clean":"2024-09-18T01:48:29.025537+0000","last_became_active":"2024-09-18T01:45:10.305713+0000","last_became_peered":"2024-09-18T01:45:10.305713+0000","last_unstale":"2024-09-18T01:48:29.025537+0000","last_undegraded":"2024-09-18T01:48:29.025537+0000","last_fullsized":"2024-09-18T01:48:29.025537+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'51","last_scrub_stamp":"2024-09-18T01:48:29.025349+0000","last_deep_scrub":"33'51","last_deep_scrub_stamp":"2024-09-18T01:48:29.025349+0000","last_clean_scrub_stamp":"2024-09-18T01:48:29.025349+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:55:10.299048+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:26.973124+0000","last_change":"2024-09-18T01:48:26.973124+0000","last_active":"2024-09-18T01:48:26.973124+0000","last_peered":"2024-09-18T01:48:26.973124+0000","last_clean":"2024-09-18T01:48:26.973124+0000","last_became_active":"2024-09-18T01:45:12.313276+0000","last_became_peered":"2024-09-18T01:45:12.313276+0000","last_unstale":"2024-09-18T01:48:26.973124+0000","last_undegraded":"2024-09-18T01:48:26.973124+0000","last_fullsized":"2024-09-18T01:48:26.973124+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:26.973012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:26.973012+0000","last_clean_scrub_stamp":"2024-09-18T01:48:26.973012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:54:46.334494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'7","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:46.918917+0000","last_change":"2024-09-18T01:48:46.918960+0000","last_active":"2024-09-18T01:48:46.918917+0000","last_peered":"2024-09-18T01:48:46.918917+0000","last_clean":"2024-09-18T01:48:46.918917+0000","last_became_active":"2024-09-18T01:45:14.318093+0000","last_became_peered":"2024-09-18T01:45:14.318093+0000","last_unstale":"2024-09-18T01:48:46.918917+0000","last_undegraded":"2024-09-18T01:48:46.918917+0000","last_fullsized":"2024-09-18T01:48:46.918917+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-09-18T01:48:46.918798+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-09-18T01:48:46.918798+0000","last_clean_scrub_stamp":"2024-09-18T01:48:46.918798+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:14:34.515429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"33'14","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:16.116506+0000","last_change":"2024-09-18T01:49:16.116550+0000","last_active":"2024-09-18T01:49:16.116506+0000","last_peered":"2024-09-18T01:49:16.116506+0000","last_clean":"2024-09-18T01:49:16.116506+0000","last_became_active":"2024-09-18T01:45:41.338243+0000","last_became_peered":"2024-09-18T01:45:41.338243+0000","last_unstale":"2024-09-18T01:49:16.116506+0000","last_undegraded":"2024-09-18T01:49:16.116506+0000","last_fullsized":"2024-09-18T01:49:16.116506+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-09-18T01:49:16.116373+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-09-18T01:49:16.116373+0000","last_clean_scrub_stamp":"2024-09-18T01:49:16.116373+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:55:17.064370+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":13,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:53.039071+0000","last_change":"2024-09-18T01:48:53.039071+0000","last_active":"2024-09-18T01:48:53.039071+0000","last_peered":"2024-09-18T01:48:53.039071+0000","last_clean":"2024-09-18T01:48:53.039071+0000","last_became_active":"2024-09-18T01:45:04.292853+0000","last_became_peered":"2024-09-18T01:45:04.292853+0000","last_unstale":"2024-09-18T01:48:53.039071+0000","last_undegraded":"2024-09-18T01:48:53.039071+0000","last_fullsized":"2024-09-18T01:48:53.039071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:48:53.038933+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:48:53.038933+0000","last_clean_scrub_stamp":"2024-09-18T01:48:53.038933+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:24:38.409165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:47.382764+0000","last_change":"2024-09-18T01:48:47.382764+0000","last_active":"2024-09-18T01:48:47.382764+0000","last_peered":"2024-09-18T01:48:47.382764+0000","last_clean":"2024-09-18T01:48:47.382764+0000","last_became_active":"2024-09-18T01:45:08.288390+0000","last_became_peered":"2024-09-18T01:45:08.288390+0000","last_unstale":"2024-09-18T01:48:47.382764+0000","last_undegraded":"2024-09-18T01:48:47.382764+0000","last_fullsized":"2024-09-18T01:48:47.382764+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:47.382647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:47.382647+0000","last_clean_scrub_stamp":"2024-09-18T01:48:47.382647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:54:16.834483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"33'16","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:28.924317+0000","last_change":"2024-09-18T01:48:28.924317+0000","last_active":"2024-09-18T01:48:28.924317+0000","last_peered":"2024-09-18T01:48:28.924317+0000","last_clean":"2024-09-18T01:48:28.924317+0000","last_became_active":"2024-09-18T01:45:10.302957+0000","last_became_peered":"2024-09-18T01:45:10.302957+0000","last_unstale":"2024-09-18T01:48:28.924317+0000","last_undegraded":"2024-09-18T01:48:28.924317+0000","last_fullsized":"2024-09-18T01:48:28.924317+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2024-09-18T01:48:28.924202+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2024-09-18T01:48:28.924202+0000","last_clean_scrub_stamp":"2024-09-18T01:48:28.924202+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:40:38.196180+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:34.948803+0000","last_change":"2024-09-18T01:48:34.948803+0000","last_active":"2024-09-18T01:48:34.948803+0000","last_peered":"2024-09-18T01:48:34.948803+0000","last_clean":"2024-09-18T01:48:34.948803+0000","last_became_active":"2024-09-18T01:45:12.317471+0000","last_became_peered":"2024-09-18T01:45:12.317471+0000","last_unstale":"2024-09-18T01:48:34.948803+0000","last_undegraded":"2024-09-18T01:48:34.948803+0000","last_fullsized":"2024-09-18T01:48:34.948803+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:34.948683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:34.948683+0000","last_clean_scrub_stamp":"2024-09-18T01:48:34.948683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:47:33.161713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:22.311066+0000","last_change":"2024-09-18T01:49:22.311092+0000","last_active":"2024-09-18T01:49:22.311066+0000","last_peered":"2024-09-18T01:49:22.311066+0000","last_clean":"2024-09-18T01:49:22.311066+0000","last_became_active":"2024-09-18T01:45:14.319387+0000","last_became_peered":"2024-09-18T01:45:14.319387+0000","last_unstale":"2024-09-18T01:49:22.311066+0000","last_undegraded":"2024-09-18T01:49:22.311066+0000","last_fullsized":"2024-09-18T01:49:22.311066+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-18T01:49:22.310976+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-18T01:49:22.310976+0000","last_clean_scrub_stamp":"2024-09-18T01:49:22.310976+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:05:15.685447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'10","reported_seq":77,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:03.891076+0000","last_change":"2024-09-18T01:49:03.891076+0000","last_active":"2024-09-18T01:49:03.891076+0000","last_peered":"2024-09-18T01:49:03.891076+0000","last_clean":"2024-09-18T01:49:03.891076+0000","last_became_active":"2024-09-18T01:45:06.283815+0000","last_became_peered":"2024-09-18T01:45:06.283815+0000","last_unstale":"2024-09-18T01:49:03.891076+0000","last_undegraded":"2024-09-18T01:49:03.891076+0000","last_fullsized":"2024-09-18T01:49:03.891076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-18T01:49:03.890961+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-18T01:49:03.890961+0000","last_clean_scrub_stamp":"2024-09-18T01:49:03.890961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:29:40.610319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:41.028787+0000","last_change":"2024-09-18T01:49:41.028787+0000","last_active":"2024-09-18T01:49:41.028787+0000","last_peered":"2024-09-18T01:49:41.028787+0000","last_clean":"2024-09-18T01:49:41.028787+0000","last_became_active":"2024-09-18T01:45:04.288040+0000","last_became_peered":"2024-09-18T01:45:04.288040+0000","last_unstale":"2024-09-18T01:49:41.028787+0000","last_undegraded":"2024-09-18T01:49:41.028787+0000","last_fullsized":"2024-09-18T01:49:41.028787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:41.028670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:41.028670+0000","last_clean_scrub_stamp":"2024-09-18T01:49:41.028670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:29:31.975214+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:46.362538+0000","last_change":"2024-09-18T01:48:46.362538+0000","last_active":"2024-09-18T01:48:46.362538+0000","last_peered":"2024-09-18T01:48:46.362538+0000","last_clean":"2024-09-18T01:48:46.362538+0000","last_became_active":"2024-09-18T01:45:08.288667+0000","last_became_peered":"2024-09-18T01:45:08.288667+0000","last_unstale":"2024-09-18T01:48:46.362538+0000","last_undegraded":"2024-09-18T01:48:46.362538+0000","last_fullsized":"2024-09-18T01:48:46.362538+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:46.362403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:46.362403+0000","last_clean_scrub_stamp":"2024-09-18T01:48:46.362403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:47:44.266347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'30","reported_seq":82,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:29.796918+0000","last_change":"2024-09-18T01:48:29.796918+0000","last_active":"2024-09-18T01:48:29.796918+0000","last_peered":"2024-09-18T01:48:29.796918+0000","last_clean":"2024-09-18T01:48:29.796918+0000","last_became_active":"2024-09-18T01:45:10.304004+0000","last_became_peered":"2024-09-18T01:45:10.304004+0000","last_unstale":"2024-09-18T01:48:29.796918+0000","last_undegraded":"2024-09-18T01:48:29.796918+0000","last_fullsized":"2024-09-18T01:48:29.796918+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'30","last_scrub_stamp":"2024-09-18T01:48:29.796760+0000","last_deep_scrub":"33'30","last_deep_scrub_stamp":"2024-09-18T01:48:29.796760+0000","last_clean_scrub_stamp":"2024-09-18T01:48:29.796760+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:49:27.020491+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'286","reported_seq":398,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:58.927175+0000","last_change":"2024-09-18T01:48:58.927175+0000","last_active":"2024-09-18T01:48:58.927175+0000","last_peered":"2024-09-18T01:48:58.927175+0000","last_clean":"2024-09-18T01:48:58.927175+0000","last_became_active":"2024-09-18T01:45:12.317288+0000","last_became_peered":"2024-09-18T01:45:12.317288+0000","last_unstale":"2024-09-18T01:48:58.927175+0000","last_undegraded":"2024-09-18T01:48:58.927175+0000","last_fullsized":"2024-09-18T01:48:58.927175+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'286","last_scrub_stamp":"2024-09-18T01:48:58.926983+0000","last_deep_scrub":"33'286","last_deep_scrub_stamp":"2024-09-18T01:48:58.926983+0000","last_clean_scrub_stamp":"2024-09-18T01:48:58.926983+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:03:15.512790+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:15.087093+0000","last_change":"2024-09-18T01:49:15.087120+0000","last_active":"2024-09-18T01:49:15.087093+0000","last_peered":"2024-09-18T01:49:15.087093+0000","last_clean":"2024-09-18T01:49:15.087093+0000","last_became_active":"2024-09-18T01:45:14.325843+0000","last_became_peered":"2024-09-18T01:45:14.325843+0000","last_unstale":"2024-09-18T01:49:15.087093+0000","last_undegraded":"2024-09-18T01:49:15.087093+0000","last_fullsized":"2024-09-18T01:49:15.087093+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:15.086999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:15.086999+0000","last_clean_scrub_stamp":"2024-09-18T01:49:15.086999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:25:53.638995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:50.402744+0000","last_change":"2024-09-18T01:48:50.402744+0000","last_active":"2024-09-18T01:48:50.402744+0000","last_peered":"2024-09-18T01:48:50.402744+0000","last_clean":"2024-09-18T01:48:50.402744+0000","last_became_active":"2024-09-18T01:45:06.295417+0000","last_became_peered":"2024-09-18T01:45:06.295417+0000","last_unstale":"2024-09-18T01:48:50.402744+0000","last_undegraded":"2024-09-18T01:48:50.402744+0000","last_fullsized":"2024-09-18T01:48:50.402744+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:50.402623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:50.402623+0000","last_clean_scrub_stamp":"2024-09-18T01:48:50.402623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:19:27.434267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:10.036641+0000","last_change":"2024-09-18T01:49:10.036641+0000","last_active":"2024-09-18T01:49:10.036641+0000","last_peered":"2024-09-18T01:49:10.036641+0000","last_clean":"2024-09-18T01:49:10.036641+0000","last_became_active":"2024-09-18T01:45:04.282500+0000","last_became_peered":"2024-09-18T01:45:04.282500+0000","last_unstale":"2024-09-18T01:49:10.036641+0000","last_undegraded":"2024-09-18T01:49:10.036641+0000","last_fullsized":"2024-09-18T01:49:10.036641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:10.036519+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:10.036519+0000","last_clean_scrub_stamp":"2024-09-18T01:49:10.036519+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:23:38.356950+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:27.978949+0000","last_change":"2024-09-18T01:48:27.978949+0000","last_active":"2024-09-18T01:48:27.978949+0000","last_peered":"2024-09-18T01:48:27.978949+0000","last_clean":"2024-09-18T01:48:27.978949+0000","last_became_active":"2024-09-18T01:45:08.296192+0000","last_became_peered":"2024-09-18T01:45:08.296192+0000","last_unstale":"2024-09-18T01:48:27.978949+0000","last_undegraded":"2024-09-18T01:48:27.978949+0000","last_fullsized":"2024-09-18T01:48:27.978949+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:27.978844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:27.978844+0000","last_clean_scrub_stamp":"2024-09-18T01:48:27.978844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:53:57.430680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'43","reported_seq":105,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:26.798290+0000","last_change":"2024-09-18T01:48:26.798290+0000","last_active":"2024-09-18T01:48:26.798290+0000","last_peered":"2024-09-18T01:48:26.798290+0000","last_clean":"2024-09-18T01:48:26.798290+0000","last_became_active":"2024-09-18T01:45:10.305515+0000","last_became_peered":"2024-09-18T01:45:10.305515+0000","last_unstale":"2024-09-18T01:48:26.798290+0000","last_undegraded":"2024-09-18T01:48:26.798290+0000","last_fullsized":"2024-09-18T01:48:26.798290+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-09-18T01:48:26.798150+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-09-18T01:48:26.798150+0000","last_clean_scrub_stamp":"2024-09-18T01:48:26.798150+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:49:57.532711+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'285","reported_seq":413,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:41.311390+0000","last_change":"2024-09-18T01:48:41.311390+0000","last_active":"2024-09-18T01:48:41.311390+0000","last_peered":"2024-09-18T01:48:41.311390+0000","last_clean":"2024-09-18T01:48:41.311390+0000","last_became_active":"2024-09-18T01:45:12.313219+0000","last_became_peered":"2024-09-18T01:45:12.313219+0000","last_unstale":"2024-09-18T01:48:41.311390+0000","last_undegraded":"2024-09-18T01:48:41.311390+0000","last_fullsized":"2024-09-18T01:48:41.311390+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-18T01:48:41.311241+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-18T01:48:41.311241+0000","last_clean_scrub_stamp":"2024-09-18T01:48:41.311241+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:53:48.228429+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"31'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:38.059865+0000","last_change":"2024-09-18T01:48:38.059865+0000","last_active":"2024-09-18T01:48:38.059865+0000","last_peered":"2024-09-18T01:48:38.059865+0000","last_clean":"2024-09-18T01:48:38.059865+0000","last_became_active":"2024-09-18T01:45:06.297283+0000","last_became_peered":"2024-09-18T01:45:06.297283+0000","last_unstale":"2024-09-18T01:48:38.059865+0000","last_undegraded":"2024-09-18T01:48:38.059865+0000","last_fullsized":"2024-09-18T01:48:38.059865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-18T01:48:38.059683+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-18T01:48:38.059683+0000","last_clean_scrub_stamp":"2024-09-18T01:48:38.059683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:38:43.486124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:01.044789+0000","last_change":"2024-09-18T01:49:01.044789+0000","last_active":"2024-09-18T01:49:01.044789+0000","last_peered":"2024-09-18T01:49:01.044789+0000","last_clean":"2024-09-18T01:49:01.044789+0000","last_became_active":"2024-09-18T01:45:04.289629+0000","last_became_peered":"2024-09-18T01:45:04.289629+0000","last_unstale":"2024-09-18T01:49:01.044789+0000","last_undegraded":"2024-09-18T01:49:01.044789+0000","last_fullsized":"2024-09-18T01:49:01.044789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:01.044645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:01.044645+0000","last_clean_scrub_stamp":"2024-09-18T01:49:01.044645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:49:00.735559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:35.930488+0000","last_change":"2024-09-18T01:48:35.930488+0000","last_active":"2024-09-18T01:48:35.930488+0000","last_peered":"2024-09-18T01:48:35.930488+0000","last_clean":"2024-09-18T01:48:35.930488+0000","last_became_active":"2024-09-18T01:45:08.294273+0000","last_became_peered":"2024-09-18T01:45:08.294273+0000","last_unstale":"2024-09-18T01:48:35.930488+0000","last_undegraded":"2024-09-18T01:48:35.930488+0000","last_fullsized":"2024-09-18T01:48:35.930488+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:35.930363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:35.930363+0000","last_clean_scrub_stamp":"2024-09-18T01:48:35.930363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:23:07.518807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'58","reported_seq":125,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:33.850466+0000","last_change":"2024-09-18T01:48:33.850466+0000","last_active":"2024-09-18T01:48:33.850466+0000","last_peered":"2024-09-18T01:48:33.850466+0000","last_clean":"2024-09-18T01:48:33.850466+0000","last_became_active":"2024-09-18T01:45:10.298021+0000","last_became_peered":"2024-09-18T01:45:10.298021+0000","last_unstale":"2024-09-18T01:48:33.850466+0000","last_undegraded":"2024-09-18T01:48:33.850466+0000","last_fullsized":"2024-09-18T01:48:33.850466+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'58","last_scrub_stamp":"2024-09-18T01:48:33.850320+0000","last_deep_scrub":"33'58","last_deep_scrub_stamp":"2024-09-18T01:48:33.850320+0000","last_clean_scrub_stamp":"2024-09-18T01:48:33.850320+0000","objects_scrubbed":10,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:47:26.923881+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:45.319977+0000","last_change":"2024-09-18T01:48:45.319977+0000","last_active":"2024-09-18T01:48:45.319977+0000","last_peered":"2024-09-18T01:48:45.319977+0000","last_clean":"2024-09-18T01:48:45.319977+0000","last_became_active":"2024-09-18T01:45:12.313875+0000","last_became_peered":"2024-09-18T01:45:12.313875+0000","last_unstale":"2024-09-18T01:48:45.319977+0000","last_undegraded":"2024-09-18T01:48:45.319977+0000","last_fullsized":"2024-09-18T01:48:45.319977+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:45.319802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:45.319802+0000","last_clean_scrub_stamp":"2024-09-18T01:48:45.319802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:30:17.984788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'7","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:13.056537+0000","last_change":"2024-09-18T01:49:13.056537+0000","last_active":"2024-09-18T01:49:13.056537+0000","last_peered":"2024-09-18T01:49:13.056537+0000","last_clean":"2024-09-18T01:49:13.056537+0000","last_became_active":"2024-09-18T01:45:14.322448+0000","last_became_peered":"2024-09-18T01:45:14.322448+0000","last_unstale":"2024-09-18T01:49:13.056537+0000","last_undegraded":"2024-09-18T01:49:13.056537+0000","last_fullsized":"2024-09-18T01:49:13.056537+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-09-18T01:49:13.056380+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-09-18T01:49:13.056380+0000","last_clean_scrub_stamp":"2024-09-18T01:49:13.056380+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:58:35.305693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":17,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'8","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:05.100881+0000","last_change":"2024-09-18T01:49:05.100881+0000","last_active":"2024-09-18T01:49:05.100881+0000","last_peered":"2024-09-18T01:49:05.100881+0000","last_clean":"2024-09-18T01:49:05.100881+0000","last_became_active":"2024-09-18T01:45:06.292143+0000","last_became_peered":"2024-09-18T01:45:06.292143+0000","last_unstale":"2024-09-18T01:49:05.100881+0000","last_undegraded":"2024-09-18T01:49:05.100881+0000","last_fullsized":"2024-09-18T01:49:05.100881+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-18T01:49:05.100764+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-18T01:49:05.100764+0000","last_clean_scrub_stamp":"2024-09-18T01:49:05.100764+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:57:47.793679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:55.061241+0000","last_change":"2024-09-18T01:48:55.061241+0000","last_active":"2024-09-18T01:48:55.061241+0000","last_peered":"2024-09-18T01:48:55.061241+0000","last_clean":"2024-09-18T01:48:55.061241+0000","last_became_active":"2024-09-18T01:45:04.292734+0000","last_became_peered":"2024-09-18T01:45:04.292734+0000","last_unstale":"2024-09-18T01:48:55.061241+0000","last_undegraded":"2024-09-18T01:48:55.061241+0000","last_fullsized":"2024-09-18T01:48:55.061241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:55.061101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:55.061101+0000","last_clean_scrub_stamp":"2024-09-18T01:48:55.061101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:28:33.987118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:38.340714+0000","last_change":"2024-09-18T01:48:38.340714+0000","last_active":"2024-09-18T01:48:38.340714+0000","last_peered":"2024-09-18T01:48:38.340714+0000","last_clean":"2024-09-18T01:48:38.340714+0000","last_became_active":"2024-09-18T01:45:08.294026+0000","last_became_peered":"2024-09-18T01:45:08.294026+0000","last_unstale":"2024-09-18T01:48:38.340714+0000","last_undegraded":"2024-09-18T01:48:38.340714+0000","last_fullsized":"2024-09-18T01:48:38.340714+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:38.340604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:38.340604+0000","last_clean_scrub_stamp":"2024-09-18T01:48:38.340604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:23:55.262120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'44","reported_seq":106,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:55.980889+0000","last_change":"2024-09-18T01:48:55.980889+0000","last_active":"2024-09-18T01:48:55.980889+0000","last_peered":"2024-09-18T01:48:55.980889+0000","last_clean":"2024-09-18T01:48:55.980889+0000","last_became_active":"2024-09-18T01:45:10.307420+0000","last_became_peered":"2024-09-18T01:45:10.307420+0000","last_unstale":"2024-09-18T01:48:55.980889+0000","last_undegraded":"2024-09-18T01:48:55.980889+0000","last_fullsized":"2024-09-18T01:48:55.980889+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'44","last_scrub_stamp":"2024-09-18T01:48:55.980766+0000","last_deep_scrub":"33'44","last_deep_scrub_stamp":"2024-09-18T01:48:55.980766+0000","last_clean_scrub_stamp":"2024-09-18T01:48:55.980766+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:39:00.785127+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:27.225386+0000","last_change":"2024-09-18T01:48:27.225386+0000","last_active":"2024-09-18T01:48:27.225386+0000","last_peered":"2024-09-18T01:48:27.225386+0000","last_clean":"2024-09-18T01:48:27.225386+0000","last_became_active":"2024-09-18T01:45:12.305838+0000","last_became_peered":"2024-09-18T01:45:12.305838+0000","last_unstale":"2024-09-18T01:48:27.225386+0000","last_undegraded":"2024-09-18T01:48:27.225386+0000","last_fullsized":"2024-09-18T01:48:27.225386+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:27.225273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:27.225273+0000","last_clean_scrub_stamp":"2024-09-18T01:48:27.225273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:40:36.497250+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'4","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:50.995327+0000","last_change":"2024-09-18T01:48:50.995327+0000","last_active":"2024-09-18T01:48:50.995327+0000","last_peered":"2024-09-18T01:48:50.995327+0000","last_clean":"2024-09-18T01:48:50.995327+0000","last_became_active":"2024-09-18T01:45:14.322272+0000","last_became_peered":"2024-09-18T01:45:14.322272+0000","last_unstale":"2024-09-18T01:48:50.995327+0000","last_undegraded":"2024-09-18T01:48:50.995327+0000","last_fullsized":"2024-09-18T01:48:50.995327+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:48:50.995161+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:48:50.995161+0000","last_clean_scrub_stamp":"2024-09-18T01:48:50.995161+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:39:37.704225+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"33'8","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:54.036697+0000","last_change":"2024-09-18T01:48:54.036697+0000","last_active":"2024-09-18T01:48:54.036697+0000","last_peered":"2024-09-18T01:48:54.036697+0000","last_clean":"2024-09-18T01:48:54.036697+0000","last_became_active":"2024-09-18T01:45:06.284677+0000","last_became_peered":"2024-09-18T01:45:06.284677+0000","last_unstale":"2024-09-18T01:48:54.036697+0000","last_undegraded":"2024-09-18T01:48:54.036697+0000","last_fullsized":"2024-09-18T01:48:54.036697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-18T01:48:54.036561+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-18T01:48:54.036561+0000","last_clean_scrub_stamp":"2024-09-18T01:48:54.036561+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:24:10.958078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:23.928837+0000","last_change":"2024-09-18T01:49:23.928837+0000","last_active":"2024-09-18T01:49:23.928837+0000","last_peered":"2024-09-18T01:49:23.928837+0000","last_clean":"2024-09-18T01:49:23.928837+0000","last_became_active":"2024-09-18T01:45:04.284151+0000","last_became_peered":"2024-09-18T01:45:04.284151+0000","last_unstale":"2024-09-18T01:49:23.928837+0000","last_undegraded":"2024-09-18T01:49:23.928837+0000","last_fullsized":"2024-09-18T01:49:23.928837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:23.928722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:23.928722+0000","last_clean_scrub_stamp":"2024-09-18T01:49:23.928722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:34:26.481735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:44.316921+0000","last_change":"2024-09-18T01:48:44.316921+0000","last_active":"2024-09-18T01:48:44.316921+0000","last_peered":"2024-09-18T01:48:44.316921+0000","last_clean":"2024-09-18T01:48:44.316921+0000","last_became_active":"2024-09-18T01:45:08.289521+0000","last_became_peered":"2024-09-18T01:45:08.289521+0000","last_unstale":"2024-09-18T01:48:44.316921+0000","last_undegraded":"2024-09-18T01:48:44.316921+0000","last_fullsized":"2024-09-18T01:48:44.316921+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:44.316811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:44.316811+0000","last_clean_scrub_stamp":"2024-09-18T01:48:44.316811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:06:52.240759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'60","reported_seq":131,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:31.041221+0000","last_change":"2024-09-18T01:48:31.041221+0000","last_active":"2024-09-18T01:48:31.041221+0000","last_peered":"2024-09-18T01:48:31.041221+0000","last_clean":"2024-09-18T01:48:31.041221+0000","last_became_active":"2024-09-18T01:45:10.306481+0000","last_became_peered":"2024-09-18T01:45:10.306481+0000","last_unstale":"2024-09-18T01:48:31.041221+0000","last_undegraded":"2024-09-18T01:48:31.041221+0000","last_fullsized":"2024-09-18T01:48:31.041221+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'60","last_scrub_stamp":"2024-09-18T01:48:31.041096+0000","last_deep_scrub":"33'60","last_deep_scrub_stamp":"2024-09-18T01:48:31.041096+0000","last_clean_scrub_stamp":"2024-09-18T01:48:31.041096+0000","objects_scrubbed":9,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:19:08.072740+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'285","reported_seq":360,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:33.295906+0000","last_change":"2024-09-18T01:48:33.295906+0000","last_active":"2024-09-18T01:48:33.295906+0000","last_peered":"2024-09-18T01:48:33.295906+0000","last_clean":"2024-09-18T01:48:33.295906+0000","last_became_active":"2024-09-18T01:45:12.313065+0000","last_became_peered":"2024-09-18T01:45:12.313065+0000","last_unstale":"2024-09-18T01:48:33.295906+0000","last_undegraded":"2024-09-18T01:48:33.295906+0000","last_fullsized":"2024-09-18T01:48:33.295906+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-18T01:48:33.295792+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-18T01:48:33.295792+0000","last_clean_scrub_stamp":"2024-09-18T01:48:33.295792+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:47:31.508822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"33'2","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:25.311129+0000","last_change":"2024-09-18T01:49:25.311129+0000","last_active":"2024-09-18T01:49:25.311129+0000","last_peered":"2024-09-18T01:49:25.311129+0000","last_clean":"2024-09-18T01:49:25.311129+0000","last_became_active":"2024-09-18T01:45:14.319805+0000","last_became_peered":"2024-09-18T01:45:14.319805+0000","last_unstale":"2024-09-18T01:49:25.311129+0000","last_undegraded":"2024-09-18T01:49:25.311129+0000","last_fullsized":"2024-09-18T01:49:25.311129+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:25.311030+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:25.311030+0000","last_clean_scrub_stamp":"2024-09-18T01:49:25.311030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:40:41.717263+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"33'10","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:47.050714+0000","last_change":"2024-09-18T01:48:47.050714+0000","last_active":"2024-09-18T01:48:47.050714+0000","last_peered":"2024-09-18T01:48:47.050714+0000","last_clean":"2024-09-18T01:48:47.050714+0000","last_became_active":"2024-09-18T01:45:06.281444+0000","last_became_peered":"2024-09-18T01:45:06.281444+0000","last_unstale":"2024-09-18T01:48:47.050714+0000","last_undegraded":"2024-09-18T01:48:47.050714+0000","last_fullsized":"2024-09-18T01:48:47.050714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-18T01:48:47.050596+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-18T01:48:47.050596+0000","last_clean_scrub_stamp":"2024-09-18T01:48:47.050596+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:04:32.118971+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:22.931837+0000","last_change":"2024-09-18T01:49:22.931837+0000","last_active":"2024-09-18T01:49:22.931837+0000","last_peered":"2024-09-18T01:49:22.931837+0000","last_clean":"2024-09-18T01:49:22.931837+0000","last_became_active":"2024-09-18T01:45:04.289216+0000","last_became_peered":"2024-09-18T01:45:04.289216+0000","last_unstale":"2024-09-18T01:49:22.931837+0000","last_undegraded":"2024-09-18T01:49:22.931837+0000","last_fullsized":"2024-09-18T01:49:22.931837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:22.931666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:22.931666+0000","last_clean_scrub_stamp":"2024-09-18T01:49:22.931666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:47:28.991122+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:42.306236+0000","last_change":"2024-09-18T01:48:42.306236+0000","last_active":"2024-09-18T01:48:42.306236+0000","last_peered":"2024-09-18T01:48:42.306236+0000","last_clean":"2024-09-18T01:48:42.306236+0000","last_became_active":"2024-09-18T01:45:08.289725+0000","last_became_peered":"2024-09-18T01:45:08.289725+0000","last_unstale":"2024-09-18T01:48:42.306236+0000","last_undegraded":"2024-09-18T01:48:42.306236+0000","last_fullsized":"2024-09-18T01:48:42.306236+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:42.306116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:42.306116+0000","last_clean_scrub_stamp":"2024-09-18T01:48:42.306116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:12:34.242137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"33'84","reported_seq":170,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:48.994684+0000","last_change":"2024-09-18T01:48:48.994684+0000","last_active":"2024-09-18T01:48:48.994684+0000","last_peered":"2024-09-18T01:48:48.994684+0000","last_clean":"2024-09-18T01:48:48.994684+0000","last_became_active":"2024-09-18T01:45:10.309360+0000","last_became_peered":"2024-09-18T01:45:10.309360+0000","last_unstale":"2024-09-18T01:48:48.994684+0000","last_undegraded":"2024-09-18T01:48:48.994684+0000","last_fullsized":"2024-09-18T01:48:48.994684+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'84","last_scrub_stamp":"2024-09-18T01:48:48.994559+0000","last_deep_scrub":"33'84","last_deep_scrub_stamp":"2024-09-18T01:48:48.994559+0000","last_clean_scrub_stamp":"2024-09-18T01:48:48.994559+0000","objects_scrubbed":7,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:06:39.021603+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5903,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":90,"num_read_kb":105,"num_write":42,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:29.256596+0000","last_change":"2024-09-18T01:48:29.256596+0000","last_active":"2024-09-18T01:48:29.256596+0000","last_peered":"2024-09-18T01:48:29.256596+0000","last_clean":"2024-09-18T01:48:29.256596+0000","last_became_active":"2024-09-18T01:45:12.312665+0000","last_became_peered":"2024-09-18T01:45:12.312665+0000","last_unstale":"2024-09-18T01:48:29.256596+0000","last_undegraded":"2024-09-18T01:48:29.256596+0000","last_fullsized":"2024-09-18T01:48:29.256596+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:29.256466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:29.256466+0000","last_clean_scrub_stamp":"2024-09-18T01:48:29.256466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:07:14.275320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'21","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:26.309796+0000","last_change":"2024-09-18T01:49:26.309796+0000","last_active":"2024-09-18T01:49:26.309796+0000","last_peered":"2024-09-18T01:49:26.309796+0000","last_clean":"2024-09-18T01:49:26.309796+0000","last_became_active":"2024-09-18T01:45:14.319638+0000","last_became_peered":"2024-09-18T01:45:14.319638+0000","last_unstale":"2024-09-18T01:49:26.309796+0000","last_undegraded":"2024-09-18T01:49:26.309796+0000","last_fullsized":"2024-09-18T01:49:26.309796+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'21","last_scrub_stamp":"2024-09-18T01:49:26.309628+0000","last_deep_scrub":"33'21","last_deep_scrub_stamp":"2024-09-18T01:49:26.309628+0000","last_clean_scrub_stamp":"2024-09-18T01:49:26.309628+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:51:44.953615+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:55.048167+0000","last_change":"2024-09-18T01:48:55.048167+0000","last_active":"2024-09-18T01:48:55.048167+0000","last_peered":"2024-09-18T01:48:55.048167+0000","last_clean":"2024-09-18T01:48:55.048167+0000","last_became_active":"2024-09-18T01:45:06.290087+0000","last_became_peered":"2024-09-18T01:45:06.290087+0000","last_unstale":"2024-09-18T01:48:55.048167+0000","last_undegraded":"2024-09-18T01:48:55.048167+0000","last_fullsized":"2024-09-18T01:48:55.048167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:48:55.048003+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:48:55.048003+0000","last_clean_scrub_stamp":"2024-09-18T01:48:55.048003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:28:28.602326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:18.345193+0000","last_change":"2024-09-18T01:49:18.345193+0000","last_active":"2024-09-18T01:49:18.345193+0000","last_peered":"2024-09-18T01:49:18.345193+0000","last_clean":"2024-09-18T01:49:18.345193+0000","last_became_active":"2024-09-18T01:45:04.278979+0000","last_became_peered":"2024-09-18T01:45:04.278979+0000","last_unstale":"2024-09-18T01:49:18.345193+0000","last_undegraded":"2024-09-18T01:49:18.345193+0000","last_fullsized":"2024-09-18T01:49:18.345193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:18.345077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:18.345077+0000","last_clean_scrub_stamp":"2024-09-18T01:49:18.345077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:47:49.187464+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:36.904948+0000","last_change":"2024-09-18T01:48:36.904948+0000","last_active":"2024-09-18T01:48:36.904948+0000","last_peered":"2024-09-18T01:48:36.904948+0000","last_clean":"2024-09-18T01:48:36.904948+0000","last_became_active":"2024-09-18T01:45:08.292156+0000","last_became_peered":"2024-09-18T01:45:08.292156+0000","last_unstale":"2024-09-18T01:48:36.904948+0000","last_undegraded":"2024-09-18T01:48:36.904948+0000","last_fullsized":"2024-09-18T01:48:36.904948+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:36.904811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:36.904811+0000","last_clean_scrub_stamp":"2024-09-18T01:48:36.904811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:16:10.795874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'46","reported_seq":109,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:31.876752+0000","last_change":"2024-09-18T01:48:31.876752+0000","last_active":"2024-09-18T01:48:31.876752+0000","last_peered":"2024-09-18T01:48:31.876752+0000","last_clean":"2024-09-18T01:48:31.876752+0000","last_became_active":"2024-09-18T01:45:10.300488+0000","last_became_peered":"2024-09-18T01:45:10.300488+0000","last_unstale":"2024-09-18T01:48:31.876752+0000","last_undegraded":"2024-09-18T01:48:31.876752+0000","last_fullsized":"2024-09-18T01:48:31.876752+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'46","last_scrub_stamp":"2024-09-18T01:48:31.876630+0000","last_deep_scrub":"33'46","last_deep_scrub_stamp":"2024-09-18T01:48:31.876630+0000","last_clean_scrub_stamp":"2024-09-18T01:48:31.876630+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:14:05.046500+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:45.045948+0000","last_change":"2024-09-18T01:48:45.045948+0000","last_active":"2024-09-18T01:48:45.045948+0000","last_peered":"2024-09-18T01:48:45.045948+0000","last_clean":"2024-09-18T01:48:45.045948+0000","last_became_active":"2024-09-18T01:45:12.315695+0000","last_became_peered":"2024-09-18T01:45:12.315695+0000","last_unstale":"2024-09-18T01:48:45.045948+0000","last_undegraded":"2024-09-18T01:48:45.045948+0000","last_fullsized":"2024-09-18T01:48:45.045948+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:45.045766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:45.045766+0000","last_clean_scrub_stamp":"2024-09-18T01:48:45.045766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:18:11.087673+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"33'4","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:45.053272+0000","last_change":"2024-09-18T01:49:45.053300+0000","last_active":"2024-09-18T01:49:45.053272+0000","last_peered":"2024-09-18T01:49:45.053272+0000","last_clean":"2024-09-18T01:49:45.053272+0000","last_became_active":"2024-09-18T01:45:14.326209+0000","last_became_peered":"2024-09-18T01:45:14.326209+0000","last_unstale":"2024-09-18T01:49:45.053272+0000","last_undegraded":"2024-09-18T01:49:45.053272+0000","last_fullsized":"2024-09-18T01:49:45.053272+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:49:45.053168+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:49:45.053168+0000","last_clean_scrub_stamp":"2024-09-18T01:49:45.053168+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:13:11.502653+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:44.062795+0000","last_change":"2024-09-18T01:48:44.062795+0000","last_active":"2024-09-18T01:48:44.062795+0000","last_peered":"2024-09-18T01:48:44.062795+0000","last_clean":"2024-09-18T01:48:44.062795+0000","last_became_active":"2024-09-18T01:45:06.285771+0000","last_became_peered":"2024-09-18T01:45:06.285771+0000","last_unstale":"2024-09-18T01:48:44.062795+0000","last_undegraded":"2024-09-18T01:48:44.062795+0000","last_fullsized":"2024-09-18T01:48:44.062795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:48:44.062649+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:48:44.062649+0000","last_clean_scrub_stamp":"2024-09-18T01:48:44.062649+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:57:52.976791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:21.979209+0000","last_change":"2024-09-18T01:49:21.979209+0000","last_active":"2024-09-18T01:49:21.979209+0000","last_peered":"2024-09-18T01:49:21.979209+0000","last_clean":"2024-09-18T01:49:21.979209+0000","last_became_active":"2024-09-18T01:45:04.287263+0000","last_became_peered":"2024-09-18T01:45:04.287263+0000","last_unstale":"2024-09-18T01:49:21.979209+0000","last_undegraded":"2024-09-18T01:49:21.979209+0000","last_fullsized":"2024-09-18T01:49:21.979209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:49:21.979054+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:49:21.979054+0000","last_clean_scrub_stamp":"2024-09-18T01:49:21.979054+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:23:37.589553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:43.281610+0000","last_change":"2024-09-18T01:48:43.281610+0000","last_active":"2024-09-18T01:48:43.281610+0000","last_peered":"2024-09-18T01:48:43.281610+0000","last_clean":"2024-09-18T01:48:43.281610+0000","last_became_active":"2024-09-18T01:45:08.289604+0000","last_became_peered":"2024-09-18T01:45:08.289604+0000","last_unstale":"2024-09-18T01:48:43.281610+0000","last_undegraded":"2024-09-18T01:48:43.281610+0000","last_fullsized":"2024-09-18T01:48:43.281610+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:43.281481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:43.281481+0000","last_clean_scrub_stamp":"2024-09-18T01:48:43.281481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:37:19.077361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'46","reported_seq":105,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:32.804773+0000","last_change":"2024-09-18T01:48:32.804773+0000","last_active":"2024-09-18T01:48:32.804773+0000","last_peered":"2024-09-18T01:48:32.804773+0000","last_clean":"2024-09-18T01:48:32.804773+0000","last_became_active":"2024-09-18T01:45:10.297511+0000","last_became_peered":"2024-09-18T01:45:10.297511+0000","last_unstale":"2024-09-18T01:48:32.804773+0000","last_undegraded":"2024-09-18T01:48:32.804773+0000","last_fullsized":"2024-09-18T01:48:32.804773+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'46","last_scrub_stamp":"2024-09-18T01:48:32.804654+0000","last_deep_scrub":"33'46","last_deep_scrub_stamp":"2024-09-18T01:48:32.804654+0000","last_clean_scrub_stamp":"2024-09-18T01:48:32.804654+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:33:34.219867+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'285","reported_seq":415,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:39.926622+0000","last_change":"2024-09-18T01:48:39.926622+0000","last_active":"2024-09-18T01:48:39.926622+0000","last_peered":"2024-09-18T01:48:39.926622+0000","last_clean":"2024-09-18T01:48:39.926622+0000","last_became_active":"2024-09-18T01:45:12.314918+0000","last_became_peered":"2024-09-18T01:45:12.314918+0000","last_unstale":"2024-09-18T01:48:39.926622+0000","last_undegraded":"2024-09-18T01:48:39.926622+0000","last_fullsized":"2024-09-18T01:48:39.926622+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-18T01:48:39.926503+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-18T01:48:39.926503+0000","last_clean_scrub_stamp":"2024-09-18T01:48:39.926503+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:49:29.916648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'13","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:23.297272+0000","last_change":"2024-09-18T01:49:23.297272+0000","last_active":"2024-09-18T01:49:23.297272+0000","last_peered":"2024-09-18T01:49:23.297272+0000","last_clean":"2024-09-18T01:49:23.297272+0000","last_became_active":"2024-09-18T01:45:14.319364+0000","last_became_peered":"2024-09-18T01:45:14.319364+0000","last_unstale":"2024-09-18T01:49:23.297272+0000","last_undegraded":"2024-09-18T01:49:23.297272+0000","last_fullsized":"2024-09-18T01:49:23.297272+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'13","last_scrub_stamp":"2024-09-18T01:49:23.297109+0000","last_deep_scrub":"33'13","last_deep_scrub_stamp":"2024-09-18T01:49:23.297109+0000","last_clean_scrub_stamp":"2024-09-18T01:49:23.297109+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:09:52.972445+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:10.031044+0000","last_change":"2024-09-18T01:49:10.031044+0000","last_active":"2024-09-18T01:49:10.031044+0000","last_peered":"2024-09-18T01:49:10.031044+0000","last_clean":"2024-09-18T01:49:10.031044+0000","last_became_active":"2024-09-18T01:45:06.291023+0000","last_became_peered":"2024-09-18T01:45:06.291023+0000","last_unstale":"2024-09-18T01:49:10.031044+0000","last_undegraded":"2024-09-18T01:49:10.031044+0000","last_fullsized":"2024-09-18T01:49:10.031044+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:49:10.030902+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:49:10.030902+0000","last_clean_scrub_stamp":"2024-09-18T01:49:10.030902+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:45:15.238343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:13.876222+0000","last_change":"2024-09-18T01:49:13.876222+0000","last_active":"2024-09-18T01:49:13.876222+0000","last_peered":"2024-09-18T01:49:13.876222+0000","last_clean":"2024-09-18T01:49:13.876222+0000","last_became_active":"2024-09-18T01:45:04.288386+0000","last_became_peered":"2024-09-18T01:45:04.288386+0000","last_unstale":"2024-09-18T01:49:13.876222+0000","last_undegraded":"2024-09-18T01:49:13.876222+0000","last_fullsized":"2024-09-18T01:49:13.876222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:13.876090+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:13.876090+0000","last_clean_scrub_stamp":"2024-09-18T01:49:13.876090+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:15:56.056182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'5","reported_seq":429,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:37.935983+0000","last_change":"2024-09-18T01:48:37.935983+0000","last_active":"2024-09-18T01:48:37.935983+0000","last_peered":"2024-09-18T01:48:37.935983+0000","last_clean":"2024-09-18T01:48:37.935983+0000","last_became_active":"2024-09-18T01:45:08.289478+0000","last_became_peered":"2024-09-18T01:45:08.289478+0000","last_unstale":"2024-09-18T01:48:37.935983+0000","last_undegraded":"2024-09-18T01:48:37.935983+0000","last_fullsized":"2024-09-18T01:48:37.935983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-18T01:48:37.935837+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-18T01:48:37.935837+0000","last_clean_scrub_stamp":"2024-09-18T01:48:37.935837+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:10:09.966686+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'16","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:35.107168+0000","last_change":"2024-09-18T01:48:35.107168+0000","last_active":"2024-09-18T01:48:35.107168+0000","last_peered":"2024-09-18T01:48:35.107168+0000","last_clean":"2024-09-18T01:48:35.107168+0000","last_became_active":"2024-09-18T01:45:10.307374+0000","last_became_peered":"2024-09-18T01:45:10.307374+0000","last_unstale":"2024-09-18T01:48:35.107168+0000","last_undegraded":"2024-09-18T01:48:35.107168+0000","last_fullsized":"2024-09-18T01:48:35.107168+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2024-09-18T01:48:35.106992+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2024-09-18T01:48:35.106992+0000","last_clean_scrub_stamp":"2024-09-18T01:48:35.106992+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:54:20.385136+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'285","reported_seq":477,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:25.009780+0000","last_change":"2024-09-18T01:48:25.009780+0000","last_active":"2024-09-18T01:48:25.009780+0000","last_peered":"2024-09-18T01:48:25.009780+0000","last_clean":"2024-09-18T01:48:25.009780+0000","last_became_active":"2024-09-18T01:45:12.311929+0000","last_became_peered":"2024-09-18T01:45:12.311929+0000","last_unstale":"2024-09-18T01:48:25.009780+0000","last_undegraded":"2024-09-18T01:48:25.009780+0000","last_fullsized":"2024-09-18T01:48:25.009780+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-18T01:48:25.009658+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-18T01:48:25.009658+0000","last_clean_scrub_stamp":"2024-09-18T01:48:25.009658+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:37:56.338472+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"33'6","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:12.045730+0000","last_change":"2024-09-18T01:49:12.045730+0000","last_active":"2024-09-18T01:49:12.045730+0000","last_peered":"2024-09-18T01:49:12.045730+0000","last_clean":"2024-09-18T01:49:12.045730+0000","last_became_active":"2024-09-18T01:45:14.318418+0000","last_became_peered":"2024-09-18T01:45:14.318418+0000","last_unstale":"2024-09-18T01:49:12.045730+0000","last_undegraded":"2024-09-18T01:49:12.045730+0000","last_fullsized":"2024-09-18T01:49:12.045730+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-18T01:49:12.045604+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-18T01:49:12.045604+0000","last_clean_scrub_stamp":"2024-09-18T01:49:12.045604+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:14:23.982223+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"31'4","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:41.845938+0000","last_change":"2024-09-18T01:48:41.845938+0000","last_active":"2024-09-18T01:48:41.845938+0000","last_peered":"2024-09-18T01:48:41.845938+0000","last_clean":"2024-09-18T01:48:41.845938+0000","last_became_active":"2024-09-18T01:45:06.296824+0000","last_became_peered":"2024-09-18T01:45:06.296824+0000","last_unstale":"2024-09-18T01:48:41.845938+0000","last_undegraded":"2024-09-18T01:48:41.845938+0000","last_fullsized":"2024-09-18T01:48:41.845938+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-18T01:48:41.845784+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-18T01:48:41.845784+0000","last_clean_scrub_stamp":"2024-09-18T01:48:41.845784+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:28:20.771801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:16.871275+0000","last_change":"2024-09-18T01:49:16.871275+0000","last_active":"2024-09-18T01:49:16.871275+0000","last_peered":"2024-09-18T01:49:16.871275+0000","last_clean":"2024-09-18T01:49:16.871275+0000","last_became_active":"2024-09-18T01:45:04.287961+0000","last_became_peered":"2024-09-18T01:45:04.287961+0000","last_unstale":"2024-09-18T01:49:16.871275+0000","last_undegraded":"2024-09-18T01:49:16.871275+0000","last_fullsized":"2024-09-18T01:49:16.871275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:49:16.871156+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:49:16.871156+0000","last_clean_scrub_stamp":"2024-09-18T01:49:16.871156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:52:07.012599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:30.056238+0000","last_change":"2024-09-18T01:48:30.056238+0000","last_active":"2024-09-18T01:48:30.056238+0000","last_peered":"2024-09-18T01:48:30.056238+0000","last_clean":"2024-09-18T01:48:30.056238+0000","last_became_active":"2024-09-18T01:45:08.294053+0000","last_became_peered":"2024-09-18T01:45:08.294053+0000","last_unstale":"2024-09-18T01:48:30.056238+0000","last_undegraded":"2024-09-18T01:48:30.056238+0000","last_fullsized":"2024-09-18T01:48:30.056238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:30.056116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:30.056116+0000","last_clean_scrub_stamp":"2024-09-18T01:48:30.056116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:08:42.773951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'49","reported_seq":109,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:32.916950+0000","last_change":"2024-09-18T01:48:32.916950+0000","last_active":"2024-09-18T01:48:32.916950+0000","last_peered":"2024-09-18T01:48:32.916950+0000","last_clean":"2024-09-18T01:48:32.916950+0000","last_became_active":"2024-09-18T01:45:10.300337+0000","last_became_peered":"2024-09-18T01:45:10.300337+0000","last_unstale":"2024-09-18T01:48:32.916950+0000","last_undegraded":"2024-09-18T01:48:32.916950+0000","last_fullsized":"2024-09-18T01:48:32.916950+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'49","last_scrub_stamp":"2024-09-18T01:48:32.916825+0000","last_deep_scrub":"33'49","last_deep_scrub_stamp":"2024-09-18T01:48:32.916825+0000","last_clean_scrub_stamp":"2024-09-18T01:48:32.916825+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:18:05.044892+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:25.794798+0000","last_change":"2024-09-18T01:48:25.794798+0000","last_active":"2024-09-18T01:48:25.794798+0000","last_peered":"2024-09-18T01:48:25.794798+0000","last_clean":"2024-09-18T01:48:25.794798+0000","last_became_active":"2024-09-18T01:45:12.307210+0000","last_became_peered":"2024-09-18T01:45:12.307210+0000","last_unstale":"2024-09-18T01:48:25.794798+0000","last_undegraded":"2024-09-18T01:48:25.794798+0000","last_fullsized":"2024-09-18T01:48:25.794798+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:25.794656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:25.794656+0000","last_clean_scrub_stamp":"2024-09-18T01:48:25.794656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:43:11.167455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'6","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:38.907977+0000","last_change":"2024-09-18T01:48:38.907977+0000","last_active":"2024-09-18T01:48:38.907977+0000","last_peered":"2024-09-18T01:48:38.907977+0000","last_clean":"2024-09-18T01:48:38.907977+0000","last_became_active":"2024-09-18T01:45:14.314786+0000","last_became_peered":"2024-09-18T01:45:14.314786+0000","last_unstale":"2024-09-18T01:48:38.907977+0000","last_undegraded":"2024-09-18T01:48:38.907977+0000","last_fullsized":"2024-09-18T01:48:38.907977+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-18T01:48:38.907803+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-18T01:48:38.907803+0000","last_clean_scrub_stamp":"2024-09-18T01:48:38.907803+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:42:22.155558+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"33'2","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:57.936018+0000","last_change":"2024-09-18T01:48:57.936018+0000","last_active":"2024-09-18T01:48:57.936018+0000","last_peered":"2024-09-18T01:48:57.936018+0000","last_clean":"2024-09-18T01:48:57.936018+0000","last_became_active":"2024-09-18T01:45:06.286138+0000","last_became_peered":"2024-09-18T01:45:06.286138+0000","last_unstale":"2024-09-18T01:48:57.936018+0000","last_undegraded":"2024-09-18T01:48:57.936018+0000","last_fullsized":"2024-09-18T01:48:57.936018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:48:57.935901+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:48:57.935901+0000","last_clean_scrub_stamp":"2024-09-18T01:48:57.935901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:05:06.158791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"33'119","reported_seq":217,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:09.052864+0000","last_change":"2024-09-18T01:49:09.052903+0000","last_active":"2024-09-18T01:49:09.052864+0000","last_peered":"2024-09-18T01:49:09.052864+0000","last_clean":"2024-09-18T01:49:09.052864+0000","last_became_active":"2024-09-18T01:44:49.572263+0000","last_became_peered":"2024-09-18T01:44:49.572263+0000","last_unstale":"2024-09-18T01:49:09.052864+0000","last_undegraded":"2024-09-18T01:49:09.052864+0000","last_fullsized":"2024-09-18T01:49:09.052864+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'119","last_scrub_stamp":"2024-09-18T01:49:09.052773+0000","last_deep_scrub":"33'119","last_deep_scrub_stamp":"2024-09-18T01:49:09.052773+0000","last_clean_scrub_stamp":"2024-09-18T01:49:09.052773+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:55:10.210330+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"33'2","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:32.978027+0000","last_change":"2024-09-18T01:49:32.978053+0000","last_active":"2024-09-18T01:49:32.978027+0000","last_peered":"2024-09-18T01:49:32.978027+0000","last_clean":"2024-09-18T01:49:32.978027+0000","last_became_active":"2024-09-18T01:44:53.233974+0000","last_became_peered":"2024-09-18T01:44:53.233974+0000","last_unstale":"2024-09-18T01:49:32.978027+0000","last_undegraded":"2024-09-18T01:49:32.978027+0000","last_fullsized":"2024-09-18T01:49:32.978027+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:32.977943+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:32.977943+0000","last_clean_scrub_stamp":"2024-09-18T01:49:32.977943+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:19:52.736971+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00045237700000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:18.910758+0000","last_change":"2024-09-18T01:49:18.910786+0000","last_active":"2024-09-18T01:49:18.910758+0000","last_peered":"2024-09-18T01:49:18.910758+0000","last_clean":"2024-09-18T01:49:18.910758+0000","last_became_active":"2024-09-18T01:45:04.287763+0000","last_became_peered":"2024-09-18T01:45:04.287763+0000","last_unstale":"2024-09-18T01:49:18.910758+0000","last_undegraded":"2024-09-18T01:49:18.910758+0000","last_fullsized":"2024-09-18T01:49:18.910758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:18.910665+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:18.910665+0000","last_clean_scrub_stamp":"2024-09-18T01:49:18.910665+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:25:07.123332+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:39.901227+0000","last_change":"2024-09-18T01:48:39.901227+0000","last_active":"2024-09-18T01:48:39.901227+0000","last_peered":"2024-09-18T01:48:39.901227+0000","last_clean":"2024-09-18T01:48:39.901227+0000","last_became_active":"2024-09-18T01:45:08.288131+0000","last_became_peered":"2024-09-18T01:45:08.288131+0000","last_unstale":"2024-09-18T01:48:39.901227+0000","last_undegraded":"2024-09-18T01:48:39.901227+0000","last_fullsized":"2024-09-18T01:48:39.901227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:39.901111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:39.901111+0000","last_clean_scrub_stamp":"2024-09-18T01:48:39.901111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:24:25.271343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'95","reported_seq":192,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:27.011354+0000","last_change":"2024-09-18T01:48:27.011354+0000","last_active":"2024-09-18T01:48:27.011354+0000","last_peered":"2024-09-18T01:48:27.011354+0000","last_clean":"2024-09-18T01:48:27.011354+0000","last_became_active":"2024-09-18T01:45:10.305004+0000","last_became_peered":"2024-09-18T01:45:10.305004+0000","last_unstale":"2024-09-18T01:48:27.011354+0000","last_undegraded":"2024-09-18T01:48:27.011354+0000","last_fullsized":"2024-09-18T01:48:27.011354+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'95","last_scrub_stamp":"2024-09-18T01:48:27.011228+0000","last_deep_scrub":"33'95","last_deep_scrub_stamp":"2024-09-18T01:48:27.011228+0000","last_clean_scrub_stamp":"2024-09-18T01:48:27.011228+0000","objects_scrubbed":6,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:47:24.915172+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":81,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:24.264584+0000","last_change":"2024-09-18T01:48:24.264584+0000","last_active":"2024-09-18T01:48:24.264584+0000","last_peered":"2024-09-18T01:48:24.264584+0000","last_clean":"2024-09-18T01:48:24.264584+0000","last_became_active":"2024-09-18T01:45:12.311337+0000","last_became_peered":"2024-09-18T01:45:12.311337+0000","last_unstale":"2024-09-18T01:48:24.264584+0000","last_undegraded":"2024-09-18T01:48:24.264584+0000","last_fullsized":"2024-09-18T01:48:24.264584+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:24.264452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:24.264452+0000","last_clean_scrub_stamp":"2024-09-18T01:48:24.264452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:54:43.625934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'81","reported_seq":172,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:44.040748+0000","last_change":"2024-09-18T01:48:44.040748+0000","last_active":"2024-09-18T01:48:44.040748+0000","last_peered":"2024-09-18T01:48:44.040748+0000","last_clean":"2024-09-18T01:48:44.040748+0000","last_became_active":"2024-09-18T01:45:14.314784+0000","last_became_peered":"2024-09-18T01:45:14.314784+0000","last_unstale":"2024-09-18T01:48:44.040748+0000","last_undegraded":"2024-09-18T01:48:44.040748+0000","last_fullsized":"2024-09-18T01:48:44.040748+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'81","last_scrub_stamp":"2024-09-18T01:48:44.040554+0000","last_deep_scrub":"33'81","last_deep_scrub_stamp":"2024-09-18T01:48:44.040554+0000","last_clean_scrub_stamp":"2024-09-18T01:48:44.040554+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:07:29.059407+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'4","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:17.112711+0000","last_change":"2024-09-18T01:49:17.112711+0000","last_active":"2024-09-18T01:49:17.112711+0000","last_peered":"2024-09-18T01:49:17.112711+0000","last_clean":"2024-09-18T01:49:17.112711+0000","last_became_active":"2024-09-18T01:45:41.338925+0000","last_became_peered":"2024-09-18T01:45:41.338925+0000","last_unstale":"2024-09-18T01:49:17.112711+0000","last_undegraded":"2024-09-18T01:49:17.112711+0000","last_fullsized":"2024-09-18T01:49:17.112711+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:49:17.112556+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:49:17.112556+0000","last_clean_scrub_stamp":"2024-09-18T01:49:17.112556+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:16:39.599997+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:35.974267+0000","last_change":"2024-09-18T01:49:35.974289+0000","last_active":"2024-09-18T01:49:35.974267+0000","last_peered":"2024-09-18T01:49:35.974267+0000","last_clean":"2024-09-18T01:49:35.974267+0000","last_became_active":"2024-09-18T01:44:53.237059+0000","last_became_peered":"2024-09-18T01:44:53.237059+0000","last_unstale":"2024-09-18T01:49:35.974267+0000","last_undegraded":"2024-09-18T01:49:35.974267+0000","last_fullsized":"2024-09-18T01:49:35.974267+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:35.974172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:35.974172+0000","last_clean_scrub_stamp":"2024-09-18T01:49:35.974172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:24:43.091880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011095359999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:14.329892+0000","last_change":"2024-09-18T01:49:14.329892+0000","last_active":"2024-09-18T01:49:14.329892+0000","last_peered":"2024-09-18T01:49:14.329892+0000","last_clean":"2024-09-18T01:49:14.329892+0000","last_became_active":"2024-09-18T01:45:04.273354+0000","last_became_peered":"2024-09-18T01:45:04.273354+0000","last_unstale":"2024-09-18T01:49:14.329892+0000","last_undegraded":"2024-09-18T01:49:14.329892+0000","last_fullsized":"2024-09-18T01:49:14.329892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:14.329766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:14.329766+0000","last_clean_scrub_stamp":"2024-09-18T01:49:14.329766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:39:48.120415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:32.043612+0000","last_change":"2024-09-18T01:48:32.043612+0000","last_active":"2024-09-18T01:48:32.043612+0000","last_peered":"2024-09-18T01:48:32.043612+0000","last_clean":"2024-09-18T01:48:32.043612+0000","last_became_active":"2024-09-18T01:45:08.291681+0000","last_became_peered":"2024-09-18T01:45:08.291681+0000","last_unstale":"2024-09-18T01:48:32.043612+0000","last_undegraded":"2024-09-18T01:48:32.043612+0000","last_fullsized":"2024-09-18T01:48:32.043612+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:32.043454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:32.043454+0000","last_clean_scrub_stamp":"2024-09-18T01:48:32.043454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:43:29.802788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'297","reported_seq":528,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:27.957047+0000","last_change":"2024-09-18T01:48:27.957047+0000","last_active":"2024-09-18T01:48:27.957047+0000","last_peered":"2024-09-18T01:48:27.957047+0000","last_clean":"2024-09-18T01:48:27.957047+0000","last_became_active":"2024-09-18T01:45:10.305472+0000","last_became_peered":"2024-09-18T01:45:10.305472+0000","last_unstale":"2024-09-18T01:48:27.957047+0000","last_undegraded":"2024-09-18T01:48:27.957047+0000","last_fullsized":"2024-09-18T01:48:27.957047+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'297","last_scrub_stamp":"2024-09-18T01:48:27.956904+0000","last_deep_scrub":"33'297","last_deep_scrub_stamp":"2024-09-18T01:48:27.956904+0000","last_clean_scrub_stamp":"2024-09-18T01:48:27.956904+0000","objects_scrubbed":11,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:56:18.052928+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":387,"num_read_kb":371,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:55.023485+0000","last_change":"2024-09-18T01:48:55.023485+0000","last_active":"2024-09-18T01:48:55.023485+0000","last_peered":"2024-09-18T01:48:55.023485+0000","last_clean":"2024-09-18T01:48:55.023485+0000","last_became_active":"2024-09-18T01:45:12.316110+0000","last_became_peered":"2024-09-18T01:45:12.316110+0000","last_unstale":"2024-09-18T01:48:55.023485+0000","last_undegraded":"2024-09-18T01:48:55.023485+0000","last_fullsized":"2024-09-18T01:48:55.023485+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:55.023295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:55.023295+0000","last_clean_scrub_stamp":"2024-09-18T01:48:55.023295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:00:27.945139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'5","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:21.046038+0000","last_change":"2024-09-18T01:49:21.046038+0000","last_active":"2024-09-18T01:49:21.046038+0000","last_peered":"2024-09-18T01:49:21.046038+0000","last_clean":"2024-09-18T01:49:21.046038+0000","last_became_active":"2024-09-18T01:45:14.322986+0000","last_became_peered":"2024-09-18T01:45:14.322986+0000","last_unstale":"2024-09-18T01:49:21.046038+0000","last_undegraded":"2024-09-18T01:49:21.046038+0000","last_fullsized":"2024-09-18T01:49:21.046038+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-18T01:49:21.045917+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-18T01:49:21.045917+0000","last_clean_scrub_stamp":"2024-09-18T01:49:21.045917+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:03:37.631724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'8","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:54.374813+0000","last_change":"2024-09-18T01:48:54.374813+0000","last_active":"2024-09-18T01:48:54.374813+0000","last_peered":"2024-09-18T01:48:54.374813+0000","last_clean":"2024-09-18T01:48:54.374813+0000","last_became_active":"2024-09-18T01:45:06.292996+0000","last_became_peered":"2024-09-18T01:45:06.292996+0000","last_unstale":"2024-09-18T01:48:54.374813+0000","last_undegraded":"2024-09-18T01:48:54.374813+0000","last_fullsized":"2024-09-18T01:48:54.374813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-18T01:48:54.374701+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-18T01:48:54.374701+0000","last_clean_scrub_stamp":"2024-09-18T01:48:54.374701+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:54:39.652845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:02.043873+0000","last_change":"2024-09-18T01:49:02.043873+0000","last_active":"2024-09-18T01:49:02.043873+0000","last_peered":"2024-09-18T01:49:02.043873+0000","last_clean":"2024-09-18T01:49:02.043873+0000","last_became_active":"2024-09-18T01:44:53.237016+0000","last_became_peered":"2024-09-18T01:44:53.237016+0000","last_unstale":"2024-09-18T01:49:02.043873+0000","last_undegraded":"2024-09-18T01:49:02.043873+0000","last_fullsized":"2024-09-18T01:49:02.043873+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:02.043751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:02.043751+0000","last_clean_scrub_stamp":"2024-09-18T01:49:02.043751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:47:59.947696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039942899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:58.422425+0000","last_change":"2024-09-18T01:48:58.422425+0000","last_active":"2024-09-18T01:48:58.422425+0000","last_peered":"2024-09-18T01:48:58.422425+0000","last_clean":"2024-09-18T01:48:58.422425+0000","last_became_active":"2024-09-18T01:45:04.283999+0000","last_became_peered":"2024-09-18T01:45:04.283999+0000","last_unstale":"2024-09-18T01:48:58.422425+0000","last_undegraded":"2024-09-18T01:48:58.422425+0000","last_fullsized":"2024-09-18T01:48:58.422425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:48:58.422302+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:48:58.422302+0000","last_clean_scrub_stamp":"2024-09-18T01:48:58.422302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:21:30.620518+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"33'4","reported_seq":233,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:43.006522+0000","last_change":"2024-09-18T01:48:43.006522+0000","last_active":"2024-09-18T01:48:43.006522+0000","last_peered":"2024-09-18T01:48:43.006522+0000","last_clean":"2024-09-18T01:48:43.006522+0000","last_became_active":"2024-09-18T01:45:08.284186+0000","last_became_peered":"2024-09-18T01:45:08.284186+0000","last_unstale":"2024-09-18T01:48:43.006522+0000","last_undegraded":"2024-09-18T01:48:43.006522+0000","last_fullsized":"2024-09-18T01:48:43.006522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:48:43.006376+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:48:43.006376+0000","last_clean_scrub_stamp":"2024-09-18T01:48:43.006376+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:03:25.253771+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'24","reported_seq":101,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:34.888969+0000","last_change":"2024-09-18T01:48:34.888969+0000","last_active":"2024-09-18T01:48:34.888969+0000","last_peered":"2024-09-18T01:48:34.888969+0000","last_clean":"2024-09-18T01:48:34.888969+0000","last_became_active":"2024-09-18T01:45:10.296284+0000","last_became_peered":"2024-09-18T01:45:10.296284+0000","last_unstale":"2024-09-18T01:48:34.888969+0000","last_undegraded":"2024-09-18T01:48:34.888969+0000","last_fullsized":"2024-09-18T01:48:34.888969+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'24","last_scrub_stamp":"2024-09-18T01:48:34.888775+0000","last_deep_scrub":"33'24","last_deep_scrub_stamp":"2024-09-18T01:48:34.888775+0000","last_clean_scrub_stamp":"2024-09-18T01:48:34.888775+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:24:45.905214+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:26.266603+0000","last_change":"2024-09-18T01:48:26.266603+0000","last_active":"2024-09-18T01:48:26.266603+0000","last_peered":"2024-09-18T01:48:26.266603+0000","last_clean":"2024-09-18T01:48:26.266603+0000","last_became_active":"2024-09-18T01:45:12.311266+0000","last_became_peered":"2024-09-18T01:45:12.311266+0000","last_unstale":"2024-09-18T01:48:26.266603+0000","last_undegraded":"2024-09-18T01:48:26.266603+0000","last_fullsized":"2024-09-18T01:48:26.266603+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:26.266453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:26.266453+0000","last_clean_scrub_stamp":"2024-09-18T01:48:26.266453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:33:31.954590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"33'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:02.888972+0000","last_change":"2024-09-18T01:49:02.888972+0000","last_active":"2024-09-18T01:49:02.888972+0000","last_peered":"2024-09-18T01:49:02.888972+0000","last_clean":"2024-09-18T01:49:02.888972+0000","last_became_active":"2024-09-18T01:45:14.318346+0000","last_became_peered":"2024-09-18T01:45:14.318346+0000","last_unstale":"2024-09-18T01:49:02.888972+0000","last_undegraded":"2024-09-18T01:49:02.888972+0000","last_fullsized":"2024-09-18T01:49:02.888972+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:02.888860+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:02.888860+0000","last_clean_scrub_stamp":"2024-09-18T01:49:02.888860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:33:30.505620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:59.400983+0000","last_change":"2024-09-18T01:48:59.400983+0000","last_active":"2024-09-18T01:48:59.400983+0000","last_peered":"2024-09-18T01:48:59.400983+0000","last_clean":"2024-09-18T01:48:59.400983+0000","last_became_active":"2024-09-18T01:45:06.282319+0000","last_became_peered":"2024-09-18T01:45:06.282319+0000","last_unstale":"2024-09-18T01:48:59.400983+0000","last_undegraded":"2024-09-18T01:48:59.400983+0000","last_fullsized":"2024-09-18T01:48:59.400983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:48:59.400854+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:48:59.400854+0000","last_clean_scrub_stamp":"2024-09-18T01:48:59.400854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:57:19.245005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"33'3","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:34.947318+0000","last_change":"2024-09-18T01:49:34.947388+0000","last_active":"2024-09-18T01:49:34.947318+0000","last_peered":"2024-09-18T01:49:34.947318+0000","last_clean":"2024-09-18T01:49:34.947318+0000","last_became_active":"2024-09-18T01:44:53.236990+0000","last_became_peered":"2024-09-18T01:44:53.236990+0000","last_unstale":"2024-09-18T01:49:34.947318+0000","last_undegraded":"2024-09-18T01:49:34.947318+0000","last_fullsized":"2024-09-18T01:49:34.947318+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-18T01:49:34.947196+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-18T01:49:34.947196+0000","last_clean_scrub_stamp":"2024-09-18T01:49:34.947196+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:57:34.019768+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.001062627,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:50.989543+0000","last_change":"2024-09-18T01:48:50.989543+0000","last_active":"2024-09-18T01:48:50.989543+0000","last_peered":"2024-09-18T01:48:50.989543+0000","last_clean":"2024-09-18T01:48:50.989543+0000","last_became_active":"2024-09-18T01:45:04.293064+0000","last_became_peered":"2024-09-18T01:45:04.293064+0000","last_unstale":"2024-09-18T01:48:50.989543+0000","last_undegraded":"2024-09-18T01:48:50.989543+0000","last_fullsized":"2024-09-18T01:48:50.989543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:50.989373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:50.989373+0000","last_clean_scrub_stamp":"2024-09-18T01:48:50.989373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:10:23.020221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:40.269797+0000","last_change":"2024-09-18T01:48:40.269797+0000","last_active":"2024-09-18T01:48:40.269797+0000","last_peered":"2024-09-18T01:48:40.269797+0000","last_clean":"2024-09-18T01:48:40.269797+0000","last_became_active":"2024-09-18T01:45:08.292477+0000","last_became_peered":"2024-09-18T01:45:08.292477+0000","last_unstale":"2024-09-18T01:48:40.269797+0000","last_undegraded":"2024-09-18T01:48:40.269797+0000","last_fullsized":"2024-09-18T01:48:40.269797+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:40.269686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:40.269686+0000","last_clean_scrub_stamp":"2024-09-18T01:48:40.269686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:24:25.007900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'20","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:39.078586+0000","last_change":"2024-09-18T01:48:39.078586+0000","last_active":"2024-09-18T01:48:39.078586+0000","last_peered":"2024-09-18T01:48:39.078586+0000","last_clean":"2024-09-18T01:48:39.078586+0000","last_became_active":"2024-09-18T01:45:10.308018+0000","last_became_peered":"2024-09-18T01:45:10.308018+0000","last_unstale":"2024-09-18T01:48:39.078586+0000","last_undegraded":"2024-09-18T01:48:39.078586+0000","last_fullsized":"2024-09-18T01:48:39.078586+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'20","last_scrub_stamp":"2024-09-18T01:48:39.078443+0000","last_deep_scrub":"33'20","last_deep_scrub_stamp":"2024-09-18T01:48:39.078443+0000","last_clean_scrub_stamp":"2024-09-18T01:48:39.078443+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:25:17.630439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:46.034806+0000","last_change":"2024-09-18T01:48:46.034806+0000","last_active":"2024-09-18T01:48:46.034806+0000","last_peered":"2024-09-18T01:48:46.034806+0000","last_clean":"2024-09-18T01:48:46.034806+0000","last_became_active":"2024-09-18T01:45:12.315342+0000","last_became_peered":"2024-09-18T01:45:12.315342+0000","last_unstale":"2024-09-18T01:48:46.034806+0000","last_undegraded":"2024-09-18T01:48:46.034806+0000","last_fullsized":"2024-09-18T01:48:46.034806+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:46.034692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:46.034692+0000","last_clean_scrub_stamp":"2024-09-18T01:48:46.034692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:33:00.369957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"33'6","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:19.079014+0000","last_change":"2024-09-18T01:49:19.079014+0000","last_active":"2024-09-18T01:49:19.079014+0000","last_peered":"2024-09-18T01:49:19.079014+0000","last_clean":"2024-09-18T01:49:19.079014+0000","last_became_active":"2024-09-18T01:45:14.322568+0000","last_became_peered":"2024-09-18T01:45:14.322568+0000","last_unstale":"2024-09-18T01:49:19.079014+0000","last_undegraded":"2024-09-18T01:49:19.079014+0000","last_fullsized":"2024-09-18T01:49:19.079014+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-18T01:49:19.078859+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-18T01:49:19.078859+0000","last_clean_scrub_stamp":"2024-09-18T01:49:19.078859+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:14:21.152081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'14","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:59.099373+0000","last_change":"2024-09-18T01:48:59.099373+0000","last_active":"2024-09-18T01:48:59.099373+0000","last_peered":"2024-09-18T01:48:59.099373+0000","last_clean":"2024-09-18T01:48:59.099373+0000","last_became_active":"2024-09-18T01:45:06.291792+0000","last_became_peered":"2024-09-18T01:45:06.291792+0000","last_unstale":"2024-09-18T01:48:59.099373+0000","last_undegraded":"2024-09-18T01:48:59.099373+0000","last_fullsized":"2024-09-18T01:48:59.099373+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-09-18T01:48:59.099213+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-09-18T01:48:59.099213+0000","last_clean_scrub_stamp":"2024-09-18T01:48:59.099213+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:58:21.348526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"31'2","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:59.100243+0000","last_change":"2024-09-18T01:48:59.100243+0000","last_active":"2024-09-18T01:48:59.100243+0000","last_peered":"2024-09-18T01:48:59.100243+0000","last_clean":"2024-09-18T01:48:59.100243+0000","last_became_active":"2024-09-18T01:45:04.291211+0000","last_became_peered":"2024-09-18T01:45:04.291211+0000","last_unstale":"2024-09-18T01:48:59.100243+0000","last_undegraded":"2024-09-18T01:48:59.100243+0000","last_fullsized":"2024-09-18T01:48:59.100243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-18T01:48:59.100062+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-18T01:48:59.100062+0000","last_clean_scrub_stamp":"2024-09-18T01:48:59.100062+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:37:34.895942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:11.357763+0000","last_change":"2024-09-18T01:49:11.357787+0000","last_active":"2024-09-18T01:49:11.357763+0000","last_peered":"2024-09-18T01:49:11.357763+0000","last_clean":"2024-09-18T01:49:11.357763+0000","last_became_active":"2024-09-18T01:44:53.234966+0000","last_became_peered":"2024-09-18T01:44:53.234966+0000","last_unstale":"2024-09-18T01:49:11.357763+0000","last_undegraded":"2024-09-18T01:49:11.357763+0000","last_fullsized":"2024-09-18T01:49:11.357763+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:11.357662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:11.357662+0000","last_clean_scrub_stamp":"2024-09-18T01:49:11.357662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:05:42.865637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045990099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:48.358622+0000","last_change":"2024-09-18T01:48:48.358622+0000","last_active":"2024-09-18T01:48:48.358622+0000","last_peered":"2024-09-18T01:48:48.358622+0000","last_clean":"2024-09-18T01:48:48.358622+0000","last_became_active":"2024-09-18T01:45:08.286195+0000","last_became_peered":"2024-09-18T01:45:08.286195+0000","last_unstale":"2024-09-18T01:48:48.358622+0000","last_undegraded":"2024-09-18T01:48:48.358622+0000","last_fullsized":"2024-09-18T01:48:48.358622+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:48:48.358462+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:48:48.358462+0000","last_clean_scrub_stamp":"2024-09-18T01:48:48.358462+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:55:29.632161+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'87","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:31.300515+0000","last_change":"2024-09-18T01:48:31.300515+0000","last_active":"2024-09-18T01:48:31.300515+0000","last_peered":"2024-09-18T01:48:31.300515+0000","last_clean":"2024-09-18T01:48:31.300515+0000","last_became_active":"2024-09-18T01:45:10.305948+0000","last_became_peered":"2024-09-18T01:45:10.305948+0000","last_unstale":"2024-09-18T01:48:31.300515+0000","last_undegraded":"2024-09-18T01:48:31.300515+0000","last_fullsized":"2024-09-18T01:48:31.300515+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'87","last_scrub_stamp":"2024-09-18T01:48:31.300310+0000","last_deep_scrub":"33'87","last_deep_scrub_stamp":"2024-09-18T01:48:31.300310+0000","last_clean_scrub_stamp":"2024-09-18T01:48:31.300310+0000","objects_scrubbed":11,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:18:03.428377+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":89,"num_read_kb":75,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:27.838906+0000","last_change":"2024-09-18T01:48:27.838906+0000","last_active":"2024-09-18T01:48:27.838906+0000","last_peered":"2024-09-18T01:48:27.838906+0000","last_clean":"2024-09-18T01:48:27.838906+0000","last_became_active":"2024-09-18T01:45:12.311862+0000","last_became_peered":"2024-09-18T01:45:12.311862+0000","last_unstale":"2024-09-18T01:48:27.838906+0000","last_undegraded":"2024-09-18T01:48:27.838906+0000","last_fullsized":"2024-09-18T01:48:27.838906+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:27.838756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:27.838756+0000","last_clean_scrub_stamp":"2024-09-18T01:48:27.838756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:26:33.881794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'13","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:53.409223+0000","last_change":"2024-09-18T01:48:53.409223+0000","last_active":"2024-09-18T01:48:53.409223+0000","last_peered":"2024-09-18T01:48:53.409223+0000","last_clean":"2024-09-18T01:48:53.409223+0000","last_became_active":"2024-09-18T01:45:14.311403+0000","last_became_peered":"2024-09-18T01:45:14.311403+0000","last_unstale":"2024-09-18T01:48:53.409223+0000","last_undegraded":"2024-09-18T01:48:53.409223+0000","last_fullsized":"2024-09-18T01:48:53.409223+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'13","last_scrub_stamp":"2024-09-18T01:48:53.409107+0000","last_deep_scrub":"33'13","last_deep_scrub_stamp":"2024-09-18T01:48:53.409107+0000","last_clean_scrub_stamp":"2024-09-18T01:48:53.409107+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:19:19.002301+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:01.149371+0000","last_change":"2024-09-18T01:49:01.149371+0000","last_active":"2024-09-18T01:49:01.149371+0000","last_peered":"2024-09-18T01:49:01.149371+0000","last_clean":"2024-09-18T01:49:01.149371+0000","last_became_active":"2024-09-18T01:45:06.291845+0000","last_became_peered":"2024-09-18T01:45:06.291845+0000","last_unstale":"2024-09-18T01:49:01.149371+0000","last_undegraded":"2024-09-18T01:49:01.149371+0000","last_fullsized":"2024-09-18T01:49:01.149371+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:01.149256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:01.149256+0000","last_clean_scrub_stamp":"2024-09-18T01:49:01.149256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:25:39.701253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:15.355172+0000","last_change":"2024-09-18T01:49:15.355172+0000","last_active":"2024-09-18T01:49:15.355172+0000","last_peered":"2024-09-18T01:49:15.355172+0000","last_clean":"2024-09-18T01:49:15.355172+0000","last_became_active":"2024-09-18T01:45:04.273385+0000","last_became_peered":"2024-09-18T01:45:04.273385+0000","last_unstale":"2024-09-18T01:49:15.355172+0000","last_undegraded":"2024-09-18T01:49:15.355172+0000","last_fullsized":"2024-09-18T01:49:15.355172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:15.355018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:15.355018+0000","last_clean_scrub_stamp":"2024-09-18T01:49:15.355018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:00:42.796946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:33.965833+0000","last_change":"2024-09-18T01:49:33.965898+0000","last_active":"2024-09-18T01:49:33.965833+0000","last_peered":"2024-09-18T01:49:33.965833+0000","last_clean":"2024-09-18T01:49:33.965833+0000","last_became_active":"2024-09-18T01:44:53.236927+0000","last_became_peered":"2024-09-18T01:44:53.236927+0000","last_unstale":"2024-09-18T01:49:33.965833+0000","last_undegraded":"2024-09-18T01:49:33.965833+0000","last_fullsized":"2024-09-18T01:49:33.965833+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:33.965692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:33.965692+0000","last_clean_scrub_stamp":"2024-09-18T01:49:33.965692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:23:17.427766+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00130324,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:24.061850+0000","last_change":"2024-09-18T01:48:24.061850+0000","last_active":"2024-09-18T01:48:24.061850+0000","last_peered":"2024-09-18T01:48:24.061850+0000","last_clean":"2024-09-18T01:48:24.061850+0000","last_became_active":"2024-09-18T01:45:08.296118+0000","last_became_peered":"2024-09-18T01:45:08.296118+0000","last_unstale":"2024-09-18T01:48:24.061850+0000","last_undegraded":"2024-09-18T01:48:24.061850+0000","last_fullsized":"2024-09-18T01:48:24.061850+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:24.061705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:24.061705+0000","last_clean_scrub_stamp":"2024-09-18T01:48:24.061705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:36:59.857585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"33'28","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:26.017268+0000","last_change":"2024-09-18T01:48:26.017268+0000","last_active":"2024-09-18T01:48:26.017268+0000","last_peered":"2024-09-18T01:48:26.017268+0000","last_clean":"2024-09-18T01:48:26.017268+0000","last_became_active":"2024-09-18T01:45:10.305932+0000","last_became_peered":"2024-09-18T01:45:10.305932+0000","last_unstale":"2024-09-18T01:48:26.017268+0000","last_undegraded":"2024-09-18T01:48:26.017268+0000","last_fullsized":"2024-09-18T01:48:26.017268+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'28","last_scrub_stamp":"2024-09-18T01:48:26.017059+0000","last_deep_scrub":"33'28","last_deep_scrub_stamp":"2024-09-18T01:48:26.017059+0000","last_clean_scrub_stamp":"2024-09-18T01:48:26.017059+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:54:30.634425+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'285","reported_seq":367,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:24.016399+0000","last_change":"2024-09-18T01:48:24.016399+0000","last_active":"2024-09-18T01:48:24.016399+0000","last_peered":"2024-09-18T01:48:24.016399+0000","last_clean":"2024-09-18T01:48:24.016399+0000","last_became_active":"2024-09-18T01:45:12.312117+0000","last_became_peered":"2024-09-18T01:45:12.312117+0000","last_unstale":"2024-09-18T01:48:24.016399+0000","last_undegraded":"2024-09-18T01:48:24.016399+0000","last_fullsized":"2024-09-18T01:48:24.016399+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-18T01:48:24.016276+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-18T01:48:24.016276+0000","last_clean_scrub_stamp":"2024-09-18T01:48:24.016276+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:28:28.633537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"33'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:06.901109+0000","last_change":"2024-09-18T01:49:06.901109+0000","last_active":"2024-09-18T01:49:06.901109+0000","last_peered":"2024-09-18T01:49:06.901109+0000","last_clean":"2024-09-18T01:49:06.901109+0000","last_became_active":"2024-09-18T01:45:14.322078+0000","last_became_peered":"2024-09-18T01:45:14.322078+0000","last_unstale":"2024-09-18T01:49:06.901109+0000","last_undegraded":"2024-09-18T01:49:06.901109+0000","last_fullsized":"2024-09-18T01:49:06.901109+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:06.900920+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:06.900920+0000","last_clean_scrub_stamp":"2024-09-18T01:49:06.900920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:34:55.515398+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:36.099827+0000","last_change":"2024-09-18T01:48:36.099827+0000","last_active":"2024-09-18T01:48:36.099827+0000","last_peered":"2024-09-18T01:48:36.099827+0000","last_clean":"2024-09-18T01:48:36.099827+0000","last_became_active":"2024-09-18T01:45:06.297660+0000","last_became_peered":"2024-09-18T01:45:06.297660+0000","last_unstale":"2024-09-18T01:48:36.099827+0000","last_undegraded":"2024-09-18T01:48:36.099827+0000","last_fullsized":"2024-09-18T01:48:36.099827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:48:36.099708+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:48:36.099708+0000","last_clean_scrub_stamp":"2024-09-18T01:48:36.099708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:13:48.036328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:12.849067+0000","last_change":"2024-09-18T01:49:12.849067+0000","last_active":"2024-09-18T01:49:12.849067+0000","last_peered":"2024-09-18T01:49:12.849067+0000","last_clean":"2024-09-18T01:49:12.849067+0000","last_became_active":"2024-09-18T01:45:04.288189+0000","last_became_peered":"2024-09-18T01:45:04.288189+0000","last_unstale":"2024-09-18T01:49:12.849067+0000","last_undegraded":"2024-09-18T01:49:12.849067+0000","last_fullsized":"2024-09-18T01:49:12.849067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:12.848889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:12.848889+0000","last_clean_scrub_stamp":"2024-09-18T01:49:12.848889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:11:11.778098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:12.325355+0000","last_change":"2024-09-18T01:49:12.325355+0000","last_active":"2024-09-18T01:49:12.325355+0000","last_peered":"2024-09-18T01:49:12.325355+0000","last_clean":"2024-09-18T01:49:12.325355+0000","last_became_active":"2024-09-18T01:44:53.236812+0000","last_became_peered":"2024-09-18T01:44:53.236812+0000","last_unstale":"2024-09-18T01:49:12.325355+0000","last_undegraded":"2024-09-18T01:49:12.325355+0000","last_fullsized":"2024-09-18T01:49:12.325355+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:12.325216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:12.325216+0000","last_clean_scrub_stamp":"2024-09-18T01:49:12.325216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:49:14.847227+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00044136000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:26.017324+0000","last_change":"2024-09-18T01:48:26.017324+0000","last_active":"2024-09-18T01:48:26.017324+0000","last_peered":"2024-09-18T01:48:26.017324+0000","last_clean":"2024-09-18T01:48:26.017324+0000","last_became_active":"2024-09-18T01:45:08.296102+0000","last_became_peered":"2024-09-18T01:45:08.296102+0000","last_unstale":"2024-09-18T01:48:26.017324+0000","last_undegraded":"2024-09-18T01:48:26.017324+0000","last_fullsized":"2024-09-18T01:48:26.017324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:26.017211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:26.017211+0000","last_clean_scrub_stamp":"2024-09-18T01:48:26.017211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:29:58.682197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"33'22","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:52.020412+0000","last_change":"2024-09-18T01:48:52.020412+0000","last_active":"2024-09-18T01:48:52.020412+0000","last_peered":"2024-09-18T01:48:52.020412+0000","last_clean":"2024-09-18T01:48:52.020412+0000","last_became_active":"2024-09-18T01:45:10.308451+0000","last_became_peered":"2024-09-18T01:45:10.308451+0000","last_unstale":"2024-09-18T01:48:52.020412+0000","last_undegraded":"2024-09-18T01:48:52.020412+0000","last_fullsized":"2024-09-18T01:48:52.020412+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2024-09-18T01:48:52.020253+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2024-09-18T01:48:52.020253+0000","last_clean_scrub_stamp":"2024-09-18T01:48:52.020253+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:29:39.718171+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'285","reported_seq":441,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:49.394846+0000","last_change":"2024-09-18T01:48:49.394846+0000","last_active":"2024-09-18T01:48:49.394846+0000","last_peered":"2024-09-18T01:48:49.394846+0000","last_clean":"2024-09-18T01:48:49.394846+0000","last_became_active":"2024-09-18T01:45:12.313885+0000","last_became_peered":"2024-09-18T01:45:12.313885+0000","last_unstale":"2024-09-18T01:48:49.394846+0000","last_undegraded":"2024-09-18T01:48:49.394846+0000","last_fullsized":"2024-09-18T01:48:49.394846+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-18T01:48:49.394735+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-18T01:48:49.394735+0000","last_clean_scrub_stamp":"2024-09-18T01:48:49.394735+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:09:02.112570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"33'7","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:42.846821+0000","last_change":"2024-09-18T01:48:42.846821+0000","last_active":"2024-09-18T01:48:42.846821+0000","last_peered":"2024-09-18T01:48:42.846821+0000","last_clean":"2024-09-18T01:48:42.846821+0000","last_became_active":"2024-09-18T01:45:14.317241+0000","last_became_peered":"2024-09-18T01:45:14.317241+0000","last_unstale":"2024-09-18T01:48:42.846821+0000","last_undegraded":"2024-09-18T01:48:42.846821+0000","last_fullsized":"2024-09-18T01:48:42.846821+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-09-18T01:48:42.846695+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-09-18T01:48:42.846695+0000","last_clean_scrub_stamp":"2024-09-18T01:48:42.846695+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:24:27.584908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"33'8","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:58.082270+0000","last_change":"2024-09-18T01:48:58.082270+0000","last_active":"2024-09-18T01:48:58.082270+0000","last_peered":"2024-09-18T01:48:58.082270+0000","last_clean":"2024-09-18T01:48:58.082270+0000","last_became_active":"2024-09-18T01:45:06.285656+0000","last_became_peered":"2024-09-18T01:45:06.285656+0000","last_unstale":"2024-09-18T01:48:58.082270+0000","last_undegraded":"2024-09-18T01:48:58.082270+0000","last_fullsized":"2024-09-18T01:48:58.082270+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-18T01:48:58.082155+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-18T01:48:58.082155+0000","last_clean_scrub_stamp":"2024-09-18T01:48:58.082155+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:12:50.018176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:12.022442+0000","last_change":"2024-09-18T01:49:12.022442+0000","last_active":"2024-09-18T01:49:12.022442+0000","last_peered":"2024-09-18T01:49:12.022442+0000","last_clean":"2024-09-18T01:49:12.022442+0000","last_became_active":"2024-09-18T01:45:04.290480+0000","last_became_peered":"2024-09-18T01:45:04.290480+0000","last_unstale":"2024-09-18T01:49:12.022442+0000","last_undegraded":"2024-09-18T01:49:12.022442+0000","last_fullsized":"2024-09-18T01:49:12.022442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:12.022321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:12.022321+0000","last_clean_scrub_stamp":"2024-09-18T01:49:12.022321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:38:59.551859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:37.006285+0000","last_change":"2024-09-18T01:49:37.006310+0000","last_active":"2024-09-18T01:49:37.006285+0000","last_peered":"2024-09-18T01:49:37.006285+0000","last_clean":"2024-09-18T01:49:37.006285+0000","last_became_active":"2024-09-18T01:44:53.298677+0000","last_became_peered":"2024-09-18T01:44:53.298677+0000","last_unstale":"2024-09-18T01:49:37.006285+0000","last_undegraded":"2024-09-18T01:49:37.006285+0000","last_fullsized":"2024-09-18T01:49:37.006285+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:37.006189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:37.006189+0000","last_clean_scrub_stamp":"2024-09-18T01:49:37.006189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:26:11.859958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052495500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:33.060133+0000","last_change":"2024-09-18T01:48:33.060133+0000","last_active":"2024-09-18T01:48:33.060133+0000","last_peered":"2024-09-18T01:48:33.060133+0000","last_clean":"2024-09-18T01:48:33.060133+0000","last_became_active":"2024-09-18T01:45:08.291696+0000","last_became_peered":"2024-09-18T01:45:08.291696+0000","last_unstale":"2024-09-18T01:48:33.060133+0000","last_undegraded":"2024-09-18T01:48:33.060133+0000","last_fullsized":"2024-09-18T01:48:33.060133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:33.059961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:33.059961+0000","last_clean_scrub_stamp":"2024-09-18T01:48:33.059961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:23:09.745291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'103","reported_seq":203,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:28.839049+0000","last_change":"2024-09-18T01:48:28.839049+0000","last_active":"2024-09-18T01:48:28.839049+0000","last_peered":"2024-09-18T01:48:28.839049+0000","last_clean":"2024-09-18T01:48:28.839049+0000","last_became_active":"2024-09-18T01:45:10.304662+0000","last_became_peered":"2024-09-18T01:45:10.304662+0000","last_unstale":"2024-09-18T01:48:28.839049+0000","last_undegraded":"2024-09-18T01:48:28.839049+0000","last_fullsized":"2024-09-18T01:48:28.839049+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'103","last_scrub_stamp":"2024-09-18T01:48:28.838915+0000","last_deep_scrub":"33'103","last_deep_scrub_stamp":"2024-09-18T01:48:28.838915+0000","last_clean_scrub_stamp":"2024-09-18T01:48:28.838915+0000","objects_scrubbed":9,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:19:33.132645+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":87,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:23.263316+0000","last_change":"2024-09-18T01:48:23.263316+0000","last_active":"2024-09-18T01:48:23.263316+0000","last_peered":"2024-09-18T01:48:23.263316+0000","last_clean":"2024-09-18T01:48:23.263316+0000","last_became_active":"2024-09-18T01:45:12.311399+0000","last_became_peered":"2024-09-18T01:45:12.311399+0000","last_unstale":"2024-09-18T01:48:23.263316+0000","last_undegraded":"2024-09-18T01:48:23.263316+0000","last_fullsized":"2024-09-18T01:48:23.263316+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:23.263202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:23.263202+0000","last_clean_scrub_stamp":"2024-09-18T01:48:23.263202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:54:27.880569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:11.051570+0000","last_change":"2024-09-18T01:49:11.051570+0000","last_active":"2024-09-18T01:49:11.051570+0000","last_peered":"2024-09-18T01:49:11.051570+0000","last_clean":"2024-09-18T01:49:11.051570+0000","last_became_active":"2024-09-18T01:45:14.314587+0000","last_became_peered":"2024-09-18T01:45:14.314587+0000","last_unstale":"2024-09-18T01:49:11.051570+0000","last_undegraded":"2024-09-18T01:49:11.051570+0000","last_fullsized":"2024-09-18T01:49:11.051570+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:11.051420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:11.051420+0000","last_clean_scrub_stamp":"2024-09-18T01:49:11.051420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:32:32.758053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"31'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:14.065572+0000","last_change":"2024-09-18T01:49:14.065572+0000","last_active":"2024-09-18T01:49:14.065572+0000","last_peered":"2024-09-18T01:49:14.065572+0000","last_clean":"2024-09-18T01:49:14.065572+0000","last_became_active":"2024-09-18T01:45:14.326051+0000","last_became_peered":"2024-09-18T01:45:14.326051+0000","last_unstale":"2024-09-18T01:49:14.065572+0000","last_undegraded":"2024-09-18T01:49:14.065572+0000","last_fullsized":"2024-09-18T01:49:14.065572+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-18T01:49:14.065439+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-18T01:49:14.065439+0000","last_clean_scrub_stamp":"2024-09-18T01:49:14.065439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:58:36.005665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"33'8","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:52.038841+0000","last_change":"2024-09-18T01:48:52.038841+0000","last_active":"2024-09-18T01:48:52.038841+0000","last_peered":"2024-09-18T01:48:52.038841+0000","last_clean":"2024-09-18T01:48:52.038841+0000","last_became_active":"2024-09-18T01:45:06.283912+0000","last_became_peered":"2024-09-18T01:45:06.283912+0000","last_unstale":"2024-09-18T01:48:52.038841+0000","last_undegraded":"2024-09-18T01:48:52.038841+0000","last_fullsized":"2024-09-18T01:48:52.038841+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-18T01:48:52.038726+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-18T01:48:52.038726+0000","last_clean_scrub_stamp":"2024-09-18T01:48:52.038726+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:42:35.286481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:20.957600+0000","last_change":"2024-09-18T01:49:20.957600+0000","last_active":"2024-09-18T01:49:20.957600+0000","last_peered":"2024-09-18T01:49:20.957600+0000","last_clean":"2024-09-18T01:49:20.957600+0000","last_became_active":"2024-09-18T01:45:04.285647+0000","last_became_peered":"2024-09-18T01:45:04.285647+0000","last_unstale":"2024-09-18T01:49:20.957600+0000","last_undegraded":"2024-09-18T01:49:20.957600+0000","last_fullsized":"2024-09-18T01:49:20.957600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:49:20.957430+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:49:20.957430+0000","last_clean_scrub_stamp":"2024-09-18T01:49:20.957430+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:31:53.699536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:22.003715+0000","last_change":"2024-09-18T01:49:22.003715+0000","last_active":"2024-09-18T01:49:22.003715+0000","last_peered":"2024-09-18T01:49:22.003715+0000","last_clean":"2024-09-18T01:49:22.003715+0000","last_became_active":"2024-09-18T01:45:41.339936+0000","last_became_peered":"2024-09-18T01:45:41.339936+0000","last_unstale":"2024-09-18T01:49:22.003715+0000","last_undegraded":"2024-09-18T01:49:22.003715+0000","last_fullsized":"2024-09-18T01:49:22.003715+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:22.003607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:22.003607+0000","last_clean_scrub_stamp":"2024-09-18T01:49:22.003607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:47:52.845993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'46","reported_seq":109,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:37.085399+0000","last_change":"2024-09-18T01:48:37.085399+0000","last_active":"2024-09-18T01:48:37.085399+0000","last_peered":"2024-09-18T01:48:37.085399+0000","last_clean":"2024-09-18T01:48:37.085399+0000","last_became_active":"2024-09-18T01:45:10.307670+0000","last_became_peered":"2024-09-18T01:45:10.307670+0000","last_unstale":"2024-09-18T01:48:37.085399+0000","last_undegraded":"2024-09-18T01:48:37.085399+0000","last_fullsized":"2024-09-18T01:48:37.085399+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'46","last_scrub_stamp":"2024-09-18T01:48:37.085236+0000","last_deep_scrub":"33'46","last_deep_scrub_stamp":"2024-09-18T01:48:37.085236+0000","last_clean_scrub_stamp":"2024-09-18T01:48:37.085236+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:57:59.334548+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:51.057271+0000","last_change":"2024-09-18T01:48:51.057271+0000","last_active":"2024-09-18T01:48:51.057271+0000","last_peered":"2024-09-18T01:48:51.057271+0000","last_clean":"2024-09-18T01:48:51.057271+0000","last_became_active":"2024-09-18T01:45:12.316192+0000","last_became_peered":"2024-09-18T01:45:12.316192+0000","last_unstale":"2024-09-18T01:48:51.057271+0000","last_undegraded":"2024-09-18T01:48:51.057271+0000","last_fullsized":"2024-09-18T01:48:51.057271+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:51.057141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:51.057141+0000","last_clean_scrub_stamp":"2024-09-18T01:48:51.057141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:10:20.432939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"33'5","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:20.339718+0000","last_change":"2024-09-18T01:49:20.339745+0000","last_active":"2024-09-18T01:49:20.339718+0000","last_peered":"2024-09-18T01:49:20.339718+0000","last_clean":"2024-09-18T01:49:20.339718+0000","last_became_active":"2024-09-18T01:45:14.311776+0000","last_became_peered":"2024-09-18T01:45:14.311776+0000","last_unstale":"2024-09-18T01:49:20.339718+0000","last_undegraded":"2024-09-18T01:49:20.339718+0000","last_fullsized":"2024-09-18T01:49:20.339718+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-18T01:49:20.339616+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-18T01:49:20.339616+0000","last_clean_scrub_stamp":"2024-09-18T01:49:20.339616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:11:44.447957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'8","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:57.040711+0000","last_change":"2024-09-18T01:48:57.040711+0000","last_active":"2024-09-18T01:48:57.040711+0000","last_peered":"2024-09-18T01:48:57.040711+0000","last_clean":"2024-09-18T01:48:57.040711+0000","last_became_active":"2024-09-18T01:45:06.291811+0000","last_became_peered":"2024-09-18T01:45:06.291811+0000","last_unstale":"2024-09-18T01:48:57.040711+0000","last_undegraded":"2024-09-18T01:48:57.040711+0000","last_fullsized":"2024-09-18T01:48:57.040711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-18T01:48:57.040600+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-18T01:48:57.040600+0000","last_clean_scrub_stamp":"2024-09-18T01:48:57.040600+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:54:42.318745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:09.025049+0000","last_change":"2024-09-18T01:49:09.025049+0000","last_active":"2024-09-18T01:49:09.025049+0000","last_peered":"2024-09-18T01:49:09.025049+0000","last_clean":"2024-09-18T01:49:09.025049+0000","last_became_active":"2024-09-18T01:45:04.289655+0000","last_became_peered":"2024-09-18T01:45:04.289655+0000","last_unstale":"2024-09-18T01:49:09.025049+0000","last_undegraded":"2024-09-18T01:49:09.025049+0000","last_fullsized":"2024-09-18T01:49:09.025049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:09.024890+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:09.024890+0000","last_clean_scrub_stamp":"2024-09-18T01:49:09.024890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:40:07.315143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:48.031077+0000","last_change":"2024-09-18T01:49:48.031077+0000","last_active":"2024-09-18T01:49:48.031077+0000","last_peered":"2024-09-18T01:49:48.031077+0000","last_clean":"2024-09-18T01:49:48.031077+0000","last_became_active":"2024-09-18T01:45:41.342149+0000","last_became_peered":"2024-09-18T01:45:41.342149+0000","last_unstale":"2024-09-18T01:49:48.031077+0000","last_undegraded":"2024-09-18T01:49:48.031077+0000","last_fullsized":"2024-09-18T01:49:48.031077+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:48.030964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:48.030964+0000","last_clean_scrub_stamp":"2024-09-18T01:49:48.030964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:54:57.015076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'8","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:36.330239+0000","last_change":"2024-09-18T01:48:36.330239+0000","last_active":"2024-09-18T01:48:36.330239+0000","last_peered":"2024-09-18T01:48:36.330239+0000","last_clean":"2024-09-18T01:48:36.330239+0000","last_became_active":"2024-09-18T01:45:10.296387+0000","last_became_peered":"2024-09-18T01:45:10.296387+0000","last_unstale":"2024-09-18T01:48:36.330239+0000","last_undegraded":"2024-09-18T01:48:36.330239+0000","last_fullsized":"2024-09-18T01:48:36.330239+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-18T01:48:36.330117+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-18T01:48:36.330117+0000","last_clean_scrub_stamp":"2024-09-18T01:48:36.330117+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:18:02.338887+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:35.876410+0000","last_change":"2024-09-18T01:48:35.876410+0000","last_active":"2024-09-18T01:48:35.876410+0000","last_peered":"2024-09-18T01:48:35.876410+0000","last_clean":"2024-09-18T01:48:35.876410+0000","last_became_active":"2024-09-18T01:45:12.313159+0000","last_became_peered":"2024-09-18T01:45:12.313159+0000","last_unstale":"2024-09-18T01:48:35.876410+0000","last_undegraded":"2024-09-18T01:48:35.876410+0000","last_fullsized":"2024-09-18T01:48:35.876410+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:35.876295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:35.876295+0000","last_clean_scrub_stamp":"2024-09-18T01:48:35.876295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:09:42.402630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:21.322150+0000","last_change":"2024-09-18T01:49:21.322173+0000","last_active":"2024-09-18T01:49:21.322150+0000","last_peered":"2024-09-18T01:49:21.322150+0000","last_clean":"2024-09-18T01:49:21.322150+0000","last_became_active":"2024-09-18T01:45:14.319073+0000","last_became_peered":"2024-09-18T01:45:14.319073+0000","last_unstale":"2024-09-18T01:49:21.322150+0000","last_undegraded":"2024-09-18T01:49:21.322150+0000","last_fullsized":"2024-09-18T01:49:21.322150+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:21.322041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:21.322041+0000","last_clean_scrub_stamp":"2024-09-18T01:49:21.322041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:33:48.938800+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'6","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:55.348701+0000","last_change":"2024-09-18T01:48:55.348701+0000","last_active":"2024-09-18T01:48:55.348701+0000","last_peered":"2024-09-18T01:48:55.348701+0000","last_clean":"2024-09-18T01:48:55.348701+0000","last_became_active":"2024-09-18T01:45:06.276408+0000","last_became_peered":"2024-09-18T01:45:06.276408+0000","last_unstale":"2024-09-18T01:48:55.348701+0000","last_undegraded":"2024-09-18T01:48:55.348701+0000","last_fullsized":"2024-09-18T01:48:55.348701+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-18T01:48:55.348539+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-18T01:48:55.348539+0000","last_clean_scrub_stamp":"2024-09-18T01:48:55.348539+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:08:52.491981+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"33'6","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:06.040054+0000","last_change":"2024-09-18T01:49:06.040054+0000","last_active":"2024-09-18T01:49:06.040054+0000","last_peered":"2024-09-18T01:49:06.040054+0000","last_clean":"2024-09-18T01:49:06.040054+0000","last_became_active":"2024-09-18T01:45:04.286887+0000","last_became_peered":"2024-09-18T01:45:04.286887+0000","last_unstale":"2024-09-18T01:49:06.040054+0000","last_undegraded":"2024-09-18T01:49:06.040054+0000","last_fullsized":"2024-09-18T01:49:06.040054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-18T01:49:06.039927+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-18T01:49:06.039927+0000","last_clean_scrub_stamp":"2024-09-18T01:49:06.039927+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:49:30.561380+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:37.881673+0000","last_change":"2024-09-18T01:48:37.881673+0000","last_active":"2024-09-18T01:48:37.881673+0000","last_peered":"2024-09-18T01:48:37.881673+0000","last_clean":"2024-09-18T01:48:37.881673+0000","last_became_active":"2024-09-18T01:45:08.291575+0000","last_became_peered":"2024-09-18T01:45:08.291575+0000","last_unstale":"2024-09-18T01:48:37.881673+0000","last_undegraded":"2024-09-18T01:48:37.881673+0000","last_fullsized":"2024-09-18T01:48:37.881673+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:37.881519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:37.881519+0000","last_clean_scrub_stamp":"2024-09-18T01:48:37.881519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:48:21.895224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'47","reported_seq":120,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:34.322343+0000","last_change":"2024-09-18T01:48:34.322343+0000","last_active":"2024-09-18T01:48:34.322343+0000","last_peered":"2024-09-18T01:48:34.322343+0000","last_clean":"2024-09-18T01:48:34.322343+0000","last_became_active":"2024-09-18T01:45:10.297904+0000","last_became_peered":"2024-09-18T01:45:10.297904+0000","last_unstale":"2024-09-18T01:48:34.322343+0000","last_undegraded":"2024-09-18T01:48:34.322343+0000","last_fullsized":"2024-09-18T01:48:34.322343+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'47","last_scrub_stamp":"2024-09-18T01:48:34.322182+0000","last_deep_scrub":"33'47","last_deep_scrub_stamp":"2024-09-18T01:48:34.322182+0000","last_clean_scrub_stamp":"2024-09-18T01:48:34.322182+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:23:05.910626+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:23.035896+0000","last_change":"2024-09-18T01:48:23.035896+0000","last_active":"2024-09-18T01:48:23.035896+0000","last_peered":"2024-09-18T01:48:23.035896+0000","last_clean":"2024-09-18T01:48:23.035896+0000","last_became_active":"2024-09-18T01:45:12.313186+0000","last_became_peered":"2024-09-18T01:45:12.313186+0000","last_unstale":"2024-09-18T01:48:23.035896+0000","last_undegraded":"2024-09-18T01:48:23.035896+0000","last_fullsized":"2024-09-18T01:48:23.035896+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:23.035704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:23.035704+0000","last_clean_scrub_stamp":"2024-09-18T01:48:23.035704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:54:29.422521+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:47.045915+0000","last_change":"2024-09-18T01:49:47.045953+0000","last_active":"2024-09-18T01:49:47.045915+0000","last_peered":"2024-09-18T01:49:47.045915+0000","last_clean":"2024-09-18T01:49:47.045915+0000","last_became_active":"2024-09-18T01:45:14.326668+0000","last_became_peered":"2024-09-18T01:45:14.326668+0000","last_unstale":"2024-09-18T01:49:47.045915+0000","last_undegraded":"2024-09-18T01:49:47.045915+0000","last_fullsized":"2024-09-18T01:49:47.045915+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:47.045780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:47.045780+0000","last_clean_scrub_stamp":"2024-09-18T01:49:47.045780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:25:13.093933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'18","reported_seq":105,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:40.058472+0000","last_change":"2024-09-18T01:48:40.058472+0000","last_active":"2024-09-18T01:48:40.058472+0000","last_peered":"2024-09-18T01:48:40.058472+0000","last_clean":"2024-09-18T01:48:40.058472+0000","last_became_active":"2024-09-18T01:45:06.297220+0000","last_became_peered":"2024-09-18T01:45:06.297220+0000","last_unstale":"2024-09-18T01:48:40.058472+0000","last_undegraded":"2024-09-18T01:48:40.058472+0000","last_fullsized":"2024-09-18T01:48:40.058472+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'18","last_scrub_stamp":"2024-09-18T01:48:40.058351+0000","last_deep_scrub":"33'18","last_deep_scrub_stamp":"2024-09-18T01:48:40.058351+0000","last_clean_scrub_stamp":"2024-09-18T01:48:40.058351+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:54:41.006349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":76,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:11.054340+0000","last_change":"2024-09-18T01:49:11.054340+0000","last_active":"2024-09-18T01:49:11.054340+0000","last_peered":"2024-09-18T01:49:11.054340+0000","last_clean":"2024-09-18T01:49:11.054340+0000","last_became_active":"2024-09-18T01:45:04.283276+0000","last_became_peered":"2024-09-18T01:45:04.283276+0000","last_unstale":"2024-09-18T01:49:11.054340+0000","last_undegraded":"2024-09-18T01:49:11.054340+0000","last_fullsized":"2024-09-18T01:49:11.054340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:11.054211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:11.054211+0000","last_clean_scrub_stamp":"2024-09-18T01:49:11.054211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:11:14.562630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:34.100576+0000","last_change":"2024-09-18T01:48:34.100576+0000","last_active":"2024-09-18T01:48:34.100576+0000","last_peered":"2024-09-18T01:48:34.100576+0000","last_clean":"2024-09-18T01:48:34.100576+0000","last_became_active":"2024-09-18T01:45:08.290911+0000","last_became_peered":"2024-09-18T01:45:08.290911+0000","last_unstale":"2024-09-18T01:48:34.100576+0000","last_undegraded":"2024-09-18T01:48:34.100576+0000","last_fullsized":"2024-09-18T01:48:34.100576+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:34.100451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:34.100451+0000","last_clean_scrub_stamp":"2024-09-18T01:48:34.100451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:18:59.693645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'36","reported_seq":92,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:30.819572+0000","last_change":"2024-09-18T01:48:30.819572+0000","last_active":"2024-09-18T01:48:30.819572+0000","last_peered":"2024-09-18T01:48:30.819572+0000","last_clean":"2024-09-18T01:48:30.819572+0000","last_became_active":"2024-09-18T01:45:10.301622+0000","last_became_peered":"2024-09-18T01:45:10.301622+0000","last_unstale":"2024-09-18T01:48:30.819572+0000","last_undegraded":"2024-09-18T01:48:30.819572+0000","last_fullsized":"2024-09-18T01:48:30.819572+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'36","last_scrub_stamp":"2024-09-18T01:48:30.819448+0000","last_deep_scrub":"33'36","last_deep_scrub_stamp":"2024-09-18T01:48:30.819448+0000","last_clean_scrub_stamp":"2024-09-18T01:48:30.819448+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:02:48.244921+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:31.837196+0000","last_change":"2024-09-18T01:48:31.837196+0000","last_active":"2024-09-18T01:48:31.837196+0000","last_peered":"2024-09-18T01:48:31.837196+0000","last_clean":"2024-09-18T01:48:31.837196+0000","last_became_active":"2024-09-18T01:45:12.313096+0000","last_became_peered":"2024-09-18T01:45:12.313096+0000","last_unstale":"2024-09-18T01:48:31.837196+0000","last_undegraded":"2024-09-18T01:48:31.837196+0000","last_fullsized":"2024-09-18T01:48:31.837196+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:31.837028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:31.837028+0000","last_clean_scrub_stamp":"2024-09-18T01:48:31.837028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:55:19.988045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"33'12","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:05.899263+0000","last_change":"2024-09-18T01:49:05.899263+0000","last_active":"2024-09-18T01:49:05.899263+0000","last_peered":"2024-09-18T01:49:05.899263+0000","last_clean":"2024-09-18T01:49:05.899263+0000","last_became_active":"2024-09-18T01:45:06.282461+0000","last_became_peered":"2024-09-18T01:45:06.282461+0000","last_unstale":"2024-09-18T01:49:05.899263+0000","last_undegraded":"2024-09-18T01:49:05.899263+0000","last_fullsized":"2024-09-18T01:49:05.899263+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-18T01:49:05.899152+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-18T01:49:05.899152+0000","last_clean_scrub_stamp":"2024-09-18T01:49:05.899152+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:45:46.971541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"33'8","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:31.037714+0000","last_change":"2024-09-18T01:49:31.037714+0000","last_active":"2024-09-18T01:49:31.037714+0000","last_peered":"2024-09-18T01:49:31.037714+0000","last_clean":"2024-09-18T01:49:31.037714+0000","last_became_active":"2024-09-18T01:45:04.288082+0000","last_became_peered":"2024-09-18T01:45:04.288082+0000","last_unstale":"2024-09-18T01:49:31.037714+0000","last_undegraded":"2024-09-18T01:49:31.037714+0000","last_fullsized":"2024-09-18T01:49:31.037714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-18T01:49:31.037590+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-18T01:49:31.037590+0000","last_clean_scrub_stamp":"2024-09-18T01:49:31.037590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:05:09.181100+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":48,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:39.315849+0000","last_change":"2024-09-18T01:48:39.315849+0000","last_active":"2024-09-18T01:48:39.315849+0000","last_peered":"2024-09-18T01:48:39.315849+0000","last_clean":"2024-09-18T01:48:39.315849+0000","last_became_active":"2024-09-18T01:45:08.292739+0000","last_became_peered":"2024-09-18T01:45:08.292739+0000","last_unstale":"2024-09-18T01:48:39.315849+0000","last_undegraded":"2024-09-18T01:48:39.315849+0000","last_fullsized":"2024-09-18T01:48:39.315849+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:39.315733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:39.315733+0000","last_clean_scrub_stamp":"2024-09-18T01:48:39.315733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:28:18.241750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'70","reported_seq":149,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:35.355474+0000","last_change":"2024-09-18T01:48:35.355511+0000","last_active":"2024-09-18T01:48:35.355474+0000","last_peered":"2024-09-18T01:48:35.355474+0000","last_clean":"2024-09-18T01:48:35.355474+0000","last_became_active":"2024-09-18T01:45:10.296396+0000","last_became_peered":"2024-09-18T01:45:10.296396+0000","last_unstale":"2024-09-18T01:48:35.355474+0000","last_undegraded":"2024-09-18T01:48:35.355474+0000","last_fullsized":"2024-09-18T01:48:35.355474+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'70","last_scrub_stamp":"2024-09-18T01:48:35.355370+0000","last_deep_scrub":"33'70","last_deep_scrub_stamp":"2024-09-18T01:48:35.355370+0000","last_clean_scrub_stamp":"2024-09-18T01:48:35.355370+0000","objects_scrubbed":6,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:18:17.350454+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:23.816836+0000","last_change":"2024-09-18T01:48:23.816862+0000","last_active":"2024-09-18T01:48:23.816836+0000","last_peered":"2024-09-18T01:48:23.816836+0000","last_clean":"2024-09-18T01:48:23.816836+0000","last_became_active":"2024-09-18T01:45:12.307279+0000","last_became_peered":"2024-09-18T01:45:12.307279+0000","last_unstale":"2024-09-18T01:48:23.816836+0000","last_undegraded":"2024-09-18T01:48:23.816836+0000","last_fullsized":"2024-09-18T01:48:23.816836+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:23.816708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:23.816708+0000","last_clean_scrub_stamp":"2024-09-18T01:48:23.816708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:52:57.423754+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'22","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:24.317930+0000","last_change":"2024-09-18T01:49:24.317930+0000","last_active":"2024-09-18T01:49:24.317930+0000","last_peered":"2024-09-18T01:49:24.317930+0000","last_clean":"2024-09-18T01:49:24.317930+0000","last_became_active":"2024-09-18T01:45:14.319540+0000","last_became_peered":"2024-09-18T01:45:14.319540+0000","last_unstale":"2024-09-18T01:49:24.317930+0000","last_undegraded":"2024-09-18T01:49:24.317930+0000","last_fullsized":"2024-09-18T01:49:24.317930+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2024-09-18T01:49:24.317811+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2024-09-18T01:49:24.317811+0000","last_clean_scrub_stamp":"2024-09-18T01:49:24.317811+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:26:25.501102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":65,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'18","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:52.432402+0000","last_change":"2024-09-18T01:48:52.432402+0000","last_active":"2024-09-18T01:48:52.432402+0000","last_peered":"2024-09-18T01:48:52.432402+0000","last_clean":"2024-09-18T01:48:52.432402+0000","last_became_active":"2024-09-18T01:45:06.293053+0000","last_became_peered":"2024-09-18T01:45:06.293053+0000","last_unstale":"2024-09-18T01:48:52.432402+0000","last_undegraded":"2024-09-18T01:48:52.432402+0000","last_fullsized":"2024-09-18T01:48:52.432402+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'18","last_scrub_stamp":"2024-09-18T01:48:52.432288+0000","last_deep_scrub":"33'18","last_deep_scrub_stamp":"2024-09-18T01:48:52.432288+0000","last_clean_scrub_stamp":"2024-09-18T01:48:52.432288+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:28:25.986612+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":45,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:14.095903+0000","last_change":"2024-09-18T01:49:14.095903+0000","last_active":"2024-09-18T01:49:14.095903+0000","last_peered":"2024-09-18T01:49:14.095903+0000","last_clean":"2024-09-18T01:49:14.095903+0000","last_became_active":"2024-09-18T01:45:04.292082+0000","last_became_peered":"2024-09-18T01:45:04.292082+0000","last_unstale":"2024-09-18T01:49:14.095903+0000","last_undegraded":"2024-09-18T01:49:14.095903+0000","last_fullsized":"2024-09-18T01:49:14.095903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:14.095775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:14.095775+0000","last_clean_scrub_stamp":"2024-09-18T01:49:14.095775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:30:01.793692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:38.882296+0000","last_change":"2024-09-18T01:48:38.882296+0000","last_active":"2024-09-18T01:48:38.882296+0000","last_peered":"2024-09-18T01:48:38.882296+0000","last_clean":"2024-09-18T01:48:38.882296+0000","last_became_active":"2024-09-18T01:45:08.286609+0000","last_became_peered":"2024-09-18T01:45:08.286609+0000","last_unstale":"2024-09-18T01:48:38.882296+0000","last_undegraded":"2024-09-18T01:48:38.882296+0000","last_fullsized":"2024-09-18T01:48:38.882296+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:38.882174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:38.882174+0000","last_clean_scrub_stamp":"2024-09-18T01:48:38.882174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:30:42.400285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'46","reported_seq":104,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:50.033208+0000","last_change":"2024-09-18T01:48:50.033254+0000","last_active":"2024-09-18T01:48:50.033208+0000","last_peered":"2024-09-18T01:48:50.033208+0000","last_clean":"2024-09-18T01:48:50.033208+0000","last_became_active":"2024-09-18T01:45:10.309360+0000","last_became_peered":"2024-09-18T01:45:10.309360+0000","last_unstale":"2024-09-18T01:48:50.033208+0000","last_undegraded":"2024-09-18T01:48:50.033208+0000","last_fullsized":"2024-09-18T01:48:50.033208+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'46","last_scrub_stamp":"2024-09-18T01:48:50.033115+0000","last_deep_scrub":"33'46","last_deep_scrub_stamp":"2024-09-18T01:48:50.033115+0000","last_clean_scrub_stamp":"2024-09-18T01:48:50.033115+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:38:37.562652+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:30.911520+0000","last_change":"2024-09-18T01:48:30.911546+0000","last_active":"2024-09-18T01:48:30.911520+0000","last_peered":"2024-09-18T01:48:30.911520+0000","last_clean":"2024-09-18T01:48:30.911520+0000","last_became_active":"2024-09-18T01:45:12.314499+0000","last_became_peered":"2024-09-18T01:45:12.314499+0000","last_unstale":"2024-09-18T01:48:30.911520+0000","last_undegraded":"2024-09-18T01:48:30.911520+0000","last_fullsized":"2024-09-18T01:48:30.911520+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:30.911422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:30.911422+0000","last_clean_scrub_stamp":"2024-09-18T01:48:30.911422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:07:15.930276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"33'2","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:43.047001+0000","last_change":"2024-09-18T01:49:43.047001+0000","last_active":"2024-09-18T01:49:43.047001+0000","last_peered":"2024-09-18T01:49:43.047001+0000","last_clean":"2024-09-18T01:49:43.047001+0000","last_became_active":"2024-09-18T01:45:14.325421+0000","last_became_peered":"2024-09-18T01:45:14.325421+0000","last_unstale":"2024-09-18T01:49:43.047001+0000","last_undegraded":"2024-09-18T01:49:43.047001+0000","last_fullsized":"2024-09-18T01:49:43.047001+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:43.046877+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:43.046877+0000","last_clean_scrub_stamp":"2024-09-18T01:49:43.046877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:02:53.411753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'8","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:56.955755+0000","last_change":"2024-09-18T01:48:56.955784+0000","last_active":"2024-09-18T01:48:56.955755+0000","last_peered":"2024-09-18T01:48:56.955755+0000","last_clean":"2024-09-18T01:48:56.955755+0000","last_became_active":"2024-09-18T01:45:06.286153+0000","last_became_peered":"2024-09-18T01:45:06.286153+0000","last_unstale":"2024-09-18T01:48:56.955755+0000","last_undegraded":"2024-09-18T01:48:56.955755+0000","last_fullsized":"2024-09-18T01:48:56.955755+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-18T01:48:56.955654+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-18T01:48:56.955654+0000","last_clean_scrub_stamp":"2024-09-18T01:48:56.955654+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:13:59.028876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:06.115374+0000","last_change":"2024-09-18T01:49:06.115400+0000","last_active":"2024-09-18T01:49:06.115374+0000","last_peered":"2024-09-18T01:49:06.115374+0000","last_clean":"2024-09-18T01:49:06.115374+0000","last_became_active":"2024-09-18T01:45:04.294537+0000","last_became_peered":"2024-09-18T01:45:04.294537+0000","last_unstale":"2024-09-18T01:49:06.115374+0000","last_undegraded":"2024-09-18T01:49:06.115374+0000","last_fullsized":"2024-09-18T01:49:06.115374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-18T01:49:06.115277+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-18T01:49:06.115277+0000","last_clean_scrub_stamp":"2024-09-18T01:49:06.115277+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:58:15.029419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:40.973877+0000","last_change":"2024-09-18T01:48:40.973902+0000","last_active":"2024-09-18T01:48:40.973877+0000","last_peered":"2024-09-18T01:48:40.973877+0000","last_clean":"2024-09-18T01:48:40.973877+0000","last_became_active":"2024-09-18T01:45:08.286466+0000","last_became_peered":"2024-09-18T01:45:08.286466+0000","last_unstale":"2024-09-18T01:48:40.973877+0000","last_undegraded":"2024-09-18T01:48:40.973877+0000","last_fullsized":"2024-09-18T01:48:40.973877+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:40.973787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:40.973787+0000","last_clean_scrub_stamp":"2024-09-18T01:48:40.973787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:56:31.069811+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'48","reported_seq":111,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:32.347342+0000","last_change":"2024-09-18T01:48:32.347342+0000","last_active":"2024-09-18T01:48:32.347342+0000","last_peered":"2024-09-18T01:48:32.347342+0000","last_clean":"2024-09-18T01:48:32.347342+0000","last_became_active":"2024-09-18T01:45:10.303911+0000","last_became_peered":"2024-09-18T01:45:10.303911+0000","last_unstale":"2024-09-18T01:48:32.347342+0000","last_undegraded":"2024-09-18T01:48:32.347342+0000","last_fullsized":"2024-09-18T01:48:32.347342+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'48","last_scrub_stamp":"2024-09-18T01:48:32.347225+0000","last_deep_scrub":"33'48","last_deep_scrub_stamp":"2024-09-18T01:48:32.347225+0000","last_clean_scrub_stamp":"2024-09-18T01:48:32.347225+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:04:17.415601+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:37.329031+0000","last_change":"2024-09-18T01:48:37.329031+0000","last_active":"2024-09-18T01:48:37.329031+0000","last_peered":"2024-09-18T01:48:37.329031+0000","last_clean":"2024-09-18T01:48:37.329031+0000","last_became_active":"2024-09-18T01:45:12.313180+0000","last_became_peered":"2024-09-18T01:45:12.313180+0000","last_unstale":"2024-09-18T01:48:37.329031+0000","last_undegraded":"2024-09-18T01:48:37.329031+0000","last_fullsized":"2024-09-18T01:48:37.329031+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:37.328895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:37.328895+0000","last_clean_scrub_stamp":"2024-09-18T01:48:37.328895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:52:12.877855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"33'3","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:46.065556+0000","last_change":"2024-09-18T01:49:46.065556+0000","last_active":"2024-09-18T01:49:46.065556+0000","last_peered":"2024-09-18T01:49:46.065556+0000","last_clean":"2024-09-18T01:49:46.065556+0000","last_became_active":"2024-09-18T01:45:14.326452+0000","last_became_peered":"2024-09-18T01:45:14.326452+0000","last_unstale":"2024-09-18T01:49:46.065556+0000","last_undegraded":"2024-09-18T01:49:46.065556+0000","last_fullsized":"2024-09-18T01:49:46.065556+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-18T01:49:46.065425+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-18T01:49:46.065425+0000","last_clean_scrub_stamp":"2024-09-18T01:49:46.065425+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:05:44.606321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:01.377573+0000","last_change":"2024-09-18T01:49:01.377628+0000","last_active":"2024-09-18T01:49:01.377573+0000","last_peered":"2024-09-18T01:49:01.377573+0000","last_clean":"2024-09-18T01:49:01.377573+0000","last_became_active":"2024-09-18T01:45:06.281987+0000","last_became_peered":"2024-09-18T01:45:06.281987+0000","last_unstale":"2024-09-18T01:49:01.377573+0000","last_undegraded":"2024-09-18T01:49:01.377573+0000","last_fullsized":"2024-09-18T01:49:01.377573+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:01.377468+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:01.377468+0000","last_clean_scrub_stamp":"2024-09-18T01:49:01.377468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:37:31.352529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:26.974759+0000","last_change":"2024-09-18T01:49:26.974785+0000","last_active":"2024-09-18T01:49:26.974759+0000","last_peered":"2024-09-18T01:49:26.974759+0000","last_clean":"2024-09-18T01:49:26.974759+0000","last_became_active":"2024-09-18T01:45:04.289909+0000","last_became_peered":"2024-09-18T01:45:04.289909+0000","last_unstale":"2024-09-18T01:49:26.974759+0000","last_undegraded":"2024-09-18T01:49:26.974759+0000","last_fullsized":"2024-09-18T01:49:26.974759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:26.974659+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:26.974659+0000","last_clean_scrub_stamp":"2024-09-18T01:49:26.974659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:52:57.644940+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:22.969948+0000","last_change":"2024-09-18T01:49:22.969972+0000","last_active":"2024-09-18T01:49:22.969948+0000","last_peered":"2024-09-18T01:49:22.969948+0000","last_clean":"2024-09-18T01:49:22.969948+0000","last_became_active":"2024-09-18T01:45:41.342280+0000","last_became_peered":"2024-09-18T01:45:41.342280+0000","last_unstale":"2024-09-18T01:49:22.969948+0000","last_undegraded":"2024-09-18T01:49:22.969948+0000","last_fullsized":"2024-09-18T01:49:22.969948+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:22.969861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:22.969861+0000","last_clean_scrub_stamp":"2024-09-18T01:49:22.969861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:49:18.155799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'22","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:53.997424+0000","last_change":"2024-09-18T01:48:53.997424+0000","last_active":"2024-09-18T01:48:53.997424+0000","last_peered":"2024-09-18T01:48:53.997424+0000","last_clean":"2024-09-18T01:48:53.997424+0000","last_became_active":"2024-09-18T01:45:10.308524+0000","last_became_peered":"2024-09-18T01:45:10.308524+0000","last_unstale":"2024-09-18T01:48:53.997424+0000","last_undegraded":"2024-09-18T01:48:53.997424+0000","last_fullsized":"2024-09-18T01:48:53.997424+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2024-09-18T01:48:53.997246+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2024-09-18T01:48:53.997246+0000","last_clean_scrub_stamp":"2024-09-18T01:48:53.997246+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:03:08.771218+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'285","reported_seq":429,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:24.768020+0000","last_change":"2024-09-18T01:48:24.768020+0000","last_active":"2024-09-18T01:48:24.768020+0000","last_peered":"2024-09-18T01:48:24.768020+0000","last_clean":"2024-09-18T01:48:24.768020+0000","last_became_active":"2024-09-18T01:45:12.307186+0000","last_became_peered":"2024-09-18T01:45:12.307186+0000","last_unstale":"2024-09-18T01:48:24.768020+0000","last_undegraded":"2024-09-18T01:48:24.768020+0000","last_fullsized":"2024-09-18T01:48:24.768020+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-18T01:48:24.767877+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-18T01:48:24.767877+0000","last_clean_scrub_stamp":"2024-09-18T01:48:24.767877+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:40:56.957174+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"33'3","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:44.098267+0000","last_change":"2024-09-18T01:49:44.098267+0000","last_active":"2024-09-18T01:49:44.098267+0000","last_peered":"2024-09-18T01:49:44.098267+0000","last_clean":"2024-09-18T01:49:44.098267+0000","last_became_active":"2024-09-18T01:45:14.326018+0000","last_became_peered":"2024-09-18T01:45:14.326018+0000","last_unstale":"2024-09-18T01:49:44.098267+0000","last_undegraded":"2024-09-18T01:49:44.098267+0000","last_fullsized":"2024-09-18T01:49:44.098267+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-18T01:49:44.098146+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-18T01:49:44.098146+0000","last_clean_scrub_stamp":"2024-09-18T01:49:44.098146+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:41:57.886157+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"33'8","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:46.046853+0000","last_change":"2024-09-18T01:48:46.046882+0000","last_active":"2024-09-18T01:48:46.046853+0000","last_peered":"2024-09-18T01:48:46.046853+0000","last_clean":"2024-09-18T01:48:46.046853+0000","last_became_active":"2024-09-18T01:45:06.281798+0000","last_became_peered":"2024-09-18T01:45:06.281798+0000","last_unstale":"2024-09-18T01:48:46.046853+0000","last_undegraded":"2024-09-18T01:48:46.046853+0000","last_fullsized":"2024-09-18T01:48:46.046853+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-18T01:48:46.046757+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-18T01:48:46.046757+0000","last_clean_scrub_stamp":"2024-09-18T01:48:46.046757+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:18:18.174824+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:15.076405+0000","last_change":"2024-09-18T01:49:15.076439+0000","last_active":"2024-09-18T01:49:15.076405+0000","last_peered":"2024-09-18T01:49:15.076405+0000","last_clean":"2024-09-18T01:49:15.076405+0000","last_became_active":"2024-09-18T01:45:04.293009+0000","last_became_peered":"2024-09-18T01:45:04.293009+0000","last_unstale":"2024-09-18T01:49:15.076405+0000","last_undegraded":"2024-09-18T01:49:15.076405+0000","last_fullsized":"2024-09-18T01:49:15.076405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:15.076307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:15.076307+0000","last_clean_scrub_stamp":"2024-09-18T01:49:15.076307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:38:22.618396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:40.879858+0000","last_change":"2024-09-18T01:48:40.879897+0000","last_active":"2024-09-18T01:48:40.879858+0000","last_peered":"2024-09-18T01:48:40.879858+0000","last_clean":"2024-09-18T01:48:40.879858+0000","last_became_active":"2024-09-18T01:45:08.287884+0000","last_became_peered":"2024-09-18T01:45:08.287884+0000","last_unstale":"2024-09-18T01:48:40.879858+0000","last_undegraded":"2024-09-18T01:48:40.879858+0000","last_fullsized":"2024-09-18T01:48:40.879858+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:40.879744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:40.879744+0000","last_clean_scrub_stamp":"2024-09-18T01:48:40.879744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:23:57.801261+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'74","reported_seq":157,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:29.900260+0000","last_change":"2024-09-18T01:48:29.900260+0000","last_active":"2024-09-18T01:48:29.900260+0000","last_peered":"2024-09-18T01:48:29.900260+0000","last_clean":"2024-09-18T01:48:29.900260+0000","last_became_active":"2024-09-18T01:45:10.301087+0000","last_became_peered":"2024-09-18T01:45:10.301087+0000","last_unstale":"2024-09-18T01:48:29.900260+0000","last_undegraded":"2024-09-18T01:48:29.900260+0000","last_fullsized":"2024-09-18T01:48:29.900260+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'74","last_scrub_stamp":"2024-09-18T01:48:29.900089+0000","last_deep_scrub":"33'74","last_deep_scrub_stamp":"2024-09-18T01:48:29.900089+0000","last_clean_scrub_stamp":"2024-09-18T01:48:29.900089+0000","objects_scrubbed":11,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:03:12.147484+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:25.260445+0000","last_change":"2024-09-18T01:48:25.260445+0000","last_active":"2024-09-18T01:48:25.260445+0000","last_peered":"2024-09-18T01:48:25.260445+0000","last_clean":"2024-09-18T01:48:25.260445+0000","last_became_active":"2024-09-18T01:45:12.312055+0000","last_became_peered":"2024-09-18T01:45:12.312055+0000","last_unstale":"2024-09-18T01:48:25.260445+0000","last_undegraded":"2024-09-18T01:48:25.260445+0000","last_fullsized":"2024-09-18T01:48:25.260445+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:25.260301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:25.260301+0000","last_clean_scrub_stamp":"2024-09-18T01:48:25.260301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:20:06.632858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"33'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:20.049248+0000","last_change":"2024-09-18T01:49:20.049275+0000","last_active":"2024-09-18T01:49:20.049248+0000","last_peered":"2024-09-18T01:49:20.049248+0000","last_clean":"2024-09-18T01:49:20.049248+0000","last_became_active":"2024-09-18T01:45:14.322945+0000","last_became_peered":"2024-09-18T01:45:14.322945+0000","last_unstale":"2024-09-18T01:49:20.049248+0000","last_undegraded":"2024-09-18T01:49:20.049248+0000","last_fullsized":"2024-09-18T01:49:20.049248+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:20.049159+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:20.049159+0000","last_clean_scrub_stamp":"2024-09-18T01:49:20.049159+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:05:28.272049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'6","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:48.023951+0000","last_change":"2024-09-18T01:48:48.023979+0000","last_active":"2024-09-18T01:48:48.023951+0000","last_peered":"2024-09-18T01:48:48.023951+0000","last_clean":"2024-09-18T01:48:48.023951+0000","last_became_active":"2024-09-18T01:45:06.281480+0000","last_became_peered":"2024-09-18T01:45:06.281480+0000","last_unstale":"2024-09-18T01:48:48.023951+0000","last_undegraded":"2024-09-18T01:48:48.023951+0000","last_fullsized":"2024-09-18T01:48:48.023951+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-18T01:48:48.023825+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-18T01:48:48.023825+0000","last_clean_scrub_stamp":"2024-09-18T01:48:48.023825+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:47:46.236855+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:29.039620+0000","last_change":"2024-09-18T01:49:29.039649+0000","last_active":"2024-09-18T01:49:29.039620+0000","last_peered":"2024-09-18T01:49:29.039620+0000","last_clean":"2024-09-18T01:49:29.039620+0000","last_became_active":"2024-09-18T01:45:04.290901+0000","last_became_peered":"2024-09-18T01:45:04.290901+0000","last_unstale":"2024-09-18T01:49:29.039620+0000","last_undegraded":"2024-09-18T01:49:29.039620+0000","last_fullsized":"2024-09-18T01:49:29.039620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:29.039515+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:29.039515+0000","last_clean_scrub_stamp":"2024-09-18T01:49:29.039515+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:16:22.127013+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:41.995434+0000","last_change":"2024-09-18T01:48:41.995473+0000","last_active":"2024-09-18T01:48:41.995434+0000","last_peered":"2024-09-18T01:48:41.995434+0000","last_clean":"2024-09-18T01:48:41.995434+0000","last_became_active":"2024-09-18T01:45:08.286502+0000","last_became_peered":"2024-09-18T01:45:08.286502+0000","last_unstale":"2024-09-18T01:48:41.995434+0000","last_undegraded":"2024-09-18T01:48:41.995434+0000","last_fullsized":"2024-09-18T01:48:41.995434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:41.995333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:41.995333+0000","last_clean_scrub_stamp":"2024-09-18T01:48:41.995333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:40:51.267310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'43","reported_seq":105,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:30.281182+0000","last_change":"2024-09-18T01:48:30.281182+0000","last_active":"2024-09-18T01:48:30.281182+0000","last_peered":"2024-09-18T01:48:30.281182+0000","last_clean":"2024-09-18T01:48:30.281182+0000","last_became_active":"2024-09-18T01:45:10.306076+0000","last_became_peered":"2024-09-18T01:45:10.306076+0000","last_unstale":"2024-09-18T01:48:30.281182+0000","last_undegraded":"2024-09-18T01:48:30.281182+0000","last_fullsized":"2024-09-18T01:48:30.281182+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-09-18T01:48:30.281049+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-09-18T01:48:30.281049+0000","last_clean_scrub_stamp":"2024-09-18T01:48:30.281049+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:14:03.450919+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:46.991507+0000","last_change":"2024-09-18T01:48:46.991507+0000","last_active":"2024-09-18T01:48:46.991507+0000","last_peered":"2024-09-18T01:48:46.991507+0000","last_clean":"2024-09-18T01:48:46.991507+0000","last_became_active":"2024-09-18T01:45:12.316022+0000","last_became_peered":"2024-09-18T01:45:12.316022+0000","last_unstale":"2024-09-18T01:48:46.991507+0000","last_undegraded":"2024-09-18T01:48:46.991507+0000","last_fullsized":"2024-09-18T01:48:46.991507+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:46.991352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:46.991352+0000","last_clean_scrub_stamp":"2024-09-18T01:48:46.991352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:54:48.148908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:10.901935+0000","last_change":"2024-09-18T01:49:10.901958+0000","last_active":"2024-09-18T01:49:10.901935+0000","last_peered":"2024-09-18T01:49:10.901935+0000","last_clean":"2024-09-18T01:49:10.901935+0000","last_became_active":"2024-09-18T01:45:14.325208+0000","last_became_peered":"2024-09-18T01:45:14.325208+0000","last_unstale":"2024-09-18T01:49:10.901935+0000","last_undegraded":"2024-09-18T01:49:10.901935+0000","last_fullsized":"2024-09-18T01:49:10.901935+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:10.901834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:10.901834+0000","last_clean_scrub_stamp":"2024-09-18T01:49:10.901834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:07:05.409713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'26","reported_seq":104,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:04.884579+0000","last_change":"2024-09-18T01:49:04.884579+0000","last_active":"2024-09-18T01:49:04.884579+0000","last_peered":"2024-09-18T01:49:04.884579+0000","last_clean":"2024-09-18T01:49:04.884579+0000","last_became_active":"2024-09-18T01:45:06.283174+0000","last_became_peered":"2024-09-18T01:45:06.283174+0000","last_unstale":"2024-09-18T01:49:04.884579+0000","last_undegraded":"2024-09-18T01:49:04.884579+0000","last_fullsized":"2024-09-18T01:49:04.884579+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'26","last_scrub_stamp":"2024-09-18T01:49:04.884436+0000","last_deep_scrub":"33'26","last_deep_scrub_stamp":"2024-09-18T01:49:04.884436+0000","last_clean_scrub_stamp":"2024-09-18T01:49:04.884436+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:46:17.194645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":84,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:13.343822+0000","last_change":"2024-09-18T01:49:13.343852+0000","last_active":"2024-09-18T01:49:13.343822+0000","last_peered":"2024-09-18T01:49:13.343822+0000","last_clean":"2024-09-18T01:49:13.343822+0000","last_became_active":"2024-09-18T01:45:04.273128+0000","last_became_peered":"2024-09-18T01:45:04.273128+0000","last_unstale":"2024-09-18T01:49:13.343822+0000","last_undegraded":"2024-09-18T01:49:13.343822+0000","last_fullsized":"2024-09-18T01:49:13.343822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:13.343714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:13.343714+0000","last_clean_scrub_stamp":"2024-09-18T01:49:13.343714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:05:43.373224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"33'5","reported_seq":239,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:33.930178+0000","last_change":"2024-09-18T01:48:33.930178+0000","last_active":"2024-09-18T01:48:33.930178+0000","last_peered":"2024-09-18T01:48:33.930178+0000","last_clean":"2024-09-18T01:48:33.930178+0000","last_became_active":"2024-09-18T01:45:08.294338+0000","last_became_peered":"2024-09-18T01:45:08.294338+0000","last_unstale":"2024-09-18T01:48:33.930178+0000","last_undegraded":"2024-09-18T01:48:33.930178+0000","last_fullsized":"2024-09-18T01:48:33.930178+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-18T01:48:33.930067+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-18T01:48:33.930067+0000","last_clean_scrub_stamp":"2024-09-18T01:48:33.930067+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:04:18.998443+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'39","reported_seq":98,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:53.009496+0000","last_change":"2024-09-18T01:48:53.009528+0000","last_active":"2024-09-18T01:48:53.009496+0000","last_peered":"2024-09-18T01:48:53.009496+0000","last_clean":"2024-09-18T01:48:53.009496+0000","last_became_active":"2024-09-18T01:45:10.308336+0000","last_became_peered":"2024-09-18T01:45:10.308336+0000","last_unstale":"2024-09-18T01:48:53.009496+0000","last_undegraded":"2024-09-18T01:48:53.009496+0000","last_fullsized":"2024-09-18T01:48:53.009496+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'39","last_scrub_stamp":"2024-09-18T01:48:53.009391+0000","last_deep_scrub":"33'39","last_deep_scrub_stamp":"2024-09-18T01:48:53.009391+0000","last_clean_scrub_stamp":"2024-09-18T01:48:53.009391+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:38:00.551480+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:48.000035+0000","last_change":"2024-09-18T01:48:48.000061+0000","last_active":"2024-09-18T01:48:48.000035+0000","last_peered":"2024-09-18T01:48:48.000035+0000","last_clean":"2024-09-18T01:48:48.000035+0000","last_became_active":"2024-09-18T01:45:12.312794+0000","last_became_peered":"2024-09-18T01:45:12.312794+0000","last_unstale":"2024-09-18T01:48:48.000035+0000","last_undegraded":"2024-09-18T01:48:48.000035+0000","last_fullsized":"2024-09-18T01:48:48.000035+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:47.999948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:47.999948+0000","last_clean_scrub_stamp":"2024-09-18T01:48:47.999948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:23:16.320379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"33'10","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:42.031408+0000","last_change":"2024-09-18T01:49:42.031433+0000","last_active":"2024-09-18T01:49:42.031408+0000","last_peered":"2024-09-18T01:49:42.031408+0000","last_clean":"2024-09-18T01:49:42.031408+0000","last_became_active":"2024-09-18T01:45:14.325464+0000","last_became_peered":"2024-09-18T01:45:14.325464+0000","last_unstale":"2024-09-18T01:49:42.031408+0000","last_undegraded":"2024-09-18T01:49:42.031408+0000","last_fullsized":"2024-09-18T01:49:42.031408+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-18T01:49:42.031309+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-18T01:49:42.031309+0000","last_clean_scrub_stamp":"2024-09-18T01:49:42.031309+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:34:39.876369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'8","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:50.009639+0000","last_change":"2024-09-18T01:48:50.009639+0000","last_active":"2024-09-18T01:48:50.009639+0000","last_peered":"2024-09-18T01:48:50.009639+0000","last_clean":"2024-09-18T01:48:50.009639+0000","last_became_active":"2024-09-18T01:45:06.283071+0000","last_became_peered":"2024-09-18T01:45:06.283071+0000","last_unstale":"2024-09-18T01:48:50.009639+0000","last_undegraded":"2024-09-18T01:48:50.009639+0000","last_fullsized":"2024-09-18T01:48:50.009639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-18T01:48:50.009508+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-18T01:48:50.009508+0000","last_clean_scrub_stamp":"2024-09-18T01:48:50.009508+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:20:50.711544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:02.173712+0000","last_change":"2024-09-18T01:49:02.173712+0000","last_active":"2024-09-18T01:49:02.173712+0000","last_peered":"2024-09-18T01:49:02.173712+0000","last_clean":"2024-09-18T01:49:02.173712+0000","last_became_active":"2024-09-18T01:45:04.297716+0000","last_became_peered":"2024-09-18T01:45:04.297716+0000","last_unstale":"2024-09-18T01:49:02.173712+0000","last_undegraded":"2024-09-18T01:49:02.173712+0000","last_fullsized":"2024-09-18T01:49:02.173712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:49:02.173559+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:49:02.173559+0000","last_clean_scrub_stamp":"2024-09-18T01:49:02.173559+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:55:03.121556+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'3","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:36.961625+0000","last_change":"2024-09-18T01:48:36.961625+0000","last_active":"2024-09-18T01:48:36.961625+0000","last_peered":"2024-09-18T01:48:36.961625+0000","last_clean":"2024-09-18T01:48:36.961625+0000","last_became_active":"2024-09-18T01:45:08.294160+0000","last_became_peered":"2024-09-18T01:45:08.294160+0000","last_unstale":"2024-09-18T01:48:36.961625+0000","last_undegraded":"2024-09-18T01:48:36.961625+0000","last_fullsized":"2024-09-18T01:48:36.961625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-18T01:48:36.961514+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-18T01:48:36.961514+0000","last_clean_scrub_stamp":"2024-09-18T01:48:36.961514+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:20:37.663549+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'53","reported_seq":122,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:43.072087+0000","last_change":"2024-09-18T01:48:43.072125+0000","last_active":"2024-09-18T01:48:43.072087+0000","last_peered":"2024-09-18T01:48:43.072087+0000","last_clean":"2024-09-18T01:48:43.072087+0000","last_became_active":"2024-09-18T01:45:10.308302+0000","last_became_peered":"2024-09-18T01:45:10.308302+0000","last_unstale":"2024-09-18T01:48:43.072087+0000","last_undegraded":"2024-09-18T01:48:43.072087+0000","last_fullsized":"2024-09-18T01:48:43.072087+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'53","last_scrub_stamp":"2024-09-18T01:48:43.071994+0000","last_deep_scrub":"33'53","last_deep_scrub_stamp":"2024-09-18T01:48:43.071994+0000","last_clean_scrub_stamp":"2024-09-18T01:48:43.071994+0000","objects_scrubbed":7,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:57:25.764909+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:28.229701+0000","last_change":"2024-09-18T01:48:28.229726+0000","last_active":"2024-09-18T01:48:28.229701+0000","last_peered":"2024-09-18T01:48:28.229701+0000","last_clean":"2024-09-18T01:48:28.229701+0000","last_became_active":"2024-09-18T01:45:12.305742+0000","last_became_peered":"2024-09-18T01:45:12.305742+0000","last_unstale":"2024-09-18T01:48:28.229701+0000","last_undegraded":"2024-09-18T01:48:28.229701+0000","last_fullsized":"2024-09-18T01:48:28.229701+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:28.229607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:28.229607+0000","last_clean_scrub_stamp":"2024-09-18T01:48:28.229607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:03:10.477001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"33'2","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:14.923068+0000","last_change":"2024-09-18T01:49:14.923068+0000","last_active":"2024-09-18T01:49:14.923068+0000","last_peered":"2024-09-18T01:49:14.923068+0000","last_clean":"2024-09-18T01:49:14.923068+0000","last_became_active":"2024-09-18T01:45:14.325368+0000","last_became_peered":"2024-09-18T01:45:14.325368+0000","last_unstale":"2024-09-18T01:49:14.923068+0000","last_undegraded":"2024-09-18T01:49:14.923068+0000","last_fullsized":"2024-09-18T01:49:14.923068+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:14.922951+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:14.922951+0000","last_clean_scrub_stamp":"2024-09-18T01:49:14.922951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:33:07.551122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"33'10","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:23.933837+0000","last_change":"2024-09-18T01:49:23.933837+0000","last_active":"2024-09-18T01:49:23.933837+0000","last_peered":"2024-09-18T01:49:23.933837+0000","last_clean":"2024-09-18T01:49:23.933837+0000","last_became_active":"2024-09-18T01:45:41.342336+0000","last_became_peered":"2024-09-18T01:45:41.342336+0000","last_unstale":"2024-09-18T01:49:23.933837+0000","last_undegraded":"2024-09-18T01:49:23.933837+0000","last_fullsized":"2024-09-18T01:49:23.933837+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-18T01:49:23.933706+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-18T01:49:23.933706+0000","last_clean_scrub_stamp":"2024-09-18T01:49:23.933706+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:54:37.025570+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:03.045975+0000","last_change":"2024-09-18T01:49:03.045975+0000","last_active":"2024-09-18T01:49:03.045975+0000","last_peered":"2024-09-18T01:49:03.045975+0000","last_clean":"2024-09-18T01:49:03.045975+0000","last_became_active":"2024-09-18T01:45:04.284969+0000","last_became_peered":"2024-09-18T01:45:04.284969+0000","last_unstale":"2024-09-18T01:49:03.045975+0000","last_undegraded":"2024-09-18T01:49:03.045975+0000","last_fullsized":"2024-09-18T01:49:03.045975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:03.045840+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:03.045840+0000","last_clean_scrub_stamp":"2024-09-18T01:49:03.045840+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:10:07.759840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'12","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:09.314766+0000","last_change":"2024-09-18T01:49:09.314766+0000","last_active":"2024-09-18T01:49:09.314766+0000","last_peered":"2024-09-18T01:49:09.314766+0000","last_clean":"2024-09-18T01:49:09.314766+0000","last_became_active":"2024-09-18T01:45:06.285500+0000","last_became_peered":"2024-09-18T01:45:06.285500+0000","last_unstale":"2024-09-18T01:49:09.314766+0000","last_undegraded":"2024-09-18T01:49:09.314766+0000","last_fullsized":"2024-09-18T01:49:09.314766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-18T01:49:09.314630+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-18T01:49:09.314630+0000","last_clean_scrub_stamp":"2024-09-18T01:49:09.314630+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:20:35.072341+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:10.357393+0000","last_change":"2024-09-18T01:49:10.357393+0000","last_active":"2024-09-18T01:49:10.357393+0000","last_peered":"2024-09-18T01:49:10.357393+0000","last_clean":"2024-09-18T01:49:10.357393+0000","last_became_active":"2024-09-18T01:45:04.280147+0000","last_became_peered":"2024-09-18T01:45:04.280147+0000","last_unstale":"2024-09-18T01:49:10.357393+0000","last_undegraded":"2024-09-18T01:49:10.357393+0000","last_fullsized":"2024-09-18T01:49:10.357393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:10.357273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:10.357273+0000","last_clean_scrub_stamp":"2024-09-18T01:49:10.357273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:29:03.313231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:11.874685+0000","last_change":"2024-09-18T01:49:11.874685+0000","last_active":"2024-09-18T01:49:11.874685+0000","last_peered":"2024-09-18T01:49:11.874685+0000","last_clean":"2024-09-18T01:49:11.874685+0000","last_became_active":"2024-09-18T01:45:06.278684+0000","last_became_peered":"2024-09-18T01:45:06.278684+0000","last_unstale":"2024-09-18T01:49:11.874685+0000","last_undegraded":"2024-09-18T01:49:11.874685+0000","last_fullsized":"2024-09-18T01:49:11.874685+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:49:11.874525+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:49:11.874525+0000","last_clean_scrub_stamp":"2024-09-18T01:49:11.874525+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:10:48.245598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:30.048139+0000","last_change":"2024-09-18T01:49:30.048177+0000","last_active":"2024-09-18T01:49:30.048139+0000","last_peered":"2024-09-18T01:49:30.048139+0000","last_clean":"2024-09-18T01:49:30.048139+0000","last_became_active":"2024-09-18T01:45:04.281920+0000","last_became_peered":"2024-09-18T01:45:04.281920+0000","last_unstale":"2024-09-18T01:49:30.048139+0000","last_undegraded":"2024-09-18T01:49:30.048139+0000","last_fullsized":"2024-09-18T01:49:30.048139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:30.048046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:30.048046+0000","last_clean_scrub_stamp":"2024-09-18T01:49:30.048046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:28:31.019549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"33'6","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:57.373010+0000","last_change":"2024-09-18T01:48:57.373010+0000","last_active":"2024-09-18T01:48:57.373010+0000","last_peered":"2024-09-18T01:48:57.373010+0000","last_clean":"2024-09-18T01:48:57.373010+0000","last_became_active":"2024-09-18T01:45:06.281998+0000","last_became_peered":"2024-09-18T01:45:06.281998+0000","last_unstale":"2024-09-18T01:48:57.373010+0000","last_undegraded":"2024-09-18T01:48:57.373010+0000","last_fullsized":"2024-09-18T01:48:57.373010+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-18T01:48:57.372819+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-18T01:48:57.372819+0000","last_clean_scrub_stamp":"2024-09-18T01:48:57.372819+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:39:02.799260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:08.302464+0000","last_change":"2024-09-18T01:49:08.302464+0000","last_active":"2024-09-18T01:49:08.302464+0000","last_peered":"2024-09-18T01:49:08.302464+0000","last_clean":"2024-09-18T01:49:08.302464+0000","last_became_active":"2024-09-18T01:45:04.280066+0000","last_became_peered":"2024-09-18T01:45:04.280066+0000","last_unstale":"2024-09-18T01:49:08.302464+0000","last_undegraded":"2024-09-18T01:49:08.302464+0000","last_fullsized":"2024-09-18T01:49:08.302464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:08.302332+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:08.302332+0000","last_clean_scrub_stamp":"2024-09-18T01:49:08.302332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:19:38.144899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:07.279054+0000","last_change":"2024-09-18T01:49:07.279054+0000","last_active":"2024-09-18T01:49:07.279054+0000","last_peered":"2024-09-18T01:49:07.279054+0000","last_clean":"2024-09-18T01:49:07.279054+0000","last_became_active":"2024-09-18T01:45:06.285054+0000","last_became_peered":"2024-09-18T01:45:06.285054+0000","last_unstale":"2024-09-18T01:49:07.279054+0000","last_undegraded":"2024-09-18T01:49:07.279054+0000","last_fullsized":"2024-09-18T01:49:07.279054+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:07.278872+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:07.278872+0000","last_clean_scrub_stamp":"2024-09-18T01:49:07.278872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:54:25.184819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"31'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:02.362686+0000","last_change":"2024-09-18T01:49:02.362686+0000","last_active":"2024-09-18T01:49:02.362686+0000","last_peered":"2024-09-18T01:49:02.362686+0000","last_clean":"2024-09-18T01:49:02.362686+0000","last_became_active":"2024-09-18T01:45:04.281146+0000","last_became_peered":"2024-09-18T01:45:04.281146+0000","last_unstale":"2024-09-18T01:49:02.362686+0000","last_undegraded":"2024-09-18T01:49:02.362686+0000","last_fullsized":"2024-09-18T01:49:02.362686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-18T01:49:02.362562+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-18T01:49:02.362562+0000","last_clean_scrub_stamp":"2024-09-18T01:49:02.362562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:27:34.245079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:07.095514+0000","last_change":"2024-09-18T01:49:07.095514+0000","last_active":"2024-09-18T01:49:07.095514+0000","last_peered":"2024-09-18T01:49:07.095514+0000","last_clean":"2024-09-18T01:49:07.095514+0000","last_became_active":"2024-09-18T01:45:06.292490+0000","last_became_peered":"2024-09-18T01:45:06.292490+0000","last_unstale":"2024-09-18T01:49:07.095514+0000","last_undegraded":"2024-09-18T01:49:07.095514+0000","last_fullsized":"2024-09-18T01:49:07.095514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:07.095395+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:07.095395+0000","last_clean_scrub_stamp":"2024-09-18T01:49:07.095395+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:18:33.137302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:16.106798+0000","last_change":"2024-09-18T01:49:16.106798+0000","last_active":"2024-09-18T01:49:16.106798+0000","last_peered":"2024-09-18T01:49:16.106798+0000","last_clean":"2024-09-18T01:49:16.106798+0000","last_became_active":"2024-09-18T01:45:04.293767+0000","last_became_peered":"2024-09-18T01:45:04.293767+0000","last_unstale":"2024-09-18T01:49:16.106798+0000","last_undegraded":"2024-09-18T01:49:16.106798+0000","last_fullsized":"2024-09-18T01:49:16.106798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:16.106685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:16.106685+0000","last_clean_scrub_stamp":"2024-09-18T01:49:16.106685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:03:30.880656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"33'10","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:51.420813+0000","last_change":"2024-09-18T01:48:51.420813+0000","last_active":"2024-09-18T01:48:51.420813+0000","last_peered":"2024-09-18T01:48:51.420813+0000","last_clean":"2024-09-18T01:48:51.420813+0000","last_became_active":"2024-09-18T01:45:06.293369+0000","last_became_peered":"2024-09-18T01:45:06.293369+0000","last_unstale":"2024-09-18T01:48:51.420813+0000","last_undegraded":"2024-09-18T01:48:51.420813+0000","last_fullsized":"2024-09-18T01:48:51.420813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-18T01:48:51.420614+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-18T01:48:51.420614+0000","last_clean_scrub_stamp":"2024-09-18T01:48:51.420614+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:43:49.179948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:57.058359+0000","last_change":"2024-09-18T01:48:57.058359+0000","last_active":"2024-09-18T01:48:57.058359+0000","last_peered":"2024-09-18T01:48:57.058359+0000","last_clean":"2024-09-18T01:48:57.058359+0000","last_became_active":"2024-09-18T01:45:04.292056+0000","last_became_peered":"2024-09-18T01:45:04.292056+0000","last_unstale":"2024-09-18T01:48:57.058359+0000","last_undegraded":"2024-09-18T01:48:57.058359+0000","last_fullsized":"2024-09-18T01:48:57.058359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:48:57.058174+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:48:57.058174+0000","last_clean_scrub_stamp":"2024-09-18T01:48:57.058174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:39:24.043782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'8","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:44.891289+0000","last_change":"2024-09-18T01:48:44.891289+0000","last_active":"2024-09-18T01:48:44.891289+0000","last_peered":"2024-09-18T01:48:44.891289+0000","last_clean":"2024-09-18T01:48:44.891289+0000","last_became_active":"2024-09-18T01:45:06.295055+0000","last_became_peered":"2024-09-18T01:45:06.295055+0000","last_unstale":"2024-09-18T01:48:44.891289+0000","last_undegraded":"2024-09-18T01:48:44.891289+0000","last_fullsized":"2024-09-18T01:48:44.891289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-18T01:48:44.891111+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-18T01:48:44.891111+0000","last_clean_scrub_stamp":"2024-09-18T01:48:44.891111+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:12:36.827132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:56.346237+0000","last_change":"2024-09-18T01:48:56.346237+0000","last_active":"2024-09-18T01:48:56.346237+0000","last_peered":"2024-09-18T01:48:56.346237+0000","last_clean":"2024-09-18T01:48:56.346237+0000","last_became_active":"2024-09-18T01:45:04.283959+0000","last_became_peered":"2024-09-18T01:45:04.283959+0000","last_unstale":"2024-09-18T01:48:56.346237+0000","last_undegraded":"2024-09-18T01:48:56.346237+0000","last_fullsized":"2024-09-18T01:48:56.346237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:56.346122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:56.346122+0000","last_clean_scrub_stamp":"2024-09-18T01:48:56.346122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:58:18.595435+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"33'4","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:47.927701+0000","last_change":"2024-09-18T01:48:47.927701+0000","last_active":"2024-09-18T01:48:47.927701+0000","last_peered":"2024-09-18T01:48:47.927701+0000","last_clean":"2024-09-18T01:48:47.927701+0000","last_became_active":"2024-09-18T01:45:06.295270+0000","last_became_peered":"2024-09-18T01:45:06.295270+0000","last_unstale":"2024-09-18T01:48:47.927701+0000","last_undegraded":"2024-09-18T01:48:47.927701+0000","last_fullsized":"2024-09-18T01:48:47.927701+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:48:47.927542+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:48:47.927542+0000","last_clean_scrub_stamp":"2024-09-18T01:48:47.927542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:48:47.618456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:39.040364+0000","last_change":"2024-09-18T01:49:39.040409+0000","last_active":"2024-09-18T01:49:39.040364+0000","last_peered":"2024-09-18T01:49:39.040364+0000","last_clean":"2024-09-18T01:49:39.040364+0000","last_became_active":"2024-09-18T01:45:04.278951+0000","last_became_peered":"2024-09-18T01:45:04.278951+0000","last_unstale":"2024-09-18T01:49:39.040364+0000","last_undegraded":"2024-09-18T01:49:39.040364+0000","last_fullsized":"2024-09-18T01:49:39.040364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:39.040257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:39.040257+0000","last_clean_scrub_stamp":"2024-09-18T01:49:39.040257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:07:13.886958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'4","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:01.924286+0000","last_change":"2024-09-18T01:49:01.924286+0000","last_active":"2024-09-18T01:49:01.924286+0000","last_peered":"2024-09-18T01:49:01.924286+0000","last_clean":"2024-09-18T01:49:01.924286+0000","last_became_active":"2024-09-18T01:45:06.285272+0000","last_became_peered":"2024-09-18T01:45:06.285272+0000","last_unstale":"2024-09-18T01:49:01.924286+0000","last_undegraded":"2024-09-18T01:49:01.924286+0000","last_fullsized":"2024-09-18T01:49:01.924286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:49:01.924168+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:49:01.924168+0000","last_clean_scrub_stamp":"2024-09-18T01:49:01.924168+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:54:15.016033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:00.389566+0000","last_change":"2024-09-18T01:49:00.389566+0000","last_active":"2024-09-18T01:49:00.389566+0000","last_peered":"2024-09-18T01:49:00.389566+0000","last_clean":"2024-09-18T01:49:00.389566+0000","last_became_active":"2024-09-18T01:45:04.281197+0000","last_became_peered":"2024-09-18T01:45:04.281197+0000","last_unstale":"2024-09-18T01:49:00.389566+0000","last_undegraded":"2024-09-18T01:49:00.389566+0000","last_fullsized":"2024-09-18T01:49:00.389566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:00.389446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:00.389446+0000","last_clean_scrub_stamp":"2024-09-18T01:49:00.389446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:16:22.876886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"33'4","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:03.333763+0000","last_change":"2024-09-18T01:49:03.333763+0000","last_active":"2024-09-18T01:49:03.333763+0000","last_peered":"2024-09-18T01:49:03.333763+0000","last_clean":"2024-09-18T01:49:03.333763+0000","last_became_active":"2024-09-18T01:45:06.284989+0000","last_became_peered":"2024-09-18T01:45:06.284989+0000","last_unstale":"2024-09-18T01:49:03.333763+0000","last_undegraded":"2024-09-18T01:49:03.333763+0000","last_fullsized":"2024-09-18T01:49:03.333763+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:49:03.333650+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:49:03.333650+0000","last_clean_scrub_stamp":"2024-09-18T01:49:03.333650+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:58:12.247792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:04.101172+0000","last_change":"2024-09-18T01:49:04.101172+0000","last_active":"2024-09-18T01:49:04.101172+0000","last_peered":"2024-09-18T01:49:04.101172+0000","last_clean":"2024-09-18T01:49:04.101172+0000","last_became_active":"2024-09-18T01:45:04.294125+0000","last_became_peered":"2024-09-18T01:45:04.294125+0000","last_unstale":"2024-09-18T01:49:04.101172+0000","last_undegraded":"2024-09-18T01:49:04.101172+0000","last_fullsized":"2024-09-18T01:49:04.101172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:04.101055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:04.101055+0000","last_clean_scrub_stamp":"2024-09-18T01:49:04.101055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:37:34.076116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"33'10","reported_seq":77,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:56.058261+0000","last_change":"2024-09-18T01:48:56.058261+0000","last_active":"2024-09-18T01:48:56.058261+0000","last_peered":"2024-09-18T01:48:56.058261+0000","last_clean":"2024-09-18T01:48:56.058261+0000","last_became_active":"2024-09-18T01:45:06.279373+0000","last_became_peered":"2024-09-18T01:45:06.279373+0000","last_unstale":"2024-09-18T01:48:56.058261+0000","last_undegraded":"2024-09-18T01:48:56.058261+0000","last_fullsized":"2024-09-18T01:48:56.058261+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-18T01:48:56.058151+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-18T01:48:56.058151+0000","last_clean_scrub_stamp":"2024-09-18T01:48:56.058151+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:04:14.350688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"33'4","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:13.057421+0000","last_change":"2024-09-18T01:49:13.057421+0000","last_active":"2024-09-18T01:49:13.057421+0000","last_peered":"2024-09-18T01:49:13.057421+0000","last_clean":"2024-09-18T01:49:13.057421+0000","last_became_active":"2024-09-18T01:45:04.291442+0000","last_became_peered":"2024-09-18T01:45:04.291442+0000","last_unstale":"2024-09-18T01:49:13.057421+0000","last_undegraded":"2024-09-18T01:49:13.057421+0000","last_fullsized":"2024-09-18T01:49:13.057421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:49:13.057304+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:49:13.057304+0000","last_clean_scrub_stamp":"2024-09-18T01:49:13.057304+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:10:42.433101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'6","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:17.085686+0000","last_change":"2024-09-18T01:49:17.085686+0000","last_active":"2024-09-18T01:49:17.085686+0000","last_peered":"2024-09-18T01:49:17.085686+0000","last_clean":"2024-09-18T01:49:17.085686+0000","last_became_active":"2024-09-18T01:45:06.292425+0000","last_became_peered":"2024-09-18T01:45:06.292425+0000","last_unstale":"2024-09-18T01:49:17.085686+0000","last_undegraded":"2024-09-18T01:49:17.085686+0000","last_fullsized":"2024-09-18T01:49:17.085686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-18T01:49:17.085574+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-18T01:49:17.085574+0000","last_clean_scrub_stamp":"2024-09-18T01:49:17.085574+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T06:00:50.007418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:24.905956+0000","last_change":"2024-09-18T01:49:24.905956+0000","last_active":"2024-09-18T01:49:24.905956+0000","last_peered":"2024-09-18T01:49:24.905956+0000","last_clean":"2024-09-18T01:49:24.905956+0000","last_became_active":"2024-09-18T01:45:04.289365+0000","last_became_peered":"2024-09-18T01:45:04.289365+0000","last_unstale":"2024-09-18T01:49:24.905956+0000","last_undegraded":"2024-09-18T01:49:24.905956+0000","last_fullsized":"2024-09-18T01:49:24.905956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:24.905795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:24.905795+0000","last_clean_scrub_stamp":"2024-09-18T01:49:24.905795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:14:35.484488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:52.005632+0000","last_change":"2024-09-18T01:48:52.005632+0000","last_active":"2024-09-18T01:48:52.005632+0000","last_peered":"2024-09-18T01:48:52.005632+0000","last_clean":"2024-09-18T01:48:52.005632+0000","last_became_active":"2024-09-18T01:45:06.293403+0000","last_became_peered":"2024-09-18T01:45:06.293403+0000","last_unstale":"2024-09-18T01:48:52.005632+0000","last_undegraded":"2024-09-18T01:48:52.005632+0000","last_fullsized":"2024-09-18T01:48:52.005632+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:48:52.005522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:48:52.005522+0000","last_clean_scrub_stamp":"2024-09-18T01:48:52.005522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:15:53.488207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:37.999869+0000","last_change":"2024-09-18T01:49:37.999892+0000","last_active":"2024-09-18T01:49:37.999869+0000","last_peered":"2024-09-18T01:49:37.999869+0000","last_clean":"2024-09-18T01:49:37.999869+0000","last_became_active":"2024-09-18T01:45:04.277907+0000","last_became_peered":"2024-09-18T01:45:04.277907+0000","last_unstale":"2024-09-18T01:49:37.999869+0000","last_undegraded":"2024-09-18T01:49:37.999869+0000","last_fullsized":"2024-09-18T01:49:37.999869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:37.999759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:37.999759+0000","last_clean_scrub_stamp":"2024-09-18T01:49:37.999759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:56:32.827098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'3","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:41.057681+0000","last_change":"2024-09-18T01:48:41.057681+0000","last_active":"2024-09-18T01:48:41.057681+0000","last_peered":"2024-09-18T01:48:41.057681+0000","last_clean":"2024-09-18T01:48:41.057681+0000","last_became_active":"2024-09-18T01:45:06.293036+0000","last_became_peered":"2024-09-18T01:45:06.293036+0000","last_unstale":"2024-09-18T01:48:41.057681+0000","last_undegraded":"2024-09-18T01:48:41.057681+0000","last_fullsized":"2024-09-18T01:48:41.057681+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-18T01:48:41.057559+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-18T01:48:41.057559+0000","last_clean_scrub_stamp":"2024-09-18T01:48:41.057559+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:16:03.544999+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:07.082806+0000","last_change":"2024-09-18T01:49:07.082806+0000","last_active":"2024-09-18T01:49:07.082806+0000","last_peered":"2024-09-18T01:49:07.082806+0000","last_clean":"2024-09-18T01:49:07.082806+0000","last_became_active":"2024-09-18T01:45:04.286591+0000","last_became_peered":"2024-09-18T01:45:04.286591+0000","last_unstale":"2024-09-18T01:49:07.082806+0000","last_undegraded":"2024-09-18T01:49:07.082806+0000","last_fullsized":"2024-09-18T01:49:07.082806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:07.082676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:07.082676+0000","last_clean_scrub_stamp":"2024-09-18T01:49:07.082676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T12:45:05.170743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"33'4","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:48:45.923392+0000","last_change":"2024-09-18T01:48:45.923392+0000","last_active":"2024-09-18T01:48:45.923392+0000","last_peered":"2024-09-18T01:48:45.923392+0000","last_clean":"2024-09-18T01:48:45.923392+0000","last_became_active":"2024-09-18T01:45:06.294911+0000","last_became_peered":"2024-09-18T01:45:06.294911+0000","last_unstale":"2024-09-18T01:48:45.923392+0000","last_undegraded":"2024-09-18T01:48:45.923392+0000","last_fullsized":"2024-09-18T01:48:45.923392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:48:45.923209+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:48:45.923209+0000","last_clean_scrub_stamp":"2024-09-18T01:48:45.923209+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:37:21.719090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"33'4","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:17.884480+0000","last_change":"2024-09-18T01:49:17.884480+0000","last_active":"2024-09-18T01:49:17.884480+0000","last_peered":"2024-09-18T01:49:17.884480+0000","last_clean":"2024-09-18T01:49:17.884480+0000","last_became_active":"2024-09-18T01:45:04.285719+0000","last_became_peered":"2024-09-18T01:45:04.285719+0000","last_unstale":"2024-09-18T01:49:17.884480+0000","last_undegraded":"2024-09-18T01:49:17.884480+0000","last_fullsized":"2024-09-18T01:49:17.884480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-18T01:49:17.884301+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-18T01:49:17.884301+0000","last_clean_scrub_stamp":"2024-09-18T01:49:17.884301+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:38:45.163944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:40.000487+0000","last_change":"2024-09-18T01:49:40.000487+0000","last_active":"2024-09-18T01:49:40.000487+0000","last_peered":"2024-09-18T01:49:40.000487+0000","last_clean":"2024-09-18T01:49:40.000487+0000","last_became_active":"2024-09-18T01:45:04.278266+0000","last_became_peered":"2024-09-18T01:45:04.278266+0000","last_unstale":"2024-09-18T01:49:40.000487+0000","last_undegraded":"2024-09-18T01:49:40.000487+0000","last_fullsized":"2024-09-18T01:49:40.000487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-18T01:49:40.000327+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-18T01:49:40.000327+0000","last_clean_scrub_stamp":"2024-09-18T01:49:40.000327+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:36:53.988157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"33'10","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:19.358802+0000","last_change":"2024-09-18T01:49:19.358802+0000","last_active":"2024-09-18T01:49:19.358802+0000","last_peered":"2024-09-18T01:49:19.358802+0000","last_clean":"2024-09-18T01:49:19.358802+0000","last_became_active":"2024-09-18T01:45:06.292127+0000","last_became_peered":"2024-09-18T01:45:06.292127+0000","last_unstale":"2024-09-18T01:49:19.358802+0000","last_undegraded":"2024-09-18T01:49:19.358802+0000","last_fullsized":"2024-09-18T01:49:19.358802+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-18T01:49:19.358648+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-18T01:49:19.358648+0000","last_clean_scrub_stamp":"2024-09-18T01:49:19.358648+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:49:14.544586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:17.377446+0000","last_change":"2024-09-18T01:49:17.377446+0000","last_active":"2024-09-18T01:49:17.377446+0000","last_peered":"2024-09-18T01:49:17.377446+0000","last_clean":"2024-09-18T01:49:17.377446+0000","last_became_active":"2024-09-18T01:45:04.273575+0000","last_became_peered":"2024-09-18T01:45:04.273575+0000","last_unstale":"2024-09-18T01:49:17.377446+0000","last_undegraded":"2024-09-18T01:49:17.377446+0000","last_fullsized":"2024-09-18T01:49:17.377446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T01:49:17.377288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T01:49:17.377288+0000","last_clean_scrub_stamp":"2024-09-18T01:49:17.377288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:03:33.963095+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'6","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T01:49:03.126408+0000","last_change":"2024-09-18T01:49:03.126408+0000","last_active":"2024-09-18T01:49:03.126408+0000","last_peered":"2024-09-18T01:49:03.126408+0000","last_clean":"2024-09-18T01:49:03.126408+0000","last_became_active":"2024-09-18T01:45:06.292037+0000","last_became_peered":"2024-09-18T01:45:06.292037+0000","last_unstale":"2024-09-18T01:49:03.126408+0000","last_undegraded":"2024-09-18T01:49:03.126408+0000","last_fullsized":"2024-09-18T01:49:03.126408+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-18T01:49:03.126249+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-18T01:49:03.126249+0000","last_clean_scrub_stamp":"2024-09-18T01:49:03.126249+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:16:25.613689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":9385,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1888,"num_read_kb":1653,"num_write":789,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1751,"ondisk_log_size":1751,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1590,"num_read_kb":1480,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":483,"ondisk_log_size":483,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705730,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39972,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331868,"statfs":{"total":96636764160,"available":96595832832,"internally_reserved":0,"allocated":479232,"data_stored":150270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705730,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40480,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331360,"statfs":{"total":96636764160,"available":96595312640,"internally_reserved":0,"allocated":999424,"data_stored":737378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705730,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40508,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331332,"statfs":{"total":96636764160,"available":96595283968,"internally_reserved":0,"allocated":1028096,"data_stored":738692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705730,"num_pgs":150,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39936,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331904,"statfs":{"total":96636764160,"available":96595869696,"internally_reserved":0,"allocated":442368,"data_stored":148296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T01:50:05.704 DEBUG:teuthology.orchestra.run.smithi129:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-18T01:50:05.827 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.825+0000 7f33ef1a6640 1 Processor -- start 2024-09-18T01:50:05.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.826+0000 7f33ef1a6640 1 -- start start 2024-09-18T01:50:05.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.826+0000 7f33ef1a6640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f33e809bd50 0x7f33e809c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:50:05.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.826+0000 7f33ef1a6640 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33e809d3b0 con 0x7f33e809c670 2024-09-18T01:50:05.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.826+0000 7f33ef1a6640 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 -- 0x7f33e8098230 con 0x7f33e809bd50 2024-09-18T01:50:05.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.826+0000 7f33ecf42640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f33e809bd50 0x7f33e809c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:50:05.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.826+0000 7f33e7fff640 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f33e809c670 0x7f33e80990f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:56856/0 (socket says 172.21.15.129:56856) 2024-09-18T01:50:05.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.826+0000 7f33e7fff640 1 -- 172.21.15.129:0/3803022123 learned_addr learned my addr 172.21.15.129:0/3803022123 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-09-18T01:50:05.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.826+0000 7f33ecf42640 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f33e809bd50 0x7f33e809c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:37628/0 (socket says 172.21.15.129:37628) 2024-09-18T01:50:05.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.826+0000 7f33ecf42640 1 -- 172.21.15.129:0/3803022123 >> v1:172.21.15.129:6789/0 conn(0x7f33e809c670 legacy=0x7f33e80990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:50:05.828 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.826+0000 7f33ecf42640 1 -- 172.21.15.129:0/3803022123 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33e80983e0 con 0x7f33e809bd50 2024-09-18T01:50:05.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.827+0000 7f33ecf42640 1 --2- 172.21.15.129:0/3803022123 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f33e809bd50 0x7f33e809c130 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f33e0009720 tx=0x7f33e002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41182525abfe36b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:50:05.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.827+0000 7f33e77fe640 1 -- 172.21.15.129:0/3803022123 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33e0037070 con 0x7f33e809bd50 2024-09-18T01:50:05.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.827+0000 7f33e77fe640 1 -- 172.21.15.129:0/3803022123 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33e002ad90 con 0x7f33e809bd50 2024-09-18T01:50:05.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.827+0000 7f33e77fe640 1 -- 172.21.15.129:0/3803022123 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33e0032590 con 0x7f33e809bd50 2024-09-18T01:50:05.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.828+0000 7f33ef1a6640 1 -- 172.21.15.129:0/3803022123 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f33e809bd50 msgr2=0x7f33e809c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:50:05.831 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.828+0000 7f33ef1a6640 1 --2- 172.21.15.129:0/3803022123 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f33e809bd50 0x7f33e809c130 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f33e0009720 tx=0x7f33e002a110 comp rx=0 tx=0).stop 2024-09-18T01:50:05.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.828+0000 7f33ef1a6640 1 -- 172.21.15.129:0/3803022123 shutdown_connections 2024-09-18T01:50:05.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.828+0000 7f33ef1a6640 1 --2- 172.21.15.129:0/3803022123 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f33e809bd50 0x7f33e809c130 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:50:05.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.828+0000 7f33ef1a6640 1 -- 172.21.15.129:0/3803022123 >> 172.21.15.129:0/3803022123 conn(0x7f33e806d4a0 msgr2=0x7f33e806d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:50:05.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.828+0000 7f33ef1a6640 1 -- 172.21.15.129:0/3803022123 shutdown_connections 2024-09-18T01:50:05.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.828+0000 7f33ef1a6640 1 -- 172.21.15.129:0/3803022123 wait complete. 2024-09-18T01:50:05.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.829+0000 7f33ef1a6640 1 Processor -- start 2024-09-18T01:50:05.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.829+0000 7f33ef1a6640 1 -- start start 2024-09-18T01:50:05.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.829+0000 7f33ef1a6640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f33e809bd50 0x7f33e81c3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:50:05.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.829+0000 7f33ef1a6640 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 -- 0x7f33e8099b90 con 0x7f33e809bd50 2024-09-18T01:50:05.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.829+0000 7f33ecf42640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f33e809bd50 0x7f33e81c3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:50:05.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.829+0000 7f33ecf42640 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f33e809bd50 0x7f33e81c3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:37630/0 (socket says 172.21.15.129:37630) 2024-09-18T01:50:05.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.829+0000 7f33ecf42640 1 -- 172.21.15.129:0/2689928878 learned_addr learned my addr 172.21.15.129:0/2689928878 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-09-18T01:50:05.832 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.829+0000 7f33ecf42640 1 -- 172.21.15.129:0/2689928878 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33e81b3080 con 0x7f33e809bd50 2024-09-18T01:50:05.833 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.830+0000 7f33ecf42640 1 --2- 172.21.15.129:0/2689928878 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f33e809bd50 0x7f33e81c3900 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f33e0009840 tx=0x7f33e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:50:05.833 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.830+0000 7f33e57fa640 1 -- 172.21.15.129:0/2689928878 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33e0041070 con 0x7f33e809bd50 2024-09-18T01:50:05.833 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.830+0000 7f33e57fa640 1 -- 172.21.15.129:0/2689928878 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33e003c460 con 0x7f33e809bd50 2024-09-18T01:50:05.833 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.830+0000 7f33ef1a6640 1 -- 172.21.15.129:0/2689928878 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33e81b4880 con 0x7f33e809bd50 2024-09-18T01:50:05.833 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.830+0000 7f33e57fa640 1 -- 172.21.15.129:0/2689928878 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33e0037040 con 0x7f33e809bd50 2024-09-18T01:50:05.833 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.830+0000 7f33ef1a6640 1 -- 172.21.15.129:0/2689928878 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33e81b1a80 con 0x7f33e809bd50 2024-09-18T01:50:05.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.831+0000 7f33e57fa640 1 -- 172.21.15.129:0/2689928878 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f33e0044070 con 0x7f33e809bd50 2024-09-18T01:50:05.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.831+0000 7f33ef1a6640 1 -- 172.21.15.129:0/2689928878 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33e809a130 con 0x7f33e809bd50 2024-09-18T01:50:05.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.831+0000 7f33e57fa640 1 --2- 172.21.15.129:0/2689928878 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f33c80382d0 0x7f33c803a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T01:50:05.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.831+0000 7f33e57fa640 1 -- 172.21.15.129:0/2689928878 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6284+0+0 (secure 0 0 0) 0x7f33e006c590 con 0x7f33e809bd50 2024-09-18T01:50:05.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.831+0000 7f33e7fff640 1 --2- 172.21.15.129:0/2689928878 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f33c80382d0 0x7f33c803a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T01:50:05.834 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.832+0000 7f33e7fff640 1 --2- 172.21.15.129:0/2689928878 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f33c80382d0 0x7f33c803a790 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f33e809cac0 tx=0x7f33d8001670 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T01:50:05.836 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:05.836+0000 7f33e57fa640 1 -- 172.21.15.129:0/2689928878 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f33e81b3080 con 0x7f33e809bd50 2024-09-18T01:50:06.002 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:06.001+0000 7f33ef1a6640 1 -- 172.21.15.129:0/2689928878 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f33e809d020 con 0x7f33e809bd50 2024-09-18T01:50:06.005 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:06.004+0000 7f33e57fa640 1 -- 172.21.15.129:0/2689928878 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7f33e0044360 con 0x7f33e809bd50 2024-09-18T01:50:06.005 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:06.004+0000 7f33e57fa640 1 -- 172.21.15.129:0/2689928878 <== mon.0 v2:172.21.15.129:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f33e003cca0 con 0x7f33e809bd50 2024-09-18T01:50:06.007 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:06.006+0000 7f33ef1a6640 1 -- 172.21.15.129:0/2689928878 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f33c80382d0 msgr2=0x7f33c803a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:50:06.008 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:06.006+0000 7f33ef1a6640 1 --2- 172.21.15.129:0/2689928878 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f33c80382d0 0x7f33c803a790 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f33e809cac0 tx=0x7f33d8001670 comp rx=0 tx=0).stop 2024-09-18T01:50:06.008 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:06.006+0000 7f33ef1a6640 1 -- 172.21.15.129:0/2689928878 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f33e809bd50 msgr2=0x7f33e81c3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T01:50:06.008 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:06.006+0000 7f33ef1a6640 1 --2- 172.21.15.129:0/2689928878 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f33e809bd50 0x7f33e81c3900 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f33e0009840 tx=0x7f33e00046c0 comp rx=0 tx=0).stop 2024-09-18T01:50:06.008 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:06.006+0000 7f33ef1a6640 1 -- 172.21.15.129:0/2689928878 shutdown_connections 2024-09-18T01:50:06.008 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:06.006+0000 7f33ef1a6640 1 --2- 172.21.15.129:0/2689928878 >> [v2:172.21.15.146:6824/168968651,v1:172.21.15.146:6825/168968651] conn(0x7f33c80382d0 0x7f33c803a790 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:50:06.008 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:06.006+0000 7f33ef1a6640 1 --2- 172.21.15.129:0/2689928878 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f33e809bd50 0x7f33e81c3900 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T01:50:06.008 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:06.006+0000 7f33ef1a6640 1 -- 172.21.15.129:0/2689928878 >> 172.21.15.129:0/2689928878 conn(0x7f33e806d4a0 msgr2=0x7f33e809eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T01:50:06.008 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:06.006+0000 7f33ef1a6640 1 -- 172.21.15.129:0/2689928878 shutdown_connections 2024-09-18T01:50:06.008 INFO:teuthology.orchestra.run.smithi129.stderr:2024-09-18T01:50:06.006+0000 7f33ef1a6640 1 -- 172.21.15.129:0/2689928878 wait complete. 2024-09-18T01:50:06.018 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-18T01:50:06.018 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-18T01:50:06.018 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-18T01:50:06.018 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T01:50:06.054 INFO:tasks.ceph.osd.0:Stopped 2024-09-18T01:50:06.055 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-18T01:50:06.055 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T01:50:06.087 INFO:tasks.ceph.osd.1:Stopped 2024-09-18T01:50:06.087 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-18T01:50:06.088 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T01:50:06.158 INFO:tasks.ceph.osd.2:Stopped 2024-09-18T01:50:06.158 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-18T01:50:06.158 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T01:50:06.228 INFO:tasks.ceph.osd.3:Stopped 2024-09-18T01:50:06.228 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-18T01:50:06.229 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-18T01:50:06.229 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T01:50:06.299 INFO:tasks.ceph.mgr.x:Stopped 2024-09-18T01:50:06.299 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-18T01:50:06.299 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-18T01:50:06.299 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T01:50:06.310 INFO:tasks.ceph.mon.a:Stopped 2024-09-18T01:50:06.310 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-18T01:50:06.311 DEBUG:teuthology.orchestra.run.smithi129:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-09-18T01:50:06.424 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi129.front.sepia.ceph.com 2024-09-18T01:50:06.424 DEBUG:teuthology.orchestra.run.smithi129:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-18T01:50:06.575 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi146.front.sepia.ceph.com 2024-09-18T01:50:06.575 DEBUG:teuthology.orchestra.run.smithi146:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-18T01:50:06.692 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi146.front.sepia.ceph.com 2024-09-18T01:50:06.692 DEBUG:teuthology.orchestra.run.smithi146:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-18T01:50:06.796 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi146.front.sepia.ceph.com 2024-09-18T01:50:06.796 DEBUG:teuthology.orchestra.run.smithi146:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-18T01:50:06.854 INFO:tasks.ceph:Archiving mon data... 2024-09-18T01:50:06.856 DEBUG:teuthology.misc:Transferring archived files from smithi129:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-17_21:40:02-rgw-squid-distro-default-smithi/7909748/data/mon.a.tgz 2024-09-18T01:50:06.856 DEBUG:teuthology.orchestra.run.smithi129:> mktemp 2024-09-18T01:50:06.872 INFO:teuthology.orchestra.run.smithi129.stdout:/tmp/tmp.GQJ13wouBB 2024-09-18T01:50:06.872 DEBUG:teuthology.orchestra.run.smithi129:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.GQJ13wouBB 2024-09-18T01:50:07.006 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod 0666 /tmp/tmp.GQJ13wouBB 2024-09-18T01:50:07.089 DEBUG:teuthology.orchestra.remote:smithi129:/tmp/tmp.GQJ13wouBB is 266KB 2024-09-18T01:50:07.186 DEBUG:teuthology.orchestra.run.smithi129:> rm -fr /tmp/tmp.GQJ13wouBB 2024-09-18T01:50:07.201 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-18T01:50:07.202 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-18T01:50:07.243 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-18T01:50:07.321 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-18T01:50:07.340 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-18T01:50:07.341 INFO:tasks.ceph:Archiving crash dumps... 2024-09-18T01:50:07.342 DEBUG:teuthology.misc:Transferring archived files from smithi129:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-17_21:40:02-rgw-squid-distro-default-smithi/7909748/remote/smithi129/crash 2024-09-18T01:50:07.343 DEBUG:teuthology.orchestra.run.smithi129:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-18T01:50:07.385 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-17_21:40:02-rgw-squid-distro-default-smithi/7909748/remote/smithi146/crash 2024-09-18T01:50:07.386 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-18T01:50:07.437 INFO:tasks.ceph:Compressing logs... 2024-09-18T01:50:07.437 DEBUG:teuthology.orchestra.run.smithi129:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-18T01:50:07.440 DEBUG:teuthology.orchestra.run.smithi146:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-18T01:50:07.485 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-18T01:50:07.485 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31069.log 2024-09-18T01:50:07.485 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31831.log 2024-09-18T01:50:07.485 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.admin.31069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31243.log 2024-09-18T01:50:07.485 INFO:teuthology.orchestra.run.smithi129.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.31069.log.gz 2024-09-18T01:50:07.485 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.admin.31831.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27382.log 2024-09-18T01:50:07.485 INFO:teuthology.orchestra.run.smithi129.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.31831.log.gz 2024-09-18T01:50:07.485 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.admin.31243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31125.log 2024-09-18T01:50:07.485 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph.tmp-client.admin.27382.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.31243.log.gz 2024-09-18T01:50:07.485 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32221.log 2024-09-18T01:50:07.485 INFO:teuthology.orchestra.run.smithi129.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27382.log.gz 2024-09-18T01:50:07.486 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.admin.31125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32431.log 2024-09-18T01:50:07.486 INFO:teuthology.orchestra.run.smithi129.stderr: 86.4%/var/log/ceph/ceph-client.admin.32221.log: -- replaced with /var/log/ceph/ceph-client.admin.31125.log.gz 2024-09-18T01:50:07.486 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31384.log 2024-09-18T01:50:07.486 INFO:teuthology.orchestra.run.smithi129.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.32221.log.gz 2024-09-18T01:50:07.486 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.admin.32431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31722.log 2024-09-18T01:50:07.486 INFO:teuthology.orchestra.run.smithi129.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.32431.log.gz 2024-09-18T01:50:07.486 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.admin.31384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32083.log 2024-09-18T01:50:07.486 INFO:teuthology.orchestra.run.smithi129.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.31384.log.gz 2024-09-18T01:50:07.486 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.admin.31722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29214.log 2024-09-18T01:50:07.486 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.admin.32083.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.31722.log.gz 2024-09-18T01:50:07.486 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32305.log 2024-09-18T01:50:07.486 INFO:teuthology.orchestra.run.smithi129.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.32083.log.gz 2024-09-18T01:50:07.486 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.29214.log: /var/log/ceph/ceph-client.admin.32809.log 2024-09-18T01:50:07.487 INFO:teuthology.orchestra.run.smithi129.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.29214.log.gz 2024-09-18T01:50:07.487 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.admin.32305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29096.log 2024-09-18T01:50:07.487 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.admin.32809.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.32305.log.gz 2024-09-18T01:50:07.487 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32041.log 2024-09-18T01:50:07.487 INFO:teuthology.orchestra.run.smithi129.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.32809.log.gz 2024-09-18T01:50:07.487 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.admin.29096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32515.log 2024-09-18T01:50:07.487 INFO:teuthology.orchestra.run.smithi129.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.29096.log.gz 2024-09-18T01:50:07.487 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.admin.32041.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-18T01:50:07.487 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.admin.32515.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.32041.log.gz 2024-09-18T01:50:07.487 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31999.log 2024-09-18T01:50:07.487 INFO:teuthology.orchestra.run.smithi129.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.32515.log.gz 2024-09-18T01:50:07.487 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32347.log 2024-09-18T01:50:07.487 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.admin.31999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32852.log 2024-09-18T01:50:07.487 INFO:teuthology.orchestra.run.smithi129.stderr: 88.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-18T01:50:07.488 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.admin.32347.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.31999.log.gz 2024-09-18T01:50:07.488 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31663.log 2024-09-18T01:50:07.488 INFO:teuthology.orchestra.run.smithi129.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.32347.log.gz 2024-09-18T01:50:07.488 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.admin.32852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30127.log 2024-09-18T01:50:07.488 INFO:teuthology.orchestra.run.smithi129.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.32852.log.gz 2024-09-18T01:50:07.488 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.admin.31663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31554.log 2024-09-18T01:50:07.488 INFO:teuthology.orchestra.run.smithi129.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.31663.log.gz 2024-09-18T01:50:07.488 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.admin.30127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31723.log 2024-09-18T01:50:07.488 INFO:teuthology.orchestra.run.smithi129.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.30127.log.gz 2024-09-18T01:50:07.488 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.admin.31554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31893.log 2024-09-18T01:50:07.488 INFO:teuthology.orchestra.run.smithi129.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.31554.log.gz 2024-09-18T01:50:07.488 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.admin.31723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32263.log 2024-09-18T01:50:07.488 INFO:teuthology.orchestra.run.smithi129.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.31723.log.gz 2024-09-18T01:50:07.488 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.admin.31893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31553.log 2024-09-18T01:50:07.489 INFO:teuthology.orchestra.run.smithi129.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.31893.log.gz 2024-09-18T01:50:07.489 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.32263.log: /var/log/ceph/ceph-client.admin.32725.log 2024-09-18T01:50:07.489 INFO:teuthology.orchestra.run.smithi129.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.32263.log.gz 2024-09-18T01:50:07.489 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.admin.31553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31721.log 2024-09-18T01:50:07.489 INFO:teuthology.orchestra.run.smithi129.stderr: 86.4%/var/log/ceph/ceph-client.admin.32725.log: -- replaced with /var/log/ceph/ceph-client.admin.31553.log.gz 2024-09-18T01:50:07.489 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31385.log 2024-09-18T01:50:07.489 INFO:teuthology.orchestra.run.smithi129.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.32725.log.gz 2024-09-18T01:50:07.489 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.admin.31721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31931.log 2024-09-18T01:50:07.489 INFO:teuthology.orchestra.run.smithi129.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.31721.log.gz 2024-09-18T01:50:07.489 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.admin.31385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32389.log 2024-09-18T01:50:07.489 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.admin.31931.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.31385.log.gz 2024-09-18T01:50:07.489 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32137.log 2024-09-18T01:50:07.489 INFO:teuthology.orchestra.run.smithi129.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.31931.log.gz 2024-09-18T01:50:07.490 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.admin.32389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32893.log 2024-09-18T01:50:07.490 INFO:teuthology.orchestra.run.smithi129.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.32389.log.gz 2024-09-18T01:50:07.490 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.admin.32137.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-18T01:50:07.490 INFO:teuthology.orchestra.run.smithi129.stderr: 85.8%/var/log/ceph/ceph-client.admin.32893.log: -- replaced with /var/log/ceph/ceph-client.admin.32137.log.gz 2024-09-18T01:50:07.490 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31150.log 2024-09-18T01:50:07.490 INFO:teuthology.orchestra.run.smithi129.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.32893.log.gz 2024-09-18T01:50:07.490 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32179.log 2024-09-18T01:50:07.490 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.admin.31150.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-18T01:50:07.490 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.admin.32179.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.31150.log.gz 2024-09-18T01:50:07.490 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32641.log 2024-09-18T01:50:07.490 INFO:teuthology.orchestra.run.smithi129.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.32179.log.gz 2024-09-18T01:50:07.490 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31387.log 2024-09-18T01:50:07.490 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.32641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31555.log 2024-09-18T01:50:07.490 INFO:teuthology.orchestra.run.smithi129.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.32641.log.gz 2024-09-18T01:50:07.490 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.admin.31387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32683.log 2024-09-18T01:50:07.491 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31386.log 2024-09-18T01:50:07.491 INFO:teuthology.orchestra.run.smithi129.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.31387.log.gz 2024-09-18T01:50:07.491 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.admin.31555.log: /var/log/ceph/ceph-client.admin.32683.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.31555.log.gz 2024-09-18T01:50:07.491 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32767.log 2024-09-18T01:50:07.491 INFO:teuthology.orchestra.run.smithi129.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.32683.log.gz 2024-09-18T01:50:07.491 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32473.log 2024-09-18T01:50:07.491 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.admin.31386.log: 86.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-18T01:50:07.491 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.admin.32767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32557.log 2024-09-18T01:50:07.491 INFO:teuthology.orchestra.run.smithi129.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.31386.log.gz 2024-09-18T01:50:07.491 INFO:teuthology.orchestra.run.smithi129.stderr: 85.8%/var/log/ceph/ceph-client.admin.32473.log: -- replaced with /var/log/ceph/ceph-client.admin.32767.log.gz 2024-09-18T01:50:07.491 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31201.log 2024-09-18T01:50:07.491 INFO:teuthology.orchestra.run.smithi129.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.32473.log.gz 2024-09-18T01:50:07.491 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.admin.32557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31285.log 2024-09-18T01:50:07.491 INFO:teuthology.orchestra.run.smithi129.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.32557.log.gz 2024-09-18T01:50:07.492 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31851.log 2024-09-18T01:50:07.492 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.admin.31201.log: /var/log/ceph/ceph-client.admin.31285.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.31201.log.gz 2024-09-18T01:50:07.492 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31552.log 2024-09-18T01:50:07.492 INFO:teuthology.orchestra.run.smithi129.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.31285.log.gz 2024-09-18T01:50:07.492 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29252.log 2024-09-18T01:50:07.492 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.admin.31851.log: /var/log/ceph/ceph-client.admin.31552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32599.log 2024-09-18T01:50:07.492 INFO:teuthology.orchestra.run.smithi129.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.31851.log.gz 2024-09-18T01:50:07.492 INFO:teuthology.orchestra.run.smithi129.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.31552.log.gz 2024-09-18T01:50:07.492 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.admin.29252.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.29252.log.gz 2024-09-18T01:50:07.492 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.admin.32599.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.32599.log.gz 2024-09-18T01:50:07.534 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87026.log 2024-09-18T01:50:07.534 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50744.log 2024-09-18T01:50:07.534 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.87026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71314.log 2024-09-18T01:50:07.534 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.50744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90644.log 2024-09-18T01:50:07.534 INFO:teuthology.orchestra.run.smithi146.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.0.87026.log.gz 2024-09-18T01:50:07.534 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.71314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68289.log 2024-09-18T01:50:07.534 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.90644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94879.log 2024-09-18T01:50:07.534 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.68289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82204.log 2024-09-18T01:50:07.535 INFO:teuthology.orchestra.run.smithi146.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.50744.log.gz 2024-09-18T01:50:07.535 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.94879.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.71314.log.gz 2024-09-18T01:50:07.535 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91854.log 2024-09-18T01:50:07.535 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.82204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40459.log 2024-09-18T01:50:07.535 INFO:teuthology.orchestra.run.smithi146.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.90644.log.gz 2024-09-18T01:50:07.535 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79784.log 2024-09-18T01:50:07.535 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.91854.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.68289.log.gz 2024-09-18T01:50:07.535 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.40459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79179.log 2024-09-18T01:50:07.535 INFO:teuthology.orchestra.run.smithi146.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.94879.log.gz 2024-09-18T01:50:07.535 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.79784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72524.log 2024-09-18T01:50:07.535 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.79179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64054.log 2024-09-18T01:50:07.535 INFO:teuthology.orchestra.run.smithi146.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.91854.log.gz 2024-09-18T01:50:07.536 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.72524.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-18T01:50:07.536 INFO:teuthology.orchestra.run.smithi146.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.0.40459.log.gz 2024-09-18T01:50:07.536 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.64054.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.82204.log.gz 2024-09-18T01:50:07.536 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-18T01:50:07.536 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.88224.log 2024-09-18T01:50:07.536 INFO:teuthology.orchestra.run.smithi146.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.79784.log.gz 2024-09-18T01:50:07.536 INFO:teuthology.orchestra.run.smithi146.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.79179.log.gz 2024-09-18T01:50:07.536 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35910.log 2024-09-18T01:50:07.536 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.88224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86427.log 2024-09-18T01:50:07.536 INFO:teuthology.orchestra.run.smithi146.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.64054.log.gz 2024-09-18T01:50:07.536 INFO:teuthology.orchestra.run.smithi146.stderr: 91.9% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-18T01:50:07.536 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.35910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84019.log 2024-09-18T01:50:07.536 INFO:teuthology.orchestra.run.smithi146.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.72524.log.gz 2024-09-18T01:50:07.537 INFO:teuthology.orchestra.run.smithi146.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.35910.log.gz 2024-09-18T01:50:07.537 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55584.log 2024-09-18T01:50:07.537 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.86427.log: /var/log/ceph/ceph-client.0.84019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47114.log 2024-09-18T01:50:07.537 INFO:teuthology.orchestra.run.smithi146.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.88224.log.gz 2024-09-18T01:50:07.537 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.55584.log: 90.3% -- replaced with /var/log/ceph/ceph-client.0.86427.log.gz 2024-09-18T01:50:07.537 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.96746.log 2024-09-18T01:50:07.537 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82809.log 2024-09-18T01:50:07.537 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.47114.log: /var/log/ceph/ceph-client.0.96746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.96089.log 2024-09-18T01:50:07.537 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.82809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44089.log 2024-09-18T01:50:07.537 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.96089.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.55584.log.gz 2024-09-18T01:50:07.537 INFO:teuthology.orchestra.run.smithi146.stderr:gzip 91.6% -5 --verbose -- /var/log/ceph/ceph-client.0.83414.log 2024-09-18T01:50:07.537 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.0.84019.log.gz 2024-09-18T01:50:07.537 INFO:teuthology.orchestra.run.smithi146.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.47114.log.gz 2024-09-18T01:50:07.538 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5/var/log/ceph/ceph-client.0.44089.log: --verbose -- /var/log/ceph/ceph-client.0.62239.log 2024-09-18T01:50:07.538 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.83414.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.82809.log.gz 2024-09-18T01:50:07.538 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48929.log 2024-09-18T01:50:07.538 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.62239.log: gzip 91.1% -- replaced with /var/log/ceph/ceph-client.0.96089.log.gz 2024-09-18T01:50:07.538 INFO:teuthology.orchestra.run.smithi146.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.36041.log 2024-09-18T01:50:07.538 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.48929.log: gzip -5 --verbose 91.4% -- replaced with /var/log/ceph/ceph-client.0.44089.log.gz 2024-09-18T01:50:07.538 INFO:teuthology.orchestra.run.smithi146.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.83414.log.gz 2024-09-18T01:50:07.538 INFO:teuthology.orchestra.run.smithi146.stderr: -- /var/log/ceph/ceph-client.0.81599.log 2024-09-18T01:50:07.538 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.36041.log: gzip -5 --verbose -- 93.3% -- replaced with /var/log/ceph/ceph-client.0.96746.log.gz 2024-09-18T01:50:07.538 INFO:teuthology.orchestra.run.smithi146.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.36041.log.gz 2024-09-18T01:50:07.538 INFO:teuthology.orchestra.run.smithi146.stderr: /var/log/ceph/ceph-client.0.47719.log 2024-09-18T01:50:07.538 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.81599.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.62239.log.gz 2024-09-18T01:50:07.538 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94274.log 2024-09-18T01:50:07.538 INFO:teuthology.orchestra.run.smithi146.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.48929.log.gz 2024-09-18T01:50:07.539 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.47719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80389.log 2024-09-18T01:50:07.539 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.94274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61029.log 2024-09-18T01:50:07.539 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.80389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53769.log 2024-09-18T01:50:07.539 INFO:teuthology.orchestra.run.smithi146.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.47719.log.gz 2024-09-18T01:50:07.539 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.61029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76154.log 2024-09-18T01:50:07.539 INFO:teuthology.orchestra.run.smithi146.stderr: 91.6%/var/log/ceph/ceph-client.0.53769.log: -- replaced with /var/log/ceph/ceph-client.0.81599.log.gz 2024-09-18T01:50:07.539 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53164.log 2024-09-18T01:50:07.539 INFO:teuthology.orchestra.run.smithi146.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.94274.log.gz 2024-09-18T01:50:07.539 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.76154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35961.log 2024-09-18T01:50:07.540 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.53164.log: gzip -5 --verbose 91.2% -- replaced with /var/log/ceph/ceph-client.0.80389.log.gz 2024-09-18T01:50:07.540 INFO:teuthology.orchestra.run.smithi146.stderr: -- /var/log/ceph/ceph-client.0.58609.log 2024-09-18T01:50:07.540 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.35961.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.61029.log.gz 2024-09-18T01:50:07.540 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71919.log 2024-09-18T01:50:07.540 INFO:teuthology.orchestra.run.smithi146.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.53769.log.gz 2024-09-18T01:50:07.540 INFO:teuthology.orchestra.run.smithi146.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.35961.log.gz 2024-09-18T01:50:07.540 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.58609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42274.log 2024-09-18T01:50:07.540 INFO:teuthology.orchestra.run.smithi146.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.76154.log.gz 2024-09-18T01:50:07.540 INFO:teuthology.orchestra.run.smithi146.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.53164.log.gz 2024-09-18T01:50:07.540 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.71919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77364.log 2024-09-18T01:50:07.540 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.42274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42879.log 2024-09-18T01:50:07.540 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.77364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70709.log 2024-09-18T01:50:07.540 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.42879.log: gzip -5 --verbose -- 91.2% -- replaced with /var/log/ceph/ceph-client.0.58609.log.gz 2024-09-18T01:50:07.541 INFO:teuthology.orchestra.run.smithi146.stderr: /var/log/ceph/ceph-client.0.59214.log 2024-09-18T01:50:07.541 INFO:teuthology.orchestra.run.smithi146.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.71919.log.gz 2024-09-18T01:50:07.541 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.70709.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.42274.log.gz 2024-09-18T01:50:07.541 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67079.log 2024-09-18T01:50:07.541 INFO:teuthology.orchestra.run.smithi146.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.77364.log.gz 2024-09-18T01:50:07.541 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.59214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58004.log 2024-09-18T01:50:07.541 INFO:teuthology.orchestra.run.smithi146.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.42879.log.gz 2024-09-18T01:50:07.541 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.67079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74339.log 2024-09-18T01:50:07.541 INFO:teuthology.orchestra.run.smithi146.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.70709.log.gz 2024-09-18T01:50:07.541 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45904.log 2024-09-18T01:50:07.541 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.58004.log: /var/log/ceph/ceph-client.0.74339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63449.log 2024-09-18T01:50:07.541 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.45904.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.59214.log.gz 2024-09-18T01:50:07.541 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85229.log 2024-09-18T01:50:07.542 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.63449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76759.log 91.8% -- replaced with /var/log/ceph/ceph-client.0.67079.log.gz 2024-09-18T01:50:07.542 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-09-18T01:50:07.542 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.85229.log: 90.9% -- replaced with /var/log/ceph/ceph-client.0.58004.log.gz 2024-09-18T01:50:07.542 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41064.log 2024-09-18T01:50:07.542 INFO:teuthology.orchestra.run.smithi146.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.45904.log.gz 2024-09-18T01:50:07.542 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.76759.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.74339.log.gz 2024-09-18T01:50:07.542 INFO:teuthology.orchestra.run.smithi146.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.0.85229.log.gz 2024-09-18T01:50:07.542 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75549.log 2024-09-18T01:50:07.542 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.41064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54374.log 2024-09-18T01:50:07.542 INFO:teuthology.orchestra.run.smithi146.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.63449.log.gz 2024-09-18T01:50:07.542 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66474.log 2024-09-18T01:50:07.542 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.75549.log: /var/log/ceph/ceph-client.0.54374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36835.log 2024-09-18T01:50:07.543 INFO:teuthology.orchestra.run.smithi146.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.76759.log.gz 2024-09-18T01:50:07.543 INFO:teuthology.orchestra.run.smithi146.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.41064.log.gz 2024-09-18T01:50:07.543 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.66474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93064.log 2024-09-18T01:50:07.543 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67684.log 2024-09-18T01:50:07.543 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.36835.log: /var/log/ceph/ceph-client.0.93064.log: gzip -5 --verbose -- 91.7% -- replaced with /var/log/ceph/ceph-client.0.75549.log.gz 2024-09-18T01:50:07.543 INFO:teuthology.orchestra.run.smithi146.stderr: /var/log/ceph/ceph-client.0.69499.log 2024-09-18T01:50:07.543 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.67684.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.54374.log.gz 2024-09-18T01:50:07.543 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49534.log 2024-09-18T01:50:07.543 INFO:teuthology.orchestra.run.smithi146.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.66474.log.gz 2024-09-18T01:50:07.543 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.69499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77969.log 2024-09-18T01:50:07.543 INFO:teuthology.orchestra.run.smithi146.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.93064.log.gz 2024-09-18T01:50:07.543 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.49534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54979.log 2024-09-18T01:50:07.543 INFO:teuthology.orchestra.run.smithi146.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.0.36835.log.gz 2024-09-18T01:50:07.543 INFO:teuthology.orchestra.run.smithi146.stderr:gzip/var/log/ceph/ceph-client.0.77969.log: -5 --verbose -- /var/log/ceph/ceph-client.0.84624.log 2024-09-18T01:50:07.544 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.54979.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.67684.log.gz 2024-09-18T01:50:07.544 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46509.log 2024-09-18T01:50:07.544 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.84624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39255.log 2024-09-18T01:50:07.544 INFO:teuthology.orchestra.run.smithi146.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.49534.log.gz 2024-09-18T01:50:07.544 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.46509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73129.log 2024-09-18T01:50:07.544 INFO:teuthology.orchestra.run.smithi146.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.77969.log.gz 2024-09-18T01:50:07.544 INFO:teuthology.orchestra.run.smithi146.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.0.54979.log.gz 2024-09-18T01:50:07.544 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.39255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44694.log 2024-09-18T01:50:07.544 INFO:teuthology.orchestra.run.smithi146.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.84624.log.gz 2024-09-18T01:50:07.544 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.73129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56189.log 2024-09-18T01:50:07.544 INFO:teuthology.orchestra.run.smithi146.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.0.69499.log.gz 2024-09-18T01:50:07.544 INFO:teuthology.orchestra.run.smithi146.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.46509.log.gz 2024-09-18T01:50:07.544 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.44694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41669.log 2024-09-18T01:50:07.545 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.56189.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.39255.log.gz 2024-09-18T01:50:07.545 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-18T01:50:07.545 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.89434.log 2024-09-18T01:50:07.545 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.41669.log: /var/log/ceph/ceph-osd.2.log: 91.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65869.log 2024-09-18T01:50:07.545 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.0.73129.log.gz 2024-09-18T01:50:07.545 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.89434.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.44694.log.gz 2024-09-18T01:50:07.545 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61634.log 2024-09-18T01:50:07.545 INFO:teuthology.orchestra.run.smithi146.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.56189.log.gz 2024-09-18T01:50:07.545 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.88829.log 2024-09-18T01:50:07.545 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.65869.log: /var/log/ceph/ceph-client.0.61634.log: gzip 91.4% -- replaced with /var/log/ceph/ceph-client.0.41669.log.gz 2024-09-18T01:50:07.545 INFO:teuthology.orchestra.run.smithi146.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.31630.log 2024-09-18T01:50:07.545 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.88829.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.89434.log.gz 2024-09-18T01:50:07.545 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74944.log 2024-09-18T01:50:07.546 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.31630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56794.log 2024-09-18T01:50:07.546 INFO:teuthology.orchestra.run.smithi146.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.31630.log.gz 91.0% -- replaced with /var/log/ceph/ceph-client.0.61634.log.gz 2024-09-18T01:50:07.546 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-09-18T01:50:07.546 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.74944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31590.log 2024-09-18T01:50:07.546 INFO:teuthology.orchestra.run.smithi146.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.65869.log.gz 2024-09-18T01:50:07.546 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.56794.log: gzip 91.1% -5 -- replaced with /var/log/ceph/ceph-client.0.88829.log.gz --verbose 2024-09-18T01:50:07.546 INFO:teuthology.orchestra.run.smithi146.stderr: -- /var/log/ceph/ceph-client.admin.35869.log 2024-09-18T01:50:07.546 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.31590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64659.log 2024-09-18T01:50:07.547 INFO:teuthology.orchestra.run.smithi146.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.31590.log.gz 2024-09-18T01:50:07.547 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.35869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70104.log 2024-09-18T01:50:07.547 INFO:teuthology.orchestra.run.smithi146.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.74944.log.gz 2024-09-18T01:50:07.547 INFO:teuthology.orchestra.run.smithi146.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.35869.log.gz 2024-09-18T01:50:07.547 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.64659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92459.log 2024-09-18T01:50:07.547 INFO:teuthology.orchestra.run.smithi146.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.56794.log.gz 2024-09-18T01:50:07.547 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43484.log 2024-09-18T01:50:07.547 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.70104.log: /var/log/ceph/ceph-client.0.92459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78574.log 2024-09-18T01:50:07.547 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.43484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65264.log 2024-09-18T01:50:07.547 INFO:teuthology.orchestra.run.smithi146.stderr: 91.2%/var/log/ceph/ceph-client.0.78574.log: -- replaced with /var/log/ceph/ceph-client.0.64659.log.gz 2024-09-18T01:50:07.547 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52559.log 2024-09-18T01:50:07.547 INFO:teuthology.orchestra.run.smithi146.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.92459.log.gz 2024-09-18T01:50:07.547 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39860.log 2024-09-18T01:50:07.548 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.65264.log: /var/log/ceph/ceph-client.0.52559.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-18T01:50:07.548 INFO:teuthology.orchestra.run.smithi146.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.43484.log.gz 2024-09-18T01:50:07.548 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.39860.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.78574.log.gz 2024-09-18T01:50:07.548 INFO:teuthology.orchestra.run.smithi146.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.0.70104.log.gz 2024-09-18T01:50:07.548 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31710.log 2024-09-18T01:50:07.548 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-mgr.x.log: 90.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45299.log 2024-09-18T01:50:07.548 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.0.39860.log.gz 2024-09-18T01:50:07.548 INFO:teuthology.orchestra.run.smithi146.stderr:gzip/var/log/ceph/ceph-client.admin.31710.log: -5 --verbose 91.1% -- replaced with /var/log/ceph/ceph-client.0.52559.log.gz 2024-09-18T01:50:07.548 INFO:teuthology.orchestra.run.smithi146.stderr: -- /var/log/ceph/ceph-client.0.85828.log 2024-09-18T01:50:07.548 INFO:teuthology.orchestra.run.smithi146.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.31710.log.gz 2024-09-18T01:50:07.548 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.45299.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.65264.log.gz 2024-09-18T01:50:07.548 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68894.log 2024-09-18T01:50:07.548 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91249.log 2024-09-18T01:50:07.549 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.85828.log: /var/log/ceph/ceph-client.0.68894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36001.log 2024-09-18T01:50:07.549 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.91249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37440.log 2024-09-18T01:50:07.549 INFO:teuthology.orchestra.run.smithi146.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.45299.log.gz 2024-09-18T01:50:07.549 INFO:teuthology.orchestra.run.smithi146.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.85828.log.gz 2024-09-18T01:50:07.549 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.36001.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.36001.log.gz 2024-09-18T01:50:07.549 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51954.log 2024-09-18T01:50:07.549 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.37440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48324.log 92.7% -- replaced with /var/log/ceph/ceph-client.0.68894.log.gz 2024-09-18T01:50:07.549 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-09-18T01:50:07.549 INFO:teuthology.orchestra.run.smithi146.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.91249.log.gz 2024-09-18T01:50:07.549 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.51954.log: gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-18T01:50:07.549 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.48324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60424.log 2024-09-18T01:50:07.549 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51349.log 2024-09-18T01:50:07.549 INFO:teuthology.orchestra.run.smithi146.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.37440.log.gz 2024-09-18T01:50:07.550 INFO:teuthology.orchestra.run.smithi146.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.51954.log.gz 2024-09-18T01:50:07.550 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.60424.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.48324.log.gz 2024-09-18T01:50:07.550 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50139.log 2024-09-18T01:50:07.550 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.51349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38650.log 2024-09-18T01:50:07.550 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.50139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93669.log 2024-09-18T01:50:07.550 INFO:teuthology.orchestra.run.smithi146.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.60424.log.gz 2024-09-18T01:50:07.550 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.38650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57399.log 2024-09-18T01:50:07.550 INFO:teuthology.orchestra.run.smithi146.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.51349.log.gz 2024-09-18T01:50:07.550 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.93669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80994.log 2024-09-18T01:50:07.550 INFO:teuthology.orchestra.run.smithi146.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.50139.log.gz 2024-09-18T01:50:07.550 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.57399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59819.log 2024-09-18T01:50:07.550 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.80994.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.93669.log.gz 2024-09-18T01:50:07.550 INFO:teuthology.orchestra.run.smithi146.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.38650.log.gz 2024-09-18T01:50:07.550 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87625.log 2024-09-18T01:50:07.551 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.59819.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.57399.log.gz 2024-09-18T01:50:07.551 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73734.log 2024-09-18T01:50:07.551 INFO:teuthology.orchestra.run.smithi146.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.80994.log.gz 2024-09-18T01:50:07.551 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.87625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.95484.log 2024-09-18T01:50:07.551 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-18T01:50:07.551 INFO:teuthology.orchestra.run.smithi146.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.0.87625.log.gz 2024-09-18T01:50:07.551 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.73734.log: gzip/var/log/ceph/ceph-client.0.95484.log: -5 91.0% -- replaced with /var/log/ceph/ceph-client.0.59819.log.gz 2024-09-18T01:50:07.551 INFO:teuthology.orchestra.run.smithi146.stderr: --verbose -- /var/log/ceph/ceph-client.0.38045.log 2024-09-18T01:50:07.551 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62844.log 2024-09-18T01:50:07.551 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.38045.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.95484.log.gz 2024-09-18T01:50:07.551 INFO:teuthology.orchestra.run.smithi146.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.73734.log.gz 2024-09-18T01:50:07.551 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31670.log 2024-09-18T01:50:07.551 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.62844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90039.log 2024-09-18T01:50:07.551 INFO:teuthology.orchestra.run.smithi146.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.38045.log.gz 2024-09-18T01:50:07.552 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.31670.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.31670.log.gz/var/log/ceph/ceph-client.0.90039.log: 2024-09-18T01:50:07.552 INFO:teuthology.orchestra.run.smithi146.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.62844.log.gz 2024-09-18T01:50:07.552 INFO:teuthology.orchestra.run.smithi146.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.90039.log.gz 2024-09-18T01:50:07.556 INFO:teuthology.orchestra.run.smithi146.stderr: 92.2% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-18T01:50:07.563 INFO:teuthology.orchestra.run.smithi146.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-18T01:50:07.650 INFO:teuthology.orchestra.run.smithi129.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-18T01:50:08.383 INFO:teuthology.orchestra.run.smithi146.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-18T01:50:08.393 INFO:teuthology.orchestra.run.smithi129.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-18T01:50:08.395 INFO:teuthology.orchestra.run.smithi129.stderr: 2024-09-18T01:50:08.395 INFO:teuthology.orchestra.run.smithi129.stderr:real 0m0.942s 2024-09-18T01:50:08.395 INFO:teuthology.orchestra.run.smithi129.stderr:user 0m1.097s 2024-09-18T01:50:08.395 INFO:teuthology.orchestra.run.smithi129.stderr:sys 0m0.076s 2024-09-18T01:50:08.501 INFO:teuthology.orchestra.run.smithi146.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-18T01:50:08.537 INFO:teuthology.orchestra.run.smithi146.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-18T01:50:08.539 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-09-18T01:50:08.539 INFO:teuthology.orchestra.run.smithi146.stderr:real 0m1.082s 2024-09-18T01:50:08.539 INFO:teuthology.orchestra.run.smithi146.stderr:user 0m3.078s 2024-09-18T01:50:08.539 INFO:teuthology.orchestra.run.smithi146.stderr:sys 0m0.224s 2024-09-18T01:50:08.539 INFO:tasks.ceph:Archiving logs... 2024-09-18T01:50:08.540 DEBUG:teuthology.misc:Transferring archived files from smithi129:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-17_21:40:02-rgw-squid-distro-default-smithi/7909748/remote/smithi129/log 2024-09-18T01:50:08.541 DEBUG:teuthology.orchestra.run.smithi129:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-18T01:50:08.795 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-17_21:40:02-rgw-squid-distro-default-smithi/7909748/remote/smithi146/log 2024-09-18T01:50:08.796 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-18T01:50:09.368 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-18T01:50:09.377 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-18T01:50:09.378 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-18T01:50:09.380 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-18T01:50:09.460 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-18T01:50:09.474 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-18T01:50:09.474 DEBUG:teuthology.orchestra.run.smithi129:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-18T01:50:09.477 DEBUG:teuthology.orchestra.run.smithi146:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-18T01:50:09.490 INFO:teuthology.orchestra.run.smithi129.stderr:bash: line 1: ntpq: command not found 2024-09-18T01:50:09.492 INFO:teuthology.orchestra.run.smithi146.stderr:bash: line 1: ntpq: command not found 2024-09-18T01:50:09.494 INFO:teuthology.orchestra.run.smithi129.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-18T01:50:09.494 INFO:teuthology.orchestra.run.smithi129.stdout:=============================================================================== 2024-09-18T01:50:09.494 INFO:teuthology.orchestra.run.smithi129.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 40 -160us[ -177us] +/- 37ms 2024-09-18T01:50:09.494 INFO:teuthology.orchestra.run.smithi129.stdout:^* hv02.front.sepia.ceph.com 3 6 377 40 -1129us[-1146us] +/- 62ms 2024-09-18T01:50:09.495 INFO:teuthology.orchestra.run.smithi129.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 41 +2171us[+2154us] +/- 93ms 2024-09-18T01:50:09.495 INFO:teuthology.orchestra.run.smithi129.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T01:50:09.496 INFO:teuthology.orchestra.run.smithi146.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-18T01:50:09.496 INFO:teuthology.orchestra.run.smithi146.stdout:=============================================================================== 2024-09-18T01:50:09.496 INFO:teuthology.orchestra.run.smithi146.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 40 -136us[ -136us] +/- 37ms 2024-09-18T01:50:09.496 INFO:teuthology.orchestra.run.smithi146.stdout:^* hv02.front.sepia.ceph.com 3 6 377 41 -1094us[-1134us] +/- 62ms 2024-09-18T01:50:09.496 INFO:teuthology.orchestra.run.smithi146.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 41 +2191us[+2151us] +/- 93ms 2024-09-18T01:50:09.497 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T01:50:09.497 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-18T01:50:09.506 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-18T01:50:09.506 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-18T01:50:09.514 DEBUG:teuthology.orchestra.run.smithi129:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-18T01:50:09.598 DEBUG:teuthology.orchestra.run.smithi146:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-18T01:50:09.661 DEBUG:teuthology.orchestra.run.smithi129:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-18T01:50:09.688 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T01:50:09.688 DEBUG:teuthology.orchestra.run.smithi146:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-18T01:50:09.715 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T01:50:09.715 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-18T01:50:09.725 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-18T01:50:09.735 INFO:teuthology.task.internal:Duration was 731.237101 seconds 2024-09-18T01:50:09.736 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-18T01:50:09.745 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-18T01:50:09.745 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-18T01:50:09.748 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-18T01:50:09.784 INFO:teuthology.orchestra.run.smithi129.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-18T01:50:09.794 INFO:teuthology.orchestra.run.smithi146.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-18T01:50:10.164 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-18T01:50:10.164 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi129.front.sepia.ceph.com 2024-09-18T01:50:10.164 DEBUG:teuthology.orchestra.run.smithi129:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-18T01:50:10.224 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi146.front.sepia.ceph.com 2024-09-18T01:50:10.224 DEBUG:teuthology.orchestra.run.smithi146:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-18T01:50:10.247 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-18T01:50:10.247 DEBUG:teuthology.orchestra.run.smithi129:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-18T01:50:10.266 DEBUG:teuthology.orchestra.run.smithi146:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-18T01:50:10.314 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-18T01:50:10.314 DEBUG:teuthology.orchestra.run.smithi129:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-18T01:50:10.332 DEBUG:teuthology.orchestra.run.smithi146:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-18T01:50:10.452 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-18T01:50:10.464 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-18T01:50:10.464 DEBUG:teuthology.orchestra.run.smithi129:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-18T01:50:10.490 DEBUG:teuthology.orchestra.run.smithi146:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-18T01:50:10.515 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-18T01:50:10.524 DEBUG:teuthology.orchestra.run.smithi129:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-18T01:50:10.532 DEBUG:teuthology.orchestra.run.smithi146:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-18T01:50:10.553 INFO:teuthology.orchestra.run.smithi129.stdout:kernel.core_pattern = core 2024-09-18T01:50:10.578 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern = core 2024-09-18T01:50:10.616 DEBUG:teuthology.orchestra.run.smithi129:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-18T01:50:10.649 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T01:50:10.650 DEBUG:teuthology.orchestra.run.smithi146:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-18T01:50:10.669 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T01:50:10.670 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-18T01:50:10.682 INFO:teuthology.task.internal:Transferring archived files... 2024-09-18T01:50:10.683 DEBUG:teuthology.misc:Transferring archived files from smithi129:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-17_21:40:02-rgw-squid-distro-default-smithi/7909748/remote/smithi129 2024-09-18T01:50:10.683 DEBUG:teuthology.orchestra.run.smithi129:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-18T01:50:10.723 DEBUG:teuthology.misc:Transferring archived files from smithi146:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-17_21:40:02-rgw-squid-distro-default-smithi/7909748/remote/smithi146 2024-09-18T01:50:10.723 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-18T01:50:10.758 INFO:teuthology.task.internal:Removing archive directory... 2024-09-18T01:50:10.759 DEBUG:teuthology.orchestra.run.smithi129:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-18T01:50:10.762 DEBUG:teuthology.orchestra.run.smithi146:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-18T01:50:10.807 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-18T01:50:10.828 INFO:teuthology.task.internal:Not uploading archives. 2024-09-18T01:50:10.829 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-18T01:50:10.839 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-18T01:50:10.839 DEBUG:teuthology.orchestra.run.smithi129:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-18T01:50:10.842 DEBUG:teuthology.orchestra.run.smithi146:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-18T01:50:10.854 INFO:teuthology.orchestra.run.smithi129.stdout: 266063 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 18 01:50 /home/ubuntu/cephtest 2024-09-18T01:50:10.862 INFO:teuthology.orchestra.run.smithi146.stdout: 265593 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 18 01:50 /home/ubuntu/cephtest 2024-09-18T01:50:10.863 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-18T01:50:10.873 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-18T01:50:10.898 INFO:teuthology.run:Summary data: description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{centos_latest}} duration: 731.237101316452 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-18T01:50:10.898 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-18T01:50:10.981 INFO:teuthology.run:pass